2024-08-18T22:27:44.714 INFO:root:teuthology version: 1.2.0 2024-08-18T22:27:44.755 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-08-18T22:27:44.863 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/teuthology-2024-08-18_21:24:02-fs-squid-distro-default-smithi/7859944 branch: squid description: fs/upgrade/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} email: ceph-qa@ceph.com first_in_suite: false job_id: '7859944' kernel: kdb: 1 sha1: distro last_in_suite: false machine_type: smithi meta: - desc: 'setup ceph/quincy ' name: teuthology-2024-08-18_21:24:02-fs-squid-distro-default-smithi no_nested_subset: false os_type: centos os_version: 9.stream overrides: admin_socket: branch: squid ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: mon pg warn min per osd: 0 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 mon warn on pool no app: false osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - OSD_DOWN - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - MON_DOWN - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy sha1: de09dd018de4baddfa6ca4d43bc8fb784cf75833 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: de09dd018de4baddfa6ca4d43bc8fb784cf75833 kclient: syntax: v1 selinux: allowlist: - scontext=system_u:system_r:logrotate_t:s0 - scontext=system_u:system_r:getty_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: squid sha1: 78215f5a1cf5eaf321d506a66539942e12851f34 owner: scheduled_teuthology@teuthology priority: 100 repo: https://git.ceph.com/ceph.git roles: - - host.a - client.0 - osd.0 - osd.1 - osd.2 - - host.b - client.1 - osd.3 - osd.4 - osd.5 seed: 1664 sha1: de09dd018de4baddfa6ca4d43bc8fb784cf75833 sleep_before_teardown: 0 subset: 36/512 suite: fs suite_branch: squid suite_path: /home/teuthworker/src/git.ceph.com_ceph_78215f5a1cf5eaf321d506a66539942e12851f34/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph.git suite_sha1: 78215f5a1cf5eaf321d506a66539942e12851f34 targets: smithi121.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDaQhmVtOdifHiWnwzJvWAERJSFGZKuMyxDpqMYWTPPwao/yhZe6X7gm+EiK/70DE5BCpUBuD3IfTd7EHSx5Ljc= smithi195.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIKAJ53MVOrSQi3aWgQL0o/4GDgIVh7FPeWJhLfmjWejQAU85ifutcP1scYJGwa/9WDmsrP5WWbUtz1tELxSmV8= tasks: - install: branch: quincy exclude_packages: - ceph-volume - print: '**** done install task...' - cephadm: cephadm_branch: quincy cephadm_git_url: https://github.com/ceph/ceph conf: osd: osd_class_default_list: '*' osd_class_load_list: '*' image: quay.ceph.io/ceph-ci/ceph:quincy roleless: true - print: '**** done end installing quincy cephadm ...' - cephadm.shell: host.a: - ceph config set mgr mgr/cephadm/use_repo_digest true --force - print: '**** done cephadm.shell ceph config set mgr...' - cephadm.shell: host.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: host.a: - ceph fs volume create cephfs --placement=4 - ceph fs dump - cephadm.shell: host.a: - ceph fs set cephfs max_mds 2 - cephadm.shell: host.a: - ceph fs set cephfs allow_standby_replay false - cephadm.shell: host.a: - ceph fs set cephfs inline_data false - cephadm.shell: host.a: - ceph fs dump - ceph --format=json fs dump | jq -e ".filesystems | length == 1" - while ! ceph --format=json mds versions | jq -e ". | add == 4"; do sleep 1; done - fs.pre_upgrade_save: null - ceph-fuse: null - print: '**** done client' - parallel: - upgrade-tasks - workload-tasks - cephadm.shell: host.a: - ceph fs dump - fs.post_upgrade_checks: null teuthology: fragments_dropped: - /home/teuthology/src/git.ceph.com_ceph_squid/qa/suites/fs/upgrade/mds_upgrade_sequence/tasks/3-upgrade-mgr-staggered.yaml meta: {} postmerge: [] variables: fail_fs: false teuthology_branch: main teuthology_sha1: 67db276914d29505c9707d04f3a3b8fb9d8aee4b timestamp: 2024-08-18_21:24:02 tube: smithi upgrade-tasks: sequential: - cephadm.shell: env: - sha1 host.a: - ceph config set mgr mgr/orchestrator/fail_fs false || true - cephadm.shell: env: - sha1 host.a: - ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force - ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force - ceph config set global log_to_journald false --force - ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1 - cephadm.shell: env: - sha1 host.a: - while ceph orch upgrade status | jq '.in_progress' | grep true && ! ceph orch upgrade status | jq '.message' | grep Error ; do ceph orch ps ; ceph versions ; ceph fs dump; ceph orch upgrade status ; ceph health detail ; sleep 30 ; done - ceph orch ps - ceph orch upgrade status - ceph health detail - ceph versions - echo "wait for servicemap items w/ changing names to refresh" - sleep 60 - ceph orch ps - ceph versions - ceph versions | jq -e '.overall | length == 1' - ceph versions | jq -e '.overall | keys' | grep $sha1 user: teuthology verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 workload-tasks: sequential: - workunit: clients: all: - suites/fsstress.sh 2024-08-18T22:27:44.864 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph_78215f5a1cf5eaf321d506a66539942e12851f34/qa; will attempt to use it 2024-08-18T22:27:44.865 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph_78215f5a1cf5eaf321d506a66539942e12851f34/qa/tasks 2024-08-18T22:27:44.865 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-08-18T22:27:45.279 INFO:teuthology.task.internal:Checking packages... 2024-08-18T22:27:45.304 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'de09dd018de4baddfa6ca4d43bc8fb784cf75833' 2024-08-18T22:27:45.304 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-08-18T22:27:45.305 INFO:teuthology.packaging:ref: None 2024-08-18T22:27:45.305 INFO:teuthology.packaging:tag: None 2024-08-18T22:27:45.305 INFO:teuthology.packaging:branch: squid 2024-08-18T22:27:45.305 INFO:teuthology.packaging:sha1: de09dd018de4baddfa6ca4d43bc8fb784cf75833 2024-08-18T22:27:45.306 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=squid 2024-08-18T22:27:45.533 INFO:teuthology.task.internal:Found packages for ceph version 19.1.0-1386.g78215f5a 2024-08-18T22:27:45.534 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-08-18T22:27:45.737 INFO:teuthology.task.internal:no buildpackages task found 2024-08-18T22:27:45.737 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-08-18T22:27:45.819 INFO:teuthology.task.internal:Saving configuration 2024-08-18T22:27:45.839 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-08-18T22:27:45.846 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-08-18T22:27:45.868 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi121.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-08-18_21:24:02-fs-squid-distro-default-smithi/7859944', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-08-18 22:22:44.569407', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDaQhmVtOdifHiWnwzJvWAERJSFGZKuMyxDpqMYWTPPwao/yhZe6X7gm+EiK/70DE5BCpUBuD3IfTd7EHSx5Ljc='} 2024-08-18T22:27:45.884 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi195.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-08-18_21:24:02-fs-squid-distro-default-smithi/7859944', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-08-18 22:22:44.570890', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIKAJ53MVOrSQi3aWgQL0o/4GDgIVh7FPeWJhLfmjWejQAU85ifutcP1scYJGwa/9WDmsrP5WWbUtz1tELxSmV8='} 2024-08-18T22:27:45.884 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-08-18T22:27:45.890 INFO:teuthology.task.internal:roles: ubuntu@smithi121.front.sepia.ceph.com - ['host.a', 'client.0', 'osd.0', 'osd.1', 'osd.2'] 2024-08-18T22:27:45.890 INFO:teuthology.task.internal:roles: ubuntu@smithi195.front.sepia.ceph.com - ['host.b', 'client.1', 'osd.3', 'osd.4', 'osd.5'] 2024-08-18T22:27:45.890 INFO:teuthology.run_tasks:Running task console_log... 2024-08-18T22:27:46.003 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f8651567be0>, signals=[15]) 2024-08-18T22:27:46.003 INFO:teuthology.run_tasks:Running task internal.connect... 2024-08-18T22:27:46.008 INFO:teuthology.task.internal:Opening connections... 2024-08-18T22:27:46.008 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi121.front.sepia.ceph.com 2024-08-18T22:27:46.010 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi121.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-18T22:27:46.086 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi195.front.sepia.ceph.com 2024-08-18T22:27:46.086 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-18T22:27:46.160 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-08-18T22:27:46.166 DEBUG:teuthology.orchestra.run.smithi121:> uname -m 2024-08-18T22:27:46.184 INFO:teuthology.orchestra.run.smithi121.stdout:x86_64 2024-08-18T22:27:46.184 DEBUG:teuthology.orchestra.run.smithi121:> cat /etc/os-release 2024-08-18T22:27:46.242 INFO:teuthology.orchestra.run.smithi121.stdout:NAME="CentOS Stream" 2024-08-18T22:27:46.242 INFO:teuthology.orchestra.run.smithi121.stdout:VERSION="9" 2024-08-18T22:27:46.242 INFO:teuthology.orchestra.run.smithi121.stdout:ID="centos" 2024-08-18T22:27:46.242 INFO:teuthology.orchestra.run.smithi121.stdout:ID_LIKE="rhel fedora" 2024-08-18T22:27:46.242 INFO:teuthology.orchestra.run.smithi121.stdout:VERSION_ID="9" 2024-08-18T22:27:46.242 INFO:teuthology.orchestra.run.smithi121.stdout:PLATFORM_ID="platform:el9" 2024-08-18T22:27:46.242 INFO:teuthology.orchestra.run.smithi121.stdout:PRETTY_NAME="CentOS Stream 9" 2024-08-18T22:27:46.242 INFO:teuthology.orchestra.run.smithi121.stdout:ANSI_COLOR="0;31" 2024-08-18T22:27:46.242 INFO:teuthology.orchestra.run.smithi121.stdout:LOGO="fedora-logo-icon" 2024-08-18T22:27:46.243 INFO:teuthology.orchestra.run.smithi121.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-08-18T22:27:46.243 INFO:teuthology.orchestra.run.smithi121.stdout:HOME_URL="https://centos.org/" 2024-08-18T22:27:46.243 INFO:teuthology.orchestra.run.smithi121.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-08-18T22:27:46.243 INFO:teuthology.orchestra.run.smithi121.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-08-18T22:27:46.243 INFO:teuthology.orchestra.run.smithi121.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-08-18T22:27:46.243 INFO:teuthology.lock.ops:Updating smithi121.front.sepia.ceph.com on lock server 2024-08-18T22:27:46.263 DEBUG:teuthology.orchestra.run.smithi195:> uname -m 2024-08-18T22:27:46.282 INFO:teuthology.orchestra.run.smithi195.stdout:x86_64 2024-08-18T22:27:46.282 DEBUG:teuthology.orchestra.run.smithi195:> cat /etc/os-release 2024-08-18T22:27:46.340 INFO:teuthology.orchestra.run.smithi195.stdout:NAME="CentOS Stream" 2024-08-18T22:27:46.340 INFO:teuthology.orchestra.run.smithi195.stdout:VERSION="9" 2024-08-18T22:27:46.340 INFO:teuthology.orchestra.run.smithi195.stdout:ID="centos" 2024-08-18T22:27:46.341 INFO:teuthology.orchestra.run.smithi195.stdout:ID_LIKE="rhel fedora" 2024-08-18T22:27:46.341 INFO:teuthology.orchestra.run.smithi195.stdout:VERSION_ID="9" 2024-08-18T22:27:46.341 INFO:teuthology.orchestra.run.smithi195.stdout:PLATFORM_ID="platform:el9" 2024-08-18T22:27:46.341 INFO:teuthology.orchestra.run.smithi195.stdout:PRETTY_NAME="CentOS Stream 9" 2024-08-18T22:27:46.341 INFO:teuthology.orchestra.run.smithi195.stdout:ANSI_COLOR="0;31" 2024-08-18T22:27:46.341 INFO:teuthology.orchestra.run.smithi195.stdout:LOGO="fedora-logo-icon" 2024-08-18T22:27:46.341 INFO:teuthology.orchestra.run.smithi195.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-08-18T22:27:46.341 INFO:teuthology.orchestra.run.smithi195.stdout:HOME_URL="https://centos.org/" 2024-08-18T22:27:46.341 INFO:teuthology.orchestra.run.smithi195.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-08-18T22:27:46.341 INFO:teuthology.orchestra.run.smithi195.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-08-18T22:27:46.341 INFO:teuthology.orchestra.run.smithi195.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-08-18T22:27:46.342 INFO:teuthology.lock.ops:Updating smithi195.front.sepia.ceph.com on lock server 2024-08-18T22:27:46.363 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-08-18T22:27:46.372 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-08-18T22:27:46.378 INFO:teuthology.task.internal:Checking for old test directory... 2024-08-18T22:27:46.378 DEBUG:teuthology.orchestra.run.smithi121:> test '!' -e /home/ubuntu/cephtest 2024-08-18T22:27:46.380 DEBUG:teuthology.orchestra.run.smithi195:> test '!' -e /home/ubuntu/cephtest 2024-08-18T22:27:46.398 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-08-18T22:27:46.403 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-08-18T22:27:46.403 DEBUG:teuthology.orchestra.run.smithi121:> test -z $(ls -A /var/lib/ceph) 2024-08-18T22:27:46.436 DEBUG:teuthology.orchestra.run.smithi195:> test -z $(ls -A /var/lib/ceph) 2024-08-18T22:27:46.538 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-08-18T22:27:46.580 INFO:teuthology.run_tasks:Running task kernel... 2024-08-18T22:27:46.593 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-08-18T22:27:46.593 INFO:teuthology.task.kernel:config {'host.a': {'kdb': 1, 'sha1': 'distro'}, 'host.b': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-08-18T22:27:46.594 DEBUG:teuthology.orchestra.run.smithi121:> test -f /run/.containerenv -o -f /.dockerenv 2024-08-18T22:27:46.594 DEBUG:teuthology.orchestra.run.smithi195:> test -f /run/.containerenv -o -f /.dockerenv 2024-08-18T22:27:46.610 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-18T22:27:46.610 DEBUG:teuthology.orchestra.run.smithi121:> uname -r 2024-08-18T22:27:46.611 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-18T22:27:46.612 DEBUG:teuthology.orchestra.run.smithi195:> uname -r 2024-08-18T22:27:46.667 INFO:teuthology.orchestra.run.smithi121.stdout:5.14.0-480.el9.x86_64 2024-08-18T22:27:46.667 INFO:teuthology.task.kernel:Running kernel on smithi121: 5.14.0-480.el9.x86_64 2024-08-18T22:27:46.668 DEBUG:teuthology.orchestra.run.smithi121:> sudo yum install -y kernel 2024-08-18T22:27:46.670 INFO:teuthology.orchestra.run.smithi195.stdout:5.14.0-480.el9.x86_64 2024-08-18T22:27:46.671 INFO:teuthology.task.kernel:Running kernel on smithi195: 5.14.0-480.el9.x86_64 2024-08-18T22:27:46.671 DEBUG:teuthology.orchestra.run.smithi195:> sudo yum install -y kernel 2024-08-18T22:27:49.210 INFO:teuthology.orchestra.run.smithi121.stdout:CentOS Stream 9 - BaseOS 12 MB/s | 8.2 MB 00:00 2024-08-18T22:27:49.255 INFO:teuthology.orchestra.run.smithi195.stdout:CentOS Stream 9 - BaseOS 13 MB/s | 8.2 MB 00:00 2024-08-18T22:27:51.014 INFO:teuthology.orchestra.run.smithi195.stdout:CentOS Stream 9 - AppStream 30 MB/s | 20 MB 00:00 2024-08-18T22:27:53.286 INFO:teuthology.orchestra.run.smithi121.stdout:CentOS Stream 9 - AppStream 6.7 MB/s | 20 MB 00:02 2024-08-18T22:27:56.607 INFO:teuthology.orchestra.run.smithi195.stdout:CentOS Stream 9 - CRB 3.5 MB/s | 6.6 MB 00:01 2024-08-18T22:27:57.703 INFO:teuthology.orchestra.run.smithi121.stdout:CentOS Stream 9 - CRB 9.4 MB/s | 6.6 MB 00:00 2024-08-18T22:27:58.106 INFO:teuthology.orchestra.run.smithi195.stdout:CentOS Stream 9 - Extras packages 64 kB/s | 18 kB 00:00 2024-08-18T22:27:59.411 INFO:teuthology.orchestra.run.smithi195.stdout:Extra Packages for Enterprise Linux 19 MB/s | 22 MB 00:01 2024-08-18T22:27:59.461 INFO:teuthology.orchestra.run.smithi121.stdout:CentOS Stream 9 - Extras packages 43 kB/s | 18 kB 00:00 2024-08-18T22:28:00.549 INFO:teuthology.orchestra.run.smithi121.stdout:Extra Packages for Enterprise Linux 23 MB/s | 22 MB 00:00 2024-08-18T22:28:04.842 INFO:teuthology.orchestra.run.smithi195.stdout:lab-extras 22 kB/s | 1.7 kB 00:00 2024-08-18T22:28:05.887 INFO:teuthology.orchestra.run.smithi121.stdout:lab-extras 31 kB/s | 1.7 kB 00:00 2024-08-18T22:28:06.781 INFO:teuthology.orchestra.run.smithi195.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-08-18T22:28:06.782 INFO:teuthology.orchestra.run.smithi195.stdout:Package kernel-5.14.0-480.el9.x86_64 is already installed. 2024-08-18T22:28:06.868 INFO:teuthology.orchestra.run.smithi195.stdout:Dependencies resolved. 2024-08-18T22:28:06.869 INFO:teuthology.orchestra.run.smithi195.stdout:Nothing to do. 2024-08-18T22:28:06.869 INFO:teuthology.orchestra.run.smithi195.stdout:Complete! 2024-08-18T22:28:06.966 DEBUG:teuthology.orchestra.run.smithi195:> echo no | sudo yum reinstall kernel || true 2024-08-18T22:28:07.490 INFO:teuthology.orchestra.run.smithi195.stdout:Last metadata expiration check: 0:00:03 ago on Sun 18 Aug 2024 10:28:04 PM UTC. 2024-08-18T22:28:07.631 INFO:teuthology.orchestra.run.smithi195.stdout:Dependencies resolved. 2024-08-18T22:28:07.636 INFO:teuthology.orchestra.run.smithi195.stdout:================================================================================ 2024-08-18T22:28:07.636 INFO:teuthology.orchestra.run.smithi195.stdout: Package Architecture Version Repository Size 2024-08-18T22:28:07.636 INFO:teuthology.orchestra.run.smithi195.stdout:================================================================================ 2024-08-18T22:28:07.636 INFO:teuthology.orchestra.run.smithi195.stdout:Reinstalling: 2024-08-18T22:28:07.636 INFO:teuthology.orchestra.run.smithi195.stdout: kernel x86_64 5.14.0-480.el9 baseos 1.5 M 2024-08-18T22:28:07.636 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-08-18T22:28:07.636 INFO:teuthology.orchestra.run.smithi195.stdout:Transaction Summary 2024-08-18T22:28:07.636 INFO:teuthology.orchestra.run.smithi195.stdout:================================================================================ 2024-08-18T22:28:07.636 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-08-18T22:28:07.636 INFO:teuthology.orchestra.run.smithi195.stdout:Total download size: 1.5 M 2024-08-18T22:28:07.636 INFO:teuthology.orchestra.run.smithi195.stdout:Installed size: 0 2024-08-18T22:28:07.637 INFO:teuthology.orchestra.run.smithi195.stderr:Operation aborted. 2024-08-18T22:28:07.704 INFO:teuthology.orchestra.run.smithi195.stdout:Is this ok [y/N]: 2024-08-18T22:28:07.705 DEBUG:teuthology.orchestra.run.smithi195:> sudo yum reinstall -y kernel || true 2024-08-18T22:28:07.802 INFO:teuthology.orchestra.run.smithi121.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-08-18T22:28:07.802 INFO:teuthology.orchestra.run.smithi121.stdout:Package kernel-5.14.0-480.el9.x86_64 is already installed. 2024-08-18T22:28:07.874 INFO:teuthology.orchestra.run.smithi121.stdout:Dependencies resolved. 2024-08-18T22:28:07.875 INFO:teuthology.orchestra.run.smithi121.stdout:Nothing to do. 2024-08-18T22:28:07.875 INFO:teuthology.orchestra.run.smithi121.stdout:Complete! 2024-08-18T22:28:07.972 DEBUG:teuthology.orchestra.run.smithi121:> echo no | sudo yum reinstall kernel || true 2024-08-18T22:28:08.221 INFO:teuthology.orchestra.run.smithi195.stdout:Last metadata expiration check: 0:00:04 ago on Sun 18 Aug 2024 10:28:04 PM UTC. 2024-08-18T22:28:08.343 INFO:teuthology.orchestra.run.smithi195.stdout:Dependencies resolved. 2024-08-18T22:28:08.344 INFO:teuthology.orchestra.run.smithi195.stdout:================================================================================ 2024-08-18T22:28:08.344 INFO:teuthology.orchestra.run.smithi195.stdout: Package Architecture Version Repository Size 2024-08-18T22:28:08.344 INFO:teuthology.orchestra.run.smithi195.stdout:================================================================================ 2024-08-18T22:28:08.344 INFO:teuthology.orchestra.run.smithi195.stdout:Reinstalling: 2024-08-18T22:28:08.344 INFO:teuthology.orchestra.run.smithi195.stdout: kernel x86_64 5.14.0-480.el9 baseos 1.5 M 2024-08-18T22:28:08.344 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-08-18T22:28:08.344 INFO:teuthology.orchestra.run.smithi195.stdout:Transaction Summary 2024-08-18T22:28:08.344 INFO:teuthology.orchestra.run.smithi195.stdout:================================================================================ 2024-08-18T22:28:08.344 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-08-18T22:28:08.345 INFO:teuthology.orchestra.run.smithi195.stdout:Total download size: 1.5 M 2024-08-18T22:28:08.345 INFO:teuthology.orchestra.run.smithi195.stdout:Installed size: 0 2024-08-18T22:28:08.345 INFO:teuthology.orchestra.run.smithi195.stdout:Downloading Packages: 2024-08-18T22:28:08.487 INFO:teuthology.orchestra.run.smithi121.stdout:Last metadata expiration check: 0:00:03 ago on Sun 18 Aug 2024 10:28:05 PM UTC. 2024-08-18T22:28:08.624 INFO:teuthology.orchestra.run.smithi121.stdout:Dependencies resolved. 2024-08-18T22:28:08.635 INFO:teuthology.orchestra.run.smithi121.stdout:================================================================================ 2024-08-18T22:28:08.636 INFO:teuthology.orchestra.run.smithi121.stdout: Package Architecture Version Repository Size 2024-08-18T22:28:08.636 INFO:teuthology.orchestra.run.smithi121.stdout:================================================================================ 2024-08-18T22:28:08.636 INFO:teuthology.orchestra.run.smithi121.stdout:Reinstalling: 2024-08-18T22:28:08.636 INFO:teuthology.orchestra.run.smithi121.stdout: kernel x86_64 5.14.0-480.el9 baseos 1.5 M 2024-08-18T22:28:08.636 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-08-18T22:28:08.636 INFO:teuthology.orchestra.run.smithi121.stdout:Transaction Summary 2024-08-18T22:28:08.636 INFO:teuthology.orchestra.run.smithi121.stdout:================================================================================ 2024-08-18T22:28:08.636 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-08-18T22:28:08.636 INFO:teuthology.orchestra.run.smithi121.stdout:Total download size: 1.5 M 2024-08-18T22:28:08.636 INFO:teuthology.orchestra.run.smithi121.stdout:Installed size: 0 2024-08-18T22:28:08.636 INFO:teuthology.orchestra.run.smithi121.stderr:Operation aborted. 2024-08-18T22:28:08.697 INFO:teuthology.orchestra.run.smithi121.stdout:Is this ok [y/N]: 2024-08-18T22:28:08.697 DEBUG:teuthology.orchestra.run.smithi121:> sudo yum reinstall -y kernel || true 2024-08-18T22:28:08.744 INFO:teuthology.orchestra.run.smithi195.stdout:kernel-5.14.0-480.el9.x86_64.rpm 5.1 MB/s | 1.5 MB 00:00 2024-08-18T22:28:08.744 INFO:teuthology.orchestra.run.smithi195.stdout:-------------------------------------------------------------------------------- 2024-08-18T22:28:08.744 INFO:teuthology.orchestra.run.smithi195.stdout:Total 3.8 MB/s | 1.5 MB 00:00 2024-08-18T22:28:08.776 INFO:teuthology.orchestra.run.smithi195.stdout:Running transaction check 2024-08-18T22:28:09.014 INFO:teuthology.orchestra.run.smithi195.stdout:Transaction check succeeded. 2024-08-18T22:28:09.014 INFO:teuthology.orchestra.run.smithi195.stdout:Running transaction test 2024-08-18T22:28:09.039 INFO:teuthology.orchestra.run.smithi195.stdout:Transaction test succeeded. 2024-08-18T22:28:09.040 INFO:teuthology.orchestra.run.smithi195.stdout:Running transaction 2024-08-18T22:28:09.185 INFO:teuthology.orchestra.run.smithi195.stdout: Preparing : 1/1 2024-08-18T22:28:09.207 INFO:teuthology.orchestra.run.smithi121.stdout:Last metadata expiration check: 0:00:04 ago on Sun 18 Aug 2024 10:28:05 PM UTC. 2024-08-18T22:28:09.279 INFO:teuthology.orchestra.run.smithi195.stdout: Reinstalling : kernel-5.14.0-480.el9.x86_64 1/2 2024-08-18T22:28:09.279 INFO:teuthology.orchestra.run.smithi195.stdout: Cleanup : kernel-5.14.0-480.el9.x86_64 2/2 2024-08-18T22:28:09.327 INFO:teuthology.orchestra.run.smithi121.stdout:Dependencies resolved. 2024-08-18T22:28:09.328 INFO:teuthology.orchestra.run.smithi121.stdout:================================================================================ 2024-08-18T22:28:09.328 INFO:teuthology.orchestra.run.smithi121.stdout: Package Architecture Version Repository Size 2024-08-18T22:28:09.328 INFO:teuthology.orchestra.run.smithi121.stdout:================================================================================ 2024-08-18T22:28:09.328 INFO:teuthology.orchestra.run.smithi121.stdout:Reinstalling: 2024-08-18T22:28:09.328 INFO:teuthology.orchestra.run.smithi121.stdout: kernel x86_64 5.14.0-480.el9 baseos 1.5 M 2024-08-18T22:28:09.328 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-08-18T22:28:09.329 INFO:teuthology.orchestra.run.smithi121.stdout:Transaction Summary 2024-08-18T22:28:09.329 INFO:teuthology.orchestra.run.smithi121.stdout:================================================================================ 2024-08-18T22:28:09.329 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-08-18T22:28:09.329 INFO:teuthology.orchestra.run.smithi121.stdout:Total download size: 1.5 M 2024-08-18T22:28:09.329 INFO:teuthology.orchestra.run.smithi121.stdout:Installed size: 0 2024-08-18T22:28:09.329 INFO:teuthology.orchestra.run.smithi121.stdout:Downloading Packages: 2024-08-18T22:28:10.002 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: kernel-5.14.0-480.el9.x86_64 2/2 2024-08-18T22:28:10.002 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : kernel-5.14.0-480.el9.x86_64 1/2 2024-08-18T22:28:10.123 INFO:teuthology.orchestra.run.smithi121.stdout:kernel-5.14.0-480.el9.x86_64.rpm 2.8 MB/s | 1.5 MB 00:00 2024-08-18T22:28:10.123 INFO:teuthology.orchestra.run.smithi121.stdout:-------------------------------------------------------------------------------- 2024-08-18T22:28:10.123 INFO:teuthology.orchestra.run.smithi121.stdout:Total 1.9 MB/s | 1.5 MB 00:00 2024-08-18T22:28:10.152 INFO:teuthology.orchestra.run.smithi121.stdout:Running transaction check 2024-08-18T22:28:10.401 INFO:teuthology.orchestra.run.smithi121.stdout:Transaction check succeeded. 2024-08-18T22:28:10.401 INFO:teuthology.orchestra.run.smithi121.stdout:Running transaction test 2024-08-18T22:28:10.425 INFO:teuthology.orchestra.run.smithi121.stdout:Transaction test succeeded. 2024-08-18T22:28:10.425 INFO:teuthology.orchestra.run.smithi121.stdout:Running transaction 2024-08-18T22:28:10.566 INFO:teuthology.orchestra.run.smithi121.stdout: Preparing : 1/1 2024-08-18T22:28:10.674 INFO:teuthology.orchestra.run.smithi121.stdout: Reinstalling : kernel-5.14.0-480.el9.x86_64 1/2 2024-08-18T22:28:10.674 INFO:teuthology.orchestra.run.smithi121.stdout: Cleanup : kernel-5.14.0-480.el9.x86_64 2/2 2024-08-18T22:28:10.817 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : kernel-5.14.0-480.el9.x86_64 2/2 2024-08-18T22:28:10.817 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-08-18T22:28:10.817 INFO:teuthology.orchestra.run.smithi195.stdout:Reinstalled: 2024-08-18T22:28:10.817 INFO:teuthology.orchestra.run.smithi195.stdout: kernel-5.14.0-480.el9.x86_64 2024-08-18T22:28:10.817 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-08-18T22:28:10.818 INFO:teuthology.orchestra.run.smithi195.stdout:Complete! 2024-08-18T22:28:11.012 DEBUG:teuthology.orchestra.run.smithi195:> rpm -q kernel | sort -rV | head -n 1 2024-08-18T22:28:11.088 INFO:teuthology.orchestra.run.smithi195.stdout:kernel-5.14.0-480.el9.x86_64 2024-08-18T22:28:11.089 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-480.el9.x86_64 2024-08-18T22:28:11.089 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2024-08-18T22:28:11.089 INFO:teuthology.task.kernel:Enabling kdb on host.b... 2024-08-18T22:28:11.089 DEBUG:teuthology.orchestra.run.smithi195:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-08-18T22:28:11.135 INFO:teuthology.orchestra.run.smithi195.stdout:ttyS1 2024-08-18T22:28:11.158 DEBUG:teuthology.parallel:result is None 2024-08-18T22:28:11.501 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: kernel-5.14.0-480.el9.x86_64 2/2 2024-08-18T22:28:11.501 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : kernel-5.14.0-480.el9.x86_64 1/2 2024-08-18T22:28:12.260 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : kernel-5.14.0-480.el9.x86_64 2/2 2024-08-18T22:28:12.261 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-08-18T22:28:12.261 INFO:teuthology.orchestra.run.smithi121.stdout:Reinstalled: 2024-08-18T22:28:12.261 INFO:teuthology.orchestra.run.smithi121.stdout: kernel-5.14.0-480.el9.x86_64 2024-08-18T22:28:12.261 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-08-18T22:28:12.261 INFO:teuthology.orchestra.run.smithi121.stdout:Complete! 2024-08-18T22:28:12.429 DEBUG:teuthology.orchestra.run.smithi121:> rpm -q kernel | sort -rV | head -n 1 2024-08-18T22:28:12.485 INFO:teuthology.orchestra.run.smithi121.stdout:kernel-5.14.0-480.el9.x86_64 2024-08-18T22:28:12.485 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-480.el9.x86_64 2024-08-18T22:28:12.485 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2024-08-18T22:28:12.485 INFO:teuthology.task.kernel:Enabling kdb on host.a... 2024-08-18T22:28:12.485 DEBUG:teuthology.orchestra.run.smithi121:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-08-18T22:28:12.521 INFO:teuthology.orchestra.run.smithi121.stdout:ttyS1 2024-08-18T22:28:12.544 DEBUG:teuthology.parallel:result is None 2024-08-18T22:28:12.544 INFO:teuthology.run_tasks:Running task internal.base... 2024-08-18T22:28:12.550 INFO:teuthology.task.internal:Creating test directory... 2024-08-18T22:28:12.551 DEBUG:teuthology.orchestra.run.smithi121:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-08-18T22:28:12.587 DEBUG:teuthology.orchestra.run.smithi195:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-08-18T22:28:12.606 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-08-18T22:28:12.612 INFO:teuthology.run_tasks:Running task internal.archive... 2024-08-18T22:28:12.617 INFO:teuthology.task.internal:Creating archive directory... 2024-08-18T22:28:12.618 DEBUG:teuthology.orchestra.run.smithi121:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-08-18T22:28:12.643 DEBUG:teuthology.orchestra.run.smithi195:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-08-18T22:28:12.673 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-08-18T22:28:12.679 INFO:teuthology.task.internal:Enabling coredump saving... 2024-08-18T22:28:12.680 DEBUG:teuthology.orchestra.run.smithi121:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-08-18T22:28:12.708 DEBUG:teuthology.orchestra.run.smithi195:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-08-18T22:28:12.739 INFO:teuthology.orchestra.run.smithi195.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-08-18T22:28:12.740 INFO:teuthology.orchestra.run.smithi121.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-08-18T22:28:12.750 INFO:teuthology.orchestra.run.smithi121.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-08-18T22:28:12.750 INFO:teuthology.orchestra.run.smithi195.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-08-18T22:28:12.752 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-08-18T22:28:12.758 INFO:teuthology.task.internal:Configuring sudo... 2024-08-18T22:28:12.759 DEBUG:teuthology.orchestra.run.smithi121:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-08-18T22:28:12.794 DEBUG:teuthology.orchestra.run.smithi195:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-08-18T22:28:12.821 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-08-18T22:28:12.831 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-08-18T22:28:12.832 DEBUG:teuthology.orchestra.run.smithi121:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-08-18T22:28:12.860 DEBUG:teuthology.orchestra.run.smithi195:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-08-18T22:28:12.877 DEBUG:teuthology.orchestra.run.smithi121:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-08-18T22:28:12.953 DEBUG:teuthology.orchestra.run.smithi121:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-08-18T22:28:13.014 DEBUG:teuthology.orchestra.run.smithi121:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-08-18T22:28:13.056 DEBUG:teuthology.orchestra.run.smithi121:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-08-18T22:28:13.096 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-08-18T22:28:13.096 DEBUG:teuthology.orchestra.run.smithi121:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-08-18T22:28:13.161 DEBUG:teuthology.orchestra.run.smithi195:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-08-18T22:28:13.204 DEBUG:teuthology.orchestra.run.smithi195:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-08-18T22:28:13.251 DEBUG:teuthology.orchestra.run.smithi195:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-08-18T22:28:13.335 DEBUG:teuthology.orchestra.run.smithi195:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-08-18T22:28:13.377 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-08-18T22:28:13.377 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-08-18T22:28:13.444 DEBUG:teuthology.orchestra.run.smithi121:> sudo service rsyslog restart 2024-08-18T22:28:13.446 DEBUG:teuthology.orchestra.run.smithi195:> sudo service rsyslog restart 2024-08-18T22:28:13.492 INFO:teuthology.orchestra.run.smithi121.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-08-18T22:28:13.531 INFO:teuthology.orchestra.run.smithi195.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-08-18T22:28:13.947 INFO:teuthology.run_tasks:Running task internal.timer... 2024-08-18T22:28:13.954 INFO:teuthology.task.internal:Starting timer... 2024-08-18T22:28:13.954 INFO:teuthology.run_tasks:Running task pcp... 2024-08-18T22:28:13.969 INFO:teuthology.run_tasks:Running task selinux... 2024-08-18T22:28:13.978 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:logrotate_t:s0', 'scontext=system_u:system_r:getty_t:s0']} 2024-08-18T22:28:13.978 DEBUG:teuthology.orchestra.run.smithi121:> sudo service auditd rotate 2024-08-18T22:28:14.036 INFO:teuthology.orchestra.run.smithi121.stdout:Rotating logs: 2024-08-18T22:28:14.038 DEBUG:teuthology.orchestra.run.smithi195:> sudo service auditd rotate 2024-08-18T22:28:14.120 INFO:teuthology.orchestra.run.smithi195.stdout:Rotating logs: 2024-08-18T22:28:14.122 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-08-18T22:28:14.122 DEBUG:teuthology.orchestra.run.smithi121:> /usr/sbin/getenforce 2024-08-18T22:28:14.151 INFO:teuthology.orchestra.run.smithi121.stdout:Permissive 2024-08-18T22:28:14.151 DEBUG:teuthology.orchestra.run.smithi195:> /usr/sbin/getenforce 2024-08-18T22:28:14.175 INFO:teuthology.orchestra.run.smithi195.stdout:Permissive 2024-08-18T22:28:14.175 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi121.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi195.front.sepia.ceph.com': 'permissive'} 2024-08-18T22:28:14.175 DEBUG:teuthology.orchestra.run.smithi121:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-08-18T22:28:14.217 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-18T22:28:14.218 DEBUG:teuthology.orchestra.run.smithi195:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-08-18T22:28:14.244 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-18T22:28:14.245 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-08-18T22:28:14.245 DEBUG:teuthology.orchestra.run.smithi121:> sudo /usr/sbin/setenforce permissive 2024-08-18T22:28:14.305 DEBUG:teuthology.orchestra.run.smithi195:> sudo /usr/sbin/setenforce permissive 2024-08-18T22:28:14.331 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-08-18T22:28:14.341 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-08-18T22:28:14.352 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-08-18T22:28:14.353 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi121.front.sepia.ceph.com,smithi195.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-08-18T22:29:57.796 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi121.front.sepia.ceph.com'), Remote(name='ubuntu@smithi195.front.sepia.ceph.com')] 2024-08-18T22:29:57.798 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi121.front.sepia.ceph.com' 2024-08-18T22:29:57.799 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi121.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-18T22:29:57.880 DEBUG:teuthology.orchestra.run.smithi121:> true 2024-08-18T22:29:57.958 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi121.front.sepia.ceph.com' 2024-08-18T22:29:57.961 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi195.front.sepia.ceph.com' 2024-08-18T22:29:57.962 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-18T22:29:58.034 DEBUG:teuthology.orchestra.run.smithi195:> true 2024-08-18T22:29:58.109 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi195.front.sepia.ceph.com' 2024-08-18T22:29:58.109 INFO:teuthology.run_tasks:Running task clock... 2024-08-18T22:29:58.119 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-08-18T22:29:58.120 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-08-18T22:29:58.120 DEBUG:teuthology.orchestra.run.smithi121:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-08-18T22:29:58.122 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-08-18T22:29:58.122 DEBUG:teuthology.orchestra.run.smithi195:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-08-18T22:29:58.150 INFO:teuthology.orchestra.run.smithi121.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-08-18T22:29:58.164 INFO:teuthology.orchestra.run.smithi121.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-08-18T22:29:58.178 INFO:teuthology.orchestra.run.smithi195.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-08-18T22:29:58.189 INFO:teuthology.orchestra.run.smithi121.stderr:sudo: ntpd: command not found 2024-08-18T22:29:58.192 INFO:teuthology.orchestra.run.smithi195.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-08-18T22:29:58.200 INFO:teuthology.orchestra.run.smithi121.stdout:506 Cannot talk to daemon 2024-08-18T22:29:58.214 INFO:teuthology.orchestra.run.smithi121.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-08-18T22:29:58.216 INFO:teuthology.orchestra.run.smithi195.stderr:sudo: ntpd: command not found 2024-08-18T22:29:58.228 INFO:teuthology.orchestra.run.smithi121.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-08-18T22:29:58.228 INFO:teuthology.orchestra.run.smithi195.stdout:506 Cannot talk to daemon 2024-08-18T22:29:58.242 INFO:teuthology.orchestra.run.smithi195.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-08-18T22:29:58.256 INFO:teuthology.orchestra.run.smithi195.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-08-18T22:29:58.286 INFO:teuthology.orchestra.run.smithi121.stderr:bash: line 1: ntpq: command not found 2024-08-18T22:29:58.289 INFO:teuthology.orchestra.run.smithi121.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-08-18T22:29:58.289 INFO:teuthology.orchestra.run.smithi121.stdout:=============================================================================== 2024-08-18T22:29:58.289 INFO:teuthology.orchestra.run.smithi121.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-18T22:29:58.289 INFO:teuthology.orchestra.run.smithi121.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-18T22:29:58.289 INFO:teuthology.orchestra.run.smithi121.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-18T22:29:58.289 INFO:teuthology.orchestra.run.smithi121.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-18T22:29:58.320 INFO:teuthology.orchestra.run.smithi195.stderr:bash: line 1: ntpq: command not found 2024-08-18T22:29:58.323 INFO:teuthology.orchestra.run.smithi195.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-08-18T22:29:58.324 INFO:teuthology.orchestra.run.smithi195.stdout:=============================================================================== 2024-08-18T22:29:58.324 INFO:teuthology.orchestra.run.smithi195.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-18T22:29:58.324 INFO:teuthology.orchestra.run.smithi195.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-18T22:29:58.324 INFO:teuthology.orchestra.run.smithi195.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-18T22:29:58.324 INFO:teuthology.orchestra.run.smithi195.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-18T22:29:58.324 INFO:teuthology.run_tasks:Running task install... 2024-08-18T22:29:58.332 DEBUG:teuthology.task.install:project ceph 2024-08-18T22:29:58.332 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'de09dd018de4baddfa6ca4d43bc8fb784cf75833'}} 2024-08-18T22:29:58.332 DEBUG:teuthology.task.install:config {'branch': 'quincy', 'exclude_packages': ['ceph-volume'], 'flavor': 'default', 'sha1': 'de09dd018de4baddfa6ca4d43bc8fb784cf75833'} 2024-08-18T22:29:58.332 INFO:teuthology.task.install:Using flavor: default 2024-08-18T22:29:58.338 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-08-18T22:29:58.338 INFO:teuthology.task.install:extra packages: [] 2024-08-18T22:29:58.339 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': 'quincy', 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': ['ceph-volume'], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'de09dd018de4baddfa6ca4d43bc8fb784cf75833', 'tag': None, 'wait_for_package': False} 2024-08-18T22:29:58.339 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-08-18T22:29:58.339 INFO:teuthology.packaging:ref: None 2024-08-18T22:29:58.339 INFO:teuthology.packaging:tag: None 2024-08-18T22:29:58.339 INFO:teuthology.packaging:branch: quincy 2024-08-18T22:29:58.339 INFO:teuthology.packaging:sha1: de09dd018de4baddfa6ca4d43bc8fb784cf75833 2024-08-18T22:29:58.340 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=quincy 2024-08-18T22:29:58.342 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': 'quincy', 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': ['ceph-volume'], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'de09dd018de4baddfa6ca4d43bc8fb784cf75833', 'tag': None, 'wait_for_package': False} 2024-08-18T22:29:58.342 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-08-18T22:29:58.342 INFO:teuthology.packaging:ref: None 2024-08-18T22:29:58.342 INFO:teuthology.packaging:tag: None 2024-08-18T22:29:58.343 INFO:teuthology.packaging:branch: quincy 2024-08-18T22:29:58.343 INFO:teuthology.packaging:sha1: de09dd018de4baddfa6ca4d43bc8fb784cf75833 2024-08-18T22:29:58.343 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=quincy 2024-08-18T22:29:58.571 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/quincy/df62bdccd9a13bf566b27a250eddfdd89be3072d/centos/9/flavors/default/ 2024-08-18T22:29:58.571 INFO:teuthology.task.install.rpm:Package version is 17.2.7-1406.gdf62bdcc 2024-08-18T22:29:58.605 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/quincy/df62bdccd9a13bf566b27a250eddfdd89be3072d/centos/9/flavors/default/ 2024-08-18T22:29:58.605 INFO:teuthology.task.install.rpm:Package version is 17.2.7-1406.gdf62bdcc 2024-08-18T22:29:58.686 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/quincy/df62bdccd9a13bf566b27a250eddfdd89be3072d/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/quincy/df62bdccd9a13bf566b27a250eddfdd89be3072d/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/quincy/df62bdccd9a13bf566b27a250eddfdd89be3072d/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-08-18T22:29:58.686 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-08-18T22:29:58.686 DEBUG:teuthology.orchestra.run.smithi121:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-08-18T22:29:58.713 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-08-18T22:29:58.713 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-08-18T22:29:58.713 INFO:teuthology.packaging:ref: None 2024-08-18T22:29:58.713 INFO:teuthology.packaging:tag: None 2024-08-18T22:29:58.713 INFO:teuthology.packaging:branch: quincy 2024-08-18T22:29:58.713 INFO:teuthology.packaging:sha1: de09dd018de4baddfa6ca4d43bc8fb784cf75833 2024-08-18T22:29:58.714 DEBUG:teuthology.orchestra.run.smithi121:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;ref/quincy/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-08-18T22:29:58.716 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/quincy/df62bdccd9a13bf566b27a250eddfdd89be3072d/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/quincy/df62bdccd9a13bf566b27a250eddfdd89be3072d/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/quincy/df62bdccd9a13bf566b27a250eddfdd89be3072d/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-08-18T22:29:58.716 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-08-18T22:29:58.716 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-08-18T22:29:58.742 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-08-18T22:29:58.743 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-08-18T22:29:58.743 INFO:teuthology.packaging:ref: None 2024-08-18T22:29:58.743 INFO:teuthology.packaging:tag: None 2024-08-18T22:29:58.743 INFO:teuthology.packaging:branch: quincy 2024-08-18T22:29:58.743 INFO:teuthology.packaging:sha1: de09dd018de4baddfa6ca4d43bc8fb784cf75833 2024-08-18T22:29:58.743 DEBUG:teuthology.orchestra.run.smithi195:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;ref/quincy/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-08-18T22:29:58.779 DEBUG:teuthology.orchestra.run.smithi121:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-08-18T22:29:58.809 DEBUG:teuthology.orchestra.run.smithi195:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-08-18T22:29:58.854 DEBUG:teuthology.orchestra.run.smithi121:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-08-18T22:29:58.885 DEBUG:teuthology.orchestra.run.smithi195:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-08-18T22:29:58.918 INFO:teuthology.orchestra.run.smithi121.stdout:check_obsoletes = 1 2024-08-18T22:29:58.920 DEBUG:teuthology.orchestra.run.smithi121:> sudo yum clean all 2024-08-18T22:29:58.949 INFO:teuthology.orchestra.run.smithi195.stdout:check_obsoletes = 1 2024-08-18T22:29:58.951 DEBUG:teuthology.orchestra.run.smithi195:> sudo yum clean all 2024-08-18T22:29:59.145 INFO:teuthology.orchestra.run.smithi121.stdout:45 files removed 2024-08-18T22:29:59.171 DEBUG:teuthology.orchestra.run.smithi121:> sudo yum -y install ceph-radosgw 2024-08-18T22:29:59.177 INFO:teuthology.orchestra.run.smithi195.stdout:45 files removed 2024-08-18T22:29:59.203 DEBUG:teuthology.orchestra.run.smithi195:> sudo yum -y install ceph-radosgw 2024-08-18T22:29:59.716 INFO:teuthology.orchestra.run.smithi121.stdout:ceph packages for x86_64 288 kB/s | 77 kB 00:00 2024-08-18T22:29:59.750 INFO:teuthology.orchestra.run.smithi195.stdout:ceph packages for x86_64 280 kB/s | 77 kB 00:00 2024-08-18T22:29:59.999 INFO:teuthology.orchestra.run.smithi121.stdout:ceph noarch packages 44 kB/s | 11 kB 00:00 2024-08-18T22:30:00.042 INFO:teuthology.orchestra.run.smithi195.stdout:ceph noarch packages 43 kB/s | 11 kB 00:00 2024-08-18T22:30:00.275 INFO:teuthology.orchestra.run.smithi121.stdout:ceph source packages 7.4 kB/s | 1.8 kB 00:00 2024-08-18T22:30:00.318 INFO:teuthology.orchestra.run.smithi195.stdout:ceph source packages 7.4 kB/s | 1.8 kB 00:00 2024-08-18T22:30:00.812 INFO:teuthology.orchestra.run.smithi195.stdout:CentOS Stream 9 - BaseOS 18 MB/s | 8.2 MB 00:00 2024-08-18T22:30:01.558 INFO:teuthology.orchestra.run.smithi121.stdout:CentOS Stream 9 - BaseOS 6.6 MB/s | 8.2 MB 00:01 2024-08-18T22:30:03.418 INFO:teuthology.orchestra.run.smithi121.stdout:CentOS Stream 9 - AppStream 26 MB/s | 20 MB 00:00 2024-08-18T22:30:04.027 INFO:teuthology.orchestra.run.smithi195.stdout:CentOS Stream 9 - AppStream 9.5 MB/s | 20 MB 00:02 2024-08-18T22:30:08.570 INFO:teuthology.orchestra.run.smithi195.stdout:CentOS Stream 9 - CRB 8.1 MB/s | 6.6 MB 00:00 2024-08-18T22:30:08.901 INFO:teuthology.orchestra.run.smithi121.stdout:CentOS Stream 9 - CRB 3.9 MB/s | 6.6 MB 00:01 2024-08-18T22:30:10.510 INFO:teuthology.orchestra.run.smithi121.stdout:CentOS Stream 9 - Extras packages 46 kB/s | 18 kB 00:00 2024-08-18T22:30:10.729 INFO:teuthology.orchestra.run.smithi195.stdout:CentOS Stream 9 - Extras packages 19 kB/s | 18 kB 00:00 2024-08-18T22:30:11.914 INFO:teuthology.orchestra.run.smithi121.stdout:Extra Packages for Enterprise Linux 17 MB/s | 22 MB 00:01 2024-08-18T22:30:12.174 INFO:teuthology.orchestra.run.smithi195.stdout:Extra Packages for Enterprise Linux 17 MB/s | 22 MB 00:01 2024-08-18T22:30:17.203 INFO:teuthology.orchestra.run.smithi121.stdout:lab-extras 33 kB/s | 1.7 kB 00:00 2024-08-18T22:30:17.706 INFO:teuthology.orchestra.run.smithi195.stdout:lab-extras 13 kB/s | 1.7 kB 00:00 2024-08-18T22:30:19.392 INFO:teuthology.orchestra.run.smithi121.stdout:Dependencies resolved. 2024-08-18T22:30:19.393 INFO:teuthology.orchestra.run.smithi121.stdout:================================================================================ 2024-08-18T22:30:19.393 INFO:teuthology.orchestra.run.smithi121.stdout: Package Arch Version Repository Size 2024-08-18T22:30:19.394 INFO:teuthology.orchestra.run.smithi121.stdout:================================================================================ 2024-08-18T22:30:19.394 INFO:teuthology.orchestra.run.smithi121.stdout:Installing: 2024-08-18T22:30:19.394 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-radosgw x86_64 2:17.2.7-1406.gdf62bdcc.el9 ceph 14 M 2024-08-18T22:30:19.394 INFO:teuthology.orchestra.run.smithi121.stdout:Upgrading: 2024-08-18T22:30:19.394 INFO:teuthology.orchestra.run.smithi121.stdout: librados2 x86_64 2:17.2.7-1406.gdf62bdcc.el9 ceph 3.1 M 2024-08-18T22:30:19.394 INFO:teuthology.orchestra.run.smithi121.stdout: librbd1 x86_64 2:17.2.7-1406.gdf62bdcc.el9 ceph 2.9 M 2024-08-18T22:30:19.394 INFO:teuthology.orchestra.run.smithi121.stdout:Installing dependencies: 2024-08-18T22:30:19.394 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-base x86_64 2:17.2.7-1406.gdf62bdcc.el9 ceph 5.0 M 2024-08-18T22:30:19.394 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-common x86_64 2:17.2.7-1406.gdf62bdcc.el9 ceph 22 M 2024-08-18T22:30:19.394 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-selinux x86_64 2:17.2.7-1406.gdf62bdcc.el9 ceph 25 k 2024-08-18T22:30:19.394 INFO:teuthology.orchestra.run.smithi121.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-08-18T22:30:19.395 INFO:teuthology.orchestra.run.smithi121.stdout: libcephfs2 x86_64 2:17.2.7-1406.gdf62bdcc.el9 ceph 636 k 2024-08-18T22:30:19.395 INFO:teuthology.orchestra.run.smithi121.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-08-18T22:30:19.395 INFO:teuthology.orchestra.run.smithi121.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-08-18T22:30:19.395 INFO:teuthology.orchestra.run.smithi121.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-08-18T22:30:19.395 INFO:teuthology.orchestra.run.smithi121.stdout: libradosstriper1 x86_64 2:17.2.7-1406.gdf62bdcc.el9 ceph 457 k 2024-08-18T22:30:19.395 INFO:teuthology.orchestra.run.smithi121.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-08-18T22:30:19.395 INFO:teuthology.orchestra.run.smithi121.stdout: librgw2 x86_64 2:17.2.7-1406.gdf62bdcc.el9 ceph 4.9 M 2024-08-18T22:30:19.395 INFO:teuthology.orchestra.run.smithi121.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-08-18T22:30:19.395 INFO:teuthology.orchestra.run.smithi121.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-08-18T22:30:19.395 INFO:teuthology.orchestra.run.smithi121.stdout: python3-ceph-argparse x86_64 2:17.2.7-1406.gdf62bdcc.el9 ceph 45 k 2024-08-18T22:30:19.395 INFO:teuthology.orchestra.run.smithi121.stdout: python3-ceph-common x86_64 2:17.2.7-1406.gdf62bdcc.el9 ceph 120 k 2024-08-18T22:30:19.395 INFO:teuthology.orchestra.run.smithi121.stdout: python3-cephfs x86_64 2:17.2.7-1406.gdf62bdcc.el9 ceph 182 k 2024-08-18T22:30:19.395 INFO:teuthology.orchestra.run.smithi121.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-08-18T22:30:19.395 INFO:teuthology.orchestra.run.smithi121.stdout: python3-rados x86_64 2:17.2.7-1406.gdf62bdcc.el9 ceph 367 k 2024-08-18T22:30:19.396 INFO:teuthology.orchestra.run.smithi121.stdout: python3-rbd x86_64 2:17.2.7-1406.gdf62bdcc.el9 ceph 343 k 2024-08-18T22:30:19.396 INFO:teuthology.orchestra.run.smithi121.stdout: python3-rgw x86_64 2:17.2.7-1406.gdf62bdcc.el9 ceph 116 k 2024-08-18T22:30:19.396 INFO:teuthology.orchestra.run.smithi121.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-08-18T22:30:19.396 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-08-18T22:30:19.396 INFO:teuthology.orchestra.run.smithi121.stdout:Transaction Summary 2024-08-18T22:30:19.396 INFO:teuthology.orchestra.run.smithi121.stdout:================================================================================ 2024-08-18T22:30:19.396 INFO:teuthology.orchestra.run.smithi121.stdout:Install 22 Packages 2024-08-18T22:30:19.396 INFO:teuthology.orchestra.run.smithi121.stdout:Upgrade 2 Packages 2024-08-18T22:30:19.396 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-08-18T22:30:19.396 INFO:teuthology.orchestra.run.smithi121.stdout:Total download size: 58 M 2024-08-18T22:30:19.397 INFO:teuthology.orchestra.run.smithi121.stdout:Downloading Packages: 2024-08-18T22:30:19.930 INFO:teuthology.orchestra.run.smithi195.stdout:Dependencies resolved. 2024-08-18T22:30:19.932 INFO:teuthology.orchestra.run.smithi195.stdout:================================================================================ 2024-08-18T22:30:19.932 INFO:teuthology.orchestra.run.smithi195.stdout: Package Arch Version Repository Size 2024-08-18T22:30:19.932 INFO:teuthology.orchestra.run.smithi195.stdout:================================================================================ 2024-08-18T22:30:19.932 INFO:teuthology.orchestra.run.smithi195.stdout:Installing: 2024-08-18T22:30:19.932 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-radosgw x86_64 2:17.2.7-1406.gdf62bdcc.el9 ceph 14 M 2024-08-18T22:30:19.932 INFO:teuthology.orchestra.run.smithi195.stdout:Upgrading: 2024-08-18T22:30:19.932 INFO:teuthology.orchestra.run.smithi195.stdout: librados2 x86_64 2:17.2.7-1406.gdf62bdcc.el9 ceph 3.1 M 2024-08-18T22:30:19.932 INFO:teuthology.orchestra.run.smithi195.stdout: librbd1 x86_64 2:17.2.7-1406.gdf62bdcc.el9 ceph 2.9 M 2024-08-18T22:30:19.932 INFO:teuthology.orchestra.run.smithi195.stdout:Installing dependencies: 2024-08-18T22:30:19.932 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-base x86_64 2:17.2.7-1406.gdf62bdcc.el9 ceph 5.0 M 2024-08-18T22:30:19.932 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-common x86_64 2:17.2.7-1406.gdf62bdcc.el9 ceph 22 M 2024-08-18T22:30:19.933 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-selinux x86_64 2:17.2.7-1406.gdf62bdcc.el9 ceph 25 k 2024-08-18T22:30:19.933 INFO:teuthology.orchestra.run.smithi195.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-08-18T22:30:19.933 INFO:teuthology.orchestra.run.smithi195.stdout: libcephfs2 x86_64 2:17.2.7-1406.gdf62bdcc.el9 ceph 636 k 2024-08-18T22:30:19.933 INFO:teuthology.orchestra.run.smithi195.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-08-18T22:30:19.933 INFO:teuthology.orchestra.run.smithi195.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-08-18T22:30:19.933 INFO:teuthology.orchestra.run.smithi195.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-08-18T22:30:19.933 INFO:teuthology.orchestra.run.smithi195.stdout: libradosstriper1 x86_64 2:17.2.7-1406.gdf62bdcc.el9 ceph 457 k 2024-08-18T22:30:19.933 INFO:teuthology.orchestra.run.smithi195.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-08-18T22:30:19.933 INFO:teuthology.orchestra.run.smithi195.stdout: librgw2 x86_64 2:17.2.7-1406.gdf62bdcc.el9 ceph 4.9 M 2024-08-18T22:30:19.933 INFO:teuthology.orchestra.run.smithi195.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-08-18T22:30:19.933 INFO:teuthology.orchestra.run.smithi195.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-08-18T22:30:19.933 INFO:teuthology.orchestra.run.smithi195.stdout: python3-ceph-argparse x86_64 2:17.2.7-1406.gdf62bdcc.el9 ceph 45 k 2024-08-18T22:30:19.933 INFO:teuthology.orchestra.run.smithi195.stdout: python3-ceph-common x86_64 2:17.2.7-1406.gdf62bdcc.el9 ceph 120 k 2024-08-18T22:30:19.933 INFO:teuthology.orchestra.run.smithi195.stdout: python3-cephfs x86_64 2:17.2.7-1406.gdf62bdcc.el9 ceph 182 k 2024-08-18T22:30:19.933 INFO:teuthology.orchestra.run.smithi195.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-08-18T22:30:19.934 INFO:teuthology.orchestra.run.smithi195.stdout: python3-rados x86_64 2:17.2.7-1406.gdf62bdcc.el9 ceph 367 k 2024-08-18T22:30:19.934 INFO:teuthology.orchestra.run.smithi195.stdout: python3-rbd x86_64 2:17.2.7-1406.gdf62bdcc.el9 ceph 343 k 2024-08-18T22:30:19.934 INFO:teuthology.orchestra.run.smithi195.stdout: python3-rgw x86_64 2:17.2.7-1406.gdf62bdcc.el9 ceph 116 k 2024-08-18T22:30:19.934 INFO:teuthology.orchestra.run.smithi195.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-08-18T22:30:19.934 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-08-18T22:30:19.934 INFO:teuthology.orchestra.run.smithi195.stdout:Transaction Summary 2024-08-18T22:30:19.934 INFO:teuthology.orchestra.run.smithi195.stdout:================================================================================ 2024-08-18T22:30:19.934 INFO:teuthology.orchestra.run.smithi195.stdout:Install 22 Packages 2024-08-18T22:30:19.934 INFO:teuthology.orchestra.run.smithi195.stdout:Upgrade 2 Packages 2024-08-18T22:30:19.934 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-08-18T22:30:19.935 INFO:teuthology.orchestra.run.smithi195.stdout:Total download size: 58 M 2024-08-18T22:30:19.935 INFO:teuthology.orchestra.run.smithi195.stdout:Downloading Packages: 2024-08-18T22:30:20.346 INFO:teuthology.orchestra.run.smithi121.stdout:(1/24): ceph-base-17.2.7-1406.gdf62bdcc.el9.x86 9.7 MB/s | 5.0 MB 00:00 2024-08-18T22:30:20.404 INFO:teuthology.orchestra.run.smithi121.stdout:(2/24): ceph-selinux-17.2.7-1406.gdf62bdcc.el9. 433 kB/s | 25 kB 00:00 2024-08-18T22:30:20.496 INFO:teuthology.orchestra.run.smithi121.stdout:(3/24): libcephfs2-17.2.7-1406.gdf62bdcc.el9.x8 6.8 MB/s | 636 kB 00:00 2024-08-18T22:30:20.588 INFO:teuthology.orchestra.run.smithi121.stdout:(4/24): libradosstriper1-17.2.7-1406.gdf62bdcc. 4.9 MB/s | 457 kB 00:00 2024-08-18T22:30:20.763 INFO:teuthology.orchestra.run.smithi121.stdout:(5/24): ceph-radosgw-17.2.7-1406.gdf62bdcc.el9. 15 MB/s | 14 MB 00:00 2024-08-18T22:30:20.814 INFO:teuthology.orchestra.run.smithi121.stdout:(6/24): python3-ceph-argparse-17.2.7-1406.gdf62 907 kB/s | 45 kB 00:00 2024-08-18T22:30:20.889 INFO:teuthology.orchestra.run.smithi121.stdout:(7/24): librgw2-17.2.7-1406.gdf62bdcc.el9.x86_6 16 MB/s | 4.9 MB 00:00 2024-08-18T22:30:20.914 INFO:teuthology.orchestra.run.smithi121.stdout:(8/24): python3-ceph-common-17.2.7-1406.gdf62bd 1.2 MB/s | 120 kB 00:00 2024-08-18T22:30:20.939 INFO:teuthology.orchestra.run.smithi121.stdout:(9/24): python3-cephfs-17.2.7-1406.gdf62bdcc.el 3.5 MB/s | 182 kB 00:00 2024-08-18T22:30:20.964 INFO:teuthology.orchestra.run.smithi121.stdout:(10/24): python3-rados-17.2.7-1406.gdf62bdcc.el 7.2 MB/s | 367 kB 00:00 2024-08-18T22:30:20.990 INFO:teuthology.orchestra.run.smithi121.stdout:(11/24): python3-rbd-17.2.7-1406.gdf62bdcc.el9. 6.7 MB/s | 343 kB 00:00 2024-08-18T22:30:21.015 INFO:teuthology.orchestra.run.smithi121.stdout:(12/24): python3-rgw-17.2.7-1406.gdf62bdcc.el9. 2.3 MB/s | 116 kB 00:00 2024-08-18T22:30:21.240 INFO:teuthology.orchestra.run.smithi121.stdout:(13/24): ceph-common-17.2.7-1406.gdf62bdcc.el9. 16 MB/s | 22 MB 00:01 2024-08-18T22:30:21.299 INFO:teuthology.orchestra.run.smithi121.stdout:(14/24): libpmemobj-1.12.1-1.el9.x86_64.rpm 519 kB/s | 160 kB 00:00 2024-08-18T22:30:21.307 INFO:teuthology.orchestra.run.smithi195.stdout:(1/24): ceph-base-17.2.7-1406.gdf62bdcc.el9.x86 3.9 MB/s | 5.0 MB 00:01 2024-08-18T22:30:21.324 INFO:teuthology.orchestra.run.smithi121.stdout:(15/24): librabbitmq-0.11.0-7.el9.x86_64.rpm 146 kB/s | 45 kB 00:00 2024-08-18T22:30:21.357 INFO:teuthology.orchestra.run.smithi195.stdout:(2/24): ceph-selinux-17.2.7-1406.gdf62bdcc.el9. 502 kB/s | 25 kB 00:00 2024-08-18T22:30:21.399 INFO:teuthology.orchestra.run.smithi121.stdout:(16/24): librdkafka-1.6.1-102.el9.x86_64.rpm 4.1 MB/s | 662 kB 00:00 2024-08-18T22:30:21.433 INFO:teuthology.orchestra.run.smithi121.stdout:(17/24): python3-prettytable-0.7.2-27.el9.noarc 389 kB/s | 42 kB 00:00 2024-08-18T22:30:21.441 INFO:teuthology.orchestra.run.smithi195.stdout:(3/24): libcephfs2-17.2.7-1406.gdf62bdcc.el9.x8 7.5 MB/s | 636 kB 00:00 2024-08-18T22:30:21.475 INFO:teuthology.orchestra.run.smithi121.stdout:(18/24): gperftools-libs-2.9.1-2.el9.x86_64.rpm 4.0 MB/s | 309 kB 00:00 2024-08-18T22:30:21.508 INFO:teuthology.orchestra.run.smithi121.stdout:(19/24): libunwind-1.6.2-1.el9.x86_64.rpm 2.1 MB/s | 67 kB 00:00 2024-08-18T22:30:21.541 INFO:teuthology.orchestra.run.smithi195.stdout:(4/24): libradosstriper1-17.2.7-1406.gdf62bdcc. 4.5 MB/s | 457 kB 00:00 2024-08-18T22:30:21.542 INFO:teuthology.orchestra.run.smithi121.stdout:(20/24): lttng-ust-2.12.0-6.el9.x86_64.rpm 1.2 MB/s | 292 kB 00:00 2024-08-18T22:30:21.568 INFO:teuthology.orchestra.run.smithi121.stdout:(21/24): liboath-2.6.7-2.el9.x86_64.rpm 367 kB/s | 49 kB 00:00 2024-08-18T22:30:21.618 INFO:teuthology.orchestra.run.smithi121.stdout:(22/24): thrift-0.15.0-2.el9.x86_64.rpm 15 MB/s | 1.6 MB 00:00 2024-08-18T22:30:21.717 INFO:teuthology.orchestra.run.smithi195.stdout:(5/24): ceph-radosgw-17.2.7-1406.gdf62bdcc.el9. 8.6 MB/s | 14 MB 00:01 2024-08-18T22:30:21.752 INFO:teuthology.orchestra.run.smithi121.stdout:(23/24): librados2-17.2.7-1406.gdf62bdcc.el9.x8 15 MB/s | 3.1 MB 00:00 2024-08-18T22:30:21.767 INFO:teuthology.orchestra.run.smithi195.stdout:(6/24): python3-ceph-argparse-17.2.7-1406.gdf62 908 kB/s | 45 kB 00:00 2024-08-18T22:30:21.810 INFO:teuthology.orchestra.run.smithi121.stdout:(24/24): librbd1-17.2.7-1406.gdf62bdcc.el9.x86_ 12 MB/s | 2.9 MB 00:00 2024-08-18T22:30:21.814 INFO:teuthology.orchestra.run.smithi121.stdout:-------------------------------------------------------------------------------- 2024-08-18T22:30:21.814 INFO:teuthology.orchestra.run.smithi121.stdout:Total 24 MB/s | 58 MB 00:02 2024-08-18T22:30:21.825 INFO:teuthology.orchestra.run.smithi195.stdout:(7/24): python3-ceph-common-17.2.7-1406.gdf62bd 2.0 MB/s | 120 kB 00:00 2024-08-18T22:30:21.880 INFO:teuthology.orchestra.run.smithi121.stdout:Running transaction check 2024-08-18T22:30:21.892 INFO:teuthology.orchestra.run.smithi195.stdout:(8/24): python3-cephfs-17.2.7-1406.gdf62bdcc.el 2.7 MB/s | 182 kB 00:00 2024-08-18T22:30:21.921 INFO:teuthology.orchestra.run.smithi121.stdout:Transaction check succeeded. 2024-08-18T22:30:21.921 INFO:teuthology.orchestra.run.smithi121.stdout:Running transaction test 2024-08-18T22:30:21.967 INFO:teuthology.orchestra.run.smithi195.stdout:(9/24): python3-rados-17.2.7-1406.gdf62bdcc.el9 4.8 MB/s | 367 kB 00:00 2024-08-18T22:30:22.043 INFO:teuthology.orchestra.run.smithi195.stdout:(10/24): librgw2-17.2.7-1406.gdf62bdcc.el9.x86_ 9.8 MB/s | 4.9 MB 00:00 2024-08-18T22:30:22.068 INFO:teuthology.orchestra.run.smithi195.stdout:(11/24): python3-rbd-17.2.7-1406.gdf62bdcc.el9. 3.3 MB/s | 343 kB 00:00 2024-08-18T22:30:22.093 INFO:teuthology.orchestra.run.smithi195.stdout:(12/24): python3-rgw-17.2.7-1406.gdf62bdcc.el9. 2.3 MB/s | 116 kB 00:00 2024-08-18T22:30:22.310 INFO:teuthology.orchestra.run.smithi195.stdout:(13/24): ceph-common-17.2.7-1406.gdf62bdcc.el9. 9.9 MB/s | 22 MB 00:02 2024-08-18T22:30:22.394 INFO:teuthology.orchestra.run.smithi195.stdout:(14/24): librabbitmq-0.11.0-7.el9.x86_64.rpm 151 kB/s | 45 kB 00:00 2024-08-18T22:30:22.419 INFO:teuthology.orchestra.run.smithi195.stdout:(15/24): libpmemobj-1.12.1-1.el9.x86_64.rpm 457 kB/s | 160 kB 00:00 2024-08-18T22:30:22.477 INFO:teuthology.orchestra.run.smithi195.stdout:(16/24): lttng-ust-2.12.0-6.el9.x86_64.rpm 3.4 MB/s | 292 kB 00:00 2024-08-18T22:30:22.503 INFO:teuthology.orchestra.run.smithi195.stdout:(17/24): python3-prettytable-0.7.2-27.el9.noarc 505 kB/s | 42 kB 00:00 2024-08-18T22:30:22.553 INFO:teuthology.orchestra.run.smithi195.stdout:(18/24): gperftools-libs-2.9.1-2.el9.x86_64.rpm 4.0 MB/s | 309 kB 00:00 2024-08-18T22:30:22.578 INFO:teuthology.orchestra.run.smithi195.stdout:(19/24): liboath-2.6.7-2.el9.x86_64.rpm 647 kB/s | 49 kB 00:00 2024-08-18T22:30:22.600 INFO:teuthology.orchestra.run.smithi121.stdout:Transaction test succeeded. 2024-08-18T22:30:22.600 INFO:teuthology.orchestra.run.smithi121.stdout:Running transaction 2024-08-18T22:30:22.604 INFO:teuthology.orchestra.run.smithi195.stdout:(20/24): libunwind-1.6.2-1.el9.x86_64.rpm 1.3 MB/s | 67 kB 00:00 2024-08-18T22:30:22.637 INFO:teuthology.orchestra.run.smithi195.stdout:(21/24): librdkafka-1.6.1-102.el9.x86_64.rpm 2.0 MB/s | 662 kB 00:00 2024-08-18T22:30:22.696 INFO:teuthology.orchestra.run.smithi195.stdout:(22/24): thrift-0.15.0-2.el9.x86_64.rpm 14 MB/s | 1.6 MB 00:00 2024-08-18T22:30:22.880 INFO:teuthology.orchestra.run.smithi195.stdout:(23/24): librbd1-17.2.7-1406.gdf62bdcc.el9.x86_ 12 MB/s | 2.9 MB 00:00 2024-08-18T22:30:22.938 INFO:teuthology.orchestra.run.smithi195.stdout:(24/24): librados2-17.2.7-1406.gdf62bdcc.el9.x8 9.2 MB/s | 3.1 MB 00:00 2024-08-18T22:30:22.943 INFO:teuthology.orchestra.run.smithi195.stdout:-------------------------------------------------------------------------------- 2024-08-18T22:30:22.943 INFO:teuthology.orchestra.run.smithi195.stdout:Total 19 MB/s | 58 MB 00:03 2024-08-18T22:30:23.009 INFO:teuthology.orchestra.run.smithi195.stdout:Running transaction check 2024-08-18T22:30:23.051 INFO:teuthology.orchestra.run.smithi195.stdout:Transaction check succeeded. 2024-08-18T22:30:23.051 INFO:teuthology.orchestra.run.smithi195.stdout:Running transaction test 2024-08-18T22:30:23.703 INFO:teuthology.orchestra.run.smithi195.stdout:Transaction test succeeded. 2024-08-18T22:30:23.703 INFO:teuthology.orchestra.run.smithi195.stdout:Running transaction 2024-08-18T22:30:23.896 INFO:teuthology.orchestra.run.smithi121.stdout: Preparing : 1/1 2024-08-18T22:30:24.230 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/26 2024-08-18T22:30:24.337 INFO:teuthology.orchestra.run.smithi121.stdout: Upgrading : librados2-2:17.2.7-1406.gdf62bdcc.el9.x86_64 2/26 2024-08-18T22:30:24.436 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: librados2-2:17.2.7-1406.gdf62bdcc.el9.x86_64 2/26 2024-08-18T22:30:24.516 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-rados-2:17.2.7-1406.gdf62bdcc.el9.x86_64 3/26 2024-08-18T22:30:24.563 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : libcephfs2-2:17.2.7-1406.gdf62bdcc.el9.x86_64 4/26 2024-08-18T22:30:24.652 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: libcephfs2-2:17.2.7-1406.gdf62bdcc.el9.x86_64 4/26 2024-08-18T22:30:24.697 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : thrift-0.15.0-2.el9.x86_64 5/26 2024-08-18T22:30:24.726 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 6/26 2024-08-18T22:30:24.942 INFO:teuthology.orchestra.run.smithi195.stdout: Preparing : 1/1 2024-08-18T22:30:25.163 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 7/26 2024-08-18T22:30:25.191 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : librgw2-2:17.2.7-1406.gdf62bdcc.el9.x86_64 8/26 2024-08-18T22:30:25.246 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: librgw2-2:17.2.7-1406.gdf62bdcc.el9.x86_64 8/26 2024-08-18T22:30:25.283 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : liboath-2.6.7-2.el9.x86_64 9/26 2024-08-18T22:30:25.307 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/26 2024-08-18T22:30:25.328 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-ceph-argparse-2:17.2.7-1406.gdf62bdcc.el9. 10/26 2024-08-18T22:30:25.364 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-cephfs-2:17.2.7-1406.gdf62bdcc.el9.x86_64 11/26 2024-08-18T22:30:25.399 INFO:teuthology.orchestra.run.smithi195.stdout: Upgrading : librados2-2:17.2.7-1406.gdf62bdcc.el9.x86_64 2/26 2024-08-18T22:30:25.432 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-rgw-2:17.2.7-1406.gdf62bdcc.el9.x86_64 12/26 2024-08-18T22:30:25.461 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : libradosstriper1-2:17.2.7-1406.gdf62bdcc.el9.x86_6 13/26 2024-08-18T22:30:25.494 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: librados2-2:17.2.7-1406.gdf62bdcc.el9.x86_64 2/26 2024-08-18T22:30:25.527 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: libradosstriper1-2:17.2.7-1406.gdf62bdcc.el9.x86_6 13/26 2024-08-18T22:30:25.566 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 14/26 2024-08-18T22:30:25.569 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-rados-2:17.2.7-1406.gdf62bdcc.el9.x86_64 3/26 2024-08-18T22:30:25.592 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : libcephfs2-2:17.2.7-1406.gdf62bdcc.el9.x86_64 4/26 2024-08-18T22:30:25.610 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 15/26 2024-08-18T22:30:25.643 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 16/26 2024-08-18T22:30:25.681 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: libcephfs2-2:17.2.7-1406.gdf62bdcc.el9.x86_64 4/26 2024-08-18T22:30:25.726 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : thrift-0.15.0-2.el9.x86_64 5/26 2024-08-18T22:30:25.755 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 6/26 2024-08-18T22:30:25.937 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 17/26 2024-08-18T22:30:25.981 INFO:teuthology.orchestra.run.smithi121.stdout: Upgrading : librbd1-2:17.2.7-1406.gdf62bdcc.el9.x86_64 18/26 2024-08-18T22:30:26.075 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: librbd1-2:17.2.7-1406.gdf62bdcc.el9.x86_64 18/26 2024-08-18T22:30:26.145 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-rbd-2:17.2.7-1406.gdf62bdcc.el9.x86_64 19/26 2024-08-18T22:30:26.175 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-ceph-common-2:17.2.7-1406.gdf62bdcc.el9.x8 20/26 2024-08-18T22:30:26.193 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 7/26 2024-08-18T22:30:26.220 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : librgw2-2:17.2.7-1406.gdf62bdcc.el9.x86_64 8/26 2024-08-18T22:30:26.266 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: librgw2-2:17.2.7-1406.gdf62bdcc.el9.x86_64 8/26 2024-08-18T22:30:26.294 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : liboath-2.6.7-2.el9.x86_64 9/26 2024-08-18T22:30:26.340 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-ceph-argparse-2:17.2.7-1406.gdf62bdcc.el9. 10/26 2024-08-18T22:30:26.376 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-cephfs-2:17.2.7-1406.gdf62bdcc.el9.x86_64 11/26 2024-08-18T22:30:26.445 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-rgw-2:17.2.7-1406.gdf62bdcc.el9.x86_64 12/26 2024-08-18T22:30:26.472 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : libradosstriper1-2:17.2.7-1406.gdf62bdcc.el9.x86_6 13/26 2024-08-18T22:30:26.538 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: libradosstriper1-2:17.2.7-1406.gdf62bdcc.el9.x86_6 13/26 2024-08-18T22:30:26.593 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 14/26 2024-08-18T22:30:26.623 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 15/26 2024-08-18T22:30:26.655 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 16/26 2024-08-18T22:30:26.965 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 17/26 2024-08-18T22:30:27.002 INFO:teuthology.orchestra.run.smithi195.stdout: Upgrading : librbd1-2:17.2.7-1406.gdf62bdcc.el9.x86_64 18/26 2024-08-18T22:30:27.096 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: librbd1-2:17.2.7-1406.gdf62bdcc.el9.x86_64 18/26 2024-08-18T22:30:27.165 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-rbd-2:17.2.7-1406.gdf62bdcc.el9.x86_64 19/26 2024-08-18T22:30:27.196 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-ceph-common-2:17.2.7-1406.gdf62bdcc.el9.x8 20/26 2024-08-18T22:30:28.734 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: ceph-common-2:17.2.7-1406.gdf62bdcc.el9.x86_64 21/26 2024-08-18T22:30:28.780 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : ceph-common-2:17.2.7-1406.gdf62bdcc.el9.x86_64 21/26 2024-08-18T22:30:29.302 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: ceph-common-2:17.2.7-1406.gdf62bdcc.el9.x86_64 21/26 2024-08-18T22:30:29.344 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : ceph-base-2:17.2.7-1406.gdf62bdcc.el9.x86_64 22/26 2024-08-18T22:30:29.446 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: ceph-base-2:17.2.7-1406.gdf62bdcc.el9.x86_64 22/26 2024-08-18T22:30:29.446 INFO:teuthology.orchestra.run.smithi121.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-08-18T22:30:29.447 INFO:teuthology.orchestra.run.smithi121.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-08-18T22:30:29.447 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-08-18T22:30:29.478 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : ceph-selinux-2:17.2.7-1406.gdf62bdcc.el9.x86_64 23/26 2024-08-18T22:30:29.759 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: ceph-common-2:17.2.7-1406.gdf62bdcc.el9.x86_64 21/26 2024-08-18T22:30:29.794 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-common-2:17.2.7-1406.gdf62bdcc.el9.x86_64 21/26 2024-08-18T22:30:30.341 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: ceph-common-2:17.2.7-1406.gdf62bdcc.el9.x86_64 21/26 2024-08-18T22:30:30.389 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-base-2:17.2.7-1406.gdf62bdcc.el9.x86_64 22/26 2024-08-18T22:30:30.471 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: ceph-base-2:17.2.7-1406.gdf62bdcc.el9.x86_64 22/26 2024-08-18T22:30:30.471 INFO:teuthology.orchestra.run.smithi195.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-08-18T22:30:30.471 INFO:teuthology.orchestra.run.smithi195.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-08-18T22:30:30.471 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-08-18T22:30:30.499 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-selinux-2:17.2.7-1406.gdf62bdcc.el9.x86_64 23/26 2024-08-18T22:30:38.839 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: ceph-selinux-2:17.2.7-1406.gdf62bdcc.el9.x86_64 23/26 2024-08-18T22:30:38.839 INFO:teuthology.orchestra.run.smithi121.stdout:skipping the directory /sys 2024-08-18T22:30:38.839 INFO:teuthology.orchestra.run.smithi121.stdout:skipping the directory /proc 2024-08-18T22:30:38.839 INFO:teuthology.orchestra.run.smithi121.stdout:skipping the directory /mnt 2024-08-18T22:30:38.839 INFO:teuthology.orchestra.run.smithi121.stdout:skipping the directory /var/tmp 2024-08-18T22:30:38.839 INFO:teuthology.orchestra.run.smithi121.stdout:skipping the directory /home 2024-08-18T22:30:38.839 INFO:teuthology.orchestra.run.smithi121.stdout:skipping the directory /root 2024-08-18T22:30:38.839 INFO:teuthology.orchestra.run.smithi121.stdout:skipping the directory /tmp 2024-08-18T22:30:38.840 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-08-18T22:30:39.911 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: ceph-selinux-2:17.2.7-1406.gdf62bdcc.el9.x86_64 23/26 2024-08-18T22:30:39.911 INFO:teuthology.orchestra.run.smithi195.stdout:skipping the directory /sys 2024-08-18T22:30:39.911 INFO:teuthology.orchestra.run.smithi195.stdout:skipping the directory /proc 2024-08-18T22:30:39.912 INFO:teuthology.orchestra.run.smithi195.stdout:skipping the directory /mnt 2024-08-18T22:30:39.912 INFO:teuthology.orchestra.run.smithi195.stdout:skipping the directory /var/tmp 2024-08-18T22:30:39.912 INFO:teuthology.orchestra.run.smithi195.stdout:skipping the directory /home 2024-08-18T22:30:39.912 INFO:teuthology.orchestra.run.smithi195.stdout:skipping the directory /root 2024-08-18T22:30:39.912 INFO:teuthology.orchestra.run.smithi195.stdout:skipping the directory /tmp 2024-08-18T22:30:39.912 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-08-18T22:30:40.118 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : ceph-radosgw-2:17.2.7-1406.gdf62bdcc.el9.x86_64 24/26 2024-08-18T22:30:40.189 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: ceph-radosgw-2:17.2.7-1406.gdf62bdcc.el9.x86_64 24/26 2024-08-18T22:30:40.189 INFO:teuthology.orchestra.run.smithi121.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-18T22:30:40.189 INFO:teuthology.orchestra.run.smithi121.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-08-18T22:30:40.189 INFO:teuthology.orchestra.run.smithi121.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-08-18T22:30:40.190 INFO:teuthology.orchestra.run.smithi121.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-08-18T22:30:40.190 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-08-18T22:30:40.191 INFO:teuthology.orchestra.run.smithi121.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 25/26 2024-08-18T22:30:40.279 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 25/26 2024-08-18T22:30:40.279 INFO:teuthology.orchestra.run.smithi121.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 26/26 2024-08-18T22:30:41.241 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-radosgw-2:17.2.7-1406.gdf62bdcc.el9.x86_64 24/26 2024-08-18T22:30:41.320 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: ceph-radosgw-2:17.2.7-1406.gdf62bdcc.el9.x86_64 24/26 2024-08-18T22:30:41.320 INFO:teuthology.orchestra.run.smithi195.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-18T22:30:41.320 INFO:teuthology.orchestra.run.smithi195.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-08-18T22:30:41.320 INFO:teuthology.orchestra.run.smithi195.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-08-18T22:30:41.320 INFO:teuthology.orchestra.run.smithi195.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-08-18T22:30:41.320 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-08-18T22:30:41.321 INFO:teuthology.orchestra.run.smithi195.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 25/26 2024-08-18T22:30:41.411 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 25/26 2024-08-18T22:30:41.411 INFO:teuthology.orchestra.run.smithi195.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 26/26 2024-08-18T22:30:41.517 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 26/26 2024-08-18T22:30:41.517 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : ceph-base-2:17.2.7-1406.gdf62bdcc.el9.x86_64 1/26 2024-08-18T22:30:41.517 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : ceph-common-2:17.2.7-1406.gdf62bdcc.el9.x86_64 2/26 2024-08-18T22:30:41.517 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : ceph-radosgw-2:17.2.7-1406.gdf62bdcc.el9.x86_64 3/26 2024-08-18T22:30:41.517 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : ceph-selinux-2:17.2.7-1406.gdf62bdcc.el9.x86_64 4/26 2024-08-18T22:30:41.517 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : libcephfs2-2:17.2.7-1406.gdf62bdcc.el9.x86_64 5/26 2024-08-18T22:30:41.517 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : libradosstriper1-2:17.2.7-1406.gdf62bdcc.el9.x86_6 6/26 2024-08-18T22:30:41.517 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : librgw2-2:17.2.7-1406.gdf62bdcc.el9.x86_64 7/26 2024-08-18T22:30:41.517 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-ceph-argparse-2:17.2.7-1406.gdf62bdcc.el9. 8/26 2024-08-18T22:30:41.517 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-ceph-common-2:17.2.7-1406.gdf62bdcc.el9.x8 9/26 2024-08-18T22:30:41.517 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-cephfs-2:17.2.7-1406.gdf62bdcc.el9.x86_64 10/26 2024-08-18T22:30:41.518 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-rados-2:17.2.7-1406.gdf62bdcc.el9.x86_64 11/26 2024-08-18T22:30:41.518 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-rbd-2:17.2.7-1406.gdf62bdcc.el9.x86_64 12/26 2024-08-18T22:30:41.518 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-rgw-2:17.2.7-1406.gdf62bdcc.el9.x86_64 13/26 2024-08-18T22:30:41.518 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 14/26 2024-08-18T22:30:41.518 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 15/26 2024-08-18T22:30:41.518 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 16/26 2024-08-18T22:30:41.518 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 17/26 2024-08-18T22:30:41.518 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 18/26 2024-08-18T22:30:41.518 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 19/26 2024-08-18T22:30:41.518 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 20/26 2024-08-18T22:30:41.518 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 21/26 2024-08-18T22:30:41.518 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 22/26 2024-08-18T22:30:41.518 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : librados2-2:17.2.7-1406.gdf62bdcc.el9.x86_64 23/26 2024-08-18T22:30:41.519 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 24/26 2024-08-18T22:30:41.519 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : librbd1-2:17.2.7-1406.gdf62bdcc.el9.x86_64 25/26 2024-08-18T22:30:42.181 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 26/26 2024-08-18T22:30:42.181 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-08-18T22:30:42.181 INFO:teuthology.orchestra.run.smithi121.stdout:Upgraded: 2024-08-18T22:30:42.181 INFO:teuthology.orchestra.run.smithi121.stdout: librados2-2:17.2.7-1406.gdf62bdcc.el9.x86_64 2024-08-18T22:30:42.181 INFO:teuthology.orchestra.run.smithi121.stdout: librbd1-2:17.2.7-1406.gdf62bdcc.el9.x86_64 2024-08-18T22:30:42.181 INFO:teuthology.orchestra.run.smithi121.stdout:Installed: 2024-08-18T22:30:42.181 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-base-2:17.2.7-1406.gdf62bdcc.el9.x86_64 2024-08-18T22:30:42.181 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-common-2:17.2.7-1406.gdf62bdcc.el9.x86_64 2024-08-18T22:30:42.181 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-radosgw-2:17.2.7-1406.gdf62bdcc.el9.x86_64 2024-08-18T22:30:42.181 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-selinux-2:17.2.7-1406.gdf62bdcc.el9.x86_64 2024-08-18T22:30:42.181 INFO:teuthology.orchestra.run.smithi121.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-08-18T22:30:42.182 INFO:teuthology.orchestra.run.smithi121.stdout: libcephfs2-2:17.2.7-1406.gdf62bdcc.el9.x86_64 2024-08-18T22:30:42.182 INFO:teuthology.orchestra.run.smithi121.stdout: liboath-2.6.7-2.el9.x86_64 2024-08-18T22:30:42.182 INFO:teuthology.orchestra.run.smithi121.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-08-18T22:30:42.182 INFO:teuthology.orchestra.run.smithi121.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-08-18T22:30:42.182 INFO:teuthology.orchestra.run.smithi121.stdout: libradosstriper1-2:17.2.7-1406.gdf62bdcc.el9.x86_64 2024-08-18T22:30:42.182 INFO:teuthology.orchestra.run.smithi121.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-08-18T22:30:42.182 INFO:teuthology.orchestra.run.smithi121.stdout: librgw2-2:17.2.7-1406.gdf62bdcc.el9.x86_64 2024-08-18T22:30:42.182 INFO:teuthology.orchestra.run.smithi121.stdout: libunwind-1.6.2-1.el9.x86_64 2024-08-18T22:30:42.182 INFO:teuthology.orchestra.run.smithi121.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-08-18T22:30:42.182 INFO:teuthology.orchestra.run.smithi121.stdout: python3-ceph-argparse-2:17.2.7-1406.gdf62bdcc.el9.x86_64 2024-08-18T22:30:42.182 INFO:teuthology.orchestra.run.smithi121.stdout: python3-ceph-common-2:17.2.7-1406.gdf62bdcc.el9.x86_64 2024-08-18T22:30:42.183 INFO:teuthology.orchestra.run.smithi121.stdout: python3-cephfs-2:17.2.7-1406.gdf62bdcc.el9.x86_64 2024-08-18T22:30:42.183 INFO:teuthology.orchestra.run.smithi121.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-08-18T22:30:42.183 INFO:teuthology.orchestra.run.smithi121.stdout: python3-rados-2:17.2.7-1406.gdf62bdcc.el9.x86_64 2024-08-18T22:30:42.183 INFO:teuthology.orchestra.run.smithi121.stdout: python3-rbd-2:17.2.7-1406.gdf62bdcc.el9.x86_64 2024-08-18T22:30:42.183 INFO:teuthology.orchestra.run.smithi121.stdout: python3-rgw-2:17.2.7-1406.gdf62bdcc.el9.x86_64 2024-08-18T22:30:42.183 INFO:teuthology.orchestra.run.smithi121.stdout: thrift-0.15.0-2.el9.x86_64 2024-08-18T22:30:42.183 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-08-18T22:30:42.183 INFO:teuthology.orchestra.run.smithi121.stdout:Complete! 2024-08-18T22:30:42.452 DEBUG:teuthology.orchestra.run.smithi121:> sudo yum -y install ceph-test 2024-08-18T22:30:42.744 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 26/26 2024-08-18T22:30:42.744 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-base-2:17.2.7-1406.gdf62bdcc.el9.x86_64 1/26 2024-08-18T22:30:42.745 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-common-2:17.2.7-1406.gdf62bdcc.el9.x86_64 2/26 2024-08-18T22:30:42.745 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-radosgw-2:17.2.7-1406.gdf62bdcc.el9.x86_64 3/26 2024-08-18T22:30:42.745 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-selinux-2:17.2.7-1406.gdf62bdcc.el9.x86_64 4/26 2024-08-18T22:30:42.745 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : libcephfs2-2:17.2.7-1406.gdf62bdcc.el9.x86_64 5/26 2024-08-18T22:30:42.745 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : libradosstriper1-2:17.2.7-1406.gdf62bdcc.el9.x86_6 6/26 2024-08-18T22:30:42.745 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : librgw2-2:17.2.7-1406.gdf62bdcc.el9.x86_64 7/26 2024-08-18T22:30:42.745 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-ceph-argparse-2:17.2.7-1406.gdf62bdcc.el9. 8/26 2024-08-18T22:30:42.745 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-ceph-common-2:17.2.7-1406.gdf62bdcc.el9.x8 9/26 2024-08-18T22:30:42.745 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-cephfs-2:17.2.7-1406.gdf62bdcc.el9.x86_64 10/26 2024-08-18T22:30:42.745 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-rados-2:17.2.7-1406.gdf62bdcc.el9.x86_64 11/26 2024-08-18T22:30:42.745 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-rbd-2:17.2.7-1406.gdf62bdcc.el9.x86_64 12/26 2024-08-18T22:30:42.745 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-rgw-2:17.2.7-1406.gdf62bdcc.el9.x86_64 13/26 2024-08-18T22:30:42.745 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 14/26 2024-08-18T22:30:42.746 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 15/26 2024-08-18T22:30:42.746 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 16/26 2024-08-18T22:30:42.746 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 17/26 2024-08-18T22:30:42.746 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 18/26 2024-08-18T22:30:42.746 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 19/26 2024-08-18T22:30:42.746 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 20/26 2024-08-18T22:30:42.746 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 21/26 2024-08-18T22:30:42.746 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 22/26 2024-08-18T22:30:42.746 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : librados2-2:17.2.7-1406.gdf62bdcc.el9.x86_64 23/26 2024-08-18T22:30:42.746 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 24/26 2024-08-18T22:30:42.746 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : librbd1-2:17.2.7-1406.gdf62bdcc.el9.x86_64 25/26 2024-08-18T22:30:43.014 INFO:teuthology.orchestra.run.smithi121.stdout:Last metadata expiration check: 0:00:26 ago on Sun 18 Aug 2024 10:30:17 PM UTC. 2024-08-18T22:30:43.177 INFO:teuthology.orchestra.run.smithi121.stdout:Dependencies resolved. 2024-08-18T22:30:43.178 INFO:teuthology.orchestra.run.smithi121.stdout:================================================================================ 2024-08-18T22:30:43.178 INFO:teuthology.orchestra.run.smithi121.stdout: Package Arch Version Repository Size 2024-08-18T22:30:43.178 INFO:teuthology.orchestra.run.smithi121.stdout:================================================================================ 2024-08-18T22:30:43.178 INFO:teuthology.orchestra.run.smithi121.stdout:Installing: 2024-08-18T22:30:43.178 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-test x86_64 2:17.2.7-1406.gdf62bdcc.el9 ceph 48 M 2024-08-18T22:30:43.179 INFO:teuthology.orchestra.run.smithi121.stdout:Installing dependencies: 2024-08-18T22:30:43.179 INFO:teuthology.orchestra.run.smithi121.stdout: libcephsqlite x86_64 2:17.2.7-1406.gdf62bdcc.el9 ceph 163 k 2024-08-18T22:30:43.179 INFO:teuthology.orchestra.run.smithi121.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-08-18T22:30:43.179 INFO:teuthology.orchestra.run.smithi121.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-08-18T22:30:43.179 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-08-18T22:30:43.179 INFO:teuthology.orchestra.run.smithi121.stdout:Transaction Summary 2024-08-18T22:30:43.179 INFO:teuthology.orchestra.run.smithi121.stdout:================================================================================ 2024-08-18T22:30:43.179 INFO:teuthology.orchestra.run.smithi121.stdout:Install 4 Packages 2024-08-18T22:30:43.179 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-08-18T22:30:43.180 INFO:teuthology.orchestra.run.smithi121.stdout:Total download size: 48 M 2024-08-18T22:30:43.180 INFO:teuthology.orchestra.run.smithi121.stdout:Installed size: 193 M 2024-08-18T22:30:43.180 INFO:teuthology.orchestra.run.smithi121.stdout:Downloading Packages: 2024-08-18T22:30:43.368 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 26/26 2024-08-18T22:30:43.368 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-08-18T22:30:43.368 INFO:teuthology.orchestra.run.smithi195.stdout:Upgraded: 2024-08-18T22:30:43.369 INFO:teuthology.orchestra.run.smithi195.stdout: librados2-2:17.2.7-1406.gdf62bdcc.el9.x86_64 2024-08-18T22:30:43.369 INFO:teuthology.orchestra.run.smithi195.stdout: librbd1-2:17.2.7-1406.gdf62bdcc.el9.x86_64 2024-08-18T22:30:43.369 INFO:teuthology.orchestra.run.smithi195.stdout:Installed: 2024-08-18T22:30:43.369 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-base-2:17.2.7-1406.gdf62bdcc.el9.x86_64 2024-08-18T22:30:43.369 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-common-2:17.2.7-1406.gdf62bdcc.el9.x86_64 2024-08-18T22:30:43.369 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-radosgw-2:17.2.7-1406.gdf62bdcc.el9.x86_64 2024-08-18T22:30:43.369 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-selinux-2:17.2.7-1406.gdf62bdcc.el9.x86_64 2024-08-18T22:30:43.369 INFO:teuthology.orchestra.run.smithi195.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-08-18T22:30:43.369 INFO:teuthology.orchestra.run.smithi195.stdout: libcephfs2-2:17.2.7-1406.gdf62bdcc.el9.x86_64 2024-08-18T22:30:43.369 INFO:teuthology.orchestra.run.smithi195.stdout: liboath-2.6.7-2.el9.x86_64 2024-08-18T22:30:43.369 INFO:teuthology.orchestra.run.smithi195.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-08-18T22:30:43.369 INFO:teuthology.orchestra.run.smithi195.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-08-18T22:30:43.369 INFO:teuthology.orchestra.run.smithi195.stdout: libradosstriper1-2:17.2.7-1406.gdf62bdcc.el9.x86_64 2024-08-18T22:30:43.370 INFO:teuthology.orchestra.run.smithi195.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-08-18T22:30:43.370 INFO:teuthology.orchestra.run.smithi195.stdout: librgw2-2:17.2.7-1406.gdf62bdcc.el9.x86_64 2024-08-18T22:30:43.370 INFO:teuthology.orchestra.run.smithi195.stdout: libunwind-1.6.2-1.el9.x86_64 2024-08-18T22:30:43.370 INFO:teuthology.orchestra.run.smithi195.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-08-18T22:30:43.370 INFO:teuthology.orchestra.run.smithi195.stdout: python3-ceph-argparse-2:17.2.7-1406.gdf62bdcc.el9.x86_64 2024-08-18T22:30:43.370 INFO:teuthology.orchestra.run.smithi195.stdout: python3-ceph-common-2:17.2.7-1406.gdf62bdcc.el9.x86_64 2024-08-18T22:30:43.370 INFO:teuthology.orchestra.run.smithi195.stdout: python3-cephfs-2:17.2.7-1406.gdf62bdcc.el9.x86_64 2024-08-18T22:30:43.370 INFO:teuthology.orchestra.run.smithi195.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-08-18T22:30:43.370 INFO:teuthology.orchestra.run.smithi195.stdout: python3-rados-2:17.2.7-1406.gdf62bdcc.el9.x86_64 2024-08-18T22:30:43.370 INFO:teuthology.orchestra.run.smithi195.stdout: python3-rbd-2:17.2.7-1406.gdf62bdcc.el9.x86_64 2024-08-18T22:30:43.370 INFO:teuthology.orchestra.run.smithi195.stdout: python3-rgw-2:17.2.7-1406.gdf62bdcc.el9.x86_64 2024-08-18T22:30:43.370 INFO:teuthology.orchestra.run.smithi195.stdout: thrift-0.15.0-2.el9.x86_64 2024-08-18T22:30:43.370 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-08-18T22:30:43.371 INFO:teuthology.orchestra.run.smithi195.stdout:Complete! 2024-08-18T22:30:43.638 INFO:teuthology.orchestra.run.smithi121.stdout:(1/4): socat-1.7.4.1-6.el9.x86_64.rpm 1.5 MB/s | 304 kB 00:00 2024-08-18T22:30:43.664 INFO:teuthology.orchestra.run.smithi121.stdout:(2/4): libcephsqlite-17.2.7-1406.gdf62bdcc.el9. 719 kB/s | 163 kB 00:00 2024-08-18T22:30:43.698 DEBUG:teuthology.orchestra.run.smithi195:> sudo yum -y install ceph-test 2024-08-18T22:30:43.840 INFO:teuthology.orchestra.run.smithi121.stdout:(3/4): xmlstarlet-1.6.1-20.el9.x86_64.rpm 316 kB/s | 64 kB 00:00 2024-08-18T22:30:44.266 INFO:teuthology.orchestra.run.smithi195.stdout:Last metadata expiration check: 0:00:27 ago on Sun 18 Aug 2024 10:30:17 PM UTC. 2024-08-18T22:30:44.399 INFO:teuthology.orchestra.run.smithi195.stdout:Dependencies resolved. 2024-08-18T22:30:44.400 INFO:teuthology.orchestra.run.smithi195.stdout:================================================================================ 2024-08-18T22:30:44.400 INFO:teuthology.orchestra.run.smithi195.stdout: Package Arch Version Repository Size 2024-08-18T22:30:44.400 INFO:teuthology.orchestra.run.smithi195.stdout:================================================================================ 2024-08-18T22:30:44.400 INFO:teuthology.orchestra.run.smithi195.stdout:Installing: 2024-08-18T22:30:44.400 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-test x86_64 2:17.2.7-1406.gdf62bdcc.el9 ceph 48 M 2024-08-18T22:30:44.400 INFO:teuthology.orchestra.run.smithi195.stdout:Installing dependencies: 2024-08-18T22:30:44.400 INFO:teuthology.orchestra.run.smithi195.stdout: libcephsqlite x86_64 2:17.2.7-1406.gdf62bdcc.el9 ceph 163 k 2024-08-18T22:30:44.401 INFO:teuthology.orchestra.run.smithi195.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-08-18T22:30:44.401 INFO:teuthology.orchestra.run.smithi195.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-08-18T22:30:44.401 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-08-18T22:30:44.401 INFO:teuthology.orchestra.run.smithi195.stdout:Transaction Summary 2024-08-18T22:30:44.401 INFO:teuthology.orchestra.run.smithi195.stdout:================================================================================ 2024-08-18T22:30:44.401 INFO:teuthology.orchestra.run.smithi195.stdout:Install 4 Packages 2024-08-18T22:30:44.401 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-08-18T22:30:44.401 INFO:teuthology.orchestra.run.smithi195.stdout:Total download size: 48 M 2024-08-18T22:30:44.402 INFO:teuthology.orchestra.run.smithi195.stdout:Installed size: 193 M 2024-08-18T22:30:44.402 INFO:teuthology.orchestra.run.smithi195.stdout:Downloading Packages: 2024-08-18T22:30:44.887 INFO:teuthology.orchestra.run.smithi195.stdout:(1/4): socat-1.7.4.1-6.el9.x86_64.rpm 1.3 MB/s | 304 kB 00:00 2024-08-18T22:30:44.936 INFO:teuthology.orchestra.run.smithi195.stdout:(2/4): libcephsqlite-17.2.7-1406.gdf62bdcc.el9. 585 kB/s | 163 kB 00:00 2024-08-18T22:30:44.970 INFO:teuthology.orchestra.run.smithi195.stdout:(3/4): xmlstarlet-1.6.1-20.el9.x86_64.rpm 770 kB/s | 64 kB 00:00 2024-08-18T22:30:45.023 INFO:teuthology.orchestra.run.smithi121.stdout:(4/4): ceph-test-17.2.7-1406.gdf62bdcc.el9.x86_ 30 MB/s | 48 MB 00:01 2024-08-18T22:30:45.025 INFO:teuthology.orchestra.run.smithi121.stdout:-------------------------------------------------------------------------------- 2024-08-18T22:30:45.026 INFO:teuthology.orchestra.run.smithi121.stdout:Total 26 MB/s | 48 MB 00:01 2024-08-18T22:30:45.053 INFO:teuthology.orchestra.run.smithi121.stdout:Running transaction check 2024-08-18T22:30:45.072 INFO:teuthology.orchestra.run.smithi121.stdout:Transaction check succeeded. 2024-08-18T22:30:45.072 INFO:teuthology.orchestra.run.smithi121.stdout:Running transaction test 2024-08-18T22:30:45.464 INFO:teuthology.orchestra.run.smithi121.stdout:Transaction test succeeded. 2024-08-18T22:30:45.464 INFO:teuthology.orchestra.run.smithi121.stdout:Running transaction 2024-08-18T22:30:45.977 INFO:teuthology.orchestra.run.smithi121.stdout: Preparing : 1/1 2024-08-18T22:30:46.077 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 1/4 2024-08-18T22:30:46.126 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 2/4 2024-08-18T22:30:46.154 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : libcephsqlite-2:17.2.7-1406.gdf62bdcc.el9.x86_64 3/4 2024-08-18T22:30:46.270 INFO:teuthology.orchestra.run.smithi195.stdout:(4/4): ceph-test-17.2.7-1406.gdf62bdcc.el9.x86_ 30 MB/s | 48 MB 00:01 2024-08-18T22:30:46.272 INFO:teuthology.orchestra.run.smithi195.stdout:-------------------------------------------------------------------------------- 2024-08-18T22:30:46.272 INFO:teuthology.orchestra.run.smithi195.stdout:Total 26 MB/s | 48 MB 00:01 2024-08-18T22:30:46.301 INFO:teuthology.orchestra.run.smithi195.stdout:Running transaction check 2024-08-18T22:30:46.320 INFO:teuthology.orchestra.run.smithi195.stdout:Transaction check succeeded. 2024-08-18T22:30:46.320 INFO:teuthology.orchestra.run.smithi195.stdout:Running transaction test 2024-08-18T22:30:46.717 INFO:teuthology.orchestra.run.smithi195.stdout:Transaction test succeeded. 2024-08-18T22:30:46.718 INFO:teuthology.orchestra.run.smithi195.stdout:Running transaction 2024-08-18T22:30:47.236 INFO:teuthology.orchestra.run.smithi195.stdout: Preparing : 1/1 2024-08-18T22:30:47.322 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 1/4 2024-08-18T22:30:47.363 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 2/4 2024-08-18T22:30:47.391 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : libcephsqlite-2:17.2.7-1406.gdf62bdcc.el9.x86_64 3/4 2024-08-18T22:30:50.533 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: libcephsqlite-2:17.2.7-1406.gdf62bdcc.el9.x86_64 3/4 2024-08-18T22:30:50.617 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : ceph-test-2:17.2.7-1406.gdf62bdcc.el9.x86_64 4/4 2024-08-18T22:30:51.768 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: libcephsqlite-2:17.2.7-1406.gdf62bdcc.el9.x86_64 3/4 2024-08-18T22:30:51.838 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-test-2:17.2.7-1406.gdf62bdcc.el9.x86_64 4/4 2024-08-18T22:30:52.845 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: ceph-test-2:17.2.7-1406.gdf62bdcc.el9.x86_64 4/4 2024-08-18T22:30:52.845 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : ceph-test-2:17.2.7-1406.gdf62bdcc.el9.x86_64 1/4 2024-08-18T22:30:52.845 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : libcephsqlite-2:17.2.7-1406.gdf62bdcc.el9.x86_64 2/4 2024-08-18T22:30:52.845 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 3/4 2024-08-18T22:30:53.112 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 4/4 2024-08-18T22:30:53.112 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-08-18T22:30:53.112 INFO:teuthology.orchestra.run.smithi121.stdout:Installed: 2024-08-18T22:30:53.112 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-test-2:17.2.7-1406.gdf62bdcc.el9.x86_64 2024-08-18T22:30:53.112 INFO:teuthology.orchestra.run.smithi121.stdout: libcephsqlite-2:17.2.7-1406.gdf62bdcc.el9.x86_64 2024-08-18T22:30:53.113 INFO:teuthology.orchestra.run.smithi121.stdout: socat-1.7.4.1-6.el9.x86_64 2024-08-18T22:30:53.113 INFO:teuthology.orchestra.run.smithi121.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-08-18T22:30:53.113 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-08-18T22:30:53.113 INFO:teuthology.orchestra.run.smithi121.stdout:Complete! 2024-08-18T22:30:53.393 DEBUG:teuthology.orchestra.run.smithi121:> sudo yum -y install ceph 2024-08-18T22:30:53.934 INFO:teuthology.orchestra.run.smithi121.stdout:Last metadata expiration check: 0:00:36 ago on Sun 18 Aug 2024 10:30:17 PM UTC. 2024-08-18T22:30:54.059 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: ceph-test-2:17.2.7-1406.gdf62bdcc.el9.x86_64 4/4 2024-08-18T22:30:54.060 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-test-2:17.2.7-1406.gdf62bdcc.el9.x86_64 1/4 2024-08-18T22:30:54.060 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : libcephsqlite-2:17.2.7-1406.gdf62bdcc.el9.x86_64 2/4 2024-08-18T22:30:54.060 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 3/4 2024-08-18T22:30:54.063 INFO:teuthology.orchestra.run.smithi121.stdout:Dependencies resolved. 2024-08-18T22:30:54.065 INFO:teuthology.orchestra.run.smithi121.stdout:================================================================================ 2024-08-18T22:30:54.065 INFO:teuthology.orchestra.run.smithi121.stdout: Package Arch Version Repository Size 2024-08-18T22:30:54.065 INFO:teuthology.orchestra.run.smithi121.stdout:================================================================================ 2024-08-18T22:30:54.066 INFO:teuthology.orchestra.run.smithi121.stdout:Installing: 2024-08-18T22:30:54.066 INFO:teuthology.orchestra.run.smithi121.stdout: ceph x86_64 2:17.2.7-1406.gdf62bdcc.el9 ceph 6.5 k 2024-08-18T22:30:54.066 INFO:teuthology.orchestra.run.smithi121.stdout:Installing dependencies: 2024-08-18T22:30:54.066 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-mds x86_64 2:17.2.7-1406.gdf62bdcc.el9 ceph 2.1 M 2024-08-18T22:30:54.066 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-mgr x86_64 2:17.2.7-1406.gdf62bdcc.el9 ceph 1.4 M 2024-08-18T22:30:54.066 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-mgr-modules-core noarch 2:17.2.7-1406.gdf62bdcc.el9 ceph-noarch 240 k 2024-08-18T22:30:54.066 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-mon x86_64 2:17.2.7-1406.gdf62bdcc.el9 ceph 3.9 M 2024-08-18T22:30:54.066 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-osd x86_64 2:17.2.7-1406.gdf62bdcc.el9 ceph 15 M 2024-08-18T22:30:54.067 INFO:teuthology.orchestra.run.smithi121.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-08-18T22:30:54.067 INFO:teuthology.orchestra.run.smithi121.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-08-18T22:30:54.067 INFO:teuthology.orchestra.run.smithi121.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-08-18T22:30:54.067 INFO:teuthology.orchestra.run.smithi121.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-08-18T22:30:54.067 INFO:teuthology.orchestra.run.smithi121.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-08-18T22:30:54.067 INFO:teuthology.orchestra.run.smithi121.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-08-18T22:30:54.067 INFO:teuthology.orchestra.run.smithi121.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-08-18T22:30:54.067 INFO:teuthology.orchestra.run.smithi121.stdout: python3-jaraco-collections 2024-08-18T22:30:54.067 INFO:teuthology.orchestra.run.smithi121.stdout: noarch 3.0.0-8.el9 epel 23 k 2024-08-18T22:30:54.067 INFO:teuthology.orchestra.run.smithi121.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-08-18T22:30:54.067 INFO:teuthology.orchestra.run.smithi121.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-08-18T22:30:54.067 INFO:teuthology.orchestra.run.smithi121.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-08-18T22:30:54.068 INFO:teuthology.orchestra.run.smithi121.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-08-18T22:30:54.068 INFO:teuthology.orchestra.run.smithi121.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-08-18T22:30:54.068 INFO:teuthology.orchestra.run.smithi121.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-08-18T22:30:54.068 INFO:teuthology.orchestra.run.smithi121.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-08-18T22:30:54.068 INFO:teuthology.orchestra.run.smithi121.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-08-18T22:30:54.068 INFO:teuthology.orchestra.run.smithi121.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-08-18T22:30:54.068 INFO:teuthology.orchestra.run.smithi121.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-08-18T22:30:54.068 INFO:teuthology.orchestra.run.smithi121.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-08-18T22:30:54.069 INFO:teuthology.orchestra.run.smithi121.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-08-18T22:30:54.069 INFO:teuthology.orchestra.run.smithi121.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-08-18T22:30:54.069 INFO:teuthology.orchestra.run.smithi121.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-08-18T22:30:54.069 INFO:teuthology.orchestra.run.smithi121.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-08-18T22:30:54.069 INFO:teuthology.orchestra.run.smithi121.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-08-18T22:30:54.069 INFO:teuthology.orchestra.run.smithi121.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-08-18T22:30:54.069 INFO:teuthology.orchestra.run.smithi121.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-08-18T22:30:54.069 INFO:teuthology.orchestra.run.smithi121.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-08-18T22:30:54.069 INFO:teuthology.orchestra.run.smithi121.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-08-18T22:30:54.069 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-08-18T22:30:54.069 INFO:teuthology.orchestra.run.smithi121.stdout:Transaction Summary 2024-08-18T22:30:54.070 INFO:teuthology.orchestra.run.smithi121.stdout:================================================================================ 2024-08-18T22:30:54.070 INFO:teuthology.orchestra.run.smithi121.stdout:Install 34 Packages 2024-08-18T22:30:54.070 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-08-18T22:30:54.070 INFO:teuthology.orchestra.run.smithi121.stdout:Total download size: 27 M 2024-08-18T22:30:54.071 INFO:teuthology.orchestra.run.smithi121.stdout:Installed size: 96 M 2024-08-18T22:30:54.071 INFO:teuthology.orchestra.run.smithi121.stdout:Downloading Packages: 2024-08-18T22:30:54.319 INFO:teuthology.orchestra.run.smithi121.stdout:(1/34): ceph-17.2.7-1406.gdf62bdcc.el9.x86_64.r 50 kB/s | 6.5 kB 00:00 2024-08-18T22:30:54.352 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 4/4 2024-08-18T22:30:54.352 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-08-18T22:30:54.352 INFO:teuthology.orchestra.run.smithi195.stdout:Installed: 2024-08-18T22:30:54.352 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-test-2:17.2.7-1406.gdf62bdcc.el9.x86_64 2024-08-18T22:30:54.353 INFO:teuthology.orchestra.run.smithi195.stdout: libcephsqlite-2:17.2.7-1406.gdf62bdcc.el9.x86_64 2024-08-18T22:30:54.353 INFO:teuthology.orchestra.run.smithi195.stdout: socat-1.7.4.1-6.el9.x86_64 2024-08-18T22:30:54.353 INFO:teuthology.orchestra.run.smithi195.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-08-18T22:30:54.353 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-08-18T22:30:54.353 INFO:teuthology.orchestra.run.smithi195.stdout:Complete! 2024-08-18T22:30:54.461 INFO:teuthology.orchestra.run.smithi121.stdout:(2/34): ceph-mgr-17.2.7-1406.gdf62bdcc.el9.x86_ 5.2 MB/s | 1.4 MB 00:00 2024-08-18T22:30:54.528 INFO:teuthology.orchestra.run.smithi121.stdout:(3/34): ceph-mds-17.2.7-1406.gdf62bdcc.el9.x86_ 6.1 MB/s | 2.1 MB 00:00 2024-08-18T22:30:54.603 INFO:teuthology.orchestra.run.smithi121.stdout:(4/34): ceph-mgr-modules-core-17.2.7-1406.gdf62 3.1 MB/s | 240 kB 00:00 2024-08-18T22:30:54.604 DEBUG:teuthology.orchestra.run.smithi195:> sudo yum -y install ceph 2024-08-18T22:30:54.703 INFO:teuthology.orchestra.run.smithi121.stdout:(5/34): ceph-mon-17.2.7-1406.gdf62bdcc.el9.x86_ 10 MB/s | 3.9 MB 00:00 2024-08-18T22:30:54.979 INFO:teuthology.orchestra.run.smithi121.stdout:(6/34): ceph-osd-17.2.7-1406.gdf62bdcc.el9.x86_ 30 MB/s | 15 MB 00:00 2024-08-18T22:30:55.145 INFO:teuthology.orchestra.run.smithi195.stdout:Last metadata expiration check: 0:00:38 ago on Sun 18 Aug 2024 10:30:17 PM UTC. 2024-08-18T22:30:55.262 INFO:teuthology.orchestra.run.smithi121.stdout:(7/34): python3-ply-3.11-14.el9.noarch.rpm 378 kB/s | 106 kB 00:00 2024-08-18T22:30:55.277 INFO:teuthology.orchestra.run.smithi195.stdout:Dependencies resolved. 2024-08-18T22:30:55.279 INFO:teuthology.orchestra.run.smithi195.stdout:================================================================================ 2024-08-18T22:30:55.279 INFO:teuthology.orchestra.run.smithi195.stdout: Package Arch Version Repository Size 2024-08-18T22:30:55.279 INFO:teuthology.orchestra.run.smithi195.stdout:================================================================================ 2024-08-18T22:30:55.279 INFO:teuthology.orchestra.run.smithi195.stdout:Installing: 2024-08-18T22:30:55.280 INFO:teuthology.orchestra.run.smithi195.stdout: ceph x86_64 2:17.2.7-1406.gdf62bdcc.el9 ceph 6.5 k 2024-08-18T22:30:55.280 INFO:teuthology.orchestra.run.smithi195.stdout:Installing dependencies: 2024-08-18T22:30:55.280 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-mds x86_64 2:17.2.7-1406.gdf62bdcc.el9 ceph 2.1 M 2024-08-18T22:30:55.280 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-mgr x86_64 2:17.2.7-1406.gdf62bdcc.el9 ceph 1.4 M 2024-08-18T22:30:55.280 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-mgr-modules-core noarch 2:17.2.7-1406.gdf62bdcc.el9 ceph-noarch 240 k 2024-08-18T22:30:55.280 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-mon x86_64 2:17.2.7-1406.gdf62bdcc.el9 ceph 3.9 M 2024-08-18T22:30:55.280 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-osd x86_64 2:17.2.7-1406.gdf62bdcc.el9 ceph 15 M 2024-08-18T22:30:55.280 INFO:teuthology.orchestra.run.smithi195.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-08-18T22:30:55.280 INFO:teuthology.orchestra.run.smithi195.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-08-18T22:30:55.280 INFO:teuthology.orchestra.run.smithi195.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-08-18T22:30:55.280 INFO:teuthology.orchestra.run.smithi195.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-08-18T22:30:55.281 INFO:teuthology.orchestra.run.smithi195.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-08-18T22:30:55.281 INFO:teuthology.orchestra.run.smithi195.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-08-18T22:30:55.281 INFO:teuthology.orchestra.run.smithi195.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-08-18T22:30:55.281 INFO:teuthology.orchestra.run.smithi195.stdout: python3-jaraco-collections 2024-08-18T22:30:55.281 INFO:teuthology.orchestra.run.smithi195.stdout: noarch 3.0.0-8.el9 epel 23 k 2024-08-18T22:30:55.281 INFO:teuthology.orchestra.run.smithi195.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-08-18T22:30:55.281 INFO:teuthology.orchestra.run.smithi195.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-08-18T22:30:55.281 INFO:teuthology.orchestra.run.smithi195.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-08-18T22:30:55.281 INFO:teuthology.orchestra.run.smithi195.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-08-18T22:30:55.281 INFO:teuthology.orchestra.run.smithi195.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-08-18T22:30:55.281 INFO:teuthology.orchestra.run.smithi195.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-08-18T22:30:55.282 INFO:teuthology.orchestra.run.smithi195.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-08-18T22:30:55.282 INFO:teuthology.orchestra.run.smithi195.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-08-18T22:30:55.282 INFO:teuthology.orchestra.run.smithi195.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-08-18T22:30:55.282 INFO:teuthology.orchestra.run.smithi195.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-08-18T22:30:55.282 INFO:teuthology.orchestra.run.smithi195.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-08-18T22:30:55.282 INFO:teuthology.orchestra.run.smithi195.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-08-18T22:30:55.282 INFO:teuthology.orchestra.run.smithi195.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-08-18T22:30:55.282 INFO:teuthology.orchestra.run.smithi195.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-08-18T22:30:55.282 INFO:teuthology.orchestra.run.smithi195.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-08-18T22:30:55.282 INFO:teuthology.orchestra.run.smithi195.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-08-18T22:30:55.282 INFO:teuthology.orchestra.run.smithi195.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-08-18T22:30:55.283 INFO:teuthology.orchestra.run.smithi195.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-08-18T22:30:55.283 INFO:teuthology.orchestra.run.smithi195.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-08-18T22:30:55.283 INFO:teuthology.orchestra.run.smithi195.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-08-18T22:30:55.283 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-08-18T22:30:55.283 INFO:teuthology.orchestra.run.smithi195.stdout:Transaction Summary 2024-08-18T22:30:55.283 INFO:teuthology.orchestra.run.smithi195.stdout:================================================================================ 2024-08-18T22:30:55.283 INFO:teuthology.orchestra.run.smithi195.stdout:Install 34 Packages 2024-08-18T22:30:55.283 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-08-18T22:30:55.284 INFO:teuthology.orchestra.run.smithi195.stdout:Total download size: 27 M 2024-08-18T22:30:55.284 INFO:teuthology.orchestra.run.smithi195.stdout:Installed size: 96 M 2024-08-18T22:30:55.284 INFO:teuthology.orchestra.run.smithi195.stdout:Downloading Packages: 2024-08-18T22:30:55.287 INFO:teuthology.orchestra.run.smithi121.stdout:(8/34): python3-cffi-1.14.5-5.el9.x86_64.rpm 370 kB/s | 253 kB 00:00 2024-08-18T22:30:55.354 INFO:teuthology.orchestra.run.smithi121.stdout:(9/34): python3-cryptography-36.0.1-4.el9.x86_6 1.9 MB/s | 1.2 MB 00:00 2024-08-18T22:30:55.579 INFO:teuthology.orchestra.run.smithi121.stdout:(10/34): python3-pycparser-2.20-6.el9.noarch.rp 426 kB/s | 135 kB 00:00 2024-08-18T22:30:55.605 INFO:teuthology.orchestra.run.smithi121.stdout:(11/34): python3-requests-2.25.1-8.el9.noarch.r 393 kB/s | 125 kB 00:00 2024-08-18T22:30:55.688 INFO:teuthology.orchestra.run.smithi121.stdout:(12/34): python3-urllib3-1.26.5-6.el9.noarch.rp 658 kB/s | 215 kB 00:00 2024-08-18T22:30:55.713 INFO:teuthology.orchestra.run.smithi121.stdout:(13/34): python3-markupsafe-1.1.1-12.el9.x86_64 320 kB/s | 35 kB 00:00 2024-08-18T22:30:55.764 INFO:teuthology.orchestra.run.smithi121.stdout:(14/34): python3-packaging-20.9-5.el9.noarch.rp 1.0 MB/s | 77 kB 00:00 2024-08-18T22:30:55.789 INFO:teuthology.orchestra.run.smithi121.stdout:(15/34): python3-mako-1.1.4-6.el9.noarch.rpm 824 kB/s | 172 kB 00:00 2024-08-18T22:30:55.823 INFO:teuthology.orchestra.run.smithi121.stdout:(16/34): python3-pytz-2021.1-5.el9.noarch.rpm 469 kB/s | 51 kB 00:00 2024-08-18T22:30:55.848 INFO:teuthology.orchestra.run.smithi121.stdout:(17/34): python3-toml-0.10.2-6.el9.noarch.rpm 498 kB/s | 42 kB 00:00 2024-08-18T22:30:55.881 INFO:teuthology.orchestra.run.smithi121.stdout:(18/34): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 471 kB/s | 43 kB 00:00 2024-08-18T22:30:55.900 INFO:teuthology.orchestra.run.smithi121.stdout:(19/34): python3-jaraco-8.2.1-3.el9.noarch.rpm 768 kB/s | 11 kB 00:00 2024-08-18T22:30:55.925 INFO:teuthology.orchestra.run.smithi121.stdout:(20/34): python3-jaraco-classes-3.2.1-5.el9.noa 715 kB/s | 18 kB 00:00 2024-08-18T22:30:55.950 INFO:teuthology.orchestra.run.smithi121.stdout:(21/34): python3-cheroot-8.6.0-4.el9.noarch.rpm 1.7 MB/s | 172 kB 00:00 2024-08-18T22:30:55.976 INFO:teuthology.orchestra.run.smithi121.stdout:(22/34): python3-jaraco-collections-3.0.0-8.el9 458 kB/s | 23 kB 00:00 2024-08-18T22:30:56.001 INFO:teuthology.orchestra.run.smithi121.stdout:(23/34): python3-jaraco-functools-3.5.0-2.el9.n 386 kB/s | 19 kB 00:00 2024-08-18T22:30:56.026 INFO:teuthology.orchestra.run.smithi121.stdout:(24/34): python3-jaraco-text-3.2.0-6.el9.noarch 393 kB/s | 20 kB 00:00 2024-08-18T22:30:56.051 INFO:teuthology.orchestra.run.smithi121.stdout:(25/34): python3-logutils-0.3.5-21.el9.noarch.r 924 kB/s | 46 kB 00:00 2024-08-18T22:30:56.068 INFO:teuthology.orchestra.run.smithi121.stdout:(26/34): python3-more-itertools-8.12.0-2.el9.no 1.8 MB/s | 79 kB 00:00 2024-08-18T22:30:56.093 INFO:teuthology.orchestra.run.smithi121.stdout:(27/34): python3-cherrypy-18.6.1-2.el9.noarch.r 1.4 MB/s | 358 kB 00:00 2024-08-18T22:30:56.119 INFO:teuthology.orchestra.run.smithi121.stdout:(28/34): python3-portend-3.1.0-2.el9.noarch.rpm 328 kB/s | 16 kB 00:00 2024-08-18T22:30:56.124 INFO:teuthology.orchestra.run.smithi195.stdout:(1/34): ceph-17.2.7-1406.gdf62bdcc.el9.x86_64.r 49 kB/s | 6.5 kB 00:00 2024-08-18T22:30:56.144 INFO:teuthology.orchestra.run.smithi121.stdout:(29/34): python3-pyOpenSSL-21.0.0-1.el9.noarch. 1.7 MB/s | 90 kB 00:00 2024-08-18T22:30:56.169 INFO:teuthology.orchestra.run.smithi121.stdout:(30/34): python3-tempora-5.0.0-2.el9.noarch.rpm 711 kB/s | 36 kB 00:00 2024-08-18T22:30:56.195 INFO:teuthology.orchestra.run.smithi121.stdout:(31/34): python3-pecan-1.4.2-3.el9.noarch.rpm 1.9 MB/s | 272 kB 00:00 2024-08-18T22:30:56.220 INFO:teuthology.orchestra.run.smithi121.stdout:(32/34): python3-zc-lockfile-2.0-10.el9.noarch. 806 kB/s | 20 kB 00:00 2024-08-18T22:30:56.245 INFO:teuthology.orchestra.run.smithi121.stdout:(33/34): python3-webob-1.8.7-6.el9.noarch.rpm 2.2 MB/s | 230 kB 00:00 2024-08-18T22:30:56.279 INFO:teuthology.orchestra.run.smithi121.stdout:(34/34): python3-werkzeug-2.0.3-3.el9.1.noarch. 3.8 MB/s | 427 kB 00:00 2024-08-18T22:30:56.283 INFO:teuthology.orchestra.run.smithi121.stdout:-------------------------------------------------------------------------------- 2024-08-18T22:30:56.284 INFO:teuthology.orchestra.run.smithi121.stdout:Total 12 MB/s | 27 MB 00:02 2024-08-18T22:30:56.308 INFO:teuthology.orchestra.run.smithi195.stdout:(2/34): ceph-mgr-17.2.7-1406.gdf62bdcc.el9.x86_ 4.5 MB/s | 1.4 MB 00:00 2024-08-18T22:30:56.358 INFO:teuthology.orchestra.run.smithi195.stdout:(3/34): ceph-mds-17.2.7-1406.gdf62bdcc.el9.x86_ 5.7 MB/s | 2.1 MB 00:00 2024-08-18T22:30:56.416 INFO:teuthology.orchestra.run.smithi121.stdout:Running transaction check 2024-08-18T22:30:56.450 INFO:teuthology.orchestra.run.smithi195.stdout:(4/34): ceph-mgr-modules-core-17.2.7-1406.gdf62 2.6 MB/s | 240 kB 00:00 2024-08-18T22:30:56.452 INFO:teuthology.orchestra.run.smithi121.stdout:Transaction check succeeded. 2024-08-18T22:30:56.452 INFO:teuthology.orchestra.run.smithi121.stdout:Running transaction test 2024-08-18T22:30:56.684 INFO:teuthology.orchestra.run.smithi195.stdout:(5/34): ceph-mon-17.2.7-1406.gdf62bdcc.el9.x86_ 7.0 MB/s | 3.9 MB 00:00 2024-08-18T22:30:56.849 INFO:teuthology.orchestra.run.smithi121.stdout:Transaction test succeeded. 2024-08-18T22:30:56.850 INFO:teuthology.orchestra.run.smithi121.stdout:Running transaction 2024-08-18T22:30:56.850 INFO:teuthology.orchestra.run.smithi195.stdout:(6/34): ceph-osd-17.2.7-1406.gdf62bdcc.el9.x86_ 28 MB/s | 15 MB 00:00 2024-08-18T22:30:57.043 INFO:teuthology.orchestra.run.smithi195.stdout:(7/34): python3-cffi-1.14.5-5.el9.x86_64.rpm 428 kB/s | 253 kB 00:00 2024-08-18T22:30:57.151 INFO:teuthology.orchestra.run.smithi195.stdout:(8/34): python3-pycparser-2.20-6.el9.noarch.rpm 1.2 MB/s | 135 kB 00:00 2024-08-18T22:30:57.259 INFO:teuthology.orchestra.run.smithi195.stdout:(9/34): python3-requests-2.25.1-8.el9.noarch.rp 1.1 MB/s | 125 kB 00:00 2024-08-18T22:30:57.285 INFO:teuthology.orchestra.run.smithi195.stdout:(10/34): python3-ply-3.11-14.el9.noarch.rpm 245 kB/s | 106 kB 00:00 2024-08-18T22:30:57.368 INFO:teuthology.orchestra.run.smithi195.stdout:(11/34): python3-urllib3-1.26.5-6.el9.noarch.rp 1.9 MB/s | 215 kB 00:00 2024-08-18T22:30:57.435 INFO:teuthology.orchestra.run.smithi195.stdout:(12/34): python3-mako-1.1.4-6.el9.noarch.rpm 1.1 MB/s | 172 kB 00:00 2024-08-18T22:30:57.462 INFO:teuthology.orchestra.run.smithi195.stdout:(13/34): python3-markupsafe-1.1.1-12.el9.x86_64 378 kB/s | 35 kB 00:00 2024-08-18T22:30:57.486 INFO:teuthology.orchestra.run.smithi195.stdout:(14/34): python3-packaging-20.9-5.el9.noarch.rp 1.5 MB/s | 77 kB 00:00 2024-08-18T22:30:57.528 INFO:teuthology.orchestra.run.smithi195.stdout:(15/34): python3-pytz-2021.1-5.el9.noarch.rpm 763 kB/s | 51 kB 00:00 2024-08-18T22:30:57.553 INFO:teuthology.orchestra.run.smithi195.stdout:(16/34): python3-toml-0.10.2-6.el9.noarch.rpm 627 kB/s | 42 kB 00:00 2024-08-18T22:30:57.603 INFO:teuthology.orchestra.run.smithi195.stdout:(17/34): python3-cryptography-36.0.1-4.el9.x86_ 1.3 MB/s | 1.2 MB 00:00 2024-08-18T22:30:57.628 INFO:teuthology.orchestra.run.smithi195.stdout:(18/34): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 433 kB/s | 43 kB 00:00 2024-08-18T22:30:57.662 INFO:teuthology.orchestra.run.smithi195.stdout:(19/34): python3-jaraco-8.2.1-3.el9.noarch.rpm 405 kB/s | 11 kB 00:00 2024-08-18T22:30:57.687 INFO:teuthology.orchestra.run.smithi195.stdout:(20/34): python3-cheroot-8.6.0-4.el9.noarch.rpm 1.3 MB/s | 172 kB 00:00 2024-08-18T22:30:57.713 INFO:teuthology.orchestra.run.smithi195.stdout:(21/34): python3-jaraco-classes-3.2.1-5.el9.noa 364 kB/s | 18 kB 00:00 2024-08-18T22:30:57.738 INFO:teuthology.orchestra.run.smithi195.stdout:(22/34): python3-jaraco-collections-3.0.0-8.el9 462 kB/s | 23 kB 00:00 2024-08-18T22:30:57.763 INFO:teuthology.orchestra.run.smithi195.stdout:(23/34): python3-jaraco-functools-3.5.0-2.el9.n 387 kB/s | 19 kB 00:00 2024-08-18T22:30:57.788 INFO:teuthology.orchestra.run.smithi195.stdout:(24/34): python3-jaraco-text-3.2.0-6.el9.noarch 391 kB/s | 20 kB 00:00 2024-08-18T22:30:57.814 INFO:teuthology.orchestra.run.smithi195.stdout:(25/34): python3-logutils-0.3.5-21.el9.noarch.r 926 kB/s | 46 kB 00:00 2024-08-18T22:30:57.830 INFO:teuthology.orchestra.run.smithi195.stdout:(26/34): python3-more-itertools-8.12.0-2.el9.no 1.9 MB/s | 79 kB 00:00 2024-08-18T22:30:57.864 INFO:teuthology.orchestra.run.smithi195.stdout:(27/34): python3-cherrypy-18.6.1-2.el9.noarch.r 1.4 MB/s | 358 kB 00:00 2024-08-18T22:30:57.890 INFO:teuthology.orchestra.run.smithi195.stdout:(28/34): python3-portend-3.1.0-2.el9.noarch.rpm 280 kB/s | 16 kB 00:00 2024-08-18T22:30:57.923 INFO:teuthology.orchestra.run.smithi195.stdout:(29/34): python3-pecan-1.4.2-3.el9.noarch.rpm 2.4 MB/s | 272 kB 00:00 2024-08-18T22:30:57.948 INFO:teuthology.orchestra.run.smithi195.stdout:(30/34): python3-tempora-5.0.0-2.el9.noarch.rpm 612 kB/s | 36 kB 00:00 2024-08-18T22:30:57.982 INFO:teuthology.orchestra.run.smithi195.stdout:(31/34): python3-pyOpenSSL-21.0.0-1.el9.noarch. 763 kB/s | 90 kB 00:00 2024-08-18T22:30:58.008 INFO:teuthology.orchestra.run.smithi195.stdout:(32/34): python3-webob-1.8.7-6.el9.noarch.rpm 2.7 MB/s | 230 kB 00:00 2024-08-18T22:30:58.025 INFO:teuthology.orchestra.run.smithi195.stdout:(33/34): python3-zc-lockfile-2.0-10.el9.noarch. 479 kB/s | 20 kB 00:00 2024-08-18T22:30:58.058 INFO:teuthology.orchestra.run.smithi195.stdout:(34/34): python3-werkzeug-2.0.3-3.el9.1.noarch. 3.8 MB/s | 427 kB 00:00 2024-08-18T22:30:58.062 INFO:teuthology.orchestra.run.smithi195.stdout:-------------------------------------------------------------------------------- 2024-08-18T22:30:58.062 INFO:teuthology.orchestra.run.smithi195.stdout:Total 9.8 MB/s | 27 MB 00:02 2024-08-18T22:30:58.182 INFO:teuthology.orchestra.run.smithi121.stdout: Preparing : 1/1 2024-08-18T22:30:58.186 INFO:teuthology.orchestra.run.smithi195.stdout:Running transaction check 2024-08-18T22:30:58.223 INFO:teuthology.orchestra.run.smithi195.stdout:Transaction check succeeded. 2024-08-18T22:30:58.223 INFO:teuthology.orchestra.run.smithi195.stdout:Running transaction test 2024-08-18T22:30:58.240 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/34 2024-08-18T22:30:58.280 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/34 2024-08-18T22:30:58.329 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 3/34 2024-08-18T22:30:58.440 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 4/34 2024-08-18T22:30:58.519 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 5/34 2024-08-18T22:30:58.567 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 6/34 2024-08-18T22:30:58.602 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 7/34 2024-08-18T22:30:58.608 INFO:teuthology.orchestra.run.smithi195.stdout:Transaction test succeeded. 2024-08-18T22:30:58.609 INFO:teuthology.orchestra.run.smithi195.stdout:Running transaction 2024-08-18T22:30:58.631 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 8/34 2024-08-18T22:30:58.666 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 9/34 2024-08-18T22:30:58.699 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 10/34 2024-08-18T22:30:58.740 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 11/34 2024-08-18T22:30:58.800 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 12/34 2024-08-18T22:30:58.834 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 13/34 2024-08-18T22:30:58.883 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 14/34 2024-08-18T22:30:58.933 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-packaging-20.9-5.el9.noarch 15/34 2024-08-18T22:30:59.005 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 16/34 2024-08-18T22:30:59.161 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 17/34 2024-08-18T22:30:59.240 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 18/34 2024-08-18T22:30:59.302 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 19/34 2024-08-18T22:30:59.339 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 20/34 2024-08-18T22:30:59.396 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-ply-3.11-14.el9.noarch 21/34 2024-08-18T22:30:59.469 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 22/34 2024-08-18T22:30:59.659 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 23/34 2024-08-18T22:30:59.702 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 24/34 2024-08-18T22:30:59.780 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 25/34 2024-08-18T22:30:59.868 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 26/34 2024-08-18T22:30:59.901 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 27/34 2024-08-18T22:30:59.906 INFO:teuthology.orchestra.run.smithi195.stdout: Preparing : 1/1 2024-08-18T22:30:59.953 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/34 2024-08-18T22:30:59.985 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/34 2024-08-18T22:31:00.017 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 28/34 2024-08-18T22:31:00.017 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 3/34 2024-08-18T22:31:00.109 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 4/34 2024-08-18T22:31:00.171 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : ceph-mgr-modules-core-2:17.2.7-1406.gdf62bdcc.el9. 29/34 2024-08-18T22:31:00.195 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 5/34 2024-08-18T22:31:00.203 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : ceph-mgr-2:17.2.7-1406.gdf62bdcc.el9.x86_64 30/34 2024-08-18T22:31:00.230 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: ceph-mgr-2:17.2.7-1406.gdf62bdcc.el9.x86_64 30/34 2024-08-18T22:31:00.230 INFO:teuthology.orchestra.run.smithi121.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-18T22:31:00.230 INFO:teuthology.orchestra.run.smithi121.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-08-18T22:31:00.230 INFO:teuthology.orchestra.run.smithi121.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-08-18T22:31:00.231 INFO:teuthology.orchestra.run.smithi121.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-08-18T22:31:00.231 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-08-18T22:31:00.237 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 6/34 2024-08-18T22:31:00.272 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 7/34 2024-08-18T22:31:00.302 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 8/34 2024-08-18T22:31:00.336 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 9/34 2024-08-18T22:31:00.370 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 10/34 2024-08-18T22:31:00.402 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 11/34 2024-08-18T22:31:00.437 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 12/34 2024-08-18T22:31:00.472 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 13/34 2024-08-18T22:31:00.520 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 14/34 2024-08-18T22:31:00.556 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-packaging-20.9-5.el9.noarch 15/34 2024-08-18T22:31:00.632 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 16/34 2024-08-18T22:31:00.780 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 17/34 2024-08-18T22:31:00.859 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 18/34 2024-08-18T22:31:00.921 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 19/34 2024-08-18T22:31:00.960 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 20/34 2024-08-18T22:31:01.017 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-ply-3.11-14.el9.noarch 21/34 2024-08-18T22:31:01.089 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 22/34 2024-08-18T22:31:01.285 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 23/34 2024-08-18T22:31:01.339 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 24/34 2024-08-18T22:31:01.408 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 25/34 2024-08-18T22:31:01.497 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 26/34 2024-08-18T22:31:01.538 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 27/34 2024-08-18T22:31:01.546 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : ceph-osd-2:17.2.7-1406.gdf62bdcc.el9.x86_64 31/34 2024-08-18T22:31:01.573 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: ceph-osd-2:17.2.7-1406.gdf62bdcc.el9.x86_64 31/34 2024-08-18T22:31:01.573 INFO:teuthology.orchestra.run.smithi121.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-18T22:31:01.573 INFO:teuthology.orchestra.run.smithi121.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-08-18T22:31:01.573 INFO:teuthology.orchestra.run.smithi121.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-08-18T22:31:01.573 INFO:teuthology.orchestra.run.smithi121.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-08-18T22:31:01.573 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-08-18T22:31:01.679 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 28/34 2024-08-18T22:31:01.843 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-mgr-modules-core-2:17.2.7-1406.gdf62bdcc.el9. 29/34 2024-08-18T22:31:01.874 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-mgr-2:17.2.7-1406.gdf62bdcc.el9.x86_64 30/34 2024-08-18T22:31:01.900 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: ceph-mgr-2:17.2.7-1406.gdf62bdcc.el9.x86_64 30/34 2024-08-18T22:31:01.900 INFO:teuthology.orchestra.run.smithi195.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-18T22:31:01.900 INFO:teuthology.orchestra.run.smithi195.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-08-18T22:31:01.900 INFO:teuthology.orchestra.run.smithi195.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-08-18T22:31:01.901 INFO:teuthology.orchestra.run.smithi195.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-08-18T22:31:01.901 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-08-18T22:31:01.946 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : ceph-mon-2:17.2.7-1406.gdf62bdcc.el9.x86_64 32/34 2024-08-18T22:31:01.970 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: ceph-mon-2:17.2.7-1406.gdf62bdcc.el9.x86_64 32/34 2024-08-18T22:31:01.970 INFO:teuthology.orchestra.run.smithi121.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-18T22:31:01.970 INFO:teuthology.orchestra.run.smithi121.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-08-18T22:31:01.970 INFO:teuthology.orchestra.run.smithi121.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-08-18T22:31:01.970 INFO:teuthology.orchestra.run.smithi121.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-08-18T22:31:01.970 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-08-18T22:31:02.180 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : ceph-mds-2:17.2.7-1406.gdf62bdcc.el9.x86_64 33/34 2024-08-18T22:31:02.204 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: ceph-mds-2:17.2.7-1406.gdf62bdcc.el9.x86_64 33/34 2024-08-18T22:31:02.204 INFO:teuthology.orchestra.run.smithi121.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-18T22:31:02.204 INFO:teuthology.orchestra.run.smithi121.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-08-18T22:31:02.204 INFO:teuthology.orchestra.run.smithi121.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-08-18T22:31:02.204 INFO:teuthology.orchestra.run.smithi121.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-08-18T22:31:02.205 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-08-18T22:31:02.267 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : ceph-2:17.2.7-1406.gdf62bdcc.el9.x86_64 34/34 2024-08-18T22:31:03.255 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-osd-2:17.2.7-1406.gdf62bdcc.el9.x86_64 31/34 2024-08-18T22:31:03.282 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: ceph-osd-2:17.2.7-1406.gdf62bdcc.el9.x86_64 31/34 2024-08-18T22:31:03.282 INFO:teuthology.orchestra.run.smithi195.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-18T22:31:03.282 INFO:teuthology.orchestra.run.smithi195.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-08-18T22:31:03.282 INFO:teuthology.orchestra.run.smithi195.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-08-18T22:31:03.282 INFO:teuthology.orchestra.run.smithi195.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-08-18T22:31:03.282 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-08-18T22:31:03.651 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-mon-2:17.2.7-1406.gdf62bdcc.el9.x86_64 32/34 2024-08-18T22:31:03.674 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: ceph-mon-2:17.2.7-1406.gdf62bdcc.el9.x86_64 32/34 2024-08-18T22:31:03.675 INFO:teuthology.orchestra.run.smithi195.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-18T22:31:03.675 INFO:teuthology.orchestra.run.smithi195.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-08-18T22:31:03.675 INFO:teuthology.orchestra.run.smithi195.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-08-18T22:31:03.675 INFO:teuthology.orchestra.run.smithi195.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-08-18T22:31:03.675 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-08-18T22:31:03.885 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-mds-2:17.2.7-1406.gdf62bdcc.el9.x86_64 33/34 2024-08-18T22:31:03.908 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: ceph-mds-2:17.2.7-1406.gdf62bdcc.el9.x86_64 33/34 2024-08-18T22:31:03.908 INFO:teuthology.orchestra.run.smithi195.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-18T22:31:03.908 INFO:teuthology.orchestra.run.smithi195.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-08-18T22:31:03.908 INFO:teuthology.orchestra.run.smithi195.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-08-18T22:31:03.908 INFO:teuthology.orchestra.run.smithi195.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-08-18T22:31:03.909 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-08-18T22:31:03.912 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: ceph-2:17.2.7-1406.gdf62bdcc.el9.x86_64 34/34 2024-08-18T22:31:03.912 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : ceph-2:17.2.7-1406.gdf62bdcc.el9.x86_64 1/34 2024-08-18T22:31:03.912 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : ceph-mds-2:17.2.7-1406.gdf62bdcc.el9.x86_64 2/34 2024-08-18T22:31:03.912 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : ceph-mgr-2:17.2.7-1406.gdf62bdcc.el9.x86_64 3/34 2024-08-18T22:31:03.912 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : ceph-mon-2:17.2.7-1406.gdf62bdcc.el9.x86_64 4/34 2024-08-18T22:31:03.912 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : ceph-osd-2:17.2.7-1406.gdf62bdcc.el9.x86_64 5/34 2024-08-18T22:31:03.912 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : ceph-mgr-modules-core-2:17.2.7-1406.gdf62bdcc.el9. 6/34 2024-08-18T22:31:03.912 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 7/34 2024-08-18T22:31:03.912 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 8/34 2024-08-18T22:31:03.912 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-ply-3.11-14.el9.noarch 9/34 2024-08-18T22:31:03.912 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 10/34 2024-08-18T22:31:03.912 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 11/34 2024-08-18T22:31:03.913 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 12/34 2024-08-18T22:31:03.913 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 13/34 2024-08-18T22:31:03.913 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 14/34 2024-08-18T22:31:03.913 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 15/34 2024-08-18T22:31:03.913 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 16/34 2024-08-18T22:31:03.913 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 17/34 2024-08-18T22:31:03.913 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 18/34 2024-08-18T22:31:03.913 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 19/34 2024-08-18T22:31:03.913 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 20/34 2024-08-18T22:31:03.913 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 21/34 2024-08-18T22:31:03.913 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 22/34 2024-08-18T22:31:03.913 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 23/34 2024-08-18T22:31:03.914 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 24/34 2024-08-18T22:31:03.914 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 25/34 2024-08-18T22:31:03.914 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 26/34 2024-08-18T22:31:03.914 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 27/34 2024-08-18T22:31:03.915 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 28/34 2024-08-18T22:31:03.915 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 29/34 2024-08-18T22:31:03.915 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 30/34 2024-08-18T22:31:03.915 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 31/34 2024-08-18T22:31:03.915 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 32/34 2024-08-18T22:31:03.915 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 33/34 2024-08-18T22:31:03.971 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-2:17.2.7-1406.gdf62bdcc.el9.x86_64 34/34 2024-08-18T22:31:04.865 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 34/34 2024-08-18T22:31:04.865 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-08-18T22:31:04.865 INFO:teuthology.orchestra.run.smithi121.stdout:Installed: 2024-08-18T22:31:04.865 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-2:17.2.7-1406.gdf62bdcc.el9.x86_64 2024-08-18T22:31:04.865 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-mds-2:17.2.7-1406.gdf62bdcc.el9.x86_64 2024-08-18T22:31:04.865 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-mgr-2:17.2.7-1406.gdf62bdcc.el9.x86_64 2024-08-18T22:31:04.865 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-mgr-modules-core-2:17.2.7-1406.gdf62bdcc.el9.noarch 2024-08-18T22:31:04.865 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-mon-2:17.2.7-1406.gdf62bdcc.el9.x86_64 2024-08-18T22:31:04.865 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-osd-2:17.2.7-1406.gdf62bdcc.el9.x86_64 2024-08-18T22:31:04.866 INFO:teuthology.orchestra.run.smithi121.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-08-18T22:31:04.866 INFO:teuthology.orchestra.run.smithi121.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-08-18T22:31:04.866 INFO:teuthology.orchestra.run.smithi121.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-08-18T22:31:04.866 INFO:teuthology.orchestra.run.smithi121.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-08-18T22:31:04.866 INFO:teuthology.orchestra.run.smithi121.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-08-18T22:31:04.866 INFO:teuthology.orchestra.run.smithi121.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-08-18T22:31:04.866 INFO:teuthology.orchestra.run.smithi121.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-08-18T22:31:04.866 INFO:teuthology.orchestra.run.smithi121.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-08-18T22:31:04.866 INFO:teuthology.orchestra.run.smithi121.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-08-18T22:31:04.866 INFO:teuthology.orchestra.run.smithi121.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-08-18T22:31:04.866 INFO:teuthology.orchestra.run.smithi121.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-08-18T22:31:04.866 INFO:teuthology.orchestra.run.smithi121.stdout: python3-mako-1.1.4-6.el9.noarch 2024-08-18T22:31:04.867 INFO:teuthology.orchestra.run.smithi121.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-08-18T22:31:04.867 INFO:teuthology.orchestra.run.smithi121.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-08-18T22:31:04.867 INFO:teuthology.orchestra.run.smithi121.stdout: python3-packaging-20.9-5.el9.noarch 2024-08-18T22:31:04.867 INFO:teuthology.orchestra.run.smithi121.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-08-18T22:31:04.867 INFO:teuthology.orchestra.run.smithi121.stdout: python3-ply-3.11-14.el9.noarch 2024-08-18T22:31:04.867 INFO:teuthology.orchestra.run.smithi121.stdout: python3-portend-3.1.0-2.el9.noarch 2024-08-18T22:31:04.867 INFO:teuthology.orchestra.run.smithi121.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-08-18T22:31:04.867 INFO:teuthology.orchestra.run.smithi121.stdout: python3-pycparser-2.20-6.el9.noarch 2024-08-18T22:31:04.867 INFO:teuthology.orchestra.run.smithi121.stdout: python3-pytz-2021.1-5.el9.noarch 2024-08-18T22:31:04.867 INFO:teuthology.orchestra.run.smithi121.stdout: python3-requests-2.25.1-8.el9.noarch 2024-08-18T22:31:04.867 INFO:teuthology.orchestra.run.smithi121.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-08-18T22:31:04.867 INFO:teuthology.orchestra.run.smithi121.stdout: python3-toml-0.10.2-6.el9.noarch 2024-08-18T22:31:04.867 INFO:teuthology.orchestra.run.smithi121.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-08-18T22:31:04.867 INFO:teuthology.orchestra.run.smithi121.stdout: python3-webob-1.8.7-6.el9.noarch 2024-08-18T22:31:04.868 INFO:teuthology.orchestra.run.smithi121.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-08-18T22:31:04.868 INFO:teuthology.orchestra.run.smithi121.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-08-18T22:31:04.868 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-08-18T22:31:04.868 INFO:teuthology.orchestra.run.smithi121.stdout:Complete! 2024-08-18T22:31:05.233 DEBUG:teuthology.orchestra.run.smithi121:> sudo yum -y install ceph-base 2024-08-18T22:31:05.553 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: ceph-2:17.2.7-1406.gdf62bdcc.el9.x86_64 34/34 2024-08-18T22:31:05.553 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-2:17.2.7-1406.gdf62bdcc.el9.x86_64 1/34 2024-08-18T22:31:05.553 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-mds-2:17.2.7-1406.gdf62bdcc.el9.x86_64 2/34 2024-08-18T22:31:05.553 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-mgr-2:17.2.7-1406.gdf62bdcc.el9.x86_64 3/34 2024-08-18T22:31:05.553 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-mon-2:17.2.7-1406.gdf62bdcc.el9.x86_64 4/34 2024-08-18T22:31:05.553 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-osd-2:17.2.7-1406.gdf62bdcc.el9.x86_64 5/34 2024-08-18T22:31:05.553 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-mgr-modules-core-2:17.2.7-1406.gdf62bdcc.el9. 6/34 2024-08-18T22:31:05.553 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 7/34 2024-08-18T22:31:05.553 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 8/34 2024-08-18T22:31:05.553 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-ply-3.11-14.el9.noarch 9/34 2024-08-18T22:31:05.553 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 10/34 2024-08-18T22:31:05.554 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 11/34 2024-08-18T22:31:05.554 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 12/34 2024-08-18T22:31:05.554 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 13/34 2024-08-18T22:31:05.554 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 14/34 2024-08-18T22:31:05.554 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 15/34 2024-08-18T22:31:05.554 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 16/34 2024-08-18T22:31:05.554 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 17/34 2024-08-18T22:31:05.554 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 18/34 2024-08-18T22:31:05.554 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 19/34 2024-08-18T22:31:05.554 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 20/34 2024-08-18T22:31:05.554 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 21/34 2024-08-18T22:31:05.554 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 22/34 2024-08-18T22:31:05.555 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 23/34 2024-08-18T22:31:05.555 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 24/34 2024-08-18T22:31:05.555 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 25/34 2024-08-18T22:31:05.556 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 26/34 2024-08-18T22:31:05.556 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 27/34 2024-08-18T22:31:05.556 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 28/34 2024-08-18T22:31:05.556 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 29/34 2024-08-18T22:31:05.556 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 30/34 2024-08-18T22:31:05.556 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 31/34 2024-08-18T22:31:05.556 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 32/34 2024-08-18T22:31:05.556 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 33/34 2024-08-18T22:31:05.772 INFO:teuthology.orchestra.run.smithi121.stdout:Last metadata expiration check: 0:00:48 ago on Sun 18 Aug 2024 10:30:17 PM UTC. 2024-08-18T22:31:05.856 INFO:teuthology.orchestra.run.smithi121.stdout:Package ceph-base-2:17.2.7-1406.gdf62bdcc.el9.x86_64 is already installed. 2024-08-18T22:31:05.898 INFO:teuthology.orchestra.run.smithi121.stdout:Dependencies resolved. 2024-08-18T22:31:05.899 INFO:teuthology.orchestra.run.smithi121.stdout:Nothing to do. 2024-08-18T22:31:05.899 INFO:teuthology.orchestra.run.smithi121.stdout:Complete! 2024-08-18T22:31:05.967 DEBUG:teuthology.orchestra.run.smithi121:> sudo yum -y install cephadm 2024-08-18T22:31:06.364 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 34/34 2024-08-18T22:31:06.364 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-08-18T22:31:06.364 INFO:teuthology.orchestra.run.smithi195.stdout:Installed: 2024-08-18T22:31:06.364 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-2:17.2.7-1406.gdf62bdcc.el9.x86_64 2024-08-18T22:31:06.364 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-mds-2:17.2.7-1406.gdf62bdcc.el9.x86_64 2024-08-18T22:31:06.364 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-mgr-2:17.2.7-1406.gdf62bdcc.el9.x86_64 2024-08-18T22:31:06.364 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-mgr-modules-core-2:17.2.7-1406.gdf62bdcc.el9.noarch 2024-08-18T22:31:06.364 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-mon-2:17.2.7-1406.gdf62bdcc.el9.x86_64 2024-08-18T22:31:06.365 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-osd-2:17.2.7-1406.gdf62bdcc.el9.x86_64 2024-08-18T22:31:06.365 INFO:teuthology.orchestra.run.smithi195.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-08-18T22:31:06.365 INFO:teuthology.orchestra.run.smithi195.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-08-18T22:31:06.365 INFO:teuthology.orchestra.run.smithi195.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-08-18T22:31:06.365 INFO:teuthology.orchestra.run.smithi195.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-08-18T22:31:06.365 INFO:teuthology.orchestra.run.smithi195.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-08-18T22:31:06.365 INFO:teuthology.orchestra.run.smithi195.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-08-18T22:31:06.365 INFO:teuthology.orchestra.run.smithi195.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-08-18T22:31:06.365 INFO:teuthology.orchestra.run.smithi195.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-08-18T22:31:06.365 INFO:teuthology.orchestra.run.smithi195.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-08-18T22:31:06.365 INFO:teuthology.orchestra.run.smithi195.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-08-18T22:31:06.365 INFO:teuthology.orchestra.run.smithi195.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-08-18T22:31:06.365 INFO:teuthology.orchestra.run.smithi195.stdout: python3-mako-1.1.4-6.el9.noarch 2024-08-18T22:31:06.366 INFO:teuthology.orchestra.run.smithi195.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-08-18T22:31:06.366 INFO:teuthology.orchestra.run.smithi195.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-08-18T22:31:06.366 INFO:teuthology.orchestra.run.smithi195.stdout: python3-packaging-20.9-5.el9.noarch 2024-08-18T22:31:06.366 INFO:teuthology.orchestra.run.smithi195.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-08-18T22:31:06.366 INFO:teuthology.orchestra.run.smithi195.stdout: python3-ply-3.11-14.el9.noarch 2024-08-18T22:31:06.366 INFO:teuthology.orchestra.run.smithi195.stdout: python3-portend-3.1.0-2.el9.noarch 2024-08-18T22:31:06.366 INFO:teuthology.orchestra.run.smithi195.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-08-18T22:31:06.366 INFO:teuthology.orchestra.run.smithi195.stdout: python3-pycparser-2.20-6.el9.noarch 2024-08-18T22:31:06.366 INFO:teuthology.orchestra.run.smithi195.stdout: python3-pytz-2021.1-5.el9.noarch 2024-08-18T22:31:06.366 INFO:teuthology.orchestra.run.smithi195.stdout: python3-requests-2.25.1-8.el9.noarch 2024-08-18T22:31:06.366 INFO:teuthology.orchestra.run.smithi195.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-08-18T22:31:06.366 INFO:teuthology.orchestra.run.smithi195.stdout: python3-toml-0.10.2-6.el9.noarch 2024-08-18T22:31:06.367 INFO:teuthology.orchestra.run.smithi195.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-08-18T22:31:06.367 INFO:teuthology.orchestra.run.smithi195.stdout: python3-webob-1.8.7-6.el9.noarch 2024-08-18T22:31:06.367 INFO:teuthology.orchestra.run.smithi195.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-08-18T22:31:06.367 INFO:teuthology.orchestra.run.smithi195.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-08-18T22:31:06.367 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-08-18T22:31:06.367 INFO:teuthology.orchestra.run.smithi195.stdout:Complete! 2024-08-18T22:31:06.506 INFO:teuthology.orchestra.run.smithi121.stdout:Last metadata expiration check: 0:00:49 ago on Sun 18 Aug 2024 10:30:17 PM UTC. 2024-08-18T22:31:06.631 INFO:teuthology.orchestra.run.smithi121.stdout:Dependencies resolved. 2024-08-18T22:31:06.631 INFO:teuthology.orchestra.run.smithi121.stdout:================================================================================ 2024-08-18T22:31:06.631 INFO:teuthology.orchestra.run.smithi121.stdout: Package Arch Version Repository Size 2024-08-18T22:31:06.631 INFO:teuthology.orchestra.run.smithi121.stdout:================================================================================ 2024-08-18T22:31:06.632 INFO:teuthology.orchestra.run.smithi121.stdout:Installing: 2024-08-18T22:31:06.632 INFO:teuthology.orchestra.run.smithi121.stdout: cephadm noarch 2:17.2.7-1406.gdf62bdcc.el9 ceph-noarch 83 k 2024-08-18T22:31:06.632 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-08-18T22:31:06.632 INFO:teuthology.orchestra.run.smithi121.stdout:Transaction Summary 2024-08-18T22:31:06.632 INFO:teuthology.orchestra.run.smithi121.stdout:================================================================================ 2024-08-18T22:31:06.632 INFO:teuthology.orchestra.run.smithi121.stdout:Install 1 Package 2024-08-18T22:31:06.632 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-08-18T22:31:06.632 INFO:teuthology.orchestra.run.smithi121.stdout:Total download size: 83 k 2024-08-18T22:31:06.632 INFO:teuthology.orchestra.run.smithi121.stdout:Installed size: 375 k 2024-08-18T22:31:06.632 INFO:teuthology.orchestra.run.smithi121.stdout:Downloading Packages: 2024-08-18T22:31:06.713 DEBUG:teuthology.orchestra.run.smithi195:> sudo yum -y install ceph-base 2024-08-18T22:31:06.821 INFO:teuthology.orchestra.run.smithi121.stdout:cephadm-17.2.7-1406.gdf62bdcc.el9.noarch.rpm 438 kB/s | 83 kB 00:00 2024-08-18T22:31:06.822 INFO:teuthology.orchestra.run.smithi121.stdout:-------------------------------------------------------------------------------- 2024-08-18T22:31:06.822 INFO:teuthology.orchestra.run.smithi121.stdout:Total 434 kB/s | 83 kB 00:00 2024-08-18T22:31:06.822 INFO:teuthology.orchestra.run.smithi121.stdout:Running transaction check 2024-08-18T22:31:06.827 INFO:teuthology.orchestra.run.smithi121.stdout:Transaction check succeeded. 2024-08-18T22:31:06.827 INFO:teuthology.orchestra.run.smithi121.stdout:Running transaction test 2024-08-18T22:31:06.829 INFO:teuthology.orchestra.run.smithi121.stdout:Transaction test succeeded. 2024-08-18T22:31:06.830 INFO:teuthology.orchestra.run.smithi121.stdout:Running transaction 2024-08-18T22:31:06.908 INFO:teuthology.orchestra.run.smithi121.stdout: Preparing : 1/1 2024-08-18T22:31:07.257 INFO:teuthology.orchestra.run.smithi195.stdout:Last metadata expiration check: 0:00:50 ago on Sun 18 Aug 2024 10:30:17 PM UTC. 2024-08-18T22:31:07.342 INFO:teuthology.orchestra.run.smithi195.stdout:Package ceph-base-2:17.2.7-1406.gdf62bdcc.el9.x86_64 is already installed. 2024-08-18T22:31:07.384 INFO:teuthology.orchestra.run.smithi195.stdout:Dependencies resolved. 2024-08-18T22:31:07.385 INFO:teuthology.orchestra.run.smithi195.stdout:Nothing to do. 2024-08-18T22:31:07.385 INFO:teuthology.orchestra.run.smithi195.stdout:Complete! 2024-08-18T22:31:07.405 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: cephadm-2:17.2.7-1406.gdf62bdcc.el9.noarch 1/1 2024-08-18T22:31:07.446 DEBUG:teuthology.orchestra.run.smithi195:> sudo yum -y install cephadm 2024-08-18T22:31:07.507 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : cephadm-2:17.2.7-1406.gdf62bdcc.el9.noarch 1/1 2024-08-18T22:31:07.803 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: cephadm-2:17.2.7-1406.gdf62bdcc.el9.noarch 1/1 2024-08-18T22:31:07.978 INFO:teuthology.orchestra.run.smithi195.stdout:Last metadata expiration check: 0:00:50 ago on Sun 18 Aug 2024 10:30:17 PM UTC. 2024-08-18T22:31:08.053 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : cephadm-2:17.2.7-1406.gdf62bdcc.el9.noarch 1/1 2024-08-18T22:31:08.053 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-08-18T22:31:08.053 INFO:teuthology.orchestra.run.smithi121.stdout:Installed: 2024-08-18T22:31:08.053 INFO:teuthology.orchestra.run.smithi121.stdout: cephadm-2:17.2.7-1406.gdf62bdcc.el9.noarch 2024-08-18T22:31:08.053 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-08-18T22:31:08.054 INFO:teuthology.orchestra.run.smithi121.stdout:Complete! 2024-08-18T22:31:08.104 INFO:teuthology.orchestra.run.smithi195.stdout:Dependencies resolved. 2024-08-18T22:31:08.105 INFO:teuthology.orchestra.run.smithi195.stdout:================================================================================ 2024-08-18T22:31:08.105 INFO:teuthology.orchestra.run.smithi195.stdout: Package Arch Version Repository Size 2024-08-18T22:31:08.105 INFO:teuthology.orchestra.run.smithi195.stdout:================================================================================ 2024-08-18T22:31:08.105 INFO:teuthology.orchestra.run.smithi195.stdout:Installing: 2024-08-18T22:31:08.105 INFO:teuthology.orchestra.run.smithi195.stdout: cephadm noarch 2:17.2.7-1406.gdf62bdcc.el9 ceph-noarch 83 k 2024-08-18T22:31:08.105 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-08-18T22:31:08.105 INFO:teuthology.orchestra.run.smithi195.stdout:Transaction Summary 2024-08-18T22:31:08.105 INFO:teuthology.orchestra.run.smithi195.stdout:================================================================================ 2024-08-18T22:31:08.106 INFO:teuthology.orchestra.run.smithi195.stdout:Install 1 Package 2024-08-18T22:31:08.106 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-08-18T22:31:08.106 INFO:teuthology.orchestra.run.smithi195.stdout:Total download size: 83 k 2024-08-18T22:31:08.106 INFO:teuthology.orchestra.run.smithi195.stdout:Installed size: 375 k 2024-08-18T22:31:08.106 INFO:teuthology.orchestra.run.smithi195.stdout:Downloading Packages: 2024-08-18T22:31:08.277 DEBUG:teuthology.orchestra.run.smithi121:> sudo yum -y install ceph-immutable-object-cache 2024-08-18T22:31:08.292 INFO:teuthology.orchestra.run.smithi195.stdout:cephadm-17.2.7-1406.gdf62bdcc.el9.noarch.rpm 446 kB/s | 83 kB 00:00 2024-08-18T22:31:08.293 INFO:teuthology.orchestra.run.smithi195.stdout:-------------------------------------------------------------------------------- 2024-08-18T22:31:08.293 INFO:teuthology.orchestra.run.smithi195.stdout:Total 442 kB/s | 83 kB 00:00 2024-08-18T22:31:08.293 INFO:teuthology.orchestra.run.smithi195.stdout:Running transaction check 2024-08-18T22:31:08.298 INFO:teuthology.orchestra.run.smithi195.stdout:Transaction check succeeded. 2024-08-18T22:31:08.298 INFO:teuthology.orchestra.run.smithi195.stdout:Running transaction test 2024-08-18T22:31:08.300 INFO:teuthology.orchestra.run.smithi195.stdout:Transaction test succeeded. 2024-08-18T22:31:08.300 INFO:teuthology.orchestra.run.smithi195.stdout:Running transaction 2024-08-18T22:31:08.379 INFO:teuthology.orchestra.run.smithi195.stdout: Preparing : 1/1 2024-08-18T22:31:08.799 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: cephadm-2:17.2.7-1406.gdf62bdcc.el9.noarch 1/1 2024-08-18T22:31:08.821 INFO:teuthology.orchestra.run.smithi121.stdout:Last metadata expiration check: 0:00:51 ago on Sun 18 Aug 2024 10:30:17 PM UTC. 2024-08-18T22:31:08.893 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : cephadm-2:17.2.7-1406.gdf62bdcc.el9.noarch 1/1 2024-08-18T22:31:08.949 INFO:teuthology.orchestra.run.smithi121.stdout:Dependencies resolved. 2024-08-18T22:31:08.950 INFO:teuthology.orchestra.run.smithi121.stdout:================================================================================ 2024-08-18T22:31:08.950 INFO:teuthology.orchestra.run.smithi121.stdout: Package Arch Version Repo Size 2024-08-18T22:31:08.950 INFO:teuthology.orchestra.run.smithi121.stdout:================================================================================ 2024-08-18T22:31:08.950 INFO:teuthology.orchestra.run.smithi121.stdout:Installing: 2024-08-18T22:31:08.950 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-immutable-object-cache x86_64 2:17.2.7-1406.gdf62bdcc.el9 ceph 137 k 2024-08-18T22:31:08.950 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-08-18T22:31:08.951 INFO:teuthology.orchestra.run.smithi121.stdout:Transaction Summary 2024-08-18T22:31:08.951 INFO:teuthology.orchestra.run.smithi121.stdout:================================================================================ 2024-08-18T22:31:08.951 INFO:teuthology.orchestra.run.smithi121.stdout:Install 1 Package 2024-08-18T22:31:08.951 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-08-18T22:31:08.951 INFO:teuthology.orchestra.run.smithi121.stdout:Total download size: 137 k 2024-08-18T22:31:08.951 INFO:teuthology.orchestra.run.smithi121.stdout:Installed size: 379 k 2024-08-18T22:31:08.951 INFO:teuthology.orchestra.run.smithi121.stdout:Downloading Packages: 2024-08-18T22:31:09.144 INFO:teuthology.orchestra.run.smithi121.stdout:ceph-immutable-object-cache-17.2.7-1406.gdf62bd 710 kB/s | 137 kB 00:00 2024-08-18T22:31:09.145 INFO:teuthology.orchestra.run.smithi121.stdout:-------------------------------------------------------------------------------- 2024-08-18T22:31:09.145 INFO:teuthology.orchestra.run.smithi121.stdout:Total 703 kB/s | 137 kB 00:00 2024-08-18T22:31:09.146 INFO:teuthology.orchestra.run.smithi121.stdout:Running transaction check 2024-08-18T22:31:09.154 INFO:teuthology.orchestra.run.smithi121.stdout:Transaction check succeeded. 2024-08-18T22:31:09.154 INFO:teuthology.orchestra.run.smithi121.stdout:Running transaction test 2024-08-18T22:31:09.209 INFO:teuthology.orchestra.run.smithi121.stdout:Transaction test succeeded. 2024-08-18T22:31:09.209 INFO:teuthology.orchestra.run.smithi121.stdout:Running transaction 2024-08-18T22:31:09.217 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: cephadm-2:17.2.7-1406.gdf62bdcc.el9.noarch 1/1 2024-08-18T22:31:09.362 INFO:teuthology.orchestra.run.smithi121.stdout: Preparing : 1/1 2024-08-18T22:31:09.446 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : cephadm-2:17.2.7-1406.gdf62bdcc.el9.noarch 1/1 2024-08-18T22:31:09.446 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-08-18T22:31:09.446 INFO:teuthology.orchestra.run.smithi195.stdout:Installed: 2024-08-18T22:31:09.446 INFO:teuthology.orchestra.run.smithi195.stdout: cephadm-2:17.2.7-1406.gdf62bdcc.el9.noarch 2024-08-18T22:31:09.446 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-08-18T22:31:09.446 INFO:teuthology.orchestra.run.smithi195.stdout:Complete! 2024-08-18T22:31:09.454 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : ceph-immutable-object-cache-2:17.2.7-1406.gdf62bdcc. 1/1 2024-08-18T22:31:09.479 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: ceph-immutable-object-cache-2:17.2.7-1406.gdf62bdcc. 1/1 2024-08-18T22:31:09.479 INFO:teuthology.orchestra.run.smithi121.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-18T22:31:09.479 INFO:teuthology.orchestra.run.smithi121.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-08-18T22:31:09.479 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-08-18T22:31:09.663 DEBUG:teuthology.orchestra.run.smithi195:> sudo yum -y install ceph-immutable-object-cache 2024-08-18T22:31:10.210 INFO:teuthology.orchestra.run.smithi195.stdout:Last metadata expiration check: 0:00:53 ago on Sun 18 Aug 2024 10:30:17 PM UTC. 2024-08-18T22:31:10.338 INFO:teuthology.orchestra.run.smithi195.stdout:Dependencies resolved. 2024-08-18T22:31:10.338 INFO:teuthology.orchestra.run.smithi195.stdout:================================================================================ 2024-08-18T22:31:10.338 INFO:teuthology.orchestra.run.smithi195.stdout: Package Arch Version Repo Size 2024-08-18T22:31:10.339 INFO:teuthology.orchestra.run.smithi195.stdout:================================================================================ 2024-08-18T22:31:10.339 INFO:teuthology.orchestra.run.smithi195.stdout:Installing: 2024-08-18T22:31:10.339 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-immutable-object-cache x86_64 2:17.2.7-1406.gdf62bdcc.el9 ceph 137 k 2024-08-18T22:31:10.339 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-08-18T22:31:10.339 INFO:teuthology.orchestra.run.smithi195.stdout:Transaction Summary 2024-08-18T22:31:10.339 INFO:teuthology.orchestra.run.smithi195.stdout:================================================================================ 2024-08-18T22:31:10.339 INFO:teuthology.orchestra.run.smithi195.stdout:Install 1 Package 2024-08-18T22:31:10.339 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-08-18T22:31:10.339 INFO:teuthology.orchestra.run.smithi195.stdout:Total download size: 137 k 2024-08-18T22:31:10.339 INFO:teuthology.orchestra.run.smithi195.stdout:Installed size: 379 k 2024-08-18T22:31:10.339 INFO:teuthology.orchestra.run.smithi195.stdout:Downloading Packages: 2024-08-18T22:31:10.401 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : ceph-immutable-object-cache-2:17.2.7-1406.gdf62bdcc. 1/1 2024-08-18T22:31:10.401 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-08-18T22:31:10.401 INFO:teuthology.orchestra.run.smithi121.stdout:Installed: 2024-08-18T22:31:10.401 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-immutable-object-cache-2:17.2.7-1406.gdf62bdcc.el9.x86_64 2024-08-18T22:31:10.401 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-08-18T22:31:10.401 INFO:teuthology.orchestra.run.smithi121.stdout:Complete! 2024-08-18T22:31:10.514 INFO:teuthology.orchestra.run.smithi195.stdout:ceph-immutable-object-cache-17.2.7-1406.gdf62bd 789 kB/s | 137 kB 00:00 2024-08-18T22:31:10.514 INFO:teuthology.orchestra.run.smithi195.stdout:-------------------------------------------------------------------------------- 2024-08-18T22:31:10.515 INFO:teuthology.orchestra.run.smithi195.stdout:Total 780 kB/s | 137 kB 00:00 2024-08-18T22:31:10.515 INFO:teuthology.orchestra.run.smithi195.stdout:Running transaction check 2024-08-18T22:31:10.523 INFO:teuthology.orchestra.run.smithi195.stdout:Transaction check succeeded. 2024-08-18T22:31:10.523 INFO:teuthology.orchestra.run.smithi195.stdout:Running transaction test 2024-08-18T22:31:10.580 INFO:teuthology.orchestra.run.smithi195.stdout:Transaction test succeeded. 2024-08-18T22:31:10.580 INFO:teuthology.orchestra.run.smithi195.stdout:Running transaction 2024-08-18T22:31:10.639 DEBUG:teuthology.orchestra.run.smithi121:> sudo yum -y install ceph-mgr 2024-08-18T22:31:10.734 INFO:teuthology.orchestra.run.smithi195.stdout: Preparing : 1/1 2024-08-18T22:31:10.815 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-immutable-object-cache-2:17.2.7-1406.gdf62bdcc. 1/1 2024-08-18T22:31:10.840 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: ceph-immutable-object-cache-2:17.2.7-1406.gdf62bdcc. 1/1 2024-08-18T22:31:10.840 INFO:teuthology.orchestra.run.smithi195.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-18T22:31:10.840 INFO:teuthology.orchestra.run.smithi195.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-08-18T22:31:10.840 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-08-18T22:31:11.180 INFO:teuthology.orchestra.run.smithi121.stdout:Last metadata expiration check: 0:00:54 ago on Sun 18 Aug 2024 10:30:17 PM UTC. 2024-08-18T22:31:11.266 INFO:teuthology.orchestra.run.smithi121.stdout:Package ceph-mgr-2:17.2.7-1406.gdf62bdcc.el9.x86_64 is already installed. 2024-08-18T22:31:11.308 INFO:teuthology.orchestra.run.smithi121.stdout:Dependencies resolved. 2024-08-18T22:31:11.309 INFO:teuthology.orchestra.run.smithi121.stdout:Nothing to do. 2024-08-18T22:31:11.309 INFO:teuthology.orchestra.run.smithi121.stdout:Complete! 2024-08-18T22:31:11.377 DEBUG:teuthology.orchestra.run.smithi121:> sudo yum -y install ceph-mgr-dashboard 2024-08-18T22:31:11.701 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-immutable-object-cache-2:17.2.7-1406.gdf62bdcc. 1/1 2024-08-18T22:31:11.701 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-08-18T22:31:11.701 INFO:teuthology.orchestra.run.smithi195.stdout:Installed: 2024-08-18T22:31:11.701 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-immutable-object-cache-2:17.2.7-1406.gdf62bdcc.el9.x86_64 2024-08-18T22:31:11.702 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-08-18T22:31:11.702 INFO:teuthology.orchestra.run.smithi195.stdout:Complete! 2024-08-18T22:31:11.908 DEBUG:teuthology.orchestra.run.smithi195:> sudo yum -y install ceph-mgr 2024-08-18T22:31:11.912 INFO:teuthology.orchestra.run.smithi121.stdout:Last metadata expiration check: 0:00:54 ago on Sun 18 Aug 2024 10:30:17 PM UTC. 2024-08-18T22:31:12.037 INFO:teuthology.orchestra.run.smithi121.stdout:Dependencies resolved. 2024-08-18T22:31:12.038 INFO:teuthology.orchestra.run.smithi121.stdout:================================================================================ 2024-08-18T22:31:12.038 INFO:teuthology.orchestra.run.smithi121.stdout: Package Arch Version Repository Size 2024-08-18T22:31:12.038 INFO:teuthology.orchestra.run.smithi121.stdout:================================================================================ 2024-08-18T22:31:12.038 INFO:teuthology.orchestra.run.smithi121.stdout:Installing: 2024-08-18T22:31:12.039 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-mgr-dashboard noarch 2:17.2.7-1406.gdf62bdcc.el9 ceph-noarch 3.4 M 2024-08-18T22:31:12.039 INFO:teuthology.orchestra.run.smithi121.stdout:Installing dependencies: 2024-08-18T22:31:12.039 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-grafana-dashboards noarch 2:17.2.7-1406.gdf62bdcc.el9 ceph-noarch 24 k 2024-08-18T22:31:12.039 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-prometheus-alerts noarch 2:17.2.7-1406.gdf62bdcc.el9 ceph-noarch 15 k 2024-08-18T22:31:12.039 INFO:teuthology.orchestra.run.smithi121.stdout: python3-jwt noarch 2.4.0-1.el9 epel 41 k 2024-08-18T22:31:12.039 INFO:teuthology.orchestra.run.smithi121.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-08-18T22:31:12.039 INFO:teuthology.orchestra.run.smithi121.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-08-18T22:31:12.040 INFO:teuthology.orchestra.run.smithi121.stdout:Installing weak dependencies: 2024-08-18T22:31:12.040 INFO:teuthology.orchestra.run.smithi121.stdout: python3-jwt+crypto noarch 2.4.0-1.el9 epel 9.0 k 2024-08-18T22:31:12.040 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-08-18T22:31:12.040 INFO:teuthology.orchestra.run.smithi121.stdout:Transaction Summary 2024-08-18T22:31:12.040 INFO:teuthology.orchestra.run.smithi121.stdout:================================================================================ 2024-08-18T22:31:12.040 INFO:teuthology.orchestra.run.smithi121.stdout:Install 7 Packages 2024-08-18T22:31:12.040 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-08-18T22:31:12.041 INFO:teuthology.orchestra.run.smithi121.stdout:Total download size: 3.7 M 2024-08-18T22:31:12.041 INFO:teuthology.orchestra.run.smithi121.stdout:Installed size: 80 M 2024-08-18T22:31:12.042 INFO:teuthology.orchestra.run.smithi121.stdout:Downloading Packages: 2024-08-18T22:31:12.265 INFO:teuthology.orchestra.run.smithi121.stdout:(1/7): ceph-grafana-dashboards-17.2.7-1406.gdf6 165 kB/s | 24 kB 00:00 2024-08-18T22:31:12.290 INFO:teuthology.orchestra.run.smithi121.stdout:(2/7): ceph-prometheus-alerts-17.2.7-1406.gdf62 84 kB/s | 15 kB 00:00 2024-08-18T22:31:12.332 INFO:teuthology.orchestra.run.smithi121.stdout:(3/7): python3-jwt+crypto-2.4.0-1.el9.noarch.rp 135 kB/s | 9.0 kB 00:00 2024-08-18T22:31:12.357 INFO:teuthology.orchestra.run.smithi121.stdout:(4/7): python3-repoze-lru-0.7-16.el9.noarch.rpm 1.3 MB/s | 31 kB 00:00 2024-08-18T22:31:12.382 INFO:teuthology.orchestra.run.smithi121.stdout:(5/7): python3-jwt-2.4.0-1.el9.noarch.rpm 444 kB/s | 41 kB 00:00 2024-08-18T22:31:12.407 INFO:teuthology.orchestra.run.smithi121.stdout:(6/7): python3-routes-2.5.1-5.el9.noarch.rpm 3.7 MB/s | 188 kB 00:00 2024-08-18T22:31:12.458 INFO:teuthology.orchestra.run.smithi195.stdout:Last metadata expiration check: 0:00:55 ago on Sun 18 Aug 2024 10:30:17 PM UTC. 2024-08-18T22:31:12.524 INFO:teuthology.orchestra.run.smithi121.stdout:(7/7): ceph-mgr-dashboard-17.2.7-1406.gdf62bdcc 8.2 MB/s | 3.4 MB 00:00 2024-08-18T22:31:12.528 INFO:teuthology.orchestra.run.smithi121.stdout:-------------------------------------------------------------------------------- 2024-08-18T22:31:12.528 INFO:teuthology.orchestra.run.smithi121.stdout:Total 7.5 MB/s | 3.7 MB 00:00 2024-08-18T22:31:12.528 INFO:teuthology.orchestra.run.smithi121.stdout:Running transaction check 2024-08-18T22:31:12.536 INFO:teuthology.orchestra.run.smithi121.stdout:Transaction check succeeded. 2024-08-18T22:31:12.536 INFO:teuthology.orchestra.run.smithi121.stdout:Running transaction test 2024-08-18T22:31:12.546 INFO:teuthology.orchestra.run.smithi195.stdout:Package ceph-mgr-2:17.2.7-1406.gdf62bdcc.el9.x86_64 is already installed. 2024-08-18T22:31:12.589 INFO:teuthology.orchestra.run.smithi195.stdout:Dependencies resolved. 2024-08-18T22:31:12.590 INFO:teuthology.orchestra.run.smithi195.stdout:Nothing to do. 2024-08-18T22:31:12.590 INFO:teuthology.orchestra.run.smithi195.stdout:Complete! 2024-08-18T22:31:12.627 INFO:teuthology.orchestra.run.smithi121.stdout:Transaction test succeeded. 2024-08-18T22:31:12.627 INFO:teuthology.orchestra.run.smithi121.stdout:Running transaction 2024-08-18T22:31:12.654 DEBUG:teuthology.orchestra.run.smithi195:> sudo yum -y install ceph-mgr-dashboard 2024-08-18T22:31:12.933 INFO:teuthology.orchestra.run.smithi121.stdout: Preparing : 1/1 2024-08-18T22:31:13.009 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-jwt-2.4.0-1.el9.noarch 1/7 2024-08-18T22:31:13.043 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-jwt+crypto-2.4.0-1.el9.noarch 2/7 2024-08-18T22:31:13.098 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 3/7 2024-08-18T22:31:13.138 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 4/7 2024-08-18T22:31:13.167 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : ceph-prometheus-alerts-2:17.2.7-1406.gdf62bdcc.el9.n 5/7 2024-08-18T22:31:13.187 INFO:teuthology.orchestra.run.smithi195.stdout:Last metadata expiration check: 0:00:56 ago on Sun 18 Aug 2024 10:30:17 PM UTC. 2024-08-18T22:31:13.315 INFO:teuthology.orchestra.run.smithi195.stdout:Dependencies resolved. 2024-08-18T22:31:13.315 INFO:teuthology.orchestra.run.smithi195.stdout:================================================================================ 2024-08-18T22:31:13.316 INFO:teuthology.orchestra.run.smithi195.stdout: Package Arch Version Repository Size 2024-08-18T22:31:13.316 INFO:teuthology.orchestra.run.smithi195.stdout:================================================================================ 2024-08-18T22:31:13.316 INFO:teuthology.orchestra.run.smithi195.stdout:Installing: 2024-08-18T22:31:13.316 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-mgr-dashboard noarch 2:17.2.7-1406.gdf62bdcc.el9 ceph-noarch 3.4 M 2024-08-18T22:31:13.316 INFO:teuthology.orchestra.run.smithi195.stdout:Installing dependencies: 2024-08-18T22:31:13.316 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-grafana-dashboards noarch 2:17.2.7-1406.gdf62bdcc.el9 ceph-noarch 24 k 2024-08-18T22:31:13.316 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-prometheus-alerts noarch 2:17.2.7-1406.gdf62bdcc.el9 ceph-noarch 15 k 2024-08-18T22:31:13.316 INFO:teuthology.orchestra.run.smithi195.stdout: python3-jwt noarch 2.4.0-1.el9 epel 41 k 2024-08-18T22:31:13.316 INFO:teuthology.orchestra.run.smithi195.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-08-18T22:31:13.316 INFO:teuthology.orchestra.run.smithi195.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-08-18T22:31:13.316 INFO:teuthology.orchestra.run.smithi195.stdout:Installing weak dependencies: 2024-08-18T22:31:13.316 INFO:teuthology.orchestra.run.smithi195.stdout: python3-jwt+crypto noarch 2.4.0-1.el9 epel 9.0 k 2024-08-18T22:31:13.316 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-08-18T22:31:13.317 INFO:teuthology.orchestra.run.smithi195.stdout:Transaction Summary 2024-08-18T22:31:13.317 INFO:teuthology.orchestra.run.smithi195.stdout:================================================================================ 2024-08-18T22:31:13.317 INFO:teuthology.orchestra.run.smithi195.stdout:Install 7 Packages 2024-08-18T22:31:13.317 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-08-18T22:31:13.317 INFO:teuthology.orchestra.run.smithi195.stdout:Total download size: 3.7 M 2024-08-18T22:31:13.317 INFO:teuthology.orchestra.run.smithi195.stdout:Installed size: 80 M 2024-08-18T22:31:13.318 INFO:teuthology.orchestra.run.smithi195.stdout:Downloading Packages: 2024-08-18T22:31:13.634 INFO:teuthology.orchestra.run.smithi195.stdout:(1/7): ceph-prometheus-alerts-17.2.7-1406.gdf62 90 kB/s | 15 kB 00:00 2024-08-18T22:31:13.659 INFO:teuthology.orchestra.run.smithi195.stdout:(2/7): ceph-grafana-dashboards-17.2.7-1406.gdf6 130 kB/s | 24 kB 00:00 2024-08-18T22:31:13.701 INFO:teuthology.orchestra.run.smithi195.stdout:(3/7): python3-jwt+crypto-2.4.0-1.el9.noarch.rp 135 kB/s | 9.0 kB 00:00 2024-08-18T22:31:13.726 INFO:teuthology.orchestra.run.smithi195.stdout:(4/7): python3-jwt-2.4.0-1.el9.noarch.rpm 613 kB/s | 41 kB 00:00 2024-08-18T22:31:13.752 INFO:teuthology.orchestra.run.smithi195.stdout:(5/7): python3-repoze-lru-0.7-16.el9.noarch.rpm 633 kB/s | 31 kB 00:00 2024-08-18T22:31:13.777 INFO:teuthology.orchestra.run.smithi195.stdout:(6/7): python3-routes-2.5.1-5.el9.noarch.rpm 3.7 MB/s | 188 kB 00:00 2024-08-18T22:31:13.844 INFO:teuthology.orchestra.run.smithi195.stdout:(7/7): ceph-mgr-dashboard-17.2.7-1406.gdf62bdcc 9.0 MB/s | 3.4 MB 00:00 2024-08-18T22:31:13.847 INFO:teuthology.orchestra.run.smithi195.stdout:-------------------------------------------------------------------------------- 2024-08-18T22:31:13.848 INFO:teuthology.orchestra.run.smithi195.stdout:Total 6.9 MB/s | 3.7 MB 00:00 2024-08-18T22:31:13.848 INFO:teuthology.orchestra.run.smithi195.stdout:Running transaction check 2024-08-18T22:31:13.856 INFO:teuthology.orchestra.run.smithi195.stdout:Transaction check succeeded. 2024-08-18T22:31:13.856 INFO:teuthology.orchestra.run.smithi195.stdout:Running transaction test 2024-08-18T22:31:13.945 INFO:teuthology.orchestra.run.smithi195.stdout:Transaction test succeeded. 2024-08-18T22:31:13.945 INFO:teuthology.orchestra.run.smithi195.stdout:Running transaction 2024-08-18T22:31:14.160 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : ceph-grafana-dashboards-2:17.2.7-1406.gdf62bdcc.el9. 6/7 2024-08-18T22:31:14.196 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : ceph-mgr-dashboard-2:17.2.7-1406.gdf62bdcc.el9.noarc 7/7 2024-08-18T22:31:14.239 INFO:teuthology.orchestra.run.smithi195.stdout: Preparing : 1/1 2024-08-18T22:31:14.312 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-jwt-2.4.0-1.el9.noarch 1/7 2024-08-18T22:31:14.346 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-jwt+crypto-2.4.0-1.el9.noarch 2/7 2024-08-18T22:31:14.392 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 3/7 2024-08-18T22:31:14.433 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 4/7 2024-08-18T22:31:14.462 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-prometheus-alerts-2:17.2.7-1406.gdf62bdcc.el9.n 5/7 2024-08-18T22:31:15.301 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: ceph-mgr-dashboard-2:17.2.7-1406.gdf62bdcc.el9.noarc 7/7 2024-08-18T22:31:15.301 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : ceph-grafana-dashboards-2:17.2.7-1406.gdf62bdcc.el9. 1/7 2024-08-18T22:31:15.301 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : ceph-mgr-dashboard-2:17.2.7-1406.gdf62bdcc.el9.noarc 2/7 2024-08-18T22:31:15.301 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : ceph-prometheus-alerts-2:17.2.7-1406.gdf62bdcc.el9.n 3/7 2024-08-18T22:31:15.301 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-jwt+crypto-2.4.0-1.el9.noarch 4/7 2024-08-18T22:31:15.301 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-jwt-2.4.0-1.el9.noarch 5/7 2024-08-18T22:31:15.301 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 6/7 2024-08-18T22:31:15.457 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-grafana-dashboards-2:17.2.7-1406.gdf62bdcc.el9. 6/7 2024-08-18T22:31:15.499 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-mgr-dashboard-2:17.2.7-1406.gdf62bdcc.el9.noarc 7/7 2024-08-18T22:31:15.616 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 7/7 2024-08-18T22:31:15.616 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-08-18T22:31:15.616 INFO:teuthology.orchestra.run.smithi121.stdout:Installed: 2024-08-18T22:31:15.616 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-grafana-dashboards-2:17.2.7-1406.gdf62bdcc.el9.noarch 2024-08-18T22:31:15.616 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-mgr-dashboard-2:17.2.7-1406.gdf62bdcc.el9.noarch 2024-08-18T22:31:15.616 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-prometheus-alerts-2:17.2.7-1406.gdf62bdcc.el9.noarch 2024-08-18T22:31:15.616 INFO:teuthology.orchestra.run.smithi121.stdout: python3-jwt-2.4.0-1.el9.noarch 2024-08-18T22:31:15.617 INFO:teuthology.orchestra.run.smithi121.stdout: python3-jwt+crypto-2.4.0-1.el9.noarch 2024-08-18T22:31:15.617 INFO:teuthology.orchestra.run.smithi121.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-08-18T22:31:15.617 INFO:teuthology.orchestra.run.smithi121.stdout: python3-routes-2.5.1-5.el9.noarch 2024-08-18T22:31:15.617 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-08-18T22:31:15.617 INFO:teuthology.orchestra.run.smithi121.stdout:Complete! 2024-08-18T22:31:15.845 DEBUG:teuthology.orchestra.run.smithi121:> sudo yum -y install ceph-mgr-diskprediction-local 2024-08-18T22:31:16.377 INFO:teuthology.orchestra.run.smithi121.stdout:Last metadata expiration check: 0:00:59 ago on Sun 18 Aug 2024 10:30:17 PM UTC. 2024-08-18T22:31:16.486 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: ceph-mgr-dashboard-2:17.2.7-1406.gdf62bdcc.el9.noarc 7/7 2024-08-18T22:31:16.487 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-grafana-dashboards-2:17.2.7-1406.gdf62bdcc.el9. 1/7 2024-08-18T22:31:16.487 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-mgr-dashboard-2:17.2.7-1406.gdf62bdcc.el9.noarc 2/7 2024-08-18T22:31:16.487 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-prometheus-alerts-2:17.2.7-1406.gdf62bdcc.el9.n 3/7 2024-08-18T22:31:16.487 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-jwt+crypto-2.4.0-1.el9.noarch 4/7 2024-08-18T22:31:16.487 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-jwt-2.4.0-1.el9.noarch 5/7 2024-08-18T22:31:16.487 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 6/7 2024-08-18T22:31:16.502 INFO:teuthology.orchestra.run.smithi121.stdout:Dependencies resolved. 2024-08-18T22:31:16.503 INFO:teuthology.orchestra.run.smithi121.stdout:======================================================================================= 2024-08-18T22:31:16.503 INFO:teuthology.orchestra.run.smithi121.stdout: Package Arch Version Repository Size 2024-08-18T22:31:16.503 INFO:teuthology.orchestra.run.smithi121.stdout:======================================================================================= 2024-08-18T22:31:16.503 INFO:teuthology.orchestra.run.smithi121.stdout:Installing: 2024-08-18T22:31:16.503 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-mgr-diskprediction-local noarch 2:17.2.7-1406.gdf62bdcc.el9 ceph-noarch 7.4 M 2024-08-18T22:31:16.504 INFO:teuthology.orchestra.run.smithi121.stdout:Installing dependencies: 2024-08-18T22:31:16.504 INFO:teuthology.orchestra.run.smithi121.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-08-18T22:31:16.504 INFO:teuthology.orchestra.run.smithi121.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-08-18T22:31:16.504 INFO:teuthology.orchestra.run.smithi121.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-08-18T22:31:16.504 INFO:teuthology.orchestra.run.smithi121.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-08-18T22:31:16.504 INFO:teuthology.orchestra.run.smithi121.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-08-18T22:31:16.504 INFO:teuthology.orchestra.run.smithi121.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-08-18T22:31:16.504 INFO:teuthology.orchestra.run.smithi121.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-08-18T22:31:16.504 INFO:teuthology.orchestra.run.smithi121.stdout: python3-devel x86_64 3.9.19-4.el9 appstream 244 k 2024-08-18T22:31:16.504 INFO:teuthology.orchestra.run.smithi121.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-08-18T22:31:16.504 INFO:teuthology.orchestra.run.smithi121.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-08-18T22:31:16.504 INFO:teuthology.orchestra.run.smithi121.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-08-18T22:31:16.504 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-08-18T22:31:16.504 INFO:teuthology.orchestra.run.smithi121.stdout:Transaction Summary 2024-08-18T22:31:16.505 INFO:teuthology.orchestra.run.smithi121.stdout:======================================================================================= 2024-08-18T22:31:16.505 INFO:teuthology.orchestra.run.smithi121.stdout:Install 12 Packages 2024-08-18T22:31:16.505 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-08-18T22:31:16.505 INFO:teuthology.orchestra.run.smithi121.stdout:Total download size: 38 M 2024-08-18T22:31:16.505 INFO:teuthology.orchestra.run.smithi121.stdout:Installed size: 209 M 2024-08-18T22:31:16.505 INFO:teuthology.orchestra.run.smithi121.stdout:Downloading Packages: 2024-08-18T22:31:16.751 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 7/7 2024-08-18T22:31:16.751 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-08-18T22:31:16.751 INFO:teuthology.orchestra.run.smithi195.stdout:Installed: 2024-08-18T22:31:16.751 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-grafana-dashboards-2:17.2.7-1406.gdf62bdcc.el9.noarch 2024-08-18T22:31:16.752 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-mgr-dashboard-2:17.2.7-1406.gdf62bdcc.el9.noarch 2024-08-18T22:31:16.752 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-prometheus-alerts-2:17.2.7-1406.gdf62bdcc.el9.noarch 2024-08-18T22:31:16.752 INFO:teuthology.orchestra.run.smithi195.stdout: python3-jwt-2.4.0-1.el9.noarch 2024-08-18T22:31:16.752 INFO:teuthology.orchestra.run.smithi195.stdout: python3-jwt+crypto-2.4.0-1.el9.noarch 2024-08-18T22:31:16.752 INFO:teuthology.orchestra.run.smithi195.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-08-18T22:31:16.752 INFO:teuthology.orchestra.run.smithi195.stdout: python3-routes-2.5.1-5.el9.noarch 2024-08-18T22:31:16.752 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-08-18T22:31:16.752 INFO:teuthology.orchestra.run.smithi195.stdout:Complete! 2024-08-18T22:31:16.973 DEBUG:teuthology.orchestra.run.smithi195:> sudo yum -y install ceph-mgr-diskprediction-local 2024-08-18T22:31:16.974 INFO:teuthology.orchestra.run.smithi121.stdout:(1/12): libquadmath-11.4.1-3.el9.x86_64.rpm 1.1 MB/s | 195 kB 00:00 2024-08-18T22:31:17.125 INFO:teuthology.orchestra.run.smithi121.stdout:(2/12): libgfortran-11.4.1-3.el9.x86_64.rpm 2.5 MB/s | 803 kB 00:00 2024-08-18T22:31:17.275 INFO:teuthology.orchestra.run.smithi121.stdout:(3/12): ceph-mgr-diskprediction-local-17.2.7-14 16 MB/s | 7.4 MB 00:00 2024-08-18T22:31:17.512 INFO:teuthology.orchestra.run.smithi195.stdout:Last metadata expiration check: 0:01:00 ago on Sun 18 Aug 2024 10:30:17 PM UTC. 2024-08-18T22:31:17.633 INFO:teuthology.orchestra.run.smithi121.stdout:(4/12): flexiblas-3.0.4-8.el9.x86_64.rpm 50 kB/s | 33 kB 00:00 2024-08-18T22:31:17.646 INFO:teuthology.orchestra.run.smithi195.stdout:Dependencies resolved. 2024-08-18T22:31:17.647 INFO:teuthology.orchestra.run.smithi195.stdout:======================================================================================= 2024-08-18T22:31:17.647 INFO:teuthology.orchestra.run.smithi195.stdout: Package Arch Version Repository Size 2024-08-18T22:31:17.648 INFO:teuthology.orchestra.run.smithi195.stdout:======================================================================================= 2024-08-18T22:31:17.648 INFO:teuthology.orchestra.run.smithi195.stdout:Installing: 2024-08-18T22:31:17.648 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-mgr-diskprediction-local noarch 2:17.2.7-1406.gdf62bdcc.el9 ceph-noarch 7.4 M 2024-08-18T22:31:17.648 INFO:teuthology.orchestra.run.smithi195.stdout:Installing dependencies: 2024-08-18T22:31:17.648 INFO:teuthology.orchestra.run.smithi195.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-08-18T22:31:17.648 INFO:teuthology.orchestra.run.smithi195.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-08-18T22:31:17.648 INFO:teuthology.orchestra.run.smithi195.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-08-18T22:31:17.648 INFO:teuthology.orchestra.run.smithi195.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-08-18T22:31:17.648 INFO:teuthology.orchestra.run.smithi195.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-08-18T22:31:17.648 INFO:teuthology.orchestra.run.smithi195.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-08-18T22:31:17.648 INFO:teuthology.orchestra.run.smithi195.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-08-18T22:31:17.648 INFO:teuthology.orchestra.run.smithi195.stdout: python3-devel x86_64 3.9.19-4.el9 appstream 244 k 2024-08-18T22:31:17.648 INFO:teuthology.orchestra.run.smithi195.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-08-18T22:31:17.649 INFO:teuthology.orchestra.run.smithi195.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-08-18T22:31:17.649 INFO:teuthology.orchestra.run.smithi195.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-08-18T22:31:17.649 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-08-18T22:31:17.649 INFO:teuthology.orchestra.run.smithi195.stdout:Transaction Summary 2024-08-18T22:31:17.649 INFO:teuthology.orchestra.run.smithi195.stdout:======================================================================================= 2024-08-18T22:31:17.649 INFO:teuthology.orchestra.run.smithi195.stdout:Install 12 Packages 2024-08-18T22:31:17.649 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-08-18T22:31:17.650 INFO:teuthology.orchestra.run.smithi195.stdout:Total download size: 38 M 2024-08-18T22:31:17.650 INFO:teuthology.orchestra.run.smithi195.stdout:Installed size: 209 M 2024-08-18T22:31:17.650 INFO:teuthology.orchestra.run.smithi195.stdout:Downloading Packages: 2024-08-18T22:31:17.759 INFO:teuthology.orchestra.run.smithi121.stdout:(5/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 38 kB/s | 18 kB 00:00 2024-08-18T22:31:18.184 INFO:teuthology.orchestra.run.smithi121.stdout:(6/12): openblas-0.3.21-2.el9.x86_64.rpm 64 kB/s | 35 kB 00:00 2024-08-18T22:31:18.276 INFO:teuthology.orchestra.run.smithi121.stdout:(7/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 2.6 MB/s | 3.0 MB 00:01 2024-08-18T22:31:18.420 INFO:teuthology.orchestra.run.smithi195.stdout:(1/12): ceph-mgr-diskprediction-local-17.2.7-14 16 MB/s | 7.4 MB 00:00 2024-08-18T22:31:18.486 INFO:teuthology.orchestra.run.smithi195.stdout:(2/12): libquadmath-11.4.1-3.el9.x86_64.rpm 365 kB/s | 195 kB 00:00 2024-08-18T22:31:18.578 INFO:teuthology.orchestra.run.smithi195.stdout:(3/12): flexiblas-3.0.4-8.el9.x86_64.rpm 206 kB/s | 33 kB 00:00 2024-08-18T22:31:18.654 INFO:teuthology.orchestra.run.smithi195.stdout:(4/12): libgfortran-11.4.1-3.el9.x86_64.rpm 1.1 MB/s | 803 kB 00:00 2024-08-18T22:31:18.679 INFO:teuthology.orchestra.run.smithi195.stdout:(5/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 181 kB/s | 18 kB 00:00 2024-08-18T22:31:18.762 INFO:teuthology.orchestra.run.smithi195.stdout:(6/12): openblas-0.3.21-2.el9.x86_64.rpm 325 kB/s | 35 kB 00:00 2024-08-18T22:31:18.851 INFO:teuthology.orchestra.run.smithi121.stdout:(8/12): openblas-openmp-0.3.21-2.el9.x86_64.rpm 4.3 MB/s | 4.7 MB 00:01 2024-08-18T22:31:18.905 INFO:teuthology.orchestra.run.smithi195.stdout:(7/12): python3-devel-3.9.19-4.el9.x86_64.rpm 1.7 MB/s | 244 kB 00:00 2024-08-18T22:31:18.976 INFO:teuthology.orchestra.run.smithi121.stdout:(9/12): python3-devel-3.9.19-4.el9.x86_64.rpm 309 kB/s | 244 kB 00:00 2024-08-18T22:31:19.460 INFO:teuthology.orchestra.run.smithi121.stdout:(10/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 4.3 MB/s | 5.1 MB 00:01 2024-08-18T22:31:19.643 INFO:teuthology.orchestra.run.smithi121.stdout:(11/12): python3-numpy-f2py-1.20.1-5.el9.x86_64 317 kB/s | 250 kB 00:00 2024-08-18T22:31:19.721 INFO:teuthology.orchestra.run.smithi195.stdout:(8/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 2.4 MB/s | 3.0 MB 00:01 2024-08-18T22:31:19.863 INFO:teuthology.orchestra.run.smithi195.stdout:(9/12): python3-numpy-f2py-1.20.1-5.el9.x86_64. 1.7 MB/s | 250 kB 00:00 2024-08-18T22:31:20.468 INFO:teuthology.orchestra.run.smithi121.stdout:(12/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 11 MB/s | 16 MB 00:01 2024-08-18T22:31:20.470 INFO:teuthology.orchestra.run.smithi121.stdout:-------------------------------------------------------------------------------- 2024-08-18T22:31:20.470 INFO:teuthology.orchestra.run.smithi121.stdout:Total 9.6 MB/s | 38 MB 00:03 2024-08-18T22:31:20.563 INFO:teuthology.orchestra.run.smithi195.stdout:(10/12): openblas-openmp-0.3.21-2.el9.x86_64.rp 2.5 MB/s | 4.7 MB 00:01 2024-08-18T22:31:20.826 INFO:teuthology.orchestra.run.smithi121.stdout:Running transaction check 2024-08-18T22:31:20.853 INFO:teuthology.orchestra.run.smithi121.stdout:Transaction check succeeded. 2024-08-18T22:31:20.853 INFO:teuthology.orchestra.run.smithi121.stdout:Running transaction test 2024-08-18T22:31:20.864 INFO:teuthology.orchestra.run.smithi195.stdout:(11/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 2.6 MB/s | 5.1 MB 00:01 2024-08-18T22:31:21.348 INFO:teuthology.orchestra.run.smithi121.stdout:Transaction test succeeded. 2024-08-18T22:31:21.349 INFO:teuthology.orchestra.run.smithi121.stdout:Running transaction 2024-08-18T22:31:22.122 INFO:teuthology.orchestra.run.smithi121.stdout: Preparing : 1/1 2024-08-18T22:31:22.191 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 1/12 2024-08-18T22:31:22.233 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 2/12 2024-08-18T22:31:22.255 INFO:teuthology.orchestra.run.smithi195.stdout:(12/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 6.8 MB/s | 16 MB 00:02 2024-08-18T22:31:22.256 INFO:teuthology.orchestra.run.smithi195.stdout:-------------------------------------------------------------------------------- 2024-08-18T22:31:22.256 INFO:teuthology.orchestra.run.smithi195.stdout:Total 8.3 MB/s | 38 MB 00:04 2024-08-18T22:31:22.333 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 3/12 2024-08-18T22:31:22.376 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-devel-3.9.19-4.el9.x86_64 4/12 2024-08-18T22:31:22.552 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : openblas-0.3.21-2.el9.x86_64 5/12 2024-08-18T22:31:22.583 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 6/12 2024-08-18T22:31:22.609 INFO:teuthology.orchestra.run.smithi195.stdout:Running transaction check 2024-08-18T22:31:22.635 INFO:teuthology.orchestra.run.smithi195.stdout:Transaction check succeeded. 2024-08-18T22:31:22.635 INFO:teuthology.orchestra.run.smithi195.stdout:Running transaction test 2024-08-18T22:31:22.671 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-08-18T22:31:23.130 INFO:teuthology.orchestra.run.smithi195.stdout:Transaction test succeeded. 2024-08-18T22:31:23.130 INFO:teuthology.orchestra.run.smithi195.stdout:Running transaction 2024-08-18T22:31:23.368 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-08-18T22:31:23.486 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-08-18T22:31:23.890 INFO:teuthology.orchestra.run.smithi195.stdout: Preparing : 1/1 2024-08-18T22:31:23.959 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 1/12 2024-08-18T22:31:23.996 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 2/12 2024-08-18T22:31:24.086 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 3/12 2024-08-18T22:31:24.130 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-devel-3.9.19-4.el9.x86_64 4/12 2024-08-18T22:31:24.309 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : openblas-0.3.21-2.el9.x86_64 5/12 2024-08-18T22:31:24.337 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 6/12 2024-08-18T22:31:24.422 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-08-18T22:31:24.723 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-08-18T22:31:25.095 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-08-18T22:31:25.225 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-08-18T22:31:25.745 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-08-18T22:31:25.766 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : ceph-mgr-diskprediction-local-2:17.2.7-1406.gdf62b 12/12 2024-08-18T22:31:26.469 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-08-18T22:31:27.495 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-08-18T22:31:27.520 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-mgr-diskprediction-local-2:17.2.7-1406.gdf62b 12/12 2024-08-18T22:31:28.401 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:17.2.7-1406.gdf62b 12/12 2024-08-18T22:31:28.401 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : ceph-mgr-diskprediction-local-2:17.2.7-1406.gdf62b 1/12 2024-08-18T22:31:28.402 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 2/12 2024-08-18T22:31:28.402 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 3/12 2024-08-18T22:31:28.402 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 4/12 2024-08-18T22:31:28.402 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 5/12 2024-08-18T22:31:28.402 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 6/12 2024-08-18T22:31:28.402 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 7/12 2024-08-18T22:31:28.402 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 8/12 2024-08-18T22:31:28.402 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-devel-3.9.19-4.el9.x86_64 9/12 2024-08-18T22:31:28.402 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 10/12 2024-08-18T22:31:28.402 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 11/12 2024-08-18T22:31:28.859 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 12/12 2024-08-18T22:31:28.859 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-08-18T22:31:28.859 INFO:teuthology.orchestra.run.smithi121.stdout:Installed: 2024-08-18T22:31:28.859 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-mgr-diskprediction-local-2:17.2.7-1406.gdf62bdcc.el9.noarch 2024-08-18T22:31:28.859 INFO:teuthology.orchestra.run.smithi121.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-08-18T22:31:28.859 INFO:teuthology.orchestra.run.smithi121.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-08-18T22:31:28.859 INFO:teuthology.orchestra.run.smithi121.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-08-18T22:31:28.859 INFO:teuthology.orchestra.run.smithi121.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-08-18T22:31:28.859 INFO:teuthology.orchestra.run.smithi121.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-08-18T22:31:28.859 INFO:teuthology.orchestra.run.smithi121.stdout: openblas-0.3.21-2.el9.x86_64 2024-08-18T22:31:28.860 INFO:teuthology.orchestra.run.smithi121.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-08-18T22:31:28.860 INFO:teuthology.orchestra.run.smithi121.stdout: python3-devel-3.9.19-4.el9.x86_64 2024-08-18T22:31:28.860 INFO:teuthology.orchestra.run.smithi121.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-08-18T22:31:28.860 INFO:teuthology.orchestra.run.smithi121.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-08-18T22:31:28.860 INFO:teuthology.orchestra.run.smithi121.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-08-18T22:31:28.860 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-08-18T22:31:28.860 INFO:teuthology.orchestra.run.smithi121.stdout:Complete! 2024-08-18T22:31:29.200 DEBUG:teuthology.orchestra.run.smithi121:> sudo yum -y install ceph-mgr-rook 2024-08-18T22:31:29.743 INFO:teuthology.orchestra.run.smithi121.stdout:Last metadata expiration check: 0:01:12 ago on Sun 18 Aug 2024 10:30:17 PM UTC. 2024-08-18T22:31:29.836 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:17.2.7-1406.gdf62b 12/12 2024-08-18T22:31:29.836 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-mgr-diskprediction-local-2:17.2.7-1406.gdf62b 1/12 2024-08-18T22:31:29.836 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 2/12 2024-08-18T22:31:29.836 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 3/12 2024-08-18T22:31:29.837 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 4/12 2024-08-18T22:31:29.837 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 5/12 2024-08-18T22:31:29.837 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 6/12 2024-08-18T22:31:29.837 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 7/12 2024-08-18T22:31:29.837 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 8/12 2024-08-18T22:31:29.837 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-devel-3.9.19-4.el9.x86_64 9/12 2024-08-18T22:31:29.837 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 10/12 2024-08-18T22:31:29.837 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 11/12 2024-08-18T22:31:29.877 INFO:teuthology.orchestra.run.smithi121.stdout:Dependencies resolved. 2024-08-18T22:31:29.878 INFO:teuthology.orchestra.run.smithi121.stdout:================================================================================ 2024-08-18T22:31:29.878 INFO:teuthology.orchestra.run.smithi121.stdout: Package Arch Version Repository Size 2024-08-18T22:31:29.878 INFO:teuthology.orchestra.run.smithi121.stdout:================================================================================ 2024-08-18T22:31:29.878 INFO:teuthology.orchestra.run.smithi121.stdout:Installing: 2024-08-18T22:31:29.878 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-mgr-rook noarch 2:17.2.7-1406.gdf62bdcc.el9 ceph-noarch 47 k 2024-08-18T22:31:29.878 INFO:teuthology.orchestra.run.smithi121.stdout:Installing dependencies: 2024-08-18T22:31:29.878 INFO:teuthology.orchestra.run.smithi121.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-08-18T22:31:29.879 INFO:teuthology.orchestra.run.smithi121.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-08-18T22:31:29.879 INFO:teuthology.orchestra.run.smithi121.stdout: python3-google-auth noarch 1:2.33.0-1.el9 epel 220 k 2024-08-18T22:31:29.879 INFO:teuthology.orchestra.run.smithi121.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-08-18T22:31:29.879 INFO:teuthology.orchestra.run.smithi121.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-08-18T22:31:29.879 INFO:teuthology.orchestra.run.smithi121.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-08-18T22:31:29.879 INFO:teuthology.orchestra.run.smithi121.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-08-18T22:31:29.879 INFO:teuthology.orchestra.run.smithi121.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-08-18T22:31:29.880 INFO:teuthology.orchestra.run.smithi121.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-08-18T22:31:29.880 INFO:teuthology.orchestra.run.smithi121.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-08-18T22:31:29.880 INFO:teuthology.orchestra.run.smithi121.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-08-18T22:31:29.880 INFO:teuthology.orchestra.run.smithi121.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-08-18T22:31:29.880 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-08-18T22:31:29.880 INFO:teuthology.orchestra.run.smithi121.stdout:Transaction Summary 2024-08-18T22:31:29.880 INFO:teuthology.orchestra.run.smithi121.stdout:================================================================================ 2024-08-18T22:31:29.880 INFO:teuthology.orchestra.run.smithi121.stdout:Install 13 Packages 2024-08-18T22:31:29.880 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-08-18T22:31:29.881 INFO:teuthology.orchestra.run.smithi121.stdout:Total download size: 2.2 M 2024-08-18T22:31:29.881 INFO:teuthology.orchestra.run.smithi121.stdout:Installed size: 26 M 2024-08-18T22:31:29.881 INFO:teuthology.orchestra.run.smithi121.stdout:Downloading Packages: 2024-08-18T22:31:30.175 INFO:teuthology.orchestra.run.smithi121.stdout:(1/13): python3-jsonpatch-1.21-16.el9.noarch.rp 215 kB/s | 26 kB 00:00 2024-08-18T22:31:30.200 INFO:teuthology.orchestra.run.smithi121.stdout:(2/13): python3-jsonpointer-2.0-4.el9.noarch.rp 133 kB/s | 19 kB 00:00 2024-08-18T22:31:30.225 INFO:teuthology.orchestra.run.smithi121.stdout:(3/13): ceph-mgr-rook-17.2.7-1406.gdf62bdcc.el9 280 kB/s | 47 kB 00:00 2024-08-18T22:31:30.259 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 12/12 2024-08-18T22:31:30.260 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-08-18T22:31:30.260 INFO:teuthology.orchestra.run.smithi195.stdout:Installed: 2024-08-18T22:31:30.260 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-mgr-diskprediction-local-2:17.2.7-1406.gdf62bdcc.el9.noarch 2024-08-18T22:31:30.260 INFO:teuthology.orchestra.run.smithi195.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-08-18T22:31:30.260 INFO:teuthology.orchestra.run.smithi195.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-08-18T22:31:30.260 INFO:teuthology.orchestra.run.smithi195.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-08-18T22:31:30.260 INFO:teuthology.orchestra.run.smithi195.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-08-18T22:31:30.260 INFO:teuthology.orchestra.run.smithi195.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-08-18T22:31:30.260 INFO:teuthology.orchestra.run.smithi195.stdout: openblas-0.3.21-2.el9.x86_64 2024-08-18T22:31:30.260 INFO:teuthology.orchestra.run.smithi195.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-08-18T22:31:30.260 INFO:teuthology.orchestra.run.smithi195.stdout: python3-devel-3.9.19-4.el9.x86_64 2024-08-18T22:31:30.261 INFO:teuthology.orchestra.run.smithi195.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-08-18T22:31:30.261 INFO:teuthology.orchestra.run.smithi195.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-08-18T22:31:30.261 INFO:teuthology.orchestra.run.smithi195.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-08-18T22:31:30.261 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-08-18T22:31:30.261 INFO:teuthology.orchestra.run.smithi195.stdout:Complete! 2024-08-18T22:31:30.309 INFO:teuthology.orchestra.run.smithi121.stdout:(4/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.4 MB/s | 159 kB 00:00 2024-08-18T22:31:30.334 INFO:teuthology.orchestra.run.smithi121.stdout:(5/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 1.4 MB/s | 222 kB 00:00 2024-08-18T22:31:30.368 INFO:teuthology.orchestra.run.smithi121.stdout:(6/13): python3-requests-oauthlib-1.3.0-12.el9. 915 kB/s | 54 kB 00:00 2024-08-18T22:31:30.401 INFO:teuthology.orchestra.run.smithi121.stdout:(7/13): python3-cachetools-4.2.4-1.el9.noarch.r 480 kB/s | 32 kB 00:00 2024-08-18T22:31:30.435 INFO:teuthology.orchestra.run.smithi121.stdout:(8/13): python3-pyasn1-modules-0.4.8-6.el9.noar 1.3 MB/s | 279 kB 00:00 2024-08-18T22:31:30.460 INFO:teuthology.orchestra.run.smithi121.stdout:(9/13): python3-certifi-2023.05.07-4.el9.noarch 156 kB/s | 14 kB 00:00 2024-08-18T22:31:30.494 INFO:teuthology.orchestra.run.smithi121.stdout:(10/13): python3-google-auth-2.33.0-1.el9.noarc 2.4 MB/s | 220 kB 00:00 2024-08-18T22:31:30.519 INFO:teuthology.orchestra.run.smithi121.stdout:(11/13): python3-rsa-4.9-2.el9.noarch.rpm 1.1 MB/s | 59 kB 00:00 2024-08-18T22:31:30.553 INFO:teuthology.orchestra.run.smithi121.stdout:(12/13): python3-websocket-client-1.2.3-2.el9.n 1.5 MB/s | 90 kB 00:00 2024-08-18T22:31:30.612 INFO:teuthology.orchestra.run.smithi121.stdout:(13/13): python3-kubernetes-26.1.0-2.el9.noarch 5.8 MB/s | 1.0 MB 00:00 2024-08-18T22:31:30.614 INFO:teuthology.orchestra.run.smithi121.stdout:-------------------------------------------------------------------------------- 2024-08-18T22:31:30.614 INFO:teuthology.orchestra.run.smithi121.stdout:Total 3.0 MB/s | 2.2 MB 00:00 2024-08-18T22:31:30.637 DEBUG:teuthology.orchestra.run.smithi195:> sudo yum -y install ceph-mgr-rook 2024-08-18T22:31:30.680 INFO:teuthology.orchestra.run.smithi121.stdout:Running transaction check 2024-08-18T22:31:30.695 INFO:teuthology.orchestra.run.smithi121.stdout:Transaction check succeeded. 2024-08-18T22:31:30.695 INFO:teuthology.orchestra.run.smithi121.stdout:Running transaction test 2024-08-18T22:31:30.782 INFO:teuthology.orchestra.run.smithi121.stdout:Transaction test succeeded. 2024-08-18T22:31:30.782 INFO:teuthology.orchestra.run.smithi121.stdout:Running transaction 2024-08-18T22:31:31.176 INFO:teuthology.orchestra.run.smithi195.stdout:Last metadata expiration check: 0:01:14 ago on Sun 18 Aug 2024 10:30:17 PM UTC. 2024-08-18T22:31:31.276 INFO:teuthology.orchestra.run.smithi121.stdout: Preparing : 1/1 2024-08-18T22:31:31.303 INFO:teuthology.orchestra.run.smithi195.stdout:Dependencies resolved. 2024-08-18T22:31:31.304 INFO:teuthology.orchestra.run.smithi195.stdout:================================================================================ 2024-08-18T22:31:31.304 INFO:teuthology.orchestra.run.smithi195.stdout: Package Arch Version Repository Size 2024-08-18T22:31:31.304 INFO:teuthology.orchestra.run.smithi195.stdout:================================================================================ 2024-08-18T22:31:31.305 INFO:teuthology.orchestra.run.smithi195.stdout:Installing: 2024-08-18T22:31:31.305 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-mgr-rook noarch 2:17.2.7-1406.gdf62bdcc.el9 ceph-noarch 47 k 2024-08-18T22:31:31.305 INFO:teuthology.orchestra.run.smithi195.stdout:Installing dependencies: 2024-08-18T22:31:31.305 INFO:teuthology.orchestra.run.smithi195.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-08-18T22:31:31.305 INFO:teuthology.orchestra.run.smithi195.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-08-18T22:31:31.305 INFO:teuthology.orchestra.run.smithi195.stdout: python3-google-auth noarch 1:2.33.0-1.el9 epel 220 k 2024-08-18T22:31:31.305 INFO:teuthology.orchestra.run.smithi195.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-08-18T22:31:31.305 INFO:teuthology.orchestra.run.smithi195.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-08-18T22:31:31.305 INFO:teuthology.orchestra.run.smithi195.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-08-18T22:31:31.305 INFO:teuthology.orchestra.run.smithi195.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-08-18T22:31:31.305 INFO:teuthology.orchestra.run.smithi195.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-08-18T22:31:31.305 INFO:teuthology.orchestra.run.smithi195.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-08-18T22:31:31.305 INFO:teuthology.orchestra.run.smithi195.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-08-18T22:31:31.306 INFO:teuthology.orchestra.run.smithi195.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-08-18T22:31:31.306 INFO:teuthology.orchestra.run.smithi195.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-08-18T22:31:31.306 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-08-18T22:31:31.306 INFO:teuthology.orchestra.run.smithi195.stdout:Transaction Summary 2024-08-18T22:31:31.306 INFO:teuthology.orchestra.run.smithi195.stdout:================================================================================ 2024-08-18T22:31:31.306 INFO:teuthology.orchestra.run.smithi195.stdout:Install 13 Packages 2024-08-18T22:31:31.306 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-08-18T22:31:31.307 INFO:teuthology.orchestra.run.smithi195.stdout:Total download size: 2.2 M 2024-08-18T22:31:31.307 INFO:teuthology.orchestra.run.smithi195.stdout:Installed size: 26 M 2024-08-18T22:31:31.307 INFO:teuthology.orchestra.run.smithi195.stdout:Downloading Packages: 2024-08-18T22:31:31.445 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-08-18T22:31:31.505 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-08-18T22:31:31.560 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-08-18T22:31:31.597 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-08-18T22:31:31.647 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 5/13 2024-08-18T22:31:31.661 INFO:teuthology.orchestra.run.smithi195.stdout:(1/13): python3-jsonpatch-1.21-16.el9.noarch.rp 334 kB/s | 26 kB 00:00 2024-08-18T22:31:31.728 INFO:teuthology.orchestra.run.smithi195.stdout:(2/13): python3-jsonpointer-2.0-4.el9.noarch.rp 133 kB/s | 19 kB 00:00 2024-08-18T22:31:31.745 INFO:teuthology.orchestra.run.smithi195.stdout:(3/13): ceph-mgr-rook-17.2.7-1406.gdf62bdcc.el9 296 kB/s | 47 kB 00:00 2024-08-18T22:31:31.749 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-08-18T22:31:31.787 INFO:teuthology.orchestra.run.smithi195.stdout:(4/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 1.7 MB/s | 222 kB 00:00 2024-08-18T22:31:31.846 INFO:teuthology.orchestra.run.smithi195.stdout:(5/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.3 MB/s | 159 kB 00:00 2024-08-18T22:31:31.851 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-google-auth-1:2.33.0-1.el9.noarch 7/13 2024-08-18T22:31:31.899 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-08-18T22:31:31.916 INFO:teuthology.orchestra.run.smithi195.stdout:(6/13): python3-cachetools-4.2.4-1.el9.noarch.r 458 kB/s | 32 kB 00:00 2024-08-18T22:31:31.938 INFO:teuthology.orchestra.run.smithi195.stdout:(7/13): python3-requests-oauthlib-1.3.0-12.el9. 357 kB/s | 54 kB 00:00 2024-08-18T22:31:31.955 INFO:teuthology.orchestra.run.smithi195.stdout:(8/13): python3-certifi-2023.05.07-4.el9.noarch 369 kB/s | 14 kB 00:00 2024-08-18T22:31:31.997 INFO:teuthology.orchestra.run.smithi195.stdout:(9/13): python3-pyasn1-modules-0.4.8-6.el9.noar 1.1 MB/s | 279 kB 00:00 2024-08-18T22:31:32.039 INFO:teuthology.orchestra.run.smithi195.stdout:(10/13): python3-google-auth-2.33.0-1.el9.noarc 2.1 MB/s | 220 kB 00:00 2024-08-18T22:31:32.072 INFO:teuthology.orchestra.run.smithi195.stdout:(11/13): python3-websocket-client-1.2.3-2.el9.n 2.8 MB/s | 90 kB 00:00 2024-08-18T22:31:32.089 INFO:teuthology.orchestra.run.smithi195.stdout:(12/13): python3-rsa-4.9-2.el9.noarch.rpm 641 kB/s | 59 kB 00:00 2024-08-18T22:31:32.131 INFO:teuthology.orchestra.run.smithi195.stdout:(13/13): python3-kubernetes-26.1.0-2.el9.noarch 6.0 MB/s | 1.0 MB 00:00 2024-08-18T22:31:32.133 INFO:teuthology.orchestra.run.smithi195.stdout:-------------------------------------------------------------------------------- 2024-08-18T22:31:32.134 INFO:teuthology.orchestra.run.smithi195.stdout:Total 2.7 MB/s | 2.2 MB 00:00 2024-08-18T22:31:32.198 INFO:teuthology.orchestra.run.smithi195.stdout:Running transaction check 2024-08-18T22:31:32.213 INFO:teuthology.orchestra.run.smithi195.stdout:Transaction check succeeded. 2024-08-18T22:31:32.213 INFO:teuthology.orchestra.run.smithi195.stdout:Running transaction test 2024-08-18T22:31:32.298 INFO:teuthology.orchestra.run.smithi195.stdout:Transaction test succeeded. 2024-08-18T22:31:32.300 INFO:teuthology.orchestra.run.smithi195.stdout:Running transaction 2024-08-18T22:31:32.624 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-08-18T22:31:32.679 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-08-18T22:31:32.713 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-08-18T22:31:32.759 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-08-18T22:31:32.783 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : ceph-mgr-rook-2:17.2.7-1406.gdf62bdcc.el9.noarch 13/13 2024-08-18T22:31:32.798 INFO:teuthology.orchestra.run.smithi195.stdout: Preparing : 1/1 2024-08-18T22:31:32.977 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-08-18T22:31:33.032 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-08-18T22:31:33.087 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-08-18T22:31:33.125 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-08-18T22:31:33.166 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 5/13 2024-08-18T22:31:33.267 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-08-18T22:31:33.378 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-google-auth-1:2.33.0-1.el9.noarch 7/13 2024-08-18T22:31:33.426 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-08-18T22:31:33.561 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: ceph-mgr-rook-2:17.2.7-1406.gdf62bdcc.el9.noarch 13/13 2024-08-18T22:31:33.561 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : ceph-mgr-rook-2:17.2.7-1406.gdf62bdcc.el9.noarch 1/13 2024-08-18T22:31:33.561 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-08-18T22:31:33.561 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-08-18T22:31:33.561 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-08-18T22:31:33.561 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-08-18T22:31:33.561 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-08-18T22:31:33.561 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-08-18T22:31:33.561 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-08-18T22:31:33.561 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 9/13 2024-08-18T22:31:33.562 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-google-auth-1:2.33.0-1.el9.noarch 10/13 2024-08-18T22:31:33.562 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-08-18T22:31:33.562 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-08-18T22:31:33.880 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-08-18T22:31:33.880 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-08-18T22:31:33.880 INFO:teuthology.orchestra.run.smithi121.stdout:Installed: 2024-08-18T22:31:33.881 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-mgr-rook-2:17.2.7-1406.gdf62bdcc.el9.noarch 2024-08-18T22:31:33.881 INFO:teuthology.orchestra.run.smithi121.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-08-18T22:31:33.881 INFO:teuthology.orchestra.run.smithi121.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-08-18T22:31:33.881 INFO:teuthology.orchestra.run.smithi121.stdout: python3-google-auth-1:2.33.0-1.el9.noarch 2024-08-18T22:31:33.881 INFO:teuthology.orchestra.run.smithi121.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-08-18T22:31:33.881 INFO:teuthology.orchestra.run.smithi121.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-08-18T22:31:33.881 INFO:teuthology.orchestra.run.smithi121.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-08-18T22:31:33.881 INFO:teuthology.orchestra.run.smithi121.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-08-18T22:31:33.881 INFO:teuthology.orchestra.run.smithi121.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-08-18T22:31:33.881 INFO:teuthology.orchestra.run.smithi121.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-08-18T22:31:33.881 INFO:teuthology.orchestra.run.smithi121.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-08-18T22:31:33.881 INFO:teuthology.orchestra.run.smithi121.stdout: python3-rsa-4.9-2.el9.noarch 2024-08-18T22:31:33.881 INFO:teuthology.orchestra.run.smithi121.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-08-18T22:31:33.881 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-08-18T22:31:33.882 INFO:teuthology.orchestra.run.smithi121.stdout:Complete! 2024-08-18T22:31:34.135 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-08-18T22:31:34.145 DEBUG:teuthology.orchestra.run.smithi121:> sudo yum -y install ceph-mgr-cephadm 2024-08-18T22:31:34.182 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-08-18T22:31:34.215 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-08-18T22:31:34.261 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-08-18T22:31:34.285 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-mgr-rook-2:17.2.7-1406.gdf62bdcc.el9.noarch 13/13 2024-08-18T22:31:34.683 INFO:teuthology.orchestra.run.smithi121.stdout:Last metadata expiration check: 0:01:17 ago on Sun 18 Aug 2024 10:30:17 PM UTC. 2024-08-18T22:31:34.810 INFO:teuthology.orchestra.run.smithi121.stdout:Dependencies resolved. 2024-08-18T22:31:34.811 INFO:teuthology.orchestra.run.smithi121.stdout:================================================================================ 2024-08-18T22:31:34.811 INFO:teuthology.orchestra.run.smithi121.stdout: Package Arch Version Repository Size 2024-08-18T22:31:34.811 INFO:teuthology.orchestra.run.smithi121.stdout:================================================================================ 2024-08-18T22:31:34.811 INFO:teuthology.orchestra.run.smithi121.stdout:Installing: 2024-08-18T22:31:34.811 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-mgr-cephadm noarch 2:17.2.7-1406.gdf62bdcc.el9 ceph-noarch 124 k 2024-08-18T22:31:34.811 INFO:teuthology.orchestra.run.smithi121.stdout:Installing dependencies: 2024-08-18T22:31:34.811 INFO:teuthology.orchestra.run.smithi121.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-08-18T22:31:34.811 INFO:teuthology.orchestra.run.smithi121.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-08-18T22:31:34.812 INFO:teuthology.orchestra.run.smithi121.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-08-18T22:31:34.812 INFO:teuthology.orchestra.run.smithi121.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-08-18T22:31:34.812 INFO:teuthology.orchestra.run.smithi121.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-08-18T22:31:34.812 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-08-18T22:31:34.812 INFO:teuthology.orchestra.run.smithi121.stdout:Transaction Summary 2024-08-18T22:31:34.812 INFO:teuthology.orchestra.run.smithi121.stdout:================================================================================ 2024-08-18T22:31:34.812 INFO:teuthology.orchestra.run.smithi121.stdout:Install 6 Packages 2024-08-18T22:31:34.812 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-08-18T22:31:34.813 INFO:teuthology.orchestra.run.smithi121.stdout:Total download size: 7.0 M 2024-08-18T22:31:34.813 INFO:teuthology.orchestra.run.smithi121.stdout:Installed size: 33 M 2024-08-18T22:31:34.813 INFO:teuthology.orchestra.run.smithi121.stdout:Downloading Packages: 2024-08-18T22:31:34.976 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: ceph-mgr-rook-2:17.2.7-1406.gdf62bdcc.el9.noarch 13/13 2024-08-18T22:31:34.977 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-mgr-rook-2:17.2.7-1406.gdf62bdcc.el9.noarch 1/13 2024-08-18T22:31:34.977 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-08-18T22:31:34.977 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-08-18T22:31:34.977 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-08-18T22:31:34.977 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-08-18T22:31:34.977 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-08-18T22:31:34.977 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-08-18T22:31:34.977 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-08-18T22:31:34.977 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 9/13 2024-08-18T22:31:34.977 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-google-auth-1:2.33.0-1.el9.noarch 10/13 2024-08-18T22:31:34.977 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-08-18T22:31:34.977 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-08-18T22:31:35.231 INFO:teuthology.orchestra.run.smithi121.stdout:(1/6): python3-jinja2-2.11.3-6.el9.noarch.rpm 1.7 MB/s | 248 kB 00:00 2024-08-18T22:31:35.289 INFO:teuthology.orchestra.run.smithi121.stdout:(2/6): python3-asyncssh-2.13.2-5.el9.noarch.rpm 9.2 MB/s | 548 kB 00:00 2024-08-18T22:31:35.306 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-08-18T22:31:35.306 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-08-18T22:31:35.306 INFO:teuthology.orchestra.run.smithi195.stdout:Installed: 2024-08-18T22:31:35.306 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-mgr-rook-2:17.2.7-1406.gdf62bdcc.el9.noarch 2024-08-18T22:31:35.306 INFO:teuthology.orchestra.run.smithi195.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-08-18T22:31:35.306 INFO:teuthology.orchestra.run.smithi195.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-08-18T22:31:35.306 INFO:teuthology.orchestra.run.smithi195.stdout: python3-google-auth-1:2.33.0-1.el9.noarch 2024-08-18T22:31:35.306 INFO:teuthology.orchestra.run.smithi195.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-08-18T22:31:35.306 INFO:teuthology.orchestra.run.smithi195.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-08-18T22:31:35.307 INFO:teuthology.orchestra.run.smithi195.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-08-18T22:31:35.307 INFO:teuthology.orchestra.run.smithi195.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-08-18T22:31:35.307 INFO:teuthology.orchestra.run.smithi195.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-08-18T22:31:35.307 INFO:teuthology.orchestra.run.smithi195.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-08-18T22:31:35.307 INFO:teuthology.orchestra.run.smithi195.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-08-18T22:31:35.307 INFO:teuthology.orchestra.run.smithi195.stdout: python3-rsa-4.9-2.el9.noarch 2024-08-18T22:31:35.307 INFO:teuthology.orchestra.run.smithi195.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-08-18T22:31:35.307 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-08-18T22:31:35.307 INFO:teuthology.orchestra.run.smithi195.stdout:Complete! 2024-08-18T22:31:35.314 INFO:teuthology.orchestra.run.smithi121.stdout:(3/6): python3-natsort-7.1.1-5.el9.noarch.rpm 2.3 MB/s | 58 kB 00:00 2024-08-18T22:31:35.340 INFO:teuthology.orchestra.run.smithi121.stdout:(4/6): ceph-mgr-cephadm-17.2.7-1406.gdf62bdcc.e 500 kB/s | 124 kB 00:00 2024-08-18T22:31:35.365 INFO:teuthology.orchestra.run.smithi121.stdout:(5/6): python3-typing-extensions-4.12.2-2.el9.n 1.4 MB/s | 74 kB 00:00 2024-08-18T22:31:35.457 INFO:teuthology.orchestra.run.smithi121.stdout:(6/6): python3-babel-2.9.1-2.el9.noarch.rpm 16 MB/s | 6.0 MB 00:00 2024-08-18T22:31:35.459 INFO:teuthology.orchestra.run.smithi121.stdout:-------------------------------------------------------------------------------- 2024-08-18T22:31:35.459 INFO:teuthology.orchestra.run.smithi121.stdout:Total 11 MB/s | 7.0 MB 00:00 2024-08-18T22:31:35.531 INFO:teuthology.orchestra.run.smithi121.stdout:Running transaction check 2024-08-18T22:31:35.542 INFO:teuthology.orchestra.run.smithi121.stdout:Transaction check succeeded. 2024-08-18T22:31:35.542 INFO:teuthology.orchestra.run.smithi121.stdout:Running transaction test 2024-08-18T22:31:35.561 DEBUG:teuthology.orchestra.run.smithi195:> sudo yum -y install ceph-mgr-cephadm 2024-08-18T22:31:35.640 INFO:teuthology.orchestra.run.smithi121.stdout:Transaction test succeeded. 2024-08-18T22:31:35.640 INFO:teuthology.orchestra.run.smithi121.stdout:Running transaction 2024-08-18T22:31:35.939 INFO:teuthology.orchestra.run.smithi121.stdout: Preparing : 1/1 2024-08-18T22:31:36.096 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 1/6 2024-08-18T22:31:36.104 INFO:teuthology.orchestra.run.smithi195.stdout:Last metadata expiration check: 0:01:19 ago on Sun 18 Aug 2024 10:30:17 PM UTC. 2024-08-18T22:31:36.150 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/6 2024-08-18T22:31:36.231 INFO:teuthology.orchestra.run.smithi195.stdout:Dependencies resolved. 2024-08-18T22:31:36.232 INFO:teuthology.orchestra.run.smithi195.stdout:================================================================================ 2024-08-18T22:31:36.232 INFO:teuthology.orchestra.run.smithi195.stdout: Package Arch Version Repository Size 2024-08-18T22:31:36.232 INFO:teuthology.orchestra.run.smithi195.stdout:================================================================================ 2024-08-18T22:31:36.232 INFO:teuthology.orchestra.run.smithi195.stdout:Installing: 2024-08-18T22:31:36.233 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-mgr-cephadm noarch 2:17.2.7-1406.gdf62bdcc.el9 ceph-noarch 124 k 2024-08-18T22:31:36.233 INFO:teuthology.orchestra.run.smithi195.stdout:Installing dependencies: 2024-08-18T22:31:36.233 INFO:teuthology.orchestra.run.smithi195.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-08-18T22:31:36.233 INFO:teuthology.orchestra.run.smithi195.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-08-18T22:31:36.233 INFO:teuthology.orchestra.run.smithi195.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-08-18T22:31:36.233 INFO:teuthology.orchestra.run.smithi195.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-08-18T22:31:36.233 INFO:teuthology.orchestra.run.smithi195.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-08-18T22:31:36.233 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-08-18T22:31:36.233 INFO:teuthology.orchestra.run.smithi195.stdout:Transaction Summary 2024-08-18T22:31:36.233 INFO:teuthology.orchestra.run.smithi195.stdout:================================================================================ 2024-08-18T22:31:36.233 INFO:teuthology.orchestra.run.smithi195.stdout:Install 6 Packages 2024-08-18T22:31:36.234 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-08-18T22:31:36.234 INFO:teuthology.orchestra.run.smithi195.stdout:Total download size: 7.0 M 2024-08-18T22:31:36.234 INFO:teuthology.orchestra.run.smithi195.stdout:Installed size: 33 M 2024-08-18T22:31:36.234 INFO:teuthology.orchestra.run.smithi195.stdout:Downloading Packages: 2024-08-18T22:31:36.662 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-08-18T22:31:36.716 INFO:teuthology.orchestra.run.smithi195.stdout:(1/6): ceph-mgr-cephadm-17.2.7-1406.gdf62bdcc.e 625 kB/s | 124 kB 00:00 2024-08-18T22:31:36.741 INFO:teuthology.orchestra.run.smithi195.stdout:(2/6): python3-jinja2-2.11.3-6.el9.noarch.rpm 1.1 MB/s | 248 kB 00:00 2024-08-18T22:31:36.753 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-08-18T22:31:36.800 INFO:teuthology.orchestra.run.smithi195.stdout:(3/6): python3-natsort-7.1.1-5.el9.noarch.rpm 1.1 MB/s | 58 kB 00:00 2024-08-18T22:31:36.817 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 5/6 2024-08-18T22:31:36.825 INFO:teuthology.orchestra.run.smithi195.stdout:(4/6): python3-asyncssh-2.13.2-5.el9.noarch.rpm 4.9 MB/s | 548 kB 00:00 2024-08-18T22:31:36.850 INFO:teuthology.orchestra.run.smithi195.stdout:(5/6): python3-typing-extensions-4.12.2-2.el9.n 1.5 MB/s | 74 kB 00:00 2024-08-18T22:31:36.854 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : ceph-mgr-cephadm-2:17.2.7-1406.gdf62bdcc.el9.noarch 6/6 2024-08-18T22:31:37.585 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: ceph-mgr-cephadm-2:17.2.7-1406.gdf62bdcc.el9.noarch 6/6 2024-08-18T22:31:37.585 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : ceph-mgr-cephadm-2:17.2.7-1406.gdf62bdcc.el9.noarch 1/6 2024-08-18T22:31:37.585 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-08-18T22:31:37.585 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 3/6 2024-08-18T22:31:37.585 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 4/6 2024-08-18T22:31:37.585 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-08-18T22:31:37.838 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 6/6 2024-08-18T22:31:37.838 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-08-18T22:31:37.838 INFO:teuthology.orchestra.run.smithi121.stdout:Installed: 2024-08-18T22:31:37.838 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-mgr-cephadm-2:17.2.7-1406.gdf62bdcc.el9.noarch 2024-08-18T22:31:37.838 INFO:teuthology.orchestra.run.smithi121.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-08-18T22:31:37.838 INFO:teuthology.orchestra.run.smithi121.stdout: python3-babel-2.9.1-2.el9.noarch 2024-08-18T22:31:37.838 INFO:teuthology.orchestra.run.smithi121.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-08-18T22:31:37.838 INFO:teuthology.orchestra.run.smithi121.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-08-18T22:31:37.838 INFO:teuthology.orchestra.run.smithi121.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-08-18T22:31:37.838 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-08-18T22:31:37.838 INFO:teuthology.orchestra.run.smithi121.stdout:Complete! 2024-08-18T22:31:38.125 DEBUG:teuthology.orchestra.run.smithi121:> sudo yum -y install ceph-fuse 2024-08-18T22:31:38.317 INFO:teuthology.orchestra.run.smithi195.stdout:(6/6): python3-babel-2.9.1-2.el9.noarch.rpm 3.3 MB/s | 6.0 MB 00:01 2024-08-18T22:31:38.319 INFO:teuthology.orchestra.run.smithi195.stdout:-------------------------------------------------------------------------------- 2024-08-18T22:31:38.320 INFO:teuthology.orchestra.run.smithi195.stdout:Total 3.4 MB/s | 7.0 MB 00:02 2024-08-18T22:31:38.393 INFO:teuthology.orchestra.run.smithi195.stdout:Running transaction check 2024-08-18T22:31:38.405 INFO:teuthology.orchestra.run.smithi195.stdout:Transaction check succeeded. 2024-08-18T22:31:38.405 INFO:teuthology.orchestra.run.smithi195.stdout:Running transaction test 2024-08-18T22:31:38.503 INFO:teuthology.orchestra.run.smithi195.stdout:Transaction test succeeded. 2024-08-18T22:31:38.504 INFO:teuthology.orchestra.run.smithi195.stdout:Running transaction 2024-08-18T22:31:38.654 INFO:teuthology.orchestra.run.smithi121.stdout:Last metadata expiration check: 0:01:21 ago on Sun 18 Aug 2024 10:30:17 PM UTC. 2024-08-18T22:31:38.780 INFO:teuthology.orchestra.run.smithi121.stdout:Dependencies resolved. 2024-08-18T22:31:38.781 INFO:teuthology.orchestra.run.smithi121.stdout:================================================================================ 2024-08-18T22:31:38.781 INFO:teuthology.orchestra.run.smithi121.stdout: Package Arch Version Repository Size 2024-08-18T22:31:38.781 INFO:teuthology.orchestra.run.smithi121.stdout:================================================================================ 2024-08-18T22:31:38.781 INFO:teuthology.orchestra.run.smithi121.stdout:Installing: 2024-08-18T22:31:38.781 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-fuse x86_64 2:17.2.7-1406.gdf62bdcc.el9 ceph 813 k 2024-08-18T22:31:38.781 INFO:teuthology.orchestra.run.smithi121.stdout:Installing dependencies: 2024-08-18T22:31:38.781 INFO:teuthology.orchestra.run.smithi121.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-08-18T22:31:38.781 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-08-18T22:31:38.782 INFO:teuthology.orchestra.run.smithi121.stdout:Transaction Summary 2024-08-18T22:31:38.782 INFO:teuthology.orchestra.run.smithi121.stdout:================================================================================ 2024-08-18T22:31:38.782 INFO:teuthology.orchestra.run.smithi121.stdout:Install 2 Packages 2024-08-18T22:31:38.782 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-08-18T22:31:38.782 INFO:teuthology.orchestra.run.smithi121.stdout:Total download size: 893 k 2024-08-18T22:31:38.782 INFO:teuthology.orchestra.run.smithi121.stdout:Installed size: 2.6 M 2024-08-18T22:31:38.783 INFO:teuthology.orchestra.run.smithi121.stdout:Downloading Packages: 2024-08-18T22:31:38.837 INFO:teuthology.orchestra.run.smithi195.stdout: Preparing : 1/1 2024-08-18T22:31:39.024 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 1/6 2024-08-18T22:31:39.085 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/6 2024-08-18T22:31:39.317 INFO:teuthology.orchestra.run.smithi121.stdout:(1/2): ceph-fuse-17.2.7-1406.gdf62bdcc.el9.x86_ 2.8 MB/s | 813 kB 00:00 2024-08-18T22:31:39.459 INFO:teuthology.orchestra.run.smithi121.stdout:(2/2): fuse-2.9.9-16.el9.x86_64.rpm 189 kB/s | 80 kB 00:00 2024-08-18T22:31:39.459 INFO:teuthology.orchestra.run.smithi121.stdout:-------------------------------------------------------------------------------- 2024-08-18T22:31:39.459 INFO:teuthology.orchestra.run.smithi121.stdout:Total 1.3 MB/s | 893 kB 00:00 2024-08-18T22:31:39.471 INFO:teuthology.orchestra.run.smithi121.stdout:Running transaction check 2024-08-18T22:31:39.493 INFO:teuthology.orchestra.run.smithi121.stdout:Transaction check succeeded. 2024-08-18T22:31:39.493 INFO:teuthology.orchestra.run.smithi121.stdout:Running transaction test 2024-08-18T22:31:39.572 INFO:teuthology.orchestra.run.smithi121.stdout:Transaction test succeeded. 2024-08-18T22:31:39.572 INFO:teuthology.orchestra.run.smithi121.stdout:Running transaction 2024-08-18T22:31:39.604 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-08-18T22:31:39.688 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-08-18T22:31:39.743 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 5/6 2024-08-18T22:31:39.754 INFO:teuthology.orchestra.run.smithi121.stdout: Preparing : 1/1 2024-08-18T22:31:39.772 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-mgr-cephadm-2:17.2.7-1406.gdf62bdcc.el9.noarch 6/6 2024-08-18T22:31:39.876 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : fuse-2.9.9-16.el9.x86_64 1/2 2024-08-18T22:31:39.938 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : ceph-fuse-2:17.2.7-1406.gdf62bdcc.el9.x86_64 2/2 2024-08-18T22:31:40.506 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: ceph-mgr-cephadm-2:17.2.7-1406.gdf62bdcc.el9.noarch 6/6 2024-08-18T22:31:40.506 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-mgr-cephadm-2:17.2.7-1406.gdf62bdcc.el9.noarch 1/6 2024-08-18T22:31:40.506 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-08-18T22:31:40.506 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 3/6 2024-08-18T22:31:40.506 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 4/6 2024-08-18T22:31:40.507 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-08-18T22:31:40.597 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: ceph-fuse-2:17.2.7-1406.gdf62bdcc.el9.x86_64 2/2 2024-08-18T22:31:40.597 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : ceph-fuse-2:17.2.7-1406.gdf62bdcc.el9.x86_64 1/2 2024-08-18T22:31:40.771 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 6/6 2024-08-18T22:31:40.771 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-08-18T22:31:40.771 INFO:teuthology.orchestra.run.smithi195.stdout:Installed: 2024-08-18T22:31:40.771 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-mgr-cephadm-2:17.2.7-1406.gdf62bdcc.el9.noarch 2024-08-18T22:31:40.771 INFO:teuthology.orchestra.run.smithi195.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-08-18T22:31:40.771 INFO:teuthology.orchestra.run.smithi195.stdout: python3-babel-2.9.1-2.el9.noarch 2024-08-18T22:31:40.771 INFO:teuthology.orchestra.run.smithi195.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-08-18T22:31:40.771 INFO:teuthology.orchestra.run.smithi195.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-08-18T22:31:40.772 INFO:teuthology.orchestra.run.smithi195.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-08-18T22:31:40.772 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-08-18T22:31:40.772 INFO:teuthology.orchestra.run.smithi195.stdout:Complete! 2024-08-18T22:31:40.837 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 2/2 2024-08-18T22:31:40.837 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-08-18T22:31:40.837 INFO:teuthology.orchestra.run.smithi121.stdout:Installed: 2024-08-18T22:31:40.837 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-fuse-2:17.2.7-1406.gdf62bdcc.el9.x86_64 fuse-2.9.9-16.el9.x86_64 2024-08-18T22:31:40.838 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-08-18T22:31:40.838 INFO:teuthology.orchestra.run.smithi121.stdout:Complete! 2024-08-18T22:31:41.017 DEBUG:teuthology.orchestra.run.smithi195:> sudo yum -y install ceph-fuse 2024-08-18T22:31:41.123 DEBUG:teuthology.orchestra.run.smithi121:> sudo yum -y install librados-devel 2024-08-18T22:31:41.558 INFO:teuthology.orchestra.run.smithi195.stdout:Last metadata expiration check: 0:01:24 ago on Sun 18 Aug 2024 10:30:17 PM UTC. 2024-08-18T22:31:41.674 INFO:teuthology.orchestra.run.smithi121.stdout:Last metadata expiration check: 0:01:24 ago on Sun 18 Aug 2024 10:30:17 PM UTC. 2024-08-18T22:31:41.686 INFO:teuthology.orchestra.run.smithi195.stdout:Dependencies resolved. 2024-08-18T22:31:41.686 INFO:teuthology.orchestra.run.smithi195.stdout:================================================================================ 2024-08-18T22:31:41.686 INFO:teuthology.orchestra.run.smithi195.stdout: Package Arch Version Repository Size 2024-08-18T22:31:41.686 INFO:teuthology.orchestra.run.smithi195.stdout:================================================================================ 2024-08-18T22:31:41.686 INFO:teuthology.orchestra.run.smithi195.stdout:Installing: 2024-08-18T22:31:41.687 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-fuse x86_64 2:17.2.7-1406.gdf62bdcc.el9 ceph 813 k 2024-08-18T22:31:41.687 INFO:teuthology.orchestra.run.smithi195.stdout:Installing dependencies: 2024-08-18T22:31:41.687 INFO:teuthology.orchestra.run.smithi195.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-08-18T22:31:41.687 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-08-18T22:31:41.687 INFO:teuthology.orchestra.run.smithi195.stdout:Transaction Summary 2024-08-18T22:31:41.687 INFO:teuthology.orchestra.run.smithi195.stdout:================================================================================ 2024-08-18T22:31:41.687 INFO:teuthology.orchestra.run.smithi195.stdout:Install 2 Packages 2024-08-18T22:31:41.687 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-08-18T22:31:41.688 INFO:teuthology.orchestra.run.smithi195.stdout:Total download size: 893 k 2024-08-18T22:31:41.688 INFO:teuthology.orchestra.run.smithi195.stdout:Installed size: 2.6 M 2024-08-18T22:31:41.688 INFO:teuthology.orchestra.run.smithi195.stdout:Downloading Packages: 2024-08-18T22:31:41.806 INFO:teuthology.orchestra.run.smithi121.stdout:Dependencies resolved. 2024-08-18T22:31:41.807 INFO:teuthology.orchestra.run.smithi121.stdout:================================================================================ 2024-08-18T22:31:41.807 INFO:teuthology.orchestra.run.smithi121.stdout: Package Arch Version Repo Size 2024-08-18T22:31:41.807 INFO:teuthology.orchestra.run.smithi121.stdout:================================================================================ 2024-08-18T22:31:41.807 INFO:teuthology.orchestra.run.smithi121.stdout:Installing: 2024-08-18T22:31:41.807 INFO:teuthology.orchestra.run.smithi121.stdout: librados-devel x86_64 2:17.2.7-1406.gdf62bdcc.el9 ceph 126 k 2024-08-18T22:31:41.807 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-08-18T22:31:41.807 INFO:teuthology.orchestra.run.smithi121.stdout:Transaction Summary 2024-08-18T22:31:41.808 INFO:teuthology.orchestra.run.smithi121.stdout:================================================================================ 2024-08-18T22:31:41.808 INFO:teuthology.orchestra.run.smithi121.stdout:Install 1 Package 2024-08-18T22:31:41.808 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-08-18T22:31:41.808 INFO:teuthology.orchestra.run.smithi121.stdout:Total download size: 126 k 2024-08-18T22:31:41.808 INFO:teuthology.orchestra.run.smithi121.stdout:Installed size: 448 k 2024-08-18T22:31:41.808 INFO:teuthology.orchestra.run.smithi121.stdout:Downloading Packages: 2024-08-18T22:31:41.997 INFO:teuthology.orchestra.run.smithi121.stdout:librados-devel-17.2.7-1406.gdf62bdcc.el9.x86_64 668 kB/s | 126 kB 00:00 2024-08-18T22:31:41.998 INFO:teuthology.orchestra.run.smithi121.stdout:-------------------------------------------------------------------------------- 2024-08-18T22:31:41.998 INFO:teuthology.orchestra.run.smithi121.stdout:Total 663 kB/s | 126 kB 00:00 2024-08-18T22:31:41.998 INFO:teuthology.orchestra.run.smithi121.stdout:Running transaction check 2024-08-18T22:31:42.002 INFO:teuthology.orchestra.run.smithi195.stdout:(1/2): ceph-fuse-17.2.7-1406.gdf62bdcc.el9.x86_ 3.0 MB/s | 813 kB 00:00 2024-08-18T22:31:42.004 INFO:teuthology.orchestra.run.smithi121.stdout:Transaction check succeeded. 2024-08-18T22:31:42.004 INFO:teuthology.orchestra.run.smithi121.stdout:Running transaction test 2024-08-18T22:31:42.068 INFO:teuthology.orchestra.run.smithi121.stdout:Transaction test succeeded. 2024-08-18T22:31:42.068 INFO:teuthology.orchestra.run.smithi121.stdout:Running transaction 2024-08-18T22:31:42.228 INFO:teuthology.orchestra.run.smithi121.stdout: Preparing : 1/1 2024-08-18T22:31:42.322 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : librados-devel-2:17.2.7-1406.gdf62bdcc.el9.x86_64 1/1 2024-08-18T22:31:42.369 INFO:teuthology.orchestra.run.smithi195.stdout:(2/2): fuse-2.9.9-16.el9.x86_64.rpm 125 kB/s | 80 kB 00:00 2024-08-18T22:31:42.370 INFO:teuthology.orchestra.run.smithi195.stdout:-------------------------------------------------------------------------------- 2024-08-18T22:31:42.370 INFO:teuthology.orchestra.run.smithi195.stdout:Total 1.3 MB/s | 893 kB 00:00 2024-08-18T22:31:42.382 INFO:teuthology.orchestra.run.smithi195.stdout:Running transaction check 2024-08-18T22:31:42.404 INFO:teuthology.orchestra.run.smithi195.stdout:Transaction check succeeded. 2024-08-18T22:31:42.405 INFO:teuthology.orchestra.run.smithi195.stdout:Running transaction test 2024-08-18T22:31:42.482 INFO:teuthology.orchestra.run.smithi195.stdout:Transaction test succeeded. 2024-08-18T22:31:42.482 INFO:teuthology.orchestra.run.smithi195.stdout:Running transaction 2024-08-18T22:31:42.664 INFO:teuthology.orchestra.run.smithi195.stdout: Preparing : 1/1 2024-08-18T22:31:42.696 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: librados-devel-2:17.2.7-1406.gdf62bdcc.el9.x86_64 1/1 2024-08-18T22:31:42.800 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : fuse-2.9.9-16.el9.x86_64 1/2 2024-08-18T22:31:42.867 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-fuse-2:17.2.7-1406.gdf62bdcc.el9.x86_64 2/2 2024-08-18T22:31:42.929 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : librados-devel-2:17.2.7-1406.gdf62bdcc.el9.x86_64 1/1 2024-08-18T22:31:42.930 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-08-18T22:31:42.930 INFO:teuthology.orchestra.run.smithi121.stdout:Installed: 2024-08-18T22:31:42.930 INFO:teuthology.orchestra.run.smithi121.stdout: librados-devel-2:17.2.7-1406.gdf62bdcc.el9.x86_64 2024-08-18T22:31:42.930 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-08-18T22:31:42.930 INFO:teuthology.orchestra.run.smithi121.stdout:Complete! 2024-08-18T22:31:43.192 DEBUG:teuthology.orchestra.run.smithi121:> sudo yum -y install libcephfs2 2024-08-18T22:31:43.504 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: ceph-fuse-2:17.2.7-1406.gdf62bdcc.el9.x86_64 2/2 2024-08-18T22:31:43.504 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-fuse-2:17.2.7-1406.gdf62bdcc.el9.x86_64 1/2 2024-08-18T22:31:43.747 INFO:teuthology.orchestra.run.smithi121.stdout:Last metadata expiration check: 0:01:26 ago on Sun 18 Aug 2024 10:30:17 PM UTC. 2024-08-18T22:31:43.755 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 2/2 2024-08-18T22:31:43.755 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-08-18T22:31:43.755 INFO:teuthology.orchestra.run.smithi195.stdout:Installed: 2024-08-18T22:31:43.755 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-fuse-2:17.2.7-1406.gdf62bdcc.el9.x86_64 fuse-2.9.9-16.el9.x86_64 2024-08-18T22:31:43.756 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-08-18T22:31:43.756 INFO:teuthology.orchestra.run.smithi195.stdout:Complete! 2024-08-18T22:31:43.836 INFO:teuthology.orchestra.run.smithi121.stdout:Package libcephfs2-2:17.2.7-1406.gdf62bdcc.el9.x86_64 is already installed. 2024-08-18T22:31:43.880 INFO:teuthology.orchestra.run.smithi121.stdout:Dependencies resolved. 2024-08-18T22:31:43.881 INFO:teuthology.orchestra.run.smithi121.stdout:Nothing to do. 2024-08-18T22:31:43.881 INFO:teuthology.orchestra.run.smithi121.stdout:Complete! 2024-08-18T22:31:43.964 DEBUG:teuthology.orchestra.run.smithi121:> sudo yum -y install libcephfs-devel 2024-08-18T22:31:44.049 DEBUG:teuthology.orchestra.run.smithi195:> sudo yum -y install librados-devel 2024-08-18T22:31:44.502 INFO:teuthology.orchestra.run.smithi121.stdout:Last metadata expiration check: 0:01:27 ago on Sun 18 Aug 2024 10:30:17 PM UTC. 2024-08-18T22:31:44.604 INFO:teuthology.orchestra.run.smithi195.stdout:Last metadata expiration check: 0:01:27 ago on Sun 18 Aug 2024 10:30:17 PM UTC. 2024-08-18T22:31:44.629 INFO:teuthology.orchestra.run.smithi121.stdout:Dependencies resolved. 2024-08-18T22:31:44.630 INFO:teuthology.orchestra.run.smithi121.stdout:================================================================================ 2024-08-18T22:31:44.630 INFO:teuthology.orchestra.run.smithi121.stdout: Package Arch Version Repo Size 2024-08-18T22:31:44.630 INFO:teuthology.orchestra.run.smithi121.stdout:================================================================================ 2024-08-18T22:31:44.630 INFO:teuthology.orchestra.run.smithi121.stdout:Installing: 2024-08-18T22:31:44.630 INFO:teuthology.orchestra.run.smithi121.stdout: libcephfs-devel x86_64 2:17.2.7-1406.gdf62bdcc.el9 ceph 25 k 2024-08-18T22:31:44.630 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-08-18T22:31:44.630 INFO:teuthology.orchestra.run.smithi121.stdout:Transaction Summary 2024-08-18T22:31:44.630 INFO:teuthology.orchestra.run.smithi121.stdout:================================================================================ 2024-08-18T22:31:44.630 INFO:teuthology.orchestra.run.smithi121.stdout:Install 1 Package 2024-08-18T22:31:44.631 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-08-18T22:31:44.631 INFO:teuthology.orchestra.run.smithi121.stdout:Total download size: 25 k 2024-08-18T22:31:44.631 INFO:teuthology.orchestra.run.smithi121.stdout:Installed size: 110 k 2024-08-18T22:31:44.631 INFO:teuthology.orchestra.run.smithi121.stdout:Downloading Packages: 2024-08-18T22:31:44.733 INFO:teuthology.orchestra.run.smithi195.stdout:Dependencies resolved. 2024-08-18T22:31:44.734 INFO:teuthology.orchestra.run.smithi195.stdout:================================================================================ 2024-08-18T22:31:44.735 INFO:teuthology.orchestra.run.smithi195.stdout: Package Arch Version Repo Size 2024-08-18T22:31:44.735 INFO:teuthology.orchestra.run.smithi195.stdout:================================================================================ 2024-08-18T22:31:44.735 INFO:teuthology.orchestra.run.smithi195.stdout:Installing: 2024-08-18T22:31:44.735 INFO:teuthology.orchestra.run.smithi195.stdout: librados-devel x86_64 2:17.2.7-1406.gdf62bdcc.el9 ceph 126 k 2024-08-18T22:31:44.735 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-08-18T22:31:44.735 INFO:teuthology.orchestra.run.smithi195.stdout:Transaction Summary 2024-08-18T22:31:44.735 INFO:teuthology.orchestra.run.smithi195.stdout:================================================================================ 2024-08-18T22:31:44.735 INFO:teuthology.orchestra.run.smithi195.stdout:Install 1 Package 2024-08-18T22:31:44.735 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-08-18T22:31:44.735 INFO:teuthology.orchestra.run.smithi195.stdout:Total download size: 126 k 2024-08-18T22:31:44.735 INFO:teuthology.orchestra.run.smithi195.stdout:Installed size: 448 k 2024-08-18T22:31:44.735 INFO:teuthology.orchestra.run.smithi195.stdout:Downloading Packages: 2024-08-18T22:31:44.775 INFO:teuthology.orchestra.run.smithi121.stdout:libcephfs-devel-17.2.7-1406.gdf62bdcc.el9.x86_6 172 kB/s | 25 kB 00:00 2024-08-18T22:31:44.776 INFO:teuthology.orchestra.run.smithi121.stdout:-------------------------------------------------------------------------------- 2024-08-18T22:31:44.776 INFO:teuthology.orchestra.run.smithi121.stdout:Total 171 kB/s | 25 kB 00:00 2024-08-18T22:31:44.776 INFO:teuthology.orchestra.run.smithi121.stdout:Running transaction check 2024-08-18T22:31:44.780 INFO:teuthology.orchestra.run.smithi121.stdout:Transaction check succeeded. 2024-08-18T22:31:44.780 INFO:teuthology.orchestra.run.smithi121.stdout:Running transaction test 2024-08-18T22:31:44.781 INFO:teuthology.orchestra.run.smithi121.stdout:Transaction test succeeded. 2024-08-18T22:31:44.782 INFO:teuthology.orchestra.run.smithi121.stdout:Running transaction 2024-08-18T22:31:44.884 INFO:teuthology.orchestra.run.smithi121.stdout: Preparing : 1/1 2024-08-18T22:31:44.940 INFO:teuthology.orchestra.run.smithi195.stdout:librados-devel-17.2.7-1406.gdf62bdcc.el9.x86_64 617 kB/s | 126 kB 00:00 2024-08-18T22:31:44.940 INFO:teuthology.orchestra.run.smithi195.stdout:-------------------------------------------------------------------------------- 2024-08-18T22:31:44.941 INFO:teuthology.orchestra.run.smithi195.stdout:Total 612 kB/s | 126 kB 00:00 2024-08-18T22:31:44.941 INFO:teuthology.orchestra.run.smithi195.stdout:Running transaction check 2024-08-18T22:31:44.946 INFO:teuthology.orchestra.run.smithi195.stdout:Transaction check succeeded. 2024-08-18T22:31:44.946 INFO:teuthology.orchestra.run.smithi195.stdout:Running transaction test 2024-08-18T22:31:44.987 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : libcephfs-devel-2:17.2.7-1406.gdf62bdcc.el9.x86_64 1/1 2024-08-18T22:31:45.008 INFO:teuthology.orchestra.run.smithi195.stdout:Transaction test succeeded. 2024-08-18T22:31:45.009 INFO:teuthology.orchestra.run.smithi195.stdout:Running transaction 2024-08-18T22:31:45.153 INFO:teuthology.orchestra.run.smithi195.stdout: Preparing : 1/1 2024-08-18T22:31:45.270 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : librados-devel-2:17.2.7-1406.gdf62bdcc.el9.x86_64 1/1 2024-08-18T22:31:45.336 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: libcephfs-devel-2:17.2.7-1406.gdf62bdcc.el9.x86_64 1/1 2024-08-18T22:31:45.559 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : libcephfs-devel-2:17.2.7-1406.gdf62bdcc.el9.x86_64 1/1 2024-08-18T22:31:45.559 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-08-18T22:31:45.559 INFO:teuthology.orchestra.run.smithi121.stdout:Installed: 2024-08-18T22:31:45.559 INFO:teuthology.orchestra.run.smithi121.stdout: libcephfs-devel-2:17.2.7-1406.gdf62bdcc.el9.x86_64 2024-08-18T22:31:45.559 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-08-18T22:31:45.560 INFO:teuthology.orchestra.run.smithi121.stdout:Complete! 2024-08-18T22:31:45.671 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: librados-devel-2:17.2.7-1406.gdf62bdcc.el9.x86_64 1/1 2024-08-18T22:31:45.758 DEBUG:teuthology.orchestra.run.smithi121:> sudo yum -y install librados2 2024-08-18T22:31:45.921 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : librados-devel-2:17.2.7-1406.gdf62bdcc.el9.x86_64 1/1 2024-08-18T22:31:45.921 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-08-18T22:31:45.921 INFO:teuthology.orchestra.run.smithi195.stdout:Installed: 2024-08-18T22:31:45.921 INFO:teuthology.orchestra.run.smithi195.stdout: librados-devel-2:17.2.7-1406.gdf62bdcc.el9.x86_64 2024-08-18T22:31:45.921 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-08-18T22:31:45.922 INFO:teuthology.orchestra.run.smithi195.stdout:Complete! 2024-08-18T22:31:46.187 DEBUG:teuthology.orchestra.run.smithi195:> sudo yum -y install libcephfs2 2024-08-18T22:31:46.299 INFO:teuthology.orchestra.run.smithi121.stdout:Last metadata expiration check: 0:01:29 ago on Sun 18 Aug 2024 10:30:17 PM UTC. 2024-08-18T22:31:46.384 INFO:teuthology.orchestra.run.smithi121.stdout:Package librados2-2:17.2.7-1406.gdf62bdcc.el9.x86_64 is already installed. 2024-08-18T22:31:46.428 INFO:teuthology.orchestra.run.smithi121.stdout:Dependencies resolved. 2024-08-18T22:31:46.429 INFO:teuthology.orchestra.run.smithi121.stdout:Nothing to do. 2024-08-18T22:31:46.429 INFO:teuthology.orchestra.run.smithi121.stdout:Complete! 2024-08-18T22:31:46.513 DEBUG:teuthology.orchestra.run.smithi121:> sudo yum -y install librbd1 2024-08-18T22:31:46.737 INFO:teuthology.orchestra.run.smithi195.stdout:Last metadata expiration check: 0:01:29 ago on Sun 18 Aug 2024 10:30:17 PM UTC. 2024-08-18T22:31:46.823 INFO:teuthology.orchestra.run.smithi195.stdout:Package libcephfs2-2:17.2.7-1406.gdf62bdcc.el9.x86_64 is already installed. 2024-08-18T22:31:46.867 INFO:teuthology.orchestra.run.smithi195.stdout:Dependencies resolved. 2024-08-18T22:31:46.868 INFO:teuthology.orchestra.run.smithi195.stdout:Nothing to do. 2024-08-18T22:31:46.868 INFO:teuthology.orchestra.run.smithi195.stdout:Complete! 2024-08-18T22:31:46.949 DEBUG:teuthology.orchestra.run.smithi195:> sudo yum -y install libcephfs-devel 2024-08-18T22:31:47.049 INFO:teuthology.orchestra.run.smithi121.stdout:Last metadata expiration check: 0:01:30 ago on Sun 18 Aug 2024 10:30:17 PM UTC. 2024-08-18T22:31:47.133 INFO:teuthology.orchestra.run.smithi121.stdout:Package librbd1-2:17.2.7-1406.gdf62bdcc.el9.x86_64 is already installed. 2024-08-18T22:31:47.175 INFO:teuthology.orchestra.run.smithi121.stdout:Dependencies resolved. 2024-08-18T22:31:47.176 INFO:teuthology.orchestra.run.smithi121.stdout:Nothing to do. 2024-08-18T22:31:47.176 INFO:teuthology.orchestra.run.smithi121.stdout:Complete! 2024-08-18T22:31:47.256 DEBUG:teuthology.orchestra.run.smithi121:> sudo yum -y install python3-rados 2024-08-18T22:31:47.514 INFO:teuthology.orchestra.run.smithi195.stdout:Last metadata expiration check: 0:01:30 ago on Sun 18 Aug 2024 10:30:17 PM UTC. 2024-08-18T22:31:47.645 INFO:teuthology.orchestra.run.smithi195.stdout:Dependencies resolved. 2024-08-18T22:31:47.645 INFO:teuthology.orchestra.run.smithi195.stdout:================================================================================ 2024-08-18T22:31:47.645 INFO:teuthology.orchestra.run.smithi195.stdout: Package Arch Version Repo Size 2024-08-18T22:31:47.645 INFO:teuthology.orchestra.run.smithi195.stdout:================================================================================ 2024-08-18T22:31:47.646 INFO:teuthology.orchestra.run.smithi195.stdout:Installing: 2024-08-18T22:31:47.646 INFO:teuthology.orchestra.run.smithi195.stdout: libcephfs-devel x86_64 2:17.2.7-1406.gdf62bdcc.el9 ceph 25 k 2024-08-18T22:31:47.646 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-08-18T22:31:47.646 INFO:teuthology.orchestra.run.smithi195.stdout:Transaction Summary 2024-08-18T22:31:47.646 INFO:teuthology.orchestra.run.smithi195.stdout:================================================================================ 2024-08-18T22:31:47.646 INFO:teuthology.orchestra.run.smithi195.stdout:Install 1 Package 2024-08-18T22:31:47.646 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-08-18T22:31:47.646 INFO:teuthology.orchestra.run.smithi195.stdout:Total download size: 25 k 2024-08-18T22:31:47.646 INFO:teuthology.orchestra.run.smithi195.stdout:Installed size: 110 k 2024-08-18T22:31:47.646 INFO:teuthology.orchestra.run.smithi195.stdout:Downloading Packages: 2024-08-18T22:31:47.794 INFO:teuthology.orchestra.run.smithi121.stdout:Last metadata expiration check: 0:01:30 ago on Sun 18 Aug 2024 10:30:17 PM UTC. 2024-08-18T22:31:47.795 INFO:teuthology.orchestra.run.smithi195.stdout:libcephfs-devel-17.2.7-1406.gdf62bdcc.el9.x86_6 167 kB/s | 25 kB 00:00 2024-08-18T22:31:47.796 INFO:teuthology.orchestra.run.smithi195.stdout:-------------------------------------------------------------------------------- 2024-08-18T22:31:47.797 INFO:teuthology.orchestra.run.smithi195.stdout:Total 165 kB/s | 25 kB 00:00 2024-08-18T22:31:47.797 INFO:teuthology.orchestra.run.smithi195.stdout:Running transaction check 2024-08-18T22:31:47.801 INFO:teuthology.orchestra.run.smithi195.stdout:Transaction check succeeded. 2024-08-18T22:31:47.801 INFO:teuthology.orchestra.run.smithi195.stdout:Running transaction test 2024-08-18T22:31:47.802 INFO:teuthology.orchestra.run.smithi195.stdout:Transaction test succeeded. 2024-08-18T22:31:47.802 INFO:teuthology.orchestra.run.smithi195.stdout:Running transaction 2024-08-18T22:31:47.878 INFO:teuthology.orchestra.run.smithi121.stdout:Package python3-rados-2:17.2.7-1406.gdf62bdcc.el9.x86_64 is already installed. 2024-08-18T22:31:47.885 INFO:teuthology.orchestra.run.smithi195.stdout: Preparing : 1/1 2024-08-18T22:31:47.920 INFO:teuthology.orchestra.run.smithi121.stdout:Dependencies resolved. 2024-08-18T22:31:47.921 INFO:teuthology.orchestra.run.smithi121.stdout:Nothing to do. 2024-08-18T22:31:47.921 INFO:teuthology.orchestra.run.smithi121.stdout:Complete! 2024-08-18T22:31:47.991 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : libcephfs-devel-2:17.2.7-1406.gdf62bdcc.el9.x86_64 1/1 2024-08-18T22:31:48.004 DEBUG:teuthology.orchestra.run.smithi121:> sudo yum -y install python3-rgw 2024-08-18T22:31:48.366 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: libcephfs-devel-2:17.2.7-1406.gdf62bdcc.el9.x86_64 1/1 2024-08-18T22:31:48.534 INFO:teuthology.orchestra.run.smithi121.stdout:Last metadata expiration check: 0:01:31 ago on Sun 18 Aug 2024 10:30:17 PM UTC. 2024-08-18T22:31:48.613 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : libcephfs-devel-2:17.2.7-1406.gdf62bdcc.el9.x86_64 1/1 2024-08-18T22:31:48.613 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-08-18T22:31:48.613 INFO:teuthology.orchestra.run.smithi195.stdout:Installed: 2024-08-18T22:31:48.614 INFO:teuthology.orchestra.run.smithi195.stdout: libcephfs-devel-2:17.2.7-1406.gdf62bdcc.el9.x86_64 2024-08-18T22:31:48.614 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-08-18T22:31:48.614 INFO:teuthology.orchestra.run.smithi195.stdout:Complete! 2024-08-18T22:31:48.617 INFO:teuthology.orchestra.run.smithi121.stdout:Package python3-rgw-2:17.2.7-1406.gdf62bdcc.el9.x86_64 is already installed. 2024-08-18T22:31:48.659 INFO:teuthology.orchestra.run.smithi121.stdout:Dependencies resolved. 2024-08-18T22:31:48.660 INFO:teuthology.orchestra.run.smithi121.stdout:Nothing to do. 2024-08-18T22:31:48.660 INFO:teuthology.orchestra.run.smithi121.stdout:Complete! 2024-08-18T22:31:48.744 DEBUG:teuthology.orchestra.run.smithi121:> sudo yum -y install python3-cephfs 2024-08-18T22:31:48.792 DEBUG:teuthology.orchestra.run.smithi195:> sudo yum -y install librados2 2024-08-18T22:31:49.281 INFO:teuthology.orchestra.run.smithi121.stdout:Last metadata expiration check: 0:01:32 ago on Sun 18 Aug 2024 10:30:17 PM UTC. 2024-08-18T22:31:49.334 INFO:teuthology.orchestra.run.smithi195.stdout:Last metadata expiration check: 0:01:32 ago on Sun 18 Aug 2024 10:30:17 PM UTC. 2024-08-18T22:31:49.365 INFO:teuthology.orchestra.run.smithi121.stdout:Package python3-cephfs-2:17.2.7-1406.gdf62bdcc.el9.x86_64 is already installed. 2024-08-18T22:31:49.408 INFO:teuthology.orchestra.run.smithi121.stdout:Dependencies resolved. 2024-08-18T22:31:49.409 INFO:teuthology.orchestra.run.smithi121.stdout:Nothing to do. 2024-08-18T22:31:49.409 INFO:teuthology.orchestra.run.smithi121.stdout:Complete! 2024-08-18T22:31:49.418 INFO:teuthology.orchestra.run.smithi195.stdout:Package librados2-2:17.2.7-1406.gdf62bdcc.el9.x86_64 is already installed. 2024-08-18T22:31:49.460 INFO:teuthology.orchestra.run.smithi195.stdout:Dependencies resolved. 2024-08-18T22:31:49.461 INFO:teuthology.orchestra.run.smithi195.stdout:Nothing to do. 2024-08-18T22:31:49.461 INFO:teuthology.orchestra.run.smithi195.stdout:Complete! 2024-08-18T22:31:49.490 DEBUG:teuthology.orchestra.run.smithi121:> sudo yum -y install python3-rbd 2024-08-18T22:31:49.527 DEBUG:teuthology.orchestra.run.smithi195:> sudo yum -y install librbd1 2024-08-18T22:31:50.026 INFO:teuthology.orchestra.run.smithi121.stdout:Last metadata expiration check: 0:01:33 ago on Sun 18 Aug 2024 10:30:17 PM UTC. 2024-08-18T22:31:50.068 INFO:teuthology.orchestra.run.smithi195.stdout:Last metadata expiration check: 0:01:33 ago on Sun 18 Aug 2024 10:30:17 PM UTC. 2024-08-18T22:31:50.111 INFO:teuthology.orchestra.run.smithi121.stdout:Package python3-rbd-2:17.2.7-1406.gdf62bdcc.el9.x86_64 is already installed. 2024-08-18T22:31:50.153 INFO:teuthology.orchestra.run.smithi195.stdout:Package librbd1-2:17.2.7-1406.gdf62bdcc.el9.x86_64 is already installed. 2024-08-18T22:31:50.154 INFO:teuthology.orchestra.run.smithi121.stdout:Dependencies resolved. 2024-08-18T22:31:50.155 INFO:teuthology.orchestra.run.smithi121.stdout:Nothing to do. 2024-08-18T22:31:50.155 INFO:teuthology.orchestra.run.smithi121.stdout:Complete! 2024-08-18T22:31:50.195 INFO:teuthology.orchestra.run.smithi195.stdout:Dependencies resolved. 2024-08-18T22:31:50.196 INFO:teuthology.orchestra.run.smithi195.stdout:Nothing to do. 2024-08-18T22:31:50.196 INFO:teuthology.orchestra.run.smithi195.stdout:Complete! 2024-08-18T22:31:50.234 DEBUG:teuthology.orchestra.run.smithi121:> sudo yum -y install rbd-fuse 2024-08-18T22:31:50.264 DEBUG:teuthology.orchestra.run.smithi195:> sudo yum -y install python3-rados 2024-08-18T22:31:50.766 INFO:teuthology.orchestra.run.smithi121.stdout:Last metadata expiration check: 0:01:33 ago on Sun 18 Aug 2024 10:30:17 PM UTC. 2024-08-18T22:31:50.797 INFO:teuthology.orchestra.run.smithi195.stdout:Last metadata expiration check: 0:01:33 ago on Sun 18 Aug 2024 10:30:17 PM UTC. 2024-08-18T22:31:50.881 INFO:teuthology.orchestra.run.smithi195.stdout:Package python3-rados-2:17.2.7-1406.gdf62bdcc.el9.x86_64 is already installed. 2024-08-18T22:31:50.893 INFO:teuthology.orchestra.run.smithi121.stdout:Dependencies resolved. 2024-08-18T22:31:50.894 INFO:teuthology.orchestra.run.smithi121.stdout:================================================================================ 2024-08-18T22:31:50.894 INFO:teuthology.orchestra.run.smithi121.stdout: Package Architecture Version Repository Size 2024-08-18T22:31:50.894 INFO:teuthology.orchestra.run.smithi121.stdout:================================================================================ 2024-08-18T22:31:50.894 INFO:teuthology.orchestra.run.smithi121.stdout:Installing: 2024-08-18T22:31:50.894 INFO:teuthology.orchestra.run.smithi121.stdout: rbd-fuse x86_64 2:17.2.7-1406.gdf62bdcc.el9 ceph 82 k 2024-08-18T22:31:50.894 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-08-18T22:31:50.894 INFO:teuthology.orchestra.run.smithi121.stdout:Transaction Summary 2024-08-18T22:31:50.894 INFO:teuthology.orchestra.run.smithi121.stdout:================================================================================ 2024-08-18T22:31:50.895 INFO:teuthology.orchestra.run.smithi121.stdout:Install 1 Package 2024-08-18T22:31:50.895 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-08-18T22:31:50.895 INFO:teuthology.orchestra.run.smithi121.stdout:Total download size: 82 k 2024-08-18T22:31:50.895 INFO:teuthology.orchestra.run.smithi121.stdout:Installed size: 222 k 2024-08-18T22:31:50.895 INFO:teuthology.orchestra.run.smithi121.stdout:Downloading Packages: 2024-08-18T22:31:50.923 INFO:teuthology.orchestra.run.smithi195.stdout:Dependencies resolved. 2024-08-18T22:31:50.924 INFO:teuthology.orchestra.run.smithi195.stdout:Nothing to do. 2024-08-18T22:31:50.924 INFO:teuthology.orchestra.run.smithi195.stdout:Complete! 2024-08-18T22:31:50.985 DEBUG:teuthology.orchestra.run.smithi195:> sudo yum -y install python3-rgw 2024-08-18T22:31:51.089 INFO:teuthology.orchestra.run.smithi121.stdout:rbd-fuse-17.2.7-1406.gdf62bdcc.el9.x86_64.rpm 424 kB/s | 82 kB 00:00 2024-08-18T22:31:51.089 INFO:teuthology.orchestra.run.smithi121.stdout:-------------------------------------------------------------------------------- 2024-08-18T22:31:51.089 INFO:teuthology.orchestra.run.smithi121.stdout:Total 421 kB/s | 82 kB 00:00 2024-08-18T22:31:51.090 INFO:teuthology.orchestra.run.smithi121.stdout:Running transaction check 2024-08-18T22:31:51.096 INFO:teuthology.orchestra.run.smithi121.stdout:Transaction check succeeded. 2024-08-18T22:31:51.096 INFO:teuthology.orchestra.run.smithi121.stdout:Running transaction test 2024-08-18T22:31:51.158 INFO:teuthology.orchestra.run.smithi121.stdout:Transaction test succeeded. 2024-08-18T22:31:51.158 INFO:teuthology.orchestra.run.smithi121.stdout:Running transaction 2024-08-18T22:31:51.298 INFO:teuthology.orchestra.run.smithi121.stdout: Preparing : 1/1 2024-08-18T22:31:51.393 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : rbd-fuse-2:17.2.7-1406.gdf62bdcc.el9.x86_64 1/1 2024-08-18T22:31:51.524 INFO:teuthology.orchestra.run.smithi195.stdout:Last metadata expiration check: 0:01:34 ago on Sun 18 Aug 2024 10:30:17 PM UTC. 2024-08-18T22:31:51.609 INFO:teuthology.orchestra.run.smithi195.stdout:Package python3-rgw-2:17.2.7-1406.gdf62bdcc.el9.x86_64 is already installed. 2024-08-18T22:31:51.651 INFO:teuthology.orchestra.run.smithi195.stdout:Dependencies resolved. 2024-08-18T22:31:51.652 INFO:teuthology.orchestra.run.smithi195.stdout:Nothing to do. 2024-08-18T22:31:51.652 INFO:teuthology.orchestra.run.smithi195.stdout:Complete! 2024-08-18T22:31:51.711 DEBUG:teuthology.orchestra.run.smithi195:> sudo yum -y install python3-cephfs 2024-08-18T22:31:51.739 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: rbd-fuse-2:17.2.7-1406.gdf62bdcc.el9.x86_64 1/1 2024-08-18T22:31:51.992 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : rbd-fuse-2:17.2.7-1406.gdf62bdcc.el9.x86_64 1/1 2024-08-18T22:31:51.993 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-08-18T22:31:51.993 INFO:teuthology.orchestra.run.smithi121.stdout:Installed: 2024-08-18T22:31:51.993 INFO:teuthology.orchestra.run.smithi121.stdout: rbd-fuse-2:17.2.7-1406.gdf62bdcc.el9.x86_64 2024-08-18T22:31:51.993 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-08-18T22:31:51.993 INFO:teuthology.orchestra.run.smithi121.stdout:Complete! 2024-08-18T22:31:52.255 INFO:teuthology.orchestra.run.smithi195.stdout:Last metadata expiration check: 0:01:35 ago on Sun 18 Aug 2024 10:30:17 PM UTC. 2024-08-18T22:31:52.256 DEBUG:teuthology.orchestra.run.smithi121:> sudo yum -y install rbd-mirror 2024-08-18T22:31:52.339 INFO:teuthology.orchestra.run.smithi195.stdout:Package python3-cephfs-2:17.2.7-1406.gdf62bdcc.el9.x86_64 is already installed. 2024-08-18T22:31:52.381 INFO:teuthology.orchestra.run.smithi195.stdout:Dependencies resolved. 2024-08-18T22:31:52.382 INFO:teuthology.orchestra.run.smithi195.stdout:Nothing to do. 2024-08-18T22:31:52.383 INFO:teuthology.orchestra.run.smithi195.stdout:Complete! 2024-08-18T22:31:52.445 DEBUG:teuthology.orchestra.run.smithi195:> sudo yum -y install python3-rbd 2024-08-18T22:31:52.804 INFO:teuthology.orchestra.run.smithi121.stdout:Last metadata expiration check: 0:01:35 ago on Sun 18 Aug 2024 10:30:17 PM UTC. 2024-08-18T22:31:52.934 INFO:teuthology.orchestra.run.smithi121.stdout:Dependencies resolved. 2024-08-18T22:31:52.935 INFO:teuthology.orchestra.run.smithi121.stdout:================================================================================ 2024-08-18T22:31:52.935 INFO:teuthology.orchestra.run.smithi121.stdout: Package Arch Version Repo Size 2024-08-18T22:31:52.935 INFO:teuthology.orchestra.run.smithi121.stdout:================================================================================ 2024-08-18T22:31:52.935 INFO:teuthology.orchestra.run.smithi121.stdout:Installing: 2024-08-18T22:31:52.936 INFO:teuthology.orchestra.run.smithi121.stdout: rbd-mirror x86_64 2:17.2.7-1406.gdf62bdcc.el9 ceph 2.9 M 2024-08-18T22:31:52.936 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-08-18T22:31:52.936 INFO:teuthology.orchestra.run.smithi121.stdout:Transaction Summary 2024-08-18T22:31:52.936 INFO:teuthology.orchestra.run.smithi121.stdout:================================================================================ 2024-08-18T22:31:52.936 INFO:teuthology.orchestra.run.smithi121.stdout:Install 1 Package 2024-08-18T22:31:52.936 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-08-18T22:31:52.936 INFO:teuthology.orchestra.run.smithi121.stdout:Total download size: 2.9 M 2024-08-18T22:31:52.936 INFO:teuthology.orchestra.run.smithi121.stdout:Installed size: 12 M 2024-08-18T22:31:52.936 INFO:teuthology.orchestra.run.smithi121.stdout:Downloading Packages: 2024-08-18T22:31:52.991 INFO:teuthology.orchestra.run.smithi195.stdout:Last metadata expiration check: 0:01:35 ago on Sun 18 Aug 2024 10:30:17 PM UTC. 2024-08-18T22:31:53.075 INFO:teuthology.orchestra.run.smithi195.stdout:Package python3-rbd-2:17.2.7-1406.gdf62bdcc.el9.x86_64 is already installed. 2024-08-18T22:31:53.117 INFO:teuthology.orchestra.run.smithi195.stdout:Dependencies resolved. 2024-08-18T22:31:53.118 INFO:teuthology.orchestra.run.smithi195.stdout:Nothing to do. 2024-08-18T22:31:53.118 INFO:teuthology.orchestra.run.smithi195.stdout:Complete! 2024-08-18T22:31:53.181 DEBUG:teuthology.orchestra.run.smithi195:> sudo yum -y install rbd-fuse 2024-08-18T22:31:53.258 INFO:teuthology.orchestra.run.smithi121.stdout:rbd-mirror-17.2.7-1406.gdf62bdcc.el9.x86_64.rpm 9.1 MB/s | 2.9 MB 00:00 2024-08-18T22:31:53.259 INFO:teuthology.orchestra.run.smithi121.stdout:-------------------------------------------------------------------------------- 2024-08-18T22:31:53.259 INFO:teuthology.orchestra.run.smithi121.stdout:Total 9.1 MB/s | 2.9 MB 00:00 2024-08-18T22:31:53.260 INFO:teuthology.orchestra.run.smithi121.stdout:Running transaction check 2024-08-18T22:31:53.268 INFO:teuthology.orchestra.run.smithi121.stdout:Transaction check succeeded. 2024-08-18T22:31:53.268 INFO:teuthology.orchestra.run.smithi121.stdout:Running transaction test 2024-08-18T22:31:53.348 INFO:teuthology.orchestra.run.smithi121.stdout:Transaction test succeeded. 2024-08-18T22:31:53.348 INFO:teuthology.orchestra.run.smithi121.stdout:Running transaction 2024-08-18T22:31:53.721 INFO:teuthology.orchestra.run.smithi195.stdout:Last metadata expiration check: 0:01:36 ago on Sun 18 Aug 2024 10:30:17 PM UTC. 2024-08-18T22:31:53.757 INFO:teuthology.orchestra.run.smithi121.stdout: Preparing : 1/1 2024-08-18T22:31:53.834 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : rbd-mirror-2:17.2.7-1406.gdf62bdcc.el9.x86_64 1/1 2024-08-18T22:31:53.848 INFO:teuthology.orchestra.run.smithi195.stdout:Dependencies resolved. 2024-08-18T22:31:53.849 INFO:teuthology.orchestra.run.smithi195.stdout:================================================================================ 2024-08-18T22:31:53.849 INFO:teuthology.orchestra.run.smithi195.stdout: Package Architecture Version Repository Size 2024-08-18T22:31:53.849 INFO:teuthology.orchestra.run.smithi195.stdout:================================================================================ 2024-08-18T22:31:53.850 INFO:teuthology.orchestra.run.smithi195.stdout:Installing: 2024-08-18T22:31:53.850 INFO:teuthology.orchestra.run.smithi195.stdout: rbd-fuse x86_64 2:17.2.7-1406.gdf62bdcc.el9 ceph 82 k 2024-08-18T22:31:53.850 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-08-18T22:31:53.850 INFO:teuthology.orchestra.run.smithi195.stdout:Transaction Summary 2024-08-18T22:31:53.850 INFO:teuthology.orchestra.run.smithi195.stdout:================================================================================ 2024-08-18T22:31:53.850 INFO:teuthology.orchestra.run.smithi195.stdout:Install 1 Package 2024-08-18T22:31:53.850 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-08-18T22:31:53.850 INFO:teuthology.orchestra.run.smithi195.stdout:Total download size: 82 k 2024-08-18T22:31:53.850 INFO:teuthology.orchestra.run.smithi195.stdout:Installed size: 222 k 2024-08-18T22:31:53.850 INFO:teuthology.orchestra.run.smithi195.stdout:Downloading Packages: 2024-08-18T22:31:53.859 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: rbd-mirror-2:17.2.7-1406.gdf62bdcc.el9.x86_64 1/1 2024-08-18T22:31:53.859 INFO:teuthology.orchestra.run.smithi121.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-18T22:31:53.859 INFO:teuthology.orchestra.run.smithi121.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-08-18T22:31:53.859 INFO:teuthology.orchestra.run.smithi121.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-08-18T22:31:53.859 INFO:teuthology.orchestra.run.smithi121.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-08-18T22:31:53.859 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-08-18T22:31:54.041 INFO:teuthology.orchestra.run.smithi195.stdout:rbd-fuse-17.2.7-1406.gdf62bdcc.el9.x86_64.rpm 430 kB/s | 82 kB 00:00 2024-08-18T22:31:54.041 INFO:teuthology.orchestra.run.smithi195.stdout:-------------------------------------------------------------------------------- 2024-08-18T22:31:54.042 INFO:teuthology.orchestra.run.smithi195.stdout:Total 427 kB/s | 82 kB 00:00 2024-08-18T22:31:54.042 INFO:teuthology.orchestra.run.smithi195.stdout:Running transaction check 2024-08-18T22:31:54.048 INFO:teuthology.orchestra.run.smithi195.stdout:Transaction check succeeded. 2024-08-18T22:31:54.048 INFO:teuthology.orchestra.run.smithi195.stdout:Running transaction test 2024-08-18T22:31:54.110 INFO:teuthology.orchestra.run.smithi195.stdout:Transaction test succeeded. 2024-08-18T22:31:54.111 INFO:teuthology.orchestra.run.smithi195.stdout:Running transaction 2024-08-18T22:31:54.247 INFO:teuthology.orchestra.run.smithi195.stdout: Preparing : 1/1 2024-08-18T22:31:54.345 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : rbd-fuse-2:17.2.7-1406.gdf62bdcc.el9.x86_64 1/1 2024-08-18T22:31:54.712 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: rbd-fuse-2:17.2.7-1406.gdf62bdcc.el9.x86_64 1/1 2024-08-18T22:31:54.858 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : rbd-mirror-2:17.2.7-1406.gdf62bdcc.el9.x86_64 1/1 2024-08-18T22:31:54.858 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-08-18T22:31:54.858 INFO:teuthology.orchestra.run.smithi121.stdout:Installed: 2024-08-18T22:31:54.858 INFO:teuthology.orchestra.run.smithi121.stdout: rbd-mirror-2:17.2.7-1406.gdf62bdcc.el9.x86_64 2024-08-18T22:31:54.859 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-08-18T22:31:54.859 INFO:teuthology.orchestra.run.smithi121.stdout:Complete! 2024-08-18T22:31:54.976 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : rbd-fuse-2:17.2.7-1406.gdf62bdcc.el9.x86_64 1/1 2024-08-18T22:31:54.976 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-08-18T22:31:54.976 INFO:teuthology.orchestra.run.smithi195.stdout:Installed: 2024-08-18T22:31:54.976 INFO:teuthology.orchestra.run.smithi195.stdout: rbd-fuse-2:17.2.7-1406.gdf62bdcc.el9.x86_64 2024-08-18T22:31:54.976 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-08-18T22:31:54.976 INFO:teuthology.orchestra.run.smithi195.stdout:Complete! 2024-08-18T22:31:55.178 DEBUG:teuthology.orchestra.run.smithi121:> sudo yum -y install rbd-nbd 2024-08-18T22:31:55.261 DEBUG:teuthology.orchestra.run.smithi195:> sudo yum -y install rbd-mirror 2024-08-18T22:31:55.730 INFO:teuthology.orchestra.run.smithi121.stdout:Last metadata expiration check: 0:01:38 ago on Sun 18 Aug 2024 10:30:17 PM UTC. 2024-08-18T22:31:55.808 INFO:teuthology.orchestra.run.smithi195.stdout:Last metadata expiration check: 0:01:38 ago on Sun 18 Aug 2024 10:30:17 PM UTC. 2024-08-18T22:31:55.859 INFO:teuthology.orchestra.run.smithi121.stdout:Dependencies resolved. 2024-08-18T22:31:55.860 INFO:teuthology.orchestra.run.smithi121.stdout:================================================================================ 2024-08-18T22:31:55.860 INFO:teuthology.orchestra.run.smithi121.stdout: Package Architecture Version Repository Size 2024-08-18T22:31:55.860 INFO:teuthology.orchestra.run.smithi121.stdout:================================================================================ 2024-08-18T22:31:55.860 INFO:teuthology.orchestra.run.smithi121.stdout:Installing: 2024-08-18T22:31:55.860 INFO:teuthology.orchestra.run.smithi121.stdout: rbd-nbd x86_64 2:17.2.7-1406.gdf62bdcc.el9 ceph 165 k 2024-08-18T22:31:55.860 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-08-18T22:31:55.860 INFO:teuthology.orchestra.run.smithi121.stdout:Transaction Summary 2024-08-18T22:31:55.860 INFO:teuthology.orchestra.run.smithi121.stdout:================================================================================ 2024-08-18T22:31:55.860 INFO:teuthology.orchestra.run.smithi121.stdout:Install 1 Package 2024-08-18T22:31:55.861 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-08-18T22:31:55.861 INFO:teuthology.orchestra.run.smithi121.stdout:Total download size: 165 k 2024-08-18T22:31:55.861 INFO:teuthology.orchestra.run.smithi121.stdout:Installed size: 477 k 2024-08-18T22:31:55.861 INFO:teuthology.orchestra.run.smithi121.stdout:Downloading Packages: 2024-08-18T22:31:55.938 INFO:teuthology.orchestra.run.smithi195.stdout:Dependencies resolved. 2024-08-18T22:31:55.938 INFO:teuthology.orchestra.run.smithi195.stdout:================================================================================ 2024-08-18T22:31:55.938 INFO:teuthology.orchestra.run.smithi195.stdout: Package Arch Version Repo Size 2024-08-18T22:31:55.939 INFO:teuthology.orchestra.run.smithi195.stdout:================================================================================ 2024-08-18T22:31:55.939 INFO:teuthology.orchestra.run.smithi195.stdout:Installing: 2024-08-18T22:31:55.939 INFO:teuthology.orchestra.run.smithi195.stdout: rbd-mirror x86_64 2:17.2.7-1406.gdf62bdcc.el9 ceph 2.9 M 2024-08-18T22:31:55.939 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-08-18T22:31:55.939 INFO:teuthology.orchestra.run.smithi195.stdout:Transaction Summary 2024-08-18T22:31:55.939 INFO:teuthology.orchestra.run.smithi195.stdout:================================================================================ 2024-08-18T22:31:55.939 INFO:teuthology.orchestra.run.smithi195.stdout:Install 1 Package 2024-08-18T22:31:55.939 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-08-18T22:31:55.939 INFO:teuthology.orchestra.run.smithi195.stdout:Total download size: 2.9 M 2024-08-18T22:31:55.939 INFO:teuthology.orchestra.run.smithi195.stdout:Installed size: 12 M 2024-08-18T22:31:55.939 INFO:teuthology.orchestra.run.smithi195.stdout:Downloading Packages: 2024-08-18T22:31:56.087 INFO:teuthology.orchestra.run.smithi121.stdout:rbd-nbd-17.2.7-1406.gdf62bdcc.el9.x86_64.rpm 729 kB/s | 165 kB 00:00 2024-08-18T22:31:56.087 INFO:teuthology.orchestra.run.smithi121.stdout:-------------------------------------------------------------------------------- 2024-08-18T22:31:56.088 INFO:teuthology.orchestra.run.smithi121.stdout:Total 725 kB/s | 165 kB 00:00 2024-08-18T22:31:56.088 INFO:teuthology.orchestra.run.smithi121.stdout:Running transaction check 2024-08-18T22:31:56.095 INFO:teuthology.orchestra.run.smithi121.stdout:Transaction check succeeded. 2024-08-18T22:31:56.095 INFO:teuthology.orchestra.run.smithi121.stdout:Running transaction test 2024-08-18T22:31:56.158 INFO:teuthology.orchestra.run.smithi121.stdout:Transaction test succeeded. 2024-08-18T22:31:56.158 INFO:teuthology.orchestra.run.smithi121.stdout:Running transaction 2024-08-18T22:31:56.252 INFO:teuthology.orchestra.run.smithi195.stdout:rbd-mirror-17.2.7-1406.gdf62bdcc.el9.x86_64.rpm 9.4 MB/s | 2.9 MB 00:00 2024-08-18T22:31:56.253 INFO:teuthology.orchestra.run.smithi195.stdout:-------------------------------------------------------------------------------- 2024-08-18T22:31:56.253 INFO:teuthology.orchestra.run.smithi195.stdout:Total 9.3 MB/s | 2.9 MB 00:00 2024-08-18T22:31:56.253 INFO:teuthology.orchestra.run.smithi195.stdout:Running transaction check 2024-08-18T22:31:56.262 INFO:teuthology.orchestra.run.smithi195.stdout:Transaction check succeeded. 2024-08-18T22:31:56.262 INFO:teuthology.orchestra.run.smithi195.stdout:Running transaction test 2024-08-18T22:31:56.305 INFO:teuthology.orchestra.run.smithi121.stdout: Preparing : 1/1 2024-08-18T22:31:56.341 INFO:teuthology.orchestra.run.smithi195.stdout:Transaction test succeeded. 2024-08-18T22:31:56.341 INFO:teuthology.orchestra.run.smithi195.stdout:Running transaction 2024-08-18T22:31:56.399 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : rbd-nbd-2:17.2.7-1406.gdf62bdcc.el9.x86_64 1/1 2024-08-18T22:31:56.758 INFO:teuthology.orchestra.run.smithi195.stdout: Preparing : 1/1 2024-08-18T22:31:56.789 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: rbd-nbd-2:17.2.7-1406.gdf62bdcc.el9.x86_64 1/1 2024-08-18T22:31:56.820 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : rbd-mirror-2:17.2.7-1406.gdf62bdcc.el9.x86_64 1/1 2024-08-18T22:31:56.846 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: rbd-mirror-2:17.2.7-1406.gdf62bdcc.el9.x86_64 1/1 2024-08-18T22:31:56.846 INFO:teuthology.orchestra.run.smithi195.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-18T22:31:56.846 INFO:teuthology.orchestra.run.smithi195.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-08-18T22:31:56.846 INFO:teuthology.orchestra.run.smithi195.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-08-18T22:31:56.846 INFO:teuthology.orchestra.run.smithi195.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-08-18T22:31:56.846 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-08-18T22:31:57.034 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : rbd-nbd-2:17.2.7-1406.gdf62bdcc.el9.x86_64 1/1 2024-08-18T22:31:57.034 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-08-18T22:31:57.034 INFO:teuthology.orchestra.run.smithi121.stdout:Installed: 2024-08-18T22:31:57.034 INFO:teuthology.orchestra.run.smithi121.stdout: rbd-nbd-2:17.2.7-1406.gdf62bdcc.el9.x86_64 2024-08-18T22:31:57.034 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-08-18T22:31:57.034 INFO:teuthology.orchestra.run.smithi121.stdout:Complete! 2024-08-18T22:31:57.317 DEBUG:teuthology.parallel:result is None 2024-08-18T22:31:57.889 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : rbd-mirror-2:17.2.7-1406.gdf62bdcc.el9.x86_64 1/1 2024-08-18T22:31:57.889 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-08-18T22:31:57.889 INFO:teuthology.orchestra.run.smithi195.stdout:Installed: 2024-08-18T22:31:57.889 INFO:teuthology.orchestra.run.smithi195.stdout: rbd-mirror-2:17.2.7-1406.gdf62bdcc.el9.x86_64 2024-08-18T22:31:57.889 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-08-18T22:31:57.889 INFO:teuthology.orchestra.run.smithi195.stdout:Complete! 2024-08-18T22:31:58.182 DEBUG:teuthology.orchestra.run.smithi195:> sudo yum -y install rbd-nbd 2024-08-18T22:31:58.738 INFO:teuthology.orchestra.run.smithi195.stdout:Last metadata expiration check: 0:01:41 ago on Sun 18 Aug 2024 10:30:17 PM UTC. 2024-08-18T22:31:58.870 INFO:teuthology.orchestra.run.smithi195.stdout:Dependencies resolved. 2024-08-18T22:31:58.871 INFO:teuthology.orchestra.run.smithi195.stdout:================================================================================ 2024-08-18T22:31:58.871 INFO:teuthology.orchestra.run.smithi195.stdout: Package Architecture Version Repository Size 2024-08-18T22:31:58.871 INFO:teuthology.orchestra.run.smithi195.stdout:================================================================================ 2024-08-18T22:31:58.871 INFO:teuthology.orchestra.run.smithi195.stdout:Installing: 2024-08-18T22:31:58.871 INFO:teuthology.orchestra.run.smithi195.stdout: rbd-nbd x86_64 2:17.2.7-1406.gdf62bdcc.el9 ceph 165 k 2024-08-18T22:31:58.871 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-08-18T22:31:58.871 INFO:teuthology.orchestra.run.smithi195.stdout:Transaction Summary 2024-08-18T22:31:58.871 INFO:teuthology.orchestra.run.smithi195.stdout:================================================================================ 2024-08-18T22:31:58.871 INFO:teuthology.orchestra.run.smithi195.stdout:Install 1 Package 2024-08-18T22:31:58.872 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-08-18T22:31:58.872 INFO:teuthology.orchestra.run.smithi195.stdout:Total download size: 165 k 2024-08-18T22:31:58.872 INFO:teuthology.orchestra.run.smithi195.stdout:Installed size: 477 k 2024-08-18T22:31:58.872 INFO:teuthology.orchestra.run.smithi195.stdout:Downloading Packages: 2024-08-18T22:31:59.098 INFO:teuthology.orchestra.run.smithi195.stdout:rbd-nbd-17.2.7-1406.gdf62bdcc.el9.x86_64.rpm 731 kB/s | 165 kB 00:00 2024-08-18T22:31:59.099 INFO:teuthology.orchestra.run.smithi195.stdout:-------------------------------------------------------------------------------- 2024-08-18T22:31:59.099 INFO:teuthology.orchestra.run.smithi195.stdout:Total 726 kB/s | 165 kB 00:00 2024-08-18T22:31:59.099 INFO:teuthology.orchestra.run.smithi195.stdout:Running transaction check 2024-08-18T22:31:59.106 INFO:teuthology.orchestra.run.smithi195.stdout:Transaction check succeeded. 2024-08-18T22:31:59.106 INFO:teuthology.orchestra.run.smithi195.stdout:Running transaction test 2024-08-18T22:31:59.168 INFO:teuthology.orchestra.run.smithi195.stdout:Transaction test succeeded. 2024-08-18T22:31:59.169 INFO:teuthology.orchestra.run.smithi195.stdout:Running transaction 2024-08-18T22:31:59.315 INFO:teuthology.orchestra.run.smithi195.stdout: Preparing : 1/1 2024-08-18T22:31:59.426 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : rbd-nbd-2:17.2.7-1406.gdf62bdcc.el9.x86_64 1/1 2024-08-18T22:31:59.806 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: rbd-nbd-2:17.2.7-1406.gdf62bdcc.el9.x86_64 1/1 2024-08-18T22:32:00.060 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : rbd-nbd-2:17.2.7-1406.gdf62bdcc.el9.x86_64 1/1 2024-08-18T22:32:00.060 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-08-18T22:32:00.060 INFO:teuthology.orchestra.run.smithi195.stdout:Installed: 2024-08-18T22:32:00.060 INFO:teuthology.orchestra.run.smithi195.stdout: rbd-nbd-2:17.2.7-1406.gdf62bdcc.el9.x86_64 2024-08-18T22:32:00.060 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-08-18T22:32:00.060 INFO:teuthology.orchestra.run.smithi195.stdout:Complete! 2024-08-18T22:32:00.314 DEBUG:teuthology.parallel:result is None 2024-08-18T22:32:00.314 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-08-18T22:32:00.314 INFO:teuthology.packaging:ref: None 2024-08-18T22:32:00.314 INFO:teuthology.packaging:tag: None 2024-08-18T22:32:00.314 INFO:teuthology.packaging:branch: quincy 2024-08-18T22:32:00.314 INFO:teuthology.packaging:sha1: de09dd018de4baddfa6ca4d43bc8fb784cf75833 2024-08-18T22:32:00.315 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=quincy 2024-08-18T22:32:00.548 DEBUG:teuthology.orchestra.run.smithi121:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-08-18T22:32:00.574 INFO:teuthology.orchestra.run.smithi121.stdout:17.2.7-1406.gdf62bdcc.el9 2024-08-18T22:32:00.575 INFO:teuthology.packaging:The installed version of ceph is 17.2.7-1406.gdf62bdcc.el9 2024-08-18T22:32:00.575 INFO:teuthology.task.install:The correct ceph version 17.2.7-1406.gdf62bdcc is installed. 2024-08-18T22:32:00.577 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-08-18T22:32:00.577 INFO:teuthology.packaging:ref: None 2024-08-18T22:32:00.577 INFO:teuthology.packaging:tag: None 2024-08-18T22:32:00.577 INFO:teuthology.packaging:branch: quincy 2024-08-18T22:32:00.577 INFO:teuthology.packaging:sha1: de09dd018de4baddfa6ca4d43bc8fb784cf75833 2024-08-18T22:32:00.577 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=quincy 2024-08-18T22:32:00.788 DEBUG:teuthology.orchestra.run.smithi195:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-08-18T22:32:00.809 INFO:teuthology.orchestra.run.smithi195.stdout:17.2.7-1406.gdf62bdcc.el9 2024-08-18T22:32:00.810 INFO:teuthology.packaging:The installed version of ceph is 17.2.7-1406.gdf62bdcc.el9 2024-08-18T22:32:00.810 INFO:teuthology.task.install:The correct ceph version 17.2.7-1406.gdf62bdcc is installed. 2024-08-18T22:32:00.812 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-08-18T22:32:00.812 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-08-18T22:32:00.812 DEBUG:teuthology.orchestra.run.smithi121:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-08-18T22:32:00.843 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-08-18T22:32:00.843 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-08-18T22:32:00.875 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-08-18T22:32:00.876 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-08-18T22:32:00.876 DEBUG:teuthology.orchestra.run.smithi121:> sudo dd of=/usr/bin/daemon-helper 2024-08-18T22:32:00.911 DEBUG:teuthology.orchestra.run.smithi121:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-08-18T22:32:00.978 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-08-18T22:32:00.978 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd of=/usr/bin/daemon-helper 2024-08-18T22:32:01.002 DEBUG:teuthology.orchestra.run.smithi195:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-08-18T22:32:01.067 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-08-18T22:32:01.068 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-08-18T22:32:01.068 DEBUG:teuthology.orchestra.run.smithi121:> sudo dd of=/usr/bin/adjust-ulimits 2024-08-18T22:32:01.094 DEBUG:teuthology.orchestra.run.smithi121:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-08-18T22:32:01.158 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-08-18T22:32:01.158 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd of=/usr/bin/adjust-ulimits 2024-08-18T22:32:01.183 DEBUG:teuthology.orchestra.run.smithi195:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-08-18T22:32:01.247 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-08-18T22:32:01.247 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-08-18T22:32:01.248 DEBUG:teuthology.orchestra.run.smithi121:> sudo dd of=/usr/bin/stdin-killer 2024-08-18T22:32:01.272 DEBUG:teuthology.orchestra.run.smithi121:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-08-18T22:32:01.339 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-08-18T22:32:01.339 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd of=/usr/bin/stdin-killer 2024-08-18T22:32:01.364 DEBUG:teuthology.orchestra.run.smithi195:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-08-18T22:32:01.428 INFO:teuthology.run_tasks:Running task print... 2024-08-18T22:32:01.439 INFO:teuthology.task.print:**** done install task... 2024-08-18T22:32:01.439 INFO:teuthology.run_tasks:Running task cephadm... 2024-08-18T22:32:01.535 INFO:tasks.cephadm:Config: {'cephadm_branch': 'quincy', 'cephadm_git_url': 'https://github.com/ceph/ceph', 'conf': {'osd': {'osd_class_default_list': '*', 'osd_class_load_list': '*', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'mon pg warn min per osd': 0}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120, 'mon warn on pool no app': False}}, 'image': 'quay.ceph.io/ceph-ci/ceph:quincy', 'roleless': True, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'OSD_DOWN', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy'], 'sha1': 'de09dd018de4baddfa6ca4d43bc8fb784cf75833'} 2024-08-18T22:32:01.535 INFO:tasks.cephadm:Cluster image is quay.ceph.io/ceph-ci/ceph:quincy 2024-08-18T22:32:01.536 INFO:tasks.cephadm:Cluster fsid is b003123a-5db1-11ef-bccf-c7b262605968 2024-08-18T22:32:01.536 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2024-08-18T22:32:01.536 INFO:tasks.cephadm:No mon roles; fabricating mons 2024-08-18T22:32:01.536 INFO:tasks.cephadm:Monitor IPs: {'mon.smithi121': '172.21.15.121', 'mon.smithi195': '172.21.15.195'} 2024-08-18T22:32:01.536 INFO:tasks.cephadm:Normalizing hostnames... 2024-08-18T22:32:01.536 DEBUG:teuthology.orchestra.run.smithi121:> sudo hostname $(hostname -s) 2024-08-18T22:32:01.562 DEBUG:teuthology.orchestra.run.smithi195:> sudo hostname $(hostname -s) 2024-08-18T22:32:01.587 INFO:tasks.cephadm:Downloading cephadm (repo https://github.com/ceph/ceph ref quincy)... 2024-08-18T22:32:01.587 DEBUG:teuthology.orchestra.run.smithi121:> curl --silent https://raw.githubusercontent.com/ceph/ceph/quincy/src/cephadm/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-08-18T22:32:01.786 INFO:teuthology.orchestra.run.smithi121.stdout:-rw-r--r--. 1 ubuntu ubuntu 378585 Aug 18 22:32 /home/ubuntu/cephtest/cephadm 2024-08-18T22:32:01.786 DEBUG:teuthology.orchestra.run.smithi195:> curl --silent https://raw.githubusercontent.com/ceph/ceph/quincy/src/cephadm/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-08-18T22:32:01.911 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r--. 1 ubuntu ubuntu 378585 Aug 18 22:32 /home/ubuntu/cephtest/cephadm 2024-08-18T22:32:01.911 DEBUG:teuthology.orchestra.run.smithi121:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-08-18T22:32:01.928 DEBUG:teuthology.orchestra.run.smithi195:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-08-18T22:32:01.952 INFO:tasks.cephadm:Pulling image quay.ceph.io/ceph-ci/ceph:quincy on all hosts... 2024-08-18T22:32:01.953 DEBUG:teuthology.orchestra.run.smithi121:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy pull 2024-08-18T22:32:01.970 DEBUG:teuthology.orchestra.run.smithi195:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy pull 2024-08-18T22:32:03.517 INFO:teuthology.orchestra.run.smithi121.stderr:Pulling container image quay.ceph.io/ceph-ci/ceph:quincy... 2024-08-18T22:32:03.627 INFO:teuthology.orchestra.run.smithi195.stderr:Pulling container image quay.ceph.io/ceph-ci/ceph:quincy... 2024-08-18T22:32:29.705 INFO:teuthology.orchestra.run.smithi121.stdout:{ 2024-08-18T22:32:29.706 INFO:teuthology.orchestra.run.smithi121.stdout: "ceph_version": "ceph version 17.2.7-1406-gdf62bdcc (df62bdccd9a13bf566b27a250eddfdd89be3072d) quincy (stable)", 2024-08-18T22:32:29.706 INFO:teuthology.orchestra.run.smithi121.stdout: "image_id": "774894bef55f35ea913e9d162881c8ec1edc99a6073e592937af43fb95913b24", 2024-08-18T22:32:29.706 INFO:teuthology.orchestra.run.smithi121.stdout: "repo_digests": [ 2024-08-18T22:32:29.706 INFO:teuthology.orchestra.run.smithi121.stdout: "quay.ceph.io/ceph-ci/ceph@sha256:bf20fb88c15fff689cf84383793d3756b4df7aceb11592a28c78dd893a0b3e7d" 2024-08-18T22:32:29.706 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-08-18T22:32:29.706 INFO:teuthology.orchestra.run.smithi121.stdout:} 2024-08-18T22:32:32.084 INFO:teuthology.orchestra.run.smithi195.stdout:{ 2024-08-18T22:32:32.085 INFO:teuthology.orchestra.run.smithi195.stdout: "ceph_version": "ceph version 17.2.7-1406-gdf62bdcc (df62bdccd9a13bf566b27a250eddfdd89be3072d) quincy (stable)", 2024-08-18T22:32:32.085 INFO:teuthology.orchestra.run.smithi195.stdout: "image_id": "774894bef55f35ea913e9d162881c8ec1edc99a6073e592937af43fb95913b24", 2024-08-18T22:32:32.085 INFO:teuthology.orchestra.run.smithi195.stdout: "repo_digests": [ 2024-08-18T22:32:32.085 INFO:teuthology.orchestra.run.smithi195.stdout: "quay.ceph.io/ceph-ci/ceph@sha256:bf20fb88c15fff689cf84383793d3756b4df7aceb11592a28c78dd893a0b3e7d" 2024-08-18T22:32:32.085 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-08-18T22:32:32.085 INFO:teuthology.orchestra.run.smithi195.stdout:} 2024-08-18T22:32:32.104 DEBUG:teuthology.orchestra.run.smithi121:> sudo mkdir -p /etc/ceph 2024-08-18T22:32:32.137 DEBUG:teuthology.orchestra.run.smithi195:> sudo mkdir -p /etc/ceph 2024-08-18T22:32:32.166 DEBUG:teuthology.orchestra.run.smithi121:> sudo chmod 777 /etc/ceph 2024-08-18T22:32:32.205 DEBUG:teuthology.orchestra.run.smithi195:> sudo chmod 777 /etc/ceph 2024-08-18T22:32:32.231 INFO:tasks.cephadm:Writing seed config... 2024-08-18T22:32:32.232 INFO:tasks.cephadm: override: [osd] osd_class_default_list = * 2024-08-18T22:32:32.232 INFO:tasks.cephadm: override: [osd] osd_class_load_list = * 2024-08-18T22:32:32.232 INFO:tasks.cephadm: override: [osd] bdev async discard = True 2024-08-18T22:32:32.232 INFO:tasks.cephadm: override: [osd] bdev enable discard = True 2024-08-18T22:32:32.232 INFO:tasks.cephadm: override: [osd] bluestore allocator = bitmap 2024-08-18T22:32:32.232 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2024-08-18T22:32:32.232 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2024-08-18T22:32:32.232 INFO:tasks.cephadm: override: [osd] debug bluefs = 1/20 2024-08-18T22:32:32.232 INFO:tasks.cephadm: override: [osd] debug bluestore = 1/20 2024-08-18T22:32:32.232 INFO:tasks.cephadm: override: [osd] debug ms = 1 2024-08-18T22:32:32.232 INFO:tasks.cephadm: override: [osd] debug osd = 20 2024-08-18T22:32:32.232 INFO:tasks.cephadm: override: [osd] debug rocksdb = 4/10 2024-08-18T22:32:32.233 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2024-08-18T22:32:32.233 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2024-08-18T22:32:32.233 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2024-08-18T22:32:32.233 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2024-08-18T22:32:32.233 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2024-08-18T22:32:32.233 INFO:tasks.cephadm: override: [osd] osd op complaint time = 180 2024-08-18T22:32:32.233 INFO:tasks.cephadm: override: [client] client mount timeout = 600 2024-08-18T22:32:32.233 INFO:tasks.cephadm: override: [client] debug client = 20 2024-08-18T22:32:32.233 INFO:tasks.cephadm: override: [client] debug ms = 1 2024-08-18T22:32:32.233 INFO:tasks.cephadm: override: [client] rados mon op timeout = 900 2024-08-18T22:32:32.233 INFO:tasks.cephadm: override: [client] rados osd op timeout = 900 2024-08-18T22:32:32.233 INFO:tasks.cephadm: override: [global] mon pg warn min per osd = 0 2024-08-18T22:32:32.233 INFO:tasks.cephadm: override: [mds] debug mds = 20 2024-08-18T22:32:32.233 INFO:tasks.cephadm: override: [mds] debug mds balancer = 20 2024-08-18T22:32:32.233 INFO:tasks.cephadm: override: [mds] debug ms = 1 2024-08-18T22:32:32.233 INFO:tasks.cephadm: override: [mds] mds debug frag = True 2024-08-18T22:32:32.234 INFO:tasks.cephadm: override: [mds] mds debug scatterstat = True 2024-08-18T22:32:32.234 INFO:tasks.cephadm: override: [mds] mds op complaint time = 180 2024-08-18T22:32:32.234 INFO:tasks.cephadm: override: [mds] mds verify scatter = True 2024-08-18T22:32:32.234 INFO:tasks.cephadm: override: [mds] osd op complaint time = 180 2024-08-18T22:32:32.234 INFO:tasks.cephadm: override: [mds] rados mon op timeout = 900 2024-08-18T22:32:32.234 INFO:tasks.cephadm: override: [mds] rados osd op timeout = 900 2024-08-18T22:32:32.234 INFO:tasks.cephadm: override: [mgr] debug client = 20 2024-08-18T22:32:32.234 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2024-08-18T22:32:32.234 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2024-08-18T22:32:32.234 INFO:tasks.cephadm: override: [mon] debug mon = 20 2024-08-18T22:32:32.235 INFO:tasks.cephadm: override: [mon] debug ms = 1 2024-08-18T22:32:32.235 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2024-08-18T22:32:32.235 INFO:tasks.cephadm: override: [mon] mon down mkfs grace = 300 2024-08-18T22:32:32.235 INFO:tasks.cephadm: override: [mon] mon op complaint time = 120 2024-08-18T22:32:32.235 INFO:tasks.cephadm: override: [mon] mon warn on pool no app = False 2024-08-18T22:32:32.236 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-08-18T22:32:32.236 DEBUG:teuthology.orchestra.run.smithi121:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2024-08-18T22:32:32.262 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log to file = true mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = b003123a-5db1-11ef-bccf-c7b262605968 mon pg warn min per osd = 0 [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = true bdev debug aio = true osd sloppy crc = true osd_class_default_list = * osd_class_load_list = * bdev async discard = True bdev enable discard = True bluestore allocator = bitmap bluestore block size = 96636764160 bluestore fsck on mount = True debug bluefs = 1/20 debug bluestore = 1/20 debug ms = 1 debug osd = 20 debug rocksdb = 4/10 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd objectstore = bluestore osd op complaint time = 180 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false debug client = 20 debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon down mkfs grace = 300 mon op complaint time = 120 mon warn on pool no app = False [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [client] client mount timeout = 600 debug client = 20 debug ms = 1 rados mon op timeout = 900 rados osd op timeout = 900 [mds] debug mds = 20 debug mds balancer = 20 debug ms = 1 mds debug frag = True mds debug scatterstat = True mds op complaint time = 180 mds verify scatter = True osd op complaint time = 180 rados mon op timeout = 900 rados osd op timeout = 900 2024-08-18T22:32:32.263 DEBUG:teuthology.orchestra.run.smithi121:mon.smithi121> sudo journalctl -f -n 0 -u ceph-b003123a-5db1-11ef-bccf-c7b262605968@mon.smithi121.service 2024-08-18T22:32:32.305 INFO:tasks.cephadm:Bootstrapping... 2024-08-18T22:32:32.305 DEBUG:teuthology.orchestra.run.smithi121:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy -v bootstrap --fsid b003123a-5db1-11ef-bccf-c7b262605968 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-ip 172.21.15.121 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2024-08-18T22:32:32.505 INFO:teuthology.orchestra.run.smithi121.stdout:-------------------------------------------------------------------------------- 2024-08-18T22:32:32.505 INFO:teuthology.orchestra.run.smithi121.stdout:cephadm ['--image', 'quay.ceph.io/ceph-ci/ceph:quincy', '-v', 'bootstrap', '--fsid', 'b003123a-5db1-11ef-bccf-c7b262605968', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-ip', '172.21.15.121', '--skip-admin-label'] 2024-08-18T22:32:32.531 INFO:teuthology.orchestra.run.smithi121.stdout:/bin/podman: stdout 5.1.2 2024-08-18T22:32:32.531 INFO:teuthology.orchestra.run.smithi121.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2024-08-18T22:32:32.531 INFO:teuthology.orchestra.run.smithi121.stdout:Verifying podman|docker is present... 2024-08-18T22:32:32.555 INFO:teuthology.orchestra.run.smithi121.stdout:/bin/podman: stdout 5.1.2 2024-08-18T22:32:32.555 INFO:teuthology.orchestra.run.smithi121.stdout:Verifying lvm2 is present... 2024-08-18T22:32:32.555 INFO:teuthology.orchestra.run.smithi121.stdout:Verifying time synchronization is in place... 2024-08-18T22:32:32.563 INFO:teuthology.orchestra.run.smithi121.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-08-18T22:32:32.563 INFO:teuthology.orchestra.run.smithi121.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-08-18T22:32:32.569 INFO:teuthology.orchestra.run.smithi121.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-08-18T22:32:32.569 INFO:teuthology.orchestra.run.smithi121.stdout:systemctl: stdout inactive 2024-08-18T22:32:32.576 INFO:teuthology.orchestra.run.smithi121.stdout:systemctl: stdout enabled 2024-08-18T22:32:32.583 INFO:teuthology.orchestra.run.smithi121.stdout:systemctl: stdout active 2024-08-18T22:32:32.583 INFO:teuthology.orchestra.run.smithi121.stdout:Unit chronyd.service is enabled and running 2024-08-18T22:32:32.583 INFO:teuthology.orchestra.run.smithi121.stdout:Repeating the final host check... 2024-08-18T22:32:32.615 INFO:teuthology.orchestra.run.smithi121.stdout:/bin/podman: stdout 5.1.2 2024-08-18T22:32:32.615 INFO:teuthology.orchestra.run.smithi121.stdout:podman (/bin/podman) version 5.1.2 is present 2024-08-18T22:32:32.615 INFO:teuthology.orchestra.run.smithi121.stdout:systemctl is present 2024-08-18T22:32:32.616 INFO:teuthology.orchestra.run.smithi121.stdout:lvcreate is present 2024-08-18T22:32:32.622 INFO:teuthology.orchestra.run.smithi121.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-08-18T22:32:32.622 INFO:teuthology.orchestra.run.smithi121.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-08-18T22:32:32.629 INFO:teuthology.orchestra.run.smithi121.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-08-18T22:32:32.629 INFO:teuthology.orchestra.run.smithi121.stdout:systemctl: stdout inactive 2024-08-18T22:32:32.636 INFO:teuthology.orchestra.run.smithi121.stdout:systemctl: stdout enabled 2024-08-18T22:32:32.643 INFO:teuthology.orchestra.run.smithi121.stdout:systemctl: stdout active 2024-08-18T22:32:32.643 INFO:teuthology.orchestra.run.smithi121.stdout:Unit chronyd.service is enabled and running 2024-08-18T22:32:32.643 INFO:teuthology.orchestra.run.smithi121.stdout:Host looks OK 2024-08-18T22:32:32.643 INFO:teuthology.orchestra.run.smithi121.stdout:Cluster fsid: b003123a-5db1-11ef-bccf-c7b262605968 2024-08-18T22:32:32.643 INFO:teuthology.orchestra.run.smithi121.stdout:Acquiring lock 139834089263792 on /run/cephadm/b003123a-5db1-11ef-bccf-c7b262605968.lock 2024-08-18T22:32:32.643 INFO:teuthology.orchestra.run.smithi121.stdout:Lock 139834089263792 acquired on /run/cephadm/b003123a-5db1-11ef-bccf-c7b262605968.lock 2024-08-18T22:32:32.644 INFO:teuthology.orchestra.run.smithi121.stdout:Verifying IP 172.21.15.121 port 3300 ... 2024-08-18T22:32:32.644 INFO:teuthology.orchestra.run.smithi121.stdout:Verifying IP 172.21.15.121 port 6789 ... 2024-08-18T22:32:32.644 INFO:teuthology.orchestra.run.smithi121.stdout:Base mon IP(s) is [172.21.15.121:3300, 172.21.15.121:6789], mon addrv is [v2:172.21.15.121:3300,v1:172.21.15.121:6789] 2024-08-18T22:32:32.647 INFO:teuthology.orchestra.run.smithi121.stdout:/sbin/ip: stdout default via 172.21.15.254 dev enp3s0f1 proto dhcp src 172.21.15.121 metric 100 2024-08-18T22:32:32.647 INFO:teuthology.orchestra.run.smithi121.stdout:/sbin/ip: stdout 172.21.0.0/20 dev enp3s0f1 proto kernel scope link src 172.21.15.121 metric 100 2024-08-18T22:32:32.650 INFO:teuthology.orchestra.run.smithi121.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2024-08-18T22:32:32.650 INFO:teuthology.orchestra.run.smithi121.stdout:/sbin/ip: stdout fe80::/64 dev enp3s0f1 proto kernel metric 1024 pref medium 2024-08-18T22:32:32.650 INFO:teuthology.orchestra.run.smithi121.stdout:/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev enp3s0f1 proto ra metric 100 pref medium 2024-08-18T22:32:32.653 INFO:teuthology.orchestra.run.smithi121.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2024-08-18T22:32:32.653 INFO:teuthology.orchestra.run.smithi121.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2024-08-18T22:32:32.653 INFO:teuthology.orchestra.run.smithi121.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-08-18T22:32:32.653 INFO:teuthology.orchestra.run.smithi121.stdout:/sbin/ip: stdout 5: enp3s0f1: mtu 1500 state UP qlen 1000 2024-08-18T22:32:32.653 INFO:teuthology.orchestra.run.smithi121.stdout:/sbin/ip: stdout inet6 fe80::ec4:7aff:fe8f:cba3/64 scope link noprefixroute 2024-08-18T22:32:32.654 INFO:teuthology.orchestra.run.smithi121.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-08-18T22:32:32.655 INFO:teuthology.orchestra.run.smithi121.stdout:Mon IP `172.21.15.121` is in CIDR network `172.21.0.0/20` 2024-08-18T22:32:32.655 INFO:teuthology.orchestra.run.smithi121.stdout:Mon IP `172.21.15.121` is in CIDR network `172.21.0.0/20` 2024-08-18T22:32:32.655 INFO:teuthology.orchestra.run.smithi121.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2024-08-18T22:32:32.655 INFO:teuthology.orchestra.run.smithi121.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2024-08-18T22:32:32.655 INFO:teuthology.orchestra.run.smithi121.stdout:Pulling container image quay.ceph.io/ceph-ci/ceph:quincy... 2024-08-18T22:32:33.147 INFO:teuthology.orchestra.run.smithi121.stdout:/bin/podman: stdout 774894bef55f35ea913e9d162881c8ec1edc99a6073e592937af43fb95913b24 2024-08-18T22:32:33.147 INFO:teuthology.orchestra.run.smithi121.stdout:/bin/podman: stderr Trying to pull quay.ceph.io/ceph-ci/ceph:quincy... 2024-08-18T22:32:33.147 INFO:teuthology.orchestra.run.smithi121.stdout:/bin/podman: stderr Getting image source signatures 2024-08-18T22:32:33.147 INFO:teuthology.orchestra.run.smithi121.stdout:/bin/podman: stderr Copying blob sha256:70731261e7f7910eab61fec9e01745777de884ba38f3eb0527758bf9057b4310 2024-08-18T22:32:33.147 INFO:teuthology.orchestra.run.smithi121.stdout:/bin/podman: stderr Copying blob sha256:e8b54c863393b7a8216a71737771b73b16a8e43ec7acf927c7faa175c255e551 2024-08-18T22:32:33.147 INFO:teuthology.orchestra.run.smithi121.stdout:/bin/podman: stderr Copying config sha256:774894bef55f35ea913e9d162881c8ec1edc99a6073e592937af43fb95913b24 2024-08-18T22:32:33.147 INFO:teuthology.orchestra.run.smithi121.stdout:/bin/podman: stderr Writing manifest to image destination 2024-08-18T22:32:34.059 INFO:teuthology.orchestra.run.smithi121.stdout:ceph: stdout ceph version 17.2.7-1406-gdf62bdcc (df62bdccd9a13bf566b27a250eddfdd89be3072d) quincy (stable) 2024-08-18T22:32:34.060 INFO:teuthology.orchestra.run.smithi121.stdout:Ceph version: ceph version 17.2.7-1406-gdf62bdcc (df62bdccd9a13bf566b27a250eddfdd89be3072d) quincy (stable) 2024-08-18T22:32:34.060 INFO:teuthology.orchestra.run.smithi121.stdout:Extracting ceph user uid/gid from container image... 2024-08-18T22:32:34.982 INFO:teuthology.orchestra.run.smithi121.stdout:stat: stdout 167 167 2024-08-18T22:32:34.982 INFO:teuthology.orchestra.run.smithi121.stdout:Creating initial keys... 2024-08-18T22:32:35.922 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph-authtool: stdout AQCDdsJmcDydERAABVgpg9N2ee9MEOqxBVgsUQ== 2024-08-18T22:32:36.860 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph-authtool: stdout AQCEdsJm7Wx/DxAA0/3NtNjpTT+MbuNA+qb9UA== 2024-08-18T22:32:37.725 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph-authtool: stdout AQCFdsJm2fFmChAAUmB/YS8OJnBKc0kG1p2X5g== 2024-08-18T22:32:37.726 INFO:teuthology.orchestra.run.smithi121.stdout:Creating initial monmap... 2024-08-18T22:32:38.930 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2024-08-18T22:32:38.931 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = octopus 2024-08-18T22:32:38.931 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to b003123a-5db1-11ef-bccf-c7b262605968 2024-08-18T22:32:38.931 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-08-18T22:32:38.931 INFO:teuthology.orchestra.run.smithi121.stdout:monmaptool for smithi121 [v2:172.21.15.121:3300,v1:172.21.15.121:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2024-08-18T22:32:38.931 INFO:teuthology.orchestra.run.smithi121.stdout:setting min_mon_release = octopus 2024-08-18T22:32:38.931 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/monmaptool: set fsid to b003123a-5db1-11ef-bccf-c7b262605968 2024-08-18T22:32:38.931 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-08-18T22:32:38.931 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-08-18T22:32:38.931 INFO:teuthology.orchestra.run.smithi121.stdout:Creating mon... 2024-08-18T22:32:39.903 INFO:teuthology.orchestra.run.smithi121.stdout:create mon.smithi121 on 2024-08-18T22:32:40.118 INFO:teuthology.orchestra.run.smithi121.stdout:systemctl: stderr Removed "/etc/systemd/system/multi-user.target.wants/ceph.target". 2024-08-18T22:32:40.268 INFO:teuthology.orchestra.run.smithi121.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2024-08-18T22:32:40.423 INFO:teuthology.orchestra.run.smithi121.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-b003123a-5db1-11ef-bccf-c7b262605968.target → /etc/systemd/system/ceph-b003123a-5db1-11ef-bccf-c7b262605968.target. 2024-08-18T22:32:40.423 INFO:teuthology.orchestra.run.smithi121.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-b003123a-5db1-11ef-bccf-c7b262605968.target → /etc/systemd/system/ceph-b003123a-5db1-11ef-bccf-c7b262605968.target. 2024-08-18T22:32:40.608 INFO:teuthology.orchestra.run.smithi121.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-b003123a-5db1-11ef-bccf-c7b262605968@mon.smithi121 2024-08-18T22:32:40.608 INFO:teuthology.orchestra.run.smithi121.stdout:systemctl: stderr Failed to reset failed state of unit ceph-b003123a-5db1-11ef-bccf-c7b262605968@mon.smithi121.service: Unit ceph-b003123a-5db1-11ef-bccf-c7b262605968@mon.smithi121.service not loaded. 2024-08-18T22:32:40.779 INFO:teuthology.orchestra.run.smithi121.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-b003123a-5db1-11ef-bccf-c7b262605968.target.wants/ceph-b003123a-5db1-11ef-bccf-c7b262605968@mon.smithi121.service → /etc/systemd/system/ceph-b003123a-5db1-11ef-bccf-c7b262605968@.service. 2024-08-18T22:32:41.418 INFO:teuthology.orchestra.run.smithi121.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-08-18T22:32:41.419 INFO:teuthology.orchestra.run.smithi121.stdout:systemctl: stdout disabled 2024-08-18T22:32:41.426 INFO:teuthology.orchestra.run.smithi121.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-08-18T22:32:41.426 INFO:teuthology.orchestra.run.smithi121.stdout:systemctl: stdout inactive 2024-08-18T22:32:41.426 INFO:teuthology.orchestra.run.smithi121.stdout:firewalld.service is not enabled 2024-08-18T22:32:41.426 INFO:teuthology.orchestra.run.smithi121.stdout:Not possible to enable service . firewalld.service is not available 2024-08-18T22:32:41.426 INFO:teuthology.orchestra.run.smithi121.stdout:Waiting for mon to start... 2024-08-18T22:32:41.427 INFO:teuthology.orchestra.run.smithi121.stdout:Waiting for mon... 2024-08-18T22:32:41.546 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:32:41 smithi121 systemd[1]: Started Ceph mon.smithi121 for b003123a-5db1-11ef-bccf-c7b262605968. 2024-08-18T22:32:42.402 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:32:42 smithi121 ceph-mon[16422]: mon.smithi121 is new leader, mons smithi121 in quorum (ranks 0) 2024-08-18T22:32:42.402 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:32:42 smithi121 ceph-mon[16422]: monmap e1: 1 mons at {smithi121=[v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-08-18T22:32:42.402 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:32:42 smithi121 ceph-mon[16422]: fsmap 2024-08-18T22:32:42.403 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:32:42 smithi121 ceph-mon[16422]: osdmap e1: 0 total, 0 up, 0 in 2024-08-18T22:32:42.403 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:32:42 smithi121 ceph-mon[16422]: mgrmap e1: no daemons active 2024-08-18T22:32:42.403 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:32:42 smithi121 ceph-mon[16422]: from='client.? 172.21.15.121:0/2035018229' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2024-08-18T22:32:42.404 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stdout cluster: 2024-08-18T22:32:42.411 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stdout id: b003123a-5db1-11ef-bccf-c7b262605968 2024-08-18T22:32:42.411 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2024-08-18T22:32:42.411 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stdout 2024-08-18T22:32:42.411 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stdout services: 2024-08-18T22:32:42.411 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum smithi121 (age 0.557879s) 2024-08-18T22:32:42.411 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2024-08-18T22:32:42.411 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2024-08-18T22:32:42.411 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stdout 2024-08-18T22:32:42.411 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stdout data: 2024-08-18T22:32:42.411 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2024-08-18T22:32:42.412 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2024-08-18T22:32:42.412 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2024-08-18T22:32:42.412 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stdout pgs: 2024-08-18T22:32:42.412 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stdout 2024-08-18T22:32:42.412 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:41.820+0000 7f22f4a8f640 1 Processor -- start 2024-08-18T22:32:42.412 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:41.820+0000 7f22f4a8f640 1 -- start start 2024-08-18T22:32:42.412 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:41.820+0000 7f22f4a8f640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f22f0101ca0 0x7f22f01020b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:42.412 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:41.820+0000 7f22f4a8f640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22f01025f0 con 0x7f22f0101ca0 2024-08-18T22:32:42.412 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:41.821+0000 7f22ee59c640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f22f0101ca0 0x7f22f01020b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:42.412 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:41.821+0000 7f22ee59c640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f22f0101ca0 0x7f22f01020b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:44928/0 (socket says 172.21.15.121:44928) 2024-08-18T22:32:42.412 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:41.821+0000 7f22ee59c640 1 -- 172.21.15.121:0/2574134762 learned_addr learned my addr 172.21.15.121:0/2574134762 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-18T22:32:42.412 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:41.821+0000 7f22ee59c640 1 -- 172.21.15.121:0/2574134762 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22f0102730 con 0x7f22f0101ca0 2024-08-18T22:32:42.412 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:41.823+0000 7f22ee59c640 1 --2- 172.21.15.121:0/2574134762 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f22f0101ca0 0x7f22f01020b0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f22e0009840 tx=0x7f22e00091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65d9c1f5df34622e server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:32:42.412 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:41.823+0000 7f22edd9b640 1 -- 172.21.15.121:0/2574134762 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f22e0032440 con 0x7f22f0101ca0 2024-08-18T22:32:42.412 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:41.823+0000 7f22edd9b640 1 -- 172.21.15.121:0/2574134762 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22e00325a0 con 0x7f22f0101ca0 2024-08-18T22:32:42.413 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:41.823+0000 7f22edd9b640 1 -- 172.21.15.121:0/2574134762 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f22e00328d0 con 0x7f22f0101ca0 2024-08-18T22:32:42.413 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:41.824+0000 7f22f4a8f640 1 -- 172.21.15.121:0/2574134762 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f22f0101ca0 msgr2=0x7f22f01020b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:42.413 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:41.824+0000 7f22f4a8f640 1 --2- 172.21.15.121:0/2574134762 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f22f0101ca0 0x7f22f01020b0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f22e0009840 tx=0x7f22e00091d0 comp rx=0 tx=0).stop 2024-08-18T22:32:42.413 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:41.824+0000 7f22f4a8f640 1 -- 172.21.15.121:0/2574134762 shutdown_connections 2024-08-18T22:32:42.413 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:41.824+0000 7f22f4a8f640 1 --2- 172.21.15.121:0/2574134762 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f22f0101ca0 0x7f22f01020b0 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:42.413 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:41.824+0000 7f22f4a8f640 1 -- 172.21.15.121:0/2574134762 >> 172.21.15.121:0/2574134762 conn(0x7f22f00fd510 msgr2=0x7f22f00ff8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:32:42.413 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:41.824+0000 7f22f4a8f640 1 -- 172.21.15.121:0/2574134762 shutdown_connections 2024-08-18T22:32:42.413 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:41.824+0000 7f22f4a8f640 1 -- 172.21.15.121:0/2574134762 wait complete. 2024-08-18T22:32:42.413 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:41.825+0000 7f22f4a8f640 1 Processor -- start 2024-08-18T22:32:42.413 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:41.825+0000 7f22f4a8f640 1 -- start start 2024-08-18T22:32:42.413 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:41.825+0000 7f22f4a8f640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f22f0101ca0 0x7f22f0110360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:42.413 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:41.825+0000 7f22f4a8f640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22f01108a0 con 0x7f22f0101ca0 2024-08-18T22:32:42.413 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:41.825+0000 7f22ee59c640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f22f0101ca0 0x7f22f0110360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:42.413 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:41.825+0000 7f22ee59c640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f22f0101ca0 0x7f22f0110360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:44932/0 (socket says 172.21.15.121:44932) 2024-08-18T22:32:42.414 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:41.825+0000 7f22ee59c640 1 -- 172.21.15.121:0/2035018229 learned_addr learned my addr 172.21.15.121:0/2035018229 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-18T22:32:42.414 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:41.825+0000 7f22ee59c640 1 -- 172.21.15.121:0/2035018229 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22e0009450 con 0x7f22f0101ca0 2024-08-18T22:32:42.414 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:41.825+0000 7f22ee59c640 1 --2- 172.21.15.121:0/2035018229 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f22f0101ca0 0x7f22f0110360 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f22e002a700 tx=0x7f22e0032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:32:42.414 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:41.825+0000 7f22e6ffd640 1 -- 172.21.15.121:0/2035018229 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f22e0031be0 con 0x7f22f0101ca0 2024-08-18T22:32:42.414 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:41.826+0000 7f22e6ffd640 1 -- 172.21.15.121:0/2035018229 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22e0031d40 con 0x7f22f0101ca0 2024-08-18T22:32:42.414 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:41.826+0000 7f22f4a8f640 1 -- 172.21.15.121:0/2035018229 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22f0110aa0 con 0x7f22f0101ca0 2024-08-18T22:32:42.414 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:41.826+0000 7f22e6ffd640 1 -- 172.21.15.121:0/2035018229 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f22e003b5a0 con 0x7f22f0101ca0 2024-08-18T22:32:42.414 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:41.826+0000 7f22f4a8f640 1 -- 172.21.15.121:0/2035018229 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22f0110eb0 con 0x7f22f0101ca0 2024-08-18T22:32:42.414 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:41.826+0000 7f22e6ffd640 1 -- 172.21.15.121:0/2035018229 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7f22e0039040 con 0x7f22f0101ca0 2024-08-18T22:32:42.414 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:41.826+0000 7f22e6ffd640 1 -- 172.21.15.121:0/2035018229 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f22e0041030 con 0x7f22f0101ca0 2024-08-18T22:32:42.414 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:41.826+0000 7f22f4a8f640 1 -- 172.21.15.121:0/2035018229 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22f004b4c0 con 0x7f22f0101ca0 2024-08-18T22:32:42.414 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:41.829+0000 7f22e6ffd640 1 -- 172.21.15.121:0/2035018229 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71553 (secure 0 0 0) 0x7f22e0037070 con 0x7f22f0101ca0 2024-08-18T22:32:42.414 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:41.886+0000 7f22f4a8f640 1 -- 172.21.15.121:0/2035018229 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "status"} v 0) v1 -- 0x7f22f01098c0 con 0x7f22f0101ca0 2024-08-18T22:32:42.415 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:41.887+0000 7f22e6ffd640 1 -- 172.21.15.121:0/2035018229 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "status"}]=0 v0) v1 ==== 54+0+325 (secure 0 0 0) 0x7f22e003bb80 con 0x7f22f0101ca0 2024-08-18T22:32:42.415 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:41.887+0000 7f22f4a8f640 1 -- 172.21.15.121:0/2035018229 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f22f0101ca0 msgr2=0x7f22f0110360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:42.415 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:41.887+0000 7f22f4a8f640 1 --2- 172.21.15.121:0/2035018229 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f22f0101ca0 0x7f22f0110360 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f22e002a700 tx=0x7f22e0032000 comp rx=0 tx=0).stop 2024-08-18T22:32:42.415 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:41.887+0000 7f22f4a8f640 1 -- 172.21.15.121:0/2035018229 shutdown_connections 2024-08-18T22:32:42.415 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:41.887+0000 7f22f4a8f640 1 --2- 172.21.15.121:0/2035018229 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f22f0101ca0 0x7f22f0110360 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:42.415 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:41.887+0000 7f22f4a8f640 1 -- 172.21.15.121:0/2035018229 >> 172.21.15.121:0/2035018229 conn(0x7f22f00fd510 msgr2=0x7f22f0104810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:32:42.415 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:41.888+0000 7f22f4a8f640 1 -- 172.21.15.121:0/2035018229 shutdown_connections 2024-08-18T22:32:42.415 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:41.888+0000 7f22f4a8f640 1 -- 172.21.15.121:0/2035018229 wait complete. 2024-08-18T22:32:42.415 INFO:teuthology.orchestra.run.smithi121.stdout:mon is available 2024-08-18T22:32:42.415 INFO:teuthology.orchestra.run.smithi121.stdout:Assimilating anything we can from ceph.conf... 2024-08-18T22:32:43.451 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stdout 2024-08-18T22:32:43.451 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stdout [global] 2024-08-18T22:32:43.451 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stdout fsid = b003123a-5db1-11ef-bccf-c7b262605968 2024-08-18T22:32:43.451 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stdout mon_cluster_log_file_level = debug 2024-08-18T22:32:43.451 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.121:3300,v1:172.21.15.121:6789] 2024-08-18T22:32:43.451 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-08-18T22:32:43.451 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-08-18T22:32:43.451 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-08-18T22:32:43.452 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-08-18T22:32:43.452 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stdout 2024-08-18T22:32:43.452 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stdout [mgr] 2024-08-18T22:32:43.452 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-08-18T22:32:43.452 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stdout 2024-08-18T22:32:43.452 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stdout [osd] 2024-08-18T22:32:43.452 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-08-18T22:32:43.452 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-08-18T22:32:43.452 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-08-18T22:32:43.452 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-08-18T22:32:43.452 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-08-18T22:32:43.452 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:42.853+0000 7fbb70897640 1 Processor -- start 2024-08-18T22:32:43.452 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:42.853+0000 7fbb70897640 1 -- start start 2024-08-18T22:32:43.453 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:42.853+0000 7fbb70897640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbb6c078cb0 0x7fbb6c0771e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:43.453 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:42.853+0000 7fbb70897640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb6c0790c0 con 0x7fbb6c078cb0 2024-08-18T22:32:43.453 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:42.854+0000 7fbb6a59c640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbb6c078cb0 0x7fbb6c0771e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:43.453 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:42.854+0000 7fbb6a59c640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbb6c078cb0 0x7fbb6c0771e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:44942/0 (socket says 172.21.15.121:44942) 2024-08-18T22:32:43.453 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:42.854+0000 7fbb6a59c640 1 -- 172.21.15.121:0/3923907006 learned_addr learned my addr 172.21.15.121:0/3923907006 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-18T22:32:43.453 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:42.854+0000 7fbb6a59c640 1 -- 172.21.15.121:0/3923907006 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb6c077720 con 0x7fbb6c078cb0 2024-08-18T22:32:43.453 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:42.855+0000 7fbb6a59c640 1 --2- 172.21.15.121:0/3923907006 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbb6c078cb0 0x7fbb6c0771e0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7fbb5c009840 tx=0x7fbb5c0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b819b977615a8d13 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:32:43.453 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:42.855+0000 7fbb69d9b640 1 -- 172.21.15.121:0/3923907006 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fbb5c032440 con 0x7fbb6c078cb0 2024-08-18T22:32:43.453 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:42.855+0000 7fbb69d9b640 1 -- 172.21.15.121:0/3923907006 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb5c0325a0 con 0x7fbb6c078cb0 2024-08-18T22:32:43.453 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:42.855+0000 7fbb69d9b640 1 -- 172.21.15.121:0/3923907006 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fbb5c0328d0 con 0x7fbb6c078cb0 2024-08-18T22:32:43.453 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:42.855+0000 7fbb70897640 1 -- 172.21.15.121:0/3923907006 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbb6c078cb0 msgr2=0x7fbb6c0771e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:43.453 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:42.855+0000 7fbb70897640 1 --2- 172.21.15.121:0/3923907006 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbb6c078cb0 0x7fbb6c0771e0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7fbb5c009840 tx=0x7fbb5c0091d0 comp rx=0 tx=0).stop 2024-08-18T22:32:43.454 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:42.855+0000 7fbb70897640 1 -- 172.21.15.121:0/3923907006 shutdown_connections 2024-08-18T22:32:43.454 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:42.855+0000 7fbb70897640 1 --2- 172.21.15.121:0/3923907006 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbb6c078cb0 0x7fbb6c0771e0 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:43.454 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:42.855+0000 7fbb70897640 1 -- 172.21.15.121:0/3923907006 >> 172.21.15.121:0/3923907006 conn(0x7fbb6c0fd510 msgr2=0x7fbb6c0ff8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:32:43.454 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:42.855+0000 7fbb70897640 1 -- 172.21.15.121:0/3923907006 shutdown_connections 2024-08-18T22:32:43.454 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:42.855+0000 7fbb70897640 1 -- 172.21.15.121:0/3923907006 wait complete. 2024-08-18T22:32:43.454 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:42.856+0000 7fbb70897640 1 Processor -- start 2024-08-18T22:32:43.454 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:42.856+0000 7fbb70897640 1 -- start start 2024-08-18T22:32:43.454 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:42.856+0000 7fbb70897640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbb6c078cb0 0x7fbb6c112520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:43.454 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:42.856+0000 7fbb70897640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb6c112a60 con 0x7fbb6c078cb0 2024-08-18T22:32:43.454 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:42.856+0000 7fbb6a59c640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbb6c078cb0 0x7fbb6c112520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:43.454 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:42.856+0000 7fbb6a59c640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbb6c078cb0 0x7fbb6c112520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:44948/0 (socket says 172.21.15.121:44948) 2024-08-18T22:32:43.454 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:42.856+0000 7fbb6a59c640 1 -- 172.21.15.121:0/3241748750 learned_addr learned my addr 172.21.15.121:0/3241748750 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-18T22:32:43.454 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:42.856+0000 7fbb6a59c640 1 -- 172.21.15.121:0/3241748750 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb5c009450 con 0x7fbb6c078cb0 2024-08-18T22:32:43.455 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:42.857+0000 7fbb6a59c640 1 --2- 172.21.15.121:0/3241748750 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbb6c078cb0 0x7fbb6c112520 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7fbb5c02a700 tx=0x7fbb5c032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:32:43.455 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:42.857+0000 7fbb62ffd640 1 -- 172.21.15.121:0/3241748750 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fbb5c031be0 con 0x7fbb6c078cb0 2024-08-18T22:32:43.455 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:42.857+0000 7fbb62ffd640 1 -- 172.21.15.121:0/3241748750 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb5c031d40 con 0x7fbb6c078cb0 2024-08-18T22:32:43.455 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:42.857+0000 7fbb70897640 1 -- 172.21.15.121:0/3241748750 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb6c112c60 con 0x7fbb6c078cb0 2024-08-18T22:32:43.455 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:42.857+0000 7fbb62ffd640 1 -- 172.21.15.121:0/3241748750 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fbb5c03b5a0 con 0x7fbb6c078cb0 2024-08-18T22:32:43.455 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:42.857+0000 7fbb70897640 1 -- 172.21.15.121:0/3241748750 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb6c113070 con 0x7fbb6c078cb0 2024-08-18T22:32:43.455 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:42.857+0000 7fbb62ffd640 1 -- 172.21.15.121:0/3241748750 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7fbb5c039040 con 0x7fbb6c078cb0 2024-08-18T22:32:43.455 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:42.857+0000 7fbb62ffd640 1 -- 172.21.15.121:0/3241748750 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7fbb5c041030 con 0x7fbb6c078cb0 2024-08-18T22:32:43.455 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:42.858+0000 7fbb70897640 1 -- 172.21.15.121:0/3241748750 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb6c04b4c0 con 0x7fbb6c078cb0 2024-08-18T22:32:43.455 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:42.860+0000 7fbb62ffd640 1 -- 172.21.15.121:0/3241748750 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71553 (secure 0 0 0) 0x7fbb5c037070 con 0x7fbb6c078cb0 2024-08-18T22:32:43.455 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:42.916+0000 7fbb70897640 1 -- 172.21.15.121:0/3241748750 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) v1 -- 0x7fbb6c10be80 con 0x7fbb6c078cb0 2024-08-18T22:32:43.455 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:42.919+0000 7fbb62ffd640 1 -- 172.21.15.121:0/3241748750 <== mon.0 v2:172.21.15.121:3300/0 7 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7fbb5c046c30 con 0x7fbb6c078cb0 2024-08-18T22:32:43.455 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:42.919+0000 7fbb62ffd640 1 -- 172.21.15.121:0/3241748750 <== mon.0 v2:172.21.15.121:3300/0 8 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v2) v1 ==== 70+0+467 (secure 0 0 0) 0x7fbb5c054d80 con 0x7fbb6c078cb0 2024-08-18T22:32:43.455 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:42.920+0000 7fbb70897640 1 -- 172.21.15.121:0/3241748750 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbb6c078cb0 msgr2=0x7fbb6c112520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:43.456 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:42.920+0000 7fbb70897640 1 --2- 172.21.15.121:0/3241748750 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbb6c078cb0 0x7fbb6c112520 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7fbb5c02a700 tx=0x7fbb5c032000 comp rx=0 tx=0).stop 2024-08-18T22:32:43.456 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:42.920+0000 7fbb70897640 1 -- 172.21.15.121:0/3241748750 shutdown_connections 2024-08-18T22:32:43.456 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:42.920+0000 7fbb70897640 1 --2- 172.21.15.121:0/3241748750 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbb6c078cb0 0x7fbb6c112520 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:43.456 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:42.920+0000 7fbb70897640 1 -- 172.21.15.121:0/3241748750 >> 172.21.15.121:0/3241748750 conn(0x7fbb6c0fd510 msgr2=0x7fbb6c1093a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:32:43.456 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:42.920+0000 7fbb70897640 1 -- 172.21.15.121:0/3241748750 shutdown_connections 2024-08-18T22:32:43.456 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:42.920+0000 7fbb70897640 1 -- 172.21.15.121:0/3241748750 wait complete. 2024-08-18T22:32:43.456 INFO:teuthology.orchestra.run.smithi121.stdout:Generating new minimal ceph.conf... 2024-08-18T22:32:43.550 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:32:43 smithi121 ceph-mon[16422]: from='client.? 172.21.15.121:0/3241748750' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-08-18T22:32:43.551 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:32:43 smithi121 ceph-mon[16422]: from='client.? 172.21.15.121:0/3241748750' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2024-08-18T22:32:44.430 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:43.832+0000 7f07107a4640 1 Processor -- start 2024-08-18T22:32:44.430 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:43.832+0000 7f07107a4640 1 -- start start 2024-08-18T22:32:44.430 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:43.832+0000 7f07107a4640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0708100bb0 0x7f0708100fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:44.430 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:43.832+0000 7f07107a4640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0708101500 con 0x7f0708100bb0 2024-08-18T22:32:44.430 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:43.832+0000 7f070e540640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0708100bb0 0x7f0708100fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:44.430 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:43.832+0000 7f070e540640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0708100bb0 0x7f0708100fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:44950/0 (socket says 172.21.15.121:44950) 2024-08-18T22:32:44.430 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:43.832+0000 7f070e540640 1 -- 172.21.15.121:0/1042793828 learned_addr learned my addr 172.21.15.121:0/1042793828 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-18T22:32:44.431 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:43.833+0000 7f070e540640 1 -- 172.21.15.121:0/1042793828 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0708101640 con 0x7f0708100bb0 2024-08-18T22:32:44.431 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:43.833+0000 7f070e540640 1 --2- 172.21.15.121:0/1042793828 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0708100bb0 0x7f0708100fc0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f070400baf0 tx=0x7f070400b460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35585bd22287bab8 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:32:44.431 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:43.834+0000 7f070d53e640 1 -- 172.21.15.121:0/1042793828 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f07040327a0 con 0x7f0708100bb0 2024-08-18T22:32:44.431 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:43.834+0000 7f070d53e640 1 -- 172.21.15.121:0/1042793828 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7f0704032d60 con 0x7f0708100bb0 2024-08-18T22:32:44.431 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:43.834+0000 7f070d53e640 1 -- 172.21.15.121:0/1042793828 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0704031df0 con 0x7f0708100bb0 2024-08-18T22:32:44.431 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:43.834+0000 7f07107a4640 1 -- 172.21.15.121:0/1042793828 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0708100bb0 msgr2=0x7f0708100fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:44.431 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:43.834+0000 7f07107a4640 1 --2- 172.21.15.121:0/1042793828 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0708100bb0 0x7f0708100fc0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f070400baf0 tx=0x7f070400b460 comp rx=0 tx=0).stop 2024-08-18T22:32:44.431 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:43.834+0000 7f07107a4640 1 -- 172.21.15.121:0/1042793828 shutdown_connections 2024-08-18T22:32:44.431 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:43.834+0000 7f07107a4640 1 --2- 172.21.15.121:0/1042793828 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0708100bb0 0x7f0708100fc0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:44.431 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:43.834+0000 7f07107a4640 1 -- 172.21.15.121:0/1042793828 >> 172.21.15.121:0/1042793828 conn(0x7f07080fc3d0 msgr2=0x7f07080fe7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:32:44.431 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:43.834+0000 7f07107a4640 1 -- 172.21.15.121:0/1042793828 shutdown_connections 2024-08-18T22:32:44.431 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:43.834+0000 7f07107a4640 1 -- 172.21.15.121:0/1042793828 wait complete. 2024-08-18T22:32:44.431 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:43.835+0000 7f07107a4640 1 Processor -- start 2024-08-18T22:32:44.432 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:43.835+0000 7f07107a4640 1 -- start start 2024-08-18T22:32:44.432 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:43.835+0000 7f07107a4640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0708100bb0 0x7f070810e910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:44.432 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:43.835+0000 7f07107a4640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f070810ee50 con 0x7f0708100bb0 2024-08-18T22:32:44.432 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:43.835+0000 7f070e540640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0708100bb0 0x7f070810e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:44.432 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:43.835+0000 7f070e540640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0708100bb0 0x7f070810e910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:44966/0 (socket says 172.21.15.121:44966) 2024-08-18T22:32:44.432 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:43.835+0000 7f070e540640 1 -- 172.21.15.121:0/1884892400 learned_addr learned my addr 172.21.15.121:0/1884892400 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-18T22:32:44.432 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:43.835+0000 7f070e540640 1 -- 172.21.15.121:0/1884892400 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f070400b700 con 0x7f0708100bb0 2024-08-18T22:32:44.432 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:43.835+0000 7f070e540640 1 --2- 172.21.15.121:0/1884892400 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0708100bb0 0x7f070810e910 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f070402ce70 tx=0x7f070400b460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:32:44.432 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:43.836+0000 7f06feffd640 1 -- 172.21.15.121:0/1884892400 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0704032ab0 con 0x7f0708100bb0 2024-08-18T22:32:44.432 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:43.836+0000 7f06feffd640 1 -- 172.21.15.121:0/1884892400 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7f070403b880 con 0x7f0708100bb0 2024-08-18T22:32:44.432 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:43.836+0000 7f07107a4640 1 -- 172.21.15.121:0/1884892400 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f070810f050 con 0x7f0708100bb0 2024-08-18T22:32:44.432 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:43.836+0000 7f06feffd640 1 -- 172.21.15.121:0/1884892400 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f070403a730 con 0x7f0708100bb0 2024-08-18T22:32:44.433 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:43.836+0000 7f07107a4640 1 -- 172.21.15.121:0/1884892400 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f070810f460 con 0x7f0708100bb0 2024-08-18T22:32:44.433 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:43.836+0000 7f06feffd640 1 -- 172.21.15.121:0/1884892400 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7f070403ac30 con 0x7f0708100bb0 2024-08-18T22:32:44.433 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:43.836+0000 7f06feffd640 1 -- 172.21.15.121:0/1884892400 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f07040463f0 con 0x7f0708100bb0 2024-08-18T22:32:44.433 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:43.837+0000 7f07107a4640 1 -- 172.21.15.121:0/1884892400 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f070804b4c0 con 0x7f0708100bb0 2024-08-18T22:32:44.433 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:43.839+0000 7f06feffd640 1 -- 172.21.15.121:0/1884892400 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71553 (secure 0 0 0) 0x7f0704036020 con 0x7f0708100bb0 2024-08-18T22:32:44.433 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:43.895+0000 7f07107a4640 1 -- 172.21.15.121:0/1884892400 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) v1 -- 0x7f07081029b0 con 0x7f0708100bb0 2024-08-18T22:32:44.433 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:43.895+0000 7f06feffd640 1 -- 172.21.15.121:0/1884892400 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v2) v1 ==== 76+0+177 (secure 0 0 0) 0x7f070403bdb0 con 0x7f0708100bb0 2024-08-18T22:32:44.433 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:43.896+0000 7f07107a4640 1 -- 172.21.15.121:0/1884892400 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0708100bb0 msgr2=0x7f070810e910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:44.433 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:43.896+0000 7f07107a4640 1 --2- 172.21.15.121:0/1884892400 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0708100bb0 0x7f070810e910 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f070402ce70 tx=0x7f070400b460 comp rx=0 tx=0).stop 2024-08-18T22:32:44.433 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:43.896+0000 7f07107a4640 1 -- 172.21.15.121:0/1884892400 shutdown_connections 2024-08-18T22:32:44.433 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:43.896+0000 7f07107a4640 1 --2- 172.21.15.121:0/1884892400 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0708100bb0 0x7f070810e910 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:44.433 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:43.896+0000 7f07107a4640 1 -- 172.21.15.121:0/1884892400 >> 172.21.15.121:0/1884892400 conn(0x7f07080fc3d0 msgr2=0x7f0708105170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:32:44.433 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:43.896+0000 7f07107a4640 1 -- 172.21.15.121:0/1884892400 shutdown_connections 2024-08-18T22:32:44.433 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:43.896+0000 7f07107a4640 1 -- 172.21.15.121:0/1884892400 wait complete. 2024-08-18T22:32:44.434 INFO:teuthology.orchestra.run.smithi121.stdout:Restarting the monitor... 2024-08-18T22:32:44.449 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:32:44 smithi121 ceph-mon[16422]: from='client.? 172.21.15.121:0/1884892400' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:32:44.719 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:32:44 smithi121 systemd[1]: Stopping Ceph mon.smithi121 for b003123a-5db1-11ef-bccf-c7b262605968... 2024-08-18T22:32:45.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:32:44 smithi121 ceph-b003123a-5db1-11ef-bccf-c7b262605968-mon-smithi121[16418]: 2024-08-18T22:32:44.717+0000 7f8c57650640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi121 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-08-18T22:32:45.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:32:44 smithi121 ceph-b003123a-5db1-11ef-bccf-c7b262605968-mon-smithi121[16418]: 2024-08-18T22:32:44.717+0000 7f8c57650640 -1 mon.smithi121@0(leader) e1 *** Got Signal Terminated *** 2024-08-18T22:32:45.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:32:44 smithi121 podman[16666]: 2024-08-18 22:32:44.850728842 +0000 UTC m=+0.237273317 container died 962e472902a72ccc5ed761eb4256aa44cdda7fe840698d06ad81f1a8f94b5600 (image=quay.ceph.io/ceph-ci/ceph:quincy, name=ceph-b003123a-5db1-11ef-bccf-c7b262605968-mon-smithi121, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, io.buildah.version=1.36.0, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, RELEASE=quincy-df62bdc, ceph=True, org.label-schema.build-date=20240731) 2024-08-18T22:32:45.583 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:32:45 smithi121 podman[16666]: 2024-08-18 22:32:45.183850202 +0000 UTC m=+0.570394679 container cleanup 962e472902a72ccc5ed761eb4256aa44cdda7fe840698d06ad81f1a8f94b5600 (image=quay.ceph.io/ceph-ci/ceph:quincy, name=ceph-b003123a-5db1-11ef-bccf-c7b262605968-mon-smithi121, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=quincy-df62bdc, GIT_CLEAN=True, io.buildah.version=1.36.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD) 2024-08-18T22:32:45.584 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:32:45 smithi121 bash[16666]: ceph-b003123a-5db1-11ef-bccf-c7b262605968-mon-smithi121 2024-08-18T22:32:45.584 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:32:45 smithi121 podman[16680]: 2024-08-18 22:32:45.351425152 +0000 UTC m=+0.497739096 container remove 962e472902a72ccc5ed761eb4256aa44cdda7fe840698d06ad81f1a8f94b5600 (image=quay.ceph.io/ceph-ci/ceph:quincy, name=ceph-b003123a-5db1-11ef-bccf-c7b262605968-mon-smithi121, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, RELEASE=quincy-df62bdc, io.buildah.version=1.36.0, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-08-18T22:32:45.965 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:32:45 smithi121 systemd[1]: ceph-b003123a-5db1-11ef-bccf-c7b262605968@mon.smithi121.service: Deactivated successfully. 2024-08-18T22:32:45.965 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:32:45 smithi121 systemd[1]: Stopped Ceph mon.smithi121 for b003123a-5db1-11ef-bccf-c7b262605968. 2024-08-18T22:32:45.965 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:32:45 smithi121 systemd[1]: Starting Ceph mon.smithi121 for b003123a-5db1-11ef-bccf-c7b262605968... 2024-08-18T22:32:45.965 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:32:45 smithi121 podman[16768]: 2024-08-18 22:32:45.725446962 +0000 UTC m=+0.016814227 image pull 774894bef55f35ea913e9d162881c8ec1edc99a6073e592937af43fb95913b24 quay.ceph.io/ceph-ci/ceph:quincy 2024-08-18T22:32:45.966 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:32:45 smithi121 podman[16768]: 2024-08-18 22:32:45.85245667 +0000 UTC m=+0.143823970 container create 4a7bead235acbc79f51e325fd860dc47cc2c9674a3c2e24147caa0317fba5595 (image=quay.ceph.io/ceph-ci/ceph:quincy, name=ceph-b003123a-5db1-11ef-bccf-c7b262605968-mon-smithi121, io.buildah.version=1.36.0, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=quincy-df62bdc, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-08-18T22:32:46.117 INFO:teuthology.orchestra.run.smithi121.stdout:Setting public_network to 172.21.0.0/20 in mon config section 2024-08-18T22:32:46.334 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:32:46 smithi121 podman[16768]: 2024-08-18 22:32:46.054698694 +0000 UTC m=+0.346065948 container init 4a7bead235acbc79f51e325fd860dc47cc2c9674a3c2e24147caa0317fba5595 (image=quay.ceph.io/ceph-ci/ceph:quincy, name=ceph-b003123a-5db1-11ef-bccf-c7b262605968-mon-smithi121, io.buildah.version=1.36.0, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=quincy-df62bdc, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2) 2024-08-18T22:32:46.334 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:32:46 smithi121 podman[16768]: 2024-08-18 22:32:46.057808115 +0000 UTC m=+0.349175373 container start 4a7bead235acbc79f51e325fd860dc47cc2c9674a3c2e24147caa0317fba5595 (image=quay.ceph.io/ceph-ci/ceph:quincy, name=ceph-b003123a-5db1-11ef-bccf-c7b262605968-mon-smithi121, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=quincy-df62bdc, org.label-schema.build-date=20240731, io.buildah.version=1.36.0) 2024-08-18T22:32:46.334 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:32:46 smithi121 ceph-mon[16788]: set uid:gid to 167:167 (ceph:ceph) 2024-08-18T22:32:46.334 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:32:46 smithi121 ceph-mon[16788]: ceph version 17.2.7-1406-gdf62bdcc (df62bdccd9a13bf566b27a250eddfdd89be3072d) quincy (stable), process ceph-mon, pid 2 2024-08-18T22:32:46.335 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:32:46 smithi121 ceph-mon[16788]: pidfile_write: ignore empty --pid-file 2024-08-18T22:32:46.335 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:32:46 smithi121 ceph-mon[16788]: load: jerasure load: lrc 2024-08-18T22:32:46.335 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:32:46 smithi121 ceph-mon[16788]: rocksdb: RocksDB version: 6.15.5 2024-08-18T22:32:46.335 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:32:46 smithi121 ceph-mon[16788]: rocksdb: Git sha rocksdb_build_git_sha:@0@ 2024-08-18T22:32:46.335 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:32:46 smithi121 ceph-mon[16788]: rocksdb: Compile date Aug 18 2024 2024-08-18T22:32:46.335 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:32:46 smithi121 ceph-mon[16788]: rocksdb: DB SUMMARY 2024-08-18T22:32:46.335 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:32:46 smithi121 ceph-mon[16788]: rocksdb: DB Session ID: BKFM8V9EKMW8KM2FC59U 2024-08-18T22:32:46.335 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:32:46 smithi121 ceph-mon[16788]: rocksdb: CURRENT file: CURRENT 2024-08-18T22:32:46.335 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:32:46 smithi121 ceph-mon[16788]: rocksdb: IDENTITY file: IDENTITY 2024-08-18T22:32:46.335 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:32:46 smithi121 ceph-mon[16788]: rocksdb: MANIFEST file: MANIFEST-000009 size: 131 Bytes 2024-08-18T22:32:46.335 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:32:46 smithi121 ceph-mon[16788]: rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi121/store.db dir, Total Num: 1, files: 000008.sst 2024-08-18T22:32:46.335 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:32:46 smithi121 ceph-mon[16788]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi121/store.db: 000010.log size: 98150 ; 2024-08-18T22:32:46.335 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:32:46 smithi121 ceph-mon[16788]: rocksdb: Options.error_if_exists: 0 2024-08-18T22:32:46.336 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:32:46 smithi121 ceph-mon[16788]: rocksdb: Options.create_if_missing: 0 2024-08-18T22:32:46.336 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:32:46 smithi121 ceph-mon[16788]: rocksdb: Options.paranoid_checks: 1 2024-08-18T22:32:46.336 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:32:46 smithi121 ceph-mon[16788]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-08-18T22:32:46.336 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:32:46 smithi121 ceph-mon[16788]: rocksdb: Options.env: 0x5573ffe4d480 2024-08-18T22:32:46.336 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:32:46 smithi121 ceph-mon[16788]: rocksdb: Options.fs: Posix File System 2024-08-18T22:32:46.336 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:32:46 smithi121 ceph-mon[16788]: rocksdb: Options.info_log: 0x557401e3d180 2024-08-18T22:32:46.336 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:32:46 smithi121 ceph-mon[16788]: rocksdb: Options.max_file_opening_threads: 16 2024-08-18T22:32:46.336 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:32:46 smithi121 ceph-mon[16788]: rocksdb: Options.statistics: (nil) 2024-08-18T22:32:46.336 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:32:46 smithi121 ceph-mon[16788]: rocksdb: Options.use_fsync: 0 2024-08-18T22:32:46.336 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:32:46 smithi121 ceph-mon[16788]: rocksdb: Options.max_log_file_size: 0 2024-08-18T22:32:46.336 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:32:46 smithi121 ceph-mon[16788]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-08-18T22:32:46.336 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:32:46 smithi121 ceph-mon[16788]: rocksdb: Options.log_file_time_to_roll: 0 2024-08-18T22:32:46.336 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:32:46 smithi121 ceph-mon[16788]: rocksdb: Options.keep_log_file_num: 1000 2024-08-18T22:32:46.337 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:32:46 smithi121 ceph-mon[16788]: rocksdb: Options.recycle_log_file_num: 0 2024-08-18T22:32:46.337 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:32:46 smithi121 ceph-mon[16788]: rocksdb: Options.allow_fallocate: 1 2024-08-18T22:32:46.337 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:32:46 smithi121 ceph-mon[16788]: rocksdb: Options.allow_mmap_reads: 0 2024-08-18T22:32:46.337 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:32:46 smithi121 ceph-mon[16788]: rocksdb: Options.allow_mmap_writes: 0 2024-08-18T22:32:46.337 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:32:46 smithi121 ceph-mon[16788]: rocksdb: Options.use_direct_reads: 0 2024-08-18T22:32:46.337 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:32:46 smithi121 ceph-mon[16788]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-08-18T22:32:46.337 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:32:46 smithi121 ceph-mon[16788]: rocksdb: Options.create_missing_column_families: 0 2024-08-18T22:32:46.337 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:32:46 smithi121 ceph-mon[16788]: rocksdb: Options.db_log_dir: 2024-08-18T22:32:46.337 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:32:46 smithi121 ceph-mon[16788]: rocksdb: Options.wal_dir: /var/lib/ceph/mon/ceph-smithi121/store.db 2024-08-18T22:32:46.337 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:32:46 smithi121 ceph-mon[16788]: rocksdb: Options.table_cache_numshardbits: 6 2024-08-18T22:32:46.337 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:32:46 smithi121 ceph-mon[16788]: rocksdb: Options.WAL_ttl_seconds: 0 2024-08-18T22:32:46.337 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:32:46 smithi121 ceph-mon[16788]: rocksdb: Options.WAL_size_limit_MB: 0 2024-08-18T22:32:46.337 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:32:46 smithi121 ceph-mon[16788]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-08-18T22:32:46.337 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:32:46 smithi121 ceph-mon[16788]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-08-18T22:32:46.338 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:32:46 smithi121 ceph-mon[16788]: rocksdb: Options.is_fd_close_on_exec: 1 2024-08-18T22:32:46.338 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:32:46 smithi121 ceph-mon[16788]: rocksdb: Options.advise_random_on_open: 1 2024-08-18T22:32:46.338 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:32:46 smithi121 ceph-mon[16788]: rocksdb: Options.db_write_buffer_size: 0 2024-08-18T22:32:46.338 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:32:46 smithi121 ceph-mon[16788]: rocksdb: Options.write_buffer_manager: 0x557401efa7b0 2024-08-18T22:32:46.338 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:32:46 smithi121 ceph-mon[16788]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-08-18T22:32:46.338 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:32:46 smithi121 ceph-mon[16788]: rocksdb: Options.new_table_reader_for_compaction_inputs: 0 2024-08-18T22:32:46.338 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:32:46 smithi121 ceph-mon[16788]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-08-18T22:32:46.338 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:32:46 smithi121 ceph-mon[16788]: rocksdb: Options.use_adaptive_mutex: 0 2024-08-18T22:32:46.338 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:32:46 smithi121 ceph-mon[16788]: rocksdb: Options.rate_limiter: (nil) 2024-08-18T22:32:46.338 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:32:46 smithi121 ceph-mon[16788]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-08-18T22:32:46.338 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:32:46 smithi121 ceph-mon[16788]: rocksdb: Options.wal_recovery_mode: 2 2024-08-18T22:32:46.338 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:32:46 smithi121 ceph-mon[16788]: rocksdb: Options.enable_thread_tracking: 0 2024-08-18T22:32:46.338 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:32:46 smithi121 ceph-mon[16788]: rocksdb: Options.enable_pipelined_write: 0 2024-08-18T22:32:46.339 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:32:46 smithi121 ceph-mon[16788]: rocksdb: Options.unordered_write: 0 2024-08-18T22:32:46.339 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:32:46 smithi121 ceph-mon[16788]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-08-18T22:32:46.339 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:32:46 smithi121 ceph-mon[16788]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-08-18T22:32:46.339 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:32:46 smithi121 ceph-mon[16788]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-08-18T22:32:46.339 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:32:46 smithi121 ceph-mon[16788]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-08-18T22:32:46.339 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:32:46 smithi121 ceph-mon[16788]: rocksdb: Options.row_cache: None 2024-08-18T22:32:46.339 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:32:46 smithi121 ceph-mon[16788]: rocksdb: Options.wal_filter: None 2024-08-18T22:32:46.339 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:32:46 smithi121 ceph-mon[16788]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-08-18T22:32:46.339 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:32:46 smithi121 ceph-mon[16788]: rocksdb: Options.allow_ingest_behind: 0 2024-08-18T22:32:46.341 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:32:46 smithi121 ceph-mon[16788]: rocksdb: Options.preserve_deletes: 0 2024-08-18T22:32:46.341 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:32:46 smithi121 ceph-mon[16788]: rocksdb: Options.two_write_queues: 0 2024-08-18T22:32:46.341 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:32:46 smithi121 ceph-mon[16788]: rocksdb: Options.manual_wal_flush: 0 2024-08-18T22:32:46.341 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:32:46 smithi121 ceph-mon[16788]: rocksdb: Options.atomic_flush: 0 2024-08-18T22:32:46.341 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:32:46 smithi121 ceph-mon[16788]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-08-18T22:32:46.341 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:32:46 smithi121 ceph-mon[16788]: rocksdb: Options.persist_stats_to_disk: 0 2024-08-18T22:32:46.341 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:32:46 smithi121 ceph-mon[16788]: rocksdb: Options.write_dbid_to_manifest: 0 2024-08-18T22:32:46.341 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:32:46 smithi121 ceph-mon[16788]: rocksdb: Options.log_readahead_size: 0 2024-08-18T22:32:46.341 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:32:46 smithi121 ceph-mon[16788]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-08-18T22:32:46.341 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:32:46 smithi121 ceph-mon[16788]: rocksdb: Options.best_efforts_recovery: 0 2024-08-18T22:32:46.341 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:32:46 smithi121 ceph-mon[16788]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-08-18T22:32:46.341 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:32:46 smithi121 ceph-mon[16788]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-08-18T22:32:46.342 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:32:46 smithi121 ceph-mon[16788]: rocksdb: Options.allow_data_in_errors: 0 2024-08-18T22:32:46.342 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:32:46 smithi121 ceph-mon[16788]: rocksdb: Options.db_host_id: __hostname__ 2024-08-18T22:32:46.342 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:32:46 smithi121 ceph-mon[16788]: rocksdb: Options.max_background_jobs: 2 2024-08-18T22:32:46.342 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:32:46 smithi121 ceph-mon[16788]: rocksdb: Options.max_background_compactions: -1 2024-08-18T22:32:46.342 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:32:46 smithi121 ceph-mon[16788]: rocksdb: Options.max_subcompactions: 1 2024-08-18T22:32:46.342 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:32:46 smithi121 ceph-mon[16788]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-08-18T22:32:46.342 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:32:46 smithi121 ceph-mon[16788]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-08-18T22:32:46.342 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:32:46 smithi121 ceph-mon[16788]: rocksdb: Options.delayed_write_rate : 16777216 2024-08-18T22:32:46.342 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:32:46 smithi121 ceph-mon[16788]: rocksdb: Options.max_total_wal_size: 0 2024-08-18T22:32:46.342 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:32:46 smithi121 ceph-mon[16788]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-08-18T22:32:46.342 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:32:46 smithi121 ceph-mon[16788]: rocksdb: Options.stats_dump_period_sec: 600 2024-08-18T22:32:46.342 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:32:46 smithi121 ceph-mon[16788]: rocksdb: Options.stats_persist_period_sec: 600 2024-08-18T22:32:46.342 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:32:46 smithi121 ceph-mon[16788]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-08-18T22:32:46.343 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:32:46 smithi121 ceph-mon[16788]: rocksdb: Options.max_open_files: -1 2024-08-18T22:32:46.343 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:32:46 smithi121 ceph-mon[16788]: rocksdb: Options.bytes_per_sync: 0 2024-08-18T22:32:46.343 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:32:46 smithi121 ceph-mon[16788]: rocksdb: Options.wal_bytes_per_sync: 0 2024-08-18T22:32:46.343 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:32:46 smithi121 ceph-mon[16788]: rocksdb: Options.strict_bytes_per_sync: 0 2024-08-18T22:32:46.343 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:32:46 smithi121 ceph-mon[16788]: rocksdb: Options.compaction_readahead_size: 0 2024-08-18T22:32:46.343 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:32:46 smithi121 ceph-mon[16788]: rocksdb: Options.max_background_flushes: -1 2024-08-18T22:32:46.343 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:32:46 smithi121 ceph-mon[16788]: rocksdb: Compression algorithms supported: 2024-08-18T22:32:46.343 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:32:46 smithi121 ceph-mon[16788]: rocksdb: kZSTD supported: 0 2024-08-18T22:32:46.343 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:32:46 smithi121 ceph-mon[16788]: rocksdb: kXpressCompression supported: 0 2024-08-18T22:32:46.343 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:32:46 smithi121 ceph-mon[16788]: rocksdb: kBZip2Compression supported: 0 2024-08-18T22:32:46.343 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:32:46 smithi121 ceph-mon[16788]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-08-18T22:32:46.343 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:32:46 smithi121 ceph-mon[16788]: rocksdb: kLZ4Compression supported: 1 2024-08-18T22:32:46.343 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:32:46 smithi121 ceph-mon[16788]: rocksdb: kZlibCompression supported: 1 2024-08-18T22:32:46.344 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:32:46 smithi121 ceph-mon[16788]: rocksdb: kLZ4HCCompression supported: 1 2024-08-18T22:32:46.344 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:32:46 smithi121 ceph-mon[16788]: rocksdb: kSnappyCompression supported: 1 2024-08-18T22:32:46.344 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:32:46 smithi121 ceph-mon[16788]: rocksdb: Fast CRC32 supported: Supported on x86 2024-08-18T22:32:46.344 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:32:46 smithi121 ceph-mon[16788]: rocksdb: [db/version_set.cc:4724] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi121/store.db/MANIFEST-000009 2024-08-18T22:32:46.344 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:32:46 smithi121 ceph-mon[16788]: rocksdb: [db/column_family.cc:595] --------------- Options for column family [default]: 2024-08-18T22:32:46.344 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:32:46 smithi121 ceph-mon[16788]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-08-18T22:32:46.344 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:32:46 smithi121 ceph-mon[16788]: rocksdb: Options.merge_operator: 2024-08-18T22:32:46.344 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:32:46 smithi121 ceph-mon[16788]: rocksdb: Options.compaction_filter: None 2024-08-18T22:32:46.344 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:32:46 smithi121 ceph-mon[16788]: rocksdb: Options.compaction_filter_factory: None 2024-08-18T22:32:46.344 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:32:46 smithi121 ceph-mon[16788]: rocksdb: Options.sst_partitioner_factory: None 2024-08-18T22:32:46.344 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:32:46 smithi121 ceph-mon[16788]: rocksdb: Options.memtable_factory: SkipListFactory 2024-08-18T22:32:46.344 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:32:46 smithi121 ceph-mon[16788]: rocksdb: Options.table_factory: BlockBasedTable 2024-08-18T22:32:46.344 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:32:46 smithi121 ceph-mon[16788]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x557401de3a78) 2024-08-18T22:32:46.344 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout: cache_index_and_filter_blocks: 1 2024-08-18T22:32:46.345 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-08-18T22:32:46.345 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-08-18T22:32:46.345 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout: pin_top_level_index_and_filter: 1 2024-08-18T22:32:46.345 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout: index_type: 0 2024-08-18T22:32:46.345 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout: data_block_index_type: 0 2024-08-18T22:32:46.345 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout: index_shortening: 1 2024-08-18T22:32:46.345 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout: data_block_hash_table_util_ratio: 0.750000 2024-08-18T22:32:46.345 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout: hash_index_allow_collision: 1 2024-08-18T22:32:46.345 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout: checksum: 1 2024-08-18T22:32:46.345 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout: no_block_cache: 0 2024-08-18T22:32:46.345 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout: block_cache: 0x557401e191f0 2024-08-18T22:32:46.345 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout: block_cache_name: BinnedLRUCache 2024-08-18T22:32:46.345 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout: block_cache_options: 2024-08-18T22:32:46.346 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout: capacity : 536870912 2024-08-18T22:32:46.346 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout: num_shard_bits : 4 2024-08-18T22:32:46.346 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout: strict_capacity_limit : 0 2024-08-18T22:32:46.346 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout: high_pri_pool_ratio: 0.000 2024-08-18T22:32:46.346 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout: block_cache_compressed: (nil) 2024-08-18T22:32:46.346 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout: persistent_cache: (nil) 2024-08-18T22:32:46.346 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout: block_size: 4096 2024-08-18T22:32:46.346 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout: block_size_deviation: 10 2024-08-18T22:32:46.346 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout: block_restart_interval: 16 2024-08-18T22:32:46.346 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout: index_block_restart_interval: 1 2024-08-18T22:32:46.346 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout: metadata_block_size: 4096 2024-08-18T22:32:46.346 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout: partition_filters: 0 2024-08-18T22:32:46.346 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout: use_delta_encoding: 1 2024-08-18T22:32:46.346 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout: filter_policy: rocksdb.BuiltinBloomFilter 2024-08-18T22:32:46.347 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout: whole_key_filtering: 1 2024-08-18T22:32:46.347 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout: verify_compression: 0 2024-08-18T22:32:46.347 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout: read_amp_bytes_per_bit: 0 2024-08-18T22:32:46.347 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout: format_version: 4 2024-08-18T22:32:46.347 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout: enable_index_compression: 1 2024-08-18T22:32:46.347 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout: block_align: 0 2024-08-18T22:32:46.347 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:32:46 smithi121 ceph-mon[16788]: rocksdb: Options.write_buffer_size: 33554432 2024-08-18T22:32:46.347 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:32:46 smithi121 ceph-mon[16788]: rocksdb: Options.max_write_buffer_number: 2 2024-08-18T22:32:46.347 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:32:46 smithi121 ceph-mon[16788]: rocksdb: Options.compression: NoCompression 2024-08-18T22:32:46.347 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:32:46 smithi121 ceph-mon[16788]: rocksdb: Options.bottommost_compression: Disabled 2024-08-18T22:32:46.347 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:32:46 smithi121 ceph-mon[16788]: rocksdb: Options.prefix_extractor: nullptr 2024-08-18T22:32:46.347 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:32:46 smithi121 ceph-mon[16788]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-08-18T22:32:46.347 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:32:46 smithi121 ceph-mon[16788]: rocksdb: Options.num_levels: 7 2024-08-18T22:32:46.348 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:32:46 smithi121 ceph-mon[16788]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-08-18T22:32:46.348 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:32:46 smithi121 ceph-mon[16788]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-08-18T22:32:46.348 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:32:46 smithi121 ceph-mon[16788]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-08-18T22:32:46.348 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:32:46 smithi121 ceph-mon[16788]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-08-18T22:32:46.348 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:32:46 smithi121 ceph-mon[16788]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-08-18T22:32:46.348 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:32:46 smithi121 ceph-mon[16788]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-08-18T22:32:46.348 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:32:46 smithi121 ceph-mon[16788]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-08-18T22:32:46.348 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:32:46 smithi121 ceph-mon[16788]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-08-18T22:32:46.348 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:32:46 smithi121 ceph-mon[16788]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-08-18T22:32:46.348 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:32:46 smithi121 ceph-mon[16788]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-08-18T22:32:46.348 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:32:46 smithi121 ceph-mon[16788]: rocksdb: Options.compression_opts.window_bits: -14 2024-08-18T22:32:46.348 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:32:46 smithi121 ceph-mon[16788]: rocksdb: Options.compression_opts.level: 32767 2024-08-18T22:32:46.348 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:32:46 smithi121 ceph-mon[16788]: rocksdb: Options.compression_opts.strategy: 0 2024-08-18T22:32:46.349 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:32:46 smithi121 ceph-mon[16788]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-08-18T22:32:46.349 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:32:46 smithi121 ceph-mon[16788]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-08-18T22:32:46.349 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:32:46 smithi121 ceph-mon[16788]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-08-18T22:32:46.349 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:32:46 smithi121 ceph-mon[16788]: rocksdb: Options.compression_opts.enabled: false 2024-08-18T22:32:46.349 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:32:46 smithi121 ceph-mon[16788]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-08-18T22:32:46.349 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:32:46 smithi121 ceph-mon[16788]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-08-18T22:32:46.349 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:32:46 smithi121 ceph-mon[16788]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-08-18T22:32:46.349 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:32:46 smithi121 ceph-mon[16788]: rocksdb: Options.target_file_size_base: 67108864 2024-08-18T22:32:46.349 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:32:46 smithi121 ceph-mon[16788]: rocksdb: Options.target_file_size_multiplier: 1 2024-08-18T22:32:46.349 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:32:46 smithi121 ceph-mon[16788]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-08-18T22:32:46.349 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:32:46 smithi121 ceph-mon[16788]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-08-18T22:32:46.349 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:32:46 smithi121 ceph-mon[16788]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-08-18T22:32:46.349 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:32:46 smithi121 ceph-mon[16788]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-08-18T22:32:46.350 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:32:46 smithi121 ceph-mon[16788]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-08-18T22:32:46.350 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:32:46 smithi121 ceph-mon[16788]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-08-18T22:32:46.350 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:32:46 smithi121 ceph-mon[16788]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-08-18T22:32:46.350 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:32:46 smithi121 ceph-mon[16788]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-08-18T22:32:46.350 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:32:46 smithi121 ceph-mon[16788]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-08-18T22:32:46.350 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:32:46 smithi121 ceph-mon[16788]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-08-18T22:32:46.350 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:32:46 smithi121 ceph-mon[16788]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-08-18T22:32:46.350 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:32:46 smithi121 ceph-mon[16788]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-08-18T22:32:46.350 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:32:46 smithi121 ceph-mon[16788]: rocksdb: Options.arena_block_size: 4194304 2024-08-18T22:32:46.350 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:32:46 smithi121 ceph-mon[16788]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-08-18T22:32:46.350 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:32:46 smithi121 ceph-mon[16788]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-08-18T22:32:46.350 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:32:46 smithi121 ceph-mon[16788]: rocksdb: Options.rate_limit_delay_max_milliseconds: 100 2024-08-18T22:32:46.350 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:32:46 smithi121 ceph-mon[16788]: rocksdb: Options.disable_auto_compactions: 0 2024-08-18T22:32:46.350 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:32:46 smithi121 ceph-mon[16788]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-08-18T22:32:46.351 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:32:46 smithi121 ceph-mon[16788]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-08-18T22:32:46.351 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:32:46 smithi121 ceph-mon[16788]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-08-18T22:32:46.351 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:32:46 smithi121 ceph-mon[16788]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-08-18T22:32:46.351 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:32:46 smithi121 ceph-mon[16788]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-08-18T22:32:46.351 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:32:46 smithi121 ceph-mon[16788]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-08-18T22:32:46.351 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:32:46 smithi121 ceph-mon[16788]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-08-18T22:32:46.351 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:32:46 smithi121 ceph-mon[16788]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-08-18T22:32:46.351 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:32:46 smithi121 ceph-mon[16788]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-08-18T22:32:46.351 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:32:46 smithi121 ceph-mon[16788]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-08-18T22:32:46.351 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:32:46 smithi121 ceph-mon[16788]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-08-18T22:32:46.351 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:32:46 smithi121 ceph-mon[16788]: rocksdb: Options.inplace_update_support: 0 2024-08-18T22:32:46.351 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:32:46 smithi121 ceph-mon[16788]: rocksdb: Options.inplace_update_num_locks: 10000 2024-08-18T22:32:46.351 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:32:46 smithi121 ceph-mon[16788]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-08-18T22:32:46.352 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:32:46 smithi121 ceph-mon[16788]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-08-18T22:32:46.352 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:32:46 smithi121 ceph-mon[16788]: rocksdb: Options.memtable_huge_page_size: 0 2024-08-18T22:32:46.352 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:32:46 smithi121 ceph-mon[16788]: rocksdb: Options.bloom_locality: 0 2024-08-18T22:32:46.352 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:32:46 smithi121 ceph-mon[16788]: rocksdb: Options.max_successive_merges: 0 2024-08-18T22:32:46.352 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:32:46 smithi121 ceph-mon[16788]: rocksdb: Options.optimize_filters_for_hits: 0 2024-08-18T22:32:46.352 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:32:46 smithi121 ceph-mon[16788]: rocksdb: Options.paranoid_file_checks: 0 2024-08-18T22:32:46.352 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:32:46 smithi121 ceph-mon[16788]: rocksdb: Options.force_consistency_checks: 1 2024-08-18T22:32:46.352 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:32:46 smithi121 ceph-mon[16788]: rocksdb: Options.report_bg_io_stats: 0 2024-08-18T22:32:46.352 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:32:46 smithi121 ceph-mon[16788]: rocksdb: Options.ttl: 2592000 2024-08-18T22:32:46.352 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:32:46 smithi121 ceph-mon[16788]: rocksdb: Options.periodic_compaction_seconds: 0 2024-08-18T22:32:46.352 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:32:46 smithi121 ceph-mon[16788]: rocksdb: Options.enable_blob_files: false 2024-08-18T22:32:46.352 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:32:46 smithi121 ceph-mon[16788]: rocksdb: Options.min_blob_size: 0 2024-08-18T22:32:46.352 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:32:46 smithi121 ceph-mon[16788]: rocksdb: Options.blob_file_size: 268435456 2024-08-18T22:32:46.352 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:32:46 smithi121 ceph-mon[16788]: rocksdb: Options.blob_compression_type: NoCompression 2024-08-18T22:32:46.353 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:32:46 smithi121 ceph-mon[16788]: rocksdb: Options.enable_blob_garbage_collection: false 2024-08-18T22:32:46.353 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:32:46 smithi121 ceph-mon[16788]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-08-18T22:32:46.353 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:32:46 smithi121 ceph-mon[16788]: rocksdb: [db/version_set.cc:4764] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi121/store.db/MANIFEST-000009 succeeded,manifest_file_number is 9, next_file_number is 11, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-08-18T22:32:46.353 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:32:46 smithi121 ceph-mon[16788]: rocksdb: [db/version_set.cc:4779] Column family [default] (ID 0), log number is 5 2024-08-18T22:32:46.353 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:32:46 smithi121 ceph-mon[16788]: rocksdb: [db/version_set.cc:4082] Creating manifest 13 2024-08-18T22:32:46.353 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:32:46 smithi121 ceph-mon[16788]: rocksdb: EVENT_LOG_v1 {"time_micros": 1724020366080964, "job": 1, "event": "recovery_started", "wal_files": [10]} 2024-08-18T22:32:46.353 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:32:46 smithi121 ceph-mon[16788]: rocksdb: [db/db_impl/db_impl_open.cc:845] Recovering log #10 mode 2 2024-08-18T22:32:46.353 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:32:46 smithi121 ceph-mon[16788]: rocksdb: [table/block_based/filter_policy.cc:991] Using legacy Bloom filter with high (20) bits/key. Dramatic filter space and/or accuracy improvement is available with format_version>=5. 2024-08-18T22:32:46.353 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:32:46 smithi121 ceph-mon[16788]: rocksdb: EVENT_LOG_v1 {"time_micros": 1724020366081808, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 14, "file_size": 93382, "file_checksum": "", "file_checksum_func_name": "Unknown", "table_properties": {"data_size": 91462, "index_size": 254, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 709, "raw_key_size": 13564, "raw_average_key_size": 49, "raw_value_size": 84044, "raw_average_value_size": 307, "num_data_blocks": 11, "num_entries": 273, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "rocksdb.BuiltinBloomFilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; ", "creation_time": 1724020366, "oldest_key_time": 0, "file_creation_time": 0, "db_id": "f0f26910-b19d-4768-825a-e441b4a17c7e", "db_session_id": "BKFM8V9EKMW8KM2FC59U"}} 2024-08-18T22:32:46.353 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:32:46 smithi121 ceph-mon[16788]: rocksdb: [db/version_set.cc:4082] Creating manifest 15 2024-08-18T22:32:46.353 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:32:46 smithi121 ceph-mon[16788]: rocksdb: EVENT_LOG_v1 {"time_micros": 1724020366082132, "job": 1, "event": "recovery_finished"} 2024-08-18T22:32:46.353 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:32:46 smithi121 ceph-mon[16788]: rocksdb: [file/delete_scheduler.cc:69] Deleted file /var/lib/ceph/mon/ceph-smithi121/store.db/000010.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-08-18T22:32:46.353 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:32:46 smithi121 ceph-mon[16788]: rocksdb: [db/db_impl/db_impl_open.cc:1700] SstFileManager instance 0x557401e4c700 2024-08-18T22:32:46.353 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:32:46 smithi121 ceph-mon[16788]: rocksdb: DB pointer 0x557401e1c000 2024-08-18T22:32:46.354 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:32:46 smithi121 ceph-mon[16788]: rocksdb: [db/db_impl/db_impl.cc:901] ------- DUMPING STATS ------- 2024-08-18T22:32:46.354 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:32:46 smithi121 ceph-mon[16788]: rocksdb: [db/db_impl/db_impl.cc:903] 2024-08-18T22:32:46.354 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout: ** DB Stats ** 2024-08-18T22:32:46.354 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-08-18T22:32:46.354 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-08-18T22:32:46.354 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-08-18T22:32:46.354 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-08-18T22:32:46.354 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-08-18T22:32:46.354 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 MB, 0.00 MB/s 2024-08-18T22:32:46.354 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-08-18T22:32:46.354 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout: 2024-08-18T22:32:46.354 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout: ** Compaction Stats [default] ** 2024-08-18T22:32:46.354 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-08-18T22:32:46.355 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-08-18T22:32:46.355 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout: L0 2/0 93.02 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 153.0 0.00 0.00 1 0.001 0 0 2024-08-18T22:32:46.355 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout: Sum 2/0 93.02 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 153.0 0.00 0.00 1 0.001 0 0 2024-08-18T22:32:46.355 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 153.0 0.00 0.00 1 0.001 0 0 2024-08-18T22:32:46.355 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout: 2024-08-18T22:32:46.355 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout: ** Compaction Stats [default] ** 2024-08-18T22:32:46.355 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-08-18T22:32:46.355 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-08-18T22:32:46.355 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 153.0 0.00 0.00 1 0.001 0 0 2024-08-18T22:32:46.355 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-08-18T22:32:46.355 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-08-18T22:32:46.355 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-08-18T22:32:46.355 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-08-18T22:32:46.355 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-08-18T22:32:46.355 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout: AddFile(Keys): cumulative 0, interval 0 2024-08-18T22:32:46.356 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout: Cumulative compaction: 0.00 GB write, 28.90 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-08-18T22:32:46.356 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout: Interval compaction: 0.00 GB write, 28.90 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-08-18T22:32:46.356 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-08-18T22:32:46.356 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout: 2024-08-18T22:32:46.356 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout: ** File Read Latency Histogram By Level [default] ** 2024-08-18T22:32:46.356 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout: 2024-08-18T22:32:46.356 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout: ** Compaction Stats [default] ** 2024-08-18T22:32:46.356 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-08-18T22:32:46.356 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-08-18T22:32:46.356 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout: L0 2/0 93.02 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 153.0 0.00 0.00 1 0.001 0 0 2024-08-18T22:32:46.356 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout: Sum 2/0 93.02 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 153.0 0.00 0.00 1 0.001 0 0 2024-08-18T22:32:46.356 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2024-08-18T22:32:46.356 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout: 2024-08-18T22:32:46.357 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout: ** Compaction Stats [default] ** 2024-08-18T22:32:46.357 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-08-18T22:32:46.357 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-08-18T22:32:46.357 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 153.0 0.00 0.00 1 0.001 0 0 2024-08-18T22:32:46.357 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-08-18T22:32:46.357 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-08-18T22:32:46.357 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-08-18T22:32:46.357 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-08-18T22:32:46.357 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-08-18T22:32:46.357 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout: AddFile(Keys): cumulative 0, interval 0 2024-08-18T22:32:46.357 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout: Cumulative compaction: 0.00 GB write, 28.60 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-08-18T22:32:46.357 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout: Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-08-18T22:32:46.357 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-08-18T22:32:46.358 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout: 2024-08-18T22:32:46.358 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout: ** File Read Latency Histogram By Level [default] ** 2024-08-18T22:32:46.358 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:32:46 smithi121 ceph-mon[16788]: starting mon.smithi121 rank 0 at public addrs [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] at bind addrs [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi121 fsid b003123a-5db1-11ef-bccf-c7b262605968 2024-08-18T22:32:46.358 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:32:46 smithi121 ceph-mon[16788]: mon.smithi121@-1(???) e1 preinit fsid b003123a-5db1-11ef-bccf-c7b262605968 2024-08-18T22:32:46.358 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:32:46 smithi121 ceph-mon[16788]: mon.smithi121@-1(???).mds e1 new map 2024-08-18T22:32:46.358 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:32:46 smithi121 ceph-mon[16788]: mon.smithi121@-1(???).mds e1 print_map 2024-08-18T22:32:46.358 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout: e1 2024-08-18T22:32:46.358 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-08-18T22:32:46.358 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-08-18T22:32:46.358 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout: legacy client fscid: -1 2024-08-18T22:32:46.358 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout: 2024-08-18T22:32:46.358 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout: No filesystems configured 2024-08-18T22:32:46.358 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:32:46 smithi121 ceph-mon[16788]: mon.smithi121@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2024-08-18T22:32:46.358 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:32:46 smithi121 ceph-mon[16788]: mon.smithi121@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-08-18T22:32:46.359 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:32:46 smithi121 ceph-mon[16788]: mon.smithi121@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-08-18T22:32:46.359 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:32:46 smithi121 ceph-mon[16788]: mon.smithi121@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-08-18T22:32:46.359 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:32:46 smithi121 ceph-mon[16788]: mon.smithi121@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2024-08-18T22:32:46.359 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:32:46 smithi121 bash[16768]: 4a7bead235acbc79f51e325fd860dc47cc2c9674a3c2e24147caa0317fba5595 2024-08-18T22:32:46.359 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:32:46 smithi121 systemd[1]: Started Ceph mon.smithi121 for b003123a-5db1-11ef-bccf-c7b262605968. 2024-08-18T22:32:46.359 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:32:46 smithi121 ceph-mon[16788]: mon.smithi121 is new leader, mons smithi121 in quorum (ranks 0) 2024-08-18T22:32:46.359 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:32:46 smithi121 ceph-mon[16788]: monmap e1: 1 mons at {smithi121=[v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-08-18T22:32:46.359 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:32:46 smithi121 ceph-mon[16788]: fsmap 2024-08-18T22:32:46.359 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:32:46 smithi121 ceph-mon[16788]: osdmap e1: 0 total, 0 up, 0 in 2024-08-18T22:32:46.359 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:32:46 smithi121 ceph-mon[16788]: mgrmap e1: no daemons active 2024-08-18T22:32:47.221 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:46.553+0000 7fcf1b778640 1 Processor -- start 2024-08-18T22:32:47.221 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:46.553+0000 7fcf1b778640 1 -- start start 2024-08-18T22:32:47.221 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:46.554+0000 7fcf1b778640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcf140708c0 0x7fcf141048a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:47.221 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:46.554+0000 7fcf1b778640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf14104de0 con 0x7fcf140708c0 2024-08-18T22:32:47.221 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:46.554+0000 7fcf19514640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcf140708c0 0x7fcf141048a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:47.221 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:46.554+0000 7fcf19514640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcf140708c0 0x7fcf141048a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:44976/0 (socket says 172.21.15.121:44976) 2024-08-18T22:32:47.221 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:46.554+0000 7fcf19514640 1 -- 172.21.15.121:0/3748245143 learned_addr learned my addr 172.21.15.121:0/3748245143 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-18T22:32:47.222 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:46.554+0000 7fcf19514640 1 -- 172.21.15.121:0/3748245143 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf14104f20 con 0x7fcf140708c0 2024-08-18T22:32:47.222 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:46.556+0000 7fcf19514640 1 --2- 172.21.15.121:0/3748245143 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcf140708c0 0x7fcf141048a0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fcf10009840 tx=0x7fcf100091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e97ce3a1669932d2 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:32:47.222 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:46.556+0000 7fcf0bfff640 1 -- 172.21.15.121:0/3748245143 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fcf10032440 con 0x7fcf140708c0 2024-08-18T22:32:47.222 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:46.556+0000 7fcf0bfff640 1 -- 172.21.15.121:0/3748245143 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7fcf10032a00 con 0x7fcf140708c0 2024-08-18T22:32:47.222 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:46.556+0000 7fcf0bfff640 1 -- 172.21.15.121:0/3748245143 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fcf100319e0 con 0x7fcf140708c0 2024-08-18T22:32:47.222 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:46.557+0000 7fcf1b778640 1 -- 172.21.15.121:0/3748245143 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcf140708c0 msgr2=0x7fcf141048a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:47.222 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:46.557+0000 7fcf1b778640 1 --2- 172.21.15.121:0/3748245143 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcf140708c0 0x7fcf141048a0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fcf10009840 tx=0x7fcf100091d0 comp rx=0 tx=0).stop 2024-08-18T22:32:47.222 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:46.557+0000 7fcf1b778640 1 -- 172.21.15.121:0/3748245143 shutdown_connections 2024-08-18T22:32:47.222 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:46.557+0000 7fcf1b778640 1 --2- 172.21.15.121:0/3748245143 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcf140708c0 0x7fcf141048a0 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:47.222 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:46.557+0000 7fcf1b778640 1 -- 172.21.15.121:0/3748245143 >> 172.21.15.121:0/3748245143 conn(0x7fcf140fc350 msgr2=0x7fcf140fe7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:32:47.222 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:46.557+0000 7fcf1b778640 1 -- 172.21.15.121:0/3748245143 shutdown_connections 2024-08-18T22:32:47.222 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:46.557+0000 7fcf1b778640 1 -- 172.21.15.121:0/3748245143 wait complete. 2024-08-18T22:32:47.222 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:46.558+0000 7fcf1b778640 1 Processor -- start 2024-08-18T22:32:47.223 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:46.558+0000 7fcf1b778640 1 -- start start 2024-08-18T22:32:47.223 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:46.558+0000 7fcf1b778640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcf140708c0 0x7fcf14110ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:47.223 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:46.558+0000 7fcf1b778640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf14111020 con 0x7fcf140708c0 2024-08-18T22:32:47.223 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:46.558+0000 7fcf19514640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcf140708c0 0x7fcf14110ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:47.223 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:46.558+0000 7fcf19514640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcf140708c0 0x7fcf14110ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:44986/0 (socket says 172.21.15.121:44986) 2024-08-18T22:32:47.223 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:46.558+0000 7fcf19514640 1 -- 172.21.15.121:0/3266214937 learned_addr learned my addr 172.21.15.121:0/3266214937 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-18T22:32:47.223 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:46.558+0000 7fcf19514640 1 -- 172.21.15.121:0/3266214937 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf10009450 con 0x7fcf140708c0 2024-08-18T22:32:47.223 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:46.558+0000 7fcf19514640 1 --2- 172.21.15.121:0/3266214937 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcf140708c0 0x7fcf14110ae0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fcf100098a0 tx=0x7fcf10008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:32:47.223 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:46.559+0000 7fcf09ffb640 1 -- 172.21.15.121:0/3266214937 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fcf10032880 con 0x7fcf140708c0 2024-08-18T22:32:47.223 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:46.559+0000 7fcf1b778640 1 -- 172.21.15.121:0/3266214937 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf14111280 con 0x7fcf140708c0 2024-08-18T22:32:47.223 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:46.559+0000 7fcf09ffb640 1 -- 172.21.15.121:0/3266214937 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7fcf1003d8b0 con 0x7fcf140708c0 2024-08-18T22:32:47.223 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:46.559+0000 7fcf09ffb640 1 -- 172.21.15.121:0/3266214937 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fcf1003b8e0 con 0x7fcf140708c0 2024-08-18T22:32:47.223 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:46.559+0000 7fcf1b778640 1 -- 172.21.15.121:0/3266214937 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf14111db0 con 0x7fcf140708c0 2024-08-18T22:32:47.223 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:46.559+0000 7fcf09ffb640 1 -- 172.21.15.121:0/3266214937 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7fcf10039070 con 0x7fcf140708c0 2024-08-18T22:32:47.223 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:46.559+0000 7fcf09ffb640 1 -- 172.21.15.121:0/3266214937 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7fcf10046720 con 0x7fcf140708c0 2024-08-18T22:32:47.224 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:46.560+0000 7fcf1b778640 1 -- 172.21.15.121:0/3266214937 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf1405eb10 con 0x7fcf140708c0 2024-08-18T22:32:47.224 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:46.562+0000 7fcf09ffb640 1 -- 172.21.15.121:0/3266214937 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71553 (secure 0 0 0) 0x7fcf100657a0 con 0x7fcf140708c0 2024-08-18T22:32:47.224 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:46.616+0000 7fcf1b778640 1 -- 172.21.15.121:0/3266214937 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command([{prefix=config set, name=public_network}] v 0) v1 -- 0x7fcf1404b540 con 0x7fcf140708c0 2024-08-18T22:32:47.224 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:46.622+0000 7fcf09ffb640 1 -- 172.21.15.121:0/3266214937 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{prefix=config set, name=public_network}]=0 v3)=0 v3) v1 ==== 124+0+0 (secure 0 0 0) 0x7fcf1404b540 con 0x7fcf140708c0 2024-08-18T22:32:47.224 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:46.622+0000 7fcf1b778640 1 -- 172.21.15.121:0/3266214937 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcf140708c0 msgr2=0x7fcf14110ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:47.224 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:46.622+0000 7fcf1b778640 1 --2- 172.21.15.121:0/3266214937 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcf140708c0 0x7fcf14110ae0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fcf100098a0 tx=0x7fcf10008040 comp rx=0 tx=0).stop 2024-08-18T22:32:47.224 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:46.622+0000 7fcf1b778640 1 -- 172.21.15.121:0/3266214937 shutdown_connections 2024-08-18T22:32:47.224 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:46.622+0000 7fcf1b778640 1 --2- 172.21.15.121:0/3266214937 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcf140708c0 0x7fcf14110ae0 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:47.224 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:46.622+0000 7fcf1b778640 1 -- 172.21.15.121:0/3266214937 >> 172.21.15.121:0/3266214937 conn(0x7fcf140fc350 msgr2=0x7fcf140fd020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:32:47.224 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:46.623+0000 7fcf1b778640 1 -- 172.21.15.121:0/3266214937 shutdown_connections 2024-08-18T22:32:47.224 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:46.623+0000 7fcf1b778640 1 -- 172.21.15.121:0/3266214937 wait complete. 2024-08-18T22:32:47.224 INFO:teuthology.orchestra.run.smithi121.stdout:Wrote config to /etc/ceph/ceph.conf 2024-08-18T22:32:47.224 INFO:teuthology.orchestra.run.smithi121.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2024-08-18T22:32:47.225 INFO:teuthology.orchestra.run.smithi121.stdout:Creating mgr... 2024-08-18T22:32:47.225 INFO:teuthology.orchestra.run.smithi121.stdout:Verifying port 0.0.0.0:9283 ... 2024-08-18T22:32:47.225 INFO:teuthology.orchestra.run.smithi121.stdout:Verifying port 0.0.0.0:8765 ... 2024-08-18T22:32:47.225 INFO:teuthology.orchestra.run.smithi121.stdout:Verifying port 0.0.0.0:8443 ... 2024-08-18T22:32:47.391 INFO:teuthology.orchestra.run.smithi121.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-b003123a-5db1-11ef-bccf-c7b262605968@mgr.smithi121.lopxqc 2024-08-18T22:32:47.391 INFO:teuthology.orchestra.run.smithi121.stdout:systemctl: stderr Failed to reset failed state of unit ceph-b003123a-5db1-11ef-bccf-c7b262605968@mgr.smithi121.lopxqc.service: Unit ceph-b003123a-5db1-11ef-bccf-c7b262605968@mgr.smithi121.lopxqc.service not loaded. 2024-08-18T22:32:47.538 INFO:teuthology.orchestra.run.smithi121.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-b003123a-5db1-11ef-bccf-c7b262605968.target.wants/ceph-b003123a-5db1-11ef-bccf-c7b262605968@mgr.smithi121.lopxqc.service → /etc/systemd/system/ceph-b003123a-5db1-11ef-bccf-c7b262605968@.service. 2024-08-18T22:32:47.764 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:32:47 smithi121 ceph-mon[16788]: from='client.? 172.21.15.121:0/3266214937' entity='client.admin' 2024-08-18T22:32:48.097 INFO:teuthology.orchestra.run.smithi121.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-08-18T22:32:48.098 INFO:teuthology.orchestra.run.smithi121.stdout:systemctl: stdout disabled 2024-08-18T22:32:48.105 INFO:teuthology.orchestra.run.smithi121.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-08-18T22:32:48.105 INFO:teuthology.orchestra.run.smithi121.stdout:systemctl: stdout inactive 2024-08-18T22:32:48.105 INFO:teuthology.orchestra.run.smithi121.stdout:firewalld.service is not enabled 2024-08-18T22:32:48.105 INFO:teuthology.orchestra.run.smithi121.stdout:Not possible to enable service . firewalld.service is not available 2024-08-18T22:32:48.114 INFO:teuthology.orchestra.run.smithi121.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-08-18T22:32:48.114 INFO:teuthology.orchestra.run.smithi121.stdout:systemctl: stdout disabled 2024-08-18T22:32:48.122 INFO:teuthology.orchestra.run.smithi121.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-08-18T22:32:48.123 INFO:teuthology.orchestra.run.smithi121.stdout:systemctl: stdout inactive 2024-08-18T22:32:48.123 INFO:teuthology.orchestra.run.smithi121.stdout:firewalld.service is not enabled 2024-08-18T22:32:48.123 INFO:teuthology.orchestra.run.smithi121.stdout:Not possible to open ports <[9283, 8765, 8443]>. firewalld.service is not available 2024-08-18T22:32:48.123 INFO:teuthology.orchestra.run.smithi121.stdout:Waiting for mgr to start... 2024-08-18T22:32:48.123 INFO:teuthology.orchestra.run.smithi121.stdout:Waiting for mgr... 2024-08-18T22:32:48.901 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:32:48 smithi121 ceph-mon[16788]: from='client.? 172.21.15.121:0/280021642' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-08-18T22:32:49.145 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stdout 2024-08-18T22:32:49.145 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stdout { 2024-08-18T22:32:49.146 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stdout "fsid": "b003123a-5db1-11ef-bccf-c7b262605968", 2024-08-18T22:32:49.146 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stdout "health": { 2024-08-18T22:32:49.146 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-08-18T22:32:49.146 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-08-18T22:32:49.146 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-08-18T22:32:49.146 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stdout }, 2024-08-18T22:32:49.146 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-08-18T22:32:49.146 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-08-18T22:32:49.146 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stdout 0 2024-08-18T22:32:49.146 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stdout ], 2024-08-18T22:32:49.146 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-08-18T22:32:49.146 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stdout "smithi121" 2024-08-18T22:32:49.146 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stdout ], 2024-08-18T22:32:49.147 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stdout "quorum_age": 2, 2024-08-18T22:32:49.147 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stdout "monmap": { 2024-08-18T22:32:49.147 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-08-18T22:32:49.147 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "quincy", 2024-08-18T22:32:49.147 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-08-18T22:32:49.147 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stdout }, 2024-08-18T22:32:49.147 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-08-18T22:32:49.147 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-08-18T22:32:49.147 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-08-18T22:32:49.147 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-08-18T22:32:49.147 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-08-18T22:32:49.155 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-08-18T22:32:49.155 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-08-18T22:32:49.155 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-08-18T22:32:49.155 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stdout }, 2024-08-18T22:32:49.155 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-08-18T22:32:49.155 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-08-18T22:32:49.156 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-08-18T22:32:49.156 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-08-18T22:32:49.156 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-08-18T22:32:49.156 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-08-18T22:32:49.156 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-08-18T22:32:49.156 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-08-18T22:32:49.156 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-08-18T22:32:49.156 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stdout }, 2024-08-18T22:32:49.156 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-08-18T22:32:49.156 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-08-18T22:32:49.156 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-08-18T22:32:49.156 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-08-18T22:32:49.156 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stdout }, 2024-08-18T22:32:49.156 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-08-18T22:32:49.157 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stdout "available": false, 2024-08-18T22:32:49.157 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-08-18T22:32:49.157 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stdout "modules": [ 2024-08-18T22:32:49.157 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stdout "iostat", 2024-08-18T22:32:49.157 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stdout "nfs", 2024-08-18T22:32:49.157 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stdout "restful" 2024-08-18T22:32:49.157 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stdout ], 2024-08-18T22:32:49.157 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stdout "services": {} 2024-08-18T22:32:49.157 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stdout }, 2024-08-18T22:32:49.157 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-08-18T22:32:49.157 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-08-18T22:32:49.157 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stdout "modified": "2024-08-18T22:32:41.331140+0000", 2024-08-18T22:32:49.157 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stdout "services": {} 2024-08-18T22:32:49.157 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stdout }, 2024-08-18T22:32:49.158 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-08-18T22:32:49.158 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stdout } 2024-08-18T22:32:49.158 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:48.527+0000 7f56042b5640 1 Processor -- start 2024-08-18T22:32:49.158 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:48.527+0000 7f56042b5640 1 -- start start 2024-08-18T22:32:49.158 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:48.528+0000 7f56042b5640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f55fc104000 0x7f55fc104410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:49.158 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:48.528+0000 7f56042b5640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55fc104950 con 0x7f55fc104000 2024-08-18T22:32:49.158 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:48.528+0000 7f5602051640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f55fc104000 0x7f55fc104410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:49.158 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:48.528+0000 7f5602051640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f55fc104000 0x7f55fc104410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:34650/0 (socket says 172.21.15.121:34650) 2024-08-18T22:32:49.158 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:48.528+0000 7f5602051640 1 -- 172.21.15.121:0/925281542 learned_addr learned my addr 172.21.15.121:0/925281542 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-18T22:32:49.158 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:48.528+0000 7f5602051640 1 -- 172.21.15.121:0/925281542 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55fc104a90 con 0x7f55fc104000 2024-08-18T22:32:49.158 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:48.529+0000 7f5602051640 1 --2- 172.21.15.121:0/925281542 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f55fc104000 0x7f55fc104410 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f55f8009840 tx=0x7f55f80091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e843242c7eeefabe server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:32:49.158 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:48.529+0000 7f560104f640 1 -- 172.21.15.121:0/925281542 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f55f8032440 con 0x7f55fc104000 2024-08-18T22:32:49.159 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:48.529+0000 7f560104f640 1 -- 172.21.15.121:0/925281542 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7f55f8032a00 con 0x7f55fc104000 2024-08-18T22:32:49.159 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:48.529+0000 7f560104f640 1 -- 172.21.15.121:0/925281542 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f55f80319e0 con 0x7f55fc104000 2024-08-18T22:32:49.159 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:48.530+0000 7f56042b5640 1 -- 172.21.15.121:0/925281542 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f55fc104000 msgr2=0x7f55fc104410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:49.159 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:48.530+0000 7f56042b5640 1 --2- 172.21.15.121:0/925281542 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f55fc104000 0x7f55fc104410 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f55f8009840 tx=0x7f55f80091d0 comp rx=0 tx=0).stop 2024-08-18T22:32:49.159 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:48.530+0000 7f56042b5640 1 -- 172.21.15.121:0/925281542 shutdown_connections 2024-08-18T22:32:49.159 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:48.530+0000 7f56042b5640 1 --2- 172.21.15.121:0/925281542 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f55fc104000 0x7f55fc104410 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:49.159 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:48.530+0000 7f56042b5640 1 -- 172.21.15.121:0/925281542 >> 172.21.15.121:0/925281542 conn(0x7f55fc077530 msgr2=0x7f55fc077950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:32:49.159 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:48.530+0000 7f56042b5640 1 -- 172.21.15.121:0/925281542 shutdown_connections 2024-08-18T22:32:49.159 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:48.530+0000 7f56042b5640 1 -- 172.21.15.121:0/925281542 wait complete. 2024-08-18T22:32:49.159 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:48.531+0000 7f56042b5640 1 Processor -- start 2024-08-18T22:32:49.159 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:48.531+0000 7f56042b5640 1 -- start start 2024-08-18T22:32:49.159 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:48.531+0000 7f56042b5640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f55fc104000 0x7f55fc112e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:49.159 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:48.531+0000 7f56042b5640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55fc113370 con 0x7f55fc104000 2024-08-18T22:32:49.160 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:48.531+0000 7f5602051640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f55fc104000 0x7f55fc112e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:49.160 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:48.531+0000 7f5602051640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f55fc104000 0x7f55fc112e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:34664/0 (socket says 172.21.15.121:34664) 2024-08-18T22:32:49.160 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:48.531+0000 7f5602051640 1 -- 172.21.15.121:0/280021642 learned_addr learned my addr 172.21.15.121:0/280021642 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-18T22:32:49.160 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:48.531+0000 7f5602051640 1 -- 172.21.15.121:0/280021642 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55f8009450 con 0x7f55fc104000 2024-08-18T22:32:49.160 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:48.532+0000 7f5602051640 1 --2- 172.21.15.121:0/280021642 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f55fc104000 0x7f55fc112e30 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f55f80098a0 tx=0x7f55f8008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:32:49.160 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:48.532+0000 7f55f2ffd640 1 -- 172.21.15.121:0/280021642 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f55f8032880 con 0x7f55fc104000 2024-08-18T22:32:49.160 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:48.532+0000 7f55f2ffd640 1 -- 172.21.15.121:0/280021642 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7f55f803d8b0 con 0x7f55fc104000 2024-08-18T22:32:49.160 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:48.532+0000 7f55f2ffd640 1 -- 172.21.15.121:0/280021642 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f55f803b8a0 con 0x7f55fc104000 2024-08-18T22:32:49.160 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:48.532+0000 7f56042b5640 1 -- 172.21.15.121:0/280021642 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55fc113570 con 0x7f55fc104000 2024-08-18T22:32:49.160 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:48.532+0000 7f56042b5640 1 -- 172.21.15.121:0/280021642 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55fc113fc0 con 0x7f55fc104000 2024-08-18T22:32:49.160 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:48.532+0000 7f55f2ffd640 1 -- 172.21.15.121:0/280021642 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7f55f8039070 con 0x7f55fc104000 2024-08-18T22:32:49.160 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:48.532+0000 7f55f2ffd640 1 -- 172.21.15.121:0/280021642 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f55f80466c0 con 0x7f55fc104000 2024-08-18T22:32:49.160 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:48.533+0000 7f56042b5640 1 -- 172.21.15.121:0/280021642 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55fc05eb10 con 0x7f55fc104000 2024-08-18T22:32:49.161 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:48.535+0000 7f55f2ffd640 1 -- 172.21.15.121:0/280021642 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71553 (secure 0 0 0) 0x7f55f80657a0 con 0x7f55fc104000 2024-08-18T22:32:49.161 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:48.595+0000 7f56042b5640 1 -- 172.21.15.121:0/280021642 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7f55fc105ef0 con 0x7f55fc104000 2024-08-18T22:32:49.161 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:48.595+0000 7f55f2ffd640 1 -- 172.21.15.121:0/280021642 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1248 (secure 0 0 0) 0x7f55fc105ef0 con 0x7f55fc104000 2024-08-18T22:32:49.161 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:48.596+0000 7f56042b5640 1 -- 172.21.15.121:0/280021642 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f55fc104000 msgr2=0x7f55fc112e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:49.161 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:48.596+0000 7f56042b5640 1 --2- 172.21.15.121:0/280021642 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f55fc104000 0x7f55fc112e30 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f55f80098a0 tx=0x7f55f8008040 comp rx=0 tx=0).stop 2024-08-18T22:32:49.161 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:48.596+0000 7f56042b5640 1 -- 172.21.15.121:0/280021642 shutdown_connections 2024-08-18T22:32:49.161 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:48.596+0000 7f56042b5640 1 --2- 172.21.15.121:0/280021642 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f55fc104000 0x7f55fc112e30 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:49.161 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:48.596+0000 7f56042b5640 1 -- 172.21.15.121:0/280021642 >> 172.21.15.121:0/280021642 conn(0x7f55fc077530 msgr2=0x7f55fc101440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:32:49.161 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:48.596+0000 7f56042b5640 1 -- 172.21.15.121:0/280021642 shutdown_connections 2024-08-18T22:32:49.161 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:48.596+0000 7f56042b5640 1 -- 172.21.15.121:0/280021642 wait complete. 2024-08-18T22:32:49.161 INFO:teuthology.orchestra.run.smithi121.stdout:mgr not available, waiting (1/15)... 2024-08-18T22:32:51.833 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:32:51 smithi121 ceph-mon[16788]: from='client.? 172.21.15.121:0/3243854133' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-08-18T22:32:52.201 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stdout 2024-08-18T22:32:52.201 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stdout { 2024-08-18T22:32:52.201 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stdout "fsid": "b003123a-5db1-11ef-bccf-c7b262605968", 2024-08-18T22:32:52.201 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stdout "health": { 2024-08-18T22:32:52.201 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-08-18T22:32:52.201 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-08-18T22:32:52.201 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-08-18T22:32:52.201 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stdout }, 2024-08-18T22:32:52.201 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-08-18T22:32:52.201 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-08-18T22:32:52.202 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stdout 0 2024-08-18T22:32:52.202 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stdout ], 2024-08-18T22:32:52.202 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-08-18T22:32:52.202 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stdout "smithi121" 2024-08-18T22:32:52.202 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stdout ], 2024-08-18T22:32:52.202 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stdout "quorum_age": 5, 2024-08-18T22:32:52.202 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stdout "monmap": { 2024-08-18T22:32:52.202 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-08-18T22:32:52.202 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "quincy", 2024-08-18T22:32:52.202 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-08-18T22:32:52.202 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stdout }, 2024-08-18T22:32:52.202 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-08-18T22:32:52.202 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-08-18T22:32:52.203 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-08-18T22:32:52.203 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-08-18T22:32:52.203 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-08-18T22:32:52.203 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-08-18T22:32:52.203 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-08-18T22:32:52.203 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-08-18T22:32:52.203 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stdout }, 2024-08-18T22:32:52.203 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-08-18T22:32:52.203 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-08-18T22:32:52.203 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-08-18T22:32:52.203 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-08-18T22:32:52.203 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-08-18T22:32:52.204 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-08-18T22:32:52.204 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-08-18T22:32:52.204 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-08-18T22:32:52.204 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-08-18T22:32:52.204 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stdout }, 2024-08-18T22:32:52.204 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-08-18T22:32:52.204 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-08-18T22:32:52.204 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-08-18T22:32:52.204 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-08-18T22:32:52.204 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stdout }, 2024-08-18T22:32:52.204 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-08-18T22:32:52.204 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stdout "available": false, 2024-08-18T22:32:52.204 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-08-18T22:32:52.205 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stdout "modules": [ 2024-08-18T22:32:52.205 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stdout "iostat", 2024-08-18T22:32:52.205 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stdout "nfs", 2024-08-18T22:32:52.205 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stdout "restful" 2024-08-18T22:32:52.205 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stdout ], 2024-08-18T22:32:52.205 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stdout "services": {} 2024-08-18T22:32:52.205 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stdout }, 2024-08-18T22:32:52.205 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-08-18T22:32:52.205 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-08-18T22:32:52.205 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stdout "modified": "2024-08-18T22:32:41.331140+0000", 2024-08-18T22:32:52.205 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stdout "services": {} 2024-08-18T22:32:52.205 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stdout }, 2024-08-18T22:32:52.205 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-08-18T22:32:52.205 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stdout } 2024-08-18T22:32:52.206 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:51.548+0000 7f681c57d640 1 Processor -- start 2024-08-18T22:32:52.206 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:51.548+0000 7f681c57d640 1 -- start start 2024-08-18T22:32:52.206 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:51.548+0000 7f681c57d640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6814076bd0 0x7f68141048f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:52.206 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:51.548+0000 7f681c57d640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6814104e30 con 0x7f6814076bd0 2024-08-18T22:32:52.206 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:51.549+0000 7f681a319640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6814076bd0 0x7f68141048f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:52.206 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:51.549+0000 7f681a319640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6814076bd0 0x7f68141048f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:34676/0 (socket says 172.21.15.121:34676) 2024-08-18T22:32:52.206 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:51.549+0000 7f681a319640 1 -- 172.21.15.121:0/2976686866 learned_addr learned my addr 172.21.15.121:0/2976686866 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-18T22:32:52.206 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:51.549+0000 7f681a319640 1 -- 172.21.15.121:0/2976686866 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6814104f70 con 0x7f6814076bd0 2024-08-18T22:32:52.206 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:51.550+0000 7f681a319640 1 --2- 172.21.15.121:0/2976686866 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6814076bd0 0x7f68141048f0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f6804009840 tx=0x7f68040091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=614f58f03b74316f server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:32:52.206 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:51.550+0000 7f6819317640 1 -- 172.21.15.121:0/2976686866 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6804032440 con 0x7f6814076bd0 2024-08-18T22:32:52.206 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:51.550+0000 7f6819317640 1 -- 172.21.15.121:0/2976686866 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7f6804032a00 con 0x7f6814076bd0 2024-08-18T22:32:52.207 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:51.550+0000 7f6819317640 1 -- 172.21.15.121:0/2976686866 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f68040319e0 con 0x7f6814076bd0 2024-08-18T22:32:52.207 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:51.550+0000 7f681c57d640 1 -- 172.21.15.121:0/2976686866 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6814076bd0 msgr2=0x7f68141048f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:52.207 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:51.550+0000 7f681c57d640 1 --2- 172.21.15.121:0/2976686866 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6814076bd0 0x7f68141048f0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f6804009840 tx=0x7f68040091d0 comp rx=0 tx=0).stop 2024-08-18T22:32:52.207 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:51.551+0000 7f681c57d640 1 -- 172.21.15.121:0/2976686866 shutdown_connections 2024-08-18T22:32:52.207 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:51.551+0000 7f681c57d640 1 --2- 172.21.15.121:0/2976686866 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6814076bd0 0x7f68141048f0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:52.207 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:51.551+0000 7f681c57d640 1 -- 172.21.15.121:0/2976686866 >> 172.21.15.121:0/2976686866 conn(0x7f68140fc400 msgr2=0x7f68140fe810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:32:52.207 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:51.551+0000 7f681c57d640 1 -- 172.21.15.121:0/2976686866 shutdown_connections 2024-08-18T22:32:52.207 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:51.551+0000 7f681c57d640 1 -- 172.21.15.121:0/2976686866 wait complete. 2024-08-18T22:32:52.207 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:51.551+0000 7f681c57d640 1 Processor -- start 2024-08-18T22:32:52.207 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:51.551+0000 7f681c57d640 1 -- start start 2024-08-18T22:32:52.207 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:51.551+0000 7f681c57d640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6814076bd0 0x7f6814110ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:32:52.207 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:51.551+0000 7f681c57d640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6814111020 con 0x7f6814076bd0 2024-08-18T22:32:52.207 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:51.551+0000 7f681a319640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6814076bd0 0x7f6814110ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:32:52.208 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:51.551+0000 7f681a319640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6814076bd0 0x7f6814110ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:34680/0 (socket says 172.21.15.121:34680) 2024-08-18T22:32:52.208 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:51.551+0000 7f681a319640 1 -- 172.21.15.121:0/3243854133 learned_addr learned my addr 172.21.15.121:0/3243854133 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-18T22:32:52.208 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:51.552+0000 7f681a319640 1 -- 172.21.15.121:0/3243854133 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6804009450 con 0x7f6814076bd0 2024-08-18T22:32:52.208 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:51.552+0000 7f681a319640 1 --2- 172.21.15.121:0/3243854133 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6814076bd0 0x7f6814110ae0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f6804006f00 tx=0x7f6804008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:32:52.208 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:51.552+0000 7f680affd640 1 -- 172.21.15.121:0/3243854133 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6804031e30 con 0x7f6814076bd0 2024-08-18T22:32:52.208 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:51.552+0000 7f680affd640 1 -- 172.21.15.121:0/3243854133 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7f680403d8b0 con 0x7f6814076bd0 2024-08-18T22:32:52.208 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:51.552+0000 7f681c57d640 1 -- 172.21.15.121:0/3243854133 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6814111220 con 0x7f6814076bd0 2024-08-18T22:32:52.208 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:51.552+0000 7f680affd640 1 -- 172.21.15.121:0/3243854133 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f680403b8f0 con 0x7f6814076bd0 2024-08-18T22:32:52.208 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:51.552+0000 7f681c57d640 1 -- 172.21.15.121:0/3243854133 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6814111690 con 0x7f6814076bd0 2024-08-18T22:32:52.208 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:51.552+0000 7f680affd640 1 -- 172.21.15.121:0/3243854133 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7f6804039070 con 0x7f6814076bd0 2024-08-18T22:32:52.208 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:51.552+0000 7f680affd640 1 -- 172.21.15.121:0/3243854133 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f6804046c50 con 0x7f6814076bd0 2024-08-18T22:32:52.208 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:51.553+0000 7f681c57d640 1 -- 172.21.15.121:0/3243854133 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f681404b4c0 con 0x7f6814076bd0 2024-08-18T22:32:52.208 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:51.555+0000 7f680affd640 1 -- 172.21.15.121:0/3243854133 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71553 (secure 0 0 0) 0x7f68040657a0 con 0x7f6814076bd0 2024-08-18T22:32:52.209 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:51.614+0000 7f681c57d640 1 -- 172.21.15.121:0/3243854133 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7f6814111db0 con 0x7f6814076bd0 2024-08-18T22:32:52.209 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:51.615+0000 7f680affd640 1 -- 172.21.15.121:0/3243854133 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1248 (secure 0 0 0) 0x7f6804054020 con 0x7f6814076bd0 2024-08-18T22:32:52.209 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:51.616+0000 7f681c57d640 1 -- 172.21.15.121:0/3243854133 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6814076bd0 msgr2=0x7f6814110ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:32:52.209 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:51.616+0000 7f681c57d640 1 --2- 172.21.15.121:0/3243854133 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6814076bd0 0x7f6814110ae0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f6804006f00 tx=0x7f6804008040 comp rx=0 tx=0).stop 2024-08-18T22:32:52.209 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:51.616+0000 7f681c57d640 1 -- 172.21.15.121:0/3243854133 shutdown_connections 2024-08-18T22:32:52.209 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:51.616+0000 7f681c57d640 1 --2- 172.21.15.121:0/3243854133 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6814076bd0 0x7f6814110ae0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:32:52.209 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:51.616+0000 7f681c57d640 1 -- 172.21.15.121:0/3243854133 >> 172.21.15.121:0/3243854133 conn(0x7f68140fc400 msgr2=0x7f68140fd020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:32:52.209 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:51.616+0000 7f681c57d640 1 -- 172.21.15.121:0/3243854133 shutdown_connections 2024-08-18T22:32:52.209 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:51.616+0000 7f681c57d640 1 -- 172.21.15.121:0/3243854133 wait complete. 2024-08-18T22:32:52.209 INFO:teuthology.orchestra.run.smithi121.stdout:mgr not available, waiting (2/15)... 2024-08-18T22:32:53.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:32:52 smithi121 ceph-mon[16788]: Activating manager daemon smithi121.lopxqc 2024-08-18T22:32:53.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:32:52 smithi121 ceph-mon[16788]: mgrmap e2: smithi121.lopxqc(active, starting, since 0.00290528s) 2024-08-18T22:32:53.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:32:52 smithi121 ceph-mon[16788]: from='mgr.14100 172.21.15.121:0/573716115' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-08-18T22:32:53.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:32:52 smithi121 ceph-mon[16788]: from='mgr.14100 172.21.15.121:0/573716115' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-08-18T22:32:53.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:32:52 smithi121 ceph-mon[16788]: from='mgr.14100 172.21.15.121:0/573716115' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-08-18T22:32:53.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:32:52 smithi121 ceph-mon[16788]: from='mgr.14100 172.21.15.121:0/573716115' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "mon metadata", "id": "smithi121"}]: dispatch 2024-08-18T22:32:53.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:32:52 smithi121 ceph-mon[16788]: from='mgr.14100 172.21.15.121:0/573716115' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "mgr metadata", "who": "smithi121.lopxqc", "id": "smithi121.lopxqc"}]: dispatch 2024-08-18T22:32:53.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:32:52 smithi121 ceph-mon[16788]: Manager daemon smithi121.lopxqc is now available 2024-08-18T22:32:53.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:32:52 smithi121 ceph-mon[16788]: from='mgr.14100 172.21.15.121:0/573716115' entity='mgr.smithi121.lopxqc' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi121.lopxqc/mirror_snapshot_schedule"}]: dispatch 2024-08-18T22:32:53.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:32:52 smithi121 ceph-mon[16788]: from='mgr.14100 172.21.15.121:0/573716115' entity='mgr.smithi121.lopxqc' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi121.lopxqc/trash_purge_schedule"}]: dispatch 2024-08-18T22:32:53.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:32:52 smithi121 ceph-mon[16788]: from='mgr.14100 172.21.15.121:0/573716115' entity='mgr.smithi121.lopxqc' 2024-08-18T22:32:53.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:32:52 smithi121 ceph-mon[16788]: from='mgr.14100 172.21.15.121:0/573716115' entity='mgr.smithi121.lopxqc' 2024-08-18T22:32:53.085 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:32:52 smithi121 ceph-mon[16788]: from='mgr.14100 172.21.15.121:0/573716115' entity='mgr.smithi121.lopxqc' 2024-08-18T22:32:54.583 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:32:54 smithi121 ceph-mon[16788]: mgrmap e3: smithi121.lopxqc(active, since 1.00607s) 2024-08-18T22:32:55.583 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:32:55 smithi121 ceph-mon[16788]: mgrmap e4: smithi121.lopxqc(active, since 2s) 2024-08-18T22:32:57.834 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:32:57 smithi121 ceph-mon[16788]: from='client.? 172.21.15.121:0/2800214633' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-08-18T22:33:03.666 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stdout 2024-08-18T22:33:03.666 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stdout { 2024-08-18T22:33:03.666 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stdout "fsid": "b003123a-5db1-11ef-bccf-c7b262605968", 2024-08-18T22:33:03.666 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stdout "health": { 2024-08-18T22:33:03.666 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-08-18T22:33:03.666 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-08-18T22:33:03.666 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-08-18T22:33:03.666 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stdout }, 2024-08-18T22:33:03.667 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-08-18T22:33:03.667 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-08-18T22:33:03.667 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stdout 0 2024-08-18T22:33:03.667 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stdout ], 2024-08-18T22:33:03.667 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-08-18T22:33:03.667 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stdout "smithi121" 2024-08-18T22:33:03.667 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stdout ], 2024-08-18T22:33:03.667 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stdout "quorum_age": 11, 2024-08-18T22:33:03.667 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stdout "monmap": { 2024-08-18T22:33:03.667 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-08-18T22:33:03.667 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "quincy", 2024-08-18T22:33:03.667 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-08-18T22:33:03.667 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stdout }, 2024-08-18T22:33:03.667 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-08-18T22:33:03.668 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-08-18T22:33:03.668 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-08-18T22:33:03.668 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-08-18T22:33:03.668 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-08-18T22:33:03.676 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-08-18T22:33:03.676 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-08-18T22:33:03.676 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-08-18T22:33:03.676 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stdout }, 2024-08-18T22:33:03.676 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-08-18T22:33:03.676 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-08-18T22:33:03.677 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-08-18T22:33:03.677 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-08-18T22:33:03.677 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-08-18T22:33:03.677 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-08-18T22:33:03.677 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-08-18T22:33:03.677 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-08-18T22:33:03.677 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-08-18T22:33:03.677 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stdout }, 2024-08-18T22:33:03.677 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-08-18T22:33:03.677 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-08-18T22:33:03.677 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-08-18T22:33:03.677 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-08-18T22:33:03.677 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stdout }, 2024-08-18T22:33:03.678 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-08-18T22:33:03.678 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stdout "available": true, 2024-08-18T22:33:03.678 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-08-18T22:33:03.678 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stdout "modules": [ 2024-08-18T22:33:03.678 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stdout "iostat", 2024-08-18T22:33:03.678 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stdout "nfs", 2024-08-18T22:33:03.678 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stdout "restful" 2024-08-18T22:33:03.678 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stdout ], 2024-08-18T22:33:03.678 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stdout "services": {} 2024-08-18T22:33:03.678 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stdout }, 2024-08-18T22:33:03.678 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-08-18T22:33:03.678 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-08-18T22:33:03.678 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stdout "modified": "2024-08-18T22:32:41.331140+0000", 2024-08-18T22:33:03.679 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stdout "services": {} 2024-08-18T22:33:03.679 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stdout }, 2024-08-18T22:33:03.679 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-08-18T22:33:03.679 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stdout } 2024-08-18T22:33:03.679 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:57.134+0000 7f2348f9e640 1 Processor -- start 2024-08-18T22:33:03.679 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:57.135+0000 7f2348f9e640 1 -- start start 2024-08-18T22:33:03.679 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:57.135+0000 7f2348f9e640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2344101d40 0x7f2344102150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:03.679 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:57.135+0000 7f2348f9e640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2344102690 con 0x7f2344101d40 2024-08-18T22:33:03.679 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:57.135+0000 7f234259c640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2344101d40 0x7f2344102150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:03.679 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:57.135+0000 7f234259c640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2344101d40 0x7f2344102150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:37784/0 (socket says 172.21.15.121:37784) 2024-08-18T22:33:03.679 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:57.135+0000 7f234259c640 1 -- 172.21.15.121:0/3448058460 learned_addr learned my addr 172.21.15.121:0/3448058460 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-18T22:33:03.679 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:57.135+0000 7f234259c640 1 -- 172.21.15.121:0/3448058460 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23441027d0 con 0x7f2344101d40 2024-08-18T22:33:03.679 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:57.136+0000 7f234259c640 1 --2- 172.21.15.121:0/3448058460 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2344101d40 0x7f2344102150 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f2334009840 tx=0x7f23340091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84a9546bff27fed7 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:33:03.680 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:57.136+0000 7f2341d9b640 1 -- 172.21.15.121:0/3448058460 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2334032440 con 0x7f2344101d40 2024-08-18T22:33:03.680 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:57.136+0000 7f2341d9b640 1 -- 172.21.15.121:0/3448058460 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7f2334032a00 con 0x7f2344101d40 2024-08-18T22:33:03.680 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:57.136+0000 7f2341d9b640 1 -- 172.21.15.121:0/3448058460 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f23340319e0 con 0x7f2344101d40 2024-08-18T22:33:03.680 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:57.137+0000 7f2348f9e640 1 -- 172.21.15.121:0/3448058460 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2344101d40 msgr2=0x7f2344102150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:03.680 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:57.137+0000 7f2348f9e640 1 --2- 172.21.15.121:0/3448058460 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2344101d40 0x7f2344102150 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f2334009840 tx=0x7f23340091d0 comp rx=0 tx=0).stop 2024-08-18T22:33:03.680 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:57.137+0000 7f2348f9e640 1 -- 172.21.15.121:0/3448058460 shutdown_connections 2024-08-18T22:33:03.680 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:57.137+0000 7f2348f9e640 1 --2- 172.21.15.121:0/3448058460 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2344101d40 0x7f2344102150 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:03.680 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:57.137+0000 7f2348f9e640 1 -- 172.21.15.121:0/3448058460 >> 172.21.15.121:0/3448058460 conn(0x7f23440fd510 msgr2=0x7f23440ff930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:33:03.680 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:57.137+0000 7f2348f9e640 1 -- 172.21.15.121:0/3448058460 shutdown_connections 2024-08-18T22:33:03.680 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:57.137+0000 7f2348f9e640 1 -- 172.21.15.121:0/3448058460 wait complete. 2024-08-18T22:33:03.680 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:57.137+0000 7f2348f9e640 1 Processor -- start 2024-08-18T22:33:03.680 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:57.137+0000 7f2348f9e640 1 -- start start 2024-08-18T22:33:03.681 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:57.138+0000 7f2348f9e640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2344101d40 0x7f2344110ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:03.681 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:57.138+0000 7f2348f9e640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2344111000 con 0x7f2344101d40 2024-08-18T22:33:03.681 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:57.138+0000 7f234259c640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2344101d40 0x7f2344110ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:03.681 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:57.138+0000 7f234259c640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2344101d40 0x7f2344110ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:37794/0 (socket says 172.21.15.121:37794) 2024-08-18T22:33:03.681 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:57.138+0000 7f234259c640 1 -- 172.21.15.121:0/2800214633 learned_addr learned my addr 172.21.15.121:0/2800214633 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-18T22:33:03.681 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:57.138+0000 7f234259c640 1 -- 172.21.15.121:0/2800214633 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2334009450 con 0x7f2344101d40 2024-08-18T22:33:03.681 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:57.138+0000 7f234259c640 1 --2- 172.21.15.121:0/2800214633 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2344101d40 0x7f2344110ac0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f23340098a0 tx=0x7f2334008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:33:03.681 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:57.138+0000 7f233affd640 1 -- 172.21.15.121:0/2800214633 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2334032880 con 0x7f2344101d40 2024-08-18T22:33:03.681 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:57.138+0000 7f233affd640 1 -- 172.21.15.121:0/2800214633 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7f233403d8b0 con 0x7f2344101d40 2024-08-18T22:33:03.681 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:57.138+0000 7f2348f9e640 1 -- 172.21.15.121:0/2800214633 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2344111200 con 0x7f2344101d40 2024-08-18T22:33:03.681 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:57.138+0000 7f233affd640 1 -- 172.21.15.121:0/2800214633 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f233403b8a0 con 0x7f2344101d40 2024-08-18T22:33:03.681 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:57.138+0000 7f2348f9e640 1 -- 172.21.15.121:0/2800214633 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2344111670 con 0x7f2344101d40 2024-08-18T22:33:03.681 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:57.139+0000 7f233affd640 1 -- 172.21.15.121:0/2800214633 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 4) v1 ==== 42625+0+0 (secure 0 0 0) 0x7f2334039070 con 0x7f2344101d40 2024-08-18T22:33:03.682 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:57.140+0000 7f2348f9e640 1 -- 172.21.15.121:0/2800214633 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f234404b4c0 con 0x7f2344101d40 2024-08-18T22:33:03.682 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:57.140+0000 7f233affd640 1 --2- 172.21.15.121:0/2800214633 >> [v2:172.21.15.121:6800/2610373559,v1:172.21.15.121:6801/2610373559] conn(0x7f23300356c0 0x7f2330037b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:03.682 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:57.140+0000 7f233affd640 1 -- 172.21.15.121:0/2800214633 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f2334068350 con 0x7f2344101d40 2024-08-18T22:33:03.682 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:57.140+0000 7f233bfff640 1 --2- 172.21.15.121:0/2800214633 >> [v2:172.21.15.121:6800/2610373559,v1:172.21.15.121:6801/2610373559] conn(0x7f23300356c0 0x7f2330037b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:03.682 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:57.140+0000 7f233bfff640 1 --2- 172.21.15.121:0/2800214633 >> [v2:172.21.15.121:6800/2610373559,v1:172.21.15.121:6801/2610373559] conn(0x7f23300356c0 0x7f2330037b70 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f232c006fd0 tx=0x7f232c006db0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:33:03.682 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:57.145+0000 7f233affd640 1 -- 172.21.15.121:0/2800214633 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f233403ab70 con 0x7f2344101d40 2024-08-18T22:33:03.682 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:57.360+0000 7f2348f9e640 1 -- 172.21.15.121:0/2800214633 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7f2344103a00 con 0x7f2344101d40 2024-08-18T22:33:03.682 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:57.360+0000 7f233affd640 1 -- 172.21.15.121:0/2800214633 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1248 (secure 0 0 0) 0x7f2334041070 con 0x7f2344101d40 2024-08-18T22:33:03.682 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:57.362+0000 7f2348f9e640 1 -- 172.21.15.121:0/2800214633 >> [v2:172.21.15.121:6800/2610373559,v1:172.21.15.121:6801/2610373559] conn(0x7f23300356c0 msgr2=0x7f2330037b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:03.682 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:57.362+0000 7f2348f9e640 1 --2- 172.21.15.121:0/2800214633 >> [v2:172.21.15.121:6800/2610373559,v1:172.21.15.121:6801/2610373559] conn(0x7f23300356c0 0x7f2330037b70 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f232c006fd0 tx=0x7f232c006db0 comp rx=0 tx=0).stop 2024-08-18T22:33:03.682 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:57.362+0000 7f2348f9e640 1 -- 172.21.15.121:0/2800214633 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2344101d40 msgr2=0x7f2344110ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:03.682 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:57.362+0000 7f2348f9e640 1 --2- 172.21.15.121:0/2800214633 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2344101d40 0x7f2344110ac0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f23340098a0 tx=0x7f2334008040 comp rx=0 tx=0).stop 2024-08-18T22:33:03.683 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:57.362+0000 7f2348f9e640 1 -- 172.21.15.121:0/2800214633 shutdown_connections 2024-08-18T22:33:03.683 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:57.362+0000 7f2348f9e640 1 --2- 172.21.15.121:0/2800214633 >> [v2:172.21.15.121:6800/2610373559,v1:172.21.15.121:6801/2610373559] conn(0x7f23300356c0 0x7f2330037b70 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:03.683 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:57.362+0000 7f2348f9e640 1 --2- 172.21.15.121:0/2800214633 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2344101d40 0x7f2344110ac0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:03.683 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:57.362+0000 7f2348f9e640 1 -- 172.21.15.121:0/2800214633 >> 172.21.15.121:0/2800214633 conn(0x7f23440fd510 msgr2=0x7f23440fe140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:33:03.683 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:57.362+0000 7f2348f9e640 1 -- 172.21.15.121:0/2800214633 shutdown_connections 2024-08-18T22:33:03.683 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:32:57.362+0000 7f2348f9e640 1 -- 172.21.15.121:0/2800214633 wait complete. 2024-08-18T22:33:03.683 INFO:teuthology.orchestra.run.smithi121.stdout:mgr is available 2024-08-18T22:33:04.543 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:33:04 smithi121 ceph-mon[16788]: from='client.? 172.21.15.121:0/2346825095' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-08-18T22:33:04.778 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stdout 2024-08-18T22:33:04.785 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stdout [global] 2024-08-18T22:33:04.785 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stdout fsid = b003123a-5db1-11ef-bccf-c7b262605968 2024-08-18T22:33:04.785 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stdout mon_cluster_log_file_level = debug 2024-08-18T22:33:04.785 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-08-18T22:33:04.785 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-08-18T22:33:04.785 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-08-18T22:33:04.786 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-08-18T22:33:04.786 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stdout 2024-08-18T22:33:04.786 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stdout [mgr] 2024-08-18T22:33:04.786 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-08-18T22:33:04.786 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stdout 2024-08-18T22:33:04.786 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stdout [osd] 2024-08-18T22:33:04.786 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-08-18T22:33:04.786 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-08-18T22:33:04.786 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-08-18T22:33:04.786 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-08-18T22:33:04.786 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-08-18T22:33:04.786 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:04.064+0000 7fd501689640 1 Processor -- start 2024-08-18T22:33:04.787 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:04.064+0000 7fd501689640 1 -- start start 2024-08-18T22:33:04.787 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:04.064+0000 7fd501689640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd4fc076ba0 0x7fd4fc1048f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:04.787 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:04.064+0000 7fd501689640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4fc104e30 con 0x7fd4fc076ba0 2024-08-18T22:33:04.787 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:04.064+0000 7fd4faffd640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd4fc076ba0 0x7fd4fc1048f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:04.787 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:04.064+0000 7fd4faffd640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd4fc076ba0 0x7fd4fc1048f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:37804/0 (socket says 172.21.15.121:37804) 2024-08-18T22:33:04.787 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:04.064+0000 7fd4faffd640 1 -- 172.21.15.121:0/290657979 learned_addr learned my addr 172.21.15.121:0/290657979 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-18T22:33:04.787 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:04.064+0000 7fd4faffd640 1 -- 172.21.15.121:0/290657979 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4fc104f70 con 0x7fd4fc076ba0 2024-08-18T22:33:04.787 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:04.065+0000 7fd4faffd640 1 --2- 172.21.15.121:0/290657979 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd4fc076ba0 0x7fd4fc1048f0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fd4ec009840 tx=0x7fd4ec0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc3dfe7e232a20f1 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:33:04.787 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:04.065+0000 7fd4f9ffb640 1 -- 172.21.15.121:0/290657979 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd4ec032440 con 0x7fd4fc076ba0 2024-08-18T22:33:04.787 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:04.065+0000 7fd4f9ffb640 1 -- 172.21.15.121:0/290657979 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7fd4ec032a00 con 0x7fd4fc076ba0 2024-08-18T22:33:04.787 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:04.065+0000 7fd4f9ffb640 1 -- 172.21.15.121:0/290657979 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd4ec0319e0 con 0x7fd4fc076ba0 2024-08-18T22:33:04.787 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:04.066+0000 7fd501689640 1 -- 172.21.15.121:0/290657979 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd4fc076ba0 msgr2=0x7fd4fc1048f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:04.787 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:04.066+0000 7fd501689640 1 --2- 172.21.15.121:0/290657979 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd4fc076ba0 0x7fd4fc1048f0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fd4ec009840 tx=0x7fd4ec0091d0 comp rx=0 tx=0).stop 2024-08-18T22:33:04.788 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:04.066+0000 7fd501689640 1 -- 172.21.15.121:0/290657979 shutdown_connections 2024-08-18T22:33:04.788 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:04.066+0000 7fd501689640 1 --2- 172.21.15.121:0/290657979 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd4fc076ba0 0x7fd4fc1048f0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:04.788 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:04.066+0000 7fd501689640 1 -- 172.21.15.121:0/290657979 >> 172.21.15.121:0/290657979 conn(0x7fd4fc0fc300 msgr2=0x7fd4fc0fe710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:33:04.788 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:04.066+0000 7fd501689640 1 -- 172.21.15.121:0/290657979 shutdown_connections 2024-08-18T22:33:04.788 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:04.066+0000 7fd501689640 1 -- 172.21.15.121:0/290657979 wait complete. 2024-08-18T22:33:04.788 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:04.067+0000 7fd501689640 1 Processor -- start 2024-08-18T22:33:04.788 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:04.067+0000 7fd501689640 1 -- start start 2024-08-18T22:33:04.788 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:04.067+0000 7fd501689640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd4fc076ba0 0x7fd4fc102220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:04.788 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:04.067+0000 7fd501689640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4fc102760 con 0x7fd4fc076ba0 2024-08-18T22:33:04.788 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:04.067+0000 7fd4faffd640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd4fc076ba0 0x7fd4fc102220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:04.788 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:04.067+0000 7fd4faffd640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd4fc076ba0 0x7fd4fc102220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:37816/0 (socket says 172.21.15.121:37816) 2024-08-18T22:33:04.788 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:04.067+0000 7fd4faffd640 1 -- 172.21.15.121:0/2346825095 learned_addr learned my addr 172.21.15.121:0/2346825095 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-18T22:33:04.788 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:04.067+0000 7fd4faffd640 1 -- 172.21.15.121:0/2346825095 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4ec009450 con 0x7fd4fc076ba0 2024-08-18T22:33:04.788 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:04.067+0000 7fd4faffd640 1 --2- 172.21.15.121:0/2346825095 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd4fc076ba0 0x7fd4fc102220 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fd4ec000c00 tx=0x7fd4ec008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:33:04.789 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:04.068+0000 7fd4e37fe640 1 -- 172.21.15.121:0/2346825095 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd4ec03d450 con 0x7fd4fc076ba0 2024-08-18T22:33:04.789 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:04.068+0000 7fd4e37fe640 1 -- 172.21.15.121:0/2346825095 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7fd4ec03da10 con 0x7fd4fc076ba0 2024-08-18T22:33:04.789 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:04.068+0000 7fd501689640 1 -- 172.21.15.121:0/2346825095 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4fc1007f0 con 0x7fd4fc076ba0 2024-08-18T22:33:04.789 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:04.068+0000 7fd4e37fe640 1 -- 172.21.15.121:0/2346825095 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd4ec03b8e0 con 0x7fd4fc076ba0 2024-08-18T22:33:04.789 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:04.068+0000 7fd501689640 1 -- 172.21.15.121:0/2346825095 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4fc100c60 con 0x7fd4fc076ba0 2024-08-18T22:33:04.789 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:04.068+0000 7fd4e37fe640 1 -- 172.21.15.121:0/2346825095 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 4) v1 ==== 42625+0+0 (secure 0 0 0) 0x7fd4ec039070 con 0x7fd4fc076ba0 2024-08-18T22:33:04.789 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:04.069+0000 7fd501689640 1 -- 172.21.15.121:0/2346825095 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4fc04b4c0 con 0x7fd4fc076ba0 2024-08-18T22:33:04.789 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:04.069+0000 7fd4e37fe640 1 --2- 172.21.15.121:0/2346825095 >> [v2:172.21.15.121:6800/2610373559,v1:172.21.15.121:6801/2610373559] conn(0x7fd4e4035670 0x7fd4e4037b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:04.789 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:04.069+0000 7fd4e37fe640 1 -- 172.21.15.121:0/2346825095 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7fd4ec068560 con 0x7fd4fc076ba0 2024-08-18T22:33:04.789 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:04.069+0000 7fd4fa7fc640 1 --2- 172.21.15.121:0/2346825095 >> [v2:172.21.15.121:6800/2610373559,v1:172.21.15.121:6801/2610373559] conn(0x7fd4e4035670 0x7fd4e4037b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:04.789 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:04.069+0000 7fd4fa7fc640 1 --2- 172.21.15.121:0/2346825095 >> [v2:172.21.15.121:6800/2610373559,v1:172.21.15.121:6801/2610373559] conn(0x7fd4e4035670 0x7fd4e4037b20 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fd4f0006fd0 tx=0x7fd4f0006db0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:33:04.789 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:04.077+0000 7fd4e37fe640 1 -- 172.21.15.121:0/2346825095 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fd4ec04e710 con 0x7fd4fc076ba0 2024-08-18T22:33:04.789 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:04.238+0000 7fd501689640 1 -- 172.21.15.121:0/2346825095 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) v1 -- 0x7fd4fc105d50 con 0x7fd4fc076ba0 2024-08-18T22:33:04.790 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:04.239+0000 7fd4e37fe640 1 -- 172.21.15.121:0/2346825095 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v3) v1 ==== 70+0+409 (secure 0 0 0) 0x7fd4ec041020 con 0x7fd4fc076ba0 2024-08-18T22:33:04.790 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:04.241+0000 7fd501689640 1 -- 172.21.15.121:0/2346825095 >> [v2:172.21.15.121:6800/2610373559,v1:172.21.15.121:6801/2610373559] conn(0x7fd4e4035670 msgr2=0x7fd4e4037b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:04.790 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:04.241+0000 7fd501689640 1 --2- 172.21.15.121:0/2346825095 >> [v2:172.21.15.121:6800/2610373559,v1:172.21.15.121:6801/2610373559] conn(0x7fd4e4035670 0x7fd4e4037b20 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fd4f0006fd0 tx=0x7fd4f0006db0 comp rx=0 tx=0).stop 2024-08-18T22:33:04.790 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:04.241+0000 7fd501689640 1 -- 172.21.15.121:0/2346825095 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd4fc076ba0 msgr2=0x7fd4fc102220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:04.790 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:04.241+0000 7fd501689640 1 --2- 172.21.15.121:0/2346825095 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd4fc076ba0 0x7fd4fc102220 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fd4ec000c00 tx=0x7fd4ec008040 comp rx=0 tx=0).stop 2024-08-18T22:33:04.790 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:04.242+0000 7fd501689640 1 -- 172.21.15.121:0/2346825095 shutdown_connections 2024-08-18T22:33:04.790 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:04.242+0000 7fd501689640 1 --2- 172.21.15.121:0/2346825095 >> [v2:172.21.15.121:6800/2610373559,v1:172.21.15.121:6801/2610373559] conn(0x7fd4e4035670 0x7fd4e4037b20 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:04.790 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:04.242+0000 7fd501689640 1 --2- 172.21.15.121:0/2346825095 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd4fc076ba0 0x7fd4fc102220 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:04.790 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:04.242+0000 7fd501689640 1 -- 172.21.15.121:0/2346825095 >> 172.21.15.121:0/2346825095 conn(0x7fd4fc0fc300 msgr2=0x7fd4fc0fced0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:33:04.790 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:04.242+0000 7fd501689640 1 -- 172.21.15.121:0/2346825095 shutdown_connections 2024-08-18T22:33:04.790 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:04.242+0000 7fd501689640 1 -- 172.21.15.121:0/2346825095 wait complete. 2024-08-18T22:33:04.790 INFO:teuthology.orchestra.run.smithi121.stdout:Enabling cephadm module... 2024-08-18T22:33:05.715 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:33:05 smithi121 ceph-mon[16788]: from='client.? 172.21.15.121:0/2567203608' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2024-08-18T22:33:06.032 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:05.195+0000 7f8d2573e640 1 Processor -- start 2024-08-18T22:33:06.032 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:05.195+0000 7f8d2573e640 1 -- start start 2024-08-18T22:33:06.032 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:05.195+0000 7f8d2573e640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8d201021d0 0x7f8d201025e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:06.032 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:05.195+0000 7f8d2573e640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d20102b20 con 0x7f8d201021d0 2024-08-18T22:33:06.032 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:05.195+0000 7f8d1effd640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8d201021d0 0x7f8d201025e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:06.033 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:05.195+0000 7f8d1effd640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8d201021d0 0x7f8d201025e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:37832/0 (socket says 172.21.15.121:37832) 2024-08-18T22:33:06.033 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:05.195+0000 7f8d1effd640 1 -- 172.21.15.121:0/3533355273 learned_addr learned my addr 172.21.15.121:0/3533355273 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-18T22:33:06.033 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:05.195+0000 7f8d1effd640 1 -- 172.21.15.121:0/3533355273 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d20102c60 con 0x7f8d201021d0 2024-08-18T22:33:06.033 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:05.196+0000 7f8d1effd640 1 --2- 172.21.15.121:0/3533355273 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8d201021d0 0x7f8d201025e0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f8d1000baf0 tx=0x7f8d1000b460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff27784673f8afbd server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:33:06.033 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:05.196+0000 7f8d1dffb640 1 -- 172.21.15.121:0/3533355273 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8d100327a0 con 0x7f8d201021d0 2024-08-18T22:33:06.033 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:05.196+0000 7f8d1dffb640 1 -- 172.21.15.121:0/3533355273 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7f8d10032d60 con 0x7f8d201021d0 2024-08-18T22:33:06.033 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:05.196+0000 7f8d1dffb640 1 -- 172.21.15.121:0/3533355273 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8d10031df0 con 0x7f8d201021d0 2024-08-18T22:33:06.033 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:05.197+0000 7f8d2573e640 1 -- 172.21.15.121:0/3533355273 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8d201021d0 msgr2=0x7f8d201025e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:06.033 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:05.197+0000 7f8d2573e640 1 --2- 172.21.15.121:0/3533355273 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8d201021d0 0x7f8d201025e0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f8d1000baf0 tx=0x7f8d1000b460 comp rx=0 tx=0).stop 2024-08-18T22:33:06.033 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:05.197+0000 7f8d2573e640 1 -- 172.21.15.121:0/3533355273 shutdown_connections 2024-08-18T22:33:06.033 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:05.197+0000 7f8d2573e640 1 --2- 172.21.15.121:0/3533355273 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8d201021d0 0x7f8d201025e0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:06.033 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:05.197+0000 7f8d2573e640 1 -- 172.21.15.121:0/3533355273 >> 172.21.15.121:0/3533355273 conn(0x7f8d200fbb60 msgr2=0x7f8d200fdf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:33:06.033 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:05.197+0000 7f8d2573e640 1 -- 172.21.15.121:0/3533355273 shutdown_connections 2024-08-18T22:33:06.034 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:05.197+0000 7f8d2573e640 1 -- 172.21.15.121:0/3533355273 wait complete. 2024-08-18T22:33:06.034 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:05.198+0000 7f8d2573e640 1 Processor -- start 2024-08-18T22:33:06.034 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:05.198+0000 7f8d2573e640 1 -- start start 2024-08-18T22:33:06.034 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:05.198+0000 7f8d2573e640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8d201021d0 0x7f8d2010e9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:06.034 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:05.198+0000 7f8d2573e640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d2010ef20 con 0x7f8d201021d0 2024-08-18T22:33:06.034 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:05.198+0000 7f8d1effd640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8d201021d0 0x7f8d2010e9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:06.034 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:05.198+0000 7f8d1effd640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8d201021d0 0x7f8d2010e9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:37840/0 (socket says 172.21.15.121:37840) 2024-08-18T22:33:06.034 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:05.198+0000 7f8d1effd640 1 -- 172.21.15.121:0/2567203608 learned_addr learned my addr 172.21.15.121:0/2567203608 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-18T22:33:06.034 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:05.198+0000 7f8d1effd640 1 -- 172.21.15.121:0/2567203608 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d1000b700 con 0x7f8d201021d0 2024-08-18T22:33:06.034 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:05.198+0000 7f8d1effd640 1 --2- 172.21.15.121:0/2567203608 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8d201021d0 0x7f8d2010e9e0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f8d10031e60 tx=0x7f8d1000b460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:33:06.034 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:05.199+0000 7f8d077fe640 1 -- 172.21.15.121:0/2567203608 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8d10032a30 con 0x7f8d201021d0 2024-08-18T22:33:06.034 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:05.199+0000 7f8d077fe640 1 -- 172.21.15.121:0/2567203608 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7f8d10032b90 con 0x7f8d201021d0 2024-08-18T22:33:06.034 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:05.199+0000 7f8d2573e640 1 -- 172.21.15.121:0/2567203608 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d2010f120 con 0x7f8d201021d0 2024-08-18T22:33:06.035 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:05.199+0000 7f8d077fe640 1 -- 172.21.15.121:0/2567203608 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8d10044830 con 0x7f8d201021d0 2024-08-18T22:33:06.035 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:05.199+0000 7f8d2573e640 1 -- 172.21.15.121:0/2567203608 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d2010f590 con 0x7f8d201021d0 2024-08-18T22:33:06.035 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:05.200+0000 7f8d077fe640 1 -- 172.21.15.121:0/2567203608 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 4) v1 ==== 42625+0+0 (secure 0 0 0) 0x7f8d1004e440 con 0x7f8d201021d0 2024-08-18T22:33:06.035 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:05.200+0000 7f8d077fe640 1 --2- 172.21.15.121:0/2567203608 >> [v2:172.21.15.121:6800/2610373559,v1:172.21.15.121:6801/2610373559] conn(0x7f8d080356c0 0x7f8d08037b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:06.035 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:05.200+0000 7f8d2573e640 1 -- 172.21.15.121:0/2567203608 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d2004b4c0 con 0x7f8d201021d0 2024-08-18T22:33:06.035 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:05.200+0000 7f8d077fe640 1 -- 172.21.15.121:0/2567203608 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f8d1006a6e0 con 0x7f8d201021d0 2024-08-18T22:33:06.035 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:05.200+0000 7f8d1e7fc640 1 --2- 172.21.15.121:0/2567203608 >> [v2:172.21.15.121:6800/2610373559,v1:172.21.15.121:6801/2610373559] conn(0x7f8d080356c0 0x7f8d08037b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:06.035 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:05.200+0000 7f8d1e7fc640 1 --2- 172.21.15.121:0/2567203608 >> [v2:172.21.15.121:6800/2610373559,v1:172.21.15.121:6801/2610373559] conn(0x7f8d080356c0 0x7f8d08037b70 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f8d14006fd0 tx=0x7f8d14006db0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:33:06.035 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:05.204+0000 7f8d077fe640 1 -- 172.21.15.121:0/2567203608 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f8d10036020 con 0x7f8d201021d0 2024-08-18T22:33:06.035 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:05.396+0000 7f8d2573e640 1 -- 172.21.15.121:0/2567203608 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "cephadm"} v 0) v1 -- 0x7f8d201008f0 con 0x7f8d201021d0 2024-08-18T22:33:06.035 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:05.449+0000 7f8d077fe640 1 -- 172.21.15.121:0/2567203608 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mgrmap(e 5) v1 ==== 42636+0+0 (secure 0 0 0) 0x7f8d10030db0 con 0x7f8d201021d0 2024-08-18T22:33:06.035 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:05.450+0000 7f8d077fe640 1 -- 172.21.15.121:0/2567203608 <== mon.0 v2:172.21.15.121:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "cephadm"}]=0 v5) v1 ==== 86+0+0 (secure 0 0 0) 0x7f8d1004dda0 con 0x7f8d201021d0 2024-08-18T22:33:06.035 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:05.452+0000 7f8d2573e640 1 -- 172.21.15.121:0/2567203608 >> [v2:172.21.15.121:6800/2610373559,v1:172.21.15.121:6801/2610373559] conn(0x7f8d080356c0 msgr2=0x7f8d08037b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:06.036 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:05.452+0000 7f8d2573e640 1 --2- 172.21.15.121:0/2567203608 >> [v2:172.21.15.121:6800/2610373559,v1:172.21.15.121:6801/2610373559] conn(0x7f8d080356c0 0x7f8d08037b70 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f8d14006fd0 tx=0x7f8d14006db0 comp rx=0 tx=0).stop 2024-08-18T22:33:06.036 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:05.452+0000 7f8d2573e640 1 -- 172.21.15.121:0/2567203608 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8d201021d0 msgr2=0x7f8d2010e9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:06.036 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:05.452+0000 7f8d2573e640 1 --2- 172.21.15.121:0/2567203608 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8d201021d0 0x7f8d2010e9e0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f8d10031e60 tx=0x7f8d1000b460 comp rx=0 tx=0).stop 2024-08-18T22:33:06.036 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:05.452+0000 7f8d2573e640 1 -- 172.21.15.121:0/2567203608 shutdown_connections 2024-08-18T22:33:06.036 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:05.452+0000 7f8d2573e640 1 --2- 172.21.15.121:0/2567203608 >> [v2:172.21.15.121:6800/2610373559,v1:172.21.15.121:6801/2610373559] conn(0x7f8d080356c0 0x7f8d08037b70 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:06.036 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:05.452+0000 7f8d2573e640 1 --2- 172.21.15.121:0/2567203608 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8d201021d0 0x7f8d2010e9e0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:06.036 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:05.452+0000 7f8d2573e640 1 -- 172.21.15.121:0/2567203608 >> 172.21.15.121:0/2567203608 conn(0x7f8d200fbb60 msgr2=0x7f8d20105240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:33:06.036 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:05.452+0000 7f8d2573e640 1 -- 172.21.15.121:0/2567203608 shutdown_connections 2024-08-18T22:33:06.036 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:05.452+0000 7f8d2573e640 1 -- 172.21.15.121:0/2567203608 wait complete. 2024-08-18T22:33:06.583 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:33:06 smithi121 ceph-mon[16788]: from='client.? 172.21.15.121:0/2567203608' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2024-08-18T22:33:06.583 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:33:06 smithi121 ceph-mon[16788]: mgrmap e5: smithi121.lopxqc(active, since 13s) 2024-08-18T22:33:07.256 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stdout { 2024-08-18T22:33:07.256 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stdout "epoch": 5, 2024-08-18T22:33:07.256 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stdout "available": true, 2024-08-18T22:33:07.257 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stdout "active_name": "smithi121.lopxqc", 2024-08-18T22:33:07.257 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-08-18T22:33:07.257 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stdout } 2024-08-18T22:33:07.257 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:06.434+0000 7f3f902a0640 1 Processor -- start 2024-08-18T22:33:07.257 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:06.434+0000 7f3f902a0640 1 -- start start 2024-08-18T22:33:07.257 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:06.434+0000 7f3f902a0640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3f88076bf0 0x7f3f881048d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:07.257 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:06.434+0000 7f3f902a0640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f88104e10 con 0x7f3f88076bf0 2024-08-18T22:33:07.257 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:06.434+0000 7f3f8e03c640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3f88076bf0 0x7f3f881048d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:07.257 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:06.434+0000 7f3f8e03c640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3f88076bf0 0x7f3f881048d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:37872/0 (socket says 172.21.15.121:37872) 2024-08-18T22:33:07.257 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:06.434+0000 7f3f8e03c640 1 -- 172.21.15.121:0/3803264844 learned_addr learned my addr 172.21.15.121:0/3803264844 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-18T22:33:07.257 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:06.435+0000 7f3f8e03c640 1 -- 172.21.15.121:0/3803264844 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f88104f50 con 0x7f3f88076bf0 2024-08-18T22:33:07.257 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:06.435+0000 7f3f8e03c640 1 --2- 172.21.15.121:0/3803264844 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3f88076bf0 0x7f3f881048d0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f3f84009840 tx=0x7f3f840091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb01bdfd72bd7762 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:33:07.257 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:06.436+0000 7f3f8d03a640 1 -- 172.21.15.121:0/3803264844 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3f84032440 con 0x7f3f88076bf0 2024-08-18T22:33:07.258 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:06.436+0000 7f3f8d03a640 1 -- 172.21.15.121:0/3803264844 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7f3f84032a00 con 0x7f3f88076bf0 2024-08-18T22:33:07.258 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:06.436+0000 7f3f8d03a640 1 -- 172.21.15.121:0/3803264844 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3f840319e0 con 0x7f3f88076bf0 2024-08-18T22:33:07.258 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:06.436+0000 7f3f902a0640 1 -- 172.21.15.121:0/3803264844 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3f88076bf0 msgr2=0x7f3f881048d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:07.258 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:06.436+0000 7f3f902a0640 1 --2- 172.21.15.121:0/3803264844 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3f88076bf0 0x7f3f881048d0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f3f84009840 tx=0x7f3f840091d0 comp rx=0 tx=0).stop 2024-08-18T22:33:07.258 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:06.436+0000 7f3f902a0640 1 -- 172.21.15.121:0/3803264844 shutdown_connections 2024-08-18T22:33:07.258 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:06.436+0000 7f3f902a0640 1 --2- 172.21.15.121:0/3803264844 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3f88076bf0 0x7f3f881048d0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:07.258 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:06.436+0000 7f3f902a0640 1 -- 172.21.15.121:0/3803264844 >> 172.21.15.121:0/3803264844 conn(0x7f3f880fc400 msgr2=0x7f3f880fe810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:33:07.258 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:06.436+0000 7f3f902a0640 1 -- 172.21.15.121:0/3803264844 shutdown_connections 2024-08-18T22:33:07.258 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:06.436+0000 7f3f902a0640 1 -- 172.21.15.121:0/3803264844 wait complete. 2024-08-18T22:33:07.258 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:06.437+0000 7f3f902a0640 1 Processor -- start 2024-08-18T22:33:07.258 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:06.437+0000 7f3f902a0640 1 -- start start 2024-08-18T22:33:07.258 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:06.437+0000 7f3f902a0640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3f88076bf0 0x7f3f88110ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:07.258 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:06.437+0000 7f3f902a0640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f88111020 con 0x7f3f88076bf0 2024-08-18T22:33:07.259 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:06.437+0000 7f3f8e03c640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3f88076bf0 0x7f3f88110ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:07.259 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:06.437+0000 7f3f8e03c640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3f88076bf0 0x7f3f88110ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:37886/0 (socket says 172.21.15.121:37886) 2024-08-18T22:33:07.259 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:06.437+0000 7f3f8e03c640 1 -- 172.21.15.121:0/2813269841 learned_addr learned my addr 172.21.15.121:0/2813269841 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-18T22:33:07.259 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:06.437+0000 7f3f8e03c640 1 -- 172.21.15.121:0/2813269841 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f84009450 con 0x7f3f88076bf0 2024-08-18T22:33:07.259 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:06.438+0000 7f3f8e03c640 1 --2- 172.21.15.121:0/2813269841 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3f88076bf0 0x7f3f88110ae0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f3f84006f00 tx=0x7f3f84008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:33:07.259 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:06.438+0000 7f3f7effd640 1 -- 172.21.15.121:0/2813269841 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3f84031e30 con 0x7f3f88076bf0 2024-08-18T22:33:07.259 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:06.438+0000 7f3f7effd640 1 -- 172.21.15.121:0/2813269841 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7f3f8403d8b0 con 0x7f3f88076bf0 2024-08-18T22:33:07.259 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:06.438+0000 7f3f902a0640 1 -- 172.21.15.121:0/2813269841 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f88111220 con 0x7f3f88076bf0 2024-08-18T22:33:07.259 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:06.438+0000 7f3f7effd640 1 -- 172.21.15.121:0/2813269841 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3f8403b8f0 con 0x7f3f88076bf0 2024-08-18T22:33:07.259 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:06.438+0000 7f3f902a0640 1 -- 172.21.15.121:0/2813269841 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f88111690 con 0x7f3f88076bf0 2024-08-18T22:33:07.259 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:06.439+0000 7f3f7effd640 1 -- 172.21.15.121:0/2813269841 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) v1 ==== 42636+0+0 (secure 0 0 0) 0x7f3f84039070 con 0x7f3f88076bf0 2024-08-18T22:33:07.260 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:06.439+0000 7f3f902a0640 1 -- 172.21.15.121:0/2813269841 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f8804b4c0 con 0x7f3f88076bf0 2024-08-18T22:33:07.260 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:06.439+0000 7f3f7effd640 1 --2- 172.21.15.121:0/2813269841 >> [v2:172.21.15.121:6800/2610373559,v1:172.21.15.121:6801/2610373559] conn(0x7f3f740356c0 0x7f3f74037b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:07.260 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:06.439+0000 7f3f7effd640 1 -- 172.21.15.121:0/2813269841 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f3f84068450 con 0x7f3f88076bf0 2024-08-18T22:33:07.260 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:06.439+0000 7f3f8d83b640 1 -- 172.21.15.121:0/2813269841 >> [v2:172.21.15.121:6800/2610373559,v1:172.21.15.121:6801/2610373559] conn(0x7f3f740356c0 msgr2=0x7f3f74037b70 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.121:6800/2610373559 2024-08-18T22:33:07.260 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:06.439+0000 7f3f8d83b640 1 --2- 172.21.15.121:0/2813269841 >> [v2:172.21.15.121:6800/2610373559,v1:172.21.15.121:6801/2610373559] conn(0x7f3f740356c0 0x7f3f74037b70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-18T22:33:07.260 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:06.443+0000 7f3f7effd640 1 -- 172.21.15.121:0/2813269841 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f3f8404e940 con 0x7f3f88076bf0 2024-08-18T22:33:07.260 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:06.640+0000 7f3f8d83b640 1 -- 172.21.15.121:0/2813269841 >> [v2:172.21.15.121:6800/2610373559,v1:172.21.15.121:6801/2610373559] conn(0x7f3f740356c0 msgr2=0x7f3f74037b70 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.121:6800/2610373559 2024-08-18T22:33:07.260 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:06.640+0000 7f3f8d83b640 1 --2- 172.21.15.121:0/2813269841 >> [v2:172.21.15.121:6800/2610373559,v1:172.21.15.121:6801/2610373559] conn(0x7f3f740356c0 0x7f3f74037b70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-18T22:33:07.260 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:06.646+0000 7f3f902a0640 1 -- 172.21.15.121:0/2813269841 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) v1 -- 0x7f3f88105ca0 con 0x7f3f88076bf0 2024-08-18T22:33:07.260 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:06.646+0000 7f3f7effd640 1 -- 172.21.15.121:0/2813269841 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v5) v1 ==== 56+0+103 (secure 0 0 0) 0x7f3f84041020 con 0x7f3f88076bf0 2024-08-18T22:33:07.260 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:06.648+0000 7f3f902a0640 1 -- 172.21.15.121:0/2813269841 >> [v2:172.21.15.121:6800/2610373559,v1:172.21.15.121:6801/2610373559] conn(0x7f3f740356c0 msgr2=0x7f3f74037b70 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-18T22:33:07.261 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:06.648+0000 7f3f902a0640 1 --2- 172.21.15.121:0/2813269841 >> [v2:172.21.15.121:6800/2610373559,v1:172.21.15.121:6801/2610373559] conn(0x7f3f740356c0 0x7f3f74037b70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:07.261 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:06.648+0000 7f3f902a0640 1 -- 172.21.15.121:0/2813269841 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3f88076bf0 msgr2=0x7f3f88110ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:07.261 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:06.648+0000 7f3f902a0640 1 --2- 172.21.15.121:0/2813269841 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3f88076bf0 0x7f3f88110ae0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f3f84006f00 tx=0x7f3f84008040 comp rx=0 tx=0).stop 2024-08-18T22:33:07.261 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:06.648+0000 7f3f902a0640 1 -- 172.21.15.121:0/2813269841 shutdown_connections 2024-08-18T22:33:07.261 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:06.648+0000 7f3f902a0640 1 --2- 172.21.15.121:0/2813269841 >> [v2:172.21.15.121:6800/2610373559,v1:172.21.15.121:6801/2610373559] conn(0x7f3f740356c0 0x7f3f74037b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:07.261 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:06.648+0000 7f3f902a0640 1 --2- 172.21.15.121:0/2813269841 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3f88076bf0 0x7f3f88110ae0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:07.261 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:06.648+0000 7f3f902a0640 1 -- 172.21.15.121:0/2813269841 >> 172.21.15.121:0/2813269841 conn(0x7f3f880fc400 msgr2=0x7f3f880fd060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:33:07.261 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:06.648+0000 7f3f902a0640 1 -- 172.21.15.121:0/2813269841 shutdown_connections 2024-08-18T22:33:07.261 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:06.648+0000 7f3f902a0640 1 -- 172.21.15.121:0/2813269841 wait complete. 2024-08-18T22:33:07.261 INFO:teuthology.orchestra.run.smithi121.stdout:Waiting for the mgr to restart... 2024-08-18T22:33:07.261 INFO:teuthology.orchestra.run.smithi121.stdout:Waiting for mgr epoch 5... 2024-08-18T22:33:07.459 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:33:07 smithi121 ceph-mon[16788]: from='client.? 172.21.15.121:0/2813269841' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-08-18T22:33:10.333 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:33:09 smithi121 ceph-mon[16788]: Active manager daemon smithi121.lopxqc restarted 2024-08-18T22:33:10.333 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:33:09 smithi121 ceph-mon[16788]: Activating manager daemon smithi121.lopxqc 2024-08-18T22:33:10.334 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:33:09 smithi121 ceph-mon[16788]: osdmap e2: 0 total, 0 up, 0 in 2024-08-18T22:33:10.334 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:33:09 smithi121 ceph-mon[16788]: mgrmap e6: smithi121.lopxqc(active, starting, since 0.00310433s) 2024-08-18T22:33:10.334 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:33:09 smithi121 ceph-mon[16788]: from='mgr.14118 172.21.15.121:0/3177338859' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "mon metadata", "id": "smithi121"}]: dispatch 2024-08-18T22:33:10.334 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:33:09 smithi121 ceph-mon[16788]: from='mgr.14118 172.21.15.121:0/3177338859' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "mgr metadata", "who": "smithi121.lopxqc", "id": "smithi121.lopxqc"}]: dispatch 2024-08-18T22:33:10.334 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:33:09 smithi121 ceph-mon[16788]: from='mgr.14118 172.21.15.121:0/3177338859' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-08-18T22:33:10.334 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:33:09 smithi121 ceph-mon[16788]: from='mgr.14118 172.21.15.121:0/3177338859' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-08-18T22:33:10.334 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:33:09 smithi121 ceph-mon[16788]: from='mgr.14118 172.21.15.121:0/3177338859' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-08-18T22:33:10.334 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:33:09 smithi121 ceph-mon[16788]: Manager daemon smithi121.lopxqc is now available 2024-08-18T22:33:10.334 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:33:09 smithi121 ceph-mon[16788]: from='mgr.14118 172.21.15.121:0/3177338859' entity='mgr.smithi121.lopxqc' 2024-08-18T22:33:10.334 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:33:09 smithi121 ceph-mon[16788]: from='mgr.14118 172.21.15.121:0/3177338859' entity='mgr.smithi121.lopxqc' 2024-08-18T22:33:10.334 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:33:09 smithi121 ceph-mon[16788]: from='mgr.14118 172.21.15.121:0/3177338859' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-18T22:33:10.334 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:33:09 smithi121 ceph-mon[16788]: from='mgr.14118 172.21.15.121:0/3177338859' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-18T22:33:10.335 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:33:09 smithi121 ceph-mon[16788]: from='mgr.14118 172.21.15.121:0/3177338859' entity='mgr.smithi121.lopxqc' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi121.lopxqc/mirror_snapshot_schedule"}]: dispatch 2024-08-18T22:33:10.335 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:33:09 smithi121 ceph-mon[16788]: from='mgr.14118 172.21.15.121:0/3177338859' entity='mgr.smithi121.lopxqc' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi121.lopxqc/trash_purge_schedule"}]: dispatch 2024-08-18T22:33:11.138 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:33:10 smithi121 ceph-mon[16788]: Found migration_current of "None". Setting to last migration. 2024-08-18T22:33:11.138 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:33:10 smithi121 ceph-mon[16788]: mgrmap e7: smithi121.lopxqc(active, since 1.00546s) 2024-08-18T22:33:11.405 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stdout { 2024-08-18T22:33:11.405 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2024-08-18T22:33:11.405 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stdout "initialized": true 2024-08-18T22:33:11.405 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stdout } 2024-08-18T22:33:11.405 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:07.656+0000 7f1bff851640 1 Processor -- start 2024-08-18T22:33:11.406 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:07.657+0000 7f1bff851640 1 -- start start 2024-08-18T22:33:11.406 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:07.657+0000 7f1bff851640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1bf8101cd0 0x7f1bf81020e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:11.406 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:07.657+0000 7f1bff851640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bf8102620 con 0x7f1bf8101cd0 2024-08-18T22:33:11.406 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:07.657+0000 7f1bfd5ed640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1bf8101cd0 0x7f1bf81020e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:11.406 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:07.657+0000 7f1bfd5ed640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1bf8101cd0 0x7f1bf81020e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:39378/0 (socket says 172.21.15.121:39378) 2024-08-18T22:33:11.406 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:07.657+0000 7f1bfd5ed640 1 -- 172.21.15.121:0/1905121417 learned_addr learned my addr 172.21.15.121:0/1905121417 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-18T22:33:11.406 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:07.658+0000 7f1bfd5ed640 1 -- 172.21.15.121:0/1905121417 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bf8102760 con 0x7f1bf8101cd0 2024-08-18T22:33:11.406 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:07.658+0000 7f1bfd5ed640 1 --2- 172.21.15.121:0/1905121417 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1bf8101cd0 0x7f1bf81020e0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f1bf4009840 tx=0x7f1bf40091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e52138343b609832 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:33:11.406 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:07.658+0000 7f1beffff640 1 -- 172.21.15.121:0/1905121417 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1bf4032440 con 0x7f1bf8101cd0 2024-08-18T22:33:11.406 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:07.659+0000 7f1beffff640 1 -- 172.21.15.121:0/1905121417 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7f1bf4032a00 con 0x7f1bf8101cd0 2024-08-18T22:33:11.406 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:07.659+0000 7f1beffff640 1 -- 172.21.15.121:0/1905121417 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1bf40319e0 con 0x7f1bf8101cd0 2024-08-18T22:33:11.406 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:07.659+0000 7f1bff851640 1 -- 172.21.15.121:0/1905121417 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1bf8101cd0 msgr2=0x7f1bf81020e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:11.407 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:07.659+0000 7f1bff851640 1 --2- 172.21.15.121:0/1905121417 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1bf8101cd0 0x7f1bf81020e0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f1bf4009840 tx=0x7f1bf40091d0 comp rx=0 tx=0).stop 2024-08-18T22:33:11.407 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:07.659+0000 7f1bff851640 1 -- 172.21.15.121:0/1905121417 shutdown_connections 2024-08-18T22:33:11.407 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:07.659+0000 7f1bff851640 1 --2- 172.21.15.121:0/1905121417 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1bf8101cd0 0x7f1bf81020e0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:11.407 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:07.659+0000 7f1bff851640 1 -- 172.21.15.121:0/1905121417 >> 172.21.15.121:0/1905121417 conn(0x7f1bf80fd510 msgr2=0x7f1bf80ff920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:33:11.407 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:07.659+0000 7f1bff851640 1 -- 172.21.15.121:0/1905121417 shutdown_connections 2024-08-18T22:33:11.407 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:07.659+0000 7f1bff851640 1 -- 172.21.15.121:0/1905121417 wait complete. 2024-08-18T22:33:11.407 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:07.660+0000 7f1bff851640 1 Processor -- start 2024-08-18T22:33:11.407 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:07.660+0000 7f1bff851640 1 -- start start 2024-08-18T22:33:11.407 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:07.660+0000 7f1bff851640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1bf8101cd0 0x7f1bf8110b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:11.407 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:07.660+0000 7f1bff851640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bf8111050 con 0x7f1bf8101cd0 2024-08-18T22:33:11.407 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:07.660+0000 7f1bfd5ed640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1bf8101cd0 0x7f1bf8110b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:11.407 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:07.660+0000 7f1bfd5ed640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1bf8101cd0 0x7f1bf8110b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:39394/0 (socket says 172.21.15.121:39394) 2024-08-18T22:33:11.407 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:07.660+0000 7f1bfd5ed640 1 -- 172.21.15.121:0/1147762897 learned_addr learned my addr 172.21.15.121:0/1147762897 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-18T22:33:11.407 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:07.660+0000 7f1bfd5ed640 1 -- 172.21.15.121:0/1147762897 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bf4009450 con 0x7f1bf8101cd0 2024-08-18T22:33:11.408 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:07.661+0000 7f1bfd5ed640 1 --2- 172.21.15.121:0/1147762897 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1bf8101cd0 0x7f1bf8110b10 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f1bf4000c00 tx=0x7f1bf4008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:33:11.408 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:07.661+0000 7f1bedffb640 1 -- 172.21.15.121:0/1147762897 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1bf403d450 con 0x7f1bf8101cd0 2024-08-18T22:33:11.408 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:07.661+0000 7f1bff851640 1 -- 172.21.15.121:0/1147762897 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1bf8111250 con 0x7f1bf8101cd0 2024-08-18T22:33:11.408 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:07.661+0000 7f1bedffb640 1 -- 172.21.15.121:0/1147762897 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7f1bf403da10 con 0x7f1bf8101cd0 2024-08-18T22:33:11.408 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:07.661+0000 7f1bedffb640 1 -- 172.21.15.121:0/1147762897 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1bf403b880 con 0x7f1bf8101cd0 2024-08-18T22:33:11.408 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:07.661+0000 7f1bff851640 1 -- 172.21.15.121:0/1147762897 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1bf81116c0 con 0x7f1bf8101cd0 2024-08-18T22:33:11.408 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:07.662+0000 7f1bedffb640 1 -- 172.21.15.121:0/1147762897 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) v1 ==== 42636+0+0 (secure 0 0 0) 0x7f1bf4039070 con 0x7f1bf8101cd0 2024-08-18T22:33:11.408 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:07.662+0000 7f1bedffb640 1 --2- 172.21.15.121:0/1147762897 >> [v2:172.21.15.121:6800/2610373559,v1:172.21.15.121:6801/2610373559] conn(0x7f1be40356c0 0x7f1be4037b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:11.408 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:07.662+0000 7f1bff851640 1 -- 172.21.15.121:0/1147762897 --> [v2:172.21.15.121:6800/2610373559,v1:172.21.15.121:6801/2610373559] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f1bf805eb10 con 0x7f1be40356c0 2024-08-18T22:33:11.408 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:07.662+0000 7f1bedffb640 1 -- 172.21.15.121:0/1147762897 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f1bf40691e0 con 0x7f1bf8101cd0 2024-08-18T22:33:11.408 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:07.662+0000 7f1bfcdec640 1 -- 172.21.15.121:0/1147762897 >> [v2:172.21.15.121:6800/2610373559,v1:172.21.15.121:6801/2610373559] conn(0x7f1be40356c0 msgr2=0x7f1be4037b70 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.121:6800/2610373559 2024-08-18T22:33:11.408 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:07.662+0000 7f1bfcdec640 1 --2- 172.21.15.121:0/1147762897 >> [v2:172.21.15.121:6800/2610373559,v1:172.21.15.121:6801/2610373559] conn(0x7f1be40356c0 0x7f1be4037b70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-18T22:33:11.409 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:07.863+0000 7f1bfcdec640 1 -- 172.21.15.121:0/1147762897 >> [v2:172.21.15.121:6800/2610373559,v1:172.21.15.121:6801/2610373559] conn(0x7f1be40356c0 msgr2=0x7f1be4037b70 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.121:6800/2610373559 2024-08-18T22:33:11.409 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:07.863+0000 7f1bfcdec640 1 --2- 172.21.15.121:0/1147762897 >> [v2:172.21.15.121:6800/2610373559,v1:172.21.15.121:6801/2610373559] conn(0x7f1be40356c0 0x7f1be4037b70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-18T22:33:11.409 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:08.264+0000 7f1bfcdec640 1 -- 172.21.15.121:0/1147762897 >> [v2:172.21.15.121:6800/2610373559,v1:172.21.15.121:6801/2610373559] conn(0x7f1be40356c0 msgr2=0x7f1be4037b70 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.121:6800/2610373559 2024-08-18T22:33:11.409 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:08.264+0000 7f1bfcdec640 1 --2- 172.21.15.121:0/1147762897 >> [v2:172.21.15.121:6800/2610373559,v1:172.21.15.121:6801/2610373559] conn(0x7f1be40356c0 0x7f1be4037b70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-08-18T22:33:11.409 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:09.065+0000 7f1bfcdec640 1 -- 172.21.15.121:0/1147762897 >> [v2:172.21.15.121:6800/2610373559,v1:172.21.15.121:6801/2610373559] conn(0x7f1be40356c0 msgr2=0x7f1be4037b70 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.121:6800/2610373559 2024-08-18T22:33:11.409 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:09.065+0000 7f1bfcdec640 1 --2- 172.21.15.121:0/1147762897 >> [v2:172.21.15.121:6800/2610373559,v1:172.21.15.121:6801/2610373559] conn(0x7f1be40356c0 0x7f1be4037b70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-08-18T22:33:11.409 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:09.835+0000 7f1bedffb640 1 -- 172.21.15.121:0/1147762897 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mgrmap(e 6) v1 ==== 42403+0+0 (secure 0 0 0) 0x7f1bf40686e0 con 0x7f1bf8101cd0 2024-08-18T22:33:11.409 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:09.836+0000 7f1bedffb640 1 -- 172.21.15.121:0/1147762897 >> [v2:172.21.15.121:6800/2610373559,v1:172.21.15.121:6801/2610373559] conn(0x7f1be40356c0 msgr2=0x7f1be4037b70 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-18T22:33:11.409 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:09.836+0000 7f1bedffb640 1 --2- 172.21.15.121:0/1147762897 >> [v2:172.21.15.121:6800/2610373559,v1:172.21.15.121:6801/2610373559] conn(0x7f1be40356c0 0x7f1be4037b70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:11.409 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:10.837+0000 7f1bedffb640 1 -- 172.21.15.121:0/1147762897 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mgrmap(e 7) v1 ==== 42530+0+0 (secure 0 0 0) 0x7f1bf4046400 con 0x7f1bf8101cd0 2024-08-18T22:33:11.409 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:10.837+0000 7f1bedffb640 1 --2- 172.21.15.121:0/1147762897 >> [v2:172.21.15.121:6800/833901271,v1:172.21.15.121:6801/833901271] conn(0x7f1be4038e80 0x7f1be403b260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:11.409 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:10.837+0000 7f1bedffb640 1 -- 172.21.15.121:0/1147762897 --> [v2:172.21.15.121:6800/833901271,v1:172.21.15.121:6801/833901271] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f1bf805eb10 con 0x7f1be4038e80 2024-08-18T22:33:11.409 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:10.837+0000 7f1bfcdec640 1 --2- 172.21.15.121:0/1147762897 >> [v2:172.21.15.121:6800/833901271,v1:172.21.15.121:6801/833901271] conn(0x7f1be4038e80 0x7f1be403b260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:11.410 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:10.838+0000 7f1bfcdec640 1 --2- 172.21.15.121:0/1147762897 >> [v2:172.21.15.121:6800/833901271,v1:172.21.15.121:6801/833901271] conn(0x7f1be4038e80 0x7f1be403b260 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f1be8003940 tx=0x7f1be8009350 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:33:11.410 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:10.838+0000 7f1bedffb640 1 -- 172.21.15.121:0/1147762897 <== mgr.14118 v2:172.21.15.121:6800/833901271 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+6549 (secure 0 0 0) 0x7f1bf805eb10 con 0x7f1be4038e80 2024-08-18T22:33:11.410 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:10.843+0000 7f1bff851640 1 -- 172.21.15.121:0/1147762897 --> [v2:172.21.15.121:6800/833901271,v1:172.21.15.121:6801/833901271] -- command(tid 1: {"prefix": "mgr_status"}) v1 -- 0x7f1bf804b4c0 con 0x7f1be4038e80 2024-08-18T22:33:11.410 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:10.844+0000 7f1bedffb640 1 -- 172.21.15.121:0/1147762897 <== mgr.14118 v2:172.21.15.121:6800/833901271 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7f1bf804b4c0 con 0x7f1be4038e80 2024-08-18T22:33:11.410 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:10.844+0000 7f1bff851640 1 -- 172.21.15.121:0/1147762897 >> [v2:172.21.15.121:6800/833901271,v1:172.21.15.121:6801/833901271] conn(0x7f1be4038e80 msgr2=0x7f1be403b260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:11.410 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:10.844+0000 7f1bff851640 1 --2- 172.21.15.121:0/1147762897 >> [v2:172.21.15.121:6800/833901271,v1:172.21.15.121:6801/833901271] conn(0x7f1be4038e80 0x7f1be403b260 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f1be8003940 tx=0x7f1be8009350 comp rx=0 tx=0).stop 2024-08-18T22:33:11.410 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:10.844+0000 7f1bff851640 1 -- 172.21.15.121:0/1147762897 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1bf8101cd0 msgr2=0x7f1bf8110b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:11.410 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:10.844+0000 7f1bff851640 1 --2- 172.21.15.121:0/1147762897 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1bf8101cd0 0x7f1bf8110b10 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f1bf4000c00 tx=0x7f1bf4008040 comp rx=0 tx=0).stop 2024-08-18T22:33:11.410 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:10.844+0000 7f1bff851640 1 -- 172.21.15.121:0/1147762897 shutdown_connections 2024-08-18T22:33:11.410 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:10.844+0000 7f1bff851640 1 --2- 172.21.15.121:0/1147762897 >> [v2:172.21.15.121:6800/833901271,v1:172.21.15.121:6801/833901271] conn(0x7f1be4038e80 0x7f1be403b260 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:11.410 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:10.844+0000 7f1bff851640 1 --2- 172.21.15.121:0/1147762897 >> [v2:172.21.15.121:6800/2610373559,v1:172.21.15.121:6801/2610373559] conn(0x7f1be40356c0 0x7f1be4037b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:11.410 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:10.844+0000 7f1bff851640 1 --2- 172.21.15.121:0/1147762897 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1bf8101cd0 0x7f1bf8110b10 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:11.410 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:10.844+0000 7f1bff851640 1 -- 172.21.15.121:0/1147762897 >> 172.21.15.121:0/1147762897 conn(0x7f1bf80fd510 msgr2=0x7f1bf80fe1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:33:11.411 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:10.844+0000 7f1bff851640 1 -- 172.21.15.121:0/1147762897 shutdown_connections 2024-08-18T22:33:11.411 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:10.844+0000 7f1bff851640 1 -- 172.21.15.121:0/1147762897 wait complete. 2024-08-18T22:33:11.411 INFO:teuthology.orchestra.run.smithi121.stdout:mgr epoch 5 is available 2024-08-18T22:33:11.411 INFO:teuthology.orchestra.run.smithi121.stdout:Setting orchestrator backend to cephadm... 2024-08-18T22:33:11.945 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:33:11 smithi121 ceph-mon[16788]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-08-18T22:33:11.945 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:33:11 smithi121 ceph-mon[16788]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-08-18T22:33:12.492 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:11.762+0000 7fcbedbc0640 1 Processor -- start 2024-08-18T22:33:12.492 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:11.763+0000 7fcbedbc0640 1 -- start start 2024-08-18T22:33:12.492 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:11.763+0000 7fcbedbc0640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcbe8100bb0 0x7fcbe8100fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:12.492 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:11.763+0000 7fcbedbc0640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbe8101500 con 0x7fcbe8100bb0 2024-08-18T22:33:12.492 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:11.763+0000 7fcbe77fe640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcbe8100bb0 0x7fcbe8100fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:12.493 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:11.763+0000 7fcbe77fe640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcbe8100bb0 0x7fcbe8100fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:39486/0 (socket says 172.21.15.121:39486) 2024-08-18T22:33:12.493 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:11.763+0000 7fcbe77fe640 1 -- 172.21.15.121:0/2220342222 learned_addr learned my addr 172.21.15.121:0/2220342222 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-18T22:33:12.493 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:11.763+0000 7fcbe77fe640 1 -- 172.21.15.121:0/2220342222 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbe8101640 con 0x7fcbe8100bb0 2024-08-18T22:33:12.493 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:11.764+0000 7fcbe77fe640 1 --2- 172.21.15.121:0/2220342222 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcbe8100bb0 0x7fcbe8100fc0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fcbd800baf0 tx=0x7fcbd800b460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e3450ccc07a0bf5 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:33:12.493 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:11.764+0000 7fcbe67fc640 1 -- 172.21.15.121:0/2220342222 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fcbd80327a0 con 0x7fcbe8100bb0 2024-08-18T22:33:12.493 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:11.764+0000 7fcbe67fc640 1 -- 172.21.15.121:0/2220342222 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7fcbd8032d60 con 0x7fcbe8100bb0 2024-08-18T22:33:12.493 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:11.764+0000 7fcbe67fc640 1 -- 172.21.15.121:0/2220342222 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fcbd8031df0 con 0x7fcbe8100bb0 2024-08-18T22:33:12.493 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:11.765+0000 7fcbedbc0640 1 -- 172.21.15.121:0/2220342222 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcbe8100bb0 msgr2=0x7fcbe8100fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:12.493 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:11.765+0000 7fcbedbc0640 1 --2- 172.21.15.121:0/2220342222 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcbe8100bb0 0x7fcbe8100fc0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fcbd800baf0 tx=0x7fcbd800b460 comp rx=0 tx=0).stop 2024-08-18T22:33:12.493 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:11.765+0000 7fcbedbc0640 1 -- 172.21.15.121:0/2220342222 shutdown_connections 2024-08-18T22:33:12.493 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:11.765+0000 7fcbedbc0640 1 --2- 172.21.15.121:0/2220342222 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcbe8100bb0 0x7fcbe8100fc0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:12.493 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:11.765+0000 7fcbedbc0640 1 -- 172.21.15.121:0/2220342222 >> 172.21.15.121:0/2220342222 conn(0x7fcbe80fc350 msgr2=0x7fcbe80fe7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:33:12.493 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:11.765+0000 7fcbedbc0640 1 -- 172.21.15.121:0/2220342222 shutdown_connections 2024-08-18T22:33:12.494 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:11.765+0000 7fcbedbc0640 1 -- 172.21.15.121:0/2220342222 wait complete. 2024-08-18T22:33:12.494 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:11.766+0000 7fcbedbc0640 1 Processor -- start 2024-08-18T22:33:12.494 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:11.766+0000 7fcbedbc0640 1 -- start start 2024-08-18T22:33:12.494 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:11.766+0000 7fcbedbc0640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcbe8100bb0 0x7fcbe810e960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:12.494 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:11.766+0000 7fcbedbc0640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbe810eea0 con 0x7fcbe8100bb0 2024-08-18T22:33:12.494 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:11.766+0000 7fcbe77fe640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcbe8100bb0 0x7fcbe810e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:12.494 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:11.766+0000 7fcbe77fe640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcbe8100bb0 0x7fcbe810e960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:39494/0 (socket says 172.21.15.121:39494) 2024-08-18T22:33:12.494 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:11.766+0000 7fcbe77fe640 1 -- 172.21.15.121:0/3277780205 learned_addr learned my addr 172.21.15.121:0/3277780205 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-18T22:33:12.494 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:11.766+0000 7fcbe77fe640 1 -- 172.21.15.121:0/3277780205 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbd800b700 con 0x7fcbe8100bb0 2024-08-18T22:33:12.494 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:11.766+0000 7fcbe77fe640 1 --2- 172.21.15.121:0/3277780205 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcbe8100bb0 0x7fcbe810e960 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fcbd802ce70 tx=0x7fcbd800b460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:33:12.494 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:11.767+0000 7fcbcffff640 1 -- 172.21.15.121:0/3277780205 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fcbd8032ab0 con 0x7fcbe8100bb0 2024-08-18T22:33:12.494 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:11.767+0000 7fcbcffff640 1 -- 172.21.15.121:0/3277780205 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7fcbd803b880 con 0x7fcbe8100bb0 2024-08-18T22:33:12.495 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:11.767+0000 7fcbedbc0640 1 -- 172.21.15.121:0/3277780205 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcbe810f0a0 con 0x7fcbe8100bb0 2024-08-18T22:33:12.495 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:11.767+0000 7fcbcffff640 1 -- 172.21.15.121:0/3277780205 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fcbd803a730 con 0x7fcbe8100bb0 2024-08-18T22:33:12.495 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:11.767+0000 7fcbedbc0640 1 -- 172.21.15.121:0/3277780205 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcbe810f4b0 con 0x7fcbe8100bb0 2024-08-18T22:33:12.495 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:11.768+0000 7fcbcffff640 1 -- 172.21.15.121:0/3277780205 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 7) v1 ==== 42530+0+0 (secure 0 0 0) 0x7fcbd803a890 con 0x7fcbe8100bb0 2024-08-18T22:33:12.495 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:11.768+0000 7fcbcffff640 1 --2- 172.21.15.121:0/3277780205 >> [v2:172.21.15.121:6800/833901271,v1:172.21.15.121:6801/833901271] conn(0x7fcbd00355e0 0x7fcbd0037a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:12.495 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:11.768+0000 7fcbedbc0640 1 -- 172.21.15.121:0/3277780205 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcbe804b4c0 con 0x7fcbe8100bb0 2024-08-18T22:33:12.495 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:11.768+0000 7fcbcffff640 1 -- 172.21.15.121:0/3277780205 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7fcbd806ab40 con 0x7fcbe8100bb0 2024-08-18T22:33:12.495 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:11.768+0000 7fcbe6ffd640 1 --2- 172.21.15.121:0/3277780205 >> [v2:172.21.15.121:6800/833901271,v1:172.21.15.121:6801/833901271] conn(0x7fcbd00355e0 0x7fcbd0037a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:12.495 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:11.768+0000 7fcbe6ffd640 1 --2- 172.21.15.121:0/3277780205 >> [v2:172.21.15.121:6800/833901271,v1:172.21.15.121:6801/833901271] conn(0x7fcbd00355e0 0x7fcbd0037a90 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fcbdc006fd0 tx=0x7fcbdc006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:33:12.495 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:11.773+0000 7fcbcffff640 1 -- 172.21.15.121:0/3277780205 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fcbd8036070 con 0x7fcbe8100bb0 2024-08-18T22:33:12.495 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:11.889+0000 7fcbcffff640 1 -- 172.21.15.121:0/3277780205 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mgrmap(e 8) v1 ==== 42636+0+0 (secure 0 0 0) 0x7fcbd803ba60 con 0x7fcbe8100bb0 2024-08-18T22:33:12.495 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:11.944+0000 7fcbedbc0640 1 -- 172.21.15.121:0/3277780205 --> [v2:172.21.15.121:6800/833901271,v1:172.21.15.121:6801/833901271] -- mgr_command(tid 0: {"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}) v1 -- 0x7fcbe8110090 con 0x7fcbd00355e0 2024-08-18T22:33:12.495 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:11.953+0000 7fcbcffff640 1 -- 172.21.15.121:0/3277780205 <== mgr.14118 v2:172.21.15.121:6800/833901271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7fcbe8110090 con 0x7fcbd00355e0 2024-08-18T22:33:12.496 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:11.955+0000 7fcbedbc0640 1 -- 172.21.15.121:0/3277780205 >> [v2:172.21.15.121:6800/833901271,v1:172.21.15.121:6801/833901271] conn(0x7fcbd00355e0 msgr2=0x7fcbd0037a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:12.496 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:11.955+0000 7fcbedbc0640 1 --2- 172.21.15.121:0/3277780205 >> [v2:172.21.15.121:6800/833901271,v1:172.21.15.121:6801/833901271] conn(0x7fcbd00355e0 0x7fcbd0037a90 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fcbdc006fd0 tx=0x7fcbdc006db0 comp rx=0 tx=0).stop 2024-08-18T22:33:12.496 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:11.955+0000 7fcbedbc0640 1 -- 172.21.15.121:0/3277780205 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcbe8100bb0 msgr2=0x7fcbe810e960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:12.496 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:11.955+0000 7fcbedbc0640 1 --2- 172.21.15.121:0/3277780205 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcbe8100bb0 0x7fcbe810e960 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fcbd802ce70 tx=0x7fcbd800b460 comp rx=0 tx=0).stop 2024-08-18T22:33:12.496 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:11.955+0000 7fcbedbc0640 1 -- 172.21.15.121:0/3277780205 shutdown_connections 2024-08-18T22:33:12.496 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:11.955+0000 7fcbedbc0640 1 --2- 172.21.15.121:0/3277780205 >> [v2:172.21.15.121:6800/833901271,v1:172.21.15.121:6801/833901271] conn(0x7fcbd00355e0 0x7fcbd0037a90 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:12.496 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:11.955+0000 7fcbedbc0640 1 --2- 172.21.15.121:0/3277780205 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcbe8100bb0 0x7fcbe810e960 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:12.496 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:11.955+0000 7fcbedbc0640 1 -- 172.21.15.121:0/3277780205 >> 172.21.15.121:0/3277780205 conn(0x7fcbe80fc350 msgr2=0x7fcbe81051c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:33:12.496 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:11.955+0000 7fcbedbc0640 1 -- 172.21.15.121:0/3277780205 shutdown_connections 2024-08-18T22:33:12.496 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:11.955+0000 7fcbedbc0640 1 -- 172.21.15.121:0/3277780205 wait complete. 2024-08-18T22:33:13.308 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:33:12 smithi121 ceph-mon[16788]: mgrmap e8: smithi121.lopxqc(active, since 2s) 2024-08-18T22:33:13.308 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:33:12 smithi121 ceph-mon[16788]: from='client.14130 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2024-08-18T22:33:13.308 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:33:12 smithi121 ceph-mon[16788]: from='mgr.14118 172.21.15.121:0/3177338859' entity='mgr.smithi121.lopxqc' 2024-08-18T22:33:13.308 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:33:12 smithi121 ceph-mon[16788]: from='mgr.14118 172.21.15.121:0/3177338859' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-18T22:33:13.308 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:33:12 smithi121 ceph-mon[16788]: [18/Aug/2024:22:33:11] ENGINE Bus STARTING 2024-08-18T22:33:13.308 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:33:12 smithi121 ceph-mon[16788]: [18/Aug/2024:22:33:12] ENGINE Serving on https://172.21.15.121:7150 2024-08-18T22:33:13.308 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:33:12 smithi121 ceph-mon[16788]: [18/Aug/2024:22:33:12] ENGINE Bus STARTED 2024-08-18T22:33:13.309 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:33:12 smithi121 ceph-mon[16788]: [18/Aug/2024:22:33:12] ENGINE Error in HTTPServer.serve 2024-08-18T22:33:13.309 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout: Traceback (most recent call last): 2024-08-18T22:33:13.309 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-08-18T22:33:13.309 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout: self._connections.run(self.expiration_interval) 2024-08-18T22:33:13.309 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-08-18T22:33:13.309 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout: self._run(expiration_interval) 2024-08-18T22:33:13.309 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-08-18T22:33:13.309 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-08-18T22:33:13.309 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-08-18T22:33:13.309 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-08-18T22:33:13.309 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-08-18T22:33:13.309 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout: s = self.context.wrap_socket( 2024-08-18T22:33:13.309 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-08-18T22:33:13.310 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout: return self.sslsocket_class._create( 2024-08-18T22:33:13.310 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-08-18T22:33:13.310 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout: self.do_handshake() 2024-08-18T22:33:13.310 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-08-18T22:33:13.310 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout: self._sslobj.do_handshake() 2024-08-18T22:33:13.310 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-08-18T22:33:13.310 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:33:12 smithi121 ceph-mon[16788]: from='mgr.14118 172.21.15.121:0/3177338859' entity='mgr.smithi121.lopxqc' 2024-08-18T22:33:13.310 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:33:12 smithi121 ceph-mon[16788]: from='mgr.14118 172.21.15.121:0/3177338859' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-18T22:33:13.573 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stdout value unchanged 2024-08-18T22:33:13.574 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:12.843+0000 7efe947f7640 1 Processor -- start 2024-08-18T22:33:13.574 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:12.843+0000 7efe947f7640 1 -- start start 2024-08-18T22:33:13.574 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:12.843+0000 7efe947f7640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efe8c100c50 0x7efe8c101060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:13.574 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:12.843+0000 7efe947f7640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe8c1015a0 con 0x7efe8c100c50 2024-08-18T22:33:13.574 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:12.843+0000 7efe92593640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efe8c100c50 0x7efe8c101060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:13.574 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:12.843+0000 7efe92593640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efe8c100c50 0x7efe8c101060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:39510/0 (socket says 172.21.15.121:39510) 2024-08-18T22:33:13.574 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:12.843+0000 7efe92593640 1 -- 172.21.15.121:0/3280665072 learned_addr learned my addr 172.21.15.121:0/3280665072 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-18T22:33:13.574 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:12.843+0000 7efe92593640 1 -- 172.21.15.121:0/3280665072 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe8c1016e0 con 0x7efe8c100c50 2024-08-18T22:33:13.574 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:12.844+0000 7efe92593640 1 --2- 172.21.15.121:0/3280665072 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efe8c100c50 0x7efe8c101060 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7efe80009840 tx=0x7efe800091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e74e1119cf5a619 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:33:13.574 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:12.844+0000 7efe91591640 1 -- 172.21.15.121:0/3280665072 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7efe80032440 con 0x7efe8c100c50 2024-08-18T22:33:13.575 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:12.844+0000 7efe91591640 1 -- 172.21.15.121:0/3280665072 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7efe80032a00 con 0x7efe8c100c50 2024-08-18T22:33:13.575 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:12.844+0000 7efe91591640 1 -- 172.21.15.121:0/3280665072 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7efe800319e0 con 0x7efe8c100c50 2024-08-18T22:33:13.575 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:12.845+0000 7efe947f7640 1 -- 172.21.15.121:0/3280665072 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efe8c100c50 msgr2=0x7efe8c101060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:13.575 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:12.845+0000 7efe947f7640 1 --2- 172.21.15.121:0/3280665072 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efe8c100c50 0x7efe8c101060 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7efe80009840 tx=0x7efe800091d0 comp rx=0 tx=0).stop 2024-08-18T22:33:13.575 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:12.845+0000 7efe947f7640 1 -- 172.21.15.121:0/3280665072 shutdown_connections 2024-08-18T22:33:13.575 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:12.845+0000 7efe947f7640 1 --2- 172.21.15.121:0/3280665072 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efe8c100c50 0x7efe8c101060 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:13.575 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:12.845+0000 7efe947f7640 1 -- 172.21.15.121:0/3280665072 >> 172.21.15.121:0/3280665072 conn(0x7efe8c0fc490 msgr2=0x7efe8c0fe8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:33:13.575 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:12.845+0000 7efe947f7640 1 -- 172.21.15.121:0/3280665072 shutdown_connections 2024-08-18T22:33:13.575 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:12.845+0000 7efe947f7640 1 -- 172.21.15.121:0/3280665072 wait complete. 2024-08-18T22:33:13.575 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:12.845+0000 7efe947f7640 1 Processor -- start 2024-08-18T22:33:13.575 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:12.846+0000 7efe947f7640 1 -- start start 2024-08-18T22:33:13.575 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:12.846+0000 7efe947f7640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efe8c100c50 0x7efe8c076a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:13.576 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:12.846+0000 7efe947f7640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe8c113830 con 0x7efe8c100c50 2024-08-18T22:33:13.576 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:12.846+0000 7efe92593640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efe8c100c50 0x7efe8c076a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:13.576 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:12.846+0000 7efe92593640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efe8c100c50 0x7efe8c076a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:39522/0 (socket says 172.21.15.121:39522) 2024-08-18T22:33:13.576 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:12.846+0000 7efe92593640 1 -- 172.21.15.121:0/448652179 learned_addr learned my addr 172.21.15.121:0/448652179 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-18T22:33:13.576 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:12.846+0000 7efe92593640 1 -- 172.21.15.121:0/448652179 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe80009450 con 0x7efe8c100c50 2024-08-18T22:33:13.576 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:12.846+0000 7efe92593640 1 --2- 172.21.15.121:0/448652179 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efe8c100c50 0x7efe8c076a90 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7efe80000c00 tx=0x7efe80008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:33:13.576 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:12.846+0000 7efe7effd640 1 -- 172.21.15.121:0/448652179 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7efe8003d450 con 0x7efe8c100c50 2024-08-18T22:33:13.576 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:12.846+0000 7efe947f7640 1 -- 172.21.15.121:0/448652179 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe8c113970 con 0x7efe8c100c50 2024-08-18T22:33:13.576 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:12.846+0000 7efe7effd640 1 -- 172.21.15.121:0/448652179 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7efe8003da10 con 0x7efe8c100c50 2024-08-18T22:33:13.576 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:12.846+0000 7efe7effd640 1 -- 172.21.15.121:0/448652179 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7efe8003b8e0 con 0x7efe8c100c50 2024-08-18T22:33:13.576 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:12.846+0000 7efe947f7640 1 -- 172.21.15.121:0/448652179 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe8c113d80 con 0x7efe8c100c50 2024-08-18T22:33:13.576 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:12.847+0000 7efe7effd640 1 -- 172.21.15.121:0/448652179 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 8) v1 ==== 42636+0+0 (secure 0 0 0) 0x7efe80039070 con 0x7efe8c100c50 2024-08-18T22:33:13.577 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:12.847+0000 7efe7effd640 1 --2- 172.21.15.121:0/448652179 >> [v2:172.21.15.121:6800/833901271,v1:172.21.15.121:6801/833901271] conn(0x7efe780356c0 0x7efe78037b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:13.577 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:12.847+0000 7efe947f7640 1 -- 172.21.15.121:0/448652179 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe8c04b4c0 con 0x7efe8c100c50 2024-08-18T22:33:13.577 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:12.848+0000 7efe7effd640 1 -- 172.21.15.121:0/448652179 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7efe800688c0 con 0x7efe8c100c50 2024-08-18T22:33:13.577 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:12.848+0000 7efe91d92640 1 --2- 172.21.15.121:0/448652179 >> [v2:172.21.15.121:6800/833901271,v1:172.21.15.121:6801/833901271] conn(0x7efe780356c0 0x7efe78037b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:13.577 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:12.848+0000 7efe91d92640 1 --2- 172.21.15.121:0/448652179 >> [v2:172.21.15.121:6800/833901271,v1:172.21.15.121:6801/833901271] conn(0x7efe780356c0 0x7efe78037b70 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7efe88006fd0 tx=0x7efe88006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:33:13.577 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:12.852+0000 7efe7effd640 1 -- 172.21.15.121:0/448652179 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7efe8003d5b0 con 0x7efe8c100c50 2024-08-18T22:33:13.577 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:13.012+0000 7efe947f7640 1 -- 172.21.15.121:0/448652179 --> [v2:172.21.15.121:6800/833901271,v1:172.21.15.121:6801/833901271] -- mgr_command(tid 0: {"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}) v1 -- 0x7efe8c114080 con 0x7efe780356c0 2024-08-18T22:33:13.577 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:13.013+0000 7efe7effd640 1 -- 172.21.15.121:0/448652179 <== mgr.14118 v2:172.21.15.121:6800/833901271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+16 (secure 0 0 0) 0x7efe8c114080 con 0x7efe780356c0 2024-08-18T22:33:13.577 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:13.015+0000 7efe947f7640 1 -- 172.21.15.121:0/448652179 >> [v2:172.21.15.121:6800/833901271,v1:172.21.15.121:6801/833901271] conn(0x7efe780356c0 msgr2=0x7efe78037b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:13.577 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:13.015+0000 7efe947f7640 1 --2- 172.21.15.121:0/448652179 >> [v2:172.21.15.121:6800/833901271,v1:172.21.15.121:6801/833901271] conn(0x7efe780356c0 0x7efe78037b70 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7efe88006fd0 tx=0x7efe88006db0 comp rx=0 tx=0).stop 2024-08-18T22:33:13.577 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:13.015+0000 7efe947f7640 1 -- 172.21.15.121:0/448652179 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efe8c100c50 msgr2=0x7efe8c076a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:13.577 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:13.015+0000 7efe947f7640 1 --2- 172.21.15.121:0/448652179 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efe8c100c50 0x7efe8c076a90 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7efe80000c00 tx=0x7efe80008040 comp rx=0 tx=0).stop 2024-08-18T22:33:13.577 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:13.015+0000 7efe947f7640 1 -- 172.21.15.121:0/448652179 shutdown_connections 2024-08-18T22:33:13.578 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:13.015+0000 7efe947f7640 1 --2- 172.21.15.121:0/448652179 >> [v2:172.21.15.121:6800/833901271,v1:172.21.15.121:6801/833901271] conn(0x7efe780356c0 0x7efe78037b70 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:13.578 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:13.015+0000 7efe947f7640 1 --2- 172.21.15.121:0/448652179 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efe8c100c50 0x7efe8c076a90 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:13.578 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:13.015+0000 7efe947f7640 1 -- 172.21.15.121:0/448652179 >> 172.21.15.121:0/448652179 conn(0x7efe8c0fc490 msgr2=0x7efe8c0fd060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:33:13.578 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:13.015+0000 7efe947f7640 1 -- 172.21.15.121:0/448652179 shutdown_connections 2024-08-18T22:33:13.578 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:13.015+0000 7efe947f7640 1 -- 172.21.15.121:0/448652179 wait complete. 2024-08-18T22:33:13.578 INFO:teuthology.orchestra.run.smithi121.stdout:Generating ssh key... 2024-08-18T22:33:14.283 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:33:13 smithi121 ceph-mon[16788]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2024-08-18T22:33:14.842 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:13.947+0000 7f5c90c68640 1 Processor -- start 2024-08-18T22:33:14.842 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:13.947+0000 7f5c90c68640 1 -- start start 2024-08-18T22:33:14.842 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:13.948+0000 7f5c90c68640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5c8c102200 0x7f5c8c102610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:14.842 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:13.948+0000 7f5c90c68640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c8c102b50 con 0x7f5c8c102200 2024-08-18T22:33:14.842 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:13.948+0000 7f5c8a59c640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5c8c102200 0x7f5c8c102610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:14.842 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:13.948+0000 7f5c8a59c640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5c8c102200 0x7f5c8c102610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:39532/0 (socket says 172.21.15.121:39532) 2024-08-18T22:33:14.843 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:13.948+0000 7f5c8a59c640 1 -- 172.21.15.121:0/1549657756 learned_addr learned my addr 172.21.15.121:0/1549657756 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-18T22:33:14.843 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:13.948+0000 7f5c8a59c640 1 -- 172.21.15.121:0/1549657756 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c8c102c90 con 0x7f5c8c102200 2024-08-18T22:33:14.843 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:13.949+0000 7f5c8a59c640 1 --2- 172.21.15.121:0/1549657756 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5c8c102200 0x7f5c8c102610 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f5c8400baf0 tx=0x7f5c8400b460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb934c7978ba0b66 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:33:14.843 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:13.949+0000 7f5c8959a640 1 -- 172.21.15.121:0/1549657756 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5c840327a0 con 0x7f5c8c102200 2024-08-18T22:33:14.843 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:13.949+0000 7f5c8959a640 1 -- 172.21.15.121:0/1549657756 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7f5c84032d60 con 0x7f5c8c102200 2024-08-18T22:33:14.843 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:13.949+0000 7f5c8959a640 1 -- 172.21.15.121:0/1549657756 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5c84031df0 con 0x7f5c8c102200 2024-08-18T22:33:14.843 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:13.949+0000 7f5c90c68640 1 -- 172.21.15.121:0/1549657756 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5c8c102200 msgr2=0x7f5c8c102610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:14.843 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:13.949+0000 7f5c90c68640 1 --2- 172.21.15.121:0/1549657756 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5c8c102200 0x7f5c8c102610 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f5c8400baf0 tx=0x7f5c8400b460 comp rx=0 tx=0).stop 2024-08-18T22:33:14.843 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:13.950+0000 7f5c90c68640 1 -- 172.21.15.121:0/1549657756 shutdown_connections 2024-08-18T22:33:14.843 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:13.950+0000 7f5c90c68640 1 --2- 172.21.15.121:0/1549657756 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5c8c102200 0x7f5c8c102610 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:14.843 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:13.950+0000 7f5c90c68640 1 -- 172.21.15.121:0/1549657756 >> 172.21.15.121:0/1549657756 conn(0x7f5c8c0fbb60 msgr2=0x7f5c8c0fdf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:33:14.843 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:13.950+0000 7f5c90c68640 1 -- 172.21.15.121:0/1549657756 shutdown_connections 2024-08-18T22:33:14.843 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:13.950+0000 7f5c90c68640 1 -- 172.21.15.121:0/1549657756 wait complete. 2024-08-18T22:33:14.844 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:13.950+0000 7f5c90c68640 1 Processor -- start 2024-08-18T22:33:14.844 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:13.950+0000 7f5c90c68640 1 -- start start 2024-08-18T22:33:14.844 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:13.950+0000 7f5c90c68640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5c8c102200 0x7f5c8c10e940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:14.844 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:13.950+0000 7f5c90c68640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c8c10ee80 con 0x7f5c8c102200 2024-08-18T22:33:14.844 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:13.950+0000 7f5c8a59c640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5c8c102200 0x7f5c8c10e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:14.844 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:13.950+0000 7f5c8a59c640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5c8c102200 0x7f5c8c10e940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:39538/0 (socket says 172.21.15.121:39538) 2024-08-18T22:33:14.844 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:13.950+0000 7f5c8a59c640 1 -- 172.21.15.121:0/1032467740 learned_addr learned my addr 172.21.15.121:0/1032467740 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-18T22:33:14.844 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:13.951+0000 7f5c8a59c640 1 -- 172.21.15.121:0/1032467740 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c8400b700 con 0x7f5c8c102200 2024-08-18T22:33:14.844 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:13.951+0000 7f5c8a59c640 1 --2- 172.21.15.121:0/1032467740 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5c8c102200 0x7f5c8c10e940 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f5c8402ce70 tx=0x7f5c8400b460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:33:14.844 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:13.951+0000 7f5c7affd640 1 -- 172.21.15.121:0/1032467740 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5c84032ab0 con 0x7f5c8c102200 2024-08-18T22:33:14.844 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:13.951+0000 7f5c7affd640 1 -- 172.21.15.121:0/1032467740 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7f5c8403b880 con 0x7f5c8c102200 2024-08-18T22:33:14.844 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:13.951+0000 7f5c90c68640 1 -- 172.21.15.121:0/1032467740 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c8c10f080 con 0x7f5c8c102200 2024-08-18T22:33:14.844 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:13.951+0000 7f5c7affd640 1 -- 172.21.15.121:0/1032467740 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5c8403a730 con 0x7f5c8c102200 2024-08-18T22:33:14.844 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:13.951+0000 7f5c90c68640 1 -- 172.21.15.121:0/1032467740 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c8c10f490 con 0x7f5c8c102200 2024-08-18T22:33:14.845 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:13.952+0000 7f5c7affd640 1 -- 172.21.15.121:0/1032467740 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 8) v1 ==== 42636+0+0 (secure 0 0 0) 0x7f5c8403b9f0 con 0x7f5c8c102200 2024-08-18T22:33:14.845 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:13.952+0000 7f5c7affd640 1 --2- 172.21.15.121:0/1032467740 >> [v2:172.21.15.121:6800/833901271,v1:172.21.15.121:6801/833901271] conn(0x7f5c74035710 0x7f5c74037bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:14.845 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:13.952+0000 7f5c7affd640 1 -- 172.21.15.121:0/1032467740 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f5c8406ab70 con 0x7f5c8c102200 2024-08-18T22:33:14.845 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:13.952+0000 7f5c90c68640 1 -- 172.21.15.121:0/1032467740 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c8c04b4c0 con 0x7f5c8c102200 2024-08-18T22:33:14.845 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:13.952+0000 7f5c89d9b640 1 --2- 172.21.15.121:0/1032467740 >> [v2:172.21.15.121:6800/833901271,v1:172.21.15.121:6801/833901271] conn(0x7f5c74035710 0x7f5c74037bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:14.845 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:13.952+0000 7f5c89d9b640 1 --2- 172.21.15.121:0/1032467740 >> [v2:172.21.15.121:6800/833901271,v1:172.21.15.121:6801/833901271] conn(0x7f5c74035710 0x7f5c74037bc0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f5c80006fd0 tx=0x7f5c80006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:33:14.845 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:13.956+0000 7f5c7affd640 1 -- 172.21.15.121:0/1032467740 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f5c84036030 con 0x7f5c8c102200 2024-08-18T22:33:14.845 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:14.114+0000 7f5c90c68640 1 -- 172.21.15.121:0/1032467740 --> [v2:172.21.15.121:6800/833901271,v1:172.21.15.121:6801/833901271] -- mgr_command(tid 0: {"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}) v1 -- 0x7f5c8c10ffc0 con 0x7f5c74035710 2024-08-18T22:33:14.845 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:14.291+0000 7f5c7affd640 1 -- 172.21.15.121:0/1032467740 <== mgr.14118 v2:172.21.15.121:6800/833901271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f5c8c10ffc0 con 0x7f5c74035710 2024-08-18T22:33:14.845 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:14.293+0000 7f5c90c68640 1 -- 172.21.15.121:0/1032467740 >> [v2:172.21.15.121:6800/833901271,v1:172.21.15.121:6801/833901271] conn(0x7f5c74035710 msgr2=0x7f5c74037bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:14.845 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:14.293+0000 7f5c90c68640 1 --2- 172.21.15.121:0/1032467740 >> [v2:172.21.15.121:6800/833901271,v1:172.21.15.121:6801/833901271] conn(0x7f5c74035710 0x7f5c74037bc0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f5c80006fd0 tx=0x7f5c80006db0 comp rx=0 tx=0).stop 2024-08-18T22:33:14.845 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:14.293+0000 7f5c90c68640 1 -- 172.21.15.121:0/1032467740 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5c8c102200 msgr2=0x7f5c8c10e940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:14.846 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:14.293+0000 7f5c90c68640 1 --2- 172.21.15.121:0/1032467740 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5c8c102200 0x7f5c8c10e940 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f5c8402ce70 tx=0x7f5c8400b460 comp rx=0 tx=0).stop 2024-08-18T22:33:14.846 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:14.293+0000 7f5c90c68640 1 -- 172.21.15.121:0/1032467740 shutdown_connections 2024-08-18T22:33:14.846 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:14.293+0000 7f5c90c68640 1 --2- 172.21.15.121:0/1032467740 >> [v2:172.21.15.121:6800/833901271,v1:172.21.15.121:6801/833901271] conn(0x7f5c74035710 0x7f5c74037bc0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:14.846 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:14.293+0000 7f5c90c68640 1 --2- 172.21.15.121:0/1032467740 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5c8c102200 0x7f5c8c10e940 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:14.846 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:14.293+0000 7f5c90c68640 1 -- 172.21.15.121:0/1032467740 >> 172.21.15.121:0/1032467740 conn(0x7f5c8c0fbb60 msgr2=0x7f5c8c1051c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:33:14.846 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:14.293+0000 7f5c90c68640 1 -- 172.21.15.121:0/1032467740 shutdown_connections 2024-08-18T22:33:14.846 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:14.293+0000 7f5c90c68640 1 -- 172.21.15.121:0/1032467740 wait complete. 2024-08-18T22:33:15.429 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:33:15 smithi121 ceph-mon[16788]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-08-18T22:33:15.430 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:33:15 smithi121 ceph-mon[16788]: Generating ssh key... 2024-08-18T22:33:15.430 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:33:15 smithi121 ceph-mon[16788]: from='mgr.14118 172.21.15.121:0/3177338859' entity='mgr.smithi121.lopxqc' 2024-08-18T22:33:15.430 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:33:15 smithi121 ceph-mon[16788]: from='mgr.14118 172.21.15.121:0/3177338859' entity='mgr.smithi121.lopxqc' 2024-08-18T22:33:15.999 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC028uiFvtEIePnBq3FsSf4SgUauykxj4MgeDtZdt/UrlZ/sGuRk9Oe4xpvt5iL8uSvfXOMk27pay7OV63s9D4EGkCFT/S921XHf+AYyzqXlF/sZXf8++x7w5O8ZP7XBUlBypLZGdh11kfkvWlkv/vjb4MyK36BRs5piSQQF8Lc7PhP3Enq9MB5yHhsIBmd/VQox2sn5lUrPfsk6xPJ37sxvV4GtP1M63uW4eeDMmOWvsZMZL75e+DjsjEagpdYuTmaUSlDQD2NhMQzoIH+yFNZi3a6Iatr8peAB3sjM/lQrHn1tbHd6KNKVGyQ4bMIV3B7zwygYF1S9GOfThfSKoPtKdO/fNy6xY1nI1Jq6Lpy6+WXZfNANuBWI45BsjlV1PFft+s4mMVl0vytlkArzqm+sARuU6EQgT17B784zzYaK5Okv7Ee5PWC2TjPbtbzTLLqOmPtAeki6r1wWUxOSnKNsvXlxhWdCHZMhrsAXQ9pyq/Hy1FoWJCiq/FkD7w5eG8= ceph-b003123a-5db1-11ef-bccf-c7b262605968 2024-08-18T22:33:15.999 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:15.258+0000 7fa781453640 1 Processor -- start 2024-08-18T22:33:16.000 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:15.258+0000 7fa781453640 1 -- start start 2024-08-18T22:33:16.000 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:15.259+0000 7fa781453640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa77c1031b0 0x7fa77c1035c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:16.000 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:15.259+0000 7fa781453640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa77c103b90 con 0x7fa77c1031b0 2024-08-18T22:33:16.000 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:15.259+0000 7fa77affd640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa77c1031b0 0x7fa77c1035c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:16.000 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:15.259+0000 7fa77affd640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa77c1031b0 0x7fa77c1035c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:39546/0 (socket says 172.21.15.121:39546) 2024-08-18T22:33:16.000 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:15.259+0000 7fa77affd640 1 -- 172.21.15.121:0/1678077025 learned_addr learned my addr 172.21.15.121:0/1678077025 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-18T22:33:16.001 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:15.259+0000 7fa77affd640 1 -- 172.21.15.121:0/1678077025 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa77c103cd0 con 0x7fa77c1031b0 2024-08-18T22:33:16.001 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:15.260+0000 7fa77affd640 1 --2- 172.21.15.121:0/1678077025 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa77c1031b0 0x7fa77c1035c0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fa76c009840 tx=0x7fa76c0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83954e8ff05e767e server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:33:16.001 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:15.260+0000 7fa77a7fc640 1 -- 172.21.15.121:0/1678077025 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa76c032440 con 0x7fa77c1031b0 2024-08-18T22:33:16.001 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:15.260+0000 7fa77a7fc640 1 -- 172.21.15.121:0/1678077025 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7fa76c032a00 con 0x7fa77c1031b0 2024-08-18T22:33:16.001 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:15.260+0000 7fa77a7fc640 1 -- 172.21.15.121:0/1678077025 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa76c0319e0 con 0x7fa77c1031b0 2024-08-18T22:33:16.001 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:15.260+0000 7fa781453640 1 -- 172.21.15.121:0/1678077025 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa77c1031b0 msgr2=0x7fa77c1035c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:16.001 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:15.260+0000 7fa781453640 1 --2- 172.21.15.121:0/1678077025 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa77c1031b0 0x7fa77c1035c0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fa76c009840 tx=0x7fa76c0091d0 comp rx=0 tx=0).stop 2024-08-18T22:33:16.002 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:15.260+0000 7fa781453640 1 -- 172.21.15.121:0/1678077025 shutdown_connections 2024-08-18T22:33:16.002 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:15.260+0000 7fa781453640 1 --2- 172.21.15.121:0/1678077025 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa77c1031b0 0x7fa77c1035c0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:16.002 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:15.260+0000 7fa781453640 1 -- 172.21.15.121:0/1678077025 >> 172.21.15.121:0/1678077025 conn(0x7fa77c0fbb60 msgr2=0x7fa77c0fdf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:33:16.002 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:15.261+0000 7fa781453640 1 -- 172.21.15.121:0/1678077025 shutdown_connections 2024-08-18T22:33:16.002 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:15.261+0000 7fa781453640 1 -- 172.21.15.121:0/1678077025 wait complete. 2024-08-18T22:33:16.002 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:15.261+0000 7fa781453640 1 Processor -- start 2024-08-18T22:33:16.002 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:15.261+0000 7fa781453640 1 -- start start 2024-08-18T22:33:16.002 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:15.261+0000 7fa781453640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa77c1031b0 0x7fa77c110b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:16.002 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:15.261+0000 7fa781453640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa77c111070 con 0x7fa77c1031b0 2024-08-18T22:33:16.002 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:15.261+0000 7fa77affd640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa77c1031b0 0x7fa77c110b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:16.002 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:15.262+0000 7fa77affd640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa77c1031b0 0x7fa77c110b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:39556/0 (socket says 172.21.15.121:39556) 2024-08-18T22:33:16.002 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:15.262+0000 7fa77affd640 1 -- 172.21.15.121:0/1737589139 learned_addr learned my addr 172.21.15.121:0/1737589139 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-18T22:33:16.003 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:15.262+0000 7fa77affd640 1 -- 172.21.15.121:0/1737589139 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa76c009450 con 0x7fa77c1031b0 2024-08-18T22:33:16.003 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:15.262+0000 7fa77affd640 1 --2- 172.21.15.121:0/1737589139 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa77c1031b0 0x7fa77c110b30 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fa76c000c00 tx=0x7fa76c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:33:16.003 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:15.262+0000 7fa773fff640 1 -- 172.21.15.121:0/1737589139 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa76c03d450 con 0x7fa77c1031b0 2024-08-18T22:33:16.003 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:15.262+0000 7fa773fff640 1 -- 172.21.15.121:0/1737589139 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7fa76c03da10 con 0x7fa77c1031b0 2024-08-18T22:33:16.003 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:15.262+0000 7fa781453640 1 -- 172.21.15.121:0/1737589139 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa77c111270 con 0x7fa77c1031b0 2024-08-18T22:33:16.003 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:15.262+0000 7fa773fff640 1 -- 172.21.15.121:0/1737589139 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa76c03b8e0 con 0x7fa77c1031b0 2024-08-18T22:33:16.003 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:15.262+0000 7fa781453640 1 -- 172.21.15.121:0/1737589139 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa77c1116e0 con 0x7fa77c1031b0 2024-08-18T22:33:16.003 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:15.263+0000 7fa773fff640 1 -- 172.21.15.121:0/1737589139 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 8) v1 ==== 42636+0+0 (secure 0 0 0) 0x7fa76c039070 con 0x7fa77c1031b0 2024-08-18T22:33:16.003 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:15.263+0000 7fa773fff640 1 --2- 172.21.15.121:0/1737589139 >> [v2:172.21.15.121:6800/833901271,v1:172.21.15.121:6801/833901271] conn(0x7fa768035710 0x7fa768037bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:16.003 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:15.263+0000 7fa781453640 1 -- 172.21.15.121:0/1737589139 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa77c04b4c0 con 0x7fa77c1031b0 2024-08-18T22:33:16.003 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:15.263+0000 7fa773fff640 1 -- 172.21.15.121:0/1737589139 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7fa76c0686f0 con 0x7fa77c1031b0 2024-08-18T22:33:16.003 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:15.263+0000 7fa7727fc640 1 --2- 172.21.15.121:0/1737589139 >> [v2:172.21.15.121:6800/833901271,v1:172.21.15.121:6801/833901271] conn(0x7fa768035710 0x7fa768037bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:16.003 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:15.264+0000 7fa7727fc640 1 --2- 172.21.15.121:0/1737589139 >> [v2:172.21.15.121:6800/833901271,v1:172.21.15.121:6801/833901271] conn(0x7fa768035710 0x7fa768037bc0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fa764006fd0 tx=0x7fa764006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:33:16.004 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:15.268+0000 7fa773fff640 1 -- 172.21.15.121:0/1737589139 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fa76c041070 con 0x7fa77c1031b0 2024-08-18T22:33:16.004 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:15.428+0000 7fa781453640 1 -- 172.21.15.121:0/1737589139 --> [v2:172.21.15.121:6800/833901271,v1:172.21.15.121:6801/833901271] -- mgr_command(tid 0: {"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}) v1 -- 0x7fa77c0fce60 con 0x7fa768035710 2024-08-18T22:33:16.004 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:15.429+0000 7fa773fff640 1 -- 172.21.15.121:0/1737589139 <== mgr.14118 v2:172.21.15.121:6800/833901271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+595 (secure 0 0 0) 0x7fa77c0fce60 con 0x7fa768035710 2024-08-18T22:33:16.004 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:15.431+0000 7fa781453640 1 -- 172.21.15.121:0/1737589139 >> [v2:172.21.15.121:6800/833901271,v1:172.21.15.121:6801/833901271] conn(0x7fa768035710 msgr2=0x7fa768037bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:16.004 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:15.431+0000 7fa781453640 1 --2- 172.21.15.121:0/1737589139 >> [v2:172.21.15.121:6800/833901271,v1:172.21.15.121:6801/833901271] conn(0x7fa768035710 0x7fa768037bc0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fa764006fd0 tx=0x7fa764006db0 comp rx=0 tx=0).stop 2024-08-18T22:33:16.004 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:15.432+0000 7fa781453640 1 -- 172.21.15.121:0/1737589139 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa77c1031b0 msgr2=0x7fa77c110b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:16.004 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:15.432+0000 7fa781453640 1 --2- 172.21.15.121:0/1737589139 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa77c1031b0 0x7fa77c110b30 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fa76c000c00 tx=0x7fa76c008040 comp rx=0 tx=0).stop 2024-08-18T22:33:16.004 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:15.432+0000 7fa781453640 1 -- 172.21.15.121:0/1737589139 shutdown_connections 2024-08-18T22:33:16.004 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:15.432+0000 7fa781453640 1 --2- 172.21.15.121:0/1737589139 >> [v2:172.21.15.121:6800/833901271,v1:172.21.15.121:6801/833901271] conn(0x7fa768035710 0x7fa768037bc0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:16.004 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:15.432+0000 7fa781453640 1 --2- 172.21.15.121:0/1737589139 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa77c1031b0 0x7fa77c110b30 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:16.004 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:15.432+0000 7fa781453640 1 -- 172.21.15.121:0/1737589139 >> 172.21.15.121:0/1737589139 conn(0x7fa77c0fbb60 msgr2=0x7fa77c0fc710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:33:16.004 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:15.432+0000 7fa781453640 1 -- 172.21.15.121:0/1737589139 shutdown_connections 2024-08-18T22:33:16.004 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:15.432+0000 7fa781453640 1 -- 172.21.15.121:0/1737589139 wait complete. 2024-08-18T22:33:16.004 INFO:teuthology.orchestra.run.smithi121.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2024-08-18T22:33:16.005 INFO:teuthology.orchestra.run.smithi121.stdout:Adding key to root@localhost authorized_keys... 2024-08-18T22:33:16.005 INFO:teuthology.orchestra.run.smithi121.stdout:Adding host smithi121... 2024-08-18T22:33:16.548 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:33:16 smithi121 ceph-mon[16788]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2024-08-18T22:33:17.583 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:33:17 smithi121 ceph-mon[16788]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi121", "addr": "172.21.15.121", "target": ["mon-mgr", ""]}]: dispatch 2024-08-18T22:33:17.583 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:33:17 smithi121 ceph-mon[16788]: Deploying cephadm binary to smithi121 2024-08-18T22:33:19.850 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stdout Added host 'smithi121' with addr '172.21.15.121' 2024-08-18T22:33:19.851 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:16.377+0000 7ff4ae9ae640 1 Processor -- start 2024-08-18T22:33:19.851 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:16.377+0000 7ff4ae9ae640 1 -- start start 2024-08-18T22:33:19.851 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:16.377+0000 7ff4ae9ae640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff4a8076bd0 0x7ff4a8106cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:19.851 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:16.377+0000 7ff4ae9ae640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4a81026e0 con 0x7ff4a8076bd0 2024-08-18T22:33:19.851 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:16.378+0000 7ff4a7fff640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff4a8076bd0 0x7ff4a8106cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:19.851 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:16.378+0000 7ff4a7fff640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff4a8076bd0 0x7ff4a8106cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:39562/0 (socket says 172.21.15.121:39562) 2024-08-18T22:33:19.851 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:16.378+0000 7ff4a7fff640 1 -- 172.21.15.121:0/1979373015 learned_addr learned my addr 172.21.15.121:0/1979373015 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-18T22:33:19.851 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:16.378+0000 7ff4a7fff640 1 -- 172.21.15.121:0/1979373015 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4a8107230 con 0x7ff4a8076bd0 2024-08-18T22:33:19.851 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:16.379+0000 7ff4a7fff640 1 --2- 172.21.15.121:0/1979373015 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff4a8076bd0 0x7ff4a8106cf0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7ff498009840 tx=0x7ff4980091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f990bc073435665 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:33:19.851 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:16.379+0000 7ff4a77fe640 1 -- 172.21.15.121:0/1979373015 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff498032440 con 0x7ff4a8076bd0 2024-08-18T22:33:19.851 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:16.379+0000 7ff4a77fe640 1 -- 172.21.15.121:0/1979373015 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7ff498032a00 con 0x7ff4a8076bd0 2024-08-18T22:33:19.852 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:16.379+0000 7ff4a77fe640 1 -- 172.21.15.121:0/1979373015 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff4980319e0 con 0x7ff4a8076bd0 2024-08-18T22:33:19.852 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:16.379+0000 7ff4ae9ae640 1 -- 172.21.15.121:0/1979373015 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff4a8076bd0 msgr2=0x7ff4a8106cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:19.852 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:16.379+0000 7ff4ae9ae640 1 --2- 172.21.15.121:0/1979373015 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff4a8076bd0 0x7ff4a8106cf0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7ff498009840 tx=0x7ff4980091d0 comp rx=0 tx=0).stop 2024-08-18T22:33:19.852 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:16.379+0000 7ff4ae9ae640 1 -- 172.21.15.121:0/1979373015 shutdown_connections 2024-08-18T22:33:19.852 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:16.379+0000 7ff4ae9ae640 1 --2- 172.21.15.121:0/1979373015 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff4a8076bd0 0x7ff4a8106cf0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:19.852 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:16.379+0000 7ff4ae9ae640 1 -- 172.21.15.121:0/1979373015 >> 172.21.15.121:0/1979373015 conn(0x7ff4a80fc400 msgr2=0x7ff4a80fe810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:33:19.852 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:16.379+0000 7ff4ae9ae640 1 -- 172.21.15.121:0/1979373015 shutdown_connections 2024-08-18T22:33:19.852 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:16.379+0000 7ff4ae9ae640 1 -- 172.21.15.121:0/1979373015 wait complete. 2024-08-18T22:33:19.852 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:16.380+0000 7ff4ae9ae640 1 Processor -- start 2024-08-18T22:33:19.852 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:16.380+0000 7ff4ae9ae640 1 -- start start 2024-08-18T22:33:19.852 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:16.380+0000 7ff4ae9ae640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff4a8076bd0 0x7ff4a8112cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:19.852 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:16.380+0000 7ff4ae9ae640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4a8113210 con 0x7ff4a8076bd0 2024-08-18T22:33:19.852 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:16.380+0000 7ff4a7fff640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff4a8076bd0 0x7ff4a8112cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:19.852 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:16.380+0000 7ff4a7fff640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff4a8076bd0 0x7ff4a8112cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:39574/0 (socket says 172.21.15.121:39574) 2024-08-18T22:33:19.853 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:16.380+0000 7ff4a7fff640 1 -- 172.21.15.121:0/2597590652 learned_addr learned my addr 172.21.15.121:0/2597590652 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-18T22:33:19.853 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:16.380+0000 7ff4a7fff640 1 -- 172.21.15.121:0/2597590652 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff498009450 con 0x7ff4a8076bd0 2024-08-18T22:33:19.853 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:16.381+0000 7ff4a7fff640 1 --2- 172.21.15.121:0/2597590652 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff4a8076bd0 0x7ff4a8112cd0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7ff4980098a0 tx=0x7ff498008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:33:19.853 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:16.381+0000 7ff4a57fa640 1 -- 172.21.15.121:0/2597590652 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff498032880 con 0x7ff4a8076bd0 2024-08-18T22:33:19.853 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:16.381+0000 7ff4a57fa640 1 -- 172.21.15.121:0/2597590652 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7ff49803d8b0 con 0x7ff4a8076bd0 2024-08-18T22:33:19.853 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:16.381+0000 7ff4ae9ae640 1 -- 172.21.15.121:0/2597590652 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4a8113410 con 0x7ff4a8076bd0 2024-08-18T22:33:19.853 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:16.381+0000 7ff4a57fa640 1 -- 172.21.15.121:0/2597590652 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff49803b8e0 con 0x7ff4a8076bd0 2024-08-18T22:33:19.853 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:16.381+0000 7ff4ae9ae640 1 -- 172.21.15.121:0/2597590652 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4a8113880 con 0x7ff4a8076bd0 2024-08-18T22:33:19.853 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:16.382+0000 7ff4a57fa640 1 -- 172.21.15.121:0/2597590652 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 8) v1 ==== 42636+0+0 (secure 0 0 0) 0x7ff498039070 con 0x7ff4a8076bd0 2024-08-18T22:33:19.854 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:16.382+0000 7ff4a57fa640 1 --2- 172.21.15.121:0/2597590652 >> [v2:172.21.15.121:6800/833901271,v1:172.21.15.121:6801/833901271] conn(0x7ff4940356c0 0x7ff494037b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:19.854 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:16.382+0000 7ff4a57fa640 1 -- 172.21.15.121:0/2597590652 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7ff4980685f0 con 0x7ff4a8076bd0 2024-08-18T22:33:19.854 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:16.382+0000 7ff49ffff640 1 --2- 172.21.15.121:0/2597590652 >> [v2:172.21.15.121:6800/833901271,v1:172.21.15.121:6801/833901271] conn(0x7ff4940356c0 0x7ff494037b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:19.854 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:16.382+0000 7ff4ae9ae640 1 -- 172.21.15.121:0/2597590652 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4a805eb10 con 0x7ff4a8076bd0 2024-08-18T22:33:19.854 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:16.382+0000 7ff49ffff640 1 --2- 172.21.15.121:0/2597590652 >> [v2:172.21.15.121:6800/833901271,v1:172.21.15.121:6801/833901271] conn(0x7ff4940356c0 0x7ff494037b70 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7ff490006fd0 tx=0x7ff490006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:33:19.854 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:16.387+0000 7ff4a57fa640 1 -- 172.21.15.121:0/2597590652 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7ff498041070 con 0x7ff4a8076bd0 2024-08-18T22:33:19.854 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:16.546+0000 7ff4ae9ae640 1 -- 172.21.15.121:0/2597590652 --> [v2:172.21.15.121:6800/833901271,v1:172.21.15.121:6801/833901271] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi121", "addr": "172.21.15.121", "target": ["mon-mgr", ""]}) v1 -- 0x7ff4a80fd7c0 con 0x7ff4940356c0 2024-08-18T22:33:19.854 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:19.273+0000 7ff4a57fa640 1 -- 172.21.15.121:0/2597590652 <== mgr.14118 v2:172.21.15.121:6800/833901271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7ff4a80fd7c0 con 0x7ff4940356c0 2024-08-18T22:33:19.854 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:19.275+0000 7ff4ae9ae640 1 -- 172.21.15.121:0/2597590652 >> [v2:172.21.15.121:6800/833901271,v1:172.21.15.121:6801/833901271] conn(0x7ff4940356c0 msgr2=0x7ff494037b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:19.854 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:19.275+0000 7ff4ae9ae640 1 --2- 172.21.15.121:0/2597590652 >> [v2:172.21.15.121:6800/833901271,v1:172.21.15.121:6801/833901271] conn(0x7ff4940356c0 0x7ff494037b70 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7ff490006fd0 tx=0x7ff490006db0 comp rx=0 tx=0).stop 2024-08-18T22:33:19.854 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:19.275+0000 7ff4ae9ae640 1 -- 172.21.15.121:0/2597590652 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff4a8076bd0 msgr2=0x7ff4a8112cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:19.854 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:19.275+0000 7ff4ae9ae640 1 --2- 172.21.15.121:0/2597590652 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff4a8076bd0 0x7ff4a8112cd0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7ff4980098a0 tx=0x7ff498008040 comp rx=0 tx=0).stop 2024-08-18T22:33:19.855 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:19.275+0000 7ff4ae9ae640 1 -- 172.21.15.121:0/2597590652 shutdown_connections 2024-08-18T22:33:19.855 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:19.275+0000 7ff4ae9ae640 1 --2- 172.21.15.121:0/2597590652 >> [v2:172.21.15.121:6800/833901271,v1:172.21.15.121:6801/833901271] conn(0x7ff4940356c0 0x7ff494037b70 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:19.855 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:19.275+0000 7ff4ae9ae640 1 --2- 172.21.15.121:0/2597590652 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff4a8076bd0 0x7ff4a8112cd0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:19.855 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:19.275+0000 7ff4ae9ae640 1 -- 172.21.15.121:0/2597590652 >> 172.21.15.121:0/2597590652 conn(0x7ff4a80fc400 msgr2=0x7ff4a80fcff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:33:19.855 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:19.275+0000 7ff4ae9ae640 1 -- 172.21.15.121:0/2597590652 shutdown_connections 2024-08-18T22:33:19.855 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:19.275+0000 7ff4ae9ae640 1 -- 172.21.15.121:0/2597590652 wait complete. 2024-08-18T22:33:19.855 INFO:teuthology.orchestra.run.smithi121.stdout:Deploying mon service with default placement... 2024-08-18T22:33:20.397 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:33:20 smithi121 ceph-mon[16788]: from='mgr.14118 172.21.15.121:0/3177338859' entity='mgr.smithi121.lopxqc' 2024-08-18T22:33:20.397 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:33:20 smithi121 ceph-mon[16788]: Added host smithi121 2024-08-18T22:33:20.397 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:33:20 smithi121 ceph-mon[16788]: from='mgr.14118 172.21.15.121:0/3177338859' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-18T22:33:21.765 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:33:21 smithi121 ceph-mon[16788]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "target": ["mon-mgr", ""]}]: dispatch 2024-08-18T22:33:21.765 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:33:21 smithi121 ceph-mon[16788]: Saving service mon spec with placement count:5 2024-08-18T22:33:21.765 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:33:21 smithi121 ceph-mon[16788]: from='mgr.14118 172.21.15.121:0/3177338859' entity='mgr.smithi121.lopxqc' 2024-08-18T22:33:22.049 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2024-08-18T22:33:22.049 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:20.329+0000 7f00c58c0640 1 Processor -- start 2024-08-18T22:33:22.049 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:20.329+0000 7f00c58c0640 1 -- start start 2024-08-18T22:33:22.049 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:20.330+0000 7f00c58c0640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f00c0100c00 0x7f00c0101010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:22.049 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:20.330+0000 7f00c58c0640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00c0101550 con 0x7f00c0100c00 2024-08-18T22:33:22.050 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:20.330+0000 7f00beffd640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f00c0100c00 0x7f00c0101010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:22.050 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:20.330+0000 7f00beffd640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f00c0100c00 0x7f00c0101010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:34990/0 (socket says 172.21.15.121:34990) 2024-08-18T22:33:22.050 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:20.330+0000 7f00beffd640 1 -- 172.21.15.121:0/3240173514 learned_addr learned my addr 172.21.15.121:0/3240173514 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-18T22:33:22.050 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:20.330+0000 7f00beffd640 1 -- 172.21.15.121:0/3240173514 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00c0101690 con 0x7f00c0100c00 2024-08-18T22:33:22.050 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:20.331+0000 7f00beffd640 1 --2- 172.21.15.121:0/3240173514 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f00c0100c00 0x7f00c0101010 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f00b0009840 tx=0x7f00b00091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4748fabaf38fff4 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:33:22.050 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:20.331+0000 7f00bdffb640 1 -- 172.21.15.121:0/3240173514 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f00b0032440 con 0x7f00c0100c00 2024-08-18T22:33:22.050 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:20.331+0000 7f00bdffb640 1 -- 172.21.15.121:0/3240173514 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7f00b0032a00 con 0x7f00c0100c00 2024-08-18T22:33:22.050 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:20.331+0000 7f00bdffb640 1 -- 172.21.15.121:0/3240173514 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f00b00319e0 con 0x7f00c0100c00 2024-08-18T22:33:22.050 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:20.331+0000 7f00c58c0640 1 -- 172.21.15.121:0/3240173514 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f00c0100c00 msgr2=0x7f00c0101010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:22.050 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:20.331+0000 7f00c58c0640 1 --2- 172.21.15.121:0/3240173514 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f00c0100c00 0x7f00c0101010 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f00b0009840 tx=0x7f00b00091d0 comp rx=0 tx=0).stop 2024-08-18T22:33:22.050 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:20.331+0000 7f00c58c0640 1 -- 172.21.15.121:0/3240173514 shutdown_connections 2024-08-18T22:33:22.050 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:20.331+0000 7f00c58c0640 1 --2- 172.21.15.121:0/3240173514 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f00c0100c00 0x7f00c0101010 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:22.051 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:20.331+0000 7f00c58c0640 1 -- 172.21.15.121:0/3240173514 >> 172.21.15.121:0/3240173514 conn(0x7f00c00fc3a0 msgr2=0x7f00c00fe7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:33:22.051 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:20.331+0000 7f00c58c0640 1 -- 172.21.15.121:0/3240173514 shutdown_connections 2024-08-18T22:33:22.051 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:20.331+0000 7f00c58c0640 1 -- 172.21.15.121:0/3240173514 wait complete. 2024-08-18T22:33:22.051 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:20.332+0000 7f00c58c0640 1 Processor -- start 2024-08-18T22:33:22.051 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:20.332+0000 7f00c58c0640 1 -- start start 2024-08-18T22:33:22.051 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:20.332+0000 7f00c58c0640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f00c0100c00 0x7f00c0070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:22.051 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:20.332+0000 7f00c58c0640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00c0113840 con 0x7f00c0100c00 2024-08-18T22:33:22.051 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:20.332+0000 7f00beffd640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f00c0100c00 0x7f00c0070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:22.051 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:20.332+0000 7f00beffd640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f00c0100c00 0x7f00c0070770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:35000/0 (socket says 172.21.15.121:35000) 2024-08-18T22:33:22.051 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:20.332+0000 7f00beffd640 1 -- 172.21.15.121:0/3703433799 learned_addr learned my addr 172.21.15.121:0/3703433799 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-18T22:33:22.051 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:20.333+0000 7f00beffd640 1 -- 172.21.15.121:0/3703433799 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00b0009450 con 0x7f00c0100c00 2024-08-18T22:33:22.051 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:20.333+0000 7f00beffd640 1 --2- 172.21.15.121:0/3703433799 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f00c0100c00 0x7f00c0070770 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f00b00098a0 tx=0x7f00b0008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:33:22.052 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:20.333+0000 7f00a77fe640 1 -- 172.21.15.121:0/3703433799 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f00b0032880 con 0x7f00c0100c00 2024-08-18T22:33:22.052 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:20.333+0000 7f00a77fe640 1 -- 172.21.15.121:0/3703433799 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7f00b003d8b0 con 0x7f00c0100c00 2024-08-18T22:33:22.052 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:20.333+0000 7f00c58c0640 1 -- 172.21.15.121:0/3703433799 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00c0113980 con 0x7f00c0100c00 2024-08-18T22:33:22.052 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:20.333+0000 7f00a77fe640 1 -- 172.21.15.121:0/3703433799 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f00b003b910 con 0x7f00c0100c00 2024-08-18T22:33:22.052 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:20.333+0000 7f00c58c0640 1 -- 172.21.15.121:0/3703433799 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00c0113d90 con 0x7f00c0100c00 2024-08-18T22:33:22.052 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:20.334+0000 7f00a77fe640 1 -- 172.21.15.121:0/3703433799 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 8) v1 ==== 42636+0+0 (secure 0 0 0) 0x7f00b0039070 con 0x7f00c0100c00 2024-08-18T22:33:22.052 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:20.334+0000 7f00a77fe640 1 --2- 172.21.15.121:0/3703433799 >> [v2:172.21.15.121:6800/833901271,v1:172.21.15.121:6801/833901271] conn(0x7f00a80356c0 0x7f00a8037b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:22.052 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:20.334+0000 7f00c58c0640 1 -- 172.21.15.121:0/3703433799 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00c004b4c0 con 0x7f00c0100c00 2024-08-18T22:33:22.052 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:20.334+0000 7f00a77fe640 1 -- 172.21.15.121:0/3703433799 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f00b0068840 con 0x7f00c0100c00 2024-08-18T22:33:22.052 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:20.334+0000 7f00be7fc640 1 --2- 172.21.15.121:0/3703433799 >> [v2:172.21.15.121:6800/833901271,v1:172.21.15.121:6801/833901271] conn(0x7f00a80356c0 0x7f00a8037b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:22.052 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:20.334+0000 7f00be7fc640 1 --2- 172.21.15.121:0/3703433799 >> [v2:172.21.15.121:6800/833901271,v1:172.21.15.121:6801/833901271] conn(0x7f00a80356c0 0x7f00a8037b70 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f00b4006fd0 tx=0x7f00b4006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:33:22.052 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:20.338+0000 7f00a77fe640 1 -- 172.21.15.121:0/3703433799 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f00b004e940 con 0x7f00c0100c00 2024-08-18T22:33:22.053 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:20.511+0000 7f00c58c0640 1 -- 172.21.15.121:0/3703433799 --> [v2:172.21.15.121:6800/833901271,v1:172.21.15.121:6801/833901271] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "target": ["mon-mgr", ""]}) v1 -- 0x7f00c00fd740 con 0x7f00a80356c0 2024-08-18T22:33:22.053 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:20.518+0000 7f00a77fe640 1 -- 172.21.15.121:0/3703433799 <== mgr.14118 v2:172.21.15.121:6800/833901271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7f00c00fd740 con 0x7f00a80356c0 2024-08-18T22:33:22.053 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:20.520+0000 7f00c58c0640 1 -- 172.21.15.121:0/3703433799 >> [v2:172.21.15.121:6800/833901271,v1:172.21.15.121:6801/833901271] conn(0x7f00a80356c0 msgr2=0x7f00a8037b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:22.053 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:20.520+0000 7f00c58c0640 1 --2- 172.21.15.121:0/3703433799 >> [v2:172.21.15.121:6800/833901271,v1:172.21.15.121:6801/833901271] conn(0x7f00a80356c0 0x7f00a8037b70 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f00b4006fd0 tx=0x7f00b4006db0 comp rx=0 tx=0).stop 2024-08-18T22:33:22.053 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:20.520+0000 7f00c58c0640 1 -- 172.21.15.121:0/3703433799 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f00c0100c00 msgr2=0x7f00c0070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:22.053 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:20.520+0000 7f00c58c0640 1 --2- 172.21.15.121:0/3703433799 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f00c0100c00 0x7f00c0070770 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f00b00098a0 tx=0x7f00b0008040 comp rx=0 tx=0).stop 2024-08-18T22:33:22.053 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:20.520+0000 7f00c58c0640 1 -- 172.21.15.121:0/3703433799 shutdown_connections 2024-08-18T22:33:22.053 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:20.520+0000 7f00c58c0640 1 --2- 172.21.15.121:0/3703433799 >> [v2:172.21.15.121:6800/833901271,v1:172.21.15.121:6801/833901271] conn(0x7f00a80356c0 0x7f00a8037b70 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:22.053 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:20.520+0000 7f00c58c0640 1 --2- 172.21.15.121:0/3703433799 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f00c0100c00 0x7f00c0070770 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:22.053 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:20.520+0000 7f00c58c0640 1 -- 172.21.15.121:0/3703433799 >> 172.21.15.121:0/3703433799 conn(0x7f00c00fc3a0 msgr2=0x7f00c00fcf70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:33:22.053 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:20.521+0000 7f00c58c0640 1 -- 172.21.15.121:0/3703433799 shutdown_connections 2024-08-18T22:33:22.053 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:20.521+0000 7f00c58c0640 1 -- 172.21.15.121:0/3703433799 wait complete. 2024-08-18T22:33:22.053 INFO:teuthology.orchestra.run.smithi121.stdout:Deploying mgr service with default placement... 2024-08-18T22:33:23.082 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:33:22 smithi121 ceph-mon[16788]: from='mgr.14118 172.21.15.121:0/3177338859' entity='mgr.smithi121.lopxqc' 2024-08-18T22:33:23.082 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:33:22 smithi121 ceph-mon[16788]: from='mgr.14118 172.21.15.121:0/3177338859' entity='mgr.smithi121.lopxqc' 2024-08-18T22:33:23.508 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2024-08-18T22:33:23.509 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:22.504+0000 7fe444a7a640 1 Processor -- start 2024-08-18T22:33:23.509 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:22.504+0000 7fe444a7a640 1 -- start start 2024-08-18T22:33:23.509 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:22.504+0000 7fe444a7a640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe4400708c0 0x7fe4401048f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:23.509 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:22.504+0000 7fe444a7a640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe440104e30 con 0x7fe4400708c0 2024-08-18T22:33:23.509 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:22.505+0000 7fe43e59c640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe4400708c0 0x7fe4401048f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:23.509 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:22.505+0000 7fe43e59c640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe4400708c0 0x7fe4401048f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:35010/0 (socket says 172.21.15.121:35010) 2024-08-18T22:33:23.509 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:22.505+0000 7fe43e59c640 1 -- 172.21.15.121:0/1485233876 learned_addr learned my addr 172.21.15.121:0/1485233876 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-18T22:33:23.509 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:22.505+0000 7fe43e59c640 1 -- 172.21.15.121:0/1485233876 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe440104f70 con 0x7fe4400708c0 2024-08-18T22:33:23.509 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:22.505+0000 7fe43e59c640 1 --2- 172.21.15.121:0/1485233876 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe4400708c0 0x7fe4401048f0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fe430009840 tx=0x7fe4300091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16a456b923e2155a server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:33:23.509 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:22.506+0000 7fe43dd9b640 1 -- 172.21.15.121:0/1485233876 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe430032440 con 0x7fe4400708c0 2024-08-18T22:33:23.509 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:22.506+0000 7fe43dd9b640 1 -- 172.21.15.121:0/1485233876 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fe430032a40 con 0x7fe4400708c0 2024-08-18T22:33:23.509 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:22.506+0000 7fe43dd9b640 1 -- 172.21.15.121:0/1485233876 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe430031a70 con 0x7fe4400708c0 2024-08-18T22:33:23.510 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:22.507+0000 7fe444a7a640 1 -- 172.21.15.121:0/1485233876 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe4400708c0 msgr2=0x7fe4401048f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:23.510 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:22.507+0000 7fe444a7a640 1 --2- 172.21.15.121:0/1485233876 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe4400708c0 0x7fe4401048f0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fe430009840 tx=0x7fe4300091d0 comp rx=0 tx=0).stop 2024-08-18T22:33:23.510 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:22.507+0000 7fe444a7a640 1 -- 172.21.15.121:0/1485233876 shutdown_connections 2024-08-18T22:33:23.510 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:22.507+0000 7fe444a7a640 1 --2- 172.21.15.121:0/1485233876 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe4400708c0 0x7fe4401048f0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:23.510 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:22.507+0000 7fe444a7a640 1 -- 172.21.15.121:0/1485233876 >> 172.21.15.121:0/1485233876 conn(0x7fe4400fc3a0 msgr2=0x7fe4400fe7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:33:23.510 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:22.507+0000 7fe444a7a640 1 -- 172.21.15.121:0/1485233876 shutdown_connections 2024-08-18T22:33:23.510 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:22.507+0000 7fe444a7a640 1 -- 172.21.15.121:0/1485233876 wait complete. 2024-08-18T22:33:23.510 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:22.507+0000 7fe444a7a640 1 Processor -- start 2024-08-18T22:33:23.510 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:22.508+0000 7fe444a7a640 1 -- start start 2024-08-18T22:33:23.510 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:22.508+0000 7fe444a7a640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe4400708c0 0x7fe440110b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:23.510 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:22.508+0000 7fe444a7a640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe440111090 con 0x7fe4400708c0 2024-08-18T22:33:23.510 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:22.508+0000 7fe43e59c640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe4400708c0 0x7fe440110b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:23.511 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:22.508+0000 7fe43e59c640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe4400708c0 0x7fe440110b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:35022/0 (socket says 172.21.15.121:35022) 2024-08-18T22:33:23.511 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:22.508+0000 7fe43e59c640 1 -- 172.21.15.121:0/57013655 learned_addr learned my addr 172.21.15.121:0/57013655 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-18T22:33:23.511 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:22.508+0000 7fe43e59c640 1 -- 172.21.15.121:0/57013655 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe430009450 con 0x7fe4400708c0 2024-08-18T22:33:23.511 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:22.508+0000 7fe43e59c640 1 --2- 172.21.15.121:0/57013655 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe4400708c0 0x7fe440110b50 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fe430031750 tx=0x7fe4300091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:33:23.511 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:22.508+0000 7fe436ffd640 1 -- 172.21.15.121:0/57013655 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe43003c400 con 0x7fe4400708c0 2024-08-18T22:33:23.511 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:22.508+0000 7fe444a7a640 1 -- 172.21.15.121:0/57013655 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe440111290 con 0x7fe4400708c0 2024-08-18T22:33:23.511 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:22.508+0000 7fe436ffd640 1 -- 172.21.15.121:0/57013655 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fe43003ca00 con 0x7fe4400708c0 2024-08-18T22:33:23.511 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:22.508+0000 7fe436ffd640 1 -- 172.21.15.121:0/57013655 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe43003a880 con 0x7fe4400708c0 2024-08-18T22:33:23.511 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:22.509+0000 7fe444a7a640 1 -- 172.21.15.121:0/57013655 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe440111e20 con 0x7fe4400708c0 2024-08-18T22:33:23.511 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:22.509+0000 7fe436ffd640 1 -- 172.21.15.121:0/57013655 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 8) v1 ==== 42636+0+0 (secure 0 0 0) 0x7fe43003a9e0 con 0x7fe4400708c0 2024-08-18T22:33:23.511 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:22.510+0000 7fe436ffd640 1 --2- 172.21.15.121:0/57013655 >> [v2:172.21.15.121:6800/833901271,v1:172.21.15.121:6801/833901271] conn(0x7fe42c035710 0x7fe42c037bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:23.511 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:22.510+0000 7fe444a7a640 1 -- 172.21.15.121:0/57013655 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe440111760 con 0x7fe4400708c0 2024-08-18T22:33:23.512 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:22.510+0000 7fe436ffd640 1 -- 172.21.15.121:0/57013655 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7fe4300682d0 con 0x7fe4400708c0 2024-08-18T22:33:23.512 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:22.510+0000 7fe437fff640 1 --2- 172.21.15.121:0/57013655 >> [v2:172.21.15.121:6800/833901271,v1:172.21.15.121:6801/833901271] conn(0x7fe42c035710 0x7fe42c037bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:23.512 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:22.510+0000 7fe437fff640 1 --2- 172.21.15.121:0/57013655 >> [v2:172.21.15.121:6800/833901271,v1:172.21.15.121:6801/833901271] conn(0x7fe42c035710 0x7fe42c037bc0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fe428006fd0 tx=0x7fe428006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:33:23.512 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:22.514+0000 7fe436ffd640 1 -- 172.21.15.121:0/57013655 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fe440111760 con 0x7fe4400708c0 2024-08-18T22:33:23.512 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:22.703+0000 7fe444a7a640 1 -- 172.21.15.121:0/57013655 --> [v2:172.21.15.121:6800/833901271,v1:172.21.15.121:6801/833901271] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "target": ["mon-mgr", ""]}) v1 -- 0x7fe440111760 con 0x7fe42c035710 2024-08-18T22:33:23.512 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:22.709+0000 7fe436ffd640 1 -- 172.21.15.121:0/57013655 <== mgr.14118 v2:172.21.15.121:6800/833901271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7fe440111760 con 0x7fe42c035710 2024-08-18T22:33:23.512 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:22.711+0000 7fe444a7a640 1 -- 172.21.15.121:0/57013655 >> [v2:172.21.15.121:6800/833901271,v1:172.21.15.121:6801/833901271] conn(0x7fe42c035710 msgr2=0x7fe42c037bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:23.512 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:22.711+0000 7fe444a7a640 1 --2- 172.21.15.121:0/57013655 >> [v2:172.21.15.121:6800/833901271,v1:172.21.15.121:6801/833901271] conn(0x7fe42c035710 0x7fe42c037bc0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fe428006fd0 tx=0x7fe428006db0 comp rx=0 tx=0).stop 2024-08-18T22:33:23.512 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:22.711+0000 7fe444a7a640 1 -- 172.21.15.121:0/57013655 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe4400708c0 msgr2=0x7fe440110b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:23.512 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:22.711+0000 7fe444a7a640 1 --2- 172.21.15.121:0/57013655 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe4400708c0 0x7fe440110b50 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fe430031750 tx=0x7fe4300091d0 comp rx=0 tx=0).stop 2024-08-18T22:33:23.513 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:22.711+0000 7fe444a7a640 1 -- 172.21.15.121:0/57013655 shutdown_connections 2024-08-18T22:33:23.513 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:22.711+0000 7fe444a7a640 1 --2- 172.21.15.121:0/57013655 >> [v2:172.21.15.121:6800/833901271,v1:172.21.15.121:6801/833901271] conn(0x7fe42c035710 0x7fe42c037bc0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:23.513 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:22.711+0000 7fe444a7a640 1 --2- 172.21.15.121:0/57013655 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe4400708c0 0x7fe440110b50 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:23.513 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:22.711+0000 7fe444a7a640 1 -- 172.21.15.121:0/57013655 >> 172.21.15.121:0/57013655 conn(0x7fe4400fc3a0 msgr2=0x7fe4400fd000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:33:23.513 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:22.711+0000 7fe444a7a640 1 -- 172.21.15.121:0/57013655 shutdown_connections 2024-08-18T22:33:23.513 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:22.711+0000 7fe444a7a640 1 -- 172.21.15.121:0/57013655 wait complete. 2024-08-18T22:33:23.513 INFO:teuthology.orchestra.run.smithi121.stdout:Deploying crash service with default placement... 2024-08-18T22:33:23.812 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:33:23 smithi121 ceph-mon[16788]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "target": ["mon-mgr", ""]}]: dispatch 2024-08-18T22:33:23.812 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:33:23 smithi121 ceph-mon[16788]: Saving service mgr spec with placement count:2 2024-08-18T22:33:23.812 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:33:23 smithi121 ceph-mon[16788]: from='mgr.14118 172.21.15.121:0/3177338859' entity='mgr.smithi121.lopxqc' 2024-08-18T22:33:24.676 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stdout Scheduled crash update... 2024-08-18T22:33:24.676 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:23.885+0000 7f044d68f640 1 Processor -- start 2024-08-18T22:33:24.676 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:23.885+0000 7f044d68f640 1 -- start start 2024-08-18T22:33:24.676 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:23.885+0000 7f044d68f640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0448076b80 0x7f04481048b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:24.676 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:23.885+0000 7f044d68f640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0448104df0 con 0x7f0448076b80 2024-08-18T22:33:24.676 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:23.885+0000 7f0446ffd640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0448076b80 0x7f04481048b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:24.676 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:23.885+0000 7f0446ffd640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0448076b80 0x7f04481048b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:35024/0 (socket says 172.21.15.121:35024) 2024-08-18T22:33:24.676 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:23.885+0000 7f0446ffd640 1 -- 172.21.15.121:0/957988525 learned_addr learned my addr 172.21.15.121:0/957988525 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-18T22:33:24.676 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:23.886+0000 7f0446ffd640 1 -- 172.21.15.121:0/957988525 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0448104f30 con 0x7f0448076b80 2024-08-18T22:33:24.676 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:23.886+0000 7f0446ffd640 1 --2- 172.21.15.121:0/957988525 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0448076b80 0x7f04481048b0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f0438009840 tx=0x7f04380091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d96ee05b16dedad3 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:33:24.676 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:23.886+0000 7f04467fc640 1 -- 172.21.15.121:0/957988525 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0438032440 con 0x7f0448076b80 2024-08-18T22:33:24.677 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:23.886+0000 7f04467fc640 1 -- 172.21.15.121:0/957988525 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f0438032a40 con 0x7f0448076b80 2024-08-18T22:33:24.677 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:23.886+0000 7f04467fc640 1 -- 172.21.15.121:0/957988525 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0438031a70 con 0x7f0448076b80 2024-08-18T22:33:24.677 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:23.887+0000 7f044d68f640 1 -- 172.21.15.121:0/957988525 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0448076b80 msgr2=0x7f04481048b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:24.677 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:23.887+0000 7f044d68f640 1 --2- 172.21.15.121:0/957988525 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0448076b80 0x7f04481048b0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f0438009840 tx=0x7f04380091d0 comp rx=0 tx=0).stop 2024-08-18T22:33:24.677 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:23.887+0000 7f044d68f640 1 -- 172.21.15.121:0/957988525 shutdown_connections 2024-08-18T22:33:24.677 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:23.887+0000 7f044d68f640 1 --2- 172.21.15.121:0/957988525 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0448076b80 0x7f04481048b0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:24.677 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:23.887+0000 7f044d68f640 1 -- 172.21.15.121:0/957988525 >> 172.21.15.121:0/957988525 conn(0x7f04480fc360 msgr2=0x7f04480fe770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:33:24.677 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:23.887+0000 7f044d68f640 1 -- 172.21.15.121:0/957988525 shutdown_connections 2024-08-18T22:33:24.677 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:23.887+0000 7f044d68f640 1 -- 172.21.15.121:0/957988525 wait complete. 2024-08-18T22:33:24.677 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:23.888+0000 7f044d68f640 1 Processor -- start 2024-08-18T22:33:24.677 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:23.888+0000 7f044d68f640 1 -- start start 2024-08-18T22:33:24.677 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:23.888+0000 7f044d68f640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0448076b80 0x7f0448110ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:24.677 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:23.888+0000 7f044d68f640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0448111010 con 0x7f0448076b80 2024-08-18T22:33:24.677 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:23.888+0000 7f0446ffd640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0448076b80 0x7f0448110ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:24.678 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:23.888+0000 7f0446ffd640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0448076b80 0x7f0448110ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:35026/0 (socket says 172.21.15.121:35026) 2024-08-18T22:33:24.678 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:23.888+0000 7f0446ffd640 1 -- 172.21.15.121:0/1198591608 learned_addr learned my addr 172.21.15.121:0/1198591608 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-18T22:33:24.678 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:23.888+0000 7f0446ffd640 1 -- 172.21.15.121:0/1198591608 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0438009450 con 0x7f0448076b80 2024-08-18T22:33:24.678 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:23.888+0000 7f0446ffd640 1 --2- 172.21.15.121:0/1198591608 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0448076b80 0x7f0448110ad0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f0438009420 tx=0x7f04380091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:33:24.678 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:23.888+0000 7f043f7fe640 1 -- 172.21.15.121:0/1198591608 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f043803c400 con 0x7f0448076b80 2024-08-18T22:33:24.678 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:23.888+0000 7f043f7fe640 1 -- 172.21.15.121:0/1198591608 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f043803ca00 con 0x7f0448076b80 2024-08-18T22:33:24.678 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:23.888+0000 7f044d68f640 1 -- 172.21.15.121:0/1198591608 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0448111210 con 0x7f0448076b80 2024-08-18T22:33:24.678 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:23.888+0000 7f043f7fe640 1 -- 172.21.15.121:0/1198591608 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f043803a920 con 0x7f0448076b80 2024-08-18T22:33:24.678 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:23.888+0000 7f044d68f640 1 -- 172.21.15.121:0/1198591608 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0448111680 con 0x7f0448076b80 2024-08-18T22:33:24.678 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:23.889+0000 7f043f7fe640 1 -- 172.21.15.121:0/1198591608 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 8) v1 ==== 42636+0+0 (secure 0 0 0) 0x7f043803aa80 con 0x7f0448076b80 2024-08-18T22:33:24.678 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:23.889+0000 7f044d68f640 1 -- 172.21.15.121:0/1198591608 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f044804b4c0 con 0x7f0448076b80 2024-08-18T22:33:24.678 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:23.889+0000 7f043f7fe640 1 --2- 172.21.15.121:0/1198591608 >> [v2:172.21.15.121:6800/833901271,v1:172.21.15.121:6801/833901271] conn(0x7f0434035710 0x7f0434037bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:24.679 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:23.889+0000 7f043f7fe640 1 -- 172.21.15.121:0/1198591608 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f0438068390 con 0x7f0448076b80 2024-08-18T22:33:24.679 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:23.889+0000 7f043ffff640 1 --2- 172.21.15.121:0/1198591608 >> [v2:172.21.15.121:6800/833901271,v1:172.21.15.121:6801/833901271] conn(0x7f0434035710 0x7f0434037bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:24.679 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:23.890+0000 7f043ffff640 1 --2- 172.21.15.121:0/1198591608 >> [v2:172.21.15.121:6800/833901271,v1:172.21.15.121:6801/833901271] conn(0x7f0434035710 0x7f0434037bc0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f0430006fd0 tx=0x7f0430006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:33:24.679 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:23.894+0000 7f043f7fe640 1 -- 172.21.15.121:0/1198591608 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f0438046460 con 0x7f0448076b80 2024-08-18T22:33:24.679 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:24.063+0000 7f044d68f640 1 -- 172.21.15.121:0/1198591608 --> [v2:172.21.15.121:6800/833901271,v1:172.21.15.121:6801/833901271] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "crash", "target": ["mon-mgr", ""]}) v1 -- 0x7f0448111680 con 0x7f0434035710 2024-08-18T22:33:24.679 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:24.069+0000 7f043f7fe640 1 -- 172.21.15.121:0/1198591608 <== mgr.14118 v2:172.21.15.121:6800/833901271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+26 (secure 0 0 0) 0x7f0448111680 con 0x7f0434035710 2024-08-18T22:33:24.679 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:24.071+0000 7f044d68f640 1 -- 172.21.15.121:0/1198591608 >> [v2:172.21.15.121:6800/833901271,v1:172.21.15.121:6801/833901271] conn(0x7f0434035710 msgr2=0x7f0434037bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:24.679 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:24.071+0000 7f044d68f640 1 --2- 172.21.15.121:0/1198591608 >> [v2:172.21.15.121:6800/833901271,v1:172.21.15.121:6801/833901271] conn(0x7f0434035710 0x7f0434037bc0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f0430006fd0 tx=0x7f0430006db0 comp rx=0 tx=0).stop 2024-08-18T22:33:24.679 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:24.071+0000 7f044d68f640 1 -- 172.21.15.121:0/1198591608 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0448076b80 msgr2=0x7f0448110ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:24.679 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:24.071+0000 7f044d68f640 1 --2- 172.21.15.121:0/1198591608 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0448076b80 0x7f0448110ad0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f0438009420 tx=0x7f04380091d0 comp rx=0 tx=0).stop 2024-08-18T22:33:24.679 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:24.071+0000 7f044d68f640 1 -- 172.21.15.121:0/1198591608 shutdown_connections 2024-08-18T22:33:24.679 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:24.071+0000 7f044d68f640 1 --2- 172.21.15.121:0/1198591608 >> [v2:172.21.15.121:6800/833901271,v1:172.21.15.121:6801/833901271] conn(0x7f0434035710 0x7f0434037bc0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:24.679 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:24.071+0000 7f044d68f640 1 --2- 172.21.15.121:0/1198591608 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0448076b80 0x7f0448110ad0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:24.680 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:24.071+0000 7f044d68f640 1 -- 172.21.15.121:0/1198591608 >> 172.21.15.121:0/1198591608 conn(0x7f04480fc360 msgr2=0x7f04480fcf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:33:24.680 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:24.071+0000 7f044d68f640 1 -- 172.21.15.121:0/1198591608 shutdown_connections 2024-08-18T22:33:24.680 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:24.071+0000 7f044d68f640 1 -- 172.21.15.121:0/1198591608 wait complete. 2024-08-18T22:33:24.680 INFO:teuthology.orchestra.run.smithi121.stdout:Deploying prometheus service with default placement... 2024-08-18T22:33:25.302 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:33:25 smithi121 ceph-mon[16788]: from='client.14144 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "crash", "target": ["mon-mgr", ""]}]: dispatch 2024-08-18T22:33:25.302 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:33:25 smithi121 ceph-mon[16788]: Saving service crash spec with placement * 2024-08-18T22:33:25.303 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:33:25 smithi121 ceph-mon[16788]: from='mgr.14118 172.21.15.121:0/3177338859' entity='mgr.smithi121.lopxqc' 2024-08-18T22:33:25.303 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:33:25 smithi121 ceph-mon[16788]: from='mgr.14118 172.21.15.121:0/3177338859' entity='mgr.smithi121.lopxqc' 2024-08-18T22:33:25.860 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stdout Scheduled prometheus update... 2024-08-18T22:33:25.860 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:25.111+0000 7fd3fd68e640 1 Processor -- start 2024-08-18T22:33:25.860 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:25.111+0000 7fd3fd68e640 1 -- start start 2024-08-18T22:33:25.860 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:25.111+0000 7fd3fd68e640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd3f8103ef0 0x7fd3f8104300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:25.860 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:25.111+0000 7fd3fd68e640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3f8104840 con 0x7fd3f8103ef0 2024-08-18T22:33:25.860 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:25.111+0000 7fd3f6ffd640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd3f8103ef0 0x7fd3f8104300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:25.860 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:25.111+0000 7fd3f6ffd640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd3f8103ef0 0x7fd3f8104300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:35040/0 (socket says 172.21.15.121:35040) 2024-08-18T22:33:25.860 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:25.111+0000 7fd3f6ffd640 1 -- 172.21.15.121:0/2099244491 learned_addr learned my addr 172.21.15.121:0/2099244491 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-18T22:33:25.860 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:25.112+0000 7fd3f6ffd640 1 -- 172.21.15.121:0/2099244491 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3f8104980 con 0x7fd3f8103ef0 2024-08-18T22:33:25.860 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:25.112+0000 7fd3f6ffd640 1 --2- 172.21.15.121:0/2099244491 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd3f8103ef0 0x7fd3f8104300 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fd3e8009a50 tx=0x7fd3e80091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93c9558fbefdcec3 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:33:25.860 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:25.112+0000 7fd3f5ffb640 1 -- 172.21.15.121:0/2099244491 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd3e802f670 con 0x7fd3f8103ef0 2024-08-18T22:33:25.861 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:25.112+0000 7fd3f5ffb640 1 -- 172.21.15.121:0/2099244491 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fd3e802d050 con 0x7fd3f8103ef0 2024-08-18T22:33:25.861 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:25.112+0000 7fd3f5ffb640 1 -- 172.21.15.121:0/2099244491 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd3e8031c20 con 0x7fd3f8103ef0 2024-08-18T22:33:25.861 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:25.113+0000 7fd3fd68e640 1 -- 172.21.15.121:0/2099244491 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd3f8103ef0 msgr2=0x7fd3f8104300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:25.861 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:25.113+0000 7fd3fd68e640 1 --2- 172.21.15.121:0/2099244491 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd3f8103ef0 0x7fd3f8104300 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fd3e8009a50 tx=0x7fd3e80091d0 comp rx=0 tx=0).stop 2024-08-18T22:33:25.861 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:25.113+0000 7fd3fd68e640 1 -- 172.21.15.121:0/2099244491 shutdown_connections 2024-08-18T22:33:25.861 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:25.113+0000 7fd3fd68e640 1 --2- 172.21.15.121:0/2099244491 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd3f8103ef0 0x7fd3f8104300 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:25.861 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:25.113+0000 7fd3fd68e640 1 -- 172.21.15.121:0/2099244491 >> 172.21.15.121:0/2099244491 conn(0x7fd3f8077630 msgr2=0x7fd3f8077a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:33:25.861 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:25.113+0000 7fd3fd68e640 1 -- 172.21.15.121:0/2099244491 shutdown_connections 2024-08-18T22:33:25.861 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:25.113+0000 7fd3fd68e640 1 -- 172.21.15.121:0/2099244491 wait complete. 2024-08-18T22:33:25.861 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:25.114+0000 7fd3fd68e640 1 Processor -- start 2024-08-18T22:33:25.861 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:25.114+0000 7fd3fd68e640 1 -- start start 2024-08-18T22:33:25.861 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:25.114+0000 7fd3fd68e640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd3f8103ef0 0x7fd3f8112dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:25.862 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:25.114+0000 7fd3fd68e640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3f8113310 con 0x7fd3f8103ef0 2024-08-18T22:33:25.862 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:25.114+0000 7fd3f6ffd640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd3f8103ef0 0x7fd3f8112dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:25.862 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:25.114+0000 7fd3f6ffd640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd3f8103ef0 0x7fd3f8112dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:35046/0 (socket says 172.21.15.121:35046) 2024-08-18T22:33:25.862 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:25.114+0000 7fd3f6ffd640 1 -- 172.21.15.121:0/1404719949 learned_addr learned my addr 172.21.15.121:0/1404719949 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-18T22:33:25.862 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:25.114+0000 7fd3f6ffd640 1 -- 172.21.15.121:0/1404719949 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3e8009450 con 0x7fd3f8103ef0 2024-08-18T22:33:25.862 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:25.115+0000 7fd3f6ffd640 1 --2- 172.21.15.121:0/1404719949 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd3f8103ef0 0x7fd3f8112dd0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fd3e8006f00 tx=0x7fd3e80091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:33:25.862 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:25.115+0000 7fd3df7fe640 1 -- 172.21.15.121:0/1404719949 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd3e803a430 con 0x7fd3f8103ef0 2024-08-18T22:33:25.862 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:25.115+0000 7fd3df7fe640 1 -- 172.21.15.121:0/1404719949 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fd3e803aa30 con 0x7fd3f8103ef0 2024-08-18T22:33:25.862 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:25.115+0000 7fd3fd68e640 1 -- 172.21.15.121:0/1404719949 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3f8113510 con 0x7fd3f8103ef0 2024-08-18T22:33:25.862 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:25.115+0000 7fd3df7fe640 1 -- 172.21.15.121:0/1404719949 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd3e8039960 con 0x7fd3f8103ef0 2024-08-18T22:33:25.862 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:25.115+0000 7fd3fd68e640 1 -- 172.21.15.121:0/1404719949 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3f8113f60 con 0x7fd3f8103ef0 2024-08-18T22:33:25.862 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:25.115+0000 7fd3df7fe640 1 -- 172.21.15.121:0/1404719949 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 8) v1 ==== 42636+0+0 (secure 0 0 0) 0x7fd3e8039c20 con 0x7fd3f8103ef0 2024-08-18T22:33:25.863 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:25.116+0000 7fd3df7fe640 1 --2- 172.21.15.121:0/1404719949 >> [v2:172.21.15.121:6800/833901271,v1:172.21.15.121:6801/833901271] conn(0x7fd3e00356c0 0x7fd3e0037b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:25.863 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:25.116+0000 7fd3df7fe640 1 -- 172.21.15.121:0/1404719949 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7fd3e8068670 con 0x7fd3f8103ef0 2024-08-18T22:33:25.863 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:25.116+0000 7fd3fd68e640 1 -- 172.21.15.121:0/1404719949 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3f805eb10 con 0x7fd3f8103ef0 2024-08-18T22:33:25.863 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:25.116+0000 7fd3f67fc640 1 --2- 172.21.15.121:0/1404719949 >> [v2:172.21.15.121:6800/833901271,v1:172.21.15.121:6801/833901271] conn(0x7fd3e00356c0 0x7fd3e0037b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:25.863 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:25.116+0000 7fd3f67fc640 1 --2- 172.21.15.121:0/1404719949 >> [v2:172.21.15.121:6800/833901271,v1:172.21.15.121:6801/833901271] conn(0x7fd3e00356c0 0x7fd3e0037b70 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fd3ec006fd0 tx=0x7fd3ec006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:33:25.863 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:25.120+0000 7fd3df7fe640 1 -- 172.21.15.121:0/1404719949 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fd3e8038d80 con 0x7fd3f8103ef0 2024-08-18T22:33:25.863 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:25.300+0000 7fd3fd68e640 1 -- 172.21.15.121:0/1404719949 --> [v2:172.21.15.121:6800/833901271,v1:172.21.15.121:6801/833901271] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "prometheus", "target": ["mon-mgr", ""]}) v1 -- 0x7fd3f8106bf0 con 0x7fd3e00356c0 2024-08-18T22:33:25.863 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:25.305+0000 7fd3df7fe640 1 -- 172.21.15.121:0/1404719949 <== mgr.14118 v2:172.21.15.121:6800/833901271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+31 (secure 0 0 0) 0x7fd3f8106bf0 con 0x7fd3e00356c0 2024-08-18T22:33:25.863 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:25.307+0000 7fd3fd68e640 1 -- 172.21.15.121:0/1404719949 >> [v2:172.21.15.121:6800/833901271,v1:172.21.15.121:6801/833901271] conn(0x7fd3e00356c0 msgr2=0x7fd3e0037b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:25.863 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:25.307+0000 7fd3fd68e640 1 --2- 172.21.15.121:0/1404719949 >> [v2:172.21.15.121:6800/833901271,v1:172.21.15.121:6801/833901271] conn(0x7fd3e00356c0 0x7fd3e0037b70 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fd3ec006fd0 tx=0x7fd3ec006db0 comp rx=0 tx=0).stop 2024-08-18T22:33:25.863 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:25.307+0000 7fd3fd68e640 1 -- 172.21.15.121:0/1404719949 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd3f8103ef0 msgr2=0x7fd3f8112dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:25.863 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:25.307+0000 7fd3fd68e640 1 --2- 172.21.15.121:0/1404719949 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd3f8103ef0 0x7fd3f8112dd0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fd3e8006f00 tx=0x7fd3e80091d0 comp rx=0 tx=0).stop 2024-08-18T22:33:25.863 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:25.307+0000 7fd3fd68e640 1 -- 172.21.15.121:0/1404719949 shutdown_connections 2024-08-18T22:33:25.864 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:25.307+0000 7fd3fd68e640 1 --2- 172.21.15.121:0/1404719949 >> [v2:172.21.15.121:6800/833901271,v1:172.21.15.121:6801/833901271] conn(0x7fd3e00356c0 0x7fd3e0037b70 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:25.864 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:25.307+0000 7fd3fd68e640 1 --2- 172.21.15.121:0/1404719949 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd3f8103ef0 0x7fd3f8112dd0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:25.864 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:25.307+0000 7fd3fd68e640 1 -- 172.21.15.121:0/1404719949 >> 172.21.15.121:0/1404719949 conn(0x7fd3f8077630 msgr2=0x7fd3f8106480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:33:25.864 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:25.308+0000 7fd3fd68e640 1 -- 172.21.15.121:0/1404719949 shutdown_connections 2024-08-18T22:33:25.864 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:25.308+0000 7fd3fd68e640 1 -- 172.21.15.121:0/1404719949 wait complete. 2024-08-18T22:33:25.864 INFO:teuthology.orchestra.run.smithi121.stdout:Deploying grafana service with default placement... 2024-08-18T22:33:26.220 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:33:26 smithi121 ceph-mon[16788]: from='mgr.14118 172.21.15.121:0/3177338859' entity='mgr.smithi121.lopxqc' 2024-08-18T22:33:26.220 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:33:26 smithi121 ceph-mon[16788]: from='client.14146 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "prometheus", "target": ["mon-mgr", ""]}]: dispatch 2024-08-18T22:33:26.220 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:33:26 smithi121 ceph-mon[16788]: Saving service prometheus spec with placement count:1 2024-08-18T22:33:26.220 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:33:26 smithi121 ceph-mon[16788]: from='mgr.14118 172.21.15.121:0/3177338859' entity='mgr.smithi121.lopxqc' 2024-08-18T22:33:26.957 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stdout Scheduled grafana update... 2024-08-18T22:33:26.957 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:26.217+0000 7f882c568640 1 Processor -- start 2024-08-18T22:33:26.957 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:26.218+0000 7f882c568640 1 -- start start 2024-08-18T22:33:26.957 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:26.218+0000 7f882c568640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f88241011a0 0x7f88241015b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:26.957 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:26.218+0000 7f882c568640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8824101af0 con 0x7f88241011a0 2024-08-18T22:33:26.957 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:26.218+0000 7f882a304640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f88241011a0 0x7f88241015b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:26.958 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:26.218+0000 7f882a304640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f88241011a0 0x7f88241015b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:35058/0 (socket says 172.21.15.121:35058) 2024-08-18T22:33:26.958 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:26.218+0000 7f882a304640 1 -- 172.21.15.121:0/2887326953 learned_addr learned my addr 172.21.15.121:0/2887326953 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-18T22:33:26.958 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:26.218+0000 7f882a304640 1 -- 172.21.15.121:0/2887326953 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8824101c30 con 0x7f88241011a0 2024-08-18T22:33:26.958 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:26.219+0000 7f882a304640 1 --2- 172.21.15.121:0/2887326953 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f88241011a0 0x7f88241015b0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f8820009840 tx=0x7f88200091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ecd9a335d57b11b server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:33:26.958 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:26.219+0000 7f8829302640 1 -- 172.21.15.121:0/2887326953 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8820032440 con 0x7f88241011a0 2024-08-18T22:33:26.958 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:26.219+0000 7f8829302640 1 -- 172.21.15.121:0/2887326953 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f8820032a40 con 0x7f88241011a0 2024-08-18T22:33:26.958 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:26.219+0000 7f8829302640 1 -- 172.21.15.121:0/2887326953 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8820031a70 con 0x7f88241011a0 2024-08-18T22:33:26.958 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:26.220+0000 7f882c568640 1 -- 172.21.15.121:0/2887326953 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f88241011a0 msgr2=0x7f88241015b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:26.958 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:26.220+0000 7f882c568640 1 --2- 172.21.15.121:0/2887326953 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f88241011a0 0x7f88241015b0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f8820009840 tx=0x7f88200091d0 comp rx=0 tx=0).stop 2024-08-18T22:33:26.958 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:26.220+0000 7f882c568640 1 -- 172.21.15.121:0/2887326953 shutdown_connections 2024-08-18T22:33:26.958 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:26.220+0000 7f882c568640 1 --2- 172.21.15.121:0/2887326953 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f88241011a0 0x7f88241015b0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:26.958 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:26.220+0000 7f882c568640 1 -- 172.21.15.121:0/2887326953 >> 172.21.15.121:0/2887326953 conn(0x7f88240fbb30 msgr2=0x7f88240fdf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:33:26.958 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:26.220+0000 7f882c568640 1 -- 172.21.15.121:0/2887326953 shutdown_connections 2024-08-18T22:33:26.959 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:26.220+0000 7f882c568640 1 -- 172.21.15.121:0/2887326953 wait complete. 2024-08-18T22:33:26.959 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:26.220+0000 7f882c568640 1 Processor -- start 2024-08-18T22:33:26.959 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:26.220+0000 7f882c568640 1 -- start start 2024-08-18T22:33:26.959 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:26.221+0000 7f882c568640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f88241011a0 0x7f8824112e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:26.959 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:26.221+0000 7f882c568640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8824113380 con 0x7f88241011a0 2024-08-18T22:33:26.959 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:26.221+0000 7f882a304640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f88241011a0 0x7f8824112e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:26.959 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:26.221+0000 7f882a304640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f88241011a0 0x7f8824112e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:35062/0 (socket says 172.21.15.121:35062) 2024-08-18T22:33:26.959 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:26.221+0000 7f882a304640 1 -- 172.21.15.121:0/3558819464 learned_addr learned my addr 172.21.15.121:0/3558819464 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-18T22:33:26.959 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:26.221+0000 7f882a304640 1 -- 172.21.15.121:0/3558819464 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8820009450 con 0x7f88241011a0 2024-08-18T22:33:26.959 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:26.221+0000 7f882a304640 1 --2- 172.21.15.121:0/3558819464 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f88241011a0 0x7f8824112e40 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f8820009420 tx=0x7f88200091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:33:26.959 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:26.221+0000 7f881affd640 1 -- 172.21.15.121:0/3558819464 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f882003c400 con 0x7f88241011a0 2024-08-18T22:33:26.959 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:26.221+0000 7f881affd640 1 -- 172.21.15.121:0/3558819464 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f882003ca00 con 0x7f88241011a0 2024-08-18T22:33:26.959 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:26.221+0000 7f882c568640 1 -- 172.21.15.121:0/3558819464 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8824113580 con 0x7f88241011a0 2024-08-18T22:33:26.959 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:26.221+0000 7f881affd640 1 -- 172.21.15.121:0/3558819464 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f882003a920 con 0x7f88241011a0 2024-08-18T22:33:26.960 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:26.221+0000 7f882c568640 1 -- 172.21.15.121:0/3558819464 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8824113fd0 con 0x7f88241011a0 2024-08-18T22:33:26.960 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:26.222+0000 7f881affd640 1 -- 172.21.15.121:0/3558819464 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 8) v1 ==== 42636+0+0 (secure 0 0 0) 0x7f882003ab90 con 0x7f88241011a0 2024-08-18T22:33:26.960 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:26.222+0000 7f882c568640 1 -- 172.21.15.121:0/3558819464 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f882405eb10 con 0x7f88241011a0 2024-08-18T22:33:26.960 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:26.222+0000 7f881affd640 1 --2- 172.21.15.121:0/3558819464 >> [v2:172.21.15.121:6800/833901271,v1:172.21.15.121:6801/833901271] conn(0x7f88100356c0 0x7f8810037b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:26.960 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:26.222+0000 7f881affd640 1 -- 172.21.15.121:0/3558819464 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f8820068410 con 0x7f88241011a0 2024-08-18T22:33:26.960 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:26.223+0000 7f8829b03640 1 --2- 172.21.15.121:0/3558819464 >> [v2:172.21.15.121:6800/833901271,v1:172.21.15.121:6801/833901271] conn(0x7f88100356c0 0x7f8810037b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:26.960 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:26.223+0000 7f8829b03640 1 --2- 172.21.15.121:0/3558819464 >> [v2:172.21.15.121:6800/833901271,v1:172.21.15.121:6801/833901271] conn(0x7f88100356c0 0x7f8810037b70 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f8814006fd0 tx=0x7f8814006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:33:26.960 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:26.228+0000 7f881affd640 1 -- 172.21.15.121:0/3558819464 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f8820046460 con 0x7f88241011a0 2024-08-18T22:33:26.960 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:26.395+0000 7f882c568640 1 -- 172.21.15.121:0/3558819464 --> [v2:172.21.15.121:6800/833901271,v1:172.21.15.121:6801/833901271] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "grafana", "target": ["mon-mgr", ""]}) v1 -- 0x7f8824114bc0 con 0x7f88100356c0 2024-08-18T22:33:26.960 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:26.399+0000 7f881affd640 1 -- 172.21.15.121:0/3558819464 <== mgr.14118 v2:172.21.15.121:6800/833901271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+28 (secure 0 0 0) 0x7f8824114bc0 con 0x7f88100356c0 2024-08-18T22:33:26.960 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:26.401+0000 7f882c568640 1 -- 172.21.15.121:0/3558819464 >> [v2:172.21.15.121:6800/833901271,v1:172.21.15.121:6801/833901271] conn(0x7f88100356c0 msgr2=0x7f8810037b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:26.960 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:26.401+0000 7f882c568640 1 --2- 172.21.15.121:0/3558819464 >> [v2:172.21.15.121:6800/833901271,v1:172.21.15.121:6801/833901271] conn(0x7f88100356c0 0x7f8810037b70 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f8814006fd0 tx=0x7f8814006db0 comp rx=0 tx=0).stop 2024-08-18T22:33:26.960 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:26.401+0000 7f882c568640 1 -- 172.21.15.121:0/3558819464 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f88241011a0 msgr2=0x7f8824112e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:26.961 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:26.401+0000 7f882c568640 1 --2- 172.21.15.121:0/3558819464 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f88241011a0 0x7f8824112e40 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f8820009420 tx=0x7f88200091d0 comp rx=0 tx=0).stop 2024-08-18T22:33:26.961 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:26.401+0000 7f882c568640 1 -- 172.21.15.121:0/3558819464 shutdown_connections 2024-08-18T22:33:26.961 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:26.401+0000 7f882c568640 1 --2- 172.21.15.121:0/3558819464 >> [v2:172.21.15.121:6800/833901271,v1:172.21.15.121:6801/833901271] conn(0x7f88100356c0 0x7f8810037b70 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:26.961 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:26.401+0000 7f882c568640 1 --2- 172.21.15.121:0/3558819464 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f88241011a0 0x7f8824112e40 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:26.961 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:26.401+0000 7f882c568640 1 -- 172.21.15.121:0/3558819464 >> 172.21.15.121:0/3558819464 conn(0x7f88240fbb30 msgr2=0x7f88240fcab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:33:26.961 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:26.401+0000 7f882c568640 1 -- 172.21.15.121:0/3558819464 shutdown_connections 2024-08-18T22:33:26.961 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:26.401+0000 7f882c568640 1 -- 172.21.15.121:0/3558819464 wait complete. 2024-08-18T22:33:26.961 INFO:teuthology.orchestra.run.smithi121.stdout:Deploying node-exporter service with default placement... 2024-08-18T22:33:27.834 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:33:27 smithi121 ceph-mon[16788]: from='client.14148 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "grafana", "target": ["mon-mgr", ""]}]: dispatch 2024-08-18T22:33:27.834 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:33:27 smithi121 ceph-mon[16788]: Saving service grafana spec with placement count:1 2024-08-18T22:33:27.834 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:33:27 smithi121 ceph-mon[16788]: from='mgr.14118 172.21.15.121:0/3177338859' entity='mgr.smithi121.lopxqc' 2024-08-18T22:33:28.483 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stdout Scheduled node-exporter update... 2024-08-18T22:33:28.483 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:27.383+0000 7fdef2f26640 1 Processor -- start 2024-08-18T22:33:28.483 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:27.383+0000 7fdef2f26640 1 -- start start 2024-08-18T22:33:28.483 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:27.383+0000 7fdef2f26640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdeec1000b0 0x7fdeec1004c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:28.483 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:27.383+0000 7fdef2f26640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdeec100a00 con 0x7fdeec1000b0 2024-08-18T22:33:28.483 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:27.383+0000 7fdef0cc2640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdeec1000b0 0x7fdeec1004c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:28.484 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:27.383+0000 7fdef0cc2640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdeec1000b0 0x7fdeec1004c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:47130/0 (socket says 172.21.15.121:47130) 2024-08-18T22:33:28.484 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:27.383+0000 7fdef0cc2640 1 -- 172.21.15.121:0/2580875231 learned_addr learned my addr 172.21.15.121:0/2580875231 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-18T22:33:28.484 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:27.383+0000 7fdef0cc2640 1 -- 172.21.15.121:0/2580875231 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdeec100b40 con 0x7fdeec1000b0 2024-08-18T22:33:28.484 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:27.384+0000 7fdef0cc2640 1 --2- 172.21.15.121:0/2580875231 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdeec1000b0 0x7fdeec1004c0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fdee0009840 tx=0x7fdee00091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ac6fbb71055d234 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:33:28.484 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:27.384+0000 7fdeeb7fe640 1 -- 172.21.15.121:0/2580875231 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fdee0032440 con 0x7fdeec1000b0 2024-08-18T22:33:28.484 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:27.384+0000 7fdeeb7fe640 1 -- 172.21.15.121:0/2580875231 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fdee0032a40 con 0x7fdeec1000b0 2024-08-18T22:33:28.484 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:27.384+0000 7fdeeb7fe640 1 -- 172.21.15.121:0/2580875231 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fdee0031a70 con 0x7fdeec1000b0 2024-08-18T22:33:28.484 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:27.385+0000 7fdef2f26640 1 -- 172.21.15.121:0/2580875231 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdeec1000b0 msgr2=0x7fdeec1004c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:28.484 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:27.385+0000 7fdef2f26640 1 --2- 172.21.15.121:0/2580875231 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdeec1000b0 0x7fdeec1004c0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fdee0009840 tx=0x7fdee00091d0 comp rx=0 tx=0).stop 2024-08-18T22:33:28.484 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:27.385+0000 7fdef2f26640 1 -- 172.21.15.121:0/2580875231 shutdown_connections 2024-08-18T22:33:28.484 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:27.385+0000 7fdef2f26640 1 --2- 172.21.15.121:0/2580875231 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdeec1000b0 0x7fdeec1004c0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:28.484 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:27.385+0000 7fdef2f26640 1 -- 172.21.15.121:0/2580875231 >> 172.21.15.121:0/2580875231 conn(0x7fdeec0fbb30 msgr2=0x7fdeec0fdf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:33:28.484 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:27.385+0000 7fdef2f26640 1 -- 172.21.15.121:0/2580875231 shutdown_connections 2024-08-18T22:33:28.484 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:27.385+0000 7fdef2f26640 1 -- 172.21.15.121:0/2580875231 wait complete. 2024-08-18T22:33:28.485 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:27.385+0000 7fdef2f26640 1 Processor -- start 2024-08-18T22:33:28.485 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:27.385+0000 7fdef2f26640 1 -- start start 2024-08-18T22:33:28.485 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:27.386+0000 7fdef2f26640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdeec1000b0 0x7fdeec110e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:28.485 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:27.386+0000 7fdef2f26640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdeec111350 con 0x7fdeec1000b0 2024-08-18T22:33:28.485 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:27.386+0000 7fdef0cc2640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdeec1000b0 0x7fdeec110e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:28.485 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:27.386+0000 7fdef0cc2640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdeec1000b0 0x7fdeec110e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:47140/0 (socket says 172.21.15.121:47140) 2024-08-18T22:33:28.485 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:27.386+0000 7fdef0cc2640 1 -- 172.21.15.121:0/281011079 learned_addr learned my addr 172.21.15.121:0/281011079 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-18T22:33:28.485 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:27.386+0000 7fdef0cc2640 1 -- 172.21.15.121:0/281011079 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdee0009450 con 0x7fdeec1000b0 2024-08-18T22:33:28.485 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:27.386+0000 7fdef0cc2640 1 --2- 172.21.15.121:0/281011079 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdeec1000b0 0x7fdeec110e10 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fdee0009810 tx=0x7fdee00091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:33:28.485 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:27.386+0000 7fdee97fa640 1 -- 172.21.15.121:0/281011079 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fdee003c400 con 0x7fdeec1000b0 2024-08-18T22:33:28.485 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:27.386+0000 7fdef2f26640 1 -- 172.21.15.121:0/281011079 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdeec111550 con 0x7fdeec1000b0 2024-08-18T22:33:28.485 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:27.386+0000 7fdee97fa640 1 -- 172.21.15.121:0/281011079 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fdee003ca00 con 0x7fdeec1000b0 2024-08-18T22:33:28.485 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:27.386+0000 7fdee97fa640 1 -- 172.21.15.121:0/281011079 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fdee003a830 con 0x7fdeec1000b0 2024-08-18T22:33:28.485 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:27.386+0000 7fdef2f26640 1 -- 172.21.15.121:0/281011079 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdeec111fa0 con 0x7fdeec1000b0 2024-08-18T22:33:28.486 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:27.387+0000 7fdee97fa640 1 -- 172.21.15.121:0/281011079 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 8) v1 ==== 42636+0+0 (secure 0 0 0) 0x7fdee003aaf0 con 0x7fdeec1000b0 2024-08-18T22:33:28.486 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:27.387+0000 7fdef2f26640 1 -- 172.21.15.121:0/281011079 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdeec05eb10 con 0x7fdeec1000b0 2024-08-18T22:33:28.486 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:27.387+0000 7fdee97fa640 1 --2- 172.21.15.121:0/281011079 >> [v2:172.21.15.121:6800/833901271,v1:172.21.15.121:6801/833901271] conn(0x7fdedc0356c0 0x7fdedc037b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:28.486 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:27.387+0000 7fdee97fa640 1 -- 172.21.15.121:0/281011079 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7fdee0068360 con 0x7fdeec1000b0 2024-08-18T22:33:28.486 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:27.387+0000 7fdeebfff640 1 --2- 172.21.15.121:0/281011079 >> [v2:172.21.15.121:6800/833901271,v1:172.21.15.121:6801/833901271] conn(0x7fdedc0356c0 0x7fdedc037b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:28.486 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:27.388+0000 7fdeebfff640 1 --2- 172.21.15.121:0/281011079 >> [v2:172.21.15.121:6800/833901271,v1:172.21.15.121:6801/833901271] conn(0x7fdedc0356c0 0x7fdedc037b70 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fded8006fd0 tx=0x7fded8006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:33:28.486 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:27.392+0000 7fdee97fa640 1 -- 172.21.15.121:0/281011079 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fdee0039b70 con 0x7fdeec1000b0 2024-08-18T22:33:28.486 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:27.560+0000 7fdef2f26640 1 -- 172.21.15.121:0/281011079 --> [v2:172.21.15.121:6800/833901271,v1:172.21.15.121:6801/833901271] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "node-exporter", "target": ["mon-mgr", ""]}) v1 -- 0x7fdeec0fce30 con 0x7fdedc0356c0 2024-08-18T22:33:28.486 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:27.564+0000 7fdee97fa640 1 -- 172.21.15.121:0/281011079 <== mgr.14118 v2:172.21.15.121:6800/833901271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+34 (secure 0 0 0) 0x7fdeec0fce30 con 0x7fdedc0356c0 2024-08-18T22:33:28.486 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:27.566+0000 7fdef2f26640 1 -- 172.21.15.121:0/281011079 >> [v2:172.21.15.121:6800/833901271,v1:172.21.15.121:6801/833901271] conn(0x7fdedc0356c0 msgr2=0x7fdedc037b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:28.486 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:27.566+0000 7fdef2f26640 1 --2- 172.21.15.121:0/281011079 >> [v2:172.21.15.121:6800/833901271,v1:172.21.15.121:6801/833901271] conn(0x7fdedc0356c0 0x7fdedc037b70 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fded8006fd0 tx=0x7fded8006db0 comp rx=0 tx=0).stop 2024-08-18T22:33:28.486 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:27.566+0000 7fdef2f26640 1 -- 172.21.15.121:0/281011079 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdeec1000b0 msgr2=0x7fdeec110e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:28.487 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:27.566+0000 7fdef2f26640 1 --2- 172.21.15.121:0/281011079 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdeec1000b0 0x7fdeec110e10 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fdee0009810 tx=0x7fdee00091d0 comp rx=0 tx=0).stop 2024-08-18T22:33:28.487 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:27.566+0000 7fdef2f26640 1 -- 172.21.15.121:0/281011079 shutdown_connections 2024-08-18T22:33:28.487 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:27.566+0000 7fdef2f26640 1 --2- 172.21.15.121:0/281011079 >> [v2:172.21.15.121:6800/833901271,v1:172.21.15.121:6801/833901271] conn(0x7fdedc0356c0 0x7fdedc037b70 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:28.487 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:27.566+0000 7fdef2f26640 1 --2- 172.21.15.121:0/281011079 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdeec1000b0 0x7fdeec110e10 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:28.487 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:27.566+0000 7fdef2f26640 1 -- 172.21.15.121:0/281011079 >> 172.21.15.121:0/281011079 conn(0x7fdeec0fbb30 msgr2=0x7fdeec0fc6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:33:28.487 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:27.566+0000 7fdef2f26640 1 -- 172.21.15.121:0/281011079 shutdown_connections 2024-08-18T22:33:28.487 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:27.566+0000 7fdef2f26640 1 -- 172.21.15.121:0/281011079 wait complete. 2024-08-18T22:33:28.487 INFO:teuthology.orchestra.run.smithi121.stdout:Deploying alertmanager service with default placement... 2024-08-18T22:33:28.794 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:33:28 smithi121 ceph-mon[16788]: from='client.14150 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "node-exporter", "target": ["mon-mgr", ""]}]: dispatch 2024-08-18T22:33:28.795 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:33:28 smithi121 ceph-mon[16788]: Saving service node-exporter spec with placement * 2024-08-18T22:33:28.795 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:33:28 smithi121 ceph-mon[16788]: from='mgr.14118 172.21.15.121:0/3177338859' entity='mgr.smithi121.lopxqc' 2024-08-18T22:33:29.993 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stdout Scheduled alertmanager update... 2024-08-18T22:33:29.993 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:28.872+0000 7f94ce9ea640 1 Processor -- start 2024-08-18T22:33:29.993 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:28.872+0000 7f94ce9ea640 1 -- start start 2024-08-18T22:33:29.994 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:28.872+0000 7f94ce9ea640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f94c8070820 0x7f94c8106d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:29.994 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:28.873+0000 7f94ce9ea640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94c8102780 con 0x7f94c8070820 2024-08-18T22:33:29.994 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:28.873+0000 7f94c7fff640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f94c8070820 0x7f94c8106d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:29.994 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:28.873+0000 7f94c7fff640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f94c8070820 0x7f94c8106d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:47144/0 (socket says 172.21.15.121:47144) 2024-08-18T22:33:29.994 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:28.873+0000 7f94c7fff640 1 -- 172.21.15.121:0/2878579832 learned_addr learned my addr 172.21.15.121:0/2878579832 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-18T22:33:29.994 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:28.873+0000 7f94c7fff640 1 -- 172.21.15.121:0/2878579832 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94c81072d0 con 0x7f94c8070820 2024-08-18T22:33:29.994 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:28.874+0000 7f94c7fff640 1 --2- 172.21.15.121:0/2878579832 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f94c8070820 0x7f94c8106d90 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f94b8009840 tx=0x7f94b80091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f80fdfbb54176f49 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:33:29.995 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:28.874+0000 7f94c6ffd640 1 -- 172.21.15.121:0/2878579832 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f94b8032440 con 0x7f94c8070820 2024-08-18T22:33:29.995 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:28.874+0000 7f94c6ffd640 1 -- 172.21.15.121:0/2878579832 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f94b8032a40 con 0x7f94c8070820 2024-08-18T22:33:29.995 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:28.874+0000 7f94c6ffd640 1 -- 172.21.15.121:0/2878579832 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f94b8031a70 con 0x7f94c8070820 2024-08-18T22:33:29.995 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:28.875+0000 7f94ce9ea640 1 -- 172.21.15.121:0/2878579832 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f94c8070820 msgr2=0x7f94c8106d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:29.995 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:28.875+0000 7f94ce9ea640 1 --2- 172.21.15.121:0/2878579832 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f94c8070820 0x7f94c8106d90 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f94b8009840 tx=0x7f94b80091d0 comp rx=0 tx=0).stop 2024-08-18T22:33:29.995 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:28.875+0000 7f94ce9ea640 1 -- 172.21.15.121:0/2878579832 shutdown_connections 2024-08-18T22:33:29.995 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:28.875+0000 7f94ce9ea640 1 --2- 172.21.15.121:0/2878579832 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f94c8070820 0x7f94c8106d90 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:29.995 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:28.875+0000 7f94ce9ea640 1 -- 172.21.15.121:0/2878579832 >> 172.21.15.121:0/2878579832 conn(0x7f94c80fc3a0 msgr2=0x7f94c80fe7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:33:29.995 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:28.875+0000 7f94ce9ea640 1 -- 172.21.15.121:0/2878579832 shutdown_connections 2024-08-18T22:33:29.996 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:28.875+0000 7f94ce9ea640 1 -- 172.21.15.121:0/2878579832 wait complete. 2024-08-18T22:33:29.996 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:28.875+0000 7f94ce9ea640 1 Processor -- start 2024-08-18T22:33:29.996 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:28.876+0000 7f94ce9ea640 1 -- start start 2024-08-18T22:33:29.996 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:28.876+0000 7f94ce9ea640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f94c8070820 0x7f94c8112e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:29.996 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:28.876+0000 7f94ce9ea640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94c8113390 con 0x7f94c8070820 2024-08-18T22:33:29.996 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:28.876+0000 7f94c7fff640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f94c8070820 0x7f94c8112e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:29.996 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:28.876+0000 7f94c7fff640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f94c8070820 0x7f94c8112e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:47158/0 (socket says 172.21.15.121:47158) 2024-08-18T22:33:29.996 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:28.876+0000 7f94c7fff640 1 -- 172.21.15.121:0/337009445 learned_addr learned my addr 172.21.15.121:0/337009445 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-18T22:33:29.997 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:28.876+0000 7f94c7fff640 1 -- 172.21.15.121:0/337009445 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94b8009450 con 0x7f94c8070820 2024-08-18T22:33:29.997 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:28.876+0000 7f94c7fff640 1 --2- 172.21.15.121:0/337009445 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f94c8070820 0x7f94c8112e50 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f94b8009420 tx=0x7f94b80091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:33:29.997 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:28.876+0000 7f94c4ff9640 1 -- 172.21.15.121:0/337009445 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f94b803c400 con 0x7f94c8070820 2024-08-18T22:33:29.997 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:28.876+0000 7f94c4ff9640 1 -- 172.21.15.121:0/337009445 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f94b803ca00 con 0x7f94c8070820 2024-08-18T22:33:29.997 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:28.876+0000 7f94ce9ea640 1 -- 172.21.15.121:0/337009445 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94c8113590 con 0x7f94c8070820 2024-08-18T22:33:29.997 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:28.876+0000 7f94c4ff9640 1 -- 172.21.15.121:0/337009445 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f94b803a920 con 0x7f94c8070820 2024-08-18T22:33:29.997 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:28.877+0000 7f94ce9ea640 1 -- 172.21.15.121:0/337009445 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94c8113fe0 con 0x7f94c8070820 2024-08-18T22:33:29.997 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:28.877+0000 7f94c4ff9640 1 -- 172.21.15.121:0/337009445 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 8) v1 ==== 42636+0+0 (secure 0 0 0) 0x7f94b803ab90 con 0x7f94c8070820 2024-08-18T22:33:29.998 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:28.877+0000 7f94ce9ea640 1 -- 172.21.15.121:0/337009445 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94c805eb10 con 0x7f94c8070820 2024-08-18T22:33:29.998 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:28.878+0000 7f94c4ff9640 1 --2- 172.21.15.121:0/337009445 >> [v2:172.21.15.121:6800/833901271,v1:172.21.15.121:6801/833901271] conn(0x7f94b00356c0 0x7f94b0037b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:29.998 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:28.878+0000 7f94c4ff9640 1 -- 172.21.15.121:0/337009445 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f94b80683e0 con 0x7f94c8070820 2024-08-18T22:33:29.998 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:28.878+0000 7f94c77fe640 1 --2- 172.21.15.121:0/337009445 >> [v2:172.21.15.121:6800/833901271,v1:172.21.15.121:6801/833901271] conn(0x7f94b00356c0 0x7f94b0037b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:29.998 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:28.878+0000 7f94c77fe640 1 --2- 172.21.15.121:0/337009445 >> [v2:172.21.15.121:6800/833901271,v1:172.21.15.121:6801/833901271] conn(0x7f94b00356c0 0x7f94b0037b70 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f94bc006fd0 tx=0x7f94bc006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:33:29.998 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:28.882+0000 7f94c4ff9640 1 -- 172.21.15.121:0/337009445 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f94b803b360 con 0x7f94c8070820 2024-08-18T22:33:29.998 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:29.049+0000 7f94ce9ea640 1 -- 172.21.15.121:0/337009445 --> [v2:172.21.15.121:6800/833901271,v1:172.21.15.121:6801/833901271] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "alertmanager", "target": ["mon-mgr", ""]}) v1 -- 0x7f94c80fd7c0 con 0x7f94b00356c0 2024-08-18T22:33:29.998 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:29.054+0000 7f94c4ff9640 1 -- 172.21.15.121:0/337009445 <== mgr.14118 v2:172.21.15.121:6800/833901271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+33 (secure 0 0 0) 0x7f94c80fd7c0 con 0x7f94b00356c0 2024-08-18T22:33:29.998 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:29.056+0000 7f94ce9ea640 1 -- 172.21.15.121:0/337009445 >> [v2:172.21.15.121:6800/833901271,v1:172.21.15.121:6801/833901271] conn(0x7f94b00356c0 msgr2=0x7f94b0037b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:29.998 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:29.056+0000 7f94ce9ea640 1 --2- 172.21.15.121:0/337009445 >> [v2:172.21.15.121:6800/833901271,v1:172.21.15.121:6801/833901271] conn(0x7f94b00356c0 0x7f94b0037b70 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f94bc006fd0 tx=0x7f94bc006db0 comp rx=0 tx=0).stop 2024-08-18T22:33:29.998 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:29.056+0000 7f94ce9ea640 1 -- 172.21.15.121:0/337009445 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f94c8070820 msgr2=0x7f94c8112e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:29.999 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:29.056+0000 7f94ce9ea640 1 --2- 172.21.15.121:0/337009445 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f94c8070820 0x7f94c8112e50 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f94b8009420 tx=0x7f94b80091d0 comp rx=0 tx=0).stop 2024-08-18T22:33:29.999 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:29.056+0000 7f94ce9ea640 1 -- 172.21.15.121:0/337009445 shutdown_connections 2024-08-18T22:33:29.999 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:29.056+0000 7f94ce9ea640 1 --2- 172.21.15.121:0/337009445 >> [v2:172.21.15.121:6800/833901271,v1:172.21.15.121:6801/833901271] conn(0x7f94b00356c0 0x7f94b0037b70 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:29.999 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:29.056+0000 7f94ce9ea640 1 --2- 172.21.15.121:0/337009445 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f94c8070820 0x7f94c8112e50 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:29.999 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:29.056+0000 7f94ce9ea640 1 -- 172.21.15.121:0/337009445 >> 172.21.15.121:0/337009445 conn(0x7f94c80fc3a0 msgr2=0x7f94c80fd010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:33:29.999 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:29.056+0000 7f94ce9ea640 1 -- 172.21.15.121:0/337009445 shutdown_connections 2024-08-18T22:33:29.999 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:29.056+0000 7f94ce9ea640 1 -- 172.21.15.121:0/337009445 wait complete. 2024-08-18T22:33:30.279 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:33:30 smithi121 ceph-mon[16788]: from='client.14152 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "alertmanager", "target": ["mon-mgr", ""]}]: dispatch 2024-08-18T22:33:30.279 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:33:30 smithi121 ceph-mon[16788]: Saving service alertmanager spec with placement count:1 2024-08-18T22:33:30.279 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:33:30 smithi121 ceph-mon[16788]: from='mgr.14118 172.21.15.121:0/3177338859' entity='mgr.smithi121.lopxqc' 2024-08-18T22:33:31.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:33:31 smithi121 ceph-mon[16788]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-18T22:33:31.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:33:31 smithi121 ceph-mon[16788]: from='client.? 172.21.15.121:0/145346582' entity='client.admin' 2024-08-18T22:33:31.099 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:30.358+0000 7ff3630a1640 1 Processor -- start 2024-08-18T22:33:31.099 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:30.358+0000 7ff3630a1640 1 -- start start 2024-08-18T22:33:31.099 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:30.359+0000 7ff3630a1640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff35c100bb0 0x7ff35c100fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:31.099 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:30.359+0000 7ff3630a1640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff35c101500 con 0x7ff35c100bb0 2024-08-18T22:33:31.099 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:30.359+0000 7ff360e3d640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff35c100bb0 0x7ff35c100fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:31.099 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:30.359+0000 7ff360e3d640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff35c100bb0 0x7ff35c100fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:47172/0 (socket says 172.21.15.121:47172) 2024-08-18T22:33:31.099 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:30.359+0000 7ff360e3d640 1 -- 172.21.15.121:0/1890072062 learned_addr learned my addr 172.21.15.121:0/1890072062 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-18T22:33:31.099 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:30.359+0000 7ff360e3d640 1 -- 172.21.15.121:0/1890072062 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff35c101640 con 0x7ff35c100bb0 2024-08-18T22:33:31.100 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:30.360+0000 7ff360e3d640 1 --2- 172.21.15.121:0/1890072062 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff35c100bb0 0x7ff35c100fc0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7ff35000baf0 tx=0x7ff35000b460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cfa346001207a179 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:33:31.100 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:30.360+0000 7ff35b7fe640 1 -- 172.21.15.121:0/1890072062 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff3500327a0 con 0x7ff35c100bb0 2024-08-18T22:33:31.100 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:30.360+0000 7ff35b7fe640 1 -- 172.21.15.121:0/1890072062 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7ff350032da0 con 0x7ff35c100bb0 2024-08-18T22:33:31.100 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:30.360+0000 7ff35b7fe640 1 -- 172.21.15.121:0/1890072062 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff350031e60 con 0x7ff35c100bb0 2024-08-18T22:33:31.100 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:30.360+0000 7ff3630a1640 1 -- 172.21.15.121:0/1890072062 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff35c100bb0 msgr2=0x7ff35c100fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:31.100 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:30.360+0000 7ff3630a1640 1 --2- 172.21.15.121:0/1890072062 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff35c100bb0 0x7ff35c100fc0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7ff35000baf0 tx=0x7ff35000b460 comp rx=0 tx=0).stop 2024-08-18T22:33:31.100 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:30.361+0000 7ff3630a1640 1 -- 172.21.15.121:0/1890072062 shutdown_connections 2024-08-18T22:33:31.100 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:30.361+0000 7ff3630a1640 1 --2- 172.21.15.121:0/1890072062 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff35c100bb0 0x7ff35c100fc0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:31.100 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:30.361+0000 7ff3630a1640 1 -- 172.21.15.121:0/1890072062 >> 172.21.15.121:0/1890072062 conn(0x7ff35c0fc350 msgr2=0x7ff35c0fe7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:33:31.100 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:30.361+0000 7ff3630a1640 1 -- 172.21.15.121:0/1890072062 shutdown_connections 2024-08-18T22:33:31.100 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:30.361+0000 7ff3630a1640 1 -- 172.21.15.121:0/1890072062 wait complete. 2024-08-18T22:33:31.100 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:30.361+0000 7ff3630a1640 1 Processor -- start 2024-08-18T22:33:31.100 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:30.361+0000 7ff3630a1640 1 -- start start 2024-08-18T22:33:31.101 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:30.362+0000 7ff3630a1640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff35c100bb0 0x7ff35c112cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:31.101 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:30.362+0000 7ff3630a1640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff35c113230 con 0x7ff35c100bb0 2024-08-18T22:33:31.101 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:30.362+0000 7ff360e3d640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff35c100bb0 0x7ff35c112cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:31.101 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:30.362+0000 7ff360e3d640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff35c100bb0 0x7ff35c112cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:47188/0 (socket says 172.21.15.121:47188) 2024-08-18T22:33:31.101 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:30.362+0000 7ff360e3d640 1 -- 172.21.15.121:0/145346582 learned_addr learned my addr 172.21.15.121:0/145346582 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-18T22:33:31.101 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:30.362+0000 7ff360e3d640 1 -- 172.21.15.121:0/145346582 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff35000b700 con 0x7ff35c100bb0 2024-08-18T22:33:31.101 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:30.362+0000 7ff360e3d640 1 --2- 172.21.15.121:0/145346582 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff35c100bb0 0x7ff35c112cf0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7ff35000b2c0 tx=0x7ff350008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:33:31.101 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:30.362+0000 7ff3597fa640 1 -- 172.21.15.121:0/145346582 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff3500329b0 con 0x7ff35c100bb0 2024-08-18T22:33:31.101 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:30.362+0000 7ff3597fa640 1 -- 172.21.15.121:0/145346582 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7ff350032b10 con 0x7ff35c100bb0 2024-08-18T22:33:31.101 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:30.362+0000 7ff3630a1640 1 -- 172.21.15.121:0/145346582 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff35c113430 con 0x7ff35c100bb0 2024-08-18T22:33:31.101 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:30.362+0000 7ff3597fa640 1 -- 172.21.15.121:0/145346582 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff350045640 con 0x7ff35c100bb0 2024-08-18T22:33:31.101 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:30.362+0000 7ff3630a1640 1 -- 172.21.15.121:0/145346582 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff35c1138a0 con 0x7ff35c100bb0 2024-08-18T22:33:31.101 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:30.363+0000 7ff3597fa640 1 -- 172.21.15.121:0/145346582 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 8) v1 ==== 42636+0+0 (secure 0 0 0) 0x7ff350045880 con 0x7ff35c100bb0 2024-08-18T22:33:31.101 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:30.363+0000 7ff3597fa640 1 --2- 172.21.15.121:0/145346582 >> [v2:172.21.15.121:6800/833901271,v1:172.21.15.121:6801/833901271] conn(0x7ff34c0356c0 0x7ff34c037b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:31.101 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:30.363+0000 7ff3597fa640 1 -- 172.21.15.121:0/145346582 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7ff35003bb70 con 0x7ff35c100bb0 2024-08-18T22:33:31.102 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:30.363+0000 7ff35bfff640 1 --2- 172.21.15.121:0/145346582 >> [v2:172.21.15.121:6800/833901271,v1:172.21.15.121:6801/833901271] conn(0x7ff34c0356c0 0x7ff34c037b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:31.102 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:30.363+0000 7ff3630a1640 1 -- 172.21.15.121:0/145346582 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff35c05eb10 con 0x7ff35c100bb0 2024-08-18T22:33:31.102 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:30.364+0000 7ff35bfff640 1 --2- 172.21.15.121:0/145346582 >> [v2:172.21.15.121:6800/833901271,v1:172.21.15.121:6801/833901271] conn(0x7ff34c0356c0 0x7ff34c037b70 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7ff348006fd0 tx=0x7ff348006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:33:31.102 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:30.368+0000 7ff3597fa640 1 -- 172.21.15.121:0/145346582 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7ff350036030 con 0x7ff35c100bb0 2024-08-18T22:33:31.102 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:30.523+0000 7ff3630a1640 1 -- 172.21.15.121:0/145346582 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/container_init}] v 0) v1 -- 0x7ff35c04b4c0 con 0x7ff35c100bb0 2024-08-18T22:33:31.102 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:30.529+0000 7ff3597fa640 1 -- 172.21.15.121:0/145346582 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/container_init}]=0 v7)=0 v7) v1 ==== 142+0+0 (secure 0 0 0) 0x7ff350067020 con 0x7ff35c100bb0 2024-08-18T22:33:31.102 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:30.532+0000 7ff3630a1640 1 -- 172.21.15.121:0/145346582 >> [v2:172.21.15.121:6800/833901271,v1:172.21.15.121:6801/833901271] conn(0x7ff34c0356c0 msgr2=0x7ff34c037b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:31.103 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:30.532+0000 7ff3630a1640 1 --2- 172.21.15.121:0/145346582 >> [v2:172.21.15.121:6800/833901271,v1:172.21.15.121:6801/833901271] conn(0x7ff34c0356c0 0x7ff34c037b70 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7ff348006fd0 tx=0x7ff348006db0 comp rx=0 tx=0).stop 2024-08-18T22:33:31.103 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:30.532+0000 7ff3630a1640 1 -- 172.21.15.121:0/145346582 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff35c100bb0 msgr2=0x7ff35c112cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:31.103 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:30.532+0000 7ff3630a1640 1 --2- 172.21.15.121:0/145346582 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff35c100bb0 0x7ff35c112cf0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7ff35000b2c0 tx=0x7ff350008040 comp rx=0 tx=0).stop 2024-08-18T22:33:31.103 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:30.532+0000 7ff3630a1640 1 -- 172.21.15.121:0/145346582 shutdown_connections 2024-08-18T22:33:31.103 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:30.532+0000 7ff3630a1640 1 --2- 172.21.15.121:0/145346582 >> [v2:172.21.15.121:6800/833901271,v1:172.21.15.121:6801/833901271] conn(0x7ff34c0356c0 0x7ff34c037b70 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:31.103 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:30.532+0000 7ff3630a1640 1 --2- 172.21.15.121:0/145346582 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff35c100bb0 0x7ff35c112cf0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:31.103 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:30.532+0000 7ff3630a1640 1 -- 172.21.15.121:0/145346582 >> 172.21.15.121:0/145346582 conn(0x7ff35c0fc350 msgr2=0x7ff35c105160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:33:31.103 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:30.532+0000 7ff3630a1640 1 -- 172.21.15.121:0/145346582 shutdown_connections 2024-08-18T22:33:31.103 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:30.532+0000 7ff3630a1640 1 -- 172.21.15.121:0/145346582 wait complete. 2024-08-18T22:33:32.204 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:31.480+0000 7f6b7337d640 1 Processor -- start 2024-08-18T22:33:32.204 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:31.480+0000 7f6b7337d640 1 -- start start 2024-08-18T22:33:32.204 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:31.480+0000 7f6b7337d640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6b6c078c90 0x7f6b6c0771c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:32.205 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:31.480+0000 7f6b7337d640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b6c0790a0 con 0x7f6b6c078c90 2024-08-18T22:33:32.205 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:31.480+0000 7f6b71119640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6b6c078c90 0x7f6b6c0771c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:32.205 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:31.480+0000 7f6b71119640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6b6c078c90 0x7f6b6c0771c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:47192/0 (socket says 172.21.15.121:47192) 2024-08-18T22:33:32.205 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:31.480+0000 7f6b71119640 1 -- 172.21.15.121:0/3137013771 learned_addr learned my addr 172.21.15.121:0/3137013771 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-18T22:33:32.205 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:31.480+0000 7f6b71119640 1 -- 172.21.15.121:0/3137013771 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b6c077700 con 0x7f6b6c078c90 2024-08-18T22:33:32.205 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:31.481+0000 7f6b71119640 1 --2- 172.21.15.121:0/3137013771 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6b6c078c90 0x7f6b6c0771c0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f6b68009840 tx=0x7f6b680091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc8f522b587cd1ae server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:33:32.205 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:31.481+0000 7f6b63fff640 1 -- 172.21.15.121:0/3137013771 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6b68032440 con 0x7f6b6c078c90 2024-08-18T22:33:32.205 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:31.481+0000 7f6b63fff640 1 -- 172.21.15.121:0/3137013771 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f6b68032a40 con 0x7f6b6c078c90 2024-08-18T22:33:32.205 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:31.481+0000 7f6b63fff640 1 -- 172.21.15.121:0/3137013771 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6b68031a70 con 0x7f6b6c078c90 2024-08-18T22:33:32.205 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:31.482+0000 7f6b7337d640 1 -- 172.21.15.121:0/3137013771 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6b6c078c90 msgr2=0x7f6b6c0771c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:32.205 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:31.482+0000 7f6b7337d640 1 --2- 172.21.15.121:0/3137013771 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6b6c078c90 0x7f6b6c0771c0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f6b68009840 tx=0x7f6b680091d0 comp rx=0 tx=0).stop 2024-08-18T22:33:32.205 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:31.482+0000 7f6b7337d640 1 -- 172.21.15.121:0/3137013771 shutdown_connections 2024-08-18T22:33:32.205 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:31.482+0000 7f6b7337d640 1 --2- 172.21.15.121:0/3137013771 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6b6c078c90 0x7f6b6c0771c0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:32.206 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:31.482+0000 7f6b7337d640 1 -- 172.21.15.121:0/3137013771 >> 172.21.15.121:0/3137013771 conn(0x7f6b6c0fd510 msgr2=0x7f6b6c0ff8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:33:32.206 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:31.482+0000 7f6b7337d640 1 -- 172.21.15.121:0/3137013771 shutdown_connections 2024-08-18T22:33:32.206 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:31.482+0000 7f6b7337d640 1 -- 172.21.15.121:0/3137013771 wait complete. 2024-08-18T22:33:32.206 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:31.483+0000 7f6b7337d640 1 Processor -- start 2024-08-18T22:33:32.206 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:31.483+0000 7f6b7337d640 1 -- start start 2024-08-18T22:33:32.206 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:31.483+0000 7f6b7337d640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6b6c078c90 0x7f6b6c112dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:32.206 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:31.483+0000 7f6b7337d640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b6c113310 con 0x7f6b6c078c90 2024-08-18T22:33:32.206 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:31.483+0000 7f6b71119640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6b6c078c90 0x7f6b6c112dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:32.206 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:31.483+0000 7f6b71119640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6b6c078c90 0x7f6b6c112dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:47202/0 (socket says 172.21.15.121:47202) 2024-08-18T22:33:32.206 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:31.483+0000 7f6b71119640 1 -- 172.21.15.121:0/261710849 learned_addr learned my addr 172.21.15.121:0/261710849 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-18T22:33:32.206 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:31.483+0000 7f6b71119640 1 -- 172.21.15.121:0/261710849 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b68009450 con 0x7f6b6c078c90 2024-08-18T22:33:32.206 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:31.483+0000 7f6b71119640 1 --2- 172.21.15.121:0/261710849 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6b6c078c90 0x7f6b6c112dd0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f6b68009420 tx=0x7f6b680091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:33:32.207 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:31.483+0000 7f6b61ffb640 1 -- 172.21.15.121:0/261710849 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6b6803c400 con 0x7f6b6c078c90 2024-08-18T22:33:32.207 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:31.484+0000 7f6b61ffb640 1 -- 172.21.15.121:0/261710849 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f6b6803ca00 con 0x7f6b6c078c90 2024-08-18T22:33:32.207 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:31.484+0000 7f6b7337d640 1 -- 172.21.15.121:0/261710849 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b6c113510 con 0x7f6b6c078c90 2024-08-18T22:33:32.207 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:31.484+0000 7f6b61ffb640 1 -- 172.21.15.121:0/261710849 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6b6803a8d0 con 0x7f6b6c078c90 2024-08-18T22:33:32.207 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:31.484+0000 7f6b7337d640 1 -- 172.21.15.121:0/261710849 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b6c113f60 con 0x7f6b6c078c90 2024-08-18T22:33:32.207 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:31.485+0000 7f6b61ffb640 1 -- 172.21.15.121:0/261710849 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 8) v1 ==== 42636+0+0 (secure 0 0 0) 0x7f6b6803c560 con 0x7f6b6c078c90 2024-08-18T22:33:32.207 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:31.485+0000 7f6b61ffb640 1 --2- 172.21.15.121:0/261710849 >> [v2:172.21.15.121:6800/833901271,v1:172.21.15.121:6801/833901271] conn(0x7f6b58035710 0x7f6b58037bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:32.207 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:31.485+0000 7f6b61ffb640 1 -- 172.21.15.121:0/261710849 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f6b680683c0 con 0x7f6b6c078c90 2024-08-18T22:33:32.207 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:31.485+0000 7f6b7337d640 1 -- 172.21.15.121:0/261710849 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b6c05eb10 con 0x7f6b6c078c90 2024-08-18T22:33:32.207 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:31.485+0000 7f6b70918640 1 --2- 172.21.15.121:0/261710849 >> [v2:172.21.15.121:6800/833901271,v1:172.21.15.121:6801/833901271] conn(0x7f6b58035710 0x7f6b58037bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:32.207 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:31.485+0000 7f6b70918640 1 --2- 172.21.15.121:0/261710849 >> [v2:172.21.15.121:6800/833901271,v1:172.21.15.121:6801/833901271] conn(0x7f6b58035710 0x7f6b58037bc0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f6b5c006fd0 tx=0x7f6b5c006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:33:32.207 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:31.490+0000 7f6b61ffb640 1 -- 172.21.15.121:0/261710849 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f6b68037030 con 0x7f6b6c078c90 2024-08-18T22:33:32.207 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:31.646+0000 7f6b7337d640 1 -- 172.21.15.121:0/261710849 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command([{prefix=config set, name=mgr/dashboard/ssl_server_port}] v 0) v1 -- 0x7f6b6c107f40 con 0x7f6b6c078c90 2024-08-18T22:33:32.207 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:31.649+0000 7f6b61ffb640 1 -- 172.21.15.121:0/261710849 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/dashboard/ssl_server_port}]=0 v8)=0 v8) v1 ==== 130+0+0 (secure 0 0 0) 0x7f6b68046460 con 0x7f6b6c078c90 2024-08-18T22:33:32.208 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:31.651+0000 7f6b7337d640 1 -- 172.21.15.121:0/261710849 >> [v2:172.21.15.121:6800/833901271,v1:172.21.15.121:6801/833901271] conn(0x7f6b58035710 msgr2=0x7f6b58037bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:32.208 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:31.651+0000 7f6b7337d640 1 --2- 172.21.15.121:0/261710849 >> [v2:172.21.15.121:6800/833901271,v1:172.21.15.121:6801/833901271] conn(0x7f6b58035710 0x7f6b58037bc0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f6b5c006fd0 tx=0x7f6b5c006db0 comp rx=0 tx=0).stop 2024-08-18T22:33:32.208 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:31.651+0000 7f6b7337d640 1 -- 172.21.15.121:0/261710849 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6b6c078c90 msgr2=0x7f6b6c112dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:32.208 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:31.651+0000 7f6b7337d640 1 --2- 172.21.15.121:0/261710849 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6b6c078c90 0x7f6b6c112dd0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f6b68009420 tx=0x7f6b680091d0 comp rx=0 tx=0).stop 2024-08-18T22:33:32.208 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:31.651+0000 7f6b7337d640 1 -- 172.21.15.121:0/261710849 shutdown_connections 2024-08-18T22:33:32.208 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:31.651+0000 7f6b7337d640 1 --2- 172.21.15.121:0/261710849 >> [v2:172.21.15.121:6800/833901271,v1:172.21.15.121:6801/833901271] conn(0x7f6b58035710 0x7f6b58037bc0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:32.208 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:31.651+0000 7f6b7337d640 1 --2- 172.21.15.121:0/261710849 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6b6c078c90 0x7f6b6c112dd0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:32.208 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:31.651+0000 7f6b7337d640 1 -- 172.21.15.121:0/261710849 >> 172.21.15.121:0/261710849 conn(0x7f6b6c0fd510 msgr2=0x7f6b6c0fe0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:33:32.208 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:31.651+0000 7f6b7337d640 1 -- 172.21.15.121:0/261710849 shutdown_connections 2024-08-18T22:33:32.208 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:31.651+0000 7f6b7337d640 1 -- 172.21.15.121:0/261710849 wait complete. 2024-08-18T22:33:32.208 INFO:teuthology.orchestra.run.smithi121.stdout:Enabling the dashboard module... 2024-08-18T22:33:33.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:33:32 smithi121 ceph-mon[16788]: from='client.? 172.21.15.121:0/261710849' entity='client.admin' 2024-08-18T22:33:33.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:33:32 smithi121 ceph-mon[16788]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-18T22:33:33.834 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:33:33 smithi121 ceph-mon[16788]: from='client.? 172.21.15.121:0/2279311624' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2024-08-18T22:33:34.242 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:32.623+0000 7f3217bf7640 1 Processor -- start 2024-08-18T22:33:34.242 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:32.623+0000 7f3217bf7640 1 -- start start 2024-08-18T22:33:34.242 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:32.623+0000 7f3217bf7640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3210100bb0 0x7f3210100fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:34.242 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:32.623+0000 7f3217bf7640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3210101500 con 0x7f3210100bb0 2024-08-18T22:33:34.242 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:32.624+0000 7f3215993640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3210100bb0 0x7f3210100fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:34.242 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:32.624+0000 7f3215993640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3210100bb0 0x7f3210100fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:47210/0 (socket says 172.21.15.121:47210) 2024-08-18T22:33:34.242 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:32.624+0000 7f3215993640 1 -- 172.21.15.121:0/1900824780 learned_addr learned my addr 172.21.15.121:0/1900824780 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-18T22:33:34.242 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:32.624+0000 7f3215993640 1 -- 172.21.15.121:0/1900824780 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3210101640 con 0x7f3210100bb0 2024-08-18T22:33:34.242 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:32.625+0000 7f3215993640 1 --2- 172.21.15.121:0/1900824780 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3210100bb0 0x7f3210100fc0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f320c009840 tx=0x7f320c0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7208b3b16ab3fae server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:33:34.243 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:32.625+0000 7f3214991640 1 -- 172.21.15.121:0/1900824780 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f320c032440 con 0x7f3210100bb0 2024-08-18T22:33:34.243 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:32.625+0000 7f3214991640 1 -- 172.21.15.121:0/1900824780 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f320c032a40 con 0x7f3210100bb0 2024-08-18T22:33:34.243 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:32.625+0000 7f3214991640 1 -- 172.21.15.121:0/1900824780 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f320c031a70 con 0x7f3210100bb0 2024-08-18T22:33:34.243 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:32.625+0000 7f3217bf7640 1 -- 172.21.15.121:0/1900824780 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3210100bb0 msgr2=0x7f3210100fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:34.243 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:32.625+0000 7f3217bf7640 1 --2- 172.21.15.121:0/1900824780 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3210100bb0 0x7f3210100fc0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f320c009840 tx=0x7f320c0091d0 comp rx=0 tx=0).stop 2024-08-18T22:33:34.243 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:32.625+0000 7f3217bf7640 1 -- 172.21.15.121:0/1900824780 shutdown_connections 2024-08-18T22:33:34.243 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:32.625+0000 7f3217bf7640 1 --2- 172.21.15.121:0/1900824780 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3210100bb0 0x7f3210100fc0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:34.243 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:32.625+0000 7f3217bf7640 1 -- 172.21.15.121:0/1900824780 >> 172.21.15.121:0/1900824780 conn(0x7f32100fc350 msgr2=0x7f32100fe7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:33:34.243 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:32.625+0000 7f3217bf7640 1 -- 172.21.15.121:0/1900824780 shutdown_connections 2024-08-18T22:33:34.243 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:32.625+0000 7f3217bf7640 1 -- 172.21.15.121:0/1900824780 wait complete. 2024-08-18T22:33:34.243 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:32.626+0000 7f3217bf7640 1 Processor -- start 2024-08-18T22:33:34.243 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:32.626+0000 7f3217bf7640 1 -- start start 2024-08-18T22:33:34.243 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:32.626+0000 7f3217bf7640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3210100bb0 0x7f3210070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:34.243 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:32.626+0000 7f3217bf7640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32101138b0 con 0x7f3210100bb0 2024-08-18T22:33:34.244 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:32.626+0000 7f3215993640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3210100bb0 0x7f3210070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:34.244 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:32.626+0000 7f3215993640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3210100bb0 0x7f3210070770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:47220/0 (socket says 172.21.15.121:47220) 2024-08-18T22:33:34.244 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:32.626+0000 7f3215993640 1 -- 172.21.15.121:0/2279311624 learned_addr learned my addr 172.21.15.121:0/2279311624 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-18T22:33:34.244 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:32.626+0000 7f3215993640 1 -- 172.21.15.121:0/2279311624 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f320c009450 con 0x7f3210100bb0 2024-08-18T22:33:34.244 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:32.626+0000 7f3215993640 1 --2- 172.21.15.121:0/2279311624 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3210100bb0 0x7f3210070770 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f320c009810 tx=0x7f320c0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:33:34.244 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:32.627+0000 7f32067fc640 1 -- 172.21.15.121:0/2279311624 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f320c03c400 con 0x7f3210100bb0 2024-08-18T22:33:34.244 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:32.627+0000 7f32067fc640 1 -- 172.21.15.121:0/2279311624 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f320c03ca00 con 0x7f3210100bb0 2024-08-18T22:33:34.244 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:32.627+0000 7f32067fc640 1 -- 172.21.15.121:0/2279311624 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f320c03a870 con 0x7f3210100bb0 2024-08-18T22:33:34.244 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:32.627+0000 7f3217bf7640 1 -- 172.21.15.121:0/2279311624 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32101139f0 con 0x7f3210100bb0 2024-08-18T22:33:34.245 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:32.627+0000 7f3217bf7640 1 -- 172.21.15.121:0/2279311624 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3210113e00 con 0x7f3210100bb0 2024-08-18T22:33:34.245 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:32.627+0000 7f32067fc640 1 -- 172.21.15.121:0/2279311624 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 8) v1 ==== 42636+0+0 (secure 0 0 0) 0x7f320c03c560 con 0x7f3210100bb0 2024-08-18T22:33:34.245 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:32.628+0000 7f3217bf7640 1 -- 172.21.15.121:0/2279311624 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f321004b4c0 con 0x7f3210100bb0 2024-08-18T22:33:34.245 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:32.628+0000 7f32067fc640 1 --2- 172.21.15.121:0/2279311624 >> [v2:172.21.15.121:6800/833901271,v1:172.21.15.121:6801/833901271] conn(0x7f31fc0356c0 0x7f31fc037b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:34.245 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:32.628+0000 7f32067fc640 1 -- 172.21.15.121:0/2279311624 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f320c068340 con 0x7f3210100bb0 2024-08-18T22:33:34.245 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:32.628+0000 7f3215192640 1 --2- 172.21.15.121:0/2279311624 >> [v2:172.21.15.121:6800/833901271,v1:172.21.15.121:6801/833901271] conn(0x7f31fc0356c0 0x7f31fc037b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:34.245 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:32.628+0000 7f3215192640 1 --2- 172.21.15.121:0/2279311624 >> [v2:172.21.15.121:6800/833901271,v1:172.21.15.121:6801/833901271] conn(0x7f31fc0356c0 0x7f31fc037b70 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f3200006fd0 tx=0x7f3200006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:33:34.245 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:32.632+0000 7f32067fc640 1 -- 172.21.15.121:0/2279311624 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f320c03ab30 con 0x7f3210100bb0 2024-08-18T22:33:34.245 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:32.832+0000 7f3217bf7640 1 -- 172.21.15.121:0/2279311624 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "dashboard"} v 0) v1 -- 0x7f3210114040 con 0x7f3210100bb0 2024-08-18T22:33:34.245 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:33.661+0000 7f32067fc640 1 -- 172.21.15.121:0/2279311624 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mgrmap(e 9) v1 ==== 42649+0+0 (secure 0 0 0) 0x7f320c04c250 con 0x7f3210100bb0 2024-08-18T22:33:34.245 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:33.662+0000 7f32067fc640 1 -- 172.21.15.121:0/2279311624 <== mon.0 v2:172.21.15.121:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "dashboard"}]=0 v9) v1 ==== 88+0+0 (secure 0 0 0) 0x7f320c03cb70 con 0x7f3210100bb0 2024-08-18T22:33:34.245 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:33.665+0000 7f3217bf7640 1 -- 172.21.15.121:0/2279311624 >> [v2:172.21.15.121:6800/833901271,v1:172.21.15.121:6801/833901271] conn(0x7f31fc0356c0 msgr2=0x7f31fc037b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:34.245 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:33.665+0000 7f3217bf7640 1 --2- 172.21.15.121:0/2279311624 >> [v2:172.21.15.121:6800/833901271,v1:172.21.15.121:6801/833901271] conn(0x7f31fc0356c0 0x7f31fc037b70 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f3200006fd0 tx=0x7f3200006db0 comp rx=0 tx=0).stop 2024-08-18T22:33:34.246 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:33.665+0000 7f3217bf7640 1 -- 172.21.15.121:0/2279311624 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3210100bb0 msgr2=0x7f3210070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:34.246 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:33.665+0000 7f3217bf7640 1 --2- 172.21.15.121:0/2279311624 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3210100bb0 0x7f3210070770 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f320c009810 tx=0x7f320c0091d0 comp rx=0 tx=0).stop 2024-08-18T22:33:34.246 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:33.665+0000 7f3217bf7640 1 -- 172.21.15.121:0/2279311624 shutdown_connections 2024-08-18T22:33:34.246 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:33.665+0000 7f3217bf7640 1 --2- 172.21.15.121:0/2279311624 >> [v2:172.21.15.121:6800/833901271,v1:172.21.15.121:6801/833901271] conn(0x7f31fc0356c0 0x7f31fc037b70 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:34.246 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:33.665+0000 7f3217bf7640 1 --2- 172.21.15.121:0/2279311624 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3210100bb0 0x7f3210070770 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:34.246 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:33.665+0000 7f3217bf7640 1 -- 172.21.15.121:0/2279311624 >> 172.21.15.121:0/2279311624 conn(0x7f32100fc350 msgr2=0x7f32100fd010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:33:34.246 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:33.665+0000 7f3217bf7640 1 -- 172.21.15.121:0/2279311624 shutdown_connections 2024-08-18T22:33:34.246 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:33.665+0000 7f3217bf7640 1 -- 172.21.15.121:0/2279311624 wait complete. 2024-08-18T22:33:34.833 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:33:34 smithi121 ceph-mon[16788]: from='client.? 172.21.15.121:0/2279311624' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2024-08-18T22:33:34.833 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:33:34 smithi121 ceph-mon[16788]: mgrmap e9: smithi121.lopxqc(active, since 23s) 2024-08-18T22:33:35.516 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stdout { 2024-08-18T22:33:35.516 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stdout "epoch": 9, 2024-08-18T22:33:35.516 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stdout "available": true, 2024-08-18T22:33:35.516 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stdout "active_name": "smithi121.lopxqc", 2024-08-18T22:33:35.516 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-08-18T22:33:35.516 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stdout } 2024-08-18T22:33:35.517 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:34.704+0000 7f16fa946640 1 Processor -- start 2024-08-18T22:33:35.517 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:34.704+0000 7f16fa946640 1 -- start start 2024-08-18T22:33:35.517 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:34.704+0000 7f16fa946640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f16f4076bd0 0x7f16f4106cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:35.517 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:34.704+0000 7f16fa946640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16f41026e0 con 0x7f16f4076bd0 2024-08-18T22:33:35.517 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:34.704+0000 7f16f3fff640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f16f4076bd0 0x7f16f4106cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:35.517 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:34.704+0000 7f16f3fff640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f16f4076bd0 0x7f16f4106cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:47246/0 (socket says 172.21.15.121:47246) 2024-08-18T22:33:35.517 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:34.704+0000 7f16f3fff640 1 -- 172.21.15.121:0/3570558695 learned_addr learned my addr 172.21.15.121:0/3570558695 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-18T22:33:35.517 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:34.704+0000 7f16f3fff640 1 -- 172.21.15.121:0/3570558695 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16f4107230 con 0x7f16f4076bd0 2024-08-18T22:33:35.517 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:34.705+0000 7f16f3fff640 1 --2- 172.21.15.121:0/3570558695 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f16f4076bd0 0x7f16f4106cf0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f16e4009840 tx=0x7f16e40091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51e56d7a9358af83 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:33:35.517 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:34.706+0000 7f16f37fe640 1 -- 172.21.15.121:0/3570558695 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f16e4032440 con 0x7f16f4076bd0 2024-08-18T22:33:35.517 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:34.706+0000 7f16f37fe640 1 -- 172.21.15.121:0/3570558695 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f16e4032a40 con 0x7f16f4076bd0 2024-08-18T22:33:35.517 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:34.706+0000 7f16f37fe640 1 -- 172.21.15.121:0/3570558695 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f16e4031a70 con 0x7f16f4076bd0 2024-08-18T22:33:35.518 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:34.706+0000 7f16fa946640 1 -- 172.21.15.121:0/3570558695 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f16f4076bd0 msgr2=0x7f16f4106cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:35.518 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:34.706+0000 7f16fa946640 1 --2- 172.21.15.121:0/3570558695 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f16f4076bd0 0x7f16f4106cf0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f16e4009840 tx=0x7f16e40091d0 comp rx=0 tx=0).stop 2024-08-18T22:33:35.518 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:34.706+0000 7f16fa946640 1 -- 172.21.15.121:0/3570558695 shutdown_connections 2024-08-18T22:33:35.518 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:34.706+0000 7f16fa946640 1 --2- 172.21.15.121:0/3570558695 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f16f4076bd0 0x7f16f4106cf0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:35.518 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:34.706+0000 7f16fa946640 1 -- 172.21.15.121:0/3570558695 >> 172.21.15.121:0/3570558695 conn(0x7f16f40fc400 msgr2=0x7f16f40fe810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:33:35.518 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:34.706+0000 7f16fa946640 1 -- 172.21.15.121:0/3570558695 shutdown_connections 2024-08-18T22:33:35.518 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:34.706+0000 7f16fa946640 1 -- 172.21.15.121:0/3570558695 wait complete. 2024-08-18T22:33:35.518 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:34.707+0000 7f16fa946640 1 Processor -- start 2024-08-18T22:33:35.518 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:34.707+0000 7f16fa946640 1 -- start start 2024-08-18T22:33:35.518 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:34.707+0000 7f16fa946640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f16f4076bd0 0x7f16f4112d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:35.518 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:34.707+0000 7f16fa946640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16f4113250 con 0x7f16f4076bd0 2024-08-18T22:33:35.518 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:34.707+0000 7f16f3fff640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f16f4076bd0 0x7f16f4112d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:35.519 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:34.707+0000 7f16f3fff640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f16f4076bd0 0x7f16f4112d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:47250/0 (socket says 172.21.15.121:47250) 2024-08-18T22:33:35.519 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:34.707+0000 7f16f3fff640 1 -- 172.21.15.121:0/1327403551 learned_addr learned my addr 172.21.15.121:0/1327403551 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-18T22:33:35.519 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:34.708+0000 7f16f3fff640 1 -- 172.21.15.121:0/1327403551 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16e4009450 con 0x7f16f4076bd0 2024-08-18T22:33:35.519 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:34.708+0000 7f16f3fff640 1 --2- 172.21.15.121:0/1327403551 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f16f4076bd0 0x7f16f4112d10 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f16e4031750 tx=0x7f16e40091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:33:35.519 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:34.708+0000 7f16f17fa640 1 -- 172.21.15.121:0/1327403551 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f16e403c400 con 0x7f16f4076bd0 2024-08-18T22:33:35.519 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:34.708+0000 7f16f17fa640 1 -- 172.21.15.121:0/1327403551 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f16e403ca00 con 0x7f16f4076bd0 2024-08-18T22:33:35.519 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:34.708+0000 7f16fa946640 1 -- 172.21.15.121:0/1327403551 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16f4113450 con 0x7f16f4076bd0 2024-08-18T22:33:35.519 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:34.708+0000 7f16f17fa640 1 -- 172.21.15.121:0/1327403551 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f16e403a880 con 0x7f16f4076bd0 2024-08-18T22:33:35.519 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:34.708+0000 7f16fa946640 1 -- 172.21.15.121:0/1327403551 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16f4113860 con 0x7f16f4076bd0 2024-08-18T22:33:35.519 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:34.709+0000 7f16ea7fc640 1 -- 172.21.15.121:0/1327403551 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16d8005210 con 0x7f16f4076bd0 2024-08-18T22:33:35.519 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:34.710+0000 7f16f17fa640 1 -- 172.21.15.121:0/1327403551 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 9) v1 ==== 42649+0+0 (secure 0 0 0) 0x7f16e403cb70 con 0x7f16f4076bd0 2024-08-18T22:33:35.519 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:34.710+0000 7f16f17fa640 1 --2- 172.21.15.121:0/1327403551 >> [v2:172.21.15.121:6800/833901271,v1:172.21.15.121:6801/833901271] conn(0x7f16e0035710 0x7f16e0037bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:35.520 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:34.710+0000 7f16f17fa640 1 -- 172.21.15.121:0/1327403551 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f16e4068c20 con 0x7f16f4076bd0 2024-08-18T22:33:35.520 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:34.710+0000 7f16ebfff640 1 -- 172.21.15.121:0/1327403551 >> [v2:172.21.15.121:6800/833901271,v1:172.21.15.121:6801/833901271] conn(0x7f16e0035710 msgr2=0x7f16e0037bc0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.121:6800/833901271 2024-08-18T22:33:35.520 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:34.710+0000 7f16ebfff640 1 --2- 172.21.15.121:0/1327403551 >> [v2:172.21.15.121:6800/833901271,v1:172.21.15.121:6801/833901271] conn(0x7f16e0035710 0x7f16e0037bc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-18T22:33:35.520 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:34.714+0000 7f16f17fa640 1 -- 172.21.15.121:0/1327403551 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f16e4068e60 con 0x7f16f4076bd0 2024-08-18T22:33:35.520 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:34.911+0000 7f16ebfff640 1 -- 172.21.15.121:0/1327403551 >> [v2:172.21.15.121:6800/833901271,v1:172.21.15.121:6801/833901271] conn(0x7f16e0035710 msgr2=0x7f16e0037bc0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.121:6800/833901271 2024-08-18T22:33:35.520 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:34.911+0000 7f16ebfff640 1 --2- 172.21.15.121:0/1327403551 >> [v2:172.21.15.121:6800/833901271,v1:172.21.15.121:6801/833901271] conn(0x7f16e0035710 0x7f16e0037bc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-18T22:33:35.520 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:34.917+0000 7f16ea7fc640 1 -- 172.21.15.121:0/1327403551 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) v1 -- 0x7f16d8005790 con 0x7f16f4076bd0 2024-08-18T22:33:35.520 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:34.917+0000 7f16f17fa640 1 -- 172.21.15.121:0/1327403551 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v9) v1 ==== 56+0+103 (secure 0 0 0) 0x7f16e4037030 con 0x7f16f4076bd0 2024-08-18T22:33:35.520 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:34.919+0000 7f16ea7fc640 1 -- 172.21.15.121:0/1327403551 >> [v2:172.21.15.121:6800/833901271,v1:172.21.15.121:6801/833901271] conn(0x7f16e0035710 msgr2=0x7f16e0037bc0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-18T22:33:35.520 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:34.919+0000 7f16ea7fc640 1 --2- 172.21.15.121:0/1327403551 >> [v2:172.21.15.121:6800/833901271,v1:172.21.15.121:6801/833901271] conn(0x7f16e0035710 0x7f16e0037bc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:35.520 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:34.919+0000 7f16ea7fc640 1 -- 172.21.15.121:0/1327403551 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f16f4076bd0 msgr2=0x7f16f4112d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:35.520 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:34.919+0000 7f16ea7fc640 1 --2- 172.21.15.121:0/1327403551 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f16f4076bd0 0x7f16f4112d10 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f16e4031750 tx=0x7f16e40091d0 comp rx=0 tx=0).stop 2024-08-18T22:33:35.520 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:34.919+0000 7f16ea7fc640 1 -- 172.21.15.121:0/1327403551 shutdown_connections 2024-08-18T22:33:35.521 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:34.919+0000 7f16ea7fc640 1 --2- 172.21.15.121:0/1327403551 >> [v2:172.21.15.121:6800/833901271,v1:172.21.15.121:6801/833901271] conn(0x7f16e0035710 0x7f16e0037bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:35.521 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:34.919+0000 7f16ea7fc640 1 --2- 172.21.15.121:0/1327403551 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f16f4076bd0 0x7f16f4112d10 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:35.521 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:34.919+0000 7f16ea7fc640 1 -- 172.21.15.121:0/1327403551 >> 172.21.15.121:0/1327403551 conn(0x7f16f40fc400 msgr2=0x7f16f40fcff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:33:35.521 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:34.920+0000 7f16ea7fc640 1 -- 172.21.15.121:0/1327403551 shutdown_connections 2024-08-18T22:33:35.521 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:34.920+0000 7f16ea7fc640 1 -- 172.21.15.121:0/1327403551 wait complete. 2024-08-18T22:33:35.521 INFO:teuthology.orchestra.run.smithi121.stdout:Waiting for the mgr to restart... 2024-08-18T22:33:35.521 INFO:teuthology.orchestra.run.smithi121.stdout:Waiting for mgr epoch 9... 2024-08-18T22:33:35.759 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:33:35 smithi121 ceph-mon[16788]: from='client.? 172.21.15.121:0/1327403551' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-08-18T22:33:38.584 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:33:38 smithi121 ceph-mon[16788]: Active manager daemon smithi121.lopxqc restarted 2024-08-18T22:33:38.584 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:33:38 smithi121 ceph-mon[16788]: Activating manager daemon smithi121.lopxqc 2024-08-18T22:33:38.584 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:33:38 smithi121 ceph-mon[16788]: osdmap e3: 0 total, 0 up, 0 in 2024-08-18T22:33:38.584 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:33:38 smithi121 ceph-mon[16788]: mgrmap e10: smithi121.lopxqc(active, starting, since 0.00311704s) 2024-08-18T22:33:38.584 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:33:38 smithi121 ceph-mon[16788]: from='mgr.14160 172.21.15.121:0/261891242' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "mon metadata", "id": "smithi121"}]: dispatch 2024-08-18T22:33:38.584 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:33:38 smithi121 ceph-mon[16788]: from='mgr.14160 172.21.15.121:0/261891242' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "mgr metadata", "who": "smithi121.lopxqc", "id": "smithi121.lopxqc"}]: dispatch 2024-08-18T22:33:38.584 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:33:38 smithi121 ceph-mon[16788]: from='mgr.14160 172.21.15.121:0/261891242' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-08-18T22:33:38.584 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:33:38 smithi121 ceph-mon[16788]: from='mgr.14160 172.21.15.121:0/261891242' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-08-18T22:33:38.584 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:33:38 smithi121 ceph-mon[16788]: from='mgr.14160 172.21.15.121:0/261891242' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-08-18T22:33:38.585 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:33:38 smithi121 ceph-mon[16788]: Manager daemon smithi121.lopxqc is now available 2024-08-18T22:33:38.585 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:33:38 smithi121 ceph-mon[16788]: from='mgr.14160 172.21.15.121:0/261891242' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-18T22:33:38.585 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:33:38 smithi121 ceph-mon[16788]: from='mgr.14160 172.21.15.121:0/261891242' entity='mgr.smithi121.lopxqc' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi121.lopxqc/mirror_snapshot_schedule"}]: dispatch 2024-08-18T22:33:38.585 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:33:38 smithi121 ceph-mon[16788]: from='mgr.14160 172.21.15.121:0/261891242' entity='mgr.smithi121.lopxqc' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi121.lopxqc/trash_purge_schedule"}]: dispatch 2024-08-18T22:33:39.810 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stdout { 2024-08-18T22:33:39.810 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2024-08-18T22:33:39.810 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stdout "initialized": true 2024-08-18T22:33:39.810 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stdout } 2024-08-18T22:33:39.810 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:35.951+0000 7f856420b640 1 Processor -- start 2024-08-18T22:33:39.810 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:35.952+0000 7f856420b640 1 -- start start 2024-08-18T22:33:39.810 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:35.952+0000 7f856420b640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f855c0708c0 0x7f855c1048f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:39.810 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:35.952+0000 7f856420b640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f855c104e30 con 0x7f855c0708c0 2024-08-18T22:33:39.810 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:35.952+0000 7f8561fa7640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f855c0708c0 0x7f855c1048f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:39.811 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:35.952+0000 7f8561fa7640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f855c0708c0 0x7f855c1048f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:47262/0 (socket says 172.21.15.121:47262) 2024-08-18T22:33:39.811 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:35.952+0000 7f8561fa7640 1 -- 172.21.15.121:0/3296624802 learned_addr learned my addr 172.21.15.121:0/3296624802 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-18T22:33:39.811 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:35.952+0000 7f8561fa7640 1 -- 172.21.15.121:0/3296624802 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f855c104f70 con 0x7f855c0708c0 2024-08-18T22:33:39.811 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:35.953+0000 7f8561fa7640 1 --2- 172.21.15.121:0/3296624802 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f855c0708c0 0x7f855c1048f0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f8558009840 tx=0x7f85580091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=796d6c8d982f8e33 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:33:39.811 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:35.953+0000 7f8560fa5640 1 -- 172.21.15.121:0/3296624802 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8558032440 con 0x7f855c0708c0 2024-08-18T22:33:39.811 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:35.953+0000 7f8560fa5640 1 -- 172.21.15.121:0/3296624802 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f8558032a40 con 0x7f855c0708c0 2024-08-18T22:33:39.811 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:35.953+0000 7f8560fa5640 1 -- 172.21.15.121:0/3296624802 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8558031a70 con 0x7f855c0708c0 2024-08-18T22:33:39.811 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:35.954+0000 7f856420b640 1 -- 172.21.15.121:0/3296624802 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f855c0708c0 msgr2=0x7f855c1048f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:39.811 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:35.954+0000 7f856420b640 1 --2- 172.21.15.121:0/3296624802 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f855c0708c0 0x7f855c1048f0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f8558009840 tx=0x7f85580091d0 comp rx=0 tx=0).stop 2024-08-18T22:33:39.811 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:35.954+0000 7f856420b640 1 -- 172.21.15.121:0/3296624802 shutdown_connections 2024-08-18T22:33:39.811 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:35.954+0000 7f856420b640 1 --2- 172.21.15.121:0/3296624802 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f855c0708c0 0x7f855c1048f0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:39.811 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:35.954+0000 7f856420b640 1 -- 172.21.15.121:0/3296624802 >> 172.21.15.121:0/3296624802 conn(0x7f855c0fc3a0 msgr2=0x7f855c0fe7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:33:39.811 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:35.954+0000 7f856420b640 1 -- 172.21.15.121:0/3296624802 shutdown_connections 2024-08-18T22:33:39.812 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:35.954+0000 7f856420b640 1 -- 172.21.15.121:0/3296624802 wait complete. 2024-08-18T22:33:39.812 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:35.955+0000 7f856420b640 1 Processor -- start 2024-08-18T22:33:39.812 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:35.955+0000 7f856420b640 1 -- start start 2024-08-18T22:33:39.812 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:35.955+0000 7f856420b640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f855c0708c0 0x7f855c110b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:39.812 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:35.955+0000 7f856420b640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f855c111090 con 0x7f855c0708c0 2024-08-18T22:33:39.812 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:35.955+0000 7f8561fa7640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f855c0708c0 0x7f855c110b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:39.812 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:35.955+0000 7f8561fa7640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f855c0708c0 0x7f855c110b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:47264/0 (socket says 172.21.15.121:47264) 2024-08-18T22:33:39.812 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:35.955+0000 7f8561fa7640 1 -- 172.21.15.121:0/295742187 learned_addr learned my addr 172.21.15.121:0/295742187 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-18T22:33:39.812 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:35.955+0000 7f8561fa7640 1 -- 172.21.15.121:0/295742187 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8558009450 con 0x7f855c0708c0 2024-08-18T22:33:39.812 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:35.955+0000 7f8561fa7640 1 --2- 172.21.15.121:0/295742187 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f855c0708c0 0x7f855c110b50 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f8558009420 tx=0x7f85580091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:33:39.812 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:35.956+0000 7f85527fc640 1 -- 172.21.15.121:0/295742187 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f855803c400 con 0x7f855c0708c0 2024-08-18T22:33:39.812 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:35.956+0000 7f85527fc640 1 -- 172.21.15.121:0/295742187 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f855803ca00 con 0x7f855c0708c0 2024-08-18T22:33:39.812 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:35.956+0000 7f856420b640 1 -- 172.21.15.121:0/295742187 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f855c111290 con 0x7f855c0708c0 2024-08-18T22:33:39.812 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:35.956+0000 7f85527fc640 1 -- 172.21.15.121:0/295742187 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f855803a920 con 0x7f855c0708c0 2024-08-18T22:33:39.813 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:35.956+0000 7f856420b640 1 -- 172.21.15.121:0/295742187 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f855c111e20 con 0x7f855c0708c0 2024-08-18T22:33:39.813 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:35.957+0000 7f85527fc640 1 -- 172.21.15.121:0/295742187 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 9) v1 ==== 42649+0+0 (secure 0 0 0) 0x7f855803aa80 con 0x7f855c0708c0 2024-08-18T22:33:39.813 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:35.957+0000 7f85527fc640 1 --2- 172.21.15.121:0/295742187 >> [v2:172.21.15.121:6800/833901271,v1:172.21.15.121:6801/833901271] conn(0x7f8548035760 0x7f8548037c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:39.813 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:35.957+0000 7f856420b640 1 -- 172.21.15.121:0/295742187 --> [v2:172.21.15.121:6800/833901271,v1:172.21.15.121:6801/833901271] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f855c05eb10 con 0x7f8548035760 2024-08-18T22:33:39.813 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:35.957+0000 7f85527fc640 1 -- 172.21.15.121:0/295742187 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f8558068490 con 0x7f855c0708c0 2024-08-18T22:33:39.813 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:35.957+0000 7f85617a6640 1 -- 172.21.15.121:0/295742187 >> [v2:172.21.15.121:6800/833901271,v1:172.21.15.121:6801/833901271] conn(0x7f8548035760 msgr2=0x7f8548037c10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.121:6800/833901271 2024-08-18T22:33:39.813 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:35.957+0000 7f85617a6640 1 --2- 172.21.15.121:0/295742187 >> [v2:172.21.15.121:6800/833901271,v1:172.21.15.121:6801/833901271] conn(0x7f8548035760 0x7f8548037c10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-18T22:33:39.813 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:36.158+0000 7f85617a6640 1 -- 172.21.15.121:0/295742187 >> [v2:172.21.15.121:6800/833901271,v1:172.21.15.121:6801/833901271] conn(0x7f8548035760 msgr2=0x7f8548037c10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.121:6800/833901271 2024-08-18T22:33:39.813 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:36.158+0000 7f85617a6640 1 --2- 172.21.15.121:0/295742187 >> [v2:172.21.15.121:6800/833901271,v1:172.21.15.121:6801/833901271] conn(0x7f8548035760 0x7f8548037c10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-18T22:33:39.813 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:36.559+0000 7f85617a6640 1 -- 172.21.15.121:0/295742187 >> [v2:172.21.15.121:6800/833901271,v1:172.21.15.121:6801/833901271] conn(0x7f8548035760 msgr2=0x7f8548037c10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.121:6800/833901271 2024-08-18T22:33:39.813 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:36.559+0000 7f85617a6640 1 --2- 172.21.15.121:0/295742187 >> [v2:172.21.15.121:6800/833901271,v1:172.21.15.121:6801/833901271] conn(0x7f8548035760 0x7f8548037c10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-08-18T22:33:39.813 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:37.361+0000 7f85617a6640 1 -- 172.21.15.121:0/295742187 >> [v2:172.21.15.121:6800/833901271,v1:172.21.15.121:6801/833901271] conn(0x7f8548035760 msgr2=0x7f8548037c10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.121:6800/833901271 2024-08-18T22:33:39.813 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:37.361+0000 7f85617a6640 1 --2- 172.21.15.121:0/295742187 >> [v2:172.21.15.121:6800/833901271,v1:172.21.15.121:6801/833901271] conn(0x7f8548035760 0x7f8548037c10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-08-18T22:33:39.814 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:38.105+0000 7f85527fc640 1 -- 172.21.15.121:0/295742187 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mgrmap(e 10) v1 ==== 42416+0+0 (secure 0 0 0) 0x7f855803ad30 con 0x7f855c0708c0 2024-08-18T22:33:39.814 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:38.105+0000 7f85527fc640 1 -- 172.21.15.121:0/295742187 >> [v2:172.21.15.121:6800/833901271,v1:172.21.15.121:6801/833901271] conn(0x7f8548035760 msgr2=0x7f8548037c10 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-18T22:33:39.814 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:38.105+0000 7f85527fc640 1 --2- 172.21.15.121:0/295742187 >> [v2:172.21.15.121:6800/833901271,v1:172.21.15.121:6801/833901271] conn(0x7f8548035760 0x7f8548037c10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:39.814 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:39.106+0000 7f85527fc640 1 -- 172.21.15.121:0/295742187 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mgrmap(e 11) v1 ==== 42543+0+0 (secure 0 0 0) 0x7f855803cb70 con 0x7f855c0708c0 2024-08-18T22:33:39.814 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:39.106+0000 7f85527fc640 1 --2- 172.21.15.121:0/295742187 >> [v2:172.21.15.121:6800/1740603058,v1:172.21.15.121:6801/1740603058] conn(0x7f8548038fc0 0x7f854803b3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:39.814 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:39.107+0000 7f85527fc640 1 -- 172.21.15.121:0/295742187 --> [v2:172.21.15.121:6800/1740603058,v1:172.21.15.121:6801/1740603058] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f855c05eb10 con 0x7f8548038fc0 2024-08-18T22:33:39.814 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:39.107+0000 7f85617a6640 1 --2- 172.21.15.121:0/295742187 >> [v2:172.21.15.121:6800/1740603058,v1:172.21.15.121:6801/1740603058] conn(0x7f8548038fc0 0x7f854803b3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:39.814 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:39.107+0000 7f85617a6640 1 --2- 172.21.15.121:0/295742187 >> [v2:172.21.15.121:6800/1740603058,v1:172.21.15.121:6801/1740603058] conn(0x7f8548038fc0 0x7f854803b3a0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f854c003940 tx=0x7f854c009350 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:33:39.814 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:39.108+0000 7f85527fc640 1 -- 172.21.15.121:0/295742187 <== mgr.14160 v2:172.21.15.121:6800/1740603058 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+6549 (secure 0 0 0) 0x7f855c05eb10 con 0x7f8548038fc0 2024-08-18T22:33:39.814 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:39.113+0000 7f856420b640 1 -- 172.21.15.121:0/295742187 --> [v2:172.21.15.121:6800/1740603058,v1:172.21.15.121:6801/1740603058] -- command(tid 1: {"prefix": "mgr_status"}) v1 -- 0x7f855c111760 con 0x7f8548038fc0 2024-08-18T22:33:39.814 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:39.113+0000 7f85527fc640 1 -- 172.21.15.121:0/295742187 <== mgr.14160 v2:172.21.15.121:6800/1740603058 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+52 (secure 0 0 0) 0x7f855c111760 con 0x7f8548038fc0 2024-08-18T22:33:39.814 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:39.113+0000 7f856420b640 1 -- 172.21.15.121:0/295742187 >> [v2:172.21.15.121:6800/1740603058,v1:172.21.15.121:6801/1740603058] conn(0x7f8548038fc0 msgr2=0x7f854803b3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:39.814 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:39.113+0000 7f856420b640 1 --2- 172.21.15.121:0/295742187 >> [v2:172.21.15.121:6800/1740603058,v1:172.21.15.121:6801/1740603058] conn(0x7f8548038fc0 0x7f854803b3a0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f854c003940 tx=0x7f854c009350 comp rx=0 tx=0).stop 2024-08-18T22:33:39.815 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:39.113+0000 7f856420b640 1 -- 172.21.15.121:0/295742187 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f855c0708c0 msgr2=0x7f855c110b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:39.815 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:39.113+0000 7f856420b640 1 --2- 172.21.15.121:0/295742187 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f855c0708c0 0x7f855c110b50 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f8558009420 tx=0x7f85580091d0 comp rx=0 tx=0).stop 2024-08-18T22:33:39.815 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:39.113+0000 7f856420b640 1 -- 172.21.15.121:0/295742187 shutdown_connections 2024-08-18T22:33:39.815 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:39.113+0000 7f856420b640 1 --2- 172.21.15.121:0/295742187 >> [v2:172.21.15.121:6800/1740603058,v1:172.21.15.121:6801/1740603058] conn(0x7f8548038fc0 0x7f854803b3a0 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:39.815 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:39.113+0000 7f856420b640 1 --2- 172.21.15.121:0/295742187 >> [v2:172.21.15.121:6800/833901271,v1:172.21.15.121:6801/833901271] conn(0x7f8548035760 0x7f8548037c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:39.815 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:39.113+0000 7f856420b640 1 --2- 172.21.15.121:0/295742187 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f855c0708c0 0x7f855c110b50 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:39.815 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:39.114+0000 7f856420b640 1 -- 172.21.15.121:0/295742187 >> 172.21.15.121:0/295742187 conn(0x7f855c0fc3a0 msgr2=0x7f855c0fd000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:33:39.815 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:39.114+0000 7f856420b640 1 -- 172.21.15.121:0/295742187 shutdown_connections 2024-08-18T22:33:39.815 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:39.114+0000 7f856420b640 1 -- 172.21.15.121:0/295742187 wait complete. 2024-08-18T22:33:39.815 INFO:teuthology.orchestra.run.smithi121.stdout:mgr epoch 9 is available 2024-08-18T22:33:39.815 INFO:teuthology.orchestra.run.smithi121.stdout:Generating a dashboard self-signed certificate... 2024-08-18T22:33:40.195 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:33:40 smithi121 ceph-mon[16788]: mgrmap e11: smithi121.lopxqc(active, since 1.00519s) 2024-08-18T22:33:40.196 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:33:40 smithi121 ceph-mon[16788]: from='mgr.14160 172.21.15.121:0/261891242' entity='mgr.smithi121.lopxqc' 2024-08-18T22:33:40.196 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:33:40 smithi121 ceph-mon[16788]: [18/Aug/2024:22:33:39] ENGINE Bus STARTING 2024-08-18T22:33:40.196 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:33:40 smithi121 ceph-mon[16788]: [18/Aug/2024:22:33:39] ENGINE Serving on https://172.21.15.121:7150 2024-08-18T22:33:40.196 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:33:40 smithi121 ceph-mon[16788]: [18/Aug/2024:22:33:39] ENGINE Bus STARTED 2024-08-18T22:33:40.196 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:33:40 smithi121 ceph-mon[16788]: [18/Aug/2024:22:33:39] ENGINE Error in HTTPServer.serve 2024-08-18T22:33:40.196 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout: Traceback (most recent call last): 2024-08-18T22:33:40.196 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-08-18T22:33:40.196 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout: self._connections.run(self.expiration_interval) 2024-08-18T22:33:40.196 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-08-18T22:33:40.196 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout: self._run(expiration_interval) 2024-08-18T22:33:40.196 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-08-18T22:33:40.197 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-08-18T22:33:40.197 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-08-18T22:33:40.197 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-08-18T22:33:40.197 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-08-18T22:33:40.197 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout: s = self.context.wrap_socket( 2024-08-18T22:33:40.197 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-08-18T22:33:40.197 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout: return self.sslsocket_class._create( 2024-08-18T22:33:40.197 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-08-18T22:33:40.197 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout: self.do_handshake() 2024-08-18T22:33:40.197 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-08-18T22:33:40.197 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout: self._sslobj.do_handshake() 2024-08-18T22:33:40.197 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-08-18T22:33:40.198 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:33:40 smithi121 ceph-mon[16788]: from='mgr.14160 172.21.15.121:0/261891242' entity='mgr.smithi121.lopxqc' 2024-08-18T22:33:41.057 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stdout Self-signed certificate created 2024-08-18T22:33:41.057 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:40.194+0000 7fc96da6d640 1 Processor -- start 2024-08-18T22:33:41.057 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:40.194+0000 7fc96da6d640 1 -- start start 2024-08-18T22:33:41.058 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:40.194+0000 7fc96da6d640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc968101ca0 0x7fc9681020b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:41.058 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:40.194+0000 7fc96da6d640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9681025f0 con 0x7fc968101ca0 2024-08-18T22:33:41.058 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:40.194+0000 7fc9677fe640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc968101ca0 0x7fc9681020b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:41.058 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:40.195+0000 7fc9677fe640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc968101ca0 0x7fc9681020b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:52462/0 (socket says 172.21.15.121:52462) 2024-08-18T22:33:41.058 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:40.195+0000 7fc9677fe640 1 -- 172.21.15.121:0/2701836868 learned_addr learned my addr 172.21.15.121:0/2701836868 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-18T22:33:41.058 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:40.195+0000 7fc9677fe640 1 -- 172.21.15.121:0/2701836868 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc968102730 con 0x7fc968101ca0 2024-08-18T22:33:41.058 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:40.196+0000 7fc9677fe640 1 --2- 172.21.15.121:0/2701836868 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc968101ca0 0x7fc9681020b0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fc958009840 tx=0x7fc9580091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b13e423197e139ce server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:33:41.058 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:40.196+0000 7fc966ffd640 1 -- 172.21.15.121:0/2701836868 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc958032440 con 0x7fc968101ca0 2024-08-18T22:33:41.058 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:40.196+0000 7fc966ffd640 1 -- 172.21.15.121:0/2701836868 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fc958032a40 con 0x7fc968101ca0 2024-08-18T22:33:41.058 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:40.196+0000 7fc966ffd640 1 -- 172.21.15.121:0/2701836868 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc958031a70 con 0x7fc968101ca0 2024-08-18T22:33:41.058 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:40.196+0000 7fc96da6d640 1 -- 172.21.15.121:0/2701836868 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc968101ca0 msgr2=0x7fc9681020b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:41.058 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:40.196+0000 7fc96da6d640 1 --2- 172.21.15.121:0/2701836868 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc968101ca0 0x7fc9681020b0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fc958009840 tx=0x7fc9580091d0 comp rx=0 tx=0).stop 2024-08-18T22:33:41.059 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:40.196+0000 7fc96da6d640 1 -- 172.21.15.121:0/2701836868 shutdown_connections 2024-08-18T22:33:41.059 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:40.196+0000 7fc96da6d640 1 --2- 172.21.15.121:0/2701836868 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc968101ca0 0x7fc9681020b0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:41.059 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:40.196+0000 7fc96da6d640 1 -- 172.21.15.121:0/2701836868 >> 172.21.15.121:0/2701836868 conn(0x7fc9680fd510 msgr2=0x7fc9680ff8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:33:41.059 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:40.197+0000 7fc96da6d640 1 -- 172.21.15.121:0/2701836868 shutdown_connections 2024-08-18T22:33:41.059 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:40.197+0000 7fc96da6d640 1 -- 172.21.15.121:0/2701836868 wait complete. 2024-08-18T22:33:41.059 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:40.197+0000 7fc96da6d640 1 Processor -- start 2024-08-18T22:33:41.059 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:40.197+0000 7fc96da6d640 1 -- start start 2024-08-18T22:33:41.059 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:40.197+0000 7fc96da6d640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc968101ca0 0x7fc968078bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:41.059 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:40.197+0000 7fc96da6d640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9680790f0 con 0x7fc968101ca0 2024-08-18T22:33:41.059 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:40.197+0000 7fc9677fe640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc968101ca0 0x7fc968078bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:41.059 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:40.197+0000 7fc9677fe640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc968101ca0 0x7fc968078bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:52474/0 (socket says 172.21.15.121:52474) 2024-08-18T22:33:41.059 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:40.197+0000 7fc9677fe640 1 -- 172.21.15.121:0/2949218864 learned_addr learned my addr 172.21.15.121:0/2949218864 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-18T22:33:41.059 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:40.198+0000 7fc9677fe640 1 -- 172.21.15.121:0/2949218864 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc958009450 con 0x7fc968101ca0 2024-08-18T22:33:41.060 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:40.198+0000 7fc9677fe640 1 --2- 172.21.15.121:0/2949218864 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc968101ca0 0x7fc968078bb0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fc958006a70 tx=0x7fc9580091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:33:41.060 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:40.198+0000 7fc964ff9640 1 -- 172.21.15.121:0/2949218864 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc95803c400 con 0x7fc968101ca0 2024-08-18T22:33:41.060 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:40.198+0000 7fc964ff9640 1 -- 172.21.15.121:0/2949218864 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fc95803ca00 con 0x7fc968101ca0 2024-08-18T22:33:41.060 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:40.198+0000 7fc96da6d640 1 -- 172.21.15.121:0/2949218864 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc968077180 con 0x7fc968101ca0 2024-08-18T22:33:41.060 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:40.198+0000 7fc964ff9640 1 -- 172.21.15.121:0/2949218864 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc95803a9a0 con 0x7fc968101ca0 2024-08-18T22:33:41.060 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:40.198+0000 7fc96da6d640 1 -- 172.21.15.121:0/2949218864 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9680775f0 con 0x7fc968101ca0 2024-08-18T22:33:41.060 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:40.199+0000 7fc964ff9640 1 -- 172.21.15.121:0/2949218864 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 11) v1 ==== 42543+0+0 (secure 0 0 0) 0x7fc95803abd0 con 0x7fc968101ca0 2024-08-18T22:33:41.060 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:40.199+0000 7fc964ff9640 1 --2- 172.21.15.121:0/2949218864 >> [v2:172.21.15.121:6800/1740603058,v1:172.21.15.121:6801/1740603058] conn(0x7fc954035640 0x7fc954037af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:41.060 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:40.199+0000 7fc964ff9640 1 -- 172.21.15.121:0/2949218864 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7fc958068200 con 0x7fc968101ca0 2024-08-18T22:33:41.060 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:40.199+0000 7fc96da6d640 1 -- 172.21.15.121:0/2949218864 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc96804b4c0 con 0x7fc968101ca0 2024-08-18T22:33:41.061 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:40.199+0000 7fc95ffff640 1 --2- 172.21.15.121:0/2949218864 >> [v2:172.21.15.121:6800/1740603058,v1:172.21.15.121:6801/1740603058] conn(0x7fc954035640 0x7fc954037af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:41.061 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:40.199+0000 7fc95ffff640 1 --2- 172.21.15.121:0/2949218864 >> [v2:172.21.15.121:6800/1740603058,v1:172.21.15.121:6801/1740603058] conn(0x7fc954035640 0x7fc954037af0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fc950006fd0 tx=0x7fc950006db0 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:33:41.061 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:40.204+0000 7fc964ff9640 1 -- 172.21.15.121:0/2949218864 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fc958037030 con 0x7fc968101ca0 2024-08-18T22:33:41.061 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:40.368+0000 7fc96da6d640 1 -- 172.21.15.121:0/2949218864 --> [v2:172.21.15.121:6800/1740603058,v1:172.21.15.121:6801/1740603058] -- mgr_command(tid 0: {"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}) v1 -- 0x7fc968077c40 con 0x7fc954035640 2024-08-18T22:33:41.061 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:40.464+0000 7fc964ff9640 1 -- 172.21.15.121:0/2949218864 <== mgr.14160 v2:172.21.15.121:6800/1740603058 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+32 (secure 0 0 0) 0x7fc968077c40 con 0x7fc954035640 2024-08-18T22:33:41.061 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:40.466+0000 7fc96da6d640 1 -- 172.21.15.121:0/2949218864 >> [v2:172.21.15.121:6800/1740603058,v1:172.21.15.121:6801/1740603058] conn(0x7fc954035640 msgr2=0x7fc954037af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:41.061 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:40.466+0000 7fc96da6d640 1 --2- 172.21.15.121:0/2949218864 >> [v2:172.21.15.121:6800/1740603058,v1:172.21.15.121:6801/1740603058] conn(0x7fc954035640 0x7fc954037af0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fc950006fd0 tx=0x7fc950006db0 comp rx=0 tx=0).stop 2024-08-18T22:33:41.061 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:40.466+0000 7fc96da6d640 1 -- 172.21.15.121:0/2949218864 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc968101ca0 msgr2=0x7fc968078bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:41.061 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:40.466+0000 7fc96da6d640 1 --2- 172.21.15.121:0/2949218864 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc968101ca0 0x7fc968078bb0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fc958006a70 tx=0x7fc9580091d0 comp rx=0 tx=0).stop 2024-08-18T22:33:41.061 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:40.466+0000 7fc96da6d640 1 -- 172.21.15.121:0/2949218864 shutdown_connections 2024-08-18T22:33:41.061 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:40.466+0000 7fc96da6d640 1 --2- 172.21.15.121:0/2949218864 >> [v2:172.21.15.121:6800/1740603058,v1:172.21.15.121:6801/1740603058] conn(0x7fc954035640 0x7fc954037af0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:41.061 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:40.466+0000 7fc96da6d640 1 --2- 172.21.15.121:0/2949218864 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc968101ca0 0x7fc968078bb0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:41.061 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:40.466+0000 7fc96da6d640 1 -- 172.21.15.121:0/2949218864 >> 172.21.15.121:0/2949218864 conn(0x7fc9680fd510 msgr2=0x7fc9680fe090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:33:41.062 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:40.466+0000 7fc96da6d640 1 -- 172.21.15.121:0/2949218864 shutdown_connections 2024-08-18T22:33:41.062 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:40.466+0000 7fc96da6d640 1 -- 172.21.15.121:0/2949218864 wait complete. 2024-08-18T22:33:41.062 INFO:teuthology.orchestra.run.smithi121.stdout:Creating initial admin user... 2024-08-18T22:33:41.707 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:33:41 smithi121 ceph-mon[16788]: from='client.14172 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2024-08-18T22:33:41.707 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:33:41 smithi121 ceph-mon[16788]: from='mgr.14160 172.21.15.121:0/261891242' entity='mgr.smithi121.lopxqc' 2024-08-18T22:33:41.707 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:33:41 smithi121 ceph-mon[16788]: from='mgr.14160 172.21.15.121:0/261891242' entity='mgr.smithi121.lopxqc' 2024-08-18T22:33:41.707 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:33:41 smithi121 ceph-mon[16788]: mgrmap e12: smithi121.lopxqc(active, since 2s) 2024-08-18T22:33:41.707 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:33:41 smithi121 ceph-mon[16788]: from='mgr.14160 172.21.15.121:0/261891242' entity='mgr.smithi121.lopxqc' 2024-08-18T22:33:42.583 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:33:42 smithi121 ceph-mon[16788]: from='client.14174 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2024-08-18T22:33:42.583 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:33:42 smithi121 ceph-mon[16788]: from='mgr.14160 172.21.15.121:0/261891242' entity='mgr.smithi121.lopxqc' 2024-08-18T22:33:42.947 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$DKSfTBzX6S5eu1yJXcfVdu/sx.3qCeZqpowgcseIIo2q2o.1hviBW", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1724020421, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2024-08-18T22:33:42.947 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:41.453+0000 7f46bfbd4640 1 Processor -- start 2024-08-18T22:33:42.947 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:41.453+0000 7f46bfbd4640 1 -- start start 2024-08-18T22:33:42.947 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:41.453+0000 7f46bfbd4640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f46b8101e00 0x7f46b8102210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:42.947 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:41.453+0000 7f46bfbd4640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46b8102750 con 0x7f46b8101e00 2024-08-18T22:33:42.947 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:41.453+0000 7f46bd970640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f46b8101e00 0x7f46b8102210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:42.947 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:41.453+0000 7f46bd970640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f46b8101e00 0x7f46b8102210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:52480/0 (socket says 172.21.15.121:52480) 2024-08-18T22:33:42.947 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:41.453+0000 7f46bd970640 1 -- 172.21.15.121:0/1172430465 learned_addr learned my addr 172.21.15.121:0/1172430465 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-18T22:33:42.947 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:41.454+0000 7f46bd970640 1 -- 172.21.15.121:0/1172430465 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46b8102890 con 0x7f46b8101e00 2024-08-18T22:33:42.947 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:41.454+0000 7f46bd970640 1 --2- 172.21.15.121:0/1172430465 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f46b8101e00 0x7f46b8102210 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f46b4009840 tx=0x7f46b40091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b4d73a9a694e1ce server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:33:42.947 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:41.454+0000 7f46bc96e640 1 -- 172.21.15.121:0/1172430465 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f46b4032440 con 0x7f46b8101e00 2024-08-18T22:33:42.948 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:41.454+0000 7f46bc96e640 1 -- 172.21.15.121:0/1172430465 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f46b4032a40 con 0x7f46b8101e00 2024-08-18T22:33:42.948 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:41.454+0000 7f46bc96e640 1 -- 172.21.15.121:0/1172430465 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f46b4031a70 con 0x7f46b8101e00 2024-08-18T22:33:42.948 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:41.455+0000 7f46bfbd4640 1 -- 172.21.15.121:0/1172430465 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f46b8101e00 msgr2=0x7f46b8102210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:42.948 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:41.455+0000 7f46bfbd4640 1 --2- 172.21.15.121:0/1172430465 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f46b8101e00 0x7f46b8102210 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f46b4009840 tx=0x7f46b40091d0 comp rx=0 tx=0).stop 2024-08-18T22:33:42.948 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:41.455+0000 7f46bfbd4640 1 -- 172.21.15.121:0/1172430465 shutdown_connections 2024-08-18T22:33:42.948 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:41.455+0000 7f46bfbd4640 1 --2- 172.21.15.121:0/1172430465 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f46b8101e00 0x7f46b8102210 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:42.948 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:41.455+0000 7f46bfbd4640 1 -- 172.21.15.121:0/1172430465 >> 172.21.15.121:0/1172430465 conn(0x7f46b80fd5a0 msgr2=0x7f46b80ff9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:33:42.948 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:41.456+0000 7f46bfbd4640 1 -- 172.21.15.121:0/1172430465 shutdown_connections 2024-08-18T22:33:42.948 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:41.456+0000 7f46bfbd4640 1 -- 172.21.15.121:0/1172430465 wait complete. 2024-08-18T22:33:42.948 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:41.456+0000 7f46bfbd4640 1 Processor -- start 2024-08-18T22:33:42.948 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:41.456+0000 7f46bfbd4640 1 -- start start 2024-08-18T22:33:42.948 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:41.456+0000 7f46bfbd4640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f46b8101e00 0x7f46b8112e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:42.948 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:41.456+0000 7f46bfbd4640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46b8113360 con 0x7f46b8101e00 2024-08-18T22:33:42.949 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:41.456+0000 7f46bd970640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f46b8101e00 0x7f46b8112e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:42.949 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:41.456+0000 7f46bd970640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f46b8101e00 0x7f46b8112e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:52482/0 (socket says 172.21.15.121:52482) 2024-08-18T22:33:42.949 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:41.456+0000 7f46bd970640 1 -- 172.21.15.121:0/1554704494 learned_addr learned my addr 172.21.15.121:0/1554704494 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-18T22:33:42.949 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:41.457+0000 7f46bd970640 1 -- 172.21.15.121:0/1554704494 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46b4009450 con 0x7f46b8101e00 2024-08-18T22:33:42.949 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:41.458+0000 7f46bd970640 1 --2- 172.21.15.121:0/1554704494 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f46b8101e00 0x7f46b8112e20 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f46b4031670 tx=0x7f46b40091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:33:42.949 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:41.458+0000 7f46ae7fc640 1 -- 172.21.15.121:0/1554704494 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f46b403c400 con 0x7f46b8101e00 2024-08-18T22:33:42.949 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:41.458+0000 7f46bfbd4640 1 -- 172.21.15.121:0/1554704494 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46b8113560 con 0x7f46b8101e00 2024-08-18T22:33:42.949 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:41.458+0000 7f46ae7fc640 1 -- 172.21.15.121:0/1554704494 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f46b403ca00 con 0x7f46b8101e00 2024-08-18T22:33:42.949 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:41.458+0000 7f46ae7fc640 1 -- 172.21.15.121:0/1554704494 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f46b403a910 con 0x7f46b8101e00 2024-08-18T22:33:42.949 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:41.458+0000 7f46bfbd4640 1 -- 172.21.15.121:0/1554704494 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46b8113fb0 con 0x7f46b8101e00 2024-08-18T22:33:42.949 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:41.459+0000 7f46ae7fc640 1 -- 172.21.15.121:0/1554704494 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 12) v1 ==== 42649+0+0 (secure 0 0 0) 0x7f46b403ab00 con 0x7f46b8101e00 2024-08-18T22:33:42.949 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:41.459+0000 7f46ae7fc640 1 --2- 172.21.15.121:0/1554704494 >> [v2:172.21.15.121:6800/1740603058,v1:172.21.15.121:6801/1740603058] conn(0x7f46a4035710 0x7f46a4037bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:42.950 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:41.459+0000 7f46ae7fc640 1 -- 172.21.15.121:0/1554704494 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f46b4068530 con 0x7f46b8101e00 2024-08-18T22:33:42.950 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:41.459+0000 7f46bfbd4640 1 -- 172.21.15.121:0/1554704494 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46b805eb10 con 0x7f46b8101e00 2024-08-18T22:33:42.950 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:41.459+0000 7f46bd16f640 1 --2- 172.21.15.121:0/1554704494 >> [v2:172.21.15.121:6800/1740603058,v1:172.21.15.121:6801/1740603058] conn(0x7f46a4035710 0x7f46a4037bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:42.950 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:41.459+0000 7f46bd16f640 1 --2- 172.21.15.121:0/1554704494 >> [v2:172.21.15.121:6800/1740603058,v1:172.21.15.121:6801/1740603058] conn(0x7f46a4035710 0x7f46a4037bc0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f46a8006fd0 tx=0x7f46a8006db0 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:33:42.950 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:41.465+0000 7f46ae7fc640 1 -- 172.21.15.121:0/1554704494 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f46b4037070 con 0x7f46b8101e00 2024-08-18T22:33:42.950 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:41.641+0000 7f46bfbd4640 1 -- 172.21.15.121:0/1554704494 --> [v2:172.21.15.121:6800/1740603058,v1:172.21.15.121:6801/1740603058] -- mgr_command(tid 0: {"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}) v1 -- 0x7f46b805e900 con 0x7f46a4035710 2024-08-18T22:33:42.950 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:41.868+0000 7f46ae7fc640 1 -- 172.21.15.121:0/1554704494 <== mgr.14160 v2:172.21.15.121:6800/1740603058 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+252 (secure 0 0 0) 0x7f46b805e900 con 0x7f46a4035710 2024-08-18T22:33:42.950 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:41.870+0000 7f46bfbd4640 1 -- 172.21.15.121:0/1554704494 >> [v2:172.21.15.121:6800/1740603058,v1:172.21.15.121:6801/1740603058] conn(0x7f46a4035710 msgr2=0x7f46a4037bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:42.950 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:41.870+0000 7f46bfbd4640 1 --2- 172.21.15.121:0/1554704494 >> [v2:172.21.15.121:6800/1740603058,v1:172.21.15.121:6801/1740603058] conn(0x7f46a4035710 0x7f46a4037bc0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f46a8006fd0 tx=0x7f46a8006db0 comp rx=0 tx=0).stop 2024-08-18T22:33:42.950 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:41.870+0000 7f46bfbd4640 1 -- 172.21.15.121:0/1554704494 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f46b8101e00 msgr2=0x7f46b8112e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:42.950 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:41.870+0000 7f46bfbd4640 1 --2- 172.21.15.121:0/1554704494 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f46b8101e00 0x7f46b8112e20 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f46b4031670 tx=0x7f46b40091d0 comp rx=0 tx=0).stop 2024-08-18T22:33:42.950 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:41.870+0000 7f46bfbd4640 1 -- 172.21.15.121:0/1554704494 shutdown_connections 2024-08-18T22:33:42.950 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:41.870+0000 7f46bfbd4640 1 --2- 172.21.15.121:0/1554704494 >> [v2:172.21.15.121:6800/1740603058,v1:172.21.15.121:6801/1740603058] conn(0x7f46a4035710 0x7f46a4037bc0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:42.951 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:41.870+0000 7f46bfbd4640 1 --2- 172.21.15.121:0/1554704494 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f46b8101e00 0x7f46b8112e20 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:42.951 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:41.870+0000 7f46bfbd4640 1 -- 172.21.15.121:0/1554704494 >> 172.21.15.121:0/1554704494 conn(0x7f46b80fd5a0 msgr2=0x7f46b80ff9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:33:42.951 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:41.870+0000 7f46bfbd4640 1 -- 172.21.15.121:0/1554704494 shutdown_connections 2024-08-18T22:33:42.951 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:41.870+0000 7f46bfbd4640 1 -- 172.21.15.121:0/1554704494 wait complete. 2024-08-18T22:33:42.951 INFO:teuthology.orchestra.run.smithi121.stdout:Fetching dashboard port number... 2024-08-18T22:33:43.834 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:33:43 smithi121 ceph-mon[16788]: from='client.? 172.21.15.121:0/2505584567' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2024-08-18T22:33:44.101 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stdout 8443 2024-08-18T22:33:44.102 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:43.347+0000 7fb62b2c2640 1 Processor -- start 2024-08-18T22:33:44.102 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:43.347+0000 7fb62b2c2640 1 -- start start 2024-08-18T22:33:44.102 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:43.348+0000 7fb62b2c2640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb624101210 0x7fb624101620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:44.102 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:43.348+0000 7fb62b2c2640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb624101b60 con 0x7fb624101210 2024-08-18T22:33:44.102 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:43.348+0000 7fb62905e640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb624101210 0x7fb624101620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:44.102 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:43.348+0000 7fb62905e640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb624101210 0x7fb624101620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:52484/0 (socket says 172.21.15.121:52484) 2024-08-18T22:33:44.102 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:43.348+0000 7fb62905e640 1 -- 172.21.15.121:0/2769118516 learned_addr learned my addr 172.21.15.121:0/2769118516 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-18T22:33:44.102 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:43.348+0000 7fb62905e640 1 -- 172.21.15.121:0/2769118516 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb624101ca0 con 0x7fb624101210 2024-08-18T22:33:44.102 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:43.349+0000 7fb62905e640 1 --2- 172.21.15.121:0/2769118516 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb624101210 0x7fb624101620 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fb620009840 tx=0x7fb6200091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=132f89f2df558e93 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:33:44.102 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:43.349+0000 7fb61bfff640 1 -- 172.21.15.121:0/2769118516 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb620032440 con 0x7fb624101210 2024-08-18T22:33:44.102 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:43.349+0000 7fb61bfff640 1 -- 172.21.15.121:0/2769118516 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fb620032a40 con 0x7fb624101210 2024-08-18T22:33:44.102 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:43.349+0000 7fb61bfff640 1 -- 172.21.15.121:0/2769118516 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb620031a70 con 0x7fb624101210 2024-08-18T22:33:44.103 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:43.349+0000 7fb62b2c2640 1 -- 172.21.15.121:0/2769118516 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb624101210 msgr2=0x7fb624101620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:44.103 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:43.349+0000 7fb62b2c2640 1 --2- 172.21.15.121:0/2769118516 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb624101210 0x7fb624101620 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fb620009840 tx=0x7fb6200091d0 comp rx=0 tx=0).stop 2024-08-18T22:33:44.103 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:43.349+0000 7fb62b2c2640 1 -- 172.21.15.121:0/2769118516 shutdown_connections 2024-08-18T22:33:44.103 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:43.349+0000 7fb62b2c2640 1 --2- 172.21.15.121:0/2769118516 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb624101210 0x7fb624101620 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:44.103 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:43.349+0000 7fb62b2c2640 1 -- 172.21.15.121:0/2769118516 >> 172.21.15.121:0/2769118516 conn(0x7fb6240fbb60 msgr2=0x7fb6240fdf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:33:44.103 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:43.350+0000 7fb62b2c2640 1 -- 172.21.15.121:0/2769118516 shutdown_connections 2024-08-18T22:33:44.103 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:43.350+0000 7fb62b2c2640 1 -- 172.21.15.121:0/2769118516 wait complete. 2024-08-18T22:33:44.103 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:43.350+0000 7fb62b2c2640 1 Processor -- start 2024-08-18T22:33:44.103 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:43.350+0000 7fb62b2c2640 1 -- start start 2024-08-18T22:33:44.103 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:43.350+0000 7fb62b2c2640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb624101210 0x7fb624100a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:44.103 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:43.350+0000 7fb62b2c2640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb624111670 con 0x7fb624101210 2024-08-18T22:33:44.103 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:43.350+0000 7fb62905e640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb624101210 0x7fb624100a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:44.103 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:43.350+0000 7fb62905e640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb624101210 0x7fb624100a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:52496/0 (socket says 172.21.15.121:52496) 2024-08-18T22:33:44.104 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:43.350+0000 7fb62905e640 1 -- 172.21.15.121:0/2505584567 learned_addr learned my addr 172.21.15.121:0/2505584567 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-18T22:33:44.104 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:43.350+0000 7fb62905e640 1 -- 172.21.15.121:0/2505584567 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb620009450 con 0x7fb624101210 2024-08-18T22:33:44.104 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:43.351+0000 7fb62905e640 1 --2- 172.21.15.121:0/2505584567 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb624101210 0x7fb624100a10 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fb620009810 tx=0x7fb6200091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:33:44.104 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:43.351+0000 7fb619ffb640 1 -- 172.21.15.121:0/2505584567 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb62003c400 con 0x7fb624101210 2024-08-18T22:33:44.104 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:43.351+0000 7fb619ffb640 1 -- 172.21.15.121:0/2505584567 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fb62003ca00 con 0x7fb624101210 2024-08-18T22:33:44.104 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:43.351+0000 7fb62b2c2640 1 -- 172.21.15.121:0/2505584567 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb624115c80 con 0x7fb624101210 2024-08-18T22:33:44.104 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:43.351+0000 7fb619ffb640 1 -- 172.21.15.121:0/2505584567 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb62003a870 con 0x7fb624101210 2024-08-18T22:33:44.104 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:43.351+0000 7fb62b2c2640 1 -- 172.21.15.121:0/2505584567 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb624115fb0 con 0x7fb624101210 2024-08-18T22:33:44.104 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:43.352+0000 7fb619ffb640 1 -- 172.21.15.121:0/2505584567 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 12) v1 ==== 42649+0+0 (secure 0 0 0) 0x7fb62003cb70 con 0x7fb624101210 2024-08-18T22:33:44.104 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:43.352+0000 7fb619ffb640 1 --2- 172.21.15.121:0/2505584567 >> [v2:172.21.15.121:6800/1740603058,v1:172.21.15.121:6801/1740603058] conn(0x7fb610035710 0x7fb610037bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:44.104 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:43.352+0000 7fb619ffb640 1 -- 172.21.15.121:0/2505584567 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7fb620068610 con 0x7fb624101210 2024-08-18T22:33:44.104 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:43.352+0000 7fb62b2c2640 1 -- 172.21.15.121:0/2505584567 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb62404b4c0 con 0x7fb624101210 2024-08-18T22:33:44.104 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:43.352+0000 7fb62885d640 1 --2- 172.21.15.121:0/2505584567 >> [v2:172.21.15.121:6800/1740603058,v1:172.21.15.121:6801/1740603058] conn(0x7fb610035710 0x7fb610037bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:44.104 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:43.352+0000 7fb62885d640 1 --2- 172.21.15.121:0/2505584567 >> [v2:172.21.15.121:6800/1740603058,v1:172.21.15.121:6801/1740603058] conn(0x7fb610035710 0x7fb610037bc0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fb614006fd0 tx=0x7fb614006db0 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:33:44.105 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:43.357+0000 7fb619ffb640 1 -- 172.21.15.121:0/2505584567 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fb620037030 con 0x7fb624101210 2024-08-18T22:33:44.105 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:43.515+0000 7fb62b2c2640 1 -- 172.21.15.121:0/2505584567 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} v 0) v1 -- 0x7fb624102a20 con 0x7fb624101210 2024-08-18T22:33:44.105 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:43.515+0000 7fb619ffb640 1 -- 172.21.15.121:0/2505584567 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]=0 v8) v1 ==== 112+0+5 (secure 0 0 0) 0x7fb62003b950 con 0x7fb624101210 2024-08-18T22:33:44.105 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:43.517+0000 7fb62b2c2640 1 -- 172.21.15.121:0/2505584567 >> [v2:172.21.15.121:6800/1740603058,v1:172.21.15.121:6801/1740603058] conn(0x7fb610035710 msgr2=0x7fb610037bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:44.105 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:43.517+0000 7fb62b2c2640 1 --2- 172.21.15.121:0/2505584567 >> [v2:172.21.15.121:6800/1740603058,v1:172.21.15.121:6801/1740603058] conn(0x7fb610035710 0x7fb610037bc0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fb614006fd0 tx=0x7fb614006db0 comp rx=0 tx=0).stop 2024-08-18T22:33:44.105 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:43.517+0000 7fb62b2c2640 1 -- 172.21.15.121:0/2505584567 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb624101210 msgr2=0x7fb624100a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:44.105 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:43.517+0000 7fb62b2c2640 1 --2- 172.21.15.121:0/2505584567 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb624101210 0x7fb624100a10 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fb620009810 tx=0x7fb6200091d0 comp rx=0 tx=0).stop 2024-08-18T22:33:44.105 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:43.517+0000 7fb62b2c2640 1 -- 172.21.15.121:0/2505584567 shutdown_connections 2024-08-18T22:33:44.105 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:43.517+0000 7fb62b2c2640 1 --2- 172.21.15.121:0/2505584567 >> [v2:172.21.15.121:6800/1740603058,v1:172.21.15.121:6801/1740603058] conn(0x7fb610035710 0x7fb610037bc0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:44.105 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:43.517+0000 7fb62b2c2640 1 --2- 172.21.15.121:0/2505584567 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb624101210 0x7fb624100a10 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:44.105 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:43.517+0000 7fb62b2c2640 1 -- 172.21.15.121:0/2505584567 >> 172.21.15.121:0/2505584567 conn(0x7fb6240fbb60 msgr2=0x7fb6240fc6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:33:44.105 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:43.517+0000 7fb62b2c2640 1 -- 172.21.15.121:0/2505584567 shutdown_connections 2024-08-18T22:33:44.105 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:43.517+0000 7fb62b2c2640 1 -- 172.21.15.121:0/2505584567 wait complete. 2024-08-18T22:33:44.108 INFO:teuthology.orchestra.run.smithi121.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-08-18T22:33:44.108 INFO:teuthology.orchestra.run.smithi121.stdout:systemctl: stdout disabled 2024-08-18T22:33:44.116 INFO:teuthology.orchestra.run.smithi121.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-08-18T22:33:44.116 INFO:teuthology.orchestra.run.smithi121.stdout:systemctl: stdout inactive 2024-08-18T22:33:44.116 INFO:teuthology.orchestra.run.smithi121.stdout:firewalld.service is not enabled 2024-08-18T22:33:44.116 INFO:teuthology.orchestra.run.smithi121.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2024-08-18T22:33:44.118 INFO:teuthology.orchestra.run.smithi121.stdout:Ceph Dashboard is now available at: 2024-08-18T22:33:44.118 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-08-18T22:33:44.118 INFO:teuthology.orchestra.run.smithi121.stdout: URL: https://smithi121:8443/ 2024-08-18T22:33:44.118 INFO:teuthology.orchestra.run.smithi121.stdout: User: admin 2024-08-18T22:33:44.118 INFO:teuthology.orchestra.run.smithi121.stdout: Password: r714dkybf1 2024-08-18T22:33:44.118 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-08-18T22:33:44.119 INFO:teuthology.orchestra.run.smithi121.stdout:Saving cluster configuration to /var/lib/ceph/b003123a-5db1-11ef-bccf-c7b262605968/config directory 2024-08-18T22:33:44.119 INFO:teuthology.orchestra.run.smithi121.stdout:Enabling autotune for osd_memory_target 2024-08-18T22:33:45.184 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:44.513+0000 7f99d9c5d640 1 Processor -- start 2024-08-18T22:33:45.184 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:44.513+0000 7f99d9c5d640 1 -- start start 2024-08-18T22:33:45.184 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:44.514+0000 7f99d9c5d640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f99d4101d20 0x7f99d4102130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:45.184 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:44.514+0000 7f99d9c5d640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99d4102670 con 0x7f99d4101d20 2024-08-18T22:33:45.184 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:44.514+0000 7f99d37fe640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f99d4101d20 0x7f99d4102130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:45.185 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:44.514+0000 7f99d37fe640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f99d4101d20 0x7f99d4102130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:52512/0 (socket says 172.21.15.121:52512) 2024-08-18T22:33:45.185 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:44.514+0000 7f99d37fe640 1 -- 172.21.15.121:0/515004790 learned_addr learned my addr 172.21.15.121:0/515004790 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-18T22:33:45.185 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:44.514+0000 7f99d37fe640 1 -- 172.21.15.121:0/515004790 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99d41027b0 con 0x7f99d4101d20 2024-08-18T22:33:45.185 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:44.515+0000 7f99d37fe640 1 --2- 172.21.15.121:0/515004790 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f99d4101d20 0x7f99d4102130 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f99c4009840 tx=0x7f99c40091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a1d48dd08c08352 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:33:45.185 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:44.515+0000 7f99d27fc640 1 -- 172.21.15.121:0/515004790 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f99c4032440 con 0x7f99d4101d20 2024-08-18T22:33:45.185 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:44.515+0000 7f99d27fc640 1 -- 172.21.15.121:0/515004790 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f99c4032a40 con 0x7f99d4101d20 2024-08-18T22:33:45.185 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:44.515+0000 7f99d27fc640 1 -- 172.21.15.121:0/515004790 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f99c4031a70 con 0x7f99d4101d20 2024-08-18T22:33:45.185 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:44.516+0000 7f99d9c5d640 1 -- 172.21.15.121:0/515004790 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f99d4101d20 msgr2=0x7f99d4102130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:45.185 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:44.516+0000 7f99d9c5d640 1 --2- 172.21.15.121:0/515004790 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f99d4101d20 0x7f99d4102130 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f99c4009840 tx=0x7f99c40091d0 comp rx=0 tx=0).stop 2024-08-18T22:33:45.185 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:44.516+0000 7f99d9c5d640 1 -- 172.21.15.121:0/515004790 shutdown_connections 2024-08-18T22:33:45.186 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:44.516+0000 7f99d9c5d640 1 --2- 172.21.15.121:0/515004790 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f99d4101d20 0x7f99d4102130 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:45.186 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:44.516+0000 7f99d9c5d640 1 -- 172.21.15.121:0/515004790 >> 172.21.15.121:0/515004790 conn(0x7f99d40fd500 msgr2=0x7f99d40ff910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:33:45.186 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:44.516+0000 7f99d9c5d640 1 -- 172.21.15.121:0/515004790 shutdown_connections 2024-08-18T22:33:45.186 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:44.516+0000 7f99d9c5d640 1 -- 172.21.15.121:0/515004790 wait complete. 2024-08-18T22:33:45.186 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:44.516+0000 7f99d9c5d640 1 Processor -- start 2024-08-18T22:33:45.186 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:44.516+0000 7f99d9c5d640 1 -- start start 2024-08-18T22:33:45.186 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:44.517+0000 7f99d9c5d640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f99d4101d20 0x7f99d4110b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:45.186 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:44.517+0000 7f99d9c5d640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99d41110a0 con 0x7f99d4101d20 2024-08-18T22:33:45.186 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:44.517+0000 7f99d37fe640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f99d4101d20 0x7f99d4110b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:45.186 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:44.517+0000 7f99d37fe640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f99d4101d20 0x7f99d4110b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:52526/0 (socket says 172.21.15.121:52526) 2024-08-18T22:33:45.186 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:44.517+0000 7f99d37fe640 1 -- 172.21.15.121:0/1554525202 learned_addr learned my addr 172.21.15.121:0/1554525202 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-18T22:33:45.186 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:44.517+0000 7f99d37fe640 1 -- 172.21.15.121:0/1554525202 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99c4009450 con 0x7f99d4101d20 2024-08-18T22:33:45.187 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:44.517+0000 7f99d37fe640 1 --2- 172.21.15.121:0/1554525202 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f99d4101d20 0x7f99d4110b60 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f99c4031670 tx=0x7f99c40091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:33:45.187 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:44.517+0000 7f99bbfff640 1 -- 172.21.15.121:0/1554525202 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f99c403c400 con 0x7f99d4101d20 2024-08-18T22:33:45.187 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:44.517+0000 7f99bbfff640 1 -- 172.21.15.121:0/1554525202 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f99c403ca00 con 0x7f99d4101d20 2024-08-18T22:33:45.187 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:44.517+0000 7f99d9c5d640 1 -- 172.21.15.121:0/1554525202 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99d41112a0 con 0x7f99d4101d20 2024-08-18T22:33:45.187 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:44.517+0000 7f99bbfff640 1 -- 172.21.15.121:0/1554525202 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f99c403a910 con 0x7f99d4101d20 2024-08-18T22:33:45.187 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:44.517+0000 7f99d9c5d640 1 -- 172.21.15.121:0/1554525202 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99d4111710 con 0x7f99d4101d20 2024-08-18T22:33:45.187 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:44.518+0000 7f99bbfff640 1 -- 172.21.15.121:0/1554525202 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 12) v1 ==== 42649+0+0 (secure 0 0 0) 0x7f99c403ab00 con 0x7f99d4101d20 2024-08-18T22:33:45.187 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:44.518+0000 7f99bbfff640 1 --2- 172.21.15.121:0/1554525202 >> [v2:172.21.15.121:6800/1740603058,v1:172.21.15.121:6801/1740603058] conn(0x7f99bc035710 0x7f99bc037bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:45.187 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:44.518+0000 7f99bbfff640 1 -- 172.21.15.121:0/1554525202 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f99c40682e0 con 0x7f99d4101d20 2024-08-18T22:33:45.187 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:44.518+0000 7f99d9c5d640 1 -- 172.21.15.121:0/1554525202 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99d405eb10 con 0x7f99d4101d20 2024-08-18T22:33:45.187 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:44.518+0000 7f99d2ffd640 1 --2- 172.21.15.121:0/1554525202 >> [v2:172.21.15.121:6800/1740603058,v1:172.21.15.121:6801/1740603058] conn(0x7f99bc035710 0x7f99bc037bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:45.187 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:44.519+0000 7f99d2ffd640 1 --2- 172.21.15.121:0/1554525202 >> [v2:172.21.15.121:6800/1740603058,v1:172.21.15.121:6801/1740603058] conn(0x7f99bc035710 0x7f99bc037bc0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f99c8006fd0 tx=0x7f99c8006db0 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:33:45.187 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:44.523+0000 7f99bbfff640 1 -- 172.21.15.121:0/1554525202 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f99c4046460 con 0x7f99d4101d20 2024-08-18T22:33:45.188 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:44.568+0000 7f99bbfff640 1 -- 172.21.15.121:0/1554525202 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mgrmap(e 13) v1 ==== 42693+0+0 (secure 0 0 0) 0x7f99c404cd10 con 0x7f99d4101d20 2024-08-18T22:33:45.188 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:44.680+0000 7f99d9c5d640 1 -- 172.21.15.121:0/1554525202 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command([{prefix=config set, name=osd_memory_target_autotune}] v 0) v1 -- 0x7f99d4103af0 con 0x7f99d4101d20 2024-08-18T22:33:45.188 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:44.681+0000 7f99bbfff640 1 -- 172.21.15.121:0/1554525202 <== mon.0 v2:172.21.15.121:3300/0 8 ==== mon_command_ack([{prefix=config set, name=osd_memory_target_autotune}]=0 v8)=0 v8) v1 ==== 127+0+0 (secure 0 0 0) 0x7f99c4044360 con 0x7f99d4101d20 2024-08-18T22:33:45.188 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:44.683+0000 7f99d9c5d640 1 -- 172.21.15.121:0/1554525202 >> [v2:172.21.15.121:6800/1740603058,v1:172.21.15.121:6801/1740603058] conn(0x7f99bc035710 msgr2=0x7f99bc037bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:45.188 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:44.683+0000 7f99d9c5d640 1 --2- 172.21.15.121:0/1554525202 >> [v2:172.21.15.121:6800/1740603058,v1:172.21.15.121:6801/1740603058] conn(0x7f99bc035710 0x7f99bc037bc0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f99c8006fd0 tx=0x7f99c8006db0 comp rx=0 tx=0).stop 2024-08-18T22:33:45.188 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:44.683+0000 7f99d9c5d640 1 -- 172.21.15.121:0/1554525202 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f99d4101d20 msgr2=0x7f99d4110b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:45.188 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:44.683+0000 7f99d9c5d640 1 --2- 172.21.15.121:0/1554525202 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f99d4101d20 0x7f99d4110b60 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f99c4031670 tx=0x7f99c40091d0 comp rx=0 tx=0).stop 2024-08-18T22:33:45.188 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:44.683+0000 7f99d9c5d640 1 -- 172.21.15.121:0/1554525202 shutdown_connections 2024-08-18T22:33:45.188 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:44.683+0000 7f99d9c5d640 1 --2- 172.21.15.121:0/1554525202 >> [v2:172.21.15.121:6800/1740603058,v1:172.21.15.121:6801/1740603058] conn(0x7f99bc035710 0x7f99bc037bc0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:45.188 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:44.683+0000 7f99d9c5d640 1 --2- 172.21.15.121:0/1554525202 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f99d4101d20 0x7f99d4110b60 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:45.188 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:44.683+0000 7f99d9c5d640 1 -- 172.21.15.121:0/1554525202 >> 172.21.15.121:0/1554525202 conn(0x7f99d40fd500 msgr2=0x7f99d40fe160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:33:45.188 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:44.683+0000 7f99d9c5d640 1 -- 172.21.15.121:0/1554525202 shutdown_connections 2024-08-18T22:33:45.188 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:44.683+0000 7f99d9c5d640 1 -- 172.21.15.121:0/1554525202 wait complete. 2024-08-18T22:33:45.833 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:33:45 smithi121 ceph-mon[16788]: mgrmap e13: smithi121.lopxqc(active, since 6s) 2024-08-18T22:33:46.449 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:45.593+0000 7f5a0515a640 1 Processor -- start 2024-08-18T22:33:46.449 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:45.593+0000 7f5a0515a640 1 -- start start 2024-08-18T22:33:46.449 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:45.593+0000 7f5a0515a640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5a00102200 0x7f5a00102610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:46.449 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:45.593+0000 7f5a0515a640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a00102b50 con 0x7f5a00102200 2024-08-18T22:33:46.449 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:45.593+0000 7f59fed9d640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5a00102200 0x7f5a00102610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:46.449 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:45.593+0000 7f59fed9d640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5a00102200 0x7f5a00102610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:52534/0 (socket says 172.21.15.121:52534) 2024-08-18T22:33:46.450 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:45.593+0000 7f59fed9d640 1 -- 172.21.15.121:0/2969691826 learned_addr learned my addr 172.21.15.121:0/2969691826 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-18T22:33:46.450 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:45.593+0000 7f59fed9d640 1 -- 172.21.15.121:0/2969691826 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a00102c90 con 0x7f5a00102200 2024-08-18T22:33:46.450 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:45.594+0000 7f59fed9d640 1 --2- 172.21.15.121:0/2969691826 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5a00102200 0x7f5a00102610 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f59f000baf0 tx=0x7f59f000b460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3237500651f12c30 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:33:46.450 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:45.594+0000 7f59fe59c640 1 -- 172.21.15.121:0/2969691826 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f59f00327a0 con 0x7f5a00102200 2024-08-18T22:33:46.450 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:45.594+0000 7f59fe59c640 1 -- 172.21.15.121:0/2969691826 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f59f0032da0 con 0x7f5a00102200 2024-08-18T22:33:46.450 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:45.594+0000 7f59fe59c640 1 -- 172.21.15.121:0/2969691826 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f59f0031e60 con 0x7f5a00102200 2024-08-18T22:33:46.450 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:45.595+0000 7f5a0515a640 1 -- 172.21.15.121:0/2969691826 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5a00102200 msgr2=0x7f5a00102610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:46.450 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:45.595+0000 7f5a0515a640 1 --2- 172.21.15.121:0/2969691826 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5a00102200 0x7f5a00102610 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f59f000baf0 tx=0x7f59f000b460 comp rx=0 tx=0).stop 2024-08-18T22:33:46.450 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:45.595+0000 7f5a0515a640 1 -- 172.21.15.121:0/2969691826 shutdown_connections 2024-08-18T22:33:46.450 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:45.595+0000 7f5a0515a640 1 --2- 172.21.15.121:0/2969691826 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5a00102200 0x7f5a00102610 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:46.450 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:45.595+0000 7f5a0515a640 1 -- 172.21.15.121:0/2969691826 >> 172.21.15.121:0/2969691826 conn(0x7f5a000fbb60 msgr2=0x7f5a000fdf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:33:46.450 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:45.595+0000 7f5a0515a640 1 -- 172.21.15.121:0/2969691826 shutdown_connections 2024-08-18T22:33:46.450 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:45.595+0000 7f5a0515a640 1 -- 172.21.15.121:0/2969691826 wait complete. 2024-08-18T22:33:46.451 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:45.595+0000 7f5a0515a640 1 Processor -- start 2024-08-18T22:33:46.451 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:45.595+0000 7f5a0515a640 1 -- start start 2024-08-18T22:33:46.451 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:45.595+0000 7f5a0515a640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5a00102200 0x7f5a00112cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:46.451 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:45.595+0000 7f5a0515a640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a00113230 con 0x7f5a00102200 2024-08-18T22:33:46.451 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:45.596+0000 7f59fed9d640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5a00102200 0x7f5a00112cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:46.451 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:45.596+0000 7f59fed9d640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5a00102200 0x7f5a00112cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:52550/0 (socket says 172.21.15.121:52550) 2024-08-18T22:33:46.451 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:45.596+0000 7f59fed9d640 1 -- 172.21.15.121:0/4112434196 learned_addr learned my addr 172.21.15.121:0/4112434196 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-18T22:33:46.451 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:45.596+0000 7f59fed9d640 1 -- 172.21.15.121:0/4112434196 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59f000b700 con 0x7f5a00102200 2024-08-18T22:33:46.451 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:45.596+0000 7f59fed9d640 1 --2- 172.21.15.121:0/4112434196 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5a00102200 0x7f5a00112cf0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f59f000b2c0 tx=0x7f59f0008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:33:46.451 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:45.596+0000 7f59f77fe640 1 -- 172.21.15.121:0/4112434196 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f59f00329b0 con 0x7f5a00102200 2024-08-18T22:33:46.451 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:45.596+0000 7f5a0515a640 1 -- 172.21.15.121:0/4112434196 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a00113430 con 0x7f5a00102200 2024-08-18T22:33:46.451 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:45.596+0000 7f59f77fe640 1 -- 172.21.15.121:0/4112434196 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f59f0032b10 con 0x7f5a00102200 2024-08-18T22:33:46.451 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:45.596+0000 7f59f77fe640 1 -- 172.21.15.121:0/4112434196 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f59f0045640 con 0x7f5a00102200 2024-08-18T22:33:46.452 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:45.596+0000 7f5a0515a640 1 -- 172.21.15.121:0/4112434196 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a001138a0 con 0x7f5a00102200 2024-08-18T22:33:46.452 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:45.597+0000 7f59f77fe640 1 -- 172.21.15.121:0/4112434196 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 13) v1 ==== 42693+0+0 (secure 0 0 0) 0x7f59f0045880 con 0x7f5a00102200 2024-08-18T22:33:46.452 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:45.597+0000 7f5a0515a640 1 -- 172.21.15.121:0/4112434196 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a0004b4c0 con 0x7f5a00102200 2024-08-18T22:33:46.452 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:45.597+0000 7f59f77fe640 1 --2- 172.21.15.121:0/4112434196 >> [v2:172.21.15.121:6800/1740603058,v1:172.21.15.121:6801/1740603058] conn(0x7f59ec0357b0 0x7f59ec037c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:46.452 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:45.597+0000 7f59f77fe640 1 -- 172.21.15.121:0/4112434196 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f59f0069070 con 0x7f5a00102200 2024-08-18T22:33:46.452 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:45.597+0000 7f59f7fff640 1 --2- 172.21.15.121:0/4112434196 >> [v2:172.21.15.121:6800/1740603058,v1:172.21.15.121:6801/1740603058] conn(0x7f59ec0357b0 0x7f59ec037c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:46.452 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:45.598+0000 7f59f7fff640 1 --2- 172.21.15.121:0/4112434196 >> [v2:172.21.15.121:6800/1740603058,v1:172.21.15.121:6801/1740603058] conn(0x7f59ec0357b0 0x7f59ec037c60 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f59e8006fd0 tx=0x7f59e8006db0 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:33:46.452 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:45.601+0000 7f59f77fe640 1 -- 172.21.15.121:0/4112434196 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f59f0044390 con 0x7f5a00102200 2024-08-18T22:33:46.452 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:45.839+0000 7f5a0515a640 1 -- 172.21.15.121:0/4112434196 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command([{prefix=config-key set, key=mgr/dashboard/cluster/status}] v 0) v1 -- 0x7f5a00114200 con 0x7f5a00102200 2024-08-18T22:33:46.452 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:45.844+0000 7f59f77fe640 1 -- 172.21.15.121:0/4112434196 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{prefix=config-key set, key=mgr/dashboard/cluster/status}]=0 set mgr/dashboard/cluster/status v33)=0 set mgr/dashboard/cluster/status v33) v1 ==== 153+0+0 (secure 0 0 0) 0x7f59f0036020 con 0x7f5a00102200 2024-08-18T22:33:46.452 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2024-08-18T22:33:46.452 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:45.846+0000 7f5a0515a640 1 -- 172.21.15.121:0/4112434196 >> [v2:172.21.15.121:6800/1740603058,v1:172.21.15.121:6801/1740603058] conn(0x7f59ec0357b0 msgr2=0x7f59ec037c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:46.452 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:45.846+0000 7f5a0515a640 1 --2- 172.21.15.121:0/4112434196 >> [v2:172.21.15.121:6800/1740603058,v1:172.21.15.121:6801/1740603058] conn(0x7f59ec0357b0 0x7f59ec037c60 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f59e8006fd0 tx=0x7f59e8006db0 comp rx=0 tx=0).stop 2024-08-18T22:33:46.452 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:45.846+0000 7f5a0515a640 1 -- 172.21.15.121:0/4112434196 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5a00102200 msgr2=0x7f5a00112cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:46.453 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:45.846+0000 7f5a0515a640 1 --2- 172.21.15.121:0/4112434196 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5a00102200 0x7f5a00112cf0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f59f000b2c0 tx=0x7f59f0008040 comp rx=0 tx=0).stop 2024-08-18T22:33:46.453 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:45.846+0000 7f5a0515a640 1 -- 172.21.15.121:0/4112434196 shutdown_connections 2024-08-18T22:33:46.453 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:45.846+0000 7f5a0515a640 1 --2- 172.21.15.121:0/4112434196 >> [v2:172.21.15.121:6800/1740603058,v1:172.21.15.121:6801/1740603058] conn(0x7f59ec0357b0 0x7f59ec037c60 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:46.453 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:45.846+0000 7f5a0515a640 1 --2- 172.21.15.121:0/4112434196 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5a00102200 0x7f5a00112cf0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:46.453 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:45.846+0000 7f5a0515a640 1 -- 172.21.15.121:0/4112434196 >> 172.21.15.121:0/4112434196 conn(0x7f5a000fbb60 msgr2=0x7f5a001051c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:33:46.453 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:45.846+0000 7f5a0515a640 1 -- 172.21.15.121:0/4112434196 shutdown_connections 2024-08-18T22:33:46.453 INFO:teuthology.orchestra.run.smithi121.stdout:/usr/bin/ceph: stderr 2024-08-18T22:33:45.846+0000 7f5a0515a640 1 -- 172.21.15.121:0/4112434196 wait complete. 2024-08-18T22:33:46.453 INFO:teuthology.orchestra.run.smithi121.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2024-08-18T22:33:46.453 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-08-18T22:33:46.453 INFO:teuthology.orchestra.run.smithi121.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid b003123a-5db1-11ef-bccf-c7b262605968 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2024-08-18T22:33:46.453 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-08-18T22:33:46.453 INFO:teuthology.orchestra.run.smithi121.stdout:Or, if you are only running a single cluster on this host: 2024-08-18T22:33:46.453 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-08-18T22:33:46.453 INFO:teuthology.orchestra.run.smithi121.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2024-08-18T22:33:46.454 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-08-18T22:33:46.454 INFO:teuthology.orchestra.run.smithi121.stdout:Please consider enabling telemetry to help improve Ceph: 2024-08-18T22:33:46.454 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-08-18T22:33:46.454 INFO:teuthology.orchestra.run.smithi121.stdout: ceph telemetry on 2024-08-18T22:33:46.454 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-08-18T22:33:46.454 INFO:teuthology.orchestra.run.smithi121.stdout:For more information see: 2024-08-18T22:33:46.454 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-08-18T22:33:46.454 INFO:teuthology.orchestra.run.smithi121.stdout: https://docs.ceph.com/docs/master/mgr/telemetry/ 2024-08-18T22:33:46.454 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-08-18T22:33:46.454 INFO:teuthology.orchestra.run.smithi121.stdout:Bootstrap complete. 2024-08-18T22:33:46.482 INFO:tasks.cephadm:Fetching config... 2024-08-18T22:33:46.483 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-08-18T22:33:46.483 DEBUG:teuthology.orchestra.run.smithi121:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2024-08-18T22:33:46.499 INFO:tasks.cephadm:Fetching client.admin keyring... 2024-08-18T22:33:46.499 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-08-18T22:33:46.499 DEBUG:teuthology.orchestra.run.smithi121:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2024-08-18T22:33:46.554 INFO:tasks.cephadm:Fetching mon keyring... 2024-08-18T22:33:46.554 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-08-18T22:33:46.554 DEBUG:teuthology.orchestra.run.smithi121:> sudo dd if=/var/lib/ceph/b003123a-5db1-11ef-bccf-c7b262605968/mon.smithi121/keyring of=/dev/stdout 2024-08-18T22:33:46.619 INFO:tasks.cephadm:Fetching pub ssh key... 2024-08-18T22:33:46.619 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-08-18T22:33:46.619 DEBUG:teuthology.orchestra.run.smithi121:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2024-08-18T22:33:46.675 INFO:tasks.cephadm:Installing pub ssh key for root users... 2024-08-18T22:33:46.676 DEBUG:teuthology.orchestra.run.smithi121:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC028uiFvtEIePnBq3FsSf4SgUauykxj4MgeDtZdt/UrlZ/sGuRk9Oe4xpvt5iL8uSvfXOMk27pay7OV63s9D4EGkCFT/S921XHf+AYyzqXlF/sZXf8++x7w5O8ZP7XBUlBypLZGdh11kfkvWlkv/vjb4MyK36BRs5piSQQF8Lc7PhP3Enq9MB5yHhsIBmd/VQox2sn5lUrPfsk6xPJ37sxvV4GtP1M63uW4eeDMmOWvsZMZL75e+DjsjEagpdYuTmaUSlDQD2NhMQzoIH+yFNZi3a6Iatr8peAB3sjM/lQrHn1tbHd6KNKVGyQ4bMIV3B7zwygYF1S9GOfThfSKoPtKdO/fNy6xY1nI1Jq6Lpy6+WXZfNANuBWI45BsjlV1PFft+s4mMVl0vytlkArzqm+sARuU6EQgT17B784zzYaK5Okv7Ee5PWC2TjPbtbzTLLqOmPtAeki6r1wWUxOSnKNsvXlxhWdCHZMhrsAXQ9pyq/Hy1FoWJCiq/FkD7w5eG8= ceph-b003123a-5db1-11ef-bccf-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-08-18T22:33:46.750 INFO:teuthology.orchestra.run.smithi121.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC028uiFvtEIePnBq3FsSf4SgUauykxj4MgeDtZdt/UrlZ/sGuRk9Oe4xpvt5iL8uSvfXOMk27pay7OV63s9D4EGkCFT/S921XHf+AYyzqXlF/sZXf8++x7w5O8ZP7XBUlBypLZGdh11kfkvWlkv/vjb4MyK36BRs5piSQQF8Lc7PhP3Enq9MB5yHhsIBmd/VQox2sn5lUrPfsk6xPJ37sxvV4GtP1M63uW4eeDMmOWvsZMZL75e+DjsjEagpdYuTmaUSlDQD2NhMQzoIH+yFNZi3a6Iatr8peAB3sjM/lQrHn1tbHd6KNKVGyQ4bMIV3B7zwygYF1S9GOfThfSKoPtKdO/fNy6xY1nI1Jq6Lpy6+WXZfNANuBWI45BsjlV1PFft+s4mMVl0vytlkArzqm+sARuU6EQgT17B784zzYaK5Okv7Ee5PWC2TjPbtbzTLLqOmPtAeki6r1wWUxOSnKNsvXlxhWdCHZMhrsAXQ9pyq/Hy1FoWJCiq/FkD7w5eG8= ceph-b003123a-5db1-11ef-bccf-c7b262605968 2024-08-18T22:33:46.761 DEBUG:teuthology.orchestra.run.smithi195:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC028uiFvtEIePnBq3FsSf4SgUauykxj4MgeDtZdt/UrlZ/sGuRk9Oe4xpvt5iL8uSvfXOMk27pay7OV63s9D4EGkCFT/S921XHf+AYyzqXlF/sZXf8++x7w5O8ZP7XBUlBypLZGdh11kfkvWlkv/vjb4MyK36BRs5piSQQF8Lc7PhP3Enq9MB5yHhsIBmd/VQox2sn5lUrPfsk6xPJ37sxvV4GtP1M63uW4eeDMmOWvsZMZL75e+DjsjEagpdYuTmaUSlDQD2NhMQzoIH+yFNZi3a6Iatr8peAB3sjM/lQrHn1tbHd6KNKVGyQ4bMIV3B7zwygYF1S9GOfThfSKoPtKdO/fNy6xY1nI1Jq6Lpy6+WXZfNANuBWI45BsjlV1PFft+s4mMVl0vytlkArzqm+sARuU6EQgT17B784zzYaK5Okv7Ee5PWC2TjPbtbzTLLqOmPtAeki6r1wWUxOSnKNsvXlxhWdCHZMhrsAXQ9pyq/Hy1FoWJCiq/FkD7w5eG8= ceph-b003123a-5db1-11ef-bccf-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-08-18T22:33:46.902 INFO:teuthology.orchestra.run.smithi195.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC028uiFvtEIePnBq3FsSf4SgUauykxj4MgeDtZdt/UrlZ/sGuRk9Oe4xpvt5iL8uSvfXOMk27pay7OV63s9D4EGkCFT/S921XHf+AYyzqXlF/sZXf8++x7w5O8ZP7XBUlBypLZGdh11kfkvWlkv/vjb4MyK36BRs5piSQQF8Lc7PhP3Enq9MB5yHhsIBmd/VQox2sn5lUrPfsk6xPJ37sxvV4GtP1M63uW4eeDMmOWvsZMZL75e+DjsjEagpdYuTmaUSlDQD2NhMQzoIH+yFNZi3a6Iatr8peAB3sjM/lQrHn1tbHd6KNKVGyQ4bMIV3B7zwygYF1S9GOfThfSKoPtKdO/fNy6xY1nI1Jq6Lpy6+WXZfNANuBWI45BsjlV1PFft+s4mMVl0vytlkArzqm+sARuU6EQgT17B784zzYaK5Okv7Ee5PWC2TjPbtbzTLLqOmPtAeki6r1wWUxOSnKNsvXlxhWdCHZMhrsAXQ9pyq/Hy1FoWJCiq/FkD7w5eG8= ceph-b003123a-5db1-11ef-bccf-c7b262605968 2024-08-18T22:33:46.915 DEBUG:teuthology.orchestra.run.smithi121:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b003123a-5db1-11ef-bccf-c7b262605968 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2024-08-18T22:33:47.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:33:46 smithi121 ceph-mon[16788]: from='client.? 172.21.15.121:0/4112434196' entity='client.admin' 2024-08-18T22:33:47.166 INFO:teuthology.orchestra.run.smithi121.stderr:Inferring config /var/lib/ceph/b003123a-5db1-11ef-bccf-c7b262605968/mon.smithi121/config 2024-08-18T22:33:49.073 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:33:49.071+0000 7f67842ba640 1 -- 172.21.15.121:0/3339135519 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f677c0fa380 msgr2=0x7f677c0fa790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:49.074 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:33:49.071+0000 7f67842ba640 1 --2- 172.21.15.121:0/3339135519 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f677c0fa380 0x7f677c0fa790 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f6778004850 tx=0x7f6778009da0 comp rx=0 tx=0).stop 2024-08-18T22:33:49.074 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:33:49.071+0000 7f67842ba640 1 -- 172.21.15.121:0/3339135519 shutdown_connections 2024-08-18T22:33:49.074 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:33:49.071+0000 7f67842ba640 1 --2- 172.21.15.121:0/3339135519 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f677c0fa380 0x7f677c0fa790 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:49.074 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:33:49.071+0000 7f67842ba640 1 -- 172.21.15.121:0/3339135519 >> 172.21.15.121:0/3339135519 conn(0x7f677c0f5de0 msgr2=0x7f677c0f81f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:33:49.074 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:33:49.071+0000 7f67842ba640 1 -- 172.21.15.121:0/3339135519 shutdown_connections 2024-08-18T22:33:49.074 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:33:49.071+0000 7f67842ba640 1 -- 172.21.15.121:0/3339135519 wait complete. 2024-08-18T22:33:49.074 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:33:49.072+0000 7f67842ba640 1 Processor -- start 2024-08-18T22:33:49.074 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:33:49.072+0000 7f67842ba640 1 -- start start 2024-08-18T22:33:49.074 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:33:49.072+0000 7f67842ba640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f677c0fa380 0x7f677c10c6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:49.074 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:33:49.072+0000 7f67842ba640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f677c10cbf0 con 0x7f677c0fa380 2024-08-18T22:33:49.074 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:33:49.072+0000 7f6782056640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f677c0fa380 0x7f677c10c6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:49.074 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:33:49.072+0000 7f6782056640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f677c0fa380 0x7f677c10c6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:46262/0 (socket says 172.21.15.121:46262) 2024-08-18T22:33:49.074 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:33:49.072+0000 7f6782056640 1 -- 172.21.15.121:0/2304484520 learned_addr learned my addr 172.21.15.121:0/2304484520 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-18T22:33:49.075 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:33:49.073+0000 7f6782056640 1 -- 172.21.15.121:0/2304484520 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6778005040 con 0x7f677c0fa380 2024-08-18T22:33:49.075 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:33:49.073+0000 7f6782056640 1 --2- 172.21.15.121:0/2304484520 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f677c0fa380 0x7f677c10c6b0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f6778009920 tx=0x7f6778009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:33:49.076 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:33:49.073+0000 7f6772ffd640 1 -- 172.21.15.121:0/2304484520 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6778033630 con 0x7f677c0fa380 2024-08-18T22:33:49.076 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:33:49.073+0000 7f6772ffd640 1 -- 172.21.15.121:0/2304484520 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f6778033c30 con 0x7f677c0fa380 2024-08-18T22:33:49.076 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:33:49.073+0000 7f67842ba640 1 -- 172.21.15.121:0/2304484520 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f677c10cdf0 con 0x7f677c0fa380 2024-08-18T22:33:49.076 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:33:49.073+0000 7f6772ffd640 1 -- 172.21.15.121:0/2304484520 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f677803dc40 con 0x7f677c0fa380 2024-08-18T22:33:49.076 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:33:49.073+0000 7f67842ba640 1 -- 172.21.15.121:0/2304484520 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f677c10d260 con 0x7f677c0fa380 2024-08-18T22:33:49.076 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:33:49.074+0000 7f6772ffd640 1 -- 172.21.15.121:0/2304484520 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 13) v1 ==== 42693+0+0 (secure 0 0 0) 0x7f6778030020 con 0x7f677c0fa380 2024-08-18T22:33:49.076 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:33:49.074+0000 7f6772ffd640 1 --2- 172.21.15.121:0/2304484520 >> [v2:172.21.15.121:6800/1740603058,v1:172.21.15.121:6801/1740603058] conn(0x7f6768035800 0x7f6768037cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:49.076 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:33:49.074+0000 7f67842ba640 1 -- 172.21.15.121:0/2304484520 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f677c05eb10 con 0x7f677c0fa380 2024-08-18T22:33:49.076 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:33:49.074+0000 7f6772ffd640 1 -- 172.21.15.121:0/2304484520 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f6778067dd0 con 0x7f677c0fa380 2024-08-18T22:33:49.077 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:33:49.074+0000 7f6781855640 1 --2- 172.21.15.121:0/2304484520 >> [v2:172.21.15.121:6800/1740603058,v1:172.21.15.121:6801/1740603058] conn(0x7f6768035800 0x7f6768037cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:49.077 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:33:49.074+0000 7f6781855640 1 --2- 172.21.15.121:0/2304484520 >> [v2:172.21.15.121:6800/1740603058,v1:172.21.15.121:6801/1740603058] conn(0x7f6768035800 0x7f6768037cb0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f676c006fd0 tx=0x7f676c006db0 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:33:49.079 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:33:49.079+0000 7f6772ffd640 1 -- 172.21.15.121:0/2304484520 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f67780463e0 con 0x7f677c0fa380 2024-08-18T22:33:49.244 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:33:49.243+0000 7f67842ba640 1 -- 172.21.15.121:0/2304484520 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/allow_ptrace}] v 0) v1 -- 0x7f677c10d260 con 0x7f677c0fa380 2024-08-18T22:33:49.247 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:33:49.246+0000 7f6772ffd640 1 -- 172.21.15.121:0/2304484520 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/allow_ptrace}]=0 v9)=0 v9) v1 ==== 125+0+0 (secure 0 0 0) 0x7f677803de60 con 0x7f677c0fa380 2024-08-18T22:33:49.250 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:33:49.248+0000 7f67842ba640 1 -- 172.21.15.121:0/2304484520 >> [v2:172.21.15.121:6800/1740603058,v1:172.21.15.121:6801/1740603058] conn(0x7f6768035800 msgr2=0x7f6768037cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:49.250 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:33:49.248+0000 7f67842ba640 1 --2- 172.21.15.121:0/2304484520 >> [v2:172.21.15.121:6800/1740603058,v1:172.21.15.121:6801/1740603058] conn(0x7f6768035800 0x7f6768037cb0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f676c006fd0 tx=0x7f676c006db0 comp rx=0 tx=0).stop 2024-08-18T22:33:49.250 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:33:49.248+0000 7f67842ba640 1 -- 172.21.15.121:0/2304484520 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f677c0fa380 msgr2=0x7f677c10c6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:49.250 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:33:49.248+0000 7f67842ba640 1 --2- 172.21.15.121:0/2304484520 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f677c0fa380 0x7f677c10c6b0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f6778009920 tx=0x7f6778009da0 comp rx=0 tx=0).stop 2024-08-18T22:33:49.250 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:33:49.248+0000 7f67842ba640 1 -- 172.21.15.121:0/2304484520 shutdown_connections 2024-08-18T22:33:49.250 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:33:49.248+0000 7f67842ba640 1 --2- 172.21.15.121:0/2304484520 >> [v2:172.21.15.121:6800/1740603058,v1:172.21.15.121:6801/1740603058] conn(0x7f6768035800 0x7f6768037cb0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:49.250 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:33:49.249+0000 7f67842ba640 1 --2- 172.21.15.121:0/2304484520 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f677c0fa380 0x7f677c10c6b0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:49.250 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:33:49.249+0000 7f67842ba640 1 -- 172.21.15.121:0/2304484520 >> 172.21.15.121:0/2304484520 conn(0x7f677c0f5de0 msgr2=0x7f677c0f6670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:33:49.250 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:33:49.249+0000 7f67842ba640 1 -- 172.21.15.121:0/2304484520 shutdown_connections 2024-08-18T22:33:49.250 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:33:49.249+0000 7f67842ba640 1 -- 172.21.15.121:0/2304484520 wait complete. 2024-08-18T22:33:49.857 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2024-08-18T22:33:49.857 DEBUG:teuthology.orchestra.run.smithi121:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b003123a-5db1-11ef-bccf-c7b262605968 -- ceph orch client-keyring set client.admin '*' --mode 0755 2024-08-18T22:33:50.117 INFO:teuthology.orchestra.run.smithi121.stderr:Inferring config /var/lib/ceph/b003123a-5db1-11ef-bccf-c7b262605968/mon.smithi121/config 2024-08-18T22:33:50.561 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:33:50 smithi121 ceph-mon[16788]: from='client.? 172.21.15.121:0/2304484520' entity='client.admin' 2024-08-18T22:33:52.584 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:33:52 smithi121 ceph-mon[16788]: from='mgr.14160 172.21.15.121:0/261891242' entity='mgr.smithi121.lopxqc' 2024-08-18T22:33:52.584 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:33:52 smithi121 ceph-mon[16788]: from='mgr.14160 172.21.15.121:0/261891242' entity='mgr.smithi121.lopxqc' 2024-08-18T22:33:52.584 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:33:52 smithi121 ceph-mon[16788]: from='mgr.14160 172.21.15.121:0/261891242' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config rm", "who": "osd/host:smithi121", "name": "osd_memory_target"}]: dispatch 2024-08-18T22:33:52.584 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:33:52 smithi121 ceph-mon[16788]: from='mgr.14160 172.21.15.121:0/261891242' entity='mgr.smithi121.lopxqc' 2024-08-18T22:33:52.584 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:33:52 smithi121 ceph-mon[16788]: from='mgr.14160 172.21.15.121:0/261891242' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi121", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-08-18T22:33:52.584 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:33:52 smithi121 ceph-mon[16788]: from='mgr.14160 172.21.15.121:0/261891242' entity='mgr.smithi121.lopxqc' cmd='[{"prefix": "auth get-or-create", "entity": "client.crash.smithi121", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]': finished 2024-08-18T22:33:52.584 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:33:52 smithi121 ceph-mon[16788]: from='mgr.14160 172.21.15.121:0/261891242' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:33:52.584 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:33:52 smithi121 ceph-mon[16788]: Deploying daemon crash.smithi121 on smithi121 2024-08-18T22:33:52.717 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:33:52.715+0000 7fbd314a5640 1 -- 172.21.15.121:0/140805507 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbd2c0fb4c0 msgr2=0x7fbd2c0fb8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:52.717 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:33:52.715+0000 7fbd314a5640 1 --2- 172.21.15.121:0/140805507 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbd2c0fb4c0 0x7fbd2c0fb8d0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fbd1c004850 tx=0x7fbd1c009da0 comp rx=0 tx=0).stop 2024-08-18T22:33:52.717 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:33:52.715+0000 7fbd314a5640 1 -- 172.21.15.121:0/140805507 shutdown_connections 2024-08-18T22:33:52.718 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:33:52.715+0000 7fbd314a5640 1 --2- 172.21.15.121:0/140805507 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbd2c0fb4c0 0x7fbd2c0fb8d0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:52.718 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:33:52.715+0000 7fbd314a5640 1 -- 172.21.15.121:0/140805507 >> 172.21.15.121:0/140805507 conn(0x7fbd2c0f5db0 msgr2=0x7fbd2c0f81e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:33:52.718 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:33:52.715+0000 7fbd314a5640 1 -- 172.21.15.121:0/140805507 shutdown_connections 2024-08-18T22:33:52.718 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:33:52.715+0000 7fbd314a5640 1 -- 172.21.15.121:0/140805507 wait complete. 2024-08-18T22:33:52.718 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:33:52.716+0000 7fbd314a5640 1 Processor -- start 2024-08-18T22:33:52.718 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:33:52.716+0000 7fbd314a5640 1 -- start start 2024-08-18T22:33:52.718 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:33:52.716+0000 7fbd314a5640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbd2c0fb4c0 0x7fbd2c10b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:52.718 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:33:52.716+0000 7fbd314a5640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd2c10b8f0 con 0x7fbd2c0fb4c0 2024-08-18T22:33:52.718 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:33:52.716+0000 7fbd2affd640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbd2c0fb4c0 0x7fbd2c10b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:52.718 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:33:52.716+0000 7fbd2affd640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbd2c0fb4c0 0x7fbd2c10b3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:46286/0 (socket says 172.21.15.121:46286) 2024-08-18T22:33:52.718 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:33:52.716+0000 7fbd2affd640 1 -- 172.21.15.121:0/390637410 learned_addr learned my addr 172.21.15.121:0/390637410 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-18T22:33:52.718 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:33:52.716+0000 7fbd2affd640 1 -- 172.21.15.121:0/390637410 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd1c005040 con 0x7fbd2c0fb4c0 2024-08-18T22:33:52.719 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:33:52.717+0000 7fbd2affd640 1 --2- 172.21.15.121:0/390637410 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbd2c0fb4c0 0x7fbd2c10b3b0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fbd1c000c00 tx=0x7fbd1c009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:33:52.720 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:33:52.717+0000 7fbd23fff640 1 -- 172.21.15.121:0/390637410 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fbd1c007a20 con 0x7fbd2c0fb4c0 2024-08-18T22:33:52.720 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:33:52.717+0000 7fbd23fff640 1 -- 172.21.15.121:0/390637410 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fbd1c033ad0 con 0x7fbd2c0fb4c0 2024-08-18T22:33:52.720 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:33:52.717+0000 7fbd314a5640 1 -- 172.21.15.121:0/390637410 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd2c10baf0 con 0x7fbd2c0fb4c0 2024-08-18T22:33:52.720 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:33:52.717+0000 7fbd23fff640 1 -- 172.21.15.121:0/390637410 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fbd1c03ea10 con 0x7fbd2c0fb4c0 2024-08-18T22:33:52.720 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:33:52.717+0000 7fbd314a5640 1 -- 172.21.15.121:0/390637410 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd2c10bf60 con 0x7fbd2c0fb4c0 2024-08-18T22:33:52.720 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:33:52.717+0000 7fbd23fff640 1 -- 172.21.15.121:0/390637410 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 13) v1 ==== 42693+0+0 (secure 0 0 0) 0x7fbd1c030020 con 0x7fbd2c0fb4c0 2024-08-18T22:33:52.720 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:33:52.718+0000 7fbd23fff640 1 --2- 172.21.15.121:0/390637410 >> [v2:172.21.15.121:6800/1740603058,v1:172.21.15.121:6801/1740603058] conn(0x7fbd180357b0 0x7fbd18037c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:52.720 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:33:52.718+0000 7fbd314a5640 1 -- 172.21.15.121:0/390637410 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd2c10bf60 con 0x7fbd2c0fb4c0 2024-08-18T22:33:52.720 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:33:52.718+0000 7fbd23fff640 1 -- 172.21.15.121:0/390637410 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7fbd1c069330 con 0x7fbd2c0fb4c0 2024-08-18T22:33:52.720 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:33:52.718+0000 7fbd227fc640 1 --2- 172.21.15.121:0/390637410 >> [v2:172.21.15.121:6800/1740603058,v1:172.21.15.121:6801/1740603058] conn(0x7fbd180357b0 0x7fbd18037c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:52.721 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:33:52.718+0000 7fbd227fc640 1 --2- 172.21.15.121:0/390637410 >> [v2:172.21.15.121:6800/1740603058,v1:172.21.15.121:6801/1740603058] conn(0x7fbd180357b0 0x7fbd18037c60 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fbd14006fd0 tx=0x7fbd14006db0 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:33:52.723 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:33:52.722+0000 7fbd23fff640 1 -- 172.21.15.121:0/390637410 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fbd2c10bf60 con 0x7fbd2c0fb4c0 2024-08-18T22:33:52.886 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:33:52.884+0000 7fbd314a5640 1 -- 172.21.15.121:0/390637410 --> [v2:172.21.15.121:6800/1740603058,v1:172.21.15.121:6801/1740603058] -- mgr_command(tid 0: {"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}) v1 -- 0x7fbd2c10bf60 con 0x7fbd180357b0 2024-08-18T22:33:52.888 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:33:52.888+0000 7fbd23fff640 1 -- 172.21.15.121:0/390637410 <== mgr.14160 v2:172.21.15.121:6800/1740603058 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7fbd2c10bf60 con 0x7fbd180357b0 2024-08-18T22:33:52.891 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:33:52.889+0000 7fbd314a5640 1 -- 172.21.15.121:0/390637410 >> [v2:172.21.15.121:6800/1740603058,v1:172.21.15.121:6801/1740603058] conn(0x7fbd180357b0 msgr2=0x7fbd18037c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:52.891 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:33:52.889+0000 7fbd314a5640 1 --2- 172.21.15.121:0/390637410 >> [v2:172.21.15.121:6800/1740603058,v1:172.21.15.121:6801/1740603058] conn(0x7fbd180357b0 0x7fbd18037c60 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fbd14006fd0 tx=0x7fbd14006db0 comp rx=0 tx=0).stop 2024-08-18T22:33:52.891 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:33:52.889+0000 7fbd314a5640 1 -- 172.21.15.121:0/390637410 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbd2c0fb4c0 msgr2=0x7fbd2c10b3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:52.891 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:33:52.889+0000 7fbd314a5640 1 --2- 172.21.15.121:0/390637410 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbd2c0fb4c0 0x7fbd2c10b3b0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fbd1c000c00 tx=0x7fbd1c009da0 comp rx=0 tx=0).stop 2024-08-18T22:33:52.891 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:33:52.889+0000 7fbd314a5640 1 -- 172.21.15.121:0/390637410 shutdown_connections 2024-08-18T22:33:52.891 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:33:52.889+0000 7fbd314a5640 1 --2- 172.21.15.121:0/390637410 >> [v2:172.21.15.121:6800/1740603058,v1:172.21.15.121:6801/1740603058] conn(0x7fbd180357b0 0x7fbd18037c60 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:52.891 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:33:52.889+0000 7fbd314a5640 1 --2- 172.21.15.121:0/390637410 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbd2c0fb4c0 0x7fbd2c10b3b0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:52.891 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:33:52.889+0000 7fbd314a5640 1 -- 172.21.15.121:0/390637410 >> 172.21.15.121:0/390637410 conn(0x7fbd2c0f5db0 msgr2=0x7fbd2c0f6690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:33:52.891 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:33:52.890+0000 7fbd314a5640 1 -- 172.21.15.121:0/390637410 shutdown_connections 2024-08-18T22:33:52.891 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:33:52.890+0000 7fbd314a5640 1 -- 172.21.15.121:0/390637410 wait complete. 2024-08-18T22:33:53.842 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi195 2024-08-18T22:33:53.843 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-08-18T22:33:53.843 DEBUG:teuthology.orchestra.run.smithi195:> dd of=/etc/ceph/ceph.conf 2024-08-18T22:33:53.861 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-08-18T22:33:53.862 DEBUG:teuthology.orchestra.run.smithi195:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-08-18T22:33:53.919 INFO:tasks.cephadm:Adding host smithi195 to orchestrator... 2024-08-18T22:33:53.920 DEBUG:teuthology.orchestra.run.smithi121:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b003123a-5db1-11ef-bccf-c7b262605968 -- ceph orch host add smithi195 2024-08-18T22:33:54.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:33:53 smithi121 ceph-mon[16788]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2024-08-18T22:33:54.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:33:53 smithi121 ceph-mon[16788]: from='mgr.14160 172.21.15.121:0/261891242' entity='mgr.smithi121.lopxqc' 2024-08-18T22:33:54.403 INFO:teuthology.orchestra.run.smithi121.stderr:Inferring config /var/lib/ceph/b003123a-5db1-11ef-bccf-c7b262605968/mon.smithi121/config 2024-08-18T22:33:55.730 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:33:55 smithi121 ceph-mon[16788]: from='mgr.14160 172.21.15.121:0/261891242' entity='mgr.smithi121.lopxqc' 2024-08-18T22:33:55.730 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:33:55 smithi121 ceph-mon[16788]: from='mgr.14160 172.21.15.121:0/261891242' entity='mgr.smithi121.lopxqc' 2024-08-18T22:33:55.730 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:33:55 smithi121 ceph-mon[16788]: from='mgr.14160 172.21.15.121:0/261891242' entity='mgr.smithi121.lopxqc' 2024-08-18T22:33:55.730 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:33:55 smithi121 ceph-mon[16788]: from='mgr.14160 172.21.15.121:0/261891242' entity='mgr.smithi121.lopxqc' 2024-08-18T22:33:55.730 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:33:55 smithi121 ceph-mon[16788]: Deploying daemon node-exporter.smithi121 on smithi121 2024-08-18T22:33:55.813 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:33:55.807+0000 7f99e2481640 1 -- 172.21.15.121:0/693894056 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f99dc0faf00 msgr2=0x7f99dc0fb310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:55.813 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:33:55.807+0000 7f99e2481640 1 --2- 172.21.15.121:0/693894056 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f99dc0faf00 0x7f99dc0fb310 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f99cc004850 tx=0x7f99cc009da0 comp rx=0 tx=0).stop 2024-08-18T22:33:55.813 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:33:55.807+0000 7f99e2481640 1 -- 172.21.15.121:0/693894056 shutdown_connections 2024-08-18T22:33:55.813 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:33:55.807+0000 7f99e2481640 1 --2- 172.21.15.121:0/693894056 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f99dc0faf00 0x7f99dc0fb310 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:55.813 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:33:55.807+0000 7f99e2481640 1 -- 172.21.15.121:0/693894056 >> 172.21.15.121:0/693894056 conn(0x7f99dc0f6620 msgr2=0x7f99dc0f8a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:33:55.813 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:33:55.807+0000 7f99e2481640 1 -- 172.21.15.121:0/693894056 shutdown_connections 2024-08-18T22:33:55.813 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:33:55.807+0000 7f99e2481640 1 -- 172.21.15.121:0/693894056 wait complete. 2024-08-18T22:33:55.814 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:33:55.808+0000 7f99e2481640 1 Processor -- start 2024-08-18T22:33:55.814 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:33:55.808+0000 7f99e2481640 1 -- start start 2024-08-18T22:33:55.814 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:33:55.808+0000 7f99e2481640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f99dc0faf00 0x7f99dc0f8590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:55.814 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:33:55.808+0000 7f99e2481640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99dc0f8ad0 con 0x7f99dc0faf00 2024-08-18T22:33:55.814 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:33:55.808+0000 7f99dbfff640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f99dc0faf00 0x7f99dc0f8590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:55.814 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:33:55.808+0000 7f99dbfff640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f99dc0faf00 0x7f99dc0f8590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:46312/0 (socket says 172.21.15.121:46312) 2024-08-18T22:33:55.814 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:33:55.808+0000 7f99dbfff640 1 -- 172.21.15.121:0/375002019 learned_addr learned my addr 172.21.15.121:0/375002019 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-18T22:33:55.814 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:33:55.808+0000 7f99dbfff640 1 -- 172.21.15.121:0/375002019 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99cc005040 con 0x7f99dc0faf00 2024-08-18T22:33:55.814 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:33:55.808+0000 7f99dbfff640 1 --2- 172.21.15.121:0/375002019 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f99dc0faf00 0x7f99dc0f8590 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f99cc02a6d0 tx=0x7f99cc009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:33:55.814 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:33:55.809+0000 7f99d97fa640 1 -- 172.21.15.121:0/375002019 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f99cc033630 con 0x7f99dc0faf00 2024-08-18T22:33:55.814 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:33:55.809+0000 7f99d97fa640 1 -- 172.21.15.121:0/375002019 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f99cc033c30 con 0x7f99dc0faf00 2024-08-18T22:33:55.814 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:33:55.809+0000 7f99e2481640 1 -- 172.21.15.121:0/375002019 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99dc0f6b60 con 0x7f99dc0faf00 2024-08-18T22:33:55.815 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:33:55.809+0000 7f99d97fa640 1 -- 172.21.15.121:0/375002019 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f99cc03dc00 con 0x7f99dc0faf00 2024-08-18T22:33:55.815 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:33:55.809+0000 7f99e2481640 1 -- 172.21.15.121:0/375002019 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99dc0f6fd0 con 0x7f99dc0faf00 2024-08-18T22:33:55.815 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:33:55.809+0000 7f99d97fa640 1 -- 172.21.15.121:0/375002019 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 13) v1 ==== 42693+0+0 (secure 0 0 0) 0x7f99cc030020 con 0x7f99dc0faf00 2024-08-18T22:33:55.815 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:33:55.809+0000 7f99d97fa640 1 --2- 172.21.15.121:0/375002019 >> [v2:172.21.15.121:6800/1740603058,v1:172.21.15.121:6801/1740603058] conn(0x7f99c80357b0 0x7f99c8037c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:33:55.815 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:33:55.810+0000 7f99d97fa640 1 -- 172.21.15.121:0/375002019 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f99cc0680e0 con 0x7f99dc0faf00 2024-08-18T22:33:55.815 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:33:55.810+0000 7f99d3fff640 1 --2- 172.21.15.121:0/375002019 >> [v2:172.21.15.121:6800/1740603058,v1:172.21.15.121:6801/1740603058] conn(0x7f99c80357b0 0x7f99c8037c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:33:55.815 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:33:55.810+0000 7f99e2481640 1 -- 172.21.15.121:0/375002019 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99dc05eb10 con 0x7f99dc0faf00 2024-08-18T22:33:55.815 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:33:55.810+0000 7f99d3fff640 1 --2- 172.21.15.121:0/375002019 >> [v2:172.21.15.121:6800/1740603058,v1:172.21.15.121:6801/1740603058] conn(0x7f99c80357b0 0x7f99c8037c60 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f99c4006fd0 tx=0x7f99c4006db0 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:33:55.815 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:33:55.814+0000 7f99d97fa640 1 -- 172.21.15.121:0/375002019 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f99cc03b960 con 0x7f99dc0faf00 2024-08-18T22:33:55.999 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:33:55.996+0000 7f99e2481640 1 -- 172.21.15.121:0/375002019 --> [v2:172.21.15.121:6800/1740603058,v1:172.21.15.121:6801/1740603058] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi195", "target": ["mon-mgr", ""]}) v1 -- 0x7f99dc0659d0 con 0x7f99c80357b0 2024-08-18T22:33:57.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:33:56 smithi121 ceph-mon[16788]: from='client.14186 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi195", "target": ["mon-mgr", ""]}]: dispatch 2024-08-18T22:33:58.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:33:57 smithi121 ceph-mon[16788]: Deploying cephadm binary to smithi195 2024-08-18T22:33:58.762 INFO:teuthology.orchestra.run.smithi121.stdout:Added host 'smithi195' with addr '172.21.15.195' 2024-08-18T22:33:58.762 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:33:58.760+0000 7f99d97fa640 1 -- 172.21.15.121:0/375002019 <== mgr.14160 v2:172.21.15.121:6800/1740603058 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7f99dc0659d0 con 0x7f99c80357b0 2024-08-18T22:33:58.764 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:33:58.763+0000 7f99e2481640 1 -- 172.21.15.121:0/375002019 >> [v2:172.21.15.121:6800/1740603058,v1:172.21.15.121:6801/1740603058] conn(0x7f99c80357b0 msgr2=0x7f99c8037c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:58.764 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:33:58.763+0000 7f99e2481640 1 --2- 172.21.15.121:0/375002019 >> [v2:172.21.15.121:6800/1740603058,v1:172.21.15.121:6801/1740603058] conn(0x7f99c80357b0 0x7f99c8037c60 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f99c4006fd0 tx=0x7f99c4006db0 comp rx=0 tx=0).stop 2024-08-18T22:33:58.764 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:33:58.763+0000 7f99e2481640 1 -- 172.21.15.121:0/375002019 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f99dc0faf00 msgr2=0x7f99dc0f8590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:33:58.764 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:33:58.763+0000 7f99e2481640 1 --2- 172.21.15.121:0/375002019 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f99dc0faf00 0x7f99dc0f8590 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f99cc02a6d0 tx=0x7f99cc009da0 comp rx=0 tx=0).stop 2024-08-18T22:33:58.764 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:33:58.763+0000 7f99e2481640 1 -- 172.21.15.121:0/375002019 shutdown_connections 2024-08-18T22:33:58.764 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:33:58.763+0000 7f99e2481640 1 --2- 172.21.15.121:0/375002019 >> [v2:172.21.15.121:6800/1740603058,v1:172.21.15.121:6801/1740603058] conn(0x7f99c80357b0 0x7f99c8037c60 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:58.765 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:33:58.763+0000 7f99e2481640 1 --2- 172.21.15.121:0/375002019 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f99dc0faf00 0x7f99dc0f8590 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:33:58.765 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:33:58.763+0000 7f99e2481640 1 -- 172.21.15.121:0/375002019 >> 172.21.15.121:0/375002019 conn(0x7f99dc0f6620 msgr2=0x7f99dc0652c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:33:58.765 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:33:58.763+0000 7f99e2481640 1 -- 172.21.15.121:0/375002019 shutdown_connections 2024-08-18T22:33:58.765 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:33:58.763+0000 7f99e2481640 1 -- 172.21.15.121:0/375002019 wait complete. 2024-08-18T22:33:59.421 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:33:59 smithi121 ceph-mon[16788]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-18T22:33:59.421 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:33:59 smithi121 ceph-mon[16788]: from='mgr.14160 172.21.15.121:0/261891242' entity='mgr.smithi121.lopxqc' 2024-08-18T22:33:59.421 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:33:59 smithi121 ceph-mon[16788]: from='mgr.14160 172.21.15.121:0/261891242' entity='mgr.smithi121.lopxqc' 2024-08-18T22:33:59.727 DEBUG:teuthology.orchestra.run.smithi121:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b003123a-5db1-11ef-bccf-c7b262605968 -- ceph orch host ls --format=json 2024-08-18T22:33:59.997 INFO:teuthology.orchestra.run.smithi121.stderr:Inferring config /var/lib/ceph/b003123a-5db1-11ef-bccf-c7b262605968/mon.smithi121/config 2024-08-18T22:34:00.834 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:34:00 smithi121 ceph-mon[16788]: Added host smithi195 2024-08-18T22:34:00.834 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:34:00 smithi121 ceph-mon[16788]: from='mgr.14160 172.21.15.121:0/261891242' entity='mgr.smithi121.lopxqc' 2024-08-18T22:34:00.834 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:34:00 smithi121 ceph-mon[16788]: from='mgr.14160 172.21.15.121:0/261891242' entity='mgr.smithi121.lopxqc' 2024-08-18T22:34:00.834 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:34:00 smithi121 ceph-mon[16788]: from='mgr.14160 172.21.15.121:0/261891242' entity='mgr.smithi121.lopxqc' 2024-08-18T22:34:00.834 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:34:00 smithi121 ceph-mon[16788]: from='mgr.14160 172.21.15.121:0/261891242' entity='mgr.smithi121.lopxqc' 2024-08-18T22:34:00.834 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:34:00 smithi121 ceph-mon[16788]: Deploying daemon alertmanager.smithi121 on smithi121 2024-08-18T22:34:01.584 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:34:01 smithi121 ceph-mon[16788]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-18T22:34:02.012 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:34:01.937+0000 7fe719481640 1 -- 172.21.15.121:0/3341386070 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe7140fd600 msgr2=0x7fe7140fda10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:34:02.012 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:34:01.937+0000 7fe719481640 1 --2- 172.21.15.121:0/3341386070 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe7140fd600 0x7fe7140fda10 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fe704004850 tx=0x7fe704009da0 comp rx=0 tx=0).stop 2024-08-18T22:34:02.013 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:34:01.937+0000 7fe719481640 1 -- 172.21.15.121:0/3341386070 shutdown_connections 2024-08-18T22:34:02.013 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:34:01.937+0000 7fe719481640 1 --2- 172.21.15.121:0/3341386070 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe7140fd600 0x7fe7140fda10 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:02.013 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:34:01.937+0000 7fe719481640 1 -- 172.21.15.121:0/3341386070 >> 172.21.15.121:0/3341386070 conn(0x7fe7140f5da0 msgr2=0x7fe7140f81d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:34:02.013 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:34:01.937+0000 7fe719481640 1 -- 172.21.15.121:0/3341386070 shutdown_connections 2024-08-18T22:34:02.013 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:34:01.937+0000 7fe719481640 1 -- 172.21.15.121:0/3341386070 wait complete. 2024-08-18T22:34:02.013 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:34:01.938+0000 7fe719481640 1 Processor -- start 2024-08-18T22:34:02.013 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:34:01.938+0000 7fe719481640 1 -- start start 2024-08-18T22:34:02.013 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:34:01.938+0000 7fe719481640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe7140fd600 0x7fe71410c500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:34:02.013 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:34:01.938+0000 7fe719481640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe71410ca40 con 0x7fe7140fd600 2024-08-18T22:34:02.013 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:34:01.938+0000 7fe712ffd640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe7140fd600 0x7fe71410c500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:34:02.013 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:34:01.938+0000 7fe712ffd640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe7140fd600 0x7fe71410c500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:54368/0 (socket says 172.21.15.121:54368) 2024-08-18T22:34:02.013 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:34:01.938+0000 7fe712ffd640 1 -- 172.21.15.121:0/1002260503 learned_addr learned my addr 172.21.15.121:0/1002260503 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-18T22:34:02.014 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:34:01.939+0000 7fe712ffd640 1 -- 172.21.15.121:0/1002260503 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe704005040 con 0x7fe7140fd600 2024-08-18T22:34:02.014 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:34:01.939+0000 7fe712ffd640 1 --2- 172.21.15.121:0/1002260503 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe7140fd600 0x7fe71410c500 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fe70402a6d0 tx=0x7fe704009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:34:02.014 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:34:01.939+0000 7fe70b7fe640 1 -- 172.21.15.121:0/1002260503 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe704033630 con 0x7fe7140fd600 2024-08-18T22:34:02.014 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:34:01.939+0000 7fe70b7fe640 1 -- 172.21.15.121:0/1002260503 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fe704033c30 con 0x7fe7140fd600 2024-08-18T22:34:02.014 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:34:01.939+0000 7fe719481640 1 -- 172.21.15.121:0/1002260503 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe71410cc40 con 0x7fe7140fd600 2024-08-18T22:34:02.014 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:34:01.939+0000 7fe70b7fe640 1 -- 172.21.15.121:0/1002260503 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe70403dc30 con 0x7fe7140fd600 2024-08-18T22:34:02.014 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:34:01.939+0000 7fe719481640 1 -- 172.21.15.121:0/1002260503 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe71410d0b0 con 0x7fe7140fd600 2024-08-18T22:34:02.014 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:34:01.940+0000 7fe70b7fe640 1 -- 172.21.15.121:0/1002260503 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 13) v1 ==== 42693+0+0 (secure 0 0 0) 0x7fe704030020 con 0x7fe7140fd600 2024-08-18T22:34:02.014 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:34:01.940+0000 7fe70b7fe640 1 --2- 172.21.15.121:0/1002260503 >> [v2:172.21.15.121:6800/1740603058,v1:172.21.15.121:6801/1740603058] conn(0x7fe7000357b0 0x7fe700037c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:34:02.014 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:34:01.940+0000 7fe719481640 1 -- 172.21.15.121:0/1002260503 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe71405eb10 con 0x7fe7140fd600 2024-08-18T22:34:02.014 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:34:01.940+0000 7fe70b7fe640 1 -- 172.21.15.121:0/1002260503 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7fe704067da0 con 0x7fe7140fd600 2024-08-18T22:34:02.014 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:34:01.940+0000 7fe7127fc640 1 --2- 172.21.15.121:0/1002260503 >> [v2:172.21.15.121:6800/1740603058,v1:172.21.15.121:6801/1740603058] conn(0x7fe7000357b0 0x7fe700037c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:34:02.014 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:34:01.941+0000 7fe7127fc640 1 --2- 172.21.15.121:0/1002260503 >> [v2:172.21.15.121:6800/1740603058,v1:172.21.15.121:6801/1740603058] conn(0x7fe7000357b0 0x7fe700037c60 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fe6fc006fd0 tx=0x7fe6fc006db0 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:34:02.015 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:34:01.945+0000 7fe70b7fe640 1 -- 172.21.15.121:0/1002260503 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fe7040463e0 con 0x7fe7140fd600 2024-08-18T22:34:02.111 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:34:02.110+0000 7fe719481640 1 -- 172.21.15.121:0/1002260503 --> [v2:172.21.15.121:6800/1740603058,v1:172.21.15.121:6801/1740603058] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe71410d890 con 0x7fe7000357b0 2024-08-18T22:34:02.112 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:34:02.111+0000 7fe70b7fe640 1 -- 172.21.15.121:0/1002260503 <== mgr.14160 v2:172.21.15.121:6800/1740603058 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+161 (secure 0 0 0) 0x7fe71410d890 con 0x7fe7000357b0 2024-08-18T22:34:02.112 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-08-18T22:34:02.112 INFO:teuthology.orchestra.run.smithi121.stdout:[{"addr": "172.21.15.121", "hostname": "smithi121", "labels": [], "status": ""}, {"addr": "172.21.15.195", "hostname": "smithi195", "labels": [], "status": ""}] 2024-08-18T22:34:02.114 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:34:02.113+0000 7fe719481640 1 -- 172.21.15.121:0/1002260503 >> [v2:172.21.15.121:6800/1740603058,v1:172.21.15.121:6801/1740603058] conn(0x7fe7000357b0 msgr2=0x7fe700037c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:34:02.114 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:34:02.113+0000 7fe719481640 1 --2- 172.21.15.121:0/1002260503 >> [v2:172.21.15.121:6800/1740603058,v1:172.21.15.121:6801/1740603058] conn(0x7fe7000357b0 0x7fe700037c60 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fe6fc006fd0 tx=0x7fe6fc006db0 comp rx=0 tx=0).stop 2024-08-18T22:34:02.114 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:34:02.113+0000 7fe719481640 1 -- 172.21.15.121:0/1002260503 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe7140fd600 msgr2=0x7fe71410c500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:34:02.114 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:34:02.113+0000 7fe719481640 1 --2- 172.21.15.121:0/1002260503 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe7140fd600 0x7fe71410c500 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fe70402a6d0 tx=0x7fe704009da0 comp rx=0 tx=0).stop 2024-08-18T22:34:02.114 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:34:02.113+0000 7fe719481640 1 -- 172.21.15.121:0/1002260503 shutdown_connections 2024-08-18T22:34:02.114 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:34:02.113+0000 7fe719481640 1 --2- 172.21.15.121:0/1002260503 >> [v2:172.21.15.121:6800/1740603058,v1:172.21.15.121:6801/1740603058] conn(0x7fe7000357b0 0x7fe700037c60 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:02.114 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:34:02.113+0000 7fe719481640 1 --2- 172.21.15.121:0/1002260503 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe7140fd600 0x7fe71410c500 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:02.114 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:34:02.113+0000 7fe719481640 1 -- 172.21.15.121:0/1002260503 >> 172.21.15.121:0/1002260503 conn(0x7fe7140f5da0 msgr2=0x7fe7140f66e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:34:02.115 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:34:02.113+0000 7fe719481640 1 -- 172.21.15.121:0/1002260503 shutdown_connections 2024-08-18T22:34:02.115 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:34:02.113+0000 7fe719481640 1 -- 172.21.15.121:0/1002260503 wait complete. 2024-08-18T22:34:03.301 INFO:tasks.cephadm:Setting crush tunables to default 2024-08-18T22:34:03.301 DEBUG:teuthology.orchestra.run.smithi121:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b003123a-5db1-11ef-bccf-c7b262605968 -- ceph osd crush tunables default 2024-08-18T22:34:03.583 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:34:03 smithi121 ceph-mon[16788]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-18T22:34:03.583 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:34:03 smithi121 ceph-mon[16788]: from='client.14188 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-18T22:34:03.584 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:34:03 smithi121 ceph-mon[16788]: from='mgr.14160 172.21.15.121:0/261891242' entity='mgr.smithi121.lopxqc' 2024-08-18T22:34:04.063 INFO:teuthology.orchestra.run.smithi121.stderr:Inferring config /var/lib/ceph/b003123a-5db1-11ef-bccf-c7b262605968/mon.smithi121/config 2024-08-18T22:34:05.523 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:34:05 smithi121 ceph-mon[16788]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-18T22:34:07.118 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:34:07.115+0000 7f5c6a2a5640 1 -- 172.21.15.121:0/900548455 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5c640fbf70 msgr2=0x7f5c640fc380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:34:07.118 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:34:07.115+0000 7f5c6a2a5640 1 --2- 172.21.15.121:0/900548455 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5c640fbf70 0x7f5c640fc380 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f5c54004850 tx=0x7f5c54009da0 comp rx=0 tx=0).stop 2024-08-18T22:34:07.118 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:34:07.115+0000 7f5c6a2a5640 1 -- 172.21.15.121:0/900548455 shutdown_connections 2024-08-18T22:34:07.118 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:34:07.115+0000 7f5c6a2a5640 1 --2- 172.21.15.121:0/900548455 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5c640fbf70 0x7f5c640fc380 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:07.118 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:34:07.115+0000 7f5c6a2a5640 1 -- 172.21.15.121:0/900548455 >> 172.21.15.121:0/900548455 conn(0x7f5c640f7750 msgr2=0x7f5c640f9b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:34:07.118 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:34:07.115+0000 7f5c6a2a5640 1 -- 172.21.15.121:0/900548455 shutdown_connections 2024-08-18T22:34:07.118 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:34:07.115+0000 7f5c6a2a5640 1 -- 172.21.15.121:0/900548455 wait complete. 2024-08-18T22:34:07.119 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:34:07.116+0000 7f5c6a2a5640 1 Processor -- start 2024-08-18T22:34:07.119 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:34:07.116+0000 7f5c6a2a5640 1 -- start start 2024-08-18T22:34:07.119 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:34:07.116+0000 7f5c6a2a5640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5c640fbf70 0x7f5c6410c4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:34:07.119 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:34:07.116+0000 7f5c6a2a5640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c6410c9f0 con 0x7f5c640fbf70 2024-08-18T22:34:07.119 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:34:07.116+0000 7f5c63fff640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5c640fbf70 0x7f5c6410c4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:34:07.119 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:34:07.116+0000 7f5c63fff640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5c640fbf70 0x7f5c6410c4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:52728/0 (socket says 172.21.15.121:52728) 2024-08-18T22:34:07.119 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:34:07.116+0000 7f5c63fff640 1 -- 172.21.15.121:0/1438052110 learned_addr learned my addr 172.21.15.121:0/1438052110 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-18T22:34:07.119 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:34:07.116+0000 7f5c63fff640 1 -- 172.21.15.121:0/1438052110 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c54005040 con 0x7f5c640fbf70 2024-08-18T22:34:07.119 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:34:07.116+0000 7f5c63fff640 1 --2- 172.21.15.121:0/1438052110 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5c640fbf70 0x7f5c6410c4b0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f5c5402a6d0 tx=0x7f5c54009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:34:07.119 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:34:07.117+0000 7f5c617fa640 1 -- 172.21.15.121:0/1438052110 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5c54033630 con 0x7f5c640fbf70 2024-08-18T22:34:07.119 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:34:07.117+0000 7f5c617fa640 1 -- 172.21.15.121:0/1438052110 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f5c54033c30 con 0x7f5c640fbf70 2024-08-18T22:34:07.119 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:34:07.117+0000 7f5c6a2a5640 1 -- 172.21.15.121:0/1438052110 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c6410cbf0 con 0x7f5c640fbf70 2024-08-18T22:34:07.119 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:34:07.117+0000 7f5c617fa640 1 -- 172.21.15.121:0/1438052110 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5c5403dc00 con 0x7f5c640fbf70 2024-08-18T22:34:07.120 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:34:07.117+0000 7f5c6a2a5640 1 -- 172.21.15.121:0/1438052110 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c6410d060 con 0x7f5c640fbf70 2024-08-18T22:34:07.120 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:34:07.118+0000 7f5c617fa640 1 -- 172.21.15.121:0/1438052110 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 13) v1 ==== 42693+0+0 (secure 0 0 0) 0x7f5c54030020 con 0x7f5c640fbf70 2024-08-18T22:34:07.121 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:34:07.118+0000 7f5c6a2a5640 1 -- 172.21.15.121:0/1438052110 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c6405eb10 con 0x7f5c640fbf70 2024-08-18T22:34:07.121 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:34:07.118+0000 7f5c617fa640 1 --2- 172.21.15.121:0/1438052110 >> [v2:172.21.15.121:6800/1740603058,v1:172.21.15.121:6801/1740603058] conn(0x7f5c50035800 0x7f5c50037cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:34:07.121 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:34:07.118+0000 7f5c617fa640 1 -- 172.21.15.121:0/1438052110 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f5c54067d40 con 0x7f5c640fbf70 2024-08-18T22:34:07.121 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:34:07.118+0000 7f5c5bfff640 1 --2- 172.21.15.121:0/1438052110 >> [v2:172.21.15.121:6800/1740603058,v1:172.21.15.121:6801/1740603058] conn(0x7f5c50035800 0x7f5c50037cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:34:07.121 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:34:07.118+0000 7f5c5bfff640 1 --2- 172.21.15.121:0/1438052110 >> [v2:172.21.15.121:6800/1740603058,v1:172.21.15.121:6801/1740603058] conn(0x7f5c50035800 0x7f5c50037cb0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f5c4c006fd0 tx=0x7f5c4c006db0 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:34:07.123 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:34:07.123+0000 7f5c617fa640 1 -- 172.21.15.121:0/1438052110 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f5c5403b760 con 0x7f5c640fbf70 2024-08-18T22:34:07.298 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:34:07.297+0000 7f5c6a2a5640 1 -- 172.21.15.121:0/1438052110 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f5c6404b4c0 con 0x7f5c640fbf70 2024-08-18T22:34:07.403 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:34:07.402+0000 7f5c617fa640 1 -- 172.21.15.121:0/1438052110 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v4) v1 ==== 124+0+0 (secure 0 0 0) 0x7f5c5403b370 con 0x7f5c640fbf70 2024-08-18T22:34:07.403 INFO:teuthology.orchestra.run.smithi121.stderr:adjusted tunables profile to default 2024-08-18T22:34:07.405 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:34:07.404+0000 7f5c6a2a5640 1 -- 172.21.15.121:0/1438052110 >> [v2:172.21.15.121:6800/1740603058,v1:172.21.15.121:6801/1740603058] conn(0x7f5c50035800 msgr2=0x7f5c50037cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:34:07.405 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:34:07.404+0000 7f5c6a2a5640 1 --2- 172.21.15.121:0/1438052110 >> [v2:172.21.15.121:6800/1740603058,v1:172.21.15.121:6801/1740603058] conn(0x7f5c50035800 0x7f5c50037cb0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f5c4c006fd0 tx=0x7f5c4c006db0 comp rx=0 tx=0).stop 2024-08-18T22:34:07.405 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:34:07.404+0000 7f5c6a2a5640 1 -- 172.21.15.121:0/1438052110 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5c640fbf70 msgr2=0x7f5c6410c4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:34:07.406 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:34:07.404+0000 7f5c6a2a5640 1 --2- 172.21.15.121:0/1438052110 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5c640fbf70 0x7f5c6410c4b0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f5c5402a6d0 tx=0x7f5c54009da0 comp rx=0 tx=0).stop 2024-08-18T22:34:07.406 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:34:07.404+0000 7f5c6a2a5640 1 -- 172.21.15.121:0/1438052110 shutdown_connections 2024-08-18T22:34:07.406 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:34:07.404+0000 7f5c6a2a5640 1 --2- 172.21.15.121:0/1438052110 >> [v2:172.21.15.121:6800/1740603058,v1:172.21.15.121:6801/1740603058] conn(0x7f5c50035800 0x7f5c50037cb0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:07.406 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:34:07.404+0000 7f5c6a2a5640 1 --2- 172.21.15.121:0/1438052110 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5c640fbf70 0x7f5c6410c4b0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:07.406 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:34:07.404+0000 7f5c6a2a5640 1 -- 172.21.15.121:0/1438052110 >> 172.21.15.121:0/1438052110 conn(0x7f5c640f7750 msgr2=0x7f5c640f8000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:34:07.406 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:34:07.404+0000 7f5c6a2a5640 1 -- 172.21.15.121:0/1438052110 shutdown_connections 2024-08-18T22:34:07.406 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:34:07.404+0000 7f5c6a2a5640 1 -- 172.21.15.121:0/1438052110 wait complete. 2024-08-18T22:34:07.561 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:34:07 smithi121 ceph-mon[16788]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-18T22:34:07.561 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:34:07 smithi121 ceph-mon[16788]: from='client.? 172.21.15.121:0/1438052110' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-08-18T22:34:08.459 INFO:tasks.cephadm:Adding mon.smithi121 on smithi121 2024-08-18T22:34:08.459 INFO:tasks.cephadm:Adding mon.smithi195 on smithi195 2024-08-18T22:34:08.459 DEBUG:teuthology.orchestra.run.smithi195:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b003123a-5db1-11ef-bccf-c7b262605968 -- ceph orch apply mon '2;smithi121:172.21.15.121=smithi121;smithi195:172.21.15.195=smithi195' 2024-08-18T22:34:08.586 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:34:08 smithi121 ceph-mon[16788]: from='client.? 172.21.15.121:0/1438052110' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-08-18T22:34:08.586 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:34:08 smithi121 ceph-mon[16788]: osdmap e4: 0 total, 0 up, 0 in 2024-08-18T22:34:08.708 INFO:teuthology.orchestra.run.smithi195.stderr:Inferring config /etc/ceph/ceph.conf 2024-08-18T22:34:08.757 INFO:teuthology.orchestra.run.smithi195.stderr:Inferring config /etc/ceph/ceph.conf 2024-08-18T22:34:09.584 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:34:09 smithi121 ceph-mon[16788]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-18T22:34:10.439 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:10.435+0000 7fbe02b7b640 1 -- 172.21.15.195:0/2576843128 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbdfc0fb080 msgr2=0x7fbdfc0fb490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:34:10.439 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:10.435+0000 7fbe02b7b640 1 --2- 172.21.15.195:0/2576843128 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbdfc0fb080 0x7fbdfc0fb490 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fbdf0004850 tx=0x7fbdf0009da0 comp rx=0 tx=0).stop 2024-08-18T22:34:10.439 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:10.435+0000 7fbe02b7b640 1 -- 172.21.15.195:0/2576843128 shutdown_connections 2024-08-18T22:34:10.439 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:10.435+0000 7fbe02b7b640 1 --2- 172.21.15.195:0/2576843128 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbdfc0fb080 0x7fbdfc0fb490 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:10.439 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:10.435+0000 7fbe02b7b640 1 -- 172.21.15.195:0/2576843128 >> 172.21.15.195:0/2576843128 conn(0x7fbdfc0f6860 msgr2=0x7fbdfc0f8c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:34:10.439 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:10.435+0000 7fbe02b7b640 1 -- 172.21.15.195:0/2576843128 shutdown_connections 2024-08-18T22:34:10.439 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:10.435+0000 7fbe02b7b640 1 -- 172.21.15.195:0/2576843128 wait complete. 2024-08-18T22:34:10.440 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:10.436+0000 7fbe02b7b640 1 Processor -- start 2024-08-18T22:34:10.440 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:10.436+0000 7fbe02b7b640 1 -- start start 2024-08-18T22:34:10.440 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:10.436+0000 7fbe02b7b640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbdfc0fb080 0x7fbdfc10c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:34:10.440 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:10.436+0000 7fbe02b7b640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdfc10cc10 con 0x7fbdfc0fb080 2024-08-18T22:34:10.440 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:10.436+0000 7fbe00917640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbdfc0fb080 0x7fbdfc10c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:34:10.440 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:10.436+0000 7fbe00917640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbdfc0fb080 0x7fbdfc10c6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.195:43652/0 (socket says 172.21.15.195:43652) 2024-08-18T22:34:10.440 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:10.436+0000 7fbe00917640 1 -- 172.21.15.195:0/4152491789 learned_addr learned my addr 172.21.15.195:0/4152491789 (peer_addr_for_me v2:172.21.15.195:0/0) 2024-08-18T22:34:10.441 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:10.437+0000 7fbe00917640 1 -- 172.21.15.195:0/4152491789 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdf0005040 con 0x7fbdfc0fb080 2024-08-18T22:34:10.441 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:10.437+0000 7fbe00917640 1 --2- 172.21.15.195:0/4152491789 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbdfc0fb080 0x7fbdfc10c6d0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fbdf002a6d0 tx=0x7fbdf0009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:34:10.441 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:10.437+0000 7fbdf97fa640 1 -- 172.21.15.195:0/4152491789 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fbdf0033630 con 0x7fbdfc0fb080 2024-08-18T22:34:10.441 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:10.437+0000 7fbe02b7b640 1 -- 172.21.15.195:0/4152491789 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbdfc10ce10 con 0x7fbdfc0fb080 2024-08-18T22:34:10.441 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:10.437+0000 7fbdf97fa640 1 -- 172.21.15.195:0/4152491789 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fbdf0033c30 con 0x7fbdfc0fb080 2024-08-18T22:34:10.441 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:10.437+0000 7fbdf97fa640 1 -- 172.21.15.195:0/4152491789 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fbdf003dc00 con 0x7fbdfc0fb080 2024-08-18T22:34:10.441 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:10.437+0000 7fbe02b7b640 1 -- 172.21.15.195:0/4152491789 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbdfc10d280 con 0x7fbdfc0fb080 2024-08-18T22:34:10.442 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:10.438+0000 7fbdf97fa640 1 -- 172.21.15.195:0/4152491789 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 13) v1 ==== 42693+0+0 (secure 0 0 0) 0x7fbdf0030020 con 0x7fbdfc0fb080 2024-08-18T22:34:10.442 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:10.438+0000 7fbdf97fa640 1 --2- 172.21.15.195:0/4152491789 >> [v2:172.21.15.121:6800/1740603058,v1:172.21.15.121:6801/1740603058] conn(0x7fbdec0357b0 0x7fbdec037c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:34:10.442 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:10.438+0000 7fbdf97fa640 1 -- 172.21.15.195:0/4152491789 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7fbdf0067e60 con 0x7fbdfc0fb080 2024-08-18T22:34:10.442 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:10.438+0000 7fbe02b7b640 1 -- 172.21.15.195:0/4152491789 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbdfc1014a0 con 0x7fbdfc0fb080 2024-08-18T22:34:10.443 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:10.438+0000 7fbdfbfff640 1 --2- 172.21.15.195:0/4152491789 >> [v2:172.21.15.121:6800/1740603058,v1:172.21.15.121:6801/1740603058] conn(0x7fbdec0357b0 0x7fbdec037c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:34:10.443 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:10.439+0000 7fbdfbfff640 1 --2- 172.21.15.195:0/4152491789 >> [v2:172.21.15.121:6800/1740603058,v1:172.21.15.121:6801/1740603058] conn(0x7fbdec0357b0 0x7fbdec037c60 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fbde8006fd0 tx=0x7fbde8006db0 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:34:10.447 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:10.446+0000 7fbdf97fa640 1 -- 172.21.15.195:0/4152491789 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fbdf00463e0 con 0x7fbdfc0fb080 2024-08-18T22:34:10.609 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:10.608+0000 7fbe02b7b640 1 -- 172.21.15.195:0/4152491789 --> [v2:172.21.15.121:6800/1740603058,v1:172.21.15.121:6801/1740603058] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "placement": "2;smithi121:172.21.15.121=smithi121;smithi195:172.21.15.195=smithi195", "target": ["mon-mgr", ""]}) v1 -- 0x7fbdfc100d80 con 0x7fbdec0357b0 2024-08-18T22:34:10.614 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:10.613+0000 7fbdf97fa640 1 -- 172.21.15.195:0/4152491789 <== mgr.14160 v2:172.21.15.121:6800/1740603058 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7fbdfc100d80 con 0x7fbdec0357b0 2024-08-18T22:34:10.615 INFO:teuthology.orchestra.run.smithi195.stdout:Scheduled mon update... 2024-08-18T22:34:10.617 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:10.615+0000 7fbe02b7b640 1 -- 172.21.15.195:0/4152491789 >> [v2:172.21.15.121:6800/1740603058,v1:172.21.15.121:6801/1740603058] conn(0x7fbdec0357b0 msgr2=0x7fbdec037c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:34:10.617 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:10.615+0000 7fbe02b7b640 1 --2- 172.21.15.195:0/4152491789 >> [v2:172.21.15.121:6800/1740603058,v1:172.21.15.121:6801/1740603058] conn(0x7fbdec0357b0 0x7fbdec037c60 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fbde8006fd0 tx=0x7fbde8006db0 comp rx=0 tx=0).stop 2024-08-18T22:34:10.617 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:10.615+0000 7fbe02b7b640 1 -- 172.21.15.195:0/4152491789 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbdfc0fb080 msgr2=0x7fbdfc10c6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:34:10.617 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:10.615+0000 7fbe02b7b640 1 --2- 172.21.15.195:0/4152491789 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbdfc0fb080 0x7fbdfc10c6d0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fbdf002a6d0 tx=0x7fbdf0009da0 comp rx=0 tx=0).stop 2024-08-18T22:34:10.617 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:10.615+0000 7fbe02b7b640 1 -- 172.21.15.195:0/4152491789 shutdown_connections 2024-08-18T22:34:10.617 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:10.615+0000 7fbe02b7b640 1 --2- 172.21.15.195:0/4152491789 >> [v2:172.21.15.121:6800/1740603058,v1:172.21.15.121:6801/1740603058] conn(0x7fbdec0357b0 0x7fbdec037c60 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:10.617 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:10.615+0000 7fbe02b7b640 1 --2- 172.21.15.195:0/4152491789 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbdfc0fb080 0x7fbdfc10c6d0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:10.617 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:10.615+0000 7fbe02b7b640 1 -- 172.21.15.195:0/4152491789 >> 172.21.15.195:0/4152491789 conn(0x7fbdfc0f6860 msgr2=0x7fbdfc064fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:34:10.618 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:10.616+0000 7fbe02b7b640 1 -- 172.21.15.195:0/4152491789 shutdown_connections 2024-08-18T22:34:10.618 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:10.616+0000 7fbe02b7b640 1 -- 172.21.15.195:0/4152491789 wait complete. 2024-08-18T22:34:11.191 DEBUG:teuthology.orchestra.run.smithi195:mon.smithi195> sudo journalctl -f -n 0 -u ceph-b003123a-5db1-11ef-bccf-c7b262605968@mon.smithi195.service 2024-08-18T22:34:11.194 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-08-18T22:34:11.195 DEBUG:teuthology.orchestra.run.smithi195:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b003123a-5db1-11ef-bccf-c7b262605968 -- ceph mon dump -f json 2024-08-18T22:34:11.466 INFO:teuthology.orchestra.run.smithi195.stderr:Inferring config /etc/ceph/ceph.conf 2024-08-18T22:34:11.513 INFO:teuthology.orchestra.run.smithi195.stderr:Inferring config /etc/ceph/ceph.conf 2024-08-18T22:34:11.583 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:34:11 smithi121 ceph-mon[16788]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-18T22:34:11.583 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:34:11 smithi121 ceph-mon[16788]: from='mgr.14160 172.21.15.121:0/261891242' entity='mgr.smithi121.lopxqc' 2024-08-18T22:34:11.584 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:34:11 smithi121 ceph-mon[16788]: from='mgr.14160 172.21.15.121:0/261891242' entity='mgr.smithi121.lopxqc' 2024-08-18T22:34:11.584 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:34:11 smithi121 ceph-mon[16788]: from='mgr.14160 172.21.15.121:0/261891242' entity='mgr.smithi121.lopxqc' 2024-08-18T22:34:11.584 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:34:11 smithi121 ceph-mon[16788]: from='mgr.14160 172.21.15.121:0/261891242' entity='mgr.smithi121.lopxqc' 2024-08-18T22:34:11.584 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:34:11 smithi121 ceph-mon[16788]: from='mgr.14160 172.21.15.121:0/261891242' entity='mgr.smithi121.lopxqc' 2024-08-18T22:34:11.584 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:34:11 smithi121 ceph-mon[16788]: from='mgr.14160 172.21.15.121:0/261891242' entity='mgr.smithi121.lopxqc' 2024-08-18T22:34:11.584 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:34:11 smithi121 ceph-mon[16788]: from='mgr.14160 172.21.15.121:0/261891242' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-08-18T22:34:11.584 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:34:11 smithi121 ceph-mon[16788]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-08-18T22:34:11.584 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:34:11 smithi121 ceph-mon[16788]: from='mgr.14160 172.21.15.121:0/261891242' entity='mgr.smithi121.lopxqc' 2024-08-18T22:34:11.584 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:34:11 smithi121 ceph-mon[16788]: Deploying daemon grafana.smithi121 on smithi121 2024-08-18T22:34:11.584 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:34:11 smithi121 ceph-mon[16788]: from='client.14192 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "2;smithi121:172.21.15.121=smithi121;smithi195:172.21.15.195=smithi195", "target": ["mon-mgr", ""]}]: dispatch 2024-08-18T22:34:11.584 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:34:11 smithi121 ceph-mon[16788]: Saving service mon spec with placement smithi121:172.21.15.121=smithi121;smithi195:172.21.15.195=smithi195;count:2 2024-08-18T22:34:11.584 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:34:11 smithi121 ceph-mon[16788]: from='mgr.14160 172.21.15.121:0/261891242' entity='mgr.smithi121.lopxqc' 2024-08-18T22:34:13.008 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:13.004+0000 7f4e35ad3640 1 -- 172.21.15.195:0/37480096 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4e300faf00 msgr2=0x7f4e300fb310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:34:13.008 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:13.004+0000 7f4e35ad3640 1 --2- 172.21.15.195:0/37480096 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4e300faf00 0x7f4e300fb310 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f4e20004850 tx=0x7f4e20009da0 comp rx=0 tx=0).stop 2024-08-18T22:34:13.008 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:13.004+0000 7f4e35ad3640 1 -- 172.21.15.195:0/37480096 shutdown_connections 2024-08-18T22:34:13.008 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:13.004+0000 7f4e35ad3640 1 --2- 172.21.15.195:0/37480096 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4e300faf00 0x7f4e300fb310 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:13.008 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:13.004+0000 7f4e35ad3640 1 -- 172.21.15.195:0/37480096 >> 172.21.15.195:0/37480096 conn(0x7f4e300f6620 msgr2=0x7f4e300f8a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:34:13.008 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:13.004+0000 7f4e35ad3640 1 -- 172.21.15.195:0/37480096 shutdown_connections 2024-08-18T22:34:13.008 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:13.004+0000 7f4e35ad3640 1 -- 172.21.15.195:0/37480096 wait complete. 2024-08-18T22:34:13.008 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:13.005+0000 7f4e35ad3640 1 Processor -- start 2024-08-18T22:34:13.008 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:13.005+0000 7f4e35ad3640 1 -- start start 2024-08-18T22:34:13.009 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:13.005+0000 7f4e35ad3640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4e300faf00 0x7f4e3010c4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:34:13.009 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:13.005+0000 7f4e35ad3640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e3010ca20 con 0x7f4e300faf00 2024-08-18T22:34:13.009 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:13.005+0000 7f4e2f7fe640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4e300faf00 0x7f4e3010c4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:34:13.009 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:13.005+0000 7f4e2f7fe640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4e300faf00 0x7f4e3010c4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.195:34124/0 (socket says 172.21.15.195:34124) 2024-08-18T22:34:13.009 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:13.005+0000 7f4e2f7fe640 1 -- 172.21.15.195:0/935242584 learned_addr learned my addr 172.21.15.195:0/935242584 (peer_addr_for_me v2:172.21.15.195:0/0) 2024-08-18T22:34:13.009 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:13.006+0000 7f4e2f7fe640 1 -- 172.21.15.195:0/935242584 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e20005040 con 0x7f4e300faf00 2024-08-18T22:34:13.010 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:13.006+0000 7f4e2f7fe640 1 --2- 172.21.15.195:0/935242584 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4e300faf00 0x7f4e3010c4e0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f4e2002a6d0 tx=0x7f4e20009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:34:13.011 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:13.006+0000 7f4e17fff640 1 -- 172.21.15.195:0/935242584 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4e20033630 con 0x7f4e300faf00 2024-08-18T22:34:13.011 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:13.006+0000 7f4e35ad3640 1 -- 172.21.15.195:0/935242584 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e3010cc20 con 0x7f4e300faf00 2024-08-18T22:34:13.011 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:13.006+0000 7f4e17fff640 1 -- 172.21.15.195:0/935242584 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f4e20033c30 con 0x7f4e300faf00 2024-08-18T22:34:13.011 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:13.006+0000 7f4e17fff640 1 -- 172.21.15.195:0/935242584 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4e2003dc00 con 0x7f4e300faf00 2024-08-18T22:34:13.011 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:13.006+0000 7f4e35ad3640 1 -- 172.21.15.195:0/935242584 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e3010d090 con 0x7f4e300faf00 2024-08-18T22:34:13.011 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:13.007+0000 7f4e17fff640 1 -- 172.21.15.195:0/935242584 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 13) v1 ==== 42693+0+0 (secure 0 0 0) 0x7f4e20030020 con 0x7f4e300faf00 2024-08-18T22:34:13.011 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:13.007+0000 7f4e35ad3640 1 -- 172.21.15.195:0/935242584 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e3005eb10 con 0x7f4e300faf00 2024-08-18T22:34:13.011 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:13.007+0000 7f4e17fff640 1 --2- 172.21.15.195:0/935242584 >> [v2:172.21.15.121:6800/1740603058,v1:172.21.15.121:6801/1740603058] conn(0x7f4e180357b0 0x7f4e18037c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:34:13.011 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:13.007+0000 7f4e17fff640 1 -- 172.21.15.195:0/935242584 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f4e20067ed0 con 0x7f4e300faf00 2024-08-18T22:34:13.011 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:13.007+0000 7f4e2effd640 1 --2- 172.21.15.195:0/935242584 >> [v2:172.21.15.121:6800/1740603058,v1:172.21.15.121:6801/1740603058] conn(0x7f4e180357b0 0x7f4e18037c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:34:13.011 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:13.008+0000 7f4e2effd640 1 --2- 172.21.15.195:0/935242584 >> [v2:172.21.15.121:6800/1740603058,v1:172.21.15.121:6801/1740603058] conn(0x7f4e180357b0 0x7f4e18037c60 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f4e24006fd0 tx=0x7f4e24006db0 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:34:13.014 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:13.012+0000 7f4e17fff640 1 -- 172.21.15.195:0/935242584 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f4e20045570 con 0x7f4e300faf00 2024-08-18T22:34:13.228 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:13.226+0000 7f4e35ad3640 1 -- 172.21.15.195:0/935242584 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f4e3004b4c0 con 0x7f4e300faf00 2024-08-18T22:34:13.229 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:13.227+0000 7f4e17fff640 1 -- 172.21.15.195:0/935242584 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+743 (secure 0 0 0) 0x7f4e20045390 con 0x7f4e300faf00 2024-08-18T22:34:13.229 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-08-18T22:34:13.230 INFO:teuthology.orchestra.run.smithi195.stdout:{"epoch":1,"fsid":"b003123a-5db1-11ef-bccf-c7b262605968","modified":"2024-08-18T22:32:38.034362Z","created":"2024-08-18T22:32:38.034362Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi121","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:3300","nonce":0},{"type":"v1","addr":"172.21.15.121:6789","nonce":0}]},"addr":"172.21.15.121:6789/0","public_addr":"172.21.15.121:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-08-18T22:34:13.230 INFO:teuthology.orchestra.run.smithi195.stderr:dumped monmap epoch 1 2024-08-18T22:34:13.231 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:13.229+0000 7f4e35ad3640 1 -- 172.21.15.195:0/935242584 >> [v2:172.21.15.121:6800/1740603058,v1:172.21.15.121:6801/1740603058] conn(0x7f4e180357b0 msgr2=0x7f4e18037c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:34:13.232 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:13.229+0000 7f4e35ad3640 1 --2- 172.21.15.195:0/935242584 >> [v2:172.21.15.121:6800/1740603058,v1:172.21.15.121:6801/1740603058] conn(0x7f4e180357b0 0x7f4e18037c60 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f4e24006fd0 tx=0x7f4e24006db0 comp rx=0 tx=0).stop 2024-08-18T22:34:13.232 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:13.229+0000 7f4e35ad3640 1 -- 172.21.15.195:0/935242584 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4e300faf00 msgr2=0x7f4e3010c4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:34:13.232 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:13.229+0000 7f4e35ad3640 1 --2- 172.21.15.195:0/935242584 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4e300faf00 0x7f4e3010c4e0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f4e2002a6d0 tx=0x7f4e20009da0 comp rx=0 tx=0).stop 2024-08-18T22:34:13.232 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:13.229+0000 7f4e35ad3640 1 -- 172.21.15.195:0/935242584 shutdown_connections 2024-08-18T22:34:13.232 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:13.229+0000 7f4e35ad3640 1 --2- 172.21.15.195:0/935242584 >> [v2:172.21.15.121:6800/1740603058,v1:172.21.15.121:6801/1740603058] conn(0x7f4e180357b0 0x7f4e18037c60 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:13.232 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:13.229+0000 7f4e35ad3640 1 --2- 172.21.15.195:0/935242584 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4e300faf00 0x7f4e3010c4e0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:13.232 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:13.229+0000 7f4e35ad3640 1 -- 172.21.15.195:0/935242584 >> 172.21.15.195:0/935242584 conn(0x7f4e300f6620 msgr2=0x7f4e300652c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:34:13.232 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:13.229+0000 7f4e35ad3640 1 -- 172.21.15.195:0/935242584 shutdown_connections 2024-08-18T22:34:13.232 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:13.229+0000 7f4e35ad3640 1 -- 172.21.15.195:0/935242584 wait complete. 2024-08-18T22:34:13.583 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:34:13 smithi121 ceph-mon[16788]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-18T22:34:13.583 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:34:13 smithi121 ceph-mon[16788]: from='mgr.14160 172.21.15.121:0/261891242' entity='mgr.smithi121.lopxqc' 2024-08-18T22:34:14.583 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:34:14 smithi121 ceph-mon[16788]: from='client.? 172.21.15.195:0/935242584' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-08-18T22:34:14.829 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-08-18T22:34:14.829 DEBUG:teuthology.orchestra.run.smithi195:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b003123a-5db1-11ef-bccf-c7b262605968 -- ceph mon dump -f json 2024-08-18T22:34:15.076 INFO:teuthology.orchestra.run.smithi195.stderr:Inferring config /etc/ceph/ceph.conf 2024-08-18T22:34:15.124 INFO:teuthology.orchestra.run.smithi195.stderr:Inferring config /etc/ceph/ceph.conf 2024-08-18T22:34:15.333 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:34:15 smithi121 ceph-mon[16788]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-18T22:34:16.553 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:16.550+0000 7f9814d65640 1 -- 172.21.15.195:0/634803172 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f98100fbf70 msgr2=0x7f98100fc380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:34:16.553 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:16.550+0000 7f9814d65640 1 --2- 172.21.15.195:0/634803172 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f98100fbf70 0x7f98100fc380 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f9800004850 tx=0x7f9800009da0 comp rx=0 tx=0).stop 2024-08-18T22:34:16.553 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:16.550+0000 7f9814d65640 1 -- 172.21.15.195:0/634803172 shutdown_connections 2024-08-18T22:34:16.553 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:16.550+0000 7f9814d65640 1 --2- 172.21.15.195:0/634803172 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f98100fbf70 0x7f98100fc380 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:16.553 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:16.550+0000 7f9814d65640 1 -- 172.21.15.195:0/634803172 >> 172.21.15.195:0/634803172 conn(0x7f98100f7750 msgr2=0x7f98100f9b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:34:16.553 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:16.550+0000 7f9814d65640 1 -- 172.21.15.195:0/634803172 shutdown_connections 2024-08-18T22:34:16.553 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:16.550+0000 7f9814d65640 1 -- 172.21.15.195:0/634803172 wait complete. 2024-08-18T22:34:16.553 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:16.551+0000 7f9814d65640 1 Processor -- start 2024-08-18T22:34:16.553 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:16.551+0000 7f9814d65640 1 -- start start 2024-08-18T22:34:16.553 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:16.551+0000 7f9814d65640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f98100fbf70 0x7f981010c4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:34:16.553 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:16.551+0000 7f9814d65640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f981010c9f0 con 0x7f98100fbf70 2024-08-18T22:34:16.555 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:16.551+0000 7f980e59c640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f98100fbf70 0x7f981010c4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:34:16.555 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:16.551+0000 7f980e59c640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f98100fbf70 0x7f981010c4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.195:34138/0 (socket says 172.21.15.195:34138) 2024-08-18T22:34:16.555 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:16.551+0000 7f980e59c640 1 -- 172.21.15.195:0/3331678749 learned_addr learned my addr 172.21.15.195:0/3331678749 (peer_addr_for_me v2:172.21.15.195:0/0) 2024-08-18T22:34:16.555 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:16.551+0000 7f980e59c640 1 -- 172.21.15.195:0/3331678749 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9800005040 con 0x7f98100fbf70 2024-08-18T22:34:16.555 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:16.551+0000 7f980e59c640 1 --2- 172.21.15.195:0/3331678749 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f98100fbf70 0x7f981010c4b0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f980002a6d0 tx=0x7f9800009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:34:16.555 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:16.552+0000 7f9806ffd640 1 -- 172.21.15.195:0/3331678749 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9800033630 con 0x7f98100fbf70 2024-08-18T22:34:16.556 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:16.552+0000 7f9814d65640 1 -- 172.21.15.195:0/3331678749 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f981010cbf0 con 0x7f98100fbf70 2024-08-18T22:34:16.556 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:16.552+0000 7f9806ffd640 1 -- 172.21.15.195:0/3331678749 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f9800033c30 con 0x7f98100fbf70 2024-08-18T22:34:16.556 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:16.552+0000 7f9806ffd640 1 -- 172.21.15.195:0/3331678749 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f980003dc00 con 0x7f98100fbf70 2024-08-18T22:34:16.556 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:16.552+0000 7f9814d65640 1 -- 172.21.15.195:0/3331678749 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f981010d060 con 0x7f98100fbf70 2024-08-18T22:34:16.556 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:16.552+0000 7f9806ffd640 1 -- 172.21.15.195:0/3331678749 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 13) v1 ==== 42693+0+0 (secure 0 0 0) 0x7f9800030020 con 0x7f98100fbf70 2024-08-18T22:34:16.556 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:16.553+0000 7f9814d65640 1 -- 172.21.15.195:0/3331678749 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f981005eb10 con 0x7f98100fbf70 2024-08-18T22:34:16.556 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:16.553+0000 7f9806ffd640 1 --2- 172.21.15.195:0/3331678749 >> [v2:172.21.15.121:6800/1740603058,v1:172.21.15.121:6801/1740603058] conn(0x7f97fc0357b0 0x7f97fc037c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:34:16.556 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:16.553+0000 7f9806ffd640 1 -- 172.21.15.195:0/3331678749 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f9800067f50 con 0x7f98100fbf70 2024-08-18T22:34:16.556 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:16.553+0000 7f9807fff640 1 --2- 172.21.15.195:0/3331678749 >> [v2:172.21.15.121:6800/1740603058,v1:172.21.15.121:6801/1740603058] conn(0x7f97fc0357b0 0x7f97fc037c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:34:16.556 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:16.553+0000 7f9807fff640 1 --2- 172.21.15.195:0/3331678749 >> [v2:172.21.15.121:6800/1740603058,v1:172.21.15.121:6801/1740603058] conn(0x7f97fc0357b0 0x7f97fc037c60 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f97f8006fd0 tx=0x7f97f8006db0 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:34:16.559 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:16.557+0000 7f9806ffd640 1 -- 172.21.15.195:0/3331678749 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f9800045b80 con 0x7f98100fbf70 2024-08-18T22:34:16.773 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:16.770+0000 7f9814d65640 1 -- 172.21.15.195:0/3331678749 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f981004b4c0 con 0x7f98100fbf70 2024-08-18T22:34:16.773 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:16.771+0000 7f9806ffd640 1 -- 172.21.15.195:0/3331678749 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+743 (secure 0 0 0) 0x7f9800045b80 con 0x7f98100fbf70 2024-08-18T22:34:16.773 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-08-18T22:34:16.774 INFO:teuthology.orchestra.run.smithi195.stdout:{"epoch":1,"fsid":"b003123a-5db1-11ef-bccf-c7b262605968","modified":"2024-08-18T22:32:38.034362Z","created":"2024-08-18T22:32:38.034362Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi121","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:3300","nonce":0},{"type":"v1","addr":"172.21.15.121:6789","nonce":0}]},"addr":"172.21.15.121:6789/0","public_addr":"172.21.15.121:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-08-18T22:34:16.774 INFO:teuthology.orchestra.run.smithi195.stderr:dumped monmap epoch 1 2024-08-18T22:34:16.775 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:16.773+0000 7f9814d65640 1 -- 172.21.15.195:0/3331678749 >> [v2:172.21.15.121:6800/1740603058,v1:172.21.15.121:6801/1740603058] conn(0x7f97fc0357b0 msgr2=0x7f97fc037c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:34:16.775 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:16.773+0000 7f9814d65640 1 --2- 172.21.15.195:0/3331678749 >> [v2:172.21.15.121:6800/1740603058,v1:172.21.15.121:6801/1740603058] conn(0x7f97fc0357b0 0x7f97fc037c60 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f97f8006fd0 tx=0x7f97f8006db0 comp rx=0 tx=0).stop 2024-08-18T22:34:16.776 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:16.773+0000 7f9814d65640 1 -- 172.21.15.195:0/3331678749 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f98100fbf70 msgr2=0x7f981010c4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:34:16.776 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:16.773+0000 7f9814d65640 1 --2- 172.21.15.195:0/3331678749 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f98100fbf70 0x7f981010c4b0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f980002a6d0 tx=0x7f9800009da0 comp rx=0 tx=0).stop 2024-08-18T22:34:16.776 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:16.773+0000 7f9814d65640 1 -- 172.21.15.195:0/3331678749 shutdown_connections 2024-08-18T22:34:16.776 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:16.773+0000 7f9814d65640 1 --2- 172.21.15.195:0/3331678749 >> [v2:172.21.15.121:6800/1740603058,v1:172.21.15.121:6801/1740603058] conn(0x7f97fc0357b0 0x7f97fc037c60 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:16.776 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:16.773+0000 7f9814d65640 1 --2- 172.21.15.195:0/3331678749 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f98100fbf70 0x7f981010c4b0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:16.776 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:16.773+0000 7f9814d65640 1 -- 172.21.15.195:0/3331678749 >> 172.21.15.195:0/3331678749 conn(0x7f98100f7750 msgr2=0x7f98100f8000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:34:16.776 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:16.773+0000 7f9814d65640 1 -- 172.21.15.195:0/3331678749 shutdown_connections 2024-08-18T22:34:16.776 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:16.773+0000 7f9814d65640 1 -- 172.21.15.195:0/3331678749 wait complete. 2024-08-18T22:34:17.583 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:34:17 smithi121 ceph-mon[16788]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-18T22:34:17.583 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:34:17 smithi121 ceph-mon[16788]: from='client.? 172.21.15.195:0/3331678749' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-08-18T22:34:18.323 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-08-18T22:34:18.324 DEBUG:teuthology.orchestra.run.smithi195:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b003123a-5db1-11ef-bccf-c7b262605968 -- ceph mon dump -f json 2024-08-18T22:34:18.579 INFO:teuthology.orchestra.run.smithi195.stderr:Inferring config /etc/ceph/ceph.conf 2024-08-18T22:34:18.629 INFO:teuthology.orchestra.run.smithi195.stderr:Inferring config /etc/ceph/ceph.conf 2024-08-18T22:34:19.583 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:34:19 smithi121 ceph-mon[16788]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-18T22:34:20.134 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:20.132+0000 7fd364a2d640 1 -- 172.21.15.195:0/2713147673 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd3600fbf70 msgr2=0x7fd3600fc380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:34:20.134 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:20.132+0000 7fd364a2d640 1 --2- 172.21.15.195:0/2713147673 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd3600fbf70 0x7fd3600fc380 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fd350009bd0 tx=0x7fd350004d10 comp rx=0 tx=0).stop 2024-08-18T22:34:20.134 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:20.132+0000 7fd364a2d640 1 -- 172.21.15.195:0/2713147673 shutdown_connections 2024-08-18T22:34:20.134 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:20.132+0000 7fd364a2d640 1 --2- 172.21.15.195:0/2713147673 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd3600fbf70 0x7fd3600fc380 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:20.134 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:20.132+0000 7fd364a2d640 1 -- 172.21.15.195:0/2713147673 >> 172.21.15.195:0/2713147673 conn(0x7fd3600f7750 msgr2=0x7fd3600f9b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:34:20.135 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:20.132+0000 7fd364a2d640 1 -- 172.21.15.195:0/2713147673 shutdown_connections 2024-08-18T22:34:20.135 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:20.132+0000 7fd364a2d640 1 -- 172.21.15.195:0/2713147673 wait complete. 2024-08-18T22:34:20.135 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:20.133+0000 7fd364a2d640 1 Processor -- start 2024-08-18T22:34:20.135 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:20.133+0000 7fd364a2d640 1 -- start start 2024-08-18T22:34:20.135 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:20.133+0000 7fd364a2d640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd3600fbf70 0x7fd36010c470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:34:20.135 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:20.133+0000 7fd364a2d640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd36010c9b0 con 0x7fd3600fbf70 2024-08-18T22:34:20.137 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:20.133+0000 7fd35e59c640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd3600fbf70 0x7fd36010c470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:34:20.137 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:20.133+0000 7fd35e59c640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd3600fbf70 0x7fd36010c470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.195:34150/0 (socket says 172.21.15.195:34150) 2024-08-18T22:34:20.137 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:20.133+0000 7fd35e59c640 1 -- 172.21.15.195:0/88895395 learned_addr learned my addr 172.21.15.195:0/88895395 (peer_addr_for_me v2:172.21.15.195:0/0) 2024-08-18T22:34:20.137 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:20.134+0000 7fd35e59c640 1 -- 172.21.15.195:0/88895395 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3500098b0 con 0x7fd3600fbf70 2024-08-18T22:34:20.137 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:20.134+0000 7fd35e59c640 1 --2- 172.21.15.195:0/88895395 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd3600fbf70 0x7fd36010c470 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fd350003400 tx=0x7fd350004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:34:20.137 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:20.134+0000 7fd34effd640 1 -- 172.21.15.195:0/88895395 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd350032910 con 0x7fd3600fbf70 2024-08-18T22:34:20.137 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:20.134+0000 7fd34effd640 1 -- 172.21.15.195:0/88895395 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fd35003d420 con 0x7fd3600fbf70 2024-08-18T22:34:20.137 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:20.134+0000 7fd34effd640 1 -- 172.21.15.195:0/88895395 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd350031590 con 0x7fd3600fbf70 2024-08-18T22:34:20.138 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:20.134+0000 7fd364a2d640 1 -- 172.21.15.195:0/88895395 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd36010cbb0 con 0x7fd3600fbf70 2024-08-18T22:34:20.138 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:20.134+0000 7fd364a2d640 1 -- 172.21.15.195:0/88895395 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd36010d740 con 0x7fd3600fbf70 2024-08-18T22:34:20.138 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:20.135+0000 7fd34effd640 1 -- 172.21.15.195:0/88895395 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 13) v1 ==== 42693+0+0 (secure 0 0 0) 0x7fd35002f030 con 0x7fd3600fbf70 2024-08-18T22:34:20.138 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:20.135+0000 7fd364a2d640 1 -- 172.21.15.195:0/88895395 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd360102390 con 0x7fd3600fbf70 2024-08-18T22:34:20.138 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:20.135+0000 7fd34effd640 1 --2- 172.21.15.195:0/88895395 >> [v2:172.21.15.121:6800/1740603058,v1:172.21.15.121:6801/1740603058] conn(0x7fd3480357b0 0x7fd348037c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:34:20.138 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:20.135+0000 7fd34effd640 1 -- 172.21.15.195:0/88895395 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7fd350068d00 con 0x7fd3600fbf70 2024-08-18T22:34:20.138 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:20.135+0000 7fd35dd9b640 1 --2- 172.21.15.195:0/88895395 >> [v2:172.21.15.121:6800/1740603058,v1:172.21.15.121:6801/1740603058] conn(0x7fd3480357b0 0x7fd348037c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:34:20.138 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:20.136+0000 7fd35dd9b640 1 --2- 172.21.15.195:0/88895395 >> [v2:172.21.15.121:6800/1740603058,v1:172.21.15.121:6801/1740603058] conn(0x7fd3480357b0 0x7fd348037c60 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fd354006fd0 tx=0x7fd354006db0 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:34:20.141 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:20.140+0000 7fd34effd640 1 -- 172.21.15.195:0/88895395 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fd35004e530 con 0x7fd3600fbf70 2024-08-18T22:34:20.353 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:20.352+0000 7fd364a2d640 1 -- 172.21.15.195:0/88895395 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fd36010e090 con 0x7fd3600fbf70 2024-08-18T22:34:20.354 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:20.353+0000 7fd34effd640 1 -- 172.21.15.195:0/88895395 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+743 (secure 0 0 0) 0x7fd35004e350 con 0x7fd3600fbf70 2024-08-18T22:34:20.354 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-08-18T22:34:20.354 INFO:teuthology.orchestra.run.smithi195.stdout:{"epoch":1,"fsid":"b003123a-5db1-11ef-bccf-c7b262605968","modified":"2024-08-18T22:32:38.034362Z","created":"2024-08-18T22:32:38.034362Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi121","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:3300","nonce":0},{"type":"v1","addr":"172.21.15.121:6789","nonce":0}]},"addr":"172.21.15.121:6789/0","public_addr":"172.21.15.121:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-08-18T22:34:20.354 INFO:teuthology.orchestra.run.smithi195.stderr:dumped monmap epoch 1 2024-08-18T22:34:20.356 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:20.355+0000 7fd364a2d640 1 -- 172.21.15.195:0/88895395 >> [v2:172.21.15.121:6800/1740603058,v1:172.21.15.121:6801/1740603058] conn(0x7fd3480357b0 msgr2=0x7fd348037c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:34:20.356 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:20.355+0000 7fd364a2d640 1 --2- 172.21.15.195:0/88895395 >> [v2:172.21.15.121:6800/1740603058,v1:172.21.15.121:6801/1740603058] conn(0x7fd3480357b0 0x7fd348037c60 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fd354006fd0 tx=0x7fd354006db0 comp rx=0 tx=0).stop 2024-08-18T22:34:20.356 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:20.355+0000 7fd364a2d640 1 -- 172.21.15.195:0/88895395 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd3600fbf70 msgr2=0x7fd36010c470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:34:20.356 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:20.355+0000 7fd364a2d640 1 --2- 172.21.15.195:0/88895395 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd3600fbf70 0x7fd36010c470 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fd350003400 tx=0x7fd350004d10 comp rx=0 tx=0).stop 2024-08-18T22:34:20.356 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:20.355+0000 7fd364a2d640 1 -- 172.21.15.195:0/88895395 shutdown_connections 2024-08-18T22:34:20.356 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:20.355+0000 7fd364a2d640 1 --2- 172.21.15.195:0/88895395 >> [v2:172.21.15.121:6800/1740603058,v1:172.21.15.121:6801/1740603058] conn(0x7fd3480357b0 0x7fd348037c60 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:20.357 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:20.355+0000 7fd364a2d640 1 --2- 172.21.15.195:0/88895395 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd3600fbf70 0x7fd36010c470 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:20.357 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:20.355+0000 7fd364a2d640 1 -- 172.21.15.195:0/88895395 >> 172.21.15.195:0/88895395 conn(0x7fd3600f7750 msgr2=0x7fd3600f7f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:34:20.357 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:20.355+0000 7fd364a2d640 1 -- 172.21.15.195:0/88895395 shutdown_connections 2024-08-18T22:34:20.357 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:20.355+0000 7fd364a2d640 1 -- 172.21.15.195:0/88895395 wait complete. 2024-08-18T22:34:21.334 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:34:21 smithi121 ceph-mon[16788]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-18T22:34:21.334 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:34:21 smithi121 ceph-mon[16788]: from='client.? 172.21.15.195:0/88895395' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-08-18T22:34:22.038 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-08-18T22:34:22.038 DEBUG:teuthology.orchestra.run.smithi195:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b003123a-5db1-11ef-bccf-c7b262605968 -- ceph mon dump -f json 2024-08-18T22:34:22.286 INFO:teuthology.orchestra.run.smithi195.stderr:Inferring config /etc/ceph/ceph.conf 2024-08-18T22:34:22.345 INFO:teuthology.orchestra.run.smithi195.stderr:Inferring config /etc/ceph/ceph.conf 2024-08-18T22:34:23.747 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:23.745+0000 7f6009c3c640 1 -- 172.21.15.195:0/2575389787 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f60040fd5c0 msgr2=0x7f60040fd9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:34:23.747 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:23.745+0000 7f6009c3c640 1 --2- 172.21.15.195:0/2575389787 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f60040fd5c0 0x7f60040fd9d0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f5ff4009bd0 tx=0x7f5ff4004d10 comp rx=0 tx=0).stop 2024-08-18T22:34:23.747 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:23.745+0000 7f6009c3c640 1 -- 172.21.15.195:0/2575389787 shutdown_connections 2024-08-18T22:34:23.747 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:23.745+0000 7f6009c3c640 1 --2- 172.21.15.195:0/2575389787 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f60040fd5c0 0x7f60040fd9d0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:23.747 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:23.745+0000 7f6009c3c640 1 -- 172.21.15.195:0/2575389787 >> 172.21.15.195:0/2575389787 conn(0x7f60040f5de0 msgr2=0x7f60040f81f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:34:23.747 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:23.745+0000 7f6009c3c640 1 -- 172.21.15.195:0/2575389787 shutdown_connections 2024-08-18T22:34:23.748 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:23.745+0000 7f6009c3c640 1 -- 172.21.15.195:0/2575389787 wait complete. 2024-08-18T22:34:23.748 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:23.745+0000 7f6009c3c640 1 Processor -- start 2024-08-18T22:34:23.748 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:23.745+0000 7f6009c3c640 1 -- start start 2024-08-18T22:34:23.748 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:23.746+0000 7f6009c3c640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f60040fd5c0 0x7f600410c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:34:23.748 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:23.746+0000 7f6009c3c640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f600410c9c0 con 0x7f60040fd5c0 2024-08-18T22:34:23.748 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:23.746+0000 7f60037fe640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f60040fd5c0 0x7f600410c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:34:23.748 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:23.746+0000 7f60037fe640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f60040fd5c0 0x7f600410c480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.195:58964/0 (socket says 172.21.15.195:58964) 2024-08-18T22:34:23.748 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:23.746+0000 7f60037fe640 1 -- 172.21.15.195:0/585666800 learned_addr learned my addr 172.21.15.195:0/585666800 (peer_addr_for_me v2:172.21.15.195:0/0) 2024-08-18T22:34:23.748 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:23.746+0000 7f60037fe640 1 -- 172.21.15.195:0/585666800 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ff40098b0 con 0x7f60040fd5c0 2024-08-18T22:34:23.748 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:23.746+0000 7f60037fe640 1 --2- 172.21.15.195:0/585666800 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f60040fd5c0 0x7f600410c480 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f5ff4003400 tx=0x7f5ff4004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:34:23.749 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:23.746+0000 7f5febfff640 1 -- 172.21.15.195:0/585666800 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5ff4032910 con 0x7f60040fd5c0 2024-08-18T22:34:23.749 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:23.746+0000 7f5febfff640 1 -- 172.21.15.195:0/585666800 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f5ff403d420 con 0x7f60040fd5c0 2024-08-18T22:34:23.750 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:23.746+0000 7f6009c3c640 1 -- 172.21.15.195:0/585666800 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f600410cbc0 con 0x7f60040fd5c0 2024-08-18T22:34:23.750 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:23.747+0000 7f5febfff640 1 -- 172.21.15.195:0/585666800 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5ff4031590 con 0x7f60040fd5c0 2024-08-18T22:34:23.750 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:23.747+0000 7f6009c3c640 1 -- 172.21.15.195:0/585666800 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f600410d750 con 0x7f60040fd5c0 2024-08-18T22:34:23.750 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:23.747+0000 7f5febfff640 1 -- 172.21.15.195:0/585666800 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 13) v1 ==== 42693+0+0 (secure 0 0 0) 0x7f5ff402f030 con 0x7f60040fd5c0 2024-08-18T22:34:23.750 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:23.748+0000 7f6009c3c640 1 -- 172.21.15.195:0/585666800 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60041023a0 con 0x7f60040fd5c0 2024-08-18T22:34:23.750 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:23.748+0000 7f5febfff640 1 --2- 172.21.15.195:0/585666800 >> [v2:172.21.15.121:6800/1740603058,v1:172.21.15.121:6801/1740603058] conn(0x7f5fec0357b0 0x7f5fec037c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:34:23.750 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:23.748+0000 7f5febfff640 1 -- 172.21.15.195:0/585666800 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f5ff4068dc0 con 0x7f60040fd5c0 2024-08-18T22:34:23.750 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:23.748+0000 7f6002ffd640 1 --2- 172.21.15.195:0/585666800 >> [v2:172.21.15.121:6800/1740603058,v1:172.21.15.121:6801/1740603058] conn(0x7f5fec0357b0 0x7f5fec037c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:34:23.750 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:23.748+0000 7f6002ffd640 1 --2- 172.21.15.195:0/585666800 >> [v2:172.21.15.121:6800/1740603058,v1:172.21.15.121:6801/1740603058] conn(0x7f5fec0357b0 0x7f5fec037c60 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f5ff8006fd0 tx=0x7f5ff8006db0 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:34:23.755 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:23.754+0000 7f5febfff640 1 -- 172.21.15.195:0/585666800 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f5ff4046400 con 0x7f60040fd5c0 2024-08-18T22:34:23.833 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:34:23 smithi121 ceph-mon[16788]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-18T22:34:23.833 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:34:23 smithi121 ceph-mon[16788]: from='mgr.14160 172.21.15.121:0/261891242' entity='mgr.smithi121.lopxqc' 2024-08-18T22:34:23.833 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:34:23 smithi121 ceph-mon[16788]: from='mgr.14160 172.21.15.121:0/261891242' entity='mgr.smithi121.lopxqc' 2024-08-18T22:34:23.834 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:34:23 smithi121 ceph-mon[16788]: from='mgr.14160 172.21.15.121:0/261891242' entity='mgr.smithi121.lopxqc' 2024-08-18T22:34:23.834 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:34:23 smithi121 ceph-mon[16788]: from='mgr.14160 172.21.15.121:0/261891242' entity='mgr.smithi121.lopxqc' 2024-08-18T22:34:23.834 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:34:23 smithi121 ceph-mon[16788]: from='mgr.14160 172.21.15.121:0/261891242' entity='mgr.smithi121.lopxqc' 2024-08-18T22:34:23.834 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:34:23 smithi121 ceph-mon[16788]: from='mgr.14160 172.21.15.121:0/261891242' entity='mgr.smithi121.lopxqc' 2024-08-18T22:34:23.834 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:34:23 smithi121 ceph-mon[16788]: Deploying daemon prometheus.smithi121 on smithi121 2024-08-18T22:34:23.834 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:34:23 smithi121 ceph-mon[16788]: from='mgr.14160 172.21.15.121:0/261891242' entity='mgr.smithi121.lopxqc' 2024-08-18T22:34:23.969 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:23.968+0000 7f6009c3c640 1 -- 172.21.15.195:0/585666800 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f600410e0a0 con 0x7f60040fd5c0 2024-08-18T22:34:23.970 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:23.969+0000 7f5febfff640 1 -- 172.21.15.195:0/585666800 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+743 (secure 0 0 0) 0x7f5ff404e350 con 0x7f60040fd5c0 2024-08-18T22:34:23.970 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-08-18T22:34:23.970 INFO:teuthology.orchestra.run.smithi195.stdout:{"epoch":1,"fsid":"b003123a-5db1-11ef-bccf-c7b262605968","modified":"2024-08-18T22:32:38.034362Z","created":"2024-08-18T22:32:38.034362Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi121","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:3300","nonce":0},{"type":"v1","addr":"172.21.15.121:6789","nonce":0}]},"addr":"172.21.15.121:6789/0","public_addr":"172.21.15.121:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-08-18T22:34:23.971 INFO:teuthology.orchestra.run.smithi195.stderr:dumped monmap epoch 1 2024-08-18T22:34:23.972 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:23.971+0000 7f6009c3c640 1 -- 172.21.15.195:0/585666800 >> [v2:172.21.15.121:6800/1740603058,v1:172.21.15.121:6801/1740603058] conn(0x7f5fec0357b0 msgr2=0x7f5fec037c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:34:23.972 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:23.971+0000 7f6009c3c640 1 --2- 172.21.15.195:0/585666800 >> [v2:172.21.15.121:6800/1740603058,v1:172.21.15.121:6801/1740603058] conn(0x7f5fec0357b0 0x7f5fec037c60 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f5ff8006fd0 tx=0x7f5ff8006db0 comp rx=0 tx=0).stop 2024-08-18T22:34:23.972 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:23.971+0000 7f6009c3c640 1 -- 172.21.15.195:0/585666800 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f60040fd5c0 msgr2=0x7f600410c480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:34:23.972 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:23.971+0000 7f6009c3c640 1 --2- 172.21.15.195:0/585666800 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f60040fd5c0 0x7f600410c480 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f5ff4003400 tx=0x7f5ff4004d10 comp rx=0 tx=0).stop 2024-08-18T22:34:23.972 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:23.971+0000 7f6009c3c640 1 -- 172.21.15.195:0/585666800 shutdown_connections 2024-08-18T22:34:23.972 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:23.971+0000 7f6009c3c640 1 --2- 172.21.15.195:0/585666800 >> [v2:172.21.15.121:6800/1740603058,v1:172.21.15.121:6801/1740603058] conn(0x7f5fec0357b0 0x7f5fec037c60 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:23.972 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:23.971+0000 7f6009c3c640 1 --2- 172.21.15.195:0/585666800 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f60040fd5c0 0x7f600410c480 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:23.973 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:23.971+0000 7f6009c3c640 1 -- 172.21.15.195:0/585666800 >> 172.21.15.195:0/585666800 conn(0x7f60040f5de0 msgr2=0x7f60040f65f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:34:23.973 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:23.971+0000 7f6009c3c640 1 -- 172.21.15.195:0/585666800 shutdown_connections 2024-08-18T22:34:23.973 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:23.971+0000 7f6009c3c640 1 -- 172.21.15.195:0/585666800 wait complete. 2024-08-18T22:34:24.977 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:34:24 smithi121 ceph-mon[16788]: from='client.? 172.21.15.195:0/585666800' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-08-18T22:34:25.548 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-08-18T22:34:25.548 DEBUG:teuthology.orchestra.run.smithi195:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b003123a-5db1-11ef-bccf-c7b262605968 -- ceph mon dump -f json 2024-08-18T22:34:25.792 INFO:teuthology.orchestra.run.smithi195.stderr:Inferring config /etc/ceph/ceph.conf 2024-08-18T22:34:25.839 INFO:teuthology.orchestra.run.smithi195.stderr:Inferring config /etc/ceph/ceph.conf 2024-08-18T22:34:25.889 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:34:25 smithi121 ceph-mon[16788]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-18T22:34:27.315 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:27.313+0000 7f33f8bc7640 1 -- 172.21.15.195:0/1207066184 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f33f40fbf50 msgr2=0x7f33f40fc360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:34:27.315 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:27.313+0000 7f33f8bc7640 1 --2- 172.21.15.195:0/1207066184 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f33f40fbf50 0x7f33f40fc360 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f33e4004850 tx=0x7f33e4009da0 comp rx=0 tx=0).stop 2024-08-18T22:34:27.316 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:27.313+0000 7f33f8bc7640 1 -- 172.21.15.195:0/1207066184 shutdown_connections 2024-08-18T22:34:27.316 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:27.313+0000 7f33f8bc7640 1 --2- 172.21.15.195:0/1207066184 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f33f40fbf50 0x7f33f40fc360 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:27.316 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:27.313+0000 7f33f8bc7640 1 -- 172.21.15.195:0/1207066184 >> 172.21.15.195:0/1207066184 conn(0x7f33f40f7730 msgr2=0x7f33f40f9b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:34:27.316 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:27.313+0000 7f33f8bc7640 1 -- 172.21.15.195:0/1207066184 shutdown_connections 2024-08-18T22:34:27.316 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:27.313+0000 7f33f8bc7640 1 -- 172.21.15.195:0/1207066184 wait complete. 2024-08-18T22:34:27.316 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:27.314+0000 7f33f8bc7640 1 Processor -- start 2024-08-18T22:34:27.316 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:27.314+0000 7f33f8bc7640 1 -- start start 2024-08-18T22:34:27.316 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:27.314+0000 7f33f8bc7640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f33f40fbf50 0x7f33f410c490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:34:27.316 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:27.314+0000 7f33f8bc7640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33f410c9d0 con 0x7f33f40fbf50 2024-08-18T22:34:27.316 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:27.314+0000 7f33f259c640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f33f40fbf50 0x7f33f410c490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:34:27.316 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:27.314+0000 7f33f259c640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f33f40fbf50 0x7f33f410c490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.195:58984/0 (socket says 172.21.15.195:58984) 2024-08-18T22:34:27.316 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:27.314+0000 7f33f259c640 1 -- 172.21.15.195:0/1342236186 learned_addr learned my addr 172.21.15.195:0/1342236186 (peer_addr_for_me v2:172.21.15.195:0/0) 2024-08-18T22:34:27.316 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:27.315+0000 7f33f259c640 1 -- 172.21.15.195:0/1342236186 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33e4005040 con 0x7f33f40fbf50 2024-08-18T22:34:27.318 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:27.315+0000 7f33f259c640 1 --2- 172.21.15.195:0/1342236186 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f33f40fbf50 0x7f33f410c490 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f33e402a6d0 tx=0x7f33e4009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:34:27.318 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:27.315+0000 7f33eaffd640 1 -- 172.21.15.195:0/1342236186 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f33e4033630 con 0x7f33f40fbf50 2024-08-18T22:34:27.318 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:27.315+0000 7f33f8bc7640 1 -- 172.21.15.195:0/1342236186 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33f410cbd0 con 0x7f33f40fbf50 2024-08-18T22:34:27.318 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:27.315+0000 7f33eaffd640 1 -- 172.21.15.195:0/1342236186 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f33e4033c30 con 0x7f33f40fbf50 2024-08-18T22:34:27.318 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:27.315+0000 7f33eaffd640 1 -- 172.21.15.195:0/1342236186 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f33e403dc00 con 0x7f33f40fbf50 2024-08-18T22:34:27.318 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:27.315+0000 7f33f8bc7640 1 -- 172.21.15.195:0/1342236186 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33f410d040 con 0x7f33f40fbf50 2024-08-18T22:34:27.318 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:27.316+0000 7f33eaffd640 1 -- 172.21.15.195:0/1342236186 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 13) v1 ==== 42693+0+0 (secure 0 0 0) 0x7f33e4030020 con 0x7f33f40fbf50 2024-08-18T22:34:27.318 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:27.316+0000 7f33f8bc7640 1 -- 172.21.15.195:0/1342236186 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33f405eb10 con 0x7f33f40fbf50 2024-08-18T22:34:27.318 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:27.316+0000 7f33eaffd640 1 --2- 172.21.15.195:0/1342236186 >> [v2:172.21.15.121:6800/1740603058,v1:172.21.15.121:6801/1740603058] conn(0x7f33e00357b0 0x7f33e0037c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:34:27.318 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:27.316+0000 7f33eaffd640 1 -- 172.21.15.195:0/1342236186 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f33e4067f70 con 0x7f33f40fbf50 2024-08-18T22:34:27.318 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:27.316+0000 7f33ebfff640 1 --2- 172.21.15.195:0/1342236186 >> [v2:172.21.15.121:6800/1740603058,v1:172.21.15.121:6801/1740603058] conn(0x7f33e00357b0 0x7f33e0037c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:34:27.318 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:27.317+0000 7f33ebfff640 1 --2- 172.21.15.195:0/1342236186 >> [v2:172.21.15.121:6800/1740603058,v1:172.21.15.121:6801/1740603058] conn(0x7f33e00357b0 0x7f33e0037c60 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f33dc006fd0 tx=0x7f33dc006db0 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:34:27.322 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:27.321+0000 7f33eaffd640 1 -- 172.21.15.195:0/1342236186 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f33e4033790 con 0x7f33f40fbf50 2024-08-18T22:34:27.538 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:27.537+0000 7f33f8bc7640 1 -- 172.21.15.195:0/1342236186 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f33f404b4c0 con 0x7f33f40fbf50 2024-08-18T22:34:27.539 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:27.538+0000 7f33eaffd640 1 -- 172.21.15.195:0/1342236186 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+743 (secure 0 0 0) 0x7f33e4045390 con 0x7f33f40fbf50 2024-08-18T22:34:27.539 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-08-18T22:34:27.539 INFO:teuthology.orchestra.run.smithi195.stdout:{"epoch":1,"fsid":"b003123a-5db1-11ef-bccf-c7b262605968","modified":"2024-08-18T22:32:38.034362Z","created":"2024-08-18T22:32:38.034362Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi121","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:3300","nonce":0},{"type":"v1","addr":"172.21.15.121:6789","nonce":0}]},"addr":"172.21.15.121:6789/0","public_addr":"172.21.15.121:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-08-18T22:34:27.540 INFO:teuthology.orchestra.run.smithi195.stderr:dumped monmap epoch 1 2024-08-18T22:34:27.541 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:27.540+0000 7f33f8bc7640 1 -- 172.21.15.195:0/1342236186 >> [v2:172.21.15.121:6800/1740603058,v1:172.21.15.121:6801/1740603058] conn(0x7f33e00357b0 msgr2=0x7f33e0037c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:34:27.541 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:27.540+0000 7f33f8bc7640 1 --2- 172.21.15.195:0/1342236186 >> [v2:172.21.15.121:6800/1740603058,v1:172.21.15.121:6801/1740603058] conn(0x7f33e00357b0 0x7f33e0037c60 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f33dc006fd0 tx=0x7f33dc006db0 comp rx=0 tx=0).stop 2024-08-18T22:34:27.541 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:27.540+0000 7f33f8bc7640 1 -- 172.21.15.195:0/1342236186 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f33f40fbf50 msgr2=0x7f33f410c490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:34:27.541 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:27.540+0000 7f33f8bc7640 1 --2- 172.21.15.195:0/1342236186 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f33f40fbf50 0x7f33f410c490 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f33e402a6d0 tx=0x7f33e4009da0 comp rx=0 tx=0).stop 2024-08-18T22:34:27.541 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:27.540+0000 7f33f8bc7640 1 -- 172.21.15.195:0/1342236186 shutdown_connections 2024-08-18T22:34:27.541 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:27.540+0000 7f33f8bc7640 1 --2- 172.21.15.195:0/1342236186 >> [v2:172.21.15.121:6800/1740603058,v1:172.21.15.121:6801/1740603058] conn(0x7f33e00357b0 0x7f33e0037c60 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:27.542 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:27.540+0000 7f33f8bc7640 1 --2- 172.21.15.195:0/1342236186 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f33f40fbf50 0x7f33f410c490 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:27.542 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:27.540+0000 7f33f8bc7640 1 -- 172.21.15.195:0/1342236186 >> 172.21.15.195:0/1342236186 conn(0x7f33f40f7730 msgr2=0x7f33f40f7fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:34:27.542 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:27.540+0000 7f33f8bc7640 1 -- 172.21.15.195:0/1342236186 shutdown_connections 2024-08-18T22:34:27.542 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:27.540+0000 7f33f8bc7640 1 -- 172.21.15.195:0/1342236186 wait complete. 2024-08-18T22:34:28.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:34:27 smithi121 ceph-mon[16788]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-18T22:34:28.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:34:27 smithi121 ceph-mon[16788]: from='client.? 172.21.15.195:0/1342236186' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-08-18T22:34:29.135 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-08-18T22:34:29.136 DEBUG:teuthology.orchestra.run.smithi195:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b003123a-5db1-11ef-bccf-c7b262605968 -- ceph mon dump -f json 2024-08-18T22:34:29.372 INFO:teuthology.orchestra.run.smithi195.stderr:Inferring config /etc/ceph/ceph.conf 2024-08-18T22:34:29.419 INFO:teuthology.orchestra.run.smithi195.stderr:Inferring config /etc/ceph/ceph.conf 2024-08-18T22:34:29.879 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:34:29 smithi121 ceph-mon[16788]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-18T22:34:30.868 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:30.860+0000 7f8c6d419640 1 -- 172.21.15.195:0/4192316794 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8c680fbf70 msgr2=0x7f8c680fc380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:34:30.869 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:30.860+0000 7f8c6d419640 1 --2- 172.21.15.195:0/4192316794 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8c680fbf70 0x7f8c680fc380 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f8c58004850 tx=0x7f8c58009da0 comp rx=0 tx=0).stop 2024-08-18T22:34:30.869 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:30.860+0000 7f8c6d419640 1 -- 172.21.15.195:0/4192316794 shutdown_connections 2024-08-18T22:34:30.869 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:30.860+0000 7f8c6d419640 1 --2- 172.21.15.195:0/4192316794 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8c680fbf70 0x7f8c680fc380 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:30.869 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:30.860+0000 7f8c6d419640 1 -- 172.21.15.195:0/4192316794 >> 172.21.15.195:0/4192316794 conn(0x7f8c680f7750 msgr2=0x7f8c680f9b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:34:30.869 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:30.860+0000 7f8c6d419640 1 -- 172.21.15.195:0/4192316794 shutdown_connections 2024-08-18T22:34:30.869 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:30.860+0000 7f8c6d419640 1 -- 172.21.15.195:0/4192316794 wait complete. 2024-08-18T22:34:30.869 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:30.860+0000 7f8c6d419640 1 Processor -- start 2024-08-18T22:34:30.869 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:30.860+0000 7f8c6d419640 1 -- start start 2024-08-18T22:34:30.869 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:30.860+0000 7f8c6d419640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8c680fbf70 0x7f8c6810c470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:34:30.869 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:30.860+0000 7f8c6d419640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c6810c9b0 con 0x7f8c680fbf70 2024-08-18T22:34:30.869 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:30.861+0000 7f8c66ffd640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8c680fbf70 0x7f8c6810c470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:34:30.870 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:30.861+0000 7f8c66ffd640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8c680fbf70 0x7f8c6810c470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.195:40602/0 (socket says 172.21.15.195:40602) 2024-08-18T22:34:30.870 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:30.861+0000 7f8c66ffd640 1 -- 172.21.15.195:0/2357336635 learned_addr learned my addr 172.21.15.195:0/2357336635 (peer_addr_for_me v2:172.21.15.195:0/0) 2024-08-18T22:34:30.870 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:30.861+0000 7f8c66ffd640 1 -- 172.21.15.195:0/2357336635 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c58005040 con 0x7f8c680fbf70 2024-08-18T22:34:30.870 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:30.861+0000 7f8c66ffd640 1 --2- 172.21.15.195:0/2357336635 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8c680fbf70 0x7f8c6810c470 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f8c5802a6d0 tx=0x7f8c58009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:34:30.870 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:30.861+0000 7f8c5f7fe640 1 -- 172.21.15.195:0/2357336635 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8c58033630 con 0x7f8c680fbf70 2024-08-18T22:34:30.870 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:30.861+0000 7f8c6d419640 1 -- 172.21.15.195:0/2357336635 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c6810cbb0 con 0x7f8c680fbf70 2024-08-18T22:34:30.870 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:30.861+0000 7f8c5f7fe640 1 -- 172.21.15.195:0/2357336635 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f8c58033c30 con 0x7f8c680fbf70 2024-08-18T22:34:30.870 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:30.861+0000 7f8c5f7fe640 1 -- 172.21.15.195:0/2357336635 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8c5803dc00 con 0x7f8c680fbf70 2024-08-18T22:34:30.870 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:30.861+0000 7f8c6d419640 1 -- 172.21.15.195:0/2357336635 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c6810d020 con 0x7f8c680fbf70 2024-08-18T22:34:30.870 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:30.862+0000 7f8c5f7fe640 1 -- 172.21.15.195:0/2357336635 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 13) v1 ==== 42693+0+0 (secure 0 0 0) 0x7f8c58030020 con 0x7f8c680fbf70 2024-08-18T22:34:30.870 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:30.862+0000 7f8c6d419640 1 -- 172.21.15.195:0/2357336635 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c6805eb10 con 0x7f8c680fbf70 2024-08-18T22:34:30.870 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:30.862+0000 7f8c5f7fe640 1 --2- 172.21.15.195:0/2357336635 >> [v2:172.21.15.121:6800/1740603058,v1:172.21.15.121:6801/1740603058] conn(0x7f8c540357b0 0x7f8c54037c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:34:30.870 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:30.863+0000 7f8c5f7fe640 1 -- 172.21.15.195:0/2357336635 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f8c58067e20 con 0x7f8c680fbf70 2024-08-18T22:34:30.870 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:30.863+0000 7f8c5ffff640 1 --2- 172.21.15.195:0/2357336635 >> [v2:172.21.15.121:6800/1740603058,v1:172.21.15.121:6801/1740603058] conn(0x7f8c540357b0 0x7f8c54037c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:34:30.871 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:30.863+0000 7f8c5ffff640 1 --2- 172.21.15.195:0/2357336635 >> [v2:172.21.15.121:6800/1740603058,v1:172.21.15.121:6801/1740603058] conn(0x7f8c540357b0 0x7f8c54037c60 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f8c50006fd0 tx=0x7f8c50006db0 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:34:30.871 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:30.867+0000 7f8c5f7fe640 1 -- 172.21.15.195:0/2357336635 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f8c58033790 con 0x7f8c680fbf70 2024-08-18T22:34:31.083 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:31.082+0000 7f8c6d419640 1 -- 172.21.15.195:0/2357336635 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f8c6804b4c0 con 0x7f8c680fbf70 2024-08-18T22:34:31.084 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:31.083+0000 7f8c5f7fe640 1 -- 172.21.15.195:0/2357336635 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+743 (secure 0 0 0) 0x7f8c58045390 con 0x7f8c680fbf70 2024-08-18T22:34:31.084 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-08-18T22:34:31.084 INFO:teuthology.orchestra.run.smithi195.stdout:{"epoch":1,"fsid":"b003123a-5db1-11ef-bccf-c7b262605968","modified":"2024-08-18T22:32:38.034362Z","created":"2024-08-18T22:32:38.034362Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi121","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:3300","nonce":0},{"type":"v1","addr":"172.21.15.121:6789","nonce":0}]},"addr":"172.21.15.121:6789/0","public_addr":"172.21.15.121:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-08-18T22:34:31.085 INFO:teuthology.orchestra.run.smithi195.stderr:dumped monmap epoch 1 2024-08-18T22:34:31.086 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:31.085+0000 7f8c6d419640 1 -- 172.21.15.195:0/2357336635 >> [v2:172.21.15.121:6800/1740603058,v1:172.21.15.121:6801/1740603058] conn(0x7f8c540357b0 msgr2=0x7f8c54037c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:34:31.087 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:31.085+0000 7f8c6d419640 1 --2- 172.21.15.195:0/2357336635 >> [v2:172.21.15.121:6800/1740603058,v1:172.21.15.121:6801/1740603058] conn(0x7f8c540357b0 0x7f8c54037c60 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f8c50006fd0 tx=0x7f8c50006db0 comp rx=0 tx=0).stop 2024-08-18T22:34:31.087 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:31.085+0000 7f8c6d419640 1 -- 172.21.15.195:0/2357336635 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8c680fbf70 msgr2=0x7f8c6810c470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:34:31.087 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:31.085+0000 7f8c6d419640 1 --2- 172.21.15.195:0/2357336635 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8c680fbf70 0x7f8c6810c470 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f8c5802a6d0 tx=0x7f8c58009da0 comp rx=0 tx=0).stop 2024-08-18T22:34:31.087 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:31.085+0000 7f8c6d419640 1 -- 172.21.15.195:0/2357336635 shutdown_connections 2024-08-18T22:34:31.087 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:31.085+0000 7f8c6d419640 1 --2- 172.21.15.195:0/2357336635 >> [v2:172.21.15.121:6800/1740603058,v1:172.21.15.121:6801/1740603058] conn(0x7f8c540357b0 0x7f8c54037c60 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:31.087 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:31.085+0000 7f8c6d419640 1 --2- 172.21.15.195:0/2357336635 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8c680fbf70 0x7f8c6810c470 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:31.087 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:31.085+0000 7f8c6d419640 1 -- 172.21.15.195:0/2357336635 >> 172.21.15.195:0/2357336635 conn(0x7f8c680f7750 msgr2=0x7f8c680f7f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:34:31.087 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:31.085+0000 7f8c6d419640 1 -- 172.21.15.195:0/2357336635 shutdown_connections 2024-08-18T22:34:31.087 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:31.085+0000 7f8c6d419640 1 -- 172.21.15.195:0/2357336635 wait complete. 2024-08-18T22:34:31.833 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:34:31 smithi121 ceph-mon[16788]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-18T22:34:31.834 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:34:31 smithi121 ceph-mon[16788]: from='client.? 172.21.15.195:0/2357336635' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-08-18T22:34:32.666 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-08-18T22:34:32.667 DEBUG:teuthology.orchestra.run.smithi195:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b003123a-5db1-11ef-bccf-c7b262605968 -- ceph mon dump -f json 2024-08-18T22:34:32.914 INFO:teuthology.orchestra.run.smithi195.stderr:Inferring config /etc/ceph/ceph.conf 2024-08-18T22:34:32.962 INFO:teuthology.orchestra.run.smithi195.stderr:Inferring config /etc/ceph/ceph.conf 2024-08-18T22:34:34.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:34:33 smithi121 ceph-mon[16788]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-18T22:34:34.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:34:33 smithi121 ceph-mon[16788]: from='mgr.14160 172.21.15.121:0/261891242' entity='mgr.smithi121.lopxqc' 2024-08-18T22:34:34.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:34:33 smithi121 ceph-mon[16788]: from='mgr.14160 172.21.15.121:0/261891242' entity='mgr.smithi121.lopxqc' 2024-08-18T22:34:34.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:34:33 smithi121 ceph-mon[16788]: from='mgr.14160 172.21.15.121:0/261891242' entity='mgr.smithi121.lopxqc' 2024-08-18T22:34:34.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:34:33 smithi121 ceph-mon[16788]: from='mgr.14160 172.21.15.121:0/261891242' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "mgr module enable", "module": "prometheus"}]: dispatch 2024-08-18T22:34:34.338 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:34.330+0000 7f305e9e9640 1 -- 172.21.15.195:0/2961412079 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f30580653f0 msgr2=0x7f30580fed90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:34:34.338 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:34.330+0000 7f305e9e9640 1 --2- 172.21.15.195:0/2961412079 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f30580653f0 0x7f30580fed90 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f3048004850 tx=0x7f3048009da0 comp rx=0 tx=0).stop 2024-08-18T22:34:34.339 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:34.330+0000 7f305e9e9640 1 -- 172.21.15.195:0/2961412079 shutdown_connections 2024-08-18T22:34:34.339 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:34.330+0000 7f305e9e9640 1 --2- 172.21.15.195:0/2961412079 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f30580653f0 0x7f30580fed90 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:34.339 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:34.330+0000 7f305e9e9640 1 -- 172.21.15.195:0/2961412079 >> 172.21.15.195:0/2961412079 conn(0x7f30580f6860 msgr2=0x7f30580f8c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:34:34.339 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:34.330+0000 7f305e9e9640 1 -- 172.21.15.195:0/2961412079 shutdown_connections 2024-08-18T22:34:34.339 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:34.330+0000 7f305e9e9640 1 -- 172.21.15.195:0/2961412079 wait complete. 2024-08-18T22:34:34.339 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:34.330+0000 7f305e9e9640 1 Processor -- start 2024-08-18T22:34:34.339 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:34.330+0000 7f305e9e9640 1 -- start start 2024-08-18T22:34:34.339 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:34.331+0000 7f305e9e9640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f30580653f0 0x7f305810c6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:34:34.339 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:34.331+0000 7f305e9e9640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f305810cc20 con 0x7f30580653f0 2024-08-18T22:34:34.339 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:34.331+0000 7f3057fff640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f30580653f0 0x7f305810c6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:34:34.339 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:34.331+0000 7f3057fff640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f30580653f0 0x7f305810c6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.195:40626/0 (socket says 172.21.15.195:40626) 2024-08-18T22:34:34.339 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:34.331+0000 7f3057fff640 1 -- 172.21.15.195:0/3803147071 learned_addr learned my addr 172.21.15.195:0/3803147071 (peer_addr_for_me v2:172.21.15.195:0/0) 2024-08-18T22:34:34.339 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:34.331+0000 7f3057fff640 1 -- 172.21.15.195:0/3803147071 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3048005040 con 0x7f30580653f0 2024-08-18T22:34:34.340 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:34.331+0000 7f3057fff640 1 --2- 172.21.15.195:0/3803147071 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f30580653f0 0x7f305810c6e0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f304802a6d0 tx=0x7f3048009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:34:34.340 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:34.331+0000 7f3054ff9640 1 -- 172.21.15.195:0/3803147071 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3048033630 con 0x7f30580653f0 2024-08-18T22:34:34.340 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:34.331+0000 7f3054ff9640 1 -- 172.21.15.195:0/3803147071 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f3048033c30 con 0x7f30580653f0 2024-08-18T22:34:34.340 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:34.331+0000 7f305e9e9640 1 -- 172.21.15.195:0/3803147071 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f305810ce20 con 0x7f30580653f0 2024-08-18T22:34:34.340 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:34.331+0000 7f3054ff9640 1 -- 172.21.15.195:0/3803147071 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f304803dc30 con 0x7f30580653f0 2024-08-18T22:34:34.340 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:34.331+0000 7f305e9e9640 1 -- 172.21.15.195:0/3803147071 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f305810d290 con 0x7f30580653f0 2024-08-18T22:34:34.340 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:34.332+0000 7f3054ff9640 1 -- 172.21.15.195:0/3803147071 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 14) v1 ==== 42707+0+0 (secure 0 0 0) 0x7f3048030020 con 0x7f30580653f0 2024-08-18T22:34:34.340 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:34.333+0000 7f3054ff9640 1 --2- 172.21.15.195:0/3803147071 >> [v2:172.21.15.121:6800/1740603058,v1:172.21.15.121:6801/1740603058] conn(0x7f3040035800 0x7f3040037cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:34:34.340 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:34.333+0000 7f305e9e9640 1 -- 172.21.15.195:0/3803147071 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f305805eb10 con 0x7f30580653f0 2024-08-18T22:34:34.340 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:34.333+0000 7f30577fe640 1 -- 172.21.15.195:0/3803147071 >> [v2:172.21.15.121:6800/1740603058,v1:172.21.15.121:6801/1740603058] conn(0x7f3040035800 msgr2=0x7f3040037cb0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.121:6800/1740603058 2024-08-18T22:34:34.340 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:34.333+0000 7f3054ff9640 1 -- 172.21.15.195:0/3803147071 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f3048067f60 con 0x7f30580653f0 2024-08-18T22:34:34.340 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:34.333+0000 7f30577fe640 1 --2- 172.21.15.195:0/3803147071 >> [v2:172.21.15.121:6800/1740603058,v1:172.21.15.121:6801/1740603058] conn(0x7f3040035800 0x7f3040037cb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-18T22:34:34.341 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:34.338+0000 7f3054ff9640 1 -- 172.21.15.195:0/3803147071 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f304803b780 con 0x7f30580653f0 2024-08-18T22:34:34.535 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:34.534+0000 7f30577fe640 1 -- 172.21.15.195:0/3803147071 >> [v2:172.21.15.121:6800/1740603058,v1:172.21.15.121:6801/1740603058] conn(0x7f3040035800 msgr2=0x7f3040037cb0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.121:6800/1740603058 2024-08-18T22:34:34.535 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:34.534+0000 7f30577fe640 1 --2- 172.21.15.195:0/3803147071 >> [v2:172.21.15.121:6800/1740603058,v1:172.21.15.121:6801/1740603058] conn(0x7f3040035800 0x7f3040037cb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-18T22:34:34.553 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:34.552+0000 7f305e9e9640 1 -- 172.21.15.195:0/3803147071 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f305804b4c0 con 0x7f30580653f0 2024-08-18T22:34:34.553 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:34.552+0000 7f3054ff9640 1 -- 172.21.15.195:0/3803147071 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+743 (secure 0 0 0) 0x7f304803b370 con 0x7f30580653f0 2024-08-18T22:34:34.554 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-08-18T22:34:34.554 INFO:teuthology.orchestra.run.smithi195.stdout:{"epoch":1,"fsid":"b003123a-5db1-11ef-bccf-c7b262605968","modified":"2024-08-18T22:32:38.034362Z","created":"2024-08-18T22:32:38.034362Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi121","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:3300","nonce":0},{"type":"v1","addr":"172.21.15.121:6789","nonce":0}]},"addr":"172.21.15.121:6789/0","public_addr":"172.21.15.121:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-08-18T22:34:34.554 INFO:teuthology.orchestra.run.smithi195.stderr:dumped monmap epoch 1 2024-08-18T22:34:34.557 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:34.554+0000 7f305e9e9640 1 -- 172.21.15.195:0/3803147071 >> [v2:172.21.15.121:6800/1740603058,v1:172.21.15.121:6801/1740603058] conn(0x7f3040035800 msgr2=0x7f3040037cb0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-18T22:34:34.557 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:34.554+0000 7f305e9e9640 1 --2- 172.21.15.195:0/3803147071 >> [v2:172.21.15.121:6800/1740603058,v1:172.21.15.121:6801/1740603058] conn(0x7f3040035800 0x7f3040037cb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:34.557 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:34.554+0000 7f305e9e9640 1 -- 172.21.15.195:0/3803147071 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f30580653f0 msgr2=0x7f305810c6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:34:34.557 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:34.554+0000 7f305e9e9640 1 --2- 172.21.15.195:0/3803147071 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f30580653f0 0x7f305810c6e0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f304802a6d0 tx=0x7f3048009da0 comp rx=0 tx=0).stop 2024-08-18T22:34:34.558 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:34.554+0000 7f305e9e9640 1 -- 172.21.15.195:0/3803147071 shutdown_connections 2024-08-18T22:34:34.558 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:34.554+0000 7f305e9e9640 1 --2- 172.21.15.195:0/3803147071 >> [v2:172.21.15.121:6800/1740603058,v1:172.21.15.121:6801/1740603058] conn(0x7f3040035800 0x7f3040037cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:34.558 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:34.554+0000 7f305e9e9640 1 --2- 172.21.15.195:0/3803147071 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f30580653f0 0x7f305810c6e0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:34.558 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:34.554+0000 7f305e9e9640 1 -- 172.21.15.195:0/3803147071 >> 172.21.15.195:0/3803147071 conn(0x7f30580f6860 msgr2=0x7f30580f70f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:34:34.558 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:34.555+0000 7f305e9e9640 1 -- 172.21.15.195:0/3803147071 shutdown_connections 2024-08-18T22:34:34.558 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:34.555+0000 7f305e9e9640 1 -- 172.21.15.195:0/3803147071 wait complete. 2024-08-18T22:34:35.422 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:34:35 smithi121 ceph-mon[16788]: from='mgr.14160 172.21.15.121:0/261891242' entity='mgr.smithi121.lopxqc' cmd='[{"prefix": "mgr module enable", "module": "prometheus"}]': finished 2024-08-18T22:34:35.422 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:34:35 smithi121 ceph-mon[16788]: mgrmap e14: smithi121.lopxqc(active, since 56s) 2024-08-18T22:34:35.422 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:34:35 smithi121 ceph-mon[16788]: from='client.? 172.21.15.195:0/3803147071' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-08-18T22:34:36.134 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-08-18T22:34:36.135 DEBUG:teuthology.orchestra.run.smithi195:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b003123a-5db1-11ef-bccf-c7b262605968 -- ceph mon dump -f json 2024-08-18T22:34:36.382 INFO:teuthology.orchestra.run.smithi195.stderr:Inferring config /etc/ceph/ceph.conf 2024-08-18T22:34:36.430 INFO:teuthology.orchestra.run.smithi195.stderr:Inferring config /etc/ceph/ceph.conf 2024-08-18T22:34:37.802 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:37.799+0000 7f07e2941640 1 -- 172.21.15.195:0/2077655262 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f07dc0fa3c0 msgr2=0x7f07dc0fa7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:34:37.803 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:37.799+0000 7f07e2941640 1 --2- 172.21.15.195:0/2077655262 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f07dc0fa3c0 0x7f07dc0fa7d0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f07cc004850 tx=0x7f07cc009da0 comp rx=0 tx=0).stop 2024-08-18T22:34:37.803 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:37.799+0000 7f07e2941640 1 -- 172.21.15.195:0/2077655262 shutdown_connections 2024-08-18T22:34:37.803 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:37.799+0000 7f07e2941640 1 --2- 172.21.15.195:0/2077655262 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f07dc0fa3c0 0x7f07dc0fa7d0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:37.803 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:37.799+0000 7f07e2941640 1 -- 172.21.15.195:0/2077655262 >> 172.21.15.195:0/2077655262 conn(0x7f07dc0f5de0 msgr2=0x7f07dc0f81f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:34:37.803 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:37.799+0000 7f07e2941640 1 -- 172.21.15.195:0/2077655262 shutdown_connections 2024-08-18T22:34:37.803 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:37.799+0000 7f07e2941640 1 -- 172.21.15.195:0/2077655262 wait complete. 2024-08-18T22:34:37.803 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:37.800+0000 7f07e2941640 1 Processor -- start 2024-08-18T22:34:37.803 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:37.800+0000 7f07e2941640 1 -- start start 2024-08-18T22:34:37.803 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:37.800+0000 7f07e2941640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f07dc0fa3c0 0x7f07dc10c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:34:37.803 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:37.800+0000 7f07e2941640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07dc10c9c0 con 0x7f07dc0fa3c0 2024-08-18T22:34:37.803 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:37.800+0000 7f07dbfff640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f07dc0fa3c0 0x7f07dc10c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:34:37.804 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:37.800+0000 7f07dbfff640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f07dc0fa3c0 0x7f07dc10c480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.195:40642/0 (socket says 172.21.15.195:40642) 2024-08-18T22:34:37.804 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:37.800+0000 7f07dbfff640 1 -- 172.21.15.195:0/2357213256 learned_addr learned my addr 172.21.15.195:0/2357213256 (peer_addr_for_me v2:172.21.15.195:0/0) 2024-08-18T22:34:37.804 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:37.801+0000 7f07dbfff640 1 -- 172.21.15.195:0/2357213256 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07cc005040 con 0x7f07dc0fa3c0 2024-08-18T22:34:37.804 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:37.801+0000 7f07dbfff640 1 --2- 172.21.15.195:0/2357213256 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f07dc0fa3c0 0x7f07dc10c480 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f07cc02a6d0 tx=0x7f07cc009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:34:37.804 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:37.801+0000 7f07d8ff9640 1 -- 172.21.15.195:0/2357213256 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f07cc033630 con 0x7f07dc0fa3c0 2024-08-18T22:34:37.804 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:37.801+0000 7f07d8ff9640 1 -- 172.21.15.195:0/2357213256 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f07cc033c30 con 0x7f07dc0fa3c0 2024-08-18T22:34:37.804 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:37.801+0000 7f07e2941640 1 -- 172.21.15.195:0/2357213256 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07dc10cbc0 con 0x7f07dc0fa3c0 2024-08-18T22:34:37.804 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:37.801+0000 7f07d8ff9640 1 -- 172.21.15.195:0/2357213256 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f07cc03dc00 con 0x7f07dc0fa3c0 2024-08-18T22:34:37.804 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:37.801+0000 7f07e2941640 1 -- 172.21.15.195:0/2357213256 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07dc10d030 con 0x7f07dc0fa3c0 2024-08-18T22:34:37.805 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:37.802+0000 7f07d8ff9640 1 -- 172.21.15.195:0/2357213256 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 14) v1 ==== 42707+0+0 (secure 0 0 0) 0x7f07cc030020 con 0x7f07dc0fa3c0 2024-08-18T22:34:37.805 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:37.802+0000 7f07e2941640 1 -- 172.21.15.195:0/2357213256 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07dc05eb10 con 0x7f07dc0fa3c0 2024-08-18T22:34:37.805 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:37.802+0000 7f07d8ff9640 1 --2- 172.21.15.195:0/2357213256 >> [v2:172.21.15.121:6800/1740603058,v1:172.21.15.121:6801/1740603058] conn(0x7f07c4035850 0x7f07c4037d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:34:37.805 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:37.802+0000 7f07d8ff9640 1 -- 172.21.15.195:0/2357213256 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f07cc067f20 con 0x7f07dc0fa3c0 2024-08-18T22:34:37.805 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:37.802+0000 7f07db7fe640 1 -- 172.21.15.195:0/2357213256 >> [v2:172.21.15.121:6800/1740603058,v1:172.21.15.121:6801/1740603058] conn(0x7f07c4035850 msgr2=0x7f07c4037d00 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.121:6800/1740603058 2024-08-18T22:34:37.805 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:37.802+0000 7f07db7fe640 1 --2- 172.21.15.195:0/2357213256 >> [v2:172.21.15.121:6800/1740603058,v1:172.21.15.121:6801/1740603058] conn(0x7f07c4035850 0x7f07c4037d00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-18T22:34:37.807 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:37.807+0000 7f07d8ff9640 1 -- 172.21.15.195:0/2357213256 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f07cc033790 con 0x7f07dc0fa3c0 2024-08-18T22:34:38.004 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:38.003+0000 7f07db7fe640 1 -- 172.21.15.195:0/2357213256 >> [v2:172.21.15.121:6800/1740603058,v1:172.21.15.121:6801/1740603058] conn(0x7f07c4035850 msgr2=0x7f07c4037d00 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.121:6800/1740603058 2024-08-18T22:34:38.004 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:38.003+0000 7f07db7fe640 1 --2- 172.21.15.195:0/2357213256 >> [v2:172.21.15.121:6800/1740603058,v1:172.21.15.121:6801/1740603058] conn(0x7f07c4035850 0x7f07c4037d00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-18T22:34:38.022 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:38.021+0000 7f07e2941640 1 -- 172.21.15.195:0/2357213256 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f07dc04b4c0 con 0x7f07dc0fa3c0 2024-08-18T22:34:38.023 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:38.021+0000 7f07d8ff9640 1 -- 172.21.15.195:0/2357213256 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+743 (secure 0 0 0) 0x7f07cc045390 con 0x7f07dc0fa3c0 2024-08-18T22:34:38.023 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-08-18T22:34:38.023 INFO:teuthology.orchestra.run.smithi195.stdout:{"epoch":1,"fsid":"b003123a-5db1-11ef-bccf-c7b262605968","modified":"2024-08-18T22:32:38.034362Z","created":"2024-08-18T22:32:38.034362Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi121","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:3300","nonce":0},{"type":"v1","addr":"172.21.15.121:6789","nonce":0}]},"addr":"172.21.15.121:6789/0","public_addr":"172.21.15.121:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-08-18T22:34:38.024 INFO:teuthology.orchestra.run.smithi195.stderr:dumped monmap epoch 1 2024-08-18T22:34:38.024 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:38.023+0000 7f07e2941640 1 -- 172.21.15.195:0/2357213256 >> [v2:172.21.15.121:6800/1740603058,v1:172.21.15.121:6801/1740603058] conn(0x7f07c4035850 msgr2=0x7f07c4037d00 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-18T22:34:38.025 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:38.023+0000 7f07e2941640 1 --2- 172.21.15.195:0/2357213256 >> [v2:172.21.15.121:6800/1740603058,v1:172.21.15.121:6801/1740603058] conn(0x7f07c4035850 0x7f07c4037d00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:38.025 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:38.023+0000 7f07e2941640 1 -- 172.21.15.195:0/2357213256 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f07dc0fa3c0 msgr2=0x7f07dc10c480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:34:38.025 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:38.023+0000 7f07e2941640 1 --2- 172.21.15.195:0/2357213256 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f07dc0fa3c0 0x7f07dc10c480 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f07cc02a6d0 tx=0x7f07cc009da0 comp rx=0 tx=0).stop 2024-08-18T22:34:38.025 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:38.023+0000 7f07e2941640 1 -- 172.21.15.195:0/2357213256 shutdown_connections 2024-08-18T22:34:38.025 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:38.023+0000 7f07e2941640 1 --2- 172.21.15.195:0/2357213256 >> [v2:172.21.15.121:6800/1740603058,v1:172.21.15.121:6801/1740603058] conn(0x7f07c4035850 0x7f07c4037d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:38.025 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:38.023+0000 7f07e2941640 1 --2- 172.21.15.195:0/2357213256 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f07dc0fa3c0 0x7f07dc10c480 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:38.025 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:38.023+0000 7f07e2941640 1 -- 172.21.15.195:0/2357213256 >> 172.21.15.195:0/2357213256 conn(0x7f07dc0f5de0 msgr2=0x7f07dc0f65d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:34:38.025 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:38.023+0000 7f07e2941640 1 -- 172.21.15.195:0/2357213256 shutdown_connections 2024-08-18T22:34:38.025 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:38.023+0000 7f07e2941640 1 -- 172.21.15.195:0/2357213256 wait complete. 2024-08-18T22:34:38.333 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:34:38 smithi121 ceph-mon[16788]: from='client.? 172.21.15.195:0/2357213256' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-08-18T22:34:39.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:34:39 smithi121 ceph-mon[16788]: Active manager daemon smithi121.lopxqc restarted 2024-08-18T22:34:39.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:34:39 smithi121 ceph-mon[16788]: Activating manager daemon smithi121.lopxqc 2024-08-18T22:34:39.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:34:39 smithi121 ceph-mon[16788]: osdmap e5: 0 total, 0 up, 0 in 2024-08-18T22:34:39.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:34:39 smithi121 ceph-mon[16788]: mgrmap e15: smithi121.lopxqc(active, starting, since 0.00813549s) 2024-08-18T22:34:39.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:34:39 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "mon metadata", "id": "smithi121"}]: dispatch 2024-08-18T22:34:39.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:34:39 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "mgr metadata", "who": "smithi121.lopxqc", "id": "smithi121.lopxqc"}]: dispatch 2024-08-18T22:34:39.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:34:39 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-08-18T22:34:39.085 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:34:39 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-08-18T22:34:39.085 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:34:39 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-08-18T22:34:39.085 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:34:39 smithi121 ceph-mon[16788]: Manager daemon smithi121.lopxqc is now available 2024-08-18T22:34:39.085 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:34:39 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-18T22:34:39.085 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:34:39 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:34:39.085 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:34:39 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-18T22:34:39.085 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:34:39 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi121.lopxqc/mirror_snapshot_schedule"}]: dispatch 2024-08-18T22:34:39.085 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:34:39 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi121.lopxqc/trash_purge_schedule"}]: dispatch 2024-08-18T22:34:39.620 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-08-18T22:34:39.621 DEBUG:teuthology.orchestra.run.smithi195:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b003123a-5db1-11ef-bccf-c7b262605968 -- ceph mon dump -f json 2024-08-18T22:34:39.871 INFO:teuthology.orchestra.run.smithi195.stderr:Inferring config /etc/ceph/ceph.conf 2024-08-18T22:34:39.919 INFO:teuthology.orchestra.run.smithi195.stderr:Inferring config /etc/ceph/ceph.conf 2024-08-18T22:34:40.584 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:34:40 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:34:40.584 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:34:40 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:34:40.584 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:34:40 smithi121 ceph-mon[16788]: mgrmap e16: smithi121.lopxqc(active, since 1.00783s) 2024-08-18T22:34:40.584 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:34:40 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:34:40.584 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:34:40 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:34:41.484 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:41.482+0000 7f752bec3640 1 -- 172.21.15.195:0/1323864183 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f75240faf00 msgr2=0x7f75240fb310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:34:41.484 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:41.482+0000 7f752bec3640 1 --2- 172.21.15.195:0/1323864183 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f75240faf00 0x7f75240fb310 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f751c009bd0 tx=0x7f751c004d10 comp rx=0 tx=0).stop 2024-08-18T22:34:41.484 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:41.482+0000 7f752bec3640 1 -- 172.21.15.195:0/1323864183 shutdown_connections 2024-08-18T22:34:41.485 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:41.482+0000 7f752bec3640 1 --2- 172.21.15.195:0/1323864183 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f75240faf00 0x7f75240fb310 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:41.485 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:41.482+0000 7f752bec3640 1 -- 172.21.15.195:0/1323864183 >> 172.21.15.195:0/1323864183 conn(0x7f75240f6620 msgr2=0x7f75240f8a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:34:41.485 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:41.482+0000 7f752bec3640 1 -- 172.21.15.195:0/1323864183 shutdown_connections 2024-08-18T22:34:41.485 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:41.482+0000 7f752bec3640 1 -- 172.21.15.195:0/1323864183 wait complete. 2024-08-18T22:34:41.485 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:41.482+0000 7f752bec3640 1 Processor -- start 2024-08-18T22:34:41.485 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:41.482+0000 7f752bec3640 1 -- start start 2024-08-18T22:34:41.485 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:41.482+0000 7f752bec3640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f75240faf00 0x7f7524065de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:34:41.485 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:41.482+0000 7f752bec3640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f752410f1d0 con 0x7f75240faf00 2024-08-18T22:34:41.485 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:41.483+0000 7f7529c5f640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f75240faf00 0x7f7524065de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:34:41.485 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:41.483+0000 7f7529c5f640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f75240faf00 0x7f7524065de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.195:54548/0 (socket says 172.21.15.195:54548) 2024-08-18T22:34:41.485 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:41.483+0000 7f7529c5f640 1 -- 172.21.15.195:0/2109099986 learned_addr learned my addr 172.21.15.195:0/2109099986 (peer_addr_for_me v2:172.21.15.195:0/0) 2024-08-18T22:34:41.485 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:41.483+0000 7f7529c5f640 1 -- 172.21.15.195:0/2109099986 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f751c0098b0 con 0x7f75240faf00 2024-08-18T22:34:41.485 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:41.483+0000 7f7529c5f640 1 --2- 172.21.15.195:0/2109099986 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f75240faf00 0x7f7524065de0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f751c003400 tx=0x7f751c004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:34:41.486 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:41.483+0000 7f75227fc640 1 -- 172.21.15.195:0/2109099986 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f751c032910 con 0x7f75240faf00 2024-08-18T22:34:41.486 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:41.483+0000 7f75227fc640 1 -- 172.21.15.195:0/2109099986 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f751c03d420 con 0x7f75240faf00 2024-08-18T22:34:41.486 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:41.483+0000 7f752bec3640 1 -- 172.21.15.195:0/2109099986 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f752410f310 con 0x7f75240faf00 2024-08-18T22:34:41.486 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:41.483+0000 7f75227fc640 1 -- 172.21.15.195:0/2109099986 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f751c031590 con 0x7f75240faf00 2024-08-18T22:34:41.486 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:41.483+0000 7f752bec3640 1 -- 172.21.15.195:0/2109099986 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f752410f780 con 0x7f75240faf00 2024-08-18T22:34:41.487 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:41.484+0000 7f75227fc640 1 -- 172.21.15.195:0/2109099986 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 17) v1 ==== 42751+0+0 (secure 0 0 0) 0x7f751c02f030 con 0x7f75240faf00 2024-08-18T22:34:41.487 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:41.484+0000 7f752bec3640 1 -- 172.21.15.195:0/2109099986 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f752405eb10 con 0x7f75240faf00 2024-08-18T22:34:41.487 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:41.484+0000 7f75227fc640 1 --2- 172.21.15.195:0/2109099986 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7f750c0358a0 0x7f750c037d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:34:41.487 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:41.484+0000 7f75227fc640 1 -- 172.21.15.195:0/2109099986 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7f751c068ea0 con 0x7f75240faf00 2024-08-18T22:34:41.487 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:41.484+0000 7f752945e640 1 --2- 172.21.15.195:0/2109099986 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7f750c0358a0 0x7f750c037d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:34:41.487 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:41.485+0000 7f752945e640 1 --2- 172.21.15.195:0/2109099986 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7f750c0358a0 0x7f750c037d50 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f7518006fd0 tx=0x7f7518006db0 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:34:41.490 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:41.489+0000 7f75227fc640 1 -- 172.21.15.195:0/2109099986 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f751c04e530 con 0x7f75240faf00 2024-08-18T22:34:41.493 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:34:41 smithi121 ceph-mon[16788]: [18/Aug/2024:22:34:39] ENGINE Bus STARTING 2024-08-18T22:34:41.493 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:34:41 smithi121 ceph-mon[16788]: [18/Aug/2024:22:34:39] ENGINE Serving on https://172.21.15.121:7150 2024-08-18T22:34:41.493 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:34:41 smithi121 ceph-mon[16788]: [18/Aug/2024:22:34:39] ENGINE Bus STARTED 2024-08-18T22:34:41.493 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:34:41 smithi121 ceph-mon[16788]: [18/Aug/2024:22:34:39] ENGINE Error in HTTPServer.serve 2024-08-18T22:34:41.493 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout: Traceback (most recent call last): 2024-08-18T22:34:41.493 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-08-18T22:34:41.493 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout: self._connections.run(self.expiration_interval) 2024-08-18T22:34:41.493 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-08-18T22:34:41.494 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout: self._run(expiration_interval) 2024-08-18T22:34:41.494 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-08-18T22:34:41.494 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-08-18T22:34:41.494 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-08-18T22:34:41.494 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-08-18T22:34:41.494 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-08-18T22:34:41.494 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout: s = self.context.wrap_socket( 2024-08-18T22:34:41.494 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-08-18T22:34:41.494 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout: return self.sslsocket_class._create( 2024-08-18T22:34:41.494 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-08-18T22:34:41.494 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout: self.do_handshake() 2024-08-18T22:34:41.494 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-08-18T22:34:41.494 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout: self._sslobj.do_handshake() 2024-08-18T22:34:41.495 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-08-18T22:34:41.712 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:41.711+0000 7f752bec3640 1 -- 172.21.15.195:0/2109099986 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f752404b4c0 con 0x7f75240faf00 2024-08-18T22:34:41.712 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:41.712+0000 7f75227fc640 1 -- 172.21.15.195:0/2109099986 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+743 (secure 0 0 0) 0x7f751c04e350 con 0x7f75240faf00 2024-08-18T22:34:41.713 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-08-18T22:34:41.713 INFO:teuthology.orchestra.run.smithi195.stdout:{"epoch":1,"fsid":"b003123a-5db1-11ef-bccf-c7b262605968","modified":"2024-08-18T22:32:38.034362Z","created":"2024-08-18T22:32:38.034362Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi121","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:3300","nonce":0},{"type":"v1","addr":"172.21.15.121:6789","nonce":0}]},"addr":"172.21.15.121:6789/0","public_addr":"172.21.15.121:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-08-18T22:34:41.713 INFO:teuthology.orchestra.run.smithi195.stderr:dumped monmap epoch 1 2024-08-18T22:34:41.715 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:41.713+0000 7f752bec3640 1 -- 172.21.15.195:0/2109099986 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7f750c0358a0 msgr2=0x7f750c037d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:34:41.715 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:41.713+0000 7f752bec3640 1 --2- 172.21.15.195:0/2109099986 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7f750c0358a0 0x7f750c037d50 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f7518006fd0 tx=0x7f7518006db0 comp rx=0 tx=0).stop 2024-08-18T22:34:41.715 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:41.713+0000 7f752bec3640 1 -- 172.21.15.195:0/2109099986 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f75240faf00 msgr2=0x7f7524065de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:34:41.715 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:41.713+0000 7f752bec3640 1 --2- 172.21.15.195:0/2109099986 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f75240faf00 0x7f7524065de0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f751c003400 tx=0x7f751c004d10 comp rx=0 tx=0).stop 2024-08-18T22:34:41.715 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:41.713+0000 7f752bec3640 1 -- 172.21.15.195:0/2109099986 shutdown_connections 2024-08-18T22:34:41.715 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:41.713+0000 7f752bec3640 1 --2- 172.21.15.195:0/2109099986 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7f750c0358a0 0x7f750c037d50 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:41.715 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:41.713+0000 7f752bec3640 1 --2- 172.21.15.195:0/2109099986 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f75240faf00 0x7f7524065de0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:41.716 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:41.714+0000 7f752bec3640 1 -- 172.21.15.195:0/2109099986 >> 172.21.15.195:0/2109099986 conn(0x7f75240f6620 msgr2=0x7f75240f6e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:34:41.716 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:41.714+0000 7f752bec3640 1 -- 172.21.15.195:0/2109099986 shutdown_connections 2024-08-18T22:34:41.716 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:41.714+0000 7f752bec3640 1 -- 172.21.15.195:0/2109099986 wait complete. 2024-08-18T22:34:42.333 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:34:42 smithi121 ceph-mon[16788]: mgrmap e17: smithi121.lopxqc(active, since 2s) 2024-08-18T22:34:42.334 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:34:42 smithi121 ceph-mon[16788]: from='client.? 172.21.15.195:0/2109099986' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-08-18T22:34:43.606 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-08-18T22:34:43.607 DEBUG:teuthology.orchestra.run.smithi195:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b003123a-5db1-11ef-bccf-c7b262605968 -- ceph mon dump -f json 2024-08-18T22:34:43.833 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:34:43 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:34:43.834 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:34:43 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:34:43.834 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:34:43 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:34:43.834 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:34:43 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:34:43.834 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:34:43 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config rm", "who": "osd/host:smithi121", "name": "osd_memory_target"}]: dispatch 2024-08-18T22:34:44.251 INFO:teuthology.orchestra.run.smithi195.stderr:Inferring config /etc/ceph/ceph.conf 2024-08-18T22:34:44.300 INFO:teuthology.orchestra.run.smithi195.stderr:Inferring config /etc/ceph/ceph.conf 2024-08-18T22:34:45.584 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:34:45 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:34:45.584 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:34:45 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:34:45.584 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:34:45 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:34:45.584 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:34:45 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:34:45.584 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:34:45 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config rm", "who": "osd/host:smithi195", "name": "osd_memory_target"}]: dispatch 2024-08-18T22:34:45.584 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:34:45 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:34:45.584 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:34:45 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-18T22:34:45.584 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:34:45 smithi121 ceph-mon[16788]: Updating smithi121:/etc/ceph/ceph.conf 2024-08-18T22:34:45.584 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:34:45 smithi121 ceph-mon[16788]: Updating smithi195:/etc/ceph/ceph.conf 2024-08-18T22:34:45.584 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:34:45 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:34:45.585 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:34:45 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:34:45.585 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:34:45 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:34:45.585 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:34:45 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:34:45.585 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:34:45 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:34:45.585 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:34:45 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi195", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-08-18T22:34:45.585 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:34:45 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd='[{"prefix": "auth get-or-create", "entity": "client.crash.smithi195", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]': finished 2024-08-18T22:34:45.585 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:34:45 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:34:45.851 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:45.848+0000 7f4185b65640 1 -- 172.21.15.195:0/933806931 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4180100e70 msgr2=0x7f4180101240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:34:45.851 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:45.848+0000 7f4185b65640 1 --2- 172.21.15.195:0/933806931 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4180100e70 0x7f4180101240 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f4170004850 tx=0x7f4170009da0 comp rx=0 tx=0).stop 2024-08-18T22:34:45.851 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:45.849+0000 7f4185b65640 1 -- 172.21.15.195:0/933806931 shutdown_connections 2024-08-18T22:34:45.851 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:45.849+0000 7f4185b65640 1 --2- 172.21.15.195:0/933806931 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4180100e70 0x7f4180101240 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:45.851 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:45.849+0000 7f4185b65640 1 -- 172.21.15.195:0/933806931 >> 172.21.15.195:0/933806931 conn(0x7f41800f6a40 msgr2=0x7f41800f8e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:34:45.851 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:45.849+0000 7f4185b65640 1 -- 172.21.15.195:0/933806931 shutdown_connections 2024-08-18T22:34:45.851 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:45.849+0000 7f4185b65640 1 -- 172.21.15.195:0/933806931 wait complete. 2024-08-18T22:34:45.851 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:45.849+0000 7f4185b65640 1 Processor -- start 2024-08-18T22:34:45.851 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:45.849+0000 7f4185b65640 1 -- start start 2024-08-18T22:34:45.851 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:45.849+0000 7f4185b65640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4180100e70 0x7f4180111410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:34:45.852 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:45.849+0000 7f4185b65640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4180111950 con 0x7f4180100e70 2024-08-18T22:34:45.852 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:45.850+0000 7f417f7fe640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4180100e70 0x7f4180111410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:34:45.852 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:45.850+0000 7f417f7fe640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4180100e70 0x7f4180111410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.195:54564/0 (socket says 172.21.15.195:54564) 2024-08-18T22:34:45.852 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:45.850+0000 7f417f7fe640 1 -- 172.21.15.195:0/3076438326 learned_addr learned my addr 172.21.15.195:0/3076438326 (peer_addr_for_me v2:172.21.15.195:0/0) 2024-08-18T22:34:45.852 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:45.850+0000 7f417f7fe640 1 -- 172.21.15.195:0/3076438326 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4170005040 con 0x7f4180100e70 2024-08-18T22:34:45.853 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:45.850+0000 7f417f7fe640 1 --2- 172.21.15.195:0/3076438326 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4180100e70 0x7f4180111410 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f4170004820 tx=0x7f4170009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:34:45.853 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:45.850+0000 7f4177fff640 1 -- 172.21.15.195:0/3076438326 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4170033630 con 0x7f4180100e70 2024-08-18T22:34:45.853 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:45.850+0000 7f4177fff640 1 -- 172.21.15.195:0/3076438326 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f4170033c30 con 0x7f4180100e70 2024-08-18T22:34:45.853 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:45.850+0000 7f4185b65640 1 -- 172.21.15.195:0/3076438326 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4180111b50 con 0x7f4180100e70 2024-08-18T22:34:45.854 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:45.850+0000 7f4177fff640 1 -- 172.21.15.195:0/3076438326 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f417003dcc0 con 0x7f4180100e70 2024-08-18T22:34:45.854 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:45.850+0000 7f4185b65640 1 -- 172.21.15.195:0/3076438326 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4180111fc0 con 0x7f4180100e70 2024-08-18T22:34:45.854 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:45.851+0000 7f4177fff640 1 -- 172.21.15.195:0/3076438326 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 17) v1 ==== 42751+0+0 (secure 0 0 0) 0x7f4170030020 con 0x7f4180100e70 2024-08-18T22:34:45.854 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:45.851+0000 7f4185b65640 1 -- 172.21.15.195:0/3076438326 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41800fc5e0 con 0x7f4180100e70 2024-08-18T22:34:45.854 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:45.851+0000 7f4177fff640 1 --2- 172.21.15.195:0/3076438326 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7f416c0358a0 0x7f416c037d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:34:45.854 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:45.851+0000 7f4177fff640 1 -- 172.21.15.195:0/3076438326 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7f4170068260 con 0x7f4180100e70 2024-08-18T22:34:45.854 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:45.852+0000 7f417effd640 1 --2- 172.21.15.195:0/3076438326 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7f416c0358a0 0x7f416c037d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:34:45.854 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:45.852+0000 7f417effd640 1 --2- 172.21.15.195:0/3076438326 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7f416c0358a0 0x7f416c037d50 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f4168006fd0 tx=0x7f4168006db0 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:34:45.857 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:45.856+0000 7f4177fff640 1 -- 172.21.15.195:0/3076438326 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f417003b730 con 0x7f4180100e70 2024-08-18T22:34:46.076 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:46.075+0000 7f4185b65640 1 -- 172.21.15.195:0/3076438326 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f418005eb10 con 0x7f4180100e70 2024-08-18T22:34:46.077 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:46.076+0000 7f4177fff640 1 -- 172.21.15.195:0/3076438326 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+743 (secure 0 0 0) 0x7f4170044560 con 0x7f4180100e70 2024-08-18T22:34:46.077 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-08-18T22:34:46.077 INFO:teuthology.orchestra.run.smithi195.stdout:{"epoch":1,"fsid":"b003123a-5db1-11ef-bccf-c7b262605968","modified":"2024-08-18T22:32:38.034362Z","created":"2024-08-18T22:32:38.034362Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi121","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:3300","nonce":0},{"type":"v1","addr":"172.21.15.121:6789","nonce":0}]},"addr":"172.21.15.121:6789/0","public_addr":"172.21.15.121:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-08-18T22:34:46.077 INFO:teuthology.orchestra.run.smithi195.stderr:dumped monmap epoch 1 2024-08-18T22:34:46.079 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:46.077+0000 7f4185b65640 1 -- 172.21.15.195:0/3076438326 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7f416c0358a0 msgr2=0x7f416c037d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:34:46.079 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:46.077+0000 7f4185b65640 1 --2- 172.21.15.195:0/3076438326 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7f416c0358a0 0x7f416c037d50 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f4168006fd0 tx=0x7f4168006db0 comp rx=0 tx=0).stop 2024-08-18T22:34:46.079 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:46.077+0000 7f4185b65640 1 -- 172.21.15.195:0/3076438326 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4180100e70 msgr2=0x7f4180111410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:34:46.079 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:46.077+0000 7f4185b65640 1 --2- 172.21.15.195:0/3076438326 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4180100e70 0x7f4180111410 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f4170004820 tx=0x7f4170009da0 comp rx=0 tx=0).stop 2024-08-18T22:34:46.079 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:46.077+0000 7f4185b65640 1 -- 172.21.15.195:0/3076438326 shutdown_connections 2024-08-18T22:34:46.079 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:46.077+0000 7f4185b65640 1 --2- 172.21.15.195:0/3076438326 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7f416c0358a0 0x7f416c037d50 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:46.079 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:46.077+0000 7f4185b65640 1 --2- 172.21.15.195:0/3076438326 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4180100e70 0x7f4180111410 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:46.079 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:46.077+0000 7f4185b65640 1 -- 172.21.15.195:0/3076438326 >> 172.21.15.195:0/3076438326 conn(0x7f41800f6a40 msgr2=0x7f41800f82b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:34:46.080 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:46.078+0000 7f4185b65640 1 -- 172.21.15.195:0/3076438326 shutdown_connections 2024-08-18T22:34:46.080 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:46.078+0000 7f4185b65640 1 -- 172.21.15.195:0/3076438326 wait complete. 2024-08-18T22:34:46.583 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:34:46 smithi121 ceph-mon[16788]: Updating smithi195:/var/lib/ceph/b003123a-5db1-11ef-bccf-c7b262605968/config/ceph.conf 2024-08-18T22:34:46.583 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:34:46 smithi121 ceph-mon[16788]: Updating smithi121:/var/lib/ceph/b003123a-5db1-11ef-bccf-c7b262605968/config/ceph.conf 2024-08-18T22:34:46.584 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:34:46 smithi121 ceph-mon[16788]: Updating smithi195:/etc/ceph/ceph.client.admin.keyring 2024-08-18T22:34:46.584 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:34:46 smithi121 ceph-mon[16788]: Updating smithi121:/etc/ceph/ceph.client.admin.keyring 2024-08-18T22:34:46.584 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:34:46 smithi121 ceph-mon[16788]: Updating smithi195:/var/lib/ceph/b003123a-5db1-11ef-bccf-c7b262605968/config/ceph.client.admin.keyring 2024-08-18T22:34:46.584 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:34:46 smithi121 ceph-mon[16788]: Updating smithi121:/var/lib/ceph/b003123a-5db1-11ef-bccf-c7b262605968/config/ceph.client.admin.keyring 2024-08-18T22:34:46.584 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:34:46 smithi121 ceph-mon[16788]: Deploying daemon crash.smithi195 on smithi195 2024-08-18T22:34:46.584 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:34:46 smithi121 ceph-mon[16788]: from='client.? 172.21.15.195:0/3076438326' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-08-18T22:34:47.866 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-08-18T22:34:47.866 DEBUG:teuthology.orchestra.run.smithi195:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b003123a-5db1-11ef-bccf-c7b262605968 -- ceph mon dump -f json 2024-08-18T22:34:48.235 INFO:teuthology.orchestra.run.smithi195.stderr:Inferring config /var/lib/ceph/b003123a-5db1-11ef-bccf-c7b262605968/config/ceph.conf 2024-08-18T22:34:49.740 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:49.725+0000 7feb11286640 1 -- 172.21.15.195:0/3606167198 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7feb0c100e80 msgr2=0x7feb0c101250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:34:49.741 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:49.725+0000 7feb11286640 1 --2- 172.21.15.195:0/3606167198 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7feb0c100e80 0x7feb0c101250 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7feafc004850 tx=0x7feafc009da0 comp rx=0 tx=0).stop 2024-08-18T22:34:49.741 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:49.725+0000 7feb11286640 1 -- 172.21.15.195:0/3606167198 shutdown_connections 2024-08-18T22:34:49.741 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:49.725+0000 7feb11286640 1 --2- 172.21.15.195:0/3606167198 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7feb0c100e80 0x7feb0c101250 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:49.741 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:49.725+0000 7feb11286640 1 -- 172.21.15.195:0/3606167198 >> 172.21.15.195:0/3606167198 conn(0x7feb0c0f6a90 msgr2=0x7feb0c0f8ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:34:49.741 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:49.725+0000 7feb11286640 1 -- 172.21.15.195:0/3606167198 shutdown_connections 2024-08-18T22:34:49.741 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:49.725+0000 7feb11286640 1 -- 172.21.15.195:0/3606167198 wait complete. 2024-08-18T22:34:49.741 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:49.726+0000 7feb11286640 1 Processor -- start 2024-08-18T22:34:49.741 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:49.726+0000 7feb11286640 1 -- start start 2024-08-18T22:34:49.742 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:49.726+0000 7feb11286640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7feb0c100e80 0x7feb0c112540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:34:49.742 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:49.726+0000 7feb11286640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb0c112a80 con 0x7feb0c100e80 2024-08-18T22:34:49.742 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:49.726+0000 7feb0affd640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7feb0c100e80 0x7feb0c112540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:34:49.742 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:49.726+0000 7feb0affd640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7feb0c100e80 0x7feb0c112540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.195:54576/0 (socket says 172.21.15.195:54576) 2024-08-18T22:34:49.742 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:49.726+0000 7feb0affd640 1 -- 172.21.15.195:0/553708240 learned_addr learned my addr 172.21.15.195:0/553708240 (peer_addr_for_me v2:172.21.15.195:0/0) 2024-08-18T22:34:49.742 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:49.726+0000 7feb0affd640 1 -- 172.21.15.195:0/553708240 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feafc005040 con 0x7feb0c100e80 2024-08-18T22:34:49.742 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:49.727+0000 7feb0affd640 1 --2- 172.21.15.195:0/553708240 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7feb0c100e80 0x7feb0c112540 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7feafc02a6d0 tx=0x7feafc009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:34:49.742 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:49.727+0000 7feaf37fe640 1 -- 172.21.15.195:0/553708240 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7feafc02cf10 con 0x7feb0c100e80 2024-08-18T22:34:49.742 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:49.727+0000 7feaf37fe640 1 -- 172.21.15.195:0/553708240 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7feafc033ad0 con 0x7feb0c100e80 2024-08-18T22:34:49.742 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:49.727+0000 7feb11286640 1 -- 172.21.15.195:0/553708240 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb0c112c80 con 0x7feb0c100e80 2024-08-18T22:34:49.742 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:49.727+0000 7feaf37fe640 1 -- 172.21.15.195:0/553708240 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7feafc03ebb0 con 0x7feb0c100e80 2024-08-18T22:34:49.743 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:49.727+0000 7feb11286640 1 -- 172.21.15.195:0/553708240 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb0c113150 con 0x7feb0c100e80 2024-08-18T22:34:49.743 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:49.728+0000 7feaf37fe640 1 -- 172.21.15.195:0/553708240 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 17) v1 ==== 42751+0+0 (secure 0 0 0) 0x7feafc030020 con 0x7feb0c100e80 2024-08-18T22:34:49.743 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:49.728+0000 7feb11286640 1 -- 172.21.15.195:0/553708240 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb0c0fc5f0 con 0x7feb0c100e80 2024-08-18T22:34:49.743 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:49.728+0000 7feaf37fe640 1 --2- 172.21.15.195:0/553708240 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7feaf40358a0 0x7feaf4037d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:34:49.743 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:49.728+0000 7feaf37fe640 1 -- 172.21.15.195:0/553708240 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7feafc067a90 con 0x7feb0c100e80 2024-08-18T22:34:49.743 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:49.728+0000 7feb0a7fc640 1 --2- 172.21.15.195:0/553708240 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7feaf40358a0 0x7feaf4037d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:34:49.743 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:49.729+0000 7feb0a7fc640 1 --2- 172.21.15.195:0/553708240 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7feaf40358a0 0x7feaf4037d50 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7feb00006fd0 tx=0x7feb00006db0 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:34:49.743 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:49.733+0000 7feaf37fe640 1 -- 172.21.15.195:0/553708240 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7feafc03c740 con 0x7feb0c100e80 2024-08-18T22:34:49.963 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:49.962+0000 7feb11286640 1 -- 172.21.15.195:0/553708240 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7feb0c113150 con 0x7feb0c100e80 2024-08-18T22:34:49.964 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:49.963+0000 7feaf37fe640 1 -- 172.21.15.195:0/553708240 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+743 (secure 0 0 0) 0x7feb0c113150 con 0x7feb0c100e80 2024-08-18T22:34:49.964 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-08-18T22:34:49.964 INFO:teuthology.orchestra.run.smithi195.stdout:{"epoch":1,"fsid":"b003123a-5db1-11ef-bccf-c7b262605968","modified":"2024-08-18T22:32:38.034362Z","created":"2024-08-18T22:32:38.034362Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi121","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:3300","nonce":0},{"type":"v1","addr":"172.21.15.121:6789","nonce":0}]},"addr":"172.21.15.121:6789/0","public_addr":"172.21.15.121:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-08-18T22:34:49.965 INFO:teuthology.orchestra.run.smithi195.stderr:dumped monmap epoch 1 2024-08-18T22:34:49.966 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:49.965+0000 7feb11286640 1 -- 172.21.15.195:0/553708240 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7feaf40358a0 msgr2=0x7feaf4037d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:34:49.966 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:49.965+0000 7feb11286640 1 --2- 172.21.15.195:0/553708240 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7feaf40358a0 0x7feaf4037d50 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7feb00006fd0 tx=0x7feb00006db0 comp rx=0 tx=0).stop 2024-08-18T22:34:49.966 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:49.965+0000 7feb11286640 1 -- 172.21.15.195:0/553708240 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7feb0c100e80 msgr2=0x7feb0c112540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:34:49.966 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:49.965+0000 7feb11286640 1 --2- 172.21.15.195:0/553708240 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7feb0c100e80 0x7feb0c112540 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7feafc02a6d0 tx=0x7feafc009da0 comp rx=0 tx=0).stop 2024-08-18T22:34:49.966 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:49.965+0000 7feb11286640 1 -- 172.21.15.195:0/553708240 shutdown_connections 2024-08-18T22:34:49.967 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:49.965+0000 7feb11286640 1 --2- 172.21.15.195:0/553708240 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7feaf40358a0 0x7feaf4037d50 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:49.967 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:49.965+0000 7feb11286640 1 --2- 172.21.15.195:0/553708240 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7feb0c100e80 0x7feb0c112540 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:49.967 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:49.965+0000 7feb11286640 1 -- 172.21.15.195:0/553708240 >> 172.21.15.195:0/553708240 conn(0x7feb0c0f6a90 msgr2=0x7feb0c0655a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:34:49.967 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:49.965+0000 7feb11286640 1 -- 172.21.15.195:0/553708240 shutdown_connections 2024-08-18T22:34:49.967 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:49.965+0000 7feb11286640 1 -- 172.21.15.195:0/553708240 wait complete. 2024-08-18T22:34:50.334 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:34:50 smithi121 ceph-mon[16788]: from='client.? 172.21.15.195:0/553708240' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-08-18T22:34:51.604 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-08-18T22:34:51.604 DEBUG:teuthology.orchestra.run.smithi195:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b003123a-5db1-11ef-bccf-c7b262605968 -- ceph mon dump -f json 2024-08-18T22:34:51.872 INFO:teuthology.orchestra.run.smithi195.stderr:Inferring config /var/lib/ceph/b003123a-5db1-11ef-bccf-c7b262605968/config/ceph.conf 2024-08-18T22:34:52.333 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:34:51 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:34:52.334 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:34:51 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:34:52.334 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:34:51 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:34:52.334 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:34:51 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:34:52.334 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:34:51 smithi121 ceph-mon[16788]: Deploying daemon node-exporter.smithi195 on smithi195 2024-08-18T22:34:54.833 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:34:54 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:34:54.834 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:34:54 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-18T22:34:55.074 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:55.072+0000 7fec66e20640 1 -- 172.21.15.195:0/2638964131 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fec60100ea0 msgr2=0x7fec60101270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:34:55.074 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:55.072+0000 7fec66e20640 1 --2- 172.21.15.195:0/2638964131 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fec60100ea0 0x7fec60101270 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fec54004850 tx=0x7fec54009da0 comp rx=0 tx=0).stop 2024-08-18T22:34:55.074 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:55.072+0000 7fec66e20640 1 -- 172.21.15.195:0/2638964131 shutdown_connections 2024-08-18T22:34:55.074 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:55.072+0000 7fec66e20640 1 --2- 172.21.15.195:0/2638964131 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fec60100ea0 0x7fec60101270 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:55.074 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:55.072+0000 7fec66e20640 1 -- 172.21.15.195:0/2638964131 >> 172.21.15.195:0/2638964131 conn(0x7fec600f6a70 msgr2=0x7fec600f8e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:34:55.074 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:55.072+0000 7fec66e20640 1 -- 172.21.15.195:0/2638964131 shutdown_connections 2024-08-18T22:34:55.074 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:55.072+0000 7fec66e20640 1 -- 172.21.15.195:0/2638964131 wait complete. 2024-08-18T22:34:55.074 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:55.073+0000 7fec66e20640 1 Processor -- start 2024-08-18T22:34:55.075 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:55.073+0000 7fec66e20640 1 -- start start 2024-08-18T22:34:55.076 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:55.073+0000 7fec66e20640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fec60100ea0 0x7fec601125c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:34:55.076 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:55.073+0000 7fec66e20640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec60112b00 con 0x7fec60100ea0 2024-08-18T22:34:55.076 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:55.074+0000 7fec64bbc640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fec60100ea0 0x7fec601125c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:34:55.077 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:55.074+0000 7fec64bbc640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fec60100ea0 0x7fec601125c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.195:34140/0 (socket says 172.21.15.195:34140) 2024-08-18T22:34:55.077 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:55.074+0000 7fec64bbc640 1 -- 172.21.15.195:0/4148420736 learned_addr learned my addr 172.21.15.195:0/4148420736 (peer_addr_for_me v2:172.21.15.195:0/0) 2024-08-18T22:34:55.077 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:55.074+0000 7fec64bbc640 1 -- 172.21.15.195:0/4148420736 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec54005040 con 0x7fec60100ea0 2024-08-18T22:34:55.077 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:55.074+0000 7fec64bbc640 1 --2- 172.21.15.195:0/4148420736 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fec60100ea0 0x7fec601125c0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fec5402a6d0 tx=0x7fec54009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:34:55.077 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:55.074+0000 7fec5d7fa640 1 -- 172.21.15.195:0/4148420736 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fec5402cf10 con 0x7fec60100ea0 2024-08-18T22:34:55.077 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:55.074+0000 7fec66e20640 1 -- 172.21.15.195:0/4148420736 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec60112d00 con 0x7fec60100ea0 2024-08-18T22:34:55.077 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:55.074+0000 7fec5d7fa640 1 -- 172.21.15.195:0/4148420736 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fec54033ad0 con 0x7fec60100ea0 2024-08-18T22:34:55.077 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:55.074+0000 7fec5d7fa640 1 -- 172.21.15.195:0/4148420736 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fec5403ebb0 con 0x7fec60100ea0 2024-08-18T22:34:55.077 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:55.074+0000 7fec66e20640 1 -- 172.21.15.195:0/4148420736 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec60113150 con 0x7fec60100ea0 2024-08-18T22:34:55.077 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:55.075+0000 7fec5d7fa640 1 -- 172.21.15.195:0/4148420736 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 17) v1 ==== 42751+0+0 (secure 0 0 0) 0x7fec54030020 con 0x7fec60100ea0 2024-08-18T22:34:55.077 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:55.075+0000 7fec66e20640 1 -- 172.21.15.195:0/4148420736 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec600fc610 con 0x7fec60100ea0 2024-08-18T22:34:55.077 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:55.075+0000 7fec5d7fa640 1 --2- 172.21.15.195:0/4148420736 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7fec500358a0 0x7fec50037d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:34:55.077 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:55.075+0000 7fec5d7fa640 1 -- 172.21.15.195:0/4148420736 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7fec54067c30 con 0x7fec60100ea0 2024-08-18T22:34:55.077 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:55.075+0000 7fec5ffff640 1 --2- 172.21.15.195:0/4148420736 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7fec500358a0 0x7fec50037d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:34:55.078 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:55.076+0000 7fec5ffff640 1 --2- 172.21.15.195:0/4148420736 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7fec500358a0 0x7fec50037d50 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fec4c006fd0 tx=0x7fec4c006db0 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:34:55.081 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:55.080+0000 7fec5d7fa640 1 -- 172.21.15.195:0/4148420736 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fec5403c510 con 0x7fec60100ea0 2024-08-18T22:34:55.306 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:55.305+0000 7fec66e20640 1 -- 172.21.15.195:0/4148420736 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fec6010dc30 con 0x7fec60100ea0 2024-08-18T22:34:55.307 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:55.305+0000 7fec5d7fa640 1 -- 172.21.15.195:0/4148420736 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+743 (secure 0 0 0) 0x7fec5403c330 con 0x7fec60100ea0 2024-08-18T22:34:55.307 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-08-18T22:34:55.307 INFO:teuthology.orchestra.run.smithi195.stdout:{"epoch":1,"fsid":"b003123a-5db1-11ef-bccf-c7b262605968","modified":"2024-08-18T22:32:38.034362Z","created":"2024-08-18T22:32:38.034362Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi121","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:3300","nonce":0},{"type":"v1","addr":"172.21.15.121:6789","nonce":0}]},"addr":"172.21.15.121:6789/0","public_addr":"172.21.15.121:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-08-18T22:34:55.307 INFO:teuthology.orchestra.run.smithi195.stderr:dumped monmap epoch 1 2024-08-18T22:34:55.308 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:55.307+0000 7fec66e20640 1 -- 172.21.15.195:0/4148420736 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7fec500358a0 msgr2=0x7fec50037d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:34:55.309 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:55.307+0000 7fec66e20640 1 --2- 172.21.15.195:0/4148420736 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7fec500358a0 0x7fec50037d50 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fec4c006fd0 tx=0x7fec4c006db0 comp rx=0 tx=0).stop 2024-08-18T22:34:55.309 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:55.307+0000 7fec66e20640 1 -- 172.21.15.195:0/4148420736 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fec60100ea0 msgr2=0x7fec601125c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:34:55.309 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:55.307+0000 7fec66e20640 1 --2- 172.21.15.195:0/4148420736 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fec60100ea0 0x7fec601125c0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fec5402a6d0 tx=0x7fec54009da0 comp rx=0 tx=0).stop 2024-08-18T22:34:55.309 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:55.307+0000 7fec66e20640 1 -- 172.21.15.195:0/4148420736 shutdown_connections 2024-08-18T22:34:55.309 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:55.307+0000 7fec66e20640 1 --2- 172.21.15.195:0/4148420736 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7fec500358a0 0x7fec50037d50 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:55.309 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:55.307+0000 7fec66e20640 1 --2- 172.21.15.195:0/4148420736 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fec60100ea0 0x7fec601125c0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:34:55.309 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:55.307+0000 7fec66e20640 1 -- 172.21.15.195:0/4148420736 >> 172.21.15.195:0/4148420736 conn(0x7fec600f6a70 msgr2=0x7fec60102220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:34:55.309 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:55.307+0000 7fec66e20640 1 -- 172.21.15.195:0/4148420736 shutdown_connections 2024-08-18T22:34:55.309 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:34:55.308+0000 7fec66e20640 1 -- 172.21.15.195:0/4148420736 wait complete. 2024-08-18T22:34:56.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:34:55 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:34:56.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:34:55 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:34:56.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:34:55 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:34:56.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:34:55 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:34:56.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:34:55 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi195.acttsj", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-08-18T22:34:56.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:34:55 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.smithi195.acttsj", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-08-18T22:34:56.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:34:55 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "mgr services"}]: dispatch 2024-08-18T22:34:56.085 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:34:55 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:34:56.085 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:34:55 smithi121 ceph-mon[16788]: Deploying daemon mgr.smithi195.acttsj on smithi195 2024-08-18T22:34:56.085 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:34:55 smithi121 ceph-mon[16788]: from='client.? 172.21.15.195:0/4148420736' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-08-18T22:34:57.790 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-08-18T22:34:57.790 DEBUG:teuthology.orchestra.run.smithi195:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b003123a-5db1-11ef-bccf-c7b262605968 -- ceph mon dump -f json 2024-08-18T22:34:58.584 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:34:58 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:34:58.584 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:34:58 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:34:58.584 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:34:58 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:34:58.584 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:34:58 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:34:58.584 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:34:58 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-08-18T22:34:58.584 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:34:58 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:34:58.584 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:34:58 smithi121 ceph-mon[16788]: Deploying daemon mon.smithi195 on smithi195 2024-08-18T22:34:59.719 INFO:teuthology.orchestra.run.smithi195.stderr:Inferring config /var/lib/ceph/b003123a-5db1-11ef-bccf-c7b262605968/mon.smithi195/config 2024-08-18T22:34:59.834 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:34:59 smithi121 ceph-mon[16788]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-18T22:34:59.834 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:34:59 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:35:01.142 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:35:01.136+0000 7f1ed7f66640 1 -- 172.21.15.195:0/3529884747 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1ed0102090 msgr2=0x7f1ed0102460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:35:01.142 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:35:01.136+0000 7f1ed7f66640 1 --2- 172.21.15.195:0/3529884747 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1ed0102090 0x7f1ed0102460 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f1ecc004850 tx=0x7f1ecc009da0 comp rx=0 tx=0).stop 2024-08-18T22:35:01.142 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:35:01.136+0000 7f1ed7f66640 1 -- 172.21.15.195:0/3529884747 shutdown_connections 2024-08-18T22:35:01.142 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:35:01.136+0000 7f1ed7f66640 1 --2- 172.21.15.195:0/3529884747 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1ed0102090 0x7f1ed0102460 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:35:01.142 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:35:01.136+0000 7f1ed7f66640 1 -- 172.21.15.195:0/3529884747 >> 172.21.15.195:0/3529884747 conn(0x7f1ed0070f60 msgr2=0x7f1ed0071360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:35:01.143 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:35:01.136+0000 7f1ed7f66640 1 -- 172.21.15.195:0/3529884747 shutdown_connections 2024-08-18T22:35:01.143 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:35:01.136+0000 7f1ed7f66640 1 -- 172.21.15.195:0/3529884747 wait complete. 2024-08-18T22:35:01.143 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:35:01.137+0000 7f1ed7f66640 1 Processor -- start 2024-08-18T22:35:01.143 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:35:01.137+0000 7f1ed7f66640 1 -- start start 2024-08-18T22:35:01.143 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:35:01.138+0000 7f1ed7f66640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1ed0102090 0x7f1ed0112650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:35:01.143 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:35:01.138+0000 7f1ed7f66640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ed0112b90 con 0x7f1ed0102090 2024-08-18T22:35:01.143 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:35:01.138+0000 7f1ed5d02640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1ed0102090 0x7f1ed0112650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:35:01.143 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:35:01.138+0000 7f1ed5d02640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1ed0102090 0x7f1ed0112650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.195:42046/0 (socket says 172.21.15.195:42046) 2024-08-18T22:35:01.143 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:35:01.138+0000 7f1ed5d02640 1 -- 172.21.15.195:0/647364072 learned_addr learned my addr 172.21.15.195:0/647364072 (peer_addr_for_me v2:172.21.15.195:0/0) 2024-08-18T22:35:01.144 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:35:01.138+0000 7f1ed5d02640 1 -- 172.21.15.195:0/647364072 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ecc005040 con 0x7f1ed0102090 2024-08-18T22:35:01.144 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:35:01.138+0000 7f1ed5d02640 1 --2- 172.21.15.195:0/647364072 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1ed0102090 0x7f1ed0112650 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f1ecc02a6d0 tx=0x7f1ecc009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:35:01.144 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:35:01.139+0000 7f1ec67fc640 1 -- 172.21.15.195:0/647364072 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1ecc02cf10 con 0x7f1ed0102090 2024-08-18T22:35:01.144 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:35:01.139+0000 7f1ed7f66640 1 -- 172.21.15.195:0/647364072 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ed0112d90 con 0x7f1ed0102090 2024-08-18T22:35:01.144 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:35:01.139+0000 7f1ec67fc640 1 -- 172.21.15.195:0/647364072 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f1ecc033ad0 con 0x7f1ed0102090 2024-08-18T22:35:01.145 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:35:01.139+0000 7f1ec67fc640 1 -- 172.21.15.195:0/647364072 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1ecc03ebb0 con 0x7f1ed0102090 2024-08-18T22:35:01.145 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:35:01.139+0000 7f1ed7f66640 1 -- 172.21.15.195:0/647364072 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ed01131e0 con 0x7f1ed0102090 2024-08-18T22:35:01.145 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:35:01.140+0000 7f1ec67fc640 1 -- 172.21.15.195:0/647364072 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 17) v1 ==== 42751+0+0 (secure 0 0 0) 0x7f1ecc030020 con 0x7f1ed0102090 2024-08-18T22:35:01.145 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:35:01.140+0000 7f1ec67fc640 1 --2- 172.21.15.195:0/647364072 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7f1ebc039d00 0x7f1ebc03c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:35:01.145 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:35:01.140+0000 7f1ec67fc640 1 -- 172.21.15.195:0/647364072 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7f1ecc067c60 con 0x7f1ed0102090 2024-08-18T22:35:01.145 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:35:01.140+0000 7f1ed7f66640 1 -- 172.21.15.195:0/647364072 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ed00fd800 con 0x7f1ed0102090 2024-08-18T22:35:01.146 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:35:01.140+0000 7f1ed5501640 1 --2- 172.21.15.195:0/647364072 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7f1ebc039d00 0x7f1ebc03c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:35:01.146 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:35:01.141+0000 7f1ed5501640 1 --2- 172.21.15.195:0/647364072 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7f1ebc039d00 0x7f1ebc03c1b0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f1ec0006fd0 tx=0x7f1ec0006db0 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:35:01.146 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:35:01.145+0000 7f1ec67fc640 1 -- 172.21.15.195:0/647364072 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f1ecc0473f0 con 0x7f1ed0102090 2024-08-18T22:35:01.371 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:35:01.369+0000 7f1ed7f66640 1 -- 172.21.15.195:0/647364072 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f1ed004b4c0 con 0x7f1ed0102090 2024-08-18T22:35:01.371 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:35:01.370+0000 7f1ec67fc640 1 -- 172.21.15.195:0/647364072 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+743 (secure 0 0 0) 0x7f1ecc03c330 con 0x7f1ed0102090 2024-08-18T22:35:01.372 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-08-18T22:35:01.372 INFO:teuthology.orchestra.run.smithi195.stdout:{"epoch":1,"fsid":"b003123a-5db1-11ef-bccf-c7b262605968","modified":"2024-08-18T22:32:38.034362Z","created":"2024-08-18T22:32:38.034362Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi121","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:3300","nonce":0},{"type":"v1","addr":"172.21.15.121:6789","nonce":0}]},"addr":"172.21.15.121:6789/0","public_addr":"172.21.15.121:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-08-18T22:35:01.372 INFO:teuthology.orchestra.run.smithi195.stderr:dumped monmap epoch 1 2024-08-18T22:35:01.373 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:35:01.372+0000 7f1ed7f66640 1 -- 172.21.15.195:0/647364072 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7f1ebc039d00 msgr2=0x7f1ebc03c1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:35:01.373 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:35:01.372+0000 7f1ed7f66640 1 --2- 172.21.15.195:0/647364072 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7f1ebc039d00 0x7f1ebc03c1b0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f1ec0006fd0 tx=0x7f1ec0006db0 comp rx=0 tx=0).stop 2024-08-18T22:35:01.374 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:35:01.372+0000 7f1ed7f66640 1 -- 172.21.15.195:0/647364072 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1ed0102090 msgr2=0x7f1ed0112650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:35:01.374 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:35:01.372+0000 7f1ed7f66640 1 --2- 172.21.15.195:0/647364072 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1ed0102090 0x7f1ed0112650 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f1ecc02a6d0 tx=0x7f1ecc009da0 comp rx=0 tx=0).stop 2024-08-18T22:35:01.374 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:35:01.372+0000 7f1ed7f66640 1 -- 172.21.15.195:0/647364072 shutdown_connections 2024-08-18T22:35:01.374 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:35:01.372+0000 7f1ed7f66640 1 --2- 172.21.15.195:0/647364072 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7f1ebc039d00 0x7f1ebc03c1b0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:35:01.374 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:35:01.372+0000 7f1ed7f66640 1 --2- 172.21.15.195:0/647364072 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1ed0102090 0x7f1ed0112650 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:35:01.374 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:35:01.372+0000 7f1ed7f66640 1 -- 172.21.15.195:0/647364072 >> 172.21.15.195:0/647364072 conn(0x7f1ed0070f60 msgr2=0x7f1ed00f9ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:35:01.374 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:35:01.372+0000 7f1ed7f66640 1 -- 172.21.15.195:0/647364072 shutdown_connections 2024-08-18T22:35:01.374 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:35:01.372+0000 7f1ed7f66640 1 -- 172.21.15.195:0/647364072 wait complete. 2024-08-18T22:35:01.833 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:35:01 smithi121 ceph-mon[16788]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-18T22:35:01.834 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:35:01 smithi121 ceph-mon[16788]: from='client.? 172.21.15.195:0/647364072' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-08-18T22:35:03.638 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-08-18T22:35:03.638 DEBUG:teuthology.orchestra.run.smithi195:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b003123a-5db1-11ef-bccf-c7b262605968 -- ceph mon dump -f json 2024-08-18T22:35:03.897 INFO:teuthology.orchestra.run.smithi195.stderr:Inferring config /var/lib/ceph/b003123a-5db1-11ef-bccf-c7b262605968/mon.smithi195/config 2024-08-18T22:35:07.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:35:06 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:35:07.240 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:35:06 smithi121 ceph-mon[16788]: from='mgr.? 172.21.15.195:0/2771556361' entity='mgr.smithi195.acttsj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-08-18T22:35:07.240 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:35:06 smithi121 ceph-mon[16788]: mon.smithi121 calling monitor election 2024-08-18T22:35:07.240 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:35:06 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "mon metadata", "id": "smithi121"}]: dispatch 2024-08-18T22:35:07.240 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:35:06 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "mon metadata", "id": "smithi195"}]: dispatch 2024-08-18T22:35:07.241 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:35:06 smithi121 ceph-mon[16788]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-18T22:35:07.241 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:35:06 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "mon metadata", "id": "smithi195"}]: dispatch 2024-08-18T22:35:07.241 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:35:06 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "mon metadata", "id": "smithi195"}]: dispatch 2024-08-18T22:35:07.241 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:35:06 smithi121 ceph-mon[16788]: mon.smithi195 calling monitor election 2024-08-18T22:35:07.241 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:35:06 smithi121 ceph-mon[16788]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-18T22:35:07.241 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:35:06 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "mon metadata", "id": "smithi195"}]: dispatch 2024-08-18T22:35:07.241 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:35:06 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "mon metadata", "id": "smithi195"}]: dispatch 2024-08-18T22:35:07.241 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:35:06 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "mon metadata", "id": "smithi195"}]: dispatch 2024-08-18T22:35:07.241 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:35:06 smithi121 ceph-mon[16788]: mon.smithi121 is new leader, mons smithi121,smithi195 in quorum (ranks 0,1) 2024-08-18T22:35:07.241 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:35:06 smithi121 ceph-mon[16788]: monmap e2: 2 mons at {smithi121=[v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0],smithi195=[v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-08-18T22:35:07.241 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:35:06 smithi121 ceph-mon[16788]: fsmap 2024-08-18T22:35:07.241 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:35:06 smithi121 ceph-mon[16788]: osdmap e5: 0 total, 0 up, 0 in 2024-08-18T22:35:07.242 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:35:06 smithi121 ceph-mon[16788]: mgrmap e17: smithi121.lopxqc(active, since 28s) 2024-08-18T22:35:07.242 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:35:06 smithi121 ceph-mon[16788]: overall HEALTH_OK 2024-08-18T22:35:07.242 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:35:06 smithi121 ceph-mon[16788]: Standby manager daemon smithi195.acttsj started 2024-08-18T22:35:07.242 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:35:06 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:35:07.242 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:35:06 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:35:07.242 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:35:06 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:35:07.242 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:35:06 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:35:07.242 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:35:06 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:35:08.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:35:07 smithi195 ceph-mon[23370]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-18T22:35:08.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:35:07 smithi195 ceph-mon[23370]: mgrmap e18: smithi121.lopxqc(active, since 28s), standbys: smithi195.acttsj 2024-08-18T22:35:08.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:35:07 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "mgr metadata", "who": "smithi195.acttsj", "id": "smithi195.acttsj"}]: dispatch 2024-08-18T22:35:08.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:35:07 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-18T22:35:08.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:35:07 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "mon metadata", "id": "smithi195"}]: dispatch 2024-08-18T22:35:08.259 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:35:08.256+0000 7ff976f43640 1 -- 172.21.15.195:0/1048542917 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff9700fd0b0 msgr2=0x7ff960005540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:35:08.259 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:35:08.256+0000 7ff976f43640 1 --2- 172.21.15.195:0/1048542917 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff9700fd0b0 0x7ff960005540 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7ff964007d80 tx=0x7ff96400b040 comp rx=0 tx=0).stop 2024-08-18T22:35:08.259 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:35:08.256+0000 7ff976f43640 1 -- 172.21.15.195:0/1048542917 shutdown_connections 2024-08-18T22:35:08.259 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:35:08.256+0000 7ff976f43640 1 --2- 172.21.15.195:0/1048542917 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff9700fd0b0 0x7ff960005540 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:35:08.259 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:35:08.256+0000 7ff976f43640 1 -- 172.21.15.195:0/1048542917 >> 172.21.15.195:0/1048542917 conn(0x7ff9700f6bb0 msgr2=0x7ff9700f8fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:35:08.259 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:35:08.256+0000 7ff976f43640 1 -- 172.21.15.195:0/1048542917 shutdown_connections 2024-08-18T22:35:08.259 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:35:08.257+0000 7ff976f43640 1 -- 172.21.15.195:0/1048542917 wait complete. 2024-08-18T22:35:08.260 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:35:08.257+0000 7ff976f43640 1 Processor -- start 2024-08-18T22:35:08.260 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:35:08.257+0000 7ff976f43640 1 -- start start 2024-08-18T22:35:08.262 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:35:08.257+0000 7ff976f43640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff9700fd0b0 0x7ff9700faf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:35:08.262 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:35:08.257+0000 7ff976f43640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff9700fb4b0 0x7ff9700fb900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:35:08.262 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:35:08.257+0000 7ff976f43640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9701189f0 con 0x7ff9700fd0b0 2024-08-18T22:35:08.262 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:35:08.257+0000 7ff976f43640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff970118b30 con 0x7ff9700fb4b0 2024-08-18T22:35:08.262 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:35:08.258+0000 7ff96ffff640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff9700fb4b0 0x7ff9700fb900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:35:08.262 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:35:08.258+0000 7ff974cdf640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff9700fd0b0 0x7ff9700faf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:35:08.262 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:35:08.258+0000 7ff96ffff640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff9700fb4b0 0x7ff9700fb900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.195:45796/0 (socket says 172.21.15.195:45796) 2024-08-18T22:35:08.262 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:35:08.258+0000 7ff974cdf640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff9700fd0b0 0x7ff9700faf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.195:42138/0 (socket says 172.21.15.195:42138) 2024-08-18T22:35:08.262 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:35:08.258+0000 7ff96ffff640 1 -- 172.21.15.195:0/790894643 learned_addr learned my addr 172.21.15.195:0/790894643 (peer_addr_for_me v2:172.21.15.195:0/0) 2024-08-18T22:35:08.262 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:35:08.258+0000 7ff96ffff640 1 -- 172.21.15.195:0/790894643 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff9700fb4b0 msgr2=0x7ff9700fb900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-08-18T22:35:08.263 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:35:08.258+0000 7ff96ffff640 1 -- 172.21.15.195:0/790894643 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff9700fb4b0 msgr2=0x7ff9700fb900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-08-18T22:35:08.263 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:35:08.258+0000 7ff96ffff640 1 --2- 172.21.15.195:0/790894643 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff9700fb4b0 0x7ff9700fb900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-08-18T22:35:08.263 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:35:08.258+0000 7ff96ffff640 1 --2- 172.21.15.195:0/790894643 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff9700fb4b0 0x7ff9700fb900 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-18T22:35:08.263 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:35:08.258+0000 7ff974cdf640 1 -- 172.21.15.195:0/790894643 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff9700fb4b0 msgr2=0x7ff9700fb900 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-18T22:35:08.263 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:35:08.258+0000 7ff974cdf640 1 --2- 172.21.15.195:0/790894643 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff9700fb4b0 0x7ff9700fb900 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:35:08.263 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:35:08.258+0000 7ff974cdf640 1 -- 172.21.15.195:0/790894643 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff964005040 con 0x7ff9700fd0b0 2024-08-18T22:35:08.263 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:35:08.258+0000 7ff974cdf640 1 --2- 172.21.15.195:0/790894643 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff9700fd0b0 0x7ff9700faf70 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7ff964007d80 tx=0x7ff96400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:35:08.263 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:35:08.258+0000 7ff96d7fa640 1 -- 172.21.15.195:0/790894643 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff964032ec0 con 0x7ff9700fd0b0 2024-08-18T22:35:08.263 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:35:08.258+0000 7ff96d7fa640 1 -- 172.21.15.195:0/790894643 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7ff96403e070 con 0x7ff9700fd0b0 2024-08-18T22:35:08.263 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:35:08.258+0000 7ff976f43640 1 -- 172.21.15.195:0/790894643 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff970118d30 con 0x7ff9700fd0b0 2024-08-18T22:35:08.263 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:35:08.258+0000 7ff96d7fa640 1 -- 172.21.15.195:0/790894643 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff964044650 con 0x7ff9700fd0b0 2024-08-18T22:35:08.263 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:35:08.258+0000 7ff976f43640 1 -- 172.21.15.195:0/790894643 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9701191c0 con 0x7ff9700fd0b0 2024-08-18T22:35:08.264 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:35:08.259+0000 7ff976f43640 1 -- 172.21.15.195:0/790894643 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff970065d80 con 0x7ff9700fd0b0 2024-08-18T22:35:08.264 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:35:08.260+0000 7ff96d7fa640 1 -- 172.21.15.195:0/790894643 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 18) v1 ==== 85071+0+0 (secure 0 0 0) 0x7ff96403a420 con 0x7ff9700fd0b0 2024-08-18T22:35:08.264 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:35:08.260+0000 7ff96d7fa640 1 --2- 172.21.15.195:0/790894643 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7ff954067210 0x7ff9540696c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:35:08.264 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:35:08.260+0000 7ff96d7fa640 1 -- 172.21.15.195:0/790894643 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7ff9640a55e0 con 0x7ff9700fd0b0 2024-08-18T22:35:08.264 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:35:08.260+0000 7ff96ffff640 1 --2- 172.21.15.195:0/790894643 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7ff954067210 0x7ff9540696c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:35:08.265 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:35:08.261+0000 7ff96ffff640 1 --2- 172.21.15.195:0/790894643 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7ff954067210 0x7ff9540696c0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7ff95c006fd0 tx=0x7ff95c008040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:35:08.267 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:35:08.265+0000 7ff96d7fa640 1 -- 172.21.15.195:0/790894643 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7ff964073980 con 0x7ff9700fd0b0 2024-08-18T22:35:08.333 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:35:07 smithi121 ceph-mon[16788]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-18T22:35:08.333 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:35:07 smithi121 ceph-mon[16788]: mgrmap e18: smithi121.lopxqc(active, since 28s), standbys: smithi195.acttsj 2024-08-18T22:35:08.333 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:35:07 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "mgr metadata", "who": "smithi195.acttsj", "id": "smithi195.acttsj"}]: dispatch 2024-08-18T22:35:08.334 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:35:07 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-18T22:35:08.334 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:35:07 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "mon metadata", "id": "smithi195"}]: dispatch 2024-08-18T22:35:08.490 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:35:08.487+0000 7ff976f43640 1 -- 172.21.15.195:0/790894643 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7ff97005eb10 con 0x7ff9700fd0b0 2024-08-18T22:35:08.491 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:35:08.488+0000 7ff96d7fa640 1 -- 172.21.15.195:0/790894643 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) v1 ==== 95+0+1021 (secure 0 0 0) 0x7ff964035410 con 0x7ff9700fd0b0 2024-08-18T22:35:08.491 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-08-18T22:35:08.491 INFO:teuthology.orchestra.run.smithi195.stdout:{"epoch":2,"fsid":"b003123a-5db1-11ef-bccf-c7b262605968","modified":"2024-08-18T22:35:01.759705Z","created":"2024-08-18T22:32:38.034362Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi121","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:3300","nonce":0},{"type":"v1","addr":"172.21.15.121:6789","nonce":0}]},"addr":"172.21.15.121:6789/0","public_addr":"172.21.15.121:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"smithi195","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:3300","nonce":0},{"type":"v1","addr":"172.21.15.195:6789","nonce":0}]},"addr":"172.21.15.195:6789/0","public_addr":"172.21.15.195:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-08-18T22:35:08.492 INFO:teuthology.orchestra.run.smithi195.stderr:dumped monmap epoch 2 2024-08-18T22:35:08.493 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:35:08.491+0000 7ff976f43640 1 -- 172.21.15.195:0/790894643 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7ff954067210 msgr2=0x7ff9540696c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:35:08.493 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:35:08.491+0000 7ff976f43640 1 --2- 172.21.15.195:0/790894643 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7ff954067210 0x7ff9540696c0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7ff95c006fd0 tx=0x7ff95c008040 comp rx=0 tx=0).stop 2024-08-18T22:35:08.493 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:35:08.491+0000 7ff976f43640 1 -- 172.21.15.195:0/790894643 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff9700fd0b0 msgr2=0x7ff9700faf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:35:08.494 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:35:08.491+0000 7ff976f43640 1 --2- 172.21.15.195:0/790894643 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff9700fd0b0 0x7ff9700faf70 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7ff964007d80 tx=0x7ff96400b040 comp rx=0 tx=0).stop 2024-08-18T22:35:08.494 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:35:08.491+0000 7ff976f43640 1 -- 172.21.15.195:0/790894643 shutdown_connections 2024-08-18T22:35:08.494 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:35:08.491+0000 7ff976f43640 1 --2- 172.21.15.195:0/790894643 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7ff954067210 0x7ff9540696c0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:35:08.494 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:35:08.491+0000 7ff976f43640 1 --2- 172.21.15.195:0/790894643 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff9700fb4b0 0x7ff9700fb900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:35:08.494 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:35:08.491+0000 7ff976f43640 1 --2- 172.21.15.195:0/790894643 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff9700fd0b0 0x7ff9700faf70 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:35:08.495 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:35:08.491+0000 7ff976f43640 1 -- 172.21.15.195:0/790894643 >> 172.21.15.195:0/790894643 conn(0x7ff9700f6bb0 msgr2=0x7ff970101850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:35:08.495 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:35:08.491+0000 7ff976f43640 1 -- 172.21.15.195:0/790894643 shutdown_connections 2024-08-18T22:35:08.495 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:35:08.491+0000 7ff976f43640 1 -- 172.21.15.195:0/790894643 wait complete. 2024-08-18T22:35:09.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:35:08 smithi195 ceph-mon[23370]: from='client.? 172.21.15.195:0/790894643' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-08-18T22:35:09.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:35:08 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-18T22:35:09.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:35:08 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:35:09.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:35:08 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:35:09.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:35:08 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:35:09.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:35:08 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:35:09.160 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:35:08 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-18T22:35:09.249 INFO:tasks.cephadm:Generating final ceph.conf file... 2024-08-18T22:35:09.249 DEBUG:teuthology.orchestra.run.smithi121:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b003123a-5db1-11ef-bccf-c7b262605968 -- ceph config generate-minimal-conf 2024-08-18T22:35:09.272 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:35:08 smithi121 ceph-mon[16788]: from='client.? 172.21.15.195:0/790894643' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-08-18T22:35:09.272 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:35:08 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-18T22:35:09.272 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:35:08 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:35:09.272 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:35:08 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:35:09.273 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:35:08 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:35:09.273 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:35:08 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:35:09.273 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:35:08 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-18T22:35:09.508 INFO:teuthology.orchestra.run.smithi121.stderr:Inferring config /var/lib/ceph/b003123a-5db1-11ef-bccf-c7b262605968/mon.smithi121/config 2024-08-18T22:35:10.334 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:35:10 smithi121 ceph-mon[16788]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-18T22:35:10.334 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:35:10 smithi121 ceph-mon[16788]: Updating smithi121:/etc/ceph/ceph.conf 2024-08-18T22:35:10.334 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:35:10 smithi121 ceph-mon[16788]: Updating smithi195:/etc/ceph/ceph.conf 2024-08-18T22:35:10.334 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:35:10 smithi121 ceph-mon[16788]: Updating smithi121:/var/lib/ceph/b003123a-5db1-11ef-bccf-c7b262605968/config/ceph.conf 2024-08-18T22:35:10.334 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:35:10 smithi121 ceph-mon[16788]: Updating smithi195:/var/lib/ceph/b003123a-5db1-11ef-bccf-c7b262605968/config/ceph.conf 2024-08-18T22:35:10.334 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:35:10 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:35:10.334 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:35:10 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:35:10.334 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:35:10 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:35:10.334 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:35:10 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:35:10.334 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:35:10 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:35:10.335 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:35:10 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-08-18T22:35:10.335 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:35:10 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-08-18T22:35:10.335 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:35:10 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:35:10.659 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:35:10 smithi195 ceph-mon[23370]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-18T22:35:10.659 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:35:10 smithi195 ceph-mon[23370]: Updating smithi121:/etc/ceph/ceph.conf 2024-08-18T22:35:10.659 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:35:10 smithi195 ceph-mon[23370]: Updating smithi195:/etc/ceph/ceph.conf 2024-08-18T22:35:10.659 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:35:10 smithi195 ceph-mon[23370]: Updating smithi121:/var/lib/ceph/b003123a-5db1-11ef-bccf-c7b262605968/config/ceph.conf 2024-08-18T22:35:10.659 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:35:10 smithi195 ceph-mon[23370]: Updating smithi195:/var/lib/ceph/b003123a-5db1-11ef-bccf-c7b262605968/config/ceph.conf 2024-08-18T22:35:10.659 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:35:10 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:35:10.659 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:35:10 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:35:10.660 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:35:10 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:35:10.660 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:35:10 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:35:10.660 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:35:10 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:35:10.660 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:35:10 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-08-18T22:35:10.660 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:35:10 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-08-18T22:35:10.660 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:35:10 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:35:11.484 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:35:11 smithi121 ceph-mon[16788]: Reconfiguring mon.smithi121 (unknown last config time)... 2024-08-18T22:35:11.484 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:35:11 smithi121 ceph-mon[16788]: Reconfiguring daemon mon.smithi121 on smithi121 2024-08-18T22:35:11.484 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:35:11 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:35:11.484 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:35:11 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:35:11.485 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:35:11 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi121.lopxqc", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-08-18T22:35:11.485 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:35:11 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "mgr services"}]: dispatch 2024-08-18T22:35:11.485 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:35:11 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:35:11.659 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:35:11 smithi195 ceph-mon[23370]: Reconfiguring mon.smithi121 (unknown last config time)... 2024-08-18T22:35:11.659 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:35:11 smithi195 ceph-mon[23370]: Reconfiguring daemon mon.smithi121 on smithi121 2024-08-18T22:35:11.659 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:35:11 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:35:11.659 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:35:11 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:35:11.660 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:35:11 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi121.lopxqc", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-08-18T22:35:11.660 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:35:11 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "mgr services"}]: dispatch 2024-08-18T22:35:11.660 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:35:11 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:35:12.490 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:35:12 smithi121 ceph-mon[16788]: Reconfiguring mgr.smithi121.lopxqc (unknown last config time)... 2024-08-18T22:35:12.490 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:35:12 smithi121 ceph-mon[16788]: Reconfiguring daemon mgr.smithi121.lopxqc on smithi121 2024-08-18T22:35:12.491 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:35:12 smithi121 ceph-mon[16788]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-18T22:35:12.491 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:35:12 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:35:12.491 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:35:12 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:35:12.491 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:35:12 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi121", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-08-18T22:35:12.491 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:35:12 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:35:12.659 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:35:12 smithi195 ceph-mon[23370]: Reconfiguring mgr.smithi121.lopxqc (unknown last config time)... 2024-08-18T22:35:12.659 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:35:12 smithi195 ceph-mon[23370]: Reconfiguring daemon mgr.smithi121.lopxqc on smithi121 2024-08-18T22:35:12.659 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:35:12 smithi195 ceph-mon[23370]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-18T22:35:12.659 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:35:12 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:35:12.659 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:35:12 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:35:12.659 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:35:12 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi121", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-08-18T22:35:12.659 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:35:12 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:35:13.108 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:35:13.105+0000 7fad01c5e640 1 -- 172.21.15.121:0/994197391 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7facfc102ca0 msgr2=0x7facfc0fc330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:35:13.108 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:35:13.105+0000 7fad01c5e640 1 --2- 172.21.15.121:0/994197391 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7facfc102ca0 0x7facfc0fc330 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7facf00048d0 tx=0x7facf0009da0 comp rx=0 tx=0).stop 2024-08-18T22:35:13.108 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:35:13.105+0000 7fad01c5e640 1 -- 172.21.15.121:0/994197391 shutdown_connections 2024-08-18T22:35:13.108 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:35:13.105+0000 7fad01c5e640 1 --2- 172.21.15.121:0/994197391 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7facfc102ca0 0x7facfc0fc330 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:35:13.108 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:35:13.105+0000 7fad01c5e640 1 --2- 172.21.15.121:0/994197391 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7facfc102300 0x7facfc1026d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:35:13.108 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:35:13.105+0000 7fad01c5e640 1 -- 172.21.15.121:0/994197391 >> 172.21.15.121:0/994197391 conn(0x7facfc0f7e90 msgr2=0x7facfc0fa2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:35:13.108 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:35:13.105+0000 7fad01c5e640 1 -- 172.21.15.121:0/994197391 shutdown_connections 2024-08-18T22:35:13.108 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:35:13.105+0000 7fad01c5e640 1 -- 172.21.15.121:0/994197391 wait complete. 2024-08-18T22:35:13.108 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:35:13.105+0000 7fad01c5e640 1 Processor -- start 2024-08-18T22:35:13.108 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:35:13.106+0000 7fad01c5e640 1 -- start start 2024-08-18T22:35:13.110 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:35:13.106+0000 7fad01c5e640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7facfc102300 0x7facfc113270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:35:13.111 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:35:13.106+0000 7fad01c5e640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7facfc102ca0 0x7facfc1137b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:35:13.111 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:35:13.106+0000 7fad01c5e640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facfc113db0 con 0x7facfc102ca0 2024-08-18T22:35:13.111 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:35:13.106+0000 7fad01c5e640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facfc10d1f0 con 0x7facfc102300 2024-08-18T22:35:13.111 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:35:13.106+0000 7facfaffd640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7facfc102ca0 0x7facfc1137b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:35:13.111 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:35:13.106+0000 7facfaffd640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7facfc102ca0 0x7facfc1137b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:58114/0 (socket says 172.21.15.121:58114) 2024-08-18T22:35:13.111 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:35:13.106+0000 7facfaffd640 1 -- 172.21.15.121:0/1678516264 learned_addr learned my addr 172.21.15.121:0/1678516264 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-18T22:35:13.111 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:35:13.106+0000 7facfb7fe640 1 --2- 172.21.15.121:0/1678516264 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7facfc102300 0x7facfc113270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:35:13.111 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:35:13.106+0000 7facfaffd640 1 -- 172.21.15.121:0/1678516264 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7facfc102300 msgr2=0x7facfc113270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:35:13.111 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:35:13.106+0000 7facfaffd640 1 --2- 172.21.15.121:0/1678516264 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7facfc102300 0x7facfc113270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:35:13.111 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:35:13.106+0000 7facfaffd640 1 -- 172.21.15.121:0/1678516264 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facf0005040 con 0x7facfc102ca0 2024-08-18T22:35:13.111 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:35:13.106+0000 7facfaffd640 1 --2- 172.21.15.121:0/1678516264 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7facfc102ca0 0x7facfc1137b0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7facf0003080 tx=0x7facf0009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:35:13.111 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:35:13.107+0000 7face3fff640 1 -- 172.21.15.121:0/1678516264 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7facf0038070 con 0x7facfc102ca0 2024-08-18T22:35:13.112 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:35:13.107+0000 7face3fff640 1 -- 172.21.15.121:0/1678516264 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7facf002ade0 con 0x7facfc102ca0 2024-08-18T22:35:13.112 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:35:13.107+0000 7fad01c5e640 1 -- 172.21.15.121:0/1678516264 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7facfc10d470 con 0x7facfc102ca0 2024-08-18T22:35:13.112 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:35:13.107+0000 7face3fff640 1 -- 172.21.15.121:0/1678516264 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7facf002c880 con 0x7facfc102ca0 2024-08-18T22:35:13.112 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:35:13.107+0000 7fad01c5e640 1 -- 172.21.15.121:0/1678516264 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7facfc10d950 con 0x7facfc102ca0 2024-08-18T22:35:13.112 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:35:13.108+0000 7fad01c5e640 1 -- 172.21.15.121:0/1678516264 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7facfc0fda70 con 0x7facfc102ca0 2024-08-18T22:35:13.112 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:35:13.108+0000 7face3fff640 1 -- 172.21.15.121:0/1678516264 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 18) v1 ==== 85071+0+0 (secure 0 0 0) 0x7facf0030020 con 0x7facfc102ca0 2024-08-18T22:35:13.112 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:35:13.108+0000 7face3fff640 1 --2- 172.21.15.121:0/1678516264 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7face4067110 0x7face40695c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:35:13.112 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:35:13.109+0000 7face3fff640 1 -- 172.21.15.121:0/1678516264 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7facf00a3b90 con 0x7facfc102ca0 2024-08-18T22:35:13.112 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:35:13.109+0000 7facfb7fe640 1 --2- 172.21.15.121:0/1678516264 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7face4067110 0x7face40695c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:35:13.112 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:35:13.109+0000 7facfb7fe640 1 --2- 172.21.15.121:0/1678516264 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7face4067110 0x7face40695c0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7facec007fd0 tx=0x7facec009040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:35:13.114 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:35:13.113+0000 7face3fff640 1 -- 172.21.15.121:0/1678516264 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7facf0071fd0 con 0x7facfc102ca0 2024-08-18T22:35:13.275 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:35:13.274+0000 7fad01c5e640 1 -- 172.21.15.121:0/1678516264 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) v1 -- 0x7facfc0fbaf0 con 0x7facfc102ca0 2024-08-18T22:35:13.276 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:35:13.274+0000 7face3fff640 1 -- 172.21.15.121:0/1678516264 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v10) v1 ==== 76+0+227 (secure 0 0 0) 0x7facf00a3340 con 0x7facfc102ca0 2024-08-18T22:35:13.276 INFO:teuthology.orchestra.run.smithi121.stdout:# minimal ceph.conf for b003123a-5db1-11ef-bccf-c7b262605968 2024-08-18T22:35:13.276 INFO:teuthology.orchestra.run.smithi121.stdout:[global] 2024-08-18T22:35:13.276 INFO:teuthology.orchestra.run.smithi121.stdout: fsid = b003123a-5db1-11ef-bccf-c7b262605968 2024-08-18T22:35:13.276 INFO:teuthology.orchestra.run.smithi121.stdout: mon_host = [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] 2024-08-18T22:35:13.277 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:35:13.276+0000 7fad01c5e640 1 -- 172.21.15.121:0/1678516264 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7face4067110 msgr2=0x7face40695c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:35:13.277 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:35:13.276+0000 7fad01c5e640 1 --2- 172.21.15.121:0/1678516264 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7face4067110 0x7face40695c0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7facec007fd0 tx=0x7facec009040 comp rx=0 tx=0).stop 2024-08-18T22:35:13.277 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:35:13.276+0000 7fad01c5e640 1 -- 172.21.15.121:0/1678516264 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7facfc102ca0 msgr2=0x7facfc1137b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:35:13.277 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:35:13.276+0000 7fad01c5e640 1 --2- 172.21.15.121:0/1678516264 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7facfc102ca0 0x7facfc1137b0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7facf0003080 tx=0x7facf0009da0 comp rx=0 tx=0).stop 2024-08-18T22:35:13.278 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:35:13.276+0000 7fad01c5e640 1 -- 172.21.15.121:0/1678516264 shutdown_connections 2024-08-18T22:35:13.278 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:35:13.276+0000 7fad01c5e640 1 --2- 172.21.15.121:0/1678516264 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7face4067110 0x7face40695c0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:35:13.278 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:35:13.276+0000 7fad01c5e640 1 --2- 172.21.15.121:0/1678516264 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7facfc102ca0 0x7facfc1137b0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:35:13.278 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:35:13.276+0000 7fad01c5e640 1 --2- 172.21.15.121:0/1678516264 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7facfc102300 0x7facfc113270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:35:13.278 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:35:13.276+0000 7fad01c5e640 1 -- 172.21.15.121:0/1678516264 >> 172.21.15.121:0/1678516264 conn(0x7facfc0f7e90 msgr2=0x7facfc0f8eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:35:13.278 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:35:13.276+0000 7fad01c5e640 1 -- 172.21.15.121:0/1678516264 shutdown_connections 2024-08-18T22:35:13.278 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:35:13.276+0000 7fad01c5e640 1 -- 172.21.15.121:0/1678516264 wait complete. 2024-08-18T22:35:13.286 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:35:13 smithi121 ceph-mon[16788]: Reconfiguring crash.smithi121 (monmap changed)... 2024-08-18T22:35:13.286 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:35:13 smithi121 ceph-mon[16788]: Reconfiguring daemon crash.smithi121 on smithi121 2024-08-18T22:35:13.659 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:35:13 smithi195 ceph-mon[23370]: Reconfiguring crash.smithi121 (monmap changed)... 2024-08-18T22:35:13.659 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:35:13 smithi195 ceph-mon[23370]: Reconfiguring daemon crash.smithi121 on smithi121 2024-08-18T22:35:14.100 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2024-08-18T22:35:14.100 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-08-18T22:35:14.100 DEBUG:teuthology.orchestra.run.smithi121:> sudo dd of=/etc/ceph/ceph.conf 2024-08-18T22:35:14.168 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-08-18T22:35:14.168 DEBUG:teuthology.orchestra.run.smithi121:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-08-18T22:35:14.234 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-08-18T22:35:14.235 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd of=/etc/ceph/ceph.conf 2024-08-18T22:35:14.268 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-08-18T22:35:14.269 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-08-18T22:35:14.340 INFO:tasks.cephadm:Deploying OSDs... 2024-08-18T22:35:14.340 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-08-18T22:35:14.341 DEBUG:teuthology.orchestra.run.smithi121:> dd if=/scratch_devs of=/dev/stdout 2024-08-18T22:35:14.357 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-08-18T22:35:14.357 DEBUG:teuthology.orchestra.run.smithi121:> stat /dev/vg_nvme/lv_1 2024-08-18T22:35:14.412 INFO:teuthology.orchestra.run.smithi121.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-08-18T22:35:14.412 INFO:teuthology.orchestra.run.smithi121.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-18T22:35:14.413 INFO:teuthology.orchestra.run.smithi121.stdout:Device: 5h/5d Inode: 666 Links: 1 2024-08-18T22:35:14.413 INFO:teuthology.orchestra.run.smithi121.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-18T22:35:14.413 INFO:teuthology.orchestra.run.smithi121.stdout:Context: system_u:object_r:device_t:s0 2024-08-18T22:35:14.413 INFO:teuthology.orchestra.run.smithi121.stdout:Access: 2024-08-18 22:34:32.535111937 +0000 2024-08-18T22:35:14.413 INFO:teuthology.orchestra.run.smithi121.stdout:Modify: 2024-08-18 22:29:37.224368317 +0000 2024-08-18T22:35:14.413 INFO:teuthology.orchestra.run.smithi121.stdout:Change: 2024-08-18 22:29:37.224368317 +0000 2024-08-18T22:35:14.413 INFO:teuthology.orchestra.run.smithi121.stdout: Birth: 2024-08-18 22:29:37.224368317 +0000 2024-08-18T22:35:14.413 DEBUG:teuthology.orchestra.run.smithi121:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-08-18T22:35:14.475 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:35:14 smithi121 ceph-mon[16788]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-18T22:35:14.475 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:35:14 smithi121 ceph-mon[16788]: from='client.? 172.21.15.121:0/1678516264' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:35:14.478 INFO:teuthology.orchestra.run.smithi121.stderr:1+0 records in 2024-08-18T22:35:14.478 INFO:teuthology.orchestra.run.smithi121.stderr:1+0 records out 2024-08-18T22:35:14.478 INFO:teuthology.orchestra.run.smithi121.stderr:512 bytes copied, 0.00021583 s, 2.4 MB/s 2024-08-18T22:35:14.479 DEBUG:teuthology.orchestra.run.smithi121:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-08-18T22:35:14.537 DEBUG:teuthology.orchestra.run.smithi121:> stat /dev/vg_nvme/lv_2 2024-08-18T22:35:14.592 INFO:teuthology.orchestra.run.smithi121.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-08-18T22:35:14.592 INFO:teuthology.orchestra.run.smithi121.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-18T22:35:14.592 INFO:teuthology.orchestra.run.smithi121.stdout:Device: 5h/5d Inode: 685 Links: 1 2024-08-18T22:35:14.592 INFO:teuthology.orchestra.run.smithi121.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-18T22:35:14.592 INFO:teuthology.orchestra.run.smithi121.stdout:Context: system_u:object_r:device_t:s0 2024-08-18T22:35:14.592 INFO:teuthology.orchestra.run.smithi121.stdout:Access: 2024-08-18 22:34:32.535111937 +0000 2024-08-18T22:35:14.592 INFO:teuthology.orchestra.run.smithi121.stdout:Modify: 2024-08-18 22:29:37.556369056 +0000 2024-08-18T22:35:14.592 INFO:teuthology.orchestra.run.smithi121.stdout:Change: 2024-08-18 22:29:37.556369056 +0000 2024-08-18T22:35:14.593 INFO:teuthology.orchestra.run.smithi121.stdout: Birth: 2024-08-18 22:29:37.556369056 +0000 2024-08-18T22:35:14.593 DEBUG:teuthology.orchestra.run.smithi121:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-08-18T22:35:14.656 INFO:teuthology.orchestra.run.smithi121.stderr:1+0 records in 2024-08-18T22:35:14.656 INFO:teuthology.orchestra.run.smithi121.stderr:1+0 records out 2024-08-18T22:35:14.656 INFO:teuthology.orchestra.run.smithi121.stderr:512 bytes copied, 0.000222 s, 2.3 MB/s 2024-08-18T22:35:14.657 DEBUG:teuthology.orchestra.run.smithi121:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-08-18T22:35:14.659 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:35:14 smithi195 ceph-mon[23370]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-18T22:35:14.659 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:35:14 smithi195 ceph-mon[23370]: from='client.? 172.21.15.121:0/1678516264' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:35:14.714 DEBUG:teuthology.orchestra.run.smithi121:> stat /dev/vg_nvme/lv_3 2024-08-18T22:35:14.769 INFO:teuthology.orchestra.run.smithi121.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-08-18T22:35:14.769 INFO:teuthology.orchestra.run.smithi121.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-18T22:35:14.769 INFO:teuthology.orchestra.run.smithi121.stdout:Device: 5h/5d Inode: 704 Links: 1 2024-08-18T22:35:14.769 INFO:teuthology.orchestra.run.smithi121.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-18T22:35:14.769 INFO:teuthology.orchestra.run.smithi121.stdout:Context: system_u:object_r:device_t:s0 2024-08-18T22:35:14.769 INFO:teuthology.orchestra.run.smithi121.stdout:Access: 2024-08-18 22:34:32.536111924 +0000 2024-08-18T22:35:14.770 INFO:teuthology.orchestra.run.smithi121.stdout:Modify: 2024-08-18 22:29:37.878369773 +0000 2024-08-18T22:35:14.770 INFO:teuthology.orchestra.run.smithi121.stdout:Change: 2024-08-18 22:29:37.878369773 +0000 2024-08-18T22:35:14.770 INFO:teuthology.orchestra.run.smithi121.stdout: Birth: 2024-08-18 22:29:37.878369773 +0000 2024-08-18T22:35:14.770 DEBUG:teuthology.orchestra.run.smithi121:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-08-18T22:35:14.833 INFO:teuthology.orchestra.run.smithi121.stderr:1+0 records in 2024-08-18T22:35:14.834 INFO:teuthology.orchestra.run.smithi121.stderr:1+0 records out 2024-08-18T22:35:14.834 INFO:teuthology.orchestra.run.smithi121.stderr:512 bytes copied, 0.00024785 s, 2.1 MB/s 2024-08-18T22:35:14.835 DEBUG:teuthology.orchestra.run.smithi121:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-08-18T22:35:14.892 DEBUG:teuthology.orchestra.run.smithi121:> stat /dev/vg_nvme/lv_4 2024-08-18T22:35:14.948 INFO:teuthology.orchestra.run.smithi121.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-08-18T22:35:14.948 INFO:teuthology.orchestra.run.smithi121.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-18T22:35:14.948 INFO:teuthology.orchestra.run.smithi121.stdout:Device: 5h/5d Inode: 723 Links: 1 2024-08-18T22:35:14.948 INFO:teuthology.orchestra.run.smithi121.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-18T22:35:14.948 INFO:teuthology.orchestra.run.smithi121.stdout:Context: system_u:object_r:device_t:s0 2024-08-18T22:35:14.948 INFO:teuthology.orchestra.run.smithi121.stdout:Access: 2024-08-18 22:34:32.536111924 +0000 2024-08-18T22:35:14.948 INFO:teuthology.orchestra.run.smithi121.stdout:Modify: 2024-08-18 22:29:38.193370474 +0000 2024-08-18T22:35:14.948 INFO:teuthology.orchestra.run.smithi121.stdout:Change: 2024-08-18 22:29:38.193370474 +0000 2024-08-18T22:35:14.948 INFO:teuthology.orchestra.run.smithi121.stdout: Birth: 2024-08-18 22:29:38.193370474 +0000 2024-08-18T22:35:14.949 DEBUG:teuthology.orchestra.run.smithi121:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-08-18T22:35:15.011 INFO:teuthology.orchestra.run.smithi121.stderr:1+0 records in 2024-08-18T22:35:15.011 INFO:teuthology.orchestra.run.smithi121.stderr:1+0 records out 2024-08-18T22:35:15.012 INFO:teuthology.orchestra.run.smithi121.stderr:512 bytes copied, 0.000222349 s, 2.3 MB/s 2024-08-18T22:35:15.013 DEBUG:teuthology.orchestra.run.smithi121:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-08-18T22:35:15.069 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-08-18T22:35:15.069 DEBUG:teuthology.orchestra.run.smithi195:> dd if=/scratch_devs of=/dev/stdout 2024-08-18T22:35:15.089 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-08-18T22:35:15.089 DEBUG:teuthology.orchestra.run.smithi195:> stat /dev/vg_nvme/lv_1 2024-08-18T22:35:15.147 INFO:teuthology.orchestra.run.smithi195.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-08-18T22:35:15.147 INFO:teuthology.orchestra.run.smithi195.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-18T22:35:15.147 INFO:teuthology.orchestra.run.smithi195.stdout:Device: 5h/5d Inode: 665 Links: 1 2024-08-18T22:35:15.147 INFO:teuthology.orchestra.run.smithi195.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-18T22:35:15.147 INFO:teuthology.orchestra.run.smithi195.stdout:Context: system_u:object_r:device_t:s0 2024-08-18T22:35:15.147 INFO:teuthology.orchestra.run.smithi195.stdout:Access: 2024-08-18 22:34:59.948062715 +0000 2024-08-18T22:35:15.148 INFO:teuthology.orchestra.run.smithi195.stdout:Modify: 2024-08-18 22:29:37.229350621 +0000 2024-08-18T22:35:15.148 INFO:teuthology.orchestra.run.smithi195.stdout:Change: 2024-08-18 22:29:37.229350621 +0000 2024-08-18T22:35:15.148 INFO:teuthology.orchestra.run.smithi195.stdout: Birth: 2024-08-18 22:29:37.229350621 +0000 2024-08-18T22:35:15.148 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-08-18T22:35:15.215 INFO:teuthology.orchestra.run.smithi195.stderr:1+0 records in 2024-08-18T22:35:15.215 INFO:teuthology.orchestra.run.smithi195.stderr:1+0 records out 2024-08-18T22:35:15.215 INFO:teuthology.orchestra.run.smithi195.stderr:512 bytes copied, 0.000135319 s, 3.8 MB/s 2024-08-18T22:35:15.217 DEBUG:teuthology.orchestra.run.smithi195:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-08-18T22:35:15.276 DEBUG:teuthology.orchestra.run.smithi195:> stat /dev/vg_nvme/lv_2 2024-08-18T22:35:15.332 INFO:teuthology.orchestra.run.smithi195.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-08-18T22:35:15.333 INFO:teuthology.orchestra.run.smithi195.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-18T22:35:15.333 INFO:teuthology.orchestra.run.smithi195.stdout:Device: 5h/5d Inode: 684 Links: 1 2024-08-18T22:35:15.333 INFO:teuthology.orchestra.run.smithi195.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-18T22:35:15.333 INFO:teuthology.orchestra.run.smithi195.stdout:Context: system_u:object_r:device_t:s0 2024-08-18T22:35:15.333 INFO:teuthology.orchestra.run.smithi195.stdout:Access: 2024-08-18 22:34:59.948062715 +0000 2024-08-18T22:35:15.333 INFO:teuthology.orchestra.run.smithi195.stdout:Modify: 2024-08-18 22:29:37.550346759 +0000 2024-08-18T22:35:15.333 INFO:teuthology.orchestra.run.smithi195.stdout:Change: 2024-08-18 22:29:37.550346759 +0000 2024-08-18T22:35:15.333 INFO:teuthology.orchestra.run.smithi195.stdout: Birth: 2024-08-18 22:29:37.550346759 +0000 2024-08-18T22:35:15.333 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-08-18T22:35:15.398 INFO:teuthology.orchestra.run.smithi195.stderr:1+0 records in 2024-08-18T22:35:15.398 INFO:teuthology.orchestra.run.smithi195.stderr:1+0 records out 2024-08-18T22:35:15.398 INFO:teuthology.orchestra.run.smithi195.stderr:512 bytes copied, 0.000132771 s, 3.9 MB/s 2024-08-18T22:35:15.399 DEBUG:teuthology.orchestra.run.smithi195:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-08-18T22:35:15.457 DEBUG:teuthology.orchestra.run.smithi195:> stat /dev/vg_nvme/lv_3 2024-08-18T22:35:15.514 INFO:teuthology.orchestra.run.smithi195.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-08-18T22:35:15.514 INFO:teuthology.orchestra.run.smithi195.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-18T22:35:15.514 INFO:teuthology.orchestra.run.smithi195.stdout:Device: 5h/5d Inode: 704 Links: 1 2024-08-18T22:35:15.514 INFO:teuthology.orchestra.run.smithi195.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-18T22:35:15.514 INFO:teuthology.orchestra.run.smithi195.stdout:Context: system_u:object_r:device_t:s0 2024-08-18T22:35:15.514 INFO:teuthology.orchestra.run.smithi195.stdout:Access: 2024-08-18 22:34:59.948062715 +0000 2024-08-18T22:35:15.515 INFO:teuthology.orchestra.run.smithi195.stdout:Modify: 2024-08-18 22:29:37.849343162 +0000 2024-08-18T22:35:15.515 INFO:teuthology.orchestra.run.smithi195.stdout:Change: 2024-08-18 22:29:37.849343162 +0000 2024-08-18T22:35:15.515 INFO:teuthology.orchestra.run.smithi195.stdout: Birth: 2024-08-18 22:29:37.849343162 +0000 2024-08-18T22:35:15.515 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-08-18T22:35:15.579 INFO:teuthology.orchestra.run.smithi195.stderr:1+0 records in 2024-08-18T22:35:15.579 INFO:teuthology.orchestra.run.smithi195.stderr:1+0 records out 2024-08-18T22:35:15.579 INFO:teuthology.orchestra.run.smithi195.stderr:512 bytes copied, 0.000130572 s, 3.9 MB/s 2024-08-18T22:35:15.580 DEBUG:teuthology.orchestra.run.smithi195:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-08-18T22:35:15.638 DEBUG:teuthology.orchestra.run.smithi195:> stat /dev/vg_nvme/lv_4 2024-08-18T22:35:15.693 INFO:teuthology.orchestra.run.smithi195.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-08-18T22:35:15.694 INFO:teuthology.orchestra.run.smithi195.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-18T22:35:15.694 INFO:teuthology.orchestra.run.smithi195.stdout:Device: 5h/5d Inode: 722 Links: 1 2024-08-18T22:35:15.694 INFO:teuthology.orchestra.run.smithi195.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-18T22:35:15.694 INFO:teuthology.orchestra.run.smithi195.stdout:Context: system_u:object_r:device_t:s0 2024-08-18T22:35:15.694 INFO:teuthology.orchestra.run.smithi195.stdout:Access: 2024-08-18 22:34:59.949062695 +0000 2024-08-18T22:35:15.694 INFO:teuthology.orchestra.run.smithi195.stdout:Modify: 2024-08-18 22:29:38.167339337 +0000 2024-08-18T22:35:15.694 INFO:teuthology.orchestra.run.smithi195.stdout:Change: 2024-08-18 22:29:38.167339337 +0000 2024-08-18T22:35:15.694 INFO:teuthology.orchestra.run.smithi195.stdout: Birth: 2024-08-18 22:29:38.167339337 +0000 2024-08-18T22:35:15.694 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-08-18T22:35:15.757 INFO:teuthology.orchestra.run.smithi195.stderr:1+0 records in 2024-08-18T22:35:15.757 INFO:teuthology.orchestra.run.smithi195.stderr:1+0 records out 2024-08-18T22:35:15.757 INFO:teuthology.orchestra.run.smithi195.stderr:512 bytes copied, 0.000111247 s, 4.6 MB/s 2024-08-18T22:35:15.758 DEBUG:teuthology.orchestra.run.smithi195:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-08-18T22:35:15.815 INFO:tasks.cephadm:Deploying osd.0 on smithi121 with /dev/vg_nvme/lv_4... 2024-08-18T22:35:15.815 DEBUG:teuthology.orchestra.run.smithi121:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b003123a-5db1-11ef-bccf-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-08-18T22:35:15.833 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:35:15 smithi121 ceph-mon[16788]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-18T22:35:15.833 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:35:15 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:35:15.833 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:35:15 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:35:15.833 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:35:15 smithi121 ceph-mon[16788]: Reconfiguring alertmanager.smithi121 (dependencies changed)... 2024-08-18T22:35:15.833 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:35:15 smithi121 ceph-mon[16788]: Reconfiguring daemon alertmanager.smithi121 on smithi121 2024-08-18T22:35:15.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:35:15 smithi195 ceph-mon[23370]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-18T22:35:15.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:35:15 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:35:15.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:35:15 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:35:15.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:35:15 smithi195 ceph-mon[23370]: Reconfiguring alertmanager.smithi121 (dependencies changed)... 2024-08-18T22:35:15.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:35:15 smithi195 ceph-mon[23370]: Reconfiguring daemon alertmanager.smithi121 on smithi121 2024-08-18T22:35:17.194 INFO:teuthology.orchestra.run.smithi121.stderr:Inferring config /var/lib/ceph/b003123a-5db1-11ef-bccf-c7b262605968/mon.smithi121/config 2024-08-18T22:35:17.584 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:35:17 smithi121 ceph-mon[16788]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-18T22:35:17.910 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:35:17 smithi195 ceph-mon[23370]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-18T22:35:19.726 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:35:19 smithi121 ceph-mon[16788]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-18T22:35:19.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:35:19 smithi195 ceph-mon[23370]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-18T22:35:21.117 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:35:20 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:35:21.117 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:35:20 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:35:21.117 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:35:20 smithi121 ceph-mon[16788]: Reconfiguring grafana.smithi121 (dependencies changed)... 2024-08-18T22:35:21.117 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:35:20 smithi121 ceph-mon[16788]: Reconfiguring daemon grafana.smithi121 on smithi121 2024-08-18T22:35:21.122 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-08-18T22:35:21.143 DEBUG:teuthology.orchestra.run.smithi121:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b003123a-5db1-11ef-bccf-c7b262605968 -- ceph orch daemon add osd smithi121:vg_nvme/lv_4 2024-08-18T22:35:21.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:35:20 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:35:21.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:35:20 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:35:21.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:35:20 smithi195 ceph-mon[23370]: Reconfiguring grafana.smithi121 (dependencies changed)... 2024-08-18T22:35:21.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:35:20 smithi195 ceph-mon[23370]: Reconfiguring daemon grafana.smithi121 on smithi121 2024-08-18T22:35:22.048 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:35:21 smithi121 ceph-mon[16788]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-18T22:35:22.085 INFO:teuthology.orchestra.run.smithi121.stderr:Inferring config /var/lib/ceph/b003123a-5db1-11ef-bccf-c7b262605968/mon.smithi121/config 2024-08-18T22:35:22.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:35:21 smithi195 ceph-mon[23370]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-18T22:35:24.103 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:35:23 smithi121 ceph-mon[16788]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-18T22:35:24.103 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:35:23 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-18T22:35:24.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:35:23 smithi195 ceph-mon[23370]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-18T22:35:24.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:35:23 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-18T22:35:24.387 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:35:24.384+0000 7fdf1649f640 1 -- 172.21.15.121:0/1943278814 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdf100ff420 msgr2=0x7fdf10101800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:35:24.387 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:35:24.384+0000 7fdf1649f640 1 --2- 172.21.15.121:0/1943278814 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdf100ff420 0x7fdf10101800 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fdf040048d0 tx=0x7fdf04009da0 comp rx=0 tx=0).stop 2024-08-18T22:35:24.387 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:35:24.384+0000 7fdf1649f640 1 -- 172.21.15.121:0/1943278814 shutdown_connections 2024-08-18T22:35:24.387 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:35:24.384+0000 7fdf1649f640 1 --2- 172.21.15.121:0/1943278814 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdf100ff420 0x7fdf10101800 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:35:24.387 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:35:24.384+0000 7fdf1649f640 1 --2- 172.21.15.121:0/1943278814 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdf100659e0 0x7fdf100feee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:35:24.387 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:35:24.384+0000 7fdf1649f640 1 -- 172.21.15.121:0/1943278814 >> 172.21.15.121:0/1943278814 conn(0x7fdf100f69b0 msgr2=0x7fdf100f8dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:35:24.387 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:35:24.384+0000 7fdf1649f640 1 -- 172.21.15.121:0/1943278814 shutdown_connections 2024-08-18T22:35:24.387 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:35:24.384+0000 7fdf1649f640 1 -- 172.21.15.121:0/1943278814 wait complete. 2024-08-18T22:35:24.387 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:35:24.384+0000 7fdf1649f640 1 Processor -- start 2024-08-18T22:35:24.388 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:35:24.384+0000 7fdf1649f640 1 -- start start 2024-08-18T22:35:24.388 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:35:24.385+0000 7fdf1649f640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdf100659e0 0x7fdf1010cee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:35:24.388 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:35:24.385+0000 7fdf1649f640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdf100ff420 0x7fdf1010d420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:35:24.388 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:35:24.385+0000 7fdf1649f640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf1010e1b0 con 0x7fdf100ff420 2024-08-18T22:35:24.388 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:35:24.385+0000 7fdf1649f640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf1010e320 con 0x7fdf100659e0 2024-08-18T22:35:24.388 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:35:24.385+0000 7fdf0f7fe640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdf100ff420 0x7fdf1010d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:35:24.388 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:35:24.385+0000 7fdf0f7fe640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdf100ff420 0x7fdf1010d420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:53172/0 (socket says 172.21.15.121:53172) 2024-08-18T22:35:24.388 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:35:24.385+0000 7fdf0ffff640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdf100659e0 0x7fdf1010cee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:35:24.388 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:35:24.385+0000 7fdf0f7fe640 1 -- 172.21.15.121:0/1693886870 learned_addr learned my addr 172.21.15.121:0/1693886870 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-18T22:35:24.388 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:35:24.385+0000 7fdf0f7fe640 1 -- 172.21.15.121:0/1693886870 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdf100659e0 msgr2=0x7fdf1010cee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:35:24.388 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:35:24.385+0000 7fdf0f7fe640 1 --2- 172.21.15.121:0/1693886870 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdf100659e0 0x7fdf1010cee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:35:24.388 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:35:24.385+0000 7fdf0f7fe640 1 -- 172.21.15.121:0/1693886870 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf04005040 con 0x7fdf100ff420 2024-08-18T22:35:24.388 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:35:24.385+0000 7fdf0f7fe640 1 --2- 172.21.15.121:0/1693886870 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdf100ff420 0x7fdf1010d420 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fdf04003080 tx=0x7fdf04009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:35:24.388 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:35:24.385+0000 7fdf0cff9640 1 -- 172.21.15.121:0/1693886870 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdf04038070 con 0x7fdf100ff420 2024-08-18T22:35:24.389 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:35:24.385+0000 7fdf0cff9640 1 -- 172.21.15.121:0/1693886870 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fdf04009800 con 0x7fdf100ff420 2024-08-18T22:35:24.389 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:35:24.385+0000 7fdf0cff9640 1 -- 172.21.15.121:0/1693886870 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdf04033660 con 0x7fdf100ff420 2024-08-18T22:35:24.389 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:35:24.385+0000 7fdf1649f640 1 -- 172.21.15.121:0/1693886870 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf1010e5a0 con 0x7fdf100ff420 2024-08-18T22:35:24.389 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:35:24.386+0000 7fdf1649f640 1 -- 172.21.15.121:0/1693886870 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf1010ea60 con 0x7fdf100ff420 2024-08-18T22:35:24.390 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:35:24.386+0000 7fdf1649f640 1 -- 172.21.15.121:0/1693886870 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf100fa630 con 0x7fdf100ff420 2024-08-18T22:35:24.390 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:35:24.387+0000 7fdf0cff9640 1 -- 172.21.15.121:0/1693886870 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 18) v1 ==== 85071+0+0 (secure 0 0 0) 0x7fdf04030020 con 0x7fdf100ff420 2024-08-18T22:35:24.390 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:35:24.387+0000 7fdf0cff9640 1 --2- 172.21.15.121:0/1693886870 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7fdef8067110 0x7fdef80695c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:35:24.390 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:35:24.388+0000 7fdf0cff9640 1 -- 172.21.15.121:0/1693886870 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7fdf040a3a00 con 0x7fdf100ff420 2024-08-18T22:35:24.390 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:35:24.388+0000 7fdf0ffff640 1 --2- 172.21.15.121:0/1693886870 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7fdef8067110 0x7fdef80695c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:35:24.390 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:35:24.388+0000 7fdf0ffff640 1 --2- 172.21.15.121:0/1693886870 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7fdef8067110 0x7fdef80695c0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fdf1010cc70 tx=0x7fdf00009120 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:35:24.392 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:35:24.392+0000 7fdf0cff9640 1 -- 172.21.15.121:0/1693886870 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fdf04071eb0 con 0x7fdf100ff420 2024-08-18T22:35:24.562 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:35:24.561+0000 7fdf1649f640 1 -- 172.21.15.121:0/1693886870 --> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi121:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7fdf1010ed90 con 0x7fdef8067110 2024-08-18T22:35:24.976 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:35:24 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-08-18T22:35:24.976 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:35:24 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-08-18T22:35:24.976 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:35:24 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:35:25.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:35:24 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-08-18T22:35:25.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:35:24 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-08-18T22:35:25.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:35:24 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:35:26.048 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:35:25 smithi121 ceph-mon[16788]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-18T22:35:26.049 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:35:25 smithi121 ceph-mon[16788]: from='client.14240 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi121:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-08-18T22:35:26.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:35:25 smithi195 ceph-mon[23370]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-18T22:35:26.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:35:25 smithi195 ceph-mon[23370]: from='client.14240 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi121:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-08-18T22:35:28.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:35:27 smithi195 ceph-mon[23370]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-18T22:35:28.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:35:27 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:35:28.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:35:27 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:35:28.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:35:27 smithi195 ceph-mon[23370]: Reconfiguring prometheus.smithi121 (dependencies changed)... 2024-08-18T22:35:28.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:35:27 smithi195 ceph-mon[23370]: Reconfiguring daemon prometheus.smithi121 on smithi121 2024-08-18T22:35:28.161 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:35:27 smithi121 ceph-mon[16788]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-18T22:35:28.161 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:35:27 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:35:28.161 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:35:27 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:35:28.161 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:35:27 smithi121 ceph-mon[16788]: Reconfiguring prometheus.smithi121 (dependencies changed)... 2024-08-18T22:35:28.161 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:35:27 smithi121 ceph-mon[16788]: Reconfiguring daemon prometheus.smithi121 on smithi121 2024-08-18T22:35:29.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:35:28 smithi195 ceph-mon[23370]: from='client.? 172.21.15.121:0/2911005342' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "46b17ad3-c549-4492-bb2b-562dfae0ac3d"}]: dispatch 2024-08-18T22:35:29.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:35:28 smithi195 ceph-mon[23370]: from='client.? 172.21.15.121:0/2911005342' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "46b17ad3-c549-4492-bb2b-562dfae0ac3d"}]': finished 2024-08-18T22:35:29.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:35:28 smithi195 ceph-mon[23370]: osdmap e6: 1 total, 0 up, 1 in 2024-08-18T22:35:29.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:35:28 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-08-18T22:35:29.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:35:28 smithi195 ceph-mon[23370]: from='client.? 172.21.15.121:0/4005082558' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-08-18T22:35:29.333 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:35:28 smithi121 ceph-mon[16788]: from='client.? 172.21.15.121:0/2911005342' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "46b17ad3-c549-4492-bb2b-562dfae0ac3d"}]: dispatch 2024-08-18T22:35:29.334 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:35:28 smithi121 ceph-mon[16788]: from='client.? 172.21.15.121:0/2911005342' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "46b17ad3-c549-4492-bb2b-562dfae0ac3d"}]': finished 2024-08-18T22:35:29.334 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:35:28 smithi121 ceph-mon[16788]: osdmap e6: 1 total, 0 up, 1 in 2024-08-18T22:35:29.334 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:35:28 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-08-18T22:35:29.334 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:35:28 smithi121 ceph-mon[16788]: from='client.? 172.21.15.121:0/4005082558' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-08-18T22:35:30.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:35:29 smithi121 ceph-mon[16788]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-18T22:35:30.409 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:35:29 smithi195 ceph-mon[23370]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-18T22:35:32.244 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:35:31 smithi121 ceph-mon[16788]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-18T22:35:32.409 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:35:31 smithi195 ceph-mon[23370]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-18T22:35:34.045 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:35:33 smithi121 ceph-mon[16788]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-18T22:35:34.409 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:35:33 smithi195 ceph-mon[23370]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-18T22:35:36.120 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:35:35 smithi121 ceph-mon[16788]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-18T22:35:36.409 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:35:35 smithi195 ceph-mon[23370]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-18T22:35:38.341 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:35:38 smithi121 ceph-mon[16788]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-18T22:35:38.341 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:35:38 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:35:38.341 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:35:38 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:35:38.341 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:35:38 smithi121 ceph-mon[16788]: Reconfiguring crash.smithi195 (monmap changed)... 2024-08-18T22:35:38.341 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:35:38 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi195", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-08-18T22:35:38.341 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:35:38 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:35:38.341 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:35:38 smithi121 ceph-mon[16788]: Reconfiguring daemon crash.smithi195 on smithi195 2024-08-18T22:35:38.427 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:35:38 smithi195 ceph-mon[23370]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-18T22:35:38.428 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:35:38 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:35:38.428 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:35:38 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:35:38.428 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:35:38 smithi195 ceph-mon[23370]: Reconfiguring crash.smithi195 (monmap changed)... 2024-08-18T22:35:38.428 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:35:38 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi195", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-08-18T22:35:38.428 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:35:38 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:35:38.428 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:35:38 smithi195 ceph-mon[23370]: Reconfiguring daemon crash.smithi195 on smithi195 2024-08-18T22:35:39.409 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:35:39 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-08-18T22:35:39.409 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:35:39 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:35:39.409 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:35:39 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:35:39.409 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:35:39 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:35:39.409 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:35:39 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi195.acttsj", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-08-18T22:35:39.409 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:35:39 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "mgr services"}]: dispatch 2024-08-18T22:35:39.409 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:35:39 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:35:39.409 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:35:39 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-18T22:35:39.462 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:35:39 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-08-18T22:35:39.463 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:35:39 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:35:39.463 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:35:39 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:35:39.463 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:35:39 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:35:39.463 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:35:39 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi195.acttsj", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-08-18T22:35:39.463 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:35:39 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "mgr services"}]: dispatch 2024-08-18T22:35:39.463 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:35:39 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:35:39.463 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:35:39 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-18T22:35:40.240 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:35:40 smithi121 ceph-mon[16788]: Deploying daemon osd.0 on smithi121 2024-08-18T22:35:40.240 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:35:40 smithi121 ceph-mon[16788]: Reconfiguring mgr.smithi195.acttsj (monmap changed)... 2024-08-18T22:35:40.241 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:35:40 smithi121 ceph-mon[16788]: Reconfiguring daemon mgr.smithi195.acttsj on smithi195 2024-08-18T22:35:40.241 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:35:40 smithi121 ceph-mon[16788]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-18T22:35:40.241 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:35:40 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:35:40.241 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:35:40 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:35:40.241 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:35:40 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-08-18T22:35:40.241 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:35:40 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-08-18T22:35:40.241 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:35:40 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:35:40.436 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:35:40 smithi195 ceph-mon[23370]: Deploying daemon osd.0 on smithi121 2024-08-18T22:35:40.436 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:35:40 smithi195 ceph-mon[23370]: Reconfiguring mgr.smithi195.acttsj (monmap changed)... 2024-08-18T22:35:40.436 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:35:40 smithi195 ceph-mon[23370]: Reconfiguring daemon mgr.smithi195.acttsj on smithi195 2024-08-18T22:35:40.436 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:35:40 smithi195 ceph-mon[23370]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-18T22:35:40.436 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:35:40 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:35:40.436 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:35:40 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:35:40.436 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:35:40 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-08-18T22:35:40.437 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:35:40 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-08-18T22:35:40.437 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:35:40 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:35:41.497 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:35:41 smithi121 ceph-mon[16788]: Reconfiguring mon.smithi195 (monmap changed)... 2024-08-18T22:35:41.497 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:35:41 smithi121 ceph-mon[16788]: Reconfiguring daemon mon.smithi195 on smithi195 2024-08-18T22:35:41.497 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:35:41 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:35:41.497 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:35:41 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:35:41.498 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:35:41 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-08-18T22:35:41.498 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:35:41 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi121:9093"}]: dispatch 2024-08-18T22:35:41.498 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:35:41 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:35:41.498 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:35:41 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-08-18T22:35:41.498 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:35:41 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi121:3000"}]: dispatch 2024-08-18T22:35:41.498 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:35:41 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:35:41.498 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:35:41 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-08-18T22:35:41.498 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:35:41 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi121:9095"}]: dispatch 2024-08-18T22:35:41.498 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:35:41 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:35:41.498 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:35:41 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-18T22:35:41.625 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:35:41 smithi195 ceph-mon[23370]: Reconfiguring mon.smithi195 (monmap changed)... 2024-08-18T22:35:41.625 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:35:41 smithi195 ceph-mon[23370]: Reconfiguring daemon mon.smithi195 on smithi195 2024-08-18T22:35:41.625 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:35:41 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:35:41.625 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:35:41 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:35:41.625 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:35:41 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-08-18T22:35:41.625 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:35:41 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi121:9093"}]: dispatch 2024-08-18T22:35:41.625 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:35:41 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:35:41.626 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:35:41 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-08-18T22:35:41.626 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:35:41 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi121:3000"}]: dispatch 2024-08-18T22:35:41.626 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:35:41 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:35:41.626 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:35:41 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-08-18T22:35:41.626 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:35:41 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi121:9095"}]: dispatch 2024-08-18T22:35:41.626 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:35:41 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:35:41.626 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:35:41 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-18T22:35:42.360 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:35:42 smithi121 ceph-mon[16788]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-18T22:35:42.360 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:35:42 smithi121 ceph-mon[16788]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-08-18T22:35:42.360 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:35:42 smithi121 ceph-mon[16788]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi121:9093"}]: dispatch 2024-08-18T22:35:42.360 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:35:42 smithi121 ceph-mon[16788]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-08-18T22:35:42.360 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:35:42 smithi121 ceph-mon[16788]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi121:3000"}]: dispatch 2024-08-18T22:35:42.360 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:35:42 smithi121 ceph-mon[16788]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-08-18T22:35:42.360 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:35:42 smithi121 ceph-mon[16788]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi121:9095"}]: dispatch 2024-08-18T22:35:42.467 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:35:42 smithi195 ceph-mon[23370]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-18T22:35:42.467 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:35:42 smithi195 ceph-mon[23370]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-08-18T22:35:42.468 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:35:42 smithi195 ceph-mon[23370]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi121:9093"}]: dispatch 2024-08-18T22:35:42.468 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:35:42 smithi195 ceph-mon[23370]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-08-18T22:35:42.468 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:35:42 smithi195 ceph-mon[23370]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi121:3000"}]: dispatch 2024-08-18T22:35:42.468 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:35:42 smithi195 ceph-mon[23370]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-08-18T22:35:42.468 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:35:42 smithi195 ceph-mon[23370]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi121:9095"}]: dispatch 2024-08-18T22:35:44.075 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:35:43 smithi121 ceph-mon[16788]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-18T22:35:44.143 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:35:43 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:35:44.143 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:35:43 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:35:44.143 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:35:43 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:35:44.143 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:35:43 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:35:44.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:35:43 smithi195 ceph-mon[23370]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-18T22:35:44.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:35:43 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:35:44.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:35:43 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:35:44.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:35:43 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:35:44.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:35:43 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:35:46.108 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:35:45 smithi121 ceph-mon[16788]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-18T22:35:46.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:35:45 smithi195 ceph-mon[23370]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-18T22:35:48.051 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:35:47 smithi121 ceph-mon[16788]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-18T22:35:48.051 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:35:47 smithi121 ceph-mon[16788]: from='osd.0 [v2:172.21.15.121:6802/3702842813,v1:172.21.15.121:6803/3702842813]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-08-18T22:35:48.086 INFO:teuthology.orchestra.run.smithi121.stdout:Created osd(s) 0 on host 'smithi121' 2024-08-18T22:35:48.086 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:35:48.084+0000 7fdf0cff9640 1 -- 172.21.15.121:0/1693886870 <== mgr.14206 v2:172.21.15.121:6800/3225195982 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fdf1010ed90 con 0x7fdef8067110 2024-08-18T22:35:48.088 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:35:48.087+0000 7fdf1649f640 1 -- 172.21.15.121:0/1693886870 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7fdef8067110 msgr2=0x7fdef80695c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:35:48.088 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:35:48.087+0000 7fdf1649f640 1 --2- 172.21.15.121:0/1693886870 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7fdef8067110 0x7fdef80695c0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fdf1010cc70 tx=0x7fdf00009120 comp rx=0 tx=0).stop 2024-08-18T22:35:48.088 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:35:48.087+0000 7fdf1649f640 1 -- 172.21.15.121:0/1693886870 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdf100ff420 msgr2=0x7fdf1010d420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:35:48.088 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:35:48.087+0000 7fdf1649f640 1 --2- 172.21.15.121:0/1693886870 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdf100ff420 0x7fdf1010d420 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fdf04003080 tx=0x7fdf04009da0 comp rx=0 tx=0).stop 2024-08-18T22:35:48.088 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:35:48.087+0000 7fdf1649f640 1 -- 172.21.15.121:0/1693886870 shutdown_connections 2024-08-18T22:35:48.089 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:35:48.087+0000 7fdf1649f640 1 --2- 172.21.15.121:0/1693886870 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7fdef8067110 0x7fdef80695c0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:35:48.089 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:35:48.087+0000 7fdf1649f640 1 --2- 172.21.15.121:0/1693886870 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdf100ff420 0x7fdf1010d420 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:35:48.089 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:35:48.087+0000 7fdf1649f640 1 --2- 172.21.15.121:0/1693886870 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdf100659e0 0x7fdf1010cee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:35:48.089 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:35:48.087+0000 7fdf1649f640 1 -- 172.21.15.121:0/1693886870 >> 172.21.15.121:0/1693886870 conn(0x7fdf100f69b0 msgr2=0x7fdf100f6d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:35:48.089 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:35:48.087+0000 7fdf1649f640 1 -- 172.21.15.121:0/1693886870 shutdown_connections 2024-08-18T22:35:48.089 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:35:48.087+0000 7fdf1649f640 1 -- 172.21.15.121:0/1693886870 wait complete. 2024-08-18T22:35:48.134 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:35:47 smithi195 ceph-mon[23370]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-18T22:35:48.134 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:35:47 smithi195 ceph-mon[23370]: from='osd.0 [v2:172.21.15.121:6802/3702842813,v1:172.21.15.121:6803/3702842813]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-08-18T22:35:48.704 DEBUG:teuthology.orchestra.run.smithi121:osd.0> sudo journalctl -f -n 0 -u ceph-b003123a-5db1-11ef-bccf-c7b262605968@osd.0.service 2024-08-18T22:35:48.707 INFO:tasks.cephadm:Deploying osd.1 on smithi121 with /dev/vg_nvme/lv_3... 2024-08-18T22:35:48.707 DEBUG:teuthology.orchestra.run.smithi121:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b003123a-5db1-11ef-bccf-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-08-18T22:35:48.951 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:35:48 smithi121 ceph-mon[16788]: from='osd.0 [v2:172.21.15.121:6802/3702842813,v1:172.21.15.121:6803/3702842813]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-08-18T22:35:48.951 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:35:48 smithi121 ceph-mon[16788]: osdmap e7: 1 total, 0 up, 1 in 2024-08-18T22:35:48.951 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:35:48 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-08-18T22:35:48.952 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:35:48 smithi121 ceph-mon[16788]: from='osd.0 [v2:172.21.15.121:6802/3702842813,v1:172.21.15.121:6803/3702842813]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi121", "root=default"]}]: dispatch 2024-08-18T22:35:48.952 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:35:48 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:35:48.952 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:35:48 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:35:48.952 INFO:journalctl@ceph.osd.0.smithi121.stdout:Aug 18 22:35:48 smithi121 ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-0[35316]: 2024-08-18T22:35:48.848+0000 7f8135768640 -1 osd.0 0 waiting for initial osdmap 2024-08-18T22:35:48.952 INFO:journalctl@ceph.osd.0.smithi121.stdout:Aug 18 22:35:48 smithi121 ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-0[35316]: 2024-08-18T22:35:48.852+0000 7f812fd9e640 -1 osd.0 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-18T22:35:49.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:35:48 smithi195 ceph-mon[23370]: from='osd.0 [v2:172.21.15.121:6802/3702842813,v1:172.21.15.121:6803/3702842813]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-08-18T22:35:49.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:35:48 smithi195 ceph-mon[23370]: osdmap e7: 1 total, 0 up, 1 in 2024-08-18T22:35:49.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:35:48 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-08-18T22:35:49.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:35:48 smithi195 ceph-mon[23370]: from='osd.0 [v2:172.21.15.121:6802/3702842813,v1:172.21.15.121:6803/3702842813]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi121", "root=default"]}]: dispatch 2024-08-18T22:35:49.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:35:48 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:35:49.160 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:35:48 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:35:49.441 INFO:teuthology.orchestra.run.smithi121.stderr:Inferring config /var/lib/ceph/b003123a-5db1-11ef-bccf-c7b262605968/mon.smithi121/config 2024-08-18T22:35:50.125 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:35:49 smithi195 ceph-mon[23370]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-18T22:35:50.125 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:35:49 smithi195 ceph-mon[23370]: from='osd.0 [v2:172.21.15.121:6802/3702842813,v1:172.21.15.121:6803/3702842813]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi121", "root=default"]}]': finished 2024-08-18T22:35:50.125 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:35:49 smithi195 ceph-mon[23370]: osdmap e8: 1 total, 0 up, 1 in 2024-08-18T22:35:50.125 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:35:49 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-08-18T22:35:50.125 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:35:49 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-08-18T22:35:50.125 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:35:49 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:35:50.125 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:35:49 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:35:50.333 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:35:49 smithi121 ceph-mon[16788]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-18T22:35:50.333 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:35:49 smithi121 ceph-mon[16788]: from='osd.0 [v2:172.21.15.121:6802/3702842813,v1:172.21.15.121:6803/3702842813]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi121", "root=default"]}]': finished 2024-08-18T22:35:50.334 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:35:49 smithi121 ceph-mon[16788]: osdmap e8: 1 total, 0 up, 1 in 2024-08-18T22:35:50.334 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:35:49 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-08-18T22:35:50.334 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:35:49 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-08-18T22:35:50.334 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:35:49 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:35:50.334 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:35:49 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:35:51.038 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:35:50 smithi121 ceph-mon[16788]: purged_snaps scrub starts 2024-08-18T22:35:51.038 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:35:50 smithi121 ceph-mon[16788]: purged_snaps scrub ok 2024-08-18T22:35:51.039 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:35:50 smithi121 ceph-mon[16788]: osd.0 [v2:172.21.15.121:6802/3702842813,v1:172.21.15.121:6803/3702842813] boot 2024-08-18T22:35:51.039 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:35:50 smithi121 ceph-mon[16788]: osdmap e9: 1 total, 1 up, 1 in 2024-08-18T22:35:51.039 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:35:50 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-08-18T22:35:51.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:35:50 smithi195 ceph-mon[23370]: purged_snaps scrub starts 2024-08-18T22:35:51.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:35:50 smithi195 ceph-mon[23370]: purged_snaps scrub ok 2024-08-18T22:35:51.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:35:50 smithi195 ceph-mon[23370]: osd.0 [v2:172.21.15.121:6802/3702842813,v1:172.21.15.121:6803/3702842813] boot 2024-08-18T22:35:51.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:35:50 smithi195 ceph-mon[23370]: osdmap e9: 1 total, 1 up, 1 in 2024-08-18T22:35:51.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:35:50 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-08-18T22:35:51.747 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-08-18T22:35:51.766 DEBUG:teuthology.orchestra.run.smithi121:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b003123a-5db1-11ef-bccf-c7b262605968 -- ceph orch daemon add osd smithi121:vg_nvme/lv_3 2024-08-18T22:35:52.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:35:51 smithi121 ceph-mon[16788]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-18T22:35:52.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:35:51 smithi121 ceph-mon[16788]: osdmap e10: 1 total, 1 up, 1 in 2024-08-18T22:35:52.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:35:51 smithi195 ceph-mon[23370]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-18T22:35:52.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:35:51 smithi195 ceph-mon[23370]: osdmap e10: 1 total, 1 up, 1 in 2024-08-18T22:35:52.582 INFO:teuthology.orchestra.run.smithi121.stderr:Inferring config /var/lib/ceph/b003123a-5db1-11ef-bccf-c7b262605968/mon.smithi121/config 2024-08-18T22:35:53.964 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:35:53 smithi121 ceph-mon[16788]: pgmap v35: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-08-18T22:35:53.964 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:35:53 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-18T22:35:54.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:35:53 smithi195 ceph-mon[23370]: pgmap v35: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-08-18T22:35:54.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:35:53 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-18T22:35:54.342 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:35:54.330+0000 7efe0aeb9640 1 -- 172.21.15.121:0/3148896120 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efe040fc2c0 msgr2=0x7efe040fc6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:35:54.342 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:35:54.330+0000 7efe0aeb9640 1 --2- 172.21.15.121:0/3148896120 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efe040fc2c0 0x7efe040fc6d0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7efdec0048d0 tx=0x7efdec009da0 comp rx=0 tx=0).stop 2024-08-18T22:35:54.342 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:35:54.330+0000 7efe0aeb9640 1 -- 172.21.15.121:0/3148896120 shutdown_connections 2024-08-18T22:35:54.343 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:35:54.330+0000 7efe0aeb9640 1 --2- 172.21.15.121:0/3148896120 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7efe040fd590 0x7efe040fda00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:35:54.343 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:35:54.330+0000 7efe0aeb9640 1 --2- 172.21.15.121:0/3148896120 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efe040fc2c0 0x7efe040fc6d0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:35:54.343 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:35:54.330+0000 7efe0aeb9640 1 -- 172.21.15.121:0/3148896120 >> 172.21.15.121:0/3148896120 conn(0x7efe040f7a80 msgr2=0x7efe040f9eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:35:54.343 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:35:54.330+0000 7efe0aeb9640 1 -- 172.21.15.121:0/3148896120 shutdown_connections 2024-08-18T22:35:54.343 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:35:54.330+0000 7efe0aeb9640 1 -- 172.21.15.121:0/3148896120 wait complete. 2024-08-18T22:35:54.343 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:35:54.330+0000 7efe0aeb9640 1 Processor -- start 2024-08-18T22:35:54.343 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:35:54.330+0000 7efe0aeb9640 1 -- start start 2024-08-18T22:35:54.343 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:35:54.331+0000 7efe0aeb9640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7efe040fc2c0 0x7efe0410ce40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:35:54.343 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:35:54.331+0000 7efe0aeb9640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efe040fd590 0x7efe0410d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:35:54.343 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:35:54.331+0000 7efe0aeb9640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe0410d9d0 con 0x7efe040fd590 2024-08-18T22:35:54.343 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:35:54.331+0000 7efe0aeb9640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe0410e110 con 0x7efe040fc2c0 2024-08-18T22:35:54.343 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:35:54.331+0000 7efe03fff640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efe040fd590 0x7efe0410d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:35:54.344 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:35:54.331+0000 7efe03fff640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efe040fd590 0x7efe0410d380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:39852/0 (socket says 172.21.15.121:39852) 2024-08-18T22:35:54.344 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:35:54.331+0000 7efe03fff640 1 -- 172.21.15.121:0/2473894265 learned_addr learned my addr 172.21.15.121:0/2473894265 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-18T22:35:54.344 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:35:54.331+0000 7efe08c55640 1 --2- 172.21.15.121:0/2473894265 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7efe040fc2c0 0x7efe0410ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:35:54.344 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:35:54.331+0000 7efe03fff640 1 -- 172.21.15.121:0/2473894265 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7efe040fc2c0 msgr2=0x7efe0410ce40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:35:54.344 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:35:54.331+0000 7efe03fff640 1 --2- 172.21.15.121:0/2473894265 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7efe040fc2c0 0x7efe0410ce40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:35:54.344 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:35:54.331+0000 7efe03fff640 1 -- 172.21.15.121:0/2473894265 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdec005040 con 0x7efe040fd590 2024-08-18T22:35:54.344 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:35:54.331+0000 7efe08c55640 1 --2- 172.21.15.121:0/2473894265 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7efe040fc2c0 0x7efe0410ce40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:35:54.344 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:35:54.331+0000 7efe03fff640 1 --2- 172.21.15.121:0/2473894265 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efe040fd590 0x7efe0410d380 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7efdf400db50 tx=0x7efdf4004ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:35:54.344 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:35:54.331+0000 7efe017fa640 1 -- 172.21.15.121:0/2473894265 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efdf400b9d0 con 0x7efe040fd590 2024-08-18T22:35:54.344 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:35:54.331+0000 7efe017fa640 1 -- 172.21.15.121:0/2473894265 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7efdf400f040 con 0x7efe040fd590 2024-08-18T22:35:54.344 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:35:54.331+0000 7efe0aeb9640 1 -- 172.21.15.121:0/2473894265 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe0410e3a0 con 0x7efe040fd590 2024-08-18T22:35:54.344 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:35:54.331+0000 7efe017fa640 1 -- 172.21.15.121:0/2473894265 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efdf4012390 con 0x7efe040fd590 2024-08-18T22:35:54.344 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:35:54.332+0000 7efe0aeb9640 1 -- 172.21.15.121:0/2473894265 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe0410e940 con 0x7efe040fd590 2024-08-18T22:35:54.345 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:35:54.333+0000 7efe0aeb9640 1 -- 172.21.15.121:0/2473894265 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe040fb720 con 0x7efe040fd590 2024-08-18T22:35:54.345 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:35:54.333+0000 7efe017fa640 1 -- 172.21.15.121:0/2473894265 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 18) v1 ==== 85071+0+0 (secure 0 0 0) 0x7efdf40137e0 con 0x7efe040fd590 2024-08-18T22:35:54.345 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:35:54.333+0000 7efe017fa640 1 --2- 172.21.15.121:0/2473894265 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7efdf0067100 0x7efdf00695b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:35:54.345 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:35:54.334+0000 7efe017fa640 1 -- 172.21.15.121:0/2473894265 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1978+0+0 (secure 0 0 0) 0x7efdf40840b0 con 0x7efe040fd590 2024-08-18T22:35:54.345 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:35:54.334+0000 7efe08c55640 1 --2- 172.21.15.121:0/2473894265 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7efdf0067100 0x7efdf00695b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:35:54.345 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:35:54.334+0000 7efe08c55640 1 --2- 172.21.15.121:0/2473894265 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7efdf0067100 0x7efdf00695b0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7efdec007ac0 tx=0x7efdec035040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:35:54.345 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:35:54.338+0000 7efe017fa640 1 -- 172.21.15.121:0/2473894265 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7efdf4052250 con 0x7efe040fd590 2024-08-18T22:35:54.508 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:35:54.506+0000 7efe0aeb9640 1 -- 172.21.15.121:0/2473894265 --> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi121:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7efe0410edc0 con 0x7efdf0067100 2024-08-18T22:35:55.030 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:35:54 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-08-18T22:35:55.031 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:35:54 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-08-18T22:35:55.031 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:35:54 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:35:55.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:35:54 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-08-18T22:35:55.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:35:54 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-08-18T22:35:55.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:35:54 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:35:56.334 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:35:56 smithi121 ceph-mon[16788]: from='client.14258 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi121:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-08-18T22:35:56.334 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:35:56 smithi121 ceph-mon[16788]: pgmap v36: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-08-18T22:35:56.334 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:35:56 smithi121 ceph-mon[16788]: Detected new or changed devices on smithi121 2024-08-18T22:35:56.334 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:35:56 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:35:56.334 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:35:56 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:35:56.334 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:35:56 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-08-18T22:35:56.334 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:35:56 smithi121 ceph-mon[16788]: Adjusting osd_memory_target on smithi121 to 12863M 2024-08-18T22:35:56.334 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:35:56 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:35:56.334 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:35:56 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:35:56.334 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:35:56 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-18T22:35:56.334 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:35:56 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:35:56.335 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:35:56 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-18T22:35:56.392 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:35:56 smithi195 ceph-mon[23370]: from='client.14258 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi121:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-08-18T22:35:56.392 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:35:56 smithi195 ceph-mon[23370]: pgmap v36: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-08-18T22:35:56.392 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:35:56 smithi195 ceph-mon[23370]: Detected new or changed devices on smithi121 2024-08-18T22:35:56.392 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:35:56 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:35:56.392 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:35:56 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:35:56.392 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:35:56 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-08-18T22:35:56.393 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:35:56 smithi195 ceph-mon[23370]: Adjusting osd_memory_target on smithi121 to 12863M 2024-08-18T22:35:56.393 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:35:56 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:35:56.393 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:35:56 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:35:56.393 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:35:56 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-18T22:35:56.393 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:35:56 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:35:56.393 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:35:56 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-18T22:35:58.108 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:35:57 smithi121 ceph-mon[16788]: pgmap v37: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-08-18T22:35:58.108 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:35:57 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:35:58.108 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:35:57 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:35:58.108 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:35:57 smithi121 ceph-mon[16788]: from='client.? 172.21.15.121:0/760890056' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "21393748-75ac-4f55-915c-8ddc79339dba"}]: dispatch 2024-08-18T22:35:58.108 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:35:57 smithi121 ceph-mon[16788]: from='client.? 172.21.15.121:0/760890056' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "21393748-75ac-4f55-915c-8ddc79339dba"}]': finished 2024-08-18T22:35:58.108 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:35:57 smithi121 ceph-mon[16788]: osdmap e11: 2 total, 1 up, 2 in 2024-08-18T22:35:58.108 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:35:57 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-08-18T22:35:58.108 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:35:57 smithi121 ceph-mon[16788]: from='client.? 172.21.15.121:0/3409519138' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-08-18T22:35:58.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:35:57 smithi195 ceph-mon[23370]: pgmap v37: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-08-18T22:35:58.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:35:57 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:35:58.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:35:57 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:35:58.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:35:57 smithi195 ceph-mon[23370]: from='client.? 172.21.15.121:0/760890056' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "21393748-75ac-4f55-915c-8ddc79339dba"}]: dispatch 2024-08-18T22:35:58.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:35:57 smithi195 ceph-mon[23370]: from='client.? 172.21.15.121:0/760890056' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "21393748-75ac-4f55-915c-8ddc79339dba"}]': finished 2024-08-18T22:35:58.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:35:57 smithi195 ceph-mon[23370]: osdmap e11: 2 total, 1 up, 2 in 2024-08-18T22:35:58.160 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:35:57 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-08-18T22:35:58.160 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:35:57 smithi195 ceph-mon[23370]: from='client.? 172.21.15.121:0/3409519138' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-08-18T22:35:59.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:35:59 smithi195 ceph-mon[23370]: pgmap v39: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-08-18T22:36:00.334 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:35:59 smithi121 ceph-mon[16788]: pgmap v39: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-08-18T22:36:01.584 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:36:01 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:36:01.584 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:36:01 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:36:01.584 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:36:01 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:36:01.584 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:36:01 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-18T22:36:01.584 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:36:01 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:36:01.584 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:36:01 smithi121 ceph-mon[16788]: pgmap v40: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-08-18T22:36:01.659 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:36:01 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:36:01.659 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:36:01 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:36:01.659 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:36:01 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:36:01.660 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:36:01 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-18T22:36:01.660 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:36:01 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:36:01.660 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:36:01 smithi195 ceph-mon[23370]: pgmap v40: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-08-18T22:36:03.834 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:36:03 smithi121 ceph-mon[16788]: pgmap v41: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-08-18T22:36:03.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:36:03 smithi195 ceph-mon[23370]: pgmap v41: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-08-18T22:36:04.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:36:04 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-08-18T22:36:04.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:36:04 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:36:04.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:36:04 smithi195 ceph-mon[23370]: Deploying daemon osd.1 on smithi121 2024-08-18T22:36:05.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:36:04 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-08-18T22:36:05.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:36:04 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:36:05.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:36:04 smithi121 ceph-mon[16788]: Deploying daemon osd.1 on smithi121 2024-08-18T22:36:05.895 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:36:05 smithi121 ceph-mon[16788]: pgmap v42: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-08-18T22:36:05.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:36:05 smithi195 ceph-mon[23370]: pgmap v42: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-08-18T22:36:07.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:36:07 smithi195 ceph-mon[23370]: pgmap v43: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-08-18T22:36:08.023 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:36:07 smithi121 ceph-mon[16788]: pgmap v43: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-08-18T22:36:08.768 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:36:08 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-18T22:36:08.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:36:08 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-18T22:36:09.659 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:36:09 smithi195 ceph-mon[23370]: pgmap v44: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-08-18T22:36:09.710 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:36:09 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-18T22:36:09.710 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:36:09 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:36:09.710 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:36:09 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:36:09.813 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:36:09 smithi121 ceph-mon[16788]: pgmap v44: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-08-18T22:36:09.813 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:36:09 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-18T22:36:09.813 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:36:09 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:36:09.813 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:36:09 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:36:11.834 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:36:11 smithi121 ceph-mon[16788]: pgmap v45: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-08-18T22:36:11.834 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:36:11 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:36:11.834 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:36:11 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:36:11.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:36:11 smithi195 ceph-mon[23370]: pgmap v45: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-08-18T22:36:11.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:36:11 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:36:11.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:36:11 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:36:12.580 INFO:teuthology.orchestra.run.smithi121.stdout:Created osd(s) 1 on host 'smithi121' 2024-08-18T22:36:12.581 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:36:12.579+0000 7efe017fa640 1 -- 172.21.15.121:0/2473894265 <== mgr.14206 v2:172.21.15.121:6800/3225195982 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7efe0410edc0 con 0x7efdf0067100 2024-08-18T22:36:12.582 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:36:12.581+0000 7efe0aeb9640 1 -- 172.21.15.121:0/2473894265 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7efdf0067100 msgr2=0x7efdf00695b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:36:12.582 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:36:12.581+0000 7efe0aeb9640 1 --2- 172.21.15.121:0/2473894265 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7efdf0067100 0x7efdf00695b0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7efdec007ac0 tx=0x7efdec035040 comp rx=0 tx=0).stop 2024-08-18T22:36:12.582 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:36:12.581+0000 7efe0aeb9640 1 -- 172.21.15.121:0/2473894265 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efe040fd590 msgr2=0x7efe0410d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:36:12.583 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:36:12.581+0000 7efe0aeb9640 1 --2- 172.21.15.121:0/2473894265 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efe040fd590 0x7efe0410d380 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7efdf400db50 tx=0x7efdf4004ee0 comp rx=0 tx=0).stop 2024-08-18T22:36:12.583 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:36:12.581+0000 7efe0aeb9640 1 -- 172.21.15.121:0/2473894265 shutdown_connections 2024-08-18T22:36:12.583 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:36:12.581+0000 7efe0aeb9640 1 --2- 172.21.15.121:0/2473894265 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7efdf0067100 0x7efdf00695b0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:36:12.583 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:36:12.581+0000 7efe0aeb9640 1 --2- 172.21.15.121:0/2473894265 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efe040fd590 0x7efe0410d380 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:36:12.583 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:36:12.581+0000 7efe0aeb9640 1 --2- 172.21.15.121:0/2473894265 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7efe040fc2c0 0x7efe0410ce40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:36:12.583 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:36:12.581+0000 7efe0aeb9640 1 -- 172.21.15.121:0/2473894265 >> 172.21.15.121:0/2473894265 conn(0x7efe040f7a80 msgr2=0x7efe040f9230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:36:12.583 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:36:12.581+0000 7efe0aeb9640 1 -- 172.21.15.121:0/2473894265 shutdown_connections 2024-08-18T22:36:12.583 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:36:12.581+0000 7efe0aeb9640 1 -- 172.21.15.121:0/2473894265 wait complete. 2024-08-18T22:36:13.804 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:36:13 smithi121 ceph-mon[16788]: pgmap v46: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-08-18T22:36:13.804 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:36:13 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:36:13.804 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:36:13 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:36:13.804 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:36:13 smithi121 ceph-mon[16788]: from='osd.1 [v2:172.21.15.121:6810/1711466097,v1:172.21.15.121:6811/1711466097]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-08-18T22:36:13.832 DEBUG:teuthology.orchestra.run.smithi121:osd.1> sudo journalctl -f -n 0 -u ceph-b003123a-5db1-11ef-bccf-c7b262605968@osd.1.service 2024-08-18T22:36:13.834 INFO:tasks.cephadm:Deploying osd.2 on smithi121 with /dev/vg_nvme/lv_2... 2024-08-18T22:36:13.834 DEBUG:teuthology.orchestra.run.smithi121:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b003123a-5db1-11ef-bccf-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-08-18T22:36:13.911 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:36:13 smithi195 ceph-mon[23370]: pgmap v46: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-08-18T22:36:13.911 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:36:13 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:36:13.911 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:36:13 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:36:13.911 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:36:13 smithi195 ceph-mon[23370]: from='osd.1 [v2:172.21.15.121:6810/1711466097,v1:172.21.15.121:6811/1711466097]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-08-18T22:36:14.185 INFO:teuthology.orchestra.run.smithi121.stderr:Inferring config /var/lib/ceph/b003123a-5db1-11ef-bccf-c7b262605968/mon.smithi121/config 2024-08-18T22:36:14.834 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:36:14 smithi121 ceph-mon[16788]: from='osd.1 [v2:172.21.15.121:6810/1711466097,v1:172.21.15.121:6811/1711466097]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-08-18T22:36:14.834 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:36:14 smithi121 ceph-mon[16788]: osdmap e12: 2 total, 1 up, 2 in 2024-08-18T22:36:14.834 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:36:14 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-08-18T22:36:14.834 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:36:14 smithi121 ceph-mon[16788]: from='osd.1 [v2:172.21.15.121:6810/1711466097,v1:172.21.15.121:6811/1711466097]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi121", "root=default"]}]: dispatch 2024-08-18T22:36:14.834 INFO:journalctl@ceph.osd.1.smithi121.stdout:Aug 18 22:36:14 smithi121 ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-1[42807]: 2024-08-18T22:36:14.590+0000 7f36ccb32640 -1 osd.1 0 waiting for initial osdmap 2024-08-18T22:36:14.834 INFO:journalctl@ceph.osd.1.smithi121.stdout:Aug 18 22:36:14 smithi121 ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-1[42807]: 2024-08-18T22:36:14.594+0000 7f36c7168640 -1 osd.1 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-18T22:36:14.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:36:14 smithi195 ceph-mon[23370]: from='osd.1 [v2:172.21.15.121:6810/1711466097,v1:172.21.15.121:6811/1711466097]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-08-18T22:36:14.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:36:14 smithi195 ceph-mon[23370]: osdmap e12: 2 total, 1 up, 2 in 2024-08-18T22:36:14.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:36:14 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-08-18T22:36:14.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:36:14 smithi195 ceph-mon[23370]: from='osd.1 [v2:172.21.15.121:6810/1711466097,v1:172.21.15.121:6811/1711466097]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi121", "root=default"]}]: dispatch 2024-08-18T22:36:15.903 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:36:15 smithi121 ceph-mon[16788]: pgmap v48: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-08-18T22:36:15.903 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:36:15 smithi121 ceph-mon[16788]: from='osd.1 [v2:172.21.15.121:6810/1711466097,v1:172.21.15.121:6811/1711466097]' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi121", "root=default"]}]': finished 2024-08-18T22:36:15.903 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:36:15 smithi121 ceph-mon[16788]: osdmap e13: 2 total, 1 up, 2 in 2024-08-18T22:36:15.903 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:36:15 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-08-18T22:36:15.903 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:36:15 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-08-18T22:36:15.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:36:15 smithi195 ceph-mon[23370]: pgmap v48: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-08-18T22:36:15.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:36:15 smithi195 ceph-mon[23370]: from='osd.1 [v2:172.21.15.121:6810/1711466097,v1:172.21.15.121:6811/1711466097]' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi121", "root=default"]}]': finished 2024-08-18T22:36:15.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:36:15 smithi195 ceph-mon[23370]: osdmap e13: 2 total, 1 up, 2 in 2024-08-18T22:36:15.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:36:15 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-08-18T22:36:15.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:36:15 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-08-18T22:36:16.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:36:16 smithi195 ceph-mon[23370]: purged_snaps scrub starts 2024-08-18T22:36:16.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:36:16 smithi195 ceph-mon[23370]: purged_snaps scrub ok 2024-08-18T22:36:16.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:36:16 smithi195 ceph-mon[23370]: osd.1 [v2:172.21.15.121:6810/1711466097,v1:172.21.15.121:6811/1711466097] boot 2024-08-18T22:36:16.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:36:16 smithi195 ceph-mon[23370]: osdmap e14: 2 total, 2 up, 2 in 2024-08-18T22:36:16.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:36:16 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-08-18T22:36:17.009 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:36:16 smithi121 ceph-mon[16788]: purged_snaps scrub starts 2024-08-18T22:36:17.009 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:36:16 smithi121 ceph-mon[16788]: purged_snaps scrub ok 2024-08-18T22:36:17.009 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:36:16 smithi121 ceph-mon[16788]: osd.1 [v2:172.21.15.121:6810/1711466097,v1:172.21.15.121:6811/1711466097] boot 2024-08-18T22:36:17.009 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:36:16 smithi121 ceph-mon[16788]: osdmap e14: 2 total, 2 up, 2 in 2024-08-18T22:36:17.009 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:36:16 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-08-18T22:36:17.015 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-08-18T22:36:17.035 DEBUG:teuthology.orchestra.run.smithi121:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b003123a-5db1-11ef-bccf-c7b262605968 -- ceph orch daemon add osd smithi121:vg_nvme/lv_2 2024-08-18T22:36:17.315 INFO:teuthology.orchestra.run.smithi121.stderr:Inferring config /var/lib/ceph/b003123a-5db1-11ef-bccf-c7b262605968/mon.smithi121/config 2024-08-18T22:36:17.738 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:36:17 smithi121 ceph-mon[16788]: pgmap v51: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-08-18T22:36:17.738 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:36:17 smithi121 ceph-mon[16788]: osdmap e15: 2 total, 2 up, 2 in 2024-08-18T22:36:17.738 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:36:17 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:36:17.738 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:36:17 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:36:17.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:36:17 smithi195 ceph-mon[23370]: pgmap v51: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-08-18T22:36:17.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:36:17 smithi195 ceph-mon[23370]: osdmap e15: 2 total, 2 up, 2 in 2024-08-18T22:36:17.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:36:17 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:36:17.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:36:17 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:36:18.951 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:36:18.948+0000 7f8773f2b640 1 -- 172.21.15.121:0/1024464136 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f876c0fd5c0 msgr2=0x7f876c0fda30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:36:18.952 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:36:18.948+0000 7f8773f2b640 1 --2- 172.21.15.121:0/1024464136 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f876c0fd5c0 0x7f876c0fda30 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f875c0048d0 tx=0x7f875c009da0 comp rx=0 tx=0).stop 2024-08-18T22:36:18.952 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:36:18.949+0000 7f8773f2b640 1 -- 172.21.15.121:0/1024464136 shutdown_connections 2024-08-18T22:36:18.952 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:36:18.949+0000 7f8773f2b640 1 --2- 172.21.15.121:0/1024464136 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f876c0fd5c0 0x7f876c0fda30 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:36:18.952 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:36:18.949+0000 7f8773f2b640 1 --2- 172.21.15.121:0/1024464136 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f876c0fc2f0 0x7f876c0fc700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:36:18.952 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:36:18.949+0000 7f8773f2b640 1 -- 172.21.15.121:0/1024464136 >> 172.21.15.121:0/1024464136 conn(0x7f876c0f7ad0 msgr2=0x7f876c0f9ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:36:18.952 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:36:18.949+0000 7f8773f2b640 1 -- 172.21.15.121:0/1024464136 shutdown_connections 2024-08-18T22:36:18.952 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:36:18.949+0000 7f8773f2b640 1 -- 172.21.15.121:0/1024464136 wait complete. 2024-08-18T22:36:18.952 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:36:18.949+0000 7f8773f2b640 1 Processor -- start 2024-08-18T22:36:18.952 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:36:18.949+0000 7f8773f2b640 1 -- start start 2024-08-18T22:36:18.952 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:36:18.949+0000 7f8773f2b640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f876c0fc2f0 0x7f876c10ce90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:36:18.953 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:36:18.949+0000 7f8773f2b640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f876c0fd5c0 0x7f876c10d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:36:18.953 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:36:18.949+0000 7f8773f2b640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f876c10da20 con 0x7f876c0fc2f0 2024-08-18T22:36:18.953 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:36:18.949+0000 7f8773f2b640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f876c10e160 con 0x7f876c0fd5c0 2024-08-18T22:36:18.953 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:36:18.949+0000 7f8771cc7640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f876c0fc2f0 0x7f876c10ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:36:18.953 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:36:18.949+0000 7f8771cc7640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f876c0fc2f0 0x7f876c10ce90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:37206/0 (socket says 172.21.15.121:37206) 2024-08-18T22:36:18.953 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:36:18.949+0000 7f8771cc7640 1 -- 172.21.15.121:0/1581980661 learned_addr learned my addr 172.21.15.121:0/1581980661 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-18T22:36:18.953 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:36:18.950+0000 7f87714c6640 1 --2- 172.21.15.121:0/1581980661 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f876c0fd5c0 0x7f876c10d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:36:18.953 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:36:18.950+0000 7f8771cc7640 1 -- 172.21.15.121:0/1581980661 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f876c0fd5c0 msgr2=0x7f876c10d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:36:18.953 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:36:18.950+0000 7f8771cc7640 1 --2- 172.21.15.121:0/1581980661 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f876c0fd5c0 0x7f876c10d3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:36:18.953 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:36:18.950+0000 7f8771cc7640 1 -- 172.21.15.121:0/1581980661 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f875c005040 con 0x7f876c0fc2f0 2024-08-18T22:36:18.953 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:36:18.950+0000 7f8771cc7640 1 --2- 172.21.15.121:0/1581980661 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f876c0fc2f0 0x7f876c10ce90 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f8768002a50 tx=0x7f8768004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:36:18.953 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:36:18.950+0000 7f87627fc640 1 -- 172.21.15.121:0/1581980661 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8768007c30 con 0x7f876c0fc2f0 2024-08-18T22:36:18.953 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:36:18.950+0000 7f8773f2b640 1 -- 172.21.15.121:0/1581980661 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f876c10e3f0 con 0x7f876c0fc2f0 2024-08-18T22:36:18.954 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:36:18.950+0000 7f87627fc640 1 -- 172.21.15.121:0/1581980661 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f876800f040 con 0x7f876c0fc2f0 2024-08-18T22:36:18.954 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:36:18.950+0000 7f87627fc640 1 -- 172.21.15.121:0/1581980661 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f876800da10 con 0x7f876c0fc2f0 2024-08-18T22:36:18.954 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:36:18.950+0000 7f8773f2b640 1 -- 172.21.15.121:0/1581980661 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f876c10e990 con 0x7f876c0fc2f0 2024-08-18T22:36:18.955 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:36:18.951+0000 7f8773f2b640 1 -- 172.21.15.121:0/1581980661 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f876c0fb750 con 0x7f876c0fc2f0 2024-08-18T22:36:18.955 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:36:18.951+0000 7f87627fc640 1 -- 172.21.15.121:0/1581980661 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 18) v1 ==== 85071+0+0 (secure 0 0 0) 0x7f876800dc80 con 0x7f876c0fc2f0 2024-08-18T22:36:18.955 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:36:18.952+0000 7f87627fc640 1 --2- 172.21.15.121:0/1581980661 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7f8758067100 0x7f87580695b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:36:18.955 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:36:18.952+0000 7f87627fc640 1 -- 172.21.15.121:0/1581980661 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 2410+0+0 (secure 0 0 0) 0x7f8768083600 con 0x7f876c0fc2f0 2024-08-18T22:36:18.955 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:36:18.952+0000 7f87714c6640 1 --2- 172.21.15.121:0/1581980661 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7f8758067100 0x7f87580695b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:36:18.955 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:36:18.952+0000 7f87714c6640 1 --2- 172.21.15.121:0/1581980661 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7f8758067100 0x7f87580695b0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f875c00b020 tx=0x7f875c035040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:36:18.957 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:36:18.956+0000 7f87627fc640 1 -- 172.21.15.121:0/1581980661 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f876804d2a0 con 0x7f876c0fc2f0 2024-08-18T22:36:19.125 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:36:19.124+0000 7f8773f2b640 1 -- 172.21.15.121:0/1581980661 --> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi121:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7f876c10ed20 con 0x7f8758067100 2024-08-18T22:36:19.893 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:36:19 smithi121 ceph-mon[16788]: pgmap v53: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-08-18T22:36:19.893 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:36:19 smithi121 ceph-mon[16788]: from='client.14276 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi121:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-08-18T22:36:19.893 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:36:19 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-08-18T22:36:19.893 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:36:19 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-08-18T22:36:19.893 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:36:19 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:36:19.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:36:19 smithi195 ceph-mon[23370]: pgmap v53: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-08-18T22:36:19.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:36:19 smithi195 ceph-mon[23370]: from='client.14276 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi121:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-08-18T22:36:19.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:36:19 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-08-18T22:36:19.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:36:19 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-08-18T22:36:19.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:36:19 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:36:21.723 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:36:21 smithi121 ceph-mon[16788]: pgmap v54: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-08-18T22:36:21.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:36:21 smithi195 ceph-mon[23370]: pgmap v54: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-08-18T22:36:22.834 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:36:22 smithi121 ceph-mon[16788]: Detected new or changed devices on smithi121 2024-08-18T22:36:22.834 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:36:22 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:36:22.834 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:36:22 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:36:22.834 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:36:22 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-08-18T22:36:22.834 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:36:22 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-08-18T22:36:22.834 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:36:22 smithi121 ceph-mon[16788]: Adjusting osd_memory_target on smithi121 to 6431M 2024-08-18T22:36:22.834 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:36:22 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:36:22.834 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:36:22 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:36:22.834 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:36:22 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-18T22:36:22.834 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:36:22 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:36:22.834 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:36:22 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-18T22:36:22.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:36:22 smithi195 ceph-mon[23370]: Detected new or changed devices on smithi121 2024-08-18T22:36:22.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:36:22 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:36:22.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:36:22 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:36:22.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:36:22 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-08-18T22:36:22.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:36:22 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-08-18T22:36:22.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:36:22 smithi195 ceph-mon[23370]: Adjusting osd_memory_target on smithi121 to 6431M 2024-08-18T22:36:22.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:36:22 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:36:22.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:36:22 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:36:22.910 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:36:22 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-18T22:36:22.910 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:36:22 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:36:22.910 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:36:22 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-18T22:36:23.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:36:23 smithi195 ceph-mon[23370]: pgmap v55: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-08-18T22:36:23.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:36:23 smithi195 ceph-mon[23370]: from='client.? 172.21.15.121:0/2254562946' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "79b07f6b-e26d-4ed7-b014-459c177f41ba"}]: dispatch 2024-08-18T22:36:23.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:36:23 smithi195 ceph-mon[23370]: from='client.? 172.21.15.121:0/2254562946' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "79b07f6b-e26d-4ed7-b014-459c177f41ba"}]': finished 2024-08-18T22:36:23.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:36:23 smithi195 ceph-mon[23370]: osdmap e16: 3 total, 2 up, 3 in 2024-08-18T22:36:23.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:36:23 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-08-18T22:36:23.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:36:23 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-18T22:36:23.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:36:23 smithi195 ceph-mon[23370]: from='client.? 172.21.15.121:0/836491630' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-08-18T22:36:24.070 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:36:23 smithi121 ceph-mon[16788]: pgmap v55: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-08-18T22:36:24.071 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:36:23 smithi121 ceph-mon[16788]: from='client.? 172.21.15.121:0/2254562946' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "79b07f6b-e26d-4ed7-b014-459c177f41ba"}]: dispatch 2024-08-18T22:36:24.071 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:36:23 smithi121 ceph-mon[16788]: from='client.? 172.21.15.121:0/2254562946' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "79b07f6b-e26d-4ed7-b014-459c177f41ba"}]': finished 2024-08-18T22:36:24.071 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:36:23 smithi121 ceph-mon[16788]: osdmap e16: 3 total, 2 up, 3 in 2024-08-18T22:36:24.071 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:36:23 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-08-18T22:36:24.071 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:36:23 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-18T22:36:24.071 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:36:23 smithi121 ceph-mon[16788]: from='client.? 172.21.15.121:0/836491630' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-08-18T22:36:25.903 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:36:25 smithi121 ceph-mon[16788]: pgmap v57: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-08-18T22:36:25.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:36:25 smithi195 ceph-mon[23370]: pgmap v57: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-08-18T22:36:27.583 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:36:27 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:36:27.583 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:36:27 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:36:27.584 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:36:27 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:36:27.584 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:36:27 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-18T22:36:27.584 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:36:27 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:36:27.584 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:36:27 smithi121 ceph-mon[16788]: pgmap v58: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-08-18T22:36:27.659 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:36:27 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:36:27.659 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:36:27 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:36:27.659 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:36:27 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:36:27.659 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:36:27 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-18T22:36:27.659 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:36:27 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:36:27.659 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:36:27 smithi195 ceph-mon[23370]: pgmap v58: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-08-18T22:36:29.897 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:36:29 smithi121 ceph-mon[16788]: pgmap v59: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-08-18T22:36:29.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:36:29 smithi195 ceph-mon[23370]: pgmap v59: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-08-18T22:36:30.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:36:30 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-08-18T22:36:30.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:36:30 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:36:30.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:36:30 smithi195 ceph-mon[23370]: Deploying daemon osd.2 on smithi121 2024-08-18T22:36:31.080 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:36:30 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-08-18T22:36:31.080 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:36:30 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:36:31.080 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:36:30 smithi121 ceph-mon[16788]: Deploying daemon osd.2 on smithi121 2024-08-18T22:36:31.609 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:36:31 smithi121 ceph-mon[16788]: pgmap v60: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-08-18T22:36:31.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:36:31 smithi195 ceph-mon[23370]: pgmap v60: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-08-18T22:36:33.644 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:36:33 smithi121 ceph-mon[16788]: pgmap v61: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-08-18T22:36:33.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:36:33 smithi195 ceph-mon[23370]: pgmap v61: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-08-18T22:36:35.904 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:36:35 smithi121 ceph-mon[16788]: pgmap v62: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-08-18T22:36:35.905 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:36:35 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-18T22:36:35.905 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:36:35 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:36:35.905 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:36:35 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:36:35.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:36:35 smithi195 ceph-mon[23370]: pgmap v62: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-08-18T22:36:35.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:36:35 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-18T22:36:35.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:36:35 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:36:35.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:36:35 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:36:37.422 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:36:37.421+0000 7f87627fc640 1 -- 172.21.15.121:0/1581980661 <== mgr.14206 v2:172.21.15.121:6800/3225195982 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f876c10ed20 con 0x7f8758067100 2024-08-18T22:36:37.423 INFO:teuthology.orchestra.run.smithi121.stdout:Created osd(s) 2 on host 'smithi121' 2024-08-18T22:36:37.424 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:36:37.423+0000 7f8773f2b640 1 -- 172.21.15.121:0/1581980661 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7f8758067100 msgr2=0x7f87580695b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:36:37.425 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:36:37.423+0000 7f8773f2b640 1 --2- 172.21.15.121:0/1581980661 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7f8758067100 0x7f87580695b0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f875c00b020 tx=0x7f875c035040 comp rx=0 tx=0).stop 2024-08-18T22:36:37.425 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:36:37.423+0000 7f8773f2b640 1 -- 172.21.15.121:0/1581980661 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f876c0fc2f0 msgr2=0x7f876c10ce90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:36:37.425 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:36:37.423+0000 7f8773f2b640 1 --2- 172.21.15.121:0/1581980661 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f876c0fc2f0 0x7f876c10ce90 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f8768002a50 tx=0x7f8768004600 comp rx=0 tx=0).stop 2024-08-18T22:36:37.425 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:36:37.423+0000 7f8773f2b640 1 -- 172.21.15.121:0/1581980661 shutdown_connections 2024-08-18T22:36:37.425 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:36:37.423+0000 7f8773f2b640 1 --2- 172.21.15.121:0/1581980661 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7f8758067100 0x7f87580695b0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:36:37.425 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:36:37.423+0000 7f8773f2b640 1 --2- 172.21.15.121:0/1581980661 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f876c0fd5c0 0x7f876c10d3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:36:37.425 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:36:37.423+0000 7f8773f2b640 1 --2- 172.21.15.121:0/1581980661 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f876c0fc2f0 0x7f876c10ce90 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:36:37.425 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:36:37.423+0000 7f8773f2b640 1 -- 172.21.15.121:0/1581980661 >> 172.21.15.121:0/1581980661 conn(0x7f876c0f7ad0 msgr2=0x7f876c0f9290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:36:37.425 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:36:37.423+0000 7f8773f2b640 1 -- 172.21.15.121:0/1581980661 shutdown_connections 2024-08-18T22:36:37.425 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:36:37.423+0000 7f8773f2b640 1 -- 172.21.15.121:0/1581980661 wait complete. 2024-08-18T22:36:37.685 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:36:37 smithi121 ceph-mon[16788]: pgmap v63: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-08-18T22:36:37.685 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:36:37 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:36:37.685 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:36:37 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:36:37.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:36:37 smithi195 ceph-mon[23370]: pgmap v63: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-08-18T22:36:37.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:36:37 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:36:37.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:36:37 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:36:37.987 DEBUG:teuthology.orchestra.run.smithi121:osd.2> sudo journalctl -f -n 0 -u ceph-b003123a-5db1-11ef-bccf-c7b262605968@osd.2.service 2024-08-18T22:36:37.990 INFO:tasks.cephadm:Deploying osd.3 on smithi195 with /dev/vg_nvme/lv_4... 2024-08-18T22:36:37.991 DEBUG:teuthology.orchestra.run.smithi195:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b003123a-5db1-11ef-bccf-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-08-18T22:36:38.250 INFO:teuthology.orchestra.run.smithi195.stderr:Inferring config /var/lib/ceph/b003123a-5db1-11ef-bccf-c7b262605968/mon.smithi195/config 2024-08-18T22:36:38.640 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:36:38 smithi195 ceph-mon[23370]: from='osd.2 [v2:172.21.15.121:6818/2696892839,v1:172.21.15.121:6819/2696892839]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-08-18T22:36:38.640 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:36:38 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-18T22:36:38.834 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:36:38 smithi121 ceph-mon[16788]: from='osd.2 [v2:172.21.15.121:6818/2696892839,v1:172.21.15.121:6819/2696892839]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-08-18T22:36:38.834 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:36:38 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-18T22:36:38.834 INFO:journalctl@ceph.osd.2.smithi121.stdout:Aug 18 22:36:38 smithi121 ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-2[50525]: 2024-08-18T22:36:38.544+0000 7f42004ac440 -1 osd.2 0 log_to_monitors true 2024-08-18T22:36:39.738 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:36:39 smithi195 ceph-mon[23370]: pgmap v64: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-08-18T22:36:39.738 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:36:39 smithi195 ceph-mon[23370]: from='osd.2 [v2:172.21.15.121:6818/2696892839,v1:172.21.15.121:6819/2696892839]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-08-18T22:36:39.738 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:36:39 smithi195 ceph-mon[23370]: osdmap e17: 3 total, 2 up, 3 in 2024-08-18T22:36:39.738 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:36:39 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-08-18T22:36:39.738 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:36:39 smithi195 ceph-mon[23370]: from='osd.2 [v2:172.21.15.121:6818/2696892839,v1:172.21.15.121:6819/2696892839]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi121", "root=default"]}]: dispatch 2024-08-18T22:36:40.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:36:39 smithi121 ceph-mon[16788]: pgmap v64: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-08-18T22:36:40.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:36:39 smithi121 ceph-mon[16788]: from='osd.2 [v2:172.21.15.121:6818/2696892839,v1:172.21.15.121:6819/2696892839]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-08-18T22:36:40.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:36:39 smithi121 ceph-mon[16788]: osdmap e17: 3 total, 2 up, 3 in 2024-08-18T22:36:40.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:36:39 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-08-18T22:36:40.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:36:39 smithi121 ceph-mon[16788]: from='osd.2 [v2:172.21.15.121:6818/2696892839,v1:172.21.15.121:6819/2696892839]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi121", "root=default"]}]: dispatch 2024-08-18T22:36:40.084 INFO:journalctl@ceph.osd.2.smithi121.stdout:Aug 18 22:36:39 smithi121 ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-2[50525]: 2024-08-18T22:36:39.612+0000 7f41fbc1e640 -1 osd.2 0 waiting for initial osdmap 2024-08-18T22:36:40.084 INFO:journalctl@ceph.osd.2.smithi121.stdout:Aug 18 22:36:39 smithi121 ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-2[50525]: 2024-08-18T22:36:39.617+0000 7f41f8a59640 -1 osd.2 18 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-18T22:36:40.664 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-08-18T22:36:40.684 DEBUG:teuthology.orchestra.run.smithi195:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b003123a-5db1-11ef-bccf-c7b262605968 -- ceph orch daemon add osd smithi195:vg_nvme/lv_4 2024-08-18T22:36:40.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:36:40 smithi195 ceph-mon[23370]: from='osd.2 [v2:172.21.15.121:6818/2696892839,v1:172.21.15.121:6819/2696892839]' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi121", "root=default"]}]': finished 2024-08-18T22:36:40.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:36:40 smithi195 ceph-mon[23370]: osdmap e18: 3 total, 2 up, 3 in 2024-08-18T22:36:40.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:36:40 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-08-18T22:36:40.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:36:40 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-08-18T22:36:40.937 INFO:teuthology.orchestra.run.smithi195.stderr:Inferring config /var/lib/ceph/b003123a-5db1-11ef-bccf-c7b262605968/mon.smithi195/config 2024-08-18T22:36:41.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:36:40 smithi121 ceph-mon[16788]: from='osd.2 [v2:172.21.15.121:6818/2696892839,v1:172.21.15.121:6819/2696892839]' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi121", "root=default"]}]': finished 2024-08-18T22:36:41.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:36:40 smithi121 ceph-mon[16788]: osdmap e18: 3 total, 2 up, 3 in 2024-08-18T22:36:41.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:36:40 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-08-18T22:36:41.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:36:40 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-08-18T22:36:41.834 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:36:41 smithi121 ceph-mon[16788]: purged_snaps scrub starts 2024-08-18T22:36:41.834 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:36:41 smithi121 ceph-mon[16788]: purged_snaps scrub ok 2024-08-18T22:36:41.834 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:36:41 smithi121 ceph-mon[16788]: pgmap v67: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-08-18T22:36:41.834 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:36:41 smithi121 ceph-mon[16788]: osd.2 [v2:172.21.15.121:6818/2696892839,v1:172.21.15.121:6819/2696892839] boot 2024-08-18T22:36:41.834 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:36:41 smithi121 ceph-mon[16788]: osdmap e19: 3 total, 3 up, 3 in 2024-08-18T22:36:41.834 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:36:41 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-08-18T22:36:41.834 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:36:41 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:36:41.834 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:36:41 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:36:41.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:36:41 smithi195 ceph-mon[23370]: purged_snaps scrub starts 2024-08-18T22:36:41.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:36:41 smithi195 ceph-mon[23370]: purged_snaps scrub ok 2024-08-18T22:36:41.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:36:41 smithi195 ceph-mon[23370]: pgmap v67: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-08-18T22:36:41.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:36:41 smithi195 ceph-mon[23370]: osd.2 [v2:172.21.15.121:6818/2696892839,v1:172.21.15.121:6819/2696892839] boot 2024-08-18T22:36:41.910 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:36:41 smithi195 ceph-mon[23370]: osdmap e19: 3 total, 3 up, 3 in 2024-08-18T22:36:41.910 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:36:41 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-08-18T22:36:41.910 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:36:41 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:36:41.910 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:36:41 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:36:42.426 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:36:42.421+0000 7f11a0916640 1 -- 172.21.15.195:0/4285346058 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f119c0661b0 msgr2=0x7f119c0fef90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:36:42.427 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:36:42.421+0000 7f11a0916640 1 --2- 172.21.15.195:0/4285346058 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f119c0661b0 0x7f119c0fef90 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f11940048d0 tx=0x7f1194009da0 comp rx=0 tx=0).stop 2024-08-18T22:36:42.427 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:36:42.421+0000 7f11a0916640 1 -- 172.21.15.195:0/4285346058 shutdown_connections 2024-08-18T22:36:42.427 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:36:42.421+0000 7f11a0916640 1 --2- 172.21.15.195:0/4285346058 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f119c0ff4d0 0x7f119c1018b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:36:42.427 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:36:42.421+0000 7f11a0916640 1 --2- 172.21.15.195:0/4285346058 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f119c0661b0 0x7f119c0fef90 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:36:42.427 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:36:42.421+0000 7f11a0916640 1 -- 172.21.15.195:0/4285346058 >> 172.21.15.195:0/4285346058 conn(0x7f119c0f69a0 msgr2=0x7f119c0f8db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:36:42.428 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:36:42.421+0000 7f11a0916640 1 -- 172.21.15.195:0/4285346058 shutdown_connections 2024-08-18T22:36:42.428 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:36:42.421+0000 7f11a0916640 1 -- 172.21.15.195:0/4285346058 wait complete. 2024-08-18T22:36:42.428 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:36:42.421+0000 7f11a0916640 1 Processor -- start 2024-08-18T22:36:42.428 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:36:42.421+0000 7f11a0916640 1 -- start start 2024-08-18T22:36:42.428 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:36:42.421+0000 7f11a0916640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f119c0661b0 0x7f119c10cf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:36:42.429 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:36:42.421+0000 7f11a0916640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f119c0ff4d0 0x7f119c10d480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:36:42.429 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:36:42.421+0000 7f11a0916640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f119c10e160 con 0x7f119c0661b0 2024-08-18T22:36:42.429 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:36:42.421+0000 7f11a0916640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f119c10e2d0 con 0x7f119c0ff4d0 2024-08-18T22:36:42.429 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:36:42.422+0000 7f1199d9b640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f119c0ff4d0 0x7f119c10d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:36:42.429 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:36:42.422+0000 7f1199d9b640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f119c0ff4d0 0x7f119c10d480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.195:48138/0 (socket says 172.21.15.195:48138) 2024-08-18T22:36:42.429 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:36:42.422+0000 7f1199d9b640 1 -- 172.21.15.195:0/2313887387 learned_addr learned my addr 172.21.15.195:0/2313887387 (peer_addr_for_me v2:172.21.15.195:0/0) 2024-08-18T22:36:42.429 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:36:42.422+0000 7f119a59c640 1 --2- 172.21.15.195:0/2313887387 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f119c0661b0 0x7f119c10cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:36:42.430 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:36:42.422+0000 7f1199d9b640 1 -- 172.21.15.195:0/2313887387 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f119c0661b0 msgr2=0x7f119c10cf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:36:42.430 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:36:42.422+0000 7f1199d9b640 1 --2- 172.21.15.195:0/2313887387 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f119c0661b0 0x7f119c10cf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:36:42.430 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:36:42.422+0000 7f1199d9b640 1 -- 172.21.15.195:0/2313887387 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1194005040 con 0x7f119c0ff4d0 2024-08-18T22:36:42.430 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:36:42.422+0000 7f1199d9b640 1 --2- 172.21.15.195:0/2313887387 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f119c0ff4d0 0x7f119c10d480 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f119000db80 tx=0x7f1190004f00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:36:42.430 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:36:42.422+0000 7f118affd640 1 -- 172.21.15.195:0/2313887387 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f119000b8d0 con 0x7f119c0ff4d0 2024-08-18T22:36:42.431 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:36:42.422+0000 7f118affd640 1 -- 172.21.15.195:0/2313887387 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f119000f040 con 0x7f119c0ff4d0 2024-08-18T22:36:42.431 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:36:42.422+0000 7f11a0916640 1 -- 172.21.15.195:0/2313887387 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f119c10e5b0 con 0x7f119c0ff4d0 2024-08-18T22:36:42.431 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:36:42.422+0000 7f118affd640 1 -- 172.21.15.195:0/2313887387 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1190012390 con 0x7f119c0ff4d0 2024-08-18T22:36:42.431 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:36:42.422+0000 7f11a0916640 1 -- 172.21.15.195:0/2313887387 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f119c10ead0 con 0x7f119c0ff4d0 2024-08-18T22:36:42.431 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:36:42.423+0000 7f11a0916640 1 -- 172.21.15.195:0/2313887387 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f119c0fa620 con 0x7f119c0ff4d0 2024-08-18T22:36:42.431 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:36:42.424+0000 7f118affd640 1 -- 172.21.15.195:0/2313887387 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 18) v1 ==== 85071+0+0 (secure 0 0 0) 0x7f119000ba30 con 0x7f119c0ff4d0 2024-08-18T22:36:42.432 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:36:42.424+0000 7f118affd640 1 --2- 172.21.15.195:0/2313887387 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7f1184067100 0x7f11840695b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:36:42.432 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:36:42.424+0000 7f118affd640 1 -- 172.21.15.195:0/2313887387 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 2842+0+0 (secure 0 0 0) 0x7f1190083da0 con 0x7f119c0ff4d0 2024-08-18T22:36:42.432 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:36:42.424+0000 7f119a59c640 1 --2- 172.21.15.195:0/2313887387 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7f1184067100 0x7f11840695b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:36:42.432 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:36:42.425+0000 7f119a59c640 1 --2- 172.21.15.195:0/2313887387 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7f1184067100 0x7f11840695b0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f1194000c00 tx=0x7f1194035040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:36:42.433 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:36:42.428+0000 7f118affd640 1 -- 172.21.15.195:0/2313887387 <== mon.1 v2:172.21.15.195:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f1190051be0 con 0x7f119c0ff4d0 2024-08-18T22:36:42.593 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:36:42.592+0000 7f11a0916640 1 -- 172.21.15.195:0/2313887387 --> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi195:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7f119c10ee00 con 0x7f1184067100 2024-08-18T22:36:43.118 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:36:42 smithi121 ceph-mon[16788]: osdmap e20: 3 total, 3 up, 3 in 2024-08-18T22:36:43.122 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:36:42 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]: dispatch 2024-08-18T22:36:43.122 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:36:42 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-08-18T22:36:43.122 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:36:42 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-08-18T22:36:43.122 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:36:42 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:36:43.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:36:42 smithi195 ceph-mon[23370]: osdmap e20: 3 total, 3 up, 3 in 2024-08-18T22:36:43.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:36:42 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]: dispatch 2024-08-18T22:36:43.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:36:42 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-08-18T22:36:43.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:36:42 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-08-18T22:36:43.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:36:42 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:36:44.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:36:43 smithi121 ceph-mon[16788]: pgmap v70: 0 pgs: ; 0 B data, 872 MiB used, 267 GiB / 268 GiB avail 2024-08-18T22:36:44.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:36:43 smithi121 ceph-mon[16788]: from='client.24129 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi195:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-08-18T22:36:44.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:36:43 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]': finished 2024-08-18T22:36:44.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:36:43 smithi121 ceph-mon[16788]: osdmap e21: 3 total, 3 up, 3 in 2024-08-18T22:36:44.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:36:43 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-08-18T22:36:44.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:36:43 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:36:44.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:36:43 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:36:44.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:36:43 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-08-18T22:36:44.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:36:43 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-08-18T22:36:44.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:36:43 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-08-18T22:36:44.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:36:43 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:36:44.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:36:43 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:36:44.085 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:36:43 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-18T22:36:44.085 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:36:43 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:36:44.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:36:43 smithi195 ceph-mon[23370]: pgmap v70: 0 pgs: ; 0 B data, 872 MiB used, 267 GiB / 268 GiB avail 2024-08-18T22:36:44.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:36:43 smithi195 ceph-mon[23370]: from='client.24129 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi195:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-08-18T22:36:44.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:36:43 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]': finished 2024-08-18T22:36:44.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:36:43 smithi195 ceph-mon[23370]: osdmap e21: 3 total, 3 up, 3 in 2024-08-18T22:36:44.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:36:43 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-08-18T22:36:44.160 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:36:43 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:36:44.160 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:36:43 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:36:44.160 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:36:43 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-08-18T22:36:44.160 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:36:43 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-08-18T22:36:44.160 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:36:43 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-08-18T22:36:44.160 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:36:43 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:36:44.160 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:36:43 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:36:44.160 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:36:43 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-18T22:36:44.160 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:36:43 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:36:44.900 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:36:44 smithi121 ceph-mon[16788]: Detected new or changed devices on smithi121 2024-08-18T22:36:44.900 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:36:44 smithi121 ceph-mon[16788]: Adjusting osd_memory_target on smithi121 to 4287M 2024-08-18T22:36:44.900 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:36:44 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-08-18T22:36:44.900 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:36:44 smithi121 ceph-mon[16788]: osdmap e22: 3 total, 3 up, 3 in 2024-08-18T22:36:44.900 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:36:44 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-18T22:36:45.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:36:44 smithi195 ceph-mon[23370]: Detected new or changed devices on smithi121 2024-08-18T22:36:45.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:36:44 smithi195 ceph-mon[23370]: Adjusting osd_memory_target on smithi121 to 4287M 2024-08-18T22:36:45.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:36:44 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-08-18T22:36:45.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:36:44 smithi195 ceph-mon[23370]: osdmap e22: 3 total, 3 up, 3 in 2024-08-18T22:36:45.160 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:36:44 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-18T22:36:45.178 INFO:journalctl@ceph.osd.0.smithi121.stdout:Aug 18 22:36:44 smithi121 sudo[55107]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-08-18T22:36:45.178 INFO:journalctl@ceph.osd.0.smithi121.stdout:Aug 18 22:36:44 smithi121 sudo[55107]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-08-18T22:36:45.178 INFO:journalctl@ceph.osd.0.smithi121.stdout:Aug 18 22:36:44 smithi121 sudo[55107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-08-18T22:36:45.178 INFO:journalctl@ceph.osd.0.smithi121.stdout:Aug 18 22:36:44 smithi121 sudo[55107]: pam_unix(sudo:session): session closed for user root 2024-08-18T22:36:45.451 INFO:journalctl@ceph.osd.0.smithi121.stdout:Aug 18 22:36:45 smithi121 sudo[55162]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-08-18T22:36:45.451 INFO:journalctl@ceph.osd.0.smithi121.stdout:Aug 18 22:36:45 smithi121 sudo[55162]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-08-18T22:36:45.451 INFO:journalctl@ceph.osd.0.smithi121.stdout:Aug 18 22:36:45 smithi121 sudo[55162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-08-18T22:36:45.452 INFO:journalctl@ceph.osd.0.smithi121.stdout:Aug 18 22:36:45 smithi121 sudo[55162]: pam_unix(sudo:session): session closed for user root 2024-08-18T22:36:45.711 INFO:journalctl@ceph.osd.1.smithi121.stdout:Aug 18 22:36:45 smithi121 sudo[55214]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-08-18T22:36:45.711 INFO:journalctl@ceph.osd.1.smithi121.stdout:Aug 18 22:36:45 smithi121 sudo[55214]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-08-18T22:36:45.711 INFO:journalctl@ceph.osd.1.smithi121.stdout:Aug 18 22:36:45 smithi121 sudo[55214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-08-18T22:36:45.711 INFO:journalctl@ceph.osd.1.smithi121.stdout:Aug 18 22:36:45 smithi121 sudo[55214]: pam_unix(sudo:session): session closed for user root 2024-08-18T22:36:45.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:36:45 smithi195 ceph-mon[23370]: pgmap v73: 1 pgs: 1 unknown; 0 B data, 872 MiB used, 267 GiB / 268 GiB avail 2024-08-18T22:36:45.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:36:45 smithi195 ceph-mon[23370]: osdmap e23: 3 total, 3 up, 3 in 2024-08-18T22:36:45.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:36:45 smithi195 ceph-mon[23370]: from='client.? 172.21.15.195:0/1823884339' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "62aafac2-c863-45df-a067-dcb6c2fa1df2"}]: dispatch 2024-08-18T22:36:45.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:36:45 smithi195 ceph-mon[23370]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "62aafac2-c863-45df-a067-dcb6c2fa1df2"}]: dispatch 2024-08-18T22:36:45.910 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:36:45 smithi195 ceph-mon[23370]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "62aafac2-c863-45df-a067-dcb6c2fa1df2"}]': finished 2024-08-18T22:36:45.910 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:36:45 smithi195 ceph-mon[23370]: osdmap e24: 4 total, 3 up, 4 in 2024-08-18T22:36:45.910 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:36:45 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-08-18T22:36:45.910 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:36:45 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:36:45.910 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:36:45 smithi195 ceph-mon[23370]: from='client.? 172.21.15.195:0/1007376528' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-08-18T22:36:45.968 INFO:journalctl@ceph.osd.1.smithi121.stdout:Aug 18 22:36:45 smithi121 sudo[55218]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-08-18T22:36:45.968 INFO:journalctl@ceph.osd.1.smithi121.stdout:Aug 18 22:36:45 smithi121 sudo[55218]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-08-18T22:36:45.968 INFO:journalctl@ceph.osd.1.smithi121.stdout:Aug 18 22:36:45 smithi121 sudo[55218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-08-18T22:36:45.968 INFO:journalctl@ceph.osd.1.smithi121.stdout:Aug 18 22:36:45 smithi121 sudo[55218]: pam_unix(sudo:session): session closed for user root 2024-08-18T22:36:45.968 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:36:45 smithi121 ceph-mon[16788]: pgmap v73: 1 pgs: 1 unknown; 0 B data, 872 MiB used, 267 GiB / 268 GiB avail 2024-08-18T22:36:45.968 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:36:45 smithi121 ceph-mon[16788]: osdmap e23: 3 total, 3 up, 3 in 2024-08-18T22:36:45.968 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:36:45 smithi121 ceph-mon[16788]: from='client.? 172.21.15.195:0/1823884339' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "62aafac2-c863-45df-a067-dcb6c2fa1df2"}]: dispatch 2024-08-18T22:36:45.968 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:36:45 smithi121 ceph-mon[16788]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "62aafac2-c863-45df-a067-dcb6c2fa1df2"}]: dispatch 2024-08-18T22:36:45.968 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:36:45 smithi121 ceph-mon[16788]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "62aafac2-c863-45df-a067-dcb6c2fa1df2"}]': finished 2024-08-18T22:36:45.969 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:36:45 smithi121 ceph-mon[16788]: osdmap e24: 4 total, 3 up, 4 in 2024-08-18T22:36:45.969 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:36:45 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-08-18T22:36:45.969 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:36:45 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:36:45.969 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:36:45 smithi121 ceph-mon[16788]: from='client.? 172.21.15.195:0/1007376528' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-08-18T22:36:46.229 INFO:journalctl@ceph.osd.2.smithi121.stdout:Aug 18 22:36:45 smithi121 sudo[55267]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-08-18T22:36:46.229 INFO:journalctl@ceph.osd.2.smithi121.stdout:Aug 18 22:36:45 smithi121 sudo[55267]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-08-18T22:36:46.229 INFO:journalctl@ceph.osd.2.smithi121.stdout:Aug 18 22:36:45 smithi121 sudo[55267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-08-18T22:36:46.229 INFO:journalctl@ceph.osd.2.smithi121.stdout:Aug 18 22:36:45 smithi121 sudo[55267]: pam_unix(sudo:session): session closed for user root 2024-08-18T22:36:46.481 INFO:journalctl@ceph.osd.2.smithi121.stdout:Aug 18 22:36:46 smithi121 sudo[55295]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-08-18T22:36:46.482 INFO:journalctl@ceph.osd.2.smithi121.stdout:Aug 18 22:36:46 smithi121 sudo[55295]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-08-18T22:36:46.482 INFO:journalctl@ceph.osd.2.smithi121.stdout:Aug 18 22:36:46 smithi121 sudo[55295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-08-18T22:36:46.482 INFO:journalctl@ceph.osd.2.smithi121.stdout:Aug 18 22:36:46 smithi121 sudo[55295]: pam_unix(sudo:session): session closed for user root 2024-08-18T22:36:46.744 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:36:46 smithi121 sudo[55301]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-08-18T22:36:46.744 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:36:46 smithi121 sudo[55301]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-08-18T22:36:46.744 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:36:46 smithi121 sudo[55301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-08-18T22:36:46.744 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:36:46 smithi121 sudo[55301]: pam_unix(sudo:session): session closed for user root 2024-08-18T22:36:47.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:36:46 smithi121 sudo[55350]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-08-18T22:36:47.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:36:46 smithi121 sudo[55350]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-08-18T22:36:47.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:36:46 smithi121 sudo[55350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-08-18T22:36:47.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:36:46 smithi121 sudo[55350]: pam_unix(sudo:session): session closed for user root 2024-08-18T22:36:47.250 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:36:46 smithi195 sudo[27249]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-08-18T22:36:47.250 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:36:46 smithi195 sudo[27249]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-08-18T22:36:47.250 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:36:46 smithi195 sudo[27249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-08-18T22:36:47.250 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:36:47 smithi195 sudo[27249]: pam_unix(sudo:session): session closed for user root 2024-08-18T22:36:47.261 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:36:47.258+0000 7f118affd640 1 -- 172.21.15.195:0/2313887387 <== mon.1 v2:172.21.15.195:3300/0 7 ==== mgrmap(e 19) v1 ==== 85127+0+0 (secure 0 0 0) 0x7f119000bce0 con 0x7f119c0ff4d0 2024-08-18T22:36:47.563 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:36:47 smithi121 ceph-mon[16788]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-08-18T22:36:47.564 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:36:47 smithi121 ceph-mon[16788]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-08-18T22:36:47.564 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:36:47 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "mon metadata", "id": "smithi121"}]: dispatch 2024-08-18T22:36:47.564 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:36:47 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "mon metadata", "id": "smithi195"}]: dispatch 2024-08-18T22:36:47.564 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:36:47 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "mon metadata", "id": "smithi121"}]: dispatch 2024-08-18T22:36:47.564 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:36:47 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "mon metadata", "id": "smithi195"}]: dispatch 2024-08-18T22:36:47.661 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:36:47 smithi195 sudo[27439]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-08-18T22:36:47.661 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:36:47 smithi195 sudo[27439]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-08-18T22:36:47.661 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:36:47 smithi195 sudo[27439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-08-18T22:36:47.661 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:36:47 smithi195 sudo[27439]: pam_unix(sudo:session): session closed for user root 2024-08-18T22:36:47.661 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:36:47 smithi195 ceph-mon[23370]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-08-18T22:36:47.662 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:36:47 smithi195 ceph-mon[23370]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-08-18T22:36:47.662 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:36:47 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "mon metadata", "id": "smithi121"}]: dispatch 2024-08-18T22:36:47.662 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:36:47 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "mon metadata", "id": "smithi195"}]: dispatch 2024-08-18T22:36:47.662 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:36:47 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "mon metadata", "id": "smithi121"}]: dispatch 2024-08-18T22:36:47.662 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:36:47 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "mon metadata", "id": "smithi195"}]: dispatch 2024-08-18T22:36:48.409 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:36:48 smithi195 ceph-mon[23370]: pgmap v76: 1 pgs: 1 unknown; 0 B data, 872 MiB used, 267 GiB / 268 GiB avail 2024-08-18T22:36:48.409 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:36:48 smithi195 ceph-mon[23370]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-08-18T22:36:48.409 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:36:48 smithi195 ceph-mon[23370]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-08-18T22:36:48.410 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:36:48 smithi195 ceph-mon[23370]: mgrmap e19: smithi121.lopxqc(active, since 2m), standbys: smithi195.acttsj 2024-08-18T22:36:48.410 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:36:48 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:36:48.410 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:36:48 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:36:48.410 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:36:48 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:36:48.410 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:36:48 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:36:48.410 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:36:48 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-18T22:36:48.410 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:36:48 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:36:48.584 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:36:48 smithi121 ceph-mon[16788]: pgmap v76: 1 pgs: 1 unknown; 0 B data, 872 MiB used, 267 GiB / 268 GiB avail 2024-08-18T22:36:48.584 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:36:48 smithi121 ceph-mon[16788]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-08-18T22:36:48.584 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:36:48 smithi121 ceph-mon[16788]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-08-18T22:36:48.584 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:36:48 smithi121 ceph-mon[16788]: mgrmap e19: smithi121.lopxqc(active, since 2m), standbys: smithi195.acttsj 2024-08-18T22:36:48.584 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:36:48 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:36:48.584 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:36:48 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:36:48.584 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:36:48 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:36:48.584 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:36:48 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:36:48.584 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:36:48 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-18T22:36:48.584 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:36:48 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:36:49.583 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:36:49 smithi121 ceph-mon[16788]: pgmap v77: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-08-18T22:36:49.659 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:36:49 smithi195 ceph-mon[23370]: pgmap v77: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-08-18T22:36:51.833 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:36:51 smithi121 ceph-mon[16788]: pgmap v78: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-08-18T22:36:51.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:36:51 smithi195 ceph-mon[23370]: pgmap v78: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-08-18T22:36:52.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:36:52 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-08-18T22:36:52.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:36:52 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:36:52.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:36:52 smithi195 ceph-mon[23370]: Deploying daemon osd.3 on smithi195 2024-08-18T22:36:53.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:36:52 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-08-18T22:36:53.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:36:52 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:36:53.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:36:52 smithi121 ceph-mon[16788]: Deploying daemon osd.3 on smithi195 2024-08-18T22:36:53.659 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:36:53 smithi195 ceph-mon[23370]: pgmap v79: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail; 4.5 KiB/s rd, 196 KiB/s wr, 13 op/s 2024-08-18T22:36:53.659 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:36:53 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-18T22:36:54.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:36:53 smithi121 ceph-mon[16788]: pgmap v79: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail; 4.5 KiB/s rd, 196 KiB/s wr, 13 op/s 2024-08-18T22:36:54.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:36:53 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-18T22:36:55.659 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:36:55 smithi195 ceph-mon[23370]: pgmap v80: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail; 3.0 KiB/s rd, 131 KiB/s wr, 9 op/s 2024-08-18T22:36:56.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:36:55 smithi121 ceph-mon[16788]: pgmap v80: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail; 3.0 KiB/s rd, 131 KiB/s wr, 9 op/s 2024-08-18T22:36:57.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:36:57 smithi195 ceph-mon[23370]: pgmap v81: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail; 2.2 KiB/s rd, 98 KiB/s wr, 6 op/s 2024-08-18T22:36:57.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:36:57 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-18T22:36:57.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:36:57 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:36:57.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:36:57 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:36:58.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:36:57 smithi121 ceph-mon[16788]: pgmap v81: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail; 2.2 KiB/s rd, 98 KiB/s wr, 6 op/s 2024-08-18T22:36:58.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:36:57 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-18T22:36:58.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:36:57 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:36:58.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:36:57 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:36:59.527 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:36:59.525+0000 7f118affd640 1 -- 172.21.15.195:0/2313887387 <== mgr.14206 v2:172.21.15.121:6800/3225195982 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f119c10ee00 con 0x7f1184067100 2024-08-18T22:36:59.527 INFO:teuthology.orchestra.run.smithi195.stdout:Created osd(s) 3 on host 'smithi195' 2024-08-18T22:36:59.528 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:36:59.527+0000 7f11a0916640 1 -- 172.21.15.195:0/2313887387 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7f1184067100 msgr2=0x7f11840695b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:36:59.528 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:36:59.527+0000 7f11a0916640 1 --2- 172.21.15.195:0/2313887387 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7f1184067100 0x7f11840695b0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f1194000c00 tx=0x7f1194035040 comp rx=0 tx=0).stop 2024-08-18T22:36:59.528 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:36:59.527+0000 7f11a0916640 1 -- 172.21.15.195:0/2313887387 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f119c0ff4d0 msgr2=0x7f119c10d480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:36:59.528 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:36:59.527+0000 7f11a0916640 1 --2- 172.21.15.195:0/2313887387 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f119c0ff4d0 0x7f119c10d480 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f119000db80 tx=0x7f1190004f00 comp rx=0 tx=0).stop 2024-08-18T22:36:59.529 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:36:59.527+0000 7f11a0916640 1 -- 172.21.15.195:0/2313887387 shutdown_connections 2024-08-18T22:36:59.529 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:36:59.527+0000 7f11a0916640 1 --2- 172.21.15.195:0/2313887387 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7f1184067100 0x7f11840695b0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:36:59.529 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:36:59.527+0000 7f11a0916640 1 --2- 172.21.15.195:0/2313887387 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f119c0ff4d0 0x7f119c10d480 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:36:59.529 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:36:59.527+0000 7f11a0916640 1 --2- 172.21.15.195:0/2313887387 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f119c0661b0 0x7f119c10cf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:36:59.529 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:36:59.527+0000 7f11a0916640 1 -- 172.21.15.195:0/2313887387 >> 172.21.15.195:0/2313887387 conn(0x7f119c0f69a0 msgr2=0x7f119c0f6d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:36:59.529 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:36:59.527+0000 7f11a0916640 1 -- 172.21.15.195:0/2313887387 shutdown_connections 2024-08-18T22:36:59.529 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:36:59.527+0000 7f11a0916640 1 -- 172.21.15.195:0/2313887387 wait complete. 2024-08-18T22:36:59.845 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:36:59 smithi195 ceph-mon[23370]: pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail; 1.8 KiB/s rd, 78 KiB/s wr, 5 op/s 2024-08-18T22:36:59.846 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:36:59 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:36:59.846 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:36:59 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:37:00.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:36:59 smithi121 ceph-mon[16788]: pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail; 1.8 KiB/s rd, 78 KiB/s wr, 5 op/s 2024-08-18T22:37:00.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:36:59 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:37:00.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:36:59 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:37:00.162 DEBUG:teuthology.orchestra.run.smithi195:osd.3> sudo journalctl -f -n 0 -u ceph-b003123a-5db1-11ef-bccf-c7b262605968@osd.3.service 2024-08-18T22:37:00.165 INFO:tasks.cephadm:Deploying osd.4 on smithi195 with /dev/vg_nvme/lv_3... 2024-08-18T22:37:00.165 DEBUG:teuthology.orchestra.run.smithi195:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b003123a-5db1-11ef-bccf-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-08-18T22:37:00.562 INFO:teuthology.orchestra.run.smithi195.stderr:Inferring config /var/lib/ceph/b003123a-5db1-11ef-bccf-c7b262605968/mon.smithi195/config 2024-08-18T22:37:00.792 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:37:00 smithi195 ceph-mon[23370]: from='osd.3 [v2:172.21.15.195:6800/1551491756,v1:172.21.15.195:6801/1551491756]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-08-18T22:37:00.792 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:37:00 smithi195 ceph-mon[23370]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-08-18T22:37:00.792 INFO:journalctl@ceph.osd.3.smithi195.stdout:Aug 18 22:37:00 smithi195 ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-3[28860]: 2024-08-18T22:37:00.482+0000 7f04478c3440 -1 osd.3 0 log_to_monitors true 2024-08-18T22:37:01.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:37:00 smithi121 ceph-mon[16788]: from='osd.3 [v2:172.21.15.195:6800/1551491756,v1:172.21.15.195:6801/1551491756]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-08-18T22:37:01.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:37:00 smithi121 ceph-mon[16788]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-08-18T22:37:01.834 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:37:01 smithi121 ceph-mon[16788]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail; 1.5 KiB/s rd, 65 KiB/s wr, 4 op/s 2024-08-18T22:37:01.834 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:37:01 smithi121 ceph-mon[16788]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-08-18T22:37:01.834 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:37:01 smithi121 ceph-mon[16788]: osdmap e25: 4 total, 3 up, 4 in 2024-08-18T22:37:01.834 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:37:01 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-08-18T22:37:01.834 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:37:01 smithi121 ceph-mon[16788]: from='osd.3 [v2:172.21.15.195:6800/1551491756,v1:172.21.15.195:6801/1551491756]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]: dispatch 2024-08-18T22:37:01.835 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:37:01 smithi121 ceph-mon[16788]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]: dispatch 2024-08-18T22:37:01.909 INFO:journalctl@ceph.osd.3.smithi195.stdout:Aug 18 22:37:01 smithi195 ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-3[28860]: 2024-08-18T22:37:01.620+0000 7f044485a640 -1 osd.3 0 waiting for initial osdmap 2024-08-18T22:37:01.909 INFO:journalctl@ceph.osd.3.smithi195.stdout:Aug 18 22:37:01 smithi195 ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-3[28860]: 2024-08-18T22:37:01.626+0000 7f043ce6a640 -1 osd.3 26 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-18T22:37:01.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:37:01 smithi195 ceph-mon[23370]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail; 1.5 KiB/s rd, 65 KiB/s wr, 4 op/s 2024-08-18T22:37:01.910 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:37:01 smithi195 ceph-mon[23370]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-08-18T22:37:01.910 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:37:01 smithi195 ceph-mon[23370]: osdmap e25: 4 total, 3 up, 4 in 2024-08-18T22:37:01.910 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:37:01 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-08-18T22:37:01.910 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:37:01 smithi195 ceph-mon[23370]: from='osd.3 [v2:172.21.15.195:6800/1551491756,v1:172.21.15.195:6801/1551491756]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]: dispatch 2024-08-18T22:37:01.910 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:37:01 smithi195 ceph-mon[23370]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]: dispatch 2024-08-18T22:37:02.889 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:37:02 smithi195 ceph-mon[23370]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]': finished 2024-08-18T22:37:02.889 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:37:02 smithi195 ceph-mon[23370]: osdmap e26: 4 total, 3 up, 4 in 2024-08-18T22:37:02.890 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:37:02 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-08-18T22:37:02.890 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:37:02 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-08-18T22:37:02.890 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:37:02 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:37:02.890 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:37:02 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:37:03.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:37:02 smithi121 ceph-mon[16788]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]': finished 2024-08-18T22:37:03.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:37:02 smithi121 ceph-mon[16788]: osdmap e26: 4 total, 3 up, 4 in 2024-08-18T22:37:03.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:37:02 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-08-18T22:37:03.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:37:02 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-08-18T22:37:03.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:37:02 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:37:03.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:37:02 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:37:03.877 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:37:03 smithi195 ceph-mon[23370]: purged_snaps scrub starts 2024-08-18T22:37:03.877 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:37:03 smithi195 ceph-mon[23370]: purged_snaps scrub ok 2024-08-18T22:37:03.877 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:37:03 smithi195 ceph-mon[23370]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-08-18T22:37:03.877 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:37:03 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-08-18T22:37:03.878 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:37:03 smithi195 ceph-mon[23370]: osd.3 [v2:172.21.15.195:6800/1551491756,v1:172.21.15.195:6801/1551491756] boot 2024-08-18T22:37:03.878 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:37:03 smithi195 ceph-mon[23370]: osdmap e27: 4 total, 4 up, 4 in 2024-08-18T22:37:03.878 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:37:03 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-08-18T22:37:04.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:37:03 smithi121 ceph-mon[16788]: purged_snaps scrub starts 2024-08-18T22:37:04.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:37:03 smithi121 ceph-mon[16788]: purged_snaps scrub ok 2024-08-18T22:37:04.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:37:03 smithi121 ceph-mon[16788]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-08-18T22:37:04.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:37:03 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-08-18T22:37:04.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:37:03 smithi121 ceph-mon[16788]: osd.3 [v2:172.21.15.195:6800/1551491756,v1:172.21.15.195:6801/1551491756] boot 2024-08-18T22:37:04.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:37:03 smithi121 ceph-mon[16788]: osdmap e27: 4 total, 4 up, 4 in 2024-08-18T22:37:04.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:37:03 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-08-18T22:37:04.310 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-08-18T22:37:04.331 DEBUG:teuthology.orchestra.run.smithi195:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b003123a-5db1-11ef-bccf-c7b262605968 -- ceph orch daemon add osd smithi195:vg_nvme/lv_3 2024-08-18T22:37:04.833 INFO:teuthology.orchestra.run.smithi195.stderr:Inferring config /var/lib/ceph/b003123a-5db1-11ef-bccf-c7b262605968/mon.smithi195/config 2024-08-18T22:37:04.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:37:04 smithi195 ceph-mon[23370]: osdmap e28: 4 total, 4 up, 4 in 2024-08-18T22:37:05.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:37:04 smithi121 ceph-mon[16788]: osdmap e28: 4 total, 4 up, 4 in 2024-08-18T22:37:05.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:37:05 smithi195 ceph-mon[23370]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-08-18T22:37:05.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:37:05 smithi195 ceph-mon[23370]: osdmap e29: 4 total, 4 up, 4 in 2024-08-18T22:37:06.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:37:05 smithi121 ceph-mon[16788]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-08-18T22:37:06.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:37:05 smithi121 ceph-mon[16788]: osdmap e29: 4 total, 4 up, 4 in 2024-08-18T22:37:06.574 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:37:06.571+0000 7fc937c75640 1 -- 172.21.15.195:0/3044997638 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc9300fe290 msgr2=0x7fc9300fa3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:37:06.574 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:37:06.571+0000 7fc937c75640 1 --2- 172.21.15.195:0/3044997638 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc9300fe290 0x7fc9300fa3f0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fc9200048d0 tx=0x7fc920009da0 comp rx=0 tx=0).stop 2024-08-18T22:37:06.574 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:37:06.571+0000 7fc937c75640 1 -- 172.21.15.195:0/3044997638 shutdown_connections 2024-08-18T22:37:06.574 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:37:06.571+0000 7fc937c75640 1 --2- 172.21.15.195:0/3044997638 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc9300fe290 0x7fc9300fa3f0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:37:06.574 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:37:06.571+0000 7fc937c75640 1 --2- 172.21.15.195:0/3044997638 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc9300fd940 0x7fc9300fdd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:37:06.574 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:37:06.571+0000 7fc937c75640 1 -- 172.21.15.195:0/3044997638 >> 172.21.15.195:0/3044997638 conn(0x7fc9300f6140 msgr2=0x7fc9300f8570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:37:06.575 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:37:06.571+0000 7fc937c75640 1 -- 172.21.15.195:0/3044997638 shutdown_connections 2024-08-18T22:37:06.575 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:37:06.571+0000 7fc937c75640 1 -- 172.21.15.195:0/3044997638 wait complete. 2024-08-18T22:37:06.575 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:37:06.572+0000 7fc937c75640 1 Processor -- start 2024-08-18T22:37:06.575 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:37:06.572+0000 7fc937c75640 1 -- start start 2024-08-18T22:37:06.575 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:37:06.572+0000 7fc937c75640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc9300fd940 0x7fc9300fd0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:37:06.575 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:37:06.572+0000 7fc937c75640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc9300fe290 0x7fc9300fb620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:37:06.575 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:37:06.572+0000 7fc937c75640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9300fbb60 con 0x7fc9300fd940 2024-08-18T22:37:06.575 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:37:06.572+0000 7fc937c75640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9300fbca0 con 0x7fc9300fe290 2024-08-18T22:37:06.575 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:37:06.572+0000 7fc935210640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc9300fe290 0x7fc9300fb620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:37:06.575 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:37:06.572+0000 7fc935210640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc9300fe290 0x7fc9300fb620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.195:33336/0 (socket says 172.21.15.195:33336) 2024-08-18T22:37:06.575 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:37:06.572+0000 7fc935210640 1 -- 172.21.15.195:0/1788627337 learned_addr learned my addr 172.21.15.195:0/1788627337 (peer_addr_for_me v2:172.21.15.195:0/0) 2024-08-18T22:37:06.575 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:37:06.572+0000 7fc935a11640 1 --2- 172.21.15.195:0/1788627337 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc9300fd940 0x7fc9300fd0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:37:06.576 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:37:06.572+0000 7fc935210640 1 -- 172.21.15.195:0/1788627337 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc9300fd940 msgr2=0x7fc9300fd0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:37:06.576 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:37:06.572+0000 7fc935210640 1 --2- 172.21.15.195:0/1788627337 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc9300fd940 0x7fc9300fd0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:37:06.576 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:37:06.572+0000 7fc935210640 1 -- 172.21.15.195:0/1788627337 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc920005040 con 0x7fc9300fe290 2024-08-18T22:37:06.576 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:37:06.572+0000 7fc935210640 1 --2- 172.21.15.195:0/1788627337 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc9300fe290 0x7fc9300fb620 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fc9200048a0 tx=0x7fc920009da0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:37:06.576 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:37:06.572+0000 7fc9267fc640 1 -- 172.21.15.195:0/1788627337 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc920038070 con 0x7fc9300fe290 2024-08-18T22:37:06.576 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:37:06.573+0000 7fc9267fc640 1 -- 172.21.15.195:0/1788627337 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fc92002abd0 con 0x7fc9300fe290 2024-08-18T22:37:06.576 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:37:06.573+0000 7fc9267fc640 1 -- 172.21.15.195:0/1788627337 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc920033640 con 0x7fc9300fe290 2024-08-18T22:37:06.576 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:37:06.573+0000 7fc937c75640 1 -- 172.21.15.195:0/1788627337 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9300fbf20 con 0x7fc9300fe290 2024-08-18T22:37:06.576 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:37:06.573+0000 7fc937c75640 1 -- 172.21.15.195:0/1788627337 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc930114ea0 con 0x7fc9300fe290 2024-08-18T22:37:06.577 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:37:06.574+0000 7fc937c75640 1 -- 172.21.15.195:0/1788627337 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9300f9de0 con 0x7fc9300fe290 2024-08-18T22:37:06.577 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:37:06.574+0000 7fc9267fc640 1 -- 172.21.15.195:0/1788627337 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 19) v1 ==== 85127+0+0 (secure 0 0 0) 0x7fc920030020 con 0x7fc9300fe290 2024-08-18T22:37:06.577 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:37:06.575+0000 7fc9267fc640 1 --2- 172.21.15.195:0/1788627337 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7fc91c067190 0x7fc91c069640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:37:06.578 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:37:06.575+0000 7fc9267fc640 1 -- 172.21.15.195:0/1788627337 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 3770+0+0 (secure 0 0 0) 0x7fc9200a4780 con 0x7fc9300fe290 2024-08-18T22:37:06.578 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:37:06.575+0000 7fc935a11640 1 --2- 172.21.15.195:0/1788627337 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7fc91c067190 0x7fc91c069640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:37:06.578 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:37:06.575+0000 7fc935a11640 1 --2- 172.21.15.195:0/1788627337 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7fc91c067190 0x7fc91c069640 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fc92c0041d0 tx=0x7fc92c009040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:37:06.580 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:37:06.579+0000 7fc9267fc640 1 -- 172.21.15.195:0/1788627337 <== mon.1 v2:172.21.15.195:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fc920072140 con 0x7fc9300fe290 2024-08-18T22:37:06.751 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:37:06.750+0000 7fc937c75640 1 -- 172.21.15.195:0/1788627337 --> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi195:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7fc930101af0 con 0x7fc91c067190 2024-08-18T22:37:06.751 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:37:06 smithi195 ceph-mon[23370]: osdmap e30: 4 total, 4 up, 4 in 2024-08-18T22:37:06.752 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:37:06 smithi195 ceph-mon[23370]: osdmap e31: 4 total, 4 up, 4 in 2024-08-18T22:37:07.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:37:06 smithi121 ceph-mon[16788]: osdmap e30: 4 total, 4 up, 4 in 2024-08-18T22:37:07.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:37:06 smithi121 ceph-mon[16788]: osdmap e31: 4 total, 4 up, 4 in 2024-08-18T22:37:07.883 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:37:07 smithi195 ceph-mon[23370]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-08-18T22:37:07.883 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:37:07 smithi195 ceph-mon[23370]: from='client.24151 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi195:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-08-18T22:37:07.883 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:37:07 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-08-18T22:37:07.883 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:37:07 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-08-18T22:37:07.884 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:37:07 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:37:07.884 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:37:07 smithi195 ceph-mon[23370]: Detected new or changed devices on smithi195 2024-08-18T22:37:07.884 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:37:07 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:37:07.884 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:37:07 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:37:07.884 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:37:07 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-08-18T22:37:07.884 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:37:07 smithi195 ceph-mon[23370]: Adjusting osd_memory_target on smithi195 to 15936M 2024-08-18T22:37:07.884 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:37:07 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:37:07.884 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:37:07 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:37:07.884 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:37:07 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-18T22:37:07.884 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:37:07 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:37:07.884 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:37:07 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-18T22:37:07.884 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:37:07 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:37:07.884 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:37:07 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-18T22:37:07.884 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:37:07 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:37:07.985 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:37:07 smithi121 ceph-mon[16788]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-08-18T22:37:07.985 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:37:07 smithi121 ceph-mon[16788]: from='client.24151 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi195:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-08-18T22:37:07.985 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:37:07 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-08-18T22:37:07.985 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:37:07 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-08-18T22:37:07.985 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:37:07 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:37:07.985 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:37:07 smithi121 ceph-mon[16788]: Detected new or changed devices on smithi195 2024-08-18T22:37:07.985 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:37:07 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:37:07.985 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:37:07 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:37:07.985 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:37:07 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-08-18T22:37:07.985 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:37:07 smithi121 ceph-mon[16788]: Adjusting osd_memory_target on smithi195 to 15936M 2024-08-18T22:37:07.986 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:37:07 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:37:07.986 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:37:07 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:37:07.986 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:37:07 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-18T22:37:07.986 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:37:07 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:37:07.986 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:37:07 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-18T22:37:07.986 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:37:07 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:37:07.986 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:37:07 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-18T22:37:07.986 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:37:07 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:37:08.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:37:08 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-18T22:37:09.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:37:08 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-18T22:37:09.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:37:09 smithi195 ceph-mon[23370]: pgmap v94: 1 pgs: 1 peering; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 118 KiB/s, 0 objects/s recovering 2024-08-18T22:37:09.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:37:09 smithi195 ceph-mon[23370]: from='client.? 172.21.15.195:0/2967489000' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a2582923-0d40-4cc4-b1bf-361f88e9bb68"}]: dispatch 2024-08-18T22:37:09.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:37:09 smithi195 ceph-mon[23370]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a2582923-0d40-4cc4-b1bf-361f88e9bb68"}]: dispatch 2024-08-18T22:37:09.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:37:09 smithi195 ceph-mon[23370]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a2582923-0d40-4cc4-b1bf-361f88e9bb68"}]': finished 2024-08-18T22:37:09.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:37:09 smithi195 ceph-mon[23370]: osdmap e32: 5 total, 4 up, 5 in 2024-08-18T22:37:09.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:37:09 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-08-18T22:37:09.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:37:09 smithi195 ceph-mon[23370]: from='client.? 172.21.15.195:0/636790085' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-08-18T22:37:10.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:37:09 smithi121 ceph-mon[16788]: pgmap v94: 1 pgs: 1 peering; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 118 KiB/s, 0 objects/s recovering 2024-08-18T22:37:10.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:37:09 smithi121 ceph-mon[16788]: from='client.? 172.21.15.195:0/2967489000' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a2582923-0d40-4cc4-b1bf-361f88e9bb68"}]: dispatch 2024-08-18T22:37:10.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:37:09 smithi121 ceph-mon[16788]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a2582923-0d40-4cc4-b1bf-361f88e9bb68"}]: dispatch 2024-08-18T22:37:10.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:37:09 smithi121 ceph-mon[16788]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a2582923-0d40-4cc4-b1bf-361f88e9bb68"}]': finished 2024-08-18T22:37:10.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:37:09 smithi121 ceph-mon[16788]: osdmap e32: 5 total, 4 up, 5 in 2024-08-18T22:37:10.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:37:09 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-08-18T22:37:10.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:37:09 smithi121 ceph-mon[16788]: from='client.? 172.21.15.195:0/636790085' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-08-18T22:37:11.834 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:37:11 smithi121 ceph-mon[16788]: pgmap v96: 1 pgs: 1 peering; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 98 KiB/s, 0 objects/s recovering 2024-08-18T22:37:12.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:37:11 smithi195 ceph-mon[23370]: pgmap v96: 1 pgs: 1 peering; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 98 KiB/s, 0 objects/s recovering 2024-08-18T22:37:13.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:37:13 smithi195 ceph-mon[23370]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 84 KiB/s, 0 objects/s recovering 2024-08-18T22:37:14.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:37:13 smithi121 ceph-mon[16788]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 84 KiB/s, 0 objects/s recovering 2024-08-18T22:37:15.850 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:37:15 smithi195 ceph-mon[23370]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-08-18T22:37:16.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:37:15 smithi121 ceph-mon[16788]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-08-18T22:37:16.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:37:16 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-08-18T22:37:16.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:37:16 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:37:16.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:37:16 smithi195 ceph-mon[23370]: Deploying daemon osd.4 on smithi195 2024-08-18T22:37:17.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:37:16 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-08-18T22:37:17.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:37:16 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:37:17.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:37:16 smithi121 ceph-mon[16788]: Deploying daemon osd.4 on smithi195 2024-08-18T22:37:17.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:37:17 smithi195 ceph-mon[23370]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-08-18T22:37:18.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:37:17 smithi121 ceph-mon[16788]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-08-18T22:37:19.792 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:37:19 smithi195 ceph-mon[23370]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-08-18T22:37:20.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:37:19 smithi121 ceph-mon[16788]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-08-18T22:37:20.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:37:20 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-18T22:37:20.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:37:20 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:37:20.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:37:20 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:37:21.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:37:20 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-18T22:37:21.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:37:20 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:37:21.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:37:20 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:37:21.833 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:37:21 smithi121 ceph-mon[16788]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-08-18T22:37:22.129 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:37:21 smithi195 ceph-mon[23370]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-08-18T22:37:23.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:37:23 smithi195 ceph-mon[23370]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-08-18T22:37:23.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:37:23 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-18T22:37:24.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:37:23 smithi121 ceph-mon[16788]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-08-18T22:37:24.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:37:23 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-18T22:37:24.282 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:37:24.280+0000 7fc9267fc640 1 -- 172.21.15.195:0/1788627337 <== mgr.14206 v2:172.21.15.121:6800/3225195982 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fc930101af0 con 0x7fc91c067190 2024-08-18T22:37:24.282 INFO:teuthology.orchestra.run.smithi195.stdout:Created osd(s) 4 on host 'smithi195' 2024-08-18T22:37:24.284 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:37:24.283+0000 7fc937c75640 1 -- 172.21.15.195:0/1788627337 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7fc91c067190 msgr2=0x7fc91c069640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:37:24.284 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:37:24.283+0000 7fc937c75640 1 --2- 172.21.15.195:0/1788627337 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7fc91c067190 0x7fc91c069640 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fc92c0041d0 tx=0x7fc92c009040 comp rx=0 tx=0).stop 2024-08-18T22:37:24.284 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:37:24.283+0000 7fc937c75640 1 -- 172.21.15.195:0/1788627337 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc9300fe290 msgr2=0x7fc9300fb620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:37:24.284 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:37:24.283+0000 7fc937c75640 1 --2- 172.21.15.195:0/1788627337 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc9300fe290 0x7fc9300fb620 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fc9200048a0 tx=0x7fc920009da0 comp rx=0 tx=0).stop 2024-08-18T22:37:24.284 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:37:24.283+0000 7fc937c75640 1 -- 172.21.15.195:0/1788627337 shutdown_connections 2024-08-18T22:37:24.284 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:37:24.283+0000 7fc937c75640 1 --2- 172.21.15.195:0/1788627337 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7fc91c067190 0x7fc91c069640 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:37:24.284 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:37:24.283+0000 7fc937c75640 1 --2- 172.21.15.195:0/1788627337 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc9300fe290 0x7fc9300fb620 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:37:24.284 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:37:24.283+0000 7fc937c75640 1 --2- 172.21.15.195:0/1788627337 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc9300fd940 0x7fc9300fd0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:37:24.284 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:37:24.283+0000 7fc937c75640 1 -- 172.21.15.195:0/1788627337 >> 172.21.15.195:0/1788627337 conn(0x7fc9300f6140 msgr2=0x7fc9300f7910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:37:24.285 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:37:24.283+0000 7fc937c75640 1 -- 172.21.15.195:0/1788627337 shutdown_connections 2024-08-18T22:37:24.285 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:37:24.283+0000 7fc937c75640 1 -- 172.21.15.195:0/1788627337 wait complete. 2024-08-18T22:37:24.902 DEBUG:teuthology.orchestra.run.smithi195:osd.4> sudo journalctl -f -n 0 -u ceph-b003123a-5db1-11ef-bccf-c7b262605968@osd.4.service 2024-08-18T22:37:24.904 INFO:tasks.cephadm:Deploying osd.5 on smithi195 with /dev/vg_nvme/lv_2... 2024-08-18T22:37:24.904 DEBUG:teuthology.orchestra.run.smithi195:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b003123a-5db1-11ef-bccf-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-08-18T22:37:25.213 INFO:teuthology.orchestra.run.smithi195.stderr:Inferring config /var/lib/ceph/b003123a-5db1-11ef-bccf-c7b262605968/mon.smithi195/config 2024-08-18T22:37:25.547 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:37:25 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:37:25.547 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:37:25 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:37:25.547 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:37:25 smithi195 ceph-mon[23370]: from='osd.4 [v2:172.21.15.195:6808/587500564,v1:172.21.15.195:6809/587500564]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-08-18T22:37:25.547 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:37:25 smithi195 ceph-mon[23370]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-08-18T22:37:25.547 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:37:25 smithi195 ceph-mon[23370]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-08-18T22:37:25.547 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:37:25 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:37:25.547 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:37:25 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:37:25.583 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:37:25 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:37:25.584 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:37:25 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:37:25.584 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:37:25 smithi121 ceph-mon[16788]: from='osd.4 [v2:172.21.15.195:6808/587500564,v1:172.21.15.195:6809/587500564]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-08-18T22:37:25.584 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:37:25 smithi121 ceph-mon[16788]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-08-18T22:37:25.584 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:37:25 smithi121 ceph-mon[16788]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-08-18T22:37:25.584 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:37:25 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:37:25.584 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:37:25 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:37:26.452 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:37:26 smithi195 ceph-mon[23370]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-08-18T22:37:26.452 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:37:26 smithi195 ceph-mon[23370]: osdmap e33: 5 total, 4 up, 5 in 2024-08-18T22:37:26.452 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:37:26 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-08-18T22:37:26.452 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:37:26 smithi195 ceph-mon[23370]: from='osd.4 [v2:172.21.15.195:6808/587500564,v1:172.21.15.195:6809/587500564]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]: dispatch 2024-08-18T22:37:26.453 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:37:26 smithi195 ceph-mon[23370]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]: dispatch 2024-08-18T22:37:26.453 INFO:journalctl@ceph.osd.4.smithi195.stdout:Aug 18 22:37:26 smithi195 ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-4[35703]: 2024-08-18T22:37:26.290+0000 7f0104f57640 -1 osd.4 0 waiting for initial osdmap 2024-08-18T22:37:26.453 INFO:journalctl@ceph.osd.4.smithi195.stdout:Aug 18 22:37:26 smithi195 ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-4[35703]: 2024-08-18T22:37:26.298+0000 7f00fdd8a640 -1 osd.4 34 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-18T22:37:26.583 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:37:26 smithi121 ceph-mon[16788]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-08-18T22:37:26.583 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:37:26 smithi121 ceph-mon[16788]: osdmap e33: 5 total, 4 up, 5 in 2024-08-18T22:37:26.584 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:37:26 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-08-18T22:37:26.584 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:37:26 smithi121 ceph-mon[16788]: from='osd.4 [v2:172.21.15.195:6808/587500564,v1:172.21.15.195:6809/587500564]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]: dispatch 2024-08-18T22:37:26.584 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:37:26 smithi121 ceph-mon[16788]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]: dispatch 2024-08-18T22:37:27.578 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:37:27 smithi195 ceph-mon[23370]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]': finished 2024-08-18T22:37:27.578 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:37:27 smithi195 ceph-mon[23370]: osdmap e34: 5 total, 4 up, 5 in 2024-08-18T22:37:27.578 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:37:27 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-08-18T22:37:27.579 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:37:27 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-08-18T22:37:27.579 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:37:27 smithi195 ceph-mon[23370]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-08-18T22:37:27.583 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:37:27 smithi121 ceph-mon[16788]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]': finished 2024-08-18T22:37:27.583 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:37:27 smithi121 ceph-mon[16788]: osdmap e34: 5 total, 4 up, 5 in 2024-08-18T22:37:27.583 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:37:27 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-08-18T22:37:27.583 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:37:27 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-08-18T22:37:27.583 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:37:27 smithi121 ceph-mon[16788]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-08-18T22:37:28.269 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-08-18T22:37:28.290 DEBUG:teuthology.orchestra.run.smithi195:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b003123a-5db1-11ef-bccf-c7b262605968 -- ceph orch daemon add osd smithi195:vg_nvme/lv_2 2024-08-18T22:37:28.409 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:37:28 smithi195 ceph-mon[23370]: purged_snaps scrub starts 2024-08-18T22:37:28.409 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:37:28 smithi195 ceph-mon[23370]: purged_snaps scrub ok 2024-08-18T22:37:28.409 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:37:28 smithi195 ceph-mon[23370]: osd.4 [v2:172.21.15.195:6808/587500564,v1:172.21.15.195:6809/587500564] boot 2024-08-18T22:37:28.409 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:37:28 smithi195 ceph-mon[23370]: osdmap e35: 5 total, 5 up, 5 in 2024-08-18T22:37:28.409 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:37:28 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-08-18T22:37:28.584 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:37:28 smithi121 ceph-mon[16788]: purged_snaps scrub starts 2024-08-18T22:37:28.584 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:37:28 smithi121 ceph-mon[16788]: purged_snaps scrub ok 2024-08-18T22:37:28.584 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:37:28 smithi121 ceph-mon[16788]: osd.4 [v2:172.21.15.195:6808/587500564,v1:172.21.15.195:6809/587500564] boot 2024-08-18T22:37:28.584 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:37:28 smithi121 ceph-mon[16788]: osdmap e35: 5 total, 5 up, 5 in 2024-08-18T22:37:28.584 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:37:28 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-08-18T22:37:28.906 INFO:teuthology.orchestra.run.smithi195.stderr:Inferring config /var/lib/ceph/b003123a-5db1-11ef-bccf-c7b262605968/mon.smithi195/config 2024-08-18T22:37:29.583 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:37:29 smithi121 ceph-mon[16788]: osdmap e36: 5 total, 5 up, 5 in 2024-08-18T22:37:29.583 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:37:29 smithi121 ceph-mon[16788]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-08-18T22:37:29.659 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:37:29 smithi195 ceph-mon[23370]: osdmap e36: 5 total, 5 up, 5 in 2024-08-18T22:37:29.659 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:37:29 smithi195 ceph-mon[23370]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-08-18T22:37:31.063 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:37:31.035+0000 7f1c58cc6640 1 -- 172.21.15.195:0/1395971895 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1c540fc4c0 msgr2=0x7f1c540fc930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:37:31.063 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:37:31.035+0000 7f1c58cc6640 1 --2- 172.21.15.195:0/1395971895 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1c540fc4c0 0x7f1c540fc930 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f1c3c0048d0 tx=0x7f1c3c009da0 comp rx=0 tx=0).stop 2024-08-18T22:37:31.064 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:37:31.035+0000 7f1c58cc6640 1 -- 172.21.15.195:0/1395971895 shutdown_connections 2024-08-18T22:37:31.064 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:37:31.035+0000 7f1c58cc6640 1 --2- 172.21.15.195:0/1395971895 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1c540fc4c0 0x7f1c540fc930 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:37:31.064 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:37:31.035+0000 7f1c58cc6640 1 --2- 172.21.15.195:0/1395971895 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1c540fb1f0 0x7f1c540fb600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:37:31.064 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:37:31.035+0000 7f1c58cc6640 1 -- 172.21.15.195:0/1395971895 >> 172.21.15.195:0/1395971895 conn(0x7f1c540f69b0 msgr2=0x7f1c540f8de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:37:31.064 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:37:31.035+0000 7f1c58cc6640 1 -- 172.21.15.195:0/1395971895 shutdown_connections 2024-08-18T22:37:31.064 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:37:31.035+0000 7f1c58cc6640 1 -- 172.21.15.195:0/1395971895 wait complete. 2024-08-18T22:37:31.064 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:37:31.035+0000 7f1c58cc6640 1 Processor -- start 2024-08-18T22:37:31.064 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:37:31.036+0000 7f1c58cc6640 1 -- start start 2024-08-18T22:37:31.064 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:37:31.036+0000 7f1c58cc6640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1c540fb1f0 0x7f1c5410fb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:37:31.064 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:37:31.036+0000 7f1c58cc6640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1c540fc4c0 0x7f1c541120b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:37:31.064 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:37:31.036+0000 7f1c58cc6640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c54066550 con 0x7f1c540fb1f0 2024-08-18T22:37:31.064 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:37:31.036+0000 7f1c58cc6640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c540666c0 con 0x7f1c540fc4c0 2024-08-18T22:37:31.065 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:37:31.036+0000 7f1c4bfff640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1c540fc4c0 0x7f1c541120b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:37:31.065 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:37:31.036+0000 7f1c4bfff640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1c540fc4c0 0x7f1c541120b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.195:49312/0 (socket says 172.21.15.195:49312) 2024-08-18T22:37:31.065 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:37:31.036+0000 7f1c4bfff640 1 -- 172.21.15.195:0/1447010791 learned_addr learned my addr 172.21.15.195:0/1447010791 (peer_addr_for_me v2:172.21.15.195:0/0) 2024-08-18T22:37:31.065 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:37:31.036+0000 7f1c5259c640 1 --2- 172.21.15.195:0/1447010791 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1c540fb1f0 0x7f1c5410fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:37:31.065 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:37:31.036+0000 7f1c4bfff640 1 -- 172.21.15.195:0/1447010791 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1c540fb1f0 msgr2=0x7f1c5410fb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:37:31.065 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:37:31.036+0000 7f1c4bfff640 1 --2- 172.21.15.195:0/1447010791 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1c540fb1f0 0x7f1c5410fb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:37:31.065 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:37:31.036+0000 7f1c4bfff640 1 -- 172.21.15.195:0/1447010791 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c3c005040 con 0x7f1c540fc4c0 2024-08-18T22:37:31.065 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:37:31.036+0000 7f1c4bfff640 1 --2- 172.21.15.195:0/1447010791 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1c540fc4c0 0x7f1c541120b0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f1c3c0043d0 tx=0x7f1c3c009da0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:37:31.065 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:37:31.036+0000 7f1c4affd640 1 -- 172.21.15.195:0/1447010791 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1c3c038070 con 0x7f1c540fc4c0 2024-08-18T22:37:31.065 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:37:31.036+0000 7f1c58cc6640 1 -- 172.21.15.195:0/1447010791 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c54112650 con 0x7f1c540fc4c0 2024-08-18T22:37:31.065 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:37:31.036+0000 7f1c4affd640 1 -- 172.21.15.195:0/1447010791 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f1c3c02ae90 con 0x7f1c540fc4c0 2024-08-18T22:37:31.065 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:37:31.036+0000 7f1c4affd640 1 -- 172.21.15.195:0/1447010791 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1c3c03e670 con 0x7f1c540fc4c0 2024-08-18T22:37:31.065 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:37:31.037+0000 7f1c58cc6640 1 -- 172.21.15.195:0/1447010791 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c54112bc0 con 0x7f1c540fc4c0 2024-08-18T22:37:31.066 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:37:31.038+0000 7f1c58cc6640 1 -- 172.21.15.195:0/1447010791 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c540fa650 con 0x7f1c540fc4c0 2024-08-18T22:37:31.066 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:37:31.038+0000 7f1c4affd640 1 -- 172.21.15.195:0/1447010791 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 19) v1 ==== 85127+0+0 (secure 0 0 0) 0x7f1c3c030020 con 0x7f1c540fc4c0 2024-08-18T22:37:31.066 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:37:31.038+0000 7f1c4affd640 1 --2- 172.21.15.195:0/1447010791 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7f1c40067190 0x7f1c40069640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:37:31.066 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:37:31.038+0000 7f1c4affd640 1 -- 172.21.15.195:0/1447010791 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 4202+0+0 (secure 0 0 0) 0x7f1c3c0a47b0 con 0x7f1c540fc4c0 2024-08-18T22:37:31.066 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:37:31.038+0000 7f1c5259c640 1 --2- 172.21.15.195:0/1447010791 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7f1c40067190 0x7f1c40069640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:37:31.066 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:37:31.039+0000 7f1c5259c640 1 --2- 172.21.15.195:0/1447010791 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7f1c40067190 0x7f1c40069640 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f1c54066240 tx=0x7f1c4400b040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:37:31.066 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:37:31.042+0000 7f1c4affd640 1 -- 172.21.15.195:0/1447010791 <== mon.1 v2:172.21.15.195:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f1c3c071ff0 con 0x7f1c540fc4c0 2024-08-18T22:37:31.206 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:37:31.205+0000 7f1c58cc6640 1 -- 172.21.15.195:0/1447010791 --> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi195:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7f1c54100960 con 0x7f1c40067190 2024-08-18T22:37:31.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:37:31 smithi195 ceph-mon[23370]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-08-18T22:37:31.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:37:31 smithi195 ceph-mon[23370]: Detected new or changed devices on smithi195 2024-08-18T22:37:31.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:37:31 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:37:31.910 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:37:31 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:37:31.910 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:37:31 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-08-18T22:37:31.910 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:37:31 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-08-18T22:37:31.910 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:37:31 smithi195 ceph-mon[23370]: Adjusting osd_memory_target on smithi195 to 7968M 2024-08-18T22:37:31.910 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:37:31 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:37:31.910 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:37:31 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:37:31.910 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:37:31 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-18T22:37:31.910 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:37:31 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:37:31.910 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:37:31 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-18T22:37:31.910 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:37:31 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:37:31.910 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:37:31 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-18T22:37:31.910 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:37:31 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:37:31.910 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:37:31 smithi195 ceph-mon[23370]: from='client.24169 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi195:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-08-18T22:37:31.911 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:37:31 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-08-18T22:37:31.911 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:37:31 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-08-18T22:37:31.911 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:37:31 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:37:32.334 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:37:31 smithi121 ceph-mon[16788]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-08-18T22:37:32.334 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:37:31 smithi121 ceph-mon[16788]: Detected new or changed devices on smithi195 2024-08-18T22:37:32.334 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:37:31 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:37:32.334 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:37:31 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:37:32.334 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:37:31 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-08-18T22:37:32.334 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:37:31 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-08-18T22:37:32.335 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:37:31 smithi121 ceph-mon[16788]: Adjusting osd_memory_target on smithi195 to 7968M 2024-08-18T22:37:32.335 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:37:31 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:37:32.335 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:37:31 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:37:32.335 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:37:31 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-18T22:37:32.335 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:37:31 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:37:32.335 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:37:31 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-18T22:37:32.335 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:37:31 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:37:32.335 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:37:31 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-18T22:37:32.335 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:37:31 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:37:32.335 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:37:31 smithi121 ceph-mon[16788]: from='client.24169 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi195:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-08-18T22:37:32.335 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:37:31 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-08-18T22:37:32.335 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:37:31 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-08-18T22:37:32.335 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:37:31 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:37:34.085 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:37:33 smithi195 ceph-mon[23370]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-08-18T22:37:34.086 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:37:33 smithi195 ceph-mon[23370]: from='client.? 172.21.15.195:0/3645985454' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ae063840-fa2d-4d2e-b303-5d034d3f1b23"}]: dispatch 2024-08-18T22:37:34.086 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:37:33 smithi195 ceph-mon[23370]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ae063840-fa2d-4d2e-b303-5d034d3f1b23"}]: dispatch 2024-08-18T22:37:34.086 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:37:33 smithi195 ceph-mon[23370]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ae063840-fa2d-4d2e-b303-5d034d3f1b23"}]': finished 2024-08-18T22:37:34.086 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:37:33 smithi195 ceph-mon[23370]: osdmap e37: 6 total, 5 up, 6 in 2024-08-18T22:37:34.086 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:37:33 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-08-18T22:37:34.333 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:37:33 smithi121 ceph-mon[16788]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-08-18T22:37:34.334 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:37:33 smithi121 ceph-mon[16788]: from='client.? 172.21.15.195:0/3645985454' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ae063840-fa2d-4d2e-b303-5d034d3f1b23"}]: dispatch 2024-08-18T22:37:34.334 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:37:33 smithi121 ceph-mon[16788]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ae063840-fa2d-4d2e-b303-5d034d3f1b23"}]: dispatch 2024-08-18T22:37:34.334 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:37:33 smithi121 ceph-mon[16788]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ae063840-fa2d-4d2e-b303-5d034d3f1b23"}]': finished 2024-08-18T22:37:34.334 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:37:33 smithi121 ceph-mon[16788]: osdmap e37: 6 total, 5 up, 6 in 2024-08-18T22:37:34.334 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:37:33 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-08-18T22:37:35.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:37:34 smithi195 ceph-mon[23370]: from='client.? 172.21.15.195:0/1030942259' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-08-18T22:37:35.333 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:37:34 smithi121 ceph-mon[16788]: from='client.? 172.21.15.195:0/1030942259' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-08-18T22:37:36.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:37:35 smithi195 ceph-mon[23370]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-08-18T22:37:36.333 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:37:35 smithi121 ceph-mon[16788]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-08-18T22:37:38.132 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:37:37 smithi195 ceph-mon[23370]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-08-18T22:37:38.135 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:37:37 smithi121 ceph-mon[16788]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-08-18T22:37:38.976 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:37:38 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-18T22:37:39.155 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:37:38 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-18T22:37:40.141 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:37:39 smithi195 ceph-mon[23370]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-08-18T22:37:40.317 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:37:39 smithi121 ceph-mon[16788]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-08-18T22:37:41.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:37:40 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-08-18T22:37:41.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:37:40 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:37:41.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:37:40 smithi195 ceph-mon[23370]: Deploying daemon osd.5 on smithi195 2024-08-18T22:37:41.333 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:37:40 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-08-18T22:37:41.333 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:37:40 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:37:41.333 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:37:40 smithi121 ceph-mon[16788]: Deploying daemon osd.5 on smithi195 2024-08-18T22:37:42.033 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:37:41 smithi195 ceph-mon[23370]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-08-18T22:37:42.333 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:37:41 smithi121 ceph-mon[16788]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-08-18T22:37:44.160 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:37:43 smithi195 ceph-mon[23370]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-08-18T22:37:44.333 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:37:43 smithi121 ceph-mon[16788]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-08-18T22:37:46.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:37:45 smithi195 ceph-mon[23370]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-08-18T22:37:46.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:37:45 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-18T22:37:46.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:37:45 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:37:46.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:37:45 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:37:46.333 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:37:45 smithi121 ceph-mon[16788]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-08-18T22:37:46.334 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:37:45 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-18T22:37:46.334 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:37:45 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:37:46.334 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:37:45 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:37:48.120 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:37:47 smithi195 ceph-mon[23370]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-08-18T22:37:48.153 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:37:48.152+0000 7f1c4affd640 1 -- 172.21.15.195:0/1447010791 <== mgr.14206 v2:172.21.15.121:6800/3225195982 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f1c54100960 con 0x7f1c40067190 2024-08-18T22:37:48.154 INFO:teuthology.orchestra.run.smithi195.stdout:Created osd(s) 5 on host 'smithi195' 2024-08-18T22:37:48.156 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:37:48.154+0000 7f1c58cc6640 1 -- 172.21.15.195:0/1447010791 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7f1c40067190 msgr2=0x7f1c40069640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:37:48.156 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:37:48.154+0000 7f1c58cc6640 1 --2- 172.21.15.195:0/1447010791 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7f1c40067190 0x7f1c40069640 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f1c54066240 tx=0x7f1c4400b040 comp rx=0 tx=0).stop 2024-08-18T22:37:48.156 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:37:48.154+0000 7f1c58cc6640 1 -- 172.21.15.195:0/1447010791 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1c540fc4c0 msgr2=0x7f1c541120b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:37:48.156 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:37:48.154+0000 7f1c58cc6640 1 --2- 172.21.15.195:0/1447010791 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1c540fc4c0 0x7f1c541120b0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f1c3c0043d0 tx=0x7f1c3c009da0 comp rx=0 tx=0).stop 2024-08-18T22:37:48.156 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:37:48.154+0000 7f1c58cc6640 1 -- 172.21.15.195:0/1447010791 shutdown_connections 2024-08-18T22:37:48.156 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:37:48.154+0000 7f1c58cc6640 1 --2- 172.21.15.195:0/1447010791 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7f1c40067190 0x7f1c40069640 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:37:48.156 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:37:48.154+0000 7f1c58cc6640 1 --2- 172.21.15.195:0/1447010791 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1c540fc4c0 0x7f1c541120b0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:37:48.156 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:37:48.154+0000 7f1c58cc6640 1 --2- 172.21.15.195:0/1447010791 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1c540fb1f0 0x7f1c5410fb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:37:48.156 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:37:48.154+0000 7f1c58cc6640 1 -- 172.21.15.195:0/1447010791 >> 172.21.15.195:0/1447010791 conn(0x7f1c540f69b0 msgr2=0x7f1c540f81a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:37:48.156 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:37:48.155+0000 7f1c58cc6640 1 -- 172.21.15.195:0/1447010791 shutdown_connections 2024-08-18T22:37:48.156 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:37:48.155+0000 7f1c58cc6640 1 -- 172.21.15.195:0/1447010791 wait complete. 2024-08-18T22:37:48.333 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:37:47 smithi121 ceph-mon[16788]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-08-18T22:37:49.138 DEBUG:teuthology.orchestra.run.smithi195:osd.5> sudo journalctl -f -n 0 -u ceph-b003123a-5db1-11ef-bccf-c7b262605968@osd.5.service 2024-08-18T22:37:49.140 INFO:tasks.cephadm:Waiting for 6 OSDs to come up... 2024-08-18T22:37:49.141 DEBUG:teuthology.orchestra.run.smithi121:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b003123a-5db1-11ef-bccf-c7b262605968 -- ceph osd stat -f json 2024-08-18T22:37:49.403 INFO:teuthology.orchestra.run.smithi121.stderr:Inferring config /var/lib/ceph/b003123a-5db1-11ef-bccf-c7b262605968/mon.smithi121/config 2024-08-18T22:37:49.409 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:37:49 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:37:49.409 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:37:49 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:37:49.409 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:37:49 smithi195 ceph-mon[23370]: from='osd.5 [v2:172.21.15.195:6816/2603984040,v1:172.21.15.195:6817/2603984040]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-08-18T22:37:49.410 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:37:49 smithi195 ceph-mon[23370]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-08-18T22:37:49.525 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:37:49 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:37:49.525 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:37:49 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:37:49.525 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:37:49 smithi121 ceph-mon[16788]: from='osd.5 [v2:172.21.15.195:6816/2603984040,v1:172.21.15.195:6817/2603984040]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-08-18T22:37:49.525 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:37:49 smithi121 ceph-mon[16788]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-08-18T22:37:50.435 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:37:50 smithi195 ceph-mon[23370]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-08-18T22:37:50.435 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:37:50 smithi195 ceph-mon[23370]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-08-18T22:37:50.435 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:37:50 smithi195 ceph-mon[23370]: osdmap e38: 6 total, 5 up, 6 in 2024-08-18T22:37:50.435 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:37:50 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-08-18T22:37:50.435 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:37:50 smithi195 ceph-mon[23370]: from='osd.5 [v2:172.21.15.195:6816/2603984040,v1:172.21.15.195:6817/2603984040]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]: dispatch 2024-08-18T22:37:50.435 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:37:50 smithi195 ceph-mon[23370]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]: dispatch 2024-08-18T22:37:50.435 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:37:50 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:37:50.436 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:37:50 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:37:50.436 INFO:journalctl@ceph.osd.5.smithi195.stdout:Aug 18 22:37:50 smithi195 ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-5[42571]: 2024-08-18T22:37:50.161+0000 7fad550d7640 -1 osd.5 0 waiting for initial osdmap 2024-08-18T22:37:50.436 INFO:journalctl@ceph.osd.5.smithi195.stdout:Aug 18 22:37:50 smithi195 ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-5[42571]: 2024-08-18T22:37:50.169+0000 7fad51f12640 -1 osd.5 39 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-18T22:37:50.466 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:37:50 smithi121 ceph-mon[16788]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-08-18T22:37:50.466 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:37:50 smithi121 ceph-mon[16788]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-08-18T22:37:50.466 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:37:50 smithi121 ceph-mon[16788]: osdmap e38: 6 total, 5 up, 6 in 2024-08-18T22:37:50.466 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:37:50 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-08-18T22:37:50.466 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:37:50 smithi121 ceph-mon[16788]: from='osd.5 [v2:172.21.15.195:6816/2603984040,v1:172.21.15.195:6817/2603984040]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]: dispatch 2024-08-18T22:37:50.466 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:37:50 smithi121 ceph-mon[16788]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]: dispatch 2024-08-18T22:37:50.466 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:37:50 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:37:50.466 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:37:50 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:37:51.002 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:37:50.996+0000 7f913a2b1640 1 -- 172.21.15.121:0/1331284774 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f91340fc2d0 msgr2=0x7f91340fc6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:37:51.002 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:37:50.996+0000 7f913a2b1640 1 --2- 172.21.15.121:0/1331284774 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f91340fc2d0 0x7f91340fc6e0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f91240048d0 tx=0x7f9124009da0 comp rx=0 tx=0).stop 2024-08-18T22:37:51.002 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:37:50.997+0000 7f913a2b1640 1 -- 172.21.15.121:0/1331284774 shutdown_connections 2024-08-18T22:37:51.002 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:37:50.997+0000 7f913a2b1640 1 --2- 172.21.15.121:0/1331284774 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f91340fd5a0 0x7f91340fda10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:37:51.003 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:37:50.997+0000 7f913a2b1640 1 --2- 172.21.15.121:0/1331284774 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f91340fc2d0 0x7f91340fc6e0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:37:51.003 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:37:50.997+0000 7f913a2b1640 1 -- 172.21.15.121:0/1331284774 >> 172.21.15.121:0/1331284774 conn(0x7f91340f7ab0 msgr2=0x7f91340f9ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:37:51.003 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:37:50.997+0000 7f913a2b1640 1 -- 172.21.15.121:0/1331284774 shutdown_connections 2024-08-18T22:37:51.003 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:37:50.997+0000 7f913a2b1640 1 -- 172.21.15.121:0/1331284774 wait complete. 2024-08-18T22:37:51.003 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:37:50.997+0000 7f913a2b1640 1 Processor -- start 2024-08-18T22:37:51.003 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:37:50.997+0000 7f913a2b1640 1 -- start start 2024-08-18T22:37:51.003 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:37:50.998+0000 7f913a2b1640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f91340fc2d0 0x7f913410ce90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:37:51.003 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:37:50.998+0000 7f913a2b1640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f91340fd5a0 0x7f913410d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:37:51.003 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:37:50.998+0000 7f913a2b1640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f913410da20 con 0x7f91340fd5a0 2024-08-18T22:37:51.003 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:37:50.998+0000 7f913a2b1640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f913410e160 con 0x7f91340fc2d0 2024-08-18T22:37:51.003 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:37:50.998+0000 7f91337fe640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f91340fd5a0 0x7f913410d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:37:51.003 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:37:50.998+0000 7f91337fe640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f91340fd5a0 0x7f913410d3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:60934/0 (socket says 172.21.15.121:60934) 2024-08-18T22:37:51.003 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:37:50.998+0000 7f91337fe640 1 -- 172.21.15.121:0/2175696188 learned_addr learned my addr 172.21.15.121:0/2175696188 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-18T22:37:51.004 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:37:50.998+0000 7f9133fff640 1 --2- 172.21.15.121:0/2175696188 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f91340fc2d0 0x7f913410ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:37:51.004 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:37:50.998+0000 7f91337fe640 1 -- 172.21.15.121:0/2175696188 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f91340fc2d0 msgr2=0x7f913410ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:37:51.004 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:37:50.998+0000 7f91337fe640 1 --2- 172.21.15.121:0/2175696188 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f91340fc2d0 0x7f913410ce90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:37:51.004 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:37:50.998+0000 7f91337fe640 1 -- 172.21.15.121:0/2175696188 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9124005040 con 0x7f91340fd5a0 2024-08-18T22:37:51.004 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:37:50.998+0000 7f9133fff640 1 --2- 172.21.15.121:0/2175696188 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f91340fc2d0 0x7f913410ce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:37:51.004 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:37:50.998+0000 7f91337fe640 1 --2- 172.21.15.121:0/2175696188 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f91340fd5a0 0x7f913410d3d0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f9128002a50 tx=0x7f9128004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:37:51.004 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:37:50.998+0000 7f9130ff9640 1 -- 172.21.15.121:0/2175696188 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9128007c30 con 0x7f91340fd5a0 2024-08-18T22:37:51.004 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:37:50.998+0000 7f913a2b1640 1 -- 172.21.15.121:0/2175696188 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f913410e3f0 con 0x7f91340fd5a0 2024-08-18T22:37:51.004 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:37:50.998+0000 7f9130ff9640 1 -- 172.21.15.121:0/2175696188 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f912800f040 con 0x7f91340fd5a0 2024-08-18T22:37:51.004 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:37:50.998+0000 7f9130ff9640 1 -- 172.21.15.121:0/2175696188 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f912800da50 con 0x7f91340fd5a0 2024-08-18T22:37:51.004 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:37:50.998+0000 7f913a2b1640 1 -- 172.21.15.121:0/2175696188 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f913410e990 con 0x7f91340fd5a0 2024-08-18T22:37:51.004 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:37:50.999+0000 7f913a2b1640 1 -- 172.21.15.121:0/2175696188 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91340fb730 con 0x7f91340fd5a0 2024-08-18T22:37:51.004 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:37:51.000+0000 7f9130ff9640 1 -- 172.21.15.121:0/2175696188 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 19) v1 ==== 85127+0+0 (secure 0 0 0) 0x7f912800dbf0 con 0x7f91340fd5a0 2024-08-18T22:37:51.005 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:37:51.000+0000 7f9130ff9640 1 --2- 172.21.15.121:0/2175696188 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7f911c067190 0x7f911c069640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:37:51.005 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:37:51.000+0000 7f9130ff9640 1 -- 172.21.15.121:0/2175696188 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4354+0+0 (secure 0 0 0) 0x7f9128083ee0 con 0x7f91340fd5a0 2024-08-18T22:37:51.005 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:37:51.001+0000 7f9133fff640 1 --2- 172.21.15.121:0/2175696188 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7f911c067190 0x7f911c069640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:37:51.005 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:37:51.001+0000 7f9133fff640 1 --2- 172.21.15.121:0/2175696188 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7f911c067190 0x7f911c069640 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f912400b020 tx=0x7f9124009da0 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:37:51.005 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:37:51.005+0000 7f9130ff9640 1 -- 172.21.15.121:0/2175696188 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f91280515d0 con 0x7f91340fd5a0 2024-08-18T22:37:51.166 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:37:51.165+0000 7f913a2b1640 1 -- 172.21.15.121:0/2175696188 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) v1 -- 0x7f913404b4c0 con 0x7f91340fd5a0 2024-08-18T22:37:51.167 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:37:51.166+0000 7f9130ff9640 1 -- 172.21.15.121:0/2175696188 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v40) v1 ==== 74+0+130 (secure 0 0 0) 0x7f913404b4c0 con 0x7f91340fd5a0 2024-08-18T22:37:51.167 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-08-18T22:37:51.169 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:37:51.168+0000 7f913a2b1640 1 -- 172.21.15.121:0/2175696188 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7f911c067190 msgr2=0x7f911c069640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:37:51.170 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:37:51.168+0000 7f913a2b1640 1 --2- 172.21.15.121:0/2175696188 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7f911c067190 0x7f911c069640 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f912400b020 tx=0x7f9124009da0 comp rx=0 tx=0).stop 2024-08-18T22:37:51.170 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:37:51.168+0000 7f913a2b1640 1 -- 172.21.15.121:0/2175696188 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f91340fd5a0 msgr2=0x7f913410d3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:37:51.170 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:37:51.168+0000 7f913a2b1640 1 --2- 172.21.15.121:0/2175696188 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f91340fd5a0 0x7f913410d3d0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f9128002a50 tx=0x7f9128004600 comp rx=0 tx=0).stop 2024-08-18T22:37:51.170 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:37:51.168+0000 7f913a2b1640 1 -- 172.21.15.121:0/2175696188 shutdown_connections 2024-08-18T22:37:51.170 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:37:51.168+0000 7f913a2b1640 1 --2- 172.21.15.121:0/2175696188 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7f911c067190 0x7f911c069640 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:37:51.170 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:37:51.168+0000 7f913a2b1640 1 --2- 172.21.15.121:0/2175696188 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f91340fd5a0 0x7f913410d3d0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:37:51.170 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:37:51.168+0000 7f913a2b1640 1 --2- 172.21.15.121:0/2175696188 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f91340fc2d0 0x7f913410ce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:37:51.170 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:37:51.168+0000 7f913a2b1640 1 -- 172.21.15.121:0/2175696188 >> 172.21.15.121:0/2175696188 conn(0x7f91340f7ab0 msgr2=0x7f91340f9260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:37:51.170 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:37:51.168+0000 7f913a2b1640 1 -- 172.21.15.121:0/2175696188 shutdown_connections 2024-08-18T22:37:51.170 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:37:51.168+0000 7f913a2b1640 1 -- 172.21.15.121:0/2175696188 wait complete. 2024-08-18T22:37:51.409 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:37:51 smithi195 ceph-mon[23370]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]': finished 2024-08-18T22:37:51.409 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:37:51 smithi195 ceph-mon[23370]: osdmap e39: 6 total, 5 up, 6 in 2024-08-18T22:37:51.409 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:37:51 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-08-18T22:37:51.409 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:37:51 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-08-18T22:37:51.444 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:37:51 smithi121 ceph-mon[16788]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]': finished 2024-08-18T22:37:51.445 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:37:51 smithi121 ceph-mon[16788]: osdmap e39: 6 total, 5 up, 6 in 2024-08-18T22:37:51.445 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:37:51 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-08-18T22:37:51.445 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:37:51 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-08-18T22:37:51.874 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":40,"num_osds":6,"num_up_osds":6,"osd_up_since":1724020671,"num_in_osds":6,"osd_in_since":1724020653,"num_remapped_pgs":0} 2024-08-18T22:37:51.874 DEBUG:teuthology.orchestra.run.smithi121:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid b003123a-5db1-11ef-bccf-c7b262605968 -- ceph osd dump --format=json 2024-08-18T22:37:52.132 INFO:teuthology.orchestra.run.smithi121.stderr:Inferring config /var/lib/ceph/b003123a-5db1-11ef-bccf-c7b262605968/mon.smithi121/config 2024-08-18T22:37:52.409 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:37:52 smithi195 ceph-mon[23370]: purged_snaps scrub starts 2024-08-18T22:37:52.409 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:37:52 smithi195 ceph-mon[23370]: purged_snaps scrub ok 2024-08-18T22:37:52.409 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:37:52 smithi195 ceph-mon[23370]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-08-18T22:37:52.409 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:37:52 smithi195 ceph-mon[23370]: osd.5 [v2:172.21.15.195:6816/2603984040,v1:172.21.15.195:6817/2603984040] boot 2024-08-18T22:37:52.409 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:37:52 smithi195 ceph-mon[23370]: osdmap e40: 6 total, 6 up, 6 in 2024-08-18T22:37:52.409 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:37:52 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-08-18T22:37:52.410 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:37:52 smithi195 ceph-mon[23370]: from='client.? 172.21.15.121:0/2175696188' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-08-18T22:37:52.469 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:37:52 smithi121 ceph-mon[16788]: purged_snaps scrub starts 2024-08-18T22:37:52.469 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:37:52 smithi121 ceph-mon[16788]: purged_snaps scrub ok 2024-08-18T22:37:52.469 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:37:52 smithi121 ceph-mon[16788]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-08-18T22:37:52.469 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:37:52 smithi121 ceph-mon[16788]: osd.5 [v2:172.21.15.195:6816/2603984040,v1:172.21.15.195:6817/2603984040] boot 2024-08-18T22:37:52.469 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:37:52 smithi121 ceph-mon[16788]: osdmap e40: 6 total, 6 up, 6 in 2024-08-18T22:37:52.469 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:37:52 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-08-18T22:37:52.470 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:37:52 smithi121 ceph-mon[16788]: from='client.? 172.21.15.121:0/2175696188' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-08-18T22:37:53.409 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:37:53 smithi195 ceph-mon[23370]: osdmap e41: 6 total, 6 up, 6 in 2024-08-18T22:37:53.409 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:37:53 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:37:53.409 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:37:53 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:37:53.409 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:37:53 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-08-18T22:37:53.409 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:37:53 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-08-18T22:37:53.409 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:37:53 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-08-18T22:37:53.409 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:37:53 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:37:53.409 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:37:53 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:37:53.410 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:37:53 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-18T22:37:53.410 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:37:53 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:37:53.457 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:37:53 smithi121 ceph-mon[16788]: osdmap e41: 6 total, 6 up, 6 in 2024-08-18T22:37:53.457 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:37:53 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:37:53.457 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:37:53 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:37:53.457 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:37:53 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-08-18T22:37:53.457 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:37:53 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-08-18T22:37:53.457 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:37:53 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-08-18T22:37:53.457 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:37:53 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:37:53.457 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:37:53 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:37:53.457 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:37:53 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-18T22:37:53.458 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:37:53 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:37:53.701 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:37:53.685+0000 7f5115830640 1 -- 172.21.15.121:0/855865316 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f51100fbec0 msgr2=0x7f51100fcdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:37:53.702 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:37:53.685+0000 7f5115830640 1 --2- 172.21.15.121:0/855865316 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f51100fbec0 0x7f51100fcdc0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f50f80048d0 tx=0x7f50f8009da0 comp rx=0 tx=0).stop 2024-08-18T22:37:53.702 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:37:53.685+0000 7f5115830640 1 -- 172.21.15.121:0/855865316 shutdown_connections 2024-08-18T22:37:53.702 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:37:53.685+0000 7f5115830640 1 --2- 172.21.15.121:0/855865316 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f51100fbec0 0x7f51100fcdc0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:37:53.702 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:37:53.685+0000 7f5115830640 1 --2- 172.21.15.121:0/855865316 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f51100fb5b0 0x7f51100fb980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:37:53.702 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:37:53.685+0000 7f5115830640 1 -- 172.21.15.121:0/855865316 >> 172.21.15.121:0/855865316 conn(0x7f5110072150 msgr2=0x7f5110072550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:37:53.702 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:37:53.685+0000 7f5115830640 1 -- 172.21.15.121:0/855865316 shutdown_connections 2024-08-18T22:37:53.702 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:37:53.685+0000 7f5115830640 1 -- 172.21.15.121:0/855865316 wait complete. 2024-08-18T22:37:53.702 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:37:53.685+0000 7f5115830640 1 Processor -- start 2024-08-18T22:37:53.702 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:37:53.685+0000 7f5115830640 1 -- start start 2024-08-18T22:37:53.703 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:37:53.686+0000 7f5115830640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f51100fb5b0 0x7f5110111ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:37:53.703 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:37:53.686+0000 7f5115830640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f51100fbec0 0x7f5110112400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:37:53.703 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:37:53.686+0000 7f5115830640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5110112a90 con 0x7f51100fbec0 2024-08-18T22:37:53.703 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:37:53.686+0000 7f5115830640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f511010be40 con 0x7f51100fb5b0 2024-08-18T22:37:53.703 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:37:53.686+0000 7f510e7fc640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f51100fbec0 0x7f5110112400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:37:53.703 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:37:53.686+0000 7f510e7fc640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f51100fbec0 0x7f5110112400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:60960/0 (socket says 172.21.15.121:60960) 2024-08-18T22:37:53.703 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:37:53.686+0000 7f510e7fc640 1 -- 172.21.15.121:0/2451940186 learned_addr learned my addr 172.21.15.121:0/2451940186 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-18T22:37:53.703 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:37:53.686+0000 7f510effd640 1 --2- 172.21.15.121:0/2451940186 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f51100fb5b0 0x7f5110111ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:37:53.703 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:37:53.686+0000 7f510e7fc640 1 -- 172.21.15.121:0/2451940186 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f51100fb5b0 msgr2=0x7f5110111ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:37:53.703 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:37:53.686+0000 7f510e7fc640 1 --2- 172.21.15.121:0/2451940186 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f51100fb5b0 0x7f5110111ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:37:53.703 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:37:53.686+0000 7f510e7fc640 1 -- 172.21.15.121:0/2451940186 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50f8005040 con 0x7f51100fbec0 2024-08-18T22:37:53.703 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:37:53.686+0000 7f510e7fc640 1 --2- 172.21.15.121:0/2451940186 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f51100fbec0 0x7f5110112400 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f50f8003080 tx=0x7f50f8009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:37:53.703 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:37:53.686+0000 7f51077fe640 1 -- 172.21.15.121:0/2451940186 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f50f8038070 con 0x7f51100fbec0 2024-08-18T22:37:53.704 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:37:53.686+0000 7f5115830640 1 -- 172.21.15.121:0/2451940186 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f511010c0c0 con 0x7f51100fbec0 2024-08-18T22:37:53.704 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:37:53.686+0000 7f51077fe640 1 -- 172.21.15.121:0/2451940186 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f50f80097e0 con 0x7f51100fbec0 2024-08-18T22:37:53.704 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:37:53.686+0000 7f51077fe640 1 -- 172.21.15.121:0/2451940186 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f50f803d420 con 0x7f51100fbec0 2024-08-18T22:37:53.704 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:37:53.686+0000 7f5115830640 1 -- 172.21.15.121:0/2451940186 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f511010c580 con 0x7f51100fbec0 2024-08-18T22:37:53.704 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:37:53.688+0000 7f5115830640 1 -- 172.21.15.121:0/2451940186 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51100fc960 con 0x7f51100fbec0 2024-08-18T22:37:53.704 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:37:53.688+0000 7f51077fe640 1 -- 172.21.15.121:0/2451940186 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 19) v1 ==== 85127+0+0 (secure 0 0 0) 0x7f50f8030020 con 0x7f51100fbec0 2024-08-18T22:37:53.704 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:37:53.688+0000 7f51077fe640 1 --2- 172.21.15.121:0/2451940186 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7f50fc067190 0x7f50fc069640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:37:53.704 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:37:53.688+0000 7f51077fe640 1 -- 172.21.15.121:0/2451940186 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f50f80a4da0 con 0x7f51100fbec0 2024-08-18T22:37:53.704 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:37:53.688+0000 7f510effd640 1 --2- 172.21.15.121:0/2451940186 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7f50fc067190 0x7f50fc069640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:37:53.704 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:37:53.689+0000 7f510effd640 1 --2- 172.21.15.121:0/2451940186 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7f50fc067190 0x7f50fc069640 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f5108001250 tx=0x7f5108009620 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:37:53.704 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:37:53.693+0000 7f51077fe640 1 -- 172.21.15.121:0/2451940186 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f50f8072380 con 0x7f51100fbec0 2024-08-18T22:37:53.852 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:37:53.851+0000 7f5115830640 1 -- 172.21.15.121:0/2451940186 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f511010d530 con 0x7f51100fbec0 2024-08-18T22:37:53.852 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:37:53.851+0000 7f51077fe640 1 -- 172.21.15.121:0/2451940186 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v41) v1 ==== 74+0+11132 (secure 0 0 0) 0x7f50f80759a0 con 0x7f51100fbec0 2024-08-18T22:37:53.853 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-08-18T22:37:53.853 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":41,"fsid":"b003123a-5db1-11ef-bccf-c7b262605968","created":"2024-08-18T22:32:41.330713+0000","modified":"2024-08-18T22:37:52.165058+0000","last_up_change":"2024-08-18T22:37:51.159312+0000","last_in_change":"2024-08-18T22:37:33.530314+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-18T22:36:42.820615+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"46b17ad3-c549-4492-bb2b-562dfae0ac3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":3702842813},{"type":"v1","addr":"172.21.15.121:6803","nonce":3702842813}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":3702842813},{"type":"v1","addr":"172.21.15.121:6805","nonce":3702842813}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":3702842813},{"type":"v1","addr":"172.21.15.121:6809","nonce":3702842813}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6806","nonce":3702842813},{"type":"v1","addr":"172.21.15.121:6807","nonce":3702842813}]},"public_addr":"172.21.15.121:6803/3702842813","cluster_addr":"172.21.15.121:6805/3702842813","heartbeat_back_addr":"172.21.15.121:6809/3702842813","heartbeat_front_addr":"172.21.15.121:6807/3702842813","state":["exists","up"]},{"osd":1,"uuid":"21393748-75ac-4f55-915c-8ddc79339dba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6810","nonce":1711466097},{"type":"v1","addr":"172.21.15.121:6811","nonce":1711466097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":1711466097},{"type":"v1","addr":"172.21.15.121:6813","nonce":1711466097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":1711466097},{"type":"v1","addr":"172.21.15.121:6817","nonce":1711466097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6814","nonce":1711466097},{"type":"v1","addr":"172.21.15.121:6815","nonce":1711466097}]},"public_addr":"172.21.15.121:6811/1711466097","cluster_addr":"172.21.15.121:6813/1711466097","heartbeat_back_addr":"172.21.15.121:6817/1711466097","heartbeat_front_addr":"172.21.15.121:6815/1711466097","state":["exists","up"]},{"osd":2,"uuid":"79b07f6b-e26d-4ed7-b014-459c177f41ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6818","nonce":2696892839},{"type":"v1","addr":"172.21.15.121:6819","nonce":2696892839}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6820","nonce":2696892839},{"type":"v1","addr":"172.21.15.121:6821","nonce":2696892839}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6824","nonce":2696892839},{"type":"v1","addr":"172.21.15.121:6825","nonce":2696892839}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":2696892839},{"type":"v1","addr":"172.21.15.121:6823","nonce":2696892839}]},"public_addr":"172.21.15.121:6819/2696892839","cluster_addr":"172.21.15.121:6821/2696892839","heartbeat_back_addr":"172.21.15.121:6825/2696892839","heartbeat_front_addr":"172.21.15.121:6823/2696892839","state":["exists","up"]},{"osd":3,"uuid":"62aafac2-c863-45df-a067-dcb6c2fa1df2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":1551491756},{"type":"v1","addr":"172.21.15.195:6801","nonce":1551491756}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":1551491756},{"type":"v1","addr":"172.21.15.195:6803","nonce":1551491756}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":1551491756},{"type":"v1","addr":"172.21.15.195:6807","nonce":1551491756}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":1551491756},{"type":"v1","addr":"172.21.15.195:6805","nonce":1551491756}]},"public_addr":"172.21.15.195:6801/1551491756","cluster_addr":"172.21.15.195:6803/1551491756","heartbeat_back_addr":"172.21.15.195:6807/1551491756","heartbeat_front_addr":"172.21.15.195:6805/1551491756","state":["exists","up"]},{"osd":4,"uuid":"a2582923-0d40-4cc4-b1bf-361f88e9bb68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":587500564},{"type":"v1","addr":"172.21.15.195:6809","nonce":587500564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":587500564},{"type":"v1","addr":"172.21.15.195:6811","nonce":587500564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":587500564},{"type":"v1","addr":"172.21.15.195:6815","nonce":587500564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":587500564},{"type":"v1","addr":"172.21.15.195:6813","nonce":587500564}]},"public_addr":"172.21.15.195:6809/587500564","cluster_addr":"172.21.15.195:6811/587500564","heartbeat_back_addr":"172.21.15.195:6815/587500564","heartbeat_front_addr":"172.21.15.195:6813/587500564","state":["exists","up"]},{"osd":5,"uuid":"ae063840-fa2d-4d2e-b303-5d034d3f1b23","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":40,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":2603984040},{"type":"v1","addr":"172.21.15.195:6817","nonce":2603984040}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":2603984040},{"type":"v1","addr":"172.21.15.195:6819","nonce":2603984040}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":2603984040},{"type":"v1","addr":"172.21.15.195:6823","nonce":2603984040}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":2603984040},{"type":"v1","addr":"172.21.15.195:6821","nonce":2603984040}]},"public_addr":"172.21.15.195:6817/2603984040","cluster_addr":"172.21.15.195:6819/2603984040","heartbeat_back_addr":"172.21.15.195:6823/2603984040","heartbeat_front_addr":"172.21.15.195:6821/2603984040","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:35:48.671526+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:36:13.721039+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:36:39.593069+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:37:01.453125+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:37:25.509748+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:37:50.000694+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.121:6801/1740603058":"2024-08-19T22:34:38.509926+0000","172.21.15.121:0/2242648652":"2024-08-19T22:33:09.834580+0000","172.21.15.121:6801/2610373559":"2024-08-19T22:33:09.834580+0000","172.21.15.121:0/772981487":"2024-08-19T22:34:38.509926+0000","172.21.15.121:0/3667011451":"2024-08-19T22:33:09.834580+0000","172.21.15.121:6800/2610373559":"2024-08-19T22:33:09.834580+0000","172.21.15.121:0/1731486537":"2024-08-19T22:33:38.104162+0000","172.21.15.121:0/2324544310":"2024-08-19T22:33:09.834580+0000","172.21.15.121:0/2570435202":"2024-08-19T22:33:38.104162+0000","172.21.15.121:6800/833901271":"2024-08-19T22:33:38.104162+0000","172.21.15.121:6801/833901271":"2024-08-19T22:33:38.104162+0000","172.21.15.121:0/3576026097":"2024-08-19T22:33:38.104162+0000","172.21.15.121:0/2061352978":"2024-08-19T22:34:38.509926+0000","172.21.15.121:0/774496394":"2024-08-19T22:34:38.509926+0000","172.21.15.121:6800/1740603058":"2024-08-19T22:34:38.509926+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-18T22:37:53.855 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:37:53.853+0000 7f5115830640 1 -- 172.21.15.121:0/2451940186 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7f50fc067190 msgr2=0x7f50fc069640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:37:53.855 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:37:53.853+0000 7f5115830640 1 --2- 172.21.15.121:0/2451940186 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7f50fc067190 0x7f50fc069640 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f5108001250 tx=0x7f5108009620 comp rx=0 tx=0).stop 2024-08-18T22:37:53.855 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:37:53.853+0000 7f5115830640 1 -- 172.21.15.121:0/2451940186 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f51100fbec0 msgr2=0x7f5110112400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:37:53.855 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:37:53.853+0000 7f5115830640 1 --2- 172.21.15.121:0/2451940186 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f51100fbec0 0x7f5110112400 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f50f8003080 tx=0x7f50f8009da0 comp rx=0 tx=0).stop 2024-08-18T22:37:53.855 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:37:53.853+0000 7f5115830640 1 -- 172.21.15.121:0/2451940186 shutdown_connections 2024-08-18T22:37:53.855 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:37:53.853+0000 7f5115830640 1 --2- 172.21.15.121:0/2451940186 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7f50fc067190 0x7f50fc069640 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:37:53.855 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:37:53.853+0000 7f5115830640 1 --2- 172.21.15.121:0/2451940186 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f51100fbec0 0x7f5110112400 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:37:53.855 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:37:53.853+0000 7f5115830640 1 --2- 172.21.15.121:0/2451940186 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f51100fb5b0 0x7f5110111ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:37:53.855 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:37:53.853+0000 7f5115830640 1 -- 172.21.15.121:0/2451940186 >> 172.21.15.121:0/2451940186 conn(0x7f5110072150 msgr2=0x7f51100f8780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:37:53.855 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:37:53.854+0000 7f5115830640 1 -- 172.21.15.121:0/2451940186 shutdown_connections 2024-08-18T22:37:53.855 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:37:53.854+0000 7f5115830640 1 -- 172.21.15.121:0/2451940186 wait complete. 2024-08-18T22:37:54.547 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:37:54 smithi121 ceph-mon[16788]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-08-18T22:37:54.548 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:37:54 smithi121 ceph-mon[16788]: Detected new or changed devices on smithi195 2024-08-18T22:37:54.548 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:37:54 smithi121 ceph-mon[16788]: Adjusting osd_memory_target on smithi195 to 5312M 2024-08-18T22:37:54.548 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:37:54 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-18T22:37:54.548 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:37:54 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:37:54.548 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:37:54 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-18T22:37:54.548 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:37:54 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:37:54.548 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:37:54 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-18T22:37:54.548 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:37:54 smithi121 ceph-mon[16788]: from='client.? 172.21.15.121:0/2451940186' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-08-18T22:37:54.575 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-18T22:36:42.820615+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2024-08-18T22:37:54.575 DEBUG:teuthology.orchestra.run.smithi121:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid b003123a-5db1-11ef-bccf-c7b262605968 -- ceph osd pool get .mgr pg_num 2024-08-18T22:37:54.659 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:37:54 smithi195 ceph-mon[23370]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-08-18T22:37:54.659 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:37:54 smithi195 ceph-mon[23370]: Detected new or changed devices on smithi195 2024-08-18T22:37:54.659 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:37:54 smithi195 ceph-mon[23370]: Adjusting osd_memory_target on smithi195 to 5312M 2024-08-18T22:37:54.659 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:37:54 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-18T22:37:54.659 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:37:54 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:37:54.659 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:37:54 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-18T22:37:54.659 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:37:54 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:37:54.659 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:37:54 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-18T22:37:54.659 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:37:54 smithi195 ceph-mon[23370]: from='client.? 172.21.15.121:0/2451940186' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-08-18T22:37:54.828 INFO:teuthology.orchestra.run.smithi121.stderr:Inferring config /var/lib/ceph/b003123a-5db1-11ef-bccf-c7b262605968/mon.smithi121/config 2024-08-18T22:37:56.307 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:37:56.294+0000 7f871b3ad640 1 -- 172.21.15.121:0/3230418842 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f87141011e0 msgr2=0x7f87141015b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:37:56.308 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:37:56.294+0000 7f871b3ad640 1 --2- 172.21.15.121:0/3230418842 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f87141011e0 0x7f87141015b0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f8704009c50 tx=0x7f8704004d10 comp rx=0 tx=0).stop 2024-08-18T22:37:56.308 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:37:56.294+0000 7f871b3ad640 1 -- 172.21.15.121:0/3230418842 shutdown_connections 2024-08-18T22:37:56.308 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:37:56.294+0000 7f871b3ad640 1 --2- 172.21.15.121:0/3230418842 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8714101b80 0x7f87140fb210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:37:56.308 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:37:56.294+0000 7f871b3ad640 1 --2- 172.21.15.121:0/3230418842 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f87141011e0 0x7f87141015b0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:37:56.308 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:37:56.294+0000 7f871b3ad640 1 -- 172.21.15.121:0/3230418842 >> 172.21.15.121:0/3230418842 conn(0x7f87140f6dd0 msgr2=0x7f87140f91e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:37:56.308 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:37:56.294+0000 7f871b3ad640 1 -- 172.21.15.121:0/3230418842 shutdown_connections 2024-08-18T22:37:56.308 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:37:56.294+0000 7f871b3ad640 1 -- 172.21.15.121:0/3230418842 wait complete. 2024-08-18T22:37:56.308 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:37:56.294+0000 7f871b3ad640 1 Processor -- start 2024-08-18T22:37:56.308 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:37:56.294+0000 7f871b3ad640 1 -- start start 2024-08-18T22:37:56.308 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:37:56.295+0000 7f871b3ad640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f87141011e0 0x7f8714112f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:37:56.308 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:37:56.295+0000 7f871b3ad640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8714101b80 0x7f8714113470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:37:56.308 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:37:56.295+0000 7f871b3ad640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8714113a70 con 0x7f8714101b80 2024-08-18T22:37:56.309 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:37:56.295+0000 7f871b3ad640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f871410ceb0 con 0x7f87141011e0 2024-08-18T22:37:56.309 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:37:56.295+0000 7f8718948640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8714101b80 0x7f8714113470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:37:56.309 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:37:56.295+0000 7f8718948640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8714101b80 0x7f8714113470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:60978/0 (socket says 172.21.15.121:60978) 2024-08-18T22:37:56.309 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:37:56.295+0000 7f8718948640 1 -- 172.21.15.121:0/1337147007 learned_addr learned my addr 172.21.15.121:0/1337147007 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-18T22:37:56.309 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:37:56.295+0000 7f8719149640 1 --2- 172.21.15.121:0/1337147007 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f87141011e0 0x7f8714112f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:37:56.309 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:37:56.295+0000 7f8718948640 1 -- 172.21.15.121:0/1337147007 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f87141011e0 msgr2=0x7f8714112f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:37:56.309 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:37:56.295+0000 7f8718948640 1 --2- 172.21.15.121:0/1337147007 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f87141011e0 0x7f8714112f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:37:56.309 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:37:56.295+0000 7f8718948640 1 -- 172.21.15.121:0/1337147007 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87040098b0 con 0x7f8714101b80 2024-08-18T22:37:56.309 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:37:56.295+0000 7f8719149640 1 --2- 172.21.15.121:0/1337147007 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f87141011e0 0x7f8714112f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:37:56.309 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:37:56.295+0000 7f8718948640 1 --2- 172.21.15.121:0/1337147007 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8714101b80 0x7f8714113470 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f870800c790 tx=0x7f87080043c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:37:56.309 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:37:56.295+0000 7f8711ffb640 1 -- 172.21.15.121:0/1337147007 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f870800a820 con 0x7f8714101b80 2024-08-18T22:37:56.310 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:37:56.295+0000 7f8711ffb640 1 -- 172.21.15.121:0/1337147007 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f870800ae20 con 0x7f8714101b80 2024-08-18T22:37:56.310 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:37:56.295+0000 7f871b3ad640 1 -- 172.21.15.121:0/1337147007 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f871410d190 con 0x7f8714101b80 2024-08-18T22:37:56.310 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:37:56.295+0000 7f8711ffb640 1 -- 172.21.15.121:0/1337147007 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f87080113a0 con 0x7f8714101b80 2024-08-18T22:37:56.310 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:37:56.295+0000 7f871b3ad640 1 -- 172.21.15.121:0/1337147007 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f871410d730 con 0x7f8714101b80 2024-08-18T22:37:56.310 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:37:56.296+0000 7f871b3ad640 1 -- 172.21.15.121:0/1337147007 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87140fc950 con 0x7f8714101b80 2024-08-18T22:37:56.310 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:37:56.297+0000 7f8711ffb640 1 -- 172.21.15.121:0/1337147007 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 19) v1 ==== 85127+0+0 (secure 0 0 0) 0x7f8708012400 con 0x7f8714101b80 2024-08-18T22:37:56.310 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:37:56.297+0000 7f8711ffb640 1 --2- 172.21.15.121:0/1337147007 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7f86fc067190 0x7f86fc069640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:37:56.310 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:37:56.297+0000 7f8711ffb640 1 -- 172.21.15.121:0/1337147007 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f87080848a0 con 0x7f8714101b80 2024-08-18T22:37:56.310 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:37:56.297+0000 7f8719149640 1 --2- 172.21.15.121:0/1337147007 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7f86fc067190 0x7f86fc069640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:37:56.310 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:37:56.298+0000 7f8719149640 1 --2- 172.21.15.121:0/1337147007 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7f86fc067190 0x7f86fc069640 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f87040048c0 tx=0x7f8704004d10 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:37:56.310 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:37:56.301+0000 7f8711ffb640 1 -- 172.21.15.121:0/1337147007 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f8708051fa0 con 0x7f8714101b80 2024-08-18T22:37:56.457 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:37:56.456+0000 7f871b3ad640 1 -- 172.21.15.121:0/1337147007 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f871410e5a0 con 0x7f8714101b80 2024-08-18T22:37:56.458 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:37:56 smithi121 ceph-mon[16788]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-08-18T22:37:56.458 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:37:56.457+0000 7f8711ffb640 1 -- 172.21.15.121:0/1337147007 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v41) v1 ==== 93+0+10 (secure 0 0 0) 0x7f87080555c0 con 0x7f8714101b80 2024-08-18T22:37:56.458 INFO:teuthology.orchestra.run.smithi121.stdout:pg_num: 1 2024-08-18T22:37:56.460 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:37:56.459+0000 7f871b3ad640 1 -- 172.21.15.121:0/1337147007 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7f86fc067190 msgr2=0x7f86fc069640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:37:56.460 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:37:56.459+0000 7f871b3ad640 1 --2- 172.21.15.121:0/1337147007 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7f86fc067190 0x7f86fc069640 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f87040048c0 tx=0x7f8704004d10 comp rx=0 tx=0).stop 2024-08-18T22:37:56.460 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:37:56.459+0000 7f871b3ad640 1 -- 172.21.15.121:0/1337147007 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8714101b80 msgr2=0x7f8714113470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:37:56.460 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:37:56.459+0000 7f871b3ad640 1 --2- 172.21.15.121:0/1337147007 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8714101b80 0x7f8714113470 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f870800c790 tx=0x7f87080043c0 comp rx=0 tx=0).stop 2024-08-18T22:37:56.460 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:37:56.459+0000 7f871b3ad640 1 -- 172.21.15.121:0/1337147007 shutdown_connections 2024-08-18T22:37:56.460 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:37:56.459+0000 7f871b3ad640 1 --2- 172.21.15.121:0/1337147007 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7f86fc067190 0x7f86fc069640 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:37:56.460 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:37:56.459+0000 7f871b3ad640 1 --2- 172.21.15.121:0/1337147007 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8714101b80 0x7f8714113470 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:37:56.461 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:37:56.459+0000 7f871b3ad640 1 --2- 172.21.15.121:0/1337147007 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f87141011e0 0x7f8714112f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:37:56.461 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:37:56.459+0000 7f871b3ad640 1 -- 172.21.15.121:0/1337147007 >> 172.21.15.121:0/1337147007 conn(0x7f87140f6dd0 msgr2=0x7f87140655e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:37:56.461 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:37:56.459+0000 7f871b3ad640 1 -- 172.21.15.121:0/1337147007 shutdown_connections 2024-08-18T22:37:56.461 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:37:56.459+0000 7f871b3ad640 1 -- 172.21.15.121:0/1337147007 wait complete. 2024-08-18T22:37:56.659 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:37:56 smithi195 ceph-mon[23370]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-08-18T22:37:57.057 INFO:tasks.cephadm:Setting up client nodes... 2024-08-18T22:37:57.058 DEBUG:teuthology.orchestra.run.smithi121:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b003123a-5db1-11ef-bccf-c7b262605968 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-08-18T22:37:57.308 INFO:teuthology.orchestra.run.smithi121.stderr:Inferring config /var/lib/ceph/b003123a-5db1-11ef-bccf-c7b262605968/mon.smithi121/config 2024-08-18T22:37:57.333 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:37:57 smithi121 ceph-mon[16788]: from='client.? 172.21.15.121:0/1337147007' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-08-18T22:37:57.659 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:37:57 smithi195 ceph-mon[23370]: from='client.? 172.21.15.121:0/1337147007' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-08-18T22:37:58.409 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:37:58 smithi195 ceph-mon[23370]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-08-18T22:37:58.462 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:37:58 smithi121 ceph-mon[16788]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-08-18T22:37:58.935 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:37:58.932+0000 7fd1c5379640 1 -- 172.21.15.121:0/2291576811 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd1c00fc2d0 msgr2=0x7fd1c00fc6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:37:58.936 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:37:58.932+0000 7fd1c5379640 1 --2- 172.21.15.121:0/2291576811 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd1c00fc2d0 0x7fd1c00fc6e0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fd1b00048d0 tx=0x7fd1b0009da0 comp rx=0 tx=0).stop 2024-08-18T22:37:58.936 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:37:58.932+0000 7fd1c5379640 1 -- 172.21.15.121:0/2291576811 shutdown_connections 2024-08-18T22:37:58.936 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:37:58.932+0000 7fd1c5379640 1 --2- 172.21.15.121:0/2291576811 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd1c00fd5a0 0x7fd1c00fda10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:37:58.936 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:37:58.932+0000 7fd1c5379640 1 --2- 172.21.15.121:0/2291576811 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd1c00fc2d0 0x7fd1c00fc6e0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:37:58.936 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:37:58.932+0000 7fd1c5379640 1 -- 172.21.15.121:0/2291576811 >> 172.21.15.121:0/2291576811 conn(0x7fd1c00f7ab0 msgr2=0x7fd1c00f9ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:37:58.936 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:37:58.932+0000 7fd1c5379640 1 -- 172.21.15.121:0/2291576811 shutdown_connections 2024-08-18T22:37:58.936 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:37:58.932+0000 7fd1c5379640 1 -- 172.21.15.121:0/2291576811 wait complete. 2024-08-18T22:37:58.936 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:37:58.933+0000 7fd1c5379640 1 Processor -- start 2024-08-18T22:37:58.936 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:37:58.933+0000 7fd1c5379640 1 -- start start 2024-08-18T22:37:58.937 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:37:58.933+0000 7fd1c5379640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd1c00fc2d0 0x7fd1c010ce70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:37:58.937 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:37:58.933+0000 7fd1c5379640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd1c00fd5a0 0x7fd1c010d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:37:58.937 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:37:58.933+0000 7fd1c5379640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1c010da00 con 0x7fd1c00fc2d0 2024-08-18T22:37:58.937 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:37:58.933+0000 7fd1c5379640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1c010e140 con 0x7fd1c00fd5a0 2024-08-18T22:37:58.937 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:37:58.933+0000 7fd1beffd640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd1c00fc2d0 0x7fd1c010ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:37:58.937 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:37:58.933+0000 7fd1beffd640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd1c00fc2d0 0x7fd1c010ce70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:41198/0 (socket says 172.21.15.121:41198) 2024-08-18T22:37:58.937 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:37:58.933+0000 7fd1beffd640 1 -- 172.21.15.121:0/737673082 learned_addr learned my addr 172.21.15.121:0/737673082 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-18T22:37:58.937 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:37:58.933+0000 7fd1b67fc640 1 --2- 172.21.15.121:0/737673082 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd1c00fd5a0 0x7fd1c010d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:37:58.937 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:37:58.933+0000 7fd1beffd640 1 -- 172.21.15.121:0/737673082 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd1c00fd5a0 msgr2=0x7fd1c010d3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:37:58.937 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:37:58.933+0000 7fd1beffd640 1 --2- 172.21.15.121:0/737673082 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd1c00fd5a0 0x7fd1c010d3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:37:58.937 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:37:58.933+0000 7fd1beffd640 1 -- 172.21.15.121:0/737673082 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1b0005040 con 0x7fd1c00fc2d0 2024-08-18T22:37:58.937 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:37:58.933+0000 7fd1b67fc640 1 --2- 172.21.15.121:0/737673082 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd1c00fd5a0 0x7fd1c010d3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:37:58.937 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:37:58.934+0000 7fd1beffd640 1 --2- 172.21.15.121:0/737673082 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd1c00fc2d0 0x7fd1c010ce70 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fd1b0003080 tx=0x7fd1b0009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:37:58.938 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:37:58.934+0000 7fd1b7fff640 1 -- 172.21.15.121:0/737673082 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd1b0038070 con 0x7fd1c00fc2d0 2024-08-18T22:37:58.938 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:37:58.934+0000 7fd1b7fff640 1 -- 172.21.15.121:0/737673082 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fd1b002abd0 con 0x7fd1c00fc2d0 2024-08-18T22:37:58.938 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:37:58.934+0000 7fd1b7fff640 1 -- 172.21.15.121:0/737673082 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd1b003e670 con 0x7fd1c00fc2d0 2024-08-18T22:37:58.938 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:37:58.934+0000 7fd1c5379640 1 -- 172.21.15.121:0/737673082 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1c010e370 con 0x7fd1c00fc2d0 2024-08-18T22:37:58.938 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:37:58.934+0000 7fd1c5379640 1 -- 172.21.15.121:0/737673082 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1c010e910 con 0x7fd1c00fc2d0 2024-08-18T22:37:58.938 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:37:58.935+0000 7fd1c5379640 1 -- 172.21.15.121:0/737673082 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1c00fb730 con 0x7fd1c00fc2d0 2024-08-18T22:37:58.939 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:37:58.935+0000 7fd1b7fff640 1 -- 172.21.15.121:0/737673082 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 19) v1 ==== 85127+0+0 (secure 0 0 0) 0x7fd1b0030020 con 0x7fd1c00fc2d0 2024-08-18T22:37:58.939 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:37:58.936+0000 7fd1b7fff640 1 --2- 172.21.15.121:0/737673082 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7fd1ac067190 0x7fd1ac069640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:37:58.939 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:37:58.936+0000 7fd1b67fc640 1 --2- 172.21.15.121:0/737673082 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7fd1ac067190 0x7fd1ac069640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:37:58.939 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:37:58.936+0000 7fd1b7fff640 1 -- 172.21.15.121:0/737673082 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fd1b00a4b20 con 0x7fd1c00fc2d0 2024-08-18T22:37:58.939 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:37:58.936+0000 7fd1b67fc640 1 --2- 172.21.15.121:0/737673082 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7fd1ac067190 0x7fd1ac069640 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fd1a8004c80 tx=0x7fd1a8009040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:37:58.941 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:37:58.940+0000 7fd1b7fff640 1 -- 172.21.15.121:0/737673082 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fd1b0072180 con 0x7fd1c00fc2d0 2024-08-18T22:37:59.160 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:37:59.159+0000 7fd1c5379640 1 -- 172.21.15.121:0/737673082 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) v1 -- 0x7fd1c004b4c0 con 0x7fd1c00fc2d0 2024-08-18T22:37:59.163 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:37:59.162+0000 7fd1b7fff640 1 -- 172.21.15.121:0/737673082 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v14) v1 ==== 170+0+59 (secure 0 0 0) 0x7fd1b00757a0 con 0x7fd1c00fc2d0 2024-08-18T22:37:59.164 INFO:teuthology.orchestra.run.smithi121.stdout:[client.0] 2024-08-18T22:37:59.164 INFO:teuthology.orchestra.run.smithi121.stdout: key = AQDHd8Jmn2GOCRAAHHJlUTjLTIF77SQ3+V9Cyg== 2024-08-18T22:37:59.166 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:37:59.165+0000 7fd1c5379640 1 -- 172.21.15.121:0/737673082 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7fd1ac067190 msgr2=0x7fd1ac069640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:37:59.166 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:37:59.165+0000 7fd1c5379640 1 --2- 172.21.15.121:0/737673082 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7fd1ac067190 0x7fd1ac069640 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fd1a8004c80 tx=0x7fd1a8009040 comp rx=0 tx=0).stop 2024-08-18T22:37:59.166 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:37:59.165+0000 7fd1c5379640 1 -- 172.21.15.121:0/737673082 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd1c00fc2d0 msgr2=0x7fd1c010ce70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:37:59.166 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:37:59.165+0000 7fd1c5379640 1 --2- 172.21.15.121:0/737673082 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd1c00fc2d0 0x7fd1c010ce70 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fd1b0003080 tx=0x7fd1b0009da0 comp rx=0 tx=0).stop 2024-08-18T22:37:59.166 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:37:59.165+0000 7fd1c5379640 1 -- 172.21.15.121:0/737673082 shutdown_connections 2024-08-18T22:37:59.166 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:37:59.165+0000 7fd1c5379640 1 --2- 172.21.15.121:0/737673082 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7fd1ac067190 0x7fd1ac069640 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:37:59.166 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:37:59.165+0000 7fd1c5379640 1 --2- 172.21.15.121:0/737673082 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd1c00fd5a0 0x7fd1c010d3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:37:59.167 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:37:59.165+0000 7fd1c5379640 1 --2- 172.21.15.121:0/737673082 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd1c00fc2d0 0x7fd1c010ce70 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:37:59.167 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:37:59.165+0000 7fd1c5379640 1 -- 172.21.15.121:0/737673082 >> 172.21.15.121:0/737673082 conn(0x7fd1c00f7ab0 msgr2=0x7fd1c00f9280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:37:59.167 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:37:59.165+0000 7fd1c5379640 1 -- 172.21.15.121:0/737673082 shutdown_connections 2024-08-18T22:37:59.167 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:37:59.165+0000 7fd1c5379640 1 -- 172.21.15.121:0/737673082 wait complete. 2024-08-18T22:37:59.511 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:37:59 smithi121 ceph-mon[16788]: from='client.? 172.21.15.121:0/737673082' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-08-18T22:37:59.511 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:37:59 smithi121 ceph-mon[16788]: from='client.? 172.21.15.121:0/737673082' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-08-18T22:37:59.659 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:37:59 smithi195 ceph-mon[23370]: from='client.? 172.21.15.121:0/737673082' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-08-18T22:37:59.659 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:37:59 smithi195 ceph-mon[23370]: from='client.? 172.21.15.121:0/737673082' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-08-18T22:37:59.823 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-08-18T22:37:59.823 DEBUG:teuthology.orchestra.run.smithi121:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2024-08-18T22:37:59.823 DEBUG:teuthology.orchestra.run.smithi121:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-08-18T22:38:00.074 DEBUG:teuthology.orchestra.run.smithi195:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b003123a-5db1-11ef-bccf-c7b262605968 -- ceph auth get-or-create client.1 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-08-18T22:38:00.333 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:38:00 smithi121 ceph-mon[16788]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-08-18T22:38:00.335 INFO:teuthology.orchestra.run.smithi195.stderr:Inferring config /var/lib/ceph/b003123a-5db1-11ef-bccf-c7b262605968/mon.smithi195/config 2024-08-18T22:38:00.409 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:38:00 smithi195 ceph-mon[23370]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-08-18T22:38:01.826 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:38:01.823+0000 7f5f81fec640 1 -- 172.21.15.195:0/2467468210 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5f7c0fc4e0 msgr2=0x7f5f7c0fc950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:38:01.826 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:38:01.823+0000 7f5f81fec640 1 --2- 172.21.15.195:0/2467468210 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5f7c0fc4e0 0x7f5f7c0fc950 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f5f640048d0 tx=0x7f5f64009da0 comp rx=0 tx=0).stop 2024-08-18T22:38:01.826 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:38:01.823+0000 7f5f81fec640 1 -- 172.21.15.195:0/2467468210 shutdown_connections 2024-08-18T22:38:01.826 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:38:01.823+0000 7f5f81fec640 1 --2- 172.21.15.195:0/2467468210 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5f7c0fc4e0 0x7f5f7c0fc950 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:38:01.826 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:38:01.823+0000 7f5f81fec640 1 --2- 172.21.15.195:0/2467468210 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5f7c0fb210 0x7f5f7c0fb620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:38:01.827 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:38:01.823+0000 7f5f81fec640 1 -- 172.21.15.195:0/2467468210 >> 172.21.15.195:0/2467468210 conn(0x7f5f7c0f69d0 msgr2=0x7f5f7c0f8e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:38:01.827 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:38:01.823+0000 7f5f81fec640 1 -- 172.21.15.195:0/2467468210 shutdown_connections 2024-08-18T22:38:01.827 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:38:01.823+0000 7f5f81fec640 1 -- 172.21.15.195:0/2467468210 wait complete. 2024-08-18T22:38:01.827 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:38:01.824+0000 7f5f81fec640 1 Processor -- start 2024-08-18T22:38:01.827 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:38:01.824+0000 7f5f81fec640 1 -- start start 2024-08-18T22:38:01.827 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:38:01.824+0000 7f5f81fec640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5f7c0fb210 0x7f5f7c10bf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:38:01.827 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:38:01.824+0000 7f5f81fec640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5f7c0fc4e0 0x7f5f7c10c460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:38:01.827 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:38:01.824+0000 7f5f81fec640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f7c10d0d0 con 0x7f5f7c0fb210 2024-08-18T22:38:01.827 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:38:01.824+0000 7f5f81fec640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f7c10d240 con 0x7f5f7c0fc4e0 2024-08-18T22:38:01.827 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:38:01.824+0000 7f5f73fff640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5f7c0fc4e0 0x7f5f7c10c460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:38:01.827 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:38:01.824+0000 7f5f73fff640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5f7c0fc4e0 0x7f5f7c10c460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.195:38196/0 (socket says 172.21.15.195:38196) 2024-08-18T22:38:01.827 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:38:01.824+0000 7f5f73fff640 1 -- 172.21.15.195:0/525225966 learned_addr learned my addr 172.21.15.195:0/525225966 (peer_addr_for_me v2:172.21.15.195:0/0) 2024-08-18T22:38:01.827 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:38:01.824+0000 7f5f7b7fe640 1 --2- 172.21.15.195:0/525225966 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5f7c0fb210 0x7f5f7c10bf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:38:01.828 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:38:01.825+0000 7f5f73fff640 1 -- 172.21.15.195:0/525225966 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5f7c0fb210 msgr2=0x7f5f7c10bf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:38:01.828 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:38:01.825+0000 7f5f73fff640 1 --2- 172.21.15.195:0/525225966 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5f7c0fb210 0x7f5f7c10bf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:38:01.828 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:38:01.825+0000 7f5f73fff640 1 -- 172.21.15.195:0/525225966 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f64005040 con 0x7f5f7c0fc4e0 2024-08-18T22:38:01.828 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:38:01.825+0000 7f5f7b7fe640 1 --2- 172.21.15.195:0/525225966 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5f7c0fb210 0x7f5f7c10bf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:38:01.828 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:38:01.825+0000 7f5f73fff640 1 --2- 172.21.15.195:0/525225966 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5f7c0fc4e0 0x7f5f7c10c460 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f5f64000c00 tx=0x7f5f64009da0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:38:01.828 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:38:01.825+0000 7f5f78ff9640 1 -- 172.21.15.195:0/525225966 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5f64038070 con 0x7f5f7c0fc4e0 2024-08-18T22:38:01.828 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:38:01.825+0000 7f5f81fec640 1 -- 172.21.15.195:0/525225966 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f7c10d4c0 con 0x7f5f7c0fc4e0 2024-08-18T22:38:01.828 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:38:01.825+0000 7f5f78ff9640 1 -- 172.21.15.195:0/525225966 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f5f6402ae90 con 0x7f5f7c0fc4e0 2024-08-18T22:38:01.828 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:38:01.825+0000 7f5f78ff9640 1 -- 172.21.15.195:0/525225966 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5f6403d420 con 0x7f5f7c0fc4e0 2024-08-18T22:38:01.828 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:38:01.825+0000 7f5f81fec640 1 -- 172.21.15.195:0/525225966 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f7c10d980 con 0x7f5f7c0fc4e0 2024-08-18T22:38:01.829 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:38:01.826+0000 7f5f81fec640 1 -- 172.21.15.195:0/525225966 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f7c04b4c0 con 0x7f5f7c0fc4e0 2024-08-18T22:38:01.829 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:38:01.826+0000 7f5f78ff9640 1 -- 172.21.15.195:0/525225966 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 19) v1 ==== 85127+0+0 (secure 0 0 0) 0x7f5f64030020 con 0x7f5f7c0fc4e0 2024-08-18T22:38:01.829 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:38:01.827+0000 7f5f78ff9640 1 --2- 172.21.15.195:0/525225966 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7f5f68067190 0x7f5f68069640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:38:01.829 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:38:01.827+0000 7f5f78ff9640 1 -- 172.21.15.195:0/525225966 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f5f640a4fd0 con 0x7f5f7c0fc4e0 2024-08-18T22:38:01.829 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:38:01.827+0000 7f5f7b7fe640 1 --2- 172.21.15.195:0/525225966 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7f5f68067190 0x7f5f68069640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:38:01.829 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:38:01.828+0000 7f5f7b7fe640 1 --2- 172.21.15.195:0/525225966 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7f5f68067190 0x7f5f68069640 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f5f6c009a80 tx=0x7f5f6c008040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:38:01.832 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:38:01.831+0000 7f5f78ff9640 1 -- 172.21.15.195:0/525225966 <== mon.1 v2:172.21.15.195:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f5f640725b0 con 0x7f5f7c0fc4e0 2024-08-18T22:38:02.048 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:38:02.047+0000 7f5f81fec640 1 -- 172.21.15.195:0/525225966 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) v1 -- 0x7f5f7c103c90 con 0x7f5f7c0fc4e0 2024-08-18T22:38:02.053 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:38:02.052+0000 7f5f78ff9640 1 -- 172.21.15.195:0/525225966 <== mon.1 v2:172.21.15.195:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v15) v1 ==== 170+0+59 (secure 0 0 0) 0x7f5f64075bd0 con 0x7f5f7c0fc4e0 2024-08-18T22:38:02.053 INFO:teuthology.orchestra.run.smithi195.stdout:[client.1] 2024-08-18T22:38:02.053 INFO:teuthology.orchestra.run.smithi195.stdout: key = AQDKd8JmjfTqAhAAQPubGYyfxB+l9i1q6F0U/g== 2024-08-18T22:38:02.055 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:38:02.054+0000 7f5f81fec640 1 -- 172.21.15.195:0/525225966 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7f5f68067190 msgr2=0x7f5f68069640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:38:02.055 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:38:02.054+0000 7f5f81fec640 1 --2- 172.21.15.195:0/525225966 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7f5f68067190 0x7f5f68069640 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f5f6c009a80 tx=0x7f5f6c008040 comp rx=0 tx=0).stop 2024-08-18T22:38:02.055 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:38:02.054+0000 7f5f81fec640 1 -- 172.21.15.195:0/525225966 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5f7c0fc4e0 msgr2=0x7f5f7c10c460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:38:02.055 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:38:02.054+0000 7f5f81fec640 1 --2- 172.21.15.195:0/525225966 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5f7c0fc4e0 0x7f5f7c10c460 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f5f64000c00 tx=0x7f5f64009da0 comp rx=0 tx=0).stop 2024-08-18T22:38:02.055 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:38:02.054+0000 7f5f81fec640 1 -- 172.21.15.195:0/525225966 shutdown_connections 2024-08-18T22:38:02.055 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:38:02.054+0000 7f5f81fec640 1 --2- 172.21.15.195:0/525225966 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7f5f68067190 0x7f5f68069640 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:38:02.055 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:38:02.054+0000 7f5f81fec640 1 --2- 172.21.15.195:0/525225966 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5f7c0fc4e0 0x7f5f7c10c460 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:38:02.056 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:38:02.054+0000 7f5f81fec640 1 --2- 172.21.15.195:0/525225966 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5f7c0fb210 0x7f5f7c10bf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:38:02.056 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:38:02.054+0000 7f5f81fec640 1 -- 172.21.15.195:0/525225966 >> 172.21.15.195:0/525225966 conn(0x7f5f7c0f69d0 msgr2=0x7f5f7c0ff870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:38:02.056 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:38:02.054+0000 7f5f81fec640 1 -- 172.21.15.195:0/525225966 shutdown_connections 2024-08-18T22:38:02.056 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:38:02.054+0000 7f5f81fec640 1 -- 172.21.15.195:0/525225966 wait complete. 2024-08-18T22:38:02.409 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:38:02 smithi195 ceph-mon[23370]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-08-18T22:38:02.409 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:38:02 smithi195 ceph-mon[23370]: from='client.? 172.21.15.195:0/525225966' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-08-18T22:38:02.409 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:38:02 smithi195 ceph-mon[23370]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-08-18T22:38:02.409 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:38:02 smithi195 ceph-mon[23370]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-08-18T22:38:02.470 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:38:02 smithi121 ceph-mon[16788]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-08-18T22:38:02.471 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:38:02 smithi121 ceph-mon[16788]: from='client.? 172.21.15.195:0/525225966' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-08-18T22:38:02.471 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:38:02 smithi121 ceph-mon[16788]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-08-18T22:38:02.471 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:38:02 smithi121 ceph-mon[16788]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-08-18T22:38:02.697 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-08-18T22:38:02.697 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd of=/etc/ceph/ceph.client.1.keyring 2024-08-18T22:38:02.697 DEBUG:teuthology.orchestra.run.smithi195:> sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-08-18T22:38:02.738 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-08-18T22:38:02.738 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2024-08-18T22:38:02.738 DEBUG:teuthology.orchestra.run.smithi121:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid b003123a-5db1-11ef-bccf-c7b262605968 -- ceph mgr dump --format=json 2024-08-18T22:38:02.995 INFO:teuthology.orchestra.run.smithi121.stderr:Inferring config /var/lib/ceph/b003123a-5db1-11ef-bccf-c7b262605968/mon.smithi121/config 2024-08-18T22:38:04.264 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:38:04 smithi121 ceph-mon[16788]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-08-18T22:38:04.463 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:04.445+0000 7fefef494640 1 -- 172.21.15.121:0/2454841071 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fefe8102300 msgr2=0x7fefe81026d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:38:04.463 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:04.445+0000 7fefef494640 1 --2- 172.21.15.121:0/2454841071 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fefe8102300 0x7fefe81026d0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fefe40048d0 tx=0x7fefe4009da0 comp rx=0 tx=0).stop 2024-08-18T22:38:04.463 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:04.446+0000 7fefef494640 1 -- 172.21.15.121:0/2454841071 shutdown_connections 2024-08-18T22:38:04.463 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:04.446+0000 7fefef494640 1 --2- 172.21.15.121:0/2454841071 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fefe8102ca0 0x7fefe80fc330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:38:04.463 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:04.446+0000 7fefef494640 1 --2- 172.21.15.121:0/2454841071 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fefe8102300 0x7fefe81026d0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:38:04.463 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:04.446+0000 7fefef494640 1 -- 172.21.15.121:0/2454841071 >> 172.21.15.121:0/2454841071 conn(0x7fefe80f7e90 msgr2=0x7fefe80fa2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:38:04.463 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:04.446+0000 7fefef494640 1 -- 172.21.15.121:0/2454841071 shutdown_connections 2024-08-18T22:38:04.463 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:04.446+0000 7fefef494640 1 -- 172.21.15.121:0/2454841071 wait complete. 2024-08-18T22:38:04.463 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:04.446+0000 7fefef494640 1 Processor -- start 2024-08-18T22:38:04.464 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:04.446+0000 7fefef494640 1 -- start start 2024-08-18T22:38:04.464 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:04.446+0000 7fefef494640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fefe8102300 0x7fefe8113270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:38:04.464 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:04.446+0000 7fefef494640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fefe8102ca0 0x7fefe81137b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:38:04.464 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:04.446+0000 7fefef494640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefe8113db0 con 0x7fefe8102300 2024-08-18T22:38:04.464 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:04.446+0000 7fefef494640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefe810d1f0 con 0x7fefe8102ca0 2024-08-18T22:38:04.464 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:04.446+0000 7fefed230640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fefe8102300 0x7fefe8113270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:38:04.464 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:04.446+0000 7fefed230640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fefe8102300 0x7fefe8113270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:41210/0 (socket says 172.21.15.121:41210) 2024-08-18T22:38:04.464 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:04.447+0000 7fefed230640 1 -- 172.21.15.121:0/1043671328 learned_addr learned my addr 172.21.15.121:0/1043671328 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-18T22:38:04.464 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:04.447+0000 7fefeca2f640 1 --2- 172.21.15.121:0/1043671328 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fefe8102ca0 0x7fefe81137b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:38:04.464 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:04.447+0000 7fefed230640 1 -- 172.21.15.121:0/1043671328 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fefe8102ca0 msgr2=0x7fefe81137b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:38:04.464 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:04.447+0000 7fefed230640 1 --2- 172.21.15.121:0/1043671328 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fefe8102ca0 0x7fefe81137b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:38:04.464 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:04.447+0000 7fefed230640 1 -- 172.21.15.121:0/1043671328 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefe4005040 con 0x7fefe8102300 2024-08-18T22:38:04.464 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:04.447+0000 7fefeca2f640 1 --2- 172.21.15.121:0/1043671328 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fefe8102ca0 0x7fefe81137b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:38:04.465 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:04.447+0000 7fefed230640 1 --2- 172.21.15.121:0/1043671328 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fefe8102300 0x7fefe8113270 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fefe4003080 tx=0x7fefe4009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:38:04.465 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:04.447+0000 7fefddffb640 1 -- 172.21.15.121:0/1043671328 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fefe4038070 con 0x7fefe8102300 2024-08-18T22:38:04.465 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:04.447+0000 7fefddffb640 1 -- 172.21.15.121:0/1043671328 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fefe40097e0 con 0x7fefe8102300 2024-08-18T22:38:04.465 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:04.447+0000 7fefef494640 1 -- 172.21.15.121:0/1043671328 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fefe810d470 con 0x7fefe8102300 2024-08-18T22:38:04.465 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:04.447+0000 7fefddffb640 1 -- 172.21.15.121:0/1043671328 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fefe403d420 con 0x7fefe8102300 2024-08-18T22:38:04.465 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:04.447+0000 7fefef494640 1 -- 172.21.15.121:0/1043671328 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fefe810d9b0 con 0x7fefe8102300 2024-08-18T22:38:04.465 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:04.448+0000 7fefef494640 1 -- 172.21.15.121:0/1043671328 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fefe80fda70 con 0x7fefe8102300 2024-08-18T22:38:04.465 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:04.449+0000 7fefddffb640 1 -- 172.21.15.121:0/1043671328 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 19) v1 ==== 85127+0+0 (secure 0 0 0) 0x7fefe4030020 con 0x7fefe8102300 2024-08-18T22:38:04.465 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:04.449+0000 7fefddffb640 1 --2- 172.21.15.121:0/1043671328 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7fefd4067190 0x7fefd4069640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:38:04.465 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:04.449+0000 7fefddffb640 1 -- 172.21.15.121:0/1043671328 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fefe40a4d70 con 0x7fefe8102300 2024-08-18T22:38:04.465 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:04.449+0000 7fefeca2f640 1 --2- 172.21.15.121:0/1043671328 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7fefd4067190 0x7fefd4069640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:38:04.465 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:04.450+0000 7fefeca2f640 1 --2- 172.21.15.121:0/1043671328 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7fefd4067190 0x7fefd4069640 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fefe810eb30 tx=0x7fefd8009040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:38:04.465 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:04.454+0000 7fefddffb640 1 -- 172.21.15.121:0/1043671328 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fefe4072350 con 0x7fefe8102300 2024-08-18T22:38:04.655 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:04.654+0000 7fefef494640 1 -- 172.21.15.121:0/1043671328 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7fefe804b4c0 con 0x7fefe8102300 2024-08-18T22:38:04.658 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:04.657+0000 7fefddffb640 1 -- 172.21.15.121:0/1043671328 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v19) v1 ==== 74+0+164116 (secure 0 0 0) 0x7fefe4075970 con 0x7fefe8102300 2024-08-18T22:38:04.660 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-08-18T22:38:04.661 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:38:04 smithi195 ceph-mon[23370]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-08-18T22:38:04.663 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:04.660+0000 7fefef494640 1 -- 172.21.15.121:0/1043671328 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7fefd4067190 msgr2=0x7fefd4069640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:38:04.663 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:04.660+0000 7fefef494640 1 --2- 172.21.15.121:0/1043671328 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7fefd4067190 0x7fefd4069640 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fefe810eb30 tx=0x7fefd8009040 comp rx=0 tx=0).stop 2024-08-18T22:38:04.663 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:04.660+0000 7fefef494640 1 -- 172.21.15.121:0/1043671328 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fefe8102300 msgr2=0x7fefe8113270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:38:04.663 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:04.660+0000 7fefef494640 1 --2- 172.21.15.121:0/1043671328 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fefe8102300 0x7fefe8113270 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fefe4003080 tx=0x7fefe4009da0 comp rx=0 tx=0).stop 2024-08-18T22:38:04.663 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:04.660+0000 7fefef494640 1 -- 172.21.15.121:0/1043671328 shutdown_connections 2024-08-18T22:38:04.664 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:04.660+0000 7fefef494640 1 --2- 172.21.15.121:0/1043671328 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7fefd4067190 0x7fefd4069640 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:38:04.664 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:04.660+0000 7fefef494640 1 --2- 172.21.15.121:0/1043671328 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fefe8102ca0 0x7fefe81137b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:38:04.664 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:04.660+0000 7fefef494640 1 --2- 172.21.15.121:0/1043671328 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fefe8102300 0x7fefe8113270 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:38:04.664 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:04.660+0000 7fefef494640 1 -- 172.21.15.121:0/1043671328 >> 172.21.15.121:0/1043671328 conn(0x7fefe80f7e90 msgr2=0x7fefe80f8f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:38:04.664 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:04.660+0000 7fefef494640 1 -- 172.21.15.121:0/1043671328 shutdown_connections 2024-08-18T22:38:04.664 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:04.660+0000 7fefef494640 1 -- 172.21.15.121:0/1043671328 wait complete. 2024-08-18T22:38:05.492 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:38:05 smithi121 ceph-mon[16788]: from='client.? 172.21.15.121:0/1043671328' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-08-18T22:38:05.519 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":19,"flags":0,"active_gid":14206,"active_name":"smithi121.lopxqc","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":3225195982},{"type":"v1","addr":"172.21.15.121:6801","nonce":3225195982}]},"active_addr":"172.21.15.121:6801/3225195982","active_change":"2024-08-18T22:34:38.510032+0000","active_mgr_features":4540138320759226367,"available":true,"standbys":[{"gid":14226,"name":"smithi195.acttsj","mgr_features":4540138320759226367,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","prometheus","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.121:8443/","prometheus":"http://172.21.15.121:9283/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":5,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.121:0","nonce":1294402539}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.121:0","nonce":2343998977}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.121:0","nonce":1769827421}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.121:0","nonce":1246808679}]}]} 2024-08-18T22:38:05.523 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2024-08-18T22:38:05.523 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2024-08-18T22:38:05.524 DEBUG:teuthology.orchestra.run.smithi121:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid b003123a-5db1-11ef-bccf-c7b262605968 -- ceph osd dump --format=json 2024-08-18T22:38:05.659 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:38:05 smithi195 ceph-mon[23370]: from='client.? 172.21.15.121:0/1043671328' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-08-18T22:38:05.775 INFO:teuthology.orchestra.run.smithi121.stderr:Inferring config /var/lib/ceph/b003123a-5db1-11ef-bccf-c7b262605968/mon.smithi121/config 2024-08-18T22:38:06.549 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:38:06 smithi121 ceph-mon[16788]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-08-18T22:38:06.659 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:38:06 smithi195 ceph-mon[23370]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-08-18T22:38:07.352 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:07.336+0000 7f65d7067640 1 -- 172.21.15.121:0/170613216 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f65d01022e0 msgr2=0x7f65d01026b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:38:07.352 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:07.336+0000 7f65d7067640 1 --2- 172.21.15.121:0/170613216 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f65d01022e0 0x7f65d01026b0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f65c40048d0 tx=0x7f65c4009da0 comp rx=0 tx=0).stop 2024-08-18T22:38:07.352 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:07.336+0000 7f65d7067640 1 -- 172.21.15.121:0/170613216 shutdown_connections 2024-08-18T22:38:07.352 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:07.336+0000 7f65d7067640 1 --2- 172.21.15.121:0/170613216 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f65d0102c80 0x7f65d00fc310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:38:07.352 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:07.336+0000 7f65d7067640 1 --2- 172.21.15.121:0/170613216 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f65d01022e0 0x7f65d01026b0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:38:07.353 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:07.336+0000 7f65d7067640 1 -- 172.21.15.121:0/170613216 >> 172.21.15.121:0/170613216 conn(0x7f65d00f7eb0 msgr2=0x7f65d00fa2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:38:07.353 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:07.336+0000 7f65d7067640 1 -- 172.21.15.121:0/170613216 shutdown_connections 2024-08-18T22:38:07.353 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:07.336+0000 7f65d7067640 1 -- 172.21.15.121:0/170613216 wait complete. 2024-08-18T22:38:07.353 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:07.337+0000 7f65d7067640 1 Processor -- start 2024-08-18T22:38:07.353 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:07.337+0000 7f65d7067640 1 -- start start 2024-08-18T22:38:07.353 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:07.337+0000 7f65d7067640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f65d01022e0 0x7f65d0112f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:38:07.353 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:07.337+0000 7f65d7067640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f65d0102c80 0x7f65d0113470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:38:07.353 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:07.337+0000 7f65d7067640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65d0113a70 con 0x7f65d01022e0 2024-08-18T22:38:07.353 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:07.337+0000 7f65d7067640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65d010ceb0 con 0x7f65d0102c80 2024-08-18T22:38:07.353 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:07.337+0000 7f65d4e03640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f65d01022e0 0x7f65d0112f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:38:07.353 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:07.337+0000 7f65d4e03640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f65d01022e0 0x7f65d0112f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:34188/0 (socket says 172.21.15.121:34188) 2024-08-18T22:38:07.353 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:07.337+0000 7f65d4e03640 1 -- 172.21.15.121:0/1626017808 learned_addr learned my addr 172.21.15.121:0/1626017808 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-18T22:38:07.353 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:07.338+0000 7f65cffff640 1 --2- 172.21.15.121:0/1626017808 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f65d0102c80 0x7f65d0113470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:38:07.354 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:07.338+0000 7f65d4e03640 1 -- 172.21.15.121:0/1626017808 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f65d0102c80 msgr2=0x7f65d0113470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:38:07.354 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:07.338+0000 7f65d4e03640 1 --2- 172.21.15.121:0/1626017808 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f65d0102c80 0x7f65d0113470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:38:07.354 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:07.338+0000 7f65d4e03640 1 -- 172.21.15.121:0/1626017808 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65c4005040 con 0x7f65d01022e0 2024-08-18T22:38:07.354 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:07.338+0000 7f65cffff640 1 --2- 172.21.15.121:0/1626017808 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f65d0102c80 0x7f65d0113470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:38:07.354 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:07.338+0000 7f65d4e03640 1 --2- 172.21.15.121:0/1626017808 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f65d01022e0 0x7f65d0112f30 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f65c4003080 tx=0x7f65c4009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:38:07.354 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:07.338+0000 7f65cd7fa640 1 -- 172.21.15.121:0/1626017808 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f65c4038070 con 0x7f65d01022e0 2024-08-18T22:38:07.354 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:07.338+0000 7f65cd7fa640 1 -- 172.21.15.121:0/1626017808 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f65c40097e0 con 0x7f65d01022e0 2024-08-18T22:38:07.354 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:07.338+0000 7f65d7067640 1 -- 172.21.15.121:0/1626017808 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65d010d130 con 0x7f65d01022e0 2024-08-18T22:38:07.354 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:07.338+0000 7f65cd7fa640 1 -- 172.21.15.121:0/1626017808 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f65c403d420 con 0x7f65d01022e0 2024-08-18T22:38:07.354 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:07.338+0000 7f65d7067640 1 -- 172.21.15.121:0/1626017808 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65d010d670 con 0x7f65d01022e0 2024-08-18T22:38:07.354 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:07.339+0000 7f65d7067640 1 -- 172.21.15.121:0/1626017808 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65d00fda50 con 0x7f65d01022e0 2024-08-18T22:38:07.354 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:07.340+0000 7f65cd7fa640 1 -- 172.21.15.121:0/1626017808 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 19) v1 ==== 85127+0+0 (secure 0 0 0) 0x7f65c4030020 con 0x7f65d01022e0 2024-08-18T22:38:07.354 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:07.340+0000 7f65cd7fa640 1 --2- 172.21.15.121:0/1626017808 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7f65c0067190 0x7f65c0069640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:38:07.354 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:07.340+0000 7f65cd7fa640 1 -- 172.21.15.121:0/1626017808 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f65c40a4d00 con 0x7f65d01022e0 2024-08-18T22:38:07.355 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:07.340+0000 7f65cffff640 1 --2- 172.21.15.121:0/1626017808 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7f65c0067190 0x7f65c0069640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:38:07.355 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:07.340+0000 7f65cffff640 1 --2- 172.21.15.121:0/1626017808 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7f65c0067190 0x7f65c0069640 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f65d010e7f0 tx=0x7f65bc009040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:38:07.355 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:07.345+0000 7f65cd7fa640 1 -- 172.21.15.121:0/1626017808 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f65c40a8030 con 0x7f65d01022e0 2024-08-18T22:38:07.502 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:07.501+0000 7f65d7067640 1 -- 172.21.15.121:0/1626017808 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f65d004b4c0 con 0x7f65d01022e0 2024-08-18T22:38:07.503 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:07.502+0000 7f65cd7fa640 1 -- 172.21.15.121:0/1626017808 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v41) v1 ==== 74+0+11132 (secure 0 0 0) 0x7f65c4072360 con 0x7f65d01022e0 2024-08-18T22:38:07.503 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-08-18T22:38:07.503 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":41,"fsid":"b003123a-5db1-11ef-bccf-c7b262605968","created":"2024-08-18T22:32:41.330713+0000","modified":"2024-08-18T22:37:52.165058+0000","last_up_change":"2024-08-18T22:37:51.159312+0000","last_in_change":"2024-08-18T22:37:33.530314+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-18T22:36:42.820615+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"46b17ad3-c549-4492-bb2b-562dfae0ac3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":3702842813},{"type":"v1","addr":"172.21.15.121:6803","nonce":3702842813}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":3702842813},{"type":"v1","addr":"172.21.15.121:6805","nonce":3702842813}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":3702842813},{"type":"v1","addr":"172.21.15.121:6809","nonce":3702842813}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6806","nonce":3702842813},{"type":"v1","addr":"172.21.15.121:6807","nonce":3702842813}]},"public_addr":"172.21.15.121:6803/3702842813","cluster_addr":"172.21.15.121:6805/3702842813","heartbeat_back_addr":"172.21.15.121:6809/3702842813","heartbeat_front_addr":"172.21.15.121:6807/3702842813","state":["exists","up"]},{"osd":1,"uuid":"21393748-75ac-4f55-915c-8ddc79339dba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6810","nonce":1711466097},{"type":"v1","addr":"172.21.15.121:6811","nonce":1711466097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":1711466097},{"type":"v1","addr":"172.21.15.121:6813","nonce":1711466097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":1711466097},{"type":"v1","addr":"172.21.15.121:6817","nonce":1711466097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6814","nonce":1711466097},{"type":"v1","addr":"172.21.15.121:6815","nonce":1711466097}]},"public_addr":"172.21.15.121:6811/1711466097","cluster_addr":"172.21.15.121:6813/1711466097","heartbeat_back_addr":"172.21.15.121:6817/1711466097","heartbeat_front_addr":"172.21.15.121:6815/1711466097","state":["exists","up"]},{"osd":2,"uuid":"79b07f6b-e26d-4ed7-b014-459c177f41ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6818","nonce":2696892839},{"type":"v1","addr":"172.21.15.121:6819","nonce":2696892839}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6820","nonce":2696892839},{"type":"v1","addr":"172.21.15.121:6821","nonce":2696892839}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6824","nonce":2696892839},{"type":"v1","addr":"172.21.15.121:6825","nonce":2696892839}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":2696892839},{"type":"v1","addr":"172.21.15.121:6823","nonce":2696892839}]},"public_addr":"172.21.15.121:6819/2696892839","cluster_addr":"172.21.15.121:6821/2696892839","heartbeat_back_addr":"172.21.15.121:6825/2696892839","heartbeat_front_addr":"172.21.15.121:6823/2696892839","state":["exists","up"]},{"osd":3,"uuid":"62aafac2-c863-45df-a067-dcb6c2fa1df2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":1551491756},{"type":"v1","addr":"172.21.15.195:6801","nonce":1551491756}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":1551491756},{"type":"v1","addr":"172.21.15.195:6803","nonce":1551491756}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":1551491756},{"type":"v1","addr":"172.21.15.195:6807","nonce":1551491756}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":1551491756},{"type":"v1","addr":"172.21.15.195:6805","nonce":1551491756}]},"public_addr":"172.21.15.195:6801/1551491756","cluster_addr":"172.21.15.195:6803/1551491756","heartbeat_back_addr":"172.21.15.195:6807/1551491756","heartbeat_front_addr":"172.21.15.195:6805/1551491756","state":["exists","up"]},{"osd":4,"uuid":"a2582923-0d40-4cc4-b1bf-361f88e9bb68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":587500564},{"type":"v1","addr":"172.21.15.195:6809","nonce":587500564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":587500564},{"type":"v1","addr":"172.21.15.195:6811","nonce":587500564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":587500564},{"type":"v1","addr":"172.21.15.195:6815","nonce":587500564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":587500564},{"type":"v1","addr":"172.21.15.195:6813","nonce":587500564}]},"public_addr":"172.21.15.195:6809/587500564","cluster_addr":"172.21.15.195:6811/587500564","heartbeat_back_addr":"172.21.15.195:6815/587500564","heartbeat_front_addr":"172.21.15.195:6813/587500564","state":["exists","up"]},{"osd":5,"uuid":"ae063840-fa2d-4d2e-b303-5d034d3f1b23","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":40,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":2603984040},{"type":"v1","addr":"172.21.15.195:6817","nonce":2603984040}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":2603984040},{"type":"v1","addr":"172.21.15.195:6819","nonce":2603984040}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":2603984040},{"type":"v1","addr":"172.21.15.195:6823","nonce":2603984040}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":2603984040},{"type":"v1","addr":"172.21.15.195:6821","nonce":2603984040}]},"public_addr":"172.21.15.195:6817/2603984040","cluster_addr":"172.21.15.195:6819/2603984040","heartbeat_back_addr":"172.21.15.195:6823/2603984040","heartbeat_front_addr":"172.21.15.195:6821/2603984040","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:35:48.671526+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:36:13.721039+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:36:39.593069+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:37:01.453125+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:37:25.509748+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:37:50.000694+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.121:6801/1740603058":"2024-08-19T22:34:38.509926+0000","172.21.15.121:0/2242648652":"2024-08-19T22:33:09.834580+0000","172.21.15.121:6801/2610373559":"2024-08-19T22:33:09.834580+0000","172.21.15.121:0/772981487":"2024-08-19T22:34:38.509926+0000","172.21.15.121:0/3667011451":"2024-08-19T22:33:09.834580+0000","172.21.15.121:6800/2610373559":"2024-08-19T22:33:09.834580+0000","172.21.15.121:0/1731486537":"2024-08-19T22:33:38.104162+0000","172.21.15.121:0/2324544310":"2024-08-19T22:33:09.834580+0000","172.21.15.121:0/2570435202":"2024-08-19T22:33:38.104162+0000","172.21.15.121:6800/833901271":"2024-08-19T22:33:38.104162+0000","172.21.15.121:6801/833901271":"2024-08-19T22:33:38.104162+0000","172.21.15.121:0/3576026097":"2024-08-19T22:33:38.104162+0000","172.21.15.121:0/2061352978":"2024-08-19T22:34:38.509926+0000","172.21.15.121:0/774496394":"2024-08-19T22:34:38.509926+0000","172.21.15.121:6800/1740603058":"2024-08-19T22:34:38.509926+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-18T22:38:07.505 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:07.504+0000 7f65d7067640 1 -- 172.21.15.121:0/1626017808 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7f65c0067190 msgr2=0x7f65c0069640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:38:07.505 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:07.504+0000 7f65d7067640 1 --2- 172.21.15.121:0/1626017808 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7f65c0067190 0x7f65c0069640 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f65d010e7f0 tx=0x7f65bc009040 comp rx=0 tx=0).stop 2024-08-18T22:38:07.505 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:07.504+0000 7f65d7067640 1 -- 172.21.15.121:0/1626017808 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f65d01022e0 msgr2=0x7f65d0112f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:38:07.505 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:07.504+0000 7f65d7067640 1 --2- 172.21.15.121:0/1626017808 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f65d01022e0 0x7f65d0112f30 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f65c4003080 tx=0x7f65c4009da0 comp rx=0 tx=0).stop 2024-08-18T22:38:07.505 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:07.504+0000 7f65d7067640 1 -- 172.21.15.121:0/1626017808 shutdown_connections 2024-08-18T22:38:07.506 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:07.504+0000 7f65d7067640 1 --2- 172.21.15.121:0/1626017808 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7f65c0067190 0x7f65c0069640 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:38:07.506 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:07.504+0000 7f65d7067640 1 --2- 172.21.15.121:0/1626017808 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f65d0102c80 0x7f65d0113470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:38:07.506 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:07.504+0000 7f65d7067640 1 --2- 172.21.15.121:0/1626017808 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f65d01022e0 0x7f65d0112f30 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:38:07.506 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:07.504+0000 7f65d7067640 1 -- 172.21.15.121:0/1626017808 >> 172.21.15.121:0/1626017808 conn(0x7f65d00f7eb0 msgr2=0x7f65d00f8ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:38:07.506 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:07.504+0000 7f65d7067640 1 -- 172.21.15.121:0/1626017808 shutdown_connections 2024-08-18T22:38:07.506 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:07.504+0000 7f65d7067640 1 -- 172.21.15.121:0/1626017808 wait complete. 2024-08-18T22:38:08.005 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2024-08-18T22:38:08.006 DEBUG:teuthology.orchestra.run.smithi121:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid b003123a-5db1-11ef-bccf-c7b262605968 -- ceph osd dump --format=json 2024-08-18T22:38:08.252 INFO:teuthology.orchestra.run.smithi121.stderr:Inferring config /var/lib/ceph/b003123a-5db1-11ef-bccf-c7b262605968/mon.smithi121/config 2024-08-18T22:38:08.333 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:38:08 smithi121 ceph-mon[16788]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-08-18T22:38:08.333 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:38:08 smithi121 ceph-mon[16788]: from='client.? 172.21.15.121:0/1626017808' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-08-18T22:38:08.409 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:38:08 smithi195 ceph-mon[23370]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-08-18T22:38:08.409 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:38:08 smithi195 ceph-mon[23370]: from='client.? 172.21.15.121:0/1626017808' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-08-18T22:38:09.430 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:38:09 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-18T22:38:09.659 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:38:09 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-18T22:38:09.720 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:09.718+0000 7f02310d8640 1 -- 172.21.15.121:0/2771187300 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f022c1099f0 msgr2=0x7f022c109dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:38:09.720 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:09.718+0000 7f02310d8640 1 --2- 172.21.15.121:0/2771187300 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f022c1099f0 0x7f022c109dc0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f021c0048d0 tx=0x7f021c009da0 comp rx=0 tx=0).stop 2024-08-18T22:38:09.720 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:09.718+0000 7f02310d8640 1 -- 172.21.15.121:0/2771187300 shutdown_connections 2024-08-18T22:38:09.720 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:09.718+0000 7f02310d8640 1 --2- 172.21.15.121:0/2771187300 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f022c10a390 0x7f022c06db90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:38:09.720 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:09.718+0000 7f02310d8640 1 --2- 172.21.15.121:0/2771187300 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f022c1099f0 0x7f022c109dc0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:38:09.720 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:09.718+0000 7f02310d8640 1 -- 172.21.15.121:0/2771187300 >> 172.21.15.121:0/2771187300 conn(0x7f022c068850 msgr2=0x7f022c068c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:38:09.720 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:09.718+0000 7f02310d8640 1 -- 172.21.15.121:0/2771187300 shutdown_connections 2024-08-18T22:38:09.721 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:09.719+0000 7f02310d8640 1 -- 172.21.15.121:0/2771187300 wait complete. 2024-08-18T22:38:09.723 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:09.719+0000 7f02310d8640 1 Processor -- start 2024-08-18T22:38:09.723 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:09.719+0000 7f02310d8640 1 -- start start 2024-08-18T22:38:09.723 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:09.720+0000 7f02310d8640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f022c1099f0 0x7f022c11a630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:38:09.723 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:09.720+0000 7f02310d8640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f022c10a390 0x7f022c11ab90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:38:09.723 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:09.720+0000 7f02310d8640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f022c11b1e0 con 0x7f022c10a390 2024-08-18T22:38:09.723 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:09.720+0000 7f02310d8640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f022c1145d0 con 0x7f022c1099f0 2024-08-18T22:38:09.723 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:09.720+0000 7f022a59c640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f022c10a390 0x7f022c11ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:38:09.723 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:09.720+0000 7f022a59c640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f022c10a390 0x7f022c11ab90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:34216/0 (socket says 172.21.15.121:34216) 2024-08-18T22:38:09.723 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:09.720+0000 7f022a59c640 1 -- 172.21.15.121:0/360935227 learned_addr learned my addr 172.21.15.121:0/360935227 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-18T22:38:09.723 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:09.720+0000 7f022ad9d640 1 --2- 172.21.15.121:0/360935227 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f022c1099f0 0x7f022c11a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:38:09.723 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:09.720+0000 7f022a59c640 1 -- 172.21.15.121:0/360935227 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f022c1099f0 msgr2=0x7f022c11a630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:38:09.724 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:09.720+0000 7f022a59c640 1 --2- 172.21.15.121:0/360935227 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f022c1099f0 0x7f022c11a630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:38:09.724 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:09.720+0000 7f022a59c640 1 -- 172.21.15.121:0/360935227 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f021c005040 con 0x7f022c10a390 2024-08-18T22:38:09.724 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:09.720+0000 7f022a59c640 1 --2- 172.21.15.121:0/360935227 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f022c10a390 0x7f022c11ab90 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f02200028a0 tx=0x7f0220004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:38:09.724 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:09.720+0000 7f02137fe640 1 -- 172.21.15.121:0/360935227 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0220007c30 con 0x7f022c10a390 2024-08-18T22:38:09.724 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:09.720+0000 7f02137fe640 1 -- 172.21.15.121:0/360935227 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f022000f040 con 0x7f022c10a390 2024-08-18T22:38:09.724 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:09.721+0000 7f02310d8640 1 -- 172.21.15.121:0/360935227 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f022c114830 con 0x7f022c10a390 2024-08-18T22:38:09.724 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:09.721+0000 7f02137fe640 1 -- 172.21.15.121:0/360935227 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f022000dab0 con 0x7f022c10a390 2024-08-18T22:38:09.724 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:09.721+0000 7f02310d8640 1 -- 172.21.15.121:0/360935227 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f022c114d50 con 0x7f022c10a390 2024-08-18T22:38:09.724 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:09.722+0000 7f02310d8640 1 -- 172.21.15.121:0/360935227 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f022c06f250 con 0x7f022c10a390 2024-08-18T22:38:09.724 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:09.722+0000 7f02137fe640 1 -- 172.21.15.121:0/360935227 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 19) v1 ==== 85127+0+0 (secure 0 0 0) 0x7f022000dc10 con 0x7f022c10a390 2024-08-18T22:38:09.725 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:09.723+0000 7f02137fe640 1 --2- 172.21.15.121:0/360935227 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7f0214067190 0x7f0214069640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:38:09.725 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:09.723+0000 7f02137fe640 1 -- 172.21.15.121:0/360935227 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f0220083e10 con 0x7f022c10a390 2024-08-18T22:38:09.725 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:09.723+0000 7f022ad9d640 1 --2- 172.21.15.121:0/360935227 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7f0214067190 0x7f0214069640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:38:09.725 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:09.723+0000 7f022ad9d640 1 --2- 172.21.15.121:0/360935227 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7f0214067190 0x7f0214069640 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f021c000c00 tx=0x7f021c035040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:38:09.727 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:09.727+0000 7f02137fe640 1 -- 172.21.15.121:0/360935227 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f022004d2a0 con 0x7f022c10a390 2024-08-18T22:38:09.891 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:09.890+0000 7f02310d8640 1 -- 172.21.15.121:0/360935227 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f022c04b4c0 con 0x7f022c10a390 2024-08-18T22:38:09.892 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:09.891+0000 7f02137fe640 1 -- 172.21.15.121:0/360935227 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v41) v1 ==== 74+0+11132 (secure 0 0 0) 0x7f0220017090 con 0x7f022c10a390 2024-08-18T22:38:09.893 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-08-18T22:38:09.893 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":41,"fsid":"b003123a-5db1-11ef-bccf-c7b262605968","created":"2024-08-18T22:32:41.330713+0000","modified":"2024-08-18T22:37:52.165058+0000","last_up_change":"2024-08-18T22:37:51.159312+0000","last_in_change":"2024-08-18T22:37:33.530314+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-18T22:36:42.820615+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"46b17ad3-c549-4492-bb2b-562dfae0ac3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":3702842813},{"type":"v1","addr":"172.21.15.121:6803","nonce":3702842813}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":3702842813},{"type":"v1","addr":"172.21.15.121:6805","nonce":3702842813}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":3702842813},{"type":"v1","addr":"172.21.15.121:6809","nonce":3702842813}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6806","nonce":3702842813},{"type":"v1","addr":"172.21.15.121:6807","nonce":3702842813}]},"public_addr":"172.21.15.121:6803/3702842813","cluster_addr":"172.21.15.121:6805/3702842813","heartbeat_back_addr":"172.21.15.121:6809/3702842813","heartbeat_front_addr":"172.21.15.121:6807/3702842813","state":["exists","up"]},{"osd":1,"uuid":"21393748-75ac-4f55-915c-8ddc79339dba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6810","nonce":1711466097},{"type":"v1","addr":"172.21.15.121:6811","nonce":1711466097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":1711466097},{"type":"v1","addr":"172.21.15.121:6813","nonce":1711466097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":1711466097},{"type":"v1","addr":"172.21.15.121:6817","nonce":1711466097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6814","nonce":1711466097},{"type":"v1","addr":"172.21.15.121:6815","nonce":1711466097}]},"public_addr":"172.21.15.121:6811/1711466097","cluster_addr":"172.21.15.121:6813/1711466097","heartbeat_back_addr":"172.21.15.121:6817/1711466097","heartbeat_front_addr":"172.21.15.121:6815/1711466097","state":["exists","up"]},{"osd":2,"uuid":"79b07f6b-e26d-4ed7-b014-459c177f41ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6818","nonce":2696892839},{"type":"v1","addr":"172.21.15.121:6819","nonce":2696892839}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6820","nonce":2696892839},{"type":"v1","addr":"172.21.15.121:6821","nonce":2696892839}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6824","nonce":2696892839},{"type":"v1","addr":"172.21.15.121:6825","nonce":2696892839}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":2696892839},{"type":"v1","addr":"172.21.15.121:6823","nonce":2696892839}]},"public_addr":"172.21.15.121:6819/2696892839","cluster_addr":"172.21.15.121:6821/2696892839","heartbeat_back_addr":"172.21.15.121:6825/2696892839","heartbeat_front_addr":"172.21.15.121:6823/2696892839","state":["exists","up"]},{"osd":3,"uuid":"62aafac2-c863-45df-a067-dcb6c2fa1df2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":1551491756},{"type":"v1","addr":"172.21.15.195:6801","nonce":1551491756}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":1551491756},{"type":"v1","addr":"172.21.15.195:6803","nonce":1551491756}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":1551491756},{"type":"v1","addr":"172.21.15.195:6807","nonce":1551491756}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":1551491756},{"type":"v1","addr":"172.21.15.195:6805","nonce":1551491756}]},"public_addr":"172.21.15.195:6801/1551491756","cluster_addr":"172.21.15.195:6803/1551491756","heartbeat_back_addr":"172.21.15.195:6807/1551491756","heartbeat_front_addr":"172.21.15.195:6805/1551491756","state":["exists","up"]},{"osd":4,"uuid":"a2582923-0d40-4cc4-b1bf-361f88e9bb68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":587500564},{"type":"v1","addr":"172.21.15.195:6809","nonce":587500564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":587500564},{"type":"v1","addr":"172.21.15.195:6811","nonce":587500564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":587500564},{"type":"v1","addr":"172.21.15.195:6815","nonce":587500564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":587500564},{"type":"v1","addr":"172.21.15.195:6813","nonce":587500564}]},"public_addr":"172.21.15.195:6809/587500564","cluster_addr":"172.21.15.195:6811/587500564","heartbeat_back_addr":"172.21.15.195:6815/587500564","heartbeat_front_addr":"172.21.15.195:6813/587500564","state":["exists","up"]},{"osd":5,"uuid":"ae063840-fa2d-4d2e-b303-5d034d3f1b23","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":40,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":2603984040},{"type":"v1","addr":"172.21.15.195:6817","nonce":2603984040}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":2603984040},{"type":"v1","addr":"172.21.15.195:6819","nonce":2603984040}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":2603984040},{"type":"v1","addr":"172.21.15.195:6823","nonce":2603984040}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":2603984040},{"type":"v1","addr":"172.21.15.195:6821","nonce":2603984040}]},"public_addr":"172.21.15.195:6817/2603984040","cluster_addr":"172.21.15.195:6819/2603984040","heartbeat_back_addr":"172.21.15.195:6823/2603984040","heartbeat_front_addr":"172.21.15.195:6821/2603984040","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:35:48.671526+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:36:13.721039+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:36:39.593069+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:37:01.453125+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:37:25.509748+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T22:37:50.000694+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.121:6801/1740603058":"2024-08-19T22:34:38.509926+0000","172.21.15.121:0/2242648652":"2024-08-19T22:33:09.834580+0000","172.21.15.121:6801/2610373559":"2024-08-19T22:33:09.834580+0000","172.21.15.121:0/772981487":"2024-08-19T22:34:38.509926+0000","172.21.15.121:0/3667011451":"2024-08-19T22:33:09.834580+0000","172.21.15.121:6800/2610373559":"2024-08-19T22:33:09.834580+0000","172.21.15.121:0/1731486537":"2024-08-19T22:33:38.104162+0000","172.21.15.121:0/2324544310":"2024-08-19T22:33:09.834580+0000","172.21.15.121:0/2570435202":"2024-08-19T22:33:38.104162+0000","172.21.15.121:6800/833901271":"2024-08-19T22:33:38.104162+0000","172.21.15.121:6801/833901271":"2024-08-19T22:33:38.104162+0000","172.21.15.121:0/3576026097":"2024-08-19T22:33:38.104162+0000","172.21.15.121:0/2061352978":"2024-08-19T22:34:38.509926+0000","172.21.15.121:0/774496394":"2024-08-19T22:34:38.509926+0000","172.21.15.121:6800/1740603058":"2024-08-19T22:34:38.509926+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-18T22:38:09.895 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:09.894+0000 7f02310d8640 1 -- 172.21.15.121:0/360935227 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7f0214067190 msgr2=0x7f0214069640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:38:09.895 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:09.894+0000 7f02310d8640 1 --2- 172.21.15.121:0/360935227 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7f0214067190 0x7f0214069640 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f021c000c00 tx=0x7f021c035040 comp rx=0 tx=0).stop 2024-08-18T22:38:09.895 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:09.894+0000 7f02310d8640 1 -- 172.21.15.121:0/360935227 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f022c10a390 msgr2=0x7f022c11ab90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:38:09.895 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:09.894+0000 7f02310d8640 1 --2- 172.21.15.121:0/360935227 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f022c10a390 0x7f022c11ab90 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f02200028a0 tx=0x7f0220004600 comp rx=0 tx=0).stop 2024-08-18T22:38:09.895 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:09.894+0000 7f02310d8640 1 -- 172.21.15.121:0/360935227 shutdown_connections 2024-08-18T22:38:09.895 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:09.894+0000 7f02310d8640 1 --2- 172.21.15.121:0/360935227 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7f0214067190 0x7f0214069640 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:38:09.895 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:09.894+0000 7f02310d8640 1 --2- 172.21.15.121:0/360935227 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f022c10a390 0x7f022c11ab90 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:38:09.896 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:09.894+0000 7f02310d8640 1 --2- 172.21.15.121:0/360935227 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f022c1099f0 0x7f022c11a630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:38:09.896 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:09.894+0000 7f02310d8640 1 -- 172.21.15.121:0/360935227 >> 172.21.15.121:0/360935227 conn(0x7f022c068850 msgr2=0x7f022c10c7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:38:09.896 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:09.894+0000 7f02310d8640 1 -- 172.21.15.121:0/360935227 shutdown_connections 2024-08-18T22:38:09.896 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:09.894+0000 7f02310d8640 1 -- 172.21.15.121:0/360935227 wait complete. 2024-08-18T22:38:10.545 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:38:10 smithi121 ceph-mon[16788]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-08-18T22:38:10.546 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:38:10 smithi121 ceph-mon[16788]: from='client.? 172.21.15.121:0/360935227' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-08-18T22:38:10.572 DEBUG:teuthology.orchestra.run.smithi121:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid b003123a-5db1-11ef-bccf-c7b262605968 -- ceph tell osd.0 flush_pg_stats 2024-08-18T22:38:10.572 DEBUG:teuthology.orchestra.run.smithi121:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid b003123a-5db1-11ef-bccf-c7b262605968 -- ceph tell osd.1 flush_pg_stats 2024-08-18T22:38:10.572 DEBUG:teuthology.orchestra.run.smithi121:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid b003123a-5db1-11ef-bccf-c7b262605968 -- ceph tell osd.2 flush_pg_stats 2024-08-18T22:38:10.573 DEBUG:teuthology.orchestra.run.smithi121:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid b003123a-5db1-11ef-bccf-c7b262605968 -- ceph tell osd.3 flush_pg_stats 2024-08-18T22:38:10.573 DEBUG:teuthology.orchestra.run.smithi121:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid b003123a-5db1-11ef-bccf-c7b262605968 -- ceph tell osd.4 flush_pg_stats 2024-08-18T22:38:10.574 DEBUG:teuthology.orchestra.run.smithi121:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid b003123a-5db1-11ef-bccf-c7b262605968 -- ceph tell osd.5 flush_pg_stats 2024-08-18T22:38:10.659 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:38:10 smithi195 ceph-mon[23370]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-08-18T22:38:10.659 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:38:10 smithi195 ceph-mon[23370]: from='client.? 172.21.15.121:0/360935227' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-08-18T22:38:10.893 INFO:teuthology.orchestra.run.smithi121.stderr:Inferring config /var/lib/ceph/b003123a-5db1-11ef-bccf-c7b262605968/mon.smithi121/config 2024-08-18T22:38:11.530 INFO:teuthology.orchestra.run.smithi121.stderr:Inferring config /var/lib/ceph/b003123a-5db1-11ef-bccf-c7b262605968/mon.smithi121/config 2024-08-18T22:38:11.530 INFO:teuthology.orchestra.run.smithi121.stderr:Inferring config /var/lib/ceph/b003123a-5db1-11ef-bccf-c7b262605968/mon.smithi121/config 2024-08-18T22:38:11.531 INFO:teuthology.orchestra.run.smithi121.stderr:Inferring config /var/lib/ceph/b003123a-5db1-11ef-bccf-c7b262605968/mon.smithi121/config 2024-08-18T22:38:11.531 INFO:teuthology.orchestra.run.smithi121.stderr:Inferring config /var/lib/ceph/b003123a-5db1-11ef-bccf-c7b262605968/mon.smithi121/config 2024-08-18T22:38:11.532 INFO:teuthology.orchestra.run.smithi121.stderr:Inferring config /var/lib/ceph/b003123a-5db1-11ef-bccf-c7b262605968/mon.smithi121/config 2024-08-18T22:38:12.583 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:38:12 smithi121 ceph-mon[16788]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-08-18T22:38:12.659 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:38:12 smithi195 ceph-mon[23370]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-08-18T22:38:14.333 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:38:14 smithi121 ceph-mon[16788]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-08-18T22:38:14.372 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:14.356+0000 7fcd83664640 1 -- 172.21.15.121:0/3505416237 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcd7c0faa90 msgr2=0x7fcd7c0faf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:38:14.372 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:14.356+0000 7fcd83664640 1 --2- 172.21.15.121:0/3505416237 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcd7c0faa90 0x7fcd7c0faf00 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fcd6c0048d0 tx=0x7fcd6c009da0 comp rx=0 tx=0).stop 2024-08-18T22:38:14.372 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:14.356+0000 7fcd83664640 1 -- 172.21.15.121:0/3505416237 shutdown_connections 2024-08-18T22:38:14.372 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:14.356+0000 7fcd83664640 1 --2- 172.21.15.121:0/3505416237 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcd7c0faa90 0x7fcd7c0faf00 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:38:14.373 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:14.356+0000 7fcd83664640 1 --2- 172.21.15.121:0/3505416237 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcd7c102420 0x7fcd7c1027f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:38:14.373 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:14.356+0000 7fcd83664640 1 -- 172.21.15.121:0/3505416237 >> 172.21.15.121:0/3505416237 conn(0x7fcd7c070af0 msgr2=0x7fcd7c070ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:38:14.373 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:14.356+0000 7fcd83664640 1 -- 172.21.15.121:0/3505416237 shutdown_connections 2024-08-18T22:38:14.373 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:14.356+0000 7fcd83664640 1 -- 172.21.15.121:0/3505416237 wait complete. 2024-08-18T22:38:14.373 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:14.357+0000 7fcd83664640 1 Processor -- start 2024-08-18T22:38:14.373 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:14.357+0000 7fcd83664640 1 -- start start 2024-08-18T22:38:14.373 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:14.357+0000 7fcd83664640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcd7c0faa90 0x7fcd7c1130f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:38:14.373 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:14.357+0000 7fcd83664640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcd7c102420 0x7fcd7c113630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:38:14.373 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:14.357+0000 7fcd83664640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd7c113cc0 con 0x7fcd7c102420 2024-08-18T22:38:14.373 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:14.357+0000 7fcd83664640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd7c10d070 con 0x7fcd7c0faa90 2024-08-18T22:38:14.373 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:14.357+0000 7fcd80bff640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcd7c102420 0x7fcd7c113630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:38:14.374 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:14.357+0000 7fcd80bff640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcd7c102420 0x7fcd7c113630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:34232/0 (socket says 172.21.15.121:34232) 2024-08-18T22:38:14.374 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:14.357+0000 7fcd80bff640 1 -- 172.21.15.121:0/2354502796 learned_addr learned my addr 172.21.15.121:0/2354502796 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-18T22:38:14.374 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:14.357+0000 7fcd81400640 1 --2- 172.21.15.121:0/2354502796 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcd7c0faa90 0x7fcd7c1130f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:38:14.374 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:14.357+0000 7fcd80bff640 1 -- 172.21.15.121:0/2354502796 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcd7c0faa90 msgr2=0x7fcd7c1130f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:38:14.374 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:14.357+0000 7fcd80bff640 1 --2- 172.21.15.121:0/2354502796 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcd7c0faa90 0x7fcd7c1130f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:38:14.374 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:14.357+0000 7fcd80bff640 1 -- 172.21.15.121:0/2354502796 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd6c005040 con 0x7fcd7c102420 2024-08-18T22:38:14.374 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:14.357+0000 7fcd81400640 1 --2- 172.21.15.121:0/2354502796 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcd7c0faa90 0x7fcd7c1130f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:38:14.374 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:14.357+0000 7fcd80bff640 1 --2- 172.21.15.121:0/2354502796 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcd7c102420 0x7fcd7c113630 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fcd6c003080 tx=0x7fcd6c009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:38:14.375 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:14.357+0000 7fcd71ffb640 1 -- 172.21.15.121:0/2354502796 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcd6c038070 con 0x7fcd7c102420 2024-08-18T22:38:14.375 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:14.357+0000 7fcd71ffb640 1 -- 172.21.15.121:0/2354502796 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fcd6c0097e0 con 0x7fcd7c102420 2024-08-18T22:38:14.375 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:14.357+0000 7fcd71ffb640 1 -- 172.21.15.121:0/2354502796 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcd6c03d420 con 0x7fcd7c102420 2024-08-18T22:38:14.375 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:14.357+0000 7fcd83664640 1 -- 172.21.15.121:0/2354502796 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd7c10d2f0 con 0x7fcd7c102420 2024-08-18T22:38:14.375 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:14.358+0000 7fcd83664640 1 -- 172.21.15.121:0/2354502796 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd7c10d7b0 con 0x7fcd7c102420 2024-08-18T22:38:14.375 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:14.359+0000 7fcd83664640 1 -- 172.21.15.121:0/2354502796 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fcd7c10dc10 con 0x7fcd7c102420 2024-08-18T22:38:14.375 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:14.359+0000 7fcd71ffb640 1 -- 172.21.15.121:0/2354502796 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 19) v1 ==== 85127+0+0 (secure 0 0 0) 0x7fcd6c030020 con 0x7fcd7c102420 2024-08-18T22:38:14.375 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:14.359+0000 7fcd71ffb640 1 --2- 172.21.15.121:0/2354502796 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7fcd68067190 0x7fcd68069640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:38:14.375 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:14.359+0000 7fcd71ffb640 1 -- 172.21.15.121:0/2354502796 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fcd6c0a4d30 con 0x7fcd7c102420 2024-08-18T22:38:14.375 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:14.360+0000 7fcd81400640 1 --2- 172.21.15.121:0/2354502796 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7fcd68067190 0x7fcd68069640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:38:14.376 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:14.360+0000 7fcd71ffb640 1 --2- 172.21.15.121:0/2354502796 >> [v2:172.21.15.121:6818/2696892839,v1:172.21.15.121:6819/2696892839] conn(0x7fcd6806cf10 0x7fcd6806f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:38:14.376 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:14.360+0000 7fcd71ffb640 1 -- 172.21.15.121:0/2354502796 --> [v2:172.21.15.121:6818/2696892839,v1:172.21.15.121:6819/2696892839] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fcd6806f9d0 con 0x7fcd6806cf10 2024-08-18T22:38:14.376 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:14.360+0000 7fcd71ffb640 1 -- 172.21.15.121:0/2354502796 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcd6c0aa390 con 0x7fcd7c102420 2024-08-18T22:38:14.376 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:14.360+0000 7fcd81c01640 1 --2- 172.21.15.121:0/2354502796 >> [v2:172.21.15.121:6818/2696892839,v1:172.21.15.121:6819/2696892839] conn(0x7fcd6806cf10 0x7fcd6806f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:38:14.376 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:14.360+0000 7fcd81400640 1 --2- 172.21.15.121:0/2354502796 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7fcd68067190 0x7fcd68069640 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fcd78007fd0 tx=0x7fcd780074f0 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:38:14.376 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:14.360+0000 7fcd81c01640 1 --2- 172.21.15.121:0/2354502796 >> [v2:172.21.15.121:6818/2696892839,v1:172.21.15.121:6819/2696892839] conn(0x7fcd6806cf10 0x7fcd6806f320 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:38:14.376 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:14.361+0000 7fcd71ffb640 1 -- 172.21.15.121:0/2354502796 <== osd.2 v2:172.21.15.121:6818/2696892839 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7fcd6806f9d0 con 0x7fcd6806cf10 2024-08-18T22:38:14.377 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:14.373+0000 7fcd83664640 1 -- 172.21.15.121:0/2354502796 --> [v2:172.21.15.121:6818/2696892839,v1:172.21.15.121:6819/2696892839] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fcd7c065590 con 0x7fcd6806cf10 2024-08-18T22:38:14.377 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:14.374+0000 7fcd71ffb640 1 -- 172.21.15.121:0/2354502796 <== osd.2 v2:172.21.15.121:6818/2696892839 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fcd7c065590 con 0x7fcd6806cf10 2024-08-18T22:38:14.378 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:14.374+0000 7fcd83664640 1 -- 172.21.15.121:0/2354502796 >> [v2:172.21.15.121:6818/2696892839,v1:172.21.15.121:6819/2696892839] conn(0x7fcd6806cf10 msgr2=0x7fcd6806f320 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:38:14.378 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:14.374+0000 7fcd83664640 1 --2- 172.21.15.121:0/2354502796 >> [v2:172.21.15.121:6818/2696892839,v1:172.21.15.121:6819/2696892839] conn(0x7fcd6806cf10 0x7fcd6806f320 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:38:14.379 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:14.374+0000 7fcd83664640 1 -- 172.21.15.121:0/2354502796 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7fcd68067190 msgr2=0x7fcd68069640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:38:14.379 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:14.374+0000 7fcd83664640 1 --2- 172.21.15.121:0/2354502796 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7fcd68067190 0x7fcd68069640 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fcd78007fd0 tx=0x7fcd780074f0 comp rx=0 tx=0).stop 2024-08-18T22:38:14.379 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:14.374+0000 7fcd83664640 1 -- 172.21.15.121:0/2354502796 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcd7c102420 msgr2=0x7fcd7c113630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:38:14.379 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:14.374+0000 7fcd83664640 1 --2- 172.21.15.121:0/2354502796 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcd7c102420 0x7fcd7c113630 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fcd6c003080 tx=0x7fcd6c009da0 comp rx=0 tx=0).stop 2024-08-18T22:38:14.379 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:14.374+0000 7fcd83664640 1 -- 172.21.15.121:0/2354502796 shutdown_connections 2024-08-18T22:38:14.379 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:14.374+0000 7fcd83664640 1 --2- 172.21.15.121:0/2354502796 >> [v2:172.21.15.121:6818/2696892839,v1:172.21.15.121:6819/2696892839] conn(0x7fcd6806cf10 0x7fcd6806f320 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:38:14.379 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:14.374+0000 7fcd83664640 1 --2- 172.21.15.121:0/2354502796 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7fcd68067190 0x7fcd68069640 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:38:14.379 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:14.374+0000 7fcd83664640 1 --2- 172.21.15.121:0/2354502796 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcd7c102420 0x7fcd7c113630 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:38:14.379 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:14.374+0000 7fcd83664640 1 --2- 172.21.15.121:0/2354502796 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcd7c0faa90 0x7fcd7c1130f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:38:14.380 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:14.374+0000 7fcd83664640 1 -- 172.21.15.121:0/2354502796 >> 172.21.15.121:0/2354502796 conn(0x7fcd7c070af0 msgr2=0x7fcd7c0f9e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:38:14.380 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:14.374+0000 7fcd83664640 1 -- 172.21.15.121:0/2354502796 shutdown_connections 2024-08-18T22:38:14.380 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:14.374+0000 7fcd83664640 1 -- 172.21.15.121:0/2354502796 wait complete. 2024-08-18T22:38:14.659 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:38:14 smithi195 ceph-mon[23370]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-08-18T22:38:16.255 INFO:teuthology.orchestra.run.smithi121.stdout:81604378645 2024-08-18T22:38:16.255 DEBUG:teuthology.orchestra.run.smithi121:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid b003123a-5db1-11ef-bccf-c7b262605968 -- ceph osd last-stat-seq osd.2 2024-08-18T22:38:16.450 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:16.438+0000 7f31c3f13640 1 -- 172.21.15.121:0/2899611816 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f31bc101cf0 msgr2=0x7f31bc0fb270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:38:16.450 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:16.438+0000 7f31c3f13640 1 --2- 172.21.15.121:0/2899611816 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f31bc101cf0 0x7f31bc0fb270 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f31ac0048d0 tx=0x7f31ac009da0 comp rx=0 tx=0).stop 2024-08-18T22:38:16.450 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:16.438+0000 7f31c3f13640 1 -- 172.21.15.121:0/2899611816 shutdown_connections 2024-08-18T22:38:16.450 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:16.438+0000 7f31c3f13640 1 --2- 172.21.15.121:0/2899611816 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f31bc101cf0 0x7f31bc0fb270 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:38:16.450 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:16.438+0000 7f31c3f13640 1 --2- 172.21.15.121:0/2899611816 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f31bc101350 0x7f31bc101720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:38:16.450 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:16.438+0000 7f31c3f13640 1 -- 172.21.15.121:0/2899611816 >> 172.21.15.121:0/2899611816 conn(0x7f31bc0f6dd0 msgr2=0x7f31bc0f91e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:38:16.450 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:16.438+0000 7f31c3f13640 1 -- 172.21.15.121:0/2899611816 shutdown_connections 2024-08-18T22:38:16.450 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:16.438+0000 7f31c3f13640 1 -- 172.21.15.121:0/2899611816 wait complete. 2024-08-18T22:38:16.450 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:16.438+0000 7f31c3f13640 1 Processor -- start 2024-08-18T22:38:16.450 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:16.438+0000 7f31c3f13640 1 -- start start 2024-08-18T22:38:16.451 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:16.439+0000 7f31c3f13640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f31bc101350 0x7f31bc10e080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:38:16.451 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:16.439+0000 7f31c3f13640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f31bc101cf0 0x7f31bc10e5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:38:16.451 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:16.439+0000 7f31c3f13640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31bc10ec10 con 0x7f31bc101cf0 2024-08-18T22:38:16.451 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:16.439+0000 7f31c3f13640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31bc10ed80 con 0x7f31bc101350 2024-08-18T22:38:16.451 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:16.439+0000 7f31c14ae640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f31bc101cf0 0x7f31bc10e5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:38:16.451 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:16.439+0000 7f31c14ae640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f31bc101cf0 0x7f31bc10e5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:34254/0 (socket says 172.21.15.121:34254) 2024-08-18T22:38:16.451 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:16.439+0000 7f31c14ae640 1 -- 172.21.15.121:0/434628017 learned_addr learned my addr 172.21.15.121:0/434628017 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-18T22:38:16.451 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:16.439+0000 7f31c1caf640 1 --2- 172.21.15.121:0/434628017 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f31bc101350 0x7f31bc10e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:38:16.451 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:16.439+0000 7f31c14ae640 1 -- 172.21.15.121:0/434628017 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f31bc101350 msgr2=0x7f31bc10e080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:38:16.451 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:16.439+0000 7f31c14ae640 1 --2- 172.21.15.121:0/434628017 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f31bc101350 0x7f31bc10e080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:38:16.451 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:16.439+0000 7f31c14ae640 1 -- 172.21.15.121:0/434628017 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31ac005040 con 0x7f31bc101cf0 2024-08-18T22:38:16.451 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:16.439+0000 7f31c14ae640 1 --2- 172.21.15.121:0/434628017 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f31bc101cf0 0x7f31bc10e5c0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f31ac000c00 tx=0x7f31ac009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:38:16.451 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:16.439+0000 7f31b27fc640 1 -- 172.21.15.121:0/434628017 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f31ac038070 con 0x7f31bc101cf0 2024-08-18T22:38:16.452 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:16.439+0000 7f31c3f13640 1 -- 172.21.15.121:0/434628017 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31bc1170f0 con 0x7f31bc101cf0 2024-08-18T22:38:16.452 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:16.439+0000 7f31b27fc640 1 -- 172.21.15.121:0/434628017 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f31ac02ade0 con 0x7f31bc101cf0 2024-08-18T22:38:16.452 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:16.439+0000 7f31b27fc640 1 -- 172.21.15.121:0/434628017 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f31ac02c7e0 con 0x7f31bc101cf0 2024-08-18T22:38:16.452 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:16.439+0000 7f31c3f13640 1 -- 172.21.15.121:0/434628017 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31bc117550 con 0x7f31bc101cf0 2024-08-18T22:38:16.452 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:16.440+0000 7f31c3f13640 1 -- 172.21.15.121:0/434628017 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f31bc0faa30 con 0x7f31bc101cf0 2024-08-18T22:38:16.452 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:16.441+0000 7f31b27fc640 1 -- 172.21.15.121:0/434628017 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 19) v1 ==== 85127+0+0 (secure 0 0 0) 0x7f31ac030020 con 0x7f31bc101cf0 2024-08-18T22:38:16.452 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:16.441+0000 7f31b27fc640 1 --2- 172.21.15.121:0/434628017 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7f31a8067190 0x7f31a8069640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:38:16.452 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:16.442+0000 7f31b27fc640 1 -- 172.21.15.121:0/434628017 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f31ac0a4920 con 0x7f31bc101cf0 2024-08-18T22:38:16.452 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:16.442+0000 7f31c1caf640 1 --2- 172.21.15.121:0/434628017 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7f31a8067190 0x7f31a8069640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:38:16.452 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:16.442+0000 7f31b27fc640 1 --2- 172.21.15.121:0/434628017 >> [v2:172.21.15.121:6802/3702842813,v1:172.21.15.121:6803/3702842813] conn(0x7f31a806cf10 0x7f31a806f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:38:16.452 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:16.442+0000 7f31b27fc640 1 -- 172.21.15.121:0/434628017 --> [v2:172.21.15.121:6802/3702842813,v1:172.21.15.121:6803/3702842813] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f31a806f9d0 con 0x7f31a806cf10 2024-08-18T22:38:16.452 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:16.442+0000 7f31b27fc640 1 -- 172.21.15.121:0/434628017 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7f31ac0a4d00 con 0x7f31bc101cf0 2024-08-18T22:38:16.452 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:16.442+0000 7f31c24b0640 1 --2- 172.21.15.121:0/434628017 >> [v2:172.21.15.121:6802/3702842813,v1:172.21.15.121:6803/3702842813] conn(0x7f31a806cf10 0x7f31a806f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:38:16.453 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:16.442+0000 7f31c1caf640 1 --2- 172.21.15.121:0/434628017 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7f31a8067190 0x7f31a8069640 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f31b8004ed0 tx=0x7f31b800b040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:38:16.453 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:16.442+0000 7f31c24b0640 1 --2- 172.21.15.121:0/434628017 >> [v2:172.21.15.121:6802/3702842813,v1:172.21.15.121:6803/3702842813] conn(0x7f31a806cf10 0x7f31a806f320 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:38:16.453 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:16.443+0000 7f31b27fc640 1 -- 172.21.15.121:0/434628017 <== osd.0 v2:172.21.15.121:6802/3702842813 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f31a806f9d0 con 0x7f31a806cf10 2024-08-18T22:38:16.457 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:16.456+0000 7f31c3f13640 1 -- 172.21.15.121:0/434628017 --> [v2:172.21.15.121:6802/3702842813,v1:172.21.15.121:6803/3702842813] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f31bc0f88a0 con 0x7f31a806cf10 2024-08-18T22:38:16.458 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:16.457+0000 7f31b27fc640 1 -- 172.21.15.121:0/434628017 <== osd.0 v2:172.21.15.121:6802/3702842813 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f31bc0f88a0 con 0x7f31a806cf10 2024-08-18T22:38:16.459 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:16.457+0000 7f31c3f13640 1 -- 172.21.15.121:0/434628017 >> [v2:172.21.15.121:6802/3702842813,v1:172.21.15.121:6803/3702842813] conn(0x7f31a806cf10 msgr2=0x7f31a806f320 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:38:16.459 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:16.457+0000 7f31c3f13640 1 --2- 172.21.15.121:0/434628017 >> [v2:172.21.15.121:6802/3702842813,v1:172.21.15.121:6803/3702842813] conn(0x7f31a806cf10 0x7f31a806f320 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:38:16.459 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:16.457+0000 7f31c3f13640 1 -- 172.21.15.121:0/434628017 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7f31a8067190 msgr2=0x7f31a8069640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:38:16.459 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:16.457+0000 7f31c3f13640 1 --2- 172.21.15.121:0/434628017 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7f31a8067190 0x7f31a8069640 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f31b8004ed0 tx=0x7f31b800b040 comp rx=0 tx=0).stop 2024-08-18T22:38:16.459 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:16.457+0000 7f31c3f13640 1 -- 172.21.15.121:0/434628017 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f31bc101cf0 msgr2=0x7f31bc10e5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:38:16.459 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:16.457+0000 7f31c3f13640 1 --2- 172.21.15.121:0/434628017 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f31bc101cf0 0x7f31bc10e5c0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f31ac000c00 tx=0x7f31ac009da0 comp rx=0 tx=0).stop 2024-08-18T22:38:16.459 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:16.457+0000 7f31c3f13640 1 -- 172.21.15.121:0/434628017 shutdown_connections 2024-08-18T22:38:16.459 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:16.457+0000 7f31c3f13640 1 --2- 172.21.15.121:0/434628017 >> [v2:172.21.15.121:6802/3702842813,v1:172.21.15.121:6803/3702842813] conn(0x7f31a806cf10 0x7f31a806f320 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:38:16.459 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:16.457+0000 7f31c3f13640 1 --2- 172.21.15.121:0/434628017 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7f31a8067190 0x7f31a8069640 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:38:16.460 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:16.457+0000 7f31c3f13640 1 --2- 172.21.15.121:0/434628017 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f31bc101cf0 0x7f31bc10e5c0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:38:16.460 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:16.457+0000 7f31c3f13640 1 --2- 172.21.15.121:0/434628017 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f31bc101350 0x7f31bc10e080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:38:16.460 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:16.457+0000 7f31c3f13640 1 -- 172.21.15.121:0/434628017 >> 172.21.15.121:0/434628017 conn(0x7f31bc0f6dd0 msgr2=0x7f31bc0f7ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:38:16.460 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:16.457+0000 7f31c3f13640 1 -- 172.21.15.121:0/434628017 shutdown_connections 2024-08-18T22:38:16.460 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:16.457+0000 7f31c3f13640 1 -- 172.21.15.121:0/434628017 wait complete. 2024-08-18T22:38:16.583 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:38:16 smithi121 ceph-mon[16788]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-08-18T22:38:16.659 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:38:16 smithi195 ceph-mon[23370]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-08-18T22:38:17.699 INFO:teuthology.orchestra.run.smithi121.stdout:38654705697 2024-08-18T22:38:17.699 DEBUG:teuthology.orchestra.run.smithi121:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid b003123a-5db1-11ef-bccf-c7b262605968 -- ceph osd last-stat-seq osd.0 2024-08-18T22:38:18.409 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:38:18 smithi195 ceph-mon[23370]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-08-18T22:38:18.583 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:38:18 smithi121 ceph-mon[16788]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-08-18T22:38:19.443 INFO:teuthology.orchestra.run.smithi121.stderr:Inferring config /var/lib/ceph/b003123a-5db1-11ef-bccf-c7b262605968/mon.smithi121/config 2024-08-18T22:38:19.620 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:19.617+0000 7fa133724640 1 -- 172.21.15.121:0/1796849584 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa12c0fb150 msgr2=0x7fa12c0fb520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:38:19.620 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:19.617+0000 7fa133724640 1 --2- 172.21.15.121:0/1796849584 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa12c0fb150 0x7fa12c0fb520 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fa1240048d0 tx=0x7fa124009da0 comp rx=0 tx=0).stop 2024-08-18T22:38:19.620 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:19.617+0000 7fa133724640 1 -- 172.21.15.121:0/1796849584 shutdown_connections 2024-08-18T22:38:19.620 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:19.617+0000 7fa133724640 1 --2- 172.21.15.121:0/1796849584 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa12c0fbaf0 0x7fa12c100110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:38:19.620 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:19.617+0000 7fa133724640 1 --2- 172.21.15.121:0/1796849584 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa12c0fb150 0x7fa12c0fb520 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:38:19.621 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:19.617+0000 7fa133724640 1 -- 172.21.15.121:0/1796849584 >> 172.21.15.121:0/1796849584 conn(0x7fa12c0f6e30 msgr2=0x7fa12c0f9240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:38:19.621 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:19.617+0000 7fa133724640 1 -- 172.21.15.121:0/1796849584 shutdown_connections 2024-08-18T22:38:19.621 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:19.617+0000 7fa133724640 1 -- 172.21.15.121:0/1796849584 wait complete. 2024-08-18T22:38:19.621 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:19.618+0000 7fa133724640 1 Processor -- start 2024-08-18T22:38:19.621 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:19.618+0000 7fa133724640 1 -- start start 2024-08-18T22:38:19.621 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:19.618+0000 7fa133724640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa12c0fb150 0x7fa12c119620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:38:19.621 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:19.618+0000 7fa133724640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa12c0fbaf0 0x7fa12c119b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:38:19.621 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:19.618+0000 7fa133724640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa12c11a1d0 con 0x7fa12c0fb150 2024-08-18T22:38:19.621 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:19.618+0000 7fa133724640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa12c1135c0 con 0x7fa12c0fbaf0 2024-08-18T22:38:19.621 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:19.618+0000 7fa1314c0640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa12c0fb150 0x7fa12c119620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:38:19.621 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:19.618+0000 7fa1314c0640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa12c0fb150 0x7fa12c119620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:49068/0 (socket says 172.21.15.121:49068) 2024-08-18T22:38:19.621 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:19.618+0000 7fa1314c0640 1 -- 172.21.15.121:0/3361014135 learned_addr learned my addr 172.21.15.121:0/3361014135 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-18T22:38:19.622 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:19.618+0000 7fa130cbf640 1 --2- 172.21.15.121:0/3361014135 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa12c0fbaf0 0x7fa12c119b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:38:19.622 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:19.618+0000 7fa1314c0640 1 -- 172.21.15.121:0/3361014135 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa12c0fbaf0 msgr2=0x7fa12c119b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:38:19.622 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:19.618+0000 7fa1314c0640 1 --2- 172.21.15.121:0/3361014135 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa12c0fbaf0 0x7fa12c119b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:38:19.622 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:19.618+0000 7fa1314c0640 1 -- 172.21.15.121:0/3361014135 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa124005040 con 0x7fa12c0fb150 2024-08-18T22:38:19.622 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:19.619+0000 7fa1314c0640 1 --2- 172.21.15.121:0/3361014135 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa12c0fb150 0x7fa12c119620 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fa124000c00 tx=0x7fa124009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:38:19.622 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:19.619+0000 7fa129ffb640 1 -- 172.21.15.121:0/3361014135 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa124038070 con 0x7fa12c0fb150 2024-08-18T22:38:19.622 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:19.619+0000 7fa129ffb640 1 -- 172.21.15.121:0/3361014135 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fa12402ade0 con 0x7fa12c0fb150 2024-08-18T22:38:19.622 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:19.619+0000 7fa133724640 1 -- 172.21.15.121:0/3361014135 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa12c113840 con 0x7fa12c0fb150 2024-08-18T22:38:19.622 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:19.619+0000 7fa129ffb640 1 -- 172.21.15.121:0/3361014135 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa12402c7e0 con 0x7fa12c0fb150 2024-08-18T22:38:19.622 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:19.619+0000 7fa133724640 1 -- 172.21.15.121:0/3361014135 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa12c113d00 con 0x7fa12c0fb150 2024-08-18T22:38:19.623 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:19.620+0000 7fa133724640 1 -- 172.21.15.121:0/3361014135 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fa12c1141f0 con 0x7fa12c0fb150 2024-08-18T22:38:19.624 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:19.620+0000 7fa129ffb640 1 -- 172.21.15.121:0/3361014135 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 19) v1 ==== 85127+0+0 (secure 0 0 0) 0x7fa124030020 con 0x7fa12c0fb150 2024-08-18T22:38:19.624 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:19.621+0000 7fa129ffb640 1 --2- 172.21.15.121:0/3361014135 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7fa114067190 0x7fa114069640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:38:19.624 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:19.621+0000 7fa129ffb640 1 -- 172.21.15.121:0/3361014135 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fa1240a43a0 con 0x7fa12c0fb150 2024-08-18T22:38:19.624 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:19.621+0000 7fa130cbf640 1 --2- 172.21.15.121:0/3361014135 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7fa114067190 0x7fa114069640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:38:19.624 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:19.621+0000 7fa129ffb640 1 --2- 172.21.15.121:0/3361014135 >> [v2:172.21.15.195:6800/1551491756,v1:172.21.15.195:6801/1551491756] conn(0x7fa11406cf10 0x7fa11406f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:38:19.624 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:19.621+0000 7fa129ffb640 1 -- 172.21.15.121:0/3361014135 --> [v2:172.21.15.195:6800/1551491756,v1:172.21.15.195:6801/1551491756] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa11406f9d0 con 0x7fa11406cf10 2024-08-18T22:38:19.624 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:19.621+0000 7fa129ffb640 1 -- 172.21.15.121:0/3361014135 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa1240a69f0 con 0x7fa12c0fb150 2024-08-18T22:38:19.624 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:19.621+0000 7fa131cc1640 1 --2- 172.21.15.121:0/3361014135 >> [v2:172.21.15.195:6800/1551491756,v1:172.21.15.195:6801/1551491756] conn(0x7fa11406cf10 0x7fa11406f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:38:19.624 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:19.621+0000 7fa130cbf640 1 --2- 172.21.15.121:0/3361014135 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7fa114067190 0x7fa114069640 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fa12c114ee0 tx=0x7fa12000b040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:38:19.624 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:19.622+0000 7fa131cc1640 1 --2- 172.21.15.121:0/3361014135 >> [v2:172.21.15.195:6800/1551491756,v1:172.21.15.195:6801/1551491756] conn(0x7fa11406cf10 0x7fa11406f320 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:38:19.624 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:19.622+0000 7fa129ffb640 1 -- 172.21.15.121:0/3361014135 <== osd.3 v2:172.21.15.195:6800/1551491756 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7fa11406f9d0 con 0x7fa11406cf10 2024-08-18T22:38:19.636 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:19.636+0000 7fa133724640 1 -- 172.21.15.121:0/3361014135 --> [v2:172.21.15.195:6800/1551491756,v1:172.21.15.195:6801/1551491756] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fa12c0660d0 con 0x7fa11406cf10 2024-08-18T22:38:19.637 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:19.636+0000 7fa129ffb640 1 -- 172.21.15.121:0/3361014135 <== osd.3 v2:172.21.15.195:6800/1551491756 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7fa12c0660d0 con 0x7fa11406cf10 2024-08-18T22:38:19.638 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:19.636+0000 7fa133724640 1 -- 172.21.15.121:0/3361014135 >> [v2:172.21.15.195:6800/1551491756,v1:172.21.15.195:6801/1551491756] conn(0x7fa11406cf10 msgr2=0x7fa11406f320 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:38:19.638 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:19.636+0000 7fa133724640 1 --2- 172.21.15.121:0/3361014135 >> [v2:172.21.15.195:6800/1551491756,v1:172.21.15.195:6801/1551491756] conn(0x7fa11406cf10 0x7fa11406f320 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:38:19.638 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:19.636+0000 7fa133724640 1 -- 172.21.15.121:0/3361014135 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7fa114067190 msgr2=0x7fa114069640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:38:19.638 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:19.636+0000 7fa133724640 1 --2- 172.21.15.121:0/3361014135 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7fa114067190 0x7fa114069640 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fa12c114ee0 tx=0x7fa12000b040 comp rx=0 tx=0).stop 2024-08-18T22:38:19.638 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:19.636+0000 7fa133724640 1 -- 172.21.15.121:0/3361014135 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa12c0fb150 msgr2=0x7fa12c119620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:38:19.638 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:19.636+0000 7fa133724640 1 --2- 172.21.15.121:0/3361014135 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa12c0fb150 0x7fa12c119620 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fa124000c00 tx=0x7fa124009da0 comp rx=0 tx=0).stop 2024-08-18T22:38:19.638 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:19.636+0000 7fa133724640 1 -- 172.21.15.121:0/3361014135 shutdown_connections 2024-08-18T22:38:19.639 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:19.636+0000 7fa133724640 1 --2- 172.21.15.121:0/3361014135 >> [v2:172.21.15.195:6800/1551491756,v1:172.21.15.195:6801/1551491756] conn(0x7fa11406cf10 0x7fa11406f320 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:38:19.639 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:19.636+0000 7fa133724640 1 --2- 172.21.15.121:0/3361014135 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7fa114067190 0x7fa114069640 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:38:19.639 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:19.636+0000 7fa133724640 1 --2- 172.21.15.121:0/3361014135 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa12c0fbaf0 0x7fa12c119b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:38:19.639 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:19.636+0000 7fa133724640 1 --2- 172.21.15.121:0/3361014135 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa12c0fb150 0x7fa12c119620 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:38:19.639 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:19.636+0000 7fa133724640 1 -- 172.21.15.121:0/3361014135 >> 172.21.15.121:0/3361014135 conn(0x7fa12c0f6e30 msgr2=0x7fa12c0f84b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:38:19.639 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:19.637+0000 7fa133724640 1 -- 172.21.15.121:0/3361014135 shutdown_connections 2024-08-18T22:38:19.639 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:19.637+0000 7fa133724640 1 -- 172.21.15.121:0/3361014135 wait complete. 2024-08-18T22:38:20.333 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:38:20 smithi121 ceph-mon[16788]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-08-18T22:38:20.597 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:38:20 smithi195 ceph-mon[23370]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-08-18T22:38:20.948 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:20.918+0000 7f96b061b640 1 -- 172.21.15.121:0/3048695487 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f96a80fbec0 msgr2=0x7f96a80fcdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:38:20.949 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:20.918+0000 7f96b061b640 1 --2- 172.21.15.121:0/3048695487 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f96a80fbec0 0x7f96a80fcdc0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f96980048d0 tx=0x7f9698009da0 comp rx=0 tx=0).stop 2024-08-18T22:38:20.949 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:20.918+0000 7f96b061b640 1 -- 172.21.15.121:0/3048695487 shutdown_connections 2024-08-18T22:38:20.949 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:20.918+0000 7f96b061b640 1 --2- 172.21.15.121:0/3048695487 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f96a80fbec0 0x7f96a80fcdc0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:38:20.949 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:20.918+0000 7f96b061b640 1 --2- 172.21.15.121:0/3048695487 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f96a80fb5b0 0x7f96a80fb980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:38:20.949 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:20.918+0000 7f96b061b640 1 -- 172.21.15.121:0/3048695487 >> 172.21.15.121:0/3048695487 conn(0x7f96a8072150 msgr2=0x7f96a8072550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:38:20.949 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:20.918+0000 7f96b061b640 1 -- 172.21.15.121:0/3048695487 shutdown_connections 2024-08-18T22:38:20.949 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:20.918+0000 7f96b061b640 1 -- 172.21.15.121:0/3048695487 wait complete. 2024-08-18T22:38:20.949 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:20.919+0000 7f96b061b640 1 Processor -- start 2024-08-18T22:38:20.949 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:20.919+0000 7f96b061b640 1 -- start start 2024-08-18T22:38:20.949 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:20.919+0000 7f96b061b640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f96a80fb5b0 0x7f96a8111e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:38:20.949 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:20.919+0000 7f96b061b640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f96a80fbec0 0x7f96a8112370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:38:20.950 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:20.919+0000 7f96b061b640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96a8112970 con 0x7f96a80fb5b0 2024-08-18T22:38:20.950 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:20.919+0000 7f96b061b640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96a810bdb0 con 0x7f96a80fbec0 2024-08-18T22:38:20.950 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:20.919+0000 7f96ae3b7640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f96a80fb5b0 0x7f96a8111e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:38:20.950 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:20.920+0000 7f96ae3b7640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f96a80fb5b0 0x7f96a8111e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:49096/0 (socket says 172.21.15.121:49096) 2024-08-18T22:38:20.950 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:20.920+0000 7f96ae3b7640 1 -- 172.21.15.121:0/944767139 learned_addr learned my addr 172.21.15.121:0/944767139 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-18T22:38:20.950 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:20.920+0000 7f96adbb6640 1 --2- 172.21.15.121:0/944767139 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f96a80fbec0 0x7f96a8112370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:38:20.951 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:20.920+0000 7f96ae3b7640 1 -- 172.21.15.121:0/944767139 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f96a80fbec0 msgr2=0x7f96a8112370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:38:20.951 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:20.920+0000 7f96ae3b7640 1 --2- 172.21.15.121:0/944767139 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f96a80fbec0 0x7f96a8112370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:38:20.951 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:20.920+0000 7f96ae3b7640 1 -- 172.21.15.121:0/944767139 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9698005040 con 0x7f96a80fb5b0 2024-08-18T22:38:20.951 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:20.920+0000 7f96ae3b7640 1 --2- 172.21.15.121:0/944767139 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f96a80fb5b0 0x7f96a8111e30 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f96a4002a50 tx=0x7f96a4004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:38:20.951 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:20.920+0000 7f969effd640 1 -- 172.21.15.121:0/944767139 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f96a4007c30 con 0x7f96a80fb5b0 2024-08-18T22:38:20.951 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:20.920+0000 7f969effd640 1 -- 172.21.15.121:0/944767139 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f96a400f040 con 0x7f96a80fb5b0 2024-08-18T22:38:20.951 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:20.920+0000 7f96b061b640 1 -- 172.21.15.121:0/944767139 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96a810c090 con 0x7f96a80fb5b0 2024-08-18T22:38:20.951 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:20.920+0000 7f969effd640 1 -- 172.21.15.121:0/944767139 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f96a400dad0 con 0x7f96a80fb5b0 2024-08-18T22:38:20.951 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:20.920+0000 7f96b061b640 1 -- 172.21.15.121:0/944767139 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96a810c600 con 0x7f96a80fb5b0 2024-08-18T22:38:20.951 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:20.921+0000 7f96b061b640 1 -- 172.21.15.121:0/944767139 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f96a810cab0 con 0x7f96a80fb5b0 2024-08-18T22:38:20.951 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:20.921+0000 7f969effd640 1 -- 172.21.15.121:0/944767139 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 19) v1 ==== 85127+0+0 (secure 0 0 0) 0x7f96a400dc30 con 0x7f96a80fb5b0 2024-08-18T22:38:20.951 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:20.922+0000 7f969effd640 1 --2- 172.21.15.121:0/944767139 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7f9694067190 0x7f9694069640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:38:20.951 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:20.922+0000 7f96adbb6640 1 --2- 172.21.15.121:0/944767139 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7f9694067190 0x7f9694069640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:38:20.952 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:20.922+0000 7f969effd640 1 -- 172.21.15.121:0/944767139 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f96a40846e0 con 0x7f96a80fb5b0 2024-08-18T22:38:20.952 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:20.922+0000 7f969effd640 1 --2- 172.21.15.121:0/944767139 >> [v2:172.21.15.195:6808/587500564,v1:172.21.15.195:6809/587500564] conn(0x7f969406cf10 0x7f969406f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:38:20.952 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:20.922+0000 7f969effd640 1 -- 172.21.15.121:0/944767139 --> [v2:172.21.15.195:6808/587500564,v1:172.21.15.195:6809/587500564] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f969406f9d0 con 0x7f969406cf10 2024-08-18T22:38:20.952 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:20.922+0000 7f969effd640 1 -- 172.21.15.121:0/944767139 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7f96a4086cd0 con 0x7f96a80fb5b0 2024-08-18T22:38:20.952 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:20.922+0000 7f96adbb6640 1 --2- 172.21.15.121:0/944767139 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7f9694067190 0x7f9694069640 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f9698009ac0 tx=0x7f9698035040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:38:20.952 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:20.923+0000 7f96aebb8640 1 --2- 172.21.15.121:0/944767139 >> [v2:172.21.15.195:6808/587500564,v1:172.21.15.195:6809/587500564] conn(0x7f969406cf10 0x7f969406f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:38:20.952 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:20.923+0000 7f96aebb8640 1 --2- 172.21.15.121:0/944767139 >> [v2:172.21.15.195:6808/587500564,v1:172.21.15.195:6809/587500564] conn(0x7f969406cf10 0x7f969406f320 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:38:20.952 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:20.924+0000 7f969effd640 1 -- 172.21.15.121:0/944767139 <== osd.4 v2:172.21.15.195:6808/587500564 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f969406f9d0 con 0x7f969406cf10 2024-08-18T22:38:20.952 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:20.936+0000 7f96b061b640 1 -- 172.21.15.121:0/944767139 --> [v2:172.21.15.195:6808/587500564,v1:172.21.15.195:6809/587500564] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f96a810cc20 con 0x7f969406cf10 2024-08-18T22:38:20.952 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:20.936+0000 7f969effd640 1 -- 172.21.15.121:0/944767139 <== osd.4 v2:172.21.15.195:6808/587500564 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f96a810cc20 con 0x7f969406cf10 2024-08-18T22:38:20.952 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:20.936+0000 7f96b061b640 1 -- 172.21.15.121:0/944767139 >> [v2:172.21.15.195:6808/587500564,v1:172.21.15.195:6809/587500564] conn(0x7f969406cf10 msgr2=0x7f969406f320 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:38:20.952 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:20.936+0000 7f96b061b640 1 --2- 172.21.15.121:0/944767139 >> [v2:172.21.15.195:6808/587500564,v1:172.21.15.195:6809/587500564] conn(0x7f969406cf10 0x7f969406f320 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:38:20.952 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:20.936+0000 7f96b061b640 1 -- 172.21.15.121:0/944767139 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7f9694067190 msgr2=0x7f9694069640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:38:20.953 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:20.936+0000 7f96b061b640 1 --2- 172.21.15.121:0/944767139 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7f9694067190 0x7f9694069640 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f9698009ac0 tx=0x7f9698035040 comp rx=0 tx=0).stop 2024-08-18T22:38:20.953 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:20.936+0000 7f96b061b640 1 -- 172.21.15.121:0/944767139 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f96a80fb5b0 msgr2=0x7f96a8111e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:38:20.953 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:20.936+0000 7f96b061b640 1 --2- 172.21.15.121:0/944767139 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f96a80fb5b0 0x7f96a8111e30 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f96a4002a50 tx=0x7f96a4004600 comp rx=0 tx=0).stop 2024-08-18T22:38:20.953 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:20.936+0000 7f96b061b640 1 -- 172.21.15.121:0/944767139 shutdown_connections 2024-08-18T22:38:20.953 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:20.936+0000 7f96b061b640 1 --2- 172.21.15.121:0/944767139 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7f9694067190 0x7f9694069640 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:38:20.953 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:20.936+0000 7f96b061b640 1 --2- 172.21.15.121:0/944767139 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f96a80fbec0 0x7f96a8112370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:38:20.953 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:20.936+0000 7f96b061b640 1 --2- 172.21.15.121:0/944767139 >> [v2:172.21.15.195:6808/587500564,v1:172.21.15.195:6809/587500564] conn(0x7f969406cf10 0x7f969406f320 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:38:20.953 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:20.936+0000 7f96b061b640 1 --2- 172.21.15.121:0/944767139 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f96a80fb5b0 0x7f96a8111e30 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:38:20.953 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:20.936+0000 7f96b061b640 1 -- 172.21.15.121:0/944767139 >> 172.21.15.121:0/944767139 conn(0x7f96a8072150 msgr2=0x7f96a80ffee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:38:20.953 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:20.936+0000 7f96b061b640 1 -- 172.21.15.121:0/944767139 shutdown_connections 2024-08-18T22:38:20.953 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:20.936+0000 7f96b061b640 1 -- 172.21.15.121:0/944767139 wait complete. 2024-08-18T22:38:21.155 INFO:teuthology.orchestra.run.smithi121.stderr:Inferring config /var/lib/ceph/b003123a-5db1-11ef-bccf-c7b262605968/mon.smithi121/config 2024-08-18T22:38:21.585 INFO:teuthology.orchestra.run.smithi121.stdout:150323855373 2024-08-18T22:38:21.586 DEBUG:teuthology.orchestra.run.smithi121:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid b003123a-5db1-11ef-bccf-c7b262605968 -- ceph osd last-stat-seq osd.4 2024-08-18T22:38:21.750 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:21.748+0000 7fb2bbcc2640 1 -- 172.21.15.121:0/3345012963 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb2b40fbec0 msgr2=0x7fb2b40fcdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:38:21.750 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:21.748+0000 7fb2bbcc2640 1 --2- 172.21.15.121:0/3345012963 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb2b40fbec0 0x7fb2b40fcdc0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fb2a40048d0 tx=0x7fb2a4009da0 comp rx=0 tx=0).stop 2024-08-18T22:38:21.750 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:21.748+0000 7fb2bbcc2640 1 -- 172.21.15.121:0/3345012963 shutdown_connections 2024-08-18T22:38:21.750 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:21.748+0000 7fb2bbcc2640 1 --2- 172.21.15.121:0/3345012963 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb2b40fbec0 0x7fb2b40fcdc0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:38:21.751 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:21.748+0000 7fb2bbcc2640 1 --2- 172.21.15.121:0/3345012963 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb2b40fb5b0 0x7fb2b40fb980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:38:21.751 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:21.748+0000 7fb2bbcc2640 1 -- 172.21.15.121:0/3345012963 >> 172.21.15.121:0/3345012963 conn(0x7fb2b4072150 msgr2=0x7fb2b4072550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:38:21.751 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:21.748+0000 7fb2bbcc2640 1 -- 172.21.15.121:0/3345012963 shutdown_connections 2024-08-18T22:38:21.751 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:21.748+0000 7fb2bbcc2640 1 -- 172.21.15.121:0/3345012963 wait complete. 2024-08-18T22:38:21.751 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:21.749+0000 7fb2bbcc2640 1 Processor -- start 2024-08-18T22:38:21.751 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:21.749+0000 7fb2bbcc2640 1 -- start start 2024-08-18T22:38:21.751 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:21.749+0000 7fb2bbcc2640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb2b40fb5b0 0x7fb2b410def0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:38:21.751 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:21.749+0000 7fb2bbcc2640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb2b40fbec0 0x7fb2b410e430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:38:21.751 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:21.749+0000 7fb2bbcc2640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2b410ea30 con 0x7fb2b40fbec0 2024-08-18T22:38:21.751 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:21.749+0000 7fb2bbcc2640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2b410eba0 con 0x7fb2b40fb5b0 2024-08-18T22:38:21.751 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:21.749+0000 7fb2b925d640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb2b40fbec0 0x7fb2b410e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:38:21.751 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:21.749+0000 7fb2b925d640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb2b40fbec0 0x7fb2b410e430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:49118/0 (socket says 172.21.15.121:49118) 2024-08-18T22:38:21.751 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:21.749+0000 7fb2b925d640 1 -- 172.21.15.121:0/3359722299 learned_addr learned my addr 172.21.15.121:0/3359722299 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-18T22:38:21.752 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:21.749+0000 7fb2b9a5e640 1 --2- 172.21.15.121:0/3359722299 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb2b40fb5b0 0x7fb2b410def0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:38:21.752 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:21.749+0000 7fb2b925d640 1 -- 172.21.15.121:0/3359722299 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb2b40fb5b0 msgr2=0x7fb2b410def0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:38:21.752 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:21.749+0000 7fb2b925d640 1 --2- 172.21.15.121:0/3359722299 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb2b40fb5b0 0x7fb2b410def0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:38:21.752 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:21.749+0000 7fb2b925d640 1 -- 172.21.15.121:0/3359722299 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2a4005040 con 0x7fb2b40fbec0 2024-08-18T22:38:21.752 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:21.749+0000 7fb2b925d640 1 --2- 172.21.15.121:0/3359722299 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb2b40fbec0 0x7fb2b410e430 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fb2a4000c00 tx=0x7fb2a4009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:38:21.753 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:21.750+0000 7fb2aa7fc640 1 -- 172.21.15.121:0/3359722299 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb2a4038070 con 0x7fb2b40fbec0 2024-08-18T22:38:21.753 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:21.750+0000 7fb2aa7fc640 1 -- 172.21.15.121:0/3359722299 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fb2a402ade0 con 0x7fb2b40fbec0 2024-08-18T22:38:21.753 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:21.750+0000 7fb2bbcc2640 1 -- 172.21.15.121:0/3359722299 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2b4116f60 con 0x7fb2b40fbec0 2024-08-18T22:38:21.753 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:21.750+0000 7fb2aa7fc640 1 -- 172.21.15.121:0/3359722299 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb2a402c7e0 con 0x7fb2b40fbec0 2024-08-18T22:38:21.753 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:21.750+0000 7fb2bbcc2640 1 -- 172.21.15.121:0/3359722299 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2b41173c0 con 0x7fb2b40fbec0 2024-08-18T22:38:21.753 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:21.751+0000 7fb2bbcc2640 1 -- 172.21.15.121:0/3359722299 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fb2b41008b0 con 0x7fb2b40fbec0 2024-08-18T22:38:21.754 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:21.751+0000 7fb2aa7fc640 1 -- 172.21.15.121:0/3359722299 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 19) v1 ==== 85127+0+0 (secure 0 0 0) 0x7fb2a4030020 con 0x7fb2b40fbec0 2024-08-18T22:38:21.754 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:21.752+0000 7fb2aa7fc640 1 --2- 172.21.15.121:0/3359722299 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7fb2a0067190 0x7fb2a0069640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:38:21.754 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:21.752+0000 7fb2b9a5e640 1 --2- 172.21.15.121:0/3359722299 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7fb2a0067190 0x7fb2a0069640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:38:21.754 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:21.752+0000 7fb2aa7fc640 1 -- 172.21.15.121:0/3359722299 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fb2a40a4990 con 0x7fb2b40fbec0 2024-08-18T22:38:21.754 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:21.752+0000 7fb2aa7fc640 1 --2- 172.21.15.121:0/3359722299 >> [v2:172.21.15.121:6810/1711466097,v1:172.21.15.121:6811/1711466097] conn(0x7fb2a006cf10 0x7fb2a006f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:38:21.754 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:21.752+0000 7fb2aa7fc640 1 -- 172.21.15.121:0/3359722299 --> [v2:172.21.15.121:6810/1711466097,v1:172.21.15.121:6811/1711466097] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb2a006f9d0 con 0x7fb2a006cf10 2024-08-18T22:38:21.754 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:21.752+0000 7fb2aa7fc640 1 -- 172.21.15.121:0/3359722299 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb2a40a4cd0 con 0x7fb2b40fbec0 2024-08-18T22:38:21.754 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:21.752+0000 7fb2ba25f640 1 --2- 172.21.15.121:0/3359722299 >> [v2:172.21.15.121:6810/1711466097,v1:172.21.15.121:6811/1711466097] conn(0x7fb2a006cf10 0x7fb2a006f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:38:21.755 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:21.753+0000 7fb2b9a5e640 1 --2- 172.21.15.121:0/3359722299 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7fb2a0067190 0x7fb2a0069640 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fb2b0004ed0 tx=0x7fb2b000b040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:38:21.755 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:21.753+0000 7fb2ba25f640 1 --2- 172.21.15.121:0/3359722299 >> [v2:172.21.15.121:6810/1711466097,v1:172.21.15.121:6811/1711466097] conn(0x7fb2a006cf10 0x7fb2a006f320 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:38:21.755 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:21.753+0000 7fb2aa7fc640 1 -- 172.21.15.121:0/3359722299 <== osd.1 v2:172.21.15.121:6810/1711466097 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7fb2a006f9d0 con 0x7fb2a006cf10 2024-08-18T22:38:21.767 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:21.766+0000 7fb2bbcc2640 1 -- 172.21.15.121:0/3359722299 --> [v2:172.21.15.121:6810/1711466097,v1:172.21.15.121:6811/1711466097] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fb2b40fc960 con 0x7fb2a006cf10 2024-08-18T22:38:21.767 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:21.766+0000 7fb2aa7fc640 1 -- 172.21.15.121:0/3359722299 <== osd.1 v2:172.21.15.121:6810/1711466097 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fb2b40fc960 con 0x7fb2a006cf10 2024-08-18T22:38:21.768 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:21.767+0000 7fb2bbcc2640 1 -- 172.21.15.121:0/3359722299 >> [v2:172.21.15.121:6810/1711466097,v1:172.21.15.121:6811/1711466097] conn(0x7fb2a006cf10 msgr2=0x7fb2a006f320 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:38:21.768 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:21.767+0000 7fb2bbcc2640 1 --2- 172.21.15.121:0/3359722299 >> [v2:172.21.15.121:6810/1711466097,v1:172.21.15.121:6811/1711466097] conn(0x7fb2a006cf10 0x7fb2a006f320 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:38:21.768 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:21.767+0000 7fb2bbcc2640 1 -- 172.21.15.121:0/3359722299 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7fb2a0067190 msgr2=0x7fb2a0069640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:38:21.768 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:21.767+0000 7fb2bbcc2640 1 --2- 172.21.15.121:0/3359722299 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7fb2a0067190 0x7fb2a0069640 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fb2b0004ed0 tx=0x7fb2b000b040 comp rx=0 tx=0).stop 2024-08-18T22:38:21.768 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:21.767+0000 7fb2bbcc2640 1 -- 172.21.15.121:0/3359722299 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb2b40fbec0 msgr2=0x7fb2b410e430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:38:21.768 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:21.767+0000 7fb2bbcc2640 1 --2- 172.21.15.121:0/3359722299 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb2b40fbec0 0x7fb2b410e430 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fb2a4000c00 tx=0x7fb2a4009da0 comp rx=0 tx=0).stop 2024-08-18T22:38:21.769 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:21.767+0000 7fb2bbcc2640 1 -- 172.21.15.121:0/3359722299 shutdown_connections 2024-08-18T22:38:21.769 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:21.767+0000 7fb2bbcc2640 1 --2- 172.21.15.121:0/3359722299 >> [v2:172.21.15.121:6810/1711466097,v1:172.21.15.121:6811/1711466097] conn(0x7fb2a006cf10 0x7fb2a006f320 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:38:21.769 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:21.767+0000 7fb2bbcc2640 1 --2- 172.21.15.121:0/3359722299 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7fb2a0067190 0x7fb2a0069640 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:38:21.769 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:21.767+0000 7fb2bbcc2640 1 --2- 172.21.15.121:0/3359722299 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb2b40fbec0 0x7fb2b410e430 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:38:21.769 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:21.767+0000 7fb2bbcc2640 1 --2- 172.21.15.121:0/3359722299 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb2b40fb5b0 0x7fb2b410def0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:38:21.769 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:21.767+0000 7fb2bbcc2640 1 -- 172.21.15.121:0/3359722299 >> 172.21.15.121:0/3359722299 conn(0x7fb2b4072150 msgr2=0x7fb2b40ffee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:38:21.769 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:21.767+0000 7fb2bbcc2640 1 -- 172.21.15.121:0/3359722299 shutdown_connections 2024-08-18T22:38:21.769 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:21.767+0000 7fb2bbcc2640 1 -- 172.21.15.121:0/3359722299 wait complete. 2024-08-18T22:38:22.408 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:38:22 smithi121 ceph-mon[16788]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-08-18T22:38:22.659 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:38:22 smithi195 ceph-mon[23370]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-08-18T22:38:22.776 INFO:teuthology.orchestra.run.smithi121.stdout:115964117011 2024-08-18T22:38:22.776 DEBUG:teuthology.orchestra.run.smithi121:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid b003123a-5db1-11ef-bccf-c7b262605968 -- ceph osd last-stat-seq osd.3 2024-08-18T22:38:23.223 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:23.182+0000 7f43b0c52640 1 -- 172.21.15.121:0/198946597 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f43ac06f7d0 msgr2=0x7f43ac06fba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:38:23.223 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:23.182+0000 7f43b0c52640 1 --2- 172.21.15.121:0/198946597 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f43ac06f7d0 0x7f43ac06fba0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f439c0048d0 tx=0x7f439c009da0 comp rx=0 tx=0).stop 2024-08-18T22:38:23.223 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:23.183+0000 7f43b0c52640 1 -- 172.21.15.121:0/198946597 shutdown_connections 2024-08-18T22:38:23.223 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:23.183+0000 7f43b0c52640 1 --2- 172.21.15.121:0/198946597 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f43ac0700e0 0x7f43ac108690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:38:23.223 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:23.183+0000 7f43b0c52640 1 --2- 172.21.15.121:0/198946597 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f43ac06f7d0 0x7f43ac06fba0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:38:23.224 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:23.183+0000 7f43b0c52640 1 -- 172.21.15.121:0/198946597 >> 172.21.15.121:0/198946597 conn(0x7f43ac0f7e90 msgr2=0x7f43ac0fa2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:38:23.224 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:23.183+0000 7f43b0c52640 1 -- 172.21.15.121:0/198946597 shutdown_connections 2024-08-18T22:38:23.224 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:23.183+0000 7f43b0c52640 1 -- 172.21.15.121:0/198946597 wait complete. 2024-08-18T22:38:23.224 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:23.183+0000 7f43b0c52640 1 Processor -- start 2024-08-18T22:38:23.224 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:23.183+0000 7f43b0c52640 1 -- start start 2024-08-18T22:38:23.224 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:23.183+0000 7f43b0c52640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f43ac06f7d0 0x7f43ac115220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:38:23.224 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:23.183+0000 7f43b0c52640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f43ac0700e0 0x7f43ac115760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:38:23.225 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:23.183+0000 7f43b0c52640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43ac115df0 con 0x7f43ac0700e0 2024-08-18T22:38:23.225 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:23.183+0000 7f43b0c52640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43ac10f1a0 con 0x7f43ac06f7d0 2024-08-18T22:38:23.225 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:23.184+0000 7f43a1d9b640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f43ac0700e0 0x7f43ac115760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:38:23.225 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:23.184+0000 7f43a1d9b640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f43ac0700e0 0x7f43ac115760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:49148/0 (socket says 172.21.15.121:49148) 2024-08-18T22:38:23.225 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:23.184+0000 7f43a1d9b640 1 -- 172.21.15.121:0/1509511883 learned_addr learned my addr 172.21.15.121:0/1509511883 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-18T22:38:23.225 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:23.184+0000 7f43aa59c640 1 --2- 172.21.15.121:0/1509511883 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f43ac06f7d0 0x7f43ac115220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:38:23.226 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:23.184+0000 7f43a1d9b640 1 -- 172.21.15.121:0/1509511883 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f43ac06f7d0 msgr2=0x7f43ac115220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:38:23.226 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:23.184+0000 7f43a1d9b640 1 --2- 172.21.15.121:0/1509511883 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f43ac06f7d0 0x7f43ac115220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:38:23.226 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:23.184+0000 7f43a1d9b640 1 -- 172.21.15.121:0/1509511883 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f439c005040 con 0x7f43ac0700e0 2024-08-18T22:38:23.226 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:23.184+0000 7f43a1d9b640 1 --2- 172.21.15.121:0/1509511883 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f43ac0700e0 0x7f43ac115760 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f439400b790 tx=0x7f43940091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:38:23.226 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:23.184+0000 7f43a37fe640 1 -- 172.21.15.121:0/1509511883 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f439400c700 con 0x7f43ac0700e0 2024-08-18T22:38:23.226 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:23.184+0000 7f43b0c52640 1 -- 172.21.15.121:0/1509511883 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43ac10f480 con 0x7f43ac0700e0 2024-08-18T22:38:23.226 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:23.184+0000 7f43a37fe640 1 -- 172.21.15.121:0/1509511883 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f439400cd00 con 0x7f43ac0700e0 2024-08-18T22:38:23.226 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:23.184+0000 7f43a37fe640 1 -- 172.21.15.121:0/1509511883 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4394015e70 con 0x7f43ac0700e0 2024-08-18T22:38:23.227 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:23.184+0000 7f43b0c52640 1 -- 172.21.15.121:0/1509511883 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43ac10f9a0 con 0x7f43ac0700e0 2024-08-18T22:38:23.227 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:23.185+0000 7f43b0c52640 1 -- 172.21.15.121:0/1509511883 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f43ac10fee0 con 0x7f43ac0700e0 2024-08-18T22:38:23.227 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:23.186+0000 7f43a37fe640 1 -- 172.21.15.121:0/1509511883 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 19) v1 ==== 85127+0+0 (secure 0 0 0) 0x7f4394012070 con 0x7f43ac0700e0 2024-08-18T22:38:23.227 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:23.186+0000 7f43a37fe640 1 --2- 172.21.15.121:0/1509511883 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7f4398067190 0x7f4398069640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:38:23.227 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:23.186+0000 7f43a37fe640 1 -- 172.21.15.121:0/1509511883 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f43940849f0 con 0x7f43ac0700e0 2024-08-18T22:38:23.227 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:23.186+0000 7f43aa59c640 1 --2- 172.21.15.121:0/1509511883 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7f4398067190 0x7f4398069640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:38:23.227 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:23.186+0000 7f43a37fe640 1 --2- 172.21.15.121:0/1509511883 >> [v2:172.21.15.195:6816/2603984040,v1:172.21.15.195:6817/2603984040] conn(0x7f439806cf10 0x7f439806f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:38:23.227 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:23.186+0000 7f43a37fe640 1 -- 172.21.15.121:0/1509511883 --> [v2:172.21.15.195:6816/2603984040,v1:172.21.15.195:6817/2603984040] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f439806f9d0 con 0x7f439806cf10 2024-08-18T22:38:23.227 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:23.186+0000 7f43a37fe640 1 -- 172.21.15.121:0/1509511883 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4394084dd0 con 0x7f43ac0700e0 2024-08-18T22:38:23.227 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:23.187+0000 7f43aad9d640 1 --2- 172.21.15.121:0/1509511883 >> [v2:172.21.15.195:6816/2603984040,v1:172.21.15.195:6817/2603984040] conn(0x7f439806cf10 0x7f439806f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:38:23.227 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:23.187+0000 7f43aa59c640 1 --2- 172.21.15.121:0/1509511883 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7f4398067190 0x7f4398069640 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f439c0043d0 tx=0x7f439c009da0 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:38:23.228 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:23.187+0000 7f43aad9d640 1 --2- 172.21.15.121:0/1509511883 >> [v2:172.21.15.195:6816/2603984040,v1:172.21.15.195:6817/2603984040] conn(0x7f439806cf10 0x7f439806f320 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:38:23.228 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:23.188+0000 7f43a37fe640 1 -- 172.21.15.121:0/1509511883 <== osd.5 v2:172.21.15.195:6816/2603984040 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f439806f9d0 con 0x7f439806cf10 2024-08-18T22:38:23.228 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:23.200+0000 7f43b0c52640 1 -- 172.21.15.121:0/1509511883 --> [v2:172.21.15.195:6816/2603984040,v1:172.21.15.195:6817/2603984040] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f43ac0f9db0 con 0x7f439806cf10 2024-08-18T22:38:23.228 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:23.200+0000 7f43a37fe640 1 -- 172.21.15.121:0/1509511883 <== osd.5 v2:172.21.15.195:6816/2603984040 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f43ac0f9db0 con 0x7f439806cf10 2024-08-18T22:38:23.228 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:23.201+0000 7f43b0c52640 1 -- 172.21.15.121:0/1509511883 >> [v2:172.21.15.195:6816/2603984040,v1:172.21.15.195:6817/2603984040] conn(0x7f439806cf10 msgr2=0x7f439806f320 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:38:23.228 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:23.201+0000 7f43b0c52640 1 --2- 172.21.15.121:0/1509511883 >> [v2:172.21.15.195:6816/2603984040,v1:172.21.15.195:6817/2603984040] conn(0x7f439806cf10 0x7f439806f320 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:38:23.228 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:23.201+0000 7f43b0c52640 1 -- 172.21.15.121:0/1509511883 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7f4398067190 msgr2=0x7f4398069640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:38:23.229 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:23.201+0000 7f43b0c52640 1 --2- 172.21.15.121:0/1509511883 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7f4398067190 0x7f4398069640 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f439c0043d0 tx=0x7f439c009da0 comp rx=0 tx=0).stop 2024-08-18T22:38:23.229 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:23.201+0000 7f43b0c52640 1 -- 172.21.15.121:0/1509511883 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f43ac0700e0 msgr2=0x7f43ac115760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:38:23.229 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:23.201+0000 7f43b0c52640 1 --2- 172.21.15.121:0/1509511883 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f43ac0700e0 0x7f43ac115760 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f439400b790 tx=0x7f43940091d0 comp rx=0 tx=0).stop 2024-08-18T22:38:23.229 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:23.201+0000 7f43b0c52640 1 -- 172.21.15.121:0/1509511883 shutdown_connections 2024-08-18T22:38:23.229 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:23.201+0000 7f43b0c52640 1 --2- 172.21.15.121:0/1509511883 >> [v2:172.21.15.195:6816/2603984040,v1:172.21.15.195:6817/2603984040] conn(0x7f439806cf10 0x7f439806f320 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:38:23.229 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:23.201+0000 7f43b0c52640 1 --2- 172.21.15.121:0/1509511883 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7f4398067190 0x7f4398069640 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:38:23.229 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:23.201+0000 7f43b0c52640 1 --2- 172.21.15.121:0/1509511883 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f43ac0700e0 0x7f43ac115760 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:38:23.229 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:23.201+0000 7f43b0c52640 1 --2- 172.21.15.121:0/1509511883 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f43ac06f7d0 0x7f43ac115220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:38:23.229 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:23.201+0000 7f43b0c52640 1 -- 172.21.15.121:0/1509511883 >> 172.21.15.121:0/1509511883 conn(0x7f43ac0f7e90 msgr2=0x7f43ac0f93e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:38:23.229 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:23.201+0000 7f43b0c52640 1 -- 172.21.15.121:0/1509511883 shutdown_connections 2024-08-18T22:38:23.229 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:23.201+0000 7f43b0c52640 1 -- 172.21.15.121:0/1509511883 wait complete. 2024-08-18T22:38:24.503 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:38:24 smithi121 ceph-mon[16788]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-08-18T22:38:24.503 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:38:24 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-18T22:38:24.504 INFO:teuthology.orchestra.run.smithi121.stdout:60129542173 2024-08-18T22:38:24.505 DEBUG:teuthology.orchestra.run.smithi121:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid b003123a-5db1-11ef-bccf-c7b262605968 -- ceph osd last-stat-seq osd.1 2024-08-18T22:38:24.659 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:38:24 smithi195 ceph-mon[23370]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-08-18T22:38:24.659 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:38:24 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-18T22:38:25.660 INFO:teuthology.orchestra.run.smithi121.stderr:Inferring config /var/lib/ceph/b003123a-5db1-11ef-bccf-c7b262605968/mon.smithi121/config 2024-08-18T22:38:25.672 INFO:teuthology.orchestra.run.smithi121.stderr:Inferring config /var/lib/ceph/b003123a-5db1-11ef-bccf-c7b262605968/mon.smithi121/config 2024-08-18T22:38:25.675 INFO:teuthology.orchestra.run.smithi121.stdout:171798691850 2024-08-18T22:38:25.675 DEBUG:teuthology.orchestra.run.smithi121:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid b003123a-5db1-11ef-bccf-c7b262605968 -- ceph osd last-stat-seq osd.5 2024-08-18T22:38:26.357 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:26.354+0000 7fb994fa3640 1 -- 172.21.15.121:0/14468181 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb9900fb5b0 msgr2=0x7fb9900fb980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:38:26.357 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:26.354+0000 7fb994fa3640 1 --2- 172.21.15.121:0/14468181 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb9900fb5b0 0x7fb9900fb980 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fb9800048d0 tx=0x7fb980009da0 comp rx=0 tx=0).stop 2024-08-18T22:38:26.357 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:26.354+0000 7fb994fa3640 1 -- 172.21.15.121:0/14468181 shutdown_connections 2024-08-18T22:38:26.358 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:26.354+0000 7fb994fa3640 1 --2- 172.21.15.121:0/14468181 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb9900fbec0 0x7fb9900fcdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:38:26.358 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:26.354+0000 7fb994fa3640 1 --2- 172.21.15.121:0/14468181 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb9900fb5b0 0x7fb9900fb980 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:38:26.358 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:26.354+0000 7fb994fa3640 1 -- 172.21.15.121:0/14468181 >> 172.21.15.121:0/14468181 conn(0x7fb990072150 msgr2=0x7fb990072550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:38:26.358 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:26.354+0000 7fb994fa3640 1 -- 172.21.15.121:0/14468181 shutdown_connections 2024-08-18T22:38:26.358 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:26.354+0000 7fb994fa3640 1 -- 172.21.15.121:0/14468181 wait complete. 2024-08-18T22:38:26.358 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:26.355+0000 7fb994fa3640 1 Processor -- start 2024-08-18T22:38:26.358 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:26.355+0000 7fb994fa3640 1 -- start start 2024-08-18T22:38:26.358 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:26.355+0000 7fb994fa3640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb9900fb5b0 0x7fb990112fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:38:26.358 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:26.355+0000 7fb994fa3640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb9900fbec0 0x7fb9901134f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:38:26.358 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:26.355+0000 7fb994fa3640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb990113af0 con 0x7fb9900fbec0 2024-08-18T22:38:26.358 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:26.355+0000 7fb994fa3640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb99010cf30 con 0x7fb9900fb5b0 2024-08-18T22:38:26.358 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:26.355+0000 7fb987fff640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb9900fbec0 0x7fb9901134f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:38:26.359 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:26.355+0000 7fb987fff640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb9900fbec0 0x7fb9901134f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:49156/0 (socket says 172.21.15.121:49156) 2024-08-18T22:38:26.359 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:26.355+0000 7fb987fff640 1 -- 172.21.15.121:0/1596035350 learned_addr learned my addr 172.21.15.121:0/1596035350 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-18T22:38:26.359 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:26.355+0000 7fb98e59c640 1 --2- 172.21.15.121:0/1596035350 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb9900fb5b0 0x7fb990112fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:38:26.359 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:26.356+0000 7fb987fff640 1 -- 172.21.15.121:0/1596035350 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb9900fb5b0 msgr2=0x7fb990112fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:38:26.359 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:26.356+0000 7fb987fff640 1 --2- 172.21.15.121:0/1596035350 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb9900fb5b0 0x7fb990112fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:38:26.359 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:26.356+0000 7fb987fff640 1 -- 172.21.15.121:0/1596035350 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb980005040 con 0x7fb9900fbec0 2024-08-18T22:38:26.359 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:26.356+0000 7fb987fff640 1 --2- 172.21.15.121:0/1596035350 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb9900fbec0 0x7fb9901134f0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fb978002a50 tx=0x7fb978004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:38:26.359 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:26.356+0000 7fb986ffd640 1 -- 172.21.15.121:0/1596035350 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb978007c30 con 0x7fb9900fbec0 2024-08-18T22:38:26.359 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:26.356+0000 7fb986ffd640 1 -- 172.21.15.121:0/1596035350 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fb97800f040 con 0x7fb9900fbec0 2024-08-18T22:38:26.359 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:26.356+0000 7fb994fa3640 1 -- 172.21.15.121:0/1596035350 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb99010d210 con 0x7fb9900fbec0 2024-08-18T22:38:26.359 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:26.356+0000 7fb986ffd640 1 -- 172.21.15.121:0/1596035350 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb97800da10 con 0x7fb9900fbec0 2024-08-18T22:38:26.359 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:26.356+0000 7fb994fa3640 1 -- 172.21.15.121:0/1596035350 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb99010d7b0 con 0x7fb9900fbec0 2024-08-18T22:38:26.360 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:26.357+0000 7fb994fa3640 1 -- 172.21.15.121:0/1596035350 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9900fc960 con 0x7fb9900fbec0 2024-08-18T22:38:26.360 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:26.358+0000 7fb986ffd640 1 -- 172.21.15.121:0/1596035350 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 19) v1 ==== 85127+0+0 (secure 0 0 0) 0x7fb97800dc80 con 0x7fb9900fbec0 2024-08-18T22:38:26.360 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:26.358+0000 7fb986ffd640 1 --2- 172.21.15.121:0/1596035350 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7fb97c067190 0x7fb97c069640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:38:26.360 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:26.358+0000 7fb986ffd640 1 -- 172.21.15.121:0/1596035350 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fb978083fc0 con 0x7fb9900fbec0 2024-08-18T22:38:26.361 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:26.358+0000 7fb98e59c640 1 --2- 172.21.15.121:0/1596035350 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7fb97c067190 0x7fb97c069640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:38:26.361 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:26.359+0000 7fb98e59c640 1 --2- 172.21.15.121:0/1596035350 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7fb97c067190 0x7fb97c069640 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fb980009ac0 tx=0x7fb980035040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:38:26.364 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:26.363+0000 7fb986ffd640 1 -- 172.21.15.121:0/1596035350 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fb978051650 con 0x7fb9900fbec0 2024-08-18T22:38:26.461 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:38:26 smithi121 ceph-mon[16788]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-08-18T22:38:26.535 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:26.534+0000 7fb994fa3640 1 -- 172.21.15.121:0/1596035350 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fb99010e650 con 0x7fb9900fbec0 2024-08-18T22:38:26.535 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:26.534+0000 7fb986ffd640 1 -- 172.21.15.121:0/1596035350 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fb978054c70 con 0x7fb9900fbec0 2024-08-18T22:38:26.536 INFO:teuthology.orchestra.run.smithi121.stdout:81604378647 2024-08-18T22:38:26.538 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:26.536+0000 7fb994fa3640 1 -- 172.21.15.121:0/1596035350 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7fb97c067190 msgr2=0x7fb97c069640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:38:26.538 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:26.536+0000 7fb994fa3640 1 --2- 172.21.15.121:0/1596035350 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7fb97c067190 0x7fb97c069640 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fb980009ac0 tx=0x7fb980035040 comp rx=0 tx=0).stop 2024-08-18T22:38:26.538 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:26.536+0000 7fb994fa3640 1 -- 172.21.15.121:0/1596035350 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb9900fbec0 msgr2=0x7fb9901134f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:38:26.538 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:26.536+0000 7fb994fa3640 1 --2- 172.21.15.121:0/1596035350 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb9900fbec0 0x7fb9901134f0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fb978002a50 tx=0x7fb978004600 comp rx=0 tx=0).stop 2024-08-18T22:38:26.538 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:26.536+0000 7fb994fa3640 1 -- 172.21.15.121:0/1596035350 shutdown_connections 2024-08-18T22:38:26.538 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:26.536+0000 7fb994fa3640 1 --2- 172.21.15.121:0/1596035350 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7fb97c067190 0x7fb97c069640 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:38:26.538 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:26.536+0000 7fb994fa3640 1 --2- 172.21.15.121:0/1596035350 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb9900fbec0 0x7fb9901134f0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:38:26.538 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:26.536+0000 7fb994fa3640 1 --2- 172.21.15.121:0/1596035350 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb9900fb5b0 0x7fb990112fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:38:26.538 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:26.536+0000 7fb994fa3640 1 -- 172.21.15.121:0/1596035350 >> 172.21.15.121:0/1596035350 conn(0x7fb990072150 msgr2=0x7fb9901040e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:38:26.538 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:26.537+0000 7fb994fa3640 1 -- 172.21.15.121:0/1596035350 shutdown_connections 2024-08-18T22:38:26.538 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:26.537+0000 7fb994fa3640 1 -- 172.21.15.121:0/1596035350 wait complete. 2024-08-18T22:38:26.659 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:38:26 smithi195 ceph-mon[23370]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-08-18T22:38:27.435 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:38:27 smithi121 ceph-mon[16788]: from='client.? 172.21.15.121:0/1596035350' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-08-18T22:38:27.438 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:27.436+0000 7fb9f4bde640 1 -- 172.21.15.121:0/835482813 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb9f01011f0 msgr2=0x7fb9f01015c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:38:27.438 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:27.436+0000 7fb9f4bde640 1 --2- 172.21.15.121:0/835482813 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb9f01011f0 0x7fb9f01015c0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fb9e00048d0 tx=0x7fb9e0009da0 comp rx=0 tx=0).stop 2024-08-18T22:38:27.438 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:27.436+0000 7fb9f4bde640 1 -- 172.21.15.121:0/835482813 shutdown_connections 2024-08-18T22:38:27.439 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:27.436+0000 7fb9f4bde640 1 --2- 172.21.15.121:0/835482813 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb9f0101b90 0x7fb9f00fb220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:38:27.439 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:27.436+0000 7fb9f4bde640 1 --2- 172.21.15.121:0/835482813 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb9f01011f0 0x7fb9f01015c0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:38:27.439 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:27.436+0000 7fb9f4bde640 1 -- 172.21.15.121:0/835482813 >> 172.21.15.121:0/835482813 conn(0x7fb9f00f6da0 msgr2=0x7fb9f00f91b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:38:27.439 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:27.436+0000 7fb9f4bde640 1 -- 172.21.15.121:0/835482813 shutdown_connections 2024-08-18T22:38:27.439 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:27.436+0000 7fb9f4bde640 1 -- 172.21.15.121:0/835482813 wait complete. 2024-08-18T22:38:27.439 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:27.436+0000 7fb9f4bde640 1 Processor -- start 2024-08-18T22:38:27.439 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:27.436+0000 7fb9f4bde640 1 -- start start 2024-08-18T22:38:27.439 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:27.437+0000 7fb9f4bde640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb9f01011f0 0x7fb9f0111f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:38:27.439 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:27.437+0000 7fb9f4bde640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb9f0101b90 0x7fb9f0112440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:38:27.439 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:27.437+0000 7fb9f4bde640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9f0112ad0 con 0x7fb9f0101b90 2024-08-18T22:38:27.439 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:27.437+0000 7fb9f4bde640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9f010be80 con 0x7fb9f01011f0 2024-08-18T22:38:27.440 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:27.437+0000 7fb9e7fff640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb9f0101b90 0x7fb9f0112440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:38:27.440 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:27.437+0000 7fb9e7fff640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb9f0101b90 0x7fb9f0112440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:54130/0 (socket says 172.21.15.121:54130) 2024-08-18T22:38:27.440 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:27.437+0000 7fb9e7fff640 1 -- 172.21.15.121:0/2898399357 learned_addr learned my addr 172.21.15.121:0/2898399357 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-18T22:38:27.440 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:27.437+0000 7fb9ee59c640 1 --2- 172.21.15.121:0/2898399357 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb9f01011f0 0x7fb9f0111f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:38:27.440 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:27.437+0000 7fb9e7fff640 1 -- 172.21.15.121:0/2898399357 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb9f01011f0 msgr2=0x7fb9f0111f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:38:27.440 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:27.437+0000 7fb9e7fff640 1 --2- 172.21.15.121:0/2898399357 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb9f01011f0 0x7fb9f0111f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:38:27.440 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:27.437+0000 7fb9e7fff640 1 -- 172.21.15.121:0/2898399357 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9e0005040 con 0x7fb9f0101b90 2024-08-18T22:38:27.440 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:27.437+0000 7fb9e7fff640 1 --2- 172.21.15.121:0/2898399357 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb9f0101b90 0x7fb9f0112440 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fb9d800b790 tx=0x7fb9d80091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:38:27.440 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:27.437+0000 7fb9e6ffd640 1 -- 172.21.15.121:0/2898399357 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb9d800c700 con 0x7fb9f0101b90 2024-08-18T22:38:27.440 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:27.437+0000 7fb9e6ffd640 1 -- 172.21.15.121:0/2898399357 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fb9d800cd00 con 0x7fb9f0101b90 2024-08-18T22:38:27.440 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:27.437+0000 7fb9f4bde640 1 -- 172.21.15.121:0/2898399357 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9f010c160 con 0x7fb9f0101b90 2024-08-18T22:38:27.440 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:27.438+0000 7fb9e6ffd640 1 -- 172.21.15.121:0/2898399357 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb9d8015e80 con 0x7fb9f0101b90 2024-08-18T22:38:27.440 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:27.438+0000 7fb9f4bde640 1 -- 172.21.15.121:0/2898399357 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9f010c680 con 0x7fb9f0101b90 2024-08-18T22:38:27.441 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:27.438+0000 7fb9f4bde640 1 -- 172.21.15.121:0/2898399357 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9f00fc960 con 0x7fb9f0101b90 2024-08-18T22:38:27.441 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:27.439+0000 7fb9e6ffd640 1 -- 172.21.15.121:0/2898399357 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 19) v1 ==== 85127+0+0 (secure 0 0 0) 0x7fb9d8012070 con 0x7fb9f0101b90 2024-08-18T22:38:27.441 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:27.439+0000 7fb9e6ffd640 1 --2- 172.21.15.121:0/2898399357 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7fb9dc067190 0x7fb9dc069640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:38:27.441 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:27.439+0000 7fb9e6ffd640 1 -- 172.21.15.121:0/2898399357 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fb9d8083f70 con 0x7fb9f0101b90 2024-08-18T22:38:27.442 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:27.439+0000 7fb9ee59c640 1 --2- 172.21.15.121:0/2898399357 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7fb9dc067190 0x7fb9dc069640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:38:27.442 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:27.440+0000 7fb9ee59c640 1 --2- 172.21.15.121:0/2898399357 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7fb9dc067190 0x7fb9dc069640 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fb9e0009ac0 tx=0x7fb9e0035040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:38:27.444 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:27.443+0000 7fb9e6ffd640 1 -- 172.21.15.121:0/2898399357 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fb9d80515d0 con 0x7fb9f0101b90 2024-08-18T22:38:27.604 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:27.602+0000 7fb9f4bde640 1 -- 172.21.15.121:0/2898399357 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fb9f0108260 con 0x7fb9f0101b90 2024-08-18T22:38:27.604 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:27.603+0000 7fb9e6ffd640 1 -- 172.21.15.121:0/2898399357 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fb9d8054bf0 con 0x7fb9f0101b90 2024-08-18T22:38:27.604 INFO:teuthology.orchestra.run.smithi121.stdout:38654705699 2024-08-18T22:38:27.606 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:27.605+0000 7fb9f4bde640 1 -- 172.21.15.121:0/2898399357 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7fb9dc067190 msgr2=0x7fb9dc069640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:38:27.606 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:27.605+0000 7fb9f4bde640 1 --2- 172.21.15.121:0/2898399357 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7fb9dc067190 0x7fb9dc069640 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fb9e0009ac0 tx=0x7fb9e0035040 comp rx=0 tx=0).stop 2024-08-18T22:38:27.606 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:27.605+0000 7fb9f4bde640 1 -- 172.21.15.121:0/2898399357 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb9f0101b90 msgr2=0x7fb9f0112440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:38:27.606 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:27.605+0000 7fb9f4bde640 1 --2- 172.21.15.121:0/2898399357 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb9f0101b90 0x7fb9f0112440 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fb9d800b790 tx=0x7fb9d80091d0 comp rx=0 tx=0).stop 2024-08-18T22:38:27.606 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:27.605+0000 7fb9f4bde640 1 -- 172.21.15.121:0/2898399357 shutdown_connections 2024-08-18T22:38:27.606 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:27.605+0000 7fb9f4bde640 1 --2- 172.21.15.121:0/2898399357 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7fb9dc067190 0x7fb9dc069640 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:38:27.606 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:27.605+0000 7fb9f4bde640 1 --2- 172.21.15.121:0/2898399357 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb9f0101b90 0x7fb9f0112440 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:38:27.606 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:27.605+0000 7fb9f4bde640 1 --2- 172.21.15.121:0/2898399357 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb9f01011f0 0x7fb9f0111f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:38:27.606 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:27.605+0000 7fb9f4bde640 1 -- 172.21.15.121:0/2898399357 >> 172.21.15.121:0/2898399357 conn(0x7fb9f00f6da0 msgr2=0x7fb9f00f7d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:38:27.607 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:27.605+0000 7fb9f4bde640 1 -- 172.21.15.121:0/2898399357 shutdown_connections 2024-08-18T22:38:27.607 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:27.605+0000 7fb9f4bde640 1 -- 172.21.15.121:0/2898399357 wait complete. 2024-08-18T22:38:27.659 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:38:27 smithi195 ceph-mon[23370]: from='client.? 172.21.15.121:0/1596035350' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-08-18T22:38:28.409 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:38:28 smithi195 ceph-mon[23370]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-08-18T22:38:28.409 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:38:28 smithi195 ceph-mon[23370]: from='client.? 172.21.15.121:0/2898399357' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-08-18T22:38:28.425 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:38:28 smithi121 ceph-mon[16788]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-08-18T22:38:28.425 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:38:28 smithi121 ceph-mon[16788]: from='client.? 172.21.15.121:0/2898399357' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-08-18T22:38:29.230 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:29.222+0000 7efdc40f5640 1 -- 172.21.15.121:0/2266792017 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efdbc1022e0 msgr2=0x7efdbc1026b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:38:29.230 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:29.222+0000 7efdc40f5640 1 --2- 172.21.15.121:0/2266792017 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efdbc1022e0 0x7efdbc1026b0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7efdb8009c50 tx=0x7efdb8004d10 comp rx=0 tx=0).stop 2024-08-18T22:38:29.231 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:29.222+0000 7efdc40f5640 1 -- 172.21.15.121:0/2266792017 shutdown_connections 2024-08-18T22:38:29.231 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:29.222+0000 7efdc40f5640 1 --2- 172.21.15.121:0/2266792017 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7efdbc102c80 0x7efdbc0fc310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:38:29.231 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:29.222+0000 7efdc40f5640 1 --2- 172.21.15.121:0/2266792017 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efdbc1022e0 0x7efdbc1026b0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:38:29.231 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:29.222+0000 7efdc40f5640 1 -- 172.21.15.121:0/2266792017 >> 172.21.15.121:0/2266792017 conn(0x7efdbc0f7e90 msgr2=0x7efdbc0fa2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:38:29.231 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:29.223+0000 7efdc40f5640 1 -- 172.21.15.121:0/2266792017 shutdown_connections 2024-08-18T22:38:29.231 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:29.223+0000 7efdc40f5640 1 -- 172.21.15.121:0/2266792017 wait complete. 2024-08-18T22:38:29.231 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:29.223+0000 7efdc40f5640 1 Processor -- start 2024-08-18T22:38:29.231 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:29.223+0000 7efdc40f5640 1 -- start start 2024-08-18T22:38:29.231 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:29.223+0000 7efdc40f5640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efdbc1022e0 0x7efdbc112ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:38:29.231 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:29.223+0000 7efdc40f5640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7efdbc102c80 0x7efdbc113420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:38:29.231 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:29.223+0000 7efdc40f5640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdbc113a20 con 0x7efdbc1022e0 2024-08-18T22:38:29.231 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:29.223+0000 7efdc40f5640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdbc10ce60 con 0x7efdbc102c80 2024-08-18T22:38:29.232 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:29.224+0000 7efdc1e91640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efdbc1022e0 0x7efdbc112ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:38:29.232 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:29.224+0000 7efdc1e91640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efdbc1022e0 0x7efdbc112ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:54150/0 (socket says 172.21.15.121:54150) 2024-08-18T22:38:29.232 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:29.224+0000 7efdc1e91640 1 -- 172.21.15.121:0/43667808 learned_addr learned my addr 172.21.15.121:0/43667808 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-18T22:38:29.232 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:29.224+0000 7efdc1690640 1 --2- 172.21.15.121:0/43667808 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7efdbc102c80 0x7efdbc113420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:38:29.232 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:29.224+0000 7efdc1e91640 1 -- 172.21.15.121:0/43667808 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7efdbc102c80 msgr2=0x7efdbc113420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:38:29.232 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:29.224+0000 7efdc1e91640 1 --2- 172.21.15.121:0/43667808 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7efdbc102c80 0x7efdbc113420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:38:29.232 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:29.224+0000 7efdc1e91640 1 -- 172.21.15.121:0/43667808 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdb80098b0 con 0x7efdbc1022e0 2024-08-18T22:38:29.232 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:29.224+0000 7efdc1e91640 1 --2- 172.21.15.121:0/43667808 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efdbc1022e0 0x7efdbc112ee0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7efdb8004750 tx=0x7efdb8004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:38:29.232 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:29.224+0000 7efdb27fc640 1 -- 172.21.15.121:0/43667808 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efdb8009610 con 0x7efdbc1022e0 2024-08-18T22:38:29.232 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:29.224+0000 7efdb27fc640 1 -- 172.21.15.121:0/43667808 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7efdb8032b10 con 0x7efdbc1022e0 2024-08-18T22:38:29.232 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:29.224+0000 7efdc40f5640 1 -- 172.21.15.121:0/43667808 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efdbc10d0e0 con 0x7efdbc1022e0 2024-08-18T22:38:29.232 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:29.224+0000 7efdb27fc640 1 -- 172.21.15.121:0/43667808 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efdb803d990 con 0x7efdbc1022e0 2024-08-18T22:38:29.232 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:29.224+0000 7efdc40f5640 1 -- 172.21.15.121:0/43667808 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efdbc10d680 con 0x7efdbc1022e0 2024-08-18T22:38:29.233 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:29.225+0000 7efdc40f5640 1 -- 172.21.15.121:0/43667808 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efdbc0fda50 con 0x7efdbc1022e0 2024-08-18T22:38:29.233 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:29.226+0000 7efdb27fc640 1 -- 172.21.15.121:0/43667808 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 19) v1 ==== 85127+0+0 (secure 0 0 0) 0x7efdb802f030 con 0x7efdbc1022e0 2024-08-18T22:38:29.233 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:29.226+0000 7efdb27fc640 1 --2- 172.21.15.121:0/43667808 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7efda8067190 0x7efda8069640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:38:29.233 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:29.226+0000 7efdb27fc640 1 -- 172.21.15.121:0/43667808 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7efdb80a5850 con 0x7efdbc1022e0 2024-08-18T22:38:29.233 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:29.226+0000 7efdc1690640 1 --2- 172.21.15.121:0/43667808 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7efda8067190 0x7efda8069640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:38:29.233 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:29.226+0000 7efdc1690640 1 --2- 172.21.15.121:0/43667808 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7efda8067190 0x7efda8069640 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7efdbc10e7a0 tx=0x7efdac00b040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:38:29.233 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:29.231+0000 7efdb27fc640 1 -- 172.21.15.121:0/43667808 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7efdb8072ef0 con 0x7efdbc1022e0 2024-08-18T22:38:29.392 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:29.391+0000 7efdc40f5640 1 -- 172.21.15.121:0/43667808 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7efdbc04b4c0 con 0x7efdbc1022e0 2024-08-18T22:38:29.392 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:29.391+0000 7efdb27fc640 1 -- 172.21.15.121:0/43667808 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7efdb8076510 con 0x7efdbc1022e0 2024-08-18T22:38:29.392 INFO:teuthology.orchestra.run.smithi121.stdout:150323855375 2024-08-18T22:38:29.394 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:29.393+0000 7efdc40f5640 1 -- 172.21.15.121:0/43667808 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7efda8067190 msgr2=0x7efda8069640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:38:29.394 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:29.393+0000 7efdc40f5640 1 --2- 172.21.15.121:0/43667808 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7efda8067190 0x7efda8069640 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7efdbc10e7a0 tx=0x7efdac00b040 comp rx=0 tx=0).stop 2024-08-18T22:38:29.394 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:29.393+0000 7efdc40f5640 1 -- 172.21.15.121:0/43667808 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efdbc1022e0 msgr2=0x7efdbc112ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:38:29.394 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:29.393+0000 7efdc40f5640 1 --2- 172.21.15.121:0/43667808 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efdbc1022e0 0x7efdbc112ee0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7efdb8004750 tx=0x7efdb8004d10 comp rx=0 tx=0).stop 2024-08-18T22:38:29.394 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:29.393+0000 7efdc40f5640 1 -- 172.21.15.121:0/43667808 shutdown_connections 2024-08-18T22:38:29.394 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:29.393+0000 7efdc40f5640 1 --2- 172.21.15.121:0/43667808 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7efda8067190 0x7efda8069640 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:38:29.395 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:29.393+0000 7efdc40f5640 1 --2- 172.21.15.121:0/43667808 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7efdbc102c80 0x7efdbc113420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:38:29.395 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:29.393+0000 7efdc40f5640 1 --2- 172.21.15.121:0/43667808 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efdbc1022e0 0x7efdbc112ee0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:38:29.395 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:29.393+0000 7efdc40f5640 1 -- 172.21.15.121:0/43667808 >> 172.21.15.121:0/43667808 conn(0x7efdbc0f7e90 msgr2=0x7efdbc0f8f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:38:29.395 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:29.393+0000 7efdc40f5640 1 -- 172.21.15.121:0/43667808 shutdown_connections 2024-08-18T22:38:29.395 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:29.393+0000 7efdc40f5640 1 -- 172.21.15.121:0/43667808 wait complete. 2024-08-18T22:38:29.715 INFO:tasks.cephadm.ceph_manager.ceph:need seq 38654705697 got 38654705699 for osd.0 2024-08-18T22:38:29.715 DEBUG:teuthology.parallel:result is None 2024-08-18T22:38:30.267 INFO:teuthology.orchestra.run.smithi121.stderr:Inferring config /var/lib/ceph/b003123a-5db1-11ef-bccf-c7b262605968/mon.smithi121/config 2024-08-18T22:38:30.409 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:38:30 smithi195 ceph-mon[23370]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-08-18T22:38:30.409 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:38:30 smithi195 ceph-mon[23370]: from='client.? 172.21.15.121:0/43667808' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-08-18T22:38:30.524 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:38:30 smithi121 ceph-mon[16788]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-08-18T22:38:30.524 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:38:30 smithi121 ceph-mon[16788]: from='client.? 172.21.15.121:0/43667808' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-08-18T22:38:30.815 INFO:tasks.cephadm.ceph_manager.ceph:need seq 81604378645 got 81604378647 for osd.2 2024-08-18T22:38:30.815 DEBUG:teuthology.parallel:result is None 2024-08-18T22:38:31.682 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:31.659+0000 7fa267c4f640 1 -- 172.21.15.121:0/4035900839 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa2601022e0 msgr2=0x7fa2601026b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:38:31.682 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:31.659+0000 7fa267c4f640 1 --2- 172.21.15.121:0/4035900839 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa2601022e0 0x7fa2601026b0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fa2500048d0 tx=0x7fa250009da0 comp rx=0 tx=0).stop 2024-08-18T22:38:31.683 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:31.659+0000 7fa267c4f640 1 -- 172.21.15.121:0/4035900839 shutdown_connections 2024-08-18T22:38:31.683 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:31.659+0000 7fa267c4f640 1 --2- 172.21.15.121:0/4035900839 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa260102c80 0x7fa2600fc310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:38:31.683 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:31.659+0000 7fa267c4f640 1 --2- 172.21.15.121:0/4035900839 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa2601022e0 0x7fa2601026b0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:38:31.683 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:31.659+0000 7fa267c4f640 1 -- 172.21.15.121:0/4035900839 >> 172.21.15.121:0/4035900839 conn(0x7fa2600f7eb0 msgr2=0x7fa2600fa2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:38:31.683 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:31.659+0000 7fa267c4f640 1 -- 172.21.15.121:0/4035900839 shutdown_connections 2024-08-18T22:38:31.683 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:31.659+0000 7fa267c4f640 1 -- 172.21.15.121:0/4035900839 wait complete. 2024-08-18T22:38:31.683 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:31.659+0000 7fa267c4f640 1 Processor -- start 2024-08-18T22:38:31.683 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:31.659+0000 7fa267c4f640 1 -- start start 2024-08-18T22:38:31.683 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:31.660+0000 7fa267c4f640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa2601022e0 0x7fa26006f7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:38:31.683 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:31.660+0000 7fa267c4f640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa260102c80 0x7fa26006fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:38:31.683 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:31.660+0000 7fa267c4f640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2600702c0 con 0x7fa260102c80 2024-08-18T22:38:31.683 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:31.660+0000 7fa267c4f640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa260070430 con 0x7fa2601022e0 2024-08-18T22:38:31.684 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:31.660+0000 7fa2651ea640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa260102c80 0x7fa26006fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:38:31.684 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:31.660+0000 7fa2651ea640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa260102c80 0x7fa26006fcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:54156/0 (socket says 172.21.15.121:54156) 2024-08-18T22:38:31.684 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:31.660+0000 7fa2651ea640 1 -- 172.21.15.121:0/3768742204 learned_addr learned my addr 172.21.15.121:0/3768742204 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-18T22:38:31.684 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:31.660+0000 7fa2659eb640 1 --2- 172.21.15.121:0/3768742204 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa2601022e0 0x7fa26006f7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:38:31.684 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:31.660+0000 7fa2651ea640 1 -- 172.21.15.121:0/3768742204 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa2601022e0 msgr2=0x7fa26006f7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:38:31.684 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:31.660+0000 7fa2651ea640 1 --2- 172.21.15.121:0/3768742204 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa2601022e0 0x7fa26006f7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:38:31.684 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:31.660+0000 7fa2651ea640 1 -- 172.21.15.121:0/3768742204 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa250005040 con 0x7fa260102c80 2024-08-18T22:38:31.684 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:31.660+0000 7fa2659eb640 1 --2- 172.21.15.121:0/3768742204 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa2601022e0 0x7fa26006f7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:38:31.684 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:31.660+0000 7fa2651ea640 1 --2- 172.21.15.121:0/3768742204 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa260102c80 0x7fa26006fcf0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fa25c00b790 tx=0x7fa25c0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:38:31.684 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:31.660+0000 7fa2567fc640 1 -- 172.21.15.121:0/3768742204 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa25c00c700 con 0x7fa260102c80 2024-08-18T22:38:31.684 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:31.660+0000 7fa2567fc640 1 -- 172.21.15.121:0/3768742204 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fa25c00cd00 con 0x7fa260102c80 2024-08-18T22:38:31.684 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:31.660+0000 7fa2567fc640 1 -- 172.21.15.121:0/3768742204 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa25c015e70 con 0x7fa260102c80 2024-08-18T22:38:31.684 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:31.660+0000 7fa267c4f640 1 -- 172.21.15.121:0/3768742204 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa260119300 con 0x7fa260102c80 2024-08-18T22:38:31.684 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:31.660+0000 7fa267c4f640 1 -- 172.21.15.121:0/3768742204 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa260119740 con 0x7fa260102c80 2024-08-18T22:38:31.685 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:31.662+0000 7fa267c4f640 1 -- 172.21.15.121:0/3768742204 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2600fda50 con 0x7fa260102c80 2024-08-18T22:38:31.685 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:31.662+0000 7fa2567fc640 1 -- 172.21.15.121:0/3768742204 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 19) v1 ==== 85127+0+0 (secure 0 0 0) 0x7fa25c012070 con 0x7fa260102c80 2024-08-18T22:38:31.685 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:31.662+0000 7fa2567fc640 1 --2- 172.21.15.121:0/3768742204 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7fa24c067190 0x7fa24c069640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:38:31.685 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:31.662+0000 7fa2567fc640 1 -- 172.21.15.121:0/3768742204 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fa25c084350 con 0x7fa260102c80 2024-08-18T22:38:31.685 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:31.662+0000 7fa2659eb640 1 --2- 172.21.15.121:0/3768742204 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7fa24c067190 0x7fa24c069640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:38:31.685 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:31.663+0000 7fa2659eb640 1 --2- 172.21.15.121:0/3768742204 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7fa24c067190 0x7fa24c069640 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fa250007ac0 tx=0x7fa250035040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:38:31.685 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:31.667+0000 7fa2567fc640 1 -- 172.21.15.121:0/3768742204 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fa25c051930 con 0x7fa260102c80 2024-08-18T22:38:31.695 INFO:teuthology.orchestra.run.smithi121.stderr:Inferring config /var/lib/ceph/b003123a-5db1-11ef-bccf-c7b262605968/mon.smithi121/config 2024-08-18T22:38:31.833 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:31.832+0000 7fa267c4f640 1 -- 172.21.15.121:0/3768742204 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fa2600fbad0 con 0x7fa260102c80 2024-08-18T22:38:31.833 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:31.832+0000 7fa2567fc640 1 -- 172.21.15.121:0/3768742204 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa25c015690 con 0x7fa260102c80 2024-08-18T22:38:31.834 INFO:teuthology.orchestra.run.smithi121.stdout:115964117013 2024-08-18T22:38:31.835 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:31.834+0000 7fa267c4f640 1 -- 172.21.15.121:0/3768742204 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7fa24c067190 msgr2=0x7fa24c069640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:38:31.836 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:31.834+0000 7fa267c4f640 1 --2- 172.21.15.121:0/3768742204 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7fa24c067190 0x7fa24c069640 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fa250007ac0 tx=0x7fa250035040 comp rx=0 tx=0).stop 2024-08-18T22:38:31.836 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:31.834+0000 7fa267c4f640 1 -- 172.21.15.121:0/3768742204 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa260102c80 msgr2=0x7fa26006fcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:38:31.836 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:31.834+0000 7fa267c4f640 1 --2- 172.21.15.121:0/3768742204 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa260102c80 0x7fa26006fcf0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fa25c00b790 tx=0x7fa25c0091d0 comp rx=0 tx=0).stop 2024-08-18T22:38:31.836 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:31.834+0000 7fa267c4f640 1 -- 172.21.15.121:0/3768742204 shutdown_connections 2024-08-18T22:38:31.836 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:31.834+0000 7fa267c4f640 1 --2- 172.21.15.121:0/3768742204 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7fa24c067190 0x7fa24c069640 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:38:31.836 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:31.834+0000 7fa267c4f640 1 --2- 172.21.15.121:0/3768742204 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa260102c80 0x7fa26006fcf0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:38:31.836 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:31.834+0000 7fa267c4f640 1 --2- 172.21.15.121:0/3768742204 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa2601022e0 0x7fa26006f7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:38:31.836 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:31.834+0000 7fa267c4f640 1 -- 172.21.15.121:0/3768742204 >> 172.21.15.121:0/3768742204 conn(0x7fa2600f7eb0 msgr2=0x7fa2600f8e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:38:31.836 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:31.834+0000 7fa267c4f640 1 -- 172.21.15.121:0/3768742204 shutdown_connections 2024-08-18T22:38:31.836 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:31.834+0000 7fa267c4f640 1 -- 172.21.15.121:0/3768742204 wait complete. 2024-08-18T22:38:32.571 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:38:32 smithi121 ceph-mon[16788]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-08-18T22:38:32.571 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:38:32 smithi121 ceph-mon[16788]: from='client.? 172.21.15.121:0/3768742204' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-08-18T22:38:32.659 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:38:32 smithi195 ceph-mon[23370]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-08-18T22:38:32.659 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:38:32 smithi195 ceph-mon[23370]: from='client.? 172.21.15.121:0/3768742204' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-08-18T22:38:33.583 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:38:33 smithi121 ceph-mon[16788]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-08-18T22:38:33.659 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:38:33 smithi195 ceph-mon[23370]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-08-18T22:38:33.749 INFO:tasks.cephadm.ceph_manager.ceph:need seq 115964117011 got 115964117013 for osd.3 2024-08-18T22:38:33.750 DEBUG:teuthology.parallel:result is None 2024-08-18T22:38:34.199 INFO:tasks.cephadm.ceph_manager.ceph:need seq 150323855373 got 150323855375 for osd.4 2024-08-18T22:38:34.199 DEBUG:teuthology.parallel:result is None 2024-08-18T22:38:34.854 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:34.851+0000 7f6b8af81640 1 -- 172.21.15.121:0/3684249352 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6b840fbec0 msgr2=0x7f6b840fcdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:38:34.854 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:34.851+0000 7f6b8af81640 1 --2- 172.21.15.121:0/3684249352 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6b840fbec0 0x7f6b840fcdc0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f6b700048d0 tx=0x7f6b70009da0 comp rx=0 tx=0).stop 2024-08-18T22:38:34.854 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:34.851+0000 7f6b8af81640 1 -- 172.21.15.121:0/3684249352 shutdown_connections 2024-08-18T22:38:34.854 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:34.851+0000 7f6b8af81640 1 --2- 172.21.15.121:0/3684249352 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6b840fbec0 0x7f6b840fcdc0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:38:34.854 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:34.851+0000 7f6b8af81640 1 --2- 172.21.15.121:0/3684249352 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6b840fb5b0 0x7f6b840fb980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:38:34.855 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:34.851+0000 7f6b8af81640 1 -- 172.21.15.121:0/3684249352 >> 172.21.15.121:0/3684249352 conn(0x7f6b84072150 msgr2=0x7f6b84072550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:38:34.855 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:34.851+0000 7f6b8af81640 1 -- 172.21.15.121:0/3684249352 shutdown_connections 2024-08-18T22:38:34.855 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:34.851+0000 7f6b8af81640 1 -- 172.21.15.121:0/3684249352 wait complete. 2024-08-18T22:38:34.855 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:34.852+0000 7f6b8af81640 1 Processor -- start 2024-08-18T22:38:34.855 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:34.852+0000 7f6b8af81640 1 -- start start 2024-08-18T22:38:34.855 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:34.852+0000 7f6b8af81640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6b840fb5b0 0x7f6b84111ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:38:34.855 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:34.852+0000 7f6b8af81640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6b840fbec0 0x7f6b84112400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:38:34.855 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:34.852+0000 7f6b8af81640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b84112a90 con 0x7f6b840fbec0 2024-08-18T22:38:34.855 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:34.852+0000 7f6b8af81640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b8410be40 con 0x7f6b840fb5b0 2024-08-18T22:38:34.855 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:34.852+0000 7f6b83fff640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6b840fbec0 0x7f6b84112400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:38:34.855 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:34.852+0000 7f6b83fff640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6b840fbec0 0x7f6b84112400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:54174/0 (socket says 172.21.15.121:54174) 2024-08-18T22:38:34.855 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:34.852+0000 7f6b83fff640 1 -- 172.21.15.121:0/2954003632 learned_addr learned my addr 172.21.15.121:0/2954003632 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-18T22:38:34.857 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:34.852+0000 7f6b83fff640 1 -- 172.21.15.121:0/2954003632 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6b840fb5b0 msgr2=0x7f6b84111ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:38:34.857 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:34.852+0000 7f6b88d1d640 1 --2- 172.21.15.121:0/2954003632 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6b840fb5b0 0x7f6b84111ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:38:34.857 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:34.852+0000 7f6b83fff640 1 --2- 172.21.15.121:0/2954003632 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6b840fb5b0 0x7f6b84111ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:38:34.857 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:34.852+0000 7f6b83fff640 1 -- 172.21.15.121:0/2954003632 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b70005040 con 0x7f6b840fbec0 2024-08-18T22:38:34.858 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:34.853+0000 7f6b83fff640 1 --2- 172.21.15.121:0/2954003632 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6b840fbec0 0x7f6b84112400 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f6b70003080 tx=0x7f6b70009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:38:34.858 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:34.853+0000 7f6b817fa640 1 -- 172.21.15.121:0/2954003632 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6b70038070 con 0x7f6b840fbec0 2024-08-18T22:38:34.858 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:34.853+0000 7f6b817fa640 1 -- 172.21.15.121:0/2954003632 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f6b700097e0 con 0x7f6b840fbec0 2024-08-18T22:38:34.858 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:34.853+0000 7f6b8af81640 1 -- 172.21.15.121:0/2954003632 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b8410c0c0 con 0x7f6b840fbec0 2024-08-18T22:38:34.858 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:34.853+0000 7f6b817fa640 1 -- 172.21.15.121:0/2954003632 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6b7003d420 con 0x7f6b840fbec0 2024-08-18T22:38:34.858 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:34.853+0000 7f6b8af81640 1 -- 172.21.15.121:0/2954003632 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b8410c580 con 0x7f6b840fbec0 2024-08-18T22:38:34.858 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:34.854+0000 7f6b8af81640 1 -- 172.21.15.121:0/2954003632 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b840fc960 con 0x7f6b840fbec0 2024-08-18T22:38:34.858 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:34.854+0000 7f6b817fa640 1 -- 172.21.15.121:0/2954003632 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 19) v1 ==== 85127+0+0 (secure 0 0 0) 0x7f6b70030020 con 0x7f6b840fbec0 2024-08-18T22:38:34.858 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:34.855+0000 7f6b817fa640 1 --2- 172.21.15.121:0/2954003632 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7f6b74067190 0x7f6b74069640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:38:34.858 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:34.855+0000 7f6b817fa640 1 -- 172.21.15.121:0/2954003632 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f6b700a4d00 con 0x7f6b840fbec0 2024-08-18T22:38:34.859 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:34.855+0000 7f6b88d1d640 1 --2- 172.21.15.121:0/2954003632 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7f6b74067190 0x7f6b74069640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:38:34.859 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:34.855+0000 7f6b88d1d640 1 --2- 172.21.15.121:0/2954003632 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7f6b74067190 0x7f6b74069640 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f6b7800a900 tx=0x7f6b78008040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:38:34.861 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:34.859+0000 7f6b817fa640 1 -- 172.21.15.121:0/2954003632 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f6b700a8030 con 0x7f6b840fbec0 2024-08-18T22:38:35.022 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:35.020+0000 7f6b8af81640 1 -- 172.21.15.121:0/2954003632 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f6b8410d530 con 0x7f6b840fbec0 2024-08-18T22:38:35.023 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:35.021+0000 7f6b817fa640 1 -- 172.21.15.121:0/2954003632 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6b70072360 con 0x7f6b840fbec0 2024-08-18T22:38:35.023 INFO:teuthology.orchestra.run.smithi121.stdout:171798691852 2024-08-18T22:38:35.024 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:35.022+0000 7f6b8af81640 1 -- 172.21.15.121:0/2954003632 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7f6b74067190 msgr2=0x7f6b74069640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:38:35.025 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:35.022+0000 7f6b8af81640 1 --2- 172.21.15.121:0/2954003632 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7f6b74067190 0x7f6b74069640 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f6b7800a900 tx=0x7f6b78008040 comp rx=0 tx=0).stop 2024-08-18T22:38:35.025 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:35.022+0000 7f6b8af81640 1 -- 172.21.15.121:0/2954003632 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6b840fbec0 msgr2=0x7f6b84112400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:38:35.025 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:35.022+0000 7f6b8af81640 1 --2- 172.21.15.121:0/2954003632 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6b840fbec0 0x7f6b84112400 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f6b70003080 tx=0x7f6b70009da0 comp rx=0 tx=0).stop 2024-08-18T22:38:35.025 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:35.023+0000 7f6b8af81640 1 -- 172.21.15.121:0/2954003632 shutdown_connections 2024-08-18T22:38:35.025 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:35.023+0000 7f6b8af81640 1 --2- 172.21.15.121:0/2954003632 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7f6b74067190 0x7f6b74069640 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:38:35.025 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:35.023+0000 7f6b8af81640 1 --2- 172.21.15.121:0/2954003632 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6b840fbec0 0x7f6b84112400 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:38:35.025 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:35.023+0000 7f6b8af81640 1 --2- 172.21.15.121:0/2954003632 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6b840fb5b0 0x7f6b84111ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:38:35.025 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:35.023+0000 7f6b8af81640 1 -- 172.21.15.121:0/2954003632 >> 172.21.15.121:0/2954003632 conn(0x7f6b84072150 msgr2=0x7f6b840f8780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:38:35.025 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:35.023+0000 7f6b8af81640 1 -- 172.21.15.121:0/2954003632 shutdown_connections 2024-08-18T22:38:35.025 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:35.023+0000 7f6b8af81640 1 -- 172.21.15.121:0/2954003632 wait complete. 2024-08-18T22:38:35.038 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:35.036+0000 7f5db3f9a640 1 -- 172.21.15.121:0/842419932 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5dac0fb5b0 msgr2=0x7f5dac0fb980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:38:35.038 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:35.036+0000 7f5db3f9a640 1 --2- 172.21.15.121:0/842419932 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5dac0fb5b0 0x7f5dac0fb980 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f5da80048d0 tx=0x7f5da8009da0 comp rx=0 tx=0).stop 2024-08-18T22:38:35.038 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:35.036+0000 7f5db3f9a640 1 -- 172.21.15.121:0/842419932 shutdown_connections 2024-08-18T22:38:35.039 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:35.036+0000 7f5db3f9a640 1 --2- 172.21.15.121:0/842419932 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5dac0fbec0 0x7f5dac0fcdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:38:35.039 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:35.036+0000 7f5db3f9a640 1 --2- 172.21.15.121:0/842419932 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5dac0fb5b0 0x7f5dac0fb980 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:38:35.039 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:35.036+0000 7f5db3f9a640 1 -- 172.21.15.121:0/842419932 >> 172.21.15.121:0/842419932 conn(0x7f5dac072150 msgr2=0x7f5dac072550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:38:35.039 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:35.037+0000 7f5db3f9a640 1 -- 172.21.15.121:0/842419932 shutdown_connections 2024-08-18T22:38:35.039 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:35.037+0000 7f5db3f9a640 1 -- 172.21.15.121:0/842419932 wait complete. 2024-08-18T22:38:35.040 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:35.037+0000 7f5db3f9a640 1 Processor -- start 2024-08-18T22:38:35.040 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:35.037+0000 7f5db3f9a640 1 -- start start 2024-08-18T22:38:35.040 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:35.037+0000 7f5db3f9a640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5dac0fb5b0 0x7f5dac110d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:38:35.041 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:35.037+0000 7f5db3f9a640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5dac0fbec0 0x7f5dac1112d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:38:35.041 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:35.037+0000 7f5db3f9a640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5dac111920 con 0x7f5dac0fb5b0 2024-08-18T22:38:35.041 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:35.037+0000 7f5db3f9a640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5dac10bec0 con 0x7f5dac0fbec0 2024-08-18T22:38:35.041 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:35.038+0000 7f5db1d36640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5dac0fb5b0 0x7f5dac110d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:38:35.041 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:35.038+0000 7f5db1d36640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5dac0fb5b0 0x7f5dac110d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:54190/0 (socket says 172.21.15.121:54190) 2024-08-18T22:38:35.041 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:35.038+0000 7f5db1d36640 1 -- 172.21.15.121:0/1307272191 learned_addr learned my addr 172.21.15.121:0/1307272191 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-18T22:38:35.041 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:35.038+0000 7f5db1535640 1 --2- 172.21.15.121:0/1307272191 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5dac0fbec0 0x7f5dac1112d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:38:35.041 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:35.038+0000 7f5db1d36640 1 -- 172.21.15.121:0/1307272191 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5dac0fbec0 msgr2=0x7f5dac1112d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:38:35.041 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:35.038+0000 7f5db1d36640 1 --2- 172.21.15.121:0/1307272191 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5dac0fbec0 0x7f5dac1112d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:38:35.041 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:35.038+0000 7f5db1d36640 1 -- 172.21.15.121:0/1307272191 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5da8005040 con 0x7f5dac0fb5b0 2024-08-18T22:38:35.041 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:35.038+0000 7f5db1d36640 1 --2- 172.21.15.121:0/1307272191 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5dac0fb5b0 0x7f5dac110d90 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f5da8000c00 tx=0x7f5da8009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:38:35.041 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:35.038+0000 7f5da27fc640 1 -- 172.21.15.121:0/1307272191 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5da8038070 con 0x7f5dac0fb5b0 2024-08-18T22:38:35.041 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:35.038+0000 7f5db3f9a640 1 -- 172.21.15.121:0/1307272191 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5dac10c140 con 0x7f5dac0fb5b0 2024-08-18T22:38:35.042 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:35.038+0000 7f5da27fc640 1 -- 172.21.15.121:0/1307272191 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f5da802ade0 con 0x7f5dac0fb5b0 2024-08-18T22:38:35.042 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:35.038+0000 7f5da27fc640 1 -- 172.21.15.121:0/1307272191 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5da802c7e0 con 0x7f5dac0fb5b0 2024-08-18T22:38:35.042 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:35.038+0000 7f5db3f9a640 1 -- 172.21.15.121:0/1307272191 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5dac10c680 con 0x7f5dac0fb5b0 2024-08-18T22:38:35.042 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:35.040+0000 7f5db3f9a640 1 -- 172.21.15.121:0/1307272191 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5dac0fc960 con 0x7f5dac0fb5b0 2024-08-18T22:38:35.042 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:35.040+0000 7f5da27fc640 1 -- 172.21.15.121:0/1307272191 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 19) v1 ==== 85127+0+0 (secure 0 0 0) 0x7f5da8030020 con 0x7f5dac0fb5b0 2024-08-18T22:38:35.043 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:35.040+0000 7f5da27fc640 1 --2- 172.21.15.121:0/1307272191 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7f5d98067190 0x7f5d98069640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:38:35.043 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:35.040+0000 7f5da27fc640 1 -- 172.21.15.121:0/1307272191 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f5da80a4420 con 0x7f5dac0fb5b0 2024-08-18T22:38:35.043 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:35.041+0000 7f5db1535640 1 --2- 172.21.15.121:0/1307272191 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7f5d98067190 0x7f5d98069640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:38:35.043 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:35.041+0000 7f5db1535640 1 --2- 172.21.15.121:0/1307272191 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7f5d98067190 0x7f5d98069640 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f5dac0f83d0 tx=0x7f5d9c00b040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:38:35.046 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:35.045+0000 7f5da27fc640 1 -- 172.21.15.121:0/1307272191 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f5da8071ab0 con 0x7f5dac0fb5b0 2024-08-18T22:38:35.204 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:35.202+0000 7f5db3f9a640 1 -- 172.21.15.121:0/1307272191 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f5dac04b4c0 con 0x7f5dac0fb5b0 2024-08-18T22:38:35.205 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:35.202+0000 7f5da27fc640 1 -- 172.21.15.121:0/1307272191 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f5da80750d0 con 0x7f5dac0fb5b0 2024-08-18T22:38:35.205 INFO:teuthology.orchestra.run.smithi121.stdout:60129542175 2024-08-18T22:38:35.207 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:35.205+0000 7f5db3f9a640 1 -- 172.21.15.121:0/1307272191 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7f5d98067190 msgr2=0x7f5d98069640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:38:35.207 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:35.205+0000 7f5db3f9a640 1 --2- 172.21.15.121:0/1307272191 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7f5d98067190 0x7f5d98069640 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f5dac0f83d0 tx=0x7f5d9c00b040 comp rx=0 tx=0).stop 2024-08-18T22:38:35.207 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:35.205+0000 7f5db3f9a640 1 -- 172.21.15.121:0/1307272191 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5dac0fb5b0 msgr2=0x7f5dac110d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:38:35.207 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:35.205+0000 7f5db3f9a640 1 --2- 172.21.15.121:0/1307272191 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5dac0fb5b0 0x7f5dac110d90 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f5da8000c00 tx=0x7f5da8009da0 comp rx=0 tx=0).stop 2024-08-18T22:38:35.207 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:35.205+0000 7f5db3f9a640 1 -- 172.21.15.121:0/1307272191 shutdown_connections 2024-08-18T22:38:35.207 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:35.205+0000 7f5db3f9a640 1 --2- 172.21.15.121:0/1307272191 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7f5d98067190 0x7f5d98069640 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:38:35.207 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:35.205+0000 7f5db3f9a640 1 --2- 172.21.15.121:0/1307272191 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5dac0fbec0 0x7f5dac1112d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:38:35.207 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:35.205+0000 7f5db3f9a640 1 --2- 172.21.15.121:0/1307272191 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5dac0fb5b0 0x7f5dac110d90 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:38:35.208 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:35.205+0000 7f5db3f9a640 1 -- 172.21.15.121:0/1307272191 >> 172.21.15.121:0/1307272191 conn(0x7f5dac072150 msgr2=0x7f5dac0f87f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:38:35.208 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:35.205+0000 7f5db3f9a640 1 -- 172.21.15.121:0/1307272191 shutdown_connections 2024-08-18T22:38:35.208 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:35.205+0000 7f5db3f9a640 1 -- 172.21.15.121:0/1307272191 wait complete. 2024-08-18T22:38:35.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:38:35 smithi195 ceph-mon[23370]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-08-18T22:38:35.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:38:35 smithi195 ceph-mon[23370]: from='client.? 172.21.15.121:0/2954003632' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-08-18T22:38:35.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:38:35 smithi195 ceph-mon[23370]: from='client.? 172.21.15.121:0/1307272191' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-08-18T22:38:35.941 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:38:35 smithi121 ceph-mon[16788]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-08-18T22:38:35.941 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:38:35 smithi121 ceph-mon[16788]: from='client.? 172.21.15.121:0/2954003632' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-08-18T22:38:35.941 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:38:35 smithi121 ceph-mon[16788]: from='client.? 172.21.15.121:0/1307272191' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-08-18T22:38:35.965 INFO:tasks.cephadm.ceph_manager.ceph:need seq 60129542173 got 60129542175 for osd.1 2024-08-18T22:38:35.965 DEBUG:teuthology.parallel:result is None 2024-08-18T22:38:36.410 INFO:tasks.cephadm.ceph_manager.ceph:need seq 171798691850 got 171798691852 for osd.5 2024-08-18T22:38:36.410 DEBUG:teuthology.parallel:result is None 2024-08-18T22:38:36.410 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-08-18T22:38:36.411 DEBUG:teuthology.orchestra.run.smithi121:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid b003123a-5db1-11ef-bccf-c7b262605968 -- ceph pg dump --format=json 2024-08-18T22:38:36.661 INFO:teuthology.orchestra.run.smithi121.stderr:Inferring config /var/lib/ceph/b003123a-5db1-11ef-bccf-c7b262605968/mon.smithi121/config 2024-08-18T22:38:37.868 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:38:37 smithi121 ceph-mon[16788]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-08-18T22:38:37.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:38:37 smithi195 ceph-mon[23370]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-08-18T22:38:38.070 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:38.067+0000 7fac0cde1640 1 -- 172.21.15.121:0/156830820 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fac08102c80 msgr2=0x7fac080fc310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:38:38.070 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:38.067+0000 7fac0cde1640 1 --2- 172.21.15.121:0/156830820 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fac08102c80 0x7fac080fc310 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fabf00048d0 tx=0x7fabf0009da0 comp rx=0 tx=0).stop 2024-08-18T22:38:38.070 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:38.067+0000 7fac0cde1640 1 -- 172.21.15.121:0/156830820 shutdown_connections 2024-08-18T22:38:38.070 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:38.067+0000 7fac0cde1640 1 --2- 172.21.15.121:0/156830820 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fac08102c80 0x7fac080fc310 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:38:38.070 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:38.067+0000 7fac0cde1640 1 --2- 172.21.15.121:0/156830820 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fac081022e0 0x7fac081026b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:38:38.070 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:38.067+0000 7fac0cde1640 1 -- 172.21.15.121:0/156830820 >> 172.21.15.121:0/156830820 conn(0x7fac080f7eb0 msgr2=0x7fac080fa2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:38:38.070 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:38.067+0000 7fac0cde1640 1 -- 172.21.15.121:0/156830820 shutdown_connections 2024-08-18T22:38:38.070 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:38.067+0000 7fac0cde1640 1 -- 172.21.15.121:0/156830820 wait complete. 2024-08-18T22:38:38.070 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:38.068+0000 7fac0cde1640 1 Processor -- start 2024-08-18T22:38:38.070 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:38.068+0000 7fac0cde1640 1 -- start start 2024-08-18T22:38:38.072 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:38.068+0000 7fac0cde1640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fac081022e0 0x7fac08113020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:38:38.072 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:38.068+0000 7fac0cde1640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fac08102c80 0x7fac08113560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:38:38.072 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:38.068+0000 7fac0cde1640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac08113bf0 con 0x7fac08102c80 2024-08-18T22:38:38.072 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:38.068+0000 7fac0cde1640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac0810cfa0 con 0x7fac081022e0 2024-08-18T22:38:38.072 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:38.068+0000 7fac05d9b640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fac08102c80 0x7fac08113560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:38:38.072 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:38.068+0000 7fac05d9b640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fac08102c80 0x7fac08113560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:36760/0 (socket says 172.21.15.121:36760) 2024-08-18T22:38:38.072 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:38.068+0000 7fac05d9b640 1 -- 172.21.15.121:0/3217327039 learned_addr learned my addr 172.21.15.121:0/3217327039 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-18T22:38:38.072 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:38.068+0000 7fac05d9b640 1 -- 172.21.15.121:0/3217327039 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fac081022e0 msgr2=0x7fac08113020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:38:38.072 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:38.068+0000 7fac05d9b640 1 --2- 172.21.15.121:0/3217327039 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fac081022e0 0x7fac08113020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:38:38.072 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:38.068+0000 7fac05d9b640 1 -- 172.21.15.121:0/3217327039 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabf0005040 con 0x7fac08102c80 2024-08-18T22:38:38.072 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:38.069+0000 7fac05d9b640 1 --2- 172.21.15.121:0/3217327039 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fac08102c80 0x7fac08113560 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fabf0003080 tx=0x7fabf0009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:38:38.073 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:38.069+0000 7fabfeffd640 1 -- 172.21.15.121:0/3217327039 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fabf0038070 con 0x7fac08102c80 2024-08-18T22:38:38.073 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:38.069+0000 7fabfeffd640 1 -- 172.21.15.121:0/3217327039 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fabf00097e0 con 0x7fac08102c80 2024-08-18T22:38:38.073 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:38.069+0000 7fac0cde1640 1 -- 172.21.15.121:0/3217327039 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac0810d220 con 0x7fac08102c80 2024-08-18T22:38:38.073 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:38.069+0000 7fabfeffd640 1 -- 172.21.15.121:0/3217327039 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fabf003d420 con 0x7fac08102c80 2024-08-18T22:38:38.073 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:38.069+0000 7fac0cde1640 1 -- 172.21.15.121:0/3217327039 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac0810d6e0 con 0x7fac08102c80 2024-08-18T22:38:38.073 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:38.070+0000 7fac0cde1640 1 -- 172.21.15.121:0/3217327039 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac080fda50 con 0x7fac08102c80 2024-08-18T22:38:38.074 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:38.070+0000 7fabfeffd640 1 -- 172.21.15.121:0/3217327039 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 19) v1 ==== 85127+0+0 (secure 0 0 0) 0x7fabf0030020 con 0x7fac08102c80 2024-08-18T22:38:38.074 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:38.071+0000 7fabfeffd640 1 --2- 172.21.15.121:0/3217327039 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7fabf4067190 0x7fabf4069640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:38:38.074 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:38.071+0000 7fabfeffd640 1 -- 172.21.15.121:0/3217327039 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fabf00a4d70 con 0x7fac08102c80 2024-08-18T22:38:38.074 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:38.071+0000 7fac0659c640 1 --2- 172.21.15.121:0/3217327039 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7fabf4067190 0x7fabf4069640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:38:38.074 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:38.071+0000 7fac0659c640 1 --2- 172.21.15.121:0/3217327039 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7fabf4067190 0x7fabf4069640 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fac0000acf0 tx=0x7fac00009370 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:38:38.077 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:38.075+0000 7fabfeffd640 1 -- 172.21.15.121:0/3217327039 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fabf0072350 con 0x7fac08102c80 2024-08-18T22:38:38.228 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:38.226+0000 7fac0cde1640 1 -- 172.21.15.121:0/3217327039 --> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fac08109350 con 0x7fabf4067190 2024-08-18T22:38:38.230 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:38.228+0000 7fabfeffd640 1 -- 172.21.15.121:0/3217327039 <== mgr.14206 v2:172.21.15.121:6800/3225195982 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+27401 (secure 0 0 0) 0x7fac08109350 con 0x7fabf4067190 2024-08-18T22:38:38.231 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-08-18T22:38:38.231 INFO:teuthology.orchestra.run.smithi121.stderr:dumped all 2024-08-18T22:38:38.233 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:38.231+0000 7fac0cde1640 1 -- 172.21.15.121:0/3217327039 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7fabf4067190 msgr2=0x7fabf4069640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:38:38.233 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:38.231+0000 7fac0cde1640 1 --2- 172.21.15.121:0/3217327039 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7fabf4067190 0x7fabf4069640 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fac0000acf0 tx=0x7fac00009370 comp rx=0 tx=0).stop 2024-08-18T22:38:38.233 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:38.231+0000 7fac0cde1640 1 -- 172.21.15.121:0/3217327039 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fac08102c80 msgr2=0x7fac08113560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:38:38.233 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:38.231+0000 7fac0cde1640 1 --2- 172.21.15.121:0/3217327039 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fac08102c80 0x7fac08113560 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fabf0003080 tx=0x7fabf0009da0 comp rx=0 tx=0).stop 2024-08-18T22:38:38.233 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:38.231+0000 7fac0cde1640 1 -- 172.21.15.121:0/3217327039 shutdown_connections 2024-08-18T22:38:38.233 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:38.231+0000 7fac0cde1640 1 --2- 172.21.15.121:0/3217327039 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7fabf4067190 0x7fabf4069640 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:38:38.233 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:38.231+0000 7fac0cde1640 1 --2- 172.21.15.121:0/3217327039 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fac08102c80 0x7fac08113560 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:38:38.233 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:38.231+0000 7fac0cde1640 1 --2- 172.21.15.121:0/3217327039 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fac081022e0 0x7fac08113020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:38:38.233 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:38.231+0000 7fac0cde1640 1 -- 172.21.15.121:0/3217327039 >> 172.21.15.121:0/3217327039 conn(0x7fac080f7eb0 msgr2=0x7fac080f8e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:38:38.233 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:38.231+0000 7fac0cde1640 1 -- 172.21.15.121:0/3217327039 shutdown_connections 2024-08-18T22:38:38.233 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:38.231+0000 7fac0cde1640 1 -- 172.21.15.121:0/3217327039 wait complete. 2024-08-18T22:38:38.756 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:38:38 smithi121 ceph-mon[16788]: from='client.14418 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-18T22:38:38.756 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:38:38 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-18T22:38:38.823 INFO:teuthology.orchestra.run.smithi121.stdout:{"pg_ready":true,"pg_map":{"version":148,"stamp":"2024-08-18T22:38:36.557687+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":3,"kb":562470912,"kb_used":1788072,"kb_used_data":3924,"kb_used_omap":9,"kb_used_meta":1784054,"kb_avail":560682840,"statfs":{"total":575970213888,"available":574139228160,"internally_reserved":0,"allocated":4018176,"data_stored":2624466,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10224,"internal_metadata":1826871312},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001818"},"pg_stats":[{"pgid":"1.0","version":"24'117","reported_seq":188,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-08-18T22:37:51.163257+0000","last_change":"2024-08-18T22:37:27.290022+0000","last_active":"2024-08-18T22:37:51.163257+0000","last_peered":"2024-08-18T22:37:51.163257+0000","last_clean":"2024-08-18T22:37:51.163257+0000","last_became_active":"2024-08-18T22:37:27.289694+0000","last_became_peered":"2024-08-18T22:37:27.289694+0000","last_unstale":"2024-08-18T22:37:51.163257+0000","last_undegraded":"2024-08-18T22:37:51.163257+0000","last_fullsized":"2024-08-18T22:37:51.163257+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:36:42.854240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:36:42.854240+0000","last_clean_scrub_stamp":"2024-08-18T22:36:42.854240+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:09:55.523834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":5,"up_from":40,"seq":171798691852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":297720,"kb_used_data":364,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93447432,"statfs":{"total":95995035648,"available":95690170368,"internally_reserved":0,"allocated":372736,"data_stored":142227,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.503}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53400000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44400000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59699999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56599999999999995}]}]},{"osd":4,"up_from":35,"seq":150323855376,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":297720,"kb_used_data":364,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93447432,"statfs":{"total":95995035648,"available":95690170368,"internally_reserved":0,"allocated":372736,"data_stored":142227,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Aug 18 22:38:30 2024","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.629,"5min":0.629,"15min":0.629},"last":0.52900000000000003}]},{"osd":1,"last update":"Sun Aug 18 22:38:30 2024","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"last":0.46899999999999997}]},{"osd":2,"last update":"Sun Aug 18 22:38:30 2024","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.502}]},{"osd":3,"last update":"Sun Aug 18 22:38:30 2024","interfaces":[{"interface":"back","average":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"last":0.57599999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61199999999999999}]}]},{"osd":3,"up_from":27,"seq":115964117014,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":298300,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93446852,"statfs":{"total":95995035648,"available":95689576448,"internally_reserved":0,"allocated":966656,"data_stored":732595,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Aug 18 22:38:05 2024","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"last":0.439},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.51700000000000002}]},{"osd":1,"last update":"Sun Aug 18 22:38:05 2024","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.497,"15min":0.497},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"last":0.55900000000000005}]},{"osd":2,"last update":"Sun Aug 18 22:38:05 2024","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.499,"15min":0.499},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"last":0.44900000000000001}]},{"osd":4,"last update":"Sun Aug 18 22:38:31 2024","interfaces":[{"interface":"back","average":{"1min":0.38,"5min":0.38,"15min":0.38},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"last":0.31},{"interface":"front","average":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"last":0.376}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33200000000000002}]}]},{"osd":2,"up_from":19,"seq":81604378649,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":297724,"kb_used_data":364,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93447428,"statfs":{"total":95995035648,"available":95690166272,"internally_reserved":0,"allocated":372736,"data_stored":142227,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Aug 18 22:37:44 2024","interfaces":[{"interface":"back","average":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"min":{"1min":0.249,"5min":0.249,"15min":0.249},"max":{"1min":0.498,"5min":0.498,"15min":0.498},"last":0.25},{"interface":"front","average":{"1min":0.375,"5min":0.375,"15min":0.375},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"last":0.29799999999999999}]},{"osd":1,"last update":"Sun Aug 18 22:37:44 2024","interfaces":[{"interface":"back","average":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"last":0.28000000000000003},{"interface":"front","average":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.5,"5min":0.5,"15min":0.5},"last":0.26200000000000001}]},{"osd":3,"last update":"Sun Aug 18 22:38:06 2024","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"last":0.61399999999999999}]},{"osd":4,"last update":"Sun Aug 18 22:38:30 2024","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.51500000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":10.148}]}]},{"osd":1,"up_from":14,"seq":60129542175,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":298304,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93446848,"statfs":{"total":95995035648,"available":95689572352,"internally_reserved":0,"allocated":966656,"data_stored":732595,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Aug 18 22:38:16 2024","interfaces":[{"interface":"back","average":{"1min":0.33300000000000002,"5min":0.29999999999999999,"15min":0.29399999999999998},"min":{"1min":0.20399999999999999,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.35399999999999998,"5min":0.31900000000000001,"15min":0.313},"min":{"1min":0.223,"5min":0.223,"15min":0.223},"max":{"1min":0.502,"5min":0.502,"15min":0.502},"last":0.40899999999999997}]},{"osd":2,"last update":"Sun Aug 18 22:37:42 2024","interfaces":[{"interface":"back","average":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"min":{"1min":0.188,"5min":0.188,"15min":0.188},"max":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.372,"5min":0.372,"15min":0.372},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"last":0.442}]},{"osd":3,"last update":"Sun Aug 18 22:38:06 2024","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.499,"15min":0.499},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"last":0.66300000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56799999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60599999999999998}]}]},{"osd":0,"up_from":9,"seq":38654705701,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":298304,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93446848,"statfs":{"total":95995035648,"available":95689572352,"internally_reserved":0,"allocated":966656,"data_stored":732595,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Aug 18 22:38:19 2024","interfaces":[{"interface":"back","average":{"1min":0.318,"5min":0.33500000000000002,"15min":0.33800000000000002},"min":{"1min":0.20000000000000001,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":0.495,"5min":0.71799999999999997,"15min":0.71799999999999997},"last":0.27200000000000002},{"interface":"front","average":{"1min":0.31900000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"min":{"1min":0.20200000000000001,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":0.47599999999999998,"5min":0.65300000000000002,"15min":0.65300000000000002},"last":0.20499999999999999}]},{"osd":2,"last update":"Sun Aug 18 22:37:42 2024","interfaces":[{"interface":"back","average":{"1min":0.374,"5min":0.374,"15min":0.374},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"last":0.22700000000000001},{"interface":"front","average":{"1min":0.376,"5min":0.376,"15min":0.376},"min":{"1min":0.22600000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"last":0.253}]},{"osd":3,"last update":"Sun Aug 18 22:38:03 2024","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.62}]},{"osd":4,"last update":"Sun Aug 18 22:38:28 2024","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"last":0.61399999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57999999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-18T22:38:38.825 DEBUG:teuthology.orchestra.run.smithi121:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid b003123a-5db1-11ef-bccf-c7b262605968 -- ceph pg dump --format=json 2024-08-18T22:38:38.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:38:38 smithi195 ceph-mon[23370]: from='client.14418 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-18T22:38:38.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:38:38 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-18T22:38:39.086 INFO:teuthology.orchestra.run.smithi121.stderr:Inferring config /var/lib/ceph/b003123a-5db1-11ef-bccf-c7b262605968/mon.smithi121/config 2024-08-18T22:38:39.830 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:38:39 smithi121 ceph-mon[16788]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-08-18T22:38:39.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:38:39 smithi195 ceph-mon[23370]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-08-18T22:38:40.642 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:40.617+0000 7f6f67b44640 1 -- 172.21.15.121:0/1949988487 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6f600faa90 msgr2=0x7f6f600faf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:38:40.642 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:40.617+0000 7f6f67b44640 1 --2- 172.21.15.121:0/1949988487 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6f600faa90 0x7f6f600faf00 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f6f500048d0 tx=0x7f6f50009da0 comp rx=0 tx=0).stop 2024-08-18T22:38:40.642 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:40.617+0000 7f6f67b44640 1 -- 172.21.15.121:0/1949988487 shutdown_connections 2024-08-18T22:38:40.642 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:40.617+0000 7f6f67b44640 1 --2- 172.21.15.121:0/1949988487 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6f600faa90 0x7f6f600faf00 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:38:40.642 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:40.617+0000 7f6f67b44640 1 --2- 172.21.15.121:0/1949988487 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6f60102420 0x7f6f601027f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:38:40.643 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:40.617+0000 7f6f67b44640 1 -- 172.21.15.121:0/1949988487 >> 172.21.15.121:0/1949988487 conn(0x7f6f60070af0 msgr2=0x7f6f60070ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:38:40.643 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:40.617+0000 7f6f67b44640 1 -- 172.21.15.121:0/1949988487 shutdown_connections 2024-08-18T22:38:40.643 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:40.617+0000 7f6f67b44640 1 -- 172.21.15.121:0/1949988487 wait complete. 2024-08-18T22:38:40.643 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:40.618+0000 7f6f67b44640 1 Processor -- start 2024-08-18T22:38:40.643 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:40.618+0000 7f6f67b44640 1 -- start start 2024-08-18T22:38:40.643 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:40.618+0000 7f6f67b44640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6f600faa90 0x7f6f60113070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:38:40.643 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:40.618+0000 7f6f67b44640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6f60102420 0x7f6f601135b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:38:40.643 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:40.618+0000 7f6f67b44640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f60113bb0 con 0x7f6f600faa90 2024-08-18T22:38:40.643 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:40.618+0000 7f6f67b44640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f6010cff0 con 0x7f6f60102420 2024-08-18T22:38:40.643 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:40.618+0000 7f6f658e0640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6f600faa90 0x7f6f60113070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:38:40.643 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:40.618+0000 7f6f658e0640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6f600faa90 0x7f6f60113070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:36774/0 (socket says 172.21.15.121:36774) 2024-08-18T22:38:40.643 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:40.618+0000 7f6f658e0640 1 -- 172.21.15.121:0/3713910622 learned_addr learned my addr 172.21.15.121:0/3713910622 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-18T22:38:40.643 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:40.618+0000 7f6f650df640 1 --2- 172.21.15.121:0/3713910622 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6f60102420 0x7f6f601135b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:38:40.644 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:40.618+0000 7f6f658e0640 1 -- 172.21.15.121:0/3713910622 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6f60102420 msgr2=0x7f6f601135b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:38:40.644 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:40.618+0000 7f6f658e0640 1 --2- 172.21.15.121:0/3713910622 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6f60102420 0x7f6f601135b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:38:40.644 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:40.618+0000 7f6f658e0640 1 -- 172.21.15.121:0/3713910622 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f50005040 con 0x7f6f600faa90 2024-08-18T22:38:40.644 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:40.619+0000 7f6f658e0640 1 --2- 172.21.15.121:0/3713910622 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6f600faa90 0x7f6f60113070 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f6f5c002a50 tx=0x7f6f5c004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:38:40.644 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:40.620+0000 7f6f567fc640 1 -- 172.21.15.121:0/3713910622 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6f5c007c30 con 0x7f6f600faa90 2024-08-18T22:38:40.644 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:40.620+0000 7f6f567fc640 1 -- 172.21.15.121:0/3713910622 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f6f5c00f040 con 0x7f6f600faa90 2024-08-18T22:38:40.644 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:40.620+0000 7f6f567fc640 1 -- 172.21.15.121:0/3713910622 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6f5c00da90 con 0x7f6f600faa90 2024-08-18T22:38:40.644 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:40.620+0000 7f6f67b44640 1 -- 172.21.15.121:0/3713910622 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f6010d2d0 con 0x7f6f600faa90 2024-08-18T22:38:40.644 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:40.620+0000 7f6f67b44640 1 -- 172.21.15.121:0/3713910622 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f6010d7c0 con 0x7f6f600faa90 2024-08-18T22:38:40.644 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:40.621+0000 7f6f67b44640 1 -- 172.21.15.121:0/3713910622 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f60065590 con 0x7f6f600faa90 2024-08-18T22:38:40.644 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:40.621+0000 7f6f567fc640 1 -- 172.21.15.121:0/3713910622 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 19) v1 ==== 85127+0+0 (secure 0 0 0) 0x7f6f5c00dc30 con 0x7f6f600faa90 2024-08-18T22:38:40.644 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:40.622+0000 7f6f567fc640 1 --2- 172.21.15.121:0/3713910622 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7f6f4c067190 0x7f6f4c069640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:38:40.644 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:40.622+0000 7f6f567fc640 1 -- 172.21.15.121:0/3713910622 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f6f5c084030 con 0x7f6f600faa90 2024-08-18T22:38:40.644 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:40.622+0000 7f6f650df640 1 --2- 172.21.15.121:0/3713910622 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7f6f4c067190 0x7f6f4c069640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:38:40.645 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:40.622+0000 7f6f650df640 1 --2- 172.21.15.121:0/3713910622 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7f6f4c067190 0x7f6f4c069640 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f6f600fa5d0 tx=0x7f6f50035040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:38:40.645 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:40.626+0000 7f6f567fc640 1 -- 172.21.15.121:0/3713910622 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f6f5c051690 con 0x7f6f600faa90 2024-08-18T22:38:40.780 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:40.778+0000 7f6f67b44640 1 -- 172.21.15.121:0/3713910622 --> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f6f6004b4c0 con 0x7f6f4c067190 2024-08-18T22:38:40.781 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:40.779+0000 7f6f567fc640 1 -- 172.21.15.121:0/3713910622 <== mgr.14206 v2:172.21.15.121:6800/3225195982 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+27954 (secure 0 0 0) 0x7f6f6004b4c0 con 0x7f6f4c067190 2024-08-18T22:38:40.782 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-08-18T22:38:40.782 INFO:teuthology.orchestra.run.smithi121.stderr:dumped all 2024-08-18T22:38:40.784 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:40.781+0000 7f6f67b44640 1 -- 172.21.15.121:0/3713910622 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7f6f4c067190 msgr2=0x7f6f4c069640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:38:40.784 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:40.782+0000 7f6f67b44640 1 --2- 172.21.15.121:0/3713910622 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7f6f4c067190 0x7f6f4c069640 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f6f600fa5d0 tx=0x7f6f50035040 comp rx=0 tx=0).stop 2024-08-18T22:38:40.784 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:40.782+0000 7f6f67b44640 1 -- 172.21.15.121:0/3713910622 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6f600faa90 msgr2=0x7f6f60113070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:38:40.784 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:40.782+0000 7f6f67b44640 1 --2- 172.21.15.121:0/3713910622 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6f600faa90 0x7f6f60113070 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f6f5c002a50 tx=0x7f6f5c004600 comp rx=0 tx=0).stop 2024-08-18T22:38:40.784 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:40.782+0000 7f6f67b44640 1 -- 172.21.15.121:0/3713910622 shutdown_connections 2024-08-18T22:38:40.784 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:40.782+0000 7f6f67b44640 1 --2- 172.21.15.121:0/3713910622 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7f6f4c067190 0x7f6f4c069640 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:38:40.784 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:40.782+0000 7f6f67b44640 1 --2- 172.21.15.121:0/3713910622 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6f60102420 0x7f6f601135b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:38:40.784 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:40.782+0000 7f6f67b44640 1 --2- 172.21.15.121:0/3713910622 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6f600faa90 0x7f6f60113070 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:38:40.784 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:40.782+0000 7f6f67b44640 1 -- 172.21.15.121:0/3713910622 >> 172.21.15.121:0/3713910622 conn(0x7f6f60070af0 msgr2=0x7f6f600fe4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:38:40.784 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:40.782+0000 7f6f67b44640 1 -- 172.21.15.121:0/3713910622 shutdown_connections 2024-08-18T22:38:40.785 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:40.782+0000 7f6f67b44640 1 -- 172.21.15.121:0/3713910622 wait complete. 2024-08-18T22:38:41.396 INFO:teuthology.orchestra.run.smithi121.stdout:{"pg_ready":true,"pg_map":{"version":150,"stamp":"2024-08-18T22:38:40.558335+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":3,"kb":562470912,"kb_used":1788072,"kb_used_data":3924,"kb_used_omap":9,"kb_used_meta":1784054,"kb_avail":560682840,"statfs":{"total":575970213888,"available":574139228160,"internally_reserved":0,"allocated":4018176,"data_stored":2624466,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10224,"internal_metadata":1826871312},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001815"},"pg_stats":[{"pgid":"1.0","version":"24'117","reported_seq":188,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-08-18T22:37:51.163257+0000","last_change":"2024-08-18T22:37:27.290022+0000","last_active":"2024-08-18T22:37:51.163257+0000","last_peered":"2024-08-18T22:37:51.163257+0000","last_clean":"2024-08-18T22:37:51.163257+0000","last_became_active":"2024-08-18T22:37:27.289694+0000","last_became_peered":"2024-08-18T22:37:27.289694+0000","last_unstale":"2024-08-18T22:37:51.163257+0000","last_undegraded":"2024-08-18T22:37:51.163257+0000","last_fullsized":"2024-08-18T22:37:51.163257+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T22:36:42.854240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T22:36:42.854240+0000","last_clean_scrub_stamp":"2024-08-18T22:36:42.854240+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:09:55.523834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":5,"up_from":40,"seq":171798691853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":297720,"kb_used_data":364,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93447432,"statfs":{"total":95995035648,"available":95690170368,"internally_reserved":0,"allocated":372736,"data_stored":142227,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48399999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53800000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51900000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38100000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40400000000000003}]}]},{"osd":4,"up_from":35,"seq":150323855377,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":297720,"kb_used_data":364,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93447432,"statfs":{"total":95995035648,"available":95690170368,"internally_reserved":0,"allocated":372736,"data_stored":142227,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Aug 18 22:38:30 2024","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.629,"5min":0.629,"15min":0.629},"last":0.38500000000000001}]},{"osd":1,"last update":"Sun Aug 18 22:38:30 2024","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"last":0.44400000000000001}]},{"osd":2,"last update":"Sun Aug 18 22:38:30 2024","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.50700000000000001}]},{"osd":3,"last update":"Sun Aug 18 22:38:30 2024","interfaces":[{"interface":"back","average":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"last":0.34100000000000003},{"interface":"front","average":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"last":0.42199999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.373}]}]},{"osd":3,"up_from":27,"seq":115964117015,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":298300,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93446852,"statfs":{"total":95995035648,"available":95689576448,"internally_reserved":0,"allocated":966656,"data_stored":732595,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Aug 18 22:38:05 2024","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.57299999999999995}]},{"osd":1,"last update":"Sun Aug 18 22:38:05 2024","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.497,"15min":0.497},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"last":0.55400000000000005}]},{"osd":2,"last update":"Sun Aug 18 22:38:05 2024","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.499,"15min":0.499},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"last":0.51200000000000001}]},{"osd":4,"last update":"Sun Aug 18 22:38:31 2024","interfaces":[{"interface":"back","average":{"1min":0.38,"5min":0.38,"15min":0.38},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"last":0.27000000000000002},{"interface":"front","average":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"last":0.34999999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.309}]}]},{"osd":2,"up_from":19,"seq":81604378650,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":297724,"kb_used_data":364,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93447428,"statfs":{"total":95995035648,"available":95690166272,"internally_reserved":0,"allocated":372736,"data_stored":142227,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Aug 18 22:37:44 2024","interfaces":[{"interface":"back","average":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"min":{"1min":0.249,"5min":0.249,"15min":0.249},"max":{"1min":0.498,"5min":0.498,"15min":0.498},"last":0.27800000000000002},{"interface":"front","average":{"1min":0.375,"5min":0.375,"15min":0.375},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"last":0.32000000000000001}]},{"osd":1,"last update":"Sun Aug 18 22:37:44 2024","interfaces":[{"interface":"back","average":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"last":0.30199999999999999},{"interface":"front","average":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.5,"5min":0.5,"15min":0.5},"last":0.34100000000000003}]},{"osd":3,"last update":"Sun Aug 18 22:38:06 2024","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"last":0.60199999999999998}]},{"osd":4,"last update":"Sun Aug 18 22:38:30 2024","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.67600000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55800000000000005}]}]},{"osd":1,"up_from":14,"seq":60129542176,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":298304,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93446848,"statfs":{"total":95995035648,"available":95689572352,"internally_reserved":0,"allocated":966656,"data_stored":732595,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Aug 18 22:38:16 2024","interfaces":[{"interface":"back","average":{"1min":0.33300000000000002,"5min":0.29999999999999999,"15min":0.29399999999999998},"min":{"1min":0.20399999999999999,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"last":0.33400000000000002},{"interface":"front","average":{"1min":0.35399999999999998,"5min":0.31900000000000001,"15min":0.313},"min":{"1min":0.223,"5min":0.223,"15min":0.223},"max":{"1min":0.502,"5min":0.502,"15min":0.502},"last":0.35799999999999998}]},{"osd":2,"last update":"Sun Aug 18 22:37:42 2024","interfaces":[{"interface":"back","average":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"min":{"1min":0.188,"5min":0.188,"15min":0.188},"max":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"last":0.377},{"interface":"front","average":{"1min":0.372,"5min":0.372,"15min":0.372},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"last":0.39300000000000002}]},{"osd":3,"last update":"Sun Aug 18 22:38:06 2024","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.499,"15min":0.499},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"last":0.61899999999999999}]},{"osd":4,"last update":"Sun Aug 18 22:38:31 2024","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":2.4700000000000002,"5min":2.4700000000000002,"15min":2.4700000000000002},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"last":0.64200000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57199999999999995}]}]},{"osd":0,"up_from":9,"seq":38654705701,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":298304,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93446848,"statfs":{"total":95995035648,"available":95689572352,"internally_reserved":0,"allocated":966656,"data_stored":732595,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Aug 18 22:38:19 2024","interfaces":[{"interface":"back","average":{"1min":0.318,"5min":0.33500000000000002,"15min":0.33800000000000002},"min":{"1min":0.20000000000000001,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":0.495,"5min":0.71799999999999997,"15min":0.71799999999999997},"last":0.27200000000000002},{"interface":"front","average":{"1min":0.31900000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"min":{"1min":0.20200000000000001,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":0.47599999999999998,"5min":0.65300000000000002,"15min":0.65300000000000002},"last":0.20499999999999999}]},{"osd":2,"last update":"Sun Aug 18 22:37:42 2024","interfaces":[{"interface":"back","average":{"1min":0.374,"5min":0.374,"15min":0.374},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"last":0.22700000000000001},{"interface":"front","average":{"1min":0.376,"5min":0.376,"15min":0.376},"min":{"1min":0.22600000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"last":0.253}]},{"osd":3,"last update":"Sun Aug 18 22:38:03 2024","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.62}]},{"osd":4,"last update":"Sun Aug 18 22:38:28 2024","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"last":0.61399999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57999999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-18T22:38:41.397 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-08-18T22:38:41.397 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-08-18T22:38:41.397 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2024-08-18T22:38:41.397 DEBUG:teuthology.orchestra.run.smithi121:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid b003123a-5db1-11ef-bccf-c7b262605968 -- ceph health --format=json 2024-08-18T22:38:41.648 INFO:teuthology.orchestra.run.smithi121.stderr:Inferring config /var/lib/ceph/b003123a-5db1-11ef-bccf-c7b262605968/mon.smithi121/config 2024-08-18T22:38:41.895 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:38:41 smithi121 ceph-mon[16788]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-08-18T22:38:41.895 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:38:41 smithi121 ceph-mon[16788]: from='client.14422 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-18T22:38:41.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:38:41 smithi195 ceph-mon[23370]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-08-18T22:38:41.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:38:41 smithi195 ceph-mon[23370]: from='client.14422 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-18T22:38:43.134 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:43.129+0000 7f53dc69b640 1 -- 172.21.15.121:0/3863473342 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f53d4101200 msgr2=0x7f53d41015d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:38:43.134 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:43.129+0000 7f53dc69b640 1 --2- 172.21.15.121:0/3863473342 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f53d4101200 0x7f53d41015d0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f53d00048d0 tx=0x7f53d0009da0 comp rx=0 tx=0).stop 2024-08-18T22:38:43.134 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:43.130+0000 7f53dc69b640 1 -- 172.21.15.121:0/3863473342 shutdown_connections 2024-08-18T22:38:43.134 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:43.130+0000 7f53dc69b640 1 --2- 172.21.15.121:0/3863473342 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f53d4101ba0 0x7f53d40fb230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:38:43.134 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:43.130+0000 7f53dc69b640 1 --2- 172.21.15.121:0/3863473342 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f53d4101200 0x7f53d41015d0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:38:43.134 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:43.130+0000 7f53dc69b640 1 -- 172.21.15.121:0/3863473342 >> 172.21.15.121:0/3863473342 conn(0x7f53d40f6df0 msgr2=0x7f53d40f9200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:38:43.134 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:43.130+0000 7f53dc69b640 1 -- 172.21.15.121:0/3863473342 shutdown_connections 2024-08-18T22:38:43.134 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:43.130+0000 7f53dc69b640 1 -- 172.21.15.121:0/3863473342 wait complete. 2024-08-18T22:38:43.134 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:43.130+0000 7f53dc69b640 1 Processor -- start 2024-08-18T22:38:43.134 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:43.130+0000 7f53dc69b640 1 -- start start 2024-08-18T22:38:43.134 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:43.130+0000 7f53dc69b640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f53d4101200 0x7f53d410ace0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:38:43.135 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:43.130+0000 7f53dc69b640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f53d4101ba0 0x7f53d410b220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:38:43.135 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:43.130+0000 7f53dc69b640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53d410b760 con 0x7f53d4101200 2024-08-18T22:38:43.135 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:43.130+0000 7f53dc69b640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53d410b8d0 con 0x7f53d4101ba0 2024-08-18T22:38:43.135 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:43.131+0000 7f53da437640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f53d4101200 0x7f53d410ace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:38:43.135 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:43.131+0000 7f53da437640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f53d4101200 0x7f53d410ace0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:36806/0 (socket says 172.21.15.121:36806) 2024-08-18T22:38:43.135 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:43.131+0000 7f53da437640 1 -- 172.21.15.121:0/754648332 learned_addr learned my addr 172.21.15.121:0/754648332 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-18T22:38:43.135 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:43.131+0000 7f53d9c36640 1 --2- 172.21.15.121:0/754648332 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f53d4101ba0 0x7f53d410b220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:38:43.135 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:43.131+0000 7f53da437640 1 -- 172.21.15.121:0/754648332 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f53d4101ba0 msgr2=0x7f53d410b220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:38:43.135 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:43.131+0000 7f53da437640 1 --2- 172.21.15.121:0/754648332 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f53d4101ba0 0x7f53d410b220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:38:43.135 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:43.131+0000 7f53da437640 1 -- 172.21.15.121:0/754648332 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53d0005040 con 0x7f53d4101200 2024-08-18T22:38:43.135 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:43.131+0000 7f53da437640 1 --2- 172.21.15.121:0/754648332 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f53d4101200 0x7f53d410ace0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f53d0003080 tx=0x7f53d0009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:38:43.135 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:43.131+0000 7f53caffd640 1 -- 172.21.15.121:0/754648332 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f53d0038070 con 0x7f53d4101200 2024-08-18T22:38:43.135 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:43.131+0000 7f53caffd640 1 -- 172.21.15.121:0/754648332 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f53d00097e0 con 0x7f53d4101200 2024-08-18T22:38:43.135 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:43.131+0000 7f53dc69b640 1 -- 172.21.15.121:0/754648332 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53d410bb50 con 0x7f53d4101200 2024-08-18T22:38:43.136 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:43.131+0000 7f53caffd640 1 -- 172.21.15.121:0/754648332 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f53d003d420 con 0x7f53d4101200 2024-08-18T22:38:43.136 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:43.131+0000 7f53dc69b640 1 -- 172.21.15.121:0/754648332 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53d411da00 con 0x7f53d4101200 2024-08-18T22:38:43.136 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:43.132+0000 7f53dc69b640 1 -- 172.21.15.121:0/754648332 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53d40fc970 con 0x7f53d4101200 2024-08-18T22:38:43.137 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:43.133+0000 7f53caffd640 1 -- 172.21.15.121:0/754648332 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 19) v1 ==== 85127+0+0 (secure 0 0 0) 0x7f53d0030020 con 0x7f53d4101200 2024-08-18T22:38:43.137 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:43.133+0000 7f53caffd640 1 --2- 172.21.15.121:0/754648332 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7f53c0067190 0x7f53c0069640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:38:43.137 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:43.133+0000 7f53caffd640 1 -- 172.21.15.121:0/754648332 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f53d00a4bf0 con 0x7f53d4101200 2024-08-18T22:38:43.137 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:43.133+0000 7f53d9c36640 1 --2- 172.21.15.121:0/754648332 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7f53c0067190 0x7f53c0069640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:38:43.137 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:43.134+0000 7f53d9c36640 1 --2- 172.21.15.121:0/754648332 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7f53c0067190 0x7f53c0069640 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f53d410c620 tx=0x7f53c4009040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:38:43.139 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:43.138+0000 7f53caffd640 1 -- 172.21.15.121:0/754648332 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f53d00721d0 con 0x7f53d4101200 2024-08-18T22:38:43.327 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:43.325+0000 7f53dc69b640 1 -- 172.21.15.121:0/754648332 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f53d40fa9f0 con 0x7f53d4101200 2024-08-18T22:38:43.328 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:43.326+0000 7f53caffd640 1 -- 172.21.15.121:0/754648332 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f53d00757f0 con 0x7f53d4101200 2024-08-18T22:38:43.328 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-08-18T22:38:43.328 INFO:teuthology.orchestra.run.smithi121.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-08-18T22:38:43.329 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:43.327+0000 7f53dc69b640 1 -- 172.21.15.121:0/754648332 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7f53c0067190 msgr2=0x7f53c0069640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:38:43.329 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:43.327+0000 7f53dc69b640 1 --2- 172.21.15.121:0/754648332 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7f53c0067190 0x7f53c0069640 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f53d410c620 tx=0x7f53c4009040 comp rx=0 tx=0).stop 2024-08-18T22:38:43.330 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:43.327+0000 7f53dc69b640 1 -- 172.21.15.121:0/754648332 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f53d4101200 msgr2=0x7f53d410ace0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:38:43.330 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:43.327+0000 7f53dc69b640 1 --2- 172.21.15.121:0/754648332 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f53d4101200 0x7f53d410ace0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f53d0003080 tx=0x7f53d0009da0 comp rx=0 tx=0).stop 2024-08-18T22:38:43.330 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:43.328+0000 7f53dc69b640 1 -- 172.21.15.121:0/754648332 shutdown_connections 2024-08-18T22:38:43.330 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:43.328+0000 7f53dc69b640 1 --2- 172.21.15.121:0/754648332 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7f53c0067190 0x7f53c0069640 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:38:43.330 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:43.328+0000 7f53dc69b640 1 --2- 172.21.15.121:0/754648332 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f53d4101ba0 0x7f53d410b220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:38:43.330 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:43.328+0000 7f53dc69b640 1 --2- 172.21.15.121:0/754648332 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f53d4101200 0x7f53d410ace0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:38:43.330 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:43.328+0000 7f53dc69b640 1 -- 172.21.15.121:0/754648332 >> 172.21.15.121:0/754648332 conn(0x7f53d40f6df0 msgr2=0x7f53d40f7d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:38:43.330 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:43.328+0000 7f53dc69b640 1 -- 172.21.15.121:0/754648332 shutdown_connections 2024-08-18T22:38:43.330 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:43.328+0000 7f53dc69b640 1 -- 172.21.15.121:0/754648332 wait complete. 2024-08-18T22:38:43.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:38:43 smithi195 ceph-mon[23370]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-08-18T22:38:43.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:38:43 smithi195 ceph-mon[23370]: from='client.? 172.21.15.121:0/754648332' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-08-18T22:38:43.960 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:38:43 smithi121 ceph-mon[16788]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-08-18T22:38:43.960 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:38:43 smithi121 ceph-mon[16788]: from='client.? 172.21.15.121:0/754648332' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-08-18T22:38:43.985 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2024-08-18T22:38:43.985 INFO:tasks.cephadm:Setup complete, yielding 2024-08-18T22:38:43.985 INFO:teuthology.run_tasks:Running task print... 2024-08-18T22:38:43.993 INFO:teuthology.task.print:**** done end installing quincy cephadm ... 2024-08-18T22:38:43.993 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-08-18T22:38:44.036 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi121.front.sepia.ceph.com 2024-08-18T22:38:44.036 DEBUG:teuthology.orchestra.run.smithi121:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b003123a-5db1-11ef-bccf-c7b262605968 -- bash -c 'ceph config set mgr mgr/cephadm/use_repo_digest true --force' 2024-08-18T22:38:44.284 INFO:teuthology.orchestra.run.smithi121.stderr:Inferring config /var/lib/ceph/b003123a-5db1-11ef-bccf-c7b262605968/mon.smithi121/config 2024-08-18T22:38:45.840 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:45.837+0000 7f0d191f2640 1 -- 172.21.15.121:0/1203731137 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0d140fc4c0 msgr2=0x7f0d140fc930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:38:45.840 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:45.837+0000 7f0d191f2640 1 --2- 172.21.15.121:0/1203731137 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0d140fc4c0 0x7f0d140fc930 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f0cfc009c50 tx=0x7f0cfc004d10 comp rx=0 tx=0).stop 2024-08-18T22:38:45.841 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:45.837+0000 7f0d191f2640 1 -- 172.21.15.121:0/1203731137 shutdown_connections 2024-08-18T22:38:45.841 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:45.837+0000 7f0d191f2640 1 --2- 172.21.15.121:0/1203731137 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0d140fc4c0 0x7f0d140fc930 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:38:45.841 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:45.837+0000 7f0d191f2640 1 --2- 172.21.15.121:0/1203731137 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0d140fb1f0 0x7f0d140fb600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:38:45.841 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:45.837+0000 7f0d191f2640 1 -- 172.21.15.121:0/1203731137 >> 172.21.15.121:0/1203731137 conn(0x7f0d140f69b0 msgr2=0x7f0d140f8de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:38:45.841 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:45.837+0000 7f0d191f2640 1 -- 172.21.15.121:0/1203731137 shutdown_connections 2024-08-18T22:38:45.841 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:45.837+0000 7f0d191f2640 1 -- 172.21.15.121:0/1203731137 wait complete. 2024-08-18T22:38:45.841 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:45.838+0000 7f0d191f2640 1 Processor -- start 2024-08-18T22:38:45.841 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:45.838+0000 7f0d191f2640 1 -- start start 2024-08-18T22:38:45.841 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:45.838+0000 7f0d191f2640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0d140fb1f0 0x7f0d1410fbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:38:45.841 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:45.838+0000 7f0d191f2640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0d140fc4c0 0x7f0d14112100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:38:45.841 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:45.838+0000 7f0d191f2640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d140664d0 con 0x7f0d140fb1f0 2024-08-18T22:38:45.841 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:45.838+0000 7f0d191f2640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d14066640 con 0x7f0d140fc4c0 2024-08-18T22:38:45.841 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:45.838+0000 7f0d12d9d640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0d140fb1f0 0x7f0d1410fbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:38:45.842 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:45.838+0000 7f0d12d9d640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0d140fb1f0 0x7f0d1410fbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:36820/0 (socket says 172.21.15.121:36820) 2024-08-18T22:38:45.842 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:45.838+0000 7f0d12d9d640 1 -- 172.21.15.121:0/2121194317 learned_addr learned my addr 172.21.15.121:0/2121194317 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-18T22:38:45.842 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:45.838+0000 7f0d1259c640 1 --2- 172.21.15.121:0/2121194317 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0d140fc4c0 0x7f0d14112100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:38:45.842 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:45.838+0000 7f0d12d9d640 1 -- 172.21.15.121:0/2121194317 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0d140fc4c0 msgr2=0x7f0d14112100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:38:45.842 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:45.838+0000 7f0d12d9d640 1 --2- 172.21.15.121:0/2121194317 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0d140fc4c0 0x7f0d14112100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:38:45.842 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:45.839+0000 7f0d12d9d640 1 -- 172.21.15.121:0/2121194317 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cfc0098b0 con 0x7f0d140fb1f0 2024-08-18T22:38:45.842 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:45.839+0000 7f0d12d9d640 1 --2- 172.21.15.121:0/2121194317 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0d140fb1f0 0x7f0d1410fbb0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f0d0c00c830 tx=0x7f0d0c004430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:38:45.843 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:45.839+0000 7f0d0b7fe640 1 -- 172.21.15.121:0/2121194317 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0d0c00a850 con 0x7f0d140fb1f0 2024-08-18T22:38:45.843 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:45.839+0000 7f0d0b7fe640 1 -- 172.21.15.121:0/2121194317 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f0d0c00ae50 con 0x7f0d140fb1f0 2024-08-18T22:38:45.843 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:45.839+0000 7f0d191f2640 1 -- 172.21.15.121:0/2121194317 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d141126a0 con 0x7f0d140fb1f0 2024-08-18T22:38:45.844 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:45.839+0000 7f0d0b7fe640 1 -- 172.21.15.121:0/2121194317 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0d0c0113a0 con 0x7f0d140fb1f0 2024-08-18T22:38:45.844 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:45.839+0000 7f0d191f2640 1 -- 172.21.15.121:0/2121194317 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d14112c10 con 0x7f0d140fb1f0 2024-08-18T22:38:45.844 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:45.840+0000 7f0d191f2640 1 -- 172.21.15.121:0/2121194317 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d140fa650 con 0x7f0d140fb1f0 2024-08-18T22:38:45.844 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:45.840+0000 7f0d0b7fe640 1 -- 172.21.15.121:0/2121194317 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 19) v1 ==== 85127+0+0 (secure 0 0 0) 0x7f0d0c011560 con 0x7f0d140fb1f0 2024-08-18T22:38:45.844 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:45.841+0000 7f0d0b7fe640 1 --2- 172.21.15.121:0/2121194317 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7f0d00067190 0x7f0d00069640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:38:45.844 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:45.841+0000 7f0d0b7fe640 1 -- 172.21.15.121:0/2121194317 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f0d0c084920 con 0x7f0d140fb1f0 2024-08-18T22:38:45.844 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:45.841+0000 7f0d1259c640 1 --2- 172.21.15.121:0/2121194317 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7f0d00067190 0x7f0d00069640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:38:45.844 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:45.841+0000 7f0d1259c640 1 --2- 172.21.15.121:0/2121194317 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7f0d00067190 0x7f0d00069640 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f0cfc000f80 tx=0x7f0cfc004d10 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:38:45.846 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:45.846+0000 7f0d0b7fe640 1 -- 172.21.15.121:0/2121194317 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f0d0c0520d0 con 0x7f0d140fb1f0 2024-08-18T22:38:45.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:38:45 smithi195 ceph-mon[23370]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-08-18T22:38:46.002 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:46.000+0000 7f0d191f2640 1 -- 172.21.15.121:0/2121194317 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/use_repo_digest}] v 0) v1 -- 0x7f0d1404b4c0 con 0x7f0d140fb1f0 2024-08-18T22:38:46.002 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:38:45 smithi121 ceph-mon[16788]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-08-18T22:38:46.006 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:46.004+0000 7f0d0b7fe640 1 -- 172.21.15.121:0/2121194317 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/use_repo_digest}]=0 v20)=0 v20) v1 ==== 143+0+0 (secure 0 0 0) 0x7f0d0c0556f0 con 0x7f0d140fb1f0 2024-08-18T22:38:46.008 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:46.006+0000 7f0d191f2640 1 -- 172.21.15.121:0/2121194317 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7f0d00067190 msgr2=0x7f0d00069640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:38:46.008 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:46.006+0000 7f0d191f2640 1 --2- 172.21.15.121:0/2121194317 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7f0d00067190 0x7f0d00069640 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f0cfc000f80 tx=0x7f0cfc004d10 comp rx=0 tx=0).stop 2024-08-18T22:38:46.008 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:46.006+0000 7f0d191f2640 1 -- 172.21.15.121:0/2121194317 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0d140fb1f0 msgr2=0x7f0d1410fbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:38:46.008 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:46.006+0000 7f0d191f2640 1 --2- 172.21.15.121:0/2121194317 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0d140fb1f0 0x7f0d1410fbb0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f0d0c00c830 tx=0x7f0d0c004430 comp rx=0 tx=0).stop 2024-08-18T22:38:46.008 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:46.006+0000 7f0d191f2640 1 -- 172.21.15.121:0/2121194317 shutdown_connections 2024-08-18T22:38:46.008 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:46.006+0000 7f0d191f2640 1 --2- 172.21.15.121:0/2121194317 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7f0d00067190 0x7f0d00069640 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:38:46.008 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:46.006+0000 7f0d191f2640 1 --2- 172.21.15.121:0/2121194317 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0d140fc4c0 0x7f0d14112100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:38:46.009 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:46.006+0000 7f0d191f2640 1 --2- 172.21.15.121:0/2121194317 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0d140fb1f0 0x7f0d1410fbb0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:38:46.009 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:46.006+0000 7f0d191f2640 1 -- 172.21.15.121:0/2121194317 >> 172.21.15.121:0/2121194317 conn(0x7f0d140f69b0 msgr2=0x7f0d140f8190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:38:46.009 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:46.006+0000 7f0d191f2640 1 -- 172.21.15.121:0/2121194317 shutdown_connections 2024-08-18T22:38:46.009 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:46.006+0000 7f0d191f2640 1 -- 172.21.15.121:0/2121194317 wait complete. 2024-08-18T22:38:46.625 INFO:teuthology.run_tasks:Running task print... 2024-08-18T22:38:46.984 INFO:teuthology.task.print:**** done cephadm.shell ceph config set mgr... 2024-08-18T22:38:46.984 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-08-18T22:38:47.015 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi121.front.sepia.ceph.com 2024-08-18T22:38:47.016 DEBUG:teuthology.orchestra.run.smithi121:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b003123a-5db1-11ef-bccf-c7b262605968 -- bash -c 'ceph orch status' 2024-08-18T22:38:47.263 INFO:teuthology.orchestra.run.smithi121.stderr:Inferring config /var/lib/ceph/b003123a-5db1-11ef-bccf-c7b262605968/mon.smithi121/config 2024-08-18T22:38:47.333 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:38:47 smithi121 ceph-mon[16788]: from='client.? 172.21.15.121:0/2121194317' entity='client.admin' 2024-08-18T22:38:47.334 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:38:47 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-18T22:38:47.334 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:38:47 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:38:47.334 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:38:47 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-18T22:38:47.334 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:38:47 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:38:47.409 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:38:47 smithi195 ceph-mon[23370]: from='client.? 172.21.15.121:0/2121194317' entity='client.admin' 2024-08-18T22:38:47.409 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:38:47 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-18T22:38:47.409 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:38:47 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:38:47.409 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:38:47 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-18T22:38:47.409 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:38:47 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:38:48.310 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:38:48 smithi195 ceph-mon[23370]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-08-18T22:38:48.333 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:38:48 smithi121 ceph-mon[16788]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-08-18T22:38:48.768 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:48.760+0000 7fb819fe6640 1 -- 172.21.15.121:0/1570696173 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb814065980 msgr2=0x7fb8140fef40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:38:48.768 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:48.760+0000 7fb819fe6640 1 --2- 172.21.15.121:0/1570696173 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb814065980 0x7fb8140fef40 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fb804009c50 tx=0x7fb804004d10 comp rx=0 tx=0).stop 2024-08-18T22:38:48.768 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:48.760+0000 7fb819fe6640 1 -- 172.21.15.121:0/1570696173 shutdown_connections 2024-08-18T22:38:48.768 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:48.760+0000 7fb819fe6640 1 --2- 172.21.15.121:0/1570696173 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb8140ff480 0x7fb814101860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:38:48.768 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:48.760+0000 7fb819fe6640 1 --2- 172.21.15.121:0/1570696173 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb814065980 0x7fb8140fef40 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:38:48.768 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:48.760+0000 7fb819fe6640 1 -- 172.21.15.121:0/1570696173 >> 172.21.15.121:0/1570696173 conn(0x7fb8140f69b0 msgr2=0x7fb8140f8dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:38:48.768 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:48.760+0000 7fb819fe6640 1 -- 172.21.15.121:0/1570696173 shutdown_connections 2024-08-18T22:38:48.768 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:48.760+0000 7fb819fe6640 1 -- 172.21.15.121:0/1570696173 wait complete. 2024-08-18T22:38:48.768 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:48.760+0000 7fb819fe6640 1 Processor -- start 2024-08-18T22:38:48.768 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:48.761+0000 7fb819fe6640 1 -- start start 2024-08-18T22:38:48.768 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:48.761+0000 7fb819fe6640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb814065980 0x7fb81410cf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:38:48.769 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:48.761+0000 7fb819fe6640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb8140ff480 0x7fb81410d470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:38:48.769 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:48.761+0000 7fb819fe6640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb81410dac0 con 0x7fb8140ff480 2024-08-18T22:38:48.769 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:48.761+0000 7fb819fe6640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb81410e1b0 con 0x7fb814065980 2024-08-18T22:38:48.769 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:48.761+0000 7fb812ffd640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb8140ff480 0x7fb81410d470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:38:48.769 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:48.761+0000 7fb812ffd640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb8140ff480 0x7fb81410d470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:41704/0 (socket says 172.21.15.121:41704) 2024-08-18T22:38:48.769 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:48.761+0000 7fb812ffd640 1 -- 172.21.15.121:0/2297212126 learned_addr learned my addr 172.21.15.121:0/2297212126 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-18T22:38:48.769 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:48.761+0000 7fb8137fe640 1 --2- 172.21.15.121:0/2297212126 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb814065980 0x7fb81410cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:38:48.769 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:48.761+0000 7fb812ffd640 1 -- 172.21.15.121:0/2297212126 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb814065980 msgr2=0x7fb81410cf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:38:48.769 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:48.761+0000 7fb812ffd640 1 --2- 172.21.15.121:0/2297212126 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb814065980 0x7fb81410cf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:38:48.769 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:48.761+0000 7fb812ffd640 1 -- 172.21.15.121:0/2297212126 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8040098b0 con 0x7fb8140ff480 2024-08-18T22:38:48.769 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:48.761+0000 7fb812ffd640 1 --2- 172.21.15.121:0/2297212126 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb8140ff480 0x7fb81410d470 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fb80800c790 tx=0x7fb8080043c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:38:48.769 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:48.761+0000 7fb7fbfff640 1 -- 172.21.15.121:0/2297212126 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb80800a820 con 0x7fb8140ff480 2024-08-18T22:38:48.769 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:48.761+0000 7fb819fe6640 1 -- 172.21.15.121:0/2297212126 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb81410e440 con 0x7fb8140ff480 2024-08-18T22:38:48.769 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:48.761+0000 7fb7fbfff640 1 -- 172.21.15.121:0/2297212126 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fb80800ae20 con 0x7fb8140ff480 2024-08-18T22:38:48.770 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:48.761+0000 7fb7fbfff640 1 -- 172.21.15.121:0/2297212126 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb8080113a0 con 0x7fb8140ff480 2024-08-18T22:38:48.770 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:48.761+0000 7fb819fe6640 1 -- 172.21.15.121:0/2297212126 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb81410e9e0 con 0x7fb8140ff480 2024-08-18T22:38:48.770 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:48.762+0000 7fb819fe6640 1 -- 172.21.15.121:0/2297212126 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8140fa630 con 0x7fb8140ff480 2024-08-18T22:38:48.770 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:48.763+0000 7fb7fbfff640 1 -- 172.21.15.121:0/2297212126 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 19) v1 ==== 85127+0+0 (secure 0 0 0) 0x7fb808012400 con 0x7fb8140ff480 2024-08-18T22:38:48.770 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:48.763+0000 7fb7fbfff640 1 --2- 172.21.15.121:0/2297212126 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7fb7fc067190 0x7fb7fc069640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:38:48.770 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:48.763+0000 7fb7fbfff640 1 -- 172.21.15.121:0/2297212126 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fb8080849e0 con 0x7fb8140ff480 2024-08-18T22:38:48.770 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:48.763+0000 7fb8137fe640 1 --2- 172.21.15.121:0/2297212126 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7fb7fc067190 0x7fb7fc069640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:38:48.770 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:48.764+0000 7fb8137fe640 1 --2- 172.21.15.121:0/2297212126 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7fb7fc067190 0x7fb7fc069640 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fb804000f80 tx=0x7fb804004d10 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:38:48.771 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:48.767+0000 7fb7fbfff640 1 -- 172.21.15.121:0/2297212126 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fb808052040 con 0x7fb8140ff480 2024-08-18T22:38:48.937 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:48.936+0000 7fb819fe6640 1 -- 172.21.15.121:0/2297212126 --> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] -- mgr_command(tid 0: {"prefix": "orch status", "target": ["mon-mgr", ""]}) v1 -- 0x7fb81410ee10 con 0x7fb7fc067190 2024-08-18T22:38:48.938 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:48.937+0000 7fb7fbfff640 1 -- 172.21.15.121:0/2297212126 <== mgr.14206 v2:172.21.15.121:6800/3225195982 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7fb81410ee10 con 0x7fb7fc067190 2024-08-18T22:38:48.938 INFO:teuthology.orchestra.run.smithi121.stdout:Backend: cephadm 2024-08-18T22:38:48.938 INFO:teuthology.orchestra.run.smithi121.stdout:Available: Yes 2024-08-18T22:38:48.938 INFO:teuthology.orchestra.run.smithi121.stdout:Paused: No 2024-08-18T22:38:48.940 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:48.939+0000 7fb819fe6640 1 -- 172.21.15.121:0/2297212126 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7fb7fc067190 msgr2=0x7fb7fc069640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:38:48.940 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:48.939+0000 7fb819fe6640 1 --2- 172.21.15.121:0/2297212126 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7fb7fc067190 0x7fb7fc069640 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fb804000f80 tx=0x7fb804004d10 comp rx=0 tx=0).stop 2024-08-18T22:38:48.940 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:48.939+0000 7fb819fe6640 1 -- 172.21.15.121:0/2297212126 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb8140ff480 msgr2=0x7fb81410d470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:38:48.940 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:48.939+0000 7fb819fe6640 1 --2- 172.21.15.121:0/2297212126 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb8140ff480 0x7fb81410d470 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fb80800c790 tx=0x7fb8080043c0 comp rx=0 tx=0).stop 2024-08-18T22:38:48.940 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:48.939+0000 7fb819fe6640 1 -- 172.21.15.121:0/2297212126 shutdown_connections 2024-08-18T22:38:48.940 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:48.939+0000 7fb819fe6640 1 --2- 172.21.15.121:0/2297212126 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7fb7fc067190 0x7fb7fc069640 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:38:48.941 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:48.939+0000 7fb819fe6640 1 --2- 172.21.15.121:0/2297212126 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb8140ff480 0x7fb81410d470 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:38:48.941 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:48.939+0000 7fb819fe6640 1 --2- 172.21.15.121:0/2297212126 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb814065980 0x7fb81410cf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:38:48.941 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:48.939+0000 7fb819fe6640 1 -- 172.21.15.121:0/2297212126 >> 172.21.15.121:0/2297212126 conn(0x7fb8140f69b0 msgr2=0x7fb8140f6d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:38:48.941 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:48.939+0000 7fb819fe6640 1 -- 172.21.15.121:0/2297212126 shutdown_connections 2024-08-18T22:38:48.941 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:48.939+0000 7fb819fe6640 1 -- 172.21.15.121:0/2297212126 wait complete. 2024-08-18T22:38:49.629 DEBUG:teuthology.orchestra.run.smithi121:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b003123a-5db1-11ef-bccf-c7b262605968 -- bash -c 'ceph orch ps' 2024-08-18T22:38:49.875 INFO:teuthology.orchestra.run.smithi121.stderr:Inferring config /var/lib/ceph/b003123a-5db1-11ef-bccf-c7b262605968/mon.smithi121/config 2024-08-18T22:38:50.275 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:38:50 smithi121 ceph-mon[16788]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-08-18T22:38:50.275 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:38:50 smithi121 ceph-mon[16788]: from='client.14434 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-18T22:38:50.409 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:38:50 smithi195 ceph-mon[23370]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-08-18T22:38:50.409 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:38:50 smithi195 ceph-mon[23370]: from='client.14434 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-18T22:38:51.478 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:51.475+0000 7fce60ca6640 1 -- 172.21.15.121:0/3686528086 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fce5c0fc490 msgr2=0x7fce5c0fc900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:38:51.478 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:51.475+0000 7fce60ca6640 1 --2- 172.21.15.121:0/3686528086 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fce5c0fc490 0x7fce5c0fc900 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fce440048d0 tx=0x7fce44009da0 comp rx=0 tx=0).stop 2024-08-18T22:38:51.478 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:51.475+0000 7fce60ca6640 1 -- 172.21.15.121:0/3686528086 shutdown_connections 2024-08-18T22:38:51.478 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:51.475+0000 7fce60ca6640 1 --2- 172.21.15.121:0/3686528086 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fce5c0fc490 0x7fce5c0fc900 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:38:51.478 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:51.475+0000 7fce60ca6640 1 --2- 172.21.15.121:0/3686528086 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fce5c0fb1c0 0x7fce5c0fb5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:38:51.478 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:51.475+0000 7fce60ca6640 1 -- 172.21.15.121:0/3686528086 >> 172.21.15.121:0/3686528086 conn(0x7fce5c0f69a0 msgr2=0x7fce5c0f8db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:38:51.478 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:51.475+0000 7fce60ca6640 1 -- 172.21.15.121:0/3686528086 shutdown_connections 2024-08-18T22:38:51.478 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:51.475+0000 7fce60ca6640 1 -- 172.21.15.121:0/3686528086 wait complete. 2024-08-18T22:38:51.479 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:51.476+0000 7fce60ca6640 1 Processor -- start 2024-08-18T22:38:51.479 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:51.476+0000 7fce60ca6640 1 -- start start 2024-08-18T22:38:51.479 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:51.476+0000 7fce60ca6640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fce5c0fb1c0 0x7fce5c066180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:38:51.479 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:51.476+0000 7fce60ca6640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fce5c0fc490 0x7fce5c111c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:38:51.479 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:51.476+0000 7fce60ca6640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce5c1122c0 con 0x7fce5c0fc490 2024-08-18T22:38:51.479 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:51.476+0000 7fce60ca6640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce5c112400 con 0x7fce5c0fb1c0 2024-08-18T22:38:51.479 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:51.476+0000 7fce53fff640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fce5c0fc490 0x7fce5c111c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:38:51.479 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:51.476+0000 7fce53fff640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fce5c0fc490 0x7fce5c111c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:41720/0 (socket says 172.21.15.121:41720) 2024-08-18T22:38:51.479 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:51.476+0000 7fce53fff640 1 -- 172.21.15.121:0/4158072080 learned_addr learned my addr 172.21.15.121:0/4158072080 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-18T22:38:51.479 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:51.476+0000 7fce5a59c640 1 --2- 172.21.15.121:0/4158072080 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fce5c0fb1c0 0x7fce5c066180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:38:51.479 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:51.476+0000 7fce53fff640 1 -- 172.21.15.121:0/4158072080 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fce5c0fb1c0 msgr2=0x7fce5c066180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:38:51.479 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:51.476+0000 7fce53fff640 1 --2- 172.21.15.121:0/4158072080 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fce5c0fb1c0 0x7fce5c066180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:38:51.479 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:51.476+0000 7fce53fff640 1 -- 172.21.15.121:0/4158072080 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce44005040 con 0x7fce5c0fc490 2024-08-18T22:38:51.480 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:51.476+0000 7fce5a59c640 1 --2- 172.21.15.121:0/4158072080 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fce5c0fb1c0 0x7fce5c066180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:38:51.480 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:51.477+0000 7fce53fff640 1 --2- 172.21.15.121:0/4158072080 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fce5c0fc490 0x7fce5c111c00 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fce44003080 tx=0x7fce44009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:38:51.480 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:51.477+0000 7fce52ffd640 1 -- 172.21.15.121:0/4158072080 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fce44038070 con 0x7fce5c0fc490 2024-08-18T22:38:51.480 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:51.477+0000 7fce60ca6640 1 -- 172.21.15.121:0/4158072080 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce5c112680 con 0x7fce5c0fc490 2024-08-18T22:38:51.480 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:51.477+0000 7fce52ffd640 1 -- 172.21.15.121:0/4158072080 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fce44009800 con 0x7fce5c0fc490 2024-08-18T22:38:51.480 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:51.477+0000 7fce52ffd640 1 -- 172.21.15.121:0/4158072080 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fce44033660 con 0x7fce5c0fc490 2024-08-18T22:38:51.480 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:51.477+0000 7fce60ca6640 1 -- 172.21.15.121:0/4158072080 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce5c112b40 con 0x7fce5c0fc490 2024-08-18T22:38:51.481 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:51.478+0000 7fce60ca6640 1 -- 172.21.15.121:0/4158072080 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce5c1055d0 con 0x7fce5c0fc490 2024-08-18T22:38:51.481 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:51.478+0000 7fce52ffd640 1 -- 172.21.15.121:0/4158072080 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 19) v1 ==== 85127+0+0 (secure 0 0 0) 0x7fce44030020 con 0x7fce5c0fc490 2024-08-18T22:38:51.481 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:51.478+0000 7fce52ffd640 1 --2- 172.21.15.121:0/4158072080 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7fce48067190 0x7fce48069640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:38:51.481 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:51.479+0000 7fce52ffd640 1 -- 172.21.15.121:0/4158072080 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fce440a4960 con 0x7fce5c0fc490 2024-08-18T22:38:51.481 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:51.479+0000 7fce5a59c640 1 --2- 172.21.15.121:0/4158072080 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7fce48067190 0x7fce48069640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:38:51.481 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:51.479+0000 7fce5a59c640 1 --2- 172.21.15.121:0/4158072080 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7fce48067190 0x7fce48069640 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fce5c065f30 tx=0x7fce4c007510 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:38:51.483 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:51.483+0000 7fce52ffd640 1 -- 172.21.15.121:0/4158072080 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fce44071f40 con 0x7fce5c0fc490 2024-08-18T22:38:51.650 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:51.649+0000 7fce60ca6640 1 -- 172.21.15.121:0/4158072080 --> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fce5c100ec0 con 0x7fce48067190 2024-08-18T22:38:51.658 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:51.657+0000 7fce52ffd640 1 -- 172.21.15.121:0/4158072080 <== mgr.14206 v2:172.21.15.121:6800/3225195982 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+2826 (secure 0 0 0) 0x7fce5c100ec0 con 0x7fce48067190 2024-08-18T22:38:51.658 INFO:teuthology.orchestra.run.smithi121.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-08-18T22:38:51.658 INFO:teuthology.orchestra.run.smithi121.stdout:alertmanager.smithi121 smithi121 *:9093,9094 running (3m) 2m ago 4m 25.5M - 0.25.0 c8568f914cd2 0e56a9950e47 2024-08-18T22:38:51.659 INFO:teuthology.orchestra.run.smithi121.stdout:crash.smithi121 smithi121 running (4m) 2m ago 4m 6899k - 17.2.7-1406-gdf62bdcc 774894bef55f cf3deea293c3 2024-08-18T22:38:51.659 INFO:teuthology.orchestra.run.smithi121.stdout:crash.smithi195 smithi195 running (4m) 61s ago 4m 6899k - 17.2.7-1406-gdf62bdcc 774894bef55f 98aa377daf77 2024-08-18T22:38:51.659 INFO:teuthology.orchestra.run.smithi121.stdout:grafana.smithi121 smithi121 *:3000 running (3m) 2m ago 4m 80.6M - 9.4.7 954c08fa6188 07c3d993780f 2024-08-18T22:38:51.659 INFO:teuthology.orchestra.run.smithi121.stdout:mgr.smithi121.lopxqc smithi121 *:9283,8765,8443 running (6m) 2m ago 6m 437M - 17.2.7-1406-gdf62bdcc 774894bef55f 3ac16dcb26e3 2024-08-18T22:38:51.659 INFO:teuthology.orchestra.run.smithi121.stdout:mgr.smithi195.acttsj smithi195 *:8443,9283 running (3m) 61s ago 3m 401M - 17.2.7-1406-gdf62bdcc 774894bef55f 3d19eb0493d5 2024-08-18T22:38:51.659 INFO:teuthology.orchestra.run.smithi121.stdout:mon.smithi121 smithi121 running (6m) 2m ago 6m 44.3M 2048M 17.2.7-1406-gdf62bdcc 774894bef55f 4a7bead235ac 2024-08-18T22:38:51.659 INFO:teuthology.orchestra.run.smithi121.stdout:mon.smithi195 smithi195 running (3m) 61s ago 3m 38.9M 2048M 17.2.7-1406-gdf62bdcc 774894bef55f ced63ecfbfae 2024-08-18T22:38:51.659 INFO:teuthology.orchestra.run.smithi121.stdout:node-exporter.smithi121 smithi121 *:9100 running (4m) 2m ago 4m 15.9M - 1.5.0 0da6a335fe13 81d394827425 2024-08-18T22:38:51.659 INFO:teuthology.orchestra.run.smithi121.stdout:node-exporter.smithi195 smithi195 *:9100 running (3m) 61s ago 3m 15.7M - 1.5.0 0da6a335fe13 e09a01163b83 2024-08-18T22:38:51.659 INFO:teuthology.orchestra.run.smithi121.stdout:osd.0 smithi121 running (3m) 2m ago 3m 36.8M 4287M 17.2.7-1406-gdf62bdcc 774894bef55f 30859216633d 2024-08-18T22:38:51.659 INFO:teuthology.orchestra.run.smithi121.stdout:osd.1 smithi121 running (2m) 2m ago 2m 40.0M 4287M 17.2.7-1406-gdf62bdcc 774894bef55f ef5fadfd753f 2024-08-18T22:38:51.659 INFO:teuthology.orchestra.run.smithi121.stdout:osd.2 smithi121 running (2m) 2m ago 2m 35.1M 4287M 17.2.7-1406-gdf62bdcc 774894bef55f 3fa061e41f99 2024-08-18T22:38:51.659 INFO:teuthology.orchestra.run.smithi121.stdout:osd.3 smithi195 running (115s) 61s ago 115s 40.5M 5312M 17.2.7-1406-gdf62bdcc 774894bef55f 15d30b1b459e 2024-08-18T22:38:51.659 INFO:teuthology.orchestra.run.smithi121.stdout:osd.4 smithi195 running (91s) 61s ago 91s 37.0M 5312M 17.2.7-1406-gdf62bdcc 774894bef55f 99ed156dfd36 2024-08-18T22:38:51.660 INFO:teuthology.orchestra.run.smithi121.stdout:osd.5 smithi195 running (67s) 61s ago 66s 11.7M 5312M 17.2.7-1406-gdf62bdcc 774894bef55f e7eff7bdb752 2024-08-18T22:38:51.660 INFO:teuthology.orchestra.run.smithi121.stdout:prometheus.smithi121 smithi121 *:9095 running (3m) 2m ago 4m 37.6M - 2.43.0 a07b618ecd1d d6016f1b45a3 2024-08-18T22:38:51.660 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:51.659+0000 7fce60ca6640 1 -- 172.21.15.121:0/4158072080 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7fce48067190 msgr2=0x7fce48069640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:38:51.660 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:51.659+0000 7fce60ca6640 1 --2- 172.21.15.121:0/4158072080 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7fce48067190 0x7fce48069640 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fce5c065f30 tx=0x7fce4c007510 comp rx=0 tx=0).stop 2024-08-18T22:38:51.660 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:51.659+0000 7fce60ca6640 1 -- 172.21.15.121:0/4158072080 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fce5c0fc490 msgr2=0x7fce5c111c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:38:51.660 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:51.659+0000 7fce60ca6640 1 --2- 172.21.15.121:0/4158072080 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fce5c0fc490 0x7fce5c111c00 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fce44003080 tx=0x7fce44009da0 comp rx=0 tx=0).stop 2024-08-18T22:38:51.660 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:51.659+0000 7fce60ca6640 1 -- 172.21.15.121:0/4158072080 shutdown_connections 2024-08-18T22:38:51.661 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:51.659+0000 7fce60ca6640 1 --2- 172.21.15.121:0/4158072080 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7fce48067190 0x7fce48069640 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:38:51.661 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:51.659+0000 7fce60ca6640 1 --2- 172.21.15.121:0/4158072080 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fce5c0fc490 0x7fce5c111c00 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:38:51.661 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:51.659+0000 7fce60ca6640 1 --2- 172.21.15.121:0/4158072080 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fce5c0fb1c0 0x7fce5c066180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:38:51.661 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:51.659+0000 7fce60ca6640 1 -- 172.21.15.121:0/4158072080 >> 172.21.15.121:0/4158072080 conn(0x7fce5c0f69a0 msgr2=0x7fce5c0ff7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:38:51.661 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:51.659+0000 7fce60ca6640 1 -- 172.21.15.121:0/4158072080 shutdown_connections 2024-08-18T22:38:51.661 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:51.659+0000 7fce60ca6640 1 -- 172.21.15.121:0/4158072080 wait complete. 2024-08-18T22:38:52.333 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:38:52 smithi121 ceph-mon[16788]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-08-18T22:38:52.409 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:38:52 smithi195 ceph-mon[23370]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-08-18T22:38:52.479 DEBUG:teuthology.orchestra.run.smithi121:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b003123a-5db1-11ef-bccf-c7b262605968 -- bash -c 'ceph orch ls' 2024-08-18T22:38:52.727 INFO:teuthology.orchestra.run.smithi121.stderr:Inferring config /var/lib/ceph/b003123a-5db1-11ef-bccf-c7b262605968/mon.smithi121/config 2024-08-18T22:38:53.115 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:38:53 smithi121 ceph-mon[16788]: from='client.14438 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-18T22:38:53.409 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:38:53 smithi195 ceph-mon[23370]: from='client.14438 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-18T22:38:54.121 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:38:54 smithi121 ceph-mon[16788]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-08-18T22:38:54.121 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:38:54 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-18T22:38:54.325 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:54.322+0000 7ff5cfd5d640 1 -- 172.21.15.121:0/567345192 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff5c80fc4c0 msgr2=0x7ff5c80fc930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:38:54.326 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:54.322+0000 7ff5cfd5d640 1 --2- 172.21.15.121:0/567345192 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff5c80fc4c0 0x7ff5c80fc930 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7ff5b80048d0 tx=0x7ff5b8009da0 comp rx=0 tx=0).stop 2024-08-18T22:38:54.326 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:54.322+0000 7ff5cfd5d640 1 -- 172.21.15.121:0/567345192 shutdown_connections 2024-08-18T22:38:54.326 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:54.322+0000 7ff5cfd5d640 1 --2- 172.21.15.121:0/567345192 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff5c80fc4c0 0x7ff5c80fc930 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:38:54.326 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:54.322+0000 7ff5cfd5d640 1 --2- 172.21.15.121:0/567345192 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff5c80fb1f0 0x7ff5c80fb600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:38:54.326 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:54.322+0000 7ff5cfd5d640 1 -- 172.21.15.121:0/567345192 >> 172.21.15.121:0/567345192 conn(0x7ff5c80f69b0 msgr2=0x7ff5c80f8de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:38:54.326 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:54.322+0000 7ff5cfd5d640 1 -- 172.21.15.121:0/567345192 shutdown_connections 2024-08-18T22:38:54.326 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:54.322+0000 7ff5cfd5d640 1 -- 172.21.15.121:0/567345192 wait complete. 2024-08-18T22:38:54.327 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:54.323+0000 7ff5cfd5d640 1 Processor -- start 2024-08-18T22:38:54.327 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:54.323+0000 7ff5cfd5d640 1 -- start start 2024-08-18T22:38:54.327 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:54.323+0000 7ff5cfd5d640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff5c80fb1f0 0x7ff5c810fc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:38:54.327 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:54.323+0000 7ff5cfd5d640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff5c80fc4c0 0x7ff5c8112190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:38:54.327 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:54.323+0000 7ff5cfd5d640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5c80665f0 con 0x7ff5c80fb1f0 2024-08-18T22:38:54.327 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:54.323+0000 7ff5cfd5d640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5c8066760 con 0x7ff5c80fc4c0 2024-08-18T22:38:54.327 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:54.323+0000 7ff5cdaf9640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff5c80fb1f0 0x7ff5c810fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:38:54.328 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:54.323+0000 7ff5cdaf9640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff5c80fb1f0 0x7ff5c810fc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:41730/0 (socket says 172.21.15.121:41730) 2024-08-18T22:38:54.328 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:54.323+0000 7ff5cdaf9640 1 -- 172.21.15.121:0/708985338 learned_addr learned my addr 172.21.15.121:0/708985338 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-18T22:38:54.328 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:54.323+0000 7ff5cd2f8640 1 --2- 172.21.15.121:0/708985338 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff5c80fc4c0 0x7ff5c8112190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:38:54.328 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:54.324+0000 7ff5cdaf9640 1 -- 172.21.15.121:0/708985338 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff5c80fc4c0 msgr2=0x7ff5c8112190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:38:54.328 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:54.324+0000 7ff5cdaf9640 1 --2- 172.21.15.121:0/708985338 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff5c80fc4c0 0x7ff5c8112190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:38:54.328 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:54.324+0000 7ff5cdaf9640 1 -- 172.21.15.121:0/708985338 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5b8005040 con 0x7ff5c80fb1f0 2024-08-18T22:38:54.328 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:54.324+0000 7ff5cdaf9640 1 --2- 172.21.15.121:0/708985338 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff5c80fb1f0 0x7ff5c810fc40 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7ff5c400b790 tx=0x7ff5c40091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:38:54.328 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:54.324+0000 7ff5be7fc640 1 -- 172.21.15.121:0/708985338 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff5c400c700 con 0x7ff5c80fb1f0 2024-08-18T22:38:54.328 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:54.324+0000 7ff5be7fc640 1 -- 172.21.15.121:0/708985338 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7ff5c400cd00 con 0x7ff5c80fb1f0 2024-08-18T22:38:54.328 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:54.324+0000 7ff5cfd5d640 1 -- 172.21.15.121:0/708985338 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5c8112790 con 0x7ff5c80fb1f0 2024-08-18T22:38:54.328 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:54.324+0000 7ff5be7fc640 1 -- 172.21.15.121:0/708985338 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff5c4015e70 con 0x7ff5c80fb1f0 2024-08-18T22:38:54.328 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:54.324+0000 7ff5cfd5d640 1 -- 172.21.15.121:0/708985338 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5c8112cb0 con 0x7ff5c80fb1f0 2024-08-18T22:38:54.329 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:54.325+0000 7ff5cfd5d640 1 -- 172.21.15.121:0/708985338 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5c804b4c0 con 0x7ff5c80fb1f0 2024-08-18T22:38:54.330 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:54.325+0000 7ff5be7fc640 1 -- 172.21.15.121:0/708985338 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 19) v1 ==== 85127+0+0 (secure 0 0 0) 0x7ff5c4012070 con 0x7ff5c80fb1f0 2024-08-18T22:38:54.330 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:54.326+0000 7ff5be7fc640 1 --2- 172.21.15.121:0/708985338 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7ff5b4067190 0x7ff5b4069640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:38:54.330 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:54.326+0000 7ff5be7fc640 1 -- 172.21.15.121:0/708985338 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7ff5c40842d0 con 0x7ff5c80fb1f0 2024-08-18T22:38:54.330 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:54.326+0000 7ff5cd2f8640 1 --2- 172.21.15.121:0/708985338 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7ff5b4067190 0x7ff5b4069640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:38:54.330 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:54.326+0000 7ff5cd2f8640 1 --2- 172.21.15.121:0/708985338 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7ff5b4067190 0x7ff5b4069640 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7ff5b8004540 tx=0x7ff5b8035040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:38:54.331 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:54.330+0000 7ff5be7fc640 1 -- 172.21.15.121:0/708985338 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7ff5c4051930 con 0x7ff5c80fb1f0 2024-08-18T22:38:54.409 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:38:54 smithi195 ceph-mon[23370]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-08-18T22:38:54.409 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:38:54 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-18T22:38:54.491 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:54.490+0000 7ff5cfd5d640 1 -- 172.21.15.121:0/708985338 --> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] -- mgr_command(tid 0: {"prefix": "orch ls", "target": ["mon-mgr", ""]}) v1 -- 0x7ff5c805d8f0 con 0x7ff5b4067190 2024-08-18T22:38:54.495 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:54.494+0000 7ff5be7fc640 1 -- 172.21.15.121:0/708985338 <== mgr.14206 v2:172.21.15.121:6800/3225195982 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+1179 (secure 0 0 0) 0x7ff5c805d8f0 con 0x7ff5b4067190 2024-08-18T22:38:54.495 INFO:teuthology.orchestra.run.smithi121.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2024-08-18T22:38:54.495 INFO:teuthology.orchestra.run.smithi121.stdout:alertmanager ?:9093,9094 1/1 2m ago 5m count:1 2024-08-18T22:38:54.495 INFO:teuthology.orchestra.run.smithi121.stdout:crash 2/2 2m ago 5m * 2024-08-18T22:38:54.495 INFO:teuthology.orchestra.run.smithi121.stdout:grafana ?:3000 1/1 2m ago 5m count:1 2024-08-18T22:38:54.496 INFO:teuthology.orchestra.run.smithi121.stdout:mgr 2/2 2m ago 5m count:2 2024-08-18T22:38:54.496 INFO:teuthology.orchestra.run.smithi121.stdout:mon 2/2 2m ago 4m smithi121:172.21.15.121=smithi121;smithi195:172.21.15.195=smithi195;count:2 2024-08-18T22:38:54.496 INFO:teuthology.orchestra.run.smithi121.stdout:node-exporter ?:9100 2/2 2m ago 5m * 2024-08-18T22:38:54.496 INFO:teuthology.orchestra.run.smithi121.stdout:osd 6 2m ago - 2024-08-18T22:38:54.496 INFO:teuthology.orchestra.run.smithi121.stdout:prometheus ?:9095 1/1 2m ago 5m count:1 2024-08-18T22:38:54.497 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:54.496+0000 7ff5cfd5d640 1 -- 172.21.15.121:0/708985338 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7ff5b4067190 msgr2=0x7ff5b4069640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:38:54.497 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:54.496+0000 7ff5cfd5d640 1 --2- 172.21.15.121:0/708985338 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7ff5b4067190 0x7ff5b4069640 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7ff5b8004540 tx=0x7ff5b8035040 comp rx=0 tx=0).stop 2024-08-18T22:38:54.497 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:54.496+0000 7ff5cfd5d640 1 -- 172.21.15.121:0/708985338 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff5c80fb1f0 msgr2=0x7ff5c810fc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:38:54.498 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:54.496+0000 7ff5cfd5d640 1 --2- 172.21.15.121:0/708985338 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff5c80fb1f0 0x7ff5c810fc40 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7ff5c400b790 tx=0x7ff5c40091d0 comp rx=0 tx=0).stop 2024-08-18T22:38:54.498 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:54.496+0000 7ff5cfd5d640 1 -- 172.21.15.121:0/708985338 shutdown_connections 2024-08-18T22:38:54.498 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:54.496+0000 7ff5cfd5d640 1 --2- 172.21.15.121:0/708985338 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7ff5b4067190 0x7ff5b4069640 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:38:54.498 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:54.496+0000 7ff5cfd5d640 1 --2- 172.21.15.121:0/708985338 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff5c80fc4c0 0x7ff5c8112190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:38:54.498 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:54.496+0000 7ff5cfd5d640 1 --2- 172.21.15.121:0/708985338 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff5c80fb1f0 0x7ff5c810fc40 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:38:54.498 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:54.496+0000 7ff5cfd5d640 1 -- 172.21.15.121:0/708985338 >> 172.21.15.121:0/708985338 conn(0x7ff5c80f69b0 msgr2=0x7ff5c80ff830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:38:54.498 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:54.496+0000 7ff5cfd5d640 1 -- 172.21.15.121:0/708985338 shutdown_connections 2024-08-18T22:38:54.498 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:54.496+0000 7ff5cfd5d640 1 -- 172.21.15.121:0/708985338 wait complete. 2024-08-18T22:38:55.218 DEBUG:teuthology.orchestra.run.smithi121:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b003123a-5db1-11ef-bccf-c7b262605968 -- bash -c 'ceph orch host ls' 2024-08-18T22:38:55.476 INFO:teuthology.orchestra.run.smithi121.stderr:Inferring config /var/lib/ceph/b003123a-5db1-11ef-bccf-c7b262605968/mon.smithi121/config 2024-08-18T22:38:56.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:38:56 smithi121 ceph-mon[16788]: from='client.14442 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-08-18T22:38:56.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:38:56 smithi121 ceph-mon[16788]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-08-18T22:38:56.409 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:38:56 smithi195 ceph-mon[23370]: from='client.14442 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-08-18T22:38:56.409 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:38:56 smithi195 ceph-mon[23370]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-08-18T22:38:57.066 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:57.063+0000 7f5e6e4db640 1 -- 172.21.15.121:0/2300639387 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5e680fc2c0 msgr2=0x7f5e680fc6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:38:57.135 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:57.063+0000 7f5e6e4db640 1 --2- 172.21.15.121:0/2300639387 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5e680fc2c0 0x7f5e680fc6d0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f5e580048d0 tx=0x7f5e58009da0 comp rx=0 tx=0).stop 2024-08-18T22:38:57.135 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:57.063+0000 7f5e6e4db640 1 -- 172.21.15.121:0/2300639387 shutdown_connections 2024-08-18T22:38:57.136 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:57.063+0000 7f5e6e4db640 1 --2- 172.21.15.121:0/2300639387 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5e680fd590 0x7f5e680fda00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:38:57.136 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:57.063+0000 7f5e6e4db640 1 --2- 172.21.15.121:0/2300639387 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5e680fc2c0 0x7f5e680fc6d0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:38:57.136 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:57.063+0000 7f5e6e4db640 1 -- 172.21.15.121:0/2300639387 >> 172.21.15.121:0/2300639387 conn(0x7f5e680f7a80 msgr2=0x7f5e680f9eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:38:57.136 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:57.063+0000 7f5e6e4db640 1 -- 172.21.15.121:0/2300639387 shutdown_connections 2024-08-18T22:38:57.136 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:57.063+0000 7f5e6e4db640 1 -- 172.21.15.121:0/2300639387 wait complete. 2024-08-18T22:38:57.136 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:57.063+0000 7f5e6e4db640 1 Processor -- start 2024-08-18T22:38:57.136 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:57.064+0000 7f5e6e4db640 1 -- start start 2024-08-18T22:38:57.136 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:57.064+0000 7f5e6e4db640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5e680fc2c0 0x7f5e6810ce40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:38:57.136 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:57.064+0000 7f5e6e4db640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5e680fd590 0x7f5e6810d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:38:57.136 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:57.064+0000 7f5e6e4db640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e6810d9d0 con 0x7f5e680fd590 2024-08-18T22:38:57.136 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:57.064+0000 7f5e6e4db640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e6810e110 con 0x7f5e680fc2c0 2024-08-18T22:38:57.136 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:57.064+0000 7f5e677fe640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5e680fd590 0x7f5e6810d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:38:57.137 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:57.064+0000 7f5e677fe640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5e680fd590 0x7f5e6810d380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:41320/0 (socket says 172.21.15.121:41320) 2024-08-18T22:38:57.137 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:57.064+0000 7f5e677fe640 1 -- 172.21.15.121:0/4154605423 learned_addr learned my addr 172.21.15.121:0/4154605423 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-18T22:38:57.137 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:57.064+0000 7f5e677fe640 1 -- 172.21.15.121:0/4154605423 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5e680fc2c0 msgr2=0x7f5e6810ce40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:38:57.137 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:57.064+0000 7f5e67fff640 1 --2- 172.21.15.121:0/4154605423 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5e680fc2c0 0x7f5e6810ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:38:57.137 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:57.064+0000 7f5e677fe640 1 --2- 172.21.15.121:0/4154605423 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5e680fc2c0 0x7f5e6810ce40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:38:57.137 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:57.064+0000 7f5e677fe640 1 -- 172.21.15.121:0/4154605423 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e58005040 con 0x7f5e680fd590 2024-08-18T22:38:57.137 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:57.064+0000 7f5e677fe640 1 --2- 172.21.15.121:0/4154605423 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5e680fd590 0x7f5e6810d380 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f5e5c00c810 tx=0x7f5e5c0043c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:38:57.137 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:57.065+0000 7f5e64ff9640 1 -- 172.21.15.121:0/4154605423 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5e5c00a820 con 0x7f5e680fd590 2024-08-18T22:38:57.137 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:57.065+0000 7f5e64ff9640 1 -- 172.21.15.121:0/4154605423 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f5e5c00ae20 con 0x7f5e680fd590 2024-08-18T22:38:57.137 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:57.065+0000 7f5e64ff9640 1 -- 172.21.15.121:0/4154605423 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5e5c0115c0 con 0x7f5e680fd590 2024-08-18T22:38:57.137 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:57.065+0000 7f5e6e4db640 1 -- 172.21.15.121:0/4154605423 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e6810e3a0 con 0x7f5e680fd590 2024-08-18T22:38:57.137 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:57.065+0000 7f5e6e4db640 1 -- 172.21.15.121:0/4154605423 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e6810e940 con 0x7f5e680fd590 2024-08-18T22:38:57.138 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:57.066+0000 7f5e6e4db640 1 -- 172.21.15.121:0/4154605423 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e680fb720 con 0x7f5e680fd590 2024-08-18T22:38:57.139 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:57.066+0000 7f5e64ff9640 1 -- 172.21.15.121:0/4154605423 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 19) v1 ==== 85127+0+0 (secure 0 0 0) 0x7f5e5c012840 con 0x7f5e680fd590 2024-08-18T22:38:57.139 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:57.067+0000 7f5e64ff9640 1 --2- 172.21.15.121:0/4154605423 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7f5e50067190 0x7f5e50069640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:38:57.139 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:57.067+0000 7f5e64ff9640 1 -- 172.21.15.121:0/4154605423 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f5e5c084d60 con 0x7f5e680fd590 2024-08-18T22:38:57.139 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:57.067+0000 7f5e67fff640 1 --2- 172.21.15.121:0/4154605423 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7f5e50067190 0x7f5e50069640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:38:57.139 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:57.067+0000 7f5e67fff640 1 --2- 172.21.15.121:0/4154605423 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7f5e50067190 0x7f5e50069640 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f5e58007ac0 tx=0x7f5e58009da0 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:38:57.139 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:57.071+0000 7f5e64ff9640 1 -- 172.21.15.121:0/4154605423 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f5e5c089070 con 0x7f5e680fd590 2024-08-18T22:38:57.236 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:57.235+0000 7f5e6e4db640 1 -- 172.21.15.121:0/4154605423 --> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f5e6810ee50 con 0x7f5e50067190 2024-08-18T22:38:57.237 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:57.236+0000 7f5e64ff9640 1 -- 172.21.15.121:0/4154605423 <== mgr.14206 v2:172.21.15.121:6800/3225195982 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+148 (secure 0 0 0) 0x7f5e6810ee50 con 0x7f5e50067190 2024-08-18T22:38:57.238 INFO:teuthology.orchestra.run.smithi121.stdout:HOST ADDR LABELS STATUS 2024-08-18T22:38:57.238 INFO:teuthology.orchestra.run.smithi121.stdout:smithi121 172.21.15.121 2024-08-18T22:38:57.238 INFO:teuthology.orchestra.run.smithi121.stdout:smithi195 172.21.15.195 2024-08-18T22:38:57.238 INFO:teuthology.orchestra.run.smithi121.stdout:2 hosts in cluster 2024-08-18T22:38:57.239 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:57.238+0000 7f5e6e4db640 1 -- 172.21.15.121:0/4154605423 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7f5e50067190 msgr2=0x7f5e50069640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:38:57.240 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:57.238+0000 7f5e6e4db640 1 --2- 172.21.15.121:0/4154605423 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7f5e50067190 0x7f5e50069640 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f5e58007ac0 tx=0x7f5e58009da0 comp rx=0 tx=0).stop 2024-08-18T22:38:57.240 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:57.238+0000 7f5e6e4db640 1 -- 172.21.15.121:0/4154605423 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5e680fd590 msgr2=0x7f5e6810d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:38:57.240 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:57.238+0000 7f5e6e4db640 1 --2- 172.21.15.121:0/4154605423 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5e680fd590 0x7f5e6810d380 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f5e5c00c810 tx=0x7f5e5c0043c0 comp rx=0 tx=0).stop 2024-08-18T22:38:57.240 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:57.239+0000 7f5e6e4db640 1 -- 172.21.15.121:0/4154605423 shutdown_connections 2024-08-18T22:38:57.240 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:57.239+0000 7f5e6e4db640 1 --2- 172.21.15.121:0/4154605423 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7f5e50067190 0x7f5e50069640 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:38:57.240 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:57.239+0000 7f5e6e4db640 1 --2- 172.21.15.121:0/4154605423 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5e680fd590 0x7f5e6810d380 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:38:57.240 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:57.239+0000 7f5e6e4db640 1 --2- 172.21.15.121:0/4154605423 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5e680fc2c0 0x7f5e6810ce40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:38:57.240 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:57.239+0000 7f5e6e4db640 1 -- 172.21.15.121:0/4154605423 >> 172.21.15.121:0/4154605423 conn(0x7f5e680f7a80 msgr2=0x7f5e680f9230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:38:57.240 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:57.239+0000 7f5e6e4db640 1 -- 172.21.15.121:0/4154605423 shutdown_connections 2024-08-18T22:38:57.240 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:57.239+0000 7f5e6e4db640 1 -- 172.21.15.121:0/4154605423 wait complete. 2024-08-18T22:38:57.807 DEBUG:teuthology.orchestra.run.smithi121:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b003123a-5db1-11ef-bccf-c7b262605968 -- bash -c 'ceph orch device ls' 2024-08-18T22:38:58.056 INFO:teuthology.orchestra.run.smithi121.stderr:Inferring config /var/lib/ceph/b003123a-5db1-11ef-bccf-c7b262605968/mon.smithi121/config 2024-08-18T22:38:58.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:38:58 smithi121 ceph-mon[16788]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-08-18T22:38:58.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:38:58 smithi121 ceph-mon[16788]: from='client.14446 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-08-18T22:38:58.409 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:38:58 smithi195 ceph-mon[23370]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-08-18T22:38:58.409 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:38:58 smithi195 ceph-mon[23370]: from='client.14446 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-08-18T22:38:59.564 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:59.562+0000 7f7b284a7640 1 -- 172.21.15.121:0/2293144392 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7b200fb1d0 msgr2=0x7f7b200fb5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:38:59.565 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:59.562+0000 7f7b284a7640 1 --2- 172.21.15.121:0/2293144392 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7b200fb1d0 0x7f7b200fb5e0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f7b1c0048d0 tx=0x7f7b1c009da0 comp rx=0 tx=0).stop 2024-08-18T22:38:59.565 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:59.562+0000 7f7b284a7640 1 -- 172.21.15.121:0/2293144392 shutdown_connections 2024-08-18T22:38:59.565 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:59.562+0000 7f7b284a7640 1 --2- 172.21.15.121:0/2293144392 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7b200fc4a0 0x7f7b200fc910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:38:59.565 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:59.562+0000 7f7b284a7640 1 --2- 172.21.15.121:0/2293144392 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7b200fb1d0 0x7f7b200fb5e0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:38:59.565 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:59.562+0000 7f7b284a7640 1 -- 172.21.15.121:0/2293144392 >> 172.21.15.121:0/2293144392 conn(0x7f7b200f69b0 msgr2=0x7f7b200f8dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:38:59.565 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:59.562+0000 7f7b284a7640 1 -- 172.21.15.121:0/2293144392 shutdown_connections 2024-08-18T22:38:59.565 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:59.562+0000 7f7b284a7640 1 -- 172.21.15.121:0/2293144392 wait complete. 2024-08-18T22:38:59.565 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:59.563+0000 7f7b284a7640 1 Processor -- start 2024-08-18T22:38:59.565 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:59.563+0000 7f7b284a7640 1 -- start start 2024-08-18T22:38:59.565 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:59.563+0000 7f7b284a7640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7b200fb1d0 0x7f7b2010be30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:38:59.565 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:59.563+0000 7f7b284a7640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7b200fc4a0 0x7f7b2010c370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:38:59.565 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:59.563+0000 7f7b284a7640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b2010d100 con 0x7f7b200fb1d0 2024-08-18T22:38:59.565 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:59.563+0000 7f7b284a7640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b2010d270 con 0x7f7b200fc4a0 2024-08-18T22:38:59.566 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:59.563+0000 7f7b26243640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7b200fb1d0 0x7f7b2010be30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:38:59.566 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:59.563+0000 7f7b26243640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7b200fb1d0 0x7f7b2010be30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:41348/0 (socket says 172.21.15.121:41348) 2024-08-18T22:38:59.566 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:59.563+0000 7f7b26243640 1 -- 172.21.15.121:0/3962612061 learned_addr learned my addr 172.21.15.121:0/3962612061 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-18T22:38:59.566 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:59.563+0000 7f7b26243640 1 -- 172.21.15.121:0/3962612061 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7b200fc4a0 msgr2=0x7f7b2010c370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:38:59.566 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:59.563+0000 7f7b26243640 1 --2- 172.21.15.121:0/3962612061 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7b200fc4a0 0x7f7b2010c370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:38:59.566 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:59.563+0000 7f7b26243640 1 -- 172.21.15.121:0/3962612061 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b1c005040 con 0x7f7b200fb1d0 2024-08-18T22:38:59.566 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:59.563+0000 7f7b26243640 1 --2- 172.21.15.121:0/3962612061 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7b200fb1d0 0x7f7b2010be30 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f7b1c003080 tx=0x7f7b1c009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:38:59.566 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:59.563+0000 7f7b16ffd640 1 -- 172.21.15.121:0/3962612061 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7b1c038070 con 0x7f7b200fb1d0 2024-08-18T22:38:59.566 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:59.564+0000 7f7b16ffd640 1 -- 172.21.15.121:0/3962612061 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f7b1c02abd0 con 0x7f7b200fb1d0 2024-08-18T22:38:59.566 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:59.564+0000 7f7b284a7640 1 -- 172.21.15.121:0/3962612061 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b2010d4f0 con 0x7f7b200fb1d0 2024-08-18T22:38:59.566 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:59.564+0000 7f7b16ffd640 1 -- 172.21.15.121:0/3962612061 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7b1c03e670 con 0x7f7b200fb1d0 2024-08-18T22:38:59.566 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:59.564+0000 7f7b284a7640 1 -- 172.21.15.121:0/3962612061 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b2010da10 con 0x7f7b200fb1d0 2024-08-18T22:38:59.568 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:59.565+0000 7f7b284a7640 1 -- 172.21.15.121:0/3962612061 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b200fa630 con 0x7f7b200fb1d0 2024-08-18T22:38:59.568 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:59.565+0000 7f7b16ffd640 1 -- 172.21.15.121:0/3962612061 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 19) v1 ==== 85127+0+0 (secure 0 0 0) 0x7f7b1c030020 con 0x7f7b200fb1d0 2024-08-18T22:38:59.568 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:59.565+0000 7f7b16ffd640 1 --2- 172.21.15.121:0/3962612061 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7f7b0c067190 0x7f7b0c069640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:38:59.568 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:59.566+0000 7f7b16ffd640 1 -- 172.21.15.121:0/3962612061 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f7b1c0a4ad0 con 0x7f7b200fb1d0 2024-08-18T22:38:59.568 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:59.566+0000 7f7b25a42640 1 --2- 172.21.15.121:0/3962612061 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7f7b0c067190 0x7f7b0c069640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:38:59.568 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:59.566+0000 7f7b25a42640 1 --2- 172.21.15.121:0/3962612061 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7f7b0c067190 0x7f7b0c069640 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f7b100097e0 tx=0x7f7b10006d20 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:38:59.571 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:59.570+0000 7f7b16ffd640 1 -- 172.21.15.121:0/3962612061 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f7b1c072130 con 0x7f7b200fb1d0 2024-08-18T22:38:59.731 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:59.730+0000 7f7b284a7640 1 -- 172.21.15.121:0/3962612061 --> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] -- mgr_command(tid 0: {"prefix": "orch device ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f7b2010dd40 con 0x7f7b0c067190 2024-08-18T22:38:59.733 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:59.732+0000 7f7b16ffd640 1 -- 172.21.15.121:0/3962612061 <== mgr.14206 v2:172.21.15.121:6800/3225195982 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+399 (secure 0 0 0) 0x7f7b2010dd40 con 0x7f7b0c067190 2024-08-18T22:38:59.733 INFO:teuthology.orchestra.run.smithi121.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2024-08-18T22:38:59.733 INFO:teuthology.orchestra.run.smithi121.stdout:smithi121 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_PHFT620400ZF400BGN 372G No 2m ago Has a FileSystem, LVM detected 2024-08-18T22:38:59.733 INFO:teuthology.orchestra.run.smithi121.stdout:smithi195 /dev/nvme0n1 ssd INTEL_SSDPED1D480GA_PHMB751300FS480DGN 447G No 66s ago Has a FileSystem, LVM detected 2024-08-18T22:38:59.735 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:59.734+0000 7f7b284a7640 1 -- 172.21.15.121:0/3962612061 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7f7b0c067190 msgr2=0x7f7b0c069640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:38:59.735 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:59.734+0000 7f7b284a7640 1 --2- 172.21.15.121:0/3962612061 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7f7b0c067190 0x7f7b0c069640 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f7b100097e0 tx=0x7f7b10006d20 comp rx=0 tx=0).stop 2024-08-18T22:38:59.735 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:59.734+0000 7f7b284a7640 1 -- 172.21.15.121:0/3962612061 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7b200fb1d0 msgr2=0x7f7b2010be30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:38:59.735 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:59.734+0000 7f7b284a7640 1 --2- 172.21.15.121:0/3962612061 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7b200fb1d0 0x7f7b2010be30 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f7b1c003080 tx=0x7f7b1c009da0 comp rx=0 tx=0).stop 2024-08-18T22:38:59.735 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:59.734+0000 7f7b284a7640 1 -- 172.21.15.121:0/3962612061 shutdown_connections 2024-08-18T22:38:59.735 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:59.734+0000 7f7b284a7640 1 --2- 172.21.15.121:0/3962612061 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7f7b0c067190 0x7f7b0c069640 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:38:59.735 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:59.734+0000 7f7b284a7640 1 --2- 172.21.15.121:0/3962612061 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7b200fc4a0 0x7f7b2010c370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:38:59.735 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:59.734+0000 7f7b284a7640 1 --2- 172.21.15.121:0/3962612061 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7b200fb1d0 0x7f7b2010be30 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:38:59.735 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:59.734+0000 7f7b284a7640 1 -- 172.21.15.121:0/3962612061 >> 172.21.15.121:0/3962612061 conn(0x7f7b200f69b0 msgr2=0x7f7b200ff7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:38:59.735 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:59.734+0000 7f7b284a7640 1 -- 172.21.15.121:0/3962612061 shutdown_connections 2024-08-18T22:38:59.736 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:38:59.734+0000 7f7b284a7640 1 -- 172.21.15.121:0/3962612061 wait complete. 2024-08-18T22:39:00.333 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:39:00 smithi121 ceph-mon[16788]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-08-18T22:39:00.409 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:39:00 smithi195 ceph-mon[23370]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-08-18T22:39:00.422 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-08-18T22:39:00.432 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi121.front.sepia.ceph.com 2024-08-18T22:39:00.433 DEBUG:teuthology.orchestra.run.smithi121:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b003123a-5db1-11ef-bccf-c7b262605968 -- bash -c 'ceph fs volume create cephfs --placement=4' 2024-08-18T22:39:00.680 INFO:teuthology.orchestra.run.smithi121.stderr:Inferring config /var/lib/ceph/b003123a-5db1-11ef-bccf-c7b262605968/mon.smithi121/config 2024-08-18T22:39:01.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:39:01 smithi121 ceph-mon[16788]: from='client.14450 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-08-18T22:39:01.409 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:39:01 smithi195 ceph-mon[23370]: from='client.14450 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-08-18T22:39:02.251 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:02.238+0000 7f5234282640 1 -- 172.21.15.121:0/3535279922 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f522c0fd590 msgr2=0x7f522c0fda00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:39:02.251 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:02.238+0000 7f5234282640 1 --2- 172.21.15.121:0/3535279922 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f522c0fd590 0x7f522c0fda00 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f521c0048d0 tx=0x7f521c009da0 comp rx=0 tx=0).stop 2024-08-18T22:39:02.251 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:02.238+0000 7f5234282640 1 -- 172.21.15.121:0/3535279922 shutdown_connections 2024-08-18T22:39:02.251 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:02.238+0000 7f5234282640 1 --2- 172.21.15.121:0/3535279922 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f522c0fd590 0x7f522c0fda00 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:39:02.252 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:02.238+0000 7f5234282640 1 --2- 172.21.15.121:0/3535279922 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f522c0fc2c0 0x7f522c0fc6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:39:02.252 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:02.238+0000 7f5234282640 1 -- 172.21.15.121:0/3535279922 >> 172.21.15.121:0/3535279922 conn(0x7f522c0f7a80 msgr2=0x7f522c0f9eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:39:02.252 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:02.238+0000 7f5234282640 1 -- 172.21.15.121:0/3535279922 shutdown_connections 2024-08-18T22:39:02.252 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:02.238+0000 7f5234282640 1 -- 172.21.15.121:0/3535279922 wait complete. 2024-08-18T22:39:02.252 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:02.238+0000 7f5234282640 1 Processor -- start 2024-08-18T22:39:02.252 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:02.238+0000 7f5234282640 1 -- start start 2024-08-18T22:39:02.252 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:02.238+0000 7f5234282640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f522c0fc2c0 0x7f522c10cef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:39:02.252 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:02.238+0000 7f5234282640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f522c0fd590 0x7f522c10d430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:39:02.252 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:02.238+0000 7f5234282640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f522c10e1c0 con 0x7f522c0fc2c0 2024-08-18T22:39:02.252 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:02.238+0000 7f5234282640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f522c10e330 con 0x7f522c0fd590 2024-08-18T22:39:02.252 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:02.239+0000 7f523201e640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f522c0fc2c0 0x7f522c10cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:39:02.252 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:02.239+0000 7f523201e640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f522c0fc2c0 0x7f522c10cef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:41380/0 (socket says 172.21.15.121:41380) 2024-08-18T22:39:02.252 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:02.239+0000 7f523201e640 1 -- 172.21.15.121:0/3288099246 learned_addr learned my addr 172.21.15.121:0/3288099246 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-18T22:39:02.253 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:02.239+0000 7f523201e640 1 -- 172.21.15.121:0/3288099246 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f522c0fd590 msgr2=0x7f522c10d430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:39:02.253 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:02.239+0000 7f523201e640 1 --2- 172.21.15.121:0/3288099246 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f522c0fd590 0x7f522c10d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:39:02.253 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:02.239+0000 7f523201e640 1 -- 172.21.15.121:0/3288099246 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f521c005040 con 0x7f522c0fc2c0 2024-08-18T22:39:02.253 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:02.239+0000 7f523201e640 1 --2- 172.21.15.121:0/3288099246 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f522c0fc2c0 0x7f522c10cef0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f522800b790 tx=0x7f52280091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:39:02.253 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:02.239+0000 7f5222ffd640 1 -- 172.21.15.121:0/3288099246 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f522800c700 con 0x7f522c0fc2c0 2024-08-18T22:39:02.253 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:02.239+0000 7f5222ffd640 1 -- 172.21.15.121:0/3288099246 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f522800cd00 con 0x7f522c0fc2c0 2024-08-18T22:39:02.253 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:02.239+0000 7f5234282640 1 -- 172.21.15.121:0/3288099246 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f522c10e610 con 0x7f522c0fc2c0 2024-08-18T22:39:02.253 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:02.239+0000 7f5222ffd640 1 -- 172.21.15.121:0/3288099246 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5228015e70 con 0x7f522c0fc2c0 2024-08-18T22:39:02.253 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:02.239+0000 7f5234282640 1 -- 172.21.15.121:0/3288099246 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f522c10eb30 con 0x7f522c0fc2c0 2024-08-18T22:39:02.253 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:02.240+0000 7f5234282640 1 -- 172.21.15.121:0/3288099246 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f522c105550 con 0x7f522c0fc2c0 2024-08-18T22:39:02.253 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:02.241+0000 7f5222ffd640 1 -- 172.21.15.121:0/3288099246 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 19) v1 ==== 85127+0+0 (secure 0 0 0) 0x7f5228012070 con 0x7f522c0fc2c0 2024-08-18T22:39:02.253 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:02.241+0000 7f5222ffd640 1 --2- 172.21.15.121:0/3288099246 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7f5218067190 0x7f5218069640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:39:02.253 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:02.241+0000 7f5222ffd640 1 -- 172.21.15.121:0/3288099246 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f5228084340 con 0x7f522c0fc2c0 2024-08-18T22:39:02.253 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:02.241+0000 7f523181d640 1 --2- 172.21.15.121:0/3288099246 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7f5218067190 0x7f5218069640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:39:02.254 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:02.241+0000 7f523181d640 1 --2- 172.21.15.121:0/3288099246 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7f5218067190 0x7f5218069640 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f521c02a530 tx=0x7f521c009da0 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:39:02.254 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:02.245+0000 7f5222ffd640 1 -- 172.21.15.121:0/3288099246 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f5228051920 con 0x7f522c0fc2c0 2024-08-18T22:39:02.333 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:39:02 smithi121 ceph-mon[16788]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-08-18T22:39:02.409 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:39:02 smithi195 ceph-mon[23370]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-08-18T22:39:02.425 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:02.424+0000 7f5234282640 1 -- 172.21.15.121:0/3288099246 --> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] -- mgr_command(tid 0: {"prefix": "fs volume create", "name": "cephfs", "placement": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7f522c10edb0 con 0x7f5218067190 2024-08-18T22:39:03.333 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:39:03 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]: dispatch 2024-08-18T22:39:03.409 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:39:03 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]: dispatch 2024-08-18T22:39:04.071 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:04.070+0000 7f5222ffd640 1 -- 172.21.15.121:0/3288099246 <== mgr.14206 v2:172.21.15.121:6800/3225195982 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f522c10edb0 con 0x7f5218067190 2024-08-18T22:39:04.074 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:04.072+0000 7f5234282640 1 -- 172.21.15.121:0/3288099246 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7f5218067190 msgr2=0x7f5218069640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:39:04.074 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:04.072+0000 7f5234282640 1 --2- 172.21.15.121:0/3288099246 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7f5218067190 0x7f5218069640 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f521c02a530 tx=0x7f521c009da0 comp rx=0 tx=0).stop 2024-08-18T22:39:04.074 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:04.072+0000 7f5234282640 1 -- 172.21.15.121:0/3288099246 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f522c0fc2c0 msgr2=0x7f522c10cef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:39:04.074 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:04.072+0000 7f5234282640 1 --2- 172.21.15.121:0/3288099246 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f522c0fc2c0 0x7f522c10cef0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f522800b790 tx=0x7f52280091d0 comp rx=0 tx=0).stop 2024-08-18T22:39:04.074 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:04.072+0000 7f5234282640 1 -- 172.21.15.121:0/3288099246 shutdown_connections 2024-08-18T22:39:04.074 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:04.072+0000 7f5234282640 1 --2- 172.21.15.121:0/3288099246 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7f5218067190 0x7f5218069640 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:39:04.074 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:04.072+0000 7f5234282640 1 --2- 172.21.15.121:0/3288099246 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f522c0fd590 0x7f522c10d430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:39:04.074 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:04.072+0000 7f5234282640 1 --2- 172.21.15.121:0/3288099246 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f522c0fc2c0 0x7f522c10cef0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:39:04.074 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:04.072+0000 7f5234282640 1 -- 172.21.15.121:0/3288099246 >> 172.21.15.121:0/3288099246 conn(0x7f522c0f7a80 msgr2=0x7f522c0f9210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:39:04.074 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:04.073+0000 7f5234282640 1 -- 172.21.15.121:0/3288099246 shutdown_connections 2024-08-18T22:39:04.074 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:04.073+0000 7f5234282640 1 -- 172.21.15.121:0/3288099246 wait complete. 2024-08-18T22:39:04.333 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:39:04 smithi121 ceph-mon[16788]: from='client.14454 -' entity='client.admin' cmd=[{"prefix": "fs volume create", "name": "cephfs", "placement": "4", "target": ["mon-mgr", ""]}]: dispatch 2024-08-18T22:39:04.333 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:39:04 smithi121 ceph-mon[16788]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-08-18T22:39:04.333 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:39:04 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd='[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]': finished 2024-08-18T22:39:04.334 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:39:04 smithi121 ceph-mon[16788]: osdmap e42: 6 total, 6 up, 6 in 2024-08-18T22:39:04.334 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:39:04 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]: dispatch 2024-08-18T22:39:04.334 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:39:04 smithi121 ceph-b003123a-5db1-11ef-bccf-c7b262605968-mon-smithi121[16784]: 2024-08-18T22:39:04.053+0000 7f67677da640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-08-18T22:39:04.409 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:39:04 smithi195 ceph-mon[23370]: from='client.14454 -' entity='client.admin' cmd=[{"prefix": "fs volume create", "name": "cephfs", "placement": "4", "target": ["mon-mgr", ""]}]: dispatch 2024-08-18T22:39:04.409 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:39:04 smithi195 ceph-mon[23370]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-08-18T22:39:04.409 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:39:04 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd='[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]': finished 2024-08-18T22:39:04.409 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:39:04 smithi195 ceph-mon[23370]: osdmap e42: 6 total, 6 up, 6 in 2024-08-18T22:39:04.409 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:39:04 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]: dispatch 2024-08-18T22:39:04.761 DEBUG:teuthology.orchestra.run.smithi121:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b003123a-5db1-11ef-bccf-c7b262605968 -- bash -c 'ceph fs dump' 2024-08-18T22:39:05.308 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:39:05 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd='[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]': finished 2024-08-18T22:39:05.308 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:39:05 smithi121 ceph-mon[16788]: osdmap e43: 6 total, 6 up, 6 in 2024-08-18T22:39:05.308 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:39:05 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]: dispatch 2024-08-18T22:39:05.308 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:39:05 smithi121 ceph-mon[16788]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-08-18T22:39:05.309 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:39:05 smithi121 ceph-mon[16788]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-08-18T22:39:05.309 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:39:05 smithi121 ceph-mon[16788]: osdmap e44: 6 total, 6 up, 6 in 2024-08-18T22:39:05.309 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:39:05 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]': finished 2024-08-18T22:39:05.309 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:39:05 smithi121 ceph-mon[16788]: fsmap cephfs:0 2024-08-18T22:39:05.309 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:39:05 smithi121 ceph-mon[16788]: Saving service mds.cephfs spec with placement count:4 2024-08-18T22:39:05.309 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:39:05 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:39:05.309 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:39:05 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-18T22:39:05.309 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:39:05 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:39:05.309 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:39:05 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-18T22:39:05.309 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:39:05 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:39:05.309 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:39:05 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi121.xuzsdg", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-08-18T22:39:05.309 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:39:05 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi121.xuzsdg", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-18T22:39:05.309 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:39:05 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:39:05.409 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:39:05 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd='[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]': finished 2024-08-18T22:39:05.409 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:39:05 smithi195 ceph-mon[23370]: osdmap e43: 6 total, 6 up, 6 in 2024-08-18T22:39:05.409 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:39:05 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]: dispatch 2024-08-18T22:39:05.409 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:39:05 smithi195 ceph-mon[23370]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-08-18T22:39:05.410 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:39:05 smithi195 ceph-mon[23370]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-08-18T22:39:05.410 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:39:05 smithi195 ceph-mon[23370]: osdmap e44: 6 total, 6 up, 6 in 2024-08-18T22:39:05.410 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:39:05 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]': finished 2024-08-18T22:39:05.410 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:39:05 smithi195 ceph-mon[23370]: fsmap cephfs:0 2024-08-18T22:39:05.410 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:39:05 smithi195 ceph-mon[23370]: Saving service mds.cephfs spec with placement count:4 2024-08-18T22:39:05.410 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:39:05 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:39:05.410 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:39:05 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-18T22:39:05.410 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:39:05 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:39:05.410 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:39:05 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-18T22:39:05.410 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:39:05 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:39:05.410 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:39:05 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi121.xuzsdg", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-08-18T22:39:05.410 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:39:05 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi121.xuzsdg", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-18T22:39:05.410 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:39:05 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:39:05.545 INFO:teuthology.orchestra.run.smithi121.stderr:Inferring config /var/lib/ceph/b003123a-5db1-11ef-bccf-c7b262605968/mon.smithi121/config 2024-08-18T22:39:06.292 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:39:06 smithi121 ceph-mon[16788]: Deploying daemon mds.cephfs.smithi121.xuzsdg on smithi121 2024-08-18T22:39:06.293 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:39:06 smithi121 ceph-mon[16788]: pgmap v165: 65 pgs: 9 creating+peering, 1 active+clean, 55 unknown; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-08-18T22:39:06.293 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:39:06 smithi121 ceph-mon[16788]: osdmap e45: 6 total, 6 up, 6 in 2024-08-18T22:39:06.409 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:39:06 smithi195 ceph-mon[23370]: Deploying daemon mds.cephfs.smithi121.xuzsdg on smithi121 2024-08-18T22:39:06.409 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:39:06 smithi195 ceph-mon[23370]: pgmap v165: 65 pgs: 9 creating+peering, 1 active+clean, 55 unknown; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-08-18T22:39:06.409 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:39:06 smithi195 ceph-mon[23370]: osdmap e45: 6 total, 6 up, 6 in 2024-08-18T22:39:07.333 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:39:07 smithi121 ceph-mon[16788]: osdmap e46: 6 total, 6 up, 6 in 2024-08-18T22:39:07.410 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:39:07 smithi195 ceph-mon[23370]: osdmap e46: 6 total, 6 up, 6 in 2024-08-18T22:39:07.849 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:07.826+0000 7fcf2acd1640 1 -- 172.21.15.121:0/3092335621 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcf240fb1f0 msgr2=0x7fcf240fb600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:39:07.849 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:07.826+0000 7fcf2acd1640 1 --2- 172.21.15.121:0/3092335621 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcf240fb1f0 0x7fcf240fb600 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fcf200048d0 tx=0x7fcf20009da0 comp rx=0 tx=0).stop 2024-08-18T22:39:07.850 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:07.826+0000 7fcf2acd1640 1 -- 172.21.15.121:0/3092335621 shutdown_connections 2024-08-18T22:39:07.850 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:07.826+0000 7fcf2acd1640 1 --2- 172.21.15.121:0/3092335621 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcf240fc4c0 0x7fcf240fc930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:39:07.850 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:07.826+0000 7fcf2acd1640 1 --2- 172.21.15.121:0/3092335621 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcf240fb1f0 0x7fcf240fb600 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:39:07.850 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:07.826+0000 7fcf2acd1640 1 -- 172.21.15.121:0/3092335621 >> 172.21.15.121:0/3092335621 conn(0x7fcf240f69b0 msgr2=0x7fcf240f8de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:39:07.850 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:07.826+0000 7fcf2acd1640 1 -- 172.21.15.121:0/3092335621 shutdown_connections 2024-08-18T22:39:07.850 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:07.826+0000 7fcf2acd1640 1 -- 172.21.15.121:0/3092335621 wait complete. 2024-08-18T22:39:07.850 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:07.827+0000 7fcf2acd1640 1 Processor -- start 2024-08-18T22:39:07.850 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:07.827+0000 7fcf2acd1640 1 -- start start 2024-08-18T22:39:07.850 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:07.827+0000 7fcf2acd1640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcf240fb1f0 0x7fcf2410bde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:39:07.850 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:07.827+0000 7fcf2acd1640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcf240fc4c0 0x7fcf2410c320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:39:07.850 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:07.827+0000 7fcf2acd1640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf2410c9a0 con 0x7fcf240fb1f0 2024-08-18T22:39:07.850 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:07.827+0000 7fcf2acd1640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf2410d0e0 con 0x7fcf240fc4c0 2024-08-18T22:39:07.851 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:07.827+0000 7fcf28a6d640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcf240fb1f0 0x7fcf2410bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:39:07.851 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:07.827+0000 7fcf28a6d640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcf240fb1f0 0x7fcf2410bde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:40874/0 (socket says 172.21.15.121:40874) 2024-08-18T22:39:07.851 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:07.827+0000 7fcf28a6d640 1 -- 172.21.15.121:0/3666294101 learned_addr learned my addr 172.21.15.121:0/3666294101 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-18T22:39:07.851 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:07.828+0000 7fcf1bfff640 1 --2- 172.21.15.121:0/3666294101 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcf240fc4c0 0x7fcf2410c320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:39:07.851 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:07.828+0000 7fcf28a6d640 1 -- 172.21.15.121:0/3666294101 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcf240fc4c0 msgr2=0x7fcf2410c320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:39:07.851 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:07.828+0000 7fcf28a6d640 1 --2- 172.21.15.121:0/3666294101 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcf240fc4c0 0x7fcf2410c320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:39:07.851 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:07.828+0000 7fcf28a6d640 1 -- 172.21.15.121:0/3666294101 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf20005040 con 0x7fcf240fb1f0 2024-08-18T22:39:07.851 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:07.828+0000 7fcf28a6d640 1 --2- 172.21.15.121:0/3666294101 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcf240fb1f0 0x7fcf2410bde0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fcf200043d0 tx=0x7fcf20009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:39:07.851 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:07.828+0000 7fcf197fa640 1 -- 172.21.15.121:0/3666294101 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcf20038070 con 0x7fcf240fb1f0 2024-08-18T22:39:07.851 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:07.828+0000 7fcf197fa640 1 -- 172.21.15.121:0/3666294101 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fcf2002ae90 con 0x7fcf240fb1f0 2024-08-18T22:39:07.851 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:07.828+0000 7fcf2acd1640 1 -- 172.21.15.121:0/3666294101 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf2410d300 con 0x7fcf240fb1f0 2024-08-18T22:39:07.851 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:07.828+0000 7fcf197fa640 1 -- 172.21.15.121:0/3666294101 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcf2003e670 con 0x7fcf240fb1f0 2024-08-18T22:39:07.851 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:07.828+0000 7fcf2acd1640 1 -- 172.21.15.121:0/3666294101 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf2410d8a0 con 0x7fcf240fb1f0 2024-08-18T22:39:07.851 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:07.829+0000 7fcf2acd1640 1 -- 172.21.15.121:0/3666294101 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf240fa650 con 0x7fcf240fb1f0 2024-08-18T22:39:07.852 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:07.829+0000 7fcf197fa640 1 -- 172.21.15.121:0/3666294101 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 19) v1 ==== 85127+0+0 (secure 0 0 0) 0x7fcf20030020 con 0x7fcf240fb1f0 2024-08-18T22:39:07.852 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:07.830+0000 7fcf197fa640 1 --2- 172.21.15.121:0/3666294101 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7fcf0c067190 0x7fcf0c069640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:39:07.852 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:07.830+0000 7fcf197fa640 1 -- 172.21.15.121:0/3666294101 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5464+0+0 (secure 0 0 0) 0x7fcf200a4db0 con 0x7fcf240fb1f0 2024-08-18T22:39:07.852 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:07.830+0000 7fcf1bfff640 1 --2- 172.21.15.121:0/3666294101 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7fcf0c067190 0x7fcf0c069640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:39:07.852 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:07.830+0000 7fcf1bfff640 1 --2- 172.21.15.121:0/3666294101 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7fcf0c067190 0x7fcf0c069640 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fcf14007fd0 tx=0x7fcf14009e90 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:39:07.852 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:07.834+0000 7fcf197fa640 1 -- 172.21.15.121:0/3666294101 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fcf20071ff0 con 0x7fcf240fb1f0 2024-08-18T22:39:08.033 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:08.032+0000 7fcf2acd1640 1 -- 172.21.15.121:0/3666294101 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fcf2404b4c0 con 0x7fcf240fb1f0 2024-08-18T22:39:08.033 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:08.032+0000 7fcf197fa640 1 -- 172.21.15.121:0/3666294101 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 2 v2) v1 ==== 75+0+1076 (secure 0 0 0) 0x7fcf20075610 con 0x7fcf240fb1f0 2024-08-18T22:39:08.033 INFO:teuthology.orchestra.run.smithi121.stdout:e2 2024-08-18T22:39:08.033 INFO:teuthology.orchestra.run.smithi121.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-08-18T22:39:08.034 INFO:teuthology.orchestra.run.smithi121.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-08-18T22:39:08.034 INFO:teuthology.orchestra.run.smithi121.stdout:legacy client fscid: 1 2024-08-18T22:39:08.034 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-08-18T22:39:08.034 INFO:teuthology.orchestra.run.smithi121.stdout:Filesystem 'cephfs' (1) 2024-08-18T22:39:08.034 INFO:teuthology.orchestra.run.smithi121.stdout:fs_name cephfs 2024-08-18T22:39:08.034 INFO:teuthology.orchestra.run.smithi121.stdout:epoch 2 2024-08-18T22:39:08.034 INFO:teuthology.orchestra.run.smithi121.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-08-18T22:39:08.034 INFO:teuthology.orchestra.run.smithi121.stdout:created 2024-08-18T22:39:04.054074+0000 2024-08-18T22:39:08.034 INFO:teuthology.orchestra.run.smithi121.stdout:modified 2024-08-18T22:39:04.054124+0000 2024-08-18T22:39:08.034 INFO:teuthology.orchestra.run.smithi121.stdout:tableserver 0 2024-08-18T22:39:08.034 INFO:teuthology.orchestra.run.smithi121.stdout:root 0 2024-08-18T22:39:08.034 INFO:teuthology.orchestra.run.smithi121.stdout:session_timeout 60 2024-08-18T22:39:08.035 INFO:teuthology.orchestra.run.smithi121.stdout:session_autoclose 300 2024-08-18T22:39:08.035 INFO:teuthology.orchestra.run.smithi121.stdout:max_file_size 1099511627776 2024-08-18T22:39:08.035 INFO:teuthology.orchestra.run.smithi121.stdout:required_client_features {} 2024-08-18T22:39:08.035 INFO:teuthology.orchestra.run.smithi121.stdout:last_failure 0 2024-08-18T22:39:08.035 INFO:teuthology.orchestra.run.smithi121.stdout:last_failure_osd_epoch 0 2024-08-18T22:39:08.035 INFO:teuthology.orchestra.run.smithi121.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-08-18T22:39:08.035 INFO:teuthology.orchestra.run.smithi121.stdout:max_mds 1 2024-08-18T22:39:08.035 INFO:teuthology.orchestra.run.smithi121.stdout:in 2024-08-18T22:39:08.035 INFO:teuthology.orchestra.run.smithi121.stdout:up {} 2024-08-18T22:39:08.035 INFO:teuthology.orchestra.run.smithi121.stdout:failed 2024-08-18T22:39:08.035 INFO:teuthology.orchestra.run.smithi121.stdout:damaged 2024-08-18T22:39:08.035 INFO:teuthology.orchestra.run.smithi121.stdout:stopped 2024-08-18T22:39:08.035 INFO:teuthology.orchestra.run.smithi121.stdout:data_pools [3] 2024-08-18T22:39:08.035 INFO:teuthology.orchestra.run.smithi121.stdout:metadata_pool 2 2024-08-18T22:39:08.036 INFO:teuthology.orchestra.run.smithi121.stdout:inline_data disabled 2024-08-18T22:39:08.036 INFO:teuthology.orchestra.run.smithi121.stdout:balancer 2024-08-18T22:39:08.036 INFO:teuthology.orchestra.run.smithi121.stdout:standby_count_wanted 0 2024-08-18T22:39:08.036 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-08-18T22:39:08.036 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-08-18T22:39:08.037 INFO:teuthology.orchestra.run.smithi121.stderr:dumped fsmap epoch 2 2024-08-18T22:39:08.037 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:08.034+0000 7fcf2acd1640 1 -- 172.21.15.121:0/3666294101 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7fcf0c067190 msgr2=0x7fcf0c069640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:39:08.037 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:08.034+0000 7fcf2acd1640 1 --2- 172.21.15.121:0/3666294101 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7fcf0c067190 0x7fcf0c069640 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fcf14007fd0 tx=0x7fcf14009e90 comp rx=0 tx=0).stop 2024-08-18T22:39:08.037 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:08.034+0000 7fcf2acd1640 1 -- 172.21.15.121:0/3666294101 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcf240fb1f0 msgr2=0x7fcf2410bde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:39:08.037 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:08.034+0000 7fcf2acd1640 1 --2- 172.21.15.121:0/3666294101 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcf240fb1f0 0x7fcf2410bde0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fcf200043d0 tx=0x7fcf20009da0 comp rx=0 tx=0).stop 2024-08-18T22:39:08.037 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:08.034+0000 7fcf2acd1640 1 -- 172.21.15.121:0/3666294101 shutdown_connections 2024-08-18T22:39:08.037 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:08.034+0000 7fcf2acd1640 1 --2- 172.21.15.121:0/3666294101 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7fcf0c067190 0x7fcf0c069640 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:39:08.037 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:08.034+0000 7fcf2acd1640 1 --2- 172.21.15.121:0/3666294101 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcf240fc4c0 0x7fcf2410c320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:39:08.038 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:08.034+0000 7fcf2acd1640 1 --2- 172.21.15.121:0/3666294101 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcf240fb1f0 0x7fcf2410bde0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:39:08.038 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:08.034+0000 7fcf2acd1640 1 -- 172.21.15.121:0/3666294101 >> 172.21.15.121:0/3666294101 conn(0x7fcf240f69b0 msgr2=0x7fcf240f81f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:39:08.038 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:08.034+0000 7fcf2acd1640 1 -- 172.21.15.121:0/3666294101 shutdown_connections 2024-08-18T22:39:08.038 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:08.034+0000 7fcf2acd1640 1 -- 172.21.15.121:0/3666294101 wait complete. 2024-08-18T22:39:08.333 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:39:08 smithi121 ceph-mon[16788]: pgmap v168: 65 pgs: 9 creating+peering, 10 active+clean, 46 unknown; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-08-18T22:39:08.333 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:39:08 smithi121 ceph-mon[16788]: from='client.? 172.21.15.121:0/3666294101' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-08-18T22:39:08.409 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:39:08 smithi195 ceph-mon[23370]: pgmap v168: 65 pgs: 9 creating+peering, 10 active+clean, 46 unknown; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-08-18T22:39:08.409 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:39:08 smithi195 ceph-mon[23370]: from='client.? 172.21.15.121:0/3666294101' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-08-18T22:39:08.663 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-08-18T22:39:09.066 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi121.front.sepia.ceph.com 2024-08-18T22:39:09.067 DEBUG:teuthology.orchestra.run.smithi121:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b003123a-5db1-11ef-bccf-c7b262605968 -- bash -c 'ceph fs set cephfs max_mds 2' 2024-08-18T22:39:09.316 INFO:teuthology.orchestra.run.smithi121.stderr:Inferring config /var/lib/ceph/b003123a-5db1-11ef-bccf-c7b262605968/mon.smithi121/config 2024-08-18T22:39:09.659 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:39:09 smithi195 ceph-mon[23370]: pgmap v169: 65 pgs: 9 creating+peering, 50 active+clean, 6 unknown; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-08-18T22:39:09.659 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:39:09 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:39:09.659 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:39:09 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-18T22:39:09.659 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:39:09 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:39:09.660 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:39:09 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:39:09.660 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:39:09 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:39:09.660 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:39:09 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi195.buqvbr", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-08-18T22:39:09.660 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:39:09 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi195.buqvbr", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-18T22:39:09.660 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:39:09 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:39:09.660 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:39:09 smithi195 ceph-mon[23370]: Deploying daemon mds.cephfs.smithi195.buqvbr on smithi195 2024-08-18T22:39:09.744 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:39:09 smithi121 ceph-mon[16788]: pgmap v169: 65 pgs: 9 creating+peering, 50 active+clean, 6 unknown; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-08-18T22:39:09.744 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:39:09 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:39:09.744 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:39:09 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-18T22:39:09.744 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:39:09 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:39:09.744 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:39:09 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:39:09.744 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:39:09 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:39:09.744 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:39:09 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi195.buqvbr", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-08-18T22:39:09.745 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:39:09 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi195.buqvbr", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-18T22:39:09.745 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:39:09 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:39:09.745 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:39:09 smithi121 ceph-mon[16788]: Deploying daemon mds.cephfs.smithi195.buqvbr on smithi195 2024-08-18T22:39:10.659 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:39:10 smithi195 ceph-mon[23370]: mds.? [v2:172.21.15.121:6826/754747487,v1:172.21.15.121:6827/754747487] up:boot 2024-08-18T22:39:10.659 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:39:10 smithi195 ceph-mon[23370]: daemon mds.cephfs.smithi121.xuzsdg assigned to filesystem cephfs as rank 0 (now has 1 ranks) 2024-08-18T22:39:10.659 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:39:10 smithi195 ceph-mon[23370]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-08-18T22:39:10.659 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:39:10 smithi195 ceph-mon[23370]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-08-18T22:39:10.659 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:39:10 smithi195 ceph-mon[23370]: Cluster is now healthy 2024-08-18T22:39:10.659 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:39:10 smithi195 ceph-mon[23370]: fsmap cephfs:0 1 up:standby 2024-08-18T22:39:10.659 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:39:10 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi121.xuzsdg"}]: dispatch 2024-08-18T22:39:10.659 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:39:10 smithi195 ceph-mon[23370]: fsmap cephfs:1 {0=cephfs.smithi121.xuzsdg=up:creating} 2024-08-18T22:39:10.659 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:39:10 smithi195 ceph-mon[23370]: daemon mds.cephfs.smithi121.xuzsdg is now active in filesystem cephfs as rank 0 2024-08-18T22:39:10.683 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:39:10 smithi121 ceph-mon[16788]: mds.? [v2:172.21.15.121:6826/754747487,v1:172.21.15.121:6827/754747487] up:boot 2024-08-18T22:39:10.683 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:39:10 smithi121 ceph-mon[16788]: daemon mds.cephfs.smithi121.xuzsdg assigned to filesystem cephfs as rank 0 (now has 1 ranks) 2024-08-18T22:39:10.683 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:39:10 smithi121 ceph-mon[16788]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-08-18T22:39:10.683 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:39:10 smithi121 ceph-mon[16788]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-08-18T22:39:10.683 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:39:10 smithi121 ceph-mon[16788]: Cluster is now healthy 2024-08-18T22:39:10.683 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:39:10 smithi121 ceph-mon[16788]: fsmap cephfs:0 1 up:standby 2024-08-18T22:39:10.683 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:39:10 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi121.xuzsdg"}]: dispatch 2024-08-18T22:39:10.683 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:39:10 smithi121 ceph-mon[16788]: fsmap cephfs:1 {0=cephfs.smithi121.xuzsdg=up:creating} 2024-08-18T22:39:10.684 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:39:10 smithi121 ceph-mon[16788]: daemon mds.cephfs.smithi121.xuzsdg is now active in filesystem cephfs as rank 0 2024-08-18T22:39:10.885 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:10.882+0000 7ff021400640 1 -- 172.21.15.121:0/68092591 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff01c0fb050 msgr2=0x7ff01c0fb460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:39:10.885 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:10.882+0000 7ff021400640 1 --2- 172.21.15.121:0/68092591 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff01c0fb050 0x7ff01c0fb460 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7ff00c0048d0 tx=0x7ff00c009da0 comp rx=0 tx=0).stop 2024-08-18T22:39:10.885 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:10.882+0000 7ff021400640 1 -- 172.21.15.121:0/68092591 shutdown_connections 2024-08-18T22:39:10.885 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:10.882+0000 7ff021400640 1 --2- 172.21.15.121:0/68092591 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff01c0fc320 0x7ff01c0fc790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:39:10.885 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:10.882+0000 7ff021400640 1 --2- 172.21.15.121:0/68092591 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff01c0fb050 0x7ff01c0fb460 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:39:10.885 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:10.882+0000 7ff021400640 1 -- 172.21.15.121:0/68092591 >> 172.21.15.121:0/68092591 conn(0x7ff01c0f6810 msgr2=0x7ff01c0f8c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:39:10.885 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:10.882+0000 7ff021400640 1 -- 172.21.15.121:0/68092591 shutdown_connections 2024-08-18T22:39:10.885 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:10.882+0000 7ff021400640 1 -- 172.21.15.121:0/68092591 wait complete. 2024-08-18T22:39:10.885 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:10.883+0000 7ff021400640 1 Processor -- start 2024-08-18T22:39:10.886 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:10.883+0000 7ff021400640 1 -- start start 2024-08-18T22:39:10.886 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:10.883+0000 7ff021400640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff01c0fb050 0x7ff01c10ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:39:10.886 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:10.883+0000 7ff021400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff01c0fc320 0x7ff01c10d230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:39:10.886 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:10.883+0000 7ff021400640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff01c10d880 con 0x7ff01c0fc320 2024-08-18T22:39:10.886 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:10.883+0000 7ff021400640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff01c10e000 con 0x7ff01c0fb050 2024-08-18T22:39:10.886 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:10.883+0000 7ff01a7fc640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff01c0fc320 0x7ff01c10d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:39:10.886 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:10.883+0000 7ff01a7fc640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff01c0fc320 0x7ff01c10d230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:40898/0 (socket says 172.21.15.121:40898) 2024-08-18T22:39:10.886 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:10.883+0000 7ff01a7fc640 1 -- 172.21.15.121:0/2923158440 learned_addr learned my addr 172.21.15.121:0/2923158440 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-18T22:39:10.886 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:10.883+0000 7ff01affd640 1 --2- 172.21.15.121:0/2923158440 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff01c0fb050 0x7ff01c10ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:39:10.886 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:10.883+0000 7ff01a7fc640 1 -- 172.21.15.121:0/2923158440 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff01c0fb050 msgr2=0x7ff01c10ccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:39:10.886 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:10.883+0000 7ff01a7fc640 1 --2- 172.21.15.121:0/2923158440 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff01c0fb050 0x7ff01c10ccf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:39:10.886 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:10.883+0000 7ff01a7fc640 1 -- 172.21.15.121:0/2923158440 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff00c005040 con 0x7ff01c0fc320 2024-08-18T22:39:10.886 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:10.884+0000 7ff01a7fc640 1 --2- 172.21.15.121:0/2923158440 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff01c0fc320 0x7ff01c10d230 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7ff010002a50 tx=0x7ff010004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:39:10.887 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:10.884+0000 7ff0037fe640 1 -- 172.21.15.121:0/2923158440 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff010007c30 con 0x7ff01c0fc320 2024-08-18T22:39:10.887 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:10.884+0000 7ff021400640 1 -- 172.21.15.121:0/2923158440 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff01c10e290 con 0x7ff01c0fc320 2024-08-18T22:39:10.887 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:10.884+0000 7ff0037fe640 1 -- 172.21.15.121:0/2923158440 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7ff01000f040 con 0x7ff01c0fc320 2024-08-18T22:39:10.887 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:10.884+0000 7ff0037fe640 1 -- 172.21.15.121:0/2923158440 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff01000dad0 con 0x7ff01c0fc320 2024-08-18T22:39:10.887 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:10.884+0000 7ff021400640 1 -- 172.21.15.121:0/2923158440 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff01c10e7b0 con 0x7ff01c0fc320 2024-08-18T22:39:10.888 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:10.885+0000 7ff021400640 1 -- 172.21.15.121:0/2923158440 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff01c05eb10 con 0x7ff01c0fc320 2024-08-18T22:39:10.888 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:10.886+0000 7ff0037fe640 1 -- 172.21.15.121:0/2923158440 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 19) v1 ==== 85127+0+0 (secure 0 0 0) 0x7ff01000dc30 con 0x7ff01c0fc320 2024-08-18T22:39:10.888 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:10.886+0000 7ff0037fe640 1 --2- 172.21.15.121:0/2923158440 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7ff004067190 0x7ff004069640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:39:10.888 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:10.886+0000 7ff0037fe640 1 -- 172.21.15.121:0/2923158440 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5464+0+0 (secure 0 0 0) 0x7ff010084900 con 0x7ff01c0fc320 2024-08-18T22:39:10.888 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:10.886+0000 7ff01affd640 1 --2- 172.21.15.121:0/2923158440 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7ff004067190 0x7ff004069640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:39:10.888 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:10.887+0000 7ff01affd640 1 --2- 172.21.15.121:0/2923158440 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7ff004067190 0x7ff004069640 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7ff00c000c00 tx=0x7ff00c035040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:39:10.891 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:10.890+0000 7ff0037fe640 1 -- 172.21.15.121:0/2923158440 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7ff010051c20 con 0x7ff01c0fc320 2024-08-18T22:39:11.093 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:11.092+0000 7ff021400640 1 -- 172.21.15.121:0/2923158440 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"} v 0) v1 -- 0x7ff01c10e420 con 0x7ff01c0fc320 2024-08-18T22:39:11.586 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:11.583+0000 7ff0037fe640 1 -- 172.21.15.121:0/2923158440 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]=0 v6) v1 ==== 105+0+0 (secure 0 0 0) 0x7ff01c10e420 con 0x7ff01c0fc320 2024-08-18T22:39:11.587 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:11.585+0000 7ff021400640 1 -- 172.21.15.121:0/2923158440 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7ff004067190 msgr2=0x7ff004069640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:39:11.587 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:11.585+0000 7ff021400640 1 --2- 172.21.15.121:0/2923158440 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7ff004067190 0x7ff004069640 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7ff00c000c00 tx=0x7ff00c035040 comp rx=0 tx=0).stop 2024-08-18T22:39:11.587 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:11.585+0000 7ff021400640 1 -- 172.21.15.121:0/2923158440 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff01c0fc320 msgr2=0x7ff01c10d230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:39:11.587 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:11.585+0000 7ff021400640 1 --2- 172.21.15.121:0/2923158440 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff01c0fc320 0x7ff01c10d230 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7ff010002a50 tx=0x7ff010004600 comp rx=0 tx=0).stop 2024-08-18T22:39:11.587 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:11.585+0000 7ff021400640 1 -- 172.21.15.121:0/2923158440 shutdown_connections 2024-08-18T22:39:11.587 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:11.586+0000 7ff021400640 1 --2- 172.21.15.121:0/2923158440 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7ff004067190 0x7ff004069640 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:39:11.587 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:11.586+0000 7ff021400640 1 --2- 172.21.15.121:0/2923158440 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff01c0fc320 0x7ff01c10d230 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:39:11.587 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:11.586+0000 7ff021400640 1 --2- 172.21.15.121:0/2923158440 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff01c0fb050 0x7ff01c10ccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:39:11.587 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:11.586+0000 7ff021400640 1 -- 172.21.15.121:0/2923158440 >> 172.21.15.121:0/2923158440 conn(0x7ff01c0f6810 msgr2=0x7ff01c0651e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:39:11.587 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:11.586+0000 7ff021400640 1 -- 172.21.15.121:0/2923158440 shutdown_connections 2024-08-18T22:39:11.588 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:11.586+0000 7ff021400640 1 -- 172.21.15.121:0/2923158440 wait complete. 2024-08-18T22:39:11.833 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:39:11 smithi121 ceph-mon[16788]: pgmap v170: 65 pgs: 65 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-08-18T22:39:11.833 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:39:11 smithi121 ceph-mon[16788]: mds.? [v2:172.21.15.121:6826/754747487,v1:172.21.15.121:6827/754747487] up:active 2024-08-18T22:39:11.834 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:39:11 smithi121 ceph-mon[16788]: fsmap cephfs:1 {0=cephfs.smithi121.xuzsdg=up:active} 2024-08-18T22:39:11.834 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:39:11 smithi121 ceph-mon[16788]: from='client.? 172.21.15.121:0/2923158440' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]: dispatch 2024-08-18T22:39:11.834 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:39:11 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:39:11.834 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:39:11 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:39:11.834 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:39:11 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:39:11.834 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:39:11 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi121.gbickb", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-08-18T22:39:11.834 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:39:11 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi121.gbickb", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-18T22:39:11.834 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:39:11 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:39:11.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:39:11 smithi195 ceph-mon[23370]: pgmap v170: 65 pgs: 65 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-08-18T22:39:11.910 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:39:11 smithi195 ceph-mon[23370]: mds.? [v2:172.21.15.121:6826/754747487,v1:172.21.15.121:6827/754747487] up:active 2024-08-18T22:39:11.910 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:39:11 smithi195 ceph-mon[23370]: fsmap cephfs:1 {0=cephfs.smithi121.xuzsdg=up:active} 2024-08-18T22:39:11.910 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:39:11 smithi195 ceph-mon[23370]: from='client.? 172.21.15.121:0/2923158440' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]: dispatch 2024-08-18T22:39:11.910 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:39:11 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:39:11.910 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:39:11 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:39:11.910 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:39:11 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:39:11.910 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:39:11 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi121.gbickb", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-08-18T22:39:11.910 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:39:11 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi121.gbickb", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-18T22:39:11.910 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:39:11 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:39:12.253 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-08-18T22:39:12.264 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi121.front.sepia.ceph.com 2024-08-18T22:39:12.265 DEBUG:teuthology.orchestra.run.smithi121:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b003123a-5db1-11ef-bccf-c7b262605968 -- bash -c 'ceph fs set cephfs allow_standby_replay false' 2024-08-18T22:39:12.659 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:39:12 smithi195 ceph-mon[23370]: Deploying daemon mds.cephfs.smithi121.gbickb on smithi121 2024-08-18T22:39:12.659 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:39:12 smithi195 ceph-mon[23370]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-08-18T22:39:12.659 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:39:12 smithi195 ceph-mon[23370]: from='client.? 172.21.15.121:0/2923158440' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]': finished 2024-08-18T22:39:12.659 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:39:12 smithi195 ceph-mon[23370]: mds.? [v2:172.21.15.195:6824/2414511859,v1:172.21.15.195:6825/2414511859] up:boot 2024-08-18T22:39:12.659 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:39:12 smithi195 ceph-mon[23370]: daemon mds.cephfs.smithi195.buqvbr assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-08-18T22:39:12.659 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:39:12 smithi195 ceph-mon[23370]: Health check failed: insufficient standby MDS daemons available (MDS_INSUFFICIENT_STANDBY) 2024-08-18T22:39:12.659 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:39:12 smithi195 ceph-mon[23370]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-08-18T22:39:12.659 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:39:12 smithi195 ceph-mon[23370]: fsmap cephfs:1 {0=cephfs.smithi121.xuzsdg=up:active} 1 up:standby 2024-08-18T22:39:12.660 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:39:12 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi195.buqvbr"}]: dispatch 2024-08-18T22:39:12.660 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:39:12 smithi195 ceph-mon[23370]: fsmap cephfs:2 {0=cephfs.smithi121.xuzsdg=up:active,1=cephfs.smithi195.buqvbr=up:creating} 2024-08-18T22:39:12.660 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:39:12 smithi195 ceph-mon[23370]: daemon mds.cephfs.smithi195.buqvbr is now active in filesystem cephfs as rank 1 2024-08-18T22:39:12.833 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:39:12 smithi121 ceph-mon[16788]: Deploying daemon mds.cephfs.smithi121.gbickb on smithi121 2024-08-18T22:39:12.833 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:39:12 smithi121 ceph-mon[16788]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-08-18T22:39:12.834 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:39:12 smithi121 ceph-mon[16788]: from='client.? 172.21.15.121:0/2923158440' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]': finished 2024-08-18T22:39:12.834 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:39:12 smithi121 ceph-mon[16788]: mds.? [v2:172.21.15.195:6824/2414511859,v1:172.21.15.195:6825/2414511859] up:boot 2024-08-18T22:39:12.834 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:39:12 smithi121 ceph-mon[16788]: daemon mds.cephfs.smithi195.buqvbr assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-08-18T22:39:12.834 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:39:12 smithi121 ceph-mon[16788]: Health check failed: insufficient standby MDS daemons available (MDS_INSUFFICIENT_STANDBY) 2024-08-18T22:39:12.834 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:39:12 smithi121 ceph-mon[16788]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-08-18T22:39:12.834 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:39:12 smithi121 ceph-mon[16788]: fsmap cephfs:1 {0=cephfs.smithi121.xuzsdg=up:active} 1 up:standby 2024-08-18T22:39:12.834 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:39:12 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi195.buqvbr"}]: dispatch 2024-08-18T22:39:12.834 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:39:12 smithi121 ceph-mon[16788]: fsmap cephfs:2 {0=cephfs.smithi121.xuzsdg=up:active,1=cephfs.smithi195.buqvbr=up:creating} 2024-08-18T22:39:12.834 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:39:12 smithi121 ceph-mon[16788]: daemon mds.cephfs.smithi195.buqvbr is now active in filesystem cephfs as rank 1 2024-08-18T22:39:13.315 INFO:teuthology.orchestra.run.smithi121.stderr:Inferring config /var/lib/ceph/b003123a-5db1-11ef-bccf-c7b262605968/mon.smithi121/config 2024-08-18T22:39:13.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:39:13 smithi195 ceph-mon[23370]: pgmap v171: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s wr, 6 op/s 2024-08-18T22:39:13.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:39:13 smithi195 ceph-mon[23370]: mds.? [v2:172.21.15.195:6824/2414511859,v1:172.21.15.195:6825/2414511859] up:active 2024-08-18T22:39:13.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:39:13 smithi195 ceph-mon[23370]: fsmap cephfs:2 {0=cephfs.smithi121.xuzsdg=up:active,1=cephfs.smithi195.buqvbr=up:active} 2024-08-18T22:39:13.916 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:39:13 smithi121 ceph-mon[16788]: pgmap v171: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s wr, 6 op/s 2024-08-18T22:39:13.916 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:39:13 smithi121 ceph-mon[16788]: mds.? [v2:172.21.15.195:6824/2414511859,v1:172.21.15.195:6825/2414511859] up:active 2024-08-18T22:39:13.916 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:39:13 smithi121 ceph-mon[16788]: fsmap cephfs:2 {0=cephfs.smithi121.xuzsdg=up:active,1=cephfs.smithi195.buqvbr=up:active} 2024-08-18T22:39:15.553 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:15.550+0000 7fab77a69640 1 -- 172.21.15.121:0/2271331676 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fab700fc4c0 msgr2=0x7fab700fc930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:39:15.553 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:15.550+0000 7fab77a69640 1 --2- 172.21.15.121:0/2271331676 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fab700fc4c0 0x7fab700fc930 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fab600048d0 tx=0x7fab60009da0 comp rx=0 tx=0).stop 2024-08-18T22:39:15.553 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:15.550+0000 7fab77a69640 1 -- 172.21.15.121:0/2271331676 shutdown_connections 2024-08-18T22:39:15.553 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:15.550+0000 7fab77a69640 1 --2- 172.21.15.121:0/2271331676 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fab700fc4c0 0x7fab700fc930 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:39:15.553 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:15.550+0000 7fab77a69640 1 --2- 172.21.15.121:0/2271331676 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fab700fb1f0 0x7fab700fb600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:39:15.553 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:15.550+0000 7fab77a69640 1 -- 172.21.15.121:0/2271331676 >> 172.21.15.121:0/2271331676 conn(0x7fab700f69b0 msgr2=0x7fab700f8de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:39:15.553 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:15.550+0000 7fab77a69640 1 -- 172.21.15.121:0/2271331676 shutdown_connections 2024-08-18T22:39:15.553 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:15.550+0000 7fab77a69640 1 -- 172.21.15.121:0/2271331676 wait complete. 2024-08-18T22:39:15.553 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:15.551+0000 7fab77a69640 1 Processor -- start 2024-08-18T22:39:15.553 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:15.551+0000 7fab77a69640 1 -- start start 2024-08-18T22:39:15.554 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:15.551+0000 7fab77a69640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fab700fb1f0 0x7fab7010fbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:39:15.554 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:15.551+0000 7fab77a69640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fab700fc4c0 0x7fab70112110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:39:15.554 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:15.551+0000 7fab77a69640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab700664f0 con 0x7fab700fc4c0 2024-08-18T22:39:15.554 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:15.551+0000 7fab77a69640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab70066660 con 0x7fab700fb1f0 2024-08-18T22:39:15.554 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:15.551+0000 7fab75004640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fab700fc4c0 0x7fab70112110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:39:15.554 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:15.551+0000 7fab75004640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fab700fc4c0 0x7fab70112110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:40942/0 (socket says 172.21.15.121:40942) 2024-08-18T22:39:15.554 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:15.551+0000 7fab75004640 1 -- 172.21.15.121:0/3412241679 learned_addr learned my addr 172.21.15.121:0/3412241679 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-18T22:39:15.554 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:15.551+0000 7fab75805640 1 --2- 172.21.15.121:0/3412241679 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fab700fb1f0 0x7fab7010fbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:39:15.554 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:15.551+0000 7fab75004640 1 -- 172.21.15.121:0/3412241679 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fab700fb1f0 msgr2=0x7fab7010fbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:39:15.554 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:15.551+0000 7fab75004640 1 --2- 172.21.15.121:0/3412241679 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fab700fb1f0 0x7fab7010fbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:39:15.554 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:15.551+0000 7fab75004640 1 -- 172.21.15.121:0/3412241679 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab60005040 con 0x7fab700fc4c0 2024-08-18T22:39:15.554 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:15.551+0000 7fab75004640 1 --2- 172.21.15.121:0/3412241679 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fab700fc4c0 0x7fab70112110 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fab60000c00 tx=0x7fab60009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:39:15.554 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:15.552+0000 7fab667fc640 1 -- 172.21.15.121:0/3412241679 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fab60038070 con 0x7fab700fc4c0 2024-08-18T22:39:15.555 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:15.552+0000 7fab667fc640 1 -- 172.21.15.121:0/3412241679 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fab60004290 con 0x7fab700fc4c0 2024-08-18T22:39:15.555 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:15.552+0000 7fab77a69640 1 -- 172.21.15.121:0/3412241679 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab70112650 con 0x7fab700fc4c0 2024-08-18T22:39:15.555 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:15.552+0000 7fab667fc640 1 -- 172.21.15.121:0/3412241679 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fab6003e430 con 0x7fab700fc4c0 2024-08-18T22:39:15.555 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:15.552+0000 7fab77a69640 1 -- 172.21.15.121:0/3412241679 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab70112bc0 con 0x7fab700fc4c0 2024-08-18T22:39:15.555 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:15.553+0000 7fab77a69640 1 -- 172.21.15.121:0/3412241679 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab700fa650 con 0x7fab700fc4c0 2024-08-18T22:39:15.556 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:15.553+0000 7fab667fc640 1 -- 172.21.15.121:0/3412241679 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 19) v1 ==== 85127+0+0 (secure 0 0 0) 0x7fab60030020 con 0x7fab700fc4c0 2024-08-18T22:39:15.556 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:15.553+0000 7fab667fc640 1 --2- 172.21.15.121:0/3412241679 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7fab5c067190 0x7fab5c069640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:39:15.556 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:15.554+0000 7fab75805640 1 --2- 172.21.15.121:0/3412241679 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7fab5c067190 0x7fab5c069640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:39:15.556 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:15.554+0000 7fab667fc640 1 -- 172.21.15.121:0/3412241679 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5464+0+0 (secure 0 0 0) 0x7fab600a4bf0 con 0x7fab700fc4c0 2024-08-18T22:39:15.556 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:15.554+0000 7fab75805640 1 --2- 172.21.15.121:0/3412241679 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7fab5c067190 0x7fab5c069640 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fab700661e0 tx=0x7fab6c00b040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:39:15.558 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:15.558+0000 7fab667fc640 1 -- 172.21.15.121:0/3412241679 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fab60071f40 con 0x7fab700fc4c0 2024-08-18T22:39:15.755 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:15.754+0000 7fab77a69640 1 -- 172.21.15.121:0/3412241679 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fab70112ef0 con 0x7fab700fc4c0 2024-08-18T22:39:15.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:39:15 smithi195 ceph-mon[23370]: pgmap v172: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s wr, 8 op/s 2024-08-18T22:39:15.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:39:15 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:39:15.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:39:15 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:39:15.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:39:15 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:39:15.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:39:15 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi195.nptgyc", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-08-18T22:39:15.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:39:15 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi195.nptgyc", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-18T22:39:15.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:39:15 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:39:16.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:39:15 smithi121 ceph-mon[16788]: pgmap v172: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s wr, 8 op/s 2024-08-18T22:39:16.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:39:15 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:39:16.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:39:15 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:39:16.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:39:15 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:39:16.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:39:15 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi195.nptgyc", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-08-18T22:39:16.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:39:15 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi195.nptgyc", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-18T22:39:16.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:39:15 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:39:16.602 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:16.601+0000 7fab667fc640 1 -- 172.21.15.121:0/3412241679 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7fab60075560 con 0x7fab700fc4c0 2024-08-18T22:39:16.604 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:16.603+0000 7fab77a69640 1 -- 172.21.15.121:0/3412241679 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7fab5c067190 msgr2=0x7fab5c069640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:39:16.605 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:16.603+0000 7fab77a69640 1 --2- 172.21.15.121:0/3412241679 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7fab5c067190 0x7fab5c069640 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fab700661e0 tx=0x7fab6c00b040 comp rx=0 tx=0).stop 2024-08-18T22:39:16.605 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:16.603+0000 7fab77a69640 1 -- 172.21.15.121:0/3412241679 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fab700fc4c0 msgr2=0x7fab70112110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:39:16.605 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:16.603+0000 7fab77a69640 1 --2- 172.21.15.121:0/3412241679 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fab700fc4c0 0x7fab70112110 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fab60000c00 tx=0x7fab60009da0 comp rx=0 tx=0).stop 2024-08-18T22:39:16.605 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:16.603+0000 7fab77a69640 1 -- 172.21.15.121:0/3412241679 shutdown_connections 2024-08-18T22:39:16.605 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:16.603+0000 7fab77a69640 1 --2- 172.21.15.121:0/3412241679 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7fab5c067190 0x7fab5c069640 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:39:16.605 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:16.603+0000 7fab77a69640 1 --2- 172.21.15.121:0/3412241679 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fab700fc4c0 0x7fab70112110 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:39:16.605 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:16.603+0000 7fab77a69640 1 --2- 172.21.15.121:0/3412241679 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fab700fb1f0 0x7fab7010fbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:39:16.605 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:16.603+0000 7fab77a69640 1 -- 172.21.15.121:0/3412241679 >> 172.21.15.121:0/3412241679 conn(0x7fab700f69b0 msgr2=0x7fab700f81b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:39:16.605 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:16.603+0000 7fab77a69640 1 -- 172.21.15.121:0/3412241679 shutdown_connections 2024-08-18T22:39:16.605 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:16.603+0000 7fab77a69640 1 -- 172.21.15.121:0/3412241679 wait complete. 2024-08-18T22:39:16.864 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:39:16 smithi195 ceph-mon[23370]: Deploying daemon mds.cephfs.smithi195.nptgyc on smithi195 2024-08-18T22:39:16.865 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:39:16 smithi195 ceph-mon[23370]: Health check cleared: MDS_INSUFFICIENT_STANDBY (was: insufficient standby MDS daemons available) 2024-08-18T22:39:16.865 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:39:16 smithi195 ceph-mon[23370]: Cluster is now healthy 2024-08-18T22:39:16.865 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:39:16 smithi195 ceph-mon[23370]: mds.? [v2:172.21.15.121:6828/2277706406,v1:172.21.15.121:6829/2277706406] up:boot 2024-08-18T22:39:16.865 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:39:16 smithi195 ceph-mon[23370]: fsmap cephfs:2 {0=cephfs.smithi121.xuzsdg=up:active,1=cephfs.smithi195.buqvbr=up:active} 1 up:standby 2024-08-18T22:39:16.865 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:39:16 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi121.gbickb"}]: dispatch 2024-08-18T22:39:16.865 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:39:16 smithi195 ceph-mon[23370]: from='client.? 172.21.15.121:0/3412241679' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]: dispatch 2024-08-18T22:39:16.939 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:39:16 smithi121 ceph-mon[16788]: Deploying daemon mds.cephfs.smithi195.nptgyc on smithi195 2024-08-18T22:39:16.939 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:39:16 smithi121 ceph-mon[16788]: Health check cleared: MDS_INSUFFICIENT_STANDBY (was: insufficient standby MDS daemons available) 2024-08-18T22:39:16.939 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:39:16 smithi121 ceph-mon[16788]: Cluster is now healthy 2024-08-18T22:39:16.939 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:39:16 smithi121 ceph-mon[16788]: mds.? [v2:172.21.15.121:6828/2277706406,v1:172.21.15.121:6829/2277706406] up:boot 2024-08-18T22:39:16.939 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:39:16 smithi121 ceph-mon[16788]: fsmap cephfs:2 {0=cephfs.smithi121.xuzsdg=up:active,1=cephfs.smithi195.buqvbr=up:active} 1 up:standby 2024-08-18T22:39:16.939 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:39:16 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi121.gbickb"}]: dispatch 2024-08-18T22:39:16.939 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:39:16 smithi121 ceph-mon[16788]: from='client.? 172.21.15.121:0/3412241679' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]: dispatch 2024-08-18T22:39:17.223 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-08-18T22:39:17.232 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi121.front.sepia.ceph.com 2024-08-18T22:39:17.233 DEBUG:teuthology.orchestra.run.smithi121:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b003123a-5db1-11ef-bccf-c7b262605968 -- bash -c 'ceph fs set cephfs inline_data false' 2024-08-18T22:39:17.484 INFO:teuthology.orchestra.run.smithi121.stderr:Inferring config /var/lib/ceph/b003123a-5db1-11ef-bccf-c7b262605968/mon.smithi121/config 2024-08-18T22:39:17.783 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:39:17 smithi195 ceph-mon[23370]: pgmap v173: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.3 KiB/s wr, 7 op/s 2024-08-18T22:39:17.783 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:39:17 smithi195 ceph-mon[23370]: from='client.? 172.21.15.121:0/3412241679' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]': finished 2024-08-18T22:39:17.783 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:39:17 smithi195 ceph-mon[23370]: fsmap cephfs:2 {0=cephfs.smithi121.xuzsdg=up:active,1=cephfs.smithi195.buqvbr=up:active} 1 up:standby 2024-08-18T22:39:17.884 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:39:17 smithi121 ceph-mon[16788]: pgmap v173: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.3 KiB/s wr, 7 op/s 2024-08-18T22:39:17.885 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:39:17 smithi121 ceph-mon[16788]: from='client.? 172.21.15.121:0/3412241679' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]': finished 2024-08-18T22:39:17.885 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:39:17 smithi121 ceph-mon[16788]: fsmap cephfs:2 {0=cephfs.smithi121.xuzsdg=up:active,1=cephfs.smithi195.buqvbr=up:active} 1 up:standby 2024-08-18T22:39:18.992 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:18.980+0000 7fe0d7323640 1 -- 172.21.15.121:0/1064355169 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe0d00659e0 msgr2=0x7fe0d00feee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:39:18.992 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:18.980+0000 7fe0d7323640 1 --2- 172.21.15.121:0/1064355169 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe0d00659e0 0x7fe0d00feee0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fe0cc0048d0 tx=0x7fe0cc009da0 comp rx=0 tx=0).stop 2024-08-18T22:39:18.992 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:18.980+0000 7fe0d7323640 1 -- 172.21.15.121:0/1064355169 shutdown_connections 2024-08-18T22:39:18.992 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:18.980+0000 7fe0d7323640 1 --2- 172.21.15.121:0/1064355169 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe0d00ff420 0x7fe0d0101800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:39:18.993 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:18.980+0000 7fe0d7323640 1 --2- 172.21.15.121:0/1064355169 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe0d00659e0 0x7fe0d00feee0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:39:18.993 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:18.980+0000 7fe0d7323640 1 -- 172.21.15.121:0/1064355169 >> 172.21.15.121:0/1064355169 conn(0x7fe0d00f69b0 msgr2=0x7fe0d00f8dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:39:18.993 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:18.980+0000 7fe0d7323640 1 -- 172.21.15.121:0/1064355169 shutdown_connections 2024-08-18T22:39:18.993 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:18.980+0000 7fe0d7323640 1 -- 172.21.15.121:0/1064355169 wait complete. 2024-08-18T22:39:18.993 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:18.980+0000 7fe0d7323640 1 Processor -- start 2024-08-18T22:39:18.993 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:18.980+0000 7fe0d7323640 1 -- start start 2024-08-18T22:39:18.993 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:18.980+0000 7fe0d7323640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe0d00659e0 0x7fe0d00fc8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:39:18.993 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:18.981+0000 7fe0d7323640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe0d00ff420 0x7fe0d00fade0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:39:18.993 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:18.981+0000 7fe0d7323640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0d00fb320 con 0x7fe0d00ff420 2024-08-18T22:39:18.993 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:18.981+0000 7fe0d7323640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0d00fb460 con 0x7fe0d00659e0 2024-08-18T22:39:18.993 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:18.981+0000 7fe0d48be640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe0d00ff420 0x7fe0d00fade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:39:18.993 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:18.981+0000 7fe0d48be640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe0d00ff420 0x7fe0d00fade0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:49796/0 (socket says 172.21.15.121:49796) 2024-08-18T22:39:18.993 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:18.981+0000 7fe0d48be640 1 -- 172.21.15.121:0/1865222934 learned_addr learned my addr 172.21.15.121:0/1865222934 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-18T22:39:18.994 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:18.981+0000 7fe0d50bf640 1 --2- 172.21.15.121:0/1865222934 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe0d00659e0 0x7fe0d00fc8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:39:18.994 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:18.981+0000 7fe0d48be640 1 -- 172.21.15.121:0/1865222934 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe0d00659e0 msgr2=0x7fe0d00fc8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:39:18.994 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:18.981+0000 7fe0d48be640 1 --2- 172.21.15.121:0/1865222934 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe0d00659e0 0x7fe0d00fc8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:39:18.994 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:18.981+0000 7fe0d48be640 1 -- 172.21.15.121:0/1865222934 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0cc005040 con 0x7fe0d00ff420 2024-08-18T22:39:18.994 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:18.981+0000 7fe0d48be640 1 --2- 172.21.15.121:0/1865222934 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe0d00ff420 0x7fe0d00fade0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fe0c000c830 tx=0x7fe0c0004430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:39:18.994 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:18.981+0000 7fe0c5ffb640 1 -- 172.21.15.121:0/1865222934 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe0c000a850 con 0x7fe0d00ff420 2024-08-18T22:39:18.994 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:18.981+0000 7fe0c5ffb640 1 -- 172.21.15.121:0/1865222934 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fe0c000ae50 con 0x7fe0d00ff420 2024-08-18T22:39:18.994 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:18.981+0000 7fe0d7323640 1 -- 172.21.15.121:0/1865222934 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0d00fb740 con 0x7fe0d00ff420 2024-08-18T22:39:18.994 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:18.981+0000 7fe0c5ffb640 1 -- 172.21.15.121:0/1865222934 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe0c00113a0 con 0x7fe0d00ff420 2024-08-18T22:39:18.994 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:18.981+0000 7fe0d7323640 1 -- 172.21.15.121:0/1865222934 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0d0114ee0 con 0x7fe0d00ff420 2024-08-18T22:39:18.994 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:18.982+0000 7fe0d7323640 1 -- 172.21.15.121:0/1865222934 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0d00fa630 con 0x7fe0d00ff420 2024-08-18T22:39:18.994 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:18.983+0000 7fe0c5ffb640 1 -- 172.21.15.121:0/1865222934 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 19) v1 ==== 85127+0+0 (secure 0 0 0) 0x7fe0c0012400 con 0x7fe0d00ff420 2024-08-18T22:39:18.995 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:18.983+0000 7fe0c5ffb640 1 --2- 172.21.15.121:0/1865222934 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7fe0bc067190 0x7fe0bc069640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:39:18.995 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:18.983+0000 7fe0d50bf640 1 --2- 172.21.15.121:0/1865222934 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7fe0bc067190 0x7fe0bc069640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:39:18.995 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:18.983+0000 7fe0c5ffb640 1 -- 172.21.15.121:0/1865222934 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5464+0+0 (secure 0 0 0) 0x7fe0c0084d80 con 0x7fe0d00ff420 2024-08-18T22:39:18.995 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:18.984+0000 7fe0d50bf640 1 --2- 172.21.15.121:0/1865222934 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7fe0bc067190 0x7fe0bc069640 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fe0cc000c00 tx=0x7fe0cc035040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:39:18.995 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:18.991+0000 7fe0c5ffb640 1 -- 172.21.15.121:0/1865222934 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fe0c00520a0 con 0x7fe0d00ff420 2024-08-18T22:39:19.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:39:18 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:39:19.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:39:18 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:39:19.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:39:18 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:39:19.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:39:18 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:39:19.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:39:18 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:39:19.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:39:18 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-18T22:39:19.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:39:18 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:39:19.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:39:18 smithi121 ceph-mon[16788]: mds.? [v2:172.21.15.195:6826/238549847,v1:172.21.15.195:6827/238549847] up:boot 2024-08-18T22:39:19.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:39:18 smithi121 ceph-mon[16788]: fsmap cephfs:2 {0=cephfs.smithi121.xuzsdg=up:active,1=cephfs.smithi195.buqvbr=up:active} 2 up:standby 2024-08-18T22:39:19.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:39:18 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi195.nptgyc"}]: dispatch 2024-08-18T22:39:19.225 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:19.224+0000 7fe0d7323640 1 -- 172.21.15.121:0/1865222934 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "false"} v 0) v1 -- 0x7fe0d004b4c0 con 0x7fe0d00ff420 2024-08-18T22:39:19.267 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:39:18 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:39:19.267 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:39:18 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:39:19.267 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:39:18 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:39:19.267 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:39:18 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:39:19.267 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:39:18 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:39:19.267 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:39:18 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-18T22:39:19.267 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:39:18 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:39:19.268 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:39:18 smithi195 ceph-mon[23370]: mds.? [v2:172.21.15.195:6826/238549847,v1:172.21.15.195:6827/238549847] up:boot 2024-08-18T22:39:19.268 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:39:18 smithi195 ceph-mon[23370]: fsmap cephfs:2 {0=cephfs.smithi121.xuzsdg=up:active,1=cephfs.smithi195.buqvbr=up:active} 2 up:standby 2024-08-18T22:39:19.268 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:39:18 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi195.nptgyc"}]: dispatch 2024-08-18T22:39:19.933 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:19.932+0000 7fe0c5ffb640 1 -- 172.21.15.121:0/1865222934 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "false"}]=0 inline data disabled v12) v1 ==== 133+0+0 (secure 0 0 0) 0x7fe0c00860b0 con 0x7fe0d00ff420 2024-08-18T22:39:19.933 INFO:teuthology.orchestra.run.smithi121.stderr:inline data disabled 2024-08-18T22:39:19.936 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:19.935+0000 7fe0d7323640 1 -- 172.21.15.121:0/1865222934 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7fe0bc067190 msgr2=0x7fe0bc069640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:39:19.936 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:19.935+0000 7fe0d7323640 1 --2- 172.21.15.121:0/1865222934 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7fe0bc067190 0x7fe0bc069640 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fe0cc000c00 tx=0x7fe0cc035040 comp rx=0 tx=0).stop 2024-08-18T22:39:19.936 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:19.935+0000 7fe0d7323640 1 -- 172.21.15.121:0/1865222934 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe0d00ff420 msgr2=0x7fe0d00fade0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:39:19.936 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:19.935+0000 7fe0d7323640 1 --2- 172.21.15.121:0/1865222934 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe0d00ff420 0x7fe0d00fade0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fe0c000c830 tx=0x7fe0c0004430 comp rx=0 tx=0).stop 2024-08-18T22:39:19.936 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:19.935+0000 7fe0d7323640 1 -- 172.21.15.121:0/1865222934 shutdown_connections 2024-08-18T22:39:19.936 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:19.935+0000 7fe0d7323640 1 --2- 172.21.15.121:0/1865222934 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7fe0bc067190 0x7fe0bc069640 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:39:19.936 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:19.935+0000 7fe0d7323640 1 --2- 172.21.15.121:0/1865222934 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe0d00ff420 0x7fe0d00fade0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:39:19.937 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:19.935+0000 7fe0d7323640 1 --2- 172.21.15.121:0/1865222934 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe0d00659e0 0x7fe0d00fc8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:39:19.937 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:19.935+0000 7fe0d7323640 1 -- 172.21.15.121:0/1865222934 >> 172.21.15.121:0/1865222934 conn(0x7fe0d00f69b0 msgr2=0x7fe0d00f6d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:39:19.937 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:19.935+0000 7fe0d7323640 1 -- 172.21.15.121:0/1865222934 shutdown_connections 2024-08-18T22:39:19.937 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:19.936+0000 7fe0d7323640 1 -- 172.21.15.121:0/1865222934 wait complete. 2024-08-18T22:39:20.198 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:39:19 smithi121 ceph-mon[16788]: pgmap v174: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s wr, 7 op/s 2024-08-18T22:39:20.199 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:39:19 smithi121 ceph-mon[16788]: from='client.? 172.21.15.121:0/1865222934' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "false"}]: dispatch 2024-08-18T22:39:20.409 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:39:19 smithi195 ceph-mon[23370]: pgmap v174: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s wr, 7 op/s 2024-08-18T22:39:20.409 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:39:19 smithi195 ceph-mon[23370]: from='client.? 172.21.15.121:0/1865222934' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "false"}]: dispatch 2024-08-18T22:39:21.320 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:39:20 smithi121 ceph-mon[16788]: mds.? [v2:172.21.15.195:6824/2414511859,v1:172.21.15.195:6825/2414511859] up:active 2024-08-18T22:39:21.320 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:39:20 smithi121 ceph-mon[16788]: from='client.? 172.21.15.121:0/1865222934' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "false"}]': finished 2024-08-18T22:39:21.320 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:39:20 smithi121 ceph-mon[16788]: mds.? [v2:172.21.15.121:6828/2277706406,v1:172.21.15.121:6829/2277706406] up:standby 2024-08-18T22:39:21.321 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:39:20 smithi121 ceph-mon[16788]: Dropping low affinity active daemon mds.cephfs.smithi121.xuzsdg in favor of higher affinity standby. 2024-08-18T22:39:21.321 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:39:20 smithi121 ceph-mon[16788]: Replacing daemon mds.cephfs.smithi121.xuzsdg as rank 0 with standby daemon mds.cephfs.smithi121.gbickb 2024-08-18T22:39:21.321 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:39:20 smithi121 ceph-mon[16788]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-08-18T22:39:21.321 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:39:20 smithi121 ceph-mon[16788]: fsmap cephfs:2 {0=cephfs.smithi121.xuzsdg=up:active,1=cephfs.smithi195.buqvbr=up:active} 2 up:standby 2024-08-18T22:39:21.321 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:39:20 smithi121 ceph-mon[16788]: osdmap e47: 6 total, 6 up, 6 in 2024-08-18T22:39:21.321 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:39:20 smithi121 ceph-mon[16788]: fsmap cephfs:2/2 {0=cephfs.smithi121.gbickb=up:replay,1=cephfs.smithi195.buqvbr=up:active} 1 up:standby 2024-08-18T22:39:21.321 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:39:20 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:39:21.321 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:39:20 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:39:21.358 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-08-18T22:39:21.367 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi121.front.sepia.ceph.com 2024-08-18T22:39:21.368 DEBUG:teuthology.orchestra.run.smithi121:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b003123a-5db1-11ef-bccf-c7b262605968 -- bash -c 'ceph fs dump' 2024-08-18T22:39:21.409 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:39:20 smithi195 ceph-mon[23370]: mds.? [v2:172.21.15.195:6824/2414511859,v1:172.21.15.195:6825/2414511859] up:active 2024-08-18T22:39:21.409 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:39:20 smithi195 ceph-mon[23370]: from='client.? 172.21.15.121:0/1865222934' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "false"}]': finished 2024-08-18T22:39:21.409 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:39:20 smithi195 ceph-mon[23370]: mds.? [v2:172.21.15.121:6828/2277706406,v1:172.21.15.121:6829/2277706406] up:standby 2024-08-18T22:39:21.409 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:39:20 smithi195 ceph-mon[23370]: Dropping low affinity active daemon mds.cephfs.smithi121.xuzsdg in favor of higher affinity standby. 2024-08-18T22:39:21.409 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:39:20 smithi195 ceph-mon[23370]: Replacing daemon mds.cephfs.smithi121.xuzsdg as rank 0 with standby daemon mds.cephfs.smithi121.gbickb 2024-08-18T22:39:21.409 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:39:20 smithi195 ceph-mon[23370]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-08-18T22:39:21.409 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:39:20 smithi195 ceph-mon[23370]: fsmap cephfs:2 {0=cephfs.smithi121.xuzsdg=up:active,1=cephfs.smithi195.buqvbr=up:active} 2 up:standby 2024-08-18T22:39:21.410 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:39:20 smithi195 ceph-mon[23370]: osdmap e47: 6 total, 6 up, 6 in 2024-08-18T22:39:21.410 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:39:20 smithi195 ceph-mon[23370]: fsmap cephfs:2/2 {0=cephfs.smithi121.gbickb=up:replay,1=cephfs.smithi195.buqvbr=up:active} 1 up:standby 2024-08-18T22:39:21.410 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:39:20 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:39:21.410 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:39:20 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:39:22.209 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:39:21 smithi121 ceph-mon[16788]: pgmap v176: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.4 KiB/s wr, 8 op/s 2024-08-18T22:39:22.209 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:39:21 smithi121 ceph-mon[16788]: mds.? [v2:172.21.15.121:6828/2277706406,v1:172.21.15.121:6829/2277706406] up:resolve 2024-08-18T22:39:22.209 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:39:21 smithi121 ceph-mon[16788]: mds.? [v2:172.21.15.121:6826/91588128,v1:172.21.15.121:6827/91588128] up:boot 2024-08-18T22:39:22.209 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:39:21 smithi121 ceph-mon[16788]: fsmap cephfs:2/2 {0=cephfs.smithi121.gbickb=up:resolve,1=cephfs.smithi195.buqvbr=up:active} 2 up:standby 2024-08-18T22:39:22.209 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:39:21 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi121.xuzsdg"}]: dispatch 2024-08-18T22:39:22.409 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:39:21 smithi195 ceph-mon[23370]: pgmap v176: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.4 KiB/s wr, 8 op/s 2024-08-18T22:39:22.409 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:39:21 smithi195 ceph-mon[23370]: mds.? [v2:172.21.15.121:6828/2277706406,v1:172.21.15.121:6829/2277706406] up:resolve 2024-08-18T22:39:22.409 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:39:21 smithi195 ceph-mon[23370]: mds.? [v2:172.21.15.121:6826/91588128,v1:172.21.15.121:6827/91588128] up:boot 2024-08-18T22:39:22.409 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:39:21 smithi195 ceph-mon[23370]: fsmap cephfs:2/2 {0=cephfs.smithi121.gbickb=up:resolve,1=cephfs.smithi195.buqvbr=up:active} 2 up:standby 2024-08-18T22:39:22.409 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:39:21 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi121.xuzsdg"}]: dispatch 2024-08-18T22:39:22.606 INFO:teuthology.orchestra.run.smithi121.stderr:Inferring config /var/lib/ceph/b003123a-5db1-11ef-bccf-c7b262605968/mon.smithi121/config 2024-08-18T22:39:23.030 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:39:22 smithi121 ceph-mon[16788]: mds.? [v2:172.21.15.121:6828/2277706406,v1:172.21.15.121:6829/2277706406] up:reconnect 2024-08-18T22:39:23.031 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:39:22 smithi121 ceph-mon[16788]: mds.? [v2:172.21.15.195:6826/238549847,v1:172.21.15.195:6827/238549847] up:standby 2024-08-18T22:39:23.031 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:39:22 smithi121 ceph-mon[16788]: fsmap cephfs:2/2 {0=cephfs.smithi121.gbickb=up:reconnect,1=cephfs.smithi195.buqvbr=up:active} 2 up:standby 2024-08-18T22:39:23.409 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:39:22 smithi195 ceph-mon[23370]: mds.? [v2:172.21.15.121:6828/2277706406,v1:172.21.15.121:6829/2277706406] up:reconnect 2024-08-18T22:39:23.409 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:39:22 smithi195 ceph-mon[23370]: mds.? [v2:172.21.15.195:6826/238549847,v1:172.21.15.195:6827/238549847] up:standby 2024-08-18T22:39:23.409 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:39:22 smithi195 ceph-mon[23370]: fsmap cephfs:2/2 {0=cephfs.smithi121.gbickb=up:reconnect,1=cephfs.smithi195.buqvbr=up:active} 2 up:standby 2024-08-18T22:39:24.149 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:39:23 smithi121 ceph-mon[16788]: pgmap v177: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 716 B/s rd, 409 B/s wr, 4 op/s 2024-08-18T22:39:24.149 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:39:23 smithi121 ceph-mon[16788]: mds.? [v2:172.21.15.121:6828/2277706406,v1:172.21.15.121:6829/2277706406] up:rejoin 2024-08-18T22:39:24.149 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:39:23 smithi121 ceph-mon[16788]: fsmap cephfs:2/2 {0=cephfs.smithi121.gbickb=up:rejoin,1=cephfs.smithi195.buqvbr=up:active} 2 up:standby 2024-08-18T22:39:24.149 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:39:23 smithi121 ceph-mon[16788]: daemon mds.cephfs.smithi121.gbickb is now active in filesystem cephfs as rank 0 2024-08-18T22:39:24.149 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:39:23 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:39:24.149 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:39:23 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-18T22:39:24.323 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:24.318+0000 7f34b4627640 1 -- 172.21.15.121:0/196871975 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f34ac0fb1d0 msgr2=0x7f34ac0fb5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:39:24.324 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:24.318+0000 7f34b4627640 1 --2- 172.21.15.121:0/196871975 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f34ac0fb1d0 0x7f34ac0fb5e0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f349c0048d0 tx=0x7f349c009da0 comp rx=0 tx=0).stop 2024-08-18T22:39:24.324 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:24.318+0000 7f34b4627640 1 -- 172.21.15.121:0/196871975 shutdown_connections 2024-08-18T22:39:24.324 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:24.318+0000 7f34b4627640 1 --2- 172.21.15.121:0/196871975 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f34ac0fc4a0 0x7f34ac0fc910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:39:24.324 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:24.318+0000 7f34b4627640 1 --2- 172.21.15.121:0/196871975 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f34ac0fb1d0 0x7f34ac0fb5e0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:39:24.324 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:24.318+0000 7f34b4627640 1 -- 172.21.15.121:0/196871975 >> 172.21.15.121:0/196871975 conn(0x7f34ac0f69b0 msgr2=0x7f34ac0f8dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:39:24.324 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:24.319+0000 7f34b4627640 1 -- 172.21.15.121:0/196871975 shutdown_connections 2024-08-18T22:39:24.324 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:24.319+0000 7f34b4627640 1 -- 172.21.15.121:0/196871975 wait complete. 2024-08-18T22:39:24.324 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:24.319+0000 7f34b4627640 1 Processor -- start 2024-08-18T22:39:24.324 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:24.319+0000 7f34b4627640 1 -- start start 2024-08-18T22:39:24.324 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:24.319+0000 7f34b4627640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f34ac0fb1d0 0x7f34ac10ce70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:39:24.324 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:24.319+0000 7f34b4627640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f34ac0fc4a0 0x7f34ac10d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:39:24.324 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:24.319+0000 7f34b4627640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34ac10da00 con 0x7f34ac0fc4a0 2024-08-18T22:39:24.325 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:24.319+0000 7f34b4627640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34ac10e140 con 0x7f34ac0fb1d0 2024-08-18T22:39:24.325 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:24.319+0000 7f34b1bc2640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f34ac0fc4a0 0x7f34ac10d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:39:24.325 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:24.320+0000 7f34b1bc2640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f34ac0fc4a0 0x7f34ac10d3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:49842/0 (socket says 172.21.15.121:49842) 2024-08-18T22:39:24.325 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:24.320+0000 7f34b1bc2640 1 -- 172.21.15.121:0/597383438 learned_addr learned my addr 172.21.15.121:0/597383438 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-18T22:39:24.325 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:24.320+0000 7f34b23c3640 1 --2- 172.21.15.121:0/597383438 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f34ac0fb1d0 0x7f34ac10ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:39:24.325 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:24.320+0000 7f34b1bc2640 1 -- 172.21.15.121:0/597383438 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f34ac0fb1d0 msgr2=0x7f34ac10ce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:39:24.325 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:24.320+0000 7f34b1bc2640 1 --2- 172.21.15.121:0/597383438 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f34ac0fb1d0 0x7f34ac10ce70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:39:24.325 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:24.320+0000 7f34b1bc2640 1 -- 172.21.15.121:0/597383438 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f349c005040 con 0x7f34ac0fc4a0 2024-08-18T22:39:24.325 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:24.320+0000 7f34b1bc2640 1 --2- 172.21.15.121:0/597383438 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f34ac0fc4a0 0x7f34ac10d3b0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f34a8002a50 tx=0x7f34a8004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:39:24.325 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:24.320+0000 7f34a2ffd640 1 -- 172.21.15.121:0/597383438 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f34a8007c30 con 0x7f34ac0fc4a0 2024-08-18T22:39:24.325 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:24.320+0000 7f34a2ffd640 1 -- 172.21.15.121:0/597383438 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f34a800f040 con 0x7f34ac0fc4a0 2024-08-18T22:39:24.325 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:24.320+0000 7f34b4627640 1 -- 172.21.15.121:0/597383438 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34ac10e3d0 con 0x7f34ac0fc4a0 2024-08-18T22:39:24.325 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:24.320+0000 7f34a2ffd640 1 -- 172.21.15.121:0/597383438 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f34a800dad0 con 0x7f34ac0fc4a0 2024-08-18T22:39:24.326 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:24.320+0000 7f34b4627640 1 -- 172.21.15.121:0/597383438 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34ac10e970 con 0x7f34ac0fc4a0 2024-08-18T22:39:24.326 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:24.322+0000 7f34a2ffd640 1 -- 172.21.15.121:0/597383438 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 19) v1 ==== 85127+0+0 (secure 0 0 0) 0x7f34a800dc30 con 0x7f34ac0fc4a0 2024-08-18T22:39:24.326 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:24.322+0000 7f34b4627640 1 -- 172.21.15.121:0/597383438 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34ac0fa630 con 0x7f34ac0fc4a0 2024-08-18T22:39:24.326 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:24.322+0000 7f34a2ffd640 1 --2- 172.21.15.121:0/597383438 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7f3498067190 0x7f3498069640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:39:24.326 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:24.322+0000 7f34a2ffd640 1 -- 172.21.15.121:0/597383438 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f34a8084a10 con 0x7f34ac0fc4a0 2024-08-18T22:39:24.326 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:24.322+0000 7f34b23c3640 1 --2- 172.21.15.121:0/597383438 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7f3498067190 0x7f3498069640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:39:24.326 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:24.323+0000 7f34b23c3640 1 --2- 172.21.15.121:0/597383438 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7f3498067190 0x7f3498069640 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f349c000c00 tx=0x7f349c035040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:39:24.327 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:24.327+0000 7f34a2ffd640 1 -- 172.21.15.121:0/597383438 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f34a8051c60 con 0x7f34ac0fc4a0 2024-08-18T22:39:24.409 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:39:23 smithi195 ceph-mon[23370]: pgmap v177: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 716 B/s rd, 409 B/s wr, 4 op/s 2024-08-18T22:39:24.409 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:39:23 smithi195 ceph-mon[23370]: mds.? [v2:172.21.15.121:6828/2277706406,v1:172.21.15.121:6829/2277706406] up:rejoin 2024-08-18T22:39:24.409 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:39:23 smithi195 ceph-mon[23370]: fsmap cephfs:2/2 {0=cephfs.smithi121.gbickb=up:rejoin,1=cephfs.smithi195.buqvbr=up:active} 2 up:standby 2024-08-18T22:39:24.409 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:39:23 smithi195 ceph-mon[23370]: daemon mds.cephfs.smithi121.gbickb is now active in filesystem cephfs as rank 0 2024-08-18T22:39:24.409 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:39:23 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:39:24.409 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:39:23 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-18T22:39:24.541 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:24.540+0000 7f34b4627640 1 -- 172.21.15.121:0/597383438 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f34ac100fa0 con 0x7f34ac0fc4a0 2024-08-18T22:39:24.542 INFO:teuthology.orchestra.run.smithi121.stdout:e17 2024-08-18T22:39:24.542 INFO:teuthology.orchestra.run.smithi121.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-08-18T22:39:24.542 INFO:teuthology.orchestra.run.smithi121.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-08-18T22:39:24.542 INFO:teuthology.orchestra.run.smithi121.stdout:legacy client fscid: 1 2024-08-18T22:39:24.542 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-08-18T22:39:24.542 INFO:teuthology.orchestra.run.smithi121.stdout:Filesystem 'cephfs' (1) 2024-08-18T22:39:24.542 INFO:teuthology.orchestra.run.smithi121.stdout:fs_name cephfs 2024-08-18T22:39:24.542 INFO:teuthology.orchestra.run.smithi121.stdout:epoch 17 2024-08-18T22:39:24.542 INFO:teuthology.orchestra.run.smithi121.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-08-18T22:39:24.542 INFO:teuthology.orchestra.run.smithi121.stdout:created 2024-08-18T22:39:04.054074+0000 2024-08-18T22:39:24.542 INFO:teuthology.orchestra.run.smithi121.stdout:modified 2024-08-18T22:39:23.955493+0000 2024-08-18T22:39:24.543 INFO:teuthology.orchestra.run.smithi121.stdout:tableserver 0 2024-08-18T22:39:24.543 INFO:teuthology.orchestra.run.smithi121.stdout:root 0 2024-08-18T22:39:24.543 INFO:teuthology.orchestra.run.smithi121.stdout:session_timeout 60 2024-08-18T22:39:24.543 INFO:teuthology.orchestra.run.smithi121.stdout:session_autoclose 300 2024-08-18T22:39:24.543 INFO:teuthology.orchestra.run.smithi121.stdout:max_file_size 1099511627776 2024-08-18T22:39:24.543 INFO:teuthology.orchestra.run.smithi121.stdout:required_client_features {} 2024-08-18T22:39:24.543 INFO:teuthology.orchestra.run.smithi121.stdout:last_failure 0 2024-08-18T22:39:24.543 INFO:teuthology.orchestra.run.smithi121.stdout:last_failure_osd_epoch 47 2024-08-18T22:39:24.543 INFO:teuthology.orchestra.run.smithi121.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-08-18T22:39:24.543 INFO:teuthology.orchestra.run.smithi121.stdout:max_mds 2 2024-08-18T22:39:24.543 INFO:teuthology.orchestra.run.smithi121.stdout:in 0,1 2024-08-18T22:39:24.543 INFO:teuthology.orchestra.run.smithi121.stdout:up {0=14474,1=24249} 2024-08-18T22:39:24.543 INFO:teuthology.orchestra.run.smithi121.stdout:failed 2024-08-18T22:39:24.543 INFO:teuthology.orchestra.run.smithi121.stdout:damaged 2024-08-18T22:39:24.544 INFO:teuthology.orchestra.run.smithi121.stdout:stopped 2024-08-18T22:39:24.544 INFO:teuthology.orchestra.run.smithi121.stdout:data_pools [3] 2024-08-18T22:39:24.544 INFO:teuthology.orchestra.run.smithi121.stdout:metadata_pool 2 2024-08-18T22:39:24.544 INFO:teuthology.orchestra.run.smithi121.stdout:inline_data disabled 2024-08-18T22:39:24.544 INFO:teuthology.orchestra.run.smithi121.stdout:balancer 2024-08-18T22:39:24.544 INFO:teuthology.orchestra.run.smithi121.stdout:standby_count_wanted 1 2024-08-18T22:39:24.544 INFO:teuthology.orchestra.run.smithi121.stdout:[mds.cephfs.smithi121.gbickb{0:14474} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.121:6828/2277706406,v1:172.21.15.121:6829/2277706406] compat {c=[1],r=[1],i=[7ff]}] 2024-08-18T22:39:24.544 INFO:teuthology.orchestra.run.smithi121.stdout:[mds.cephfs.smithi195.buqvbr{1:24249} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.195:6824/2414511859,v1:172.21.15.195:6825/2414511859] compat {c=[1],r=[1],i=[7ff]}] 2024-08-18T22:39:24.544 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-08-18T22:39:24.544 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-08-18T22:39:24.544 INFO:teuthology.orchestra.run.smithi121.stdout:Standby daemons: 2024-08-18T22:39:24.544 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-08-18T22:39:24.544 INFO:teuthology.orchestra.run.smithi121.stdout:[mds.cephfs.smithi121.xuzsdg{-1:14490} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.121:6826/91588128,v1:172.21.15.121:6827/91588128] compat {c=[1],r=[1],i=[7ff]}] 2024-08-18T22:39:24.544 INFO:teuthology.orchestra.run.smithi121.stdout:[mds.cephfs.smithi195.nptgyc{-1:24259} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.195:6826/238549847,v1:172.21.15.195:6827/238549847] compat {c=[1],r=[1],i=[7ff]}] 2024-08-18T22:39:24.545 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:24.540+0000 7f34a2ffd640 1 -- 172.21.15.121:0/597383438 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 17 v17) v1 ==== 76+0+1818 (secure 0 0 0) 0x7f34a8055280 con 0x7f34ac0fc4a0 2024-08-18T22:39:24.545 INFO:teuthology.orchestra.run.smithi121.stderr:dumped fsmap epoch 17 2024-08-18T22:39:24.545 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:24.542+0000 7f34b4627640 1 -- 172.21.15.121:0/597383438 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7f3498067190 msgr2=0x7f3498069640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:39:24.545 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:24.542+0000 7f34b4627640 1 --2- 172.21.15.121:0/597383438 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7f3498067190 0x7f3498069640 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f349c000c00 tx=0x7f349c035040 comp rx=0 tx=0).stop 2024-08-18T22:39:24.545 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:24.542+0000 7f34b4627640 1 -- 172.21.15.121:0/597383438 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f34ac0fc4a0 msgr2=0x7f34ac10d3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:39:24.545 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:24.542+0000 7f34b4627640 1 --2- 172.21.15.121:0/597383438 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f34ac0fc4a0 0x7f34ac10d3b0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f34a8002a50 tx=0x7f34a8004600 comp rx=0 tx=0).stop 2024-08-18T22:39:24.545 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:24.542+0000 7f34b4627640 1 -- 172.21.15.121:0/597383438 shutdown_connections 2024-08-18T22:39:24.546 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:24.542+0000 7f34b4627640 1 --2- 172.21.15.121:0/597383438 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7f3498067190 0x7f3498069640 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:39:24.546 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:24.542+0000 7f34b4627640 1 --2- 172.21.15.121:0/597383438 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f34ac0fc4a0 0x7f34ac10d3b0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:39:24.546 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:24.542+0000 7f34b4627640 1 --2- 172.21.15.121:0/597383438 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f34ac0fb1d0 0x7f34ac10ce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:39:24.546 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:24.542+0000 7f34b4627640 1 -- 172.21.15.121:0/597383438 >> 172.21.15.121:0/597383438 conn(0x7f34ac0f69b0 msgr2=0x7f34ac065460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:39:24.546 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:24.542+0000 7f34b4627640 1 -- 172.21.15.121:0/597383438 shutdown_connections 2024-08-18T22:39:24.546 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:24.542+0000 7f34b4627640 1 -- 172.21.15.121:0/597383438 wait complete. 2024-08-18T22:39:25.145 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:39:24 smithi121 ceph-mon[16788]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-08-18T22:39:25.145 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:39:24 smithi121 ceph-mon[16788]: Cluster is now healthy 2024-08-18T22:39:25.146 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:39:24 smithi121 ceph-mon[16788]: mds.? [v2:172.21.15.121:6828/2277706406,v1:172.21.15.121:6829/2277706406] up:active 2024-08-18T22:39:25.146 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:39:24 smithi121 ceph-mon[16788]: fsmap cephfs:2 {0=cephfs.smithi121.gbickb=up:active,1=cephfs.smithi195.buqvbr=up:active} 2 up:standby 2024-08-18T22:39:25.146 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:39:24 smithi121 ceph-mon[16788]: from='client.? 172.21.15.121:0/597383438' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-08-18T22:39:25.169 DEBUG:teuthology.orchestra.run.smithi121:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b003123a-5db1-11ef-bccf-c7b262605968 -- bash -c 'ceph --format=json fs dump | jq -e ".filesystems | length == 1"' 2024-08-18T22:39:25.409 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:39:24 smithi195 ceph-mon[23370]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-08-18T22:39:25.409 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:39:24 smithi195 ceph-mon[23370]: Cluster is now healthy 2024-08-18T22:39:25.409 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:39:24 smithi195 ceph-mon[23370]: mds.? [v2:172.21.15.121:6828/2277706406,v1:172.21.15.121:6829/2277706406] up:active 2024-08-18T22:39:25.409 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:39:24 smithi195 ceph-mon[23370]: fsmap cephfs:2 {0=cephfs.smithi121.gbickb=up:active,1=cephfs.smithi195.buqvbr=up:active} 2 up:standby 2024-08-18T22:39:25.409 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:39:24 smithi195 ceph-mon[23370]: from='client.? 172.21.15.121:0/597383438' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-08-18T22:39:25.444 INFO:teuthology.orchestra.run.smithi121.stderr:Inferring config /var/lib/ceph/b003123a-5db1-11ef-bccf-c7b262605968/mon.smithi121/config 2024-08-18T22:39:26.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:39:25 smithi121 ceph-mon[16788]: pgmap v178: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2024-08-18T22:39:26.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:39:25 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:39:26.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:39:25 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:39:26.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:39:25 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:39:26.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:39:25 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-18T22:39:26.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:39:25 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:39:26.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:39:25 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-18T22:39:26.338 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:39:25 smithi195 ceph-mon[23370]: pgmap v178: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2024-08-18T22:39:26.338 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:39:25 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:39:26.338 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:39:25 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:39:26.339 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:39:25 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:39:26.339 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:39:25 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-18T22:39:26.339 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:39:25 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:39:26.339 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:39:25 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-18T22:39:26.884 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:26.883+0000 7fce12aea640 1 -- 172.21.15.121:0/1724325486 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fce0c0fb1d0 msgr2=0x7fce0c0fb5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:39:26.885 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:26.883+0000 7fce12aea640 1 --2- 172.21.15.121:0/1724325486 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fce0c0fb1d0 0x7fce0c0fb5e0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fce040048d0 tx=0x7fce04009da0 comp rx=0 tx=0).stop 2024-08-18T22:39:26.885 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:26.883+0000 7fce12aea640 1 -- 172.21.15.121:0/1724325486 shutdown_connections 2024-08-18T22:39:26.885 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:26.883+0000 7fce12aea640 1 --2- 172.21.15.121:0/1724325486 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fce0c0fc4a0 0x7fce0c0fc910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:39:26.885 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:26.883+0000 7fce12aea640 1 --2- 172.21.15.121:0/1724325486 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fce0c0fb1d0 0x7fce0c0fb5e0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:39:26.885 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:26.883+0000 7fce12aea640 1 -- 172.21.15.121:0/1724325486 >> 172.21.15.121:0/1724325486 conn(0x7fce0c0f69b0 msgr2=0x7fce0c0f8dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:39:26.885 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:26.883+0000 7fce12aea640 1 -- 172.21.15.121:0/1724325486 shutdown_connections 2024-08-18T22:39:26.885 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:26.883+0000 7fce12aea640 1 -- 172.21.15.121:0/1724325486 wait complete. 2024-08-18T22:39:26.885 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:26.884+0000 7fce12aea640 1 Processor -- start 2024-08-18T22:39:26.885 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:26.884+0000 7fce12aea640 1 -- start start 2024-08-18T22:39:26.887 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:26.884+0000 7fce12aea640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fce0c0fb1d0 0x7fce0c10cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:39:26.887 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:26.884+0000 7fce12aea640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fce0c0fc4a0 0x7fce0c10d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:39:26.887 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:26.884+0000 7fce12aea640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce0c10e170 con 0x7fce0c0fc4a0 2024-08-18T22:39:26.887 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:26.884+0000 7fce12aea640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce0c10e2e0 con 0x7fce0c0fb1d0 2024-08-18T22:39:26.887 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:26.884+0000 7fce0bfff640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fce0c0fc4a0 0x7fce0c10d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:39:26.887 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:26.884+0000 7fce0bfff640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fce0c0fc4a0 0x7fce0c10d440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:47244/0 (socket says 172.21.15.121:47244) 2024-08-18T22:39:26.887 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:26.884+0000 7fce0bfff640 1 -- 172.21.15.121:0/532455054 learned_addr learned my addr 172.21.15.121:0/532455054 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-18T22:39:26.887 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:26.884+0000 7fce10886640 1 --2- 172.21.15.121:0/532455054 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fce0c0fb1d0 0x7fce0c10cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:39:26.887 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:26.885+0000 7fce0bfff640 1 -- 172.21.15.121:0/532455054 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fce0c0fb1d0 msgr2=0x7fce0c10cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:39:26.887 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:26.885+0000 7fce0bfff640 1 --2- 172.21.15.121:0/532455054 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fce0c0fb1d0 0x7fce0c10cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:39:26.887 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:26.885+0000 7fce0bfff640 1 -- 172.21.15.121:0/532455054 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce04005040 con 0x7fce0c0fc4a0 2024-08-18T22:39:26.888 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:26.885+0000 7fce0bfff640 1 --2- 172.21.15.121:0/532455054 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fce0c0fc4a0 0x7fce0c10d440 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fcdf4002a50 tx=0x7fcdf4004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:39:26.888 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:26.885+0000 7fce097fa640 1 -- 172.21.15.121:0/532455054 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcdf4007c30 con 0x7fce0c0fc4a0 2024-08-18T22:39:26.888 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:26.885+0000 7fce12aea640 1 -- 172.21.15.121:0/532455054 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce0c10e5c0 con 0x7fce0c0fc4a0 2024-08-18T22:39:26.888 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:26.885+0000 7fce097fa640 1 -- 172.21.15.121:0/532455054 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fcdf400f040 con 0x7fce0c0fc4a0 2024-08-18T22:39:26.888 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:26.885+0000 7fce097fa640 1 -- 172.21.15.121:0/532455054 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcdf400da10 con 0x7fce0c0fc4a0 2024-08-18T22:39:26.888 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:26.885+0000 7fce12aea640 1 -- 172.21.15.121:0/532455054 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce0c10eb60 con 0x7fce0c0fc4a0 2024-08-18T22:39:26.889 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:26.886+0000 7fce12aea640 1 -- 172.21.15.121:0/532455054 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce0c0fa630 con 0x7fce0c0fc4a0 2024-08-18T22:39:26.889 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:26.886+0000 7fce097fa640 1 -- 172.21.15.121:0/532455054 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 19) v1 ==== 85127+0+0 (secure 0 0 0) 0x7fcdf400dc80 con 0x7fce0c0fc4a0 2024-08-18T22:39:26.889 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:26.887+0000 7fce097fa640 1 --2- 172.21.15.121:0/532455054 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7fcdf8067190 0x7fcdf8069640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:39:26.889 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:26.887+0000 7fce097fa640 1 -- 172.21.15.121:0/532455054 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5550+0+0 (secure 0 0 0) 0x7fcdf4084350 con 0x7fce0c0fc4a0 2024-08-18T22:39:26.889 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:26.887+0000 7fce10886640 1 --2- 172.21.15.121:0/532455054 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7fcdf8067190 0x7fcdf8069640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:39:26.889 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:26.887+0000 7fce10886640 1 --2- 172.21.15.121:0/532455054 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7fcdf8067190 0x7fcdf8069640 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fce0400b020 tx=0x7fce04035040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:39:26.892 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:26.891+0000 7fce097fa640 1 -- 172.21.15.121:0/532455054 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fcdf4051650 con 0x7fce0c0fc4a0 2024-08-18T22:39:27.094 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:27.093+0000 7fce12aea640 1 -- 172.21.15.121:0/532455054 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fce0c04b4c0 con 0x7fce0c0fc4a0 2024-08-18T22:39:27.094 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:27.093+0000 7fce097fa640 1 -- 172.21.15.121:0/532455054 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4706 (secure 0 0 0) 0x7fce0c04b4c0 con 0x7fce0c0fc4a0 2024-08-18T22:39:27.095 INFO:teuthology.orchestra.run.smithi121.stderr:dumped fsmap epoch 17 2024-08-18T22:39:27.096 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:27.095+0000 7fce12aea640 1 -- 172.21.15.121:0/532455054 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7fcdf8067190 msgr2=0x7fcdf8069640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:39:27.096 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:27.095+0000 7fce12aea640 1 --2- 172.21.15.121:0/532455054 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7fcdf8067190 0x7fcdf8069640 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fce0400b020 tx=0x7fce04035040 comp rx=0 tx=0).stop 2024-08-18T22:39:27.096 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:27.095+0000 7fce12aea640 1 -- 172.21.15.121:0/532455054 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fce0c0fc4a0 msgr2=0x7fce0c10d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:39:27.097 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:27.095+0000 7fce12aea640 1 --2- 172.21.15.121:0/532455054 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fce0c0fc4a0 0x7fce0c10d440 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fcdf4002a50 tx=0x7fcdf4004600 comp rx=0 tx=0).stop 2024-08-18T22:39:27.097 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:27.095+0000 7fce12aea640 1 -- 172.21.15.121:0/532455054 shutdown_connections 2024-08-18T22:39:27.097 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:27.095+0000 7fce12aea640 1 --2- 172.21.15.121:0/532455054 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7fcdf8067190 0x7fcdf8069640 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:39:27.097 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:27.095+0000 7fce12aea640 1 --2- 172.21.15.121:0/532455054 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fce0c0fc4a0 0x7fce0c10d440 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:39:27.097 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:27.095+0000 7fce12aea640 1 --2- 172.21.15.121:0/532455054 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fce0c0fb1d0 0x7fce0c10cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:39:27.097 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:27.095+0000 7fce12aea640 1 -- 172.21.15.121:0/532455054 >> 172.21.15.121:0/532455054 conn(0x7fce0c0f69b0 msgr2=0x7fce0c065410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:39:27.097 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:27.095+0000 7fce12aea640 1 -- 172.21.15.121:0/532455054 shutdown_connections 2024-08-18T22:39:27.097 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:27.095+0000 7fce12aea640 1 -- 172.21.15.121:0/532455054 wait complete. 2024-08-18T22:39:27.105 INFO:teuthology.orchestra.run.smithi121.stdout:true 2024-08-18T22:39:28.164 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:39:27 smithi121 ceph-mon[16788]: pgmap v179: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 0 B/s wr, 2 op/s 2024-08-18T22:39:28.164 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:39:27 smithi121 ceph-mon[16788]: from='client.? 172.21.15.121:0/532455054' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-18T22:39:28.164 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:39:27 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:39:28.165 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:39:27 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:39:28.188 DEBUG:teuthology.orchestra.run.smithi121:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b003123a-5db1-11ef-bccf-c7b262605968 -- bash -c 'while ! ceph --format=json mds versions | jq -e ". | add == 4"; do sleep 1; done' 2024-08-18T22:39:28.409 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:39:27 smithi195 ceph-mon[23370]: pgmap v179: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 0 B/s wr, 2 op/s 2024-08-18T22:39:28.409 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:39:27 smithi195 ceph-mon[23370]: from='client.? 172.21.15.121:0/532455054' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-18T22:39:28.409 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:39:27 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:39:28.409 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:39:27 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:39:28.941 INFO:teuthology.orchestra.run.smithi121.stderr:Inferring config /var/lib/ceph/b003123a-5db1-11ef-bccf-c7b262605968/mon.smithi121/config 2024-08-18T22:39:30.333 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:39:29 smithi121 ceph-mon[16788]: pgmap v180: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 4.2 KiB/s rd, 0 B/s wr, 4 op/s 2024-08-18T22:39:30.409 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:39:29 smithi195 ceph-mon[23370]: pgmap v180: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 4.2 KiB/s rd, 0 B/s wr, 4 op/s 2024-08-18T22:39:31.827 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:31.795+0000 7f617f07a640 1 -- 172.21.15.121:0/4177261920 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f61780fb1d0 msgr2=0x7f61780fb5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:39:31.827 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:31.795+0000 7f617f07a640 1 --2- 172.21.15.121:0/4177261920 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f61780fb1d0 0x7f61780fb5e0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f61700048d0 tx=0x7f6170009da0 comp rx=0 tx=0).stop 2024-08-18T22:39:31.827 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:31.795+0000 7f617f07a640 1 -- 172.21.15.121:0/4177261920 shutdown_connections 2024-08-18T22:39:31.827 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:31.795+0000 7f617f07a640 1 --2- 172.21.15.121:0/4177261920 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f61780fc4a0 0x7f61780fc910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:39:31.827 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:31.795+0000 7f617f07a640 1 --2- 172.21.15.121:0/4177261920 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f61780fb1d0 0x7f61780fb5e0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:39:31.827 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:31.795+0000 7f617f07a640 1 -- 172.21.15.121:0/4177261920 >> 172.21.15.121:0/4177261920 conn(0x7f61780f69b0 msgr2=0x7f61780f8dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:39:31.827 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:31.795+0000 7f617f07a640 1 -- 172.21.15.121:0/4177261920 shutdown_connections 2024-08-18T22:39:31.828 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:31.795+0000 7f617f07a640 1 -- 172.21.15.121:0/4177261920 wait complete. 2024-08-18T22:39:31.828 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:31.795+0000 7f617f07a640 1 Processor -- start 2024-08-18T22:39:31.828 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:31.795+0000 7f617f07a640 1 -- start start 2024-08-18T22:39:31.828 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:31.796+0000 7f617f07a640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f61780fb1d0 0x7f617810ce70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:39:31.828 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:31.796+0000 7f617f07a640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f61780fc4a0 0x7f617810d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:39:31.828 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:31.796+0000 7f617f07a640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f617810da00 con 0x7f61780fc4a0 2024-08-18T22:39:31.828 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:31.796+0000 7f617f07a640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f617810e140 con 0x7f61780fb1d0 2024-08-18T22:39:31.828 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:31.796+0000 7f6177fff640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f61780fc4a0 0x7f617810d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:39:31.828 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:31.796+0000 7f6177fff640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f61780fc4a0 0x7f617810d3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:47262/0 (socket says 172.21.15.121:47262) 2024-08-18T22:39:31.828 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:31.796+0000 7f6177fff640 1 -- 172.21.15.121:0/3150685183 learned_addr learned my addr 172.21.15.121:0/3150685183 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-18T22:39:31.828 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:31.796+0000 7f617ce16640 1 --2- 172.21.15.121:0/3150685183 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f61780fb1d0 0x7f617810ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:39:31.828 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:31.796+0000 7f6177fff640 1 -- 172.21.15.121:0/3150685183 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f61780fb1d0 msgr2=0x7f617810ce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:39:31.828 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:31.796+0000 7f6177fff640 1 --2- 172.21.15.121:0/3150685183 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f61780fb1d0 0x7f617810ce70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:39:31.829 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:31.796+0000 7f6177fff640 1 -- 172.21.15.121:0/3150685183 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6170005040 con 0x7f61780fc4a0 2024-08-18T22:39:31.829 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:31.796+0000 7f6177fff640 1 --2- 172.21.15.121:0/3150685183 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f61780fc4a0 0x7f617810d3b0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f6160002a50 tx=0x7f6160004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:39:31.829 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:31.796+0000 7f61757fa640 1 -- 172.21.15.121:0/3150685183 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6160007c30 con 0x7f61780fc4a0 2024-08-18T22:39:31.829 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:31.796+0000 7f617f07a640 1 -- 172.21.15.121:0/3150685183 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f617810e3d0 con 0x7f61780fc4a0 2024-08-18T22:39:31.829 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:31.796+0000 7f61757fa640 1 -- 172.21.15.121:0/3150685183 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f616000f040 con 0x7f61780fc4a0 2024-08-18T22:39:31.829 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:31.796+0000 7f61757fa640 1 -- 172.21.15.121:0/3150685183 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f616000dad0 con 0x7f61780fc4a0 2024-08-18T22:39:31.829 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:31.796+0000 7f617f07a640 1 -- 172.21.15.121:0/3150685183 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f617810e970 con 0x7f61780fc4a0 2024-08-18T22:39:31.829 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:31.797+0000 7f617f07a640 1 -- 172.21.15.121:0/3150685183 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61780fa630 con 0x7f61780fc4a0 2024-08-18T22:39:31.829 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:31.798+0000 7f61757fa640 1 -- 172.21.15.121:0/3150685183 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 19) v1 ==== 85127+0+0 (secure 0 0 0) 0x7f616000dc30 con 0x7f61780fc4a0 2024-08-18T22:39:31.829 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:31.798+0000 7f61757fa640 1 --2- 172.21.15.121:0/3150685183 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7f6164067190 0x7f6164069640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:39:31.829 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:31.798+0000 7f61757fa640 1 -- 172.21.15.121:0/3150685183 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f61600849c0 con 0x7f61780fc4a0 2024-08-18T22:39:31.829 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:31.798+0000 7f617ce16640 1 --2- 172.21.15.121:0/3150685183 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7f6164067190 0x7f6164069640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:39:31.829 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:31.799+0000 7f617ce16640 1 --2- 172.21.15.121:0/3150685183 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7f6164067190 0x7f6164069640 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f6170000c00 tx=0x7f6170035040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:39:31.829 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:31.802+0000 7f61757fa640 1 -- 172.21.15.121:0/3150685183 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f6160051c10 con 0x7f61780fc4a0 2024-08-18T22:39:32.035 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:32.034+0000 7f617f07a640 1 -- 172.21.15.121:0/3150685183 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "mds versions", "format": "json"} v 0) v1 -- 0x7f617804b4c0 con 0x7f61780fc4a0 2024-08-18T22:39:32.036 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:32.035+0000 7f61757fa640 1 -- 172.21.15.121:0/3150685183 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "mds versions", "format": "json"}]=0 v17) v1 ==== 78+0+100 (secure 0 0 0) 0x7f6160055230 con 0x7f61780fc4a0 2024-08-18T22:39:32.038 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:32.037+0000 7f617f07a640 1 -- 172.21.15.121:0/3150685183 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7f6164067190 msgr2=0x7f6164069640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:39:32.038 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:32.037+0000 7f617f07a640 1 --2- 172.21.15.121:0/3150685183 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7f6164067190 0x7f6164069640 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f6170000c00 tx=0x7f6170035040 comp rx=0 tx=0).stop 2024-08-18T22:39:32.038 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:32.037+0000 7f617f07a640 1 -- 172.21.15.121:0/3150685183 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f61780fc4a0 msgr2=0x7f617810d3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:39:32.038 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:32.037+0000 7f617f07a640 1 --2- 172.21.15.121:0/3150685183 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f61780fc4a0 0x7f617810d3b0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f6160002a50 tx=0x7f6160004600 comp rx=0 tx=0).stop 2024-08-18T22:39:32.038 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:32.037+0000 7f617f07a640 1 -- 172.21.15.121:0/3150685183 shutdown_connections 2024-08-18T22:39:32.038 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:32.037+0000 7f617f07a640 1 --2- 172.21.15.121:0/3150685183 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7f6164067190 0x7f6164069640 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:39:32.038 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:32.037+0000 7f617f07a640 1 --2- 172.21.15.121:0/3150685183 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f61780fc4a0 0x7f617810d3b0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:39:32.038 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:32.037+0000 7f617f07a640 1 --2- 172.21.15.121:0/3150685183 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f61780fb1d0 0x7f617810ce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:39:32.038 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:32.037+0000 7f617f07a640 1 -- 172.21.15.121:0/3150685183 >> 172.21.15.121:0/3150685183 conn(0x7f61780f69b0 msgr2=0x7f61780653e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:39:32.038 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:32.037+0000 7f617f07a640 1 -- 172.21.15.121:0/3150685183 shutdown_connections 2024-08-18T22:39:32.039 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:32.037+0000 7f617f07a640 1 -- 172.21.15.121:0/3150685183 wait complete. 2024-08-18T22:39:32.047 INFO:teuthology.orchestra.run.smithi121.stdout:true 2024-08-18T22:39:32.333 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:39:31 smithi121 ceph-mon[16788]: pgmap v181: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 4.8 KiB/s rd, 0 B/s wr, 4 op/s 2024-08-18T22:39:32.409 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:39:31 smithi195 ceph-mon[23370]: pgmap v181: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 4.8 KiB/s rd, 0 B/s wr, 4 op/s 2024-08-18T22:39:32.911 INFO:teuthology.run_tasks:Running task fs.pre_upgrade_save... 2024-08-18T22:39:32.923 DEBUG:teuthology.orchestra.run.smithi121:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid b003123a-5db1-11ef-bccf-c7b262605968 -- ceph fs dump --format=json 2024-08-18T22:39:33.274 INFO:teuthology.orchestra.run.smithi121.stderr:Inferring config /var/lib/ceph/b003123a-5db1-11ef-bccf-c7b262605968/mon.smithi121/config 2024-08-18T22:39:33.333 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:39:32 smithi121 ceph-mon[16788]: from='client.? 172.21.15.121:0/3150685183' entity='client.admin' cmd=[{"prefix": "mds versions", "format": "json"}]: dispatch 2024-08-18T22:39:33.409 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:39:32 smithi195 ceph-mon[23370]: from='client.? 172.21.15.121:0/3150685183' entity='client.admin' cmd=[{"prefix": "mds versions", "format": "json"}]: dispatch 2024-08-18T22:39:34.333 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:39:33 smithi121 ceph-mon[16788]: pgmap v182: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 4.2 KiB/s rd, 0 B/s wr, 4 op/s 2024-08-18T22:39:34.409 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:39:33 smithi195 ceph-mon[23370]: pgmap v182: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 4.2 KiB/s rd, 0 B/s wr, 4 op/s 2024-08-18T22:39:34.822 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:34.821+0000 7fbcc6f06640 1 -- 172.21.15.121:0/2957318618 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbcc00fb5b0 msgr2=0x7fbcc00fb980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:39:34.822 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:34.821+0000 7fbcc6f06640 1 --2- 172.21.15.121:0/2957318618 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbcc00fb5b0 0x7fbcc00fb980 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fbcbc0048d0 tx=0x7fbcbc009da0 comp rx=0 tx=0).stop 2024-08-18T22:39:34.822 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:34.821+0000 7fbcc6f06640 1 -- 172.21.15.121:0/2957318618 shutdown_connections 2024-08-18T22:39:34.822 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:34.821+0000 7fbcc6f06640 1 --2- 172.21.15.121:0/2957318618 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbcc00fbec0 0x7fbcc00fcdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:39:34.823 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:34.821+0000 7fbcc6f06640 1 --2- 172.21.15.121:0/2957318618 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbcc00fb5b0 0x7fbcc00fb980 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:39:34.823 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:34.821+0000 7fbcc6f06640 1 -- 172.21.15.121:0/2957318618 >> 172.21.15.121:0/2957318618 conn(0x7fbcc0072150 msgr2=0x7fbcc0072550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:39:34.823 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:34.821+0000 7fbcc6f06640 1 -- 172.21.15.121:0/2957318618 shutdown_connections 2024-08-18T22:39:34.823 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:34.821+0000 7fbcc6f06640 1 -- 172.21.15.121:0/2957318618 wait complete. 2024-08-18T22:39:34.823 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:34.821+0000 7fbcc6f06640 1 Processor -- start 2024-08-18T22:39:34.823 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:34.821+0000 7fbcc6f06640 1 -- start start 2024-08-18T22:39:34.824 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:34.822+0000 7fbcc6f06640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbcc00fb5b0 0x7fbcc0112f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:39:34.824 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:34.822+0000 7fbcc6f06640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbcc00fbec0 0x7fbcc0113460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:39:34.824 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:34.822+0000 7fbcc6f06640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcc0113a60 con 0x7fbcc00fb5b0 2024-08-18T22:39:34.825 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:34.822+0000 7fbcc6f06640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcc010cea0 con 0x7fbcc00fbec0 2024-08-18T22:39:34.825 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:34.822+0000 7fbcc4ca2640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbcc00fb5b0 0x7fbcc0112f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:39:34.825 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:34.822+0000 7fbcc4ca2640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbcc00fb5b0 0x7fbcc0112f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:47282/0 (socket says 172.21.15.121:47282) 2024-08-18T22:39:34.825 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:34.822+0000 7fbcc4ca2640 1 -- 172.21.15.121:0/3502990726 learned_addr learned my addr 172.21.15.121:0/3502990726 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-18T22:39:34.825 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:34.822+0000 7fbcb7fff640 1 --2- 172.21.15.121:0/3502990726 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbcc00fbec0 0x7fbcc0113460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:39:34.825 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:34.822+0000 7fbcc4ca2640 1 -- 172.21.15.121:0/3502990726 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbcc00fbec0 msgr2=0x7fbcc0113460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:39:34.825 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:34.822+0000 7fbcc4ca2640 1 --2- 172.21.15.121:0/3502990726 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbcc00fbec0 0x7fbcc0113460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:39:34.825 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:34.822+0000 7fbcc4ca2640 1 -- 172.21.15.121:0/3502990726 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcbc005040 con 0x7fbcc00fb5b0 2024-08-18T22:39:34.825 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:34.822+0000 7fbcc4ca2640 1 --2- 172.21.15.121:0/3502990726 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbcc00fb5b0 0x7fbcc0112f20 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fbcbc003080 tx=0x7fbcbc009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:39:34.825 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:34.823+0000 7fbcb57fa640 1 -- 172.21.15.121:0/3502990726 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbcbc038070 con 0x7fbcc00fb5b0 2024-08-18T22:39:34.825 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:34.823+0000 7fbcb57fa640 1 -- 172.21.15.121:0/3502990726 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fbcbc0097e0 con 0x7fbcc00fb5b0 2024-08-18T22:39:34.825 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:34.823+0000 7fbcb57fa640 1 -- 172.21.15.121:0/3502990726 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbcbc03d420 con 0x7fbcc00fb5b0 2024-08-18T22:39:34.825 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:34.823+0000 7fbcc6f06640 1 -- 172.21.15.121:0/3502990726 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbcc010d120 con 0x7fbcc00fb5b0 2024-08-18T22:39:34.826 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:34.823+0000 7fbcc6f06640 1 -- 172.21.15.121:0/3502990726 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbcc010d610 con 0x7fbcc00fb5b0 2024-08-18T22:39:34.826 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:34.824+0000 7fbcc6f06640 1 -- 172.21.15.121:0/3502990726 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbcc00fc960 con 0x7fbcc00fb5b0 2024-08-18T22:39:34.826 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:34.824+0000 7fbcb57fa640 1 -- 172.21.15.121:0/3502990726 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 19) v1 ==== 85127+0+0 (secure 0 0 0) 0x7fbcbc030020 con 0x7fbcc00fb5b0 2024-08-18T22:39:34.827 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:34.825+0000 7fbcb57fa640 1 --2- 172.21.15.121:0/3502990726 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7fbca8067190 0x7fbca8069640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:39:34.827 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:34.825+0000 7fbcb57fa640 1 -- 172.21.15.121:0/3502990726 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5550+0+0 (secure 0 0 0) 0x7fbcbc0a5070 con 0x7fbcc00fb5b0 2024-08-18T22:39:34.827 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:34.825+0000 7fbcb7fff640 1 --2- 172.21.15.121:0/3502990726 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7fbca8067190 0x7fbca8069640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:39:34.827 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:34.825+0000 7fbcb7fff640 1 --2- 172.21.15.121:0/3502990726 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7fbca8067190 0x7fbca8069640 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fbcc010e7e0 tx=0x7fbcb0004330 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:39:34.830 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:34.829+0000 7fbcb57fa640 1 -- 172.21.15.121:0/3502990726 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fbcbc0722c0 con 0x7fbcc00fb5b0 2024-08-18T22:39:35.025 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:35.024+0000 7fbcc6f06640 1 -- 172.21.15.121:0/3502990726 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbcc0072c60 con 0x7fbcc00fb5b0 2024-08-18T22:39:35.026 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:35.025+0000 7fbcb57fa640 1 -- 172.21.15.121:0/3502990726 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4706 (secure 0 0 0) 0x7fbcbc0758e0 con 0x7fbcc00fb5b0 2024-08-18T22:39:35.026 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-08-18T22:39:35.026 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":17,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14490,"name":"cephfs.smithi121.xuzsdg","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6827/91588128","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":91588128},{"type":"v1","addr":"172.21.15.121:6827","nonce":91588128}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":14},{"gid":24259,"name":"cephfs.smithi195.nptgyc","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.195:6827/238549847","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":238549847},{"type":"v1","addr":"172.21.15.195:6827","nonce":238549847}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-18T22:39:04.054074+0000","modified":"2024-08-18T22:39:23.955493+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":47,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":14474,"mds_1":24249},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14474":{"gid":14474,"name":"cephfs.smithi121.gbickb","rank":0,"incarnation":13,"state":"up:active","state_seq":6,"addr":"172.21.15.121:6829/2277706406","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6828","nonce":2277706406},{"type":"v1","addr":"172.21.15.121:6829","nonce":2277706406}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24249":{"gid":24249,"name":"cephfs.smithi195.buqvbr","rank":1,"incarnation":7,"state":"up:active","state_seq":4,"addr":"172.21.15.195:6825/2414511859","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":2414511859},{"type":"v1","addr":"172.21.15.195:6825","nonce":2414511859}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":1},"id":1}]} 2024-08-18T22:39:35.026 INFO:teuthology.orchestra.run.smithi121.stderr:dumped fsmap epoch 17 2024-08-18T22:39:35.028 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:35.027+0000 7fbcc6f06640 1 -- 172.21.15.121:0/3502990726 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7fbca8067190 msgr2=0x7fbca8069640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:39:35.028 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:35.027+0000 7fbcc6f06640 1 --2- 172.21.15.121:0/3502990726 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7fbca8067190 0x7fbca8069640 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fbcc010e7e0 tx=0x7fbcb0004330 comp rx=0 tx=0).stop 2024-08-18T22:39:35.028 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:35.027+0000 7fbcc6f06640 1 -- 172.21.15.121:0/3502990726 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbcc00fb5b0 msgr2=0x7fbcc0112f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:39:35.028 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:35.027+0000 7fbcc6f06640 1 --2- 172.21.15.121:0/3502990726 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbcc00fb5b0 0x7fbcc0112f20 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fbcbc003080 tx=0x7fbcbc009da0 comp rx=0 tx=0).stop 2024-08-18T22:39:35.028 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:35.027+0000 7fbcc6f06640 1 -- 172.21.15.121:0/3502990726 shutdown_connections 2024-08-18T22:39:35.028 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:35.027+0000 7fbcc6f06640 1 --2- 172.21.15.121:0/3502990726 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7fbca8067190 0x7fbca8069640 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:39:35.028 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:35.027+0000 7fbcc6f06640 1 --2- 172.21.15.121:0/3502990726 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbcc00fbec0 0x7fbcc0113460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:39:35.029 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:35.027+0000 7fbcc6f06640 1 --2- 172.21.15.121:0/3502990726 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbcc00fb5b0 0x7fbcc0112f20 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:39:35.029 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:35.027+0000 7fbcc6f06640 1 -- 172.21.15.121:0/3502990726 >> 172.21.15.121:0/3502990726 conn(0x7fbcc0072150 msgr2=0x7fbcc00ffee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:39:35.029 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:35.027+0000 7fbcc6f06640 1 -- 172.21.15.121:0/3502990726 shutdown_connections 2024-08-18T22:39:35.029 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:35.027+0000 7fbcc6f06640 1 -- 172.21.15.121:0/3502990726 wait complete. 2024-08-18T22:39:35.333 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:39:35 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:39:35.333 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:39:35 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:39:35.333 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:39:35 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:39:35.333 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:39:35 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-18T22:39:35.334 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:39:35 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:39:35.409 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:39:35 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:39:35.410 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:39:35 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:39:35.410 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:39:35 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:39:35.410 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:39:35 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-18T22:39:35.410 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:39:35 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:39:35.748 DEBUG:tasks.fs:fs fscid=1,name=cephfs state = {'epoch': 17, 'max_mds': 2, 'flags': 18} 2024-08-18T22:39:35.749 INFO:teuthology.run_tasks:Running task ceph-fuse... 2024-08-18T22:39:35.776 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2024-08-18T22:39:35.776 INFO:tasks.ceph_fuse:config is {'client.0': {}, 'client.1': {}} 2024-08-18T22:39:35.776 INFO:tasks.ceph_fuse:client.0 config is {} 2024-08-18T22:39:35.776 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-08-18T22:39:35.776 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-08-18T22:39:35.777 INFO:tasks.ceph_fuse:client.1 config is {} 2024-08-18T22:39:35.777 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-08-18T22:39:35.777 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-08-18T22:39:35.777 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T22:39:35.777 DEBUG:teuthology.orchestra.run.smithi195:> ip netns list 2024-08-18T22:39:35.798 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T22:39:35.798 DEBUG:teuthology.orchestra.run.smithi195:> sudo ip link delete ceph-brx 2024-08-18T22:39:35.873 INFO:teuthology.orchestra.run.smithi195.stderr:Cannot find device "ceph-brx" 2024-08-18T22:39:35.874 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-18T22:39:35.874 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T22:39:35.874 DEBUG:teuthology.orchestra.run.smithi121:> ip netns list 2024-08-18T22:39:35.890 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T22:39:35.890 DEBUG:teuthology.orchestra.run.smithi121:> sudo ip link delete ceph-brx 2024-08-18T22:39:35.959 INFO:teuthology.orchestra.run.smithi121.stderr:Cannot find device "ceph-brx" 2024-08-18T22:39:35.960 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-18T22:39:35.960 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2024-08-18T22:39:35.960 DEBUG:tasks.ceph_fuse:passing mntargs=[] 2024-08-18T22:39:35.960 DEBUG:teuthology.orchestra.run.smithi121:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid b003123a-5db1-11ef-bccf-c7b262605968 -- ceph fs ls 2024-08-18T22:39:36.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:39:36 smithi195 ceph-mon[23370]: pgmap v183: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 3.7 KiB/s rd, 0 B/s wr, 3 op/s 2024-08-18T22:39:36.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:39:36 smithi195 ceph-mon[23370]: from='client.? 172.21.15.121:0/3502990726' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-18T22:39:36.252 INFO:teuthology.orchestra.run.smithi121.stderr:Inferring config /var/lib/ceph/b003123a-5db1-11ef-bccf-c7b262605968/mon.smithi121/config 2024-08-18T22:39:36.333 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:39:36 smithi121 ceph-mon[16788]: pgmap v183: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 3.7 KiB/s rd, 0 B/s wr, 3 op/s 2024-08-18T22:39:36.334 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:39:36 smithi121 ceph-mon[16788]: from='client.? 172.21.15.121:0/3502990726' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-18T22:39:37.719 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:37.710+0000 7fd71deb4640 1 -- 172.21.15.121:0/4151760563 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd718102300 msgr2=0x7fd7181026d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:39:37.719 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:37.710+0000 7fd71deb4640 1 --2- 172.21.15.121:0/4151760563 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd718102300 0x7fd7181026d0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fd708009c50 tx=0x7fd708004d10 comp rx=0 tx=0).stop 2024-08-18T22:39:37.719 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:37.710+0000 7fd71deb4640 1 -- 172.21.15.121:0/4151760563 shutdown_connections 2024-08-18T22:39:37.719 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:37.710+0000 7fd71deb4640 1 --2- 172.21.15.121:0/4151760563 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd718102ca0 0x7fd7180fc330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:39:37.719 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:37.710+0000 7fd71deb4640 1 --2- 172.21.15.121:0/4151760563 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd718102300 0x7fd7181026d0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:39:37.719 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:37.710+0000 7fd71deb4640 1 -- 172.21.15.121:0/4151760563 >> 172.21.15.121:0/4151760563 conn(0x7fd7180f7e90 msgr2=0x7fd7180fa2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:39:37.719 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:37.710+0000 7fd71deb4640 1 -- 172.21.15.121:0/4151760563 shutdown_connections 2024-08-18T22:39:37.719 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:37.710+0000 7fd71deb4640 1 -- 172.21.15.121:0/4151760563 wait complete. 2024-08-18T22:39:37.720 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:37.711+0000 7fd71deb4640 1 Processor -- start 2024-08-18T22:39:37.720 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:37.711+0000 7fd71deb4640 1 -- start start 2024-08-18T22:39:37.720 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:37.711+0000 7fd71deb4640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd718102300 0x7fd718113270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:39:37.720 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:37.711+0000 7fd71deb4640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd718102ca0 0x7fd7181137b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:39:37.720 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:37.711+0000 7fd71deb4640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd718113db0 con 0x7fd718102ca0 2024-08-18T22:39:37.720 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:37.711+0000 7fd71deb4640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd71810d1f0 con 0x7fd718102300 2024-08-18T22:39:37.720 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:37.711+0000 7fd716ffd640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd718102ca0 0x7fd7181137b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:39:37.720 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:37.711+0000 7fd716ffd640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd718102ca0 0x7fd7181137b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:36894/0 (socket says 172.21.15.121:36894) 2024-08-18T22:39:37.720 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:37.711+0000 7fd716ffd640 1 -- 172.21.15.121:0/3897647781 learned_addr learned my addr 172.21.15.121:0/3897647781 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-18T22:39:37.720 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:37.711+0000 7fd7177fe640 1 --2- 172.21.15.121:0/3897647781 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd718102300 0x7fd718113270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:39:37.720 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:37.712+0000 7fd716ffd640 1 -- 172.21.15.121:0/3897647781 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd718102300 msgr2=0x7fd718113270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:39:37.720 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:37.712+0000 7fd716ffd640 1 --2- 172.21.15.121:0/3897647781 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd718102300 0x7fd718113270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:39:37.720 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:37.712+0000 7fd716ffd640 1 -- 172.21.15.121:0/3897647781 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7080098b0 con 0x7fd718102ca0 2024-08-18T22:39:37.721 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:37.712+0000 7fd716ffd640 1 --2- 172.21.15.121:0/3897647781 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd718102ca0 0x7fd7181137b0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fd70000c810 tx=0x7fd7000043c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:39:37.721 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:37.712+0000 7fd70ffff640 1 -- 172.21.15.121:0/3897647781 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd70000a820 con 0x7fd718102ca0 2024-08-18T22:39:37.721 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:37.712+0000 7fd70ffff640 1 -- 172.21.15.121:0/3897647781 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fd70000ae20 con 0x7fd718102ca0 2024-08-18T22:39:37.721 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:37.712+0000 7fd71deb4640 1 -- 172.21.15.121:0/3897647781 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd71810d4d0 con 0x7fd718102ca0 2024-08-18T22:39:37.721 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:37.712+0000 7fd70ffff640 1 -- 172.21.15.121:0/3897647781 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd7000115c0 con 0x7fd718102ca0 2024-08-18T22:39:37.721 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:37.712+0000 7fd71deb4640 1 -- 172.21.15.121:0/3897647781 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd71810da70 con 0x7fd718102ca0 2024-08-18T22:39:37.721 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:37.713+0000 7fd71deb4640 1 -- 172.21.15.121:0/3897647781 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7180fda70 con 0x7fd718102ca0 2024-08-18T22:39:37.721 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:37.713+0000 7fd70ffff640 1 -- 172.21.15.121:0/3897647781 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 19) v1 ==== 85127+0+0 (secure 0 0 0) 0x7fd700012840 con 0x7fd718102ca0 2024-08-18T22:39:37.721 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:37.714+0000 7fd70ffff640 1 --2- 172.21.15.121:0/3897647781 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7fd704067190 0x7fd704069640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:39:37.721 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:37.714+0000 7fd7177fe640 1 --2- 172.21.15.121:0/3897647781 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7fd704067190 0x7fd704069640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:39:37.721 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:37.714+0000 7fd70ffff640 1 -- 172.21.15.121:0/3897647781 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5550+0+0 (secure 0 0 0) 0x7fd700085120 con 0x7fd718102ca0 2024-08-18T22:39:37.721 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:37.714+0000 7fd7177fe640 1 --2- 172.21.15.121:0/3897647781 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7fd704067190 0x7fd704069640 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fd708004a30 tx=0x7fd708004d10 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:39:37.722 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:37.718+0000 7fd70ffff640 1 -- 172.21.15.121:0/3897647781 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fd700055e00 con 0x7fd718102ca0 2024-08-18T22:39:37.910 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:37.909+0000 7fd71deb4640 1 -- 172.21.15.121:0/3897647781 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fd718109320 con 0x7fd718102ca0 2024-08-18T22:39:37.910 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:37.909+0000 7fd70ffff640 1 -- 172.21.15.121:0/3897647781 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v17) v1 ==== 53+0+83 (secure 0 0 0) 0x7fd700055990 con 0x7fd718102ca0 2024-08-18T22:39:37.910 INFO:teuthology.orchestra.run.smithi121.stdout:name: cephfs, metadata pool: cephfs.cephfs.meta, data pools: [cephfs.cephfs.data ] 2024-08-18T22:39:37.912 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:37.911+0000 7fd71deb4640 1 -- 172.21.15.121:0/3897647781 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7fd704067190 msgr2=0x7fd704069640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:39:37.912 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:37.911+0000 7fd71deb4640 1 --2- 172.21.15.121:0/3897647781 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7fd704067190 0x7fd704069640 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fd708004a30 tx=0x7fd708004d10 comp rx=0 tx=0).stop 2024-08-18T22:39:37.912 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:37.911+0000 7fd71deb4640 1 -- 172.21.15.121:0/3897647781 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd718102ca0 msgr2=0x7fd7181137b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:39:37.912 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:37.911+0000 7fd71deb4640 1 --2- 172.21.15.121:0/3897647781 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd718102ca0 0x7fd7181137b0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fd70000c810 tx=0x7fd7000043c0 comp rx=0 tx=0).stop 2024-08-18T22:39:37.913 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:37.911+0000 7fd71deb4640 1 -- 172.21.15.121:0/3897647781 shutdown_connections 2024-08-18T22:39:37.913 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:37.911+0000 7fd71deb4640 1 --2- 172.21.15.121:0/3897647781 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7fd704067190 0x7fd704069640 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:39:37.913 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:37.911+0000 7fd71deb4640 1 --2- 172.21.15.121:0/3897647781 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd718102ca0 0x7fd7181137b0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:39:37.913 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:37.911+0000 7fd71deb4640 1 --2- 172.21.15.121:0/3897647781 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd718102300 0x7fd718113270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:39:37.913 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:37.911+0000 7fd71deb4640 1 -- 172.21.15.121:0/3897647781 >> 172.21.15.121:0/3897647781 conn(0x7fd7180f7e90 msgr2=0x7fd7180f8f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:39:37.913 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:37.911+0000 7fd71deb4640 1 -- 172.21.15.121:0/3897647781 shutdown_connections 2024-08-18T22:39:37.913 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:37.911+0000 7fd71deb4640 1 -- 172.21.15.121:0/3897647781 wait complete. 2024-08-18T22:39:38.333 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:39:38 smithi121 ceph-mon[16788]: pgmap v184: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 3.2 KiB/s rd, 0 B/s wr, 3 op/s 2024-08-18T22:39:38.333 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:39:38 smithi121 ceph-mon[16788]: from='client.? 172.21.15.121:0/3897647781' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-08-18T22:39:38.409 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:39:38 smithi195 ceph-mon[23370]: pgmap v184: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 3.2 KiB/s rd, 0 B/s wr, 3 op/s 2024-08-18T22:39:38.409 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:39:38 smithi195 ceph-mon[23370]: from='client.? 172.21.15.121:0/3897647781' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-08-18T22:39:38.466 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-08-18T22:39:38.467 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-08-18T22:39:38.467 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi121.front.sepia.ceph.com 2024-08-18T22:39:38.467 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-08-18T22:39:38.467 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-08-18T22:39:38.467 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-08-18T22:39:38.467 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-08-18T22:39:38.467 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-08-18T22:39:38.467 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-08-18T22:39:38.467 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T22:39:38.467 DEBUG:teuthology.orchestra.run.smithi121:> ip addr 2024-08-18T22:39:38.483 INFO:teuthology.orchestra.run.smithi121.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-08-18T22:39:38.483 INFO:teuthology.orchestra.run.smithi121.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-08-18T22:39:38.484 INFO:teuthology.orchestra.run.smithi121.stdout: inet 127.0.0.1/8 scope host lo 2024-08-18T22:39:38.484 INFO:teuthology.orchestra.run.smithi121.stdout: valid_lft forever preferred_lft forever 2024-08-18T22:39:38.484 INFO:teuthology.orchestra.run.smithi121.stdout: inet6 ::1/128 scope host 2024-08-18T22:39:38.484 INFO:teuthology.orchestra.run.smithi121.stdout: valid_lft forever preferred_lft forever 2024-08-18T22:39:38.484 INFO:teuthology.orchestra.run.smithi121.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-18T22:39:38.484 INFO:teuthology.orchestra.run.smithi121.stdout: link/ether 0c:c4:7a:d8:a4:82 brd ff:ff:ff:ff:ff:ff 2024-08-18T22:39:38.484 INFO:teuthology.orchestra.run.smithi121.stdout: altname enp7s0f0 2024-08-18T22:39:38.484 INFO:teuthology.orchestra.run.smithi121.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-18T22:39:38.484 INFO:teuthology.orchestra.run.smithi121.stdout: link/ether 0c:c4:7a:d8:a4:83 brd ff:ff:ff:ff:ff:ff 2024-08-18T22:39:38.484 INFO:teuthology.orchestra.run.smithi121.stdout: altname enp7s0f1 2024-08-18T22:39:38.484 INFO:teuthology.orchestra.run.smithi121.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-18T22:39:38.484 INFO:teuthology.orchestra.run.smithi121.stdout: link/ether 0c:c4:7a:8f:cb:a2 brd ff:ff:ff:ff:ff:ff 2024-08-18T22:39:38.484 INFO:teuthology.orchestra.run.smithi121.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-08-18T22:39:38.485 INFO:teuthology.orchestra.run.smithi121.stdout: link/ether 0c:c4:7a:8f:cb:a3 brd ff:ff:ff:ff:ff:ff 2024-08-18T22:39:38.485 INFO:teuthology.orchestra.run.smithi121.stdout: inet 172.21.15.121/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-08-18T22:39:38.485 INFO:teuthology.orchestra.run.smithi121.stdout: valid_lft 42452sec preferred_lft 42452sec 2024-08-18T22:39:38.485 INFO:teuthology.orchestra.run.smithi121.stdout: inet6 fe80::ec4:7aff:fe8f:cba3/64 scope link noprefixroute 2024-08-18T22:39:38.485 INFO:teuthology.orchestra.run.smithi121.stdout: valid_lft forever preferred_lft forever 2024-08-18T22:39:38.485 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-08-18T22:39:38.485 DEBUG:teuthology.orchestra.run.smithi121:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-08-18T22:39:38.486 DEBUG:teuthology.orchestra.run.smithi121:> set -e 2024-08-18T22:39:38.486 DEBUG:teuthology.orchestra.run.smithi121:> sudo ip link add name ceph-brx type bridge 2024-08-18T22:39:38.486 DEBUG:teuthology.orchestra.run.smithi121:> sudo ip addr flush dev ceph-brx 2024-08-18T22:39:38.486 DEBUG:teuthology.orchestra.run.smithi121:> sudo ip link set ceph-brx up 2024-08-18T22:39:38.486 DEBUG:teuthology.orchestra.run.smithi121:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-08-18T22:39:38.486 DEBUG:teuthology.orchestra.run.smithi121:> ') 2024-08-18T22:39:38.573 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:38 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-08-18T22:39:38.690 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:38 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-18T22:39:38.697 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T22:39:38.697 DEBUG:teuthology.orchestra.run.smithi121:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-08-18T22:39:38.722 INFO:teuthology.orchestra.run.smithi121.stdout:1 2024-08-18T22:39:38.724 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T22:39:38.724 DEBUG:teuthology.orchestra.run.smithi121:> route 2024-08-18T22:39:38.799 INFO:teuthology.orchestra.run.smithi121.stdout:Kernel IP routing table 2024-08-18T22:39:38.799 INFO:teuthology.orchestra.run.smithi121.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-08-18T22:39:38.799 INFO:teuthology.orchestra.run.smithi121.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-08-18T22:39:38.799 INFO:teuthology.orchestra.run.smithi121.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-08-18T22:39:38.799 INFO:teuthology.orchestra.run.smithi121.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-08-18T22:39:38.800 DEBUG:teuthology.orchestra.run.smithi121:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-08-18T22:39:38.800 DEBUG:teuthology.orchestra.run.smithi121:> set -e 2024-08-18T22:39:38.800 DEBUG:teuthology.orchestra.run.smithi121:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-08-18T22:39:38.800 DEBUG:teuthology.orchestra.run.smithi121:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-08-18T22:39:38.801 DEBUG:teuthology.orchestra.run.smithi121:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-08-18T22:39:38.801 DEBUG:teuthology.orchestra.run.smithi121:> ') 2024-08-18T22:39:38.910 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:38 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-08-18T22:39:39.118 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:39 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-18T22:39:39.124 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T22:39:39.125 DEBUG:teuthology.orchestra.run.smithi121:> ip netns list 2024-08-18T22:39:39.183 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T22:39:39.183 DEBUG:teuthology.orchestra.run.smithi121:> ip netns list-id 2024-08-18T22:39:39.241 DEBUG:teuthology.orchestra.run.smithi121:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-08-18T22:39:39.241 DEBUG:teuthology.orchestra.run.smithi121:> set -e 2024-08-18T22:39:39.241 DEBUG:teuthology.orchestra.run.smithi121:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-08-18T22:39:39.241 DEBUG:teuthology.orchestra.run.smithi121:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-08-18T22:39:39.241 DEBUG:teuthology.orchestra.run.smithi121:> ') 2024-08-18T22:39:39.334 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:39 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-08-18T22:39:39.360 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:39 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-18T22:39:39.366 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-08-18T22:39:39.366 DEBUG:teuthology.orchestra.run.smithi121:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-08-18T22:39:39.366 DEBUG:teuthology.orchestra.run.smithi121:> set -e 2024-08-18T22:39:39.367 DEBUG:teuthology.orchestra.run.smithi121:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-08-18T22:39:39.367 DEBUG:teuthology.orchestra.run.smithi121:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-08-18T22:39:39.367 DEBUG:teuthology.orchestra.run.smithi121:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-08-18T22:39:39.367 DEBUG:teuthology.orchestra.run.smithi121:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-08-18T22:39:39.367 DEBUG:teuthology.orchestra.run.smithi121:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-08-18T22:39:39.367 DEBUG:teuthology.orchestra.run.smithi121:> ') 2024-08-18T22:39:39.417 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:39 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-08-18T22:39:39.505 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:39 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-18T22:39:39.511 DEBUG:teuthology.orchestra.run.smithi121:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-08-18T22:39:39.511 DEBUG:teuthology.orchestra.run.smithi121:> set -e 2024-08-18T22:39:39.511 DEBUG:teuthology.orchestra.run.smithi121:> sudo ip link set brx.0 up 2024-08-18T22:39:39.511 DEBUG:teuthology.orchestra.run.smithi121:> sudo ip link set dev brx.0 master ceph-brx 2024-08-18T22:39:39.511 DEBUG:teuthology.orchestra.run.smithi121:> ') 2024-08-18T22:39:39.560 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:39 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-08-18T22:39:39.584 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:39 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-18T22:39:39.589 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-08-18T22:39:39.590 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-18T22:39:39.590 DEBUG:teuthology.orchestra.run.smithi121:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-08-18T22:39:39.606 INFO:teuthology.orchestra.run.smithi121.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-08-18T22:39:39.606 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-18T22:39:39.606 DEBUG:teuthology.orchestra.run.smithi121:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-08-18T22:39:39.663 DEBUG:teuthology.orchestra.run.smithi121:> sudo modprobe fuse 2024-08-18T22:39:39.731 DEBUG:teuthology.orchestra.run.smithi121:> cat /proc/self/mounts | awk '{print $2}' 2024-08-18T22:39:39.787 INFO:teuthology.orchestra.run.smithi121.stdout:/proc 2024-08-18T22:39:39.788 INFO:teuthology.orchestra.run.smithi121.stdout:/sys 2024-08-18T22:39:39.788 INFO:teuthology.orchestra.run.smithi121.stdout:/dev 2024-08-18T22:39:39.788 INFO:teuthology.orchestra.run.smithi121.stdout:/sys/kernel/security 2024-08-18T22:39:39.788 INFO:teuthology.orchestra.run.smithi121.stdout:/dev/shm 2024-08-18T22:39:39.788 INFO:teuthology.orchestra.run.smithi121.stdout:/dev/pts 2024-08-18T22:39:39.788 INFO:teuthology.orchestra.run.smithi121.stdout:/run 2024-08-18T22:39:39.788 INFO:teuthology.orchestra.run.smithi121.stdout:/sys/fs/cgroup 2024-08-18T22:39:39.788 INFO:teuthology.orchestra.run.smithi121.stdout:/sys/fs/pstore 2024-08-18T22:39:39.788 INFO:teuthology.orchestra.run.smithi121.stdout:/sys/fs/bpf 2024-08-18T22:39:39.788 INFO:teuthology.orchestra.run.smithi121.stdout:/ 2024-08-18T22:39:39.788 INFO:teuthology.orchestra.run.smithi121.stdout:/sys/fs/selinux 2024-08-18T22:39:39.788 INFO:teuthology.orchestra.run.smithi121.stdout:/proc/sys/fs/binfmt_misc 2024-08-18T22:39:39.789 INFO:teuthology.orchestra.run.smithi121.stdout:/dev/mqueue 2024-08-18T22:39:39.789 INFO:teuthology.orchestra.run.smithi121.stdout:/dev/hugepages 2024-08-18T22:39:39.789 INFO:teuthology.orchestra.run.smithi121.stdout:/sys/kernel/debug 2024-08-18T22:39:39.789 INFO:teuthology.orchestra.run.smithi121.stdout:/sys/kernel/tracing 2024-08-18T22:39:39.789 INFO:teuthology.orchestra.run.smithi121.stdout:/sys/kernel/config 2024-08-18T22:39:39.789 INFO:teuthology.orchestra.run.smithi121.stdout:/run/credentials/systemd-sysusers.service 2024-08-18T22:39:39.789 INFO:teuthology.orchestra.run.smithi121.stdout:/sys/fs/fuse/connections 2024-08-18T22:39:39.789 INFO:teuthology.orchestra.run.smithi121.stdout:/run/credentials/systemd-sysctl.service 2024-08-18T22:39:39.789 INFO:teuthology.orchestra.run.smithi121.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-08-18T22:39:39.789 INFO:teuthology.orchestra.run.smithi121.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-08-18T22:39:39.789 INFO:teuthology.orchestra.run.smithi121.stdout:/var/lib/nfs/rpc_pipefs 2024-08-18T22:39:39.789 INFO:teuthology.orchestra.run.smithi121.stdout:/run/user/1000 2024-08-18T22:39:39.789 INFO:teuthology.orchestra.run.smithi121.stdout:/var/lib/ceph 2024-08-18T22:39:39.789 INFO:teuthology.orchestra.run.smithi121.stdout:/var/lib/containers/storage/overlay 2024-08-18T22:39:39.790 INFO:teuthology.orchestra.run.smithi121.stdout:/var/lib/containers/storage/overlay/6d850b15ecaa2bd814833b63ac0cd8eee2bd0d97ba18eb42f374fb18243870b5/merged 2024-08-18T22:39:39.790 INFO:teuthology.orchestra.run.smithi121.stdout:/var/lib/containers/storage/overlay/4b230788931dede3ad205ea1fcb3ec411b42f0004d378fbc3f9287fd3c5e8bf6/merged 2024-08-18T22:39:39.790 INFO:teuthology.orchestra.run.smithi121.stdout:/run/user/0 2024-08-18T22:39:39.790 INFO:teuthology.orchestra.run.smithi121.stdout:/proc/sys/fs/binfmt_misc 2024-08-18T22:39:39.790 INFO:teuthology.orchestra.run.smithi121.stdout:/var/lib/containers/storage/overlay/f2f34015159e27f496cf4ec9e7f3f89acb7d803776fda44c468a12aaceb1efc4/merged 2024-08-18T22:39:39.790 INFO:teuthology.orchestra.run.smithi121.stdout:/var/lib/containers/storage/overlay/09b3d6edb78ff59faf895cffe8137bc752c65c98a669ca44e947ebfff034907c/merged 2024-08-18T22:39:39.790 INFO:teuthology.orchestra.run.smithi121.stdout:/var/lib/containers/storage/overlay/8a1708b985e6625c58de49a8d1538ae2f42cb4ad9a8d235896324a6df5ec1cc2/merged 2024-08-18T22:39:39.790 INFO:teuthology.orchestra.run.smithi121.stdout:/var/lib/containers/storage/overlay/7032630cebb5d1c3133d6843f85baef68577a04acc31faa5546878e052614019/merged 2024-08-18T22:39:39.790 INFO:teuthology.orchestra.run.smithi121.stdout:/var/lib/containers/storage/overlay/ea94bb3fd02a91b7d6a0590fe177bc86f2fc5592a275272e834a7834f066bd98/merged 2024-08-18T22:39:39.790 INFO:teuthology.orchestra.run.smithi121.stdout:/var/lib/containers/storage/overlay/daa1d1bcc678ee38500948bde97df97f303ac489967d55f72d4f479888b1840a/merged 2024-08-18T22:39:39.790 INFO:teuthology.orchestra.run.smithi121.stdout:/var/lib/containers/storage/overlay/61c3c49f9be13d31492d343282f6d0d5067d22bf02bb7b24acd90c32ce504ff0/merged 2024-08-18T22:39:39.790 INFO:teuthology.orchestra.run.smithi121.stdout:/var/lib/containers/storage/overlay/8bd7f33248bdab26bdf3267a0cb1cea09182a95272dd112a230048c286728a06/merged 2024-08-18T22:39:39.790 INFO:teuthology.orchestra.run.smithi121.stdout:/var/lib/containers/storage/overlay/2408b6e00c638ecabfebc2a602f2649786a6e467c8a678e13a202968b5ec08ef/merged 2024-08-18T22:39:39.791 INFO:teuthology.orchestra.run.smithi121.stdout:/var/lib/containers/storage/overlay/c3c45e9dd266e7301b5a1ee9716aa4f71ef12e07bd7ff34b763c01e54943e3a4/merged 2024-08-18T22:39:39.791 INFO:teuthology.orchestra.run.smithi121.stdout:/run/netns 2024-08-18T22:39:39.791 INFO:teuthology.orchestra.run.smithi121.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-08-18T22:39:39.791 INFO:teuthology.orchestra.run.smithi121.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-08-18T22:39:39.791 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T22:39:39.791 DEBUG:teuthology.orchestra.run.smithi121:> ls /sys/fs/fuse/connections 2024-08-18T22:39:39.833 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:39:39 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:39:39.833 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:39:39 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-18T22:39:39.833 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:39:39 smithi121 ceph-mon[16788]: pgmap v185: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 0 B/s wr, 2 op/s 2024-08-18T22:39:39.844 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-08-18T22:39:39.844 DEBUG:teuthology.orchestra.run.smithi121:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-08-18T22:39:39.888 DEBUG:teuthology.orchestra.run.smithi121:> sudo modprobe fuse 2024-08-18T22:39:39.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:39:39 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:39:39.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:39:39 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-18T22:39:39.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:39:39 smithi195 ceph-mon[23370]: pgmap v185: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 0 B/s wr, 2 op/s 2024-08-18T22:39:39.911 DEBUG:teuthology.orchestra.run.smithi121:> cat /proc/self/mounts | awk '{print $2}' 2024-08-18T22:39:39.968 INFO:teuthology.orchestra.run.smithi121.stdout:/proc 2024-08-18T22:39:39.968 INFO:teuthology.orchestra.run.smithi121.stdout:/sys 2024-08-18T22:39:39.969 INFO:teuthology.orchestra.run.smithi121.stdout:/dev 2024-08-18T22:39:39.969 INFO:teuthology.orchestra.run.smithi121.stdout:/sys/kernel/security 2024-08-18T22:39:39.969 INFO:teuthology.orchestra.run.smithi121.stdout:/dev/shm 2024-08-18T22:39:39.969 INFO:teuthology.orchestra.run.smithi121.stdout:/dev/pts 2024-08-18T22:39:39.969 INFO:teuthology.orchestra.run.smithi121.stdout:/run 2024-08-18T22:39:39.969 INFO:teuthology.orchestra.run.smithi121.stdout:/sys/fs/cgroup 2024-08-18T22:39:39.969 INFO:teuthology.orchestra.run.smithi121.stdout:/sys/fs/pstore 2024-08-18T22:39:39.969 INFO:teuthology.orchestra.run.smithi121.stdout:/sys/fs/bpf 2024-08-18T22:39:39.969 INFO:teuthology.orchestra.run.smithi121.stdout:/ 2024-08-18T22:39:39.969 INFO:teuthology.orchestra.run.smithi121.stdout:/sys/fs/selinux 2024-08-18T22:39:39.969 INFO:teuthology.orchestra.run.smithi121.stdout:/proc/sys/fs/binfmt_misc 2024-08-18T22:39:39.969 INFO:teuthology.orchestra.run.smithi121.stdout:/dev/mqueue 2024-08-18T22:39:39.969 INFO:teuthology.orchestra.run.smithi121.stdout:/dev/hugepages 2024-08-18T22:39:39.970 INFO:teuthology.orchestra.run.smithi121.stdout:/sys/kernel/debug 2024-08-18T22:39:39.970 INFO:teuthology.orchestra.run.smithi121.stdout:/sys/kernel/tracing 2024-08-18T22:39:39.970 INFO:teuthology.orchestra.run.smithi121.stdout:/sys/kernel/config 2024-08-18T22:39:39.970 INFO:teuthology.orchestra.run.smithi121.stdout:/run/credentials/systemd-sysusers.service 2024-08-18T22:39:39.970 INFO:teuthology.orchestra.run.smithi121.stdout:/sys/fs/fuse/connections 2024-08-18T22:39:39.970 INFO:teuthology.orchestra.run.smithi121.stdout:/run/credentials/systemd-sysctl.service 2024-08-18T22:39:39.970 INFO:teuthology.orchestra.run.smithi121.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-08-18T22:39:39.970 INFO:teuthology.orchestra.run.smithi121.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-08-18T22:39:39.970 INFO:teuthology.orchestra.run.smithi121.stdout:/var/lib/nfs/rpc_pipefs 2024-08-18T22:39:39.970 INFO:teuthology.orchestra.run.smithi121.stdout:/run/user/1000 2024-08-18T22:39:39.970 INFO:teuthology.orchestra.run.smithi121.stdout:/var/lib/ceph 2024-08-18T22:39:39.970 INFO:teuthology.orchestra.run.smithi121.stdout:/var/lib/containers/storage/overlay 2024-08-18T22:39:39.970 INFO:teuthology.orchestra.run.smithi121.stdout:/var/lib/containers/storage/overlay/6d850b15ecaa2bd814833b63ac0cd8eee2bd0d97ba18eb42f374fb18243870b5/merged 2024-08-18T22:39:39.971 INFO:teuthology.orchestra.run.smithi121.stdout:/var/lib/containers/storage/overlay/4b230788931dede3ad205ea1fcb3ec411b42f0004d378fbc3f9287fd3c5e8bf6/merged 2024-08-18T22:39:39.971 INFO:teuthology.orchestra.run.smithi121.stdout:/run/user/0 2024-08-18T22:39:39.971 INFO:teuthology.orchestra.run.smithi121.stdout:/proc/sys/fs/binfmt_misc 2024-08-18T22:39:39.971 INFO:teuthology.orchestra.run.smithi121.stdout:/var/lib/containers/storage/overlay/f2f34015159e27f496cf4ec9e7f3f89acb7d803776fda44c468a12aaceb1efc4/merged 2024-08-18T22:39:39.971 INFO:teuthology.orchestra.run.smithi121.stdout:/var/lib/containers/storage/overlay/09b3d6edb78ff59faf895cffe8137bc752c65c98a669ca44e947ebfff034907c/merged 2024-08-18T22:39:39.971 INFO:teuthology.orchestra.run.smithi121.stdout:/var/lib/containers/storage/overlay/8a1708b985e6625c58de49a8d1538ae2f42cb4ad9a8d235896324a6df5ec1cc2/merged 2024-08-18T22:39:39.971 INFO:teuthology.orchestra.run.smithi121.stdout:/var/lib/containers/storage/overlay/7032630cebb5d1c3133d6843f85baef68577a04acc31faa5546878e052614019/merged 2024-08-18T22:39:39.971 INFO:teuthology.orchestra.run.smithi121.stdout:/var/lib/containers/storage/overlay/ea94bb3fd02a91b7d6a0590fe177bc86f2fc5592a275272e834a7834f066bd98/merged 2024-08-18T22:39:39.971 INFO:teuthology.orchestra.run.smithi121.stdout:/var/lib/containers/storage/overlay/daa1d1bcc678ee38500948bde97df97f303ac489967d55f72d4f479888b1840a/merged 2024-08-18T22:39:39.971 INFO:teuthology.orchestra.run.smithi121.stdout:/var/lib/containers/storage/overlay/61c3c49f9be13d31492d343282f6d0d5067d22bf02bb7b24acd90c32ce504ff0/merged 2024-08-18T22:39:39.971 INFO:teuthology.orchestra.run.smithi121.stdout:/var/lib/containers/storage/overlay/8bd7f33248bdab26bdf3267a0cb1cea09182a95272dd112a230048c286728a06/merged 2024-08-18T22:39:39.971 INFO:teuthology.orchestra.run.smithi121.stdout:/var/lib/containers/storage/overlay/2408b6e00c638ecabfebc2a602f2649786a6e467c8a678e13a202968b5ec08ef/merged 2024-08-18T22:39:39.971 INFO:teuthology.orchestra.run.smithi121.stdout:/var/lib/containers/storage/overlay/c3c45e9dd266e7301b5a1ee9716aa4f71ef12e07bd7ff34b763c01e54943e3a4/merged 2024-08-18T22:39:39.971 INFO:teuthology.orchestra.run.smithi121.stdout:/run/netns 2024-08-18T22:39:39.972 INFO:teuthology.orchestra.run.smithi121.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-08-18T22:39:39.972 INFO:teuthology.orchestra.run.smithi121.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-08-18T22:39:39.972 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T22:39:39.972 DEBUG:teuthology.orchestra.run.smithi121:> ls /sys/fs/fuse/connections 2024-08-18T22:39:40.014 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi121.stderr:2024-08-18T22:39:40.014+0000 7ff8d502c300 -1 init, newargv = 0x560275ccd9b0 newargc=15 2024-08-18T22:39:40.015 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi121.stderr:ceph-fuse[64378]: starting ceph client 2024-08-18T22:39:40.023 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi121.stderr:ceph-fuse[64378]: starting fuse 2024-08-18T22:39:40.027 INFO:teuthology.orchestra.run.smithi121.stdout:99 2024-08-18T22:39:40.028 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [99] 2024-08-18T22:39:40.028 DEBUG:teuthology.orchestra.run.smithi121:> sudo stdin-killer -- python3 -c ' 2024-08-18T22:39:40.028 DEBUG:teuthology.orchestra.run.smithi121:> import glob 2024-08-18T22:39:40.028 DEBUG:teuthology.orchestra.run.smithi121:> import re 2024-08-18T22:39:40.028 DEBUG:teuthology.orchestra.run.smithi121:> import os 2024-08-18T22:39:40.028 DEBUG:teuthology.orchestra.run.smithi121:> import subprocess 2024-08-18T22:39:40.028 DEBUG:teuthology.orchestra.run.smithi121:> 2024-08-18T22:39:40.028 DEBUG:teuthology.orchestra.run.smithi121:> def _find_admin_socket(client_name): 2024-08-18T22:39:40.029 DEBUG:teuthology.orchestra.run.smithi121:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-08-18T22:39:40.029 DEBUG:teuthology.orchestra.run.smithi121:> files = glob.glob(asok_path) 2024-08-18T22:39:40.029 DEBUG:teuthology.orchestra.run.smithi121:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-08-18T22:39:40.029 DEBUG:teuthology.orchestra.run.smithi121:> 2024-08-18T22:39:40.029 DEBUG:teuthology.orchestra.run.smithi121:> # Given a non-glob path, it better be there 2024-08-18T22:39:40.029 DEBUG:teuthology.orchestra.run.smithi121:> if "*" not in asok_path: 2024-08-18T22:39:40.029 DEBUG:teuthology.orchestra.run.smithi121:> assert(len(files) == 1) 2024-08-18T22:39:40.029 DEBUG:teuthology.orchestra.run.smithi121:> return files[0] 2024-08-18T22:39:40.029 DEBUG:teuthology.orchestra.run.smithi121:> 2024-08-18T22:39:40.029 DEBUG:teuthology.orchestra.run.smithi121:> for f in files: 2024-08-18T22:39:40.029 DEBUG:teuthology.orchestra.run.smithi121:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-08-18T22:39:40.029 DEBUG:teuthology.orchestra.run.smithi121:> if os.path.exists("/proc/{0}".format(pid)): 2024-08-18T22:39:40.029 DEBUG:teuthology.orchestra.run.smithi121:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-08-18T22:39:40.030 DEBUG:teuthology.orchestra.run.smithi121:> contents = proc_f.read() 2024-08-18T22:39:40.030 DEBUG:teuthology.orchestra.run.smithi121:> if mountpoint in contents: 2024-08-18T22:39:40.030 DEBUG:teuthology.orchestra.run.smithi121:> return f 2024-08-18T22:39:40.030 DEBUG:teuthology.orchestra.run.smithi121:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-08-18T22:39:40.030 DEBUG:teuthology.orchestra.run.smithi121:> 2024-08-18T22:39:40.030 DEBUG:teuthology.orchestra.run.smithi121:> print(_find_admin_socket("client.0")) 2024-08-18T22:39:40.030 DEBUG:teuthology.orchestra.run.smithi121:> ' 2024-08-18T22:39:40.146 INFO:teuthology.orchestra.run.smithi121.stdout:/var/run/ceph/ceph-client.0.64378.asok 2024-08-18T22:39:40.149 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:40 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-18T22:39:40.157 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.64378.asok 2024-08-18T22:39:40.157 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T22:39:40.157 DEBUG:teuthology.orchestra.run.smithi121:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.64378.asok status 2024-08-18T22:39:40.297 INFO:teuthology.orchestra.run.smithi121.stdout:{ 2024-08-18T22:39:40.297 INFO:teuthology.orchestra.run.smithi121.stdout: "metadata": { 2024-08-18T22:39:40.297 INFO:teuthology.orchestra.run.smithi121.stdout: "ceph_sha1": "df62bdccd9a13bf566b27a250eddfdd89be3072d", 2024-08-18T22:39:40.297 INFO:teuthology.orchestra.run.smithi121.stdout: "ceph_version": "ceph version 17.2.7-1406-gdf62bdcc (df62bdccd9a13bf566b27a250eddfdd89be3072d) quincy (stable)", 2024-08-18T22:39:40.297 INFO:teuthology.orchestra.run.smithi121.stdout: "entity_id": "0", 2024-08-18T22:39:40.297 INFO:teuthology.orchestra.run.smithi121.stdout: "hostname": "smithi121", 2024-08-18T22:39:40.297 INFO:teuthology.orchestra.run.smithi121.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-08-18T22:39:40.297 INFO:teuthology.orchestra.run.smithi121.stdout: "pid": "64378", 2024-08-18T22:39:40.298 INFO:teuthology.orchestra.run.smithi121.stdout: "root": "/" 2024-08-18T22:39:40.298 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-18T22:39:40.298 INFO:teuthology.orchestra.run.smithi121.stdout: "dentry_count": 0, 2024-08-18T22:39:40.298 INFO:teuthology.orchestra.run.smithi121.stdout: "dentry_pinned_count": 0, 2024-08-18T22:39:40.298 INFO:teuthology.orchestra.run.smithi121.stdout: "id": 14514, 2024-08-18T22:39:40.298 INFO:teuthology.orchestra.run.smithi121.stdout: "inst": { 2024-08-18T22:39:40.298 INFO:teuthology.orchestra.run.smithi121.stdout: "name": { 2024-08-18T22:39:40.298 INFO:teuthology.orchestra.run.smithi121.stdout: "type": "client", 2024-08-18T22:39:40.298 INFO:teuthology.orchestra.run.smithi121.stdout: "num": 14514 2024-08-18T22:39:40.298 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-18T22:39:40.298 INFO:teuthology.orchestra.run.smithi121.stdout: "addr": { 2024-08-18T22:39:40.298 INFO:teuthology.orchestra.run.smithi121.stdout: "type": "v1", 2024-08-18T22:39:40.299 INFO:teuthology.orchestra.run.smithi121.stdout: "addr": "192.168.0.1:0", 2024-08-18T22:39:40.299 INFO:teuthology.orchestra.run.smithi121.stdout: "nonce": 1090582303 2024-08-18T22:39:40.299 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-08-18T22:39:40.299 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-18T22:39:40.299 INFO:teuthology.orchestra.run.smithi121.stdout: "addr": { 2024-08-18T22:39:40.299 INFO:teuthology.orchestra.run.smithi121.stdout: "type": "v1", 2024-08-18T22:39:40.299 INFO:teuthology.orchestra.run.smithi121.stdout: "addr": "192.168.0.1:0", 2024-08-18T22:39:40.299 INFO:teuthology.orchestra.run.smithi121.stdout: "nonce": 1090582303 2024-08-18T22:39:40.299 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-18T22:39:40.299 INFO:teuthology.orchestra.run.smithi121.stdout: "inst_str": "client.14514 192.168.0.1:0/1090582303", 2024-08-18T22:39:40.299 INFO:teuthology.orchestra.run.smithi121.stdout: "addr_str": "192.168.0.1:0/1090582303", 2024-08-18T22:39:40.299 INFO:teuthology.orchestra.run.smithi121.stdout: "inode_count": 1, 2024-08-18T22:39:40.300 INFO:teuthology.orchestra.run.smithi121.stdout: "mds_epoch": 17, 2024-08-18T22:39:40.300 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_epoch": 47, 2024-08-18T22:39:40.300 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_epoch_barrier": 0, 2024-08-18T22:39:40.300 INFO:teuthology.orchestra.run.smithi121.stdout: "blocklisted": false, 2024-08-18T22:39:40.300 INFO:teuthology.orchestra.run.smithi121.stdout: "fs_name": "cephfs" 2024-08-18T22:39:40.300 INFO:teuthology.orchestra.run.smithi121.stdout:} 2024-08-18T22:39:40.305 DEBUG:tasks.ceph_fuse:passing mntargs=[] 2024-08-18T22:39:40.305 DEBUG:teuthology.orchestra.run.smithi121:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid b003123a-5db1-11ef-bccf-c7b262605968 -- ceph fs ls 2024-08-18T22:39:40.554 INFO:teuthology.orchestra.run.smithi121.stderr:Inferring config /var/lib/ceph/b003123a-5db1-11ef-bccf-c7b262605968/mon.smithi121/config 2024-08-18T22:39:41.901 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:39:41 smithi121 ceph-mon[16788]: pgmap v186: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 767 B/s rd, 0 op/s 2024-08-18T22:39:41.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:39:41 smithi195 ceph-mon[23370]: pgmap v186: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 767 B/s rd, 0 op/s 2024-08-18T22:39:42.096 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:42.094+0000 7fdbfa298640 1 -- 172.21.15.121:0/1225562071 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdbf41022e0 msgr2=0x7fdbf41026b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:39:42.097 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:42.094+0000 7fdbfa298640 1 --2- 172.21.15.121:0/1225562071 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdbf41022e0 0x7fdbf41026b0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fdbe40048d0 tx=0x7fdbe4009da0 comp rx=0 tx=0).stop 2024-08-18T22:39:42.097 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:42.094+0000 7fdbfa298640 1 -- 172.21.15.121:0/1225562071 shutdown_connections 2024-08-18T22:39:42.097 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:42.094+0000 7fdbfa298640 1 --2- 172.21.15.121:0/1225562071 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdbf4102c80 0x7fdbf40fc310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:39:42.097 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:42.094+0000 7fdbfa298640 1 --2- 172.21.15.121:0/1225562071 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdbf41022e0 0x7fdbf41026b0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:39:42.097 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:42.094+0000 7fdbfa298640 1 -- 172.21.15.121:0/1225562071 >> 172.21.15.121:0/1225562071 conn(0x7fdbf40f7eb0 msgr2=0x7fdbf40fa2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:39:42.097 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:42.094+0000 7fdbfa298640 1 -- 172.21.15.121:0/1225562071 shutdown_connections 2024-08-18T22:39:42.097 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:42.094+0000 7fdbfa298640 1 -- 172.21.15.121:0/1225562071 wait complete. 2024-08-18T22:39:42.097 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:42.095+0000 7fdbfa298640 1 Processor -- start 2024-08-18T22:39:42.097 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:42.095+0000 7fdbfa298640 1 -- start start 2024-08-18T22:39:42.097 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:42.095+0000 7fdbfa298640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdbf41022e0 0x7fdbf4112f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:39:42.097 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:42.095+0000 7fdbfa298640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdbf4102c80 0x7fdbf41134a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:39:42.097 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:42.095+0000 7fdbfa298640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbf4113aa0 con 0x7fdbf41022e0 2024-08-18T22:39:42.098 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:42.095+0000 7fdbfa298640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbf410cee0 con 0x7fdbf4102c80 2024-08-18T22:39:42.098 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:42.095+0000 7fdbf3fff640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdbf41022e0 0x7fdbf4112f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:39:42.098 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:42.095+0000 7fdbf3fff640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdbf41022e0 0x7fdbf4112f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:36910/0 (socket says 172.21.15.121:36910) 2024-08-18T22:39:42.098 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:42.095+0000 7fdbf3fff640 1 -- 172.21.15.121:0/2974405447 learned_addr learned my addr 172.21.15.121:0/2974405447 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-18T22:39:42.098 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:42.095+0000 7fdbf37fe640 1 --2- 172.21.15.121:0/2974405447 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdbf4102c80 0x7fdbf41134a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:39:42.098 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:42.096+0000 7fdbf3fff640 1 -- 172.21.15.121:0/2974405447 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdbf4102c80 msgr2=0x7fdbf41134a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:39:42.098 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:42.096+0000 7fdbf3fff640 1 --2- 172.21.15.121:0/2974405447 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdbf4102c80 0x7fdbf41134a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:39:42.098 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:42.096+0000 7fdbf3fff640 1 -- 172.21.15.121:0/2974405447 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbe4005040 con 0x7fdbf41022e0 2024-08-18T22:39:42.098 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:42.096+0000 7fdbf3fff640 1 --2- 172.21.15.121:0/2974405447 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdbf41022e0 0x7fdbf4112f60 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fdbe4000c00 tx=0x7fdbe4009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:39:42.100 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:42.096+0000 7fdbf0ff9640 1 -- 172.21.15.121:0/2974405447 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdbe4038070 con 0x7fdbf41022e0 2024-08-18T22:39:42.100 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:42.096+0000 7fdbfa298640 1 -- 172.21.15.121:0/2974405447 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdbf410d160 con 0x7fdbf41022e0 2024-08-18T22:39:42.100 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:42.096+0000 7fdbf0ff9640 1 -- 172.21.15.121:0/2974405447 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fdbe402ade0 con 0x7fdbf41022e0 2024-08-18T22:39:42.100 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:42.096+0000 7fdbf0ff9640 1 -- 172.21.15.121:0/2974405447 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdbe402c7e0 con 0x7fdbf41022e0 2024-08-18T22:39:42.100 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:42.096+0000 7fdbfa298640 1 -- 172.21.15.121:0/2974405447 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdbf410d6a0 con 0x7fdbf41022e0 2024-08-18T22:39:42.100 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:42.097+0000 7fdbfa298640 1 -- 172.21.15.121:0/2974405447 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdbf40fda50 con 0x7fdbf41022e0 2024-08-18T22:39:42.100 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:42.097+0000 7fdbf0ff9640 1 -- 172.21.15.121:0/2974405447 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 19) v1 ==== 85127+0+0 (secure 0 0 0) 0x7fdbe4030020 con 0x7fdbf41022e0 2024-08-18T22:39:42.100 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:42.098+0000 7fdbf0ff9640 1 --2- 172.21.15.121:0/2974405447 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7fdbdc067190 0x7fdbdc069640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:39:42.100 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:42.098+0000 7fdbf0ff9640 1 -- 172.21.15.121:0/2974405447 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5550+0+0 (secure 0 0 0) 0x7fdbe40a47b0 con 0x7fdbf41022e0 2024-08-18T22:39:42.100 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:42.098+0000 7fdbf37fe640 1 --2- 172.21.15.121:0/2974405447 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7fdbdc067190 0x7fdbdc069640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:39:42.101 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:42.098+0000 7fdbf37fe640 1 --2- 172.21.15.121:0/2974405447 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7fdbdc067190 0x7fdbdc069640 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fdbf410e820 tx=0x7fdbe800b040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:39:42.104 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:42.103+0000 7fdbf0ff9640 1 -- 172.21.15.121:0/2974405447 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fdbe4071ab0 con 0x7fdbf41022e0 2024-08-18T22:39:42.295 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:42.293+0000 7fdbfa298640 1 -- 172.21.15.121:0/2974405447 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fdbf404b4c0 con 0x7fdbf41022e0 2024-08-18T22:39:42.295 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:42.294+0000 7fdbf0ff9640 1 -- 172.21.15.121:0/2974405447 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v17) v1 ==== 53+0+83 (secure 0 0 0) 0x7fdbe40750d0 con 0x7fdbf41022e0 2024-08-18T22:39:42.295 INFO:teuthology.orchestra.run.smithi121.stdout:name: cephfs, metadata pool: cephfs.cephfs.meta, data pools: [cephfs.cephfs.data ] 2024-08-18T22:39:42.297 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:42.296+0000 7fdbfa298640 1 -- 172.21.15.121:0/2974405447 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7fdbdc067190 msgr2=0x7fdbdc069640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:39:42.297 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:42.296+0000 7fdbfa298640 1 --2- 172.21.15.121:0/2974405447 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7fdbdc067190 0x7fdbdc069640 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fdbf410e820 tx=0x7fdbe800b040 comp rx=0 tx=0).stop 2024-08-18T22:39:42.297 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:42.296+0000 7fdbfa298640 1 -- 172.21.15.121:0/2974405447 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdbf41022e0 msgr2=0x7fdbf4112f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:39:42.297 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:42.296+0000 7fdbfa298640 1 --2- 172.21.15.121:0/2974405447 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdbf41022e0 0x7fdbf4112f60 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fdbe4000c00 tx=0x7fdbe4009da0 comp rx=0 tx=0).stop 2024-08-18T22:39:42.297 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:42.296+0000 7fdbfa298640 1 -- 172.21.15.121:0/2974405447 shutdown_connections 2024-08-18T22:39:42.297 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:42.296+0000 7fdbfa298640 1 --2- 172.21.15.121:0/2974405447 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7fdbdc067190 0x7fdbdc069640 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:39:42.298 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:42.296+0000 7fdbfa298640 1 --2- 172.21.15.121:0/2974405447 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdbf4102c80 0x7fdbf41134a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:39:42.298 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:42.296+0000 7fdbfa298640 1 --2- 172.21.15.121:0/2974405447 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdbf41022e0 0x7fdbf4112f60 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:39:42.298 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:42.296+0000 7fdbfa298640 1 -- 172.21.15.121:0/2974405447 >> 172.21.15.121:0/2974405447 conn(0x7fdbf40f7eb0 msgr2=0x7fdbf40f8f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:39:42.298 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:42.296+0000 7fdbfa298640 1 -- 172.21.15.121:0/2974405447 shutdown_connections 2024-08-18T22:39:42.298 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:42.296+0000 7fdbfa298640 1 -- 172.21.15.121:0/2974405447 wait complete. 2024-08-18T22:39:42.873 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:39:42 smithi121 ceph-mon[16788]: from='client.? 172.21.15.121:0/2974405447' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-08-18T22:39:42.897 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-08-18T22:39:42.897 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-08-18T22:39:42.897 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi195.front.sepia.ceph.com 2024-08-18T22:39:42.897 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-08-18T22:39:42.897 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-08-18T22:39:42.897 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-08-18T22:39:42.897 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-08-18T22:39:42.897 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-08-18T22:39:42.898 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2024-08-18T22:39:42.898 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T22:39:42.898 DEBUG:teuthology.orchestra.run.smithi195:> ip addr 2024-08-18T22:39:42.908 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:39:42 smithi195 ceph-mon[23370]: from='client.? 172.21.15.121:0/2974405447' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-08-18T22:39:42.917 INFO:teuthology.orchestra.run.smithi195.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-08-18T22:39:42.917 INFO:teuthology.orchestra.run.smithi195.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-08-18T22:39:42.918 INFO:teuthology.orchestra.run.smithi195.stdout: inet 127.0.0.1/8 scope host lo 2024-08-18T22:39:42.918 INFO:teuthology.orchestra.run.smithi195.stdout: valid_lft forever preferred_lft forever 2024-08-18T22:39:42.918 INFO:teuthology.orchestra.run.smithi195.stdout: inet6 ::1/128 scope host 2024-08-18T22:39:42.918 INFO:teuthology.orchestra.run.smithi195.stdout: valid_lft forever preferred_lft forever 2024-08-18T22:39:42.918 INFO:teuthology.orchestra.run.smithi195.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-18T22:39:42.918 INFO:teuthology.orchestra.run.smithi195.stdout: link/ether 0c:c4:7a:d9:36:f0 brd ff:ff:ff:ff:ff:ff 2024-08-18T22:39:42.918 INFO:teuthology.orchestra.run.smithi195.stdout: altname enp7s0f0 2024-08-18T22:39:42.918 INFO:teuthology.orchestra.run.smithi195.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-18T22:39:42.918 INFO:teuthology.orchestra.run.smithi195.stdout: link/ether 0c:c4:7a:d9:36:f1 brd ff:ff:ff:ff:ff:ff 2024-08-18T22:39:42.918 INFO:teuthology.orchestra.run.smithi195.stdout: altname enp7s0f1 2024-08-18T22:39:42.918 INFO:teuthology.orchestra.run.smithi195.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-18T22:39:42.918 INFO:teuthology.orchestra.run.smithi195.stdout: link/ether 0c:c4:7a:88:80:80 brd ff:ff:ff:ff:ff:ff 2024-08-18T22:39:42.919 INFO:teuthology.orchestra.run.smithi195.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-08-18T22:39:42.919 INFO:teuthology.orchestra.run.smithi195.stdout: link/ether 0c:c4:7a:88:80:81 brd ff:ff:ff:ff:ff:ff 2024-08-18T22:39:42.919 INFO:teuthology.orchestra.run.smithi195.stdout: inet 172.21.15.195/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-08-18T22:39:42.919 INFO:teuthology.orchestra.run.smithi195.stdout: valid_lft 42435sec preferred_lft 42435sec 2024-08-18T22:39:42.919 INFO:teuthology.orchestra.run.smithi195.stdout: inet6 fe80::ec4:7aff:fe88:8081/64 scope link noprefixroute 2024-08-18T22:39:42.919 INFO:teuthology.orchestra.run.smithi195.stdout: valid_lft forever preferred_lft forever 2024-08-18T22:39:42.919 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-08-18T22:39:42.919 DEBUG:teuthology.orchestra.run.smithi195:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-08-18T22:39:42.919 DEBUG:teuthology.orchestra.run.smithi195:> set -e 2024-08-18T22:39:42.919 DEBUG:teuthology.orchestra.run.smithi195:> sudo ip link add name ceph-brx type bridge 2024-08-18T22:39:42.920 DEBUG:teuthology.orchestra.run.smithi195:> sudo ip addr flush dev ceph-brx 2024-08-18T22:39:42.920 DEBUG:teuthology.orchestra.run.smithi195:> sudo ip link set ceph-brx up 2024-08-18T22:39:42.920 DEBUG:teuthology.orchestra.run.smithi195:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-08-18T22:39:42.920 DEBUG:teuthology.orchestra.run.smithi195:> ') 2024-08-18T22:39:43.013 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:39:43 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-08-18T22:39:43.146 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:39:43 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-18T22:39:43.152 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T22:39:43.152 DEBUG:teuthology.orchestra.run.smithi195:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-08-18T22:39:43.177 INFO:teuthology.orchestra.run.smithi195.stdout:1 2024-08-18T22:39:43.179 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T22:39:43.179 DEBUG:teuthology.orchestra.run.smithi195:> route 2024-08-18T22:39:43.249 INFO:teuthology.orchestra.run.smithi195.stdout:Kernel IP routing table 2024-08-18T22:39:43.249 INFO:teuthology.orchestra.run.smithi195.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-08-18T22:39:43.249 INFO:teuthology.orchestra.run.smithi195.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-08-18T22:39:43.249 INFO:teuthology.orchestra.run.smithi195.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-08-18T22:39:43.250 INFO:teuthology.orchestra.run.smithi195.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-08-18T22:39:43.250 DEBUG:teuthology.orchestra.run.smithi195:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-08-18T22:39:43.250 DEBUG:teuthology.orchestra.run.smithi195:> set -e 2024-08-18T22:39:43.250 DEBUG:teuthology.orchestra.run.smithi195:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-08-18T22:39:43.250 DEBUG:teuthology.orchestra.run.smithi195:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-08-18T22:39:43.250 DEBUG:teuthology.orchestra.run.smithi195:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-08-18T22:39:43.250 DEBUG:teuthology.orchestra.run.smithi195:> ') 2024-08-18T22:39:43.338 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:39:43 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-08-18T22:39:43.527 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:39:43 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-18T22:39:43.535 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T22:39:43.535 DEBUG:teuthology.orchestra.run.smithi195:> ip netns list 2024-08-18T22:39:43.552 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T22:39:43.552 DEBUG:teuthology.orchestra.run.smithi195:> ip netns list-id 2024-08-18T22:39:43.608 DEBUG:teuthology.orchestra.run.smithi195:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-08-18T22:39:43.608 DEBUG:teuthology.orchestra.run.smithi195:> set -e 2024-08-18T22:39:43.608 DEBUG:teuthology.orchestra.run.smithi195:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2024-08-18T22:39:43.608 DEBUG:teuthology.orchestra.run.smithi195:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2024-08-18T22:39:43.608 DEBUG:teuthology.orchestra.run.smithi195:> ') 2024-08-18T22:39:43.698 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:39:43 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-08-18T22:39:43.722 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:39:43 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-18T22:39:43.729 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2024-08-18T22:39:43.729 DEBUG:teuthology.orchestra.run.smithi195:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-08-18T22:39:43.729 DEBUG:teuthology.orchestra.run.smithi195:> set -e 2024-08-18T22:39:43.730 DEBUG:teuthology.orchestra.run.smithi195:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2024-08-18T22:39:43.730 DEBUG:teuthology.orchestra.run.smithi195:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-08-18T22:39:43.730 DEBUG:teuthology.orchestra.run.smithi195:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2024-08-18T22:39:43.730 DEBUG:teuthology.orchestra.run.smithi195:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2024-08-18T22:39:43.730 DEBUG:teuthology.orchestra.run.smithi195:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2024-08-18T22:39:43.730 DEBUG:teuthology.orchestra.run.smithi195:> ') 2024-08-18T22:39:43.780 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:39:43 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-08-18T22:39:43.871 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:39:43 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-18T22:39:43.877 DEBUG:teuthology.orchestra.run.smithi195:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-08-18T22:39:43.878 DEBUG:teuthology.orchestra.run.smithi195:> set -e 2024-08-18T22:39:43.878 DEBUG:teuthology.orchestra.run.smithi195:> sudo ip link set brx.0 up 2024-08-18T22:39:43.878 DEBUG:teuthology.orchestra.run.smithi195:> sudo ip link set dev brx.0 master ceph-brx 2024-08-18T22:39:43.878 DEBUG:teuthology.orchestra.run.smithi195:> ') 2024-08-18T22:39:43.908 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:39:43 smithi195 ceph-mon[23370]: pgmap v187: 65 pgs: 65 active+clean; 581 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 170 B/s wr, 0 op/s 2024-08-18T22:39:43.926 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:39:43 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-08-18T22:39:43.953 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:39:43 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-18T22:39:43.960 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2024-08-18T22:39:43.960 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-18T22:39:43.960 DEBUG:teuthology.orchestra.run.smithi195:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-08-18T22:39:44.015 INFO:teuthology.orchestra.run.smithi195.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-08-18T22:39:44.016 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-18T22:39:44.016 DEBUG:teuthology.orchestra.run.smithi195:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-08-18T22:39:44.072 DEBUG:teuthology.orchestra.run.smithi195:> sudo modprobe fuse 2024-08-18T22:39:44.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:39:43 smithi121 ceph-mon[16788]: pgmap v187: 65 pgs: 65 active+clean; 581 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 170 B/s wr, 0 op/s 2024-08-18T22:39:44.138 DEBUG:teuthology.orchestra.run.smithi195:> cat /proc/self/mounts | awk '{print $2}' 2024-08-18T22:39:44.198 INFO:teuthology.orchestra.run.smithi195.stdout:/proc 2024-08-18T22:39:44.199 INFO:teuthology.orchestra.run.smithi195.stdout:/sys 2024-08-18T22:39:44.199 INFO:teuthology.orchestra.run.smithi195.stdout:/dev 2024-08-18T22:39:44.199 INFO:teuthology.orchestra.run.smithi195.stdout:/sys/kernel/security 2024-08-18T22:39:44.199 INFO:teuthology.orchestra.run.smithi195.stdout:/dev/shm 2024-08-18T22:39:44.199 INFO:teuthology.orchestra.run.smithi195.stdout:/dev/pts 2024-08-18T22:39:44.199 INFO:teuthology.orchestra.run.smithi195.stdout:/run 2024-08-18T22:39:44.199 INFO:teuthology.orchestra.run.smithi195.stdout:/sys/fs/cgroup 2024-08-18T22:39:44.199 INFO:teuthology.orchestra.run.smithi195.stdout:/sys/fs/pstore 2024-08-18T22:39:44.199 INFO:teuthology.orchestra.run.smithi195.stdout:/sys/fs/bpf 2024-08-18T22:39:44.199 INFO:teuthology.orchestra.run.smithi195.stdout:/ 2024-08-18T22:39:44.199 INFO:teuthology.orchestra.run.smithi195.stdout:/sys/fs/selinux 2024-08-18T22:39:44.199 INFO:teuthology.orchestra.run.smithi195.stdout:/proc/sys/fs/binfmt_misc 2024-08-18T22:39:44.199 INFO:teuthology.orchestra.run.smithi195.stdout:/dev/hugepages 2024-08-18T22:39:44.199 INFO:teuthology.orchestra.run.smithi195.stdout:/dev/mqueue 2024-08-18T22:39:44.200 INFO:teuthology.orchestra.run.smithi195.stdout:/sys/kernel/debug 2024-08-18T22:39:44.200 INFO:teuthology.orchestra.run.smithi195.stdout:/sys/kernel/tracing 2024-08-18T22:39:44.200 INFO:teuthology.orchestra.run.smithi195.stdout:/sys/kernel/config 2024-08-18T22:39:44.200 INFO:teuthology.orchestra.run.smithi195.stdout:/run/credentials/systemd-sysusers.service 2024-08-18T22:39:44.200 INFO:teuthology.orchestra.run.smithi195.stdout:/sys/fs/fuse/connections 2024-08-18T22:39:44.200 INFO:teuthology.orchestra.run.smithi195.stdout:/run/credentials/systemd-sysctl.service 2024-08-18T22:39:44.200 INFO:teuthology.orchestra.run.smithi195.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-08-18T22:39:44.200 INFO:teuthology.orchestra.run.smithi195.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-08-18T22:39:44.200 INFO:teuthology.orchestra.run.smithi195.stdout:/var/lib/nfs/rpc_pipefs 2024-08-18T22:39:44.200 INFO:teuthology.orchestra.run.smithi195.stdout:/run/user/1000 2024-08-18T22:39:44.200 INFO:teuthology.orchestra.run.smithi195.stdout:/var/lib/ceph 2024-08-18T22:39:44.201 INFO:teuthology.orchestra.run.smithi195.stdout:/run/user/0 2024-08-18T22:39:44.201 INFO:teuthology.orchestra.run.smithi195.stdout:/proc/sys/fs/binfmt_misc 2024-08-18T22:39:44.201 INFO:teuthology.orchestra.run.smithi195.stdout:/var/lib/containers/storage/overlay 2024-08-18T22:39:44.201 INFO:teuthology.orchestra.run.smithi195.stdout:/var/lib/containers/storage/overlay/8c669641e04e96e59b6637a084ef544f30cfc74379542d0a53fce78ca356df38/merged 2024-08-18T22:39:44.201 INFO:teuthology.orchestra.run.smithi195.stdout:/var/lib/containers/storage/overlay/a8508150699e699bc13246250edf2fd5a9b3e67e3c70f7f298ba5948a454f2fb/merged 2024-08-18T22:39:44.201 INFO:teuthology.orchestra.run.smithi195.stdout:/var/lib/containers/storage/overlay/1eb13e81c42247f92062c41e261eabf3e142a610af2389402409274b78a6b18c/merged 2024-08-18T22:39:44.201 INFO:teuthology.orchestra.run.smithi195.stdout:/var/lib/containers/storage/overlay/5c7e3fc2c41b568cf5088dbaec95f7e8af637ea6161da9d5da507cd26e849c1a/merged 2024-08-18T22:39:44.201 INFO:teuthology.orchestra.run.smithi195.stdout:/var/lib/containers/storage/overlay/e3c8abae0b2b1fd63633928dd254bebcf336d24d3dadcb19e8e4c5a81fca30f3/merged 2024-08-18T22:39:44.201 INFO:teuthology.orchestra.run.smithi195.stdout:/var/lib/containers/storage/overlay/03d78dac567a0f4cae76c1436c6fc1a7fb91a7bce6c8a08c05c8d4ecd50715f3/merged 2024-08-18T22:39:44.201 INFO:teuthology.orchestra.run.smithi195.stdout:/var/lib/containers/storage/overlay/ac33c31f0904b99a159a8f218a5fb92d530b6a6efc9d5aa40ca9c127d905ab5e/merged 2024-08-18T22:39:44.201 INFO:teuthology.orchestra.run.smithi195.stdout:/var/lib/containers/storage/overlay/18773131083a0f50d9d75d7aafc90431cefc2da1f147798a3e42ebfebfdb8f2b/merged 2024-08-18T22:39:44.201 INFO:teuthology.orchestra.run.smithi195.stdout:/var/lib/containers/storage/overlay/d0b2700b48e731ee424718a43540c9ad8926bb0271169b51504134514914b867/merged 2024-08-18T22:39:44.202 INFO:teuthology.orchestra.run.smithi195.stdout:/run/netns 2024-08-18T22:39:44.202 INFO:teuthology.orchestra.run.smithi195.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-08-18T22:39:44.202 INFO:teuthology.orchestra.run.smithi195.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-08-18T22:39:44.202 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T22:39:44.202 DEBUG:teuthology.orchestra.run.smithi195:> ls /sys/fs/fuse/connections 2024-08-18T22:39:44.260 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-08-18T22:39:44.260 DEBUG:teuthology.orchestra.run.smithi195:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2024-08-18T22:39:44.305 DEBUG:teuthology.orchestra.run.smithi195:> sudo modprobe fuse 2024-08-18T22:39:44.330 DEBUG:teuthology.orchestra.run.smithi195:> cat /proc/self/mounts | awk '{print $2}' 2024-08-18T22:39:44.388 INFO:teuthology.orchestra.run.smithi195.stdout:/proc 2024-08-18T22:39:44.389 INFO:teuthology.orchestra.run.smithi195.stdout:/sys 2024-08-18T22:39:44.389 INFO:teuthology.orchestra.run.smithi195.stdout:/dev 2024-08-18T22:39:44.389 INFO:teuthology.orchestra.run.smithi195.stdout:/sys/kernel/security 2024-08-18T22:39:44.389 INFO:teuthology.orchestra.run.smithi195.stdout:/dev/shm 2024-08-18T22:39:44.389 INFO:teuthology.orchestra.run.smithi195.stdout:/dev/pts 2024-08-18T22:39:44.389 INFO:teuthology.orchestra.run.smithi195.stdout:/run 2024-08-18T22:39:44.389 INFO:teuthology.orchestra.run.smithi195.stdout:/sys/fs/cgroup 2024-08-18T22:39:44.389 INFO:teuthology.orchestra.run.smithi195.stdout:/sys/fs/pstore 2024-08-18T22:39:44.389 INFO:teuthology.orchestra.run.smithi195.stdout:/sys/fs/bpf 2024-08-18T22:39:44.389 INFO:teuthology.orchestra.run.smithi195.stdout:/ 2024-08-18T22:39:44.389 INFO:teuthology.orchestra.run.smithi195.stdout:/sys/fs/selinux 2024-08-18T22:39:44.390 INFO:teuthology.orchestra.run.smithi195.stdout:/proc/sys/fs/binfmt_misc 2024-08-18T22:39:44.390 INFO:teuthology.orchestra.run.smithi195.stdout:/dev/hugepages 2024-08-18T22:39:44.390 INFO:teuthology.orchestra.run.smithi195.stdout:/dev/mqueue 2024-08-18T22:39:44.390 INFO:teuthology.orchestra.run.smithi195.stdout:/sys/kernel/debug 2024-08-18T22:39:44.390 INFO:teuthology.orchestra.run.smithi195.stdout:/sys/kernel/tracing 2024-08-18T22:39:44.390 INFO:teuthology.orchestra.run.smithi195.stdout:/sys/kernel/config 2024-08-18T22:39:44.390 INFO:teuthology.orchestra.run.smithi195.stdout:/run/credentials/systemd-sysusers.service 2024-08-18T22:39:44.390 INFO:teuthology.orchestra.run.smithi195.stdout:/sys/fs/fuse/connections 2024-08-18T22:39:44.390 INFO:teuthology.orchestra.run.smithi195.stdout:/run/credentials/systemd-sysctl.service 2024-08-18T22:39:44.390 INFO:teuthology.orchestra.run.smithi195.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-08-18T22:39:44.391 INFO:teuthology.orchestra.run.smithi195.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-08-18T22:39:44.391 INFO:teuthology.orchestra.run.smithi195.stdout:/var/lib/nfs/rpc_pipefs 2024-08-18T22:39:44.391 INFO:teuthology.orchestra.run.smithi195.stdout:/run/user/1000 2024-08-18T22:39:44.391 INFO:teuthology.orchestra.run.smithi195.stdout:/var/lib/ceph 2024-08-18T22:39:44.391 INFO:teuthology.orchestra.run.smithi195.stdout:/run/user/0 2024-08-18T22:39:44.391 INFO:teuthology.orchestra.run.smithi195.stdout:/proc/sys/fs/binfmt_misc 2024-08-18T22:39:44.391 INFO:teuthology.orchestra.run.smithi195.stdout:/var/lib/containers/storage/overlay 2024-08-18T22:39:44.391 INFO:teuthology.orchestra.run.smithi195.stdout:/var/lib/containers/storage/overlay/8c669641e04e96e59b6637a084ef544f30cfc74379542d0a53fce78ca356df38/merged 2024-08-18T22:39:44.391 INFO:teuthology.orchestra.run.smithi195.stdout:/var/lib/containers/storage/overlay/a8508150699e699bc13246250edf2fd5a9b3e67e3c70f7f298ba5948a454f2fb/merged 2024-08-18T22:39:44.391 INFO:teuthology.orchestra.run.smithi195.stdout:/var/lib/containers/storage/overlay/1eb13e81c42247f92062c41e261eabf3e142a610af2389402409274b78a6b18c/merged 2024-08-18T22:39:44.391 INFO:teuthology.orchestra.run.smithi195.stdout:/var/lib/containers/storage/overlay/5c7e3fc2c41b568cf5088dbaec95f7e8af637ea6161da9d5da507cd26e849c1a/merged 2024-08-18T22:39:44.391 INFO:teuthology.orchestra.run.smithi195.stdout:/var/lib/containers/storage/overlay/e3c8abae0b2b1fd63633928dd254bebcf336d24d3dadcb19e8e4c5a81fca30f3/merged 2024-08-18T22:39:44.391 INFO:teuthology.orchestra.run.smithi195.stdout:/var/lib/containers/storage/overlay/03d78dac567a0f4cae76c1436c6fc1a7fb91a7bce6c8a08c05c8d4ecd50715f3/merged 2024-08-18T22:39:44.391 INFO:teuthology.orchestra.run.smithi195.stdout:/var/lib/containers/storage/overlay/ac33c31f0904b99a159a8f218a5fb92d530b6a6efc9d5aa40ca9c127d905ab5e/merged 2024-08-18T22:39:44.391 INFO:teuthology.orchestra.run.smithi195.stdout:/var/lib/containers/storage/overlay/18773131083a0f50d9d75d7aafc90431cefc2da1f147798a3e42ebfebfdb8f2b/merged 2024-08-18T22:39:44.392 INFO:teuthology.orchestra.run.smithi195.stdout:/var/lib/containers/storage/overlay/d0b2700b48e731ee424718a43540c9ad8926bb0271169b51504134514914b867/merged 2024-08-18T22:39:44.392 INFO:teuthology.orchestra.run.smithi195.stdout:/run/netns 2024-08-18T22:39:44.392 INFO:teuthology.orchestra.run.smithi195.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-08-18T22:39:44.392 INFO:teuthology.orchestra.run.smithi195.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-08-18T22:39:44.392 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T22:39:44.392 DEBUG:teuthology.orchestra.run.smithi195:> ls /sys/fs/fuse/connections 2024-08-18T22:39:44.403 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi195.stderr:2024-08-18T22:39:44.402+0000 7f626c2d0300 -1 init, newargv = 0x55674b8339b0 newargc=15 2024-08-18T22:39:44.403 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi195.stderr:ceph-fuse[49201]: starting ceph client 2024-08-18T22:39:44.411 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi195.stderr:ceph-fuse[49201]: starting fuse 2024-08-18T22:39:44.419 INFO:teuthology.orchestra.run.smithi195.stdout:118 2024-08-18T22:39:44.420 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [118] 2024-08-18T22:39:44.420 DEBUG:teuthology.orchestra.run.smithi195:> sudo stdin-killer -- python3 -c ' 2024-08-18T22:39:44.420 DEBUG:teuthology.orchestra.run.smithi195:> import glob 2024-08-18T22:39:44.420 DEBUG:teuthology.orchestra.run.smithi195:> import re 2024-08-18T22:39:44.420 DEBUG:teuthology.orchestra.run.smithi195:> import os 2024-08-18T22:39:44.420 DEBUG:teuthology.orchestra.run.smithi195:> import subprocess 2024-08-18T22:39:44.420 DEBUG:teuthology.orchestra.run.smithi195:> 2024-08-18T22:39:44.420 DEBUG:teuthology.orchestra.run.smithi195:> def _find_admin_socket(client_name): 2024-08-18T22:39:44.420 DEBUG:teuthology.orchestra.run.smithi195:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2024-08-18T22:39:44.420 DEBUG:teuthology.orchestra.run.smithi195:> files = glob.glob(asok_path) 2024-08-18T22:39:44.420 DEBUG:teuthology.orchestra.run.smithi195:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2024-08-18T22:39:44.420 DEBUG:teuthology.orchestra.run.smithi195:> 2024-08-18T22:39:44.420 DEBUG:teuthology.orchestra.run.smithi195:> # Given a non-glob path, it better be there 2024-08-18T22:39:44.421 DEBUG:teuthology.orchestra.run.smithi195:> if "*" not in asok_path: 2024-08-18T22:39:44.421 DEBUG:teuthology.orchestra.run.smithi195:> assert(len(files) == 1) 2024-08-18T22:39:44.421 DEBUG:teuthology.orchestra.run.smithi195:> return files[0] 2024-08-18T22:39:44.421 DEBUG:teuthology.orchestra.run.smithi195:> 2024-08-18T22:39:44.421 DEBUG:teuthology.orchestra.run.smithi195:> for f in files: 2024-08-18T22:39:44.421 DEBUG:teuthology.orchestra.run.smithi195:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-08-18T22:39:44.421 DEBUG:teuthology.orchestra.run.smithi195:> if os.path.exists("/proc/{0}".format(pid)): 2024-08-18T22:39:44.421 DEBUG:teuthology.orchestra.run.smithi195:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-08-18T22:39:44.421 DEBUG:teuthology.orchestra.run.smithi195:> contents = proc_f.read() 2024-08-18T22:39:44.421 DEBUG:teuthology.orchestra.run.smithi195:> if mountpoint in contents: 2024-08-18T22:39:44.421 DEBUG:teuthology.orchestra.run.smithi195:> return f 2024-08-18T22:39:44.421 DEBUG:teuthology.orchestra.run.smithi195:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-08-18T22:39:44.421 DEBUG:teuthology.orchestra.run.smithi195:> 2024-08-18T22:39:44.421 DEBUG:teuthology.orchestra.run.smithi195:> print(_find_admin_socket("client.1")) 2024-08-18T22:39:44.421 DEBUG:teuthology.orchestra.run.smithi195:> ' 2024-08-18T22:39:44.537 INFO:teuthology.orchestra.run.smithi195.stdout:/var/run/ceph/ceph-client.1.49201.asok 2024-08-18T22:39:44.540 INFO:teuthology.orchestra.run.smithi195.stderr:2024-08-18T22:39:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-18T22:39:44.548 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.49201.asok 2024-08-18T22:39:44.548 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T22:39:44.548 DEBUG:teuthology.orchestra.run.smithi195:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.49201.asok status 2024-08-18T22:39:44.676 INFO:teuthology.orchestra.run.smithi195.stdout:{ 2024-08-18T22:39:44.677 INFO:teuthology.orchestra.run.smithi195.stdout: "metadata": { 2024-08-18T22:39:44.677 INFO:teuthology.orchestra.run.smithi195.stdout: "ceph_sha1": "df62bdccd9a13bf566b27a250eddfdd89be3072d", 2024-08-18T22:39:44.677 INFO:teuthology.orchestra.run.smithi195.stdout: "ceph_version": "ceph version 17.2.7-1406-gdf62bdcc (df62bdccd9a13bf566b27a250eddfdd89be3072d) quincy (stable)", 2024-08-18T22:39:44.677 INFO:teuthology.orchestra.run.smithi195.stdout: "entity_id": "1", 2024-08-18T22:39:44.677 INFO:teuthology.orchestra.run.smithi195.stdout: "hostname": "smithi195", 2024-08-18T22:39:44.678 INFO:teuthology.orchestra.run.smithi195.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2024-08-18T22:39:44.678 INFO:teuthology.orchestra.run.smithi195.stdout: "pid": "49201", 2024-08-18T22:39:44.678 INFO:teuthology.orchestra.run.smithi195.stdout: "root": "/" 2024-08-18T22:39:44.678 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-08-18T22:39:44.678 INFO:teuthology.orchestra.run.smithi195.stdout: "dentry_count": 0, 2024-08-18T22:39:44.678 INFO:teuthology.orchestra.run.smithi195.stdout: "dentry_pinned_count": 0, 2024-08-18T22:39:44.678 INFO:teuthology.orchestra.run.smithi195.stdout: "id": 24293, 2024-08-18T22:39:44.678 INFO:teuthology.orchestra.run.smithi195.stdout: "inst": { 2024-08-18T22:39:44.679 INFO:teuthology.orchestra.run.smithi195.stdout: "name": { 2024-08-18T22:39:44.679 INFO:teuthology.orchestra.run.smithi195.stdout: "type": "client", 2024-08-18T22:39:44.679 INFO:teuthology.orchestra.run.smithi195.stdout: "num": 24293 2024-08-18T22:39:44.679 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-08-18T22:39:44.679 INFO:teuthology.orchestra.run.smithi195.stdout: "addr": { 2024-08-18T22:39:44.679 INFO:teuthology.orchestra.run.smithi195.stdout: "type": "v1", 2024-08-18T22:39:44.680 INFO:teuthology.orchestra.run.smithi195.stdout: "addr": "192.168.0.1:0", 2024-08-18T22:39:44.680 INFO:teuthology.orchestra.run.smithi195.stdout: "nonce": 1761984941 2024-08-18T22:39:44.680 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-08-18T22:39:44.680 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-08-18T22:39:44.680 INFO:teuthology.orchestra.run.smithi195.stdout: "addr": { 2024-08-18T22:39:44.680 INFO:teuthology.orchestra.run.smithi195.stdout: "type": "v1", 2024-08-18T22:39:44.680 INFO:teuthology.orchestra.run.smithi195.stdout: "addr": "192.168.0.1:0", 2024-08-18T22:39:44.680 INFO:teuthology.orchestra.run.smithi195.stdout: "nonce": 1761984941 2024-08-18T22:39:44.680 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-08-18T22:39:44.680 INFO:teuthology.orchestra.run.smithi195.stdout: "inst_str": "client.24293 192.168.0.1:0/1761984941", 2024-08-18T22:39:44.680 INFO:teuthology.orchestra.run.smithi195.stdout: "addr_str": "192.168.0.1:0/1761984941", 2024-08-18T22:39:44.680 INFO:teuthology.orchestra.run.smithi195.stdout: "inode_count": 1, 2024-08-18T22:39:44.681 INFO:teuthology.orchestra.run.smithi195.stdout: "mds_epoch": 17, 2024-08-18T22:39:44.681 INFO:teuthology.orchestra.run.smithi195.stdout: "osd_epoch": 47, 2024-08-18T22:39:44.681 INFO:teuthology.orchestra.run.smithi195.stdout: "osd_epoch_barrier": 0, 2024-08-18T22:39:44.681 INFO:teuthology.orchestra.run.smithi195.stdout: "blocklisted": false, 2024-08-18T22:39:44.681 INFO:teuthology.orchestra.run.smithi195.stdout: "fs_name": "cephfs" 2024-08-18T22:39:44.681 INFO:teuthology.orchestra.run.smithi195.stdout:} 2024-08-18T22:39:44.687 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T22:39:44.687 DEBUG:teuthology.orchestra.run.smithi121:> stat --file-system '--printf=%T 2024-08-18T22:39:44.687 DEBUG:teuthology.orchestra.run.smithi121:> ' -- /home/ubuntu/cephtest/mnt.0 2024-08-18T22:39:44.708 INFO:teuthology.orchestra.run.smithi121.stdout:fuseblk 2024-08-18T22:39:44.709 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-08-18T22:39:44.709 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T22:39:44.709 DEBUG:teuthology.orchestra.run.smithi121:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-08-18T22:39:44.782 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T22:39:44.782 DEBUG:teuthology.orchestra.run.smithi195:> stat --file-system '--printf=%T 2024-08-18T22:39:44.782 DEBUG:teuthology.orchestra.run.smithi195:> ' -- /home/ubuntu/cephtest/mnt.1 2024-08-18T22:39:44.799 INFO:teuthology.orchestra.run.smithi195.stdout:fuseblk 2024-08-18T22:39:44.799 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2024-08-18T22:39:44.799 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T22:39:44.799 DEBUG:teuthology.orchestra.run.smithi195:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-08-18T22:39:45.274 INFO:teuthology.run_tasks:Running task print... 2024-08-18T22:39:45.286 INFO:teuthology.task.print:**** done client 2024-08-18T22:39:45.286 INFO:teuthology.run_tasks:Running task parallel... 2024-08-18T22:39:45.298 INFO:teuthology.task.parallel:starting parallel... 2024-08-18T22:39:45.298 INFO:teuthology.task.parallel:In parallel, running task sequential... 2024-08-18T22:39:45.299 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2024-08-18T22:39:45.299 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi121.front.sepia.ceph.com 2024-08-18T22:39:45.299 DEBUG:teuthology.orchestra.run.smithi121:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b003123a-5db1-11ef-bccf-c7b262605968 -e sha1=de09dd018de4baddfa6ca4d43bc8fb784cf75833 -- bash -c 'ceph config set mgr mgr/orchestrator/fail_fs false || true' 2024-08-18T22:39:45.299 INFO:teuthology.task.parallel:In parallel, running task sequential... 2024-08-18T22:39:45.300 INFO:teuthology.task.sequential:In sequential, running task workunit... 2024-08-18T22:39:45.304 INFO:tasks.workunit:Pulling workunits from ref 78215f5a1cf5eaf321d506a66539942e12851f34 2024-08-18T22:39:45.304 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-08-18T22:39:45.304 INFO:tasks.workunit:timeout=3h 2024-08-18T22:39:45.304 INFO:tasks.workunit:cleanup=True 2024-08-18T22:39:45.305 DEBUG:teuthology.orchestra.run.smithi121:> stat -- /home/ubuntu/cephtest/mnt.0 2024-08-18T22:39:45.326 INFO:teuthology.orchestra.run.smithi121.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-08-18T22:39:45.326 INFO:teuthology.orchestra.run.smithi121.stdout: Size: 0 Blocks: 1 IO Block: 4194304 directory 2024-08-18T22:39:45.326 INFO:teuthology.orchestra.run.smithi121.stdout:Device: 63h/99d Inode: 1 Links: 2 2024-08-18T22:39:45.326 INFO:teuthology.orchestra.run.smithi121.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-18T22:39:45.326 INFO:teuthology.orchestra.run.smithi121.stdout:Context: system_u:object_r:fusefs_t:s0 2024-08-18T22:39:45.326 INFO:teuthology.orchestra.run.smithi121.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2024-08-18T22:39:45.326 INFO:teuthology.orchestra.run.smithi121.stdout:Modify: 2024-08-18 22:39:09.573863965 +0000 2024-08-18T22:39:45.326 INFO:teuthology.orchestra.run.smithi121.stdout:Change: 2024-08-18 22:39:44.778948229 +0000 2024-08-18T22:39:45.326 INFO:teuthology.orchestra.run.smithi121.stdout: Birth: - 2024-08-18T22:39:45.326 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-08-18T22:39:45.327 DEBUG:teuthology.orchestra.run.smithi121:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-08-18T22:39:45.399 DEBUG:teuthology.orchestra.run.smithi195:> stat -- /home/ubuntu/cephtest/mnt.1 2024-08-18T22:39:45.419 INFO:teuthology.orchestra.run.smithi195.stdout: File: /home/ubuntu/cephtest/mnt.1 2024-08-18T22:39:45.419 INFO:teuthology.orchestra.run.smithi195.stdout: Size: 0 Blocks: 1 IO Block: 4194304 directory 2024-08-18T22:39:45.419 INFO:teuthology.orchestra.run.smithi195.stdout:Device: 76h/118d Inode: 1 Links: 3 2024-08-18T22:39:45.419 INFO:teuthology.orchestra.run.smithi195.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-18T22:39:45.419 INFO:teuthology.orchestra.run.smithi195.stdout:Context: system_u:object_r:fusefs_t:s0 2024-08-18T22:39:45.419 INFO:teuthology.orchestra.run.smithi195.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2024-08-18T22:39:45.419 INFO:teuthology.orchestra.run.smithi195.stdout:Modify: 2024-08-18 22:39:45.392692406 +0000 2024-08-18T22:39:45.419 INFO:teuthology.orchestra.run.smithi195.stdout:Change: 2024-08-18 22:39:45.392692406 +0000 2024-08-18T22:39:45.420 INFO:teuthology.orchestra.run.smithi195.stdout: Birth: - 2024-08-18T22:39:45.420 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.1 2024-08-18T22:39:45.420 DEBUG:teuthology.orchestra.run.smithi195:> cd -- /home/ubuntu/cephtest/mnt.1 && sudo install -d -m 0755 --owner=ubuntu -- client.1 2024-08-18T22:39:45.495 DEBUG:teuthology.orchestra.run.smithi121:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 78215f5a1cf5eaf321d506a66539942e12851f34 2024-08-18T22:39:45.496 DEBUG:teuthology.orchestra.run.smithi195:> rm -rf /home/ubuntu/cephtest/clone.client.1 && git clone https://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.1 && cd /home/ubuntu/cephtest/clone.client.1 && git checkout 78215f5a1cf5eaf321d506a66539942e12851f34 2024-08-18T22:39:45.512 INFO:tasks.workunit.client.0.smithi121.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-08-18T22:39:45.554 INFO:tasks.workunit.client.1.smithi195.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.1'... 2024-08-18T22:39:45.572 INFO:teuthology.orchestra.run.smithi121.stderr:Inferring config /var/lib/ceph/b003123a-5db1-11ef-bccf-c7b262605968/mon.smithi121/config 2024-08-18T22:39:45.910 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:39:45 smithi195 ceph-mon[23370]: pgmap v188: 65 pgs: 65 active+clean; 581 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 341 B/s wr, 0 op/s 2024-08-18T22:39:45.943 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:39:45 smithi121 ceph-mon[16788]: pgmap v188: 65 pgs: 65 active+clean; 581 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 341 B/s wr, 0 op/s 2024-08-18T22:39:47.184 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:47.171+0000 7f722f3a8640 1 -- 172.21.15.121:0/1301106035 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f72280fb210 msgr2=0x7f72280fb620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:39:47.184 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:47.171+0000 7f722f3a8640 1 --2- 172.21.15.121:0/1301106035 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f72280fb210 0x7f72280fb620 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f72240048d0 tx=0x7f7224009da0 comp rx=0 tx=0).stop 2024-08-18T22:39:47.184 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:47.171+0000 7f722f3a8640 1 -- 172.21.15.121:0/1301106035 shutdown_connections 2024-08-18T22:39:47.184 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:47.171+0000 7f722f3a8640 1 --2- 172.21.15.121:0/1301106035 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f72280fc4e0 0x7f72280fc950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:39:47.184 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:47.171+0000 7f722f3a8640 1 --2- 172.21.15.121:0/1301106035 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f72280fb210 0x7f72280fb620 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:39:47.184 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:47.171+0000 7f722f3a8640 1 -- 172.21.15.121:0/1301106035 >> 172.21.15.121:0/1301106035 conn(0x7f72280f69d0 msgr2=0x7f72280f8e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:39:47.184 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:47.171+0000 7f722f3a8640 1 -- 172.21.15.121:0/1301106035 shutdown_connections 2024-08-18T22:39:47.184 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:47.171+0000 7f722f3a8640 1 -- 172.21.15.121:0/1301106035 wait complete. 2024-08-18T22:39:47.185 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:47.172+0000 7f722f3a8640 1 Processor -- start 2024-08-18T22:39:47.185 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:47.172+0000 7f722f3a8640 1 -- start start 2024-08-18T22:39:47.185 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:47.172+0000 7f722f3a8640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f72280fb210 0x7f722810be50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:39:47.185 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:47.172+0000 7f722f3a8640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f72280fc4e0 0x7f722810c390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:39:47.185 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:47.172+0000 7f722f3a8640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f722810d120 con 0x7f72280fc4e0 2024-08-18T22:39:47.185 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:47.172+0000 7f722f3a8640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f722810d290 con 0x7f72280fb210 2024-08-18T22:39:47.185 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:47.172+0000 7f722c943640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f72280fc4e0 0x7f722810c390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:39:47.185 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:47.172+0000 7f722c943640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f72280fc4e0 0x7f722810c390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:53164/0 (socket says 172.21.15.121:53164) 2024-08-18T22:39:47.185 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:47.172+0000 7f722c943640 1 -- 172.21.15.121:0/2981802172 learned_addr learned my addr 172.21.15.121:0/2981802172 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-18T22:39:47.185 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:47.173+0000 7f722c943640 1 -- 172.21.15.121:0/2981802172 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f72280fb210 msgr2=0x7f722810be50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:39:47.185 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:47.173+0000 7f722c943640 1 --2- 172.21.15.121:0/2981802172 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f72280fb210 0x7f722810be50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:39:47.185 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:47.173+0000 7f722c943640 1 -- 172.21.15.121:0/2981802172 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7224005040 con 0x7f72280fc4e0 2024-08-18T22:39:47.185 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:47.173+0000 7f722c943640 1 --2- 172.21.15.121:0/2981802172 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f72280fc4e0 0x7f722810c390 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f721800b790 tx=0x7f72180091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:39:47.186 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:47.173+0000 7f721dffb640 1 -- 172.21.15.121:0/2981802172 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f721800c700 con 0x7f72280fc4e0 2024-08-18T22:39:47.186 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:47.173+0000 7f721dffb640 1 -- 172.21.15.121:0/2981802172 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f721800cd00 con 0x7f72280fc4e0 2024-08-18T22:39:47.186 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:47.173+0000 7f722f3a8640 1 -- 172.21.15.121:0/2981802172 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f722810d570 con 0x7f72280fc4e0 2024-08-18T22:39:47.186 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:47.173+0000 7f721dffb640 1 -- 172.21.15.121:0/2981802172 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7218015e70 con 0x7f72280fc4e0 2024-08-18T22:39:47.186 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:47.173+0000 7f722f3a8640 1 -- 172.21.15.121:0/2981802172 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f722810da90 con 0x7f72280fc4e0 2024-08-18T22:39:47.186 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:47.174+0000 7f722f3a8640 1 -- 172.21.15.121:0/2981802172 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7228105620 con 0x7f72280fc4e0 2024-08-18T22:39:47.186 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:47.174+0000 7f721dffb640 1 -- 172.21.15.121:0/2981802172 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 19) v1 ==== 85127+0+0 (secure 0 0 0) 0x7f7218012070 con 0x7f72280fc4e0 2024-08-18T22:39:47.186 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:47.175+0000 7f721dffb640 1 --2- 172.21.15.121:0/2981802172 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7f7214067190 0x7f7214069640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:39:47.186 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:47.175+0000 7f721dffb640 1 -- 172.21.15.121:0/2981802172 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f72180846e0 con 0x7f72280fc4e0 2024-08-18T22:39:47.186 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:47.175+0000 7f722d144640 1 --2- 172.21.15.121:0/2981802172 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7f7214067190 0x7f7214069640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:39:47.186 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:47.175+0000 7f722d144640 1 --2- 172.21.15.121:0/2981802172 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7f7214067190 0x7f7214069640 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f722402a530 tx=0x7f7224009da0 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:39:47.186 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:47.179+0000 7f721dffb640 1 -- 172.21.15.121:0/2981802172 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f7218051930 con 0x7f72280fc4e0 2024-08-18T22:39:47.338 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:47.334+0000 7f722f3a8640 1 -- 172.21.15.121:0/2981802172 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command([{prefix=config set, name=mgr/orchestrator/fail_fs}] v 0) v1 -- 0x7f722804b4c0 con 0x7f72280fc4e0 2024-08-18T22:39:47.339 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:47.335+0000 7f721dffb640 1 -- 172.21.15.121:0/2981802172 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/orchestrator/fail_fs}]=-22 unrecognized config option 'mgr/orchestrator/fail_fs' v21)=-22 unrecognized config option 'mgr/orchestrator/fail_fs' v21) v1 ==== 179+0+0 (secure 0 0 0) 0x7f7218054f50 con 0x7f72280fc4e0 2024-08-18T22:39:47.339 INFO:teuthology.orchestra.run.smithi121.stderr:Error EINVAL: unrecognized config option 'mgr/orchestrator/fail_fs' 2024-08-18T22:39:47.903 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:39:47 smithi121 ceph-mon[16788]: pgmap v189: 65 pgs: 65 active+clean; 581 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 341 B/s wr, 0 op/s 2024-08-18T22:39:47.904 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2024-08-18T22:39:47.904 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi121.front.sepia.ceph.com 2024-08-18T22:39:47.904 DEBUG:teuthology.orchestra.run.smithi121:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b003123a-5db1-11ef-bccf-c7b262605968 -e sha1=de09dd018de4baddfa6ca4d43bc8fb784cf75833 -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force' 2024-08-18T22:39:47.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:39:47 smithi195 ceph-mon[23370]: pgmap v189: 65 pgs: 65 active+clean; 581 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 341 B/s wr, 0 op/s 2024-08-18T22:39:48.194 INFO:teuthology.orchestra.run.smithi121.stderr:Inferring config /var/lib/ceph/b003123a-5db1-11ef-bccf-c7b262605968/mon.smithi121/config 2024-08-18T22:39:49.664 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:49.661+0000 7f0d41419640 1 -- 172.21.15.121:0/2080899865 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0d3c0fd5a0 msgr2=0x7f0d3c0fda10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:39:49.664 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:49.661+0000 7f0d41419640 1 --2- 172.21.15.121:0/2080899865 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0d3c0fd5a0 0x7f0d3c0fda10 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f0d300048d0 tx=0x7f0d30009da0 comp rx=0 tx=0).stop 2024-08-18T22:39:49.665 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:49.661+0000 7f0d41419640 1 -- 172.21.15.121:0/2080899865 shutdown_connections 2024-08-18T22:39:49.665 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:49.661+0000 7f0d41419640 1 --2- 172.21.15.121:0/2080899865 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0d3c0fd5a0 0x7f0d3c0fda10 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:39:49.665 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:49.661+0000 7f0d41419640 1 --2- 172.21.15.121:0/2080899865 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0d3c0fc2d0 0x7f0d3c0fc6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:39:49.665 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:49.661+0000 7f0d41419640 1 -- 172.21.15.121:0/2080899865 >> 172.21.15.121:0/2080899865 conn(0x7f0d3c0f7ab0 msgr2=0x7f0d3c0f9ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:39:49.665 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:49.661+0000 7f0d41419640 1 -- 172.21.15.121:0/2080899865 shutdown_connections 2024-08-18T22:39:49.665 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:49.661+0000 7f0d41419640 1 -- 172.21.15.121:0/2080899865 wait complete. 2024-08-18T22:39:49.665 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:49.662+0000 7f0d41419640 1 Processor -- start 2024-08-18T22:39:49.665 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:49.662+0000 7f0d41419640 1 -- start start 2024-08-18T22:39:49.665 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:49.662+0000 7f0d41419640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0d3c0fc2d0 0x7f0d3c071310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:39:49.665 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:49.662+0000 7f0d41419640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0d3c0fd5a0 0x7f0d3c06f800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:39:49.665 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:49.662+0000 7f0d41419640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d3c06fe20 con 0x7f0d3c0fc2d0 2024-08-18T22:39:49.665 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:49.662+0000 7f0d41419640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d3c06ff60 con 0x7f0d3c0fd5a0 2024-08-18T22:39:49.665 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:49.662+0000 7f0d3affd640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0d3c0fc2d0 0x7f0d3c071310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:39:49.666 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:49.662+0000 7f0d3affd640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0d3c0fc2d0 0x7f0d3c071310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:53182/0 (socket says 172.21.15.121:53182) 2024-08-18T22:39:49.666 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:49.662+0000 7f0d3affd640 1 -- 172.21.15.121:0/2881646914 learned_addr learned my addr 172.21.15.121:0/2881646914 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-18T22:39:49.666 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:49.662+0000 7f0d3a7fc640 1 --2- 172.21.15.121:0/2881646914 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0d3c0fd5a0 0x7f0d3c06f800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:39:49.666 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:49.662+0000 7f0d3affd640 1 -- 172.21.15.121:0/2881646914 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0d3c0fd5a0 msgr2=0x7f0d3c06f800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:39:49.666 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:49.662+0000 7f0d3affd640 1 --2- 172.21.15.121:0/2881646914 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0d3c0fd5a0 0x7f0d3c06f800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:39:49.666 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:49.662+0000 7f0d3affd640 1 -- 172.21.15.121:0/2881646914 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d30005040 con 0x7f0d3c0fc2d0 2024-08-18T22:39:49.666 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:49.662+0000 7f0d3affd640 1 --2- 172.21.15.121:0/2881646914 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0d3c0fc2d0 0x7f0d3c071310 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f0d2c00b790 tx=0x7f0d2c0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:39:49.666 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:49.663+0000 7f0d237fe640 1 -- 172.21.15.121:0/2881646914 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0d2c00c700 con 0x7f0d3c0fc2d0 2024-08-18T22:39:49.667 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:49.663+0000 7f0d237fe640 1 -- 172.21.15.121:0/2881646914 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f0d2c00cd00 con 0x7f0d3c0fc2d0 2024-08-18T22:39:49.667 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:49.663+0000 7f0d41419640 1 -- 172.21.15.121:0/2881646914 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d3c070240 con 0x7f0d3c0fc2d0 2024-08-18T22:39:49.667 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:49.663+0000 7f0d237fe640 1 -- 172.21.15.121:0/2881646914 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0d2c015e70 con 0x7f0d3c0fc2d0 2024-08-18T22:39:49.667 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:49.663+0000 7f0d41419640 1 -- 172.21.15.121:0/2881646914 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d3c114ed0 con 0x7f0d3c0fc2d0 2024-08-18T22:39:49.668 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:49.664+0000 7f0d41419640 1 -- 172.21.15.121:0/2881646914 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d3c0fb730 con 0x7f0d3c0fc2d0 2024-08-18T22:39:49.668 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:49.664+0000 7f0d237fe640 1 -- 172.21.15.121:0/2881646914 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 19) v1 ==== 85127+0+0 (secure 0 0 0) 0x7f0d2c012070 con 0x7f0d3c0fc2d0 2024-08-18T22:39:49.668 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:49.665+0000 7f0d237fe640 1 --2- 172.21.15.121:0/2881646914 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7f0d24067190 0x7f0d24069640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:39:49.668 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:49.665+0000 7f0d237fe640 1 -- 172.21.15.121:0/2881646914 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f0d2c084740 con 0x7f0d3c0fc2d0 2024-08-18T22:39:49.668 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:49.665+0000 7f0d3a7fc640 1 --2- 172.21.15.121:0/2881646914 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7f0d24067190 0x7f0d24069640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:39:49.668 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:49.665+0000 7f0d3a7fc640 1 --2- 172.21.15.121:0/2881646914 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7f0d24067190 0x7f0d24069640 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f0d30000c00 tx=0x7f0d30009da0 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:39:49.670 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:49.669+0000 7f0d237fe640 1 -- 172.21.15.121:0/2881646914 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f0d2c0518f0 con 0x7f0d3c0fc2d0 2024-08-18T22:39:49.830 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:49.829+0000 7f0d41419640 1 -- 172.21.15.121:0/2881646914 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim}] v 0) v1 -- 0x7f0d3c04b4c0 con 0x7f0d3c0fc2d0 2024-08-18T22:39:49.831 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:49.830+0000 7f0d237fe640 1 -- 172.21.15.121:0/2881646914 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim}]=0 v21)=0 v21) v1 ==== 155+0+0 (secure 0 0 0) 0x7f0d3c04b4c0 con 0x7f0d3c0fc2d0 2024-08-18T22:39:49.833 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:49.832+0000 7f0d41419640 1 -- 172.21.15.121:0/2881646914 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7f0d24067190 msgr2=0x7f0d24069640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:39:49.833 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:49.832+0000 7f0d41419640 1 --2- 172.21.15.121:0/2881646914 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7f0d24067190 0x7f0d24069640 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f0d30000c00 tx=0x7f0d30009da0 comp rx=0 tx=0).stop 2024-08-18T22:39:49.833 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:49.832+0000 7f0d41419640 1 -- 172.21.15.121:0/2881646914 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0d3c0fc2d0 msgr2=0x7f0d3c071310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:39:49.833 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:49.832+0000 7f0d41419640 1 --2- 172.21.15.121:0/2881646914 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0d3c0fc2d0 0x7f0d3c071310 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f0d2c00b790 tx=0x7f0d2c0091d0 comp rx=0 tx=0).stop 2024-08-18T22:39:49.833 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:49.832+0000 7f0d41419640 1 -- 172.21.15.121:0/2881646914 shutdown_connections 2024-08-18T22:39:49.833 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:49.832+0000 7f0d41419640 1 --2- 172.21.15.121:0/2881646914 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7f0d24067190 0x7f0d24069640 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:39:49.833 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:49.832+0000 7f0d41419640 1 --2- 172.21.15.121:0/2881646914 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0d3c0fd5a0 0x7f0d3c06f800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:39:49.833 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:49.832+0000 7f0d41419640 1 --2- 172.21.15.121:0/2881646914 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0d3c0fc2d0 0x7f0d3c071310 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:39:49.833 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:49.832+0000 7f0d41419640 1 -- 172.21.15.121:0/2881646914 >> 172.21.15.121:0/2881646914 conn(0x7f0d3c0f7ab0 msgr2=0x7f0d3c0f9220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:39:49.833 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:49.832+0000 7f0d41419640 1 -- 172.21.15.121:0/2881646914 shutdown_connections 2024-08-18T22:39:49.833 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:49.832+0000 7f0d41419640 1 -- 172.21.15.121:0/2881646914 wait complete. 2024-08-18T22:39:49.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:39:49 smithi195 ceph-mon[23370]: pgmap v190: 65 pgs: 65 active+clean; 581 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-08-18T22:39:50.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:39:49 smithi121 ceph-mon[16788]: pgmap v190: 65 pgs: 65 active+clean; 581 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-08-18T22:39:50.492 DEBUG:teuthology.orchestra.run.smithi121:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b003123a-5db1-11ef-bccf-c7b262605968 -e sha1=de09dd018de4baddfa6ca4d43bc8fb784cf75833 -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force' 2024-08-18T22:39:50.742 INFO:teuthology.orchestra.run.smithi121.stderr:Inferring config /var/lib/ceph/b003123a-5db1-11ef-bccf-c7b262605968/mon.smithi121/config 2024-08-18T22:39:51.769 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:39:51 smithi121 ceph-mon[16788]: pgmap v191: 65 pgs: 65 active+clean; 587 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1023 B/s wr, 0 op/s 2024-08-18T22:39:51.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:39:51 smithi195 ceph-mon[23370]: pgmap v191: 65 pgs: 65 active+clean; 587 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1023 B/s wr, 0 op/s 2024-08-18T22:39:52.273 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:52.269+0000 7f4ee3a6e640 1 -- 172.21.15.121:0/1582793740 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4edc0fc870 msgr2=0x7f4edc0fcc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:39:52.273 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:52.269+0000 7f4ee3a6e640 1 --2- 172.21.15.121:0/1582793740 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4edc0fc870 0x7f4edc0fcc80 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f4ed80048d0 tx=0x7f4ed8009da0 comp rx=0 tx=0).stop 2024-08-18T22:39:52.273 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:52.269+0000 7f4ee3a6e640 1 -- 172.21.15.121:0/1582793740 shutdown_connections 2024-08-18T22:39:52.273 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:52.269+0000 7f4ee3a6e640 1 --2- 172.21.15.121:0/1582793740 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4edc0fd1c0 0x7f4edc103b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:39:52.273 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:52.269+0000 7f4ee3a6e640 1 --2- 172.21.15.121:0/1582793740 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4edc0fc870 0x7f4edc0fcc80 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:39:52.273 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:52.269+0000 7f4ee3a6e640 1 -- 172.21.15.121:0/1582793740 >> 172.21.15.121:0/1582793740 conn(0x7f4edc0f6140 msgr2=0x7f4edc0f8570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:39:52.273 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:52.269+0000 7f4ee3a6e640 1 -- 172.21.15.121:0/1582793740 shutdown_connections 2024-08-18T22:39:52.273 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:52.269+0000 7f4ee3a6e640 1 -- 172.21.15.121:0/1582793740 wait complete. 2024-08-18T22:39:52.273 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:52.270+0000 7f4ee3a6e640 1 Processor -- start 2024-08-18T22:39:52.274 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:52.270+0000 7f4ee3a6e640 1 -- start start 2024-08-18T22:39:52.274 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:52.270+0000 7f4ee3a6e640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4edc0fc870 0x7f4edc10f0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:39:52.274 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:52.270+0000 7f4ee3a6e640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4edc0fd1c0 0x7f4edc10f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:39:52.274 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:52.270+0000 7f4ee3a6e640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4edc110450 con 0x7f4edc0fd1c0 2024-08-18T22:39:52.274 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:52.270+0000 7f4ee3a6e640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4edc1105c0 con 0x7f4edc0fc870 2024-08-18T22:39:52.274 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:52.270+0000 7f4ee1009640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4edc0fd1c0 0x7f4edc10f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:39:52.274 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:52.270+0000 7f4ee1009640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4edc0fd1c0 0x7f4edc10f5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:53196/0 (socket says 172.21.15.121:53196) 2024-08-18T22:39:52.274 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:52.270+0000 7f4ee1009640 1 -- 172.21.15.121:0/794077197 learned_addr learned my addr 172.21.15.121:0/794077197 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-18T22:39:52.274 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:52.270+0000 7f4ee180a640 1 --2- 172.21.15.121:0/794077197 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4edc0fc870 0x7f4edc10f0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:39:52.274 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:52.270+0000 7f4ee1009640 1 -- 172.21.15.121:0/794077197 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4edc0fc870 msgr2=0x7f4edc10f0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:39:52.274 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:52.270+0000 7f4ee1009640 1 --2- 172.21.15.121:0/794077197 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4edc0fc870 0x7f4edc10f0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:39:52.274 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:52.270+0000 7f4ee1009640 1 -- 172.21.15.121:0/794077197 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ed8005040 con 0x7f4edc0fd1c0 2024-08-18T22:39:52.274 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:52.270+0000 7f4ee1009640 1 --2- 172.21.15.121:0/794077197 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4edc0fd1c0 0x7f4edc10f5e0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f4ecc00b790 tx=0x7f4ecc009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:39:52.275 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:52.271+0000 7f4ed27fc640 1 -- 172.21.15.121:0/794077197 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4ecc00c700 con 0x7f4edc0fd1c0 2024-08-18T22:39:52.275 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:52.271+0000 7f4ee3a6e640 1 -- 172.21.15.121:0/794077197 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4edc1108a0 con 0x7f4edc0fd1c0 2024-08-18T22:39:52.275 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:52.271+0000 7f4ed27fc640 1 -- 172.21.15.121:0/794077197 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f4ecc00cd00 con 0x7f4edc0fd1c0 2024-08-18T22:39:52.275 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:52.271+0000 7f4ed27fc640 1 -- 172.21.15.121:0/794077197 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4ecc015dd0 con 0x7f4edc0fd1c0 2024-08-18T22:39:52.275 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:52.271+0000 7f4ee3a6e640 1 -- 172.21.15.121:0/794077197 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4edc110dc0 con 0x7f4edc0fd1c0 2024-08-18T22:39:52.276 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:52.272+0000 7f4ee3a6e640 1 -- 172.21.15.121:0/794077197 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4edc0f9de0 con 0x7f4edc0fd1c0 2024-08-18T22:39:52.276 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:52.272+0000 7f4ed27fc640 1 -- 172.21.15.121:0/794077197 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 19) v1 ==== 85127+0+0 (secure 0 0 0) 0x7f4ecc012070 con 0x7f4edc0fd1c0 2024-08-18T22:39:52.276 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:52.273+0000 7f4ed27fc640 1 --2- 172.21.15.121:0/794077197 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7f4ec8067190 0x7f4ec8069640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:39:52.276 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:52.273+0000 7f4ed27fc640 1 -- 172.21.15.121:0/794077197 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f4ecc084450 con 0x7f4edc0fd1c0 2024-08-18T22:39:52.276 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:52.273+0000 7f4ee180a640 1 --2- 172.21.15.121:0/794077197 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7f4ec8067190 0x7f4ec8069640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:39:52.276 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:52.273+0000 7f4ee180a640 1 --2- 172.21.15.121:0/794077197 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7f4ec8067190 0x7f4ec8069640 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f4ed8000c00 tx=0x7f4ed8035040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:39:52.279 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:52.277+0000 7f4ed27fc640 1 -- 172.21.15.121:0/794077197 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f4ecc0516a0 con 0x7f4edc0fd1c0 2024-08-18T22:39:52.434 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:52.432+0000 7f4ee3a6e640 1 -- 172.21.15.121:0/794077197 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim_allowed}] v 0) v1 -- 0x7f4edc04b4c0 con 0x7f4edc0fd1c0 2024-08-18T22:39:52.435 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:52.433+0000 7f4ed27fc640 1 -- 172.21.15.121:0/794077197 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim_allowed}]=0 v21)=0 v21) v1 ==== 163+0+0 (secure 0 0 0) 0x7f4edc04b4c0 con 0x7f4edc0fd1c0 2024-08-18T22:39:52.437 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:52.434+0000 7f4ee3a6e640 1 -- 172.21.15.121:0/794077197 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7f4ec8067190 msgr2=0x7f4ec8069640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:39:52.437 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:52.434+0000 7f4ee3a6e640 1 --2- 172.21.15.121:0/794077197 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7f4ec8067190 0x7f4ec8069640 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f4ed8000c00 tx=0x7f4ed8035040 comp rx=0 tx=0).stop 2024-08-18T22:39:52.437 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:52.434+0000 7f4ee3a6e640 1 -- 172.21.15.121:0/794077197 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4edc0fd1c0 msgr2=0x7f4edc10f5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:39:52.437 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:52.434+0000 7f4ee3a6e640 1 --2- 172.21.15.121:0/794077197 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4edc0fd1c0 0x7f4edc10f5e0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f4ecc00b790 tx=0x7f4ecc009120 comp rx=0 tx=0).stop 2024-08-18T22:39:52.437 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:52.434+0000 7f4ee3a6e640 1 -- 172.21.15.121:0/794077197 shutdown_connections 2024-08-18T22:39:52.437 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:52.434+0000 7f4ee3a6e640 1 --2- 172.21.15.121:0/794077197 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7f4ec8067190 0x7f4ec8069640 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:39:52.437 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:52.434+0000 7f4ee3a6e640 1 --2- 172.21.15.121:0/794077197 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4edc0fd1c0 0x7f4edc10f5e0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:39:52.437 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:52.434+0000 7f4ee3a6e640 1 --2- 172.21.15.121:0/794077197 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4edc0fc870 0x7f4edc10f0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:39:52.437 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:52.434+0000 7f4ee3a6e640 1 -- 172.21.15.121:0/794077197 >> 172.21.15.121:0/794077197 conn(0x7f4edc0f6140 msgr2=0x7f4edc0f6560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:39:52.437 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:52.435+0000 7f4ee3a6e640 1 -- 172.21.15.121:0/794077197 shutdown_connections 2024-08-18T22:39:52.437 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:52.435+0000 7f4ee3a6e640 1 -- 172.21.15.121:0/794077197 wait complete. 2024-08-18T22:39:53.061 DEBUG:teuthology.orchestra.run.smithi121:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b003123a-5db1-11ef-bccf-c7b262605968 -e sha1=de09dd018de4baddfa6ca4d43bc8fb784cf75833 -- bash -c 'ceph config set global log_to_journald false --force' 2024-08-18T22:39:53.314 INFO:teuthology.orchestra.run.smithi121.stderr:Inferring config /var/lib/ceph/b003123a-5db1-11ef-bccf-c7b262605968/mon.smithi121/config 2024-08-18T22:39:53.737 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:39:53 smithi121 ceph-mon[16788]: pgmap v192: 65 pgs: 65 active+clean; 587 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.1 KiB/s wr, 1 op/s 2024-08-18T22:39:53.737 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:39:53 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-18T22:39:53.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:39:53 smithi195 ceph-mon[23370]: pgmap v192: 65 pgs: 65 active+clean; 587 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.1 KiB/s wr, 1 op/s 2024-08-18T22:39:53.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:39:53 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-18T22:39:54.828 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:54.822+0000 7f0c72b24640 1 -- 172.21.15.121:0/2161937932 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0c6c0fc2f0 msgr2=0x7f0c6c0fc700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:39:54.828 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:54.822+0000 7f0c72b24640 1 --2- 172.21.15.121:0/2161937932 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0c6c0fc2f0 0x7f0c6c0fc700 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f0c680048d0 tx=0x7f0c68009da0 comp rx=0 tx=0).stop 2024-08-18T22:39:54.828 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:54.822+0000 7f0c72b24640 1 -- 172.21.15.121:0/2161937932 shutdown_connections 2024-08-18T22:39:54.828 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:54.822+0000 7f0c72b24640 1 --2- 172.21.15.121:0/2161937932 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0c6c0fd5c0 0x7f0c6c0fda30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:39:54.828 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:54.822+0000 7f0c72b24640 1 --2- 172.21.15.121:0/2161937932 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0c6c0fc2f0 0x7f0c6c0fc700 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:39:54.828 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:54.822+0000 7f0c72b24640 1 -- 172.21.15.121:0/2161937932 >> 172.21.15.121:0/2161937932 conn(0x7f0c6c0f7ad0 msgr2=0x7f0c6c0f9ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:39:54.828 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:54.822+0000 7f0c72b24640 1 -- 172.21.15.121:0/2161937932 shutdown_connections 2024-08-18T22:39:54.829 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:54.822+0000 7f0c72b24640 1 -- 172.21.15.121:0/2161937932 wait complete. 2024-08-18T22:39:54.829 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:54.823+0000 7f0c72b24640 1 Processor -- start 2024-08-18T22:39:54.829 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:54.823+0000 7f0c72b24640 1 -- start start 2024-08-18T22:39:54.829 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:54.823+0000 7f0c72b24640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0c6c0fc2f0 0x7f0c6c10ced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:39:54.829 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:54.823+0000 7f0c72b24640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0c6c0fd5c0 0x7f0c6c10d410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:39:54.829 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:54.823+0000 7f0c72b24640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c6c10e140 con 0x7f0c6c0fd5c0 2024-08-18T22:39:54.829 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:54.823+0000 7f0c72b24640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c6c10e2b0 con 0x7f0c6c0fc2f0 2024-08-18T22:39:54.829 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:54.823+0000 7f0c63fff640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0c6c0fd5c0 0x7f0c6c10d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:39:54.829 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:54.823+0000 7f0c63fff640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0c6c0fd5c0 0x7f0c6c10d410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:53216/0 (socket says 172.21.15.121:53216) 2024-08-18T22:39:54.829 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:54.823+0000 7f0c63fff640 1 -- 172.21.15.121:0/875545991 learned_addr learned my addr 172.21.15.121:0/875545991 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-18T22:39:54.829 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:54.824+0000 7f0c708c0640 1 --2- 172.21.15.121:0/875545991 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0c6c0fc2f0 0x7f0c6c10ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:39:54.829 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:54.824+0000 7f0c63fff640 1 -- 172.21.15.121:0/875545991 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0c6c0fc2f0 msgr2=0x7f0c6c10ced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:39:54.830 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:54.824+0000 7f0c63fff640 1 --2- 172.21.15.121:0/875545991 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0c6c0fc2f0 0x7f0c6c10ced0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:39:54.830 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:54.824+0000 7f0c63fff640 1 -- 172.21.15.121:0/875545991 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c68005040 con 0x7f0c6c0fd5c0 2024-08-18T22:39:54.830 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:54.824+0000 7f0c63fff640 1 --2- 172.21.15.121:0/875545991 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0c6c0fd5c0 0x7f0c6c10d410 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f0c5c00c830 tx=0x7f0c5c004430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:39:54.830 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:54.824+0000 7f0c617fa640 1 -- 172.21.15.121:0/875545991 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0c5c00a850 con 0x7f0c6c0fd5c0 2024-08-18T22:39:54.830 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:54.824+0000 7f0c617fa640 1 -- 172.21.15.121:0/875545991 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f0c5c00ae50 con 0x7f0c6c0fd5c0 2024-08-18T22:39:54.830 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:54.824+0000 7f0c72b24640 1 -- 172.21.15.121:0/875545991 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c6c10e590 con 0x7f0c6c0fd5c0 2024-08-18T22:39:54.830 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:54.824+0000 7f0c617fa640 1 -- 172.21.15.121:0/875545991 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0c5c0113a0 con 0x7f0c6c0fd5c0 2024-08-18T22:39:54.830 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:54.824+0000 7f0c72b24640 1 -- 172.21.15.121:0/875545991 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c6c10eb30 con 0x7f0c6c0fd5c0 2024-08-18T22:39:54.830 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:54.825+0000 7f0c72b24640 1 -- 172.21.15.121:0/875545991 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c6c0fb750 con 0x7f0c6c0fd5c0 2024-08-18T22:39:54.830 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:54.825+0000 7f0c617fa640 1 -- 172.21.15.121:0/875545991 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 19) v1 ==== 85127+0+0 (secure 0 0 0) 0x7f0c5c012400 con 0x7f0c6c0fd5c0 2024-08-18T22:39:54.830 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:54.826+0000 7f0c617fa640 1 --2- 172.21.15.121:0/875545991 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7f0c54067190 0x7f0c54069640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:39:54.830 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:54.826+0000 7f0c617fa640 1 -- 172.21.15.121:0/875545991 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f0c5c084e70 con 0x7f0c6c0fd5c0 2024-08-18T22:39:54.830 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:54.826+0000 7f0c708c0640 1 --2- 172.21.15.121:0/875545991 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7f0c54067190 0x7f0c54069640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:39:54.831 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:54.826+0000 7f0c708c0640 1 --2- 172.21.15.121:0/875545991 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7f0c54067190 0x7f0c54069640 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f0c68007ac0 tx=0x7f0c68035040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:39:54.832 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:54.830+0000 7f0c617fa640 1 -- 172.21.15.121:0/875545991 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f0c5c0520a0 con 0x7f0c6c0fd5c0 2024-08-18T22:39:54.988 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:54.986+0000 7f0c72b24640 1 -- 172.21.15.121:0/875545991 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command([{prefix=config set, name=log_to_journald}] v 0) v1 -- 0x7f0c6c04b4c0 con 0x7f0c6c0fd5c0 2024-08-18T22:39:54.989 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:54.987+0000 7f0c617fa640 1 -- 172.21.15.121:0/875545991 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{prefix=config set, name=log_to_journald}]=0 v21)=0 v21) v1 ==== 135+0+0 (secure 0 0 0) 0x7f0c5c0556c0 con 0x7f0c6c0fd5c0 2024-08-18T22:39:54.992 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:54.990+0000 7f0c72b24640 1 -- 172.21.15.121:0/875545991 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7f0c54067190 msgr2=0x7f0c54069640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:39:54.992 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:54.990+0000 7f0c72b24640 1 --2- 172.21.15.121:0/875545991 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7f0c54067190 0x7f0c54069640 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f0c68007ac0 tx=0x7f0c68035040 comp rx=0 tx=0).stop 2024-08-18T22:39:54.992 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:54.990+0000 7f0c72b24640 1 -- 172.21.15.121:0/875545991 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0c6c0fd5c0 msgr2=0x7f0c6c10d410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:39:54.992 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:54.990+0000 7f0c72b24640 1 --2- 172.21.15.121:0/875545991 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0c6c0fd5c0 0x7f0c6c10d410 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f0c5c00c830 tx=0x7f0c5c004430 comp rx=0 tx=0).stop 2024-08-18T22:39:54.992 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:54.990+0000 7f0c72b24640 1 -- 172.21.15.121:0/875545991 shutdown_connections 2024-08-18T22:39:54.992 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:54.990+0000 7f0c72b24640 1 --2- 172.21.15.121:0/875545991 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7f0c54067190 0x7f0c54069640 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:39:54.992 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:54.990+0000 7f0c72b24640 1 --2- 172.21.15.121:0/875545991 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0c6c0fd5c0 0x7f0c6c10d410 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:39:54.992 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:54.990+0000 7f0c72b24640 1 --2- 172.21.15.121:0/875545991 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0c6c0fc2f0 0x7f0c6c10ced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:39:54.992 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:54.990+0000 7f0c72b24640 1 -- 172.21.15.121:0/875545991 >> 172.21.15.121:0/875545991 conn(0x7f0c6c0f7ad0 msgr2=0x7f0c6c0f9290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:39:54.993 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:54.990+0000 7f0c72b24640 1 -- 172.21.15.121:0/875545991 shutdown_connections 2024-08-18T22:39:54.993 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:54.990+0000 7f0c72b24640 1 -- 172.21.15.121:0/875545991 wait complete. 2024-08-18T22:39:55.617 DEBUG:teuthology.orchestra.run.smithi121:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b003123a-5db1-11ef-bccf-c7b262605968 -e sha1=de09dd018de4baddfa6ca4d43bc8fb784cf75833 -- bash -c 'ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1' 2024-08-18T22:39:55.872 INFO:teuthology.orchestra.run.smithi121.stderr:Inferring config /var/lib/ceph/b003123a-5db1-11ef-bccf-c7b262605968/mon.smithi121/config 2024-08-18T22:39:55.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:39:55 smithi195 ceph-mon[23370]: pgmap v193: 65 pgs: 65 active+clean; 587 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 938 B/s wr, 0 op/s 2024-08-18T22:39:55.995 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:39:55 smithi121 ceph-mon[16788]: pgmap v193: 65 pgs: 65 active+clean; 587 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 938 B/s wr, 0 op/s 2024-08-18T22:39:57.434 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:57.420+0000 7fe4f9afa640 1 -- 172.21.15.121:0/851696941 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe4f40ff420 msgr2=0x7fe4f4101800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:39:57.434 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:57.420+0000 7fe4f9afa640 1 --2- 172.21.15.121:0/851696941 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe4f40ff420 0x7fe4f4101800 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fe4dc0048d0 tx=0x7fe4dc009da0 comp rx=0 tx=0).stop 2024-08-18T22:39:57.434 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:57.420+0000 7fe4f9afa640 1 -- 172.21.15.121:0/851696941 shutdown_connections 2024-08-18T22:39:57.434 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:57.420+0000 7fe4f9afa640 1 --2- 172.21.15.121:0/851696941 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe4f40ff420 0x7fe4f4101800 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:39:57.434 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:57.420+0000 7fe4f9afa640 1 --2- 172.21.15.121:0/851696941 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe4f40659e0 0x7fe4f40feee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:39:57.434 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:57.420+0000 7fe4f9afa640 1 -- 172.21.15.121:0/851696941 >> 172.21.15.121:0/851696941 conn(0x7fe4f40f69b0 msgr2=0x7fe4f40f8dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:39:57.434 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:57.420+0000 7fe4f9afa640 1 -- 172.21.15.121:0/851696941 shutdown_connections 2024-08-18T22:39:57.434 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:57.420+0000 7fe4f9afa640 1 -- 172.21.15.121:0/851696941 wait complete. 2024-08-18T22:39:57.434 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:57.420+0000 7fe4f9afa640 1 Processor -- start 2024-08-18T22:39:57.434 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:57.420+0000 7fe4f9afa640 1 -- start start 2024-08-18T22:39:57.435 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:57.421+0000 7fe4f9afa640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe4f40659e0 0x7fe4f40fc8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:39:57.435 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:57.421+0000 7fe4f9afa640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe4f40ff420 0x7fe4f40fade0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:39:57.435 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:57.421+0000 7fe4f9afa640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4f40fb370 con 0x7fe4f40659e0 2024-08-18T22:39:57.435 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:57.421+0000 7fe4f9afa640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4f40fb4b0 con 0x7fe4f40ff420 2024-08-18T22:39:57.435 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:57.421+0000 7fe4f37fe640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe4f40659e0 0x7fe4f40fc8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:39:57.435 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:57.421+0000 7fe4f37fe640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe4f40659e0 0x7fe4f40fc8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:51194/0 (socket says 172.21.15.121:51194) 2024-08-18T22:39:57.435 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:57.421+0000 7fe4f37fe640 1 -- 172.21.15.121:0/1634715850 learned_addr learned my addr 172.21.15.121:0/1634715850 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-18T22:39:57.435 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:57.421+0000 7fe4f37fe640 1 -- 172.21.15.121:0/1634715850 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe4f40ff420 msgr2=0x7fe4f40fade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:39:57.435 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:57.421+0000 7fe4f37fe640 1 --2- 172.21.15.121:0/1634715850 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe4f40ff420 0x7fe4f40fade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:39:57.435 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:57.421+0000 7fe4f37fe640 1 -- 172.21.15.121:0/1634715850 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4dc005040 con 0x7fe4f40659e0 2024-08-18T22:39:57.435 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:57.421+0000 7fe4f37fe640 1 --2- 172.21.15.121:0/1634715850 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe4f40659e0 0x7fe4f40fc8f0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fe4e400c810 tx=0x7fe4e4004430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:39:57.435 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:57.421+0000 7fe4f0ff9640 1 -- 172.21.15.121:0/1634715850 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe4e400a850 con 0x7fe4f40659e0 2024-08-18T22:39:57.435 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:57.421+0000 7fe4f9afa640 1 -- 172.21.15.121:0/1634715850 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4f40fb790 con 0x7fe4f40659e0 2024-08-18T22:39:57.436 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:57.421+0000 7fe4f0ff9640 1 -- 172.21.15.121:0/1634715850 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fe4e400ae50 con 0x7fe4f40659e0 2024-08-18T22:39:57.436 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:57.421+0000 7fe4f0ff9640 1 -- 172.21.15.121:0/1634715850 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe4e40113a0 con 0x7fe4f40659e0 2024-08-18T22:39:57.436 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:57.421+0000 7fe4f9afa640 1 -- 172.21.15.121:0/1634715850 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4f4114e40 con 0x7fe4f40659e0 2024-08-18T22:39:57.436 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:57.422+0000 7fe4f9afa640 1 -- 172.21.15.121:0/1634715850 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4f40fa630 con 0x7fe4f40659e0 2024-08-18T22:39:57.436 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:57.423+0000 7fe4f0ff9640 1 -- 172.21.15.121:0/1634715850 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 19) v1 ==== 85127+0+0 (secure 0 0 0) 0x7fe4e4012400 con 0x7fe4f40659e0 2024-08-18T22:39:57.436 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:57.423+0000 7fe4f0ff9640 1 --2- 172.21.15.121:0/1634715850 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7fe4e0067190 0x7fe4e0069640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:39:57.436 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:57.423+0000 7fe4f0ff9640 1 -- 172.21.15.121:0/1634715850 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5550+0+0 (secure 0 0 0) 0x7fe4e4084d30 con 0x7fe4f40659e0 2024-08-18T22:39:57.436 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:57.423+0000 7fe4ebfff640 1 --2- 172.21.15.121:0/1634715850 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7fe4e0067190 0x7fe4e0069640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:39:57.436 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:57.424+0000 7fe4ebfff640 1 --2- 172.21.15.121:0/1634715850 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7fe4e0067190 0x7fe4e0069640 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fe4dc02a530 tx=0x7fe4dc009da0 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:39:57.436 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:57.427+0000 7fe4f0ff9640 1 -- 172.21.15.121:0/1634715850 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fe4e40520c0 con 0x7fe4f40659e0 2024-08-18T22:39:57.597 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:57.595+0000 7fe4f9afa640 1 -- 172.21.15.121:0/1634715850 --> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] -- mgr_command(tid 0: {"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833", "target": ["mon-mgr", ""]}) v1 -- 0x7fe4f40f84a0 con 0x7fe4e0067190 2024-08-18T22:39:57.602 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:57.600+0000 7fe4f0ff9640 1 -- 172.21.15.121:0/1634715850 <== mgr.14206 v2:172.21.15.121:6800/3225195982 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+89 (secure 0 0 0) 0x7fe4f40f84a0 con 0x7fe4e0067190 2024-08-18T22:39:57.602 INFO:teuthology.orchestra.run.smithi121.stdout:Initiating upgrade to quay.ceph.io/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 2024-08-18T22:39:57.605 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:57.602+0000 7fe4f9afa640 1 -- 172.21.15.121:0/1634715850 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7fe4e0067190 msgr2=0x7fe4e0069640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:39:57.605 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:57.602+0000 7fe4f9afa640 1 --2- 172.21.15.121:0/1634715850 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7fe4e0067190 0x7fe4e0069640 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fe4dc02a530 tx=0x7fe4dc009da0 comp rx=0 tx=0).stop 2024-08-18T22:39:57.605 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:57.602+0000 7fe4f9afa640 1 -- 172.21.15.121:0/1634715850 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe4f40659e0 msgr2=0x7fe4f40fc8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:39:57.605 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:57.602+0000 7fe4f9afa640 1 --2- 172.21.15.121:0/1634715850 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe4f40659e0 0x7fe4f40fc8f0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fe4e400c810 tx=0x7fe4e4004430 comp rx=0 tx=0).stop 2024-08-18T22:39:57.605 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:57.603+0000 7fe4f9afa640 1 -- 172.21.15.121:0/1634715850 shutdown_connections 2024-08-18T22:39:57.605 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:57.603+0000 7fe4f9afa640 1 --2- 172.21.15.121:0/1634715850 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7fe4e0067190 0x7fe4e0069640 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:39:57.605 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:57.603+0000 7fe4f9afa640 1 --2- 172.21.15.121:0/1634715850 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe4f40ff420 0x7fe4f40fade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:39:57.605 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:57.603+0000 7fe4f9afa640 1 --2- 172.21.15.121:0/1634715850 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe4f40659e0 0x7fe4f40fc8f0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:39:57.605 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:57.603+0000 7fe4f9afa640 1 -- 172.21.15.121:0/1634715850 >> 172.21.15.121:0/1634715850 conn(0x7fe4f40f69b0 msgr2=0x7fe4f40f6d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:39:57.605 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:57.603+0000 7fe4f9afa640 1 -- 172.21.15.121:0/1634715850 shutdown_connections 2024-08-18T22:39:57.605 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:39:57.603+0000 7fe4f9afa640 1 -- 172.21.15.121:0/1634715850 wait complete. 2024-08-18T22:39:57.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:39:57 smithi195 ceph-mon[23370]: pgmap v194: 65 pgs: 65 active+clean; 587 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 767 B/s wr, 0 op/s 2024-08-18T22:39:57.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:39:57 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:39:57.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:39:57 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-18T22:39:58.037 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:39:57 smithi121 ceph-mon[16788]: pgmap v194: 65 pgs: 65 active+clean; 587 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 767 B/s wr, 0 op/s 2024-08-18T22:39:58.037 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:39:57 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:39:58.037 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:39:57 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-18T22:39:58.263 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2024-08-18T22:39:58.263 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi121.front.sepia.ceph.com 2024-08-18T22:39:58.263 DEBUG:teuthology.orchestra.run.smithi121:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b003123a-5db1-11ef-bccf-c7b262605968 -e sha1=de09dd018de4baddfa6ca4d43bc8fb784cf75833 -- bash -c 'while ceph orch upgrade status | jq '"'"'.in_progress'"'"' | grep true && ! ceph orch upgrade status | jq '"'"'.message'"'"' | grep Error ; do ceph orch ps ; ceph versions ; ceph fs dump; ceph orch upgrade status ; ceph health detail ; sleep 30 ; done' 2024-08-18T22:39:58.557 INFO:teuthology.orchestra.run.smithi121.stderr:Inferring config /var/lib/ceph/b003123a-5db1-11ef-bccf-c7b262605968/mon.smithi121/config 2024-08-18T22:39:58.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:39:58 smithi195 ceph-mon[23370]: from='client.14540 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833", "target": ["mon-mgr", ""]}]: dispatch 2024-08-18T22:39:58.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:39:58 smithi195 ceph-mon[23370]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 2024-08-18T22:39:58.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:39:58 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:39:58.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:39:58 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-18T22:39:58.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:39:58 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:39:58.916 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:39:58 smithi121 ceph-mon[16788]: from='client.14540 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833", "target": ["mon-mgr", ""]}]: dispatch 2024-08-18T22:39:58.916 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:39:58 smithi121 ceph-mon[16788]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 2024-08-18T22:39:58.916 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:39:58 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:39:58.916 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:39:58 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-18T22:39:58.916 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:39:58 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:39:59.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:39:59 smithi195 ceph-mon[23370]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 2024-08-18T22:39:59.910 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:39:59 smithi195 ceph-mon[23370]: pgmap v195: 65 pgs: 65 active+clean; 587 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 853 B/s wr, 0 op/s 2024-08-18T22:40:00.007 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:39:59 smithi121 ceph-mon[16788]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 2024-08-18T22:40:00.007 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:39:59 smithi121 ceph-mon[16788]: pgmap v195: 65 pgs: 65 active+clean; 587 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 853 B/s wr, 0 op/s 2024-08-18T22:40:00.230 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:00.227+0000 7f988cca5640 1 -- 172.21.15.121:0/152667420 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f98880fb1d0 msgr2=0x7f98880fb5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:40:00.230 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:00.227+0000 7f988cca5640 1 --2- 172.21.15.121:0/152667420 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f98880fb1d0 0x7f98880fb5e0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f98780048d0 tx=0x7f9878009da0 comp rx=0 tx=0).stop 2024-08-18T22:40:00.230 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:00.227+0000 7f988cca5640 1 -- 172.21.15.121:0/152667420 shutdown_connections 2024-08-18T22:40:00.230 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:00.227+0000 7f988cca5640 1 --2- 172.21.15.121:0/152667420 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f98880fc4a0 0x7f98880fc910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:40:00.230 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:00.227+0000 7f988cca5640 1 --2- 172.21.15.121:0/152667420 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f98880fb1d0 0x7f98880fb5e0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:40:00.231 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:00.227+0000 7f988cca5640 1 -- 172.21.15.121:0/152667420 >> 172.21.15.121:0/152667420 conn(0x7f98880f69b0 msgr2=0x7f98880f8dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:40:00.231 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:00.227+0000 7f988cca5640 1 -- 172.21.15.121:0/152667420 shutdown_connections 2024-08-18T22:40:00.231 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:00.227+0000 7f988cca5640 1 -- 172.21.15.121:0/152667420 wait complete. 2024-08-18T22:40:00.231 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:00.227+0000 7f988cca5640 1 Processor -- start 2024-08-18T22:40:00.231 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:00.227+0000 7f988cca5640 1 -- start start 2024-08-18T22:40:00.231 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:00.228+0000 7f988cca5640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f98880fb1d0 0x7f9888111f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:40:00.231 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:00.228+0000 7f988cca5640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f98880fc4a0 0x7f9888114490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:40:00.231 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:00.228+0000 7f988cca5640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f988810d9f0 con 0x7f98880fb1d0 2024-08-18T22:40:00.231 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:00.228+0000 7f988cca5640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9888065970 con 0x7f98880fc4a0 2024-08-18T22:40:00.231 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:00.228+0000 7f988659c640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f98880fb1d0 0x7f9888111f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:40:00.232 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:00.228+0000 7f988659c640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f98880fb1d0 0x7f9888111f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:51210/0 (socket says 172.21.15.121:51210) 2024-08-18T22:40:00.232 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:00.228+0000 7f988659c640 1 -- 172.21.15.121:0/1298658076 learned_addr learned my addr 172.21.15.121:0/1298658076 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-18T22:40:00.233 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:00.228+0000 7f987ffff640 1 --2- 172.21.15.121:0/1298658076 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f98880fc4a0 0x7f9888114490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:40:00.234 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:00.228+0000 7f988659c640 1 -- 172.21.15.121:0/1298658076 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f98880fc4a0 msgr2=0x7f9888114490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:40:00.234 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:00.228+0000 7f988659c640 1 --2- 172.21.15.121:0/1298658076 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f98880fc4a0 0x7f9888114490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:40:00.234 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:00.228+0000 7f988659c640 1 -- 172.21.15.121:0/1298658076 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9878005040 con 0x7f98880fb1d0 2024-08-18T22:40:00.234 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:00.228+0000 7f988659c640 1 --2- 172.21.15.121:0/1298658076 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f98880fb1d0 0x7f9888111f40 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f98780043d0 tx=0x7f9878009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:40:00.234 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:00.228+0000 7f987effd640 1 -- 172.21.15.121:0/1298658076 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9878038070 con 0x7f98880fb1d0 2024-08-18T22:40:00.234 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:00.228+0000 7f987effd640 1 -- 172.21.15.121:0/1298658076 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f987802ae90 con 0x7f98880fb1d0 2024-08-18T22:40:00.234 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:00.228+0000 7f988cca5640 1 -- 172.21.15.121:0/1298658076 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9888065bf0 con 0x7f98880fb1d0 2024-08-18T22:40:00.235 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:00.229+0000 7f987effd640 1 -- 172.21.15.121:0/1298658076 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f987803e670 con 0x7f98880fb1d0 2024-08-18T22:40:00.235 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:00.229+0000 7f988cca5640 1 -- 172.21.15.121:0/1298658076 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9888114d30 con 0x7f98880fb1d0 2024-08-18T22:40:00.235 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:00.230+0000 7f988cca5640 1 -- 172.21.15.121:0/1298658076 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98880fa630 con 0x7f98880fb1d0 2024-08-18T22:40:00.235 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:00.230+0000 7f987effd640 1 -- 172.21.15.121:0/1298658076 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 19) v1 ==== 85127+0+0 (secure 0 0 0) 0x7f9878030020 con 0x7f98880fb1d0 2024-08-18T22:40:00.235 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:00.231+0000 7f987effd640 1 --2- 172.21.15.121:0/1298658076 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7f9874067190 0x7f9874069640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:40:00.235 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:00.231+0000 7f987effd640 1 -- 172.21.15.121:0/1298658076 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f98780a4de0 con 0x7f98880fb1d0 2024-08-18T22:40:00.235 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:00.231+0000 7f987ffff640 1 --2- 172.21.15.121:0/1298658076 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7f9874067190 0x7f9874069640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:40:00.235 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:00.232+0000 7f987ffff640 1 --2- 172.21.15.121:0/1298658076 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7f9874067190 0x7f9874069640 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f9870004eb0 tx=0x7f987000b040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:40:00.237 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:00.236+0000 7f987effd640 1 -- 172.21.15.121:0/1298658076 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f9878072040 con 0x7f98880fb1d0 2024-08-18T22:40:00.468 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:00.466+0000 7f988cca5640 1 -- 172.21.15.121:0/1298658076 --> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f9888100900 con 0x7f9874067190 2024-08-18T22:40:00.468 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:00.467+0000 7f987effd640 1 -- 172.21.15.121:0/1298658076 <== mgr.14206 v2:172.21.15.121:6800/3225195982 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+358 (secure 0 0 0) 0x7f9888100900 con 0x7f9874067190 2024-08-18T22:40:00.471 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:00.469+0000 7f988cca5640 1 -- 172.21.15.121:0/1298658076 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7f9874067190 msgr2=0x7f9874069640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:40:00.471 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:00.469+0000 7f988cca5640 1 --2- 172.21.15.121:0/1298658076 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7f9874067190 0x7f9874069640 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f9870004eb0 tx=0x7f987000b040 comp rx=0 tx=0).stop 2024-08-18T22:40:00.472 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:00.469+0000 7f988cca5640 1 -- 172.21.15.121:0/1298658076 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f98880fb1d0 msgr2=0x7f9888111f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:40:00.472 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:00.469+0000 7f988cca5640 1 --2- 172.21.15.121:0/1298658076 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f98880fb1d0 0x7f9888111f40 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f98780043d0 tx=0x7f9878009da0 comp rx=0 tx=0).stop 2024-08-18T22:40:00.472 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:00.470+0000 7f988cca5640 1 -- 172.21.15.121:0/1298658076 shutdown_connections 2024-08-18T22:40:00.472 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:00.470+0000 7f988cca5640 1 --2- 172.21.15.121:0/1298658076 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7f9874067190 0x7f9874069640 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:40:00.472 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:00.470+0000 7f988cca5640 1 --2- 172.21.15.121:0/1298658076 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f98880fc4a0 0x7f9888114490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:40:00.472 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:00.470+0000 7f988cca5640 1 --2- 172.21.15.121:0/1298658076 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f98880fb1d0 0x7f9888111f40 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:40:00.472 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:00.470+0000 7f988cca5640 1 -- 172.21.15.121:0/1298658076 >> 172.21.15.121:0/1298658076 conn(0x7f98880f69b0 msgr2=0x7f98880f8180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:40:00.472 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:00.470+0000 7f988cca5640 1 -- 172.21.15.121:0/1298658076 shutdown_connections 2024-08-18T22:40:00.473 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:00.470+0000 7f988cca5640 1 -- 172.21.15.121:0/1298658076 wait complete. 2024-08-18T22:40:00.481 INFO:teuthology.orchestra.run.smithi121.stdout:true 2024-08-18T22:40:00.567 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:00.565+0000 7f2d7f0d1640 1 -- 172.21.15.121:0/2980846141 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2d780fe260 msgr2=0x7f2d780fa3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:40:00.568 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:00.565+0000 7f2d7f0d1640 1 --2- 172.21.15.121:0/2980846141 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2d780fe260 0x7f2d780fa3c0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f2d640048d0 tx=0x7f2d64009da0 comp rx=0 tx=0).stop 2024-08-18T22:40:00.568 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:00.565+0000 7f2d7f0d1640 1 -- 172.21.15.121:0/2980846141 shutdown_connections 2024-08-18T22:40:00.568 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:00.565+0000 7f2d7f0d1640 1 --2- 172.21.15.121:0/2980846141 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2d780fe260 0x7f2d780fa3c0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:40:00.568 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:00.565+0000 7f2d7f0d1640 1 --2- 172.21.15.121:0/2980846141 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2d780fd910 0x7f2d780fdd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:40:00.568 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:00.565+0000 7f2d7f0d1640 1 -- 172.21.15.121:0/2980846141 >> 172.21.15.121:0/2980846141 conn(0x7f2d780f6130 msgr2=0x7f2d780f8540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:40:00.568 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:00.565+0000 7f2d7f0d1640 1 -- 172.21.15.121:0/2980846141 shutdown_connections 2024-08-18T22:40:00.568 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:00.565+0000 7f2d7f0d1640 1 -- 172.21.15.121:0/2980846141 wait complete. 2024-08-18T22:40:00.569 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:00.566+0000 7f2d7f0d1640 1 Processor -- start 2024-08-18T22:40:00.570 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:00.566+0000 7f2d7f0d1640 1 -- start start 2024-08-18T22:40:00.570 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:00.566+0000 7f2d7f0d1640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2d780fd910 0x7f2d7810cee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:40:00.570 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:00.566+0000 7f2d7f0d1640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2d780fe260 0x7f2d7810d420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:40:00.570 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:00.566+0000 7f2d7f0d1640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d7810e150 con 0x7f2d780fe260 2024-08-18T22:40:00.570 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:00.566+0000 7f2d7f0d1640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d7810e2c0 con 0x7f2d780fd910 2024-08-18T22:40:00.570 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:00.567+0000 7f2d77fff640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2d780fe260 0x7f2d7810d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:40:00.570 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:00.567+0000 7f2d7ce6d640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2d780fd910 0x7f2d7810cee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:40:00.570 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:00.567+0000 7f2d77fff640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2d780fe260 0x7f2d7810d420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:51216/0 (socket says 172.21.15.121:51216) 2024-08-18T22:40:00.570 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:00.567+0000 7f2d77fff640 1 -- 172.21.15.121:0/1110915805 learned_addr learned my addr 172.21.15.121:0/1110915805 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-18T22:40:00.570 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:00.567+0000 7f2d77fff640 1 -- 172.21.15.121:0/1110915805 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2d780fd910 msgr2=0x7f2d7810cee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:40:00.571 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:00.567+0000 7f2d77fff640 1 --2- 172.21.15.121:0/1110915805 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2d780fd910 0x7f2d7810cee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:40:00.571 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:00.567+0000 7f2d77fff640 1 -- 172.21.15.121:0/1110915805 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d64005040 con 0x7f2d780fe260 2024-08-18T22:40:00.571 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:00.567+0000 7f2d77fff640 1 --2- 172.21.15.121:0/1110915805 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2d780fe260 0x7f2d7810d420 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f2d6402d040 tx=0x7f2d64009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:40:00.571 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:00.567+0000 7f2d757fa640 1 -- 172.21.15.121:0/1110915805 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2d64038070 con 0x7f2d780fe260 2024-08-18T22:40:00.571 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:00.568+0000 7f2d757fa640 1 -- 172.21.15.121:0/1110915805 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f2d6402ae90 con 0x7f2d780fe260 2024-08-18T22:40:00.571 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:00.568+0000 7f2d757fa640 1 -- 172.21.15.121:0/1110915805 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2d6403e670 con 0x7f2d780fe260 2024-08-18T22:40:00.571 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:00.568+0000 7f2d7f0d1640 1 -- 172.21.15.121:0/1110915805 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d7810e540 con 0x7f2d780fe260 2024-08-18T22:40:00.572 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:00.568+0000 7f2d7f0d1640 1 -- 172.21.15.121:0/1110915805 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d7810ea20 con 0x7f2d780fe260 2024-08-18T22:40:00.572 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:00.569+0000 7f2d7f0d1640 1 -- 172.21.15.121:0/1110915805 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d780f9db0 con 0x7f2d780fe260 2024-08-18T22:40:00.572 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:00.569+0000 7f2d757fa640 1 -- 172.21.15.121:0/1110915805 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 19) v1 ==== 85127+0+0 (secure 0 0 0) 0x7f2d64030020 con 0x7f2d780fe260 2024-08-18T22:40:00.572 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:00.570+0000 7f2d757fa640 1 --2- 172.21.15.121:0/1110915805 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7f2d68067190 0x7f2d68069640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:40:00.572 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:00.570+0000 7f2d757fa640 1 -- 172.21.15.121:0/1110915805 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f2d640a4aa0 con 0x7f2d780fe260 2024-08-18T22:40:00.572 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:00.570+0000 7f2d7ce6d640 1 --2- 172.21.15.121:0/1110915805 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7f2d68067190 0x7f2d68069640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:40:00.573 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:00.571+0000 7f2d7ce6d640 1 --2- 172.21.15.121:0/1110915805 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7f2d68067190 0x7f2d68069640 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f2d6c009af0 tx=0x7f2d6c00b040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:40:00.576 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:00.575+0000 7f2d757fa640 1 -- 172.21.15.121:0/1110915805 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f2d64071e20 con 0x7f2d780fe260 2024-08-18T22:40:00.796 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:00.794+0000 7f2d7f0d1640 1 -- 172.21.15.121:0/1110915805 --> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f2d7810ed50 con 0x7f2d68067190 2024-08-18T22:40:00.797 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:40:00 smithi121 ceph-mon[16788]: overall HEALTH_OK 2024-08-18T22:40:00.797 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:00.795+0000 7f2d757fa640 1 -- 172.21.15.121:0/1110915805 <== mgr.14206 v2:172.21.15.121:6800/3225195982 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+358 (secure 0 0 0) 0x7f2d7810ed50 con 0x7f2d68067190 2024-08-18T22:40:00.800 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:00.798+0000 7f2d7f0d1640 1 -- 172.21.15.121:0/1110915805 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7f2d68067190 msgr2=0x7f2d68069640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:40:00.800 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:00.798+0000 7f2d7f0d1640 1 --2- 172.21.15.121:0/1110915805 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7f2d68067190 0x7f2d68069640 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f2d6c009af0 tx=0x7f2d6c00b040 comp rx=0 tx=0).stop 2024-08-18T22:40:00.800 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:00.798+0000 7f2d7f0d1640 1 -- 172.21.15.121:0/1110915805 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2d780fe260 msgr2=0x7f2d7810d420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:40:00.801 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:00.798+0000 7f2d7f0d1640 1 --2- 172.21.15.121:0/1110915805 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2d780fe260 0x7f2d7810d420 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f2d6402d040 tx=0x7f2d64009da0 comp rx=0 tx=0).stop 2024-08-18T22:40:00.801 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:00.798+0000 7f2d7f0d1640 1 -- 172.21.15.121:0/1110915805 shutdown_connections 2024-08-18T22:40:00.801 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:00.798+0000 7f2d7f0d1640 1 --2- 172.21.15.121:0/1110915805 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7f2d68067190 0x7f2d68069640 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:40:00.801 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:00.798+0000 7f2d7f0d1640 1 --2- 172.21.15.121:0/1110915805 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2d780fe260 0x7f2d7810d420 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:40:00.801 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:00.798+0000 7f2d7f0d1640 1 --2- 172.21.15.121:0/1110915805 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2d780fd910 0x7f2d7810cee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:40:00.801 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:00.798+0000 7f2d7f0d1640 1 -- 172.21.15.121:0/1110915805 >> 172.21.15.121:0/1110915805 conn(0x7f2d780f6130 msgr2=0x7f2d780f78f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:40:00.801 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:00.798+0000 7f2d7f0d1640 1 -- 172.21.15.121:0/1110915805 shutdown_connections 2024-08-18T22:40:00.801 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:00.798+0000 7f2d7f0d1640 1 -- 172.21.15.121:0/1110915805 wait complete. 2024-08-18T22:40:00.888 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:00.886+0000 7f9ea8ad7640 1 -- 172.21.15.121:0/1901592120 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9ea40fb1d0 msgr2=0x7f9ea40fb5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:40:00.889 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:00.886+0000 7f9ea8ad7640 1 --2- 172.21.15.121:0/1901592120 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9ea40fb1d0 0x7f9ea40fb5e0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f9e940048d0 tx=0x7f9e94009da0 comp rx=0 tx=0).stop 2024-08-18T22:40:00.889 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:00.886+0000 7f9ea8ad7640 1 -- 172.21.15.121:0/1901592120 shutdown_connections 2024-08-18T22:40:00.889 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:00.886+0000 7f9ea8ad7640 1 --2- 172.21.15.121:0/1901592120 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9ea40fc4a0 0x7f9ea40fc910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:40:00.889 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:00.886+0000 7f9ea8ad7640 1 --2- 172.21.15.121:0/1901592120 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9ea40fb1d0 0x7f9ea40fb5e0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:40:00.889 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:00.886+0000 7f9ea8ad7640 1 -- 172.21.15.121:0/1901592120 >> 172.21.15.121:0/1901592120 conn(0x7f9ea40f69b0 msgr2=0x7f9ea40f8dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:40:00.889 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:00.886+0000 7f9ea8ad7640 1 -- 172.21.15.121:0/1901592120 shutdown_connections 2024-08-18T22:40:00.889 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:00.886+0000 7f9ea8ad7640 1 -- 172.21.15.121:0/1901592120 wait complete. 2024-08-18T22:40:00.889 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:00.887+0000 7f9ea8ad7640 1 Processor -- start 2024-08-18T22:40:00.889 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:00.887+0000 7f9ea8ad7640 1 -- start start 2024-08-18T22:40:00.890 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:00.887+0000 7f9ea8ad7640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9ea40fb1d0 0x7f9ea410fb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:40:00.890 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:00.887+0000 7f9ea8ad7640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9ea40fc4a0 0x7f9ea41120b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:40:00.891 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:00.887+0000 7f9ea8ad7640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ea4065a00 con 0x7f9ea40fc4a0 2024-08-18T22:40:00.891 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:00.887+0000 7f9ea8ad7640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ea4065b70 con 0x7f9ea40fb1d0 2024-08-18T22:40:00.891 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:00.887+0000 7f9ea259c640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9ea40fb1d0 0x7f9ea410fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:40:00.891 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:00.887+0000 7f9ea259c640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9ea40fb1d0 0x7f9ea410fb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.121:40210/0 (socket says 172.21.15.121:40210) 2024-08-18T22:40:00.891 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:00.887+0000 7f9ea259c640 1 -- 172.21.15.121:0/278051484 learned_addr learned my addr 172.21.15.121:0/278051484 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-18T22:40:00.891 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:00.887+0000 7f9e9bfff640 1 --2- 172.21.15.121:0/278051484 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9ea40fc4a0 0x7f9ea41120b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:40:00.891 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:00.888+0000 7f9ea259c640 1 -- 172.21.15.121:0/278051484 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9ea40fc4a0 msgr2=0x7f9ea41120b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:40:00.891 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:00.888+0000 7f9ea259c640 1 --2- 172.21.15.121:0/278051484 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9ea40fc4a0 0x7f9ea41120b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:40:00.891 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:00.888+0000 7f9ea259c640 1 -- 172.21.15.121:0/278051484 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e94005040 con 0x7f9ea40fb1d0 2024-08-18T22:40:00.891 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:00.888+0000 7f9e9bfff640 1 --2- 172.21.15.121:0/278051484 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9ea40fc4a0 0x7f9ea41120b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:40:00.891 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:00.888+0000 7f9ea259c640 1 --2- 172.21.15.121:0/278051484 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9ea40fb1d0 0x7f9ea410fb60 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f9e940043d0 tx=0x7f9e94009da0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:40:00.892 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:00.888+0000 7f9e9affd640 1 -- 172.21.15.121:0/278051484 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9e94038070 con 0x7f9ea40fb1d0 2024-08-18T22:40:00.892 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:00.888+0000 7f9e9affd640 1 -- 172.21.15.121:0/278051484 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f9e9402ae90 con 0x7f9ea40fb1d0 2024-08-18T22:40:00.892 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:00.888+0000 7f9e9affd640 1 -- 172.21.15.121:0/278051484 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9e9403e670 con 0x7f9ea40fb1d0 2024-08-18T22:40:00.892 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:00.888+0000 7f9ea8ad7640 1 -- 172.21.15.121:0/278051484 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ea41125f0 con 0x7f9ea40fb1d0 2024-08-18T22:40:00.892 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:00.888+0000 7f9ea8ad7640 1 -- 172.21.15.121:0/278051484 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ea4112b60 con 0x7f9ea40fb1d0 2024-08-18T22:40:00.893 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:00.889+0000 7f9ea8ad7640 1 -- 172.21.15.121:0/278051484 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ea40fa630 con 0x7f9ea40fb1d0 2024-08-18T22:40:00.893 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:00.890+0000 7f9e9affd640 1 -- 172.21.15.121:0/278051484 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 19) v1 ==== 85127+0+0 (secure 0 0 0) 0x7f9e94030020 con 0x7f9ea40fb1d0 2024-08-18T22:40:00.893 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:00.890+0000 7f9e9affd640 1 --2- 172.21.15.121:0/278051484 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7f9e90067190 0x7f9e90069640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:40:00.893 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:00.891+0000 7f9e9bfff640 1 --2- 172.21.15.121:0/278051484 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7f9e90067190 0x7f9e90069640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:40:00.893 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:00.891+0000 7f9e9affd640 1 -- 172.21.15.121:0/278051484 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f9e940a4d10 con 0x7f9ea40fb1d0 2024-08-18T22:40:00.893 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:00.891+0000 7f9e9bfff640 1 --2- 172.21.15.121:0/278051484 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7f9e90067190 0x7f9e90069640 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f9e8c004fd0 tx=0x7f9e8c00b040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:40:00.897 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:00.895+0000 7f9e9affd640 1 -- 172.21.15.121:0/278051484 <== mon.1 v2:172.21.15.195:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f9e94071ff0 con 0x7f9ea40fb1d0 2024-08-18T22:40:00.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:40:00 smithi195 ceph-mon[23370]: overall HEALTH_OK 2024-08-18T22:40:01.111 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:01.109+0000 7f9ea8ad7640 1 -- 172.21.15.121:0/278051484 --> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f9ea4100900 con 0x7f9e90067190 2024-08-18T22:40:01.127 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:01.125+0000 7f9e9affd640 1 -- 172.21.15.121:0/278051484 <== mgr.14206 v2:172.21.15.121:6800/3225195982 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f9ea4100900 con 0x7f9e90067190 2024-08-18T22:40:01.127 INFO:teuthology.orchestra.run.smithi121.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-08-18T22:40:01.127 INFO:teuthology.orchestra.run.smithi121.stdout:alertmanager.smithi121 smithi121 *:9093,9094 running (4m) 27s ago 5m 24.7M - 0.25.0 c8568f914cd2 0e56a9950e47 2024-08-18T22:40:01.127 INFO:teuthology.orchestra.run.smithi121.stdout:crash.smithi121 smithi121 running (6m) 27s ago 6m 6899k - 17.2.7-1406-gdf62bdcc 774894bef55f cf3deea293c3 2024-08-18T22:40:01.127 INFO:teuthology.orchestra.run.smithi121.stdout:crash.smithi195 smithi195 running (5m) 33s ago 5m 6899k - 17.2.7-1406-gdf62bdcc 774894bef55f 98aa377daf77 2024-08-18T22:40:01.127 INFO:teuthology.orchestra.run.smithi121.stdout:grafana.smithi121 smithi121 *:3000 running (4m) 27s ago 5m 87.2M - 9.4.7 954c08fa6188 07c3d993780f 2024-08-18T22:40:01.127 INFO:teuthology.orchestra.run.smithi121.stdout:mds.cephfs.smithi121.gbickb smithi121 running (46s) 27s ago 45s 16.2M - 17.2.7-1406-gdf62bdcc 774894bef55f 484da0bc2c95 2024-08-18T22:40:01.127 INFO:teuthology.orchestra.run.smithi121.stdout:mds.cephfs.smithi121.xuzsdg smithi121 running (53s) 27s ago 52s 10.7M - 17.2.7-1406-gdf62bdcc 774894bef55f 6976b708cdcd 2024-08-18T22:40:01.128 INFO:teuthology.orchestra.run.smithi121.stdout:mds.cephfs.smithi195.buqvbr smithi195 running (50s) 33s ago 49s 15.5M - 17.2.7-1406-gdf62bdcc 774894bef55f 11a3703b4276 2024-08-18T22:40:01.128 INFO:teuthology.orchestra.run.smithi121.stdout:mds.cephfs.smithi195.nptgyc smithi195 running (43s) 33s ago 43s 15.0M - 17.2.7-1406-gdf62bdcc 774894bef55f b9f8043ea83e 2024-08-18T22:40:01.128 INFO:teuthology.orchestra.run.smithi121.stdout:mgr.smithi121.lopxqc smithi121 *:9283,8765,8443 running (7m) 27s ago 7m 447M - 17.2.7-1406-gdf62bdcc 774894bef55f 3ac16dcb26e3 2024-08-18T22:40:01.128 INFO:teuthology.orchestra.run.smithi121.stdout:mgr.smithi195.acttsj smithi195 *:8443,9283 running (5m) 33s ago 5m 402M - 17.2.7-1406-gdf62bdcc 774894bef55f 3d19eb0493d5 2024-08-18T22:40:01.128 INFO:teuthology.orchestra.run.smithi121.stdout:mon.smithi121 smithi121 running (7m) 27s ago 7m 51.2M 2048M 17.2.7-1406-gdf62bdcc 774894bef55f 4a7bead235ac 2024-08-18T22:40:01.128 INFO:teuthology.orchestra.run.smithi121.stdout:mon.smithi195 smithi195 running (4m) 33s ago 4m 42.0M 2048M 17.2.7-1406-gdf62bdcc 774894bef55f ced63ecfbfae 2024-08-18T22:40:01.128 INFO:teuthology.orchestra.run.smithi121.stdout:node-exporter.smithi121 smithi121 *:9100 running (6m) 27s ago 6m 16.9M - 1.5.0 0da6a335fe13 81d394827425 2024-08-18T22:40:01.128 INFO:teuthology.orchestra.run.smithi121.stdout:node-exporter.smithi195 smithi195 *:9100 running (5m) 33s ago 5m 16.2M - 1.5.0 0da6a335fe13 e09a01163b83 2024-08-18T22:40:01.128 INFO:teuthology.orchestra.run.smithi121.stdout:osd.0 smithi121 running (4m) 27s ago 4m 47.2M 4287M 17.2.7-1406-gdf62bdcc 774894bef55f 30859216633d 2024-08-18T22:40:01.128 INFO:teuthology.orchestra.run.smithi121.stdout:osd.1 smithi121 running (3m) 27s ago 3m 49.1M 4287M 17.2.7-1406-gdf62bdcc 774894bef55f ef5fadfd753f 2024-08-18T22:40:01.128 INFO:teuthology.orchestra.run.smithi121.stdout:osd.2 smithi121 running (3m) 27s ago 3m 43.6M 4287M 17.2.7-1406-gdf62bdcc 774894bef55f 3fa061e41f99 2024-08-18T22:40:01.128 INFO:teuthology.orchestra.run.smithi121.stdout:osd.3 smithi195 running (3m) 33s ago 3m 46.2M 5312M 17.2.7-1406-gdf62bdcc 774894bef55f 15d30b1b459e 2024-08-18T22:40:01.128 INFO:teuthology.orchestra.run.smithi121.stdout:osd.4 smithi195 running (2m) 33s ago 2m 42.2M 5312M 17.2.7-1406-gdf62bdcc 774894bef55f 99ed156dfd36 2024-08-18T22:40:01.129 INFO:teuthology.orchestra.run.smithi121.stdout:osd.5 smithi195 running (2m) 33s ago 2m 44.1M 5312M 17.2.7-1406-gdf62bdcc 774894bef55f e7eff7bdb752 2024-08-18T22:40:01.129 INFO:teuthology.orchestra.run.smithi121.stdout:prometheus.smithi121 smithi121 *:9095 running (4m) 27s ago 5m 56.2M - 2.43.0 a07b618ecd1d d6016f1b45a3 2024-08-18T22:40:01.129 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:01.127+0000 7f9ea8ad7640 1 -- 172.21.15.121:0/278051484 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7f9e90067190 msgr2=0x7f9e90069640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:40:01.129 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:01.127+0000 7f9ea8ad7640 1 --2- 172.21.15.121:0/278051484 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7f9e90067190 0x7f9e90069640 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f9e8c004fd0 tx=0x7f9e8c00b040 comp rx=0 tx=0).stop 2024-08-18T22:40:01.130 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:01.127+0000 7f9ea8ad7640 1 -- 172.21.15.121:0/278051484 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9ea40fb1d0 msgr2=0x7f9ea410fb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:40:01.130 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:01.127+0000 7f9ea8ad7640 1 --2- 172.21.15.121:0/278051484 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9ea40fb1d0 0x7f9ea410fb60 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f9e940043d0 tx=0x7f9e94009da0 comp rx=0 tx=0).stop 2024-08-18T22:40:01.130 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:01.127+0000 7f9ea8ad7640 1 -- 172.21.15.121:0/278051484 shutdown_connections 2024-08-18T22:40:01.130 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:01.127+0000 7f9ea8ad7640 1 --2- 172.21.15.121:0/278051484 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7f9e90067190 0x7f9e90069640 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:40:01.130 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:01.127+0000 7f9ea8ad7640 1 --2- 172.21.15.121:0/278051484 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9ea40fc4a0 0x7f9ea41120b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:40:01.130 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:01.127+0000 7f9ea8ad7640 1 --2- 172.21.15.121:0/278051484 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9ea40fb1d0 0x7f9ea410fb60 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:40:01.130 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:01.127+0000 7f9ea8ad7640 1 -- 172.21.15.121:0/278051484 >> 172.21.15.121:0/278051484 conn(0x7f9ea40f69b0 msgr2=0x7f9ea40f8180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:40:01.130 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:01.127+0000 7f9ea8ad7640 1 -- 172.21.15.121:0/278051484 shutdown_connections 2024-08-18T22:40:01.130 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:01.127+0000 7f9ea8ad7640 1 -- 172.21.15.121:0/278051484 wait complete. 2024-08-18T22:40:01.217 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:01.214+0000 7ff6b49c9640 1 -- 172.21.15.121:0/393296907 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff6b00fb1f0 msgr2=0x7ff6b00fb600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:40:01.217 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:01.214+0000 7ff6b49c9640 1 --2- 172.21.15.121:0/393296907 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff6b00fb1f0 0x7ff6b00fb600 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7ff6a00048d0 tx=0x7ff6a0009da0 comp rx=0 tx=0).stop 2024-08-18T22:40:01.217 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:01.215+0000 7ff6b49c9640 1 -- 172.21.15.121:0/393296907 shutdown_connections 2024-08-18T22:40:01.217 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:01.215+0000 7ff6b49c9640 1 --2- 172.21.15.121:0/393296907 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff6b00fc4c0 0x7ff6b00fc930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:40:01.217 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:01.215+0000 7ff6b49c9640 1 --2- 172.21.15.121:0/393296907 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff6b00fb1f0 0x7ff6b00fb600 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:40:01.217 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:01.215+0000 7ff6b49c9640 1 -- 172.21.15.121:0/393296907 >> 172.21.15.121:0/393296907 conn(0x7ff6b00f69b0 msgr2=0x7ff6b00f8de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:40:01.217 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:01.215+0000 7ff6b49c9640 1 -- 172.21.15.121:0/393296907 shutdown_connections 2024-08-18T22:40:01.217 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:01.215+0000 7ff6b49c9640 1 -- 172.21.15.121:0/393296907 wait complete. 2024-08-18T22:40:01.219 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:01.215+0000 7ff6b49c9640 1 Processor -- start 2024-08-18T22:40:01.219 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:01.215+0000 7ff6b49c9640 1 -- start start 2024-08-18T22:40:01.219 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:01.216+0000 7ff6b49c9640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff6b00fb1f0 0x7ff6b010fbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:40:01.219 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:01.216+0000 7ff6b49c9640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff6b00fc4c0 0x7ff6b0112100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:40:01.219 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:01.216+0000 7ff6b49c9640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6b00664f0 con 0x7ff6b00fb1f0 2024-08-18T22:40:01.219 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:01.216+0000 7ff6b49c9640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6b0066660 con 0x7ff6b00fc4c0 2024-08-18T22:40:01.220 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:01.216+0000 7ff6ae59c640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff6b00fb1f0 0x7ff6b010fbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:40:01.220 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:01.216+0000 7ff6ae59c640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff6b00fb1f0 0x7ff6b010fbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:51256/0 (socket says 172.21.15.121:51256) 2024-08-18T22:40:01.220 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:01.216+0000 7ff6ae59c640 1 -- 172.21.15.121:0/1858065252 learned_addr learned my addr 172.21.15.121:0/1858065252 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-18T22:40:01.220 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:01.216+0000 7ff6add9b640 1 --2- 172.21.15.121:0/1858065252 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff6b00fc4c0 0x7ff6b0112100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:40:01.220 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:01.216+0000 7ff6ae59c640 1 -- 172.21.15.121:0/1858065252 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff6b00fc4c0 msgr2=0x7ff6b0112100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:40:01.220 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:01.216+0000 7ff6ae59c640 1 --2- 172.21.15.121:0/1858065252 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff6b00fc4c0 0x7ff6b0112100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:40:01.220 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:01.216+0000 7ff6ae59c640 1 -- 172.21.15.121:0/1858065252 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6a0005040 con 0x7ff6b00fb1f0 2024-08-18T22:40:01.220 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:01.216+0000 7ff6ae59c640 1 --2- 172.21.15.121:0/1858065252 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff6b00fb1f0 0x7ff6b010fbb0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7ff6a00048a0 tx=0x7ff6a0009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:40:01.220 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:01.217+0000 7ff69effd640 1 -- 172.21.15.121:0/1858065252 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff6a0038070 con 0x7ff6b00fb1f0 2024-08-18T22:40:01.220 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:01.217+0000 7ff6b49c9640 1 -- 172.21.15.121:0/1858065252 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6b0112640 con 0x7ff6b00fb1f0 2024-08-18T22:40:01.220 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:01.217+0000 7ff69effd640 1 -- 172.21.15.121:0/1858065252 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7ff6a0004290 con 0x7ff6b00fb1f0 2024-08-18T22:40:01.220 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:01.217+0000 7ff6b49c9640 1 -- 172.21.15.121:0/1858065252 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6b0112bb0 con 0x7ff6b00fb1f0 2024-08-18T22:40:01.220 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:01.217+0000 7ff69effd640 1 -- 172.21.15.121:0/1858065252 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff6a0033660 con 0x7ff6b00fb1f0 2024-08-18T22:40:01.221 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:01.218+0000 7ff6b49c9640 1 -- 172.21.15.121:0/1858065252 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6b00fa650 con 0x7ff6b00fb1f0 2024-08-18T22:40:01.221 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:01.219+0000 7ff69effd640 1 -- 172.21.15.121:0/1858065252 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 19) v1 ==== 85127+0+0 (secure 0 0 0) 0x7ff6a0030020 con 0x7ff6b00fb1f0 2024-08-18T22:40:01.221 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:01.219+0000 7ff69effd640 1 --2- 172.21.15.121:0/1858065252 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7ff698067190 0x7ff698069640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:40:01.221 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:01.219+0000 7ff69effd640 1 -- 172.21.15.121:0/1858065252 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5550+0+0 (secure 0 0 0) 0x7ff6a00a4cf0 con 0x7ff6b00fb1f0 2024-08-18T22:40:01.221 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:01.219+0000 7ff6add9b640 1 --2- 172.21.15.121:0/1858065252 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7ff698067190 0x7ff698069640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:40:01.222 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:01.220+0000 7ff6add9b640 1 --2- 172.21.15.121:0/1858065252 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7ff698067190 0x7ff698069640 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7ff6a4009af0 tx=0x7ff6a400b040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:40:01.225 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:01.224+0000 7ff69effd640 1 -- 172.21.15.121:0/1858065252 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7ff6a0072070 con 0x7ff6b00fb1f0 2024-08-18T22:40:01.511 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:01.508+0000 7ff6b49c9640 1 -- 172.21.15.121:0/1858065252 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7ff6b0112ec0 con 0x7ff6b00fb1f0 2024-08-18T22:40:01.511 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:01.509+0000 7ff69effd640 1 -- 172.21.15.121:0/1858065252 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+643 (secure 0 0 0) 0x7ff6a002c870 con 0x7ff6b00fb1f0 2024-08-18T22:40:01.511 INFO:teuthology.orchestra.run.smithi121.stdout:{ 2024-08-18T22:40:01.511 INFO:teuthology.orchestra.run.smithi121.stdout: "mon": { 2024-08-18T22:40:01.511 INFO:teuthology.orchestra.run.smithi121.stdout: "ceph version 17.2.7-1406-gdf62bdcc (df62bdccd9a13bf566b27a250eddfdd89be3072d) quincy (stable)": 2 2024-08-18T22:40:01.511 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-18T22:40:01.511 INFO:teuthology.orchestra.run.smithi121.stdout: "mgr": { 2024-08-18T22:40:01.511 INFO:teuthology.orchestra.run.smithi121.stdout: "ceph version 17.2.7-1406-gdf62bdcc (df62bdccd9a13bf566b27a250eddfdd89be3072d) quincy (stable)": 2 2024-08-18T22:40:01.512 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-18T22:40:01.512 INFO:teuthology.orchestra.run.smithi121.stdout: "osd": { 2024-08-18T22:40:01.512 INFO:teuthology.orchestra.run.smithi121.stdout: "ceph version 17.2.7-1406-gdf62bdcc (df62bdccd9a13bf566b27a250eddfdd89be3072d) quincy (stable)": 6 2024-08-18T22:40:01.512 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-18T22:40:01.512 INFO:teuthology.orchestra.run.smithi121.stdout: "mds": { 2024-08-18T22:40:01.512 INFO:teuthology.orchestra.run.smithi121.stdout: "ceph version 17.2.7-1406-gdf62bdcc (df62bdccd9a13bf566b27a250eddfdd89be3072d) quincy (stable)": 4 2024-08-18T22:40:01.512 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-18T22:40:01.512 INFO:teuthology.orchestra.run.smithi121.stdout: "overall": { 2024-08-18T22:40:01.512 INFO:teuthology.orchestra.run.smithi121.stdout: "ceph version 17.2.7-1406-gdf62bdcc (df62bdccd9a13bf566b27a250eddfdd89be3072d) quincy (stable)": 14 2024-08-18T22:40:01.512 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-08-18T22:40:01.512 INFO:teuthology.orchestra.run.smithi121.stdout:} 2024-08-18T22:40:01.513 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:01.511+0000 7ff6b49c9640 1 -- 172.21.15.121:0/1858065252 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7ff698067190 msgr2=0x7ff698069640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:40:01.513 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:01.511+0000 7ff6b49c9640 1 --2- 172.21.15.121:0/1858065252 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7ff698067190 0x7ff698069640 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7ff6a4009af0 tx=0x7ff6a400b040 comp rx=0 tx=0).stop 2024-08-18T22:40:01.514 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:01.511+0000 7ff6b49c9640 1 -- 172.21.15.121:0/1858065252 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff6b00fb1f0 msgr2=0x7ff6b010fbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:40:01.514 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:01.511+0000 7ff6b49c9640 1 --2- 172.21.15.121:0/1858065252 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff6b00fb1f0 0x7ff6b010fbb0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7ff6a00048a0 tx=0x7ff6a0009da0 comp rx=0 tx=0).stop 2024-08-18T22:40:01.514 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:01.511+0000 7ff6b49c9640 1 -- 172.21.15.121:0/1858065252 shutdown_connections 2024-08-18T22:40:01.514 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:01.511+0000 7ff6b49c9640 1 --2- 172.21.15.121:0/1858065252 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7ff698067190 0x7ff698069640 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:40:01.514 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:01.511+0000 7ff6b49c9640 1 --2- 172.21.15.121:0/1858065252 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff6b00fc4c0 0x7ff6b0112100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:40:01.514 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:01.511+0000 7ff6b49c9640 1 --2- 172.21.15.121:0/1858065252 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff6b00fb1f0 0x7ff6b010fbb0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:40:01.514 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:01.511+0000 7ff6b49c9640 1 -- 172.21.15.121:0/1858065252 >> 172.21.15.121:0/1858065252 conn(0x7ff6b00f69b0 msgr2=0x7ff6b00f8170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:40:01.514 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:01.511+0000 7ff6b49c9640 1 -- 172.21.15.121:0/1858065252 shutdown_connections 2024-08-18T22:40:01.514 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:01.511+0000 7ff6b49c9640 1 -- 172.21.15.121:0/1858065252 wait complete. 2024-08-18T22:40:01.606 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:01.601+0000 7f57082d4640 1 -- 172.21.15.121:0/672751216 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f57000fc2e0 msgr2=0x7f57000fc6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:40:01.606 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:01.601+0000 7f57082d4640 1 --2- 172.21.15.121:0/672751216 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f57000fc2e0 0x7f57000fc6f0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f56fc0048d0 tx=0x7f56fc009da0 comp rx=0 tx=0).stop 2024-08-18T22:40:01.606 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:01.601+0000 7f57082d4640 1 -- 172.21.15.121:0/672751216 shutdown_connections 2024-08-18T22:40:01.607 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:01.601+0000 7f57082d4640 1 --2- 172.21.15.121:0/672751216 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f57000fd5b0 0x7f57000fda20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:40:01.607 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:01.601+0000 7f57082d4640 1 --2- 172.21.15.121:0/672751216 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f57000fc2e0 0x7f57000fc6f0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:40:01.608 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:01.601+0000 7f57082d4640 1 -- 172.21.15.121:0/672751216 >> 172.21.15.121:0/672751216 conn(0x7f57000f7a80 msgr2=0x7f57000f9ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:40:01.608 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:01.601+0000 7f57082d4640 1 -- 172.21.15.121:0/672751216 shutdown_connections 2024-08-18T22:40:01.608 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:01.601+0000 7f57082d4640 1 -- 172.21.15.121:0/672751216 wait complete. 2024-08-18T22:40:01.608 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:01.602+0000 7f57082d4640 1 Processor -- start 2024-08-18T22:40:01.608 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:01.602+0000 7f57082d4640 1 -- start start 2024-08-18T22:40:01.609 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:01.602+0000 7f57082d4640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f57000fc2e0 0x7f570010ced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:40:01.609 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:01.602+0000 7f57082d4640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f57000fd5b0 0x7f570010d410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:40:01.609 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:01.602+0000 7f57082d4640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f570010e140 con 0x7f57000fc2e0 2024-08-18T22:40:01.609 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:01.602+0000 7f57082d4640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f570010e2b0 con 0x7f57000fd5b0 2024-08-18T22:40:01.609 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:01.602+0000 7f5706070640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f57000fc2e0 0x7f570010ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:40:01.610 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:01.602+0000 7f5706070640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f57000fc2e0 0x7f570010ced0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:51266/0 (socket says 172.21.15.121:51266) 2024-08-18T22:40:01.610 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:01.602+0000 7f5706070640 1 -- 172.21.15.121:0/1646534074 learned_addr learned my addr 172.21.15.121:0/1646534074 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-18T22:40:01.610 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:01.602+0000 7f570586f640 1 --2- 172.21.15.121:0/1646534074 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f57000fd5b0 0x7f570010d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:40:01.610 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:01.602+0000 7f5706070640 1 -- 172.21.15.121:0/1646534074 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f57000fd5b0 msgr2=0x7f570010d410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:40:01.610 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:01.602+0000 7f5706070640 1 --2- 172.21.15.121:0/1646534074 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f57000fd5b0 0x7f570010d410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:40:01.611 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:01.602+0000 7f5706070640 1 -- 172.21.15.121:0/1646534074 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56fc005040 con 0x7f57000fc2e0 2024-08-18T22:40:01.611 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:01.603+0000 7f5706070640 1 --2- 172.21.15.121:0/1646534074 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f57000fc2e0 0x7f570010ced0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f56fc0048a0 tx=0x7f56fc009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:40:01.611 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:01.603+0000 7f56f6ffd640 1 -- 172.21.15.121:0/1646534074 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f56fc038070 con 0x7f57000fc2e0 2024-08-18T22:40:01.611 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:01.603+0000 7f56f6ffd640 1 -- 172.21.15.121:0/1646534074 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f56fc004290 con 0x7f57000fc2e0 2024-08-18T22:40:01.611 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:01.603+0000 7f56f6ffd640 1 -- 172.21.15.121:0/1646534074 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f56fc033660 con 0x7f57000fc2e0 2024-08-18T22:40:01.611 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:01.603+0000 7f57082d4640 1 -- 172.21.15.121:0/1646534074 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f570010e530 con 0x7f57000fc2e0 2024-08-18T22:40:01.612 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:01.603+0000 7f57082d4640 1 -- 172.21.15.121:0/1646534074 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f570010ead0 con 0x7f57000fc2e0 2024-08-18T22:40:01.613 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:01.604+0000 7f57082d4640 1 -- 172.21.15.121:0/1646534074 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5700105510 con 0x7f57000fc2e0 2024-08-18T22:40:01.613 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:01.605+0000 7f56f6ffd640 1 -- 172.21.15.121:0/1646534074 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 19) v1 ==== 85127+0+0 (secure 0 0 0) 0x7f56fc030020 con 0x7f57000fc2e0 2024-08-18T22:40:01.613 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:01.605+0000 7f56f6ffd640 1 --2- 172.21.15.121:0/1646534074 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7f56ec067190 0x7f56ec069640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:40:01.613 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:01.605+0000 7f56f6ffd640 1 -- 172.21.15.121:0/1646534074 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f56fc0a4bb0 con 0x7f57000fc2e0 2024-08-18T22:40:01.614 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:01.605+0000 7f570586f640 1 --2- 172.21.15.121:0/1646534074 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7f56ec067190 0x7f56ec069640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:40:01.614 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:01.606+0000 7f570586f640 1 --2- 172.21.15.121:0/1646534074 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7f56ec067190 0x7f56ec069640 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f570010cc80 tx=0x7f56f000b040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:40:01.615 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:01.613+0000 7f56f6ffd640 1 -- 172.21.15.121:0/1646534074 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f56fc0ab080 con 0x7f57000fc2e0 2024-08-18T22:40:01.833 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:40:01 smithi121 ceph-mon[16788]: from='client.14544 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-18T22:40:01.833 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:40:01 smithi121 ceph-mon[16788]: pgmap v196: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.1 KiB/s wr, 0 op/s 2024-08-18T22:40:01.833 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:40:01 smithi121 ceph-mon[16788]: from='client.14548 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-18T22:40:01.833 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:40:01 smithi121 ceph-mon[16788]: from='client.24309 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-18T22:40:01.834 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:40:01 smithi121 ceph-mon[16788]: from='client.? 172.21.15.121:0/1858065252' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-08-18T22:40:01.864 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:01.857+0000 7f57082d4640 1 -- 172.21.15.121:0/1646534074 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f57000fb740 con 0x7f57000fc2e0 2024-08-18T22:40:01.865 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:01.857+0000 7f56f6ffd640 1 -- 172.21.15.121:0/1646534074 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 17 v17) v1 ==== 76+0+1818 (secure 0 0 0) 0x7f56fc071f30 con 0x7f57000fc2e0 2024-08-18T22:40:01.865 INFO:teuthology.orchestra.run.smithi121.stdout:e17 2024-08-18T22:40:01.865 INFO:teuthology.orchestra.run.smithi121.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-08-18T22:40:01.865 INFO:teuthology.orchestra.run.smithi121.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-08-18T22:40:01.865 INFO:teuthology.orchestra.run.smithi121.stdout:legacy client fscid: 1 2024-08-18T22:40:01.865 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-08-18T22:40:01.865 INFO:teuthology.orchestra.run.smithi121.stdout:Filesystem 'cephfs' (1) 2024-08-18T22:40:01.865 INFO:teuthology.orchestra.run.smithi121.stdout:fs_name cephfs 2024-08-18T22:40:01.865 INFO:teuthology.orchestra.run.smithi121.stdout:epoch 17 2024-08-18T22:40:01.866 INFO:teuthology.orchestra.run.smithi121.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-08-18T22:40:01.866 INFO:teuthology.orchestra.run.smithi121.stdout:created 2024-08-18T22:39:04.054074+0000 2024-08-18T22:40:01.866 INFO:teuthology.orchestra.run.smithi121.stdout:modified 2024-08-18T22:39:23.955493+0000 2024-08-18T22:40:01.866 INFO:teuthology.orchestra.run.smithi121.stdout:tableserver 0 2024-08-18T22:40:01.866 INFO:teuthology.orchestra.run.smithi121.stdout:root 0 2024-08-18T22:40:01.866 INFO:teuthology.orchestra.run.smithi121.stdout:session_timeout 60 2024-08-18T22:40:01.866 INFO:teuthology.orchestra.run.smithi121.stdout:session_autoclose 300 2024-08-18T22:40:01.866 INFO:teuthology.orchestra.run.smithi121.stdout:max_file_size 1099511627776 2024-08-18T22:40:01.866 INFO:teuthology.orchestra.run.smithi121.stdout:required_client_features {} 2024-08-18T22:40:01.866 INFO:teuthology.orchestra.run.smithi121.stdout:last_failure 0 2024-08-18T22:40:01.866 INFO:teuthology.orchestra.run.smithi121.stdout:last_failure_osd_epoch 47 2024-08-18T22:40:01.866 INFO:teuthology.orchestra.run.smithi121.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-08-18T22:40:01.867 INFO:teuthology.orchestra.run.smithi121.stdout:max_mds 2 2024-08-18T22:40:01.867 INFO:teuthology.orchestra.run.smithi121.stdout:in 0,1 2024-08-18T22:40:01.867 INFO:teuthology.orchestra.run.smithi121.stdout:up {0=14474,1=24249} 2024-08-18T22:40:01.867 INFO:teuthology.orchestra.run.smithi121.stdout:failed 2024-08-18T22:40:01.867 INFO:teuthology.orchestra.run.smithi121.stdout:damaged 2024-08-18T22:40:01.867 INFO:teuthology.orchestra.run.smithi121.stdout:stopped 2024-08-18T22:40:01.867 INFO:teuthology.orchestra.run.smithi121.stdout:data_pools [3] 2024-08-18T22:40:01.867 INFO:teuthology.orchestra.run.smithi121.stdout:metadata_pool 2 2024-08-18T22:40:01.867 INFO:teuthology.orchestra.run.smithi121.stdout:inline_data disabled 2024-08-18T22:40:01.867 INFO:teuthology.orchestra.run.smithi121.stdout:balancer 2024-08-18T22:40:01.868 INFO:teuthology.orchestra.run.smithi121.stdout:standby_count_wanted 1 2024-08-18T22:40:01.868 INFO:teuthology.orchestra.run.smithi121.stdout:[mds.cephfs.smithi121.gbickb{0:14474} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.121:6828/2277706406,v1:172.21.15.121:6829/2277706406] compat {c=[1],r=[1],i=[7ff]}] 2024-08-18T22:40:01.868 INFO:teuthology.orchestra.run.smithi121.stdout:[mds.cephfs.smithi195.buqvbr{1:24249} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.195:6824/2414511859,v1:172.21.15.195:6825/2414511859] compat {c=[1],r=[1],i=[7ff]}] 2024-08-18T22:40:01.868 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-08-18T22:40:01.868 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-08-18T22:40:01.868 INFO:teuthology.orchestra.run.smithi121.stdout:Standby daemons: 2024-08-18T22:40:01.868 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-08-18T22:40:01.868 INFO:teuthology.orchestra.run.smithi121.stdout:[mds.cephfs.smithi121.xuzsdg{-1:14490} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.121:6826/91588128,v1:172.21.15.121:6827/91588128] compat {c=[1],r=[1],i=[7ff]}] 2024-08-18T22:40:01.868 INFO:teuthology.orchestra.run.smithi121.stdout:[mds.cephfs.smithi195.nptgyc{-1:24259} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.195:6826/238549847,v1:172.21.15.195:6827/238549847] compat {c=[1],r=[1],i=[7ff]}] 2024-08-18T22:40:01.869 INFO:teuthology.orchestra.run.smithi121.stderr:dumped fsmap epoch 17 2024-08-18T22:40:01.869 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:01.859+0000 7f57082d4640 1 -- 172.21.15.121:0/1646534074 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7f56ec067190 msgr2=0x7f56ec069640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:40:01.869 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:01.859+0000 7f57082d4640 1 --2- 172.21.15.121:0/1646534074 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7f56ec067190 0x7f56ec069640 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f570010cc80 tx=0x7f56f000b040 comp rx=0 tx=0).stop 2024-08-18T22:40:01.869 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:01.859+0000 7f57082d4640 1 -- 172.21.15.121:0/1646534074 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f57000fc2e0 msgr2=0x7f570010ced0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:40:01.869 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:01.859+0000 7f57082d4640 1 --2- 172.21.15.121:0/1646534074 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f57000fc2e0 0x7f570010ced0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f56fc0048a0 tx=0x7f56fc009da0 comp rx=0 tx=0).stop 2024-08-18T22:40:01.869 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:01.860+0000 7f57082d4640 1 -- 172.21.15.121:0/1646534074 shutdown_connections 2024-08-18T22:40:01.870 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:01.860+0000 7f57082d4640 1 --2- 172.21.15.121:0/1646534074 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7f56ec067190 0x7f56ec069640 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:40:01.870 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:01.860+0000 7f57082d4640 1 --2- 172.21.15.121:0/1646534074 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f57000fd5b0 0x7f570010d410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:40:01.870 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:01.860+0000 7f57082d4640 1 --2- 172.21.15.121:0/1646534074 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f57000fc2e0 0x7f570010ced0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:40:01.870 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:01.860+0000 7f57082d4640 1 -- 172.21.15.121:0/1646534074 >> 172.21.15.121:0/1646534074 conn(0x7f57000f7a80 msgr2=0x7f57000f9290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:40:01.870 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:01.860+0000 7f57082d4640 1 -- 172.21.15.121:0/1646534074 shutdown_connections 2024-08-18T22:40:01.870 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:01.860+0000 7f57082d4640 1 -- 172.21.15.121:0/1646534074 wait complete. 2024-08-18T22:40:01.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:40:01 smithi195 ceph-mon[23370]: from='client.14544 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-18T22:40:01.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:40:01 smithi195 ceph-mon[23370]: pgmap v196: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.1 KiB/s wr, 0 op/s 2024-08-18T22:40:01.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:40:01 smithi195 ceph-mon[23370]: from='client.14548 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-18T22:40:01.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:40:01 smithi195 ceph-mon[23370]: from='client.24309 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-18T22:40:01.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:40:01 smithi195 ceph-mon[23370]: from='client.? 172.21.15.121:0/1858065252' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-08-18T22:40:01.957 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:01.953+0000 7f771d079640 1 -- 172.21.15.121:0/1307376173 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f77180fd910 msgr2=0x7f77180fdd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:40:01.957 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:01.953+0000 7f771d079640 1 --2- 172.21.15.121:0/1307376173 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f77180fd910 0x7f77180fdd20 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f77080048d0 tx=0x7f7708009da0 comp rx=0 tx=0).stop 2024-08-18T22:40:01.957 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:01.953+0000 7f771d079640 1 -- 172.21.15.121:0/1307376173 shutdown_connections 2024-08-18T22:40:01.957 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:01.954+0000 7f771d079640 1 --2- 172.21.15.121:0/1307376173 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f77180fe260 0x7f77180fa3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:40:01.957 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:01.954+0000 7f771d079640 1 --2- 172.21.15.121:0/1307376173 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f77180fd910 0x7f77180fdd20 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:40:01.957 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:01.954+0000 7f771d079640 1 -- 172.21.15.121:0/1307376173 >> 172.21.15.121:0/1307376173 conn(0x7f77180f6130 msgr2=0x7f77180f8540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:40:01.958 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:01.954+0000 7f771d079640 1 -- 172.21.15.121:0/1307376173 shutdown_connections 2024-08-18T22:40:01.958 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:01.954+0000 7f771d079640 1 -- 172.21.15.121:0/1307376173 wait complete. 2024-08-18T22:40:01.958 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:01.954+0000 7f771d079640 1 Processor -- start 2024-08-18T22:40:01.958 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:01.954+0000 7f771d079640 1 -- start start 2024-08-18T22:40:01.958 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:01.955+0000 7f771d079640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f77180fd910 0x7f77180fd100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:40:01.958 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:01.955+0000 7f771d079640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f77180fe260 0x7f77180fb5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:40:01.958 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:01.955+0000 7f771d079640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77180fbb80 con 0x7f77180fe260 2024-08-18T22:40:01.958 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:01.955+0000 7f771d079640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77180fbcc0 con 0x7f77180fd910 2024-08-18T22:40:01.958 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:01.955+0000 7f771659c640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f77180fe260 0x7f77180fb5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:40:01.958 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:01.955+0000 7f7716d9d640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f77180fd910 0x7f77180fd100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:40:01.958 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:01.955+0000 7f7716d9d640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f77180fd910 0x7f77180fd100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.121:40270/0 (socket says 172.21.15.121:40270) 2024-08-18T22:40:01.959 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:01.955+0000 7f7716d9d640 1 -- 172.21.15.121:0/4071935166 learned_addr learned my addr 172.21.15.121:0/4071935166 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-18T22:40:01.959 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:01.955+0000 7f771659c640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f77180fe260 0x7f77180fb5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:51278/0 (socket says 172.21.15.121:51278) 2024-08-18T22:40:01.960 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:01.955+0000 7f771659c640 1 -- 172.21.15.121:0/4071935166 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f77180fd910 msgr2=0x7f77180fd100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:40:01.960 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:01.955+0000 7f771659c640 1 --2- 172.21.15.121:0/4071935166 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f77180fd910 0x7f77180fd100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:40:01.960 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:01.955+0000 7f771659c640 1 -- 172.21.15.121:0/4071935166 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7708005040 con 0x7f77180fe260 2024-08-18T22:40:01.961 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:01.955+0000 7f7716d9d640 1 --2- 172.21.15.121:0/4071935166 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f77180fd910 0x7f77180fd100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:40:01.961 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:01.956+0000 7f771659c640 1 --2- 172.21.15.121:0/4071935166 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f77180fe260 0x7f77180fb5f0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f7718064c50 tx=0x7f770c004570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:40:01.961 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:01.956+0000 7f76ff7fe640 1 -- 172.21.15.121:0/4071935166 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f770c002d80 con 0x7f77180fe260 2024-08-18T22:40:01.961 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:01.956+0000 7f76ff7fe640 1 -- 172.21.15.121:0/4071935166 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f770c00f040 con 0x7f77180fe260 2024-08-18T22:40:01.961 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:01.956+0000 7f771d079640 1 -- 172.21.15.121:0/4071935166 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77180fbfa0 con 0x7f77180fe260 2024-08-18T22:40:01.961 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:01.956+0000 7f76ff7fe640 1 -- 172.21.15.121:0/4071935166 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f770c009490 con 0x7f77180fe260 2024-08-18T22:40:01.961 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:01.956+0000 7f771d079640 1 -- 172.21.15.121:0/4071935166 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7718114e80 con 0x7f77180fe260 2024-08-18T22:40:01.961 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:01.957+0000 7f771d079640 1 -- 172.21.15.121:0/4071935166 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77180f9db0 con 0x7f77180fe260 2024-08-18T22:40:01.961 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:01.957+0000 7f76ff7fe640 1 -- 172.21.15.121:0/4071935166 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 19) v1 ==== 85127+0+0 (secure 0 0 0) 0x7f770c007c30 con 0x7f77180fe260 2024-08-18T22:40:01.961 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:01.958+0000 7f76ff7fe640 1 --2- 172.21.15.121:0/4071935166 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7f7700067190 0x7f7700069640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:40:01.961 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:01.958+0000 7f76ff7fe640 1 -- 172.21.15.121:0/4071935166 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f770c084230 con 0x7f77180fe260 2024-08-18T22:40:01.961 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:01.958+0000 7f7716d9d640 1 --2- 172.21.15.121:0/4071935166 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7f7700067190 0x7f7700069640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:40:01.961 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:01.958+0000 7f7716d9d640 1 --2- 172.21.15.121:0/4071935166 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7f7700067190 0x7f7700069640 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f7708000c00 tx=0x7f7708035040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:40:01.968 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:01.966+0000 7f76ff7fe640 1 -- 172.21.15.121:0/4071935166 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f770c04d2a0 con 0x7f77180fe260 2024-08-18T22:40:02.206 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:02.204+0000 7f771d079640 1 -- 172.21.15.121:0/4071935166 --> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f7718101b00 con 0x7f7700067190 2024-08-18T22:40:02.207 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:02.205+0000 7f76ff7fe640 1 -- 172.21.15.121:0/4071935166 <== mgr.14206 v2:172.21.15.121:6800/3225195982 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+358 (secure 0 0 0) 0x7f7718101b00 con 0x7f7700067190 2024-08-18T22:40:02.207 INFO:teuthology.orchestra.run.smithi121.stdout:{ 2024-08-18T22:40:02.207 INFO:teuthology.orchestra.run.smithi121.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833", 2024-08-18T22:40:02.207 INFO:teuthology.orchestra.run.smithi121.stdout: "in_progress": true, 2024-08-18T22:40:02.208 INFO:teuthology.orchestra.run.smithi121.stdout: "which": "Upgrading all daemon types on all hosts", 2024-08-18T22:40:02.208 INFO:teuthology.orchestra.run.smithi121.stdout: "services_complete": [], 2024-08-18T22:40:02.208 INFO:teuthology.orchestra.run.smithi121.stdout: "progress": "", 2024-08-18T22:40:02.208 INFO:teuthology.orchestra.run.smithi121.stdout: "message": "Doing first pull of quay.ceph.io/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 image", 2024-08-18T22:40:02.208 INFO:teuthology.orchestra.run.smithi121.stdout: "is_paused": false 2024-08-18T22:40:02.208 INFO:teuthology.orchestra.run.smithi121.stdout:} 2024-08-18T22:40:02.210 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:02.208+0000 7f771d079640 1 -- 172.21.15.121:0/4071935166 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7f7700067190 msgr2=0x7f7700069640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:40:02.210 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:02.208+0000 7f771d079640 1 --2- 172.21.15.121:0/4071935166 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7f7700067190 0x7f7700069640 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f7708000c00 tx=0x7f7708035040 comp rx=0 tx=0).stop 2024-08-18T22:40:02.210 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:02.208+0000 7f771d079640 1 -- 172.21.15.121:0/4071935166 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f77180fe260 msgr2=0x7f77180fb5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:40:02.210 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:02.208+0000 7f771d079640 1 --2- 172.21.15.121:0/4071935166 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f77180fe260 0x7f77180fb5f0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f7718064c50 tx=0x7f770c004570 comp rx=0 tx=0).stop 2024-08-18T22:40:02.210 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:02.208+0000 7f771d079640 1 -- 172.21.15.121:0/4071935166 shutdown_connections 2024-08-18T22:40:02.210 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:02.208+0000 7f771d079640 1 --2- 172.21.15.121:0/4071935166 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7f7700067190 0x7f7700069640 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:40:02.210 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:02.208+0000 7f771d079640 1 --2- 172.21.15.121:0/4071935166 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f77180fe260 0x7f77180fb5f0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:40:02.211 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:02.208+0000 7f771d079640 1 --2- 172.21.15.121:0/4071935166 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f77180fd910 0x7f77180fd100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:40:02.211 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:02.208+0000 7f771d079640 1 -- 172.21.15.121:0/4071935166 >> 172.21.15.121:0/4071935166 conn(0x7f77180f6130 msgr2=0x7f77180f78e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:40:02.211 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:02.208+0000 7f771d079640 1 -- 172.21.15.121:0/4071935166 shutdown_connections 2024-08-18T22:40:02.211 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:02.208+0000 7f771d079640 1 -- 172.21.15.121:0/4071935166 wait complete. 2024-08-18T22:40:02.310 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:02.308+0000 7ff149a3e640 1 -- 172.21.15.121:0/103136829 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff1440fc300 msgr2=0x7ff1440fc710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:40:02.311 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:02.308+0000 7ff149a3e640 1 --2- 172.21.15.121:0/103136829 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff1440fc300 0x7ff1440fc710 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7ff1340048d0 tx=0x7ff134009da0 comp rx=0 tx=0).stop 2024-08-18T22:40:02.311 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:02.308+0000 7ff149a3e640 1 -- 172.21.15.121:0/103136829 shutdown_connections 2024-08-18T22:40:02.311 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:02.308+0000 7ff149a3e640 1 --2- 172.21.15.121:0/103136829 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff1440fd5d0 0x7ff1440fda40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:40:02.311 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:02.308+0000 7ff149a3e640 1 --2- 172.21.15.121:0/103136829 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff1440fc300 0x7ff1440fc710 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:40:02.311 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:02.308+0000 7ff149a3e640 1 -- 172.21.15.121:0/103136829 >> 172.21.15.121:0/103136829 conn(0x7ff1440f7ac0 msgr2=0x7ff1440f9ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:40:02.311 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:02.308+0000 7ff149a3e640 1 -- 172.21.15.121:0/103136829 shutdown_connections 2024-08-18T22:40:02.311 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:02.308+0000 7ff149a3e640 1 -- 172.21.15.121:0/103136829 wait complete. 2024-08-18T22:40:02.313 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:02.309+0000 7ff149a3e640 1 Processor -- start 2024-08-18T22:40:02.313 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:02.309+0000 7ff149a3e640 1 -- start start 2024-08-18T22:40:02.313 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:02.309+0000 7ff149a3e640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff1440fc300 0x7ff14410ce50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:40:02.313 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:02.309+0000 7ff149a3e640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff1440fd5d0 0x7ff14410d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:40:02.313 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:02.309+0000 7ff149a3e640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff14410d9e0 con 0x7ff1440fd5d0 2024-08-18T22:40:02.313 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:02.309+0000 7ff149a3e640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff14410e120 con 0x7ff1440fc300 2024-08-18T22:40:02.313 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:02.309+0000 7ff1427fc640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff1440fd5d0 0x7ff14410d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:40:02.313 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:02.309+0000 7ff142ffd640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff1440fc300 0x7ff14410ce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:40:02.313 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:02.309+0000 7ff1427fc640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff1440fd5d0 0x7ff14410d390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:51292/0 (socket says 172.21.15.121:51292) 2024-08-18T22:40:02.314 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:02.309+0000 7ff1427fc640 1 -- 172.21.15.121:0/2998417226 learned_addr learned my addr 172.21.15.121:0/2998417226 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-18T22:40:02.314 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:02.310+0000 7ff142ffd640 1 -- 172.21.15.121:0/2998417226 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff1440fd5d0 msgr2=0x7ff14410d390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:40:02.314 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:02.310+0000 7ff142ffd640 1 --2- 172.21.15.121:0/2998417226 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff1440fd5d0 0x7ff14410d390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:40:02.314 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:02.310+0000 7ff142ffd640 1 -- 172.21.15.121:0/2998417226 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff134005040 con 0x7ff1440fc300 2024-08-18T22:40:02.314 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:02.310+0000 7ff1427fc640 1 --2- 172.21.15.121:0/2998417226 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff1440fd5d0 0x7ff14410d390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:40:02.314 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:02.310+0000 7ff142ffd640 1 --2- 172.21.15.121:0/2998417226 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff1440fc300 0x7ff14410ce50 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7ff1340043d0 tx=0x7ff134009da0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:40:02.314 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:02.310+0000 7ff12b7fe640 1 -- 172.21.15.121:0/2998417226 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff134038070 con 0x7ff1440fc300 2024-08-18T22:40:02.314 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:02.310+0000 7ff12b7fe640 1 -- 172.21.15.121:0/2998417226 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7ff134009800 con 0x7ff1440fc300 2024-08-18T22:40:02.314 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:02.310+0000 7ff149a3e640 1 -- 172.21.15.121:0/2998417226 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff14410e350 con 0x7ff1440fc300 2024-08-18T22:40:02.314 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:02.310+0000 7ff12b7fe640 1 -- 172.21.15.121:0/2998417226 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff134033660 con 0x7ff1440fc300 2024-08-18T22:40:02.314 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:02.310+0000 7ff149a3e640 1 -- 172.21.15.121:0/2998417226 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff14410e870 con 0x7ff1440fc300 2024-08-18T22:40:02.315 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:02.312+0000 7ff149a3e640 1 -- 172.21.15.121:0/2998417226 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1440fb760 con 0x7ff1440fc300 2024-08-18T22:40:02.315 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:02.312+0000 7ff12b7fe640 1 -- 172.21.15.121:0/2998417226 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 19) v1 ==== 85127+0+0 (secure 0 0 0) 0x7ff134030020 con 0x7ff1440fc300 2024-08-18T22:40:02.315 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:02.313+0000 7ff12b7fe640 1 --2- 172.21.15.121:0/2998417226 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7ff12c067190 0x7ff12c069640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:40:02.316 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:02.313+0000 7ff12b7fe640 1 -- 172.21.15.121:0/2998417226 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5550+0+0 (secure 0 0 0) 0x7ff1340a4b50 con 0x7ff1440fc300 2024-08-18T22:40:02.316 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:02.313+0000 7ff1427fc640 1 --2- 172.21.15.121:0/2998417226 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7ff12c067190 0x7ff12c069640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:40:02.316 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:02.313+0000 7ff1427fc640 1 --2- 172.21.15.121:0/2998417226 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7ff12c067190 0x7ff12c069640 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7ff138004fd0 tx=0x7ff13800b040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:40:02.319 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:02.317+0000 7ff12b7fe640 1 -- 172.21.15.121:0/2998417226 <== mon.1 v2:172.21.15.195:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7ff134071ed0 con 0x7ff1440fc300 2024-08-18T22:40:02.589 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:02.586+0000 7ff149a3e640 1 -- 172.21.15.121:0/2998417226 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7ff14404b4c0 con 0x7ff1440fc300 2024-08-18T22:40:02.589 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:02.587+0000 7ff12b7fe640 1 -- 172.21.15.121:0/2998417226 <== mon.1 v2:172.21.15.195:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7ff1340754f0 con 0x7ff1440fc300 2024-08-18T22:40:02.589 INFO:teuthology.orchestra.run.smithi121.stdout:HEALTH_OK 2024-08-18T22:40:02.591 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:02.589+0000 7ff149a3e640 1 -- 172.21.15.121:0/2998417226 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7ff12c067190 msgr2=0x7ff12c069640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:40:02.592 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:02.589+0000 7ff149a3e640 1 --2- 172.21.15.121:0/2998417226 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7ff12c067190 0x7ff12c069640 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7ff138004fd0 tx=0x7ff13800b040 comp rx=0 tx=0).stop 2024-08-18T22:40:02.592 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:02.589+0000 7ff149a3e640 1 -- 172.21.15.121:0/2998417226 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff1440fc300 msgr2=0x7ff14410ce50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:40:02.592 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:02.589+0000 7ff149a3e640 1 --2- 172.21.15.121:0/2998417226 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff1440fc300 0x7ff14410ce50 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7ff1340043d0 tx=0x7ff134009da0 comp rx=0 tx=0).stop 2024-08-18T22:40:02.592 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:02.589+0000 7ff149a3e640 1 -- 172.21.15.121:0/2998417226 shutdown_connections 2024-08-18T22:40:02.592 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:02.589+0000 7ff149a3e640 1 --2- 172.21.15.121:0/2998417226 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7ff12c067190 0x7ff12c069640 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:40:02.592 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:02.589+0000 7ff149a3e640 1 --2- 172.21.15.121:0/2998417226 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff1440fd5d0 0x7ff14410d390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:40:02.592 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:02.589+0000 7ff149a3e640 1 --2- 172.21.15.121:0/2998417226 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff1440fc300 0x7ff14410ce50 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:40:02.592 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:02.589+0000 7ff149a3e640 1 -- 172.21.15.121:0/2998417226 >> 172.21.15.121:0/2998417226 conn(0x7ff1440f7ac0 msgr2=0x7ff1440f9230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:40:02.592 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:02.589+0000 7ff149a3e640 1 -- 172.21.15.121:0/2998417226 shutdown_connections 2024-08-18T22:40:02.592 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:02.590+0000 7ff149a3e640 1 -- 172.21.15.121:0/2998417226 wait complete. 2024-08-18T22:40:03.087 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:40:02 smithi121 ceph-mon[16788]: from='client.? 172.21.15.121:0/1646534074' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-08-18T22:40:03.087 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:40:02 smithi121 ceph-mon[16788]: from='client.14564 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-18T22:40:03.087 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:40:02 smithi121 ceph-mon[16788]: from='client.? 172.21.15.121:0/2998417226' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-08-18T22:40:03.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:40:02 smithi195 ceph-mon[23370]: from='client.? 172.21.15.121:0/1646534074' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-08-18T22:40:03.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:40:02 smithi195 ceph-mon[23370]: from='client.14564 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-18T22:40:03.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:40:02 smithi195 ceph-mon[23370]: from='client.? 172.21.15.121:0/2998417226' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-08-18T22:40:04.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:40:03 smithi121 ceph-mon[16788]: pgmap v197: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 597 B/s wr, 0 op/s 2024-08-18T22:40:04.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:40:03 smithi195 ceph-mon[23370]: pgmap v197: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 597 B/s wr, 0 op/s 2024-08-18T22:40:06.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:40:05 smithi121 ceph-mon[16788]: pgmap v198: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-08-18T22:40:06.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:40:05 smithi195 ceph-mon[23370]: pgmap v198: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-08-18T22:40:08.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:40:07 smithi121 ceph-mon[16788]: pgmap v199: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-08-18T22:40:08.132 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:40:07 smithi195 ceph-mon[23370]: pgmap v199: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-08-18T22:40:09.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:40:08 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-18T22:40:09.158 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:40:08 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-18T22:40:09.833 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:40:09 smithi121 ceph-mon[16788]: pgmap v200: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-08-18T22:40:10.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:40:09 smithi195 ceph-mon[23370]: pgmap v200: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-08-18T22:40:11.833 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:40:11 smithi121 ceph-mon[16788]: pgmap v201: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 426 B/s wr, 0 op/s 2024-08-18T22:40:12.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:40:11 smithi195 ceph-mon[23370]: pgmap v201: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 426 B/s wr, 0 op/s 2024-08-18T22:40:14.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:40:13 smithi121 ceph-mon[16788]: pgmap v202: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-08-18T22:40:14.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:40:13 smithi195 ceph-mon[23370]: pgmap v202: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-08-18T22:40:16.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:40:15 smithi121 ceph-mon[16788]: pgmap v203: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-08-18T22:40:16.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:40:15 smithi195 ceph-mon[23370]: pgmap v203: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-08-18T22:40:18.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:40:17 smithi121 ceph-mon[16788]: pgmap v204: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-08-18T22:40:18.132 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:40:17 smithi195 ceph-mon[23370]: pgmap v204: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-08-18T22:40:20.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:40:19 smithi121 ceph-mon[16788]: pgmap v205: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-08-18T22:40:20.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:40:19 smithi195 ceph-mon[23370]: pgmap v205: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-08-18T22:40:21.833 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:40:21 smithi121 ceph-mon[16788]: pgmap v206: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-08-18T22:40:22.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:40:21 smithi195 ceph-mon[23370]: pgmap v206: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-08-18T22:40:24.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:40:23 smithi121 ceph-mon[16788]: pgmap v207: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-08-18T22:40:24.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:40:23 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-18T22:40:24.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:40:23 smithi195 ceph-mon[23370]: pgmap v207: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-08-18T22:40:24.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:40:23 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-18T22:40:26.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:40:25 smithi121 ceph-mon[16788]: pgmap v208: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-08-18T22:40:26.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:40:25 smithi195 ceph-mon[23370]: pgmap v208: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-08-18T22:40:27.833 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:40:27 smithi121 ceph-mon[16788]: pgmap v209: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-08-18T22:40:28.132 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:40:27 smithi195 ceph-mon[23370]: pgmap v209: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-08-18T22:40:29.659 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:40:29 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:40:29.659 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:40:29 smithi195 ceph-mon[23370]: Upgrade: Target is version 19.1.0-1382-gde09dd01 (unknown) 2024-08-18T22:40:29.659 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:40:29 smithi195 ceph-mon[23370]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, digests ['quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9'] 2024-08-18T22:40:29.659 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:40:29 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-18T22:40:29.659 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:40:29 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:40:29.659 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:40:29 smithi195 ceph-mon[23370]: Upgrade: Need to upgrade myself (mgr.smithi121.lopxqc) 2024-08-18T22:40:29.659 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:40:29 smithi195 ceph-mon[23370]: pgmap v210: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-08-18T22:40:29.659 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:40:29 smithi195 ceph-mon[23370]: Upgrade: Pulling quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9 on smithi195 2024-08-18T22:40:29.833 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:40:29 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:40:29.833 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:40:29 smithi121 ceph-mon[16788]: Upgrade: Target is version 19.1.0-1382-gde09dd01 (unknown) 2024-08-18T22:40:29.834 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:40:29 smithi121 ceph-mon[16788]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, digests ['quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9'] 2024-08-18T22:40:29.834 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:40:29 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-18T22:40:29.834 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:40:29 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:40:29.834 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:40:29 smithi121 ceph-mon[16788]: Upgrade: Need to upgrade myself (mgr.smithi121.lopxqc) 2024-08-18T22:40:29.834 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:40:29 smithi121 ceph-mon[16788]: pgmap v210: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-08-18T22:40:29.834 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:40:29 smithi121 ceph-mon[16788]: Upgrade: Pulling quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9 on smithi195 2024-08-18T22:40:31.833 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:40:31 smithi121 ceph-mon[16788]: pgmap v211: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-08-18T22:40:31.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:40:31 smithi195 ceph-mon[23370]: pgmap v211: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-08-18T22:40:32.675 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:32.674+0000 7fbf27bf9640 1 -- 172.21.15.121:0/152132961 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbf200659e0 msgr2=0x7fbf200feee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:40:32.676 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:32.674+0000 7fbf27bf9640 1 --2- 172.21.15.121:0/152132961 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbf200659e0 0x7fbf200feee0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fbf1c0048d0 tx=0x7fbf1c009da0 comp rx=0 tx=0).stop 2024-08-18T22:40:32.676 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:32.674+0000 7fbf27bf9640 1 -- 172.21.15.121:0/152132961 shutdown_connections 2024-08-18T22:40:32.676 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:32.674+0000 7fbf27bf9640 1 --2- 172.21.15.121:0/152132961 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbf200ff420 0x7fbf20101800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:40:32.676 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:32.674+0000 7fbf27bf9640 1 --2- 172.21.15.121:0/152132961 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbf200659e0 0x7fbf200feee0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:40:32.676 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:32.674+0000 7fbf27bf9640 1 -- 172.21.15.121:0/152132961 >> 172.21.15.121:0/152132961 conn(0x7fbf200f69b0 msgr2=0x7fbf200f8dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:40:32.676 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:32.674+0000 7fbf27bf9640 1 -- 172.21.15.121:0/152132961 shutdown_connections 2024-08-18T22:40:32.676 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:32.674+0000 7fbf27bf9640 1 -- 172.21.15.121:0/152132961 wait complete. 2024-08-18T22:40:32.677 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:32.675+0000 7fbf27bf9640 1 Processor -- start 2024-08-18T22:40:32.678 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:32.675+0000 7fbf27bf9640 1 -- start start 2024-08-18T22:40:32.678 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:32.675+0000 7fbf27bf9640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbf200659e0 0x7fbf20103a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:40:32.678 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:32.675+0000 7fbf27bf9640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbf200ff420 0x7fbf20103f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:40:32.678 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:32.675+0000 7fbf27bf9640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf20104590 con 0x7fbf200ff420 2024-08-18T22:40:32.678 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:32.675+0000 7fbf27bf9640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf20104e50 con 0x7fbf200659e0 2024-08-18T22:40:32.678 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:32.675+0000 7fbf25194640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbf200ff420 0x7fbf20103f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:40:32.678 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:32.675+0000 7fbf25995640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbf200659e0 0x7fbf20103a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:40:32.678 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:32.675+0000 7fbf25194640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbf200ff420 0x7fbf20103f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:52310/0 (socket says 172.21.15.121:52310) 2024-08-18T22:40:32.678 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:32.675+0000 7fbf25194640 1 -- 172.21.15.121:0/456214706 learned_addr learned my addr 172.21.15.121:0/456214706 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-18T22:40:32.678 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:32.676+0000 7fbf25194640 1 -- 172.21.15.121:0/456214706 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbf200659e0 msgr2=0x7fbf20103a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:40:32.678 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:32.676+0000 7fbf25194640 1 --2- 172.21.15.121:0/456214706 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbf200659e0 0x7fbf20103a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:40:32.678 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:32.676+0000 7fbf25194640 1 -- 172.21.15.121:0/456214706 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf1c005040 con 0x7fbf200ff420 2024-08-18T22:40:32.679 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:32.676+0000 7fbf25995640 1 --2- 172.21.15.121:0/456214706 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbf200659e0 0x7fbf20103a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:40:32.679 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:32.676+0000 7fbf25194640 1 --2- 172.21.15.121:0/456214706 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbf200ff420 0x7fbf20103f90 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fbf14002a80 tx=0x7fbf14004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:40:32.679 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:32.676+0000 7fbf127fc640 1 -- 172.21.15.121:0/456214706 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbf14007c30 con 0x7fbf200ff420 2024-08-18T22:40:32.679 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:32.676+0000 7fbf127fc640 1 -- 172.21.15.121:0/456214706 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fbf1400f040 con 0x7fbf200ff420 2024-08-18T22:40:32.679 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:32.676+0000 7fbf127fc640 1 -- 172.21.15.121:0/456214706 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbf140094f0 con 0x7fbf200ff420 2024-08-18T22:40:32.679 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:32.677+0000 7fbf27bf9640 1 -- 172.21.15.121:0/456214706 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf20105130 con 0x7fbf200ff420 2024-08-18T22:40:32.679 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:32.677+0000 7fbf27bf9640 1 -- 172.21.15.121:0/456214706 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf20105650 con 0x7fbf200ff420 2024-08-18T22:40:32.679 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:32.678+0000 7fbf27bf9640 1 -- 172.21.15.121:0/456214706 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf200fa630 con 0x7fbf200ff420 2024-08-18T22:40:32.680 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:32.678+0000 7fbf127fc640 1 -- 172.21.15.121:0/456214706 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 19) v1 ==== 85127+0+0 (secure 0 0 0) 0x7fbf140096d0 con 0x7fbf200ff420 2024-08-18T22:40:32.680 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:32.679+0000 7fbf127fc640 1 --2- 172.21.15.121:0/456214706 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7fbf0c067190 0x7fbf0c069640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:40:32.680 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:32.679+0000 7fbf25995640 1 --2- 172.21.15.121:0/456214706 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7fbf0c067190 0x7fbf0c069640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:40:32.680 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:32.679+0000 7fbf127fc640 1 -- 172.21.15.121:0/456214706 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5550+0+0 (secure 0 0 0) 0x7fbf14084a40 con 0x7fbf200ff420 2024-08-18T22:40:32.681 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:32.680+0000 7fbf25995640 1 --2- 172.21.15.121:0/456214706 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7fbf0c067190 0x7fbf0c069640 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fbf20103800 tx=0x7fbf1c035040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:40:32.684 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:32.683+0000 7fbf127fc640 1 -- 172.21.15.121:0/456214706 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fbf14051d10 con 0x7fbf200ff420 2024-08-18T22:40:32.911 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:32.910+0000 7fbf27bf9640 1 -- 172.21.15.121:0/456214706 --> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fbf201059f0 con 0x7fbf0c067190 2024-08-18T22:40:32.912 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:32.911+0000 7fbf127fc640 1 -- 172.21.15.121:0/456214706 <== mgr.14206 v2:172.21.15.121:6800/3225195982 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+447 (secure 0 0 0) 0x7fbf201059f0 con 0x7fbf0c067190 2024-08-18T22:40:32.914 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:32.913+0000 7fbf27bf9640 1 -- 172.21.15.121:0/456214706 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7fbf0c067190 msgr2=0x7fbf0c069640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:40:32.914 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:32.913+0000 7fbf27bf9640 1 --2- 172.21.15.121:0/456214706 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7fbf0c067190 0x7fbf0c069640 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fbf20103800 tx=0x7fbf1c035040 comp rx=0 tx=0).stop 2024-08-18T22:40:32.914 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:32.913+0000 7fbf27bf9640 1 -- 172.21.15.121:0/456214706 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbf200ff420 msgr2=0x7fbf20103f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:40:32.914 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:32.913+0000 7fbf27bf9640 1 --2- 172.21.15.121:0/456214706 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbf200ff420 0x7fbf20103f90 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fbf14002a80 tx=0x7fbf14004600 comp rx=0 tx=0).stop 2024-08-18T22:40:32.915 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:32.914+0000 7fbf27bf9640 1 -- 172.21.15.121:0/456214706 shutdown_connections 2024-08-18T22:40:32.915 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:32.914+0000 7fbf27bf9640 1 --2- 172.21.15.121:0/456214706 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7fbf0c067190 0x7fbf0c069640 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:40:32.915 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:32.914+0000 7fbf27bf9640 1 --2- 172.21.15.121:0/456214706 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbf200ff420 0x7fbf20103f90 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:40:32.915 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:32.914+0000 7fbf27bf9640 1 --2- 172.21.15.121:0/456214706 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbf200659e0 0x7fbf20103a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:40:32.915 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:32.914+0000 7fbf27bf9640 1 -- 172.21.15.121:0/456214706 >> 172.21.15.121:0/456214706 conn(0x7fbf200f69b0 msgr2=0x7fbf200f8d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:40:32.916 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:32.914+0000 7fbf27bf9640 1 -- 172.21.15.121:0/456214706 shutdown_connections 2024-08-18T22:40:32.916 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:32.914+0000 7fbf27bf9640 1 -- 172.21.15.121:0/456214706 wait complete. 2024-08-18T22:40:32.926 INFO:teuthology.orchestra.run.smithi121.stdout:true 2024-08-18T22:40:32.999 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:32.998+0000 7f977c4a5640 1 -- 172.21.15.121:0/2612178891 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f977406fd80 msgr2=0x7f97740701f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:40:32.999 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:32.998+0000 7f977c4a5640 1 --2- 172.21.15.121:0/2612178891 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f977406fd80 0x7f97740701f0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f97640048d0 tx=0x7f9764009da0 comp rx=0 tx=0).stop 2024-08-18T22:40:32.999 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:32.998+0000 7f977c4a5640 1 -- 172.21.15.121:0/2612178891 shutdown_connections 2024-08-18T22:40:33.000 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:32.998+0000 7f977c4a5640 1 --2- 172.21.15.121:0/2612178891 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f977406fd80 0x7f97740701f0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:40:33.000 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:32.998+0000 7f977c4a5640 1 --2- 172.21.15.121:0/2612178891 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9774071310 0x7f977406f840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:40:33.000 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:32.998+0000 7f977c4a5640 1 -- 172.21.15.121:0/2612178891 >> 172.21.15.121:0/2612178891 conn(0x7f97740f7a80 msgr2=0x7f97740f9eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:40:33.000 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:32.998+0000 7f977c4a5640 1 -- 172.21.15.121:0/2612178891 shutdown_connections 2024-08-18T22:40:33.000 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:32.998+0000 7f977c4a5640 1 -- 172.21.15.121:0/2612178891 wait complete. 2024-08-18T22:40:33.001 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:32.999+0000 7f977c4a5640 1 Processor -- start 2024-08-18T22:40:33.001 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:32.999+0000 7f977c4a5640 1 -- start start 2024-08-18T22:40:33.001 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:32.999+0000 7f977c4a5640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f977406fd80 0x7f97741134b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:40:33.002 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:32.999+0000 7f977c4a5640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9774071310 0x7f97741139f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:40:33.002 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:32.999+0000 7f977c4a5640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9774114040 con 0x7f977406fd80 2024-08-18T22:40:33.002 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:32.999+0000 7f977c4a5640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97741147f0 con 0x7f9774071310 2024-08-18T22:40:33.002 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:32.999+0000 7f977a241640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f977406fd80 0x7f97741134b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:40:33.002 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:33.000+0000 7f977a241640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f977406fd80 0x7f97741134b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:52318/0 (socket says 172.21.15.121:52318) 2024-08-18T22:40:33.002 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:33.000+0000 7f977a241640 1 -- 172.21.15.121:0/3696089920 learned_addr learned my addr 172.21.15.121:0/3696089920 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-18T22:40:33.002 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:33.000+0000 7f9779a40640 1 --2- 172.21.15.121:0/3696089920 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9774071310 0x7f97741139f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:40:33.002 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:33.000+0000 7f977a241640 1 -- 172.21.15.121:0/3696089920 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9774071310 msgr2=0x7f97741139f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:40:33.002 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:33.000+0000 7f977a241640 1 --2- 172.21.15.121:0/3696089920 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9774071310 0x7f97741139f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:40:33.002 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:33.000+0000 7f977a241640 1 -- 172.21.15.121:0/3696089920 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9764005040 con 0x7f977406fd80 2024-08-18T22:40:33.002 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:33.000+0000 7f977a241640 1 --2- 172.21.15.121:0/3696089920 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f977406fd80 0x7f97741134b0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f9770002a80 tx=0x7f9770004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:40:33.002 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:33.000+0000 7f976affd640 1 -- 172.21.15.121:0/3696089920 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9770007c30 con 0x7f977406fd80 2024-08-18T22:40:33.002 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:33.000+0000 7f977c4a5640 1 -- 172.21.15.121:0/3696089920 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9774114a80 con 0x7f977406fd80 2024-08-18T22:40:33.003 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:33.000+0000 7f977c4a5640 1 -- 172.21.15.121:0/3696089920 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9774114fa0 con 0x7f977406fd80 2024-08-18T22:40:33.003 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:33.000+0000 7f976affd640 1 -- 172.21.15.121:0/3696089920 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f977000f040 con 0x7f977406fd80 2024-08-18T22:40:33.003 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:33.000+0000 7f976affd640 1 -- 172.21.15.121:0/3696089920 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f977000db10 con 0x7f977406fd80 2024-08-18T22:40:33.003 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:33.001+0000 7f977c4a5640 1 -- 172.21.15.121:0/3696089920 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97740fb720 con 0x7f977406fd80 2024-08-18T22:40:33.003 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:33.002+0000 7f976affd640 1 -- 172.21.15.121:0/3696089920 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 19) v1 ==== 85127+0+0 (secure 0 0 0) 0x7f977000dc70 con 0x7f977406fd80 2024-08-18T22:40:33.004 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:33.003+0000 7f976affd640 1 --2- 172.21.15.121:0/3696089920 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7f9760067190 0x7f9760069640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:40:33.004 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:33.003+0000 7f976affd640 1 -- 172.21.15.121:0/3696089920 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f9770084830 con 0x7f977406fd80 2024-08-18T22:40:33.004 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:33.003+0000 7f9779a40640 1 --2- 172.21.15.121:0/3696089920 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7f9760067190 0x7f9760069640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:40:33.004 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:33.003+0000 7f9779a40640 1 --2- 172.21.15.121:0/3696089920 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7f9760067190 0x7f9760069640 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f9774113260 tx=0x7f9764035040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:40:33.008 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:33.007+0000 7f976affd640 1 -- 172.21.15.121:0/3696089920 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f9770051a60 con 0x7f977406fd80 2024-08-18T22:40:33.294 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:33.292+0000 7f977c4a5640 1 -- 172.21.15.121:0/3696089920 --> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f9774115280 con 0x7f9760067190 2024-08-18T22:40:33.295 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:33.294+0000 7f976affd640 1 -- 172.21.15.121:0/3696089920 <== mgr.14206 v2:172.21.15.121:6800/3225195982 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+447 (secure 0 0 0) 0x7f9774115280 con 0x7f9760067190 2024-08-18T22:40:33.299 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:33.297+0000 7f977c4a5640 1 -- 172.21.15.121:0/3696089920 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7f9760067190 msgr2=0x7f9760069640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:40:33.299 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:33.297+0000 7f977c4a5640 1 --2- 172.21.15.121:0/3696089920 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7f9760067190 0x7f9760069640 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f9774113260 tx=0x7f9764035040 comp rx=0 tx=0).stop 2024-08-18T22:40:33.299 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:33.297+0000 7f977c4a5640 1 -- 172.21.15.121:0/3696089920 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f977406fd80 msgr2=0x7f97741134b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:40:33.299 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:33.297+0000 7f977c4a5640 1 --2- 172.21.15.121:0/3696089920 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f977406fd80 0x7f97741134b0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f9770002a80 tx=0x7f9770004600 comp rx=0 tx=0).stop 2024-08-18T22:40:33.299 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:33.297+0000 7f977c4a5640 1 -- 172.21.15.121:0/3696089920 shutdown_connections 2024-08-18T22:40:33.300 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:33.297+0000 7f977c4a5640 1 --2- 172.21.15.121:0/3696089920 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7f9760067190 0x7f9760069640 secure :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f9774113260 tx=0x7f9764035040 comp rx=0 tx=0).stop 2024-08-18T22:40:33.300 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:33.297+0000 7f977c4a5640 1 --2- 172.21.15.121:0/3696089920 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9774071310 0x7f97741139f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:40:33.300 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:33.297+0000 7f977c4a5640 1 --2- 172.21.15.121:0/3696089920 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f977406fd80 0x7f97741134b0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:40:33.300 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:33.297+0000 7f977c4a5640 1 -- 172.21.15.121:0/3696089920 >> 172.21.15.121:0/3696089920 conn(0x7f97740f7a80 msgr2=0x7f97740f9230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:40:33.300 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:33.298+0000 7f977c4a5640 1 -- 172.21.15.121:0/3696089920 shutdown_connections 2024-08-18T22:40:33.300 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:33.298+0000 7f977c4a5640 1 -- 172.21.15.121:0/3696089920 wait complete. 2024-08-18T22:40:33.422 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:33.419+0000 7f98e6d2a640 1 -- 172.21.15.121:0/2660065061 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f98e00ff4e0 msgr2=0x7f98e01018c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:40:33.422 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:33.419+0000 7f98e6d2a640 1 --2- 172.21.15.121:0/2660065061 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f98e00ff4e0 0x7f98e01018c0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f98cc0048d0 tx=0x7f98cc009da0 comp rx=0 tx=0).stop 2024-08-18T22:40:33.422 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:33.419+0000 7f98e6d2a640 1 -- 172.21.15.121:0/2660065061 shutdown_connections 2024-08-18T22:40:33.423 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:33.419+0000 7f98e6d2a640 1 --2- 172.21.15.121:0/2660065061 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f98e00ff4e0 0x7f98e01018c0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:40:33.423 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:33.419+0000 7f98e6d2a640 1 --2- 172.21.15.121:0/2660065061 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f98e0065920 0x7f98e00fefa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:40:33.423 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:33.419+0000 7f98e6d2a640 1 -- 172.21.15.121:0/2660065061 >> 172.21.15.121:0/2660065061 conn(0x7f98e00f69b0 msgr2=0x7f98e00f8dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:40:33.423 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:33.420+0000 7f98e6d2a640 1 -- 172.21.15.121:0/2660065061 shutdown_connections 2024-08-18T22:40:33.423 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:33.420+0000 7f98e6d2a640 1 -- 172.21.15.121:0/2660065061 wait complete. 2024-08-18T22:40:33.423 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:33.420+0000 7f98e6d2a640 1 Processor -- start 2024-08-18T22:40:33.423 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:33.420+0000 7f98e6d2a640 1 -- start start 2024-08-18T22:40:33.423 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:33.421+0000 7f98e6d2a640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f98e0065920 0x7f98e010cc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:40:33.423 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:33.421+0000 7f98e6d2a640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f98e00ff4e0 0x7f98e010d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:40:33.423 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:33.421+0000 7f98e6d2a640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98e010d7e0 con 0x7f98e0065920 2024-08-18T22:40:33.424 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:33.421+0000 7f98e6d2a640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98e010dfb0 con 0x7f98e00ff4e0 2024-08-18T22:40:33.424 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:33.421+0000 7f98e4ac6640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f98e0065920 0x7f98e010cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:40:33.424 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:33.421+0000 7f98e4ac6640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f98e0065920 0x7f98e010cc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:52330/0 (socket says 172.21.15.121:52330) 2024-08-18T22:40:33.424 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:33.421+0000 7f98dffff640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f98e00ff4e0 0x7f98e010d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:40:33.424 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:33.421+0000 7f98e4ac6640 1 -- 172.21.15.121:0/4124462458 learned_addr learned my addr 172.21.15.121:0/4124462458 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-18T22:40:33.425 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:33.421+0000 7f98dffff640 1 -- 172.21.15.121:0/4124462458 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f98e0065920 msgr2=0x7f98e010cc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:40:33.425 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:33.421+0000 7f98dffff640 1 --2- 172.21.15.121:0/4124462458 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f98e0065920 0x7f98e010cc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:40:33.425 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:33.421+0000 7f98dffff640 1 -- 172.21.15.121:0/4124462458 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98cc005040 con 0x7f98e00ff4e0 2024-08-18T22:40:33.425 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:33.421+0000 7f98e4ac6640 1 --2- 172.21.15.121:0/4124462458 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f98e0065920 0x7f98e010cc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:40:33.425 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:33.422+0000 7f98dffff640 1 --2- 172.21.15.121:0/4124462458 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f98e00ff4e0 0x7f98e010d190 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f98cc02a530 tx=0x7f98cc009da0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:40:33.425 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:33.422+0000 7f98dd7fa640 1 -- 172.21.15.121:0/4124462458 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f98cc03c070 con 0x7f98e00ff4e0 2024-08-18T22:40:33.425 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:33.422+0000 7f98dd7fa640 1 -- 172.21.15.121:0/4124462458 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f98cc004290 con 0x7f98e00ff4e0 2024-08-18T22:40:33.425 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:33.422+0000 7f98e6d2a640 1 -- 172.21.15.121:0/4124462458 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98e010e1e0 con 0x7f98e00ff4e0 2024-08-18T22:40:33.426 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:33.422+0000 7f98dd7fa640 1 -- 172.21.15.121:0/4124462458 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f98cc032e30 con 0x7f98e00ff4e0 2024-08-18T22:40:33.426 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:33.422+0000 7f98e6d2a640 1 -- 172.21.15.121:0/4124462458 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98e010e5e0 con 0x7f98e00ff4e0 2024-08-18T22:40:33.426 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:33.424+0000 7f98dd7fa640 1 -- 172.21.15.121:0/4124462458 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 19) v1 ==== 85127+0+0 (secure 0 0 0) 0x7f98cc030020 con 0x7f98e00ff4e0 2024-08-18T22:40:33.426 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:33.425+0000 7f98dd7fa640 1 --2- 172.21.15.121:0/4124462458 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7f98d0067190 0x7f98d0069640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:40:33.427 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:33.425+0000 7f98dd7fa640 1 -- 172.21.15.121:0/4124462458 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f98cc0a9ef0 con 0x7f98e00ff4e0 2024-08-18T22:40:33.427 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:33.425+0000 7f98e4ac6640 1 --2- 172.21.15.121:0/4124462458 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7f98d0067190 0x7f98d0069640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:40:33.427 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:33.425+0000 7f98e6d2a640 1 -- 172.21.15.121:0/4124462458 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98e00fa630 con 0x7f98e00ff4e0 2024-08-18T22:40:33.427 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:33.426+0000 7f98e4ac6640 1 --2- 172.21.15.121:0/4124462458 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7f98d0067190 0x7f98d0069640 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f98d400f690 tx=0x7f98d400b040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:40:33.433 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:33.432+0000 7f98dd7fa640 1 -- 172.21.15.121:0/4124462458 <== mon.1 v2:172.21.15.195:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f98cc077150 con 0x7f98e00ff4e0 2024-08-18T22:40:33.770 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:33.769+0000 7f98e6d2a640 1 -- 172.21.15.121:0/4124462458 --> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f98e010e8b0 con 0x7f98d0067190 2024-08-18T22:40:33.785 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:33.784+0000 7f98dd7fa640 1 -- 172.21.15.121:0/4124462458 <== mgr.14206 v2:172.21.15.121:6800/3225195982 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f98e010e8b0 con 0x7f98d0067190 2024-08-18T22:40:33.785 INFO:teuthology.orchestra.run.smithi121.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-08-18T22:40:33.785 INFO:teuthology.orchestra.run.smithi121.stdout:alertmanager.smithi121 smithi121 *:9093,9094 running (5m) 59s ago 6m 24.7M - 0.25.0 c8568f914cd2 0e56a9950e47 2024-08-18T22:40:33.785 INFO:teuthology.orchestra.run.smithi121.stdout:crash.smithi121 smithi121 running (6m) 59s ago 6m 6899k - 17.2.7-1406-gdf62bdcc 774894bef55f cf3deea293c3 2024-08-18T22:40:33.786 INFO:teuthology.orchestra.run.smithi121.stdout:crash.smithi195 smithi195 running (5m) 66s ago 5m 6899k - 17.2.7-1406-gdf62bdcc 774894bef55f 98aa377daf77 2024-08-18T22:40:33.786 INFO:teuthology.orchestra.run.smithi121.stdout:grafana.smithi121 smithi121 *:3000 running (5m) 59s ago 6m 87.2M - 9.4.7 954c08fa6188 07c3d993780f 2024-08-18T22:40:33.786 INFO:teuthology.orchestra.run.smithi121.stdout:mds.cephfs.smithi121.gbickb smithi121 running (79s) 59s ago 78s 16.2M - 17.2.7-1406-gdf62bdcc 774894bef55f 484da0bc2c95 2024-08-18T22:40:33.786 INFO:teuthology.orchestra.run.smithi121.stdout:mds.cephfs.smithi121.xuzsdg smithi121 running (85s) 59s ago 84s 10.7M - 17.2.7-1406-gdf62bdcc 774894bef55f 6976b708cdcd 2024-08-18T22:40:33.786 INFO:teuthology.orchestra.run.smithi121.stdout:mds.cephfs.smithi195.buqvbr smithi195 running (82s) 66s ago 82s 15.5M - 17.2.7-1406-gdf62bdcc 774894bef55f 11a3703b4276 2024-08-18T22:40:33.786 INFO:teuthology.orchestra.run.smithi121.stdout:mds.cephfs.smithi195.nptgyc smithi195 running (76s) 66s ago 75s 15.0M - 17.2.7-1406-gdf62bdcc 774894bef55f b9f8043ea83e 2024-08-18T22:40:33.786 INFO:teuthology.orchestra.run.smithi121.stdout:mgr.smithi121.lopxqc smithi121 *:9283,8765,8443 running (7m) 59s ago 7m 447M - 17.2.7-1406-gdf62bdcc 774894bef55f 3ac16dcb26e3 2024-08-18T22:40:33.786 INFO:teuthology.orchestra.run.smithi121.stdout:mgr.smithi195.acttsj smithi195 *:8443,9283 running (5m) 66s ago 5m 402M - 17.2.7-1406-gdf62bdcc 774894bef55f 3d19eb0493d5 2024-08-18T22:40:33.786 INFO:teuthology.orchestra.run.smithi121.stdout:mon.smithi121 smithi121 running (7m) 59s ago 7m 51.2M 2048M 17.2.7-1406-gdf62bdcc 774894bef55f 4a7bead235ac 2024-08-18T22:40:33.786 INFO:teuthology.orchestra.run.smithi121.stdout:mon.smithi195 smithi195 running (5m) 66s ago 5m 42.0M 2048M 17.2.7-1406-gdf62bdcc 774894bef55f ced63ecfbfae 2024-08-18T22:40:33.786 INFO:teuthology.orchestra.run.smithi121.stdout:node-exporter.smithi121 smithi121 *:9100 running (6m) 59s ago 6m 16.9M - 1.5.0 0da6a335fe13 81d394827425 2024-08-18T22:40:33.786 INFO:teuthology.orchestra.run.smithi121.stdout:node-exporter.smithi195 smithi195 *:9100 running (5m) 66s ago 5m 16.2M - 1.5.0 0da6a335fe13 e09a01163b83 2024-08-18T22:40:33.786 INFO:teuthology.orchestra.run.smithi121.stdout:osd.0 smithi121 running (4m) 59s ago 4m 47.2M 4287M 17.2.7-1406-gdf62bdcc 774894bef55f 30859216633d 2024-08-18T22:40:33.787 INFO:teuthology.orchestra.run.smithi121.stdout:osd.1 smithi121 running (4m) 59s ago 4m 49.1M 4287M 17.2.7-1406-gdf62bdcc 774894bef55f ef5fadfd753f 2024-08-18T22:40:33.787 INFO:teuthology.orchestra.run.smithi121.stdout:osd.2 smithi121 running (3m) 59s ago 3m 43.6M 4287M 17.2.7-1406-gdf62bdcc 774894bef55f 3fa061e41f99 2024-08-18T22:40:33.787 INFO:teuthology.orchestra.run.smithi121.stdout:osd.3 smithi195 running (3m) 66s ago 3m 46.2M 5312M 17.2.7-1406-gdf62bdcc 774894bef55f 15d30b1b459e 2024-08-18T22:40:33.787 INFO:teuthology.orchestra.run.smithi121.stdout:osd.4 smithi195 running (3m) 66s ago 3m 42.2M 5312M 17.2.7-1406-gdf62bdcc 774894bef55f 99ed156dfd36 2024-08-18T22:40:33.787 INFO:teuthology.orchestra.run.smithi121.stdout:osd.5 smithi195 running (2m) 66s ago 2m 44.1M 5312M 17.2.7-1406-gdf62bdcc 774894bef55f e7eff7bdb752 2024-08-18T22:40:33.787 INFO:teuthology.orchestra.run.smithi121.stdout:prometheus.smithi121 smithi121 *:9095 running (4m) 59s ago 6m 56.2M - 2.43.0 a07b618ecd1d d6016f1b45a3 2024-08-18T22:40:33.788 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:33.787+0000 7f98e6d2a640 1 -- 172.21.15.121:0/4124462458 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7f98d0067190 msgr2=0x7f98d0069640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:40:33.788 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:33.787+0000 7f98e6d2a640 1 --2- 172.21.15.121:0/4124462458 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7f98d0067190 0x7f98d0069640 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f98d400f690 tx=0x7f98d400b040 comp rx=0 tx=0).stop 2024-08-18T22:40:33.789 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:33.787+0000 7f98e6d2a640 1 -- 172.21.15.121:0/4124462458 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f98e00ff4e0 msgr2=0x7f98e010d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:40:33.789 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:33.787+0000 7f98e6d2a640 1 --2- 172.21.15.121:0/4124462458 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f98e00ff4e0 0x7f98e010d190 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f98cc02a530 tx=0x7f98cc009da0 comp rx=0 tx=0).stop 2024-08-18T22:40:33.789 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:33.787+0000 7f98e6d2a640 1 -- 172.21.15.121:0/4124462458 shutdown_connections 2024-08-18T22:40:33.789 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:33.787+0000 7f98e6d2a640 1 --2- 172.21.15.121:0/4124462458 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7f98d0067190 0x7f98d0069640 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:40:33.789 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:33.787+0000 7f98e6d2a640 1 --2- 172.21.15.121:0/4124462458 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f98e00ff4e0 0x7f98e010d190 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:40:33.789 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:33.787+0000 7f98e6d2a640 1 --2- 172.21.15.121:0/4124462458 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f98e0065920 0x7f98e010cc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:40:33.789 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:33.787+0000 7f98e6d2a640 1 -- 172.21.15.121:0/4124462458 >> 172.21.15.121:0/4124462458 conn(0x7f98e00f69b0 msgr2=0x7f98e00f6d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:40:33.789 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:33.787+0000 7f98e6d2a640 1 -- 172.21.15.121:0/4124462458 shutdown_connections 2024-08-18T22:40:33.789 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:33.787+0000 7f98e6d2a640 1 -- 172.21.15.121:0/4124462458 wait complete. 2024-08-18T22:40:33.906 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:33.904+0000 7f4ca7d07640 1 -- 172.21.15.121:0/1512885048 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4ca00fb1d0 msgr2=0x7f4ca00fb5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:40:33.906 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:33.904+0000 7f4ca7d07640 1 --2- 172.21.15.121:0/1512885048 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4ca00fb1d0 0x7f4ca00fb5e0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f4c9c0048d0 tx=0x7f4c9c009da0 comp rx=0 tx=0).stop 2024-08-18T22:40:33.906 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:33.904+0000 7f4ca7d07640 1 -- 172.21.15.121:0/1512885048 shutdown_connections 2024-08-18T22:40:33.906 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:33.904+0000 7f4ca7d07640 1 --2- 172.21.15.121:0/1512885048 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4ca00fc4a0 0x7f4ca00fc910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:40:33.906 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:33.904+0000 7f4ca7d07640 1 --2- 172.21.15.121:0/1512885048 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4ca00fb1d0 0x7f4ca00fb5e0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:40:33.907 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:33.904+0000 7f4ca7d07640 1 -- 172.21.15.121:0/1512885048 >> 172.21.15.121:0/1512885048 conn(0x7f4ca00f69b0 msgr2=0x7f4ca00f8dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:40:33.907 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:40:33 smithi121 ceph-mon[16788]: pgmap v212: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-08-18T22:40:33.907 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:40:33 smithi121 ceph-mon[16788]: from='client.14572 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-18T22:40:33.909 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:33.905+0000 7f4ca7d07640 1 -- 172.21.15.121:0/1512885048 shutdown_connections 2024-08-18T22:40:33.909 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:33.905+0000 7f4ca7d07640 1 -- 172.21.15.121:0/1512885048 wait complete. 2024-08-18T22:40:33.909 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:33.905+0000 7f4ca7d07640 1 Processor -- start 2024-08-18T22:40:33.909 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:33.906+0000 7f4ca7d07640 1 -- start start 2024-08-18T22:40:33.909 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:33.906+0000 7f4ca7d07640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4ca00fb1d0 0x7f4ca00ff2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:40:33.909 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:33.906+0000 7f4ca7d07640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4ca00fc4a0 0x7f4ca00fd7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:40:33.910 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:33.906+0000 7f4ca7d07640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ca00fdd70 con 0x7f4ca00fc4a0 2024-08-18T22:40:33.910 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:33.906+0000 7f4ca7d07640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ca00fdeb0 con 0x7f4ca00fb1d0 2024-08-18T22:40:33.910 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:33.906+0000 7f4ca5aa3640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4ca00fb1d0 0x7f4ca00ff2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:40:33.910 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:33.906+0000 7f4ca5aa3640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4ca00fb1d0 0x7f4ca00ff2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.121:59944/0 (socket says 172.21.15.121:59944) 2024-08-18T22:40:33.910 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:33.906+0000 7f4ca5aa3640 1 -- 172.21.15.121:0/1201761492 learned_addr learned my addr 172.21.15.121:0/1201761492 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-18T22:40:33.910 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:33.906+0000 7f4ca52a2640 1 --2- 172.21.15.121:0/1201761492 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4ca00fc4a0 0x7f4ca00fd7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:40:33.910 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:33.907+0000 7f4ca5aa3640 1 -- 172.21.15.121:0/1201761492 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4ca00fc4a0 msgr2=0x7f4ca00fd7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:40:33.910 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:33.907+0000 7f4ca5aa3640 1 --2- 172.21.15.121:0/1201761492 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4ca00fc4a0 0x7f4ca00fd7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:40:33.910 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:33.907+0000 7f4ca5aa3640 1 -- 172.21.15.121:0/1201761492 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c9c005040 con 0x7f4ca00fb1d0 2024-08-18T22:40:33.910 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:33.907+0000 7f4ca5aa3640 1 --2- 172.21.15.121:0/1201761492 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4ca00fb1d0 0x7f4ca00ff2f0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f4c9c0048a0 tx=0x7f4c9c009da0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:40:33.910 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:33.907+0000 7f4c967fc640 1 -- 172.21.15.121:0/1201761492 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4c9c038070 con 0x7f4ca00fb1d0 2024-08-18T22:40:33.910 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:33.907+0000 7f4c967fc640 1 -- 172.21.15.121:0/1201761492 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f4c9c004290 con 0x7f4ca00fb1d0 2024-08-18T22:40:33.910 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:33.907+0000 7f4c967fc640 1 -- 172.21.15.121:0/1201761492 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4c9c033660 con 0x7f4ca00fb1d0 2024-08-18T22:40:33.911 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:33.907+0000 7f4ca7d07640 1 -- 172.21.15.121:0/1201761492 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ca00fe130 con 0x7f4ca00fb1d0 2024-08-18T22:40:33.911 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:33.908+0000 7f4ca7d07640 1 -- 172.21.15.121:0/1201761492 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ca0114e70 con 0x7f4ca00fb1d0 2024-08-18T22:40:33.912 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:40:33 smithi195 ceph-mon[23370]: pgmap v212: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-08-18T22:40:33.912 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:40:33 smithi195 ceph-mon[23370]: from='client.14572 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-18T22:40:33.912 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:33.909+0000 7f4ca7d07640 1 -- 172.21.15.121:0/1201761492 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ca00fa630 con 0x7f4ca00fb1d0 2024-08-18T22:40:33.912 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:33.910+0000 7f4c967fc640 1 -- 172.21.15.121:0/1201761492 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 19) v1 ==== 85127+0+0 (secure 0 0 0) 0x7f4c9c030020 con 0x7f4ca00fb1d0 2024-08-18T22:40:33.912 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:33.910+0000 7f4c967fc640 1 --2- 172.21.15.121:0/1201761492 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7f4c8c067190 0x7f4c8c069640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:40:33.913 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:33.910+0000 7f4c967fc640 1 -- 172.21.15.121:0/1201761492 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f4c9c0a4c10 con 0x7f4ca00fb1d0 2024-08-18T22:40:33.913 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:33.911+0000 7f4ca52a2640 1 --2- 172.21.15.121:0/1201761492 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7f4c8c067190 0x7f4c8c069640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:40:33.913 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:33.911+0000 7f4ca52a2640 1 --2- 172.21.15.121:0/1201761492 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7f4c8c067190 0x7f4c8c069640 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f4c90009af0 tx=0x7f4c9000b040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:40:33.919 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:33.918+0000 7f4c967fc640 1 -- 172.21.15.121:0/1201761492 <== mon.1 v2:172.21.15.195:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f4c9c071f30 con 0x7f4ca00fb1d0 2024-08-18T22:40:34.146 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:34.145+0000 7f4ca7d07640 1 -- 172.21.15.121:0/1201761492 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f4ca0103cf0 con 0x7f4ca00fb1d0 2024-08-18T22:40:34.147 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:34.146+0000 7f4c967fc640 1 -- 172.21.15.121:0/1201761492 <== mon.1 v2:172.21.15.195:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+643 (secure 0 0 0) 0x7f4c9c02c870 con 0x7f4ca00fb1d0 2024-08-18T22:40:34.147 INFO:teuthology.orchestra.run.smithi121.stdout:{ 2024-08-18T22:40:34.147 INFO:teuthology.orchestra.run.smithi121.stdout: "mon": { 2024-08-18T22:40:34.147 INFO:teuthology.orchestra.run.smithi121.stdout: "ceph version 17.2.7-1406-gdf62bdcc (df62bdccd9a13bf566b27a250eddfdd89be3072d) quincy (stable)": 2 2024-08-18T22:40:34.147 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-18T22:40:34.147 INFO:teuthology.orchestra.run.smithi121.stdout: "mgr": { 2024-08-18T22:40:34.147 INFO:teuthology.orchestra.run.smithi121.stdout: "ceph version 17.2.7-1406-gdf62bdcc (df62bdccd9a13bf566b27a250eddfdd89be3072d) quincy (stable)": 2 2024-08-18T22:40:34.148 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-18T22:40:34.148 INFO:teuthology.orchestra.run.smithi121.stdout: "osd": { 2024-08-18T22:40:34.148 INFO:teuthology.orchestra.run.smithi121.stdout: "ceph version 17.2.7-1406-gdf62bdcc (df62bdccd9a13bf566b27a250eddfdd89be3072d) quincy (stable)": 6 2024-08-18T22:40:34.148 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-18T22:40:34.148 INFO:teuthology.orchestra.run.smithi121.stdout: "mds": { 2024-08-18T22:40:34.148 INFO:teuthology.orchestra.run.smithi121.stdout: "ceph version 17.2.7-1406-gdf62bdcc (df62bdccd9a13bf566b27a250eddfdd89be3072d) quincy (stable)": 4 2024-08-18T22:40:34.148 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-18T22:40:34.148 INFO:teuthology.orchestra.run.smithi121.stdout: "overall": { 2024-08-18T22:40:34.148 INFO:teuthology.orchestra.run.smithi121.stdout: "ceph version 17.2.7-1406-gdf62bdcc (df62bdccd9a13bf566b27a250eddfdd89be3072d) quincy (stable)": 14 2024-08-18T22:40:34.148 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-08-18T22:40:34.148 INFO:teuthology.orchestra.run.smithi121.stdout:} 2024-08-18T22:40:34.150 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:34.149+0000 7f4ca7d07640 1 -- 172.21.15.121:0/1201761492 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7f4c8c067190 msgr2=0x7f4c8c069640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:40:34.150 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:34.149+0000 7f4ca7d07640 1 --2- 172.21.15.121:0/1201761492 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7f4c8c067190 0x7f4c8c069640 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f4c90009af0 tx=0x7f4c9000b040 comp rx=0 tx=0).stop 2024-08-18T22:40:34.150 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:34.149+0000 7f4ca7d07640 1 -- 172.21.15.121:0/1201761492 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4ca00fb1d0 msgr2=0x7f4ca00ff2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:40:34.150 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:34.149+0000 7f4ca7d07640 1 --2- 172.21.15.121:0/1201761492 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4ca00fb1d0 0x7f4ca00ff2f0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f4c9c0048a0 tx=0x7f4c9c009da0 comp rx=0 tx=0).stop 2024-08-18T22:40:34.150 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:34.149+0000 7f4ca7d07640 1 -- 172.21.15.121:0/1201761492 shutdown_connections 2024-08-18T22:40:34.150 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:34.149+0000 7f4ca7d07640 1 --2- 172.21.15.121:0/1201761492 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7f4c8c067190 0x7f4c8c069640 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:40:34.150 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:34.149+0000 7f4ca7d07640 1 --2- 172.21.15.121:0/1201761492 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4ca00fc4a0 0x7f4ca00fd7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:40:34.150 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:34.149+0000 7f4ca7d07640 1 --2- 172.21.15.121:0/1201761492 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4ca00fb1d0 0x7f4ca00ff2f0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:40:34.150 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:34.149+0000 7f4ca7d07640 1 -- 172.21.15.121:0/1201761492 >> 172.21.15.121:0/1201761492 conn(0x7f4ca00f69b0 msgr2=0x7f4ca00653e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:40:34.151 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:34.149+0000 7f4ca7d07640 1 -- 172.21.15.121:0/1201761492 shutdown_connections 2024-08-18T22:40:34.151 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:34.149+0000 7f4ca7d07640 1 -- 172.21.15.121:0/1201761492 wait complete. 2024-08-18T22:40:34.263 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:34.261+0000 7f5d9e987640 1 -- 172.21.15.121:0/3753719653 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5d98066450 msgr2=0x7f5d980fef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:40:34.263 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:34.261+0000 7f5d9e987640 1 --2- 172.21.15.121:0/3753719653 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5d98066450 0x7f5d980fef60 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f5d880048d0 tx=0x7f5d88009da0 comp rx=0 tx=0).stop 2024-08-18T22:40:34.263 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:34.262+0000 7f5d9e987640 1 -- 172.21.15.121:0/3753719653 shutdown_connections 2024-08-18T22:40:34.263 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:34.262+0000 7f5d9e987640 1 --2- 172.21.15.121:0/3753719653 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5d980ff4a0 0x7f5d98101880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:40:34.263 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:34.262+0000 7f5d9e987640 1 --2- 172.21.15.121:0/3753719653 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5d98066450 0x7f5d980fef60 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:40:34.263 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:34.262+0000 7f5d9e987640 1 -- 172.21.15.121:0/3753719653 >> 172.21.15.121:0/3753719653 conn(0x7f5d980f69b0 msgr2=0x7f5d980f8de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:40:34.263 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:34.262+0000 7f5d9e987640 1 -- 172.21.15.121:0/3753719653 shutdown_connections 2024-08-18T22:40:34.263 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:34.262+0000 7f5d9e987640 1 -- 172.21.15.121:0/3753719653 wait complete. 2024-08-18T22:40:34.264 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:34.262+0000 7f5d9e987640 1 Processor -- start 2024-08-18T22:40:34.264 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:34.263+0000 7f5d9e987640 1 -- start start 2024-08-18T22:40:34.264 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:34.263+0000 7f5d9e987640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5d98066450 0x7f5d980fc920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:40:34.264 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:34.263+0000 7f5d9e987640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5d980ff4a0 0x7f5d980fae60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:40:34.264 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:34.263+0000 7f5d9e987640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d98110b80 con 0x7f5d980ff4a0 2024-08-18T22:40:34.264 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:34.263+0000 7f5d9e987640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d98110cc0 con 0x7f5d98066450 2024-08-18T22:40:34.264 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:34.263+0000 7f5d97fff640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5d98066450 0x7f5d980fc920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:40:34.264 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:34.263+0000 7f5d97fff640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5d98066450 0x7f5d980fc920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.121:59962/0 (socket says 172.21.15.121:59962) 2024-08-18T22:40:34.265 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:34.263+0000 7f5d97fff640 1 -- 172.21.15.121:0/3367420493 learned_addr learned my addr 172.21.15.121:0/3367420493 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-18T22:40:34.265 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:34.263+0000 7f5d977fe640 1 --2- 172.21.15.121:0/3367420493 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5d980ff4a0 0x7f5d980fae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:40:34.265 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:34.264+0000 7f5d97fff640 1 -- 172.21.15.121:0/3367420493 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5d980ff4a0 msgr2=0x7f5d980fae60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:40:34.265 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:34.264+0000 7f5d97fff640 1 --2- 172.21.15.121:0/3367420493 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5d980ff4a0 0x7f5d980fae60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:40:34.265 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:34.264+0000 7f5d97fff640 1 -- 172.21.15.121:0/3367420493 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d88005040 con 0x7f5d98066450 2024-08-18T22:40:34.265 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:34.264+0000 7f5d97fff640 1 --2- 172.21.15.121:0/3367420493 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5d98066450 0x7f5d980fc920 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f5d88009ac0 tx=0x7f5d88009da0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:40:34.266 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:34.264+0000 7f5d94ff9640 1 -- 172.21.15.121:0/3367420493 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5d88038070 con 0x7f5d98066450 2024-08-18T22:40:34.266 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:34.264+0000 7f5d9e987640 1 -- 172.21.15.121:0/3367420493 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d980fb3a0 con 0x7f5d98066450 2024-08-18T22:40:34.266 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:34.264+0000 7f5d94ff9640 1 -- 172.21.15.121:0/3367420493 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f5d88004290 con 0x7f5d98066450 2024-08-18T22:40:34.266 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:34.264+0000 7f5d9e987640 1 -- 172.21.15.121:0/3367420493 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d980fb910 con 0x7f5d98066450 2024-08-18T22:40:34.266 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:34.264+0000 7f5d94ff9640 1 -- 172.21.15.121:0/3367420493 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5d8803eb60 con 0x7f5d98066450 2024-08-18T22:40:34.267 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:34.266+0000 7f5d9e987640 1 -- 172.21.15.121:0/3367420493 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d980fa650 con 0x7f5d98066450 2024-08-18T22:40:34.267 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:34.266+0000 7f5d94ff9640 1 -- 172.21.15.121:0/3367420493 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 19) v1 ==== 85127+0+0 (secure 0 0 0) 0x7f5d88030020 con 0x7f5d98066450 2024-08-18T22:40:34.268 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:34.267+0000 7f5d94ff9640 1 --2- 172.21.15.121:0/3367420493 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7f5d80067190 0x7f5d80069640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:40:34.268 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:34.267+0000 7f5d94ff9640 1 -- 172.21.15.121:0/3367420493 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f5d880a4e60 con 0x7f5d98066450 2024-08-18T22:40:34.268 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:34.267+0000 7f5d977fe640 1 --2- 172.21.15.121:0/3367420493 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7f5d80067190 0x7f5d80069640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:40:34.268 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:34.267+0000 7f5d977fe640 1 --2- 172.21.15.121:0/3367420493 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7f5d80067190 0x7f5d80069640 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f5d8c009af0 tx=0x7f5d8c00b040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:40:34.273 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:34.272+0000 7f5d94ff9640 1 -- 172.21.15.121:0/3367420493 <== mon.1 v2:172.21.15.195:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f5d88072130 con 0x7f5d98066450 2024-08-18T22:40:34.516 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:34.515+0000 7f5d9e987640 1 -- 172.21.15.121:0/3367420493 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f5d98104e20 con 0x7f5d98066450 2024-08-18T22:40:34.517 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:34.515+0000 7f5d94ff9640 1 -- 172.21.15.121:0/3367420493 <== mon.1 v2:172.21.15.195:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 17 v17) v1 ==== 76+0+1818 (secure 0 0 0) 0x7f5d88009740 con 0x7f5d98066450 2024-08-18T22:40:34.517 INFO:teuthology.orchestra.run.smithi121.stdout:e17 2024-08-18T22:40:34.517 INFO:teuthology.orchestra.run.smithi121.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-08-18T22:40:34.517 INFO:teuthology.orchestra.run.smithi121.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-08-18T22:40:34.517 INFO:teuthology.orchestra.run.smithi121.stdout:legacy client fscid: 1 2024-08-18T22:40:34.517 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-08-18T22:40:34.517 INFO:teuthology.orchestra.run.smithi121.stdout:Filesystem 'cephfs' (1) 2024-08-18T22:40:34.518 INFO:teuthology.orchestra.run.smithi121.stdout:fs_name cephfs 2024-08-18T22:40:34.518 INFO:teuthology.orchestra.run.smithi121.stdout:epoch 17 2024-08-18T22:40:34.518 INFO:teuthology.orchestra.run.smithi121.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-08-18T22:40:34.518 INFO:teuthology.orchestra.run.smithi121.stdout:created 2024-08-18T22:39:04.054074+0000 2024-08-18T22:40:34.518 INFO:teuthology.orchestra.run.smithi121.stdout:modified 2024-08-18T22:39:23.955493+0000 2024-08-18T22:40:34.518 INFO:teuthology.orchestra.run.smithi121.stdout:tableserver 0 2024-08-18T22:40:34.518 INFO:teuthology.orchestra.run.smithi121.stdout:root 0 2024-08-18T22:40:34.518 INFO:teuthology.orchestra.run.smithi121.stdout:session_timeout 60 2024-08-18T22:40:34.518 INFO:teuthology.orchestra.run.smithi121.stdout:session_autoclose 300 2024-08-18T22:40:34.518 INFO:teuthology.orchestra.run.smithi121.stdout:max_file_size 1099511627776 2024-08-18T22:40:34.518 INFO:teuthology.orchestra.run.smithi121.stdout:required_client_features {} 2024-08-18T22:40:34.519 INFO:teuthology.orchestra.run.smithi121.stdout:last_failure 0 2024-08-18T22:40:34.519 INFO:teuthology.orchestra.run.smithi121.stdout:last_failure_osd_epoch 47 2024-08-18T22:40:34.519 INFO:teuthology.orchestra.run.smithi121.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-08-18T22:40:34.519 INFO:teuthology.orchestra.run.smithi121.stdout:max_mds 2 2024-08-18T22:40:34.519 INFO:teuthology.orchestra.run.smithi121.stdout:in 0,1 2024-08-18T22:40:34.519 INFO:teuthology.orchestra.run.smithi121.stdout:up {0=14474,1=24249} 2024-08-18T22:40:34.519 INFO:teuthology.orchestra.run.smithi121.stdout:failed 2024-08-18T22:40:34.519 INFO:teuthology.orchestra.run.smithi121.stdout:damaged 2024-08-18T22:40:34.519 INFO:teuthology.orchestra.run.smithi121.stdout:stopped 2024-08-18T22:40:34.519 INFO:teuthology.orchestra.run.smithi121.stdout:data_pools [3] 2024-08-18T22:40:34.519 INFO:teuthology.orchestra.run.smithi121.stdout:metadata_pool 2 2024-08-18T22:40:34.519 INFO:teuthology.orchestra.run.smithi121.stdout:inline_data disabled 2024-08-18T22:40:34.519 INFO:teuthology.orchestra.run.smithi121.stdout:balancer 2024-08-18T22:40:34.519 INFO:teuthology.orchestra.run.smithi121.stdout:standby_count_wanted 1 2024-08-18T22:40:34.520 INFO:teuthology.orchestra.run.smithi121.stdout:[mds.cephfs.smithi121.gbickb{0:14474} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.121:6828/2277706406,v1:172.21.15.121:6829/2277706406] compat {c=[1],r=[1],i=[7ff]}] 2024-08-18T22:40:34.520 INFO:teuthology.orchestra.run.smithi121.stdout:[mds.cephfs.smithi195.buqvbr{1:24249} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.195:6824/2414511859,v1:172.21.15.195:6825/2414511859] compat {c=[1],r=[1],i=[7ff]}] 2024-08-18T22:40:34.520 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-08-18T22:40:34.520 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-08-18T22:40:34.520 INFO:teuthology.orchestra.run.smithi121.stdout:Standby daemons: 2024-08-18T22:40:34.520 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-08-18T22:40:34.520 INFO:teuthology.orchestra.run.smithi121.stdout:[mds.cephfs.smithi121.xuzsdg{-1:14490} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.121:6826/91588128,v1:172.21.15.121:6827/91588128] compat {c=[1],r=[1],i=[7ff]}] 2024-08-18T22:40:34.520 INFO:teuthology.orchestra.run.smithi121.stdout:[mds.cephfs.smithi195.nptgyc{-1:24259} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.195:6826/238549847,v1:172.21.15.195:6827/238549847] compat {c=[1],r=[1],i=[7ff]}] 2024-08-18T22:40:34.521 INFO:teuthology.orchestra.run.smithi121.stderr:dumped fsmap epoch 17 2024-08-18T22:40:34.522 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:34.517+0000 7f5d9e987640 1 -- 172.21.15.121:0/3367420493 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7f5d80067190 msgr2=0x7f5d80069640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:40:34.522 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:34.517+0000 7f5d9e987640 1 --2- 172.21.15.121:0/3367420493 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7f5d80067190 0x7f5d80069640 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f5d8c009af0 tx=0x7f5d8c00b040 comp rx=0 tx=0).stop 2024-08-18T22:40:34.522 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:34.517+0000 7f5d9e987640 1 -- 172.21.15.121:0/3367420493 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5d98066450 msgr2=0x7f5d980fc920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:40:34.522 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:34.517+0000 7f5d9e987640 1 --2- 172.21.15.121:0/3367420493 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5d98066450 0x7f5d980fc920 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f5d88009ac0 tx=0x7f5d88009da0 comp rx=0 tx=0).stop 2024-08-18T22:40:34.522 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:34.518+0000 7f5d9e987640 1 -- 172.21.15.121:0/3367420493 shutdown_connections 2024-08-18T22:40:34.522 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:34.518+0000 7f5d9e987640 1 --2- 172.21.15.121:0/3367420493 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7f5d80067190 0x7f5d80069640 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:40:34.522 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:34.518+0000 7f5d9e987640 1 --2- 172.21.15.121:0/3367420493 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5d980ff4a0 0x7f5d980fae60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:40:34.522 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:34.518+0000 7f5d9e987640 1 --2- 172.21.15.121:0/3367420493 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5d98066450 0x7f5d980fc920 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:40:34.523 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:34.518+0000 7f5d9e987640 1 -- 172.21.15.121:0/3367420493 >> 172.21.15.121:0/3367420493 conn(0x7f5d980f69b0 msgr2=0x7f5d980f6dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:40:34.523 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:34.518+0000 7f5d9e987640 1 -- 172.21.15.121:0/3367420493 shutdown_connections 2024-08-18T22:40:34.523 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:34.518+0000 7f5d9e987640 1 -- 172.21.15.121:0/3367420493 wait complete. 2024-08-18T22:40:34.600 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:34.599+0000 7f67bc0de640 1 -- 172.21.15.121:0/1122657891 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f67b40659e0 msgr2=0x7f67b40feee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:40:34.600 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:34.599+0000 7f67bc0de640 1 --2- 172.21.15.121:0/1122657891 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f67b40659e0 0x7f67b40feee0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f67b00048d0 tx=0x7f67b0009da0 comp rx=0 tx=0).stop 2024-08-18T22:40:34.601 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:34.599+0000 7f67bc0de640 1 -- 172.21.15.121:0/1122657891 shutdown_connections 2024-08-18T22:40:34.601 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:34.599+0000 7f67bc0de640 1 --2- 172.21.15.121:0/1122657891 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f67b40ff420 0x7f67b4101800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:40:34.601 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:34.599+0000 7f67bc0de640 1 --2- 172.21.15.121:0/1122657891 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f67b40659e0 0x7f67b40feee0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:40:34.601 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:34.599+0000 7f67bc0de640 1 -- 172.21.15.121:0/1122657891 >> 172.21.15.121:0/1122657891 conn(0x7f67b40f69b0 msgr2=0x7f67b40f8dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:40:34.602 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:34.600+0000 7f67bc0de640 1 -- 172.21.15.121:0/1122657891 shutdown_connections 2024-08-18T22:40:34.602 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:34.600+0000 7f67bc0de640 1 -- 172.21.15.121:0/1122657891 wait complete. 2024-08-18T22:40:34.602 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:34.600+0000 7f67bc0de640 1 Processor -- start 2024-08-18T22:40:34.602 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:34.600+0000 7f67bc0de640 1 -- start start 2024-08-18T22:40:34.602 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:34.601+0000 7f67bc0de640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f67b40659e0 0x7f67b410cf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:40:34.602 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:34.601+0000 7f67bc0de640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f67b40ff420 0x7f67b410d470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:40:34.602 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:34.601+0000 7f67bc0de640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67b410e150 con 0x7f67b40659e0 2024-08-18T22:40:34.602 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:34.601+0000 7f67bc0de640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67b410e2c0 con 0x7f67b40ff420 2024-08-18T22:40:34.602 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:34.601+0000 7f67b9679640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f67b40ff420 0x7f67b410d470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:40:34.602 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:34.601+0000 7f67b9679640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f67b40ff420 0x7f67b410d470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.121:59984/0 (socket says 172.21.15.121:59984) 2024-08-18T22:40:34.602 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:34.601+0000 7f67b9e7a640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f67b40659e0 0x7f67b410cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:40:34.603 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:34.601+0000 7f67b9679640 1 -- 172.21.15.121:0/1954681627 learned_addr learned my addr 172.21.15.121:0/1954681627 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-18T22:40:34.603 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:34.601+0000 7f67b9679640 1 -- 172.21.15.121:0/1954681627 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f67b40659e0 msgr2=0x7f67b410cf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:40:34.603 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:34.601+0000 7f67b9679640 1 --2- 172.21.15.121:0/1954681627 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f67b40659e0 0x7f67b410cf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:40:34.603 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:34.601+0000 7f67b9679640 1 -- 172.21.15.121:0/1954681627 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67b0005040 con 0x7f67b40ff420 2024-08-18T22:40:34.603 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:34.601+0000 7f67b9e7a640 1 --2- 172.21.15.121:0/1954681627 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f67b40659e0 0x7f67b410cf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:40:34.604 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:34.602+0000 7f67b9679640 1 --2- 172.21.15.121:0/1954681627 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f67b40ff420 0x7f67b410d470 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f67a800eb70 tx=0x7f67a800b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:40:34.604 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:34.602+0000 7f67a67fc640 1 -- 172.21.15.121:0/1954681627 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f67a8007c30 con 0x7f67b40ff420 2024-08-18T22:40:34.604 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:34.602+0000 7f67a67fc640 1 -- 172.21.15.121:0/1954681627 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f67a800f040 con 0x7f67b40ff420 2024-08-18T22:40:34.604 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:34.602+0000 7f67bc0de640 1 -- 172.21.15.121:0/1954681627 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67b410e540 con 0x7f67b40ff420 2024-08-18T22:40:34.604 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:34.602+0000 7f67a67fc640 1 -- 172.21.15.121:0/1954681627 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f67a8009550 con 0x7f67b40ff420 2024-08-18T22:40:34.604 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:34.602+0000 7f67bc0de640 1 -- 172.21.15.121:0/1954681627 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67b410eae0 con 0x7f67b40ff420 2024-08-18T22:40:34.604 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:34.603+0000 7f67a67fc640 1 -- 172.21.15.121:0/1954681627 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 19) v1 ==== 85127+0+0 (secure 0 0 0) 0x7f67a80097c0 con 0x7f67b40ff420 2024-08-18T22:40:34.605 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:34.604+0000 7f67bc0de640 1 -- 172.21.15.121:0/1954681627 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67b40fa630 con 0x7f67b40ff420 2024-08-18T22:40:34.605 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:34.604+0000 7f67a67fc640 1 --2- 172.21.15.121:0/1954681627 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7f67a0067190 0x7f67a0069640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:40:34.605 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:34.604+0000 7f67a67fc640 1 -- 172.21.15.121:0/1954681627 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f67a8084880 con 0x7f67b40ff420 2024-08-18T22:40:34.605 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:34.604+0000 7f67b9e7a640 1 --2- 172.21.15.121:0/1954681627 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7f67a0067190 0x7f67a0069640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:40:34.606 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:34.605+0000 7f67b9e7a640 1 --2- 172.21.15.121:0/1954681627 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7f67a0067190 0x7f67a0069640 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f67b0000c00 tx=0x7f67b0035040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:40:34.612 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:34.611+0000 7f67a67fc640 1 -- 172.21.15.121:0/1954681627 <== mon.1 v2:172.21.15.195:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f67a804e2a0 con 0x7f67b40ff420 2024-08-18T22:40:34.790 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:34.789+0000 7f67bc0de640 1 -- 172.21.15.121:0/1954681627 --> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f67b410ecc0 con 0x7f67a0067190 2024-08-18T22:40:34.791 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:40:34 smithi121 ceph-mon[16788]: from='client.14576 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-18T22:40:34.791 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:40:34 smithi121 ceph-mon[16788]: from='client.24337 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-18T22:40:34.791 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:40:34 smithi121 ceph-mon[16788]: from='client.? 172.21.15.121:0/1201761492' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-08-18T22:40:34.791 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:40:34 smithi121 ceph-mon[16788]: from='client.? 172.21.15.121:0/3367420493' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-08-18T22:40:34.791 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:34.791+0000 7f67a67fc640 1 -- 172.21.15.121:0/1954681627 <== mgr.14206 v2:172.21.15.121:6800/3225195982 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+447 (secure 0 0 0) 0x7f67b410ecc0 con 0x7f67a0067190 2024-08-18T22:40:34.792 INFO:teuthology.orchestra.run.smithi121.stdout:{ 2024-08-18T22:40:34.792 INFO:teuthology.orchestra.run.smithi121.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9", 2024-08-18T22:40:34.792 INFO:teuthology.orchestra.run.smithi121.stdout: "in_progress": true, 2024-08-18T22:40:34.792 INFO:teuthology.orchestra.run.smithi121.stdout: "which": "Upgrading all daemon types on all hosts", 2024-08-18T22:40:34.792 INFO:teuthology.orchestra.run.smithi121.stdout: "services_complete": [], 2024-08-18T22:40:34.792 INFO:teuthology.orchestra.run.smithi121.stdout: "progress": "0/21 daemons upgraded", 2024-08-18T22:40:34.792 INFO:teuthology.orchestra.run.smithi121.stdout: "message": "Pulling quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9 image on host smithi195", 2024-08-18T22:40:34.792 INFO:teuthology.orchestra.run.smithi121.stdout: "is_paused": false 2024-08-18T22:40:34.792 INFO:teuthology.orchestra.run.smithi121.stdout:} 2024-08-18T22:40:34.795 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:34.793+0000 7f67bc0de640 1 -- 172.21.15.121:0/1954681627 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7f67a0067190 msgr2=0x7f67a0069640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:40:34.795 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:34.793+0000 7f67bc0de640 1 --2- 172.21.15.121:0/1954681627 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7f67a0067190 0x7f67a0069640 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f67b0000c00 tx=0x7f67b0035040 comp rx=0 tx=0).stop 2024-08-18T22:40:34.795 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:34.793+0000 7f67bc0de640 1 -- 172.21.15.121:0/1954681627 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f67b40ff420 msgr2=0x7f67b410d470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:40:34.795 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:34.793+0000 7f67bc0de640 1 --2- 172.21.15.121:0/1954681627 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f67b40ff420 0x7f67b410d470 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f67a800eb70 tx=0x7f67a800b040 comp rx=0 tx=0).stop 2024-08-18T22:40:34.795 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:34.794+0000 7f67bc0de640 1 -- 172.21.15.121:0/1954681627 shutdown_connections 2024-08-18T22:40:34.795 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:34.794+0000 7f67bc0de640 1 --2- 172.21.15.121:0/1954681627 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7f67a0067190 0x7f67a0069640 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:40:34.796 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:34.794+0000 7f67bc0de640 1 --2- 172.21.15.121:0/1954681627 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f67b40ff420 0x7f67b410d470 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:40:34.796 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:34.794+0000 7f67bc0de640 1 --2- 172.21.15.121:0/1954681627 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f67b40659e0 0x7f67b410cf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:40:34.796 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:34.794+0000 7f67bc0de640 1 -- 172.21.15.121:0/1954681627 >> 172.21.15.121:0/1954681627 conn(0x7f67b40f69b0 msgr2=0x7f67b40f6d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:40:34.796 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:34.794+0000 7f67bc0de640 1 -- 172.21.15.121:0/1954681627 shutdown_connections 2024-08-18T22:40:34.796 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:34.794+0000 7f67bc0de640 1 -- 172.21.15.121:0/1954681627 wait complete. 2024-08-18T22:40:34.879 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:34.878+0000 7f119b0e4640 1 -- 172.21.15.121:0/3835174635 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1194101880 msgr2=0x7f1194103c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:40:34.880 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:34.878+0000 7f119b0e4640 1 --2- 172.21.15.121:0/3835174635 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1194101880 0x7f1194103c60 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f11800048d0 tx=0x7f1180009da0 comp rx=0 tx=0).stop 2024-08-18T22:40:34.881 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:34.878+0000 7f119b0e4640 1 -- 172.21.15.121:0/3835174635 shutdown_connections 2024-08-18T22:40:34.881 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:34.878+0000 7f119b0e4640 1 --2- 172.21.15.121:0/3835174635 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1194101880 0x7f1194103c60 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:40:34.881 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:34.878+0000 7f119b0e4640 1 --2- 172.21.15.121:0/3835174635 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1194065980 0x7f1194101340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:40:34.881 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:34.879+0000 7f119b0e4640 1 -- 172.21.15.121:0/3835174635 >> 172.21.15.121:0/3835174635 conn(0x7f11940f69b0 msgr2=0x7f11940f8dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:40:34.881 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:34.879+0000 7f119b0e4640 1 -- 172.21.15.121:0/3835174635 shutdown_connections 2024-08-18T22:40:34.881 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:34.879+0000 7f119b0e4640 1 -- 172.21.15.121:0/3835174635 wait complete. 2024-08-18T22:40:34.881 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:34.879+0000 7f119b0e4640 1 Processor -- start 2024-08-18T22:40:34.881 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:34.879+0000 7f119b0e4640 1 -- start start 2024-08-18T22:40:34.881 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:34.880+0000 7f119b0e4640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1194065980 0x7f119410f170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:40:34.881 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:34.880+0000 7f119b0e4640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f119410f6b0 0x7f1194110520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:40:34.882 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:34.880+0000 7f119b0e4640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f119410fb70 con 0x7f119410f6b0 2024-08-18T22:40:34.882 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:34.880+0000 7f1193fff640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f119410f6b0 0x7f1194110520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:40:34.882 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:34.880+0000 7f1193fff640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f119410f6b0 0x7f1194110520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:52416/0 (socket says 172.21.15.121:52416) 2024-08-18T22:40:34.882 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:34.880+0000 7f1193fff640 1 -- 172.21.15.121:0/1521602513 learned_addr learned my addr 172.21.15.121:0/1521602513 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-18T22:40:34.882 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:34.880+0000 7f119b0e4640 1 -- 172.21.15.121:0/1521602513 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f119410fcb0 con 0x7f1194065980 2024-08-18T22:40:34.883 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:34.880+0000 7f1198e80640 1 --2- 172.21.15.121:0/1521602513 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1194065980 0x7f119410f170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:40:34.883 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:34.880+0000 7f1193fff640 1 -- 172.21.15.121:0/1521602513 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1194065980 msgr2=0x7f119410f170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:40:34.883 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:34.881+0000 7f1193fff640 1 --2- 172.21.15.121:0/1521602513 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1194065980 0x7f119410f170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:40:34.883 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:34.881+0000 7f1193fff640 1 -- 172.21.15.121:0/1521602513 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1180005040 con 0x7f119410f6b0 2024-08-18T22:40:34.883 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:34.881+0000 7f1198e80640 1 --2- 172.21.15.121:0/1521602513 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1194065980 0x7f119410f170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:40:34.883 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:34.881+0000 7f1193fff640 1 --2- 172.21.15.121:0/1521602513 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f119410f6b0 0x7f1194110520 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f11800048a0 tx=0x7f1180009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:40:34.883 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:34.881+0000 7f11917fa640 1 -- 172.21.15.121:0/1521602513 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1180038070 con 0x7f119410f6b0 2024-08-18T22:40:34.883 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:34.881+0000 7f119b0e4640 1 -- 172.21.15.121:0/1521602513 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1194110ac0 con 0x7f119410f6b0 2024-08-18T22:40:34.883 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:34.881+0000 7f119b0e4640 1 -- 172.21.15.121:0/1521602513 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1194111000 con 0x7f119410f6b0 2024-08-18T22:40:34.883 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:34.881+0000 7f11917fa640 1 -- 172.21.15.121:0/1521602513 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f1180004290 con 0x7f119410f6b0 2024-08-18T22:40:34.884 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:34.881+0000 7f11917fa640 1 -- 172.21.15.121:0/1521602513 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1180033660 con 0x7f119410f6b0 2024-08-18T22:40:34.884 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:34.883+0000 7f119b0e4640 1 -- 172.21.15.121:0/1521602513 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1178005240 con 0x7f119410f6b0 2024-08-18T22:40:34.884 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:34.884+0000 7f11917fa640 1 -- 172.21.15.121:0/1521602513 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 19) v1 ==== 85127+0+0 (secure 0 0 0) 0x7f1180030020 con 0x7f119410f6b0 2024-08-18T22:40:34.885 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:34.884+0000 7f11917fa640 1 --2- 172.21.15.121:0/1521602513 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7f1184067190 0x7f1184069640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:40:34.885 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:34.884+0000 7f11917fa640 1 -- 172.21.15.121:0/1521602513 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f11800a4800 con 0x7f119410f6b0 2024-08-18T22:40:34.886 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:34.885+0000 7f1198e80640 1 --2- 172.21.15.121:0/1521602513 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7f1184067190 0x7f1184069640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:40:34.886 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:34.885+0000 7f1198e80640 1 --2- 172.21.15.121:0/1521602513 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7f1184067190 0x7f1184069640 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f1188004fd0 tx=0x7f118800b040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:40:34.890 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:34.889+0000 7f11917fa640 1 -- 172.21.15.121:0/1521602513 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f1180075610 con 0x7f119410f6b0 2024-08-18T22:40:34.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:40:34 smithi195 ceph-mon[23370]: from='client.14576 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-18T22:40:34.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:40:34 smithi195 ceph-mon[23370]: from='client.24337 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-18T22:40:34.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:40:34 smithi195 ceph-mon[23370]: from='client.? 172.21.15.121:0/1201761492' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-08-18T22:40:34.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:40:34 smithi195 ceph-mon[23370]: from='client.? 172.21.15.121:0/3367420493' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-08-18T22:40:35.133 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:35.131+0000 7f119b0e4640 1 -- 172.21.15.121:0/1521602513 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f11780054f0 con 0x7f119410f6b0 2024-08-18T22:40:35.133 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:35.132+0000 7f11917fa640 1 -- 172.21.15.121:0/1521602513 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f11800751a0 con 0x7f119410f6b0 2024-08-18T22:40:35.133 INFO:teuthology.orchestra.run.smithi121.stdout:HEALTH_OK 2024-08-18T22:40:35.135 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:35.134+0000 7f119b0e4640 1 -- 172.21.15.121:0/1521602513 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7f1184067190 msgr2=0x7f1184069640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:40:35.135 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:35.134+0000 7f119b0e4640 1 --2- 172.21.15.121:0/1521602513 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7f1184067190 0x7f1184069640 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f1188004fd0 tx=0x7f118800b040 comp rx=0 tx=0).stop 2024-08-18T22:40:35.135 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:35.134+0000 7f119b0e4640 1 -- 172.21.15.121:0/1521602513 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f119410f6b0 msgr2=0x7f1194110520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:40:35.135 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:35.134+0000 7f119b0e4640 1 --2- 172.21.15.121:0/1521602513 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f119410f6b0 0x7f1194110520 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f11800048a0 tx=0x7f1180009da0 comp rx=0 tx=0).stop 2024-08-18T22:40:35.136 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:35.134+0000 7f119b0e4640 1 -- 172.21.15.121:0/1521602513 shutdown_connections 2024-08-18T22:40:35.136 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:35.134+0000 7f119b0e4640 1 --2- 172.21.15.121:0/1521602513 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7f1184067190 0x7f1184069640 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:40:35.136 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:35.134+0000 7f119b0e4640 1 --2- 172.21.15.121:0/1521602513 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f119410f6b0 0x7f1194110520 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:40:35.136 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:35.134+0000 7f119b0e4640 1 --2- 172.21.15.121:0/1521602513 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1194065980 0x7f119410f170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:40:35.136 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:35.134+0000 7f119b0e4640 1 -- 172.21.15.121:0/1521602513 >> 172.21.15.121:0/1521602513 conn(0x7f11940f69b0 msgr2=0x7f11940f6d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:40:35.136 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:35.134+0000 7f119b0e4640 1 -- 172.21.15.121:0/1521602513 shutdown_connections 2024-08-18T22:40:35.136 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:40:35.134+0000 7f119b0e4640 1 -- 172.21.15.121:0/1521602513 wait complete. 2024-08-18T22:40:35.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:40:35 smithi195 ceph-mon[23370]: pgmap v213: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-08-18T22:40:35.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:40:35 smithi195 ceph-mon[23370]: from='client.24349 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-18T22:40:35.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:40:35 smithi195 ceph-mon[23370]: from='client.? 172.21.15.121:0/1521602513' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-08-18T22:40:36.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:40:35 smithi121 ceph-mon[16788]: pgmap v213: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-08-18T22:40:36.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:40:35 smithi121 ceph-mon[16788]: from='client.24349 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-18T22:40:36.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:40:35 smithi121 ceph-mon[16788]: from='client.? 172.21.15.121:0/1521602513' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-08-18T22:40:37.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:40:37 smithi195 ceph-mon[23370]: pgmap v214: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-08-18T22:40:38.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:40:37 smithi121 ceph-mon[16788]: pgmap v214: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-08-18T22:40:38.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:40:38 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-18T22:40:38.984 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:40:38 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-18T22:40:39.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:40:39 smithi195 ceph-mon[23370]: pgmap v215: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-08-18T22:40:39.998 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:40:39 smithi121 ceph-mon[16788]: pgmap v215: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-08-18T22:40:41.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:40:41 smithi195 ceph-mon[23370]: pgmap v216: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-08-18T22:40:42.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:40:41 smithi121 ceph-mon[16788]: pgmap v216: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-08-18T22:40:42.689 INFO:tasks.workunit.client.1.smithi195.stderr:Updating files: 92% (11911/12849) Updating files: 93% (11950/12849) Updating files: 94% (12079/12849) Updating files: 95% (12207/12849) Updating files: 96% (12336/12849) Updating files: 97% (12464/12849) Updating files: 98% (12593/12849) Updating files: 99% (12721/12849) Updating files: 100% (12849/12849) Updating files: 100% (12849/12849), done. 2024-08-18T22:40:43.516 INFO:tasks.workunit.client.1.smithi195.stderr:Note: switching to '78215f5a1cf5eaf321d506a66539942e12851f34'. 2024-08-18T22:40:43.516 INFO:tasks.workunit.client.1.smithi195.stderr: 2024-08-18T22:40:43.517 INFO:tasks.workunit.client.1.smithi195.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-08-18T22:40:43.517 INFO:tasks.workunit.client.1.smithi195.stderr:changes and commit them, and you can discard any commits you make in this 2024-08-18T22:40:43.517 INFO:tasks.workunit.client.1.smithi195.stderr:state without impacting any branches by switching back to a branch. 2024-08-18T22:40:43.517 INFO:tasks.workunit.client.1.smithi195.stderr: 2024-08-18T22:40:43.517 INFO:tasks.workunit.client.1.smithi195.stderr:If you want to create a new branch to retain commits you create, you may 2024-08-18T22:40:43.517 INFO:tasks.workunit.client.1.smithi195.stderr:do so (now or later) by using -c with the switch command. Example: 2024-08-18T22:40:43.517 INFO:tasks.workunit.client.1.smithi195.stderr: 2024-08-18T22:40:43.517 INFO:tasks.workunit.client.1.smithi195.stderr: git switch -c 2024-08-18T22:40:43.517 INFO:tasks.workunit.client.1.smithi195.stderr: 2024-08-18T22:40:43.517 INFO:tasks.workunit.client.1.smithi195.stderr:Or undo this operation with: 2024-08-18T22:40:43.517 INFO:tasks.workunit.client.1.smithi195.stderr: 2024-08-18T22:40:43.517 INFO:tasks.workunit.client.1.smithi195.stderr: git switch - 2024-08-18T22:40:43.517 INFO:tasks.workunit.client.1.smithi195.stderr: 2024-08-18T22:40:43.518 INFO:tasks.workunit.client.1.smithi195.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-08-18T22:40:43.518 INFO:tasks.workunit.client.1.smithi195.stderr: 2024-08-18T22:40:43.518 INFO:tasks.workunit.client.1.smithi195.stderr:HEAD is now at 78215f5a1cf Merge pull request #59291 from zdover23/wip-doc-2024-08-19-backport-59290-to-squid 2024-08-18T22:40:43.521 DEBUG:teuthology.orchestra.run.smithi195:> cd -- /home/ubuntu/cephtest/clone.client.1/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.1 2024-08-18T22:40:43.584 INFO:tasks.workunit.client.1.smithi195.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-08-18T22:40:43.587 INFO:tasks.workunit.client.1.smithi195.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/direct_io' 2024-08-18T22:40:43.587 INFO:tasks.workunit.client.1.smithi195.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-08-18T22:40:43.908 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:40:43 smithi195 ceph-mon[23370]: pgmap v217: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-08-18T22:40:44.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:40:43 smithi121 ceph-mon[16788]: pgmap v217: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-08-18T22:40:44.272 INFO:tasks.workunit.client.1.smithi195.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-08-18T22:40:44.330 INFO:tasks.workunit.client.1.smithi195.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-08-18T22:40:44.407 INFO:tasks.workunit.client.1.smithi195.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/direct_io' 2024-08-18T22:40:44.409 INFO:tasks.workunit.client.1.smithi195.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/fs' 2024-08-18T22:40:44.409 INFO:tasks.workunit.client.1.smithi195.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-08-18T22:40:44.531 INFO:tasks.workunit.client.1.smithi195.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/fs' 2024-08-18T22:40:44.534 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-08-18T22:40:44.534 DEBUG:teuthology.orchestra.run.smithi195:> dd if=/home/ubuntu/cephtest/workunits.list.client.1 of=/dev/stdout 2024-08-18T22:40:44.590 INFO:tasks.workunit:Running workunits matching suites/fsstress.sh on client.1... 2024-08-18T22:40:44.592 INFO:tasks.workunit:Running workunit suites/fsstress.sh... 2024-08-18T22:40:44.592 DEBUG:teuthology.orchestra.run.smithi195:workunit test suites/fsstress.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && cd -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=78215f5a1cf5eaf321d506a66539942e12851f34 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="1" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.1 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.1 CEPH_MNT=/home/ubuntu/cephtest/mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.1/qa/workunits/suites/fsstress.sh 2024-08-18T22:40:44.657 INFO:tasks.workunit.client.1.smithi195.stderr:+ mkdir -p fsstress 2024-08-18T22:40:44.659 INFO:tasks.workunit.client.1.smithi195.stderr:+ pushd fsstress 2024-08-18T22:40:44.661 INFO:tasks.workunit.client.1.smithi195.stdout:~/cephtest/mnt.1/client.1/tmp/fsstress ~/cephtest/mnt.1/client.1/tmp 2024-08-18T22:40:44.661 INFO:tasks.workunit.client.1.smithi195.stderr:+ wget -q -O ltp-full.tgz http://download.ceph.com/qa/ltp-full-20091231.tgz 2024-08-18T22:40:45.051 INFO:tasks.workunit.client.0.smithi121.stderr:Note: switching to '78215f5a1cf5eaf321d506a66539942e12851f34'. 2024-08-18T22:40:45.051 INFO:tasks.workunit.client.0.smithi121.stderr: 2024-08-18T22:40:45.052 INFO:tasks.workunit.client.0.smithi121.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-08-18T22:40:45.052 INFO:tasks.workunit.client.0.smithi121.stderr:changes and commit them, and you can discard any commits you make in this 2024-08-18T22:40:45.052 INFO:tasks.workunit.client.0.smithi121.stderr:state without impacting any branches by switching back to a branch. 2024-08-18T22:40:45.052 INFO:tasks.workunit.client.0.smithi121.stderr: 2024-08-18T22:40:45.052 INFO:tasks.workunit.client.0.smithi121.stderr:If you want to create a new branch to retain commits you create, you may 2024-08-18T22:40:45.052 INFO:tasks.workunit.client.0.smithi121.stderr:do so (now or later) by using -c with the switch command. Example: 2024-08-18T22:40:45.052 INFO:tasks.workunit.client.0.smithi121.stderr: 2024-08-18T22:40:45.052 INFO:tasks.workunit.client.0.smithi121.stderr: git switch -c 2024-08-18T22:40:45.052 INFO:tasks.workunit.client.0.smithi121.stderr: 2024-08-18T22:40:45.052 INFO:tasks.workunit.client.0.smithi121.stderr:Or undo this operation with: 2024-08-18T22:40:45.052 INFO:tasks.workunit.client.0.smithi121.stderr: 2024-08-18T22:40:45.052 INFO:tasks.workunit.client.0.smithi121.stderr: git switch - 2024-08-18T22:40:45.052 INFO:tasks.workunit.client.0.smithi121.stderr: 2024-08-18T22:40:45.053 INFO:tasks.workunit.client.0.smithi121.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-08-18T22:40:45.053 INFO:tasks.workunit.client.0.smithi121.stderr: 2024-08-18T22:40:45.053 INFO:tasks.workunit.client.0.smithi121.stderr:HEAD is now at 78215f5a1cf Merge pull request #59291 from zdover23/wip-doc-2024-08-19-backport-59290-to-squid 2024-08-18T22:40:45.056 DEBUG:teuthology.orchestra.run.smithi121:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-08-18T22:40:45.086 INFO:tasks.workunit.client.0.smithi121.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-08-18T22:40:45.088 INFO:tasks.workunit.client.0.smithi121.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-08-18T22:40:45.088 INFO:tasks.workunit.client.0.smithi121.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-08-18T22:40:45.757 INFO:tasks.workunit.client.0.smithi121.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-08-18T22:40:45.815 INFO:tasks.workunit.client.0.smithi121.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-08-18T22:40:45.860 INFO:tasks.workunit.client.0.smithi121.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-08-18T22:40:45.861 INFO:tasks.workunit.client.0.smithi121.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-08-18T22:40:45.861 INFO:tasks.workunit.client.0.smithi121.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-08-18T22:40:45.899 INFO:tasks.workunit.client.0.smithi121.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-08-18T22:40:45.901 INFO:tasks.workunit.client.1.smithi195.stderr:+ tar xzf ltp-full.tgz 2024-08-18T22:40:45.903 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-08-18T22:40:45.903 DEBUG:teuthology.orchestra.run.smithi121:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-08-18T22:40:45.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:40:45 smithi195 ceph-mon[23370]: pgmap v218: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-08-18T22:40:45.960 INFO:tasks.workunit:Running workunits matching suites/fsstress.sh on client.0... 2024-08-18T22:40:45.961 INFO:tasks.workunit:Running workunit suites/fsstress.sh... 2024-08-18T22:40:45.961 DEBUG:teuthology.orchestra.run.smithi121:workunit test suites/fsstress.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=78215f5a1cf5eaf321d506a66539942e12851f34 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/fsstress.sh 2024-08-18T22:40:46.024 INFO:tasks.workunit.client.0.smithi121.stderr:+ mkdir -p fsstress 2024-08-18T22:40:46.026 INFO:tasks.workunit.client.0.smithi121.stderr:+ pushd fsstress 2024-08-18T22:40:46.027 INFO:tasks.workunit.client.0.smithi121.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-08-18T22:40:46.027 INFO:tasks.workunit.client.0.smithi121.stderr:+ wget -q -O ltp-full.tgz http://download.ceph.com/qa/ltp-full-20091231.tgz 2024-08-18T22:40:46.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:40:45 smithi121 ceph-mon[16788]: pgmap v218: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-08-18T22:40:46.670 INFO:tasks.workunit.client.0.smithi121.stderr:+ tar xzf ltp-full.tgz 2024-08-18T22:40:48.409 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:40:48 smithi195 ceph-mon[23370]: pgmap v219: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-08-18T22:40:48.583 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:40:48 smithi121 ceph-mon[16788]: pgmap v219: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-08-18T22:40:50.583 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:40:50 smithi121 ceph-mon[16788]: pgmap v220: 65 pgs: 65 active+clean; 16 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.3 MiB/s wr, 18 op/s 2024-08-18T22:40:50.659 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:40:50 smithi195 ceph-mon[23370]: pgmap v220: 65 pgs: 65 active+clean; 16 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.3 MiB/s wr, 18 op/s 2024-08-18T22:40:52.586 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:40:52 smithi121 ceph-mon[16788]: pgmap v221: 65 pgs: 65 active+clean; 21 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 1.7 MiB/s wr, 40 op/s 2024-08-18T22:40:52.659 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:40:52 smithi195 ceph-mon[23370]: pgmap v221: 65 pgs: 65 active+clean; 21 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 1.7 MiB/s wr, 40 op/s 2024-08-18T22:40:54.583 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:40:54 smithi121 ceph-mon[16788]: pgmap v222: 65 pgs: 65 active+clean; 35 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 3.0 MiB/s wr, 243 op/s 2024-08-18T22:40:54.583 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:40:54 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-18T22:40:54.659 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:40:54 smithi195 ceph-mon[23370]: pgmap v222: 65 pgs: 65 active+clean; 35 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 3.0 MiB/s wr, 243 op/s 2024-08-18T22:40:54.659 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:40:54 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-18T22:40:56.418 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:40:56 smithi195 ceph-mon[23370]: pgmap v223: 65 pgs: 65 active+clean; 38 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 3.3 MiB/s wr, 287 op/s 2024-08-18T22:40:56.583 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:40:56 smithi121 ceph-mon[16788]: pgmap v223: 65 pgs: 65 active+clean; 38 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 3.3 MiB/s wr, 287 op/s 2024-08-18T22:40:58.408 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:40:58 smithi195 ceph-mon[23370]: pgmap v224: 65 pgs: 65 active+clean; 44 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 3.8 MiB/s wr, 332 op/s 2024-08-18T22:40:58.583 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:40:58 smithi121 ceph-mon[16788]: pgmap v224: 65 pgs: 65 active+clean; 44 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 3.8 MiB/s wr, 332 op/s 2024-08-18T22:41:00.442 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:41:00 smithi195 ceph-mon[23370]: pgmap v225: 65 pgs: 65 active+clean; 53 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 4.6 MiB/s wr, 456 op/s 2024-08-18T22:41:00.583 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:41:00 smithi121 ceph-mon[16788]: pgmap v225: 65 pgs: 65 active+clean; 53 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 4.6 MiB/s wr, 456 op/s 2024-08-18T22:41:02.409 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:41:02 smithi195 ceph-mon[23370]: pgmap v226: 65 pgs: 65 active+clean; 64 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 4.3 MiB/s wr, 480 op/s 2024-08-18T22:41:02.409 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:41:02 smithi195 ceph-mon[23370]: fsmap cephfs:2 {0=cephfs.smithi121.gbickb=up:active,1=cephfs.smithi195.buqvbr=up:active} 2 up:standby 2024-08-18T22:41:02.409 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:41:02 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:41:02.409 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:41:02 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi195.acttsj", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-08-18T22:41:02.409 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:41:02 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "mgr services"}]: dispatch 2024-08-18T22:41:02.409 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:41:02 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:41:02.583 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:41:02 smithi121 ceph-mon[16788]: pgmap v226: 65 pgs: 65 active+clean; 64 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 4.3 MiB/s wr, 480 op/s 2024-08-18T22:41:02.583 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:41:02 smithi121 ceph-mon[16788]: fsmap cephfs:2 {0=cephfs.smithi121.gbickb=up:active,1=cephfs.smithi195.buqvbr=up:active} 2 up:standby 2024-08-18T22:41:02.583 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:41:02 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:41:02.584 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:41:02 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi195.acttsj", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-08-18T22:41:02.584 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:41:02 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "mgr services"}]: dispatch 2024-08-18T22:41:02.584 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:41:02 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:41:03.409 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:41:03 smithi195 ceph-mon[23370]: Upgrade: Updating mgr.smithi195.acttsj 2024-08-18T22:41:03.409 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:41:03 smithi195 ceph-mon[23370]: Deploying daemon mgr.smithi195.acttsj on smithi195 2024-08-18T22:41:03.583 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:41:03 smithi121 ceph-mon[16788]: Upgrade: Updating mgr.smithi195.acttsj 2024-08-18T22:41:03.583 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:41:03 smithi121 ceph-mon[16788]: Deploying daemon mgr.smithi195.acttsj on smithi195 2024-08-18T22:41:04.583 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:41:04 smithi121 ceph-mon[16788]: pgmap v227: 65 pgs: 65 active+clean; 85 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 5.7 MiB/s wr, 608 op/s 2024-08-18T22:41:04.613 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:41:04 smithi195 ceph-mon[23370]: pgmap v227: 65 pgs: 65 active+clean; 85 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 5.7 MiB/s wr, 608 op/s 2024-08-18T22:41:05.245 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:05.241+0000 7fb3ae00e640 1 -- 172.21.15.121:0/2797522748 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb3a8066270 msgr2=0x7fb3a80feed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:41:05.245 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:05.241+0000 7fb3ae00e640 1 --2- 172.21.15.121:0/2797522748 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb3a8066270 0x7fb3a80feed0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fb3980048d0 tx=0x7fb398009da0 comp rx=0 tx=0).stop 2024-08-18T22:41:05.245 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:05.241+0000 7fb3ae00e640 1 -- 172.21.15.121:0/2797522748 shutdown_connections 2024-08-18T22:41:05.245 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:05.241+0000 7fb3ae00e640 1 --2- 172.21.15.121:0/2797522748 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb3a80ff410 0x7fb3a81017f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:41:05.245 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:05.241+0000 7fb3ae00e640 1 --2- 172.21.15.121:0/2797522748 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb3a8066270 0x7fb3a80feed0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:41:05.246 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:05.241+0000 7fb3ae00e640 1 -- 172.21.15.121:0/2797522748 >> 172.21.15.121:0/2797522748 conn(0x7fb3a80f69a0 msgr2=0x7fb3a80f8db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:41:05.246 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:05.241+0000 7fb3ae00e640 1 -- 172.21.15.121:0/2797522748 shutdown_connections 2024-08-18T22:41:05.246 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:05.241+0000 7fb3ae00e640 1 -- 172.21.15.121:0/2797522748 wait complete. 2024-08-18T22:41:05.246 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:05.242+0000 7fb3ae00e640 1 Processor -- start 2024-08-18T22:41:05.246 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:05.242+0000 7fb3ae00e640 1 -- start start 2024-08-18T22:41:05.246 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:05.243+0000 7fb3ae00e640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb3a8066270 0x7fb3a80fc8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:41:05.246 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:05.243+0000 7fb3ae00e640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb3a80ff410 0x7fb3a80fadd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:41:05.246 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:05.243+0000 7fb3ae00e640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3a8110a90 con 0x7fb3a8066270 2024-08-18T22:41:05.246 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:05.243+0000 7fb3ae00e640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3a8110bd0 con 0x7fb3a80ff410 2024-08-18T22:41:05.246 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:05.243+0000 7fb3a77fe640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb3a8066270 0x7fb3a80fc8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:41:05.246 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:05.243+0000 7fb3a6ffd640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb3a80ff410 0x7fb3a80fadd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:41:05.246 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:05.243+0000 7fb3a77fe640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb3a8066270 0x7fb3a80fc8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:39212/0 (socket says 172.21.15.121:39212) 2024-08-18T22:41:05.246 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:05.243+0000 7fb3a6ffd640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb3a80ff410 0x7fb3a80fadd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.121:34906/0 (socket says 172.21.15.121:34906) 2024-08-18T22:41:05.247 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:05.243+0000 7fb3a77fe640 1 -- 172.21.15.121:0/2327139514 learned_addr learned my addr 172.21.15.121:0/2327139514 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-18T22:41:05.247 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:05.244+0000 7fb3a77fe640 1 -- 172.21.15.121:0/2327139514 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb3a80ff410 msgr2=0x7fb3a80fadd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:41:05.247 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:05.244+0000 7fb3a77fe640 1 --2- 172.21.15.121:0/2327139514 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb3a80ff410 0x7fb3a80fadd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:41:05.247 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:05.244+0000 7fb3a77fe640 1 -- 172.21.15.121:0/2327139514 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb398005040 con 0x7fb3a8066270 2024-08-18T22:41:05.247 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:05.244+0000 7fb3a77fe640 1 --2- 172.21.15.121:0/2327139514 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb3a8066270 0x7fb3a80fc8e0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fb39802d040 tx=0x7fb398009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:41:05.247 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:05.244+0000 7fb38ffff640 1 -- 172.21.15.121:0/2327139514 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb398038070 con 0x7fb3a8066270 2024-08-18T22:41:05.247 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:05.244+0000 7fb3ae00e640 1 -- 172.21.15.121:0/2327139514 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3a80fb370 con 0x7fb3a8066270 2024-08-18T22:41:05.247 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:05.244+0000 7fb3ae00e640 1 -- 172.21.15.121:0/2327139514 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3a80fb910 con 0x7fb3a8066270 2024-08-18T22:41:05.247 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:05.244+0000 7fb38ffff640 1 -- 172.21.15.121:0/2327139514 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fb39802ae90 con 0x7fb3a8066270 2024-08-18T22:41:05.247 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:05.244+0000 7fb38ffff640 1 -- 172.21.15.121:0/2327139514 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb39803e670 con 0x7fb3a8066270 2024-08-18T22:41:05.248 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:05.245+0000 7fb3ae00e640 1 -- 172.21.15.121:0/2327139514 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3a80fa620 con 0x7fb3a8066270 2024-08-18T22:41:05.248 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:05.246+0000 7fb38ffff640 1 -- 172.21.15.121:0/2327139514 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 19) v1 ==== 85127+0+0 (secure 0 0 0) 0x7fb398030020 con 0x7fb3a8066270 2024-08-18T22:41:05.248 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:05.247+0000 7fb38ffff640 1 --2- 172.21.15.121:0/2327139514 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7fb3900671e0 0x7fb390069690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:41:05.248 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:05.247+0000 7fb38ffff640 1 -- 172.21.15.121:0/2327139514 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5550+0+0 (secure 0 0 0) 0x7fb3980a4c50 con 0x7fb3a8066270 2024-08-18T22:41:05.248 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:05.247+0000 7fb3a6ffd640 1 --2- 172.21.15.121:0/2327139514 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7fb3900671e0 0x7fb390069690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:41:05.249 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:05.248+0000 7fb3a6ffd640 1 --2- 172.21.15.121:0/2327139514 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7fb3900671e0 0x7fb390069690 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fb39c009af0 tx=0x7fb39c00b040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:41:05.254 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:05.253+0000 7fb38ffff640 1 -- 172.21.15.121:0/2327139514 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fb398071eb0 con 0x7fb3a8066270 2024-08-18T22:41:05.475 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:05.474+0000 7fb3ae00e640 1 -- 172.21.15.121:0/2327139514 --> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fb3a8104e00 con 0x7fb3900671e0 2024-08-18T22:41:05.476 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:05.476+0000 7fb38ffff640 1 -- 172.21.15.121:0/2327139514 <== mgr.14206 v2:172.21.15.121:6800/3225195982 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+349 (secure 0 0 0) 0x7fb3a8104e00 con 0x7fb3900671e0 2024-08-18T22:41:05.480 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:05.479+0000 7fb3ae00e640 1 -- 172.21.15.121:0/2327139514 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7fb3900671e0 msgr2=0x7fb390069690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:41:05.480 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:05.479+0000 7fb3ae00e640 1 --2- 172.21.15.121:0/2327139514 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7fb3900671e0 0x7fb390069690 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fb39c009af0 tx=0x7fb39c00b040 comp rx=0 tx=0).stop 2024-08-18T22:41:05.480 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:05.479+0000 7fb3ae00e640 1 -- 172.21.15.121:0/2327139514 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb3a8066270 msgr2=0x7fb3a80fc8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:41:05.480 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:05.479+0000 7fb3ae00e640 1 --2- 172.21.15.121:0/2327139514 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb3a8066270 0x7fb3a80fc8e0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fb39802d040 tx=0x7fb398009da0 comp rx=0 tx=0).stop 2024-08-18T22:41:05.480 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:05.479+0000 7fb3ae00e640 1 -- 172.21.15.121:0/2327139514 shutdown_connections 2024-08-18T22:41:05.481 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:05.479+0000 7fb3ae00e640 1 --2- 172.21.15.121:0/2327139514 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7fb3900671e0 0x7fb390069690 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:41:05.481 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:05.479+0000 7fb3ae00e640 1 --2- 172.21.15.121:0/2327139514 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb3a80ff410 0x7fb3a80fadd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:41:05.481 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:05.479+0000 7fb3ae00e640 1 --2- 172.21.15.121:0/2327139514 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb3a8066270 0x7fb3a80fc8e0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:41:05.481 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:05.479+0000 7fb3ae00e640 1 -- 172.21.15.121:0/2327139514 >> 172.21.15.121:0/2327139514 conn(0x7fb3a80f69a0 msgr2=0x7fb3a80f6d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:41:05.481 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:05.479+0000 7fb3ae00e640 1 -- 172.21.15.121:0/2327139514 shutdown_connections 2024-08-18T22:41:05.481 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:05.479+0000 7fb3ae00e640 1 -- 172.21.15.121:0/2327139514 wait complete. 2024-08-18T22:41:05.492 INFO:teuthology.orchestra.run.smithi121.stdout:true 2024-08-18T22:41:05.601 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:05.599+0000 7f141e245640 1 -- 172.21.15.121:0/2753457022 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1418101860 msgr2=0x7f1418103c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:41:05.601 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:05.599+0000 7f141e245640 1 --2- 172.21.15.121:0/2753457022 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1418101860 0x7f1418103c40 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f1408004840 tx=0x7f1408009da0 comp rx=0 tx=0).stop 2024-08-18T22:41:05.601 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:05.599+0000 7f141e245640 1 -- 172.21.15.121:0/2753457022 shutdown_connections 2024-08-18T22:41:05.601 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:05.599+0000 7f141e245640 1 --2- 172.21.15.121:0/2753457022 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1418101860 0x7f1418103c40 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:41:05.601 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:05.599+0000 7f141e245640 1 --2- 172.21.15.121:0/2753457022 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f14180659a0 0x7f1418101320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:41:05.601 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:05.599+0000 7f141e245640 1 -- 172.21.15.121:0/2753457022 >> 172.21.15.121:0/2753457022 conn(0x7f14180f69b0 msgr2=0x7f14180f8dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:41:05.601 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:05.600+0000 7f141e245640 1 -- 172.21.15.121:0/2753457022 shutdown_connections 2024-08-18T22:41:05.601 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:05.600+0000 7f141e245640 1 -- 172.21.15.121:0/2753457022 wait complete. 2024-08-18T22:41:05.602 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:05.600+0000 7f141e245640 1 Processor -- start 2024-08-18T22:41:05.602 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:05.600+0000 7f141e245640 1 -- start start 2024-08-18T22:41:05.602 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:05.601+0000 7f141e245640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f14180659a0 0x7f14180fd2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:41:05.602 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:05.601+0000 7f141e245640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1418101860 0x7f14180fd7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:41:05.602 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:05.601+0000 7f14177fe640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f14180659a0 0x7f14180fd2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:41:05.602 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:05.601+0000 7f14177fe640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f14180659a0 0x7f14180fd2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.121:34928/0 (socket says 172.21.15.121:34928) 2024-08-18T22:41:05.602 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:05.601+0000 7f14177fe640 1 -- 172.21.15.121:0/2558131554 learned_addr learned my addr 172.21.15.121:0/2558131554 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-18T22:41:05.603 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:05.601+0000 7f141e245640 1 -- 172.21.15.121:0/2558131554 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14180fdde0 con 0x7f1418101860 2024-08-18T22:41:05.603 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:05.601+0000 7f141e245640 1 -- 172.21.15.121:0/2558131554 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14180fe6a0 con 0x7f14180659a0 2024-08-18T22:41:05.603 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:05.601+0000 7f1416ffd640 1 --2- 172.21.15.121:0/2558131554 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1418101860 0x7f14180fd7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:41:05.603 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:05.602+0000 7f14177fe640 1 -- 172.21.15.121:0/2558131554 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1418101860 msgr2=0x7f14180fd7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:41:05.603 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:05.602+0000 7f14177fe640 1 --2- 172.21.15.121:0/2558131554 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1418101860 0x7f14180fd7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:41:05.603 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:05.602+0000 7f14177fe640 1 -- 172.21.15.121:0/2558131554 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1408005040 con 0x7f14180659a0 2024-08-18T22:41:05.604 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:05.602+0000 7f14177fe640 1 --2- 172.21.15.121:0/2558131554 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f14180659a0 0x7f14180fd2a0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f140c00eb40 tx=0x7f140c00b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:41:05.604 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:05.602+0000 7f13fffff640 1 -- 172.21.15.121:0/2558131554 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f140c007c30 con 0x7f14180659a0 2024-08-18T22:41:05.604 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:05.602+0000 7f141e245640 1 -- 172.21.15.121:0/2558131554 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14180fe980 con 0x7f14180659a0 2024-08-18T22:41:05.604 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:05.602+0000 7f13fffff640 1 -- 172.21.15.121:0/2558131554 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f140c00f040 con 0x7f14180659a0 2024-08-18T22:41:05.604 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:05.602+0000 7f13fffff640 1 -- 172.21.15.121:0/2558131554 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f140c009610 con 0x7f14180659a0 2024-08-18T22:41:05.604 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:05.602+0000 7f141e245640 1 -- 172.21.15.121:0/2558131554 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14180fef20 con 0x7f14180659a0 2024-08-18T22:41:05.605 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:05.604+0000 7f141e245640 1 -- 172.21.15.121:0/2558131554 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14180fa630 con 0x7f14180659a0 2024-08-18T22:41:05.605 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:05.604+0000 7f13fffff640 1 -- 172.21.15.121:0/2558131554 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 19) v1 ==== 85127+0+0 (secure 0 0 0) 0x7f140c009790 con 0x7f14180659a0 2024-08-18T22:41:05.606 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:05.605+0000 7f13fffff640 1 --2- 172.21.15.121:0/2558131554 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7f14000671e0 0x7f1400069690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:41:05.606 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:05.605+0000 7f13fffff640 1 -- 172.21.15.121:0/2558131554 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f140c084f00 con 0x7f14180659a0 2024-08-18T22:41:05.606 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:05.605+0000 7f1416ffd640 1 --2- 172.21.15.121:0/2558131554 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7f14000671e0 0x7f1400069690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:41:05.607 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:05.606+0000 7f1416ffd640 1 --2- 172.21.15.121:0/2558131554 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7f14000671e0 0x7f1400069690 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f1408000c00 tx=0x7f1408035040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:41:05.612 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:05.611+0000 7f13fffff640 1 -- 172.21.15.121:0/2558131554 <== mon.1 v2:172.21.15.195:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f140c0520b0 con 0x7f14180659a0 2024-08-18T22:41:05.863 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:05.862+0000 7f141e245640 1 -- 172.21.15.121:0/2558131554 --> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f14180ff1e0 con 0x7f14000671e0 2024-08-18T22:41:05.864 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:05.863+0000 7f13fffff640 1 -- 172.21.15.121:0/2558131554 <== mgr.14206 v2:172.21.15.121:6800/3225195982 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+349 (secure 0 0 0) 0x7f14180ff1e0 con 0x7f14000671e0 2024-08-18T22:41:05.867 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:05.865+0000 7f141e245640 1 -- 172.21.15.121:0/2558131554 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7f14000671e0 msgr2=0x7f1400069690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:41:05.867 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:05.865+0000 7f141e245640 1 --2- 172.21.15.121:0/2558131554 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7f14000671e0 0x7f1400069690 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f1408000c00 tx=0x7f1408035040 comp rx=0 tx=0).stop 2024-08-18T22:41:05.867 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:05.865+0000 7f141e245640 1 -- 172.21.15.121:0/2558131554 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f14180659a0 msgr2=0x7f14180fd2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:41:05.867 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:05.865+0000 7f141e245640 1 --2- 172.21.15.121:0/2558131554 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f14180659a0 0x7f14180fd2a0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f140c00eb40 tx=0x7f140c00b040 comp rx=0 tx=0).stop 2024-08-18T22:41:05.867 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:05.865+0000 7f141e245640 1 -- 172.21.15.121:0/2558131554 shutdown_connections 2024-08-18T22:41:05.867 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:05.865+0000 7f141e245640 1 --2- 172.21.15.121:0/2558131554 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7f14000671e0 0x7f1400069690 secure :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f1408000c00 tx=0x7f1408035040 comp rx=0 tx=0).stop 2024-08-18T22:41:05.867 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:05.865+0000 7f141e245640 1 --2- 172.21.15.121:0/2558131554 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1418101860 0x7f14180fd7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:41:05.867 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:05.865+0000 7f141e245640 1 --2- 172.21.15.121:0/2558131554 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f14180659a0 0x7f14180fd2a0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:41:05.867 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:05.865+0000 7f141e245640 1 -- 172.21.15.121:0/2558131554 >> 172.21.15.121:0/2558131554 conn(0x7f14180f69b0 msgr2=0x7f14180f6d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:41:05.867 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:05.866+0000 7f141e245640 1 -- 172.21.15.121:0/2558131554 shutdown_connections 2024-08-18T22:41:05.868 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:05.866+0000 7f141e245640 1 -- 172.21.15.121:0/2558131554 wait complete. 2024-08-18T22:41:05.976 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:05.974+0000 7fd887264640 1 -- 172.21.15.121:0/3507261766 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd8800fb1d0 msgr2=0x7fd8800fb5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:41:05.976 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:05.974+0000 7fd887264640 1 --2- 172.21.15.121:0/3507261766 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd8800fb1d0 0x7fd8800fb5e0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fd874004810 tx=0x7fd874009da0 comp rx=0 tx=0).stop 2024-08-18T22:41:05.976 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:05.974+0000 7fd887264640 1 -- 172.21.15.121:0/3507261766 shutdown_connections 2024-08-18T22:41:05.976 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:05.974+0000 7fd887264640 1 --2- 172.21.15.121:0/3507261766 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd8800fc4a0 0x7fd8800fc910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:41:05.976 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:05.974+0000 7fd887264640 1 --2- 172.21.15.121:0/3507261766 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd8800fb1d0 0x7fd8800fb5e0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:41:05.976 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:05.974+0000 7fd887264640 1 -- 172.21.15.121:0/3507261766 >> 172.21.15.121:0/3507261766 conn(0x7fd8800f69b0 msgr2=0x7fd8800f8dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:41:05.976 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:05.974+0000 7fd887264640 1 -- 172.21.15.121:0/3507261766 shutdown_connections 2024-08-18T22:41:05.976 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:05.974+0000 7fd887264640 1 -- 172.21.15.121:0/3507261766 wait complete. 2024-08-18T22:41:05.976 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:05.975+0000 7fd887264640 1 Processor -- start 2024-08-18T22:41:05.976 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:05.975+0000 7fd887264640 1 -- start start 2024-08-18T22:41:05.978 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:05.975+0000 7fd887264640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd8800fb1d0 0x7fd8801134a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:41:05.978 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:05.975+0000 7fd887264640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd8800fc4a0 0x7fd8801139e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:41:05.978 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:05.975+0000 7fd887264640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd880114030 con 0x7fd8800fc4a0 2024-08-18T22:41:05.978 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:05.975+0000 7fd887264640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8801147b0 con 0x7fd8800fb1d0 2024-08-18T22:41:05.978 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:05.976+0000 7fd87ffff640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd8800fc4a0 0x7fd8801139e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:41:05.978 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:05.976+0000 7fd885000640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd8800fb1d0 0x7fd8801134a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:41:05.978 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:05.976+0000 7fd87ffff640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd8800fc4a0 0x7fd8801139e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:39234/0 (socket says 172.21.15.121:39234) 2024-08-18T22:41:05.979 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:05.976+0000 7fd87ffff640 1 -- 172.21.15.121:0/3912880449 learned_addr learned my addr 172.21.15.121:0/3912880449 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-18T22:41:05.979 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:05.976+0000 7fd885000640 1 -- 172.21.15.121:0/3912880449 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd8800fc4a0 msgr2=0x7fd8801139e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:41:05.979 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:05.976+0000 7fd885000640 1 --2- 172.21.15.121:0/3912880449 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd8800fc4a0 0x7fd8801139e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:41:05.979 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:05.976+0000 7fd885000640 1 -- 172.21.15.121:0/3912880449 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd874005040 con 0x7fd8800fb1d0 2024-08-18T22:41:05.979 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:05.976+0000 7fd87ffff640 1 --2- 172.21.15.121:0/3912880449 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd8800fc4a0 0x7fd8801139e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:41:05.979 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:05.977+0000 7fd885000640 1 --2- 172.21.15.121:0/3912880449 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd8800fb1d0 0x7fd8801134a0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fd8740047e0 tx=0x7fd874009da0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:41:05.979 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:05.977+0000 7fd87d7fa640 1 -- 172.21.15.121:0/3912880449 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd874038070 con 0x7fd8800fb1d0 2024-08-18T22:41:05.979 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:05.977+0000 7fd887264640 1 -- 172.21.15.121:0/3912880449 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8801149e0 con 0x7fd8800fb1d0 2024-08-18T22:41:05.979 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:05.977+0000 7fd887264640 1 -- 172.21.15.121:0/3912880449 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd880114f20 con 0x7fd8800fb1d0 2024-08-18T22:41:05.979 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:05.977+0000 7fd87d7fa640 1 -- 172.21.15.121:0/3912880449 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fd874032c10 con 0x7fd8800fb1d0 2024-08-18T22:41:05.979 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:05.977+0000 7fd87d7fa640 1 -- 172.21.15.121:0/3912880449 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd874032610 con 0x7fd8800fb1d0 2024-08-18T22:41:05.980 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:05.978+0000 7fd887264640 1 -- 172.21.15.121:0/3912880449 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd864005210 con 0x7fd8800fb1d0 2024-08-18T22:41:05.980 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:05.979+0000 7fd87d7fa640 1 -- 172.21.15.121:0/3912880449 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 19) v1 ==== 85127+0+0 (secure 0 0 0) 0x7fd874030020 con 0x7fd8800fb1d0 2024-08-18T22:41:05.980 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:05.979+0000 7fd87d7fa640 1 --2- 172.21.15.121:0/3912880449 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7fd870067190 0x7fd870069640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:41:05.980 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:05.979+0000 7fd87d7fa640 1 -- 172.21.15.121:0/3912880449 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5550+0+0 (secure 0 0 0) 0x7fd8740a4a60 con 0x7fd8800fb1d0 2024-08-18T22:41:05.980 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:05.980+0000 7fd87ffff640 1 --2- 172.21.15.121:0/3912880449 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7fd870067190 0x7fd870069640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:41:05.981 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:05.980+0000 7fd87ffff640 1 --2- 172.21.15.121:0/3912880449 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7fd870067190 0x7fd870069640 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fd880113250 tx=0x7fd86c00b040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:41:05.985 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:05.984+0000 7fd87d7fa640 1 -- 172.21.15.121:0/3912880449 <== mon.1 v2:172.21.15.195:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fd874075850 con 0x7fd8800fb1d0 2024-08-18T22:41:06.244 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:06.243+0000 7fd887264640 1 -- 172.21.15.121:0/3912880449 --> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fd864000bc0 con 0x7fd870067190 2024-08-18T22:41:06.256 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:06.255+0000 7fd87d7fa640 1 -- 172.21.15.121:0/3912880449 <== mgr.14206 v2:172.21.15.121:6800/3225195982 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3542 (secure 0 0 0) 0x7fd864000bc0 con 0x7fd870067190 2024-08-18T22:41:06.256 INFO:teuthology.orchestra.run.smithi121.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-08-18T22:41:06.256 INFO:teuthology.orchestra.run.smithi121.stdout:alertmanager.smithi121 smithi121 *:9093,9094 running (5m) 92s ago 6m 24.7M - 0.25.0 c8568f914cd2 0e56a9950e47 2024-08-18T22:41:06.256 INFO:teuthology.orchestra.run.smithi121.stdout:crash.smithi121 smithi121 running (7m) 92s ago 7m 6899k - 17.2.7-1406-gdf62bdcc 774894bef55f cf3deea293c3 2024-08-18T22:41:06.257 INFO:teuthology.orchestra.run.smithi121.stdout:crash.smithi195 smithi195 running (6m) 98s ago 6m 6899k - 17.2.7-1406-gdf62bdcc 774894bef55f 98aa377daf77 2024-08-18T22:41:06.257 INFO:teuthology.orchestra.run.smithi121.stdout:grafana.smithi121 smithi121 *:3000 running (5m) 92s ago 6m 87.2M - 9.4.7 954c08fa6188 07c3d993780f 2024-08-18T22:41:06.257 INFO:teuthology.orchestra.run.smithi121.stdout:mds.cephfs.smithi121.gbickb smithi121 running (111s) 92s ago 110s 16.2M - 17.2.7-1406-gdf62bdcc 774894bef55f 484da0bc2c95 2024-08-18T22:41:06.257 INFO:teuthology.orchestra.run.smithi121.stdout:mds.cephfs.smithi121.xuzsdg smithi121 running (118s) 92s ago 117s 10.7M - 17.2.7-1406-gdf62bdcc 774894bef55f 6976b708cdcd 2024-08-18T22:41:06.257 INFO:teuthology.orchestra.run.smithi121.stdout:mds.cephfs.smithi195.buqvbr smithi195 running (115s) 98s ago 114s 15.5M - 17.2.7-1406-gdf62bdcc 774894bef55f 11a3703b4276 2024-08-18T22:41:06.257 INFO:teuthology.orchestra.run.smithi121.stdout:mds.cephfs.smithi195.nptgyc smithi195 running (108s) 98s ago 108s 15.0M - 17.2.7-1406-gdf62bdcc 774894bef55f b9f8043ea83e 2024-08-18T22:41:06.257 INFO:teuthology.orchestra.run.smithi121.stdout:mgr.smithi121.lopxqc smithi121 *:9283,8765,8443 running (8m) 92s ago 8m 447M - 17.2.7-1406-gdf62bdcc 774894bef55f 3ac16dcb26e3 2024-08-18T22:41:06.257 INFO:teuthology.orchestra.run.smithi121.stdout:mgr.smithi195.acttsj smithi195 *:8443,9283 running (6m) 98s ago 6m 402M - 17.2.7-1406-gdf62bdcc 774894bef55f 3d19eb0493d5 2024-08-18T22:41:06.257 INFO:teuthology.orchestra.run.smithi121.stdout:mon.smithi121 smithi121 running (8m) 92s ago 8m 51.2M 2048M 17.2.7-1406-gdf62bdcc 774894bef55f 4a7bead235ac 2024-08-18T22:41:06.257 INFO:teuthology.orchestra.run.smithi121.stdout:mon.smithi195 smithi195 running (6m) 98s ago 6m 42.0M 2048M 17.2.7-1406-gdf62bdcc 774894bef55f ced63ecfbfae 2024-08-18T22:41:06.257 INFO:teuthology.orchestra.run.smithi121.stdout:node-exporter.smithi121 smithi121 *:9100 running (7m) 92s ago 7m 16.9M - 1.5.0 0da6a335fe13 81d394827425 2024-08-18T22:41:06.257 INFO:teuthology.orchestra.run.smithi121.stdout:node-exporter.smithi195 smithi195 *:9100 running (6m) 98s ago 6m 16.2M - 1.5.0 0da6a335fe13 e09a01163b83 2024-08-18T22:41:06.258 INFO:teuthology.orchestra.run.smithi121.stdout:osd.0 smithi121 running (5m) 92s ago 5m 47.2M 4287M 17.2.7-1406-gdf62bdcc 774894bef55f 30859216633d 2024-08-18T22:41:06.258 INFO:teuthology.orchestra.run.smithi121.stdout:osd.1 smithi121 running (4m) 92s ago 4m 49.1M 4287M 17.2.7-1406-gdf62bdcc 774894bef55f ef5fadfd753f 2024-08-18T22:41:06.258 INFO:teuthology.orchestra.run.smithi121.stdout:osd.2 smithi121 running (4m) 92s ago 4m 43.6M 4287M 17.2.7-1406-gdf62bdcc 774894bef55f 3fa061e41f99 2024-08-18T22:41:06.258 INFO:teuthology.orchestra.run.smithi121.stdout:osd.3 smithi195 running (4m) 98s ago 4m 46.2M 5312M 17.2.7-1406-gdf62bdcc 774894bef55f 15d30b1b459e 2024-08-18T22:41:06.258 INFO:teuthology.orchestra.run.smithi121.stdout:osd.4 smithi195 running (3m) 98s ago 3m 42.2M 5312M 17.2.7-1406-gdf62bdcc 774894bef55f 99ed156dfd36 2024-08-18T22:41:06.258 INFO:teuthology.orchestra.run.smithi121.stdout:osd.5 smithi195 running (3m) 98s ago 3m 44.1M 5312M 17.2.7-1406-gdf62bdcc 774894bef55f e7eff7bdb752 2024-08-18T22:41:06.258 INFO:teuthology.orchestra.run.smithi121.stdout:prometheus.smithi121 smithi121 *:9095 running (5m) 92s ago 6m 56.2M - 2.43.0 a07b618ecd1d d6016f1b45a3 2024-08-18T22:41:06.259 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:06.258+0000 7fd887264640 1 -- 172.21.15.121:0/3912880449 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7fd870067190 msgr2=0x7fd870069640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:41:06.259 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:06.258+0000 7fd887264640 1 --2- 172.21.15.121:0/3912880449 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7fd870067190 0x7fd870069640 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fd880113250 tx=0x7fd86c00b040 comp rx=0 tx=0).stop 2024-08-18T22:41:06.259 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:06.258+0000 7fd887264640 1 -- 172.21.15.121:0/3912880449 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd8800fb1d0 msgr2=0x7fd8801134a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:41:06.259 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:06.258+0000 7fd887264640 1 --2- 172.21.15.121:0/3912880449 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd8800fb1d0 0x7fd8801134a0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fd8740047e0 tx=0x7fd874009da0 comp rx=0 tx=0).stop 2024-08-18T22:41:06.259 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:06.258+0000 7fd887264640 1 -- 172.21.15.121:0/3912880449 shutdown_connections 2024-08-18T22:41:06.259 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:06.258+0000 7fd887264640 1 --2- 172.21.15.121:0/3912880449 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7fd870067190 0x7fd870069640 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:41:06.259 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:06.258+0000 7fd887264640 1 --2- 172.21.15.121:0/3912880449 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd8800fc4a0 0x7fd8801139e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:41:06.259 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:06.258+0000 7fd887264640 1 --2- 172.21.15.121:0/3912880449 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd8800fb1d0 0x7fd8801134a0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:41:06.259 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:06.258+0000 7fd887264640 1 -- 172.21.15.121:0/3912880449 >> 172.21.15.121:0/3912880449 conn(0x7fd8800f69b0 msgr2=0x7fd880065430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:41:06.260 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:06.258+0000 7fd887264640 1 -- 172.21.15.121:0/3912880449 shutdown_connections 2024-08-18T22:41:06.260 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:06.258+0000 7fd887264640 1 -- 172.21.15.121:0/3912880449 wait complete. 2024-08-18T22:41:06.359 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:06.358+0000 7f0d8d839640 1 -- 172.21.15.121:0/3477617123 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0d880fc4a0 msgr2=0x7f0d880fc910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:41:06.360 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:06.358+0000 7f0d8d839640 1 --2- 172.21.15.121:0/3477617123 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0d880fc4a0 0x7f0d880fc910 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f0d7c0048d0 tx=0x7f0d7c009da0 comp rx=0 tx=0).stop 2024-08-18T22:41:06.360 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:06.358+0000 7f0d8d839640 1 -- 172.21.15.121:0/3477617123 shutdown_connections 2024-08-18T22:41:06.360 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:06.358+0000 7f0d8d839640 1 --2- 172.21.15.121:0/3477617123 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0d880fc4a0 0x7f0d880fc910 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:41:06.360 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:06.358+0000 7f0d8d839640 1 --2- 172.21.15.121:0/3477617123 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0d880fb1d0 0x7f0d880fb5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:41:06.360 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:06.358+0000 7f0d8d839640 1 -- 172.21.15.121:0/3477617123 >> 172.21.15.121:0/3477617123 conn(0x7f0d880f69b0 msgr2=0x7f0d880f8dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:41:06.360 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:06.358+0000 7f0d8d839640 1 -- 172.21.15.121:0/3477617123 shutdown_connections 2024-08-18T22:41:06.360 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:06.358+0000 7f0d8d839640 1 -- 172.21.15.121:0/3477617123 wait complete. 2024-08-18T22:41:06.362 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:06.359+0000 7f0d8d839640 1 Processor -- start 2024-08-18T22:41:06.362 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:06.359+0000 7f0d8d839640 1 -- start start 2024-08-18T22:41:06.362 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:06.360+0000 7f0d8d839640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0d880fb1d0 0x7f0d881134c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:41:06.362 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:06.360+0000 7f0d8d839640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0d880fc4a0 0x7f0d88113a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:41:06.362 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:06.360+0000 7f0d8d839640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d88114050 con 0x7f0d880fb1d0 2024-08-18T22:41:06.362 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:06.360+0000 7f0d8d839640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d88114820 con 0x7f0d880fc4a0 2024-08-18T22:41:06.362 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:06.360+0000 7f0d86ffd640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0d880fb1d0 0x7f0d881134c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:41:06.362 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:06.360+0000 7f0d86ffd640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0d880fb1d0 0x7f0d881134c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:39244/0 (socket says 172.21.15.121:39244) 2024-08-18T22:41:06.362 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:06.360+0000 7f0d86ffd640 1 -- 172.21.15.121:0/2971518124 learned_addr learned my addr 172.21.15.121:0/2971518124 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-18T22:41:06.362 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:06.360+0000 7f0d867fc640 1 --2- 172.21.15.121:0/2971518124 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0d880fc4a0 0x7f0d88113a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:41:06.362 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:06.360+0000 7f0d86ffd640 1 -- 172.21.15.121:0/2971518124 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0d880fc4a0 msgr2=0x7f0d88113a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:41:06.363 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:06.360+0000 7f0d86ffd640 1 --2- 172.21.15.121:0/2971518124 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0d880fc4a0 0x7f0d88113a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:41:06.363 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:06.360+0000 7f0d86ffd640 1 -- 172.21.15.121:0/2971518124 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d7c005040 con 0x7f0d880fb1d0 2024-08-18T22:41:06.363 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:06.360+0000 7f0d86ffd640 1 --2- 172.21.15.121:0/2971518124 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0d880fb1d0 0x7f0d881134c0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f0d7800eb70 tx=0x7f0d7800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:41:06.363 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:06.360+0000 7f0d6f7fe640 1 -- 172.21.15.121:0/2971518124 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0d78007c30 con 0x7f0d880fb1d0 2024-08-18T22:41:06.363 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:06.361+0000 7f0d6f7fe640 1 -- 172.21.15.121:0/2971518124 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f0d7800f040 con 0x7f0d880fb1d0 2024-08-18T22:41:06.363 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:06.361+0000 7f0d8d839640 1 -- 172.21.15.121:0/2971518124 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d88114a50 con 0x7f0d880fb1d0 2024-08-18T22:41:06.364 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:06.361+0000 7f0d6f7fe640 1 -- 172.21.15.121:0/2971518124 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0d7800ca60 con 0x7f0d880fb1d0 2024-08-18T22:41:06.364 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:06.361+0000 7f0d8d839640 1 -- 172.21.15.121:0/2971518124 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d88114ff0 con 0x7f0d880fb1d0 2024-08-18T22:41:06.364 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:06.362+0000 7f0d6f7fe640 1 -- 172.21.15.121:0/2971518124 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 19) v1 ==== 85127+0+0 (secure 0 0 0) 0x7f0d7800cc80 con 0x7f0d880fb1d0 2024-08-18T22:41:06.364 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:06.363+0000 7f0d8d839640 1 -- 172.21.15.121:0/2971518124 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d880fa630 con 0x7f0d880fb1d0 2024-08-18T22:41:06.364 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:06.363+0000 7f0d6f7fe640 1 --2- 172.21.15.121:0/2971518124 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7f0d70067190 0x7f0d70069640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:41:06.364 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:06.363+0000 7f0d6f7fe640 1 -- 172.21.15.121:0/2971518124 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f0d780845b0 con 0x7f0d880fb1d0 2024-08-18T22:41:06.364 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:06.363+0000 7f0d867fc640 1 --2- 172.21.15.121:0/2971518124 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7f0d70067190 0x7f0d70069640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:41:06.365 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:06.364+0000 7f0d867fc640 1 --2- 172.21.15.121:0/2971518124 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7f0d70067190 0x7f0d70069640 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f0d7c007ac0 tx=0x7f0d7c035040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:41:06.369 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:06.368+0000 7f0d6f7fe640 1 -- 172.21.15.121:0/2971518124 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f0d78051820 con 0x7f0d880fb1d0 2024-08-18T22:41:06.583 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:41:06 smithi121 ceph-mon[16788]: pgmap v228: 65 pgs: 65 active+clean; 93 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 5.1 MiB/s wr, 450 op/s 2024-08-18T22:41:06.638 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:41:06 smithi195 ceph-mon[23370]: pgmap v228: 65 pgs: 65 active+clean; 93 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 5.1 MiB/s wr, 450 op/s 2024-08-18T22:41:06.716 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:06.715+0000 7f0d8d839640 1 -- 172.21.15.121:0/2971518124 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f0d88103d70 con 0x7f0d880fb1d0 2024-08-18T22:41:06.716 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:06.716+0000 7f0d6f7fe640 1 -- 172.21.15.121:0/2971518124 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+643 (secure 0 0 0) 0x7f0d78051030 con 0x7f0d880fb1d0 2024-08-18T22:41:06.717 INFO:teuthology.orchestra.run.smithi121.stdout:{ 2024-08-18T22:41:06.717 INFO:teuthology.orchestra.run.smithi121.stdout: "mon": { 2024-08-18T22:41:06.717 INFO:teuthology.orchestra.run.smithi121.stdout: "ceph version 17.2.7-1406-gdf62bdcc (df62bdccd9a13bf566b27a250eddfdd89be3072d) quincy (stable)": 2 2024-08-18T22:41:06.717 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-18T22:41:06.717 INFO:teuthology.orchestra.run.smithi121.stdout: "mgr": { 2024-08-18T22:41:06.717 INFO:teuthology.orchestra.run.smithi121.stdout: "ceph version 17.2.7-1406-gdf62bdcc (df62bdccd9a13bf566b27a250eddfdd89be3072d) quincy (stable)": 2 2024-08-18T22:41:06.717 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-18T22:41:06.717 INFO:teuthology.orchestra.run.smithi121.stdout: "osd": { 2024-08-18T22:41:06.717 INFO:teuthology.orchestra.run.smithi121.stdout: "ceph version 17.2.7-1406-gdf62bdcc (df62bdccd9a13bf566b27a250eddfdd89be3072d) quincy (stable)": 6 2024-08-18T22:41:06.717 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-18T22:41:06.717 INFO:teuthology.orchestra.run.smithi121.stdout: "mds": { 2024-08-18T22:41:06.718 INFO:teuthology.orchestra.run.smithi121.stdout: "ceph version 17.2.7-1406-gdf62bdcc (df62bdccd9a13bf566b27a250eddfdd89be3072d) quincy (stable)": 4 2024-08-18T22:41:06.718 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-18T22:41:06.718 INFO:teuthology.orchestra.run.smithi121.stdout: "overall": { 2024-08-18T22:41:06.718 INFO:teuthology.orchestra.run.smithi121.stdout: "ceph version 17.2.7-1406-gdf62bdcc (df62bdccd9a13bf566b27a250eddfdd89be3072d) quincy (stable)": 14 2024-08-18T22:41:06.718 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-08-18T22:41:06.718 INFO:teuthology.orchestra.run.smithi121.stdout:} 2024-08-18T22:41:06.719 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:06.718+0000 7f0d8d839640 1 -- 172.21.15.121:0/2971518124 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7f0d70067190 msgr2=0x7f0d70069640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:41:06.719 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:06.718+0000 7f0d8d839640 1 --2- 172.21.15.121:0/2971518124 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7f0d70067190 0x7f0d70069640 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f0d7c007ac0 tx=0x7f0d7c035040 comp rx=0 tx=0).stop 2024-08-18T22:41:06.719 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:06.718+0000 7f0d8d839640 1 -- 172.21.15.121:0/2971518124 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0d880fb1d0 msgr2=0x7f0d881134c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:41:06.719 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:06.718+0000 7f0d8d839640 1 --2- 172.21.15.121:0/2971518124 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0d880fb1d0 0x7f0d881134c0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f0d7800eb70 tx=0x7f0d7800b040 comp rx=0 tx=0).stop 2024-08-18T22:41:06.719 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:06.718+0000 7f0d8d839640 1 -- 172.21.15.121:0/2971518124 shutdown_connections 2024-08-18T22:41:06.719 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:06.718+0000 7f0d8d839640 1 --2- 172.21.15.121:0/2971518124 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7f0d70067190 0x7f0d70069640 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:41:06.719 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:06.718+0000 7f0d8d839640 1 --2- 172.21.15.121:0/2971518124 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0d880fc4a0 0x7f0d88113a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:41:06.720 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:06.718+0000 7f0d8d839640 1 --2- 172.21.15.121:0/2971518124 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0d880fb1d0 0x7f0d881134c0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:41:06.720 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:06.718+0000 7f0d8d839640 1 -- 172.21.15.121:0/2971518124 >> 172.21.15.121:0/2971518124 conn(0x7f0d880f69b0 msgr2=0x7f0d880653b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:41:06.720 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:06.718+0000 7f0d8d839640 1 -- 172.21.15.121:0/2971518124 shutdown_connections 2024-08-18T22:41:06.720 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:06.718+0000 7f0d8d839640 1 -- 172.21.15.121:0/2971518124 wait complete. 2024-08-18T22:41:06.831 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:06.830+0000 7f7353c9d640 1 -- 172.21.15.121:0/3370755473 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f734c0fc4b0 msgr2=0x7f734c0fc920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:41:06.832 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:06.830+0000 7f7353c9d640 1 --2- 172.21.15.121:0/3370755473 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f734c0fc4b0 0x7f734c0fc920 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f733c0048d0 tx=0x7f733c009da0 comp rx=0 tx=0).stop 2024-08-18T22:41:06.832 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:06.830+0000 7f7353c9d640 1 -- 172.21.15.121:0/3370755473 shutdown_connections 2024-08-18T22:41:06.832 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:06.830+0000 7f7353c9d640 1 --2- 172.21.15.121:0/3370755473 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f734c0fc4b0 0x7f734c0fc920 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:41:06.832 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:06.830+0000 7f7353c9d640 1 --2- 172.21.15.121:0/3370755473 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f734c0fb1e0 0x7f734c0fb5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:41:06.832 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:06.830+0000 7f7353c9d640 1 -- 172.21.15.121:0/3370755473 >> 172.21.15.121:0/3370755473 conn(0x7f734c0f69c0 msgr2=0x7f734c0f8dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:41:06.832 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:06.830+0000 7f7353c9d640 1 -- 172.21.15.121:0/3370755473 shutdown_connections 2024-08-18T22:41:06.832 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:06.830+0000 7f7353c9d640 1 -- 172.21.15.121:0/3370755473 wait complete. 2024-08-18T22:41:06.834 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:06.831+0000 7f7353c9d640 1 Processor -- start 2024-08-18T22:41:06.834 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:06.831+0000 7f7353c9d640 1 -- start start 2024-08-18T22:41:06.834 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:06.831+0000 7f7353c9d640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f734c0fb1e0 0x7f734c10bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:41:06.834 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:06.831+0000 7f7353c9d640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f734c0fc4b0 0x7f734c10c300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:41:06.834 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:06.831+0000 7f7353c9d640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f734c10c980 con 0x7f734c0fb1e0 2024-08-18T22:41:06.834 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:06.831+0000 7f7353c9d640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f734c10d0c0 con 0x7f734c0fc4b0 2024-08-18T22:41:06.834 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:06.832+0000 7f7351a39640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f734c0fb1e0 0x7f734c10bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:41:06.834 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:06.832+0000 7f7351a39640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f734c0fb1e0 0x7f734c10bdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:53242/0 (socket says 172.21.15.121:53242) 2024-08-18T22:41:06.834 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:06.832+0000 7f7351a39640 1 -- 172.21.15.121:0/3662803901 learned_addr learned my addr 172.21.15.121:0/3662803901 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-18T22:41:06.835 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:06.832+0000 7f7351238640 1 --2- 172.21.15.121:0/3662803901 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f734c0fc4b0 0x7f734c10c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:41:06.835 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:06.832+0000 7f7351238640 1 -- 172.21.15.121:0/3662803901 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f734c0fb1e0 msgr2=0x7f734c10bdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:41:06.835 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:06.832+0000 7f7351238640 1 --2- 172.21.15.121:0/3662803901 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f734c0fb1e0 0x7f734c10bdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:41:06.835 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:06.832+0000 7f7351238640 1 -- 172.21.15.121:0/3662803901 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f733c005040 con 0x7f734c0fc4b0 2024-08-18T22:41:06.835 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:06.832+0000 7f7351a39640 1 --2- 172.21.15.121:0/3662803901 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f734c0fb1e0 0x7f734c10bdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:41:06.835 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:06.832+0000 7f7351238640 1 --2- 172.21.15.121:0/3662803901 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f734c0fc4b0 0x7f734c10c300 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f733c0048d0 tx=0x7f733c009da0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:41:06.835 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:06.833+0000 7f73427fc640 1 -- 172.21.15.121:0/3662803901 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f733c038070 con 0x7f734c0fc4b0 2024-08-18T22:41:06.835 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:06.833+0000 7f7353c9d640 1 -- 172.21.15.121:0/3662803901 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f734c10d2e0 con 0x7f734c0fc4b0 2024-08-18T22:41:06.835 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:06.833+0000 7f73427fc640 1 -- 172.21.15.121:0/3662803901 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f733c02ae90 con 0x7f734c0fc4b0 2024-08-18T22:41:06.835 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:06.833+0000 7f73427fc640 1 -- 172.21.15.121:0/3662803901 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f733c03e430 con 0x7f734c0fc4b0 2024-08-18T22:41:06.835 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:06.833+0000 7f7353c9d640 1 -- 172.21.15.121:0/3662803901 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f734c10d830 con 0x7f734c0fc4b0 2024-08-18T22:41:06.836 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:06.835+0000 7f7353c9d640 1 -- 172.21.15.121:0/3662803901 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f734c0fa640 con 0x7f734c0fc4b0 2024-08-18T22:41:06.836 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:06.835+0000 7f73427fc640 1 -- 172.21.15.121:0/3662803901 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 19) v1 ==== 85127+0+0 (secure 0 0 0) 0x7f733c030020 con 0x7f734c0fc4b0 2024-08-18T22:41:06.836 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:06.835+0000 7f73427fc640 1 --2- 172.21.15.121:0/3662803901 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7f73380671e0 0x7f7338069690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:41:06.836 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:06.835+0000 7f73427fc640 1 -- 172.21.15.121:0/3662803901 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f733c0a4c30 con 0x7f734c0fc4b0 2024-08-18T22:41:06.836 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:06.835+0000 7f7351a39640 1 --2- 172.21.15.121:0/3662803901 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7f73380671e0 0x7f7338069690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:41:06.837 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:06.836+0000 7f7351a39640 1 --2- 172.21.15.121:0/3662803901 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7f73380671e0 0x7f7338069690 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f734c0fd830 tx=0x7f734800b040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:41:06.842 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:06.841+0000 7f73427fc640 1 -- 172.21.15.121:0/3662803901 <== mon.1 v2:172.21.15.195:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f733c071ea0 con 0x7f734c0fc4b0 2024-08-18T22:41:07.146 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:07.145+0000 7f7353c9d640 1 -- 172.21.15.121:0/3662803901 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f734c04b4c0 con 0x7f734c0fc4b0 2024-08-18T22:41:07.146 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:07.145+0000 7f73427fc640 1 -- 172.21.15.121:0/3662803901 <== mon.1 v2:172.21.15.195:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 18 v18) v1 ==== 76+0+1835 (secure 0 0 0) 0x7f733c0754c0 con 0x7f734c0fc4b0 2024-08-18T22:41:07.147 INFO:teuthology.orchestra.run.smithi121.stdout:e18 2024-08-18T22:41:07.147 INFO:teuthology.orchestra.run.smithi121.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-08-18T22:41:07.147 INFO:teuthology.orchestra.run.smithi121.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-08-18T22:41:07.147 INFO:teuthology.orchestra.run.smithi121.stdout:legacy client fscid: 1 2024-08-18T22:41:07.147 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-08-18T22:41:07.147 INFO:teuthology.orchestra.run.smithi121.stdout:Filesystem 'cephfs' (1) 2024-08-18T22:41:07.147 INFO:teuthology.orchestra.run.smithi121.stdout:fs_name cephfs 2024-08-18T22:41:07.147 INFO:teuthology.orchestra.run.smithi121.stdout:epoch 18 2024-08-18T22:41:07.148 INFO:teuthology.orchestra.run.smithi121.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-08-18T22:41:07.148 INFO:teuthology.orchestra.run.smithi121.stdout:created 2024-08-18T22:39:04.054074+0000 2024-08-18T22:41:07.148 INFO:teuthology.orchestra.run.smithi121.stdout:modified 2024-08-18T22:41:01.169096+0000 2024-08-18T22:41:07.148 INFO:teuthology.orchestra.run.smithi121.stdout:tableserver 0 2024-08-18T22:41:07.148 INFO:teuthology.orchestra.run.smithi121.stdout:root 0 2024-08-18T22:41:07.148 INFO:teuthology.orchestra.run.smithi121.stdout:session_timeout 60 2024-08-18T22:41:07.148 INFO:teuthology.orchestra.run.smithi121.stdout:session_autoclose 300 2024-08-18T22:41:07.148 INFO:teuthology.orchestra.run.smithi121.stdout:max_file_size 1099511627776 2024-08-18T22:41:07.148 INFO:teuthology.orchestra.run.smithi121.stdout:required_client_features {} 2024-08-18T22:41:07.148 INFO:teuthology.orchestra.run.smithi121.stdout:last_failure 0 2024-08-18T22:41:07.148 INFO:teuthology.orchestra.run.smithi121.stdout:last_failure_osd_epoch 47 2024-08-18T22:41:07.148 INFO:teuthology.orchestra.run.smithi121.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-08-18T22:41:07.148 INFO:teuthology.orchestra.run.smithi121.stdout:max_mds 2 2024-08-18T22:41:07.148 INFO:teuthology.orchestra.run.smithi121.stdout:in 0,1 2024-08-18T22:41:07.148 INFO:teuthology.orchestra.run.smithi121.stdout:up {0=14474,1=24249} 2024-08-18T22:41:07.149 INFO:teuthology.orchestra.run.smithi121.stdout:failed 2024-08-18T22:41:07.149 INFO:teuthology.orchestra.run.smithi121.stdout:damaged 2024-08-18T22:41:07.149 INFO:teuthology.orchestra.run.smithi121.stdout:stopped 2024-08-18T22:41:07.149 INFO:teuthology.orchestra.run.smithi121.stdout:data_pools [3] 2024-08-18T22:41:07.149 INFO:teuthology.orchestra.run.smithi121.stdout:metadata_pool 2 2024-08-18T22:41:07.149 INFO:teuthology.orchestra.run.smithi121.stdout:inline_data disabled 2024-08-18T22:41:07.149 INFO:teuthology.orchestra.run.smithi121.stdout:balancer 2024-08-18T22:41:07.149 INFO:teuthology.orchestra.run.smithi121.stdout:standby_count_wanted 1 2024-08-18T22:41:07.149 INFO:teuthology.orchestra.run.smithi121.stdout:[mds.cephfs.smithi121.gbickb{0:14474} state up:active seq 6 export targets 1 join_fscid=1 addr [v2:172.21.15.121:6828/2277706406,v1:172.21.15.121:6829/2277706406] compat {c=[1],r=[1],i=[7ff]}] 2024-08-18T22:41:07.149 INFO:teuthology.orchestra.run.smithi121.stdout:[mds.cephfs.smithi195.buqvbr{1:24249} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.195:6824/2414511859,v1:172.21.15.195:6825/2414511859] compat {c=[1],r=[1],i=[7ff]}] 2024-08-18T22:41:07.149 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-08-18T22:41:07.149 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-08-18T22:41:07.149 INFO:teuthology.orchestra.run.smithi121.stdout:Standby daemons: 2024-08-18T22:41:07.150 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-08-18T22:41:07.150 INFO:teuthology.orchestra.run.smithi121.stdout:[mds.cephfs.smithi121.xuzsdg{-1:14490} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.121:6826/91588128,v1:172.21.15.121:6827/91588128] compat {c=[1],r=[1],i=[7ff]}] 2024-08-18T22:41:07.150 INFO:teuthology.orchestra.run.smithi121.stdout:[mds.cephfs.smithi195.nptgyc{-1:24259} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.195:6826/238549847,v1:172.21.15.195:6827/238549847] compat {c=[1],r=[1],i=[7ff]}] 2024-08-18T22:41:07.150 INFO:teuthology.orchestra.run.smithi121.stderr:dumped fsmap epoch 18 2024-08-18T22:41:07.151 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:07.149+0000 7f7353c9d640 1 -- 172.21.15.121:0/3662803901 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7f73380671e0 msgr2=0x7f7338069690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:41:07.151 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:07.149+0000 7f7353c9d640 1 --2- 172.21.15.121:0/3662803901 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7f73380671e0 0x7f7338069690 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f734c0fd830 tx=0x7f734800b040 comp rx=0 tx=0).stop 2024-08-18T22:41:07.151 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:07.149+0000 7f7353c9d640 1 -- 172.21.15.121:0/3662803901 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f734c0fc4b0 msgr2=0x7f734c10c300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:41:07.151 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:07.149+0000 7f7353c9d640 1 --2- 172.21.15.121:0/3662803901 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f734c0fc4b0 0x7f734c10c300 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f733c0048d0 tx=0x7f733c009da0 comp rx=0 tx=0).stop 2024-08-18T22:41:07.151 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:07.149+0000 7f7353c9d640 1 -- 172.21.15.121:0/3662803901 shutdown_connections 2024-08-18T22:41:07.151 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:07.149+0000 7f7353c9d640 1 --2- 172.21.15.121:0/3662803901 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7f73380671e0 0x7f7338069690 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:41:07.151 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:07.149+0000 7f7353c9d640 1 --2- 172.21.15.121:0/3662803901 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f734c0fc4b0 0x7f734c10c300 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:41:07.151 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:07.149+0000 7f7353c9d640 1 --2- 172.21.15.121:0/3662803901 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f734c0fb1e0 0x7f734c10bdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:41:07.151 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:07.149+0000 7f7353c9d640 1 -- 172.21.15.121:0/3662803901 >> 172.21.15.121:0/3662803901 conn(0x7f734c0f69c0 msgr2=0x7f734c0f81e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:41:07.151 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:07.149+0000 7f7353c9d640 1 -- 172.21.15.121:0/3662803901 shutdown_connections 2024-08-18T22:41:07.151 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:07.149+0000 7f7353c9d640 1 -- 172.21.15.121:0/3662803901 wait complete. 2024-08-18T22:41:07.262 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:07.261+0000 7fea1b061640 1 -- 172.21.15.121:0/3867848364 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fea140fd210 msgr2=0x7fea140ff690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:41:07.262 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:07.261+0000 7fea1b061640 1 --2- 172.21.15.121:0/3867848364 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fea140fd210 0x7fea140ff690 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fea000048d0 tx=0x7fea00009da0 comp rx=0 tx=0).stop 2024-08-18T22:41:07.262 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:07.261+0000 7fea1b061640 1 -- 172.21.15.121:0/3867848364 shutdown_connections 2024-08-18T22:41:07.262 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:07.261+0000 7fea1b061640 1 --2- 172.21.15.121:0/3867848364 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fea140fd210 0x7fea140ff690 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:41:07.262 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:07.261+0000 7fea1b061640 1 --2- 172.21.15.121:0/3867848364 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fea140659e0 0x7fea140fccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:41:07.262 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:07.261+0000 7fea1b061640 1 -- 172.21.15.121:0/3867848364 >> 172.21.15.121:0/3867848364 conn(0x7fea140f69b0 msgr2=0x7fea140f8dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:41:07.263 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:07.261+0000 7fea1b061640 1 -- 172.21.15.121:0/3867848364 shutdown_connections 2024-08-18T22:41:07.263 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:07.261+0000 7fea1b061640 1 -- 172.21.15.121:0/3867848364 wait complete. 2024-08-18T22:41:07.264 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:07.262+0000 7fea1b061640 1 Processor -- start 2024-08-18T22:41:07.264 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:07.262+0000 7fea1b061640 1 -- start start 2024-08-18T22:41:07.264 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:07.262+0000 7fea1b061640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fea140659e0 0x7fea14113450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:41:07.264 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:07.262+0000 7fea1b061640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fea140fd210 0x7fea14113990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:41:07.264 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:07.262+0000 7fea1b061640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea14113fe0 con 0x7fea140659e0 2024-08-18T22:41:07.264 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:07.262+0000 7fea1b061640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea141147b0 con 0x7fea140fd210 2024-08-18T22:41:07.264 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:07.263+0000 7fea13fff640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fea140fd210 0x7fea14113990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:41:07.264 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:07.263+0000 7fea13fff640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fea140fd210 0x7fea14113990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.121:59720/0 (socket says 172.21.15.121:59720) 2024-08-18T22:41:07.264 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:07.263+0000 7fea13fff640 1 -- 172.21.15.121:0/2179558878 learned_addr learned my addr 172.21.15.121:0/2179558878 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-18T22:41:07.265 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:07.263+0000 7fea18dfd640 1 --2- 172.21.15.121:0/2179558878 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fea140659e0 0x7fea14113450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:41:07.265 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:07.263+0000 7fea18dfd640 1 -- 172.21.15.121:0/2179558878 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fea140fd210 msgr2=0x7fea14113990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:41:07.266 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:07.263+0000 7fea18dfd640 1 --2- 172.21.15.121:0/2179558878 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fea140fd210 0x7fea14113990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:41:07.266 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:07.264+0000 7fea18dfd640 1 -- 172.21.15.121:0/2179558878 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea00005040 con 0x7fea140659e0 2024-08-18T22:41:07.266 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:07.264+0000 7fea18dfd640 1 --2- 172.21.15.121:0/2179558878 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fea140659e0 0x7fea14113450 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fea14065740 tx=0x7fea08004570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:41:07.266 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:07.264+0000 7fea117fa640 1 -- 172.21.15.121:0/2179558878 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fea08007c30 con 0x7fea140659e0 2024-08-18T22:41:07.266 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:07.264+0000 7fea117fa640 1 -- 172.21.15.121:0/2179558878 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fea0800f040 con 0x7fea140659e0 2024-08-18T22:41:07.266 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:07.264+0000 7fea117fa640 1 -- 172.21.15.121:0/2179558878 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fea0800d970 con 0x7fea140659e0 2024-08-18T22:41:07.266 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:07.264+0000 7fea1b061640 1 -- 172.21.15.121:0/2179558878 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea14114a40 con 0x7fea140659e0 2024-08-18T22:41:07.266 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:07.264+0000 7fea1b061640 1 -- 172.21.15.121:0/2179558878 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea14114f60 con 0x7fea140659e0 2024-08-18T22:41:07.267 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:07.266+0000 7fea1b061640 1 -- 172.21.15.121:0/2179558878 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea140fa630 con 0x7fea140659e0 2024-08-18T22:41:07.267 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:07.267+0000 7fea117fa640 1 -- 172.21.15.121:0/2179558878 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 19) v1 ==== 85127+0+0 (secure 0 0 0) 0x7fea0800daf0 con 0x7fea140659e0 2024-08-18T22:41:07.268 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:07.267+0000 7fea117fa640 1 --2- 172.21.15.121:0/2179558878 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7fea04067190 0x7fea04069640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:41:07.268 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:07.267+0000 7fea117fa640 1 -- 172.21.15.121:0/2179558878 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5550+0+0 (secure 0 0 0) 0x7fea08084230 con 0x7fea140659e0 2024-08-18T22:41:07.269 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:07.267+0000 7fea13fff640 1 --2- 172.21.15.121:0/2179558878 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7fea04067190 0x7fea04069640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:41:07.269 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:07.268+0000 7fea13fff640 1 --2- 172.21.15.121:0/2179558878 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7fea04067190 0x7fea04069640 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fea14113200 tx=0x7fea00035040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:41:07.274 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:07.273+0000 7fea117fa640 1 -- 172.21.15.121:0/2179558878 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fea0804d2a0 con 0x7fea140659e0 2024-08-18T22:41:07.535 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:41:07 smithi195 ceph-mon[23370]: from='client.14600 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-18T22:41:07.535 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:41:07 smithi195 ceph-mon[23370]: from='client.24361 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-18T22:41:07.535 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:41:07 smithi195 ceph-mon[23370]: from='client.24365 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-18T22:41:07.535 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:41:07 smithi195 ceph-mon[23370]: from='client.? 172.21.15.121:0/2971518124' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-08-18T22:41:07.535 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:41:07 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:41:07.535 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:41:07 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:41:07.535 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:41:07 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-18T22:41:07.535 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:41:07 smithi195 ceph-mon[23370]: from='client.? 172.21.15.121:0/3662803901' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-08-18T22:41:07.542 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:07.541+0000 7fea1b061640 1 -- 172.21.15.121:0/2179558878 --> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fea14115330 con 0x7fea04067190 2024-08-18T22:41:07.542 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:41:07 smithi121 ceph-mon[16788]: from='client.14600 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-18T22:41:07.542 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:41:07 smithi121 ceph-mon[16788]: from='client.24361 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-18T22:41:07.542 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:41:07 smithi121 ceph-mon[16788]: from='client.24365 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-18T22:41:07.542 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:41:07 smithi121 ceph-mon[16788]: from='client.? 172.21.15.121:0/2971518124' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-08-18T22:41:07.542 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:41:07 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:41:07.543 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:41:07 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:41:07.543 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:41:07 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-18T22:41:07.543 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:41:07 smithi121 ceph-mon[16788]: from='client.? 172.21.15.121:0/3662803901' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-08-18T22:41:07.543 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:07.542+0000 7fea117fa640 1 -- 172.21.15.121:0/2179558878 <== mgr.14206 v2:172.21.15.121:6800/3225195982 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+328 (secure 0 0 0) 0x7fea14115330 con 0x7fea04067190 2024-08-18T22:41:07.543 INFO:teuthology.orchestra.run.smithi121.stdout:{ 2024-08-18T22:41:07.543 INFO:teuthology.orchestra.run.smithi121.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9", 2024-08-18T22:41:07.543 INFO:teuthology.orchestra.run.smithi121.stdout: "in_progress": true, 2024-08-18T22:41:07.543 INFO:teuthology.orchestra.run.smithi121.stdout: "which": "Upgrading all daemon types on all hosts", 2024-08-18T22:41:07.544 INFO:teuthology.orchestra.run.smithi121.stdout: "services_complete": [], 2024-08-18T22:41:07.544 INFO:teuthology.orchestra.run.smithi121.stdout: "progress": "", 2024-08-18T22:41:07.544 INFO:teuthology.orchestra.run.smithi121.stdout: "message": "Currently upgrading mgr daemons", 2024-08-18T22:41:07.544 INFO:teuthology.orchestra.run.smithi121.stdout: "is_paused": false 2024-08-18T22:41:07.544 INFO:teuthology.orchestra.run.smithi121.stdout:} 2024-08-18T22:41:07.546 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:07.544+0000 7fea1b061640 1 -- 172.21.15.121:0/2179558878 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7fea04067190 msgr2=0x7fea04069640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:41:07.546 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:07.544+0000 7fea1b061640 1 --2- 172.21.15.121:0/2179558878 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7fea04067190 0x7fea04069640 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fea14113200 tx=0x7fea00035040 comp rx=0 tx=0).stop 2024-08-18T22:41:07.546 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:07.545+0000 7fea1b061640 1 -- 172.21.15.121:0/2179558878 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fea140659e0 msgr2=0x7fea14113450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:41:07.546 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:07.545+0000 7fea1b061640 1 --2- 172.21.15.121:0/2179558878 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fea140659e0 0x7fea14113450 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fea14065740 tx=0x7fea08004570 comp rx=0 tx=0).stop 2024-08-18T22:41:07.546 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:07.545+0000 7fea1b061640 1 -- 172.21.15.121:0/2179558878 shutdown_connections 2024-08-18T22:41:07.546 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:07.545+0000 7fea1b061640 1 --2- 172.21.15.121:0/2179558878 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7fea04067190 0x7fea04069640 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:41:07.547 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:07.545+0000 7fea1b061640 1 --2- 172.21.15.121:0/2179558878 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fea140fd210 0x7fea14113990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:41:07.547 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:07.545+0000 7fea1b061640 1 --2- 172.21.15.121:0/2179558878 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fea140659e0 0x7fea14113450 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:41:07.547 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:07.545+0000 7fea1b061640 1 -- 172.21.15.121:0/2179558878 >> 172.21.15.121:0/2179558878 conn(0x7fea140f69b0 msgr2=0x7fea140f6d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:41:07.547 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:07.545+0000 7fea1b061640 1 -- 172.21.15.121:0/2179558878 shutdown_connections 2024-08-18T22:41:07.547 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:07.545+0000 7fea1b061640 1 -- 172.21.15.121:0/2179558878 wait complete. 2024-08-18T22:41:07.659 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:07.657+0000 7fe84c85d640 1 -- 172.21.15.121:0/3691034148 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe8480fc4a0 msgr2=0x7fe8480fc910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:41:07.659 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:07.657+0000 7fe84c85d640 1 --2- 172.21.15.121:0/3691034148 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe8480fc4a0 0x7fe8480fc910 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fe83c0048d0 tx=0x7fe83c009da0 comp rx=0 tx=0).stop 2024-08-18T22:41:07.659 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:07.657+0000 7fe84c85d640 1 -- 172.21.15.121:0/3691034148 shutdown_connections 2024-08-18T22:41:07.659 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:07.658+0000 7fe84c85d640 1 --2- 172.21.15.121:0/3691034148 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe8480fc4a0 0x7fe8480fc910 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:41:07.659 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:07.658+0000 7fe84c85d640 1 --2- 172.21.15.121:0/3691034148 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe8480fb1d0 0x7fe8480fb5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:41:07.659 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:07.658+0000 7fe84c85d640 1 -- 172.21.15.121:0/3691034148 >> 172.21.15.121:0/3691034148 conn(0x7fe8480f69b0 msgr2=0x7fe8480f8dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:41:07.659 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:07.658+0000 7fe84c85d640 1 -- 172.21.15.121:0/3691034148 shutdown_connections 2024-08-18T22:41:07.659 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:07.658+0000 7fe84c85d640 1 -- 172.21.15.121:0/3691034148 wait complete. 2024-08-18T22:41:07.661 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:07.658+0000 7fe84c85d640 1 Processor -- start 2024-08-18T22:41:07.662 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:07.658+0000 7fe84c85d640 1 -- start start 2024-08-18T22:41:07.662 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:07.659+0000 7fe84c85d640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe8480fb1d0 0x7fe84810ab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:41:07.662 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:07.659+0000 7fe84c85d640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe8480fc4a0 0x7fe84810b0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:41:07.662 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:07.659+0000 7fe84c85d640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe84810b6c0 con 0x7fe8480fb1d0 2024-08-18T22:41:07.662 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:07.659+0000 7fe84c85d640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe84810bf80 con 0x7fe8480fc4a0 2024-08-18T22:41:07.662 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:07.659+0000 7fe84659c640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe8480fb1d0 0x7fe84810ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:41:07.662 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:07.659+0000 7fe84659c640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe8480fb1d0 0x7fe84810ab80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:53270/0 (socket says 172.21.15.121:53270) 2024-08-18T22:41:07.662 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:07.659+0000 7fe84659c640 1 -- 172.21.15.121:0/1261791351 learned_addr learned my addr 172.21.15.121:0/1261791351 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-18T22:41:07.662 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:07.659+0000 7fe845d9b640 1 --2- 172.21.15.121:0/1261791351 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe8480fc4a0 0x7fe84810b0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:41:07.662 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:07.659+0000 7fe84659c640 1 -- 172.21.15.121:0/1261791351 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe8480fc4a0 msgr2=0x7fe84810b0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:41:07.662 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:07.659+0000 7fe84659c640 1 --2- 172.21.15.121:0/1261791351 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe8480fc4a0 0x7fe84810b0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:41:07.662 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:07.659+0000 7fe84659c640 1 -- 172.21.15.121:0/1261791351 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe83c005040 con 0x7fe8480fb1d0 2024-08-18T22:41:07.662 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:07.660+0000 7fe84659c640 1 --2- 172.21.15.121:0/1261791351 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe8480fb1d0 0x7fe84810ab80 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fe83800b8d0 tx=0x7fe838007d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:41:07.663 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:07.660+0000 7fe836ffd640 1 -- 172.21.15.121:0/1261791351 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe838010070 con 0x7fe8480fb1d0 2024-08-18T22:41:07.663 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:07.660+0000 7fe836ffd640 1 -- 172.21.15.121:0/1261791351 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fe83800ac30 con 0x7fe8480fb1d0 2024-08-18T22:41:07.663 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:07.660+0000 7fe84c85d640 1 -- 172.21.15.121:0/1261791351 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe84810c260 con 0x7fe8480fb1d0 2024-08-18T22:41:07.663 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:07.660+0000 7fe84c85d640 1 -- 172.21.15.121:0/1261791351 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe84810c780 con 0x7fe8480fb1d0 2024-08-18T22:41:07.663 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:07.660+0000 7fe836ffd640 1 -- 172.21.15.121:0/1261791351 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe838012510 con 0x7fe8480fb1d0 2024-08-18T22:41:07.663 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:07.661+0000 7fe84c85d640 1 -- 172.21.15.121:0/1261791351 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8480fa630 con 0x7fe8480fb1d0 2024-08-18T22:41:07.664 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:07.662+0000 7fe836ffd640 1 -- 172.21.15.121:0/1261791351 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 19) v1 ==== 85127+0+0 (secure 0 0 0) 0x7fe8380153d0 con 0x7fe8480fb1d0 2024-08-18T22:41:07.664 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:07.663+0000 7fe836ffd640 1 --2- 172.21.15.121:0/1261791351 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7fe830067190 0x7fe830069640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:41:07.664 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:07.663+0000 7fe836ffd640 1 -- 172.21.15.121:0/1261791351 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5550+0+0 (secure 0 0 0) 0x7fe838085370 con 0x7fe8480fb1d0 2024-08-18T22:41:07.664 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:07.663+0000 7fe845d9b640 1 --2- 172.21.15.121:0/1261791351 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7fe830067190 0x7fe830069640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:41:07.664 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:07.664+0000 7fe845d9b640 1 --2- 172.21.15.121:0/1261791351 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7fe830067190 0x7fe830069640 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fe83c00b020 tx=0x7fe83c035040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:41:07.668 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:07.668+0000 7fe836ffd640 1 -- 172.21.15.121:0/1261791351 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fe838052640 con 0x7fe8480fb1d0 2024-08-18T22:41:07.967 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:07.966+0000 7fe84c85d640 1 -- 172.21.15.121:0/1261791351 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fe84804b4c0 con 0x7fe8480fb1d0 2024-08-18T22:41:07.968 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:07.967+0000 7fe836ffd640 1 -- 172.21.15.121:0/1261791351 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7fe838055c60 con 0x7fe8480fb1d0 2024-08-18T22:41:07.968 INFO:teuthology.orchestra.run.smithi121.stdout:HEALTH_OK 2024-08-18T22:41:07.970 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:07.969+0000 7fe84c85d640 1 -- 172.21.15.121:0/1261791351 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7fe830067190 msgr2=0x7fe830069640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:41:07.970 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:07.969+0000 7fe84c85d640 1 --2- 172.21.15.121:0/1261791351 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7fe830067190 0x7fe830069640 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fe83c00b020 tx=0x7fe83c035040 comp rx=0 tx=0).stop 2024-08-18T22:41:07.970 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:07.969+0000 7fe84c85d640 1 -- 172.21.15.121:0/1261791351 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe8480fb1d0 msgr2=0x7fe84810ab80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:41:07.971 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:07.969+0000 7fe84c85d640 1 --2- 172.21.15.121:0/1261791351 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe8480fb1d0 0x7fe84810ab80 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fe83800b8d0 tx=0x7fe838007d10 comp rx=0 tx=0).stop 2024-08-18T22:41:07.971 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:07.969+0000 7fe84c85d640 1 -- 172.21.15.121:0/1261791351 shutdown_connections 2024-08-18T22:41:07.971 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:07.969+0000 7fe84c85d640 1 --2- 172.21.15.121:0/1261791351 >> [v2:172.21.15.121:6800/3225195982,v1:172.21.15.121:6801/3225195982] conn(0x7fe830067190 0x7fe830069640 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:41:07.971 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:07.969+0000 7fe84c85d640 1 --2- 172.21.15.121:0/1261791351 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe8480fc4a0 0x7fe84810b0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:41:07.971 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:07.969+0000 7fe84c85d640 1 --2- 172.21.15.121:0/1261791351 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe8480fb1d0 0x7fe84810ab80 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:41:07.971 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:07.969+0000 7fe84c85d640 1 -- 172.21.15.121:0/1261791351 >> 172.21.15.121:0/1261791351 conn(0x7fe8480f69b0 msgr2=0x7fe8480f8190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:41:07.971 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:07.969+0000 7fe84c85d640 1 -- 172.21.15.121:0/1261791351 shutdown_connections 2024-08-18T22:41:07.971 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:07.969+0000 7fe84c85d640 1 -- 172.21.15.121:0/1261791351 wait complete. 2024-08-18T22:41:08.333 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:41:08 smithi121 ceph-mon[16788]: pgmap v229: 65 pgs: 65 active+clean; 94 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 4.9 MiB/s wr, 446 op/s 2024-08-18T22:41:08.333 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:41:08 smithi121 ceph-mon[16788]: from='client.? 172.21.15.121:0/1261791351' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-08-18T22:41:08.409 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:41:08 smithi195 ceph-mon[23370]: pgmap v229: 65 pgs: 65 active+clean; 94 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 4.9 MiB/s wr, 446 op/s 2024-08-18T22:41:08.409 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:41:08 smithi195 ceph-mon[23370]: from='client.? 172.21.15.121:0/1261791351' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-08-18T22:41:09.293 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:41:09 smithi195 ceph-mon[23370]: from='client.14624 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-18T22:41:09.293 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:41:09 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-18T22:41:09.583 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:41:09 smithi121 ceph-mon[16788]: from='client.14624 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-18T22:41:09.583 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:41:09 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-18T22:41:10.311 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:41:10 smithi195 ceph-mon[23370]: pgmap v230: 65 pgs: 65 active+clean; 105 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 5.4 MiB/s wr, 562 op/s 2024-08-18T22:41:10.583 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:41:10 smithi121 ceph-mon[16788]: pgmap v230: 65 pgs: 65 active+clean; 105 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 5.4 MiB/s wr, 562 op/s 2024-08-18T22:41:12.408 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:41:12 smithi195 ceph-mon[23370]: pgmap v231: 65 pgs: 65 active+clean; 114 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 5.4 MiB/s wr, 488 op/s 2024-08-18T22:41:12.583 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:41:12 smithi121 ceph-mon[16788]: pgmap v231: 65 pgs: 65 active+clean; 114 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 5.4 MiB/s wr, 488 op/s 2024-08-18T22:41:14.583 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:41:14 smithi121 ceph-mon[16788]: pgmap v232: 65 pgs: 65 active+clean; 124 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 5.4 MiB/s wr, 634 op/s 2024-08-18T22:41:14.583 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:41:14 smithi121 ceph-mon[16788]: Standby manager daemon smithi195.acttsj restarted 2024-08-18T22:41:14.583 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:41:14 smithi121 ceph-mon[16788]: Standby manager daemon smithi195.acttsj started 2024-08-18T22:41:14.584 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:41:14 smithi121 ceph-mon[16788]: from='mgr.? 172.21.15.195:0/2331273060' entity='mgr.smithi195.acttsj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi195.acttsj/crt"}]: dispatch 2024-08-18T22:41:14.584 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:41:14 smithi121 ceph-mon[16788]: from='mgr.? 172.21.15.195:0/2331273060' entity='mgr.smithi195.acttsj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-08-18T22:41:14.584 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:41:14 smithi121 ceph-mon[16788]: from='mgr.? 172.21.15.195:0/2331273060' entity='mgr.smithi195.acttsj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi195.acttsj/key"}]: dispatch 2024-08-18T22:41:14.584 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:41:14 smithi121 ceph-mon[16788]: from='mgr.? 172.21.15.195:0/2331273060' entity='mgr.smithi195.acttsj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-08-18T22:41:14.659 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:41:14 smithi195 ceph-mon[23370]: pgmap v232: 65 pgs: 65 active+clean; 124 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 5.4 MiB/s wr, 634 op/s 2024-08-18T22:41:14.659 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:41:14 smithi195 ceph-mon[23370]: Standby manager daemon smithi195.acttsj restarted 2024-08-18T22:41:14.659 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:41:14 smithi195 ceph-mon[23370]: Standby manager daemon smithi195.acttsj started 2024-08-18T22:41:14.659 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:41:14 smithi195 ceph-mon[23370]: from='mgr.? 172.21.15.195:0/2331273060' entity='mgr.smithi195.acttsj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi195.acttsj/crt"}]: dispatch 2024-08-18T22:41:14.659 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:41:14 smithi195 ceph-mon[23370]: from='mgr.? 172.21.15.195:0/2331273060' entity='mgr.smithi195.acttsj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-08-18T22:41:14.659 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:41:14 smithi195 ceph-mon[23370]: from='mgr.? 172.21.15.195:0/2331273060' entity='mgr.smithi195.acttsj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi195.acttsj/key"}]: dispatch 2024-08-18T22:41:14.659 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:41:14 smithi195 ceph-mon[23370]: from='mgr.? 172.21.15.195:0/2331273060' entity='mgr.smithi195.acttsj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-08-18T22:41:15.583 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:41:15 smithi121 ceph-mon[16788]: mgrmap e20: smithi121.lopxqc(active, since 6m), standbys: smithi195.acttsj 2024-08-18T22:41:15.659 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:41:15 smithi195 ceph-mon[23370]: mgrmap e20: smithi121.lopxqc(active, since 6m), standbys: smithi195.acttsj 2024-08-18T22:41:16.583 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:41:16 smithi121 ceph-mon[16788]: pgmap v233: 65 pgs: 65 active+clean; 131 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 4.1 MiB/s wr, 524 op/s 2024-08-18T22:41:16.658 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:41:16 smithi195 ceph-mon[23370]: pgmap v233: 65 pgs: 65 active+clean; 131 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 4.1 MiB/s wr, 524 op/s 2024-08-18T22:41:18.409 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:41:18 smithi195 ceph-mon[23370]: pgmap v234: 65 pgs: 65 active+clean; 135 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 3.8 MiB/s wr, 520 op/s 2024-08-18T22:41:18.409 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:41:18 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:41:18.409 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:41:18 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:41:18.583 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:41:18 smithi121 ceph-mon[16788]: pgmap v234: 65 pgs: 65 active+clean; 135 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 3.8 MiB/s wr, 520 op/s 2024-08-18T22:41:18.583 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:41:18 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:41:18.583 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:41:18 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:41:20.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:41:19 smithi195 ceph-mon[23370]: pgmap v235: 65 pgs: 65 active+clean; 155 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 5.4 MiB/s wr, 623 op/s 2024-08-18T22:41:20.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:41:19 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:41:20.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:41:19 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:41:20.333 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:41:19 smithi121 ceph-mon[16788]: pgmap v235: 65 pgs: 65 active+clean; 155 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 5.4 MiB/s wr, 623 op/s 2024-08-18T22:41:20.333 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:41:19 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:41:20.333 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:41:19 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:41:22.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:41:21 smithi195 ceph-mon[23370]: pgmap v236: 65 pgs: 65 active+clean; 161 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 4.9 MiB/s wr, 509 op/s 2024-08-18T22:41:22.333 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:41:21 smithi121 ceph-mon[16788]: pgmap v236: 65 pgs: 65 active+clean; 161 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 4.9 MiB/s wr, 509 op/s 2024-08-18T22:41:23.483 INFO:tasks.workunit.client.0.smithi121.stderr:+ pushd ltp-full-20091231/testcases/kernel/fs/fsstress 2024-08-18T22:41:23.487 INFO:tasks.workunit.client.0.smithi121.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress ~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-08-18T22:41:23.487 INFO:tasks.workunit.client.0.smithi121.stderr:+ make 2024-08-18T22:41:23.970 INFO:tasks.workunit.client.0.smithi121.stdout:cc -DNO_XFS -I/home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress -D_LARGEFILE64_SOURCE -D_GNU_SOURCE -I../../../../include -I../../../../include -L../../../../lib fsstress.c -o fsstress 2024-08-18T22:41:24.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:41:23 smithi195 ceph-mon[23370]: pgmap v237: 65 pgs: 65 active+clean; 182 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 6.0 MiB/s wr, 648 op/s 2024-08-18T22:41:24.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:41:23 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-18T22:41:24.333 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:41:23 smithi121 ceph-mon[16788]: pgmap v237: 65 pgs: 65 active+clean; 182 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 6.0 MiB/s wr, 648 op/s 2024-08-18T22:41:24.333 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:41:23 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-18T22:41:24.334 INFO:tasks.workunit.client.0.smithi121.stderr:++ readlink -f fsstress 2024-08-18T22:41:24.335 INFO:tasks.workunit.client.0.smithi121.stderr:+ BIN=/home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress 2024-08-18T22:41:24.335 INFO:tasks.workunit.client.0.smithi121.stderr:+ popd 2024-08-18T22:41:24.336 INFO:tasks.workunit.client.0.smithi121.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-08-18T22:41:24.336 INFO:tasks.workunit.client.0.smithi121.stderr:+ popd 2024-08-18T22:41:24.336 INFO:tasks.workunit.client.0.smithi121.stdout:~/cephtest/mnt.0/client.0/tmp 2024-08-18T22:41:24.337 INFO:tasks.workunit.client.0.smithi121.stderr:++ mktemp -d -p . 2024-08-18T22:41:24.338 INFO:tasks.workunit.client.0.smithi121.stderr:+ T=./tmp.pFCfUp6iZz 2024-08-18T22:41:24.339 INFO:tasks.workunit.client.0.smithi121.stderr:+ /home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress -d ./tmp.pFCfUp6iZz -l 1 -n 1000 -p 10 -v 2024-08-18T22:41:24.341 INFO:tasks.workunit.client.0.smithi121.stdout:seed = 1724337953 2024-08-18T22:41:24.344 INFO:tasks.workunit.client.0.smithi121.stdout:0/0: dread - no filename 2024-08-18T22:41:24.344 INFO:tasks.workunit.client.0.smithi121.stdout:0/1: read - no filename 2024-08-18T22:41:24.344 INFO:tasks.workunit.client.0.smithi121.stdout:0/2: chown . 610297 1 2024-08-18T22:41:24.344 INFO:tasks.workunit.client.0.smithi121.stdout:0/3: fsync - no filename 2024-08-18T22:41:24.345 INFO:tasks.workunit.client.0.smithi121.stdout:1/0: rmdir - no directory 2024-08-18T22:41:24.345 INFO:tasks.workunit.client.0.smithi121.stdout:1/1: dwrite - no filename 2024-08-18T22:41:24.346 INFO:tasks.workunit.client.0.smithi121.stdout:0/4: creat f0 x:0 0 0 2024-08-18T22:41:24.347 INFO:tasks.workunit.client.0.smithi121.stdout:2/0: readlink - no filename 2024-08-18T22:41:24.347 INFO:tasks.workunit.client.0.smithi121.stdout:2/1: link - no file 2024-08-18T22:41:24.347 INFO:tasks.workunit.client.0.smithi121.stdout:2/2: dread - no filename 2024-08-18T22:41:24.348 INFO:tasks.workunit.client.0.smithi121.stdout:0/5: mkdir d1 0 2024-08-18T22:41:24.348 INFO:tasks.workunit.client.0.smithi121.stdout:1/2: symlink l0 0 2024-08-18T22:41:24.349 INFO:tasks.workunit.client.0.smithi121.stdout:1/3: write - no filename 2024-08-18T22:41:24.349 INFO:tasks.workunit.client.0.smithi121.stdout:0/6: truncate f0 1046909 0 2024-08-18T22:41:24.349 INFO:tasks.workunit.client.0.smithi121.stdout:1/4: readlink l0 0 2024-08-18T22:41:24.349 INFO:tasks.workunit.client.0.smithi121.stdout:0/7: stat d1 0 2024-08-18T22:41:24.349 INFO:tasks.workunit.client.0.smithi121.stdout:1/5: chown l0 2614 1 2024-08-18T22:41:24.349 INFO:tasks.workunit.client.0.smithi121.stdout:0/8: rename d1 to d1/d2 22 2024-08-18T22:41:24.350 INFO:tasks.workunit.client.0.smithi121.stdout:3/0: chown . 714075 1 2024-08-18T22:41:24.350 INFO:tasks.workunit.client.0.smithi121.stdout:3/1: readlink - no filename 2024-08-18T22:41:24.350 INFO:tasks.workunit.client.0.smithi121.stdout:3/2: dread - no filename 2024-08-18T22:41:24.351 INFO:tasks.workunit.client.0.smithi121.stdout:4/0: read - no filename 2024-08-18T22:41:24.351 INFO:tasks.workunit.client.0.smithi121.stdout:4/1: link - no file 2024-08-18T22:41:24.351 INFO:tasks.workunit.client.0.smithi121.stdout:4/2: write - no filename 2024-08-18T22:41:24.351 INFO:tasks.workunit.client.0.smithi121.stdout:4/3: unlink - no file 2024-08-18T22:41:24.351 INFO:tasks.workunit.client.0.smithi121.stdout:4/4: dread - no filename 2024-08-18T22:41:24.351 INFO:tasks.workunit.client.0.smithi121.stdout:1/6: creat f1 x:0 0 0 2024-08-18T22:41:24.353 INFO:tasks.workunit.client.0.smithi121.stdout:3/3: getdents . 0 2024-08-18T22:41:24.353 INFO:tasks.workunit.client.0.smithi121.stdout:5/0: chown . 202173000 1 2024-08-18T22:41:24.353 INFO:tasks.workunit.client.0.smithi121.stdout:5/1: truncate - no filename 2024-08-18T22:41:24.353 INFO:tasks.workunit.client.0.smithi121.stdout:5/2: dread - no filename 2024-08-18T22:41:24.354 INFO:tasks.workunit.client.0.smithi121.stdout:1/7: rename l0 to l2 0 2024-08-18T22:41:24.354 INFO:tasks.workunit.client.0.smithi121.stdout:4/5: creat f0 x:0 0 0 2024-08-18T22:41:24.355 INFO:tasks.workunit.client.0.smithi121.stdout:1/8: write f1 [957616,99593] 0 2024-08-18T22:41:24.356 INFO:tasks.workunit.client.0.smithi121.stdout:6/0: write - no filename 2024-08-18T22:41:24.357 INFO:tasks.workunit.client.0.smithi121.stdout:6/1: link - no file 2024-08-18T22:41:24.357 INFO:tasks.workunit.client.0.smithi121.stdout:3/4: getdents . 0 2024-08-18T22:41:24.357 INFO:tasks.workunit.client.0.smithi121.stdout:3/5: dwrite - no filename 2024-08-18T22:41:24.357 INFO:tasks.workunit.client.0.smithi121.stdout:3/6: chown . 1 1 2024-08-18T22:41:24.357 INFO:tasks.workunit.client.0.smithi121.stdout:3/7: rename - no filename 2024-08-18T22:41:24.357 INFO:tasks.workunit.client.0.smithi121.stdout:3/8: rename - no filename 2024-08-18T22:41:24.357 INFO:tasks.workunit.client.0.smithi121.stdout:5/3: getdents . 0 2024-08-18T22:41:24.357 INFO:tasks.workunit.client.0.smithi121.stdout:5/4: dwrite - no filename 2024-08-18T22:41:24.357 INFO:tasks.workunit.client.0.smithi121.stdout:5/5: dwrite - no filename 2024-08-18T22:41:24.357 INFO:tasks.workunit.client.0.smithi121.stdout:5/6: write - no filename 2024-08-18T22:41:24.357 INFO:tasks.workunit.client.0.smithi121.stdout:5/7: write - no filename 2024-08-18T22:41:24.357 INFO:tasks.workunit.client.0.smithi121.stdout:5/8: fdatasync - no filename 2024-08-18T22:41:24.358 INFO:tasks.workunit.client.0.smithi121.stdout:4/6: creat f1 x:0 0 0 2024-08-18T22:41:24.359 INFO:tasks.workunit.client.0.smithi121.stdout:1/9: creat f3 x:0 0 0 2024-08-18T22:41:24.362 INFO:tasks.workunit.client.0.smithi121.stdout:4/7: mkdir d2 0 2024-08-18T22:41:24.362 INFO:tasks.workunit.client.0.smithi121.stdout:4/8: chown f0 394819644 1 2024-08-18T22:41:24.364 INFO:tasks.workunit.client.0.smithi121.stdout:1/10: creat f4 x:0 0 0 2024-08-18T22:41:24.364 INFO:tasks.workunit.client.0.smithi121.stdout:1/11: chown f3 1 1 2024-08-18T22:41:24.365 INFO:tasks.workunit.client.0.smithi121.stdout:6/2: getdents . 0 2024-08-18T22:41:24.365 INFO:tasks.workunit.client.0.smithi121.stdout:3/9: symlink l0 0 2024-08-18T22:41:24.366 INFO:tasks.workunit.client.0.smithi121.stdout:5/9: mknod c0 0 2024-08-18T22:41:24.368 INFO:tasks.workunit.client.0.smithi121.stdout:9/0: dwrite - no filename 2024-08-18T22:41:24.369 INFO:tasks.workunit.client.0.smithi121.stdout:1/12: mkdir d5 0 2024-08-18T22:41:24.370 INFO:tasks.workunit.client.0.smithi121.stdout:3/10: creat f1 x:0 0 0 2024-08-18T22:41:24.370 INFO:tasks.workunit.client.0.smithi121.stdout:3/11: dread - f1 zero size 2024-08-18T22:41:24.371 INFO:tasks.workunit.client.0.smithi121.stdout:4/9: creat d2/f3 x:0 0 0 2024-08-18T22:41:24.371 INFO:tasks.workunit.client.0.smithi121.stdout:3/12: write f1 [825594,5165] 0 2024-08-18T22:41:24.373 INFO:tasks.workunit.client.0.smithi121.stdout:1/13: dread f1 [0,4194304] 0 2024-08-18T22:41:24.373 INFO:tasks.workunit.client.0.smithi121.stdout:9/1: mkdir d0 0 2024-08-18T22:41:24.375 INFO:tasks.workunit.client.0.smithi121.stdout:3/13: mknod c2 0 2024-08-18T22:41:24.376 INFO:tasks.workunit.client.0.smithi121.stdout:3/14: stat l0 0 2024-08-18T22:41:24.377 INFO:tasks.workunit.client.0.smithi121.stdout:9/2: creat d0/f1 x:0 0 0 2024-08-18T22:41:24.378 INFO:tasks.workunit.client.0.smithi121.stdout:1/14: link f4 d5/f6 0 2024-08-18T22:41:24.379 INFO:tasks.workunit.client.0.smithi121.stdout:3/15: creat f3 x:0 0 0 2024-08-18T22:41:24.381 INFO:tasks.workunit.client.0.smithi121.stdout:1/15: fdatasync f1 0 2024-08-18T22:41:24.382 INFO:tasks.workunit.client.0.smithi121.stdout:3/16: read f1 [738803,50544] 0 2024-08-18T22:41:24.383 INFO:tasks.workunit.client.0.smithi121.stdout:4/10: dwrite d2/f3 [0,4194304] 0 2024-08-18T22:41:24.383 INFO:tasks.workunit.client.0.smithi121.stdout:1/16: dread - f4 zero size 2024-08-18T22:41:24.386 INFO:tasks.workunit.client.0.smithi121.stdout:4/11: write f0 [956212,108923] 0 2024-08-18T22:41:24.388 INFO:tasks.workunit.client.0.smithi121.stdout:4/12: chown f1 7393 1 2024-08-18T22:41:24.390 INFO:tasks.workunit.client.0.smithi121.stdout:9/3: dwrite d0/f1 [0,4194304] 0 2024-08-18T22:41:24.391 INFO:tasks.workunit.client.0.smithi121.stdout:4/13: write d2/f3 [3462945,108716] 0 2024-08-18T22:41:24.392 INFO:tasks.workunit.client.0.smithi121.stdout:9/4: write d0/f1 [689793,7758] 0 2024-08-18T22:41:24.426 INFO:tasks.workunit.client.0.smithi121.stdout:0/9: fsync f0 0 2024-08-18T22:41:24.428 INFO:tasks.workunit.client.0.smithi121.stdout:0/10: unlink f0 0 2024-08-18T22:41:24.428 INFO:tasks.workunit.client.0.smithi121.stdout:0/11: truncate - no filename 2024-08-18T22:41:24.430 INFO:tasks.workunit.client.0.smithi121.stdout:0/12: mknod d1/c3 0 2024-08-18T22:41:24.430 INFO:tasks.workunit.client.0.smithi121.stdout:0/13: truncate - no filename 2024-08-18T22:41:24.430 INFO:tasks.workunit.client.0.smithi121.stdout:0/14: fdatasync - no filename 2024-08-18T22:41:24.430 INFO:tasks.workunit.client.0.smithi121.stdout:0/15: chown d1 3638405 1 2024-08-18T22:41:24.430 INFO:tasks.workunit.client.0.smithi121.stdout:0/16: dwrite - no filename 2024-08-18T22:41:24.430 INFO:tasks.workunit.client.0.smithi121.stdout:0/17: truncate - no filename 2024-08-18T22:41:24.431 INFO:tasks.workunit.client.0.smithi121.stdout:0/18: rmdir d1 39 2024-08-18T22:41:24.436 INFO:tasks.workunit.client.0.smithi121.stdout:4/14: rmdir d2 39 2024-08-18T22:41:24.436 INFO:tasks.workunit.client.0.smithi121.stdout:4/15: write f0 [582953,74013] 0 2024-08-18T22:41:24.437 INFO:tasks.workunit.client.0.smithi121.stdout:4/16: write f1 [67596,109504] 0 2024-08-18T22:41:24.438 INFO:tasks.workunit.client.0.smithi121.stdout:9/5: fsync d0/f1 0 2024-08-18T22:41:24.440 INFO:tasks.workunit.client.0.smithi121.stdout:1/17: getdents d5 0 2024-08-18T22:41:24.441 INFO:tasks.workunit.client.0.smithi121.stdout:4/17: rmdir d2 39 2024-08-18T22:41:24.442 INFO:tasks.workunit.client.0.smithi121.stdout:1/18: creat d5/f7 x:0 0 0 2024-08-18T22:41:24.443 INFO:tasks.workunit.client.0.smithi121.stdout:3/17: getdents . 0 2024-08-18T22:41:24.445 INFO:tasks.workunit.client.0.smithi121.stdout:4/18: rmdir d2 39 2024-08-18T22:41:24.447 INFO:tasks.workunit.client.0.smithi121.stdout:9/6: dwrite d0/f1 [0,4194304] 0 2024-08-18T22:41:24.449 INFO:tasks.workunit.client.0.smithi121.stdout:4/19: creat d2/f4 x:0 0 0 2024-08-18T22:41:24.450 INFO:tasks.workunit.client.0.smithi121.stdout:4/20: chown d2/f3 10364 1 2024-08-18T22:41:24.451 INFO:tasks.workunit.client.0.smithi121.stdout:9/7: symlink d0/l2 0 2024-08-18T22:41:24.452 INFO:tasks.workunit.client.0.smithi121.stdout:4/21: write d2/f3 [795307,67427] 0 2024-08-18T22:41:24.452 INFO:tasks.workunit.client.0.smithi121.stdout:9/8: stat d0/f1 0 2024-08-18T22:41:24.453 INFO:tasks.workunit.client.0.smithi121.stdout:9/9: chown d0/l2 4184406 1 2024-08-18T22:41:24.454 INFO:tasks.workunit.client.0.smithi121.stdout:1/19: getdents d5 0 2024-08-18T22:41:24.460 INFO:tasks.workunit.client.0.smithi121.stdout:4/22: getdents d2 0 2024-08-18T22:41:24.462 INFO:tasks.workunit.client.0.smithi121.stdout:9/10: dwrite d0/f1 [0,4194304] 0 2024-08-18T22:41:24.468 INFO:tasks.workunit.client.0.smithi121.stdout:1/20: dwrite f4 [0,4194304] 0 2024-08-18T22:41:24.470 INFO:tasks.workunit.client.0.smithi121.stdout:9/11: dread d0/f1 [0,4194304] 0 2024-08-18T22:41:24.470 INFO:tasks.workunit.client.0.smithi121.stdout:1/21: symlink d5/l8 0 2024-08-18T22:41:24.472 INFO:tasks.workunit.client.0.smithi121.stdout:9/12: write d0/f1 [3848210,126161] 0 2024-08-18T22:41:24.472 INFO:tasks.workunit.client.0.smithi121.stdout:1/22: write d5/f6 [2848823,126815] 0 2024-08-18T22:41:24.474 INFO:tasks.workunit.client.0.smithi121.stdout:1/23: chown d5/f6 4200959 1 2024-08-18T22:41:24.479 INFO:tasks.workunit.client.0.smithi121.stdout:9/13: dread d0/f1 [0,4194304] 0 2024-08-18T22:41:24.482 INFO:tasks.workunit.client.0.smithi121.stdout:9/14: creat d0/f3 x:0 0 0 2024-08-18T22:41:24.483 INFO:tasks.workunit.client.0.smithi121.stdout:1/24: dwrite f3 [0,4194304] 0 2024-08-18T22:41:24.483 INFO:tasks.workunit.client.0.smithi121.stdout:9/15: write d0/f3 [374541,51276] 0 2024-08-18T22:41:24.486 INFO:tasks.workunit.client.0.smithi121.stdout:1/25: unlink f1 0 2024-08-18T22:41:24.489 INFO:tasks.workunit.client.0.smithi121.stdout:1/26: unlink d5/f6 0 2024-08-18T22:41:24.490 INFO:tasks.workunit.client.0.smithi121.stdout:9/16: link d0/f1 d0/f4 0 2024-08-18T22:41:24.493 INFO:tasks.workunit.client.0.smithi121.stdout:9/17: mkdir d0/d5 0 2024-08-18T22:41:24.493 INFO:tasks.workunit.client.0.smithi121.stdout:9/18: truncate d0/f3 1000806 0 2024-08-18T22:41:24.499 INFO:tasks.workunit.client.0.smithi121.stdout:1/27: read f4 [1829215,53754] 0 2024-08-18T22:41:24.500 INFO:tasks.workunit.client.0.smithi121.stdout:1/28: fsync d5/f7 0 2024-08-18T22:41:24.501 INFO:tasks.workunit.client.0.smithi121.stdout:1/29: fdatasync f3 0 2024-08-18T22:41:24.506 INFO:tasks.workunit.client.0.smithi121.stdout:9/19: dwrite d0/f4 [4194304,4194304] 0 2024-08-18T22:41:24.509 INFO:tasks.workunit.client.0.smithi121.stdout:9/20: mkdir d0/d6 0 2024-08-18T22:41:24.511 INFO:tasks.workunit.client.0.smithi121.stdout:9/21: write d0/f4 [2397803,100737] 0 2024-08-18T22:41:24.512 INFO:tasks.workunit.client.0.smithi121.stdout:1/30: dwrite f3 [4194304,4194304] 0 2024-08-18T22:41:24.513 INFO:tasks.workunit.client.0.smithi121.stdout:1/31: readlink l2 0 2024-08-18T22:41:24.514 INFO:tasks.workunit.client.0.smithi121.stdout:9/22: symlink d0/d5/l7 0 2024-08-18T22:41:24.516 INFO:tasks.workunit.client.0.smithi121.stdout:9/23: unlink d0/f1 0 2024-08-18T22:41:24.517 INFO:tasks.workunit.client.0.smithi121.stdout:9/24: mknod d0/c8 0 2024-08-18T22:41:24.525 INFO:tasks.workunit.client.0.smithi121.stdout:9/25: dwrite d0/f3 [0,4194304] 0 2024-08-18T22:41:24.527 INFO:tasks.workunit.client.0.smithi121.stdout:9/26: creat d0/d5/f9 x:0 0 0 2024-08-18T22:41:24.533 INFO:tasks.workunit.client.0.smithi121.stdout:9/27: dread d0/f4 [4194304,4194304] 0 2024-08-18T22:41:24.545 INFO:tasks.workunit.client.0.smithi121.stdout:9/28: creat d0/d5/fa x:0 0 0 2024-08-18T22:41:24.548 INFO:tasks.workunit.client.0.smithi121.stdout:9/29: truncate d0/f4 7648308 0 2024-08-18T22:41:24.550 INFO:tasks.workunit.client.0.smithi121.stdout:9/30: unlink d0/c8 0 2024-08-18T22:41:24.550 INFO:tasks.workunit.client.0.smithi121.stdout:9/31: rename d0/d5 to d0/d5/db 22 2024-08-18T22:41:24.552 INFO:tasks.workunit.client.0.smithi121.stdout:9/32: unlink d0/d5/l7 0 2024-08-18T22:41:24.562 INFO:tasks.workunit.client.0.smithi121.stdout:9/33: dwrite d0/f4 [4194304,4194304] 0 2024-08-18T22:41:24.566 INFO:tasks.workunit.client.0.smithi121.stdout:9/34: creat d0/d6/fc x:0 0 0 2024-08-18T22:41:24.567 INFO:tasks.workunit.client.0.smithi121.stdout:9/35: fdatasync d0/d5/fa 0 2024-08-18T22:41:24.568 INFO:tasks.workunit.client.0.smithi121.stdout:9/36: truncate d0/d5/f9 452942 0 2024-08-18T22:41:24.569 INFO:tasks.workunit.client.0.smithi121.stdout:9/37: write d0/f4 [1301833,22317] 0 2024-08-18T22:41:24.571 INFO:tasks.workunit.client.0.smithi121.stdout:9/38: mkdir d0/d5/dd 0 2024-08-18T22:41:24.578 INFO:tasks.workunit.client.0.smithi121.stdout:9/39: dwrite d0/f3 [0,4194304] 0 2024-08-18T22:41:24.579 INFO:tasks.workunit.client.0.smithi121.stdout:9/40: write d0/f4 [5410882,12230] 0 2024-08-18T22:41:24.584 INFO:tasks.workunit.client.0.smithi121.stdout:9/41: link d0/f3 d0/d5/fe 0 2024-08-18T22:41:24.585 INFO:tasks.workunit.client.0.smithi121.stdout:9/42: write d0/d6/fc [419563,11196] 0 2024-08-18T22:41:24.587 INFO:tasks.workunit.client.0.smithi121.stdout:9/43: mkdir d0/d6/df 0 2024-08-18T22:41:24.593 INFO:tasks.workunit.client.0.smithi121.stdout:9/44: rmdir d0 39 2024-08-18T22:41:24.596 INFO:tasks.workunit.client.0.smithi121.stdout:9/45: creat d0/d6/f10 x:0 0 0 2024-08-18T22:41:24.597 INFO:tasks.workunit.client.0.smithi121.stdout:9/46: symlink d0/d5/dd/l11 0 2024-08-18T22:41:24.598 INFO:tasks.workunit.client.0.smithi121.stdout:9/47: mknod d0/d5/c12 0 2024-08-18T22:41:24.599 INFO:tasks.workunit.client.0.smithi121.stdout:9/48: write d0/d5/f9 [449241,47535] 0 2024-08-18T22:41:24.603 INFO:tasks.workunit.client.0.smithi121.stdout:9/49: dread d0/f4 [4194304,4194304] 0 2024-08-18T22:41:24.604 INFO:tasks.workunit.client.0.smithi121.stdout:9/50: mknod d0/c13 0 2024-08-18T22:41:24.606 INFO:tasks.workunit.client.0.smithi121.stdout:9/51: mknod d0/d5/dd/c14 0 2024-08-18T22:41:24.606 INFO:tasks.workunit.client.0.smithi121.stdout:9/52: stat d0 0 2024-08-18T22:41:24.606 INFO:tasks.workunit.client.0.smithi121.stdout:9/53: fdatasync d0/d5/fa 0 2024-08-18T22:41:24.607 INFO:tasks.workunit.client.0.smithi121.stdout:9/54: symlink d0/d5/l15 0 2024-08-18T22:41:24.610 INFO:tasks.workunit.client.0.smithi121.stdout:9/55: dread d0/f3 [0,4194304] 0 2024-08-18T22:41:24.611 INFO:tasks.workunit.client.0.smithi121.stdout:9/56: read d0/f4 [6172366,31053] 0 2024-08-18T22:41:24.613 INFO:tasks.workunit.client.0.smithi121.stdout:9/57: fsync d0/d6/f10 0 2024-08-18T22:41:24.617 INFO:tasks.workunit.client.0.smithi121.stdout:9/58: getdents d0/d5/dd 0 2024-08-18T22:41:24.623 INFO:tasks.workunit.client.0.smithi121.stdout:9/59: dwrite d0/d5/fa [0,4194304] 0 2024-08-18T22:41:24.625 INFO:tasks.workunit.client.0.smithi121.stdout:9/60: symlink d0/d6/l16 0 2024-08-18T22:41:24.626 INFO:tasks.workunit.client.0.smithi121.stdout:9/61: chown d0/d5/fa 17 1 2024-08-18T22:41:24.634 INFO:tasks.workunit.client.0.smithi121.stdout:9/62: dwrite d0/d5/fa [0,4194304] 0 2024-08-18T22:41:24.636 INFO:tasks.workunit.client.0.smithi121.stdout:9/63: write d0/d5/fe [3942537,12771] 0 2024-08-18T22:41:24.639 INFO:tasks.workunit.client.0.smithi121.stdout:9/64: getdents d0/d6 0 2024-08-18T22:41:24.643 INFO:tasks.workunit.client.0.smithi121.stdout:9/65: dread d0/d6/fc [0,4194304] 0 2024-08-18T22:41:24.644 INFO:tasks.workunit.client.0.smithi121.stdout:9/66: fdatasync d0/d6/fc 0 2024-08-18T22:41:24.645 INFO:tasks.workunit.client.0.smithi121.stdout:9/67: write d0/d5/fa [3223150,71161] 0 2024-08-18T22:41:24.647 INFO:tasks.workunit.client.0.smithi121.stdout:9/68: rename d0/d5/l15 to d0/d5/l17 0 2024-08-18T22:41:24.648 INFO:tasks.workunit.client.0.smithi121.stdout:9/69: fsync d0/f4 0 2024-08-18T22:41:24.649 INFO:tasks.workunit.client.0.smithi121.stdout:9/70: chown d0/f3 446 1 2024-08-18T22:41:24.649 INFO:tasks.workunit.client.0.smithi121.stdout:9/71: fdatasync d0/d5/f9 0 2024-08-18T22:41:24.651 INFO:tasks.workunit.client.0.smithi121.stdout:9/72: mkdir d0/d6/d18 0 2024-08-18T22:41:26.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:41:25 smithi195 ceph-mon[23370]: pgmap v238: 65 pgs: 65 active+clean; 191 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 5.8 MiB/s wr, 509 op/s 2024-08-18T22:41:26.333 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:41:25 smithi121 ceph-mon[16788]: pgmap v238: 65 pgs: 65 active+clean; 191 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 5.8 MiB/s wr, 509 op/s 2024-08-18T22:41:28.119 INFO:tasks.workunit.client.0.smithi121.stdout:2/3: sync 2024-08-18T22:41:28.121 INFO:tasks.workunit.client.0.smithi121.stdout:2/4: mknod c0 0 2024-08-18T22:41:28.123 INFO:tasks.workunit.client.0.smithi121.stdout:2/5: link c0 c1 0 2024-08-18T22:41:28.123 INFO:tasks.workunit.client.0.smithi121.stdout:2/6: dwrite - no filename 2024-08-18T22:41:28.123 INFO:tasks.workunit.client.0.smithi121.stdout:2/7: write - no filename 2024-08-18T22:41:28.124 INFO:tasks.workunit.client.0.smithi121.stdout:2/8: mkdir d2 0 2024-08-18T22:41:28.125 INFO:tasks.workunit.client.0.smithi121.stdout:2/9: getdents d2 0 2024-08-18T22:41:28.127 INFO:tasks.workunit.client.0.smithi121.stdout:2/10: mkdir d2/d3 0 2024-08-18T22:41:28.128 INFO:tasks.workunit.client.0.smithi121.stdout:2/11: stat c0 0 2024-08-18T22:41:28.130 INFO:tasks.workunit.client.0.smithi121.stdout:2/12: unlink c1 0 2024-08-18T22:41:28.130 INFO:tasks.workunit.client.0.smithi121.stdout:2/13: write - no filename 2024-08-18T22:41:28.131 INFO:tasks.workunit.client.0.smithi121.stdout:2/14: truncate - no filename 2024-08-18T22:41:28.131 INFO:tasks.workunit.client.0.smithi121.stdout:2/15: creat d2/d3/f4 x:0 0 0 2024-08-18T22:41:28.132 INFO:tasks.workunit.client.0.smithi121.stdout:2/16: readlink - no filename 2024-08-18T22:41:28.133 INFO:tasks.workunit.client.0.smithi121.stdout:2/17: symlink d2/l5 0 2024-08-18T22:41:28.139 INFO:tasks.workunit.client.0.smithi121.stdout:2/18: dwrite d2/d3/f4 [0,4194304] 0 2024-08-18T22:41:28.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:41:27 smithi195 ceph-mon[23370]: pgmap v239: 65 pgs: 65 active+clean; 202 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 7.3 MiB/s wr, 503 op/s 2024-08-18T22:41:28.193 INFO:tasks.workunit.client.1.smithi195.stderr:+ pushd ltp-full-20091231/testcases/kernel/fs/fsstress 2024-08-18T22:41:28.275 INFO:tasks.workunit.client.0.smithi121.stdout:8/0: sync 2024-08-18T22:41:28.275 INFO:tasks.workunit.client.0.smithi121.stdout:6/3: sync 2024-08-18T22:41:28.275 INFO:tasks.workunit.client.0.smithi121.stdout:8/1: link - no file 2024-08-18T22:41:28.275 INFO:tasks.workunit.client.0.smithi121.stdout:7/0: sync 2024-08-18T22:41:28.276 INFO:tasks.workunit.client.0.smithi121.stdout:7/1: write - no filename 2024-08-18T22:41:28.276 INFO:tasks.workunit.client.0.smithi121.stdout:7/2: dwrite - no filename 2024-08-18T22:41:28.276 INFO:tasks.workunit.client.0.smithi121.stdout:7/3: chown . 81190 1 2024-08-18T22:41:28.276 INFO:tasks.workunit.client.0.smithi121.stdout:7/4: chown . 469215620 1 2024-08-18T22:41:28.277 INFO:tasks.workunit.client.0.smithi121.stdout:6/4: creat f0 x:0 0 0 2024-08-18T22:41:28.278 INFO:tasks.workunit.client.0.smithi121.stdout:6/5: dread - f0 zero size 2024-08-18T22:41:28.278 INFO:tasks.workunit.client.0.smithi121.stdout:8/2: creat f0 x:0 0 0 2024-08-18T22:41:28.279 INFO:tasks.workunit.client.0.smithi121.stdout:8/3: truncate f0 800486 0 2024-08-18T22:41:28.279 INFO:tasks.workunit.client.0.smithi121.stdout:7/5: creat f0 x:0 0 0 2024-08-18T22:41:28.279 INFO:tasks.workunit.client.0.smithi121.stdout:8/4: chown f0 7 1 2024-08-18T22:41:28.281 INFO:tasks.workunit.client.0.smithi121.stdout:6/6: rename f0 to f1 0 2024-08-18T22:41:28.281 INFO:tasks.workunit.client.0.smithi121.stdout:6/7: readlink - no filename 2024-08-18T22:41:28.282 INFO:tasks.workunit.client.0.smithi121.stdout:8/5: symlink l1 0 2024-08-18T22:41:28.283 INFO:tasks.workunit.client.0.smithi121.stdout:8/6: write f0 [1534371,104174] 0 2024-08-18T22:41:28.283 INFO:tasks.workunit.client.0.smithi121.stdout:6/8: mknod c2 0 2024-08-18T22:41:28.285 INFO:tasks.workunit.client.0.smithi121.stdout:6/9: unlink c2 0 2024-08-18T22:41:28.287 INFO:tasks.workunit.client.0.smithi121.stdout:8/7: symlink l2 0 2024-08-18T22:41:28.290 INFO:tasks.workunit.client.0.smithi121.stdout:6/10: link f1 f3 0 2024-08-18T22:41:28.294 INFO:tasks.workunit.client.0.smithi121.stdout:8/8: dwrite f0 [0,4194304] 0 2024-08-18T22:41:28.294 INFO:tasks.workunit.client.0.smithi121.stdout:8/9: chown f0 3 1 2024-08-18T22:41:28.302 INFO:tasks.workunit.client.0.smithi121.stdout:8/10: dwrite f0 [0,4194304] 0 2024-08-18T22:41:28.305 INFO:tasks.workunit.client.0.smithi121.stdout:8/11: rename f0 to f3 0 2024-08-18T22:41:28.307 INFO:tasks.workunit.client.1.smithi195.stdout:~/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress ~/cephtest/mnt.1/client.1/tmp/fsstress ~/cephtest/mnt.1/client.1/tmp 2024-08-18T22:41:28.308 INFO:tasks.workunit.client.1.smithi195.stderr:+ make 2024-08-18T22:41:28.308 INFO:tasks.workunit.client.0.smithi121.stdout:8/12: unlink l2 0 2024-08-18T22:41:28.311 INFO:tasks.workunit.client.0.smithi121.stdout:8/13: link l1 l4 0 2024-08-18T22:41:28.316 INFO:tasks.workunit.client.0.smithi121.stdout:0/19: sync 2024-08-18T22:41:28.316 INFO:tasks.workunit.client.0.smithi121.stdout:5/10: sync 2024-08-18T22:41:28.316 INFO:tasks.workunit.client.0.smithi121.stdout:5/11: dread - no filename 2024-08-18T22:41:28.316 INFO:tasks.workunit.client.0.smithi121.stdout:5/12: dread - no filename 2024-08-18T22:41:28.318 INFO:tasks.workunit.client.0.smithi121.stdout:8/14: dwrite f3 [0,4194304] 0 2024-08-18T22:41:28.318 INFO:tasks.workunit.client.0.smithi121.stdout:5/13: creat f1 x:0 0 0 2024-08-18T22:41:28.319 INFO:tasks.workunit.client.0.smithi121.stdout:8/15: write f3 [684120,117189] 0 2024-08-18T22:41:28.320 INFO:tasks.workunit.client.0.smithi121.stdout:0/20: mkdir d1/d4 0 2024-08-18T22:41:28.320 INFO:tasks.workunit.client.0.smithi121.stdout:0/21: chown d1/d4 16564 1 2024-08-18T22:41:28.320 INFO:tasks.workunit.client.0.smithi121.stdout:0/22: dwrite - no filename 2024-08-18T22:41:28.322 INFO:tasks.workunit.client.0.smithi121.stdout:5/14: mknod c2 0 2024-08-18T22:41:28.325 INFO:tasks.workunit.client.0.smithi121.stdout:5/15: mkdir d3 0 2024-08-18T22:41:28.326 INFO:tasks.workunit.client.0.smithi121.stdout:8/16: stat l4 0 2024-08-18T22:41:28.326 INFO:tasks.workunit.client.0.smithi121.stdout:5/16: write f1 [683099,102378] 0 2024-08-18T22:41:28.328 INFO:tasks.workunit.client.0.smithi121.stdout:0/23: mkdir d1/d4/d5 0 2024-08-18T22:41:28.328 INFO:tasks.workunit.client.0.smithi121.stdout:0/24: dwrite - no filename 2024-08-18T22:41:28.331 INFO:tasks.workunit.client.0.smithi121.stdout:0/25: symlink d1/d4/d5/l6 0 2024-08-18T22:41:28.331 INFO:tasks.workunit.client.0.smithi121.stdout:0/26: dwrite - no filename 2024-08-18T22:41:28.332 INFO:tasks.workunit.client.0.smithi121.stdout:0/27: write - no filename 2024-08-18T22:41:28.332 INFO:tasks.workunit.client.0.smithi121.stdout:0/28: write - no filename 2024-08-18T22:41:28.333 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:41:27 smithi121 ceph-mon[16788]: pgmap v239: 65 pgs: 65 active+clean; 202 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 7.3 MiB/s wr, 503 op/s 2024-08-18T22:41:28.333 INFO:tasks.workunit.client.0.smithi121.stdout:5/17: dwrite f1 [0,4194304] 0 2024-08-18T22:41:28.336 INFO:tasks.workunit.client.0.smithi121.stdout:0/29: creat d1/d4/d5/f7 x:0 0 0 2024-08-18T22:41:28.338 INFO:tasks.workunit.client.0.smithi121.stdout:0/30: rmdir d1/d4 39 2024-08-18T22:41:28.410 INFO:tasks.workunit.client.0.smithi121.stdout:2/19: truncate d2/d3/f4 3195707 0 2024-08-18T22:41:28.411 INFO:tasks.workunit.client.0.smithi121.stdout:7/6: fsync f0 0 2024-08-18T22:41:28.411 INFO:tasks.workunit.client.0.smithi121.stdout:7/7: write f0 [406903,56561] 0 2024-08-18T22:41:28.412 INFO:tasks.workunit.client.0.smithi121.stdout:6/11: unlink f1 0 2024-08-18T22:41:28.414 INFO:tasks.workunit.client.0.smithi121.stdout:7/8: creat f1 x:0 0 0 2024-08-18T22:41:28.415 INFO:tasks.workunit.client.0.smithi121.stdout:7/9: dread - f1 zero size 2024-08-18T22:41:28.415 INFO:tasks.workunit.client.0.smithi121.stdout:7/10: rmdir - no directory 2024-08-18T22:41:28.415 INFO:tasks.workunit.client.0.smithi121.stdout:7/11: write f1 [761936,51733] 0 2024-08-18T22:41:28.417 INFO:tasks.workunit.client.0.smithi121.stdout:6/12: write f3 [499422,100458] 0 2024-08-18T22:41:28.418 INFO:tasks.workunit.client.0.smithi121.stdout:6/13: truncate f3 1082331 0 2024-08-18T22:41:28.419 INFO:tasks.workunit.client.0.smithi121.stdout:7/12: rename f0 to f2 0 2024-08-18T22:41:28.419 INFO:tasks.workunit.client.0.smithi121.stdout:7/13: rmdir - no directory 2024-08-18T22:41:28.421 INFO:tasks.workunit.client.0.smithi121.stdout:7/14: mknod c3 0 2024-08-18T22:41:28.422 INFO:tasks.workunit.client.0.smithi121.stdout:7/15: chown f1 6397 1 2024-08-18T22:41:28.424 INFO:tasks.workunit.client.0.smithi121.stdout:7/16: dread f2 [0,4194304] 0 2024-08-18T22:41:28.425 INFO:tasks.workunit.client.0.smithi121.stdout:8/17: getdents . 0 2024-08-18T22:41:28.426 INFO:tasks.workunit.client.0.smithi121.stdout:7/17: creat f4 x:0 0 0 2024-08-18T22:41:28.428 INFO:tasks.workunit.client.0.smithi121.stdout:8/18: creat f5 x:0 0 0 2024-08-18T22:41:28.429 INFO:tasks.workunit.client.0.smithi121.stdout:7/18: creat f5 x:0 0 0 2024-08-18T22:41:28.430 INFO:tasks.workunit.client.0.smithi121.stdout:7/19: truncate f1 1148640 0 2024-08-18T22:41:28.431 INFO:tasks.workunit.client.0.smithi121.stdout:0/31: mkdir d1/d4/d5/d8 0 2024-08-18T22:41:28.432 INFO:tasks.workunit.client.0.smithi121.stdout:0/32: chown d1/d4 104805 1 2024-08-18T22:41:28.432 INFO:tasks.workunit.client.0.smithi121.stdout:8/19: dread f3 [0,4194304] 0 2024-08-18T22:41:28.433 INFO:tasks.workunit.client.0.smithi121.stdout:7/20: creat f6 x:0 0 0 2024-08-18T22:41:28.433 INFO:tasks.workunit.client.0.smithi121.stdout:8/20: readlink l4 0 2024-08-18T22:41:28.435 INFO:tasks.workunit.client.0.smithi121.stdout:0/33: creat d1/d4/d5/f9 x:0 0 0 2024-08-18T22:41:28.435 INFO:tasks.workunit.client.0.smithi121.stdout:7/21: creat f7 x:0 0 0 2024-08-18T22:41:28.436 INFO:tasks.workunit.client.0.smithi121.stdout:2/20: fsync d2/d3/f4 0 2024-08-18T22:41:28.438 INFO:tasks.workunit.client.0.smithi121.stdout:8/21: mkdir d6 0 2024-08-18T22:41:28.440 INFO:tasks.workunit.client.0.smithi121.stdout:7/22: unlink f6 0 2024-08-18T22:41:28.445 INFO:tasks.workunit.client.0.smithi121.stdout:0/34: dwrite d1/d4/d5/f9 [0,4194304] 0 2024-08-18T22:41:28.447 INFO:tasks.workunit.client.0.smithi121.stdout:2/21: dwrite d2/d3/f4 [0,4194304] 0 2024-08-18T22:41:28.447 INFO:tasks.workunit.client.0.smithi121.stdout:7/23: rename f1 to f8 0 2024-08-18T22:41:28.448 INFO:tasks.workunit.client.0.smithi121.stdout:0/35: write d1/d4/d5/f9 [4074081,104931] 0 2024-08-18T22:41:28.449 INFO:tasks.workunit.client.0.smithi121.stdout:2/22: write d2/d3/f4 [2793082,100994] 0 2024-08-18T22:41:28.450 INFO:tasks.workunit.client.0.smithi121.stdout:8/22: creat d6/f7 x:0 0 0 2024-08-18T22:41:28.451 INFO:tasks.workunit.client.0.smithi121.stdout:8/23: dread - f5 zero size 2024-08-18T22:41:28.451 INFO:tasks.workunit.client.0.smithi121.stdout:8/24: stat d6 0 2024-08-18T22:41:28.455 INFO:tasks.workunit.client.0.smithi121.stdout:0/36: mkdir d1/d4/da 0 2024-08-18T22:41:28.456 INFO:tasks.workunit.client.0.smithi121.stdout:2/23: dread d2/d3/f4 [0,4194304] 0 2024-08-18T22:41:28.462 INFO:tasks.workunit.client.0.smithi121.stdout:2/24: creat d2/f6 x:0 0 0 2024-08-18T22:41:28.463 INFO:tasks.workunit.client.0.smithi121.stdout:0/37: dwrite d1/d4/d5/f9 [0,4194304] 0 2024-08-18T22:41:28.463 INFO:tasks.workunit.client.0.smithi121.stdout:2/25: readlink d2/l5 0 2024-08-18T22:41:28.465 INFO:tasks.workunit.client.0.smithi121.stdout:0/38: mkdir d1/d4/db 0 2024-08-18T22:41:28.467 INFO:tasks.workunit.client.0.smithi121.stdout:8/25: rmdir d6 39 2024-08-18T22:41:28.469 INFO:tasks.workunit.client.0.smithi121.stdout:8/26: write f3 [4531084,12825] 0 2024-08-18T22:41:28.470 INFO:tasks.workunit.client.0.smithi121.stdout:0/39: symlink d1/d4/da/lc 0 2024-08-18T22:41:28.472 INFO:tasks.workunit.client.0.smithi121.stdout:8/27: creat d6/f8 x:0 0 0 2024-08-18T22:41:28.472 INFO:tasks.workunit.client.0.smithi121.stdout:8/28: truncate f5 482951 0 2024-08-18T22:41:28.478 INFO:tasks.workunit.client.0.smithi121.stdout:8/29: dwrite d6/f7 [0,4194304] 0 2024-08-18T22:41:28.482 INFO:tasks.workunit.client.0.smithi121.stdout:3/18: sync 2024-08-18T22:41:28.482 INFO:tasks.workunit.client.0.smithi121.stdout:1/32: sync 2024-08-18T22:41:28.482 INFO:tasks.workunit.client.0.smithi121.stdout:4/23: sync 2024-08-18T22:41:28.482 INFO:tasks.workunit.client.0.smithi121.stdout:9/73: sync 2024-08-18T22:41:28.483 INFO:tasks.workunit.client.0.smithi121.stdout:8/30: link f5 d6/f9 0 2024-08-18T22:41:28.484 INFO:tasks.workunit.client.0.smithi121.stdout:9/74: dread d0/d6/fc [0,4194304] 0 2024-08-18T22:41:28.484 INFO:tasks.workunit.client.0.smithi121.stdout:8/31: truncate d6/f9 909805 0 2024-08-18T22:41:28.485 INFO:tasks.workunit.client.0.smithi121.stdout:3/19: mknod c4 0 2024-08-18T22:41:28.485 INFO:tasks.workunit.client.0.smithi121.stdout:8/32: dread - d6/f8 zero size 2024-08-18T22:41:28.486 INFO:tasks.workunit.client.0.smithi121.stdout:4/24: rename f1 to d2/f5 0 2024-08-18T22:41:28.487 INFO:tasks.workunit.client.0.smithi121.stdout:3/20: creat f5 x:0 0 0 2024-08-18T22:41:28.488 INFO:tasks.workunit.client.0.smithi121.stdout:3/21: dread - f3 zero size 2024-08-18T22:41:28.488 INFO:tasks.workunit.client.0.smithi121.stdout:3/22: read - f3 zero size 2024-08-18T22:41:28.491 INFO:tasks.workunit.client.0.smithi121.stdout:3/23: write f1 [699280,107347] 0 2024-08-18T22:41:28.492 INFO:tasks.workunit.client.0.smithi121.stdout:8/33: unlink d6/f7 0 2024-08-18T22:41:28.492 INFO:tasks.workunit.client.0.smithi121.stdout:3/24: write f5 [970485,68815] 0 2024-08-18T22:41:28.496 INFO:tasks.workunit.client.0.smithi121.stdout:8/34: dread f5 [0,4194304] 0 2024-08-18T22:41:28.496 INFO:tasks.workunit.client.0.smithi121.stdout:8/35: stat l1 0 2024-08-18T22:41:28.499 INFO:tasks.workunit.client.0.smithi121.stdout:9/75: truncate d0/d5/fa 1487765 0 2024-08-18T22:41:28.499 INFO:tasks.workunit.client.0.smithi121.stdout:3/25: dread f5 [0,4194304] 0 2024-08-18T22:41:28.499 INFO:tasks.workunit.client.0.smithi121.stdout:8/36: symlink d6/la 0 2024-08-18T22:41:28.500 INFO:tasks.workunit.client.0.smithi121.stdout:9/76: mkdir d0/d5/dd/d19 0 2024-08-18T22:41:28.502 INFO:tasks.workunit.client.0.smithi121.stdout:8/37: dread f5 [0,4194304] 0 2024-08-18T22:41:28.502 INFO:tasks.workunit.client.0.smithi121.stdout:9/77: write d0/f4 [471249,63892] 0 2024-08-18T22:41:28.502 INFO:tasks.workunit.client.0.smithi121.stdout:3/26: rename c4 to c6 0 2024-08-18T22:41:28.503 INFO:tasks.workunit.client.0.smithi121.stdout:4/25: truncate f0 176974 0 2024-08-18T22:41:28.503 INFO:tasks.workunit.client.0.smithi121.stdout:8/38: chown f5 7 1 2024-08-18T22:41:28.504 INFO:tasks.workunit.client.0.smithi121.stdout:3/27: mknod c7 0 2024-08-18T22:41:28.505 INFO:tasks.workunit.client.0.smithi121.stdout:8/39: unlink f3 0 2024-08-18T22:41:28.506 INFO:tasks.workunit.client.0.smithi121.stdout:3/28: creat f8 x:0 0 0 2024-08-18T22:41:28.509 INFO:tasks.workunit.client.0.smithi121.stdout:8/40: write d6/f9 [797002,104713] 0 2024-08-18T22:41:28.510 INFO:tasks.workunit.client.0.smithi121.stdout:3/29: write f1 [125244,123187] 0 2024-08-18T22:41:28.514 INFO:tasks.workunit.client.0.smithi121.stdout:3/30: symlink l9 0 2024-08-18T22:41:28.515 INFO:tasks.workunit.client.0.smithi121.stdout:9/78: dwrite d0/d6/f10 [0,4194304] 0 2024-08-18T22:41:28.516 INFO:tasks.workunit.client.0.smithi121.stdout:8/41: mkdir d6/db 0 2024-08-18T22:41:28.517 INFO:tasks.workunit.client.0.smithi121.stdout:9/79: chown d0/d6/d18 2 1 2024-08-18T22:41:28.518 INFO:tasks.workunit.client.0.smithi121.stdout:3/31: truncate f5 1863756 0 2024-08-18T22:41:28.519 INFO:tasks.workunit.client.0.smithi121.stdout:4/26: dwrite d2/f5 [0,4194304] 0 2024-08-18T22:41:28.522 INFO:tasks.workunit.client.0.smithi121.stdout:8/42: write d6/f9 [783751,11708] 0 2024-08-18T22:41:28.527 INFO:tasks.workunit.client.0.smithi121.stdout:9/80: dread d0/d5/f9 [0,4194304] 0 2024-08-18T22:41:28.533 INFO:tasks.workunit.client.0.smithi121.stdout:9/81: mkdir d0/d5/dd/d1a 0 2024-08-18T22:41:28.535 INFO:tasks.workunit.client.0.smithi121.stdout:3/32: dwrite f8 [0,4194304] 0 2024-08-18T22:41:28.539 INFO:tasks.workunit.client.0.smithi121.stdout:9/82: chown d0/d5/dd/l11 9238 1 2024-08-18T22:41:28.539 INFO:tasks.workunit.client.0.smithi121.stdout:4/27: dwrite d2/f5 [0,4194304] 0 2024-08-18T22:41:28.540 INFO:tasks.workunit.client.0.smithi121.stdout:8/43: dwrite d6/f9 [0,4194304] 0 2024-08-18T22:41:28.542 INFO:tasks.workunit.client.0.smithi121.stdout:3/33: getdents . 0 2024-08-18T22:41:28.542 INFO:tasks.workunit.client.0.smithi121.stdout:9/83: read d0/d6/fc [385130,70348] 0 2024-08-18T22:41:28.542 INFO:tasks.workunit.client.0.smithi121.stdout:3/34: stat l9 0 2024-08-18T22:41:28.542 INFO:tasks.workunit.client.0.smithi121.stdout:4/28: creat d2/f6 x:0 0 0 2024-08-18T22:41:28.544 INFO:tasks.workunit.client.0.smithi121.stdout:4/29: write d2/f3 [321635,12116] 0 2024-08-18T22:41:28.545 INFO:tasks.workunit.client.0.smithi121.stdout:9/84: symlink d0/d5/l1b 0 2024-08-18T22:41:28.546 INFO:tasks.workunit.client.0.smithi121.stdout:4/30: write d2/f4 [747930,77189] 0 2024-08-18T22:41:28.549 INFO:tasks.workunit.client.0.smithi121.stdout:8/44: rmdir d6/db 0 2024-08-18T22:41:28.550 INFO:tasks.workunit.client.0.smithi121.stdout:3/35: dwrite f1 [0,4194304] 0 2024-08-18T22:41:28.552 INFO:tasks.workunit.client.0.smithi121.stdout:9/85: rename d0/d5/l17 to d0/d5/l1c 0 2024-08-18T22:41:28.552 INFO:tasks.workunit.client.0.smithi121.stdout:9/86: stat d0/d5/f9 0 2024-08-18T22:41:28.553 INFO:tasks.workunit.client.0.smithi121.stdout:9/87: chown d0/d6/l16 927302227 1 2024-08-18T22:41:28.553 INFO:tasks.workunit.client.0.smithi121.stdout:3/36: mknod ca 0 2024-08-18T22:41:28.556 INFO:tasks.workunit.client.0.smithi121.stdout:3/37: symlink lb 0 2024-08-18T22:41:28.560 INFO:tasks.workunit.client.0.smithi121.stdout:3/38: link c2 cc 0 2024-08-18T22:41:28.563 INFO:tasks.workunit.client.0.smithi121.stdout:9/88: dwrite d0/d6/f10 [0,4194304] 0 2024-08-18T22:41:28.566 INFO:tasks.workunit.client.0.smithi121.stdout:4/31: fdatasync d2/f5 0 2024-08-18T22:41:28.568 INFO:tasks.workunit.client.0.smithi121.stdout:9/89: creat d0/d6/d18/f1d x:0 0 0 2024-08-18T22:41:28.568 INFO:tasks.workunit.client.0.smithi121.stdout:3/39: dwrite f8 [0,4194304] 0 2024-08-18T22:41:28.569 INFO:tasks.workunit.client.0.smithi121.stdout:9/90: fsync d0/f3 0 2024-08-18T22:41:28.570 INFO:tasks.workunit.client.0.smithi121.stdout:8/45: getdents d6 0 2024-08-18T22:41:28.572 INFO:tasks.workunit.client.0.smithi121.stdout:3/40: fdatasync f5 0 2024-08-18T22:41:28.573 INFO:tasks.workunit.client.0.smithi121.stdout:3/41: write f8 [5027609,102195] 0 2024-08-18T22:41:28.574 INFO:tasks.workunit.client.0.smithi121.stdout:4/32: dread d2/f3 [0,4194304] 0 2024-08-18T22:41:28.575 INFO:tasks.workunit.client.0.smithi121.stdout:9/91: readlink d0/l2 0 2024-08-18T22:41:28.581 INFO:tasks.workunit.client.0.smithi121.stdout:8/46: link d6/la d6/lc 0 2024-08-18T22:41:28.582 INFO:tasks.workunit.client.0.smithi121.stdout:8/47: write d6/f8 [752902,116650] 0 2024-08-18T22:41:28.582 INFO:tasks.workunit.client.0.smithi121.stdout:9/92: creat d0/f1e x:0 0 0 2024-08-18T22:41:28.583 INFO:tasks.workunit.client.0.smithi121.stdout:4/33: link f0 d2/f7 0 2024-08-18T22:41:28.589 INFO:tasks.workunit.client.0.smithi121.stdout:8/48: dwrite d6/f9 [0,4194304] 0 2024-08-18T22:41:28.590 INFO:tasks.workunit.client.0.smithi121.stdout:3/42: read f8 [4940058,83589] 0 2024-08-18T22:41:28.590 INFO:tasks.workunit.client.0.smithi121.stdout:8/49: mkdir d6/dd 0 2024-08-18T22:41:28.591 INFO:tasks.workunit.client.0.smithi121.stdout:3/43: creat fd x:0 0 0 2024-08-18T22:41:28.592 INFO:tasks.workunit.client.0.smithi121.stdout:3/44: symlink le 0 2024-08-18T22:41:28.592 INFO:tasks.workunit.client.0.smithi121.stdout:8/50: link l1 d6/dd/le 0 2024-08-18T22:41:28.595 INFO:tasks.workunit.client.0.smithi121.stdout:8/51: mknod d6/dd/cf 0 2024-08-18T22:41:28.597 INFO:tasks.workunit.client.0.smithi121.stdout:8/52: mkdir d6/dd/d10 0 2024-08-18T22:41:28.599 INFO:tasks.workunit.client.0.smithi121.stdout:8/53: mknod d6/dd/c11 0 2024-08-18T22:41:28.600 INFO:tasks.workunit.client.0.smithi121.stdout:8/54: chown d6/dd 3839 1 2024-08-18T22:41:28.600 INFO:tasks.workunit.client.0.smithi121.stdout:3/45: dwrite f5 [0,4194304] 0 2024-08-18T22:41:28.600 INFO:tasks.workunit.client.0.smithi121.stdout:9/93: rmdir d0/d6/d18 39 2024-08-18T22:41:28.602 INFO:tasks.workunit.client.0.smithi121.stdout:8/55: rmdir d6 39 2024-08-18T22:41:28.604 INFO:tasks.workunit.client.0.smithi121.stdout:9/94: unlink d0/f4 0 2024-08-18T22:41:28.607 INFO:tasks.workunit.client.0.smithi121.stdout:3/46: rename f1 to ff 0 2024-08-18T22:41:28.612 INFO:tasks.workunit.client.0.smithi121.stdout:9/95: dwrite d0/d5/fe [0,4194304] 0 2024-08-18T22:41:28.613 INFO:tasks.workunit.client.0.smithi121.stdout:8/56: creat d6/f12 x:0 0 0 2024-08-18T22:41:28.614 INFO:tasks.workunit.client.0.smithi121.stdout:9/96: write d0/d6/f10 [4722234,11319] 0 2024-08-18T22:41:28.618 INFO:tasks.workunit.client.0.smithi121.stdout:9/97: dread - d0/d6/d18/f1d zero size 2024-08-18T22:41:28.620 INFO:tasks.workunit.client.0.smithi121.stdout:8/57: rmdir d6/dd/d10 0 2024-08-18T22:41:28.623 INFO:tasks.workunit.client.0.smithi121.stdout:3/47: getdents . 0 2024-08-18T22:41:28.624 INFO:tasks.workunit.client.0.smithi121.stdout:8/58: unlink d6/f12 0 2024-08-18T22:41:28.625 INFO:tasks.workunit.client.0.smithi121.stdout:8/59: fdatasync d6/f9 0 2024-08-18T22:41:28.625 INFO:tasks.workunit.client.0.smithi121.stdout:8/60: fdatasync d6/f8 0 2024-08-18T22:41:28.626 INFO:tasks.workunit.client.0.smithi121.stdout:3/48: creat f10 x:0 0 0 2024-08-18T22:41:28.627 INFO:tasks.workunit.client.0.smithi121.stdout:9/98: creat d0/d6/f1f x:0 0 0 2024-08-18T22:41:28.629 INFO:tasks.workunit.client.0.smithi121.stdout:3/49: creat f11 x:0 0 0 2024-08-18T22:41:28.631 INFO:tasks.workunit.client.0.smithi121.stdout:3/50: creat f12 x:0 0 0 2024-08-18T22:41:28.632 INFO:tasks.workunit.client.0.smithi121.stdout:9/99: truncate d0/d5/f9 466929 0 2024-08-18T22:41:28.633 INFO:tasks.workunit.client.0.smithi121.stdout:3/51: rename le to l13 0 2024-08-18T22:41:28.633 INFO:tasks.workunit.client.0.smithi121.stdout:3/52: fdatasync f5 0 2024-08-18T22:41:28.635 INFO:tasks.workunit.client.0.smithi121.stdout:9/100: creat d0/d6/df/f20 x:0 0 0 2024-08-18T22:41:28.636 INFO:tasks.workunit.client.0.smithi121.stdout:3/53: mknod c14 0 2024-08-18T22:41:28.637 INFO:tasks.workunit.client.0.smithi121.stdout:3/54: dread - f10 zero size 2024-08-18T22:41:28.638 INFO:tasks.workunit.client.0.smithi121.stdout:9/101: symlink d0/l21 0 2024-08-18T22:41:28.640 INFO:tasks.workunit.client.0.smithi121.stdout:9/102: fsync d0/f3 0 2024-08-18T22:41:28.642 INFO:tasks.workunit.client.0.smithi121.stdout:9/103: write d0/d6/fc [1103815,89443] 0 2024-08-18T22:41:28.644 INFO:tasks.workunit.client.0.smithi121.stdout:9/104: read d0/d5/fe [3361127,129136] 0 2024-08-18T22:41:28.645 INFO:tasks.workunit.client.0.smithi121.stdout:3/55: dwrite f12 [0,4194304] 0 2024-08-18T22:41:28.647 INFO:tasks.workunit.client.0.smithi121.stdout:3/56: mknod c15 0 2024-08-18T22:41:28.647 INFO:tasks.workunit.client.0.smithi121.stdout:3/57: dread - f3 zero size 2024-08-18T22:41:28.648 INFO:tasks.workunit.client.0.smithi121.stdout:3/58: stat c15 0 2024-08-18T22:41:28.650 INFO:tasks.workunit.client.0.smithi121.stdout:9/105: dread d0/f3 [0,4194304] 0 2024-08-18T22:41:28.654 INFO:tasks.workunit.client.0.smithi121.stdout:9/106: rename d0/l2 to d0/d5/dd/d19/l22 0 2024-08-18T22:41:28.657 INFO:tasks.workunit.client.0.smithi121.stdout:3/59: dwrite f8 [4194304,4194304] 0 2024-08-18T22:41:28.657 INFO:tasks.workunit.client.0.smithi121.stdout:9/107: truncate d0/d6/df/f20 270549 0 2024-08-18T22:41:28.658 INFO:tasks.workunit.client.0.smithi121.stdout:3/60: write f3 [427414,104962] 0 2024-08-18T22:41:28.660 INFO:tasks.workunit.client.0.smithi121.stdout:9/108: symlink d0/d5/l23 0 2024-08-18T22:41:28.663 INFO:tasks.workunit.client.0.smithi121.stdout:3/61: dread f12 [0,4194304] 0 2024-08-18T22:41:28.664 INFO:tasks.workunit.client.0.smithi121.stdout:3/62: fdatasync f10 0 2024-08-18T22:41:28.666 INFO:tasks.workunit.client.0.smithi121.stdout:3/63: creat f16 x:0 0 0 2024-08-18T22:41:28.668 INFO:tasks.workunit.client.0.smithi121.stdout:3/64: unlink lb 0 2024-08-18T22:41:28.669 INFO:tasks.workunit.client.0.smithi121.stdout:3/65: rename f8 to f17 0 2024-08-18T22:41:28.670 INFO:tasks.workunit.client.1.smithi195.stdout:cc -DNO_XFS -I/home/ubuntu/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress -D_LARGEFILE64_SOURCE -D_GNU_SOURCE -I../../../../include -I../../../../include -L../../../../lib fsstress.c -o fsstress 2024-08-18T22:41:28.676 INFO:tasks.workunit.client.0.smithi121.stdout:9/109: dwrite d0/d5/f9 [0,4194304] 0 2024-08-18T22:41:28.676 INFO:tasks.workunit.client.0.smithi121.stdout:3/66: dread f12 [0,4194304] 0 2024-08-18T22:41:28.680 INFO:tasks.workunit.client.0.smithi121.stdout:9/110: rename d0/d5/l1b to d0/l24 0 2024-08-18T22:41:28.681 INFO:tasks.workunit.client.0.smithi121.stdout:3/67: truncate f12 1764034 0 2024-08-18T22:41:28.682 INFO:tasks.workunit.client.0.smithi121.stdout:3/68: dread - f16 zero size 2024-08-18T22:41:28.684 INFO:tasks.workunit.client.0.smithi121.stdout:9/111: dread d0/d5/fe [0,4194304] 0 2024-08-18T22:41:28.686 INFO:tasks.workunit.client.0.smithi121.stdout:9/112: rmdir d0/d5 39 2024-08-18T22:41:28.687 INFO:tasks.workunit.client.0.smithi121.stdout:9/113: write d0/f1e [845005,55695] 0 2024-08-18T22:41:28.690 INFO:tasks.workunit.client.0.smithi121.stdout:3/69: dwrite f3 [0,4194304] 0 2024-08-18T22:41:28.692 INFO:tasks.workunit.client.0.smithi121.stdout:9/114: creat d0/d5/f25 x:0 0 0 2024-08-18T22:41:28.692 INFO:tasks.workunit.client.0.smithi121.stdout:3/70: mknod c18 0 2024-08-18T22:41:28.693 INFO:tasks.workunit.client.0.smithi121.stdout:3/71: readlink l13 0 2024-08-18T22:41:28.694 INFO:tasks.workunit.client.0.smithi121.stdout:3/72: write f10 [503881,117384] 0 2024-08-18T22:41:28.694 INFO:tasks.workunit.client.0.smithi121.stdout:3/73: rmdir - no directory 2024-08-18T22:41:28.695 INFO:tasks.workunit.client.0.smithi121.stdout:3/74: write f16 [395677,3446] 0 2024-08-18T22:41:28.696 INFO:tasks.workunit.client.0.smithi121.stdout:9/115: link d0/d6/f10 d0/d5/dd/d1a/f26 0 2024-08-18T22:41:28.698 INFO:tasks.workunit.client.0.smithi121.stdout:9/116: mknod d0/d6/df/c27 0 2024-08-18T22:41:28.698 INFO:tasks.workunit.client.0.smithi121.stdout:3/75: link l13 l19 0 2024-08-18T22:41:28.700 INFO:tasks.workunit.client.0.smithi121.stdout:9/117: write d0/d5/fe [3876673,119536] 0 2024-08-18T22:41:28.707 INFO:tasks.workunit.client.0.smithi121.stdout:9/118: dread d0/d6/f10 [0,4194304] 0 2024-08-18T22:41:28.707 INFO:tasks.workunit.client.0.smithi121.stdout:3/76: dwrite ff [0,4194304] 0 2024-08-18T22:41:28.710 INFO:tasks.workunit.client.0.smithi121.stdout:9/119: rename d0/c13 to d0/d5/dd/c28 0 2024-08-18T22:41:28.711 INFO:tasks.workunit.client.0.smithi121.stdout:3/77: dread f5 [0,4194304] 0 2024-08-18T22:41:28.712 INFO:tasks.workunit.client.0.smithi121.stdout:3/78: creat f1a x:0 0 0 2024-08-18T22:41:28.713 INFO:tasks.workunit.client.0.smithi121.stdout:3/79: readlink l13 0 2024-08-18T22:41:28.715 INFO:tasks.workunit.client.0.smithi121.stdout:3/80: symlink l1b 0 2024-08-18T22:41:28.716 INFO:tasks.workunit.client.0.smithi121.stdout:5/18: sync 2024-08-18T22:41:28.717 INFO:tasks.workunit.client.0.smithi121.stdout:9/120: dread d0/f1e [0,4194304] 0 2024-08-18T22:41:28.718 INFO:tasks.workunit.client.0.smithi121.stdout:5/19: creat d3/f4 x:0 0 0 2024-08-18T22:41:28.720 INFO:tasks.workunit.client.0.smithi121.stdout:5/20: mkdir d3/d5 0 2024-08-18T22:41:28.724 INFO:tasks.workunit.client.0.smithi121.stdout:5/21: link c2 d3/d5/c6 0 2024-08-18T22:41:28.725 INFO:tasks.workunit.client.0.smithi121.stdout:9/121: dwrite d0/d5/fe [4194304,4194304] 0 2024-08-18T22:41:28.731 INFO:tasks.workunit.client.0.smithi121.stdout:5/22: dread f1 [0,4194304] 0 2024-08-18T22:41:28.734 INFO:tasks.workunit.client.0.smithi121.stdout:5/23: chown d3/d5/c6 13269234 1 2024-08-18T22:41:28.735 INFO:tasks.workunit.client.0.smithi121.stdout:9/122: dwrite d0/d5/dd/d1a/f26 [0,4194304] 0 2024-08-18T22:41:28.735 INFO:tasks.workunit.client.0.smithi121.stdout:5/24: fdatasync f1 0 2024-08-18T22:41:28.736 INFO:tasks.workunit.client.0.smithi121.stdout:5/25: chown f1 32655 1 2024-08-18T22:41:28.738 INFO:tasks.workunit.client.0.smithi121.stdout:5/26: creat d3/d5/f7 x:0 0 0 2024-08-18T22:41:28.774 INFO:tasks.workunit.client.0.smithi121.stdout:9/123: link d0/d5/dd/c28 d0/d6/c29 0 2024-08-18T22:41:28.774 INFO:tasks.workunit.client.0.smithi121.stdout:3/81: truncate ff 3628432 0 2024-08-18T22:41:28.775 INFO:tasks.workunit.client.0.smithi121.stdout:3/82: fdatasync f3 0 2024-08-18T22:41:28.777 INFO:tasks.workunit.client.0.smithi121.stdout:9/124: fdatasync d0/d5/fa 0 2024-08-18T22:41:28.778 INFO:tasks.workunit.client.0.smithi121.stdout:3/83: rename f3 to f1c 0 2024-08-18T22:41:28.781 INFO:tasks.workunit.client.0.smithi121.stdout:3/84: mknod c1d 0 2024-08-18T22:41:28.781 INFO:tasks.workunit.client.0.smithi121.stdout:5/27: fsync d3/d5/f7 0 2024-08-18T22:41:28.782 INFO:tasks.workunit.client.0.smithi121.stdout:3/85: chown l13 7166 1 2024-08-18T22:41:28.784 INFO:tasks.workunit.client.0.smithi121.stdout:9/125: creat d0/f2a x:0 0 0 2024-08-18T22:41:28.789 INFO:tasks.workunit.client.0.smithi121.stdout:5/28: dwrite d3/f4 [0,4194304] 0 2024-08-18T22:41:28.791 INFO:tasks.workunit.client.0.smithi121.stdout:9/126: truncate d0/d5/f9 2477121 0 2024-08-18T22:41:28.795 INFO:tasks.workunit.client.0.smithi121.stdout:9/127: symlink d0/d5/dd/l2b 0 2024-08-18T22:41:28.795 INFO:tasks.workunit.client.0.smithi121.stdout:3/86: dwrite f17 [0,4194304] 0 2024-08-18T22:41:28.797 INFO:tasks.workunit.client.0.smithi121.stdout:3/87: truncate f1c 4564576 0 2024-08-18T22:41:28.799 INFO:tasks.workunit.client.0.smithi121.stdout:3/88: mkdir d1e 0 2024-08-18T22:41:28.801 INFO:tasks.workunit.client.0.smithi121.stdout:5/29: dwrite d3/f4 [0,4194304] 0 2024-08-18T22:41:28.802 INFO:tasks.workunit.client.0.smithi121.stdout:3/89: mkdir d1e/d1f 0 2024-08-18T22:41:28.804 INFO:tasks.workunit.client.0.smithi121.stdout:3/90: chown ca 7884 1 2024-08-18T22:41:28.804 INFO:tasks.workunit.client.0.smithi121.stdout:5/30: truncate d3/d5/f7 759086 0 2024-08-18T22:41:28.830 INFO:tasks.workunit.client.0.smithi121.stdout:5/31: fsync d3/d5/f7 0 2024-08-18T22:41:28.830 INFO:tasks.workunit.client.0.smithi121.stdout:9/128: dwrite d0/f2a [0,4194304] 0 2024-08-18T22:41:28.831 INFO:tasks.workunit.client.0.smithi121.stdout:5/32: write d3/f4 [2535701,128578] 0 2024-08-18T22:41:28.860 INFO:tasks.workunit.client.0.smithi121.stdout:7/24: sync 2024-08-18T22:41:28.860 INFO:tasks.workunit.client.0.smithi121.stdout:2/26: sync 2024-08-18T22:41:28.860 INFO:tasks.workunit.client.0.smithi121.stdout:2/27: dread - d2/f6 zero size 2024-08-18T22:41:28.860 INFO:tasks.workunit.client.0.smithi121.stdout:2/28: dread - d2/f6 zero size 2024-08-18T22:41:28.916 INFO:tasks.workunit.client.0.smithi121.stdout:4/34: sync 2024-08-18T22:41:28.916 INFO:tasks.workunit.client.0.smithi121.stdout:0/40: sync 2024-08-18T22:41:28.916 INFO:tasks.workunit.client.0.smithi121.stdout:1/33: sync 2024-08-18T22:41:28.917 INFO:tasks.workunit.client.0.smithi121.stdout:8/61: sync 2024-08-18T22:41:28.917 INFO:tasks.workunit.client.0.smithi121.stdout:8/62: stat d6 0 2024-08-18T22:41:28.917 INFO:tasks.workunit.client.0.smithi121.stdout:1/34: read f3 [5248904,60107] 0 2024-08-18T22:41:28.918 INFO:tasks.workunit.client.0.smithi121.stdout:8/63: fdatasync d6/f8 0 2024-08-18T22:41:28.918 INFO:tasks.workunit.client.0.smithi121.stdout:1/35: write f3 [6621747,53212] 0 2024-08-18T22:41:28.919 INFO:tasks.workunit.client.0.smithi121.stdout:8/64: write d6/f9 [3254203,87230] 0 2024-08-18T22:41:28.919 INFO:tasks.workunit.client.0.smithi121.stdout:1/36: dread - d5/f7 zero size 2024-08-18T22:41:28.920 INFO:tasks.workunit.client.0.smithi121.stdout:8/65: write d6/f9 [1027822,94507] 0 2024-08-18T22:41:28.922 INFO:tasks.workunit.client.0.smithi121.stdout:8/66: fdatasync d6/f9 0 2024-08-18T22:41:28.934 INFO:tasks.workunit.client.0.smithi121.stdout:9/129: unlink d0/d5/c12 0 2024-08-18T22:41:28.935 INFO:tasks.workunit.client.0.smithi121.stdout:5/33: rename d3/f4 to d3/d5/f8 0 2024-08-18T22:41:28.936 INFO:tasks.workunit.client.0.smithi121.stdout:7/25: rename f4 to f9 0 2024-08-18T22:41:28.936 INFO:tasks.workunit.client.0.smithi121.stdout:7/26: rmdir - no directory 2024-08-18T22:41:28.937 INFO:tasks.workunit.client.0.smithi121.stdout:7/27: dread - f5 zero size 2024-08-18T22:41:28.937 INFO:tasks.workunit.client.0.smithi121.stdout:2/29: symlink d2/d3/l7 0 2024-08-18T22:41:28.937 INFO:tasks.workunit.client.0.smithi121.stdout:7/28: chown c3 25372 1 2024-08-18T22:41:28.938 INFO:tasks.workunit.client.0.smithi121.stdout:4/35: unlink d2/f6 0 2024-08-18T22:41:28.939 INFO:tasks.workunit.client.0.smithi121.stdout:0/41: rmdir d1/d4/d5 39 2024-08-18T22:41:28.941 INFO:tasks.workunit.client.0.smithi121.stdout:2/30: dread d2/d3/f4 [0,4194304] 0 2024-08-18T22:41:28.941 INFO:tasks.workunit.client.0.smithi121.stdout:1/37: mknod d5/c9 0 2024-08-18T22:41:28.942 INFO:tasks.workunit.client.0.smithi121.stdout:8/67: mknod d6/dd/c13 0 2024-08-18T22:41:28.943 INFO:tasks.workunit.client.0.smithi121.stdout:3/91: mknod d1e/d1f/c20 0 2024-08-18T22:41:28.943 INFO:tasks.workunit.client.0.smithi121.stdout:8/68: truncate d6/f9 4943170 0 2024-08-18T22:41:28.944 INFO:tasks.workunit.client.0.smithi121.stdout:8/69: fdatasync d6/f8 0 2024-08-18T22:41:28.946 INFO:tasks.workunit.client.0.smithi121.stdout:3/92: dread f10 [0,4194304] 0 2024-08-18T22:41:28.947 INFO:tasks.workunit.client.0.smithi121.stdout:3/93: chown f5 13 1 2024-08-18T22:41:28.949 INFO:tasks.workunit.client.0.smithi121.stdout:7/29: mknod ca 0 2024-08-18T22:41:28.949 INFO:tasks.workunit.client.0.smithi121.stdout:7/30: dread - f7 zero size 2024-08-18T22:41:28.950 INFO:tasks.workunit.client.0.smithi121.stdout:4/36: creat d2/f8 x:0 0 0 2024-08-18T22:41:28.951 INFO:tasks.workunit.client.0.smithi121.stdout:2/31: mkdir d2/d8 0 2024-08-18T22:41:28.952 INFO:tasks.workunit.client.0.smithi121.stdout:1/38: creat d5/fa x:0 0 0 2024-08-18T22:41:28.953 INFO:tasks.workunit.client.0.smithi121.stdout:1/39: stat f3 0 2024-08-18T22:41:28.957 INFO:tasks.workunit.client.0.smithi121.stdout:2/32: write d2/d3/f4 [1255050,62739] 0 2024-08-18T22:41:28.958 INFO:tasks.workunit.client.0.smithi121.stdout:1/40: creat d5/fb x:0 0 0 2024-08-18T22:41:28.958 INFO:tasks.workunit.client.0.smithi121.stdout:4/37: dread f0 [0,4194304] 0 2024-08-18T22:41:28.959 INFO:tasks.workunit.client.0.smithi121.stdout:4/38: fdatasync d2/f8 0 2024-08-18T22:41:28.961 INFO:tasks.workunit.client.0.smithi121.stdout:8/70: truncate d6/f8 787276 0 2024-08-18T22:41:28.963 INFO:tasks.workunit.client.0.smithi121.stdout:4/39: dread d2/f4 [0,4194304] 0 2024-08-18T22:41:28.963 INFO:tasks.workunit.client.0.smithi121.stdout:4/40: readlink - no filename 2024-08-18T22:41:28.964 INFO:tasks.workunit.client.0.smithi121.stdout:4/41: write d2/f8 [751921,91153] 0 2024-08-18T22:41:28.965 INFO:tasks.workunit.client.0.smithi121.stdout:4/42: dread f0 [0,4194304] 0 2024-08-18T22:41:28.967 INFO:tasks.workunit.client.0.smithi121.stdout:8/71: creat d6/f14 x:0 0 0 2024-08-18T22:41:28.969 INFO:tasks.workunit.client.0.smithi121.stdout:0/42: rename d1/d4/d5/f9 to d1/fd 0 2024-08-18T22:41:28.971 INFO:tasks.workunit.client.0.smithi121.stdout:4/43: creat d2/f9 x:0 0 0 2024-08-18T22:41:28.971 INFO:tasks.workunit.client.0.smithi121.stdout:4/44: readlink - no filename 2024-08-18T22:41:28.971 INFO:tasks.workunit.client.0.smithi121.stdout:4/45: stat d2/f4 0 2024-08-18T22:41:28.972 INFO:tasks.workunit.client.0.smithi121.stdout:8/72: creat d6/f15 x:0 0 0 2024-08-18T22:41:28.972 INFO:tasks.workunit.client.0.smithi121.stdout:4/46: read d2/f5 [4141547,131002] 0 2024-08-18T22:41:28.973 INFO:tasks.workunit.client.0.smithi121.stdout:1/41: link d5/l8 d5/lc 0 2024-08-18T22:41:28.975 INFO:tasks.workunit.client.0.smithi121.stdout:4/47: mknod d2/ca 0 2024-08-18T22:41:28.976 INFO:tasks.workunit.client.0.smithi121.stdout:4/48: chown d2/f3 853940522 1 2024-08-18T22:41:28.976 INFO:tasks.workunit.client.0.smithi121.stdout:1/42: creat d5/fd x:0 0 0 2024-08-18T22:41:28.978 INFO:tasks.workunit.client.0.smithi121.stdout:1/43: creat d5/fe x:0 0 0 2024-08-18T22:41:28.980 INFO:tasks.workunit.client.0.smithi121.stdout:4/49: link d2/f3 d2/fb 0 2024-08-18T22:41:28.982 INFO:tasks.workunit.client.0.smithi121.stdout:4/50: mkdir d2/dc 0 2024-08-18T22:41:28.986 INFO:tasks.workunit.client.0.smithi121.stdout:1/44: dwrite d5/fa [0,4194304] 0 2024-08-18T22:41:28.987 INFO:tasks.workunit.client.0.smithi121.stdout:1/45: truncate f4 2133411 0 2024-08-18T22:41:29.034 INFO:tasks.workunit.client.0.smithi121.stdout:5/34: rmdir d3 39 2024-08-18T22:41:29.034 INFO:tasks.workunit.client.0.smithi121.stdout:5/35: stat c0 0 2024-08-18T22:41:29.034 INFO:tasks.workunit.client.0.smithi121.stdout:7/31: fsync f9 0 2024-08-18T22:41:29.036 INFO:tasks.workunit.client.0.smithi121.stdout:7/32: creat fb x:0 0 0 2024-08-18T22:41:29.036 INFO:tasks.workunit.client.0.smithi121.stdout:5/36: symlink d3/d5/l9 0 2024-08-18T22:41:29.037 INFO:tasks.workunit.client.0.smithi121.stdout:5/37: truncate d3/d5/f8 4431308 0 2024-08-18T22:41:29.038 INFO:tasks.workunit.client.0.smithi121.stdout:7/33: creat fc x:0 0 0 2024-08-18T22:41:29.039 INFO:tasks.workunit.client.0.smithi121.stdout:7/34: creat fd x:0 0 0 2024-08-18T22:41:29.040 INFO:tasks.workunit.client.0.smithi121.stdout:7/35: dread - fd zero size 2024-08-18T22:41:29.040 INFO:tasks.workunit.client.0.smithi121.stdout:5/38: dread d3/d5/f7 [0,4194304] 0 2024-08-18T22:41:29.043 INFO:tasks.workunit.client.0.smithi121.stdout:5/39: write d3/d5/f7 [371866,110094] 0 2024-08-18T22:41:29.044 INFO:tasks.workunit.client.0.smithi121.stdout:3/94: write f12 [505704,88426] 0 2024-08-18T22:41:29.048 INFO:tasks.workunit.client.0.smithi121.stdout:3/95: write f5 [4269218,93898] 0 2024-08-18T22:41:29.050 INFO:tasks.workunit.client.0.smithi121.stdout:9/130: dwrite d0/d5/fa [0,4194304] 0 2024-08-18T22:41:29.050 INFO:tasks.workunit.client.0.smithi121.stdout:5/40: write d3/d5/f8 [2022145,105682] 0 2024-08-18T22:41:29.051 INFO:tasks.workunit.client.0.smithi121.stdout:3/96: chown f1a 189 1 2024-08-18T22:41:29.052 INFO:tasks.workunit.client.0.smithi121.stdout:1/46: getdents d5 0 2024-08-18T22:41:29.053 INFO:tasks.workunit.client.0.smithi121.stdout:3/97: read f16 [85855,10332] 0 2024-08-18T22:41:29.054 INFO:tasks.workunit.client.0.smithi121.stdout:4/51: write d2/f7 [932087,34524] 0 2024-08-18T22:41:29.055 INFO:tasks.workunit.client.0.smithi121.stdout:5/41: chown d3/d5/l9 126 1 2024-08-18T22:41:29.056 INFO:tasks.workunit.client.0.smithi121.stdout:3/98: read ff [2956792,68230] 0 2024-08-18T22:41:29.056 INFO:tasks.workunit.client.0.smithi121.stdout:9/131: write d0/f3 [3045897,80915] 0 2024-08-18T22:41:29.057 INFO:tasks.workunit.client.0.smithi121.stdout:1/47: dread - d5/fe zero size 2024-08-18T22:41:29.060 INFO:tasks.workunit.client.0.smithi121.stdout:7/36: dwrite fc [0,4194304] 0 2024-08-18T22:41:29.062 INFO:tasks.workunit.client.0.smithi121.stdout:5/42: truncate d3/d5/f7 1033650 0 2024-08-18T22:41:29.064 INFO:tasks.workunit.client.0.smithi121.stdout:1/48: mkdir d5/df 0 2024-08-18T22:41:29.066 INFO:tasks.workunit.client.0.smithi121.stdout:3/99: mknod d1e/d1f/c21 0 2024-08-18T22:41:29.069 INFO:tasks.workunit.client.0.smithi121.stdout:4/52: link d2/f8 d2/dc/fd 0 2024-08-18T22:41:29.071 INFO:tasks.workunit.client.0.smithi121.stdout:5/43: creat d3/fa x:0 0 0 2024-08-18T22:41:29.072 INFO:tasks.workunit.client.0.smithi121.stdout:7/37: mkdir de 0 2024-08-18T22:41:29.073 INFO:tasks.workunit.client.0.smithi121.stdout:1/49: mkdir d5/d10 0 2024-08-18T22:41:29.073 INFO:tasks.workunit.client.0.smithi121.stdout:8/73: dwrite d6/f8 [0,4194304] 0 2024-08-18T22:41:29.075 INFO:tasks.workunit.client.0.smithi121.stdout:9/132: dwrite d0/d6/df/f20 [0,4194304] 0 2024-08-18T22:41:29.081 INFO:tasks.workunit.client.0.smithi121.stdout:3/100: rename c2 to d1e/c22 0 2024-08-18T22:41:29.084 INFO:tasks.workunit.client.0.smithi121.stdout:8/74: dread d6/f8 [0,4194304] 0 2024-08-18T22:41:29.084 INFO:tasks.workunit.client.0.smithi121.stdout:8/75: stat f5 0 2024-08-18T22:41:29.085 INFO:tasks.workunit.client.0.smithi121.stdout:7/38: creat de/ff x:0 0 0 2024-08-18T22:41:29.086 INFO:tasks.workunit.client.0.smithi121.stdout:1/50: mkdir d5/df/d11 0 2024-08-18T22:41:29.087 INFO:tasks.workunit.client.0.smithi121.stdout:9/133: dwrite d0/d6/fc [0,4194304] 0 2024-08-18T22:41:29.087 INFO:tasks.workunit.client.0.smithi121.stdout:7/39: stat fb 0 2024-08-18T22:41:29.089 INFO:tasks.workunit.client.0.smithi121.stdout:7/40: fdatasync de/ff 0 2024-08-18T22:41:29.092 INFO:tasks.workunit.client.0.smithi121.stdout:3/101: creat d1e/d1f/f23 x:0 0 0 2024-08-18T22:41:29.094 INFO:tasks.workunit.client.0.smithi121.stdout:8/76: unlink d6/f15 0 2024-08-18T22:41:29.096 INFO:tasks.workunit.client.0.smithi121.stdout:9/134: readlink d0/d5/dd/d19/l22 0 2024-08-18T22:41:29.097 INFO:tasks.workunit.client.0.smithi121.stdout:7/41: symlink de/l10 0 2024-08-18T22:41:29.098 INFO:tasks.workunit.client.0.smithi121.stdout:5/44: link d3/d5/l9 d3/d5/lb 0 2024-08-18T22:41:29.099 INFO:tasks.workunit.client.0.smithi121.stdout:4/53: write d2/fb [3383218,113734] 0 2024-08-18T22:41:29.101 INFO:tasks.workunit.client.0.smithi121.stdout:8/77: rmdir d6/dd 39 2024-08-18T22:41:29.101 INFO:tasks.workunit.client.0.smithi121.stdout:3/102: dwrite f5 [0,4194304] 0 2024-08-18T22:41:29.104 INFO:tasks.workunit.client.0.smithi121.stdout:9/135: fsync d0/f1e 0 2024-08-18T22:41:29.105 INFO:tasks.workunit.client.0.smithi121.stdout:5/45: creat d3/fc x:0 0 0 2024-08-18T22:41:29.106 INFO:tasks.workunit.client.0.smithi121.stdout:8/78: write d6/f9 [2353177,89013] 0 2024-08-18T22:41:29.106 INFO:tasks.workunit.client.0.smithi121.stdout:3/103: write f17 [9074408,42557] 0 2024-08-18T22:41:29.108 INFO:tasks.workunit.client.0.smithi121.stdout:1/51: link d5/l8 d5/df/d11/l12 0 2024-08-18T22:41:29.111 INFO:tasks.workunit.client.0.smithi121.stdout:3/104: mknod d1e/d1f/c24 0 2024-08-18T22:41:29.113 INFO:tasks.workunit.client.0.smithi121.stdout:5/46: write d3/d5/f8 [1987350,103201] 0 2024-08-18T22:41:29.116 INFO:tasks.workunit.client.0.smithi121.stdout:8/79: dread d6/f9 [4194304,4194304] 0 2024-08-18T22:41:29.116 INFO:tasks.workunit.client.0.smithi121.stdout:1/52: mknod d5/d10/c13 0 2024-08-18T22:41:29.122 INFO:tasks.workunit.client.0.smithi121.stdout:7/42: dwrite fd [0,4194304] 0 2024-08-18T22:41:29.124 INFO:tasks.workunit.client.0.smithi121.stdout:4/54: dwrite f0 [0,4194304] 0 2024-08-18T22:41:29.130 INFO:tasks.workunit.client.0.smithi121.stdout:8/80: write f5 [5330557,90530] 0 2024-08-18T22:41:29.133 INFO:tasks.workunit.client.0.smithi121.stdout:9/136: dread d0/d5/fe [0,4194304] 0 2024-08-18T22:41:29.135 INFO:tasks.workunit.client.0.smithi121.stdout:3/105: dwrite f12 [0,4194304] 0 2024-08-18T22:41:29.135 INFO:tasks.workunit.client.0.smithi121.stdout:4/55: write d2/fb [966290,35081] 0 2024-08-18T22:41:29.136 INFO:tasks.workunit.client.0.smithi121.stdout:7/43: rename f2 to de/f11 0 2024-08-18T22:41:29.138 INFO:tasks.workunit.client.0.smithi121.stdout:7/44: read - f7 zero size 2024-08-18T22:41:29.139 INFO:tasks.workunit.client.0.smithi121.stdout:4/56: read d2/f7 [3790365,123848] 0 2024-08-18T22:41:29.140 INFO:tasks.workunit.client.0.smithi121.stdout:5/47: dwrite d3/d5/f8 [4194304,4194304] 0 2024-08-18T22:41:29.142 INFO:tasks.workunit.client.0.smithi121.stdout:1/53: dread d5/fa [0,4194304] 0 2024-08-18T22:41:29.143 INFO:tasks.workunit.client.0.smithi121.stdout:9/137: write d0/d5/fa [4124895,21477] 0 2024-08-18T22:41:29.143 INFO:tasks.workunit.client.0.smithi121.stdout:5/48: read - d3/fc zero size 2024-08-18T22:41:29.143 INFO:tasks.workunit.client.0.smithi121.stdout:3/106: rmdir d1e/d1f 39 2024-08-18T22:41:29.144 INFO:tasks.workunit.client.0.smithi121.stdout:7/45: truncate f8 1601656 0 2024-08-18T22:41:29.145 INFO:tasks.workunit.client.0.smithi121.stdout:8/81: creat d6/dd/f16 x:0 0 0 2024-08-18T22:41:29.145 INFO:tasks.workunit.client.0.smithi121.stdout:3/107: readlink l9 0 2024-08-18T22:41:29.145 INFO:tasks.workunit.client.0.smithi121.stdout:3/108: readlink l1b 0 2024-08-18T22:41:29.147 INFO:tasks.workunit.client.0.smithi121.stdout:3/109: write f5 [1572586,3313] 0 2024-08-18T22:41:29.147 INFO:tasks.workunit.client.0.smithi121.stdout:7/46: symlink de/l12 0 2024-08-18T22:41:29.148 INFO:tasks.workunit.client.0.smithi121.stdout:7/47: chown ca 1898 1 2024-08-18T22:41:29.148 INFO:tasks.workunit.client.0.smithi121.stdout:9/138: mknod d0/d5/dd/c2c 0 2024-08-18T22:41:29.149 INFO:tasks.workunit.client.0.smithi121.stdout:4/57: symlink d2/dc/le 0 2024-08-18T22:41:29.150 INFO:tasks.workunit.client.0.smithi121.stdout:4/58: rename d2 to d2/df 22 2024-08-18T22:41:29.153 INFO:tasks.workunit.client.0.smithi121.stdout:9/139: dread d0/f2a [0,4194304] 0 2024-08-18T22:41:29.155 INFO:tasks.workunit.client.0.smithi121.stdout:9/140: fdatasync d0/d6/df/f20 0 2024-08-18T22:41:29.157 INFO:tasks.workunit.client.0.smithi121.stdout:9/141: write d0/d5/f25 [51585,123205] 0 2024-08-18T22:41:29.158 INFO:tasks.workunit.client.0.smithi121.stdout:3/110: mkdir d1e/d1f/d25 0 2024-08-18T22:41:29.164 INFO:tasks.workunit.client.0.smithi121.stdout:8/82: getdents d6 0 2024-08-18T22:41:29.164 INFO:tasks.workunit.client.0.smithi121.stdout:1/54: dwrite f3 [0,4194304] 0 2024-08-18T22:41:29.164 INFO:tasks.workunit.client.0.smithi121.stdout:7/48: getdents de 0 2024-08-18T22:41:29.166 INFO:tasks.workunit.client.0.smithi121.stdout:3/111: symlink d1e/l26 0 2024-08-18T22:41:29.166 INFO:tasks.workunit.client.0.smithi121.stdout:1/55: dread - d5/f7 zero size 2024-08-18T22:41:29.167 INFO:tasks.workunit.client.0.smithi121.stdout:5/49: fsync d3/d5/f8 0 2024-08-18T22:41:29.167 INFO:tasks.workunit.client.0.smithi121.stdout:9/142: dread d0/d5/f9 [0,4194304] 0 2024-08-18T22:41:29.167 INFO:tasks.workunit.client.0.smithi121.stdout:8/83: mkdir d6/d17 0 2024-08-18T22:41:29.168 INFO:tasks.workunit.client.0.smithi121.stdout:9/143: stat d0/d6/df 0 2024-08-18T22:41:29.169 INFO:tasks.workunit.client.0.smithi121.stdout:7/49: getdents de 0 2024-08-18T22:41:29.170 INFO:tasks.workunit.client.0.smithi121.stdout:5/50: creat d3/fd x:0 0 0 2024-08-18T22:41:29.174 INFO:tasks.workunit.client.0.smithi121.stdout:9/144: creat d0/d6/d18/f2d x:0 0 0 2024-08-18T22:41:29.174 INFO:tasks.workunit.client.0.smithi121.stdout:7/50: chown f5 190013 1 2024-08-18T22:41:29.177 INFO:tasks.workunit.client.0.smithi121.stdout:3/112: truncate ff 1775889 0 2024-08-18T22:41:29.178 INFO:tasks.workunit.client.0.smithi121.stdout:7/51: rmdir de 39 2024-08-18T22:41:29.179 INFO:tasks.workunit.client.0.smithi121.stdout:4/59: dwrite d2/f4 [0,4194304] 0 2024-08-18T22:41:29.180 INFO:tasks.workunit.client.0.smithi121.stdout:9/145: fdatasync d0/d6/df/f20 0 2024-08-18T22:41:29.180 INFO:tasks.workunit.client.0.smithi121.stdout:8/84: read d6/f9 [4570065,9385] 0 2024-08-18T22:41:29.186 INFO:tasks.workunit.client.0.smithi121.stdout:7/52: truncate f5 225283 0 2024-08-18T22:41:29.187 INFO:tasks.workunit.client.0.smithi121.stdout:7/53: dread - f9 zero size 2024-08-18T22:41:29.187 INFO:tasks.workunit.client.0.smithi121.stdout:4/60: symlink d2/l10 0 2024-08-18T22:41:29.188 INFO:tasks.workunit.client.0.smithi121.stdout:4/61: chown d2 19102 1 2024-08-18T22:41:29.191 INFO:tasks.workunit.client.0.smithi121.stdout:1/56: dwrite d5/f7 [0,4194304] 0 2024-08-18T22:41:29.192 INFO:tasks.workunit.client.0.smithi121.stdout:3/113: creat d1e/d1f/d25/f27 x:0 0 0 2024-08-18T22:41:29.193 INFO:tasks.workunit.client.0.smithi121.stdout:8/85: write d6/f9 [4447208,9207] 0 2024-08-18T22:41:29.194 INFO:tasks.workunit.client.0.smithi121.stdout:4/62: unlink d2/f5 0 2024-08-18T22:41:29.195 INFO:tasks.workunit.client.0.smithi121.stdout:5/51: dwrite d3/fa [0,4194304] 0 2024-08-18T22:41:29.196 INFO:tasks.workunit.client.0.smithi121.stdout:7/54: mkdir de/d13 0 2024-08-18T22:41:29.197 INFO:tasks.workunit.client.0.smithi121.stdout:1/57: mkdir d5/d10/d14 0 2024-08-18T22:41:29.199 INFO:tasks.workunit.client.0.smithi121.stdout:4/63: chown d2/dc/fd 1 1 2024-08-18T22:41:29.199 INFO:tasks.workunit.client.0.smithi121.stdout:8/86: chown d6/dd/cf 77 1 2024-08-18T22:41:29.200 INFO:tasks.workunit.client.0.smithi121.stdout:7/55: unlink f7 0 2024-08-18T22:41:29.203 INFO:tasks.workunit.client.0.smithi121.stdout:7/56: chown de/ff 1451333 1 2024-08-18T22:41:29.204 INFO:tasks.workunit.client.0.smithi121.stdout:5/52: readlink d3/d5/l9 0 2024-08-18T22:41:29.207 INFO:tasks.workunit.client.0.smithi121.stdout:3/114: rename f17 to d1e/f28 0 2024-08-18T22:41:29.207 INFO:tasks.workunit.client.0.smithi121.stdout:9/146: dwrite d0/d5/fa [0,4194304] 0 2024-08-18T22:41:29.208 INFO:tasks.workunit.client.0.smithi121.stdout:5/53: chown d3/d5/f7 22538 1 2024-08-18T22:41:29.210 INFO:tasks.workunit.client.0.smithi121.stdout:7/57: creat de/f14 x:0 0 0 2024-08-18T22:41:29.212 INFO:tasks.workunit.client.0.smithi121.stdout:3/115: unlink l13 0 2024-08-18T22:41:29.213 INFO:tasks.workunit.client.0.smithi121.stdout:7/58: write f9 [975798,118545] 0 2024-08-18T22:41:29.216 INFO:tasks.workunit.client.0.smithi121.stdout:1/58: dwrite f3 [4194304,4194304] 0 2024-08-18T22:41:29.217 INFO:tasks.workunit.client.0.smithi121.stdout:9/147: rmdir d0 39 2024-08-18T22:41:29.218 INFO:tasks.workunit.client.0.smithi121.stdout:4/64: dread d2/f4 [0,4194304] 0 2024-08-18T22:41:29.218 INFO:tasks.workunit.client.0.smithi121.stdout:8/87: mkdir d6/d17/d18 0 2024-08-18T22:41:29.219 INFO:tasks.workunit.client.0.smithi121.stdout:7/59: unlink ca 0 2024-08-18T22:41:29.222 INFO:tasks.workunit.client.0.smithi121.stdout:8/88: readlink d6/lc 0 2024-08-18T22:41:29.222 INFO:tasks.workunit.client.0.smithi121.stdout:1/59: mkdir d5/df/d15 0 2024-08-18T22:41:29.222 INFO:tasks.workunit.client.0.smithi121.stdout:7/60: readlink de/l12 0 2024-08-18T22:41:29.223 INFO:tasks.workunit.client.0.smithi121.stdout:5/54: dwrite d3/fa [4194304,4194304] 0 2024-08-18T22:41:29.225 INFO:tasks.workunit.client.0.smithi121.stdout:7/61: fdatasync fd 0 2024-08-18T22:41:29.226 INFO:tasks.workunit.client.0.smithi121.stdout:4/65: getdents d2/dc 0 2024-08-18T22:41:29.231 INFO:tasks.workunit.client.0.smithi121.stdout:8/89: truncate d6/f14 389393 0 2024-08-18T22:41:29.231 INFO:tasks.workunit.client.0.smithi121.stdout:1/60: write d5/fa [1503769,20455] 0 2024-08-18T22:41:29.232 INFO:tasks.workunit.client.0.smithi121.stdout:9/148: mknod d0/d5/dd/d1a/c2e 0 2024-08-18T22:41:29.233 INFO:tasks.workunit.client.0.smithi121.stdout:7/62: creat de/f15 x:0 0 0 2024-08-18T22:41:29.236 INFO:tasks.workunit.client.0.smithi121.stdout:7/63: read fc [1776622,23052] 0 2024-08-18T22:41:29.237 INFO:tasks.workunit.client.0.smithi121.stdout:4/66: dread d2/dc/fd [0,4194304] 0 2024-08-18T22:41:29.237 INFO:tasks.workunit.client.0.smithi121.stdout:3/116: dwrite d1e/d1f/f23 [0,4194304] 0 2024-08-18T22:41:29.238 INFO:tasks.workunit.client.0.smithi121.stdout:1/61: truncate d5/fb 85333 0 2024-08-18T22:41:29.241 INFO:tasks.workunit.client.0.smithi121.stdout:9/149: write d0/d6/df/f20 [1084430,58270] 0 2024-08-18T22:41:29.241 INFO:tasks.workunit.client.0.smithi121.stdout:3/117: dread - fd zero size 2024-08-18T22:41:29.241 INFO:tasks.workunit.client.0.smithi121.stdout:1/62: chown d5/d10/d14 6084 1 2024-08-18T22:41:29.243 INFO:tasks.workunit.client.0.smithi121.stdout:5/55: link c2 d3/d5/ce 0 2024-08-18T22:41:29.244 INFO:tasks.workunit.client.0.smithi121.stdout:4/67: mknod d2/dc/c11 0 2024-08-18T22:41:29.248 INFO:tasks.workunit.client.0.smithi121.stdout:8/90: dwrite d6/f9 [0,4194304] 0 2024-08-18T22:41:29.249 INFO:tasks.workunit.client.0.smithi121.stdout:3/118: dread ff [0,4194304] 0 2024-08-18T22:41:29.249 INFO:tasks.workunit.client.0.smithi121.stdout:9/150: mkdir d0/d5/dd/d2f 0 2024-08-18T22:41:29.250 INFO:tasks.workunit.client.0.smithi121.stdout:1/63: mknod d5/df/c16 0 2024-08-18T22:41:29.252 INFO:tasks.workunit.client.0.smithi121.stdout:1/64: write d5/fb [876097,23028] 0 2024-08-18T22:41:29.253 INFO:tasks.workunit.client.0.smithi121.stdout:5/56: mknod d3/d5/cf 0 2024-08-18T22:41:29.253 INFO:tasks.workunit.client.0.smithi121.stdout:0/43: sync 2024-08-18T22:41:29.253 INFO:tasks.workunit.client.0.smithi121.stdout:2/33: sync 2024-08-18T22:41:29.255 INFO:tasks.workunit.client.0.smithi121.stdout:4/68: creat d2/dc/f12 x:0 0 0 2024-08-18T22:41:29.261 INFO:tasks.workunit.client.0.smithi121.stdout:1/65: mknod d5/df/c17 0 2024-08-18T22:41:29.261 INFO:tasks.workunit.client.0.smithi121.stdout:3/119: write d1e/d1f/f23 [971959,33801] 0 2024-08-18T22:41:29.262 INFO:tasks.workunit.client.0.smithi121.stdout:9/151: dwrite d0/d6/d18/f2d [0,4194304] 0 2024-08-18T22:41:29.262 INFO:tasks.workunit.client.0.smithi121.stdout:2/34: mknod d2/c9 0 2024-08-18T22:41:29.263 INFO:tasks.workunit.client.0.smithi121.stdout:7/64: truncate fc 3805579 0 2024-08-18T22:41:29.264 INFO:tasks.workunit.client.0.smithi121.stdout:5/57: dread f1 [0,4194304] 0 2024-08-18T22:41:29.268 INFO:tasks.workunit.client.0.smithi121.stdout:7/65: write f9 [1177956,76894] 0 2024-08-18T22:41:29.269 INFO:tasks.workunit.client.0.smithi121.stdout:2/35: truncate d2/f6 503048 0 2024-08-18T22:41:29.270 INFO:tasks.workunit.client.0.smithi121.stdout:5/58: truncate d3/d5/f7 1991066 0 2024-08-18T22:41:29.271 INFO:tasks.workunit.client.0.smithi121.stdout:4/69: creat d2/dc/f13 x:0 0 0 2024-08-18T22:41:29.271 INFO:tasks.workunit.client.0.smithi121.stdout:5/59: fsync d3/fc 0 2024-08-18T22:41:29.271 INFO:tasks.workunit.client.0.smithi121.stdout:1/66: creat d5/d10/f18 x:0 0 0 2024-08-18T22:41:29.273 INFO:tasks.workunit.client.0.smithi121.stdout:3/120: symlink d1e/d1f/l29 0 2024-08-18T22:41:29.274 INFO:tasks.workunit.client.0.smithi121.stdout:9/152: creat d0/d5/f30 x:0 0 0 2024-08-18T22:41:29.276 INFO:tasks.workunit.client.0.smithi121.stdout:0/44: mkdir d1/d4/de 0 2024-08-18T22:41:29.277 INFO:tasks.workunit.client.0.smithi121.stdout:7/66: creat de/f16 x:0 0 0 2024-08-18T22:41:29.279 INFO:tasks.workunit.client.0.smithi121.stdout:8/91: getdents d6 0 2024-08-18T22:41:29.279 INFO:tasks.workunit.client.0.smithi121.stdout:7/67: chown de/ff 1384 1 2024-08-18T22:41:29.280 INFO:tasks.workunit.client.0.smithi121.stdout:1/67: dwrite d5/fa [0,4194304] 0 2024-08-18T22:41:29.280 INFO:tasks.workunit.client.0.smithi121.stdout:2/36: symlink d2/la 0 2024-08-18T22:41:29.281 INFO:tasks.workunit.client.0.smithi121.stdout:1/68: dread - d5/d10/f18 zero size 2024-08-18T22:41:29.281 INFO:tasks.workunit.client.0.smithi121.stdout:4/70: creat d2/f14 x:0 0 0 2024-08-18T22:41:29.324 INFO:tasks.workunit.client.0.smithi121.stdout:5/60: mknod d3/c10 0 2024-08-18T22:41:29.325 INFO:tasks.workunit.client.0.smithi121.stdout:0/45: rename d1/d4/d5 to d1/d4/de/df 0 2024-08-18T22:41:29.327 INFO:tasks.workunit.client.0.smithi121.stdout:7/68: unlink f9 0 2024-08-18T22:41:29.329 INFO:tasks.workunit.client.0.smithi121.stdout:5/61: creat d3/d5/f11 x:0 0 0 2024-08-18T22:41:29.383 INFO:tasks.workunit.client.0.smithi121.stdout:4/71: rename d2/dc/le to d2/l15 0 2024-08-18T22:41:29.384 INFO:tasks.workunit.client.0.smithi121.stdout:2/37: mkdir d2/d8/db 0 2024-08-18T22:41:29.389 INFO:tasks.workunit.client.0.smithi121.stdout:1/69: dread f3 [0,4194304] 0 2024-08-18T22:41:29.389 INFO:tasks.workunit.client.0.smithi121.stdout:2/38: write d2/d3/f4 [5181776,19546] 0 2024-08-18T22:41:29.390 INFO:tasks.workunit.client.0.smithi121.stdout:5/62: creat d3/f12 x:0 0 0 2024-08-18T22:41:29.391 INFO:tasks.workunit.client.0.smithi121.stdout:7/69: creat de/d13/f17 x:0 0 0 2024-08-18T22:41:29.392 INFO:tasks.workunit.client.0.smithi121.stdout:8/92: getdents d6/dd 0 2024-08-18T22:41:29.393 INFO:tasks.workunit.client.0.smithi121.stdout:3/121: dwrite f11 [0,4194304] 0 2024-08-18T22:41:29.396 INFO:tasks.workunit.client.0.smithi121.stdout:7/70: truncate de/ff 89199 0 2024-08-18T22:41:29.396 INFO:tasks.workunit.client.0.smithi121.stdout:1/70: truncate d5/fe 831914 0 2024-08-18T22:41:29.396 INFO:tasks.workunit.client.0.smithi121.stdout:0/46: dwrite d1/d4/de/df/f7 [0,4194304] 0 2024-08-18T22:41:29.398 INFO:tasks.workunit.client.0.smithi121.stdout:3/122: mkdir d1e/d1f/d2a 0 2024-08-18T22:41:29.398 INFO:tasks.workunit.client.0.smithi121.stdout:8/93: readlink d6/dd/le 0 2024-08-18T22:41:29.399 INFO:tasks.workunit.client.0.smithi121.stdout:2/39: mkdir d2/d8/db/dc 0 2024-08-18T22:41:29.399 INFO:tasks.workunit.client.0.smithi121.stdout:5/63: chown d3/d5/ce 20475 1 2024-08-18T22:41:29.401 INFO:tasks.workunit.client.0.smithi121.stdout:1/71: symlink d5/df/l19 0 2024-08-18T22:41:29.403 INFO:tasks.workunit.client.0.smithi121.stdout:5/64: write d3/d5/f11 [1035816,68000] 0 2024-08-18T22:41:29.403 INFO:tasks.workunit.client.0.smithi121.stdout:8/94: creat d6/f19 x:0 0 0 2024-08-18T22:41:29.406 INFO:tasks.workunit.client.0.smithi121.stdout:0/47: creat d1/d4/de/f10 x:0 0 0 2024-08-18T22:41:29.406 INFO:tasks.workunit.client.0.smithi121.stdout:1/72: fdatasync f3 0 2024-08-18T22:41:29.406 INFO:tasks.workunit.client.0.smithi121.stdout:3/123: creat d1e/d1f/d25/f2b x:0 0 0 2024-08-18T22:41:29.408 INFO:tasks.workunit.client.0.smithi121.stdout:8/95: mknod d6/d17/c1a 0 2024-08-18T22:41:29.409 INFO:tasks.workunit.client.0.smithi121.stdout:4/72: dwrite d2/dc/fd [0,4194304] 0 2024-08-18T22:41:29.409 INFO:tasks.workunit.client.0.smithi121.stdout:8/96: fsync f5 0 2024-08-18T22:41:29.410 INFO:tasks.workunit.client.0.smithi121.stdout:1/73: mknod d5/c1a 0 2024-08-18T22:41:29.410 INFO:tasks.workunit.client.0.smithi121.stdout:3/124: chown d1e/d1f/f23 7700 1 2024-08-18T22:41:29.413 INFO:tasks.workunit.client.0.smithi121.stdout:4/73: write d2/f14 [276339,89029] 0 2024-08-18T22:41:29.415 INFO:tasks.workunit.client.0.smithi121.stdout:8/97: creat d6/dd/f1b x:0 0 0 2024-08-18T22:41:29.417 INFO:tasks.workunit.client.0.smithi121.stdout:1/74: read d5/fb [821913,76515] 0 2024-08-18T22:41:29.417 INFO:tasks.workunit.client.0.smithi121.stdout:7/71: dwrite de/f16 [0,4194304] 0 2024-08-18T22:41:29.418 INFO:tasks.workunit.client.0.smithi121.stdout:3/125: dread f16 [0,4194304] 0 2024-08-18T22:41:29.419 INFO:tasks.workunit.client.0.smithi121.stdout:4/74: mkdir d2/dc/d16 0 2024-08-18T22:41:29.420 INFO:tasks.workunit.client.0.smithi121.stdout:7/72: write de/d13/f17 [667800,19969] 0 2024-08-18T22:41:29.422 INFO:tasks.workunit.client.0.smithi121.stdout:3/126: mknod d1e/d1f/d2a/c2c 0 2024-08-18T22:41:29.424 INFO:tasks.workunit.client.0.smithi121.stdout:7/73: mkdir de/d13/d18 0 2024-08-18T22:41:29.424 INFO:tasks.workunit.client.0.smithi121.stdout:4/75: mknod d2/dc/d16/c17 0 2024-08-18T22:41:29.425 INFO:tasks.workunit.client.0.smithi121.stdout:7/74: chown de/l10 9324 1 2024-08-18T22:41:29.425 INFO:tasks.workunit.client.0.smithi121.stdout:3/127: chown d1e/c22 2675 1 2024-08-18T22:41:29.427 INFO:tasks.workunit.client.0.smithi121.stdout:4/76: symlink d2/dc/l18 0 2024-08-18T22:41:29.428 INFO:tasks.workunit.client.0.smithi121.stdout:3/128: chown d1e/d1f/c24 103849667 1 2024-08-18T22:41:29.430 INFO:tasks.workunit.client.0.smithi121.stdout:1/75: dwrite d5/fa [4194304,4194304] 0 2024-08-18T22:41:29.439 INFO:tasks.workunit.client.0.smithi121.stdout:7/75: dwrite de/ff [0,4194304] 0 2024-08-18T22:41:29.442 INFO:tasks.workunit.client.0.smithi121.stdout:1/76: dwrite d5/fd [0,4194304] 0 2024-08-18T22:41:29.445 INFO:tasks.workunit.client.0.smithi121.stdout:1/77: mknod d5/df/d15/c1b 0 2024-08-18T22:41:29.447 INFO:tasks.workunit.client.0.smithi121.stdout:1/78: chown d5/df/d11/l12 891060 1 2024-08-18T22:41:29.448 INFO:tasks.workunit.client.0.smithi121.stdout:7/76: dwrite de/f11 [0,4194304] 0 2024-08-18T22:41:29.452 INFO:tasks.workunit.client.0.smithi121.stdout:7/77: creat de/d13/d18/f19 x:0 0 0 2024-08-18T22:41:29.452 INFO:tasks.workunit.client.0.smithi121.stdout:1/79: link d5/df/c16 d5/df/d11/c1c 0 2024-08-18T22:41:29.454 INFO:tasks.workunit.client.0.smithi121.stdout:7/78: mkdir de/d1a 0 2024-08-18T22:41:29.456 INFO:tasks.workunit.client.0.smithi121.stdout:7/79: write de/ff [2997587,112171] 0 2024-08-18T22:41:29.458 INFO:tasks.workunit.client.0.smithi121.stdout:1/80: dread d5/fb [0,4194304] 0 2024-08-18T22:41:29.461 INFO:tasks.workunit.client.0.smithi121.stdout:1/81: dread d5/fd [0,4194304] 0 2024-08-18T22:41:29.463 INFO:tasks.workunit.client.0.smithi121.stdout:1/82: truncate f4 2611750 0 2024-08-18T22:41:29.464 INFO:tasks.workunit.client.0.smithi121.stdout:1/83: creat d5/f1d x:0 0 0 2024-08-18T22:41:29.465 INFO:tasks.workunit.client.0.smithi121.stdout:1/84: write d5/fe [694789,2597] 0 2024-08-18T22:41:29.466 INFO:tasks.workunit.client.0.smithi121.stdout:1/85: rmdir d5/df 39 2024-08-18T22:41:29.467 INFO:tasks.workunit.client.0.smithi121.stdout:1/86: fsync d5/fe 0 2024-08-18T22:41:29.469 INFO:tasks.workunit.client.0.smithi121.stdout:1/87: mknod d5/df/d11/c1e 0 2024-08-18T22:41:29.470 INFO:tasks.workunit.client.0.smithi121.stdout:1/88: creat d5/f1f x:0 0 0 2024-08-18T22:41:29.471 INFO:tasks.workunit.client.0.smithi121.stdout:1/89: fsync d5/fb 0 2024-08-18T22:41:29.472 INFO:tasks.workunit.client.0.smithi121.stdout:1/90: write d5/fe [1353198,107136] 0 2024-08-18T22:41:29.472 INFO:tasks.workunit.client.0.smithi121.stdout:1/91: fdatasync d5/f1d 0 2024-08-18T22:41:29.479 INFO:tasks.workunit.client.0.smithi121.stdout:1/92: dwrite d5/f1f [0,4194304] 0 2024-08-18T22:41:29.481 INFO:tasks.workunit.client.0.smithi121.stdout:1/93: creat d5/d10/f20 x:0 0 0 2024-08-18T22:41:29.482 INFO:tasks.workunit.client.0.smithi121.stdout:1/94: truncate d5/d10/f18 773752 0 2024-08-18T22:41:29.483 INFO:tasks.workunit.client.0.smithi121.stdout:1/95: rmdir d5/df/d15 39 2024-08-18T22:41:29.484 INFO:tasks.workunit.client.0.smithi121.stdout:1/96: symlink d5/df/l21 0 2024-08-18T22:41:29.486 INFO:tasks.workunit.client.0.smithi121.stdout:1/97: creat d5/d10/d14/f22 x:0 0 0 2024-08-18T22:41:29.488 INFO:tasks.workunit.client.0.smithi121.stdout:1/98: mknod d5/d10/d14/c23 0 2024-08-18T22:41:29.489 INFO:tasks.workunit.client.0.smithi121.stdout:1/99: rmdir d5/df/d11 39 2024-08-18T22:41:29.492 INFO:tasks.workunit.client.0.smithi121.stdout:1/100: write d5/fa [1787178,11954] 0 2024-08-18T22:41:29.499 INFO:tasks.workunit.client.0.smithi121.stdout:1/101: write d5/f1f [814225,24396] 0 2024-08-18T22:41:29.500 INFO:tasks.workunit.client.0.smithi121.stdout:1/102: readlink d5/l8 0 2024-08-18T22:41:29.503 INFO:tasks.workunit.client.0.smithi121.stdout:1/103: write d5/d10/d14/f22 [788264,47580] 0 2024-08-18T22:41:29.503 INFO:tasks.workunit.client.0.smithi121.stdout:0/48: rename d1/d4/de to d1/d11 0 2024-08-18T22:41:29.508 INFO:tasks.workunit.client.0.smithi121.stdout:8/98: rename d6/dd/le to d6/d17/d18/l1c 0 2024-08-18T22:41:29.512 INFO:tasks.workunit.client.0.smithi121.stdout:1/104: dwrite d5/f1f [0,4194304] 0 2024-08-18T22:41:29.515 INFO:tasks.workunit.client.0.smithi121.stdout:0/49: dwrite d1/fd [0,4194304] 0 2024-08-18T22:41:29.517 INFO:tasks.workunit.client.0.smithi121.stdout:0/50: write d1/fd [50475,45656] 0 2024-08-18T22:41:29.524 INFO:tasks.workunit.client.0.smithi121.stdout:1/105: dwrite d5/fa [0,4194304] 0 2024-08-18T22:41:29.526 INFO:tasks.workunit.client.0.smithi121.stdout:0/51: dread d1/fd [0,4194304] 0 2024-08-18T22:41:29.527 INFO:tasks.workunit.client.0.smithi121.stdout:4/77: getdents d2/dc 0 2024-08-18T22:41:29.528 INFO:tasks.workunit.client.0.smithi121.stdout:0/52: stat d1/d11/df/l6 0 2024-08-18T22:41:29.528 INFO:tasks.workunit.client.0.smithi121.stdout:0/53: read - d1/d11/f10 zero size 2024-08-18T22:41:29.528 INFO:tasks.workunit.client.0.smithi121.stdout:3/129: truncate d1e/f28 209877 0 2024-08-18T22:41:29.530 INFO:tasks.workunit.client.0.smithi121.stdout:4/78: write f0 [4393585,104246] 0 2024-08-18T22:41:29.531 INFO:tasks.workunit.client.0.smithi121.stdout:0/54: write d1/fd [1120924,117080] 0 2024-08-18T22:41:29.531 INFO:tasks.workunit.client.0.smithi121.stdout:4/79: write f0 [5085172,124206] 0 2024-08-18T22:41:29.531 INFO:tasks.workunit.client.0.smithi121.stdout:3/130: mknod d1e/d1f/d2a/c2d 0 2024-08-18T22:41:29.537 INFO:tasks.workunit.client.0.smithi121.stdout:4/80: rmdir d2/dc/d16 39 2024-08-18T22:41:29.540 INFO:tasks.workunit.client.0.smithi121.stdout:0/55: symlink d1/l12 0 2024-08-18T22:41:29.542 INFO:tasks.workunit.client.0.smithi121.stdout:3/131: dwrite f11 [0,4194304] 0 2024-08-18T22:41:29.546 INFO:tasks.workunit.client.0.smithi121.stdout:1/106: rmdir d5 39 2024-08-18T22:41:29.548 INFO:tasks.workunit.client.0.smithi121.stdout:3/132: unlink d1e/d1f/d2a/c2d 0 2024-08-18T22:41:29.548 INFO:tasks.workunit.client.0.smithi121.stdout:4/81: dread d2/f7 [0,4194304] 0 2024-08-18T22:41:29.549 INFO:tasks.workunit.client.0.smithi121.stdout:7/80: dwrite fc [0,4194304] 0 2024-08-18T22:41:29.550 INFO:tasks.workunit.client.0.smithi121.stdout:4/82: write d2/f14 [1278911,43142] 0 2024-08-18T22:41:29.555 INFO:tasks.workunit.client.0.smithi121.stdout:1/107: dread d5/f7 [0,4194304] 0 2024-08-18T22:41:29.557 INFO:tasks.workunit.client.0.smithi121.stdout:1/108: write f3 [8715401,88173] 0 2024-08-18T22:41:29.557 INFO:tasks.workunit.client.0.smithi121.stdout:3/133: mkdir d1e/d1f/d25/d2e 0 2024-08-18T22:41:29.558 INFO:tasks.workunit.client.0.smithi121.stdout:1/109: dread - d5/f1d zero size 2024-08-18T22:41:29.558 INFO:tasks.workunit.client.0.smithi121.stdout:0/56: getdents d1/d11/df 0 2024-08-18T22:41:29.560 INFO:tasks.workunit.client.0.smithi121.stdout:4/83: fsync d2/f7 0 2024-08-18T22:41:29.562 INFO:tasks.workunit.client.0.smithi121.stdout:4/84: write d2/dc/f12 [112269,35107] 0 2024-08-18T22:41:29.562 INFO:tasks.workunit.client.0.smithi121.stdout:7/81: mknod de/d1a/c1b 0 2024-08-18T22:41:29.562 INFO:tasks.workunit.client.0.smithi121.stdout:7/82: chown de/f14 49867 1 2024-08-18T22:41:29.563 INFO:tasks.workunit.client.0.smithi121.stdout:3/134: symlink d1e/d1f/d2a/l2f 0 2024-08-18T22:41:29.563 INFO:tasks.workunit.client.0.smithi121.stdout:4/85: truncate d2/dc/f12 427580 0 2024-08-18T22:41:29.564 INFO:tasks.workunit.client.0.smithi121.stdout:1/110: symlink d5/d10/l24 0 2024-08-18T22:41:29.565 INFO:tasks.workunit.client.0.smithi121.stdout:9/153: sync 2024-08-18T22:41:29.566 INFO:tasks.workunit.client.0.smithi121.stdout:0/57: rename d1/d4/da/lc to d1/d4/db/l13 0 2024-08-18T22:41:29.570 INFO:tasks.workunit.client.0.smithi121.stdout:0/58: stat d1/fd 0 2024-08-18T22:41:29.572 INFO:tasks.workunit.client.0.smithi121.stdout:7/83: dread de/ff [0,4194304] 0 2024-08-18T22:41:29.573 INFO:tasks.workunit.client.0.smithi121.stdout:1/111: mknod d5/df/d15/c25 0 2024-08-18T22:41:29.577 INFO:tasks.workunit.client.0.smithi121.stdout:4/86: dwrite d2/f14 [0,4194304] 0 2024-08-18T22:41:29.578 INFO:tasks.workunit.client.0.smithi121.stdout:7/84: creat de/f1c x:0 0 0 2024-08-18T22:41:29.579 INFO:tasks.workunit.client.0.smithi121.stdout:0/59: dread d1/fd [0,4194304] 0 2024-08-18T22:41:29.584 INFO:tasks.workunit.client.0.smithi121.stdout:7/85: creat de/f1d x:0 0 0 2024-08-18T22:41:29.586 INFO:tasks.workunit.client.0.smithi121.stdout:0/60: symlink d1/d11/l14 0 2024-08-18T22:41:29.587 INFO:tasks.workunit.client.0.smithi121.stdout:4/87: getdents d2 0 2024-08-18T22:41:29.587 INFO:tasks.workunit.client.0.smithi121.stdout:3/135: dwrite f16 [0,4194304] 0 2024-08-18T22:41:29.593 INFO:tasks.workunit.client.0.smithi121.stdout:3/136: mkdir d1e/d1f/d25/d2e/d30 0 2024-08-18T22:41:29.595 INFO:tasks.workunit.client.0.smithi121.stdout:9/154: dwrite d0/d6/fc [4194304,4194304] 0 2024-08-18T22:41:29.598 INFO:tasks.workunit.client.0.smithi121.stdout:3/137: fsync d1e/d1f/d25/f27 0 2024-08-18T22:41:29.603 INFO:tasks.workunit.client.0.smithi121.stdout:0/61: dread d1/fd [0,4194304] 0 2024-08-18T22:41:29.607 INFO:tasks.workunit.client.0.smithi121.stdout:4/88: truncate d2/f14 306951 0 2024-08-18T22:41:29.607 INFO:tasks.workunit.client.0.smithi121.stdout:9/155: unlink d0/l24 0 2024-08-18T22:41:29.607 INFO:tasks.workunit.client.0.smithi121.stdout:7/86: dwrite de/d13/d18/f19 [0,4194304] 0 2024-08-18T22:41:29.609 INFO:tasks.workunit.client.0.smithi121.stdout:1/112: dwrite f4 [0,4194304] 0 2024-08-18T22:41:29.609 INFO:tasks.workunit.client.0.smithi121.stdout:9/156: write d0/d5/f30 [76818,115054] 0 2024-08-18T22:41:29.610 INFO:tasks.workunit.client.0.smithi121.stdout:3/138: creat d1e/f31 x:0 0 0 2024-08-18T22:41:29.610 INFO:tasks.workunit.client.0.smithi121.stdout:7/87: chown de/f1c 5580 1 2024-08-18T22:41:29.614 INFO:tasks.workunit.client.0.smithi121.stdout:9/157: write d0/d6/fc [8386841,49210] 0 2024-08-18T22:41:29.615 INFO:tasks.workunit.client.0.smithi121.stdout:0/62: truncate d1/d11/df/f7 4633791 0 2024-08-18T22:41:29.616 INFO:tasks.workunit.client.0.smithi121.stdout:7/88: creat de/d1a/f1e x:0 0 0 2024-08-18T22:41:29.617 INFO:tasks.workunit.client.0.smithi121.stdout:3/139: symlink d1e/d1f/d2a/l32 0 2024-08-18T22:41:29.619 INFO:tasks.workunit.client.0.smithi121.stdout:1/113: creat d5/df/d11/f26 x:0 0 0 2024-08-18T22:41:29.621 INFO:tasks.workunit.client.0.smithi121.stdout:0/63: write d1/fd [3472447,95928] 0 2024-08-18T22:41:29.622 INFO:tasks.workunit.client.0.smithi121.stdout:4/89: dwrite d2/dc/f13 [0,4194304] 0 2024-08-18T22:41:29.624 INFO:tasks.workunit.client.0.smithi121.stdout:1/114: symlink d5/l27 0 2024-08-18T22:41:29.625 INFO:tasks.workunit.client.0.smithi121.stdout:4/90: chown d2/dc/fd 2 1 2024-08-18T22:41:29.625 INFO:tasks.workunit.client.0.smithi121.stdout:0/64: symlink d1/l15 0 2024-08-18T22:41:29.625 INFO:tasks.workunit.client.0.smithi121.stdout:1/115: rmdir d5 39 2024-08-18T22:41:29.631 INFO:tasks.workunit.client.0.smithi121.stdout:4/91: write d2/dc/fd [2241311,12233] 0 2024-08-18T22:41:29.631 INFO:tasks.workunit.client.0.smithi121.stdout:0/65: write d1/d11/df/f7 [777183,6734] 0 2024-08-18T22:41:29.632 INFO:tasks.workunit.client.0.smithi121.stdout:1/116: chown d5/c9 1 1 2024-08-18T22:41:29.633 INFO:tasks.workunit.client.0.smithi121.stdout:9/158: write d0/d5/f9 [3165664,65643] 0 2024-08-18T22:41:29.635 INFO:tasks.workunit.client.0.smithi121.stdout:7/89: dwrite de/d13/f17 [0,4194304] 0 2024-08-18T22:41:29.635 INFO:tasks.workunit.client.0.smithi121.stdout:4/92: creat d2/f19 x:0 0 0 2024-08-18T22:41:29.636 INFO:tasks.workunit.client.0.smithi121.stdout:1/117: rmdir d5/df/d11 39 2024-08-18T22:41:29.637 INFO:tasks.workunit.client.0.smithi121.stdout:7/90: creat de/f1f x:0 0 0 2024-08-18T22:41:29.639 INFO:tasks.workunit.client.0.smithi121.stdout:0/66: getdents d1/d11/df/d8 0 2024-08-18T22:41:29.641 INFO:tasks.workunit.client.0.smithi121.stdout:9/159: rename d0/d5/dd/l2b to d0/d5/dd/l31 0 2024-08-18T22:41:29.642 INFO:tasks.workunit.client.0.smithi121.stdout:1/118: chown d5/df/d11/f26 62391412 1 2024-08-18T22:41:29.643 INFO:tasks.workunit.client.0.smithi121.stdout:4/93: mkdir d2/dc/d16/d1a 0 2024-08-18T22:41:29.643 INFO:tasks.workunit.client.0.smithi121.stdout:4/94: stat d2/f9 0 2024-08-18T22:41:29.644 INFO:tasks.workunit.client.0.smithi121.stdout:7/91: mkdir de/d1a/d20 0 2024-08-18T22:41:29.645 INFO:tasks.workunit.client.0.smithi121.stdout:0/67: symlink d1/d4/da/l16 0 2024-08-18T22:41:29.646 INFO:tasks.workunit.client.0.smithi121.stdout:1/119: mkdir d5/df/d15/d28 0 2024-08-18T22:41:29.646 INFO:tasks.workunit.client.0.smithi121.stdout:4/95: fdatasync d2/f4 0 2024-08-18T22:41:29.647 INFO:tasks.workunit.client.0.smithi121.stdout:4/96: readlink d2/l10 0 2024-08-18T22:41:29.648 INFO:tasks.workunit.client.0.smithi121.stdout:0/68: creat d1/d11/df/d8/f17 x:0 0 0 2024-08-18T22:41:29.649 INFO:tasks.workunit.client.0.smithi121.stdout:1/120: mknod d5/d10/d14/c29 0 2024-08-18T22:41:29.651 INFO:tasks.workunit.client.0.smithi121.stdout:0/69: mkdir d1/d4/db/d18 0 2024-08-18T22:41:29.651 INFO:tasks.workunit.client.0.smithi121.stdout:1/121: write f3 [4017211,71893] 0 2024-08-18T22:41:29.651 INFO:tasks.workunit.client.0.smithi121.stdout:9/160: stat d0/d5/dd/l31 0 2024-08-18T22:41:29.651 INFO:tasks.workunit.client.0.smithi121.stdout:4/97: symlink d2/dc/l1b 0 2024-08-18T22:41:29.654 INFO:tasks.workunit.client.0.smithi121.stdout:1/122: mkdir d5/d10/d14/d2a 0 2024-08-18T22:41:29.656 INFO:tasks.workunit.client.0.smithi121.stdout:0/70: mkdir d1/d19 0 2024-08-18T22:41:29.657 INFO:tasks.workunit.client.0.smithi121.stdout:7/92: truncate fc 10929 0 2024-08-18T22:41:29.657 INFO:tasks.workunit.client.0.smithi121.stdout:9/161: mknod d0/d6/c32 0 2024-08-18T22:41:29.659 INFO:tasks.workunit.client.0.smithi121.stdout:9/162: fsync d0/f3 0 2024-08-18T22:41:29.660 INFO:tasks.workunit.client.0.smithi121.stdout:9/163: stat d0/d5/dd/c2c 0 2024-08-18T22:41:29.661 INFO:tasks.workunit.client.0.smithi121.stdout:1/123: link d5/d10/d14/f22 d5/df/d15/f2b 0 2024-08-18T22:41:29.661 INFO:tasks.workunit.client.0.smithi121.stdout:4/98: dwrite d2/f19 [0,4194304] 0 2024-08-18T22:41:29.662 INFO:tasks.workunit.client.0.smithi121.stdout:1/124: readlink d5/df/l21 0 2024-08-18T22:41:29.662 INFO:tasks.workunit.client.0.smithi121.stdout:4/99: fsync d2/f9 0 2024-08-18T22:41:29.663 INFO:tasks.workunit.client.0.smithi121.stdout:0/71: creat d1/d4/db/f1a x:0 0 0 2024-08-18T22:41:29.664 INFO:tasks.workunit.client.0.smithi121.stdout:4/100: read d2/dc/fd [3613599,24158] 0 2024-08-18T22:41:29.664 INFO:tasks.workunit.client.0.smithi121.stdout:9/164: creat d0/d5/dd/d19/f33 x:0 0 0 2024-08-18T22:41:29.665 INFO:tasks.workunit.client.0.smithi121.stdout:0/72: write d1/d11/f10 [131164,128058] 0 2024-08-18T22:41:29.666 INFO:tasks.workunit.client.0.smithi121.stdout:1/125: mknod d5/df/d15/c2c 0 2024-08-18T22:41:29.667 INFO:tasks.workunit.client.0.smithi121.stdout:0/73: fsync d1/fd 0 2024-08-18T22:41:29.668 INFO:tasks.workunit.client.0.smithi121.stdout:1/126: chown d5/df/d15/d28 51 1 2024-08-18T22:41:29.672 INFO:tasks.workunit.client.0.smithi121.stdout:4/101: mkdir d2/dc/d1c 0 2024-08-18T22:41:29.673 INFO:tasks.workunit.client.0.smithi121.stdout:7/93: dwrite f8 [0,4194304] 0 2024-08-18T22:41:29.675 INFO:tasks.workunit.client.0.smithi121.stdout:1/127: fdatasync d5/f7 0 2024-08-18T22:41:29.676 INFO:tasks.workunit.client.0.smithi121.stdout:7/94: truncate de/f14 757616 0 2024-08-18T22:41:29.682 INFO:tasks.workunit.client.0.smithi121.stdout:1/128: creat d5/df/d15/f2d x:0 0 0 2024-08-18T22:41:29.682 INFO:tasks.workunit.client.0.smithi121.stdout:7/95: mknod de/d13/c21 0 2024-08-18T22:41:29.683 INFO:tasks.workunit.client.0.smithi121.stdout:7/96: write de/f14 [524188,120584] 0 2024-08-18T22:41:29.685 INFO:tasks.workunit.client.0.smithi121.stdout:1/129: mknod d5/d10/c2e 0 2024-08-18T22:41:29.686 INFO:tasks.workunit.client.0.smithi121.stdout:1/130: fsync d5/fe 0 2024-08-18T22:41:29.687 INFO:tasks.workunit.client.1.smithi195.stderr:++ readlink -f fsstress 2024-08-18T22:41:29.687 INFO:tasks.workunit.client.0.smithi121.stdout:7/97: mknod de/d13/c22 0 2024-08-18T22:41:29.689 INFO:tasks.workunit.client.1.smithi195.stderr:+ BIN=/home/ubuntu/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress 2024-08-18T22:41:29.689 INFO:tasks.workunit.client.1.smithi195.stderr:+ popd 2024-08-18T22:41:29.689 INFO:tasks.workunit.client.0.smithi121.stdout:1/131: creat d5/d10/d14/d2a/f2f x:0 0 0 2024-08-18T22:41:29.690 INFO:tasks.workunit.client.0.smithi121.stdout:7/98: mkdir de/d13/d18/d23 0 2024-08-18T22:41:29.690 INFO:tasks.workunit.client.1.smithi195.stdout:~/cephtest/mnt.1/client.1/tmp/fsstress ~/cephtest/mnt.1/client.1/tmp 2024-08-18T22:41:29.691 INFO:tasks.workunit.client.1.smithi195.stderr:+ popd 2024-08-18T22:41:29.691 INFO:tasks.workunit.client.1.smithi195.stdout:~/cephtest/mnt.1/client.1/tmp 2024-08-18T22:41:29.691 INFO:tasks.workunit.client.1.smithi195.stderr:++ mktemp -d -p . 2024-08-18T22:41:29.692 INFO:tasks.workunit.client.0.smithi121.stdout:1/132: write d5/d10/d14/d2a/f2f [801972,38021] 0 2024-08-18T22:41:29.692 INFO:tasks.workunit.client.0.smithi121.stdout:9/165: truncate d0/d6/df/f20 2405823 0 2024-08-18T22:41:29.693 INFO:tasks.workunit.client.0.smithi121.stdout:4/102: write d2/f14 [259674,1583] 0 2024-08-18T22:41:29.693 INFO:tasks.workunit.client.1.smithi195.stderr:+ T=./tmp.Jv9LMPp3wl 2024-08-18T22:41:29.693 INFO:tasks.workunit.client.1.smithi195.stderr:+ /home/ubuntu/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress -d ./tmp.Jv9LMPp3wl -l 1 -n 1000 -p 10 -v 2024-08-18T22:41:29.694 INFO:tasks.workunit.client.0.smithi121.stdout:0/74: truncate d1/d11/df/f7 2963621 0 2024-08-18T22:41:29.695 INFO:tasks.workunit.client.0.smithi121.stdout:7/99: mkdir de/d13/d18/d23/d24 0 2024-08-18T22:41:29.695 INFO:tasks.workunit.client.0.smithi121.stdout:0/75: write d1/fd [3008633,119281] 0 2024-08-18T22:41:29.695 INFO:tasks.workunit.client.0.smithi121.stdout:7/100: readlink de/l12 0 2024-08-18T22:41:29.696 INFO:tasks.workunit.client.1.smithi195.stdout:seed = 1724438889 2024-08-18T22:41:29.696 INFO:tasks.workunit.client.0.smithi121.stdout:7/101: write f8 [3304267,26857] 0 2024-08-18T22:41:29.697 INFO:tasks.workunit.client.0.smithi121.stdout:9/166: rename d0/d5/dd/d1a/f26 to d0/d5/dd/d19/f34 0 2024-08-18T22:41:29.698 INFO:tasks.workunit.client.0.smithi121.stdout:4/103: mknod d2/dc/d16/c1d 0 2024-08-18T22:41:29.699 INFO:tasks.workunit.client.0.smithi121.stdout:4/104: fsync d2/dc/f13 0 2024-08-18T22:41:29.699 INFO:tasks.workunit.client.0.smithi121.stdout:1/133: creat d5/df/f30 x:0 0 0 2024-08-18T22:41:29.700 INFO:tasks.workunit.client.1.smithi195.stdout:0/0: dwrite - no filename 2024-08-18T22:41:29.700 INFO:tasks.workunit.client.1.smithi195.stdout:0/1: dwrite - no filename 2024-08-18T22:41:29.700 INFO:tasks.workunit.client.1.smithi195.stdout:0/2: write - no filename 2024-08-18T22:41:29.700 INFO:tasks.workunit.client.1.smithi195.stdout:0/3: unlink - no file 2024-08-18T22:41:29.700 INFO:tasks.workunit.client.1.smithi195.stdout:0/4: link - no file 2024-08-18T22:41:29.701 INFO:tasks.workunit.client.1.smithi195.stdout:0/5: fsync - no filename 2024-08-18T22:41:29.701 INFO:tasks.workunit.client.1.smithi195.stdout:0/6: dread - no filename 2024-08-18T22:41:29.701 INFO:tasks.workunit.client.1.smithi195.stdout:0/7: write - no filename 2024-08-18T22:41:29.701 INFO:tasks.workunit.client.1.smithi195.stdout:0/8: truncate - no filename 2024-08-18T22:41:29.701 INFO:tasks.workunit.client.1.smithi195.stdout:0/9: rmdir - no directory 2024-08-18T22:41:29.701 INFO:tasks.workunit.client.1.smithi195.stdout:0/10: chown . 1907417 1 2024-08-18T22:41:29.701 INFO:tasks.workunit.client.0.smithi121.stdout:1/134: read - d5/df/d15/f2d zero size 2024-08-18T22:41:29.702 INFO:tasks.workunit.client.1.smithi195.stdout:0/11: mkdir d0 0 2024-08-18T22:41:29.702 INFO:tasks.workunit.client.1.smithi195.stdout:0/12: chown d0 54388 1 2024-08-18T22:41:29.703 INFO:tasks.workunit.client.0.smithi121.stdout:9/167: creat d0/d6/df/f35 x:0 0 0 2024-08-18T22:41:29.703 INFO:tasks.workunit.client.0.smithi121.stdout:7/102: mkdir de/d13/d18/d23/d24/d25 0 2024-08-18T22:41:29.704 INFO:tasks.workunit.client.1.smithi195.stdout:1/0: creat f0 x:0 0 0 2024-08-18T22:41:29.705 INFO:tasks.workunit.client.0.smithi121.stdout:4/105: dread d2/f7 [0,4194304] 0 2024-08-18T22:41:29.705 INFO:tasks.workunit.client.1.smithi195.stdout:0/13: symlink d0/l1 0 2024-08-18T22:41:29.705 INFO:tasks.workunit.client.1.smithi195.stdout:0/14: chown d0 237536066 1 2024-08-18T22:41:29.705 INFO:tasks.workunit.client.1.smithi195.stdout:0/15: write - no filename 2024-08-18T22:41:29.706 INFO:tasks.workunit.client.0.smithi121.stdout:0/76: rmdir d1/d19 0 2024-08-18T22:41:29.706 INFO:tasks.workunit.client.1.smithi195.stdout:0/16: chown d0/l1 0 1 2024-08-18T22:41:29.706 INFO:tasks.workunit.client.1.smithi195.stdout:3/0: write - no filename 2024-08-18T22:41:29.706 INFO:tasks.workunit.client.1.smithi195.stdout:3/1: dwrite - no filename 2024-08-18T22:41:29.706 INFO:tasks.workunit.client.1.smithi195.stdout:0/17: dwrite - no filename 2024-08-18T22:41:29.706 INFO:tasks.workunit.client.1.smithi195.stdout:0/18: write - no filename 2024-08-18T22:41:29.707 INFO:tasks.workunit.client.0.smithi121.stdout:0/77: write d1/d11/df/d8/f17 [901408,46739] 0 2024-08-18T22:41:29.707 INFO:tasks.workunit.client.1.smithi195.stdout:1/1: mknod c1 0 2024-08-18T22:41:29.707 INFO:tasks.workunit.client.0.smithi121.stdout:9/168: symlink d0/d6/df/l36 0 2024-08-18T22:41:29.708 INFO:tasks.workunit.client.1.smithi195.stdout:1/2: write f0 [300146,99671] 0 2024-08-18T22:41:29.708 INFO:tasks.workunit.client.1.smithi195.stdout:1/3: readlink - no filename 2024-08-18T22:41:29.708 INFO:tasks.workunit.client.1.smithi195.stdout:1/4: rmdir - no directory 2024-08-18T22:41:29.708 INFO:tasks.workunit.client.1.smithi195.stdout:4/0: truncate - no filename 2024-08-18T22:41:29.709 INFO:tasks.workunit.client.1.smithi195.stdout:2/0: symlink l0 0 2024-08-18T22:41:29.709 INFO:tasks.workunit.client.0.smithi121.stdout:7/103: unlink de/d1a/c1b 0 2024-08-18T22:41:29.709 INFO:tasks.workunit.client.1.smithi195.stdout:1/5: truncate f0 932084 0 2024-08-18T22:41:29.710 INFO:tasks.workunit.client.0.smithi121.stdout:1/135: link d5/d10/d14/c29 d5/df/d11/c31 0 2024-08-18T22:41:29.710 INFO:tasks.workunit.client.1.smithi195.stdout:3/2: symlink l0 0 2024-08-18T22:41:29.714 INFO:tasks.workunit.client.1.smithi195.stdout:0/19: link d0/l1 d0/l2 0 2024-08-18T22:41:29.715 INFO:tasks.workunit.client.0.smithi121.stdout:9/169: creat d0/d5/dd/d1a/f37 x:0 0 0 2024-08-18T22:41:29.715 INFO:tasks.workunit.client.0.smithi121.stdout:4/106: mknod d2/dc/d1c/c1e 0 2024-08-18T22:41:29.716 INFO:tasks.workunit.client.1.smithi195.stdout:4/1: getdents . 0 2024-08-18T22:41:29.716 INFO:tasks.workunit.client.1.smithi195.stdout:5/0: mkdir d0 0 2024-08-18T22:41:29.717 INFO:tasks.workunit.client.1.smithi195.stdout:1/6: dread f0 [0,4194304] 0 2024-08-18T22:41:29.717 INFO:tasks.workunit.client.0.smithi121.stdout:1/136: mknod d5/d10/c32 0 2024-08-18T22:41:29.718 INFO:tasks.workunit.client.0.smithi121.stdout:0/78: symlink d1/d4/l1b 0 2024-08-18T22:41:29.719 INFO:tasks.workunit.client.1.smithi195.stdout:0/20: creat d0/f3 x:0 0 0 2024-08-18T22:41:29.719 INFO:tasks.workunit.client.0.smithi121.stdout:9/170: write d0/d6/f10 [2878830,24428] 0 2024-08-18T22:41:29.720 INFO:tasks.workunit.client.1.smithi195.stdout:0/21: write d0/f3 [702471,37765] 0 2024-08-18T22:41:29.721 INFO:tasks.workunit.client.0.smithi121.stdout:4/107: unlink f0 0 2024-08-18T22:41:29.722 INFO:tasks.workunit.client.0.smithi121.stdout:4/108: dread - d2/f9 zero size 2024-08-18T22:41:29.723 INFO:tasks.workunit.client.1.smithi195.stdout:4/2: mkdir d0 0 2024-08-18T22:41:29.723 INFO:tasks.workunit.client.0.smithi121.stdout:4/109: read d2/dc/f13 [1619766,117199] 0 2024-08-18T22:41:29.723 INFO:tasks.workunit.client.0.smithi121.stdout:1/137: rmdir d5/d10/d14/d2a 39 2024-08-18T22:41:29.725 INFO:tasks.workunit.client.0.smithi121.stdout:0/79: dwrite d1/fd [0,4194304] 0 2024-08-18T22:41:29.725 INFO:tasks.workunit.client.1.smithi195.stdout:5/1: mknod d0/c1 0 2024-08-18T22:41:29.726 INFO:tasks.workunit.client.1.smithi195.stdout:8/0: chown . 0 1 2024-08-18T22:41:29.726 INFO:tasks.workunit.client.1.smithi195.stdout:1/7: write f0 [405193,20943] 0 2024-08-18T22:41:29.727 INFO:tasks.workunit.client.1.smithi195.stdout:7/0: mknod c0 0 2024-08-18T22:41:29.727 INFO:tasks.workunit.client.1.smithi195.stdout:7/1: rmdir - no directory 2024-08-18T22:41:29.728 INFO:tasks.workunit.client.0.smithi121.stdout:9/171: chown d0/d5/l1c 61524 1 2024-08-18T22:41:29.730 INFO:tasks.workunit.client.1.smithi195.stdout:9/0: unlink - no file 2024-08-18T22:41:29.730 INFO:tasks.workunit.client.1.smithi195.stdout:9/1: fdatasync - no filename 2024-08-18T22:41:29.730 INFO:tasks.workunit.client.0.smithi121.stdout:7/104: link de/d13/c21 de/d1a/d20/c26 0 2024-08-18T22:41:29.730 INFO:tasks.workunit.client.1.smithi195.stdout:5/2: rmdir d0 39 2024-08-18T22:41:29.731 INFO:tasks.workunit.client.0.smithi121.stdout:7/105: chown de/f1d 484 1 2024-08-18T22:41:29.731 INFO:tasks.workunit.client.0.smithi121.stdout:1/138: symlink d5/df/d15/l33 0 2024-08-18T22:41:29.731 INFO:tasks.workunit.client.0.smithi121.stdout:7/106: fdatasync de/f14 0 2024-08-18T22:41:29.731 INFO:tasks.workunit.client.0.smithi121.stdout:1/139: dread - d5/f1d zero size 2024-08-18T22:41:29.732 INFO:tasks.workunit.client.1.smithi195.stdout:7/2: creat f1 x:0 0 0 2024-08-18T22:41:29.733 INFO:tasks.workunit.client.0.smithi121.stdout:1/140: write f3 [5501394,42902] 0 2024-08-18T22:41:29.733 INFO:tasks.workunit.client.0.smithi121.stdout:0/80: unlink d1/d4/l1b 0 2024-08-18T22:41:29.733 INFO:tasks.workunit.client.1.smithi195.stdout:1/8: rename c1 to c2 0 2024-08-18T22:41:29.734 INFO:tasks.workunit.client.0.smithi121.stdout:1/141: fsync d5/df/d11/f26 0 2024-08-18T22:41:29.734 INFO:tasks.workunit.client.0.smithi121.stdout:1/142: stat d5/fb 0 2024-08-18T22:41:29.735 INFO:tasks.workunit.client.1.smithi195.stdout:8/1: creat f0 x:0 0 0 2024-08-18T22:41:29.735 INFO:tasks.workunit.client.1.smithi195.stdout:0/22: dwrite d0/f3 [0,4194304] 0 2024-08-18T22:41:29.736 INFO:tasks.workunit.client.1.smithi195.stdout:8/2: chown f0 1018191 1 2024-08-18T22:41:29.736 INFO:tasks.workunit.client.1.smithi195.stdout:1/9: truncate f0 987454 0 2024-08-18T22:41:29.739 INFO:tasks.workunit.client.1.smithi195.stdout:9/2: creat f0 x:0 0 0 2024-08-18T22:41:29.739 INFO:tasks.workunit.client.1.smithi195.stdout:1/10: write f0 [638352,99273] 0 2024-08-18T22:41:29.739 INFO:tasks.workunit.client.0.smithi121.stdout:4/110: truncate d2/dc/f13 2477594 0 2024-08-18T22:41:29.740 INFO:tasks.workunit.client.1.smithi195.stdout:7/3: creat f2 x:0 0 0 2024-08-18T22:41:29.741 INFO:tasks.workunit.client.1.smithi195.stdout:7/4: truncate f2 915295 0 2024-08-18T22:41:29.741 INFO:tasks.workunit.client.1.smithi195.stdout:8/3: mkdir d1 0 2024-08-18T22:41:29.742 INFO:tasks.workunit.client.0.smithi121.stdout:9/172: mkdir d0/d38 0 2024-08-18T22:41:29.745 INFO:tasks.workunit.client.1.smithi195.stdout:9/3: mknod c1 0 2024-08-18T22:41:29.745 INFO:tasks.workunit.client.0.smithi121.stdout:1/143: unlink d5/d10/d14/f22 0 2024-08-18T22:41:29.745 INFO:tasks.workunit.client.0.smithi121.stdout:1/144: chown d5/df/d11 8646605 1 2024-08-18T22:41:29.745 INFO:tasks.workunit.client.1.smithi195.stdout:0/23: chown d0/l1 16147834 1 2024-08-18T22:41:29.746 INFO:tasks.workunit.client.0.smithi121.stdout:1/145: write d5/df/d15/f2d [57579,5508] 0 2024-08-18T22:41:29.746 INFO:tasks.workunit.client.0.smithi121.stdout:7/107: link fb de/d13/d18/f27 0 2024-08-18T22:41:29.747 INFO:tasks.workunit.client.0.smithi121.stdout:7/108: fdatasync de/d1a/f1e 0 2024-08-18T22:41:29.747 INFO:tasks.workunit.client.0.smithi121.stdout:1/146: write d5/fe [306383,88944] 0 2024-08-18T22:41:29.747 INFO:tasks.workunit.client.0.smithi121.stdout:7/109: readlink de/l12 0 2024-08-18T22:41:29.748 INFO:tasks.workunit.client.1.smithi195.stdout:7/5: creat f3 x:0 0 0 2024-08-18T22:41:29.751 INFO:tasks.workunit.client.0.smithi121.stdout:9/173: symlink d0/d5/dd/l39 0 2024-08-18T22:41:29.751 INFO:tasks.workunit.client.0.smithi121.stdout:2/40: sync 2024-08-18T22:41:29.752 INFO:tasks.workunit.client.1.smithi195.stdout:8/4: creat d1/f2 x:0 0 0 2024-08-18T22:41:29.753 INFO:tasks.workunit.client.1.smithi195.stdout:2/1: getdents . 0 2024-08-18T22:41:29.753 INFO:tasks.workunit.client.1.smithi195.stdout:7/6: read - f1 zero size 2024-08-18T22:41:29.753 INFO:tasks.workunit.client.0.smithi121.stdout:2/41: dread d2/f6 [0,4194304] 0 2024-08-18T22:41:29.754 INFO:tasks.workunit.client.0.smithi121.stdout:0/81: getdents d1/d11/df 0 2024-08-18T22:41:29.754 INFO:tasks.workunit.client.1.smithi195.stdout:2/2: chown l0 29625 1 2024-08-18T22:41:29.754 INFO:tasks.workunit.client.1.smithi195.stdout:2/3: dwrite - no filename 2024-08-18T22:41:29.754 INFO:tasks.workunit.client.1.smithi195.stdout:2/4: truncate - no filename 2024-08-18T22:41:29.754 INFO:tasks.workunit.client.1.smithi195.stdout:0/24: dread d0/f3 [0,4194304] 0 2024-08-18T22:41:29.755 INFO:tasks.workunit.client.0.smithi121.stdout:2/42: dread d2/f6 [0,4194304] 0 2024-08-18T22:41:29.755 INFO:tasks.workunit.client.1.smithi195.stdout:2/5: readlink l0 0 2024-08-18T22:41:29.756 INFO:tasks.workunit.client.1.smithi195.stdout:3/3: getdents . 0 2024-08-18T22:41:29.756 INFO:tasks.workunit.client.0.smithi121.stdout:4/111: write d2/dc/fd [2450412,17272] 0 2024-08-18T22:41:29.757 INFO:tasks.workunit.client.1.smithi195.stdout:7/7: write f1 [159442,46823] 0 2024-08-18T22:41:29.757 INFO:tasks.workunit.client.1.smithi195.stdout:8/5: mkdir d1/d3 0 2024-08-18T22:41:29.758 INFO:tasks.workunit.client.1.smithi195.stdout:9/4: dwrite f0 [0,4194304] 0 2024-08-18T22:41:29.760 INFO:tasks.workunit.client.0.smithi121.stdout:9/174: rename d0/f2a to d0/d5/dd/d19/f3a 0 2024-08-18T22:41:29.760 INFO:tasks.workunit.client.1.smithi195.stdout:2/6: mkdir d1 0 2024-08-18T22:41:29.760 INFO:tasks.workunit.client.1.smithi195.stdout:2/7: dwrite - no filename 2024-08-18T22:41:29.760 INFO:tasks.workunit.client.1.smithi195.stdout:2/8: write - no filename 2024-08-18T22:41:29.760 INFO:tasks.workunit.client.1.smithi195.stdout:2/9: write - no filename 2024-08-18T22:41:29.761 INFO:tasks.workunit.client.0.smithi121.stdout:2/43: dread d2/d3/f4 [0,4194304] 0 2024-08-18T22:41:29.761 INFO:tasks.workunit.client.1.smithi195.stdout:3/4: unlink l0 0 2024-08-18T22:41:29.762 INFO:tasks.workunit.client.0.smithi121.stdout:1/147: mkdir d5/d10/d14/d34 0 2024-08-18T22:41:29.762 INFO:tasks.workunit.client.1.smithi195.stdout:7/8: symlink l4 0 2024-08-18T22:41:29.762 INFO:tasks.workunit.client.0.smithi121.stdout:1/148: chown d5/d10/f20 0 1 2024-08-18T22:41:29.764 INFO:tasks.workunit.client.1.smithi195.stdout:5/3: mkdir d0/d2 0 2024-08-18T22:41:29.765 INFO:tasks.workunit.client.1.smithi195.stdout:9/5: mknod c2 0 2024-08-18T22:41:29.767 INFO:tasks.workunit.client.0.smithi121.stdout:9/175: dread d0/d6/d18/f2d [0,4194304] 0 2024-08-18T22:41:29.767 INFO:tasks.workunit.client.1.smithi195.stdout:3/5: creat f1 x:0 0 0 2024-08-18T22:41:29.767 INFO:tasks.workunit.client.1.smithi195.stdout:3/6: stat f1 0 2024-08-18T22:41:29.767 INFO:tasks.workunit.client.1.smithi195.stdout:3/7: read - f1 zero size 2024-08-18T22:41:29.767 INFO:tasks.workunit.client.1.smithi195.stdout:7/9: creat f5 x:0 0 0 2024-08-18T22:41:29.769 INFO:tasks.workunit.client.1.smithi195.stdout:5/4: mkdir d0/d3 0 2024-08-18T22:41:29.769 INFO:tasks.workunit.client.1.smithi195.stdout:5/5: write - no filename 2024-08-18T22:41:29.770 INFO:tasks.workunit.client.1.smithi195.stdout:2/10: creat d1/f2 x:0 0 0 2024-08-18T22:41:29.770 INFO:tasks.workunit.client.0.smithi121.stdout:0/82: mkdir d1/d4/db/d18/d1c 0 2024-08-18T22:41:29.771 INFO:tasks.workunit.client.0.smithi121.stdout:0/83: chown d1/d11/df/l6 35017 1 2024-08-18T22:41:29.771 INFO:tasks.workunit.client.0.smithi121.stdout:9/176: mkdir d0/d5/dd/d3b 0 2024-08-18T22:41:29.772 INFO:tasks.workunit.client.0.smithi121.stdout:0/84: chown d1/d11/f10 1809 1 2024-08-18T22:41:29.775 INFO:tasks.workunit.client.1.smithi195.stdout:2/11: write d1/f2 [746191,66178] 0 2024-08-18T22:41:29.776 INFO:tasks.workunit.client.1.smithi195.stdout:3/8: mknod c2 0 2024-08-18T22:41:29.776 INFO:tasks.workunit.client.1.smithi195.stdout:7/10: mknod c6 0 2024-08-18T22:41:29.776 INFO:tasks.workunit.client.1.smithi195.stdout:5/6: symlink d0/l4 0 2024-08-18T22:41:29.776 INFO:tasks.workunit.client.1.smithi195.stdout:5/7: dread - no filename 2024-08-18T22:41:29.776 INFO:tasks.workunit.client.0.smithi121.stdout:2/44: unlink c0 0 2024-08-18T22:41:29.776 INFO:tasks.workunit.client.0.smithi121.stdout:7/110: getdents de/d13/d18/d23 0 2024-08-18T22:41:29.777 INFO:tasks.workunit.client.1.smithi195.stdout:3/9: chown c2 20717 1 2024-08-18T22:41:29.778 INFO:tasks.workunit.client.1.smithi195.stdout:7/11: creat f7 x:0 0 0 2024-08-18T22:41:29.778 INFO:tasks.workunit.client.1.smithi195.stdout:3/10: dread - f1 zero size 2024-08-18T22:41:29.778 INFO:tasks.workunit.client.1.smithi195.stdout:1/11: dread f0 [0,4194304] 0 2024-08-18T22:41:29.779 INFO:tasks.workunit.client.0.smithi121.stdout:1/149: symlink d5/d10/d14/l35 0 2024-08-18T22:41:29.780 INFO:tasks.workunit.client.1.smithi195.stdout:5/8: mkdir d0/d3/d5 0 2024-08-18T22:41:29.781 INFO:tasks.workunit.client.1.smithi195.stdout:7/12: symlink l8 0 2024-08-18T22:41:29.781 INFO:tasks.workunit.client.0.smithi121.stdout:9/177: rename d0/d6/df/f35 to d0/d5/dd/d2f/f3c 0 2024-08-18T22:41:29.782 INFO:tasks.workunit.client.1.smithi195.stdout:3/11: symlink l3 0 2024-08-18T22:41:29.782 INFO:tasks.workunit.client.1.smithi195.stdout:1/12: dread f0 [0,4194304] 0 2024-08-18T22:41:29.783 INFO:tasks.workunit.client.0.smithi121.stdout:0/85: dwrite d1/fd [4194304,4194304] 0 2024-08-18T22:41:29.785 INFO:tasks.workunit.client.0.smithi121.stdout:4/112: unlink d2/dc/d1c/c1e 0 2024-08-18T22:41:29.787 INFO:tasks.workunit.client.0.smithi121.stdout:5/65: sync 2024-08-18T22:41:29.787 INFO:tasks.workunit.client.0.smithi121.stdout:8/99: sync 2024-08-18T22:41:29.787 INFO:tasks.workunit.client.0.smithi121.stdout:3/140: sync 2024-08-18T22:41:29.787 INFO:tasks.workunit.client.0.smithi121.stdout:7/111: dwrite f8 [4194304,4194304] 0 2024-08-18T22:41:29.788 INFO:tasks.workunit.client.0.smithi121.stdout:5/66: chown c2 565373 1 2024-08-18T22:41:29.791 INFO:tasks.workunit.client.0.smithi121.stdout:1/150: mkdir d5/d10/d36 0 2024-08-18T22:41:29.794 INFO:tasks.workunit.client.0.smithi121.stdout:0/86: symlink d1/d4/da/l1d 0 2024-08-18T22:41:29.798 INFO:tasks.workunit.client.0.smithi121.stdout:7/112: rename f5 to de/f28 0 2024-08-18T22:41:29.799 INFO:tasks.workunit.client.0.smithi121.stdout:5/67: mkdir d3/d5/d13 0 2024-08-18T22:41:29.800 INFO:tasks.workunit.client.0.smithi121.stdout:8/100: dwrite d6/f19 [0,4194304] 0 2024-08-18T22:41:29.802 INFO:tasks.workunit.client.0.smithi121.stdout:5/68: chown d3/c10 1 1 2024-08-18T22:41:29.802 INFO:tasks.workunit.client.0.smithi121.stdout:4/113: mknod d2/dc/c1f 0 2024-08-18T22:41:29.805 INFO:tasks.workunit.client.0.smithi121.stdout:7/113: mkdir de/d13/d18/d23/d24/d29 0 2024-08-18T22:41:29.805 INFO:tasks.workunit.client.0.smithi121.stdout:4/114: readlink d2/dc/l1b 0 2024-08-18T22:41:29.805 INFO:tasks.workunit.client.0.smithi121.stdout:0/87: mknod d1/d4/c1e 0 2024-08-18T22:41:29.806 INFO:tasks.workunit.client.0.smithi121.stdout:8/101: write d6/f19 [145333,96715] 0 2024-08-18T22:41:29.807 INFO:tasks.workunit.client.0.smithi121.stdout:9/178: getdents d0/d5/dd 0 2024-08-18T22:41:29.809 INFO:tasks.workunit.client.0.smithi121.stdout:8/102: stat d6/dd/f16 0 2024-08-18T22:41:29.809 INFO:tasks.workunit.client.0.smithi121.stdout:7/114: dread - de/d13/d18/f27 zero size 2024-08-18T22:41:29.810 INFO:tasks.workunit.client.0.smithi121.stdout:2/45: dwrite d2/d3/f4 [4194304,4194304] 0 2024-08-18T22:41:29.812 INFO:tasks.workunit.client.0.smithi121.stdout:9/179: chown d0/d5/dd/d1a/f37 246 1 2024-08-18T22:41:29.812 INFO:tasks.workunit.client.0.smithi121.stdout:7/115: symlink de/l2a 0 2024-08-18T22:41:29.817 INFO:tasks.workunit.client.0.smithi121.stdout:8/103: creat d6/d17/f1d x:0 0 0 2024-08-18T22:41:29.818 INFO:tasks.workunit.client.0.smithi121.stdout:7/116: write de/d13/d18/f19 [3850291,65375] 0 2024-08-18T22:41:29.818 INFO:tasks.workunit.client.0.smithi121.stdout:9/180: mkdir d0/d6/df/d3d 0 2024-08-18T22:41:29.818 INFO:tasks.workunit.client.0.smithi121.stdout:4/115: dread d2/fb [0,4194304] 0 2024-08-18T22:41:29.819 INFO:tasks.workunit.client.0.smithi121.stdout:7/117: symlink de/d13/l2b 0 2024-08-18T22:41:29.821 INFO:tasks.workunit.client.0.smithi121.stdout:4/116: write d2/f8 [113686,21234] 0 2024-08-18T22:41:29.823 INFO:tasks.workunit.client.0.smithi121.stdout:9/181: link d0/d5/f25 d0/d5/dd/d3b/f3e 0 2024-08-18T22:41:29.825 INFO:tasks.workunit.client.0.smithi121.stdout:4/117: creat d2/dc/d16/d1a/f20 x:0 0 0 2024-08-18T22:41:29.826 INFO:tasks.workunit.client.0.smithi121.stdout:8/104: dwrite d6/dd/f1b [0,4194304] 0 2024-08-18T22:41:29.826 INFO:tasks.workunit.client.0.smithi121.stdout:9/182: fsync d0/d5/dd/d19/f33 0 2024-08-18T22:41:29.827 INFO:tasks.workunit.client.0.smithi121.stdout:7/118: getdents de/d1a 0 2024-08-18T22:41:29.833 INFO:tasks.workunit.client.0.smithi121.stdout:8/105: mkdir d6/d1e 0 2024-08-18T22:41:29.833 INFO:tasks.workunit.client.0.smithi121.stdout:9/183: mkdir d0/d5/dd/d3f 0 2024-08-18T22:41:29.834 INFO:tasks.workunit.client.0.smithi121.stdout:4/118: dread d2/f14 [0,4194304] 0 2024-08-18T22:41:29.834 INFO:tasks.workunit.client.0.smithi121.stdout:7/119: mknod de/d13/d18/d23/d24/d29/c2c 0 2024-08-18T22:41:29.836 INFO:tasks.workunit.client.0.smithi121.stdout:4/119: chown d2/dc/f13 43069 1 2024-08-18T22:41:29.836 INFO:tasks.workunit.client.0.smithi121.stdout:8/106: mknod d6/d17/d18/c1f 0 2024-08-18T22:41:29.837 INFO:tasks.workunit.client.0.smithi121.stdout:7/120: mkdir de/d2d 0 2024-08-18T22:41:29.838 INFO:tasks.workunit.client.0.smithi121.stdout:8/107: mkdir d6/d20 0 2024-08-18T22:41:29.840 INFO:tasks.workunit.client.0.smithi121.stdout:4/120: creat d2/f21 x:0 0 0 2024-08-18T22:41:29.841 INFO:tasks.workunit.client.0.smithi121.stdout:7/121: mkdir de/d13/d18/d2e 0 2024-08-18T22:41:29.841 INFO:tasks.workunit.client.0.smithi121.stdout:8/108: unlink l4 0 2024-08-18T22:41:29.842 INFO:tasks.workunit.client.0.smithi121.stdout:9/184: dwrite d0/d5/f30 [0,4194304] 0 2024-08-18T22:41:29.842 INFO:tasks.workunit.client.0.smithi121.stdout:4/121: mkdir d2/dc/d16/d22 0 2024-08-18T22:41:29.842 INFO:tasks.workunit.client.0.smithi121.stdout:7/122: write de/f1f [256623,62917] 0 2024-08-18T22:41:29.844 INFO:tasks.workunit.client.0.smithi121.stdout:7/123: write de/f1c [120205,79858] 0 2024-08-18T22:41:29.845 INFO:tasks.workunit.client.0.smithi121.stdout:9/185: chown d0/d5/dd/l39 2608 1 2024-08-18T22:41:29.845 INFO:tasks.workunit.client.0.smithi121.stdout:8/109: dread d6/f9 [4194304,4194304] 0 2024-08-18T22:41:29.846 INFO:tasks.workunit.client.0.smithi121.stdout:4/122: fsync d2/f3 0 2024-08-18T22:41:29.847 INFO:tasks.workunit.client.0.smithi121.stdout:4/123: readlink d2/l15 0 2024-08-18T22:41:29.848 INFO:tasks.workunit.client.0.smithi121.stdout:8/110: mknod d6/dd/c21 0 2024-08-18T22:41:29.849 INFO:tasks.workunit.client.0.smithi121.stdout:8/111: write d6/f14 [5649,79402] 0 2024-08-18T22:41:29.850 INFO:tasks.workunit.client.0.smithi121.stdout:8/112: chown d6/f9 735235315 1 2024-08-18T22:41:29.851 INFO:tasks.workunit.client.1.smithi195.stdout:3/12: fdatasync f1 0 2024-08-18T22:41:29.852 INFO:tasks.workunit.client.0.smithi121.stdout:0/88: dread d1/d11/f10 [0,4194304] 0 2024-08-18T22:41:29.853 INFO:tasks.workunit.client.1.smithi195.stdout:2/12: dwrite d1/f2 [0,4194304] 0 2024-08-18T22:41:29.853 INFO:tasks.workunit.client.0.smithi121.stdout:9/186: link d0/d5/fe d0/d6/df/f40 0 2024-08-18T22:41:29.854 INFO:tasks.workunit.client.0.smithi121.stdout:8/113: mknod d6/d20/c22 0 2024-08-18T22:41:29.855 INFO:tasks.workunit.client.0.smithi121.stdout:8/114: readlink d6/lc 0 2024-08-18T22:41:29.855 INFO:tasks.workunit.client.0.smithi121.stdout:9/187: write d0/d6/f1f [7571,105841] 0 2024-08-18T22:41:29.856 INFO:tasks.workunit.client.1.smithi195.stdout:1/13: dread f0 [0,4194304] 0 2024-08-18T22:41:29.857 INFO:tasks.workunit.client.0.smithi121.stdout:8/115: symlink d6/d1e/l23 0 2024-08-18T22:41:29.859 INFO:tasks.workunit.client.1.smithi195.stdout:3/13: write f1 [97076,24824] 0 2024-08-18T22:41:29.859 INFO:tasks.workunit.client.0.smithi121.stdout:9/188: creat d0/d5/dd/f41 x:0 0 0 2024-08-18T22:41:29.859 INFO:tasks.workunit.client.1.smithi195.stdout:7/13: dread f2 [0,4194304] 0 2024-08-18T22:41:29.861 INFO:tasks.workunit.client.1.smithi195.stdout:5/9: getdents d0/d3/d5 0 2024-08-18T22:41:29.861 INFO:tasks.workunit.client.1.smithi195.stdout:1/14: dread f0 [0,4194304] 0 2024-08-18T22:41:29.862 INFO:tasks.workunit.client.0.smithi121.stdout:8/116: write d6/f14 [1101475,30151] 0 2024-08-18T22:41:29.862 INFO:tasks.workunit.client.1.smithi195.stdout:0/25: write d0/f3 [4230158,76806] 0 2024-08-18T22:41:29.862 INFO:tasks.workunit.client.1.smithi195.stdout:1/15: readlink - no filename 2024-08-18T22:41:29.863 INFO:tasks.workunit.client.1.smithi195.stdout:3/14: write f1 [844324,66373] 0 2024-08-18T22:41:29.864 INFO:tasks.workunit.client.0.smithi121.stdout:0/89: dwrite d1/d4/db/f1a [0,4194304] 0 2024-08-18T22:41:29.864 INFO:tasks.workunit.client.0.smithi121.stdout:5/69: rmdir d3 39 2024-08-18T22:41:29.866 INFO:tasks.workunit.client.0.smithi121.stdout:3/141: truncate f16 1574385 0 2024-08-18T22:41:29.869 INFO:tasks.workunit.client.0.smithi121.stdout:8/117: symlink d6/d20/l24 0 2024-08-18T22:41:29.870 INFO:tasks.workunit.client.1.smithi195.stdout:8/6: rmdir d1 39 2024-08-18T22:41:29.871 INFO:tasks.workunit.client.1.smithi195.stdout:1/16: dread f0 [0,4194304] 0 2024-08-18T22:41:29.871 INFO:tasks.workunit.client.0.smithi121.stdout:8/118: write d6/f14 [64318,47220] 0 2024-08-18T22:41:29.872 INFO:tasks.workunit.client.1.smithi195.stdout:7/14: symlink l9 0 2024-08-18T22:41:29.874 INFO:tasks.workunit.client.0.smithi121.stdout:9/189: dwrite d0/d5/f9 [0,4194304] 0 2024-08-18T22:41:29.874 INFO:tasks.workunit.client.0.smithi121.stdout:8/119: chown d6/f19 32305 1 2024-08-18T22:41:29.876 INFO:tasks.workunit.client.0.smithi121.stdout:2/46: write d2/f6 [726914,57694] 0 2024-08-18T22:41:29.876 INFO:tasks.workunit.client.0.smithi121.stdout:5/70: getdents d3/d5/d13 0 2024-08-18T22:41:29.876 INFO:tasks.workunit.client.0.smithi121.stdout:8/120: read - d6/d17/f1d zero size 2024-08-18T22:41:29.877 INFO:tasks.workunit.client.1.smithi195.stdout:1/17: truncate f0 1057014 0 2024-08-18T22:41:29.878 INFO:tasks.workunit.client.0.smithi121.stdout:2/47: stat d2/d3 0 2024-08-18T22:41:29.878 INFO:tasks.workunit.client.0.smithi121.stdout:5/71: chown d3 338 1 2024-08-18T22:41:29.878 INFO:tasks.workunit.client.1.smithi195.stdout:7/15: mknod ca 0 2024-08-18T22:41:29.880 INFO:tasks.workunit.client.0.smithi121.stdout:0/90: creat d1/d4/f1f x:0 0 0 2024-08-18T22:41:29.880 INFO:tasks.workunit.client.0.smithi121.stdout:8/121: mkdir d6/dd/d25 0 2024-08-18T22:41:29.880 INFO:tasks.workunit.client.0.smithi121.stdout:2/48: chown d2/l5 2 1 2024-08-18T22:41:29.880 INFO:tasks.workunit.client.1.smithi195.stdout:8/7: write f0 [742919,43173] 0 2024-08-18T22:41:29.882 INFO:tasks.workunit.client.0.smithi121.stdout:8/122: stat d6/dd/c13 0 2024-08-18T22:41:29.882 INFO:tasks.workunit.client.0.smithi121.stdout:0/91: write d1/fd [2036677,80613] 0 2024-08-18T22:41:29.883 INFO:tasks.workunit.client.1.smithi195.stdout:5/10: creat d0/d2/f6 x:0 0 0 2024-08-18T22:41:29.883 INFO:tasks.workunit.client.1.smithi195.stdout:3/15: link f1 f4 0 2024-08-18T22:41:29.883 INFO:tasks.workunit.client.0.smithi121.stdout:8/123: readlink d6/d1e/l23 0 2024-08-18T22:41:29.884 INFO:tasks.workunit.client.0.smithi121.stdout:5/72: rmdir d3 39 2024-08-18T22:41:29.886 INFO:tasks.workunit.client.1.smithi195.stdout:0/26: dread d0/f3 [0,4194304] 0 2024-08-18T22:41:29.888 INFO:tasks.workunit.client.1.smithi195.stdout:9/6: dwrite f0 [4194304,4194304] 0 2024-08-18T22:41:29.888 INFO:tasks.workunit.client.0.smithi121.stdout:2/49: dread d2/d3/f4 [4194304,4194304] 0 2024-08-18T22:41:29.890 INFO:tasks.workunit.client.1.smithi195.stdout:2/13: write d1/f2 [4889328,19828] 0 2024-08-18T22:41:29.891 INFO:tasks.workunit.client.0.smithi121.stdout:8/124: creat d6/d20/f26 x:0 0 0 2024-08-18T22:41:29.892 INFO:tasks.workunit.client.1.smithi195.stdout:3/16: fdatasync f1 0 2024-08-18T22:41:29.892 INFO:tasks.workunit.client.1.smithi195.stdout:7/16: creat fb x:0 0 0 2024-08-18T22:41:29.892 INFO:tasks.workunit.client.1.smithi195.stdout:5/11: rmdir d0/d3 39 2024-08-18T22:41:29.893 INFO:tasks.workunit.client.0.smithi121.stdout:0/92: dwrite d1/fd [4194304,4194304] 0 2024-08-18T22:41:29.893 INFO:tasks.workunit.client.1.smithi195.stdout:2/14: stat l0 0 2024-08-18T22:41:29.896 INFO:tasks.workunit.client.1.smithi195.stdout:9/7: creat f3 x:0 0 0 2024-08-18T22:41:29.897 INFO:tasks.workunit.client.1.smithi195.stdout:7/17: mkdir dc 0 2024-08-18T22:41:29.897 INFO:tasks.workunit.client.1.smithi195.stdout:3/17: read f4 [779,44472] 0 2024-08-18T22:41:29.897 INFO:tasks.workunit.client.1.smithi195.stdout:0/27: write d0/f3 [87264,22130] 0 2024-08-18T22:41:29.898 INFO:tasks.workunit.client.0.smithi121.stdout:0/93: creat d1/d11/df/d8/f20 x:0 0 0 2024-08-18T22:41:29.899 INFO:tasks.workunit.client.1.smithi195.stdout:2/15: write d1/f2 [3768653,36213] 0 2024-08-18T22:41:29.901 INFO:tasks.workunit.client.0.smithi121.stdout:0/94: dread - d1/d4/f1f zero size 2024-08-18T22:41:29.902 INFO:tasks.workunit.client.1.smithi195.stdout:2/16: chown d1 230 1 2024-08-18T22:41:29.903 INFO:tasks.workunit.client.0.smithi121.stdout:9/190: truncate d0/d5/fe 5536179 0 2024-08-18T22:41:29.903 INFO:tasks.workunit.client.1.smithi195.stdout:1/18: dwrite f0 [0,4194304] 0 2024-08-18T22:41:29.905 INFO:tasks.workunit.client.1.smithi195.stdout:7/18: write f5 [796470,63612] 0 2024-08-18T22:41:29.906 INFO:tasks.workunit.client.0.smithi121.stdout:8/125: dread d6/f19 [0,4194304] 0 2024-08-18T22:41:29.908 INFO:tasks.workunit.client.0.smithi121.stdout:2/50: dwrite d2/d3/f4 [4194304,4194304] 0 2024-08-18T22:41:29.908 INFO:tasks.workunit.client.1.smithi195.stdout:3/18: symlink l5 0 2024-08-18T22:41:29.908 INFO:tasks.workunit.client.1.smithi195.stdout:7/19: chown c0 201043333 1 2024-08-18T22:41:29.911 INFO:tasks.workunit.client.1.smithi195.stdout:0/28: symlink d0/l4 0 2024-08-18T22:41:29.912 INFO:tasks.workunit.client.0.smithi121.stdout:2/51: write d2/f6 [1178072,73200] 0 2024-08-18T22:41:29.912 INFO:tasks.workunit.client.1.smithi195.stdout:3/19: chown l5 66575061 1 2024-08-18T22:41:29.913 INFO:tasks.workunit.client.1.smithi195.stdout:7/20: chown ca 93 1 2024-08-18T22:41:29.913 INFO:tasks.workunit.client.0.smithi121.stdout:4/124: dwrite d2/dc/f13 [0,4194304] 0 2024-08-18T22:41:29.913 INFO:tasks.workunit.client.0.smithi121.stdout:3/142: dread f16 [0,4194304] 0 2024-08-18T22:41:29.915 INFO:tasks.workunit.client.1.smithi195.stdout:5/12: dwrite d0/d2/f6 [0,4194304] 0 2024-08-18T22:41:29.916 INFO:tasks.workunit.client.0.smithi121.stdout:9/191: rename d0/d5/l23 to d0/d6/d18/l42 0 2024-08-18T22:41:29.917 INFO:tasks.workunit.client.1.smithi195.stdout:3/20: write f1 [1345603,1393] 0 2024-08-18T22:41:29.918 INFO:tasks.workunit.client.1.smithi195.stdout:7/21: write f1 [994879,101483] 0 2024-08-18T22:41:29.919 INFO:tasks.workunit.client.0.smithi121.stdout:9/192: write d0/d6/fc [7166311,50011] 0 2024-08-18T22:41:29.920 INFO:tasks.workunit.client.0.smithi121.stdout:3/143: symlink d1e/d1f/l33 0 2024-08-18T22:41:29.922 INFO:tasks.workunit.client.0.smithi121.stdout:4/125: creat d2/dc/d1c/f23 x:0 0 0 2024-08-18T22:41:29.922 INFO:tasks.workunit.client.0.smithi121.stdout:2/52: dread d2/f6 [0,4194304] 0 2024-08-18T22:41:29.924 INFO:tasks.workunit.client.0.smithi121.stdout:9/193: fdatasync d0/d5/f9 0 2024-08-18T22:41:29.924 INFO:tasks.workunit.client.0.smithi121.stdout:8/126: link d6/d17/c1a d6/c27 0 2024-08-18T22:41:29.926 INFO:tasks.workunit.client.1.smithi195.stdout:0/29: rename d0/l1 to d0/l5 0 2024-08-18T22:41:29.928 INFO:tasks.workunit.client.0.smithi121.stdout:0/95: dwrite d1/d11/f10 [0,4194304] 0 2024-08-18T22:41:29.928 INFO:tasks.workunit.client.0.smithi121.stdout:9/194: write d0/d6/f10 [738029,57118] 0 2024-08-18T22:41:29.929 INFO:tasks.workunit.client.0.smithi121.stdout:4/126: chown d2/f7 4867 1 2024-08-18T22:41:29.929 INFO:tasks.workunit.client.1.smithi195.stdout:3/21: write f1 [842942,33268] 0 2024-08-18T22:41:29.930 INFO:tasks.workunit.client.1.smithi195.stdout:9/8: dwrite f0 [0,4194304] 0 2024-08-18T22:41:29.931 INFO:tasks.workunit.client.1.smithi195.stdout:5/13: symlink d0/d3/l7 0 2024-08-18T22:41:29.934 INFO:tasks.workunit.client.0.smithi121.stdout:3/144: mknod d1e/d1f/d2a/c34 0 2024-08-18T22:41:29.934 INFO:tasks.workunit.client.0.smithi121.stdout:0/96: truncate d1/d11/df/d8/f20 639354 0 2024-08-18T22:41:29.934 INFO:tasks.workunit.client.0.smithi121.stdout:8/127: mknod d6/dd/c28 0 2024-08-18T22:41:29.935 INFO:tasks.workunit.client.0.smithi121.stdout:4/127: mkdir d2/dc/d16/d1a/d24 0 2024-08-18T22:41:29.936 INFO:tasks.workunit.client.0.smithi121.stdout:3/145: dread - f1a zero size 2024-08-18T22:41:29.937 INFO:tasks.workunit.client.1.smithi195.stdout:9/9: symlink l4 0 2024-08-18T22:41:29.937 INFO:tasks.workunit.client.0.smithi121.stdout:9/195: mknod d0/d5/dd/d1a/c43 0 2024-08-18T22:41:29.938 INFO:tasks.workunit.client.1.smithi195.stdout:5/14: chown d0/d2/f6 18 1 2024-08-18T22:41:29.938 INFO:tasks.workunit.client.0.smithi121.stdout:0/97: mknod d1/d11/df/d8/c21 0 2024-08-18T22:41:29.939 INFO:tasks.workunit.client.0.smithi121.stdout:2/53: symlink d2/d8/db/dc/ld 0 2024-08-18T22:41:29.940 INFO:tasks.workunit.client.1.smithi195.stdout:1/19: dwrite f0 [4194304,4194304] 0 2024-08-18T22:41:29.940 INFO:tasks.workunit.client.0.smithi121.stdout:8/128: creat d6/d20/f29 x:0 0 0 2024-08-18T22:41:29.941 INFO:tasks.workunit.client.1.smithi195.stdout:2/17: dwrite d1/f2 [4194304,4194304] 0 2024-08-18T22:41:29.942 INFO:tasks.workunit.client.1.smithi195.stdout:7/22: link c6 dc/cd 0 2024-08-18T22:41:29.943 INFO:tasks.workunit.client.0.smithi121.stdout:3/146: mknod d1e/d1f/d25/d2e/c35 0 2024-08-18T22:41:29.944 INFO:tasks.workunit.client.0.smithi121.stdout:3/147: dread - d1e/d1f/d25/f27 zero size 2024-08-18T22:41:29.945 INFO:tasks.workunit.client.0.smithi121.stdout:3/148: write d1e/d1f/d25/f2b [605833,74221] 0 2024-08-18T22:41:29.947 INFO:tasks.workunit.client.1.smithi195.stdout:9/10: rename l4 to l5 0 2024-08-18T22:41:29.948 INFO:tasks.workunit.client.0.smithi121.stdout:0/98: rename d1/d11/df/d8/f17 to d1/d4/db/d18/f22 0 2024-08-18T22:41:29.949 INFO:tasks.workunit.client.0.smithi121.stdout:2/54: creat d2/d3/fe x:0 0 0 2024-08-18T22:41:29.950 INFO:tasks.workunit.client.0.smithi121.stdout:4/128: creat d2/dc/d16/d22/f25 x:0 0 0 2024-08-18T22:41:29.951 INFO:tasks.workunit.client.0.smithi121.stdout:8/129: dread d6/f9 [0,4194304] 0 2024-08-18T22:41:29.951 INFO:tasks.workunit.client.0.smithi121.stdout:4/129: read - d2/dc/d1c/f23 zero size 2024-08-18T22:41:29.954 INFO:tasks.workunit.client.0.smithi121.stdout:3/149: mkdir d1e/d1f/d25/d2e/d36 0 2024-08-18T22:41:29.954 INFO:tasks.workunit.client.0.smithi121.stdout:0/99: rmdir d1/d11/df 39 2024-08-18T22:41:29.955 INFO:tasks.workunit.client.0.smithi121.stdout:0/100: fdatasync d1/d4/db/f1a 0 2024-08-18T22:41:29.955 INFO:tasks.workunit.client.1.smithi195.stdout:0/30: dread d0/f3 [0,4194304] 0 2024-08-18T22:41:29.956 INFO:tasks.workunit.client.0.smithi121.stdout:4/130: creat d2/dc/d16/d1a/f26 x:0 0 0 2024-08-18T22:41:29.956 INFO:tasks.workunit.client.1.smithi195.stdout:1/20: stat c2 0 2024-08-18T22:41:29.957 INFO:tasks.workunit.client.1.smithi195.stdout:9/11: symlink l6 0 2024-08-18T22:41:29.957 INFO:tasks.workunit.client.0.smithi121.stdout:8/130: symlink d6/dd/d25/l2a 0 2024-08-18T22:41:29.958 INFO:tasks.workunit.client.1.smithi195.stdout:3/22: truncate f4 157932 0 2024-08-18T22:41:29.961 INFO:tasks.workunit.client.0.smithi121.stdout:8/131: symlink d6/d1e/l2b 0 2024-08-18T22:41:29.961 INFO:tasks.workunit.client.0.smithi121.stdout:4/131: symlink d2/dc/d16/d22/l27 0 2024-08-18T22:41:29.962 INFO:tasks.workunit.client.0.smithi121.stdout:0/101: stat d1/d11/df/d8/f20 0 2024-08-18T22:41:29.962 INFO:tasks.workunit.client.1.smithi195.stdout:1/21: write f0 [2799592,14800] 0 2024-08-18T22:41:29.962 INFO:tasks.workunit.client.0.smithi121.stdout:8/132: dread - d6/d20/f29 zero size 2024-08-18T22:41:29.963 INFO:tasks.workunit.client.1.smithi195.stdout:7/23: dwrite f7 [0,4194304] 0 2024-08-18T22:41:29.963 INFO:tasks.workunit.client.0.smithi121.stdout:3/150: rename d1e/f28 to d1e/d1f/d25/d2e/d36/f37 0 2024-08-18T22:41:29.965 INFO:tasks.workunit.client.0.smithi121.stdout:0/102: write d1/d4/db/f1a [4906736,121259] 0 2024-08-18T22:41:29.965 INFO:tasks.workunit.client.1.smithi195.stdout:3/23: creat f6 x:0 0 0 2024-08-18T22:41:29.966 INFO:tasks.workunit.client.0.smithi121.stdout:3/151: chown ca 353 1 2024-08-18T22:41:29.968 INFO:tasks.workunit.client.1.smithi195.stdout:1/22: write f0 [306148,19550] 0 2024-08-18T22:41:29.969 INFO:tasks.workunit.client.0.smithi121.stdout:0/103: read d1/d11/df/f7 [1977372,17384] 0 2024-08-18T22:41:29.970 INFO:tasks.workunit.client.0.smithi121.stdout:4/132: getdents d2 0 2024-08-18T22:41:29.970 INFO:tasks.workunit.client.0.smithi121.stdout:8/133: dread d6/f8 [0,4194304] 0 2024-08-18T22:41:29.971 INFO:tasks.workunit.client.1.smithi195.stdout:7/24: rename l8 to dc/le 0 2024-08-18T22:41:29.972 INFO:tasks.workunit.client.0.smithi121.stdout:0/104: write d1/d4/f1f [1026882,68495] 0 2024-08-18T22:41:29.972 INFO:tasks.workunit.client.1.smithi195.stdout:5/15: dwrite d0/d2/f6 [0,4194304] 0 2024-08-18T22:41:29.975 INFO:tasks.workunit.client.0.smithi121.stdout:4/133: truncate d2/f7 2025295 0 2024-08-18T22:41:29.976 INFO:tasks.workunit.client.1.smithi195.stdout:9/12: getdents . 0 2024-08-18T22:41:29.977 INFO:tasks.workunit.client.0.smithi121.stdout:3/152: dwrite d1e/f31 [0,4194304] 0 2024-08-18T22:41:29.977 INFO:tasks.workunit.client.0.smithi121.stdout:8/134: creat d6/d17/d18/f2c x:0 0 0 2024-08-18T22:41:29.978 INFO:tasks.workunit.client.1.smithi195.stdout:0/31: dwrite d0/f3 [0,4194304] 0 2024-08-18T22:41:29.979 INFO:tasks.workunit.client.0.smithi121.stdout:0/105: write d1/d4/db/d18/f22 [1392185,63345] 0 2024-08-18T22:41:29.979 INFO:tasks.workunit.client.1.smithi195.stdout:2/18: truncate d1/f2 2429690 0 2024-08-18T22:41:29.979 INFO:tasks.workunit.client.1.smithi195.stdout:9/13: write f0 [9230078,81347] 0 2024-08-18T22:41:29.983 INFO:tasks.workunit.client.1.smithi195.stdout:3/24: dread f1 [0,4194304] 0 2024-08-18T22:41:29.984 INFO:tasks.workunit.client.1.smithi195.stdout:1/23: dread f0 [0,4194304] 0 2024-08-18T22:41:29.984 INFO:tasks.workunit.client.1.smithi195.stdout:3/25: readlink l3 0 2024-08-18T22:41:29.985 INFO:tasks.workunit.client.1.smithi195.stdout:7/25: unlink f7 0 2024-08-18T22:41:29.985 INFO:tasks.workunit.client.1.smithi195.stdout:0/32: creat d0/f6 x:0 0 0 2024-08-18T22:41:29.986 INFO:tasks.workunit.client.1.smithi195.stdout:2/19: symlink d1/l3 0 2024-08-18T22:41:29.988 INFO:tasks.workunit.client.1.smithi195.stdout:1/24: write f0 [5207439,129523] 0 2024-08-18T22:41:29.990 INFO:tasks.workunit.client.1.smithi195.stdout:7/26: creat dc/ff x:0 0 0 2024-08-18T22:41:29.991 INFO:tasks.workunit.client.0.smithi121.stdout:9/196: dwrite d0/d5/f25 [0,4194304] 0 2024-08-18T22:41:29.993 INFO:tasks.workunit.client.0.smithi121.stdout:9/197: write d0/d5/dd/d1a/f37 [1035512,74015] 0 2024-08-18T22:41:29.993 INFO:tasks.workunit.client.1.smithi195.stdout:1/25: symlink l3 0 2024-08-18T22:41:29.994 INFO:tasks.workunit.client.1.smithi195.stdout:1/26: stat l3 0 2024-08-18T22:41:29.995 INFO:tasks.workunit.client.0.smithi121.stdout:4/134: rmdir d2/dc/d16/d1a/d24 0 2024-08-18T22:41:29.996 INFO:tasks.workunit.client.1.smithi195.stdout:7/27: creat dc/f10 x:0 0 0 2024-08-18T22:41:29.998 INFO:tasks.workunit.client.1.smithi195.stdout:1/27: symlink l4 0 2024-08-18T22:41:29.998 INFO:tasks.workunit.client.0.smithi121.stdout:4/135: fdatasync d2/dc/d16/d22/f25 0 2024-08-18T22:41:29.998 INFO:tasks.workunit.client.1.smithi195.stdout:3/26: dwrite f4 [0,4194304] 0 2024-08-18T22:41:30.000 INFO:tasks.workunit.client.1.smithi195.stdout:7/28: mknod dc/c11 0 2024-08-18T22:41:30.001 INFO:tasks.workunit.client.0.smithi121.stdout:9/198: dread d0/d5/f30 [0,4194304] 0 2024-08-18T22:41:30.002 INFO:tasks.workunit.client.1.smithi195.stdout:1/28: creat f5 x:0 0 0 2024-08-18T22:41:30.002 INFO:tasks.workunit.client.0.smithi121.stdout:4/136: rename d2/dc/d16/c1d to d2/dc/c28 0 2024-08-18T22:41:30.004 INFO:tasks.workunit.client.1.smithi195.stdout:2/20: dread d1/f2 [0,4194304] 0 2024-08-18T22:41:30.005 INFO:tasks.workunit.client.1.smithi195.stdout:7/29: symlink dc/l12 0 2024-08-18T22:41:30.007 INFO:tasks.workunit.client.1.smithi195.stdout:5/16: fdatasync d0/d2/f6 0 2024-08-18T22:41:30.008 INFO:tasks.workunit.client.0.smithi121.stdout:8/135: truncate d6/f8 1301234 0 2024-08-18T22:41:30.010 INFO:tasks.workunit.client.0.smithi121.stdout:8/136: write d6/d20/f26 [578860,57703] 0 2024-08-18T22:41:30.011 INFO:tasks.workunit.client.0.smithi121.stdout:0/106: truncate d1/fd 4948165 0 2024-08-18T22:41:30.011 INFO:tasks.workunit.client.0.smithi121.stdout:8/137: dread - d6/dd/f16 zero size 2024-08-18T22:41:30.011 INFO:tasks.workunit.client.1.smithi195.stdout:5/17: unlink d0/l4 0 2024-08-18T22:41:30.012 INFO:tasks.workunit.client.0.smithi121.stdout:0/107: fdatasync d1/d11/df/d8/f20 0 2024-08-18T22:41:30.013 INFO:tasks.workunit.client.1.smithi195.stdout:3/27: dwrite f4 [0,4194304] 0 2024-08-18T22:41:30.013 INFO:tasks.workunit.client.0.smithi121.stdout:8/138: mkdir d6/d1e/d2d 0 2024-08-18T22:41:30.014 INFO:tasks.workunit.client.1.smithi195.stdout:2/21: rmdir d1 39 2024-08-18T22:41:30.014 INFO:tasks.workunit.client.1.smithi195.stdout:1/29: dwrite f0 [4194304,4194304] 0 2024-08-18T22:41:30.014 INFO:tasks.workunit.client.0.smithi121.stdout:3/153: truncate f1c 2645531 0 2024-08-18T22:41:30.015 INFO:tasks.workunit.client.1.smithi195.stdout:1/30: read - f5 zero size 2024-08-18T22:41:30.016 INFO:tasks.workunit.client.1.smithi195.stdout:0/33: truncate d0/f3 2311111 0 2024-08-18T22:41:30.017 INFO:tasks.workunit.client.0.smithi121.stdout:4/137: rename d2/dc/d16/d1a to d2/dc/d16/d22/d29 0 2024-08-18T22:41:30.017 INFO:tasks.workunit.client.0.smithi121.stdout:4/138: fdatasync d2/fb 0 2024-08-18T22:41:30.018 INFO:tasks.workunit.client.1.smithi195.stdout:3/28: mkdir d7 0 2024-08-18T22:41:30.020 INFO:tasks.workunit.client.0.smithi121.stdout:8/139: mkdir d6/d2e 0 2024-08-18T22:41:30.021 INFO:tasks.workunit.client.1.smithi195.stdout:1/31: creat f6 x:0 0 0 2024-08-18T22:41:30.022 INFO:tasks.workunit.client.0.smithi121.stdout:9/199: dread d0/d6/df/f20 [0,4194304] 0 2024-08-18T22:41:30.025 INFO:tasks.workunit.client.0.smithi121.stdout:9/200: chown d0/d5/dd/c14 25964995 1 2024-08-18T22:41:30.026 INFO:tasks.workunit.client.0.smithi121.stdout:8/140: symlink d6/d17/l2f 0 2024-08-18T22:41:30.027 INFO:tasks.workunit.client.0.smithi121.stdout:8/141: chown d6/d20/f26 21 1 2024-08-18T22:41:30.028 INFO:tasks.workunit.client.1.smithi195.stdout:2/22: link l0 d1/l4 0 2024-08-18T22:41:30.028 INFO:tasks.workunit.client.0.smithi121.stdout:4/139: dwrite d2/f21 [0,4194304] 0 2024-08-18T22:41:30.028 INFO:tasks.workunit.client.1.smithi195.stdout:3/29: dwrite f6 [0,4194304] 0 2024-08-18T22:41:30.029 INFO:tasks.workunit.client.1.smithi195.stdout:1/32: link f6 f7 0 2024-08-18T22:41:30.031 INFO:tasks.workunit.client.1.smithi195.stdout:1/33: mknod c8 0 2024-08-18T22:41:30.032 INFO:tasks.workunit.client.0.smithi121.stdout:8/142: chown d6/f19 8768595 1 2024-08-18T22:41:30.033 INFO:tasks.workunit.client.1.smithi195.stdout:1/34: write f5 [355152,58468] 0 2024-08-18T22:41:30.033 INFO:tasks.workunit.client.1.smithi195.stdout:3/30: link c2 d7/c8 0 2024-08-18T22:41:30.035 INFO:tasks.workunit.client.0.smithi121.stdout:9/201: mkdir d0/d38/d44 0 2024-08-18T22:41:30.036 INFO:tasks.workunit.client.1.smithi195.stdout:0/34: truncate d0/f3 2330634 0 2024-08-18T22:41:30.036 INFO:tasks.workunit.client.0.smithi121.stdout:9/202: readlink d0/d6/df/l36 0 2024-08-18T22:41:30.037 INFO:tasks.workunit.client.0.smithi121.stdout:4/140: symlink d2/dc/l2a 0 2024-08-18T22:41:30.038 INFO:tasks.workunit.client.1.smithi195.stdout:1/35: truncate f6 25577 0 2024-08-18T22:41:30.039 INFO:tasks.workunit.client.0.smithi121.stdout:4/141: rename d2/dc/d16/d22 to d2/dc/d16/d22/d29/d2b 22 2024-08-18T22:41:30.039 INFO:tasks.workunit.client.0.smithi121.stdout:8/143: symlink d6/d17/l30 0 2024-08-18T22:41:30.040 INFO:tasks.workunit.client.1.smithi195.stdout:0/35: mknod d0/c7 0 2024-08-18T22:41:30.042 INFO:tasks.workunit.client.1.smithi195.stdout:1/36: symlink l9 0 2024-08-18T22:41:30.042 INFO:tasks.workunit.client.1.smithi195.stdout:2/23: dwrite d1/f2 [0,4194304] 0 2024-08-18T22:41:30.043 INFO:tasks.workunit.client.0.smithi121.stdout:8/144: mknod d6/dd/c31 0 2024-08-18T22:41:30.043 INFO:tasks.workunit.client.1.smithi195.stdout:3/31: creat d7/f9 x:0 0 0 2024-08-18T22:41:30.045 INFO:tasks.workunit.client.1.smithi195.stdout:1/37: mkdir da 0 2024-08-18T22:41:30.046 INFO:tasks.workunit.client.1.smithi195.stdout:2/24: creat d1/f5 x:0 0 0 2024-08-18T22:41:30.047 INFO:tasks.workunit.client.0.smithi121.stdout:0/108: dwrite d1/d11/df/f7 [0,4194304] 0 2024-08-18T22:41:30.047 INFO:tasks.workunit.client.1.smithi195.stdout:1/38: truncate f5 1343959 0 2024-08-18T22:41:30.048 INFO:tasks.workunit.client.0.smithi121.stdout:9/203: getdents d0/d5/dd/d3b 0 2024-08-18T22:41:30.049 INFO:tasks.workunit.client.0.smithi121.stdout:8/145: dread d6/dd/f1b [0,4194304] 0 2024-08-18T22:41:30.049 INFO:tasks.workunit.client.0.smithi121.stdout:0/109: read d1/d4/f1f [72131,98165] 0 2024-08-18T22:41:30.050 INFO:tasks.workunit.client.1.smithi195.stdout:1/39: mknod da/cb 0 2024-08-18T22:41:30.051 INFO:tasks.workunit.client.0.smithi121.stdout:9/204: chown d0/d6/c29 7428 1 2024-08-18T22:41:30.051 INFO:tasks.workunit.client.0.smithi121.stdout:8/146: write d6/f14 [1063505,14736] 0 2024-08-18T22:41:30.052 INFO:tasks.workunit.client.0.smithi121.stdout:9/205: stat d0/d38/d44 0 2024-08-18T22:41:30.053 INFO:tasks.workunit.client.0.smithi121.stdout:9/206: fdatasync d0/d6/d18/f1d 0 2024-08-18T22:41:30.053 INFO:tasks.workunit.client.0.smithi121.stdout:0/110: creat d1/d4/db/d18/f23 x:0 0 0 2024-08-18T22:41:30.054 INFO:tasks.workunit.client.1.smithi195.stdout:1/40: rename l4 to da/lc 0 2024-08-18T22:41:30.055 INFO:tasks.workunit.client.0.smithi121.stdout:0/111: write d1/d4/db/f1a [4807390,57066] 0 2024-08-18T22:41:30.055 INFO:tasks.workunit.client.0.smithi121.stdout:8/147: rename d6/f19 to d6/d17/d18/f32 0 2024-08-18T22:41:30.056 INFO:tasks.workunit.client.1.smithi195.stdout:2/25: dwrite d1/f2 [0,4194304] 0 2024-08-18T22:41:30.057 INFO:tasks.workunit.client.1.smithi195.stdout:1/41: read f6 [4736,101237] 0 2024-08-18T22:41:30.057 INFO:tasks.workunit.client.0.smithi121.stdout:9/207: rmdir d0/d5 39 2024-08-18T22:41:30.059 INFO:tasks.workunit.client.1.smithi195.stdout:1/42: stat f5 0 2024-08-18T22:41:30.060 INFO:tasks.workunit.client.0.smithi121.stdout:8/148: unlink d6/d17/l30 0 2024-08-18T22:41:30.063 INFO:tasks.workunit.client.0.smithi121.stdout:8/149: dread d6/f9 [4194304,4194304] 0 2024-08-18T22:41:30.063 INFO:tasks.workunit.client.0.smithi121.stdout:0/112: rename d1/d11 to d1/d4/db/d24 0 2024-08-18T22:41:30.065 INFO:tasks.workunit.client.0.smithi121.stdout:9/208: dread d0/f1e [0,4194304] 0 2024-08-18T22:41:30.066 INFO:tasks.workunit.client.1.smithi195.stdout:2/26: fsync d1/f5 0 2024-08-18T22:41:30.067 INFO:tasks.workunit.client.1.smithi195.stdout:0/36: dread d0/f3 [0,4194304] 0 2024-08-18T22:41:30.069 INFO:tasks.workunit.client.1.smithi195.stdout:2/27: mknod d1/c6 0 2024-08-18T22:41:30.069 INFO:tasks.workunit.client.0.smithi121.stdout:0/113: mknod d1/c25 0 2024-08-18T22:41:30.069 INFO:tasks.workunit.client.0.smithi121.stdout:4/142: truncate d2/f14 280923 0 2024-08-18T22:41:30.070 INFO:tasks.workunit.client.1.smithi195.stdout:0/37: creat d0/f8 x:0 0 0 2024-08-18T22:41:30.070 INFO:tasks.workunit.client.0.smithi121.stdout:9/209: mkdir d0/d6/d45 0 2024-08-18T22:41:30.071 INFO:tasks.workunit.client.0.smithi121.stdout:0/114: mknod d1/d4/db/c26 0 2024-08-18T22:41:30.071 INFO:tasks.workunit.client.1.smithi195.stdout:0/38: chown d0/l4 0 1 2024-08-18T22:41:30.071 INFO:tasks.workunit.client.0.smithi121.stdout:4/143: mkdir d2/dc/d16/d22/d2c 0 2024-08-18T22:41:30.074 INFO:tasks.workunit.client.1.smithi195.stdout:0/39: rename d0/f6 to d0/f9 0 2024-08-18T22:41:30.075 INFO:tasks.workunit.client.0.smithi121.stdout:0/115: dread d1/d4/db/d24/df/d8/f20 [0,4194304] 0 2024-08-18T22:41:30.075 INFO:tasks.workunit.client.0.smithi121.stdout:8/150: truncate d6/f8 913456 0 2024-08-18T22:41:30.075 INFO:tasks.workunit.client.1.smithi195.stdout:1/43: dwrite f6 [0,4194304] 0 2024-08-18T22:41:30.075 INFO:tasks.workunit.client.1.smithi195.stdout:2/28: dread d1/f2 [0,4194304] 0 2024-08-18T22:41:30.078 INFO:tasks.workunit.client.1.smithi195.stdout:2/29: rename d1/c6 to d1/c7 0 2024-08-18T22:41:30.078 INFO:tasks.workunit.client.0.smithi121.stdout:4/144: dread d2/f8 [0,4194304] 0 2024-08-18T22:41:30.080 INFO:tasks.workunit.client.0.smithi121.stdout:0/116: dread d1/d4/db/d24/df/d8/f20 [0,4194304] 0 2024-08-18T22:41:30.080 INFO:tasks.workunit.client.1.smithi195.stdout:2/30: mkdir d1/d8 0 2024-08-18T22:41:30.081 INFO:tasks.workunit.client.1.smithi195.stdout:1/44: getdents da 0 2024-08-18T22:41:30.081 INFO:tasks.workunit.client.1.smithi195.stdout:1/45: chown da 40061211 1 2024-08-18T22:41:30.082 INFO:tasks.workunit.client.1.smithi195.stdout:1/46: write f5 [2060175,13659] 0 2024-08-18T22:41:30.082 INFO:tasks.workunit.client.1.smithi195.stdout:0/40: rmdir d0 39 2024-08-18T22:41:30.084 INFO:tasks.workunit.client.1.smithi195.stdout:1/47: creat da/fd x:0 0 0 2024-08-18T22:41:30.086 INFO:tasks.workunit.client.0.smithi121.stdout:4/145: creat d2/f2d x:0 0 0 2024-08-18T22:41:30.087 INFO:tasks.workunit.client.0.smithi121.stdout:9/210: dread d0/d5/dd/d3b/f3e [0,4194304] 0 2024-08-18T22:41:30.087 INFO:tasks.workunit.client.0.smithi121.stdout:8/151: dwrite d6/d20/f26 [0,4194304] 0 2024-08-18T22:41:30.089 INFO:tasks.workunit.client.0.smithi121.stdout:0/117: rename d1/l12 to d1/d4/db/d18/d1c/l27 0 2024-08-18T22:41:30.090 INFO:tasks.workunit.client.0.smithi121.stdout:0/118: readlink d1/d4/da/l16 0 2024-08-18T22:41:30.092 INFO:tasks.workunit.client.1.smithi195.stdout:1/48: dread f0 [0,4194304] 0 2024-08-18T22:41:30.093 INFO:tasks.workunit.client.0.smithi121.stdout:8/152: dread d6/f9 [0,4194304] 0 2024-08-18T22:41:30.093 INFO:tasks.workunit.client.1.smithi195.stdout:1/49: stat f7 0 2024-08-18T22:41:30.094 INFO:tasks.workunit.client.0.smithi121.stdout:8/153: write d6/dd/f16 [1003703,49425] 0 2024-08-18T22:41:30.094 INFO:tasks.workunit.client.0.smithi121.stdout:0/119: creat d1/d4/da/f28 x:0 0 0 2024-08-18T22:41:30.095 INFO:tasks.workunit.client.1.smithi195.stdout:0/41: dwrite d0/f8 [0,4194304] 0 2024-08-18T22:41:30.095 INFO:tasks.workunit.client.1.smithi195.stdout:2/31: getdents d1 0 2024-08-18T22:41:30.095 INFO:tasks.workunit.client.0.smithi121.stdout:9/211: creat d0/d5/dd/d3f/f46 x:0 0 0 2024-08-18T22:41:30.096 INFO:tasks.workunit.client.0.smithi121.stdout:8/154: chown d6/d17/d18/f32 8354 1 2024-08-18T22:41:30.097 INFO:tasks.workunit.client.1.smithi195.stdout:1/50: creat da/fe x:0 0 0 2024-08-18T22:41:30.097 INFO:tasks.workunit.client.1.smithi195.stdout:2/32: truncate d1/f5 398672 0 2024-08-18T22:41:30.100 INFO:tasks.workunit.client.1.smithi195.stdout:1/51: write da/fd [634672,20948] 0 2024-08-18T22:41:30.100 INFO:tasks.workunit.client.1.smithi195.stdout:2/33: mkdir d1/d9 0 2024-08-18T22:41:30.102 INFO:tasks.workunit.client.0.smithi121.stdout:9/212: rename d0/d5/dd/d19 to d0/d38/d47 0 2024-08-18T22:41:30.104 INFO:tasks.workunit.client.1.smithi195.stdout:2/34: fdatasync d1/f2 0 2024-08-18T22:41:30.106 INFO:tasks.workunit.client.1.smithi195.stdout:1/52: rename l9 to da/lf 0 2024-08-18T22:41:30.107 INFO:tasks.workunit.client.0.smithi121.stdout:0/120: dwrite d1/d4/db/d24/f10 [0,4194304] 0 2024-08-18T22:41:30.107 INFO:tasks.workunit.client.0.smithi121.stdout:8/155: dread d6/d17/d18/f32 [0,4194304] 0 2024-08-18T22:41:30.109 INFO:tasks.workunit.client.1.smithi195.stdout:2/35: creat d1/d9/fa x:0 0 0 2024-08-18T22:41:30.110 INFO:tasks.workunit.client.0.smithi121.stdout:4/146: chown d2/l15 93692679 1 2024-08-18T22:41:30.110 INFO:tasks.workunit.client.0.smithi121.stdout:9/213: dread d0/d5/f9 [0,4194304] 0 2024-08-18T22:41:30.111 INFO:tasks.workunit.client.1.smithi195.stdout:0/42: dwrite d0/f9 [0,4194304] 0 2024-08-18T22:41:30.111 INFO:tasks.workunit.client.0.smithi121.stdout:8/156: mknod d6/d17/d18/c33 0 2024-08-18T22:41:30.111 INFO:tasks.workunit.client.1.smithi195.stdout:0/43: chown d0/f9 5540668 1 2024-08-18T22:41:30.111 INFO:tasks.workunit.client.1.smithi195.stdout:0/44: chown d0 128025 1 2024-08-18T22:41:30.112 INFO:tasks.workunit.client.0.smithi121.stdout:9/214: mkdir d0/d5/dd/d3b/d48 0 2024-08-18T22:41:30.113 INFO:tasks.workunit.client.0.smithi121.stdout:8/157: symlink d6/d1e/l34 0 2024-08-18T22:41:30.113 INFO:tasks.workunit.client.1.smithi195.stdout:1/53: creat da/f10 x:0 0 0 2024-08-18T22:41:30.113 INFO:tasks.workunit.client.1.smithi195.stdout:2/36: mkdir d1/db 0 2024-08-18T22:41:30.114 INFO:tasks.workunit.client.0.smithi121.stdout:9/215: read d0/d6/d18/f2d [3563501,16459] 0 2024-08-18T22:41:30.115 INFO:tasks.workunit.client.0.smithi121.stdout:8/158: creat d6/d1e/f35 x:0 0 0 2024-08-18T22:41:30.115 INFO:tasks.workunit.client.1.smithi195.stdout:2/37: write d1/f5 [1325983,107156] 0 2024-08-18T22:41:30.115 INFO:tasks.workunit.client.1.smithi195.stdout:0/45: symlink d0/la 0 2024-08-18T22:41:30.116 INFO:tasks.workunit.client.0.smithi121.stdout:9/216: symlink d0/d6/d18/l49 0 2024-08-18T22:41:30.119 INFO:tasks.workunit.client.0.smithi121.stdout:9/217: rename d0/d5/dd/d1a/c2e to d0/d5/dd/d2f/c4a 0 2024-08-18T22:41:30.119 INFO:tasks.workunit.client.0.smithi121.stdout:8/159: link d6/d17/l2f d6/d1e/l36 0 2024-08-18T22:41:30.119 INFO:tasks.workunit.client.1.smithi195.stdout:1/54: creat da/f11 x:0 0 0 2024-08-18T22:41:30.119 INFO:tasks.workunit.client.1.smithi195.stdout:1/55: chown c2 2463535 1 2024-08-18T22:41:30.120 INFO:tasks.workunit.client.0.smithi121.stdout:9/218: dread - d0/d5/dd/d3f/f46 zero size 2024-08-18T22:41:30.121 INFO:tasks.workunit.client.1.smithi195.stdout:1/56: write f7 [3183824,36037] 0 2024-08-18T22:41:30.121 INFO:tasks.workunit.client.0.smithi121.stdout:8/160: mkdir d6/d17/d37 0 2024-08-18T22:41:30.121 INFO:tasks.workunit.client.1.smithi195.stdout:1/57: chown c2 342 1 2024-08-18T22:41:30.121 INFO:tasks.workunit.client.1.smithi195.stdout:0/46: creat d0/fb x:0 0 0 2024-08-18T22:41:30.122 INFO:tasks.workunit.client.1.smithi195.stdout:1/58: read - da/f10 zero size 2024-08-18T22:41:30.123 INFO:tasks.workunit.client.1.smithi195.stdout:2/38: unlink d1/c7 0 2024-08-18T22:41:30.124 INFO:tasks.workunit.client.1.smithi195.stdout:0/47: mkdir d0/dc 0 2024-08-18T22:41:30.124 INFO:tasks.workunit.client.0.smithi121.stdout:8/161: rename d6/d20/l24 to d6/d17/d37/l38 0 2024-08-18T22:41:30.125 INFO:tasks.workunit.client.1.smithi195.stdout:1/59: creat da/f12 x:0 0 0 2024-08-18T22:41:30.127 INFO:tasks.workunit.client.0.smithi121.stdout:8/162: read d6/f14 [1075386,91172] 0 2024-08-18T22:41:30.128 INFO:tasks.workunit.client.1.smithi195.stdout:1/60: link da/f11 da/f13 0 2024-08-18T22:41:30.129 INFO:tasks.workunit.client.0.smithi121.stdout:8/163: unlink d6/c27 0 2024-08-18T22:41:30.129 INFO:tasks.workunit.client.1.smithi195.stdout:2/39: rmdir d1/db 0 2024-08-18T22:41:30.129 INFO:tasks.workunit.client.0.smithi121.stdout:8/164: readlink d6/d1e/l2b 0 2024-08-18T22:41:30.131 INFO:tasks.workunit.client.1.smithi195.stdout:1/61: unlink f0 0 2024-08-18T22:41:30.132 INFO:tasks.workunit.client.0.smithi121.stdout:8/165: mknod d6/d1e/d2d/c39 0 2024-08-18T22:41:30.133 INFO:tasks.workunit.client.1.smithi195.stdout:0/48: dwrite d0/fb [0,4194304] 0 2024-08-18T22:41:30.134 INFO:tasks.workunit.client.1.smithi195.stdout:1/62: symlink da/l14 0 2024-08-18T22:41:30.136 INFO:tasks.workunit.client.0.smithi121.stdout:8/166: dread d6/d17/d18/f32 [0,4194304] 0 2024-08-18T22:41:30.136 INFO:tasks.workunit.client.0.smithi121.stdout:8/167: stat d6/d20 0 2024-08-18T22:41:30.138 INFO:tasks.workunit.client.1.smithi195.stdout:1/63: chown da/cb 1092 1 2024-08-18T22:41:30.139 INFO:tasks.workunit.client.0.smithi121.stdout:8/168: creat d6/d17/d18/f3a x:0 0 0 2024-08-18T22:41:30.140 INFO:tasks.workunit.client.0.smithi121.stdout:9/219: dwrite d0/d5/fe [4194304,4194304] 0 2024-08-18T22:41:30.140 INFO:tasks.workunit.client.1.smithi195.stdout:1/64: truncate da/fd 1171183 0 2024-08-18T22:41:30.141 INFO:tasks.workunit.client.0.smithi121.stdout:8/169: write d6/d17/d18/f3a [609635,54297] 0 2024-08-18T22:41:30.141 INFO:tasks.workunit.client.1.smithi195.stdout:2/40: dwrite d1/f5 [0,4194304] 0 2024-08-18T22:41:30.142 INFO:tasks.workunit.client.1.smithi195.stdout:1/65: truncate da/f11 348554 0 2024-08-18T22:41:30.144 INFO:tasks.workunit.client.1.smithi195.stdout:2/41: creat d1/d9/fc x:0 0 0 2024-08-18T22:41:30.145 INFO:tasks.workunit.client.1.smithi195.stdout:1/66: creat da/f15 x:0 0 0 2024-08-18T22:41:30.145 INFO:tasks.workunit.client.0.smithi121.stdout:9/220: mknod d0/c4b 0 2024-08-18T22:41:30.146 INFO:tasks.workunit.client.0.smithi121.stdout:9/221: dread - d0/d5/dd/d2f/f3c zero size 2024-08-18T22:41:30.147 INFO:tasks.workunit.client.1.smithi195.stdout:1/67: mknod da/c16 0 2024-08-18T22:41:30.147 INFO:tasks.workunit.client.1.smithi195.stdout:1/68: dread - da/f15 zero size 2024-08-18T22:41:30.148 INFO:tasks.workunit.client.1.smithi195.stdout:2/42: mknod d1/d8/cd 0 2024-08-18T22:41:30.148 INFO:tasks.workunit.client.0.smithi121.stdout:9/222: write d0/d38/d47/f33 [566742,3616] 0 2024-08-18T22:41:30.148 INFO:tasks.workunit.client.1.smithi195.stdout:0/49: truncate d0/f3 2110769 0 2024-08-18T22:41:30.149 INFO:tasks.workunit.client.0.smithi121.stdout:9/223: chown d0/d5/dd/d3b/d48 732 1 2024-08-18T22:41:30.150 INFO:tasks.workunit.client.0.smithi121.stdout:9/224: chown d0/d6/f1f 225224 1 2024-08-18T22:41:30.150 INFO:tasks.workunit.client.1.smithi195.stdout:2/43: creat d1/d9/fe x:0 0 0 2024-08-18T22:41:30.152 INFO:tasks.workunit.client.0.smithi121.stdout:9/225: write d0/d5/dd/d3f/f46 [573658,82311] 0 2024-08-18T22:41:30.152 INFO:tasks.workunit.client.1.smithi195.stdout:0/50: mkdir d0/dc/dd 0 2024-08-18T22:41:30.152 INFO:tasks.workunit.client.1.smithi195.stdout:0/51: chown d0/dc 1 1 2024-08-18T22:41:30.154 INFO:tasks.workunit.client.1.smithi195.stdout:0/52: write d0/f8 [3053117,129287] 0 2024-08-18T22:41:30.155 INFO:tasks.workunit.client.0.smithi121.stdout:9/226: rename d0/d6 to d0/d38/d47/d4c 0 2024-08-18T22:41:30.155 INFO:tasks.workunit.client.1.smithi195.stdout:2/44: getdents d1 0 2024-08-18T22:41:30.156 INFO:tasks.workunit.client.0.smithi121.stdout:9/227: truncate d0/d5/dd/d2f/f3c 170308 0 2024-08-18T22:41:30.157 INFO:tasks.workunit.client.0.smithi121.stdout:9/228: unlink d0/l21 0 2024-08-18T22:41:30.158 INFO:tasks.workunit.client.0.smithi121.stdout:9/229: fdatasync d0/d5/dd/d1a/f37 0 2024-08-18T22:41:30.158 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:41:29 smithi195 ceph-mon[23370]: pgmap v240: 65 pgs: 65 active+clean; 237 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 117 KiB/s rd, 10 MiB/s wr, 560 op/s 2024-08-18T22:41:30.160 INFO:tasks.workunit.client.0.smithi121.stdout:9/230: creat d0/d5/dd/d1a/f4d x:0 0 0 2024-08-18T22:41:30.160 INFO:tasks.workunit.client.1.smithi195.stdout:0/53: dread d0/f8 [0,4194304] 0 2024-08-18T22:41:30.163 INFO:tasks.workunit.client.0.smithi121.stdout:9/231: dread d0/d5/f25 [0,4194304] 0 2024-08-18T22:41:30.163 INFO:tasks.workunit.client.1.smithi195.stdout:2/45: dwrite d1/f5 [0,4194304] 0 2024-08-18T22:41:30.164 INFO:tasks.workunit.client.0.smithi121.stdout:9/232: chown d0/d38/d47/l22 65991904 1 2024-08-18T22:41:30.166 INFO:tasks.workunit.client.1.smithi195.stdout:2/46: creat d1/d9/ff x:0 0 0 2024-08-18T22:41:30.167 INFO:tasks.workunit.client.0.smithi121.stdout:9/233: unlink d0/d38/d47/d4c/d18/f2d 0 2024-08-18T22:41:30.168 INFO:tasks.workunit.client.1.smithi195.stdout:1/69: getdents da 0 2024-08-18T22:41:30.168 INFO:tasks.workunit.client.1.smithi195.stdout:2/47: creat d1/f10 x:0 0 0 2024-08-18T22:41:30.169 INFO:tasks.workunit.client.1.smithi195.stdout:0/54: dwrite d0/f9 [4194304,4194304] 0 2024-08-18T22:41:30.169 INFO:tasks.workunit.client.0.smithi121.stdout:9/234: creat d0/d38/f4e x:0 0 0 2024-08-18T22:41:30.171 INFO:tasks.workunit.client.1.smithi195.stdout:1/70: mknod da/c17 0 2024-08-18T22:41:30.171 INFO:tasks.workunit.client.0.smithi121.stdout:8/170: write d6/f8 [1477662,43864] 0 2024-08-18T22:41:30.172 INFO:tasks.workunit.client.0.smithi121.stdout:8/171: read - d6/d20/f29 zero size 2024-08-18T22:41:30.173 INFO:tasks.workunit.client.0.smithi121.stdout:9/235: creat d0/d38/d47/d4c/d18/f4f x:0 0 0 2024-08-18T22:41:30.174 INFO:tasks.workunit.client.0.smithi121.stdout:8/172: chown d6/d1e/l36 2 1 2024-08-18T22:41:30.175 INFO:tasks.workunit.client.0.smithi121.stdout:8/173: readlink d6/d1e/l36 0 2024-08-18T22:41:30.175 INFO:tasks.workunit.client.1.smithi195.stdout:0/55: write d0/f9 [8770184,109982] 0 2024-08-18T22:41:30.176 INFO:tasks.workunit.client.0.smithi121.stdout:9/236: creat d0/d5/dd/d2f/f50 x:0 0 0 2024-08-18T22:41:30.178 INFO:tasks.workunit.client.0.smithi121.stdout:9/237: fsync d0/d5/f30 0 2024-08-18T22:41:30.180 INFO:tasks.workunit.client.0.smithi121.stdout:8/174: rmdir d6/d2e 0 2024-08-18T22:41:30.182 INFO:tasks.workunit.client.0.smithi121.stdout:8/175: mkdir d6/dd/d3b 0 2024-08-18T22:41:30.183 INFO:tasks.workunit.client.1.smithi195.stdout:2/48: dwrite d1/f10 [0,4194304] 0 2024-08-18T22:41:30.185 INFO:tasks.workunit.client.1.smithi195.stdout:2/49: chown d1/d8 38 1 2024-08-18T22:41:30.185 INFO:tasks.workunit.client.0.smithi121.stdout:9/238: dwrite d0/f1e [0,4194304] 0 2024-08-18T22:41:30.185 INFO:tasks.workunit.client.0.smithi121.stdout:8/176: dread f5 [4194304,4194304] 0 2024-08-18T22:41:30.186 INFO:tasks.workunit.client.0.smithi121.stdout:8/177: chown d6/dd/c21 65546877 1 2024-08-18T22:41:30.187 INFO:tasks.workunit.client.1.smithi195.stdout:1/71: dwrite f7 [4194304,4194304] 0 2024-08-18T22:41:30.187 INFO:tasks.workunit.client.0.smithi121.stdout:8/178: truncate d6/d20/f29 501807 0 2024-08-18T22:41:30.188 INFO:tasks.workunit.client.1.smithi195.stdout:2/50: creat d1/d8/f11 x:0 0 0 2024-08-18T22:41:30.188 INFO:tasks.workunit.client.0.smithi121.stdout:8/179: write d6/d20/f29 [950345,128322] 0 2024-08-18T22:41:30.189 INFO:tasks.workunit.client.1.smithi195.stdout:2/51: write d1/d9/fe [570313,788] 0 2024-08-18T22:41:30.190 INFO:tasks.workunit.client.0.smithi121.stdout:8/180: write d6/d17/d18/f3a [573426,593] 0 2024-08-18T22:41:30.190 INFO:tasks.workunit.client.1.smithi195.stdout:1/72: mkdir da/d18 0 2024-08-18T22:41:30.190 INFO:tasks.workunit.client.1.smithi195.stdout:2/52: dread - d1/d9/fc zero size 2024-08-18T22:41:30.191 INFO:tasks.workunit.client.1.smithi195.stdout:1/73: stat da/fe 0 2024-08-18T22:41:30.193 INFO:tasks.workunit.client.1.smithi195.stdout:2/53: truncate d1/d9/fc 397179 0 2024-08-18T22:41:30.195 INFO:tasks.workunit.client.0.smithi121.stdout:8/181: rename d6/d17/d37/l38 to d6/l3c 0 2024-08-18T22:41:30.198 INFO:tasks.workunit.client.0.smithi121.stdout:8/182: write d6/f14 [2132889,1621] 0 2024-08-18T22:41:30.202 INFO:tasks.workunit.client.0.smithi121.stdout:8/183: rename d6/f14 to d6/d1e/d2d/f3d 0 2024-08-18T22:41:30.205 INFO:tasks.workunit.client.1.smithi195.stdout:1/74: dwrite da/fe [0,4194304] 0 2024-08-18T22:41:30.206 INFO:tasks.workunit.client.0.smithi121.stdout:8/184: symlink d6/dd/d25/l3e 0 2024-08-18T22:41:30.207 INFO:tasks.workunit.client.0.smithi121.stdout:8/185: read - d6/d17/f1d zero size 2024-08-18T22:41:30.207 INFO:tasks.workunit.client.0.smithi121.stdout:9/239: truncate d0/d38/d47/d4c/fc 4928216 0 2024-08-18T22:41:30.208 INFO:tasks.workunit.client.1.smithi195.stdout:2/54: dwrite d1/d9/ff [0,4194304] 0 2024-08-18T22:41:30.209 INFO:tasks.workunit.client.0.smithi121.stdout:8/186: fdatasync d6/dd/f1b 0 2024-08-18T22:41:30.210 INFO:tasks.workunit.client.0.smithi121.stdout:9/240: creat d0/d38/d47/f51 x:0 0 0 2024-08-18T22:41:30.210 INFO:tasks.workunit.client.0.smithi121.stdout:8/187: creat d6/d1e/f3f x:0 0 0 2024-08-18T22:41:30.211 INFO:tasks.workunit.client.1.smithi195.stdout:1/75: link l3 da/d18/l19 0 2024-08-18T22:41:30.213 INFO:tasks.workunit.client.1.smithi195.stdout:1/76: chown da/c16 5095013 1 2024-08-18T22:41:30.214 INFO:tasks.workunit.client.1.smithi195.stdout:0/56: dwrite d0/f3 [0,4194304] 0 2024-08-18T22:41:30.214 INFO:tasks.workunit.client.0.smithi121.stdout:8/188: creat d6/d17/f40 x:0 0 0 2024-08-18T22:41:30.216 INFO:tasks.workunit.client.0.smithi121.stdout:9/241: dread d0/d5/f9 [0,4194304] 0 2024-08-18T22:41:30.217 INFO:tasks.workunit.client.0.smithi121.stdout:8/189: mknod d6/c41 0 2024-08-18T22:41:30.219 INFO:tasks.workunit.client.0.smithi121.stdout:8/190: mkdir d6/d17/d42 0 2024-08-18T22:41:30.222 INFO:tasks.workunit.client.1.smithi195.stdout:1/77: creat da/d18/f1a x:0 0 0 2024-08-18T22:41:30.222 INFO:tasks.workunit.client.1.smithi195.stdout:2/55: dwrite d1/f10 [0,4194304] 0 2024-08-18T22:41:30.223 INFO:tasks.workunit.client.1.smithi195.stdout:0/57: link d0/f8 d0/dc/fe 0 2024-08-18T22:41:30.224 INFO:tasks.workunit.client.0.smithi121.stdout:9/242: dwrite d0/d5/dd/f41 [0,4194304] 0 2024-08-18T22:41:30.226 INFO:tasks.workunit.client.0.smithi121.stdout:9/243: mkdir d0/d38/d52 0 2024-08-18T22:41:30.229 INFO:tasks.workunit.client.1.smithi195.stdout:2/56: fsync d1/d9/ff 0 2024-08-18T22:41:30.229 INFO:tasks.workunit.client.0.smithi121.stdout:9/244: chown d0/d38/d47/d4c/d18/l42 583 1 2024-08-18T22:41:30.232 INFO:tasks.workunit.client.0.smithi121.stdout:9/245: rename d0/d5/dd/c28 to d0/d5/c53 0 2024-08-18T22:41:30.234 INFO:tasks.workunit.client.0.smithi121.stdout:8/191: getdents d6/d17 0 2024-08-18T22:41:30.235 INFO:tasks.workunit.client.0.smithi121.stdout:8/192: chown f5 4831 1 2024-08-18T22:41:30.236 INFO:tasks.workunit.client.0.smithi121.stdout:8/193: truncate d6/d17/f1d 434317 0 2024-08-18T22:41:30.237 INFO:tasks.workunit.client.0.smithi121.stdout:9/246: truncate d0/d5/dd/d1a/f37 539489 0 2024-08-18T22:41:30.237 INFO:tasks.workunit.client.0.smithi121.stdout:8/194: write d6/d17/d18/f3a [1477368,107908] 0 2024-08-18T22:41:30.238 INFO:tasks.workunit.client.0.smithi121.stdout:8/195: chown d6/d20/c22 10510 1 2024-08-18T22:41:30.242 INFO:tasks.workunit.client.0.smithi121.stdout:8/196: getdents d6/d1e 0 2024-08-18T22:41:30.243 INFO:tasks.workunit.client.0.smithi121.stdout:8/197: write d6/d17/d18/f3a [2195422,108221] 0 2024-08-18T22:41:30.248 INFO:tasks.workunit.client.0.smithi121.stdout:8/198: creat d6/dd/d3b/f43 x:0 0 0 2024-08-18T22:41:30.248 INFO:tasks.workunit.client.0.smithi121.stdout:9/247: chown d0/d38/d47/d4c/fc 418396927 1 2024-08-18T22:41:30.248 INFO:tasks.workunit.client.1.smithi195.stdout:1/78: dwrite da/f10 [0,4194304] 0 2024-08-18T22:41:30.249 INFO:tasks.workunit.client.0.smithi121.stdout:8/199: write d6/f8 [1437802,52592] 0 2024-08-18T22:41:30.249 INFO:tasks.workunit.client.0.smithi121.stdout:9/248: stat d0/d38/d47/d4c/d18 0 2024-08-18T22:41:30.249 INFO:tasks.workunit.client.1.smithi195.stdout:2/57: truncate d1/d8/f11 345459 0 2024-08-18T22:41:30.250 INFO:tasks.workunit.client.1.smithi195.stdout:0/58: dread d0/f9 [0,4194304] 0 2024-08-18T22:41:30.250 INFO:tasks.workunit.client.0.smithi121.stdout:8/200: truncate d6/dd/d3b/f43 388802 0 2024-08-18T22:41:30.252 INFO:tasks.workunit.client.0.smithi121.stdout:8/201: symlink d6/d17/l44 0 2024-08-18T22:41:30.252 INFO:tasks.workunit.client.0.smithi121.stdout:8/202: stat d6/d17/d18/f3a 0 2024-08-18T22:41:30.253 INFO:tasks.workunit.client.0.smithi121.stdout:8/203: fdatasync f5 0 2024-08-18T22:41:30.254 INFO:tasks.workunit.client.0.smithi121.stdout:8/204: fsync d6/d17/d18/f3a 0 2024-08-18T22:41:30.255 INFO:tasks.workunit.client.0.smithi121.stdout:8/205: write d6/d20/f26 [350867,102251] 0 2024-08-18T22:41:30.259 INFO:tasks.workunit.client.0.smithi121.stdout:9/249: truncate d0/d5/dd/f41 3834527 0 2024-08-18T22:41:30.261 INFO:tasks.workunit.client.0.smithi121.stdout:9/250: write d0/d5/dd/d1a/f4d [141485,81838] 0 2024-08-18T22:41:30.262 INFO:tasks.workunit.client.0.smithi121.stdout:8/206: dwrite d6/f8 [0,4194304] 0 2024-08-18T22:41:30.264 INFO:tasks.workunit.client.0.smithi121.stdout:9/251: symlink d0/d38/d47/l54 0 2024-08-18T22:41:30.265 INFO:tasks.workunit.client.0.smithi121.stdout:8/207: mkdir d6/d17/d42/d45 0 2024-08-18T22:41:30.267 INFO:tasks.workunit.client.0.smithi121.stdout:8/208: write d6/d17/d18/f32 [4692374,45724] 0 2024-08-18T22:41:30.269 INFO:tasks.workunit.client.0.smithi121.stdout:1/151: sync 2024-08-18T22:41:30.269 INFO:tasks.workunit.client.0.smithi121.stdout:8/209: write d6/d17/d18/f32 [3045544,119757] 0 2024-08-18T22:41:30.272 INFO:tasks.workunit.client.0.smithi121.stdout:9/252: dwrite d0/d38/d47/d4c/d18/f4f [0,4194304] 0 2024-08-18T22:41:30.273 INFO:tasks.workunit.client.0.smithi121.stdout:1/152: dread d5/fb [0,4194304] 0 2024-08-18T22:41:30.274 INFO:tasks.workunit.client.0.smithi121.stdout:1/153: fdatasync d5/df/f30 0 2024-08-18T22:41:30.282 INFO:tasks.workunit.client.0.smithi121.stdout:8/210: dwrite d6/d17/f40 [0,4194304] 0 2024-08-18T22:41:30.307 INFO:tasks.workunit.client.0.smithi121.stdout:9/253: mkdir d0/d5/dd/d1a/d55 0 2024-08-18T22:41:30.311 INFO:tasks.workunit.client.0.smithi121.stdout:9/254: dread d0/d38/d47/d4c/df/f20 [0,4194304] 0 2024-08-18T22:41:30.312 INFO:tasks.workunit.client.0.smithi121.stdout:8/211: symlink d6/l46 0 2024-08-18T22:41:30.314 INFO:tasks.workunit.client.0.smithi121.stdout:8/212: write d6/d17/f40 [827213,113474] 0 2024-08-18T22:41:30.316 INFO:tasks.workunit.client.0.smithi121.stdout:9/255: dread d0/d38/d47/f33 [0,4194304] 0 2024-08-18T22:41:30.317 INFO:tasks.workunit.client.0.smithi121.stdout:9/256: readlink d0/d38/d47/l22 0 2024-08-18T22:41:30.320 INFO:tasks.workunit.client.0.smithi121.stdout:1/154: rename d5/fe to d5/df/d15/f37 0 2024-08-18T22:41:30.321 INFO:tasks.workunit.client.0.smithi121.stdout:9/257: dread d0/d5/dd/d3b/f3e [0,4194304] 0 2024-08-18T22:41:30.323 INFO:tasks.workunit.client.0.smithi121.stdout:8/213: creat d6/d1e/f47 x:0 0 0 2024-08-18T22:41:30.325 INFO:tasks.workunit.client.0.smithi121.stdout:8/214: dread d6/d17/f1d [0,4194304] 0 2024-08-18T22:41:30.326 INFO:tasks.workunit.client.0.smithi121.stdout:9/258: creat d0/d38/d47/d4c/d18/f56 x:0 0 0 2024-08-18T22:41:30.328 INFO:tasks.workunit.client.0.smithi121.stdout:8/215: mknod d6/c48 0 2024-08-18T22:41:30.330 INFO:tasks.workunit.client.0.smithi121.stdout:8/216: mkdir d6/d1e/d49 0 2024-08-18T22:41:30.331 INFO:tasks.workunit.client.0.smithi121.stdout:8/217: truncate d6/d1e/f35 905184 0 2024-08-18T22:41:30.332 INFO:tasks.workunit.client.0.smithi121.stdout:9/259: creat d0/d5/dd/d3b/d48/f57 x:0 0 0 2024-08-18T22:41:30.332 INFO:tasks.workunit.client.0.smithi121.stdout:8/218: fsync d6/dd/f1b 0 2024-08-18T22:41:30.333 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:41:29 smithi121 ceph-mon[16788]: pgmap v240: 65 pgs: 65 active+clean; 237 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 117 KiB/s rd, 10 MiB/s wr, 560 op/s 2024-08-18T22:41:30.333 INFO:tasks.workunit.client.0.smithi121.stdout:8/219: dread - d6/d17/d18/f2c zero size 2024-08-18T22:41:30.336 INFO:tasks.workunit.client.0.smithi121.stdout:9/260: rename d0/d5/dd/l39 to d0/d38/d47/l58 0 2024-08-18T22:41:30.337 INFO:tasks.workunit.client.0.smithi121.stdout:8/220: readlink d6/l3c 0 2024-08-18T22:41:30.338 INFO:tasks.workunit.client.0.smithi121.stdout:8/221: truncate f5 6172581 0 2024-08-18T22:41:30.338 INFO:tasks.workunit.client.0.smithi121.stdout:8/222: dread - d6/d17/d18/f2c zero size 2024-08-18T22:41:30.340 INFO:tasks.workunit.client.0.smithi121.stdout:9/261: rename d0/d5/dd/d3b/f3e to d0/d38/d47/d4c/d18/f59 0 2024-08-18T22:41:30.342 INFO:tasks.workunit.client.0.smithi121.stdout:8/223: mknod d6/d17/d42/d45/c4a 0 2024-08-18T22:41:30.343 INFO:tasks.workunit.client.0.smithi121.stdout:8/224: fsync d6/d17/d18/f32 0 2024-08-18T22:41:30.343 INFO:tasks.workunit.client.0.smithi121.stdout:9/262: mkdir d0/d38/d44/d5a 0 2024-08-18T22:41:30.346 INFO:tasks.workunit.client.0.smithi121.stdout:9/263: mknod d0/d5/dd/d3b/d48/c5b 0 2024-08-18T22:41:30.347 INFO:tasks.workunit.client.0.smithi121.stdout:9/264: fsync d0/f1e 0 2024-08-18T22:41:30.350 INFO:tasks.workunit.client.0.smithi121.stdout:9/265: creat d0/d5/dd/d1a/f5c x:0 0 0 2024-08-18T22:41:30.351 INFO:tasks.workunit.client.0.smithi121.stdout:8/225: getdents d6/dd/d25 0 2024-08-18T22:41:30.361 INFO:tasks.workunit.client.0.smithi121.stdout:1/155: mkdir d5/df/d15/d38 0 2024-08-18T22:41:30.361 INFO:tasks.workunit.client.0.smithi121.stdout:1/156: fdatasync d5/df/f30 0 2024-08-18T22:41:30.362 INFO:tasks.workunit.client.0.smithi121.stdout:1/157: write f3 [9118672,130653] 0 2024-08-18T22:41:30.368 INFO:tasks.workunit.client.0.smithi121.stdout:1/158: dread d5/df/d15/f37 [0,4194304] 0 2024-08-18T22:41:30.370 INFO:tasks.workunit.client.0.smithi121.stdout:1/159: creat d5/df/f39 x:0 0 0 2024-08-18T22:41:30.371 INFO:tasks.workunit.client.0.smithi121.stdout:1/160: chown d5/f1d 0 1 2024-08-18T22:41:30.371 INFO:tasks.workunit.client.0.smithi121.stdout:1/161: chown d5/f1d 3344885 1 2024-08-18T22:41:30.375 INFO:tasks.workunit.client.0.smithi121.stdout:1/162: dread d5/d10/d14/d2a/f2f [0,4194304] 0 2024-08-18T22:41:30.377 INFO:tasks.workunit.client.0.smithi121.stdout:1/163: mkdir d5/d10/d14/d2a/d3a 0 2024-08-18T22:41:30.378 INFO:tasks.workunit.client.0.smithi121.stdout:1/164: symlink d5/df/l3b 0 2024-08-18T22:41:30.379 INFO:tasks.workunit.client.0.smithi121.stdout:1/165: write d5/d10/d14/d2a/f2f [881080,85324] 0 2024-08-18T22:41:30.380 INFO:tasks.workunit.client.0.smithi121.stdout:1/166: chown d5/df/f39 394 1 2024-08-18T22:41:30.382 INFO:tasks.workunit.client.0.smithi121.stdout:1/167: dread d5/df/d15/f37 [0,4194304] 0 2024-08-18T22:41:30.385 INFO:tasks.workunit.client.0.smithi121.stdout:1/168: link d5/fd d5/f3c 0 2024-08-18T22:41:30.387 INFO:tasks.workunit.client.0.smithi121.stdout:1/169: mkdir d5/df/d15/d28/d3d 0 2024-08-18T22:41:30.387 INFO:tasks.workunit.client.0.smithi121.stdout:1/170: read d5/f1f [201485,5046] 0 2024-08-18T22:41:30.388 INFO:tasks.workunit.client.0.smithi121.stdout:1/171: truncate d5/df/f30 333362 0 2024-08-18T22:41:30.389 INFO:tasks.workunit.client.0.smithi121.stdout:1/172: creat d5/df/d11/f3e x:0 0 0 2024-08-18T22:41:30.391 INFO:tasks.workunit.client.0.smithi121.stdout:1/173: mknod d5/df/c3f 0 2024-08-18T22:41:30.394 INFO:tasks.workunit.client.0.smithi121.stdout:1/174: dread d5/fa [4194304,4194304] 0 2024-08-18T22:41:30.395 INFO:tasks.workunit.client.0.smithi121.stdout:1/175: dread d5/df/d15/f37 [0,4194304] 0 2024-08-18T22:41:30.401 INFO:tasks.workunit.client.0.smithi121.stdout:1/176: dwrite f4 [4194304,4194304] 0 2024-08-18T22:41:30.403 INFO:tasks.workunit.client.0.smithi121.stdout:1/177: symlink d5/l40 0 2024-08-18T22:41:30.404 INFO:tasks.workunit.client.0.smithi121.stdout:1/178: chown d5/df/d11 52372 1 2024-08-18T22:41:30.404 INFO:tasks.workunit.client.0.smithi121.stdout:1/179: stat l2 0 2024-08-18T22:41:30.406 INFO:tasks.workunit.client.0.smithi121.stdout:1/180: mknod d5/df/c41 0 2024-08-18T22:41:30.406 INFO:tasks.workunit.client.0.smithi121.stdout:1/181: chown d5/d10/d14 230 1 2024-08-18T22:41:30.409 INFO:tasks.workunit.client.0.smithi121.stdout:1/182: creat d5/df/f42 x:0 0 0 2024-08-18T22:41:30.416 INFO:tasks.workunit.client.0.smithi121.stdout:1/183: dwrite d5/df/d15/f37 [0,4194304] 0 2024-08-18T22:41:30.418 INFO:tasks.workunit.client.0.smithi121.stdout:1/184: write d5/df/d15/f2d [879514,59241] 0 2024-08-18T22:41:30.419 INFO:tasks.workunit.client.0.smithi121.stdout:1/185: chown d5/df/l21 215745 1 2024-08-18T22:41:30.422 INFO:tasks.workunit.client.0.smithi121.stdout:1/186: rename d5/df/d11/f3e to d5/df/d15/d28/d3d/f43 0 2024-08-18T22:41:30.422 INFO:tasks.workunit.client.0.smithi121.stdout:1/187: fsync f3 0 2024-08-18T22:41:30.428 INFO:tasks.workunit.client.0.smithi121.stdout:1/188: write d5/df/d15/f2b [1858286,87189] 0 2024-08-18T22:41:30.430 INFO:tasks.workunit.client.0.smithi121.stdout:1/189: creat d5/d10/d14/d34/f44 x:0 0 0 2024-08-18T22:41:30.431 INFO:tasks.workunit.client.0.smithi121.stdout:1/190: chown d5/d10/l24 165465 1 2024-08-18T22:41:30.434 INFO:tasks.workunit.client.0.smithi121.stdout:1/191: write f4 [4690053,75667] 0 2024-08-18T22:41:30.435 INFO:tasks.workunit.client.0.smithi121.stdout:1/192: creat d5/d10/d14/f45 x:0 0 0 2024-08-18T22:41:30.435 INFO:tasks.workunit.client.1.smithi195.stdout:2/58: mknod d1/d8/c12 0 2024-08-18T22:41:30.436 INFO:tasks.workunit.client.0.smithi121.stdout:1/193: chown d5/df/l21 1979228 1 2024-08-18T22:41:30.437 INFO:tasks.workunit.client.0.smithi121.stdout:1/194: write d5/df/f30 [1327510,30193] 0 2024-08-18T22:41:30.438 INFO:tasks.workunit.client.0.smithi121.stdout:1/195: write d5/d10/f18 [1197912,75382] 0 2024-08-18T22:41:30.439 INFO:tasks.workunit.client.1.smithi195.stdout:2/59: rename d1/d8/c12 to d1/c13 0 2024-08-18T22:41:30.439 INFO:tasks.workunit.client.0.smithi121.stdout:1/196: read - d5/df/f39 zero size 2024-08-18T22:41:30.440 INFO:tasks.workunit.client.0.smithi121.stdout:1/197: write d5/df/f30 [2343050,34923] 0 2024-08-18T22:41:30.440 INFO:tasks.workunit.client.0.smithi121.stdout:1/198: fsync f3 0 2024-08-18T22:41:30.442 INFO:tasks.workunit.client.0.smithi121.stdout:1/199: creat d5/d10/f46 x:0 0 0 2024-08-18T22:41:30.443 INFO:tasks.workunit.client.0.smithi121.stdout:1/200: write d5/df/d15/f2d [107413,86193] 0 2024-08-18T22:41:30.443 INFO:tasks.workunit.client.0.smithi121.stdout:1/201: fsync d5/fb 0 2024-08-18T22:41:30.444 INFO:tasks.workunit.client.1.smithi195.stdout:2/60: link d1/l4 d1/d9/l14 0 2024-08-18T22:41:30.445 INFO:tasks.workunit.client.0.smithi121.stdout:1/202: creat d5/d10/d14/d2a/d3a/f47 x:0 0 0 2024-08-18T22:41:30.446 INFO:tasks.workunit.client.1.smithi195.stdout:2/61: link d1/f5 d1/f15 0 2024-08-18T22:41:30.447 INFO:tasks.workunit.client.0.smithi121.stdout:1/203: mkdir d5/df/d48 0 2024-08-18T22:41:30.447 INFO:tasks.workunit.client.1.smithi195.stdout:2/62: chown d1/d9/ff 51946 1 2024-08-18T22:41:30.448 INFO:tasks.workunit.client.0.smithi121.stdout:1/204: fsync d5/f3c 0 2024-08-18T22:41:30.448 INFO:tasks.workunit.client.1.smithi195.stdout:2/63: truncate d1/d9/fe 639882 0 2024-08-18T22:41:30.448 INFO:tasks.workunit.client.1.smithi195.stdout:2/64: chown d1/d9/fa 7992 1 2024-08-18T22:41:30.450 INFO:tasks.workunit.client.1.smithi195.stdout:2/65: chown l0 4978 1 2024-08-18T22:41:30.451 INFO:tasks.workunit.client.1.smithi195.stdout:2/66: chown d1/d9/fe 3370464 1 2024-08-18T22:41:30.451 INFO:tasks.workunit.client.0.smithi121.stdout:1/205: truncate d5/fb 700697 0 2024-08-18T22:41:30.454 INFO:tasks.workunit.client.1.smithi195.stdout:2/67: link d1/l3 d1/d8/l16 0 2024-08-18T22:41:30.454 INFO:tasks.workunit.client.0.smithi121.stdout:1/206: dread d5/f3c [0,4194304] 0 2024-08-18T22:41:30.456 INFO:tasks.workunit.client.0.smithi121.stdout:1/207: creat d5/f49 x:0 0 0 2024-08-18T22:41:30.457 INFO:tasks.workunit.client.0.smithi121.stdout:1/208: write d5/f7 [978070,77600] 0 2024-08-18T22:41:30.457 INFO:tasks.workunit.client.1.smithi195.stdout:2/68: link d1/d9/ff d1/d8/f17 0 2024-08-18T22:41:30.459 INFO:tasks.workunit.client.1.smithi195.stdout:2/69: creat d1/d9/f18 x:0 0 0 2024-08-18T22:41:30.461 INFO:tasks.workunit.client.1.smithi195.stdout:2/70: write d1/d9/fa [696282,62673] 0 2024-08-18T22:41:30.463 INFO:tasks.workunit.client.1.smithi195.stdout:2/71: creat d1/d9/f19 x:0 0 0 2024-08-18T22:41:30.463 INFO:tasks.workunit.client.0.smithi121.stdout:1/209: truncate d5/df/d15/f37 3637846 0 2024-08-18T22:41:30.469 INFO:tasks.workunit.client.1.smithi195.stdout:2/72: dwrite d1/d9/ff [0,4194304] 0 2024-08-18T22:41:30.470 INFO:tasks.workunit.client.0.smithi121.stdout:1/210: dwrite d5/df/d15/d28/d3d/f43 [0,4194304] 0 2024-08-18T22:41:30.473 INFO:tasks.workunit.client.0.smithi121.stdout:1/211: unlink d5/fa 0 2024-08-18T22:41:30.475 INFO:tasks.workunit.client.0.smithi121.stdout:1/212: mknod d5/df/d11/c4a 0 2024-08-18T22:41:30.476 INFO:tasks.workunit.client.0.smithi121.stdout:1/213: read d5/f3c [1064614,126186] 0 2024-08-18T22:41:30.480 INFO:tasks.workunit.client.1.smithi195.stdout:2/73: dread d1/d8/f11 [0,4194304] 0 2024-08-18T22:41:30.482 INFO:tasks.workunit.client.1.smithi195.stdout:2/74: unlink d1/d9/fe 0 2024-08-18T22:41:30.484 INFO:tasks.workunit.client.0.smithi121.stdout:2/55: sync 2024-08-18T22:41:30.484 INFO:tasks.workunit.client.0.smithi121.stdout:7/124: sync 2024-08-18T22:41:30.484 INFO:tasks.workunit.client.0.smithi121.stdout:5/73: sync 2024-08-18T22:41:30.484 INFO:tasks.workunit.client.1.smithi195.stdout:2/75: creat d1/d8/f1a x:0 0 0 2024-08-18T22:41:30.485 INFO:tasks.workunit.client.0.smithi121.stdout:7/125: write de/f16 [2298108,68658] 0 2024-08-18T22:41:30.485 INFO:tasks.workunit.client.0.smithi121.stdout:2/56: write d2/d3/fe [876490,81147] 0 2024-08-18T22:41:30.486 INFO:tasks.workunit.client.1.smithi195.stdout:2/76: write d1/f5 [644676,80841] 0 2024-08-18T22:41:30.488 INFO:tasks.workunit.client.0.smithi121.stdout:7/126: write de/d13/d18/f19 [4603467,20588] 0 2024-08-18T22:41:30.490 INFO:tasks.workunit.client.0.smithi121.stdout:7/127: chown de/d1a/d20 1939873 1 2024-08-18T22:41:30.494 INFO:tasks.workunit.client.0.smithi121.stdout:5/74: dwrite f1 [0,4194304] 0 2024-08-18T22:41:30.497 INFO:tasks.workunit.client.0.smithi121.stdout:2/57: dwrite d2/d3/f4 [8388608,4194304] 0 2024-08-18T22:41:30.499 INFO:tasks.workunit.client.0.smithi121.stdout:2/58: mknod d2/cf 0 2024-08-18T22:41:30.503 INFO:tasks.workunit.client.0.smithi121.stdout:2/59: symlink d2/d8/db/dc/l10 0 2024-08-18T22:41:30.505 INFO:tasks.workunit.client.0.smithi121.stdout:7/128: dwrite de/d13/d18/f27 [0,4194304] 0 2024-08-18T22:41:30.507 INFO:tasks.workunit.client.0.smithi121.stdout:7/129: write de/d1a/f1e [946782,17459] 0 2024-08-18T22:41:30.510 INFO:tasks.workunit.client.0.smithi121.stdout:7/130: mkdir de/d1a/d2f 0 2024-08-18T22:41:30.512 INFO:tasks.workunit.client.0.smithi121.stdout:7/131: symlink de/d13/d18/d23/d24/d29/l30 0 2024-08-18T22:41:30.514 INFO:tasks.workunit.client.0.smithi121.stdout:7/132: mknod de/d13/d18/d23/c31 0 2024-08-18T22:41:30.516 INFO:tasks.workunit.client.0.smithi121.stdout:7/133: rename fd to de/d13/d18/d2e/f32 0 2024-08-18T22:41:30.522 INFO:tasks.workunit.client.0.smithi121.stdout:7/134: dwrite de/f1c [0,4194304] 0 2024-08-18T22:41:30.523 INFO:tasks.workunit.client.0.smithi121.stdout:7/135: write de/f11 [1706152,46073] 0 2024-08-18T22:41:30.524 INFO:tasks.workunit.client.1.smithi195.stdout:0/59: write d0/f8 [875916,6781] 0 2024-08-18T22:41:30.526 INFO:tasks.workunit.client.0.smithi121.stdout:7/136: rmdir de/d13/d18/d23/d24/d29 39 2024-08-18T22:41:30.527 INFO:tasks.workunit.client.1.smithi195.stdout:0/60: mkdir d0/dc/df 0 2024-08-18T22:41:30.529 INFO:tasks.workunit.client.1.smithi195.stdout:0/61: write d0/f8 [3355865,88603] 0 2024-08-18T22:41:30.529 INFO:tasks.workunit.client.0.smithi121.stdout:7/137: link de/f1c de/d1a/f33 0 2024-08-18T22:41:30.531 INFO:tasks.workunit.client.1.smithi195.stdout:1/79: dwrite da/f13 [0,4194304] 0 2024-08-18T22:41:30.531 INFO:tasks.workunit.client.0.smithi121.stdout:7/138: mkdir de/d1a/d34 0 2024-08-18T22:41:30.532 INFO:tasks.workunit.client.1.smithi195.stdout:1/80: write f6 [2312043,64259] 0 2024-08-18T22:41:30.533 INFO:tasks.workunit.client.1.smithi195.stdout:0/62: mknod d0/dc/c10 0 2024-08-18T22:41:30.534 INFO:tasks.workunit.client.0.smithi121.stdout:7/139: creat de/d1a/d20/f35 x:0 0 0 2024-08-18T22:41:30.536 INFO:tasks.workunit.client.1.smithi195.stdout:0/63: readlink d0/l5 0 2024-08-18T22:41:30.538 INFO:tasks.workunit.client.0.smithi121.stdout:7/140: mkdir de/d1a/d2f/d36 0 2024-08-18T22:41:30.539 INFO:tasks.workunit.client.0.smithi121.stdout:7/141: read de/d13/d18/f27 [1790602,45569] 0 2024-08-18T22:41:30.540 INFO:tasks.workunit.client.1.smithi195.stdout:1/81: dwrite da/f15 [0,4194304] 0 2024-08-18T22:41:30.541 INFO:tasks.workunit.client.1.smithi195.stdout:0/64: mkdir d0/dc/d11 0 2024-08-18T22:41:30.541 INFO:tasks.workunit.client.1.smithi195.stdout:0/65: readlink d0/l2 0 2024-08-18T22:41:30.543 INFO:tasks.workunit.client.1.smithi195.stdout:2/77: getdents d1/d8 0 2024-08-18T22:41:30.546 INFO:tasks.workunit.client.0.smithi121.stdout:7/142: dwrite de/d13/f17 [0,4194304] 0 2024-08-18T22:41:30.546 INFO:tasks.workunit.client.1.smithi195.stdout:2/78: creat d1/f1b x:0 0 0 2024-08-18T22:41:30.548 INFO:tasks.workunit.client.1.smithi195.stdout:1/82: dread da/f13 [0,4194304] 0 2024-08-18T22:41:30.551 INFO:tasks.workunit.client.1.smithi195.stdout:2/79: dread d1/d9/fa [0,4194304] 0 2024-08-18T22:41:30.552 INFO:tasks.workunit.client.1.smithi195.stdout:2/80: fdatasync d1/f10 0 2024-08-18T22:41:30.554 INFO:tasks.workunit.client.1.smithi195.stdout:1/83: getdents da 0 2024-08-18T22:41:30.556 INFO:tasks.workunit.client.1.smithi195.stdout:0/66: truncate d0/f3 2200227 0 2024-08-18T22:41:30.557 INFO:tasks.workunit.client.1.smithi195.stdout:1/84: rmdir da/d18 39 2024-08-18T22:41:30.559 INFO:tasks.workunit.client.1.smithi195.stdout:0/67: creat d0/dc/df/f12 x:0 0 0 2024-08-18T22:41:30.560 INFO:tasks.workunit.client.1.smithi195.stdout:1/85: creat da/f1b x:0 0 0 2024-08-18T22:41:30.564 INFO:tasks.workunit.client.1.smithi195.stdout:1/86: dread da/f11 [0,4194304] 0 2024-08-18T22:41:30.566 INFO:tasks.workunit.client.1.smithi195.stdout:0/68: dread d0/f3 [0,4194304] 0 2024-08-18T22:41:30.566 INFO:tasks.workunit.client.1.smithi195.stdout:1/87: truncate da/d18/f1a 1004906 0 2024-08-18T22:41:30.568 INFO:tasks.workunit.client.1.smithi195.stdout:0/69: mknod d0/dc/df/c13 0 2024-08-18T22:41:30.569 INFO:tasks.workunit.client.1.smithi195.stdout:1/88: mkdir da/d18/d1c 0 2024-08-18T22:41:30.573 INFO:tasks.workunit.client.1.smithi195.stdout:0/70: dread d0/dc/fe [0,4194304] 0 2024-08-18T22:41:30.574 INFO:tasks.workunit.client.1.smithi195.stdout:1/89: dwrite f5 [0,4194304] 0 2024-08-18T22:41:30.574 INFO:tasks.workunit.client.1.smithi195.stdout:0/71: fdatasync d0/f3 0 2024-08-18T22:41:30.577 INFO:tasks.workunit.client.1.smithi195.stdout:0/72: unlink d0/f9 0 2024-08-18T22:41:30.579 INFO:tasks.workunit.client.1.smithi195.stdout:0/73: unlink d0/fb 0 2024-08-18T22:41:30.580 INFO:tasks.workunit.client.1.smithi195.stdout:0/74: chown d0/dc/d11 2525257 1 2024-08-18T22:41:30.581 INFO:tasks.workunit.client.1.smithi195.stdout:1/90: dwrite da/fd [0,4194304] 0 2024-08-18T22:41:30.582 INFO:tasks.workunit.client.1.smithi195.stdout:0/75: symlink d0/dc/df/l14 0 2024-08-18T22:41:30.584 INFO:tasks.workunit.client.1.smithi195.stdout:1/91: creat da/f1d x:0 0 0 2024-08-18T22:41:30.589 INFO:tasks.workunit.client.1.smithi195.stdout:1/92: mknod da/c1e 0 2024-08-18T22:41:30.592 INFO:tasks.workunit.client.1.smithi195.stdout:1/93: creat da/d18/f1f x:0 0 0 2024-08-18T22:41:30.593 INFO:tasks.workunit.client.1.smithi195.stdout:0/76: dwrite d0/dc/fe [0,4194304] 0 2024-08-18T22:41:30.593 INFO:tasks.workunit.client.1.smithi195.stdout:0/77: stat d0/dc/df/c13 0 2024-08-18T22:41:30.595 INFO:tasks.workunit.client.1.smithi195.stdout:1/94: fdatasync f5 0 2024-08-18T22:41:30.599 INFO:tasks.workunit.client.1.smithi195.stdout:1/95: symlink da/d18/l20 0 2024-08-18T22:41:30.602 INFO:tasks.workunit.client.1.smithi195.stdout:1/96: mknod da/c21 0 2024-08-18T22:41:30.602 INFO:tasks.workunit.client.1.smithi195.stdout:0/78: dwrite d0/f8 [0,4194304] 0 2024-08-18T22:41:30.603 INFO:tasks.workunit.client.1.smithi195.stdout:1/97: stat da/d18/f1f 0 2024-08-18T22:41:30.604 INFO:tasks.workunit.client.1.smithi195.stdout:0/79: write d0/f8 [4992524,75870] 0 2024-08-18T22:41:30.606 INFO:tasks.workunit.client.1.smithi195.stdout:1/98: symlink da/d18/d1c/l22 0 2024-08-18T22:41:30.608 INFO:tasks.workunit.client.1.smithi195.stdout:1/99: write da/d18/f1f [113591,82257] 0 2024-08-18T22:41:30.609 INFO:tasks.workunit.client.1.smithi195.stdout:0/80: rename d0/f8 to d0/dc/d11/f15 0 2024-08-18T22:41:30.609 INFO:tasks.workunit.client.1.smithi195.stdout:1/100: truncate da/f1d 128389 0 2024-08-18T22:41:30.610 INFO:tasks.workunit.client.1.smithi195.stdout:1/101: write da/f1d [120002,82157] 0 2024-08-18T22:41:30.611 INFO:tasks.workunit.client.1.smithi195.stdout:0/81: mknod d0/c16 0 2024-08-18T22:41:30.612 INFO:tasks.workunit.client.1.smithi195.stdout:1/102: chown l3 0 1 2024-08-18T22:41:30.613 INFO:tasks.workunit.client.1.smithi195.stdout:1/103: read da/f15 [1162020,4746] 0 2024-08-18T22:41:30.615 INFO:tasks.workunit.client.1.smithi195.stdout:1/104: mknod da/d18/c23 0 2024-08-18T22:41:30.616 INFO:tasks.workunit.client.1.smithi195.stdout:0/82: dread d0/dc/d11/f15 [0,4194304] 0 2024-08-18T22:41:30.616 INFO:tasks.workunit.client.1.smithi195.stdout:1/105: write f7 [3708262,55156] 0 2024-08-18T22:41:30.616 INFO:tasks.workunit.client.1.smithi195.stdout:0/83: chown d0/dc/d11 9 1 2024-08-18T22:41:30.618 INFO:tasks.workunit.client.1.smithi195.stdout:0/84: write d0/f3 [1674005,116777] 0 2024-08-18T22:41:30.618 INFO:tasks.workunit.client.1.smithi195.stdout:1/106: fsync da/f13 0 2024-08-18T22:41:30.619 INFO:tasks.workunit.client.1.smithi195.stdout:0/85: write d0/f3 [276806,51128] 0 2024-08-18T22:41:30.622 INFO:tasks.workunit.client.1.smithi195.stdout:0/86: symlink d0/dc/l17 0 2024-08-18T22:41:30.623 INFO:tasks.workunit.client.1.smithi195.stdout:0/87: read d0/f3 [1766252,61542] 0 2024-08-18T22:41:30.623 INFO:tasks.workunit.client.1.smithi195.stdout:1/107: link da/f1b da/f24 0 2024-08-18T22:41:30.624 INFO:tasks.workunit.client.1.smithi195.stdout:0/88: symlink d0/l18 0 2024-08-18T22:41:30.625 INFO:tasks.workunit.client.1.smithi195.stdout:1/108: symlink da/d18/l25 0 2024-08-18T22:41:30.626 INFO:tasks.workunit.client.1.smithi195.stdout:0/89: symlink d0/dc/l19 0 2024-08-18T22:41:30.626 INFO:tasks.workunit.client.1.smithi195.stdout:1/109: mknod da/d18/c26 0 2024-08-18T22:41:30.627 INFO:tasks.workunit.client.1.smithi195.stdout:0/90: symlink d0/dc/l1a 0 2024-08-18T22:41:30.628 INFO:tasks.workunit.client.1.smithi195.stdout:1/110: creat da/d18/d1c/f27 x:0 0 0 2024-08-18T22:41:30.628 INFO:tasks.workunit.client.1.smithi195.stdout:0/91: mkdir d0/dc/d11/d1b 0 2024-08-18T22:41:30.631 INFO:tasks.workunit.client.1.smithi195.stdout:0/92: rename d0/dc/fe to d0/f1c 0 2024-08-18T22:41:30.634 INFO:tasks.workunit.client.1.smithi195.stdout:0/93: dread d0/dc/d11/f15 [0,4194304] 0 2024-08-18T22:41:30.634 INFO:tasks.workunit.client.0.smithi121.stdout:3/154: sync 2024-08-18T22:41:30.637 INFO:tasks.workunit.client.1.smithi195.stdout:0/94: write d0/f1c [907881,10808] 0 2024-08-18T22:41:30.638 INFO:tasks.workunit.client.0.smithi121.stdout:3/155: symlink d1e/d1f/d25/d2e/d30/l38 0 2024-08-18T22:41:30.638 INFO:tasks.workunit.client.1.smithi195.stdout:1/111: rename da/d18/d1c to da/d18/d28 0 2024-08-18T22:41:30.638 INFO:tasks.workunit.client.1.smithi195.stdout:1/112: fdatasync f6 0 2024-08-18T22:41:30.639 INFO:tasks.workunit.client.0.smithi121.stdout:3/156: link d1e/d1f/c21 d1e/d1f/d25/c39 0 2024-08-18T22:41:30.640 INFO:tasks.workunit.client.0.smithi121.stdout:3/157: creat d1e/d1f/f3a x:0 0 0 2024-08-18T22:41:30.641 INFO:tasks.workunit.client.0.smithi121.stdout:3/158: mknod d1e/d1f/c3b 0 2024-08-18T22:41:30.642 INFO:tasks.workunit.client.1.smithi195.stdout:1/113: creat da/f29 x:0 0 0 2024-08-18T22:41:30.642 INFO:tasks.workunit.client.1.smithi195.stdout:0/95: dwrite d0/dc/df/f12 [0,4194304] 0 2024-08-18T22:41:30.642 INFO:tasks.workunit.client.1.smithi195.stdout:1/114: write f6 [906447,72055] 0 2024-08-18T22:41:30.643 INFO:tasks.workunit.client.0.smithi121.stdout:3/159: creat d1e/d1f/d25/d2e/d36/f3c x:0 0 0 2024-08-18T22:41:30.645 INFO:tasks.workunit.client.1.smithi195.stdout:0/96: creat d0/dc/d11/f1d x:0 0 0 2024-08-18T22:41:30.646 INFO:tasks.workunit.client.1.smithi195.stdout:0/97: fdatasync d0/dc/d11/f1d 0 2024-08-18T22:41:30.646 INFO:tasks.workunit.client.1.smithi195.stdout:1/115: creat da/d18/f2a x:0 0 0 2024-08-18T22:41:30.648 INFO:tasks.workunit.client.1.smithi195.stdout:0/98: chown d0/dc/d11/d1b 585330987 1 2024-08-18T22:41:30.651 INFO:tasks.workunit.client.1.smithi195.stdout:1/116: dread da/f15 [0,4194304] 0 2024-08-18T22:41:30.651 INFO:tasks.workunit.client.1.smithi195.stdout:0/99: rename d0/dc/d11/f1d to d0/dc/d11/d1b/f1e 0 2024-08-18T22:41:30.653 INFO:tasks.workunit.client.1.smithi195.stdout:0/100: creat d0/dc/d11/d1b/f1f x:0 0 0 2024-08-18T22:41:30.654 INFO:tasks.workunit.client.0.smithi121.stdout:3/160: dwrite f10 [0,4194304] 0 2024-08-18T22:41:30.655 INFO:tasks.workunit.client.1.smithi195.stdout:1/117: rename l3 to da/l2b 0 2024-08-18T22:41:30.657 INFO:tasks.workunit.client.0.smithi121.stdout:3/161: getdents d1e 0 2024-08-18T22:41:30.658 INFO:tasks.workunit.client.0.smithi121.stdout:3/162: chown c1d 5 1 2024-08-18T22:41:30.658 INFO:tasks.workunit.client.1.smithi195.stdout:1/118: mknod da/d18/d28/c2c 0 2024-08-18T22:41:30.660 INFO:tasks.workunit.client.1.smithi195.stdout:0/101: dwrite d0/f1c [0,4194304] 0 2024-08-18T22:41:30.661 INFO:tasks.workunit.client.1.smithi195.stdout:0/102: readlink d0/dc/l19 0 2024-08-18T22:41:30.667 INFO:tasks.workunit.client.1.smithi195.stdout:0/103: creat d0/dc/d11/f20 x:0 0 0 2024-08-18T22:41:30.667 INFO:tasks.workunit.client.0.smithi121.stdout:3/163: write f16 [36511,80233] 0 2024-08-18T22:41:30.669 INFO:tasks.workunit.client.1.smithi195.stdout:1/119: dwrite da/d18/d28/f27 [0,4194304] 0 2024-08-18T22:41:30.670 INFO:tasks.workunit.client.0.smithi121.stdout:3/164: mknod d1e/d1f/d25/d2e/c3d 0 2024-08-18T22:41:30.670 INFO:tasks.workunit.client.1.smithi195.stdout:0/104: write d0/f3 [2267489,37536] 0 2024-08-18T22:41:30.675 INFO:tasks.workunit.client.1.smithi195.stdout:0/105: creat d0/dc/f21 x:0 0 0 2024-08-18T22:41:30.679 INFO:tasks.workunit.client.0.smithi121.stdout:3/165: truncate f5 1904616 0 2024-08-18T22:41:30.679 INFO:tasks.workunit.client.1.smithi195.stdout:0/106: dread d0/f1c [0,4194304] 0 2024-08-18T22:41:30.680 INFO:tasks.workunit.client.0.smithi121.stdout:3/166: mkdir d1e/d1f/d3e 0 2024-08-18T22:41:30.680 INFO:tasks.workunit.client.1.smithi195.stdout:1/120: getdents da/d18 0 2024-08-18T22:41:30.681 INFO:tasks.workunit.client.1.smithi195.stdout:0/107: unlink d0/l18 0 2024-08-18T22:41:30.687 INFO:tasks.workunit.client.1.smithi195.stdout:1/121: write da/f24 [231515,22367] 0 2024-08-18T22:41:30.695 INFO:tasks.workunit.client.1.smithi195.stdout:1/122: dwrite da/d18/f1f [0,4194304] 0 2024-08-18T22:41:30.696 INFO:tasks.workunit.client.0.smithi121.stdout:3/167: dread f5 [0,4194304] 0 2024-08-18T22:41:30.696 INFO:tasks.workunit.client.1.smithi195.stdout:1/123: chown da/f12 7584743 1 2024-08-18T22:41:30.696 INFO:tasks.workunit.client.0.smithi121.stdout:3/168: write f1a [43639,65764] 0 2024-08-18T22:41:30.697 INFO:tasks.workunit.client.1.smithi195.stdout:1/124: dread - da/d18/f2a zero size 2024-08-18T22:41:30.697 INFO:tasks.workunit.client.1.smithi195.stdout:1/125: readlink da/l14 0 2024-08-18T22:41:30.701 INFO:tasks.workunit.client.0.smithi121.stdout:3/169: truncate f11 3584902 0 2024-08-18T22:41:30.701 INFO:tasks.workunit.client.1.smithi195.stdout:1/126: getdents da/d18/d28 0 2024-08-18T22:41:30.702 INFO:tasks.workunit.client.0.smithi121.stdout:3/170: symlink d1e/d1f/d25/l3f 0 2024-08-18T22:41:30.703 INFO:tasks.workunit.client.0.smithi121.stdout:3/171: write d1e/d1f/f23 [795357,122478] 0 2024-08-18T22:41:30.706 INFO:tasks.workunit.client.0.smithi121.stdout:3/172: rename l0 to d1e/d1f/d25/l40 0 2024-08-18T22:41:30.708 INFO:tasks.workunit.client.1.smithi195.stdout:1/127: dwrite da/f1d [0,4194304] 0 2024-08-18T22:41:30.710 INFO:tasks.workunit.client.0.smithi121.stdout:3/173: dread f10 [0,4194304] 0 2024-08-18T22:41:30.713 INFO:tasks.workunit.client.0.smithi121.stdout:3/174: rename f10 to d1e/d1f/d25/f41 0 2024-08-18T22:41:30.714 INFO:tasks.workunit.client.1.smithi195.stdout:1/128: dwrite da/fd [0,4194304] 0 2024-08-18T22:41:30.715 INFO:tasks.workunit.client.1.smithi195.stdout:1/129: dread - da/d18/f2a zero size 2024-08-18T22:41:30.715 INFO:tasks.workunit.client.0.smithi121.stdout:3/175: mkdir d1e/d1f/d3e/d42 0 2024-08-18T22:41:30.719 INFO:tasks.workunit.client.1.smithi195.stdout:1/130: dread da/f24 [0,4194304] 0 2024-08-18T22:41:30.722 INFO:tasks.workunit.client.1.smithi195.stdout:1/131: creat da/d18/d28/f2d x:0 0 0 2024-08-18T22:41:30.723 INFO:tasks.workunit.client.0.smithi121.stdout:3/176: dwrite d1e/d1f/d25/f41 [0,4194304] 0 2024-08-18T22:41:30.725 INFO:tasks.workunit.client.0.smithi121.stdout:3/177: mknod d1e/d1f/d3e/c43 0 2024-08-18T22:41:30.727 INFO:tasks.workunit.client.0.smithi121.stdout:3/178: fdatasync d1e/d1f/f3a 0 2024-08-18T22:41:30.728 INFO:tasks.workunit.client.0.smithi121.stdout:0/121: sync 2024-08-18T22:41:30.728 INFO:tasks.workunit.client.0.smithi121.stdout:3/179: symlink d1e/d1f/d25/l44 0 2024-08-18T22:41:30.728 INFO:tasks.workunit.client.0.smithi121.stdout:0/122: readlink d1/d4/da/l16 0 2024-08-18T22:41:30.729 INFO:tasks.workunit.client.1.smithi195.stdout:1/132: dwrite da/f1d [0,4194304] 0 2024-08-18T22:41:30.730 INFO:tasks.workunit.client.0.smithi121.stdout:3/180: unlink d1e/d1f/l29 0 2024-08-18T22:41:30.731 INFO:tasks.workunit.client.1.smithi195.stdout:1/133: rmdir da/d18 39 2024-08-18T22:41:30.732 INFO:tasks.workunit.client.1.smithi195.stdout:1/134: chown da/f11 742 1 2024-08-18T22:41:30.732 INFO:tasks.workunit.client.1.smithi195.stdout:1/135: chown f6 3449088 1 2024-08-18T22:41:30.732 INFO:tasks.workunit.client.0.smithi121.stdout:0/123: creat d1/d4/db/d24/f29 x:0 0 0 2024-08-18T22:41:30.733 INFO:tasks.workunit.client.0.smithi121.stdout:3/181: mknod d1e/d1f/d25/c45 0 2024-08-18T22:41:30.734 INFO:tasks.workunit.client.1.smithi195.stdout:1/136: creat da/d18/d28/f2e x:0 0 0 2024-08-18T22:41:30.734 INFO:tasks.workunit.client.1.smithi195.stdout:1/137: readlink da/lf 0 2024-08-18T22:41:30.735 INFO:tasks.workunit.client.1.smithi195.stdout:1/138: write da/f11 [3441385,33129] 0 2024-08-18T22:41:30.741 INFO:tasks.workunit.client.0.smithi121.stdout:0/124: dwrite d1/d4/db/d24/df/d8/f20 [0,4194304] 0 2024-08-18T22:41:30.743 INFO:tasks.workunit.client.0.smithi121.stdout:0/125: chown d1/d4/db/d18/f23 2033628114 1 2024-08-18T22:41:30.745 INFO:tasks.workunit.client.0.smithi121.stdout:3/182: dwrite f12 [0,4194304] 0 2024-08-18T22:41:30.745 INFO:tasks.workunit.client.0.smithi121.stdout:0/126: mkdir d1/d4/db/d18/d1c/d2a 0 2024-08-18T22:41:30.746 INFO:tasks.workunit.client.0.smithi121.stdout:0/127: stat d1/d4 0 2024-08-18T22:41:30.747 INFO:tasks.workunit.client.0.smithi121.stdout:0/128: readlink d1/d4/db/d24/df/l6 0 2024-08-18T22:41:30.747 INFO:tasks.workunit.client.0.smithi121.stdout:3/183: creat d1e/f46 x:0 0 0 2024-08-18T22:41:30.748 INFO:tasks.workunit.client.0.smithi121.stdout:0/129: chown d1/c25 5478 1 2024-08-18T22:41:30.751 INFO:tasks.workunit.client.0.smithi121.stdout:0/130: creat d1/d4/db/d24/f2b x:0 0 0 2024-08-18T22:41:30.753 INFO:tasks.workunit.client.0.smithi121.stdout:0/131: creat d1/d4/db/f2c x:0 0 0 2024-08-18T22:41:30.759 INFO:tasks.workunit.client.0.smithi121.stdout:0/132: dwrite d1/d4/db/f1a [0,4194304] 0 2024-08-18T22:41:30.760 INFO:tasks.workunit.client.1.smithi195.stdout:1/139: rmdir da 39 2024-08-18T22:41:30.761 INFO:tasks.workunit.client.0.smithi121.stdout:0/133: creat d1/d4/db/d18/f2d x:0 0 0 2024-08-18T22:41:30.763 INFO:tasks.workunit.client.0.smithi121.stdout:0/134: chown d1/d4/db/d18/d1c/l27 20 1 2024-08-18T22:41:30.765 INFO:tasks.workunit.client.0.smithi121.stdout:0/135: mkdir d1/d4/db/d18/d2e 0 2024-08-18T22:41:30.767 INFO:tasks.workunit.client.0.smithi121.stdout:0/136: chown d1/d4/db/d24/df/d8/c21 46249 1 2024-08-18T22:41:30.770 INFO:tasks.workunit.client.1.smithi195.stdout:1/140: dwrite da/f24 [0,4194304] 0 2024-08-18T22:41:30.772 INFO:tasks.workunit.client.0.smithi121.stdout:9/266: sync 2024-08-18T22:41:30.772 INFO:tasks.workunit.client.0.smithi121.stdout:4/147: sync 2024-08-18T22:41:30.772 INFO:tasks.workunit.client.0.smithi121.stdout:2/60: sync 2024-08-18T22:41:30.772 INFO:tasks.workunit.client.0.smithi121.stdout:1/214: sync 2024-08-18T22:41:30.772 INFO:tasks.workunit.client.0.smithi121.stdout:8/226: sync 2024-08-18T22:41:30.772 INFO:tasks.workunit.client.0.smithi121.stdout:5/75: sync 2024-08-18T22:41:30.772 INFO:tasks.workunit.client.0.smithi121.stdout:7/143: sync 2024-08-18T22:41:30.773 INFO:tasks.workunit.client.1.smithi195.stdout:1/141: creat da/d18/d28/f2f x:0 0 0 2024-08-18T22:41:30.773 INFO:tasks.workunit.client.1.smithi195.stdout:1/142: write f5 [4884054,39973] 0 2024-08-18T22:41:30.776 INFO:tasks.workunit.client.0.smithi121.stdout:9/267: chown d0/d5/dd/d2f/c4a 208 1 2024-08-18T22:41:30.776 INFO:tasks.workunit.client.0.smithi121.stdout:2/61: read d2/d3/fe [288055,18475] 0 2024-08-18T22:41:30.777 INFO:tasks.workunit.client.0.smithi121.stdout:5/76: creat d3/f14 x:0 0 0 2024-08-18T22:41:30.778 INFO:tasks.workunit.client.0.smithi121.stdout:9/268: chown d0/d38/d47/d4c/d45 13149722 1 2024-08-18T22:41:30.780 INFO:tasks.workunit.client.1.smithi195.stdout:1/143: truncate da/d18/f1a 661469 0 2024-08-18T22:41:30.781 INFO:tasks.workunit.client.0.smithi121.stdout:1/215: creat d5/d10/d14/f4b x:0 0 0 2024-08-18T22:41:30.782 INFO:tasks.workunit.client.1.smithi195.stdout:1/144: creat da/d18/f30 x:0 0 0 2024-08-18T22:41:30.782 INFO:tasks.workunit.client.0.smithi121.stdout:1/216: chown d5/df/d15/f2d 1 1 2024-08-18T22:41:30.783 INFO:tasks.workunit.client.0.smithi121.stdout:1/217: fsync d5/f7 0 2024-08-18T22:41:30.783 INFO:tasks.workunit.client.1.smithi195.stdout:1/145: mkdir da/d18/d28/d31 0 2024-08-18T22:41:30.784 INFO:tasks.workunit.client.0.smithi121.stdout:5/77: getdents d3/d5/d13 0 2024-08-18T22:41:30.784 INFO:tasks.workunit.client.1.smithi195.stdout:1/146: write da/d18/d28/f2e [464332,111414] 0 2024-08-18T22:41:30.785 INFO:tasks.workunit.client.0.smithi121.stdout:5/78: write d3/f12 [1046712,68919] 0 2024-08-18T22:41:30.785 INFO:tasks.workunit.client.1.smithi195.stdout:1/147: write f5 [5695887,58566] 0 2024-08-18T22:41:30.786 INFO:tasks.workunit.client.1.smithi195.stdout:1/148: read f6 [7052154,84073] 0 2024-08-18T22:41:30.786 INFO:tasks.workunit.client.0.smithi121.stdout:7/144: getdents de/d13/d18 0 2024-08-18T22:41:30.786 INFO:tasks.workunit.client.0.smithi121.stdout:5/79: fdatasync d3/d5/f8 0 2024-08-18T22:41:30.787 INFO:tasks.workunit.client.0.smithi121.stdout:4/148: getdents d2/dc/d16/d22/d29 0 2024-08-18T22:41:30.787 INFO:tasks.workunit.client.0.smithi121.stdout:5/80: fdatasync d3/d5/f8 0 2024-08-18T22:41:30.787 INFO:tasks.workunit.client.0.smithi121.stdout:9/269: link d0/d38/d47/d4c/df/l36 d0/d38/d52/l5d 0 2024-08-18T22:41:30.788 INFO:tasks.workunit.client.0.smithi121.stdout:4/149: chown d2/dc 2825566 1 2024-08-18T22:41:30.788 INFO:tasks.workunit.client.0.smithi121.stdout:7/145: rename de/d13 to de/d13/d18/d23/d24/d25/d37 22 2024-08-18T22:41:30.788 INFO:tasks.workunit.client.0.smithi121.stdout:5/81: chown d3/fa 8 1 2024-08-18T22:41:30.789 INFO:tasks.workunit.client.0.smithi121.stdout:5/82: stat c2 0 2024-08-18T22:41:30.789 INFO:tasks.workunit.client.1.smithi195.stdout:1/149: symlink da/d18/d28/d31/l32 0 2024-08-18T22:41:30.789 INFO:tasks.workunit.client.1.smithi195.stdout:1/150: fdatasync da/f29 0 2024-08-18T22:41:30.789 INFO:tasks.workunit.client.0.smithi121.stdout:4/150: write d2/dc/f12 [78813,124742] 0 2024-08-18T22:41:30.790 INFO:tasks.workunit.client.1.smithi195.stdout:1/151: symlink da/l33 0 2024-08-18T22:41:30.791 INFO:tasks.workunit.client.0.smithi121.stdout:7/146: mkdir de/d1a/d34/d38 0 2024-08-18T22:41:30.792 INFO:tasks.workunit.client.0.smithi121.stdout:4/151: rmdir d2/dc 39 2024-08-18T22:41:30.792 INFO:tasks.workunit.client.0.smithi121.stdout:5/83: mknod d3/d5/d13/c15 0 2024-08-18T22:41:30.793 INFO:tasks.workunit.client.0.smithi121.stdout:7/147: mkdir de/d1a/d20/d39 0 2024-08-18T22:41:30.795 INFO:tasks.workunit.client.0.smithi121.stdout:9/270: dwrite d0/d5/f9 [0,4194304] 0 2024-08-18T22:41:30.797 INFO:tasks.workunit.client.0.smithi121.stdout:5/84: rename d3/d5/f8 to d3/d5/d13/f16 0 2024-08-18T22:41:30.797 INFO:tasks.workunit.client.1.smithi195.stdout:1/152: dwrite da/d18/f30 [0,4194304] 0 2024-08-18T22:41:30.797 INFO:tasks.workunit.client.0.smithi121.stdout:5/85: write d3/f14 [379008,360] 0 2024-08-18T22:41:30.798 INFO:tasks.workunit.client.1.smithi195.stdout:1/153: chown da/fd 1069894567 1 2024-08-18T22:41:30.800 INFO:tasks.workunit.client.0.smithi121.stdout:5/86: symlink d3/d5/d13/l17 0 2024-08-18T22:41:30.800 INFO:tasks.workunit.client.0.smithi121.stdout:7/148: link c3 de/d1a/d34/d38/c3a 0 2024-08-18T22:41:30.801 INFO:tasks.workunit.client.0.smithi121.stdout:9/271: link d0/d38/d47/d4c/df/f20 d0/d5/dd/d2f/f5e 0 2024-08-18T22:41:30.801 INFO:tasks.workunit.client.0.smithi121.stdout:9/272: stat d0/d38/d47/d4c/c32 0 2024-08-18T22:41:30.802 INFO:tasks.workunit.client.0.smithi121.stdout:5/87: write d3/d5/d13/f16 [5988704,102600] 0 2024-08-18T22:41:30.802 INFO:tasks.workunit.client.0.smithi121.stdout:7/149: mknod de/d13/d18/d23/c3b 0 2024-08-18T22:41:30.802 INFO:tasks.workunit.client.0.smithi121.stdout:5/88: stat d3/d5 0 2024-08-18T22:41:30.803 INFO:tasks.workunit.client.1.smithi195.stdout:1/154: dread da/f13 [0,4194304] 0 2024-08-18T22:41:30.804 INFO:tasks.workunit.client.0.smithi121.stdout:7/150: creat de/d13/d18/f3c x:0 0 0 2024-08-18T22:41:30.804 INFO:tasks.workunit.client.1.smithi195.stdout:1/155: fdatasync da/d18/d28/f2f 0 2024-08-18T22:41:30.804 INFO:tasks.workunit.client.0.smithi121.stdout:9/273: mkdir d0/d38/d52/d5f 0 2024-08-18T22:41:30.805 INFO:tasks.workunit.client.0.smithi121.stdout:5/89: creat d3/d5/d13/f18 x:0 0 0 2024-08-18T22:41:30.807 INFO:tasks.workunit.client.0.smithi121.stdout:5/90: write d3/fc [331669,81144] 0 2024-08-18T22:41:30.807 INFO:tasks.workunit.client.0.smithi121.stdout:9/274: mkdir d0/d5/dd/d1a/d55/d60 0 2024-08-18T22:41:30.809 INFO:tasks.workunit.client.1.smithi195.stdout:1/156: dread da/d18/f30 [0,4194304] 0 2024-08-18T22:41:30.813 INFO:tasks.workunit.client.0.smithi121.stdout:5/91: write d3/f14 [842830,128234] 0 2024-08-18T22:41:30.815 INFO:tasks.workunit.client.0.smithi121.stdout:7/151: dwrite de/d1a/d20/f35 [0,4194304] 0 2024-08-18T22:41:30.815 INFO:tasks.workunit.client.1.smithi195.stdout:1/157: link da/d18/d28/f2d da/d18/d28/f34 0 2024-08-18T22:41:30.815 INFO:tasks.workunit.client.0.smithi121.stdout:8/227: write d6/f8 [4943555,69674] 0 2024-08-18T22:41:30.816 INFO:tasks.workunit.client.0.smithi121.stdout:3/184: mknod d1e/d1f/c47 0 2024-08-18T22:41:30.817 INFO:tasks.workunit.client.0.smithi121.stdout:1/218: dread d5/df/d15/f2d [0,4194304] 0 2024-08-18T22:41:30.818 INFO:tasks.workunit.client.1.smithi195.stdout:1/158: mkdir da/d35 0 2024-08-18T22:41:30.818 INFO:tasks.workunit.client.1.smithi195.stdout:1/159: readlink da/lf 0 2024-08-18T22:41:30.819 INFO:tasks.workunit.client.0.smithi121.stdout:5/92: write d3/f14 [359773,27009] 0 2024-08-18T22:41:30.819 INFO:tasks.workunit.client.1.smithi195.stdout:1/160: write da/f1d [4419413,31975] 0 2024-08-18T22:41:30.820 INFO:tasks.workunit.client.0.smithi121.stdout:0/137: fdatasync d1/d4/db/f1a 0 2024-08-18T22:41:30.822 INFO:tasks.workunit.client.1.smithi195.stdout:1/161: mknod da/d18/d28/d31/c36 0 2024-08-18T22:41:30.822 INFO:tasks.workunit.client.0.smithi121.stdout:8/228: mknod d6/d1e/d2d/c4b 0 2024-08-18T22:41:30.823 INFO:tasks.workunit.client.0.smithi121.stdout:7/152: creat de/d13/d18/d23/f3d x:0 0 0 2024-08-18T22:41:30.824 INFO:tasks.workunit.client.0.smithi121.stdout:3/185: mknod d1e/d1f/d2a/c48 0 2024-08-18T22:41:30.824 INFO:tasks.workunit.client.1.smithi195.stdout:1/162: creat da/d18/f37 x:0 0 0 2024-08-18T22:41:30.825 INFO:tasks.workunit.client.0.smithi121.stdout:0/138: fsync d1/d4/da/f28 0 2024-08-18T22:41:30.827 INFO:tasks.workunit.client.0.smithi121.stdout:3/186: readlink d1e/d1f/d25/l44 0 2024-08-18T22:41:30.828 INFO:tasks.workunit.client.0.smithi121.stdout:8/229: symlink d6/d1e/l4c 0 2024-08-18T22:41:30.828 INFO:tasks.workunit.client.0.smithi121.stdout:1/219: creat d5/df/d48/f4c x:0 0 0 2024-08-18T22:41:30.828 INFO:tasks.workunit.client.0.smithi121.stdout:9/275: dwrite d0/d5/dd/d1a/f4d [0,4194304] 0 2024-08-18T22:41:30.830 INFO:tasks.workunit.client.0.smithi121.stdout:0/139: chown d1/d4/f1f 30330618 1 2024-08-18T22:41:30.830 INFO:tasks.workunit.client.0.smithi121.stdout:7/153: symlink de/d13/d18/d2e/l3e 0 2024-08-18T22:41:30.832 INFO:tasks.workunit.client.0.smithi121.stdout:1/220: chown d5/df/c41 5427 1 2024-08-18T22:41:30.833 INFO:tasks.workunit.client.0.smithi121.stdout:8/230: truncate d6/dd/d3b/f43 964439 0 2024-08-18T22:41:30.834 INFO:tasks.workunit.client.1.smithi195.stdout:1/163: truncate da/d18/f30 2084726 0 2024-08-18T22:41:30.837 INFO:tasks.workunit.client.0.smithi121.stdout:3/187: fsync f1c 0 2024-08-18T22:41:30.842 INFO:tasks.workunit.client.0.smithi121.stdout:1/221: creat d5/d10/d14/d2a/d3a/f4d x:0 0 0 2024-08-18T22:41:30.844 INFO:tasks.workunit.client.1.smithi195.stdout:1/164: rename da/d18/f30 to da/d18/f38 0 2024-08-18T22:41:30.844 INFO:tasks.workunit.client.0.smithi121.stdout:7/154: dwrite de/f1d [0,4194304] 0 2024-08-18T22:41:30.845 INFO:tasks.workunit.client.0.smithi121.stdout:1/222: fdatasync d5/df/d11/f26 0 2024-08-18T22:41:30.846 INFO:tasks.workunit.client.0.smithi121.stdout:0/140: rename d1/d4/db/d18/d1c/d2a to d1/d4/da/d2f 0 2024-08-18T22:41:30.846 INFO:tasks.workunit.client.1.smithi195.stdout:1/165: link da/f29 da/d18/f39 0 2024-08-18T22:41:30.848 INFO:tasks.workunit.client.1.smithi195.stdout:1/166: rmdir da/d18/d28 39 2024-08-18T22:41:30.850 INFO:tasks.workunit.client.0.smithi121.stdout:3/188: creat d1e/d1f/d3e/d42/f49 x:0 0 0 2024-08-18T22:41:30.850 INFO:tasks.workunit.client.0.smithi121.stdout:5/93: dread d3/d5/d13/f16 [0,4194304] 0 2024-08-18T22:41:30.851 INFO:tasks.workunit.client.0.smithi121.stdout:7/155: fdatasync de/d13/d18/d2e/f32 0 2024-08-18T22:41:30.852 INFO:tasks.workunit.client.1.smithi195.stdout:1/167: link da/d18/f1a da/d35/f3a 0 2024-08-18T22:41:30.853 INFO:tasks.workunit.client.0.smithi121.stdout:3/189: readlink d1e/d1f/d2a/l32 0 2024-08-18T22:41:30.854 INFO:tasks.workunit.client.0.smithi121.stdout:5/94: chown d3/fa 0 1 2024-08-18T22:41:30.854 INFO:tasks.workunit.client.0.smithi121.stdout:8/231: dwrite f5 [0,4194304] 0 2024-08-18T22:41:30.855 INFO:tasks.workunit.client.0.smithi121.stdout:1/223: rmdir d5/d10/d14/d2a 39 2024-08-18T22:41:30.856 INFO:tasks.workunit.client.0.smithi121.stdout:0/141: mkdir d1/d4/db/d24/d30 0 2024-08-18T22:41:30.858 INFO:tasks.workunit.client.0.smithi121.stdout:1/224: chown d5/lc 5 1 2024-08-18T22:41:30.858 INFO:tasks.workunit.client.0.smithi121.stdout:5/95: mkdir d3/d5/d13/d19 0 2024-08-18T22:41:30.859 INFO:tasks.workunit.client.0.smithi121.stdout:7/156: chown de/d1a/d34/d38/c3a 1445932 1 2024-08-18T22:41:30.860 INFO:tasks.workunit.client.0.smithi121.stdout:5/96: stat d3/fc 0 2024-08-18T22:41:30.862 INFO:tasks.workunit.client.0.smithi121.stdout:8/232: link d6/d1e/f3f d6/d1e/f4d 0 2024-08-18T22:41:30.863 INFO:tasks.workunit.client.0.smithi121.stdout:5/97: chown d3/d5/d13/f18 857 1 2024-08-18T22:41:30.864 INFO:tasks.workunit.client.1.smithi195.stdout:1/168: rename da/d35 to da/d18/d28/d31/d3b 0 2024-08-18T22:41:30.864 INFO:tasks.workunit.client.0.smithi121.stdout:9/276: dwrite d0/d38/d47/d4c/fc [0,4194304] 0 2024-08-18T22:41:30.864 INFO:tasks.workunit.client.0.smithi121.stdout:0/142: creat d1/d4/db/d24/d30/f31 x:0 0 0 2024-08-18T22:41:30.865 INFO:tasks.workunit.client.0.smithi121.stdout:3/190: dread d1e/d1f/d25/f41 [0,4194304] 0 2024-08-18T22:41:30.865 INFO:tasks.workunit.client.0.smithi121.stdout:7/157: creat de/d1a/d20/f3f x:0 0 0 2024-08-18T22:41:30.866 INFO:tasks.workunit.client.1.smithi195.stdout:1/169: creat da/d18/d28/d31/d3b/f3c x:0 0 0 2024-08-18T22:41:30.866 INFO:tasks.workunit.client.1.smithi195.stdout:1/170: fdatasync da/d18/d28/f2e 0 2024-08-18T22:41:30.867 INFO:tasks.workunit.client.0.smithi121.stdout:5/98: creat d3/f1a x:0 0 0 2024-08-18T22:41:30.868 INFO:tasks.workunit.client.0.smithi121.stdout:0/143: readlink d1/d4/db/d24/l14 0 2024-08-18T22:41:30.869 INFO:tasks.workunit.client.0.smithi121.stdout:5/99: read - d3/f1a zero size 2024-08-18T22:41:30.870 INFO:tasks.workunit.client.0.smithi121.stdout:7/158: rmdir de/d13/d18/d2e 39 2024-08-18T22:41:30.870 INFO:tasks.workunit.client.0.smithi121.stdout:3/191: dread f1a [0,4194304] 0 2024-08-18T22:41:30.871 INFO:tasks.workunit.client.1.smithi195.stdout:1/171: dread da/d18/d28/f27 [0,4194304] 0 2024-08-18T22:41:30.872 INFO:tasks.workunit.client.0.smithi121.stdout:1/225: rename d5/df/d11/c1c to d5/c4e 0 2024-08-18T22:41:30.872 INFO:tasks.workunit.client.0.smithi121.stdout:5/100: stat d3/d5/ce 0 2024-08-18T22:41:30.873 INFO:tasks.workunit.client.0.smithi121.stdout:7/159: stat de/d13/d18/d23/f3d 0 2024-08-18T22:41:30.874 INFO:tasks.workunit.client.0.smithi121.stdout:8/233: link d6/d20/f26 d6/d1e/f4e 0 2024-08-18T22:41:30.875 INFO:tasks.workunit.client.0.smithi121.stdout:5/101: write d3/fc [590443,71188] 0 2024-08-18T22:41:30.876 INFO:tasks.workunit.client.0.smithi121.stdout:0/144: mkdir d1/d4/db/d24/df/d8/d32 0 2024-08-18T22:41:30.876 INFO:tasks.workunit.client.0.smithi121.stdout:8/234: readlink d6/d1e/l4c 0 2024-08-18T22:41:30.877 INFO:tasks.workunit.client.0.smithi121.stdout:9/277: dwrite d0/d5/dd/d1a/f4d [0,4194304] 0 2024-08-18T22:41:30.879 INFO:tasks.workunit.client.0.smithi121.stdout:8/235: read - d6/d1e/f4d zero size 2024-08-18T22:41:30.879 INFO:tasks.workunit.client.0.smithi121.stdout:3/192: mknod d1e/d1f/d25/d2e/d30/c4a 0 2024-08-18T22:41:30.881 INFO:tasks.workunit.client.0.smithi121.stdout:8/236: chown d6/d1e/l34 14787 1 2024-08-18T22:41:30.887 INFO:tasks.workunit.client.0.smithi121.stdout:8/237: dread d6/d20/f26 [0,4194304] 0 2024-08-18T22:41:30.888 INFO:tasks.workunit.client.0.smithi121.stdout:7/160: unlink de/d13/d18/d23/d24/d29/l30 0 2024-08-18T22:41:30.888 INFO:tasks.workunit.client.0.smithi121.stdout:9/278: dwrite d0/d5/fa [0,4194304] 0 2024-08-18T22:41:30.891 INFO:tasks.workunit.client.0.smithi121.stdout:7/161: chown de/d13/d18/d23/d24 185961138 1 2024-08-18T22:41:30.892 INFO:tasks.workunit.client.0.smithi121.stdout:1/226: rename d5/df/f30 to d5/d10/d14/f4f 0 2024-08-18T22:41:30.892 INFO:tasks.workunit.client.0.smithi121.stdout:7/162: readlink de/l2a 0 2024-08-18T22:41:30.893 INFO:tasks.workunit.client.0.smithi121.stdout:9/279: write d0/d5/f9 [505076,34315] 0 2024-08-18T22:41:30.895 INFO:tasks.workunit.client.0.smithi121.stdout:1/227: dread - d5/f1d zero size 2024-08-18T22:41:30.895 INFO:tasks.workunit.client.0.smithi121.stdout:7/163: stat de/d1a 0 2024-08-18T22:41:30.896 INFO:tasks.workunit.client.0.smithi121.stdout:5/102: symlink d3/d5/d13/d19/l1b 0 2024-08-18T22:41:30.897 INFO:tasks.workunit.client.0.smithi121.stdout:8/238: symlink d6/d17/d42/l4f 0 2024-08-18T22:41:30.900 INFO:tasks.workunit.client.0.smithi121.stdout:3/193: dwrite fd [0,4194304] 0 2024-08-18T22:41:30.905 INFO:tasks.workunit.client.0.smithi121.stdout:9/280: unlink d0/d38/d47/d4c/f10 0 2024-08-18T22:41:30.906 INFO:tasks.workunit.client.0.smithi121.stdout:5/103: rename f1 to d3/f1c 0 2024-08-18T22:41:30.909 INFO:tasks.workunit.client.0.smithi121.stdout:1/228: dread d5/df/d15/f2b [0,4194304] 0 2024-08-18T22:41:30.911 INFO:tasks.workunit.client.0.smithi121.stdout:9/281: fsync d0/d5/f25 0 2024-08-18T22:41:30.912 INFO:tasks.workunit.client.0.smithi121.stdout:0/145: truncate d1/d4/db/d18/f22 1120951 0 2024-08-18T22:41:30.917 INFO:tasks.workunit.client.0.smithi121.stdout:7/164: dwrite de/ff [0,4194304] 0 2024-08-18T22:41:30.918 INFO:tasks.workunit.client.0.smithi121.stdout:8/239: dwrite d6/d1e/f35 [0,4194304] 0 2024-08-18T22:41:30.923 INFO:tasks.workunit.client.0.smithi121.stdout:3/194: dwrite d1e/f46 [0,4194304] 0 2024-08-18T22:41:30.925 INFO:tasks.workunit.client.0.smithi121.stdout:1/229: creat d5/d10/d14/f50 x:0 0 0 2024-08-18T22:41:30.927 INFO:tasks.workunit.client.0.smithi121.stdout:7/165: symlink de/d1a/d34/l40 0 2024-08-18T22:41:30.928 INFO:tasks.workunit.client.0.smithi121.stdout:7/166: fdatasync de/d1a/d20/f3f 0 2024-08-18T22:41:30.929 INFO:tasks.workunit.client.0.smithi121.stdout:7/167: fsync de/f1d 0 2024-08-18T22:41:30.931 INFO:tasks.workunit.client.0.smithi121.stdout:3/195: symlink d1e/d1f/d25/l4b 0 2024-08-18T22:41:30.933 INFO:tasks.workunit.client.0.smithi121.stdout:3/196: write d1e/d1f/d3e/d42/f49 [163024,113487] 0 2024-08-18T22:41:30.934 INFO:tasks.workunit.client.0.smithi121.stdout:0/146: mknod d1/d4/db/d24/df/d8/d32/c33 0 2024-08-18T22:41:30.936 INFO:tasks.workunit.client.0.smithi121.stdout:7/168: creat de/d13/d18/d23/f41 x:0 0 0 2024-08-18T22:41:30.940 INFO:tasks.workunit.client.0.smithi121.stdout:3/197: dread fd [0,4194304] 0 2024-08-18T22:41:30.941 INFO:tasks.workunit.client.0.smithi121.stdout:1/230: rename d5/fb to d5/df/f51 0 2024-08-18T22:41:30.944 INFO:tasks.workunit.client.0.smithi121.stdout:0/147: dwrite d1/d4/db/d18/f23 [0,4194304] 0 2024-08-18T22:41:30.946 INFO:tasks.workunit.client.0.smithi121.stdout:8/240: write d6/d1e/f4e [3016659,71440] 0 2024-08-18T22:41:30.946 INFO:tasks.workunit.client.0.smithi121.stdout:3/198: creat d1e/d1f/d25/f4c x:0 0 0 2024-08-18T22:41:30.950 INFO:tasks.workunit.client.0.smithi121.stdout:9/282: dwrite d0/d38/d47/f34 [0,4194304] 0 2024-08-18T22:41:30.955 INFO:tasks.workunit.client.0.smithi121.stdout:7/169: write de/d13/d18/f27 [2004296,93570] 0 2024-08-18T22:41:30.956 INFO:tasks.workunit.client.0.smithi121.stdout:3/199: chown d1e/d1f/d25/l40 0 1 2024-08-18T22:41:30.958 INFO:tasks.workunit.client.0.smithi121.stdout:8/241: creat d6/d17/d37/f50 x:0 0 0 2024-08-18T22:41:30.961 INFO:tasks.workunit.client.0.smithi121.stdout:1/231: creat d5/df/d15/f52 x:0 0 0 2024-08-18T22:41:30.963 INFO:tasks.workunit.client.0.smithi121.stdout:1/232: write d5/d10/d14/f45 [362967,18842] 0 2024-08-18T22:41:30.963 INFO:tasks.workunit.client.0.smithi121.stdout:8/242: dread d6/d1e/f4e [0,4194304] 0 2024-08-18T22:41:30.963 INFO:tasks.workunit.client.0.smithi121.stdout:7/170: rename de/d13/d18/f27 to de/d2d/f42 0 2024-08-18T22:41:30.964 INFO:tasks.workunit.client.0.smithi121.stdout:8/243: readlink d6/d17/l2f 0 2024-08-18T22:41:30.965 INFO:tasks.workunit.client.0.smithi121.stdout:3/200: symlink d1e/d1f/d3e/d42/l4d 0 2024-08-18T22:41:30.967 INFO:tasks.workunit.client.0.smithi121.stdout:9/283: chown d0/d38/d47/d4c/df/d3d 0 1 2024-08-18T22:41:30.970 INFO:tasks.workunit.client.0.smithi121.stdout:9/284: chown d0/d5/f30 18747071 1 2024-08-18T22:41:30.975 INFO:tasks.workunit.client.0.smithi121.stdout:7/171: dwrite de/d1a/d20/f35 [4194304,4194304] 0 2024-08-18T22:41:30.975 INFO:tasks.workunit.client.0.smithi121.stdout:9/285: mkdir d0/d38/d47/d4c/df/d61 0 2024-08-18T22:41:30.976 INFO:tasks.workunit.client.0.smithi121.stdout:0/148: dwrite d1/fd [0,4194304] 0 2024-08-18T22:41:30.977 INFO:tasks.workunit.client.0.smithi121.stdout:1/233: getdents d5 0 2024-08-18T22:41:30.977 INFO:tasks.workunit.client.0.smithi121.stdout:8/244: truncate d6/d1e/f35 2699860 0 2024-08-18T22:41:30.981 INFO:tasks.workunit.client.0.smithi121.stdout:3/201: write f11 [2680606,35214] 0 2024-08-18T22:41:30.983 INFO:tasks.workunit.client.0.smithi121.stdout:3/202: readlink d1e/d1f/d25/l44 0 2024-08-18T22:41:30.986 INFO:tasks.workunit.client.0.smithi121.stdout:7/172: rmdir de 39 2024-08-18T22:41:30.988 INFO:tasks.workunit.client.0.smithi121.stdout:8/245: creat d6/d17/f51 x:0 0 0 2024-08-18T22:41:30.989 INFO:tasks.workunit.client.0.smithi121.stdout:9/286: dwrite d0/d38/f4e [0,4194304] 0 2024-08-18T22:41:30.989 INFO:tasks.workunit.client.0.smithi121.stdout:0/149: creat d1/d4/db/d24/df/d8/d32/f34 x:0 0 0 2024-08-18T22:41:30.990 INFO:tasks.workunit.client.0.smithi121.stdout:1/234: dread d5/df/f51 [0,4194304] 0 2024-08-18T22:41:30.996 INFO:tasks.workunit.client.0.smithi121.stdout:9/287: unlink d0/d5/dd/d1a/f4d 0 2024-08-18T22:41:30.996 INFO:tasks.workunit.client.0.smithi121.stdout:1/235: read d5/df/d15/f2d [145092,111238] 0 2024-08-18T22:41:30.998 INFO:tasks.workunit.client.0.smithi121.stdout:8/246: rename d6/d1e/l23 to d6/dd/d3b/l52 0 2024-08-18T22:41:31.000 INFO:tasks.workunit.client.0.smithi121.stdout:9/288: fdatasync d0/d5/dd/d2f/f50 0 2024-08-18T22:41:31.000 INFO:tasks.workunit.client.0.smithi121.stdout:7/173: write de/f1c [1755435,58040] 0 2024-08-18T22:41:31.001 INFO:tasks.workunit.client.0.smithi121.stdout:1/236: rename d5/l8 to d5/d10/l53 0 2024-08-18T22:41:31.003 INFO:tasks.workunit.client.0.smithi121.stdout:8/247: creat d6/d17/d42/d45/f53 x:0 0 0 2024-08-18T22:41:31.003 INFO:tasks.workunit.client.0.smithi121.stdout:3/203: dwrite f5 [0,4194304] 0 2024-08-18T22:41:31.005 INFO:tasks.workunit.client.0.smithi121.stdout:7/174: fsync de/d13/d18/f3c 0 2024-08-18T22:41:31.005 INFO:tasks.workunit.client.0.smithi121.stdout:8/248: read d6/f8 [4053016,3333] 0 2024-08-18T22:41:31.006 INFO:tasks.workunit.client.0.smithi121.stdout:0/150: dwrite d1/d4/db/d24/f10 [0,4194304] 0 2024-08-18T22:41:31.009 INFO:tasks.workunit.client.0.smithi121.stdout:9/289: creat d0/d38/d47/d4c/df/d3d/f62 x:0 0 0 2024-08-18T22:41:31.011 INFO:tasks.workunit.client.0.smithi121.stdout:0/151: dread - d1/d4/db/d24/f2b zero size 2024-08-18T22:41:31.011 INFO:tasks.workunit.client.0.smithi121.stdout:3/204: mknod d1e/d1f/d25/c4e 0 2024-08-18T22:41:31.018 INFO:tasks.workunit.client.0.smithi121.stdout:0/152: unlink d1/d4/db/d24/f10 0 2024-08-18T22:41:31.022 INFO:tasks.workunit.client.0.smithi121.stdout:8/249: dwrite d6/dd/f16 [0,4194304] 0 2024-08-18T22:41:31.025 INFO:tasks.workunit.client.0.smithi121.stdout:7/175: dwrite f8 [0,4194304] 0 2024-08-18T22:41:31.025 INFO:tasks.workunit.client.0.smithi121.stdout:1/237: read - d5/f1d zero size 2024-08-18T22:41:31.025 INFO:tasks.workunit.client.0.smithi121.stdout:8/250: readlink d6/d17/l2f 0 2024-08-18T22:41:31.026 INFO:tasks.workunit.client.0.smithi121.stdout:9/290: creat d0/d38/d47/d4c/f63 x:0 0 0 2024-08-18T22:41:31.027 INFO:tasks.workunit.client.0.smithi121.stdout:2/62: sync 2024-08-18T22:41:31.029 INFO:tasks.workunit.client.0.smithi121.stdout:9/291: chown d0/d5/l1c 2693010 1 2024-08-18T22:41:31.030 INFO:tasks.workunit.client.0.smithi121.stdout:1/238: read - d5/df/f42 zero size 2024-08-18T22:41:31.032 INFO:tasks.workunit.client.0.smithi121.stdout:3/205: dwrite fd [0,4194304] 0 2024-08-18T22:41:31.035 INFO:tasks.workunit.client.0.smithi121.stdout:3/206: dread - d1e/d1f/d25/f4c zero size 2024-08-18T22:41:31.035 INFO:tasks.workunit.client.0.smithi121.stdout:0/153: dread d1/fd [0,4194304] 0 2024-08-18T22:41:31.037 INFO:tasks.workunit.client.0.smithi121.stdout:7/176: mkdir de/d13/d18/d23/d24/d29/d43 0 2024-08-18T22:41:31.038 INFO:tasks.workunit.client.0.smithi121.stdout:3/207: creat d1e/d1f/f4f x:0 0 0 2024-08-18T22:41:31.040 INFO:tasks.workunit.client.0.smithi121.stdout:1/239: dread f4 [4194304,4194304] 0 2024-08-18T22:41:31.040 INFO:tasks.workunit.client.0.smithi121.stdout:7/177: write de/f28 [1248113,85141] 0 2024-08-18T22:41:31.042 INFO:tasks.workunit.client.0.smithi121.stdout:3/208: unlink d1e/d1f/d25/f2b 0 2024-08-18T22:41:31.045 INFO:tasks.workunit.client.0.smithi121.stdout:1/240: fdatasync d5/df/d15/f2b 0 2024-08-18T22:41:31.047 INFO:tasks.workunit.client.0.smithi121.stdout:3/209: mknod d1e/d1f/d25/d2e/d36/c50 0 2024-08-18T22:41:31.047 INFO:tasks.workunit.client.0.smithi121.stdout:5/104: sync 2024-08-18T22:41:31.047 INFO:tasks.workunit.client.0.smithi121.stdout:4/152: sync 2024-08-18T22:41:31.048 INFO:tasks.workunit.client.0.smithi121.stdout:0/154: link d1/c3 d1/d4/db/d18/d1c/c35 0 2024-08-18T22:41:31.048 INFO:tasks.workunit.client.0.smithi121.stdout:3/210: write fd [4195285,39890] 0 2024-08-18T22:41:31.049 INFO:tasks.workunit.client.0.smithi121.stdout:7/178: mknod de/d13/d18/d23/d24/d29/d43/c44 0 2024-08-18T22:41:31.049 INFO:tasks.workunit.client.0.smithi121.stdout:0/155: chown d1/d4/db/d24/f2b 11651020 1 2024-08-18T22:41:31.049 INFO:tasks.workunit.client.0.smithi121.stdout:3/211: dread - d1e/d1f/f4f zero size 2024-08-18T22:41:31.050 INFO:tasks.workunit.client.0.smithi121.stdout:8/251: write d6/d17/f1d [314225,30861] 0 2024-08-18T22:41:31.051 INFO:tasks.workunit.client.0.smithi121.stdout:7/179: chown de/d1a/d2f/d36 6074886 1 2024-08-18T22:41:31.051 INFO:tasks.workunit.client.0.smithi121.stdout:0/156: fsync d1/d4/db/d24/f2b 0 2024-08-18T22:41:31.054 INFO:tasks.workunit.client.0.smithi121.stdout:5/105: creat d3/d5/f1d x:0 0 0 2024-08-18T22:41:31.056 INFO:tasks.workunit.client.0.smithi121.stdout:7/180: symlink de/d13/d18/d23/l45 0 2024-08-18T22:41:31.057 INFO:tasks.workunit.client.0.smithi121.stdout:9/292: write d0/d5/dd/d1a/f37 [447379,119405] 0 2024-08-18T22:41:31.058 INFO:tasks.workunit.client.0.smithi121.stdout:3/212: symlink d1e/d1f/d3e/d42/l51 0 2024-08-18T22:41:31.061 INFO:tasks.workunit.client.0.smithi121.stdout:0/157: creat d1/d4/db/d18/d1c/f36 x:0 0 0 2024-08-18T22:41:31.061 INFO:tasks.workunit.client.0.smithi121.stdout:9/293: fsync d0/d5/f25 0 2024-08-18T22:41:31.062 INFO:tasks.workunit.client.0.smithi121.stdout:7/181: write de/d13/d18/d23/f3d [401731,63574] 0 2024-08-18T22:41:31.065 INFO:tasks.workunit.client.0.smithi121.stdout:2/63: dwrite d2/d3/fe [0,4194304] 0 2024-08-18T22:41:31.067 INFO:tasks.workunit.client.0.smithi121.stdout:5/106: creat d3/d5/d13/d19/f1e x:0 0 0 2024-08-18T22:41:31.067 INFO:tasks.workunit.client.0.smithi121.stdout:3/213: unlink f1c 0 2024-08-18T22:41:31.070 INFO:tasks.workunit.client.0.smithi121.stdout:1/241: write d5/f3c [2721730,61395] 0 2024-08-18T22:41:31.071 INFO:tasks.workunit.client.0.smithi121.stdout:8/252: dwrite d6/d17/d37/f50 [0,4194304] 0 2024-08-18T22:41:31.071 INFO:tasks.workunit.client.0.smithi121.stdout:9/294: fsync d0/d38/d47/f51 0 2024-08-18T22:41:31.075 INFO:tasks.workunit.client.0.smithi121.stdout:7/182: unlink de/d1a/f33 0 2024-08-18T22:41:31.076 INFO:tasks.workunit.client.0.smithi121.stdout:4/153: dwrite d2/f21 [0,4194304] 0 2024-08-18T22:41:31.076 INFO:tasks.workunit.client.0.smithi121.stdout:0/158: creat d1/d4/db/f37 x:0 0 0 2024-08-18T22:41:31.077 INFO:tasks.workunit.client.0.smithi121.stdout:1/242: mknod d5/df/d48/c54 0 2024-08-18T22:41:31.078 INFO:tasks.workunit.client.0.smithi121.stdout:8/253: creat d6/d1e/f54 x:0 0 0 2024-08-18T22:41:31.080 INFO:tasks.workunit.client.0.smithi121.stdout:0/159: chown d1/d4/db/d24/df 650934710 1 2024-08-18T22:41:31.082 INFO:tasks.workunit.client.0.smithi121.stdout:9/295: write d0/d38/d47/d4c/f1f [255103,42182] 0 2024-08-18T22:41:31.083 INFO:tasks.workunit.client.0.smithi121.stdout:7/183: chown de/d1a/d20/c26 6421393 1 2024-08-18T22:41:31.085 INFO:tasks.workunit.client.0.smithi121.stdout:4/154: write d2/f9 [835373,48641] 0 2024-08-18T22:41:31.085 INFO:tasks.workunit.client.0.smithi121.stdout:7/184: readlink de/l10 0 2024-08-18T22:41:31.086 INFO:tasks.workunit.client.0.smithi121.stdout:8/254: rmdir d6/d17/d42 39 2024-08-18T22:41:31.086 INFO:tasks.workunit.client.0.smithi121.stdout:1/243: truncate d5/f49 692866 0 2024-08-18T22:41:31.087 INFO:tasks.workunit.client.0.smithi121.stdout:7/185: chown de/d13/d18/f19 1588 1 2024-08-18T22:41:31.088 INFO:tasks.workunit.client.0.smithi121.stdout:3/214: dwrite d1e/f46 [0,4194304] 0 2024-08-18T22:41:31.089 INFO:tasks.workunit.client.0.smithi121.stdout:5/107: link d3/d5/d13/f18 d3/d5/d13/d19/f1f 0 2024-08-18T22:41:31.091 INFO:tasks.workunit.client.0.smithi121.stdout:0/160: unlink d1/d4/db/l13 0 2024-08-18T22:41:31.094 INFO:tasks.workunit.client.0.smithi121.stdout:3/215: creat d1e/d1f/f52 x:0 0 0 2024-08-18T22:41:31.095 INFO:tasks.workunit.client.0.smithi121.stdout:0/161: write d1/d4/db/f37 [266515,123723] 0 2024-08-18T22:41:31.096 INFO:tasks.workunit.client.0.smithi121.stdout:1/244: write d5/fd [888892,112917] 0 2024-08-18T22:41:31.096 INFO:tasks.workunit.client.0.smithi121.stdout:7/186: dread fb [0,4194304] 0 2024-08-18T22:41:31.097 INFO:tasks.workunit.client.0.smithi121.stdout:9/296: truncate d0/d38/d47/d4c/df/f20 3282255 0 2024-08-18T22:41:31.099 INFO:tasks.workunit.client.0.smithi121.stdout:4/155: creat d2/f2e x:0 0 0 2024-08-18T22:41:31.099 INFO:tasks.workunit.client.0.smithi121.stdout:3/216: truncate d1e/d1f/f52 633990 0 2024-08-18T22:41:31.101 INFO:tasks.workunit.client.0.smithi121.stdout:8/255: creat d6/d17/f55 x:0 0 0 2024-08-18T22:41:31.102 INFO:tasks.workunit.client.0.smithi121.stdout:7/187: rmdir de/d1a/d20 39 2024-08-18T22:41:31.102 INFO:tasks.workunit.client.0.smithi121.stdout:1/245: write d5/df/d15/f2d [1650631,6652] 0 2024-08-18T22:41:31.104 INFO:tasks.workunit.client.0.smithi121.stdout:9/297: creat d0/d38/d47/d4c/df/d3d/f64 x:0 0 0 2024-08-18T22:41:31.105 INFO:tasks.workunit.client.0.smithi121.stdout:5/108: rmdir d3 39 2024-08-18T22:41:31.109 INFO:tasks.workunit.client.0.smithi121.stdout:1/246: creat d5/df/d15/d28/d3d/f55 x:0 0 0 2024-08-18T22:41:31.109 INFO:tasks.workunit.client.0.smithi121.stdout:0/162: dwrite d1/d4/db/d24/f29 [0,4194304] 0 2024-08-18T22:41:31.113 INFO:tasks.workunit.client.0.smithi121.stdout:8/256: truncate d6/d1e/f4d 864518 0 2024-08-18T22:41:31.115 INFO:tasks.workunit.client.0.smithi121.stdout:7/188: creat de/d1a/d34/d38/f46 x:0 0 0 2024-08-18T22:41:31.116 INFO:tasks.workunit.client.0.smithi121.stdout:4/156: symlink d2/dc/d16/d22/d2c/l2f 0 2024-08-18T22:41:31.119 INFO:tasks.workunit.client.0.smithi121.stdout:3/217: dwrite d1e/d1f/d25/f27 [0,4194304] 0 2024-08-18T22:41:31.121 INFO:tasks.workunit.client.0.smithi121.stdout:8/257: mkdir d6/dd/d25/d56 0 2024-08-18T22:41:31.122 INFO:tasks.workunit.client.0.smithi121.stdout:7/189: truncate de/f1f 1328374 0 2024-08-18T22:41:31.126 INFO:tasks.workunit.client.0.smithi121.stdout:1/247: truncate d5/d10/d14/d34/f44 303563 0 2024-08-18T22:41:31.127 INFO:tasks.workunit.client.0.smithi121.stdout:8/258: truncate d6/d1e/f54 1035240 0 2024-08-18T22:41:31.127 INFO:tasks.workunit.client.0.smithi121.stdout:3/218: symlink d1e/d1f/l53 0 2024-08-18T22:41:31.129 INFO:tasks.workunit.client.0.smithi121.stdout:3/219: fsync f16 0 2024-08-18T22:41:31.129 INFO:tasks.workunit.client.0.smithi121.stdout:4/157: unlink d2/dc/d16/d22/d2c/l2f 0 2024-08-18T22:41:31.132 INFO:tasks.workunit.client.0.smithi121.stdout:1/248: symlink d5/df/d48/l56 0 2024-08-18T22:41:31.132 INFO:tasks.workunit.client.0.smithi121.stdout:9/298: dwrite d0/d5/dd/d3b/d48/f57 [0,4194304] 0 2024-08-18T22:41:31.132 INFO:tasks.workunit.client.0.smithi121.stdout:0/163: dwrite d1/d4/db/d24/df/f7 [0,4194304] 0 2024-08-18T22:41:31.133 INFO:tasks.workunit.client.0.smithi121.stdout:8/259: symlink d6/d17/d42/l57 0 2024-08-18T22:41:31.136 INFO:tasks.workunit.client.0.smithi121.stdout:1/249: dread - d5/d10/f20 zero size 2024-08-18T22:41:31.136 INFO:tasks.workunit.client.0.smithi121.stdout:4/158: write d2/f4 [482123,48276] 0 2024-08-18T22:41:31.138 INFO:tasks.workunit.client.0.smithi121.stdout:3/220: rename f5 to d1e/d1f/d25/f54 0 2024-08-18T22:41:31.139 INFO:tasks.workunit.client.0.smithi121.stdout:9/299: truncate d0/d38/d47/d4c/f63 644901 0 2024-08-18T22:41:31.139 INFO:tasks.workunit.client.0.smithi121.stdout:9/300: fsync d0/f3 0 2024-08-18T22:41:31.140 INFO:tasks.workunit.client.0.smithi121.stdout:7/190: getdents de/d13/d18/d23/d24/d29 0 2024-08-18T22:41:31.141 INFO:tasks.workunit.client.0.smithi121.stdout:0/164: fsync d1/fd 0 2024-08-18T22:41:31.144 INFO:tasks.workunit.client.0.smithi121.stdout:8/260: creat d6/d17/d42/f58 x:0 0 0 2024-08-18T22:41:31.145 INFO:tasks.workunit.client.0.smithi121.stdout:3/221: mknod d1e/d1f/c55 0 2024-08-18T22:41:31.146 INFO:tasks.workunit.client.0.smithi121.stdout:3/222: chown f16 1 1 2024-08-18T22:41:31.148 INFO:tasks.workunit.client.0.smithi121.stdout:9/301: symlink d0/d38/d52/l65 0 2024-08-18T22:41:31.149 INFO:tasks.workunit.client.0.smithi121.stdout:1/250: symlink d5/d10/d36/l57 0 2024-08-18T22:41:31.151 INFO:tasks.workunit.client.0.smithi121.stdout:0/165: dwrite d1/d4/db/d24/f2b [0,4194304] 0 2024-08-18T22:41:31.151 INFO:tasks.workunit.client.0.smithi121.stdout:8/261: creat d6/d17/d42/d45/f59 x:0 0 0 2024-08-18T22:41:31.155 INFO:tasks.workunit.client.0.smithi121.stdout:7/191: creat de/d13/d18/d2e/f47 x:0 0 0 2024-08-18T22:41:31.158 INFO:tasks.workunit.client.0.smithi121.stdout:9/302: chown d0/d38/d47/d4c/c29 329 1 2024-08-18T22:41:31.159 INFO:tasks.workunit.client.0.smithi121.stdout:3/223: dwrite f12 [0,4194304] 0 2024-08-18T22:41:31.159 INFO:tasks.workunit.client.0.smithi121.stdout:7/192: chown de/d13/d18/d23/c3b 235802726 1 2024-08-18T22:41:31.160 INFO:tasks.workunit.client.0.smithi121.stdout:0/166: creat d1/d4/db/f38 x:0 0 0 2024-08-18T22:41:31.161 INFO:tasks.workunit.client.0.smithi121.stdout:3/224: write fd [2116566,62912] 0 2024-08-18T22:41:31.163 INFO:tasks.workunit.client.0.smithi121.stdout:9/303: write d0/d38/d47/d4c/d18/f1d [532468,99575] 0 2024-08-18T22:41:31.163 INFO:tasks.workunit.client.0.smithi121.stdout:7/193: readlink de/d13/d18/d2e/l3e 0 2024-08-18T22:41:31.164 INFO:tasks.workunit.client.0.smithi121.stdout:5/109: truncate d3/f14 127009 0 2024-08-18T22:41:31.166 INFO:tasks.workunit.client.0.smithi121.stdout:9/304: write d0/d5/fe [4452094,110842] 0 2024-08-18T22:41:31.166 INFO:tasks.workunit.client.0.smithi121.stdout:3/225: symlink d1e/d1f/d2a/l56 0 2024-08-18T22:41:31.167 INFO:tasks.workunit.client.0.smithi121.stdout:7/194: rmdir de/d13/d18 39 2024-08-18T22:41:31.168 INFO:tasks.workunit.client.0.smithi121.stdout:5/110: symlink d3/d5/d13/l20 0 2024-08-18T22:41:31.169 INFO:tasks.workunit.client.0.smithi121.stdout:9/305: truncate d0/d5/dd/d2f/f3c 385190 0 2024-08-18T22:41:31.170 INFO:tasks.workunit.client.0.smithi121.stdout:7/195: fdatasync de/d13/d18/d23/f41 0 2024-08-18T22:41:31.173 INFO:tasks.workunit.client.0.smithi121.stdout:5/111: mkdir d3/d5/d13/d19/d21 0 2024-08-18T22:41:31.176 INFO:tasks.workunit.client.0.smithi121.stdout:9/306: unlink d0/d38/d47/f33 0 2024-08-18T22:41:31.177 INFO:tasks.workunit.client.0.smithi121.stdout:9/307: chown d0/d38/d47/d4c/d18/l42 66920559 1 2024-08-18T22:41:31.179 INFO:tasks.workunit.client.0.smithi121.stdout:5/112: mkdir d3/d5/d13/d22 0 2024-08-18T22:41:31.180 INFO:tasks.workunit.client.0.smithi121.stdout:7/196: symlink de/d13/l48 0 2024-08-18T22:41:31.181 INFO:tasks.workunit.client.0.smithi121.stdout:5/113: write d3/d5/f7 [334603,40275] 0 2024-08-18T22:41:31.181 INFO:tasks.workunit.client.0.smithi121.stdout:9/308: chown d0/d38/d47/f3a 60581893 1 2024-08-18T22:41:31.183 INFO:tasks.workunit.client.0.smithi121.stdout:8/262: write d6/d20/f26 [2360605,69882] 0 2024-08-18T22:41:31.185 INFO:tasks.workunit.client.0.smithi121.stdout:7/197: fdatasync de/d1a/d20/f3f 0 2024-08-18T22:41:31.187 INFO:tasks.workunit.client.0.smithi121.stdout:5/114: rename d3/d5/d13/d19/d21 to d3/d5/d13/d23 0 2024-08-18T22:41:31.189 INFO:tasks.workunit.client.0.smithi121.stdout:1/251: dwrite d5/df/f51 [0,4194304] 0 2024-08-18T22:41:31.191 INFO:tasks.workunit.client.0.smithi121.stdout:3/226: truncate d1e/f31 2910988 0 2024-08-18T22:41:31.192 INFO:tasks.workunit.client.0.smithi121.stdout:1/252: write d5/df/d15/d28/d3d/f43 [1718475,115144] 0 2024-08-18T22:41:31.193 INFO:tasks.workunit.client.0.smithi121.stdout:7/198: dread de/d1a/f1e [0,4194304] 0 2024-08-18T22:41:31.194 INFO:tasks.workunit.client.0.smithi121.stdout:9/309: creat d0/d38/d52/d5f/f66 x:0 0 0 2024-08-18T22:41:31.195 INFO:tasks.workunit.client.0.smithi121.stdout:5/115: mkdir d3/d5/d13/d19/d24 0 2024-08-18T22:41:31.196 INFO:tasks.workunit.client.0.smithi121.stdout:7/199: chown de/d13/d18/d23/c31 133642175 1 2024-08-18T22:41:31.196 INFO:tasks.workunit.client.0.smithi121.stdout:8/263: getdents d6/d1e/d49 0 2024-08-18T22:41:31.197 INFO:tasks.workunit.client.0.smithi121.stdout:7/200: chown de/d2d 14070 1 2024-08-18T22:41:31.200 INFO:tasks.workunit.client.0.smithi121.stdout:1/253: fsync d5/d10/d14/d2a/f2f 0 2024-08-18T22:41:31.201 INFO:tasks.workunit.client.0.smithi121.stdout:9/310: creat d0/d38/f67 x:0 0 0 2024-08-18T22:41:31.202 INFO:tasks.workunit.client.0.smithi121.stdout:9/311: write d0/f1e [5233131,123908] 0 2024-08-18T22:41:31.204 INFO:tasks.workunit.client.0.smithi121.stdout:5/116: rename d3/d5/d13/d19/f1f to d3/d5/d13/d22/f25 0 2024-08-18T22:41:31.205 INFO:tasks.workunit.client.0.smithi121.stdout:9/312: write d0/d38/f67 [860539,48794] 0 2024-08-18T22:41:31.207 INFO:tasks.workunit.client.0.smithi121.stdout:8/264: symlink d6/d1e/d49/l5a 0 2024-08-18T22:41:31.209 INFO:tasks.workunit.client.0.smithi121.stdout:3/227: dread f11 [0,4194304] 0 2024-08-18T22:41:31.212 INFO:tasks.workunit.client.0.smithi121.stdout:1/254: dwrite d5/d10/d14/d34/f44 [0,4194304] 0 2024-08-18T22:41:31.213 INFO:tasks.workunit.client.0.smithi121.stdout:9/313: mknod d0/d5/dd/d1a/d55/c68 0 2024-08-18T22:41:31.213 INFO:tasks.workunit.client.0.smithi121.stdout:8/265: dread d6/d1e/f54 [0,4194304] 0 2024-08-18T22:41:31.215 INFO:tasks.workunit.client.0.smithi121.stdout:1/255: write d5/f1d [160585,55152] 0 2024-08-18T22:41:31.216 INFO:tasks.workunit.client.0.smithi121.stdout:5/117: getdents d3/d5/d13 0 2024-08-18T22:41:31.216 INFO:tasks.workunit.client.0.smithi121.stdout:8/266: stat d6/dd/d25 0 2024-08-18T22:41:31.217 INFO:tasks.workunit.client.0.smithi121.stdout:5/118: fdatasync d3/f1a 0 2024-08-18T22:41:31.219 INFO:tasks.workunit.client.0.smithi121.stdout:9/314: dread d0/d5/dd/d2f/f3c [0,4194304] 0 2024-08-18T22:41:31.219 INFO:tasks.workunit.client.0.smithi121.stdout:8/267: read - d6/d17/d42/f58 zero size 2024-08-18T22:41:31.224 INFO:tasks.workunit.client.0.smithi121.stdout:8/268: mkdir d6/d1e/d49/d5b 0 2024-08-18T22:41:31.225 INFO:tasks.workunit.client.0.smithi121.stdout:3/228: dwrite d1e/d1f/d25/f41 [0,4194304] 0 2024-08-18T22:41:31.225 INFO:tasks.workunit.client.0.smithi121.stdout:9/315: creat d0/d5/dd/d3b/d48/f69 x:0 0 0 2024-08-18T22:41:31.227 INFO:tasks.workunit.client.0.smithi121.stdout:9/316: chown d0/d38/d47/d4c/d45 470267416 1 2024-08-18T22:41:31.227 INFO:tasks.workunit.client.0.smithi121.stdout:8/269: mknod d6/dd/d3b/c5c 0 2024-08-18T22:41:31.228 INFO:tasks.workunit.client.0.smithi121.stdout:9/317: dread - d0/d38/d47/f51 zero size 2024-08-18T22:41:31.229 INFO:tasks.workunit.client.0.smithi121.stdout:8/270: write d6/d17/d42/d45/f59 [531567,41876] 0 2024-08-18T22:41:31.230 INFO:tasks.workunit.client.0.smithi121.stdout:1/256: write d5/df/d15/f37 [4277838,118858] 0 2024-08-18T22:41:31.230 INFO:tasks.workunit.client.0.smithi121.stdout:5/119: write d3/f14 [857853,24080] 0 2024-08-18T22:41:31.231 INFO:tasks.workunit.client.0.smithi121.stdout:9/318: write d0/d5/fa [2205267,47370] 0 2024-08-18T22:41:31.233 INFO:tasks.workunit.client.0.smithi121.stdout:8/271: chown d6/d1e/d2d/c39 9570 1 2024-08-18T22:41:31.236 INFO:tasks.workunit.client.0.smithi121.stdout:9/319: mknod d0/d38/d47/d4c/df/d3d/c6a 0 2024-08-18T22:41:31.236 INFO:tasks.workunit.client.0.smithi121.stdout:5/120: creat d3/f26 x:0 0 0 2024-08-18T22:41:31.237 INFO:tasks.workunit.client.0.smithi121.stdout:8/272: dread d6/d17/f1d [0,4194304] 0 2024-08-18T22:41:31.240 INFO:tasks.workunit.client.0.smithi121.stdout:9/320: symlink d0/d38/d44/l6b 0 2024-08-18T22:41:31.242 INFO:tasks.workunit.client.0.smithi121.stdout:1/257: dwrite d5/df/f51 [4194304,4194304] 0 2024-08-18T22:41:31.243 INFO:tasks.workunit.client.0.smithi121.stdout:8/273: getdents d6/d1e/d49/d5b 0 2024-08-18T22:41:31.244 INFO:tasks.workunit.client.0.smithi121.stdout:3/229: truncate f12 645543 0 2024-08-18T22:41:31.247 INFO:tasks.workunit.client.0.smithi121.stdout:1/258: chown d5/df/d11/c1e 435994 1 2024-08-18T22:41:31.250 INFO:tasks.workunit.client.0.smithi121.stdout:5/121: dwrite d3/d5/d13/d19/f1e [0,4194304] 0 2024-08-18T22:41:31.252 INFO:tasks.workunit.client.0.smithi121.stdout:1/259: creat d5/d10/d14/d2a/f58 x:0 0 0 2024-08-18T22:41:31.259 INFO:tasks.workunit.client.0.smithi121.stdout:9/321: rmdir d0/d38/d44/d5a 0 2024-08-18T22:41:31.261 INFO:tasks.workunit.client.0.smithi121.stdout:5/122: mkdir d3/d5/d27 0 2024-08-18T22:41:31.261 INFO:tasks.workunit.client.0.smithi121.stdout:3/230: truncate ff 1040821 0 2024-08-18T22:41:31.263 INFO:tasks.workunit.client.0.smithi121.stdout:5/123: read - d3/d5/f1d zero size 2024-08-18T22:41:31.265 INFO:tasks.workunit.client.0.smithi121.stdout:3/231: write d1e/d1f/d25/f54 [3712397,110229] 0 2024-08-18T22:41:31.266 INFO:tasks.workunit.client.0.smithi121.stdout:1/260: dwrite d5/d10/d14/d34/f44 [0,4194304] 0 2024-08-18T22:41:31.266 INFO:tasks.workunit.client.0.smithi121.stdout:9/322: rename d0/d38/f67 to d0/d5/dd/d1a/d55/f6c 0 2024-08-18T22:41:31.267 INFO:tasks.workunit.client.0.smithi121.stdout:3/232: dread - d1e/d1f/d25/f4c zero size 2024-08-18T22:41:31.268 INFO:tasks.workunit.client.0.smithi121.stdout:1/261: fsync d5/df/d15/f52 0 2024-08-18T22:41:31.269 INFO:tasks.workunit.client.0.smithi121.stdout:3/233: write d1e/d1f/f52 [499651,129091] 0 2024-08-18T22:41:31.270 INFO:tasks.workunit.client.0.smithi121.stdout:9/323: write d0/d38/d47/d4c/d18/f1d [1393674,92667] 0 2024-08-18T22:41:31.270 INFO:tasks.workunit.client.0.smithi121.stdout:1/262: dread - d5/df/d15/d28/d3d/f55 zero size 2024-08-18T22:41:31.276 INFO:tasks.workunit.client.0.smithi121.stdout:1/263: truncate d5/f1f 3540449 0 2024-08-18T22:41:31.278 INFO:tasks.workunit.client.0.smithi121.stdout:3/234: link fd d1e/d1f/d25/d2e/d36/f57 0 2024-08-18T22:41:31.283 INFO:tasks.workunit.client.0.smithi121.stdout:3/235: unlink d1e/d1f/d25/d2e/d30/l38 0 2024-08-18T22:41:31.285 INFO:tasks.workunit.client.0.smithi121.stdout:9/324: rmdir d0/d5/dd/d1a 39 2024-08-18T22:41:31.286 INFO:tasks.workunit.client.0.smithi121.stdout:8/274: dwrite d6/d1e/f3f [0,4194304] 0 2024-08-18T22:41:31.287 INFO:tasks.workunit.client.0.smithi121.stdout:5/124: truncate d3/d5/f11 420457 0 2024-08-18T22:41:31.288 INFO:tasks.workunit.client.0.smithi121.stdout:5/125: readlink d3/d5/l9 0 2024-08-18T22:41:31.289 INFO:tasks.workunit.client.0.smithi121.stdout:5/126: rename d3/d5 to d3/d5/d13/d28 22 2024-08-18T22:41:31.289 INFO:tasks.workunit.client.0.smithi121.stdout:5/127: chown d3/c10 1235041891 1 2024-08-18T22:41:31.289 INFO:tasks.workunit.client.0.smithi121.stdout:3/236: mkdir d1e/d1f/d25/d58 0 2024-08-18T22:41:31.291 INFO:tasks.workunit.client.0.smithi121.stdout:9/325: readlink d0/d38/d47/l58 0 2024-08-18T22:41:31.293 INFO:tasks.workunit.client.0.smithi121.stdout:8/275: creat d6/d1e/f5d x:0 0 0 2024-08-18T22:41:31.295 INFO:tasks.workunit.client.0.smithi121.stdout:8/276: write d6/f9 [777675,83171] 0 2024-08-18T22:41:31.298 INFO:tasks.workunit.client.0.smithi121.stdout:5/128: dwrite d3/f14 [0,4194304] 0 2024-08-18T22:41:31.300 INFO:tasks.workunit.client.0.smithi121.stdout:9/326: creat d0/d38/d52/f6d x:0 0 0 2024-08-18T22:41:31.301 INFO:tasks.workunit.client.0.smithi121.stdout:9/327: stat d0/d38/d47/d4c/df/d3d/f64 0 2024-08-18T22:41:31.304 INFO:tasks.workunit.client.0.smithi121.stdout:8/277: mknod d6/d17/d37/c5e 0 2024-08-18T22:41:31.306 INFO:tasks.workunit.client.0.smithi121.stdout:5/129: creat d3/d5/d13/d22/f29 x:0 0 0 2024-08-18T22:41:31.308 INFO:tasks.workunit.client.0.smithi121.stdout:9/328: write d0/d5/dd/d2f/f3c [616629,114460] 0 2024-08-18T22:41:31.309 INFO:tasks.workunit.client.0.smithi121.stdout:5/130: creat d3/f2a x:0 0 0 2024-08-18T22:41:31.310 INFO:tasks.workunit.client.0.smithi121.stdout:3/237: getdents d1e/d1f/d25/d2e 0 2024-08-18T22:41:31.315 INFO:tasks.workunit.client.0.smithi121.stdout:8/278: getdents d6/d1e 0 2024-08-18T22:41:31.315 INFO:tasks.workunit.client.0.smithi121.stdout:9/329: dwrite d0/f1e [0,4194304] 0 2024-08-18T22:41:31.317 INFO:tasks.workunit.client.0.smithi121.stdout:5/131: link d3/d5/d13/l17 d3/d5/d13/d19/d24/l2b 0 2024-08-18T22:41:31.318 INFO:tasks.workunit.client.0.smithi121.stdout:5/132: chown d3/fa 21 1 2024-08-18T22:41:31.318 INFO:tasks.workunit.client.0.smithi121.stdout:5/133: fdatasync d3/f2a 0 2024-08-18T22:41:31.322 INFO:tasks.workunit.client.0.smithi121.stdout:8/279: creat d6/d17/f5f x:0 0 0 2024-08-18T22:41:31.326 INFO:tasks.workunit.client.0.smithi121.stdout:5/134: dwrite d3/f1c [0,4194304] 0 2024-08-18T22:41:31.327 INFO:tasks.workunit.client.0.smithi121.stdout:9/330: truncate d0/d5/f9 1188988 0 2024-08-18T22:41:31.330 INFO:tasks.workunit.client.0.smithi121.stdout:8/280: rename d6/d1e/d49 to d6/d17/d60 0 2024-08-18T22:41:31.333 INFO:tasks.workunit.client.0.smithi121.stdout:5/135: link d3/d5/f7 d3/f2c 0 2024-08-18T22:41:31.334 INFO:tasks.workunit.client.0.smithi121.stdout:9/331: truncate d0/d5/f30 673096 0 2024-08-18T22:41:31.336 INFO:tasks.workunit.client.0.smithi121.stdout:5/136: mknod d3/d5/d13/d23/c2d 0 2024-08-18T22:41:31.337 INFO:tasks.workunit.client.0.smithi121.stdout:5/137: write d3/f2a [785510,36635] 0 2024-08-18T22:41:31.338 INFO:tasks.workunit.client.0.smithi121.stdout:8/281: rename d6/d17/d18/l1c to d6/dd/l61 0 2024-08-18T22:41:31.338 INFO:tasks.workunit.client.0.smithi121.stdout:5/138: chown d3/fa 121651035 1 2024-08-18T22:41:31.338 INFO:tasks.workunit.client.0.smithi121.stdout:5/139: chown d3/f1c 415923 1 2024-08-18T22:41:31.339 INFO:tasks.workunit.client.0.smithi121.stdout:9/332: creat d0/d38/d47/d4c/df/d61/f6e x:0 0 0 2024-08-18T22:41:31.340 INFO:tasks.workunit.client.0.smithi121.stdout:8/282: mknod d6/d1e/d2d/c62 0 2024-08-18T22:41:31.343 INFO:tasks.workunit.client.0.smithi121.stdout:9/333: creat d0/d5/dd/d1a/d55/f6f x:0 0 0 2024-08-18T22:41:31.347 INFO:tasks.workunit.client.0.smithi121.stdout:8/283: dwrite d6/d17/d42/f58 [0,4194304] 0 2024-08-18T22:41:31.350 INFO:tasks.workunit.client.0.smithi121.stdout:8/284: symlink d6/d17/d60/l63 0 2024-08-18T22:41:31.356 INFO:tasks.workunit.client.0.smithi121.stdout:5/140: truncate d3/f1c 1373089 0 2024-08-18T22:41:31.358 INFO:tasks.workunit.client.0.smithi121.stdout:9/334: write d0/d5/dd/f41 [4364153,88611] 0 2024-08-18T22:41:31.358 INFO:tasks.workunit.client.0.smithi121.stdout:8/285: rmdir d6 39 2024-08-18T22:41:31.359 INFO:tasks.workunit.client.0.smithi121.stdout:8/286: write f5 [1349673,74919] 0 2024-08-18T22:41:31.362 INFO:tasks.workunit.client.0.smithi121.stdout:9/335: unlink d0/d38/d47/d4c/df/d3d/f62 0 2024-08-18T22:41:31.364 INFO:tasks.workunit.client.0.smithi121.stdout:5/141: write d3/d5/d13/f18 [631027,24871] 0 2024-08-18T22:41:31.364 INFO:tasks.workunit.client.0.smithi121.stdout:9/336: truncate d0/d5/dd/d1a/d55/f6f 844668 0 2024-08-18T22:41:31.366 INFO:tasks.workunit.client.0.smithi121.stdout:5/142: creat d3/d5/d27/f2e x:0 0 0 2024-08-18T22:41:31.367 INFO:tasks.workunit.client.0.smithi121.stdout:9/337: creat d0/d5/dd/d1a/d55/f70 x:0 0 0 2024-08-18T22:41:31.369 INFO:tasks.workunit.client.0.smithi121.stdout:2/64: sync 2024-08-18T22:41:31.369 INFO:tasks.workunit.client.0.smithi121.stdout:5/143: rename d3/d5/d13/d19/l1b to d3/d5/d13/d19/d24/l2f 0 2024-08-18T22:41:31.370 INFO:tasks.workunit.client.0.smithi121.stdout:5/144: read - d3/fd zero size 2024-08-18T22:41:31.371 INFO:tasks.workunit.client.0.smithi121.stdout:9/338: rename d0/d38/d47/d4c/l16 to d0/d5/dd/d1a/l71 0 2024-08-18T22:41:31.372 INFO:tasks.workunit.client.0.smithi121.stdout:9/339: stat d0/d5/dd/d1a/d55/c68 0 2024-08-18T22:41:31.372 INFO:tasks.workunit.client.0.smithi121.stdout:2/65: mkdir d2/d11 0 2024-08-18T22:41:31.372 INFO:tasks.workunit.client.0.smithi121.stdout:5/145: rmdir d3/d5 39 2024-08-18T22:41:31.376 INFO:tasks.workunit.client.0.smithi121.stdout:9/340: getdents d0/d5/dd/d3b 0 2024-08-18T22:41:31.377 INFO:tasks.workunit.client.0.smithi121.stdout:5/146: creat d3/d5/d13/d19/f30 x:0 0 0 2024-08-18T22:41:31.378 INFO:tasks.workunit.client.0.smithi121.stdout:9/341: symlink d0/d5/dd/d1a/l72 0 2024-08-18T22:41:31.378 INFO:tasks.workunit.client.0.smithi121.stdout:2/66: dwrite d2/d3/f4 [4194304,4194304] 0 2024-08-18T22:41:31.382 INFO:tasks.workunit.client.0.smithi121.stdout:9/342: read d0/d38/d47/d4c/f1f [246775,94674] 0 2024-08-18T22:41:31.388 INFO:tasks.workunit.client.0.smithi121.stdout:2/67: rename d2/la to d2/d8/db/l12 0 2024-08-18T22:41:31.390 INFO:tasks.workunit.client.0.smithi121.stdout:9/343: mkdir d0/d38/d47/d4c/df/d73 0 2024-08-18T22:41:31.391 INFO:tasks.workunit.client.0.smithi121.stdout:9/344: dread - d0/d5/dd/d1a/d55/f70 zero size 2024-08-18T22:41:31.392 INFO:tasks.workunit.client.0.smithi121.stdout:2/68: dread d2/d3/fe [0,4194304] 0 2024-08-18T22:41:31.393 INFO:tasks.workunit.client.0.smithi121.stdout:5/147: link d3/d5/d13/d19/d24/l2b d3/d5/d13/d19/d24/l31 0 2024-08-18T22:41:31.395 INFO:tasks.workunit.client.0.smithi121.stdout:2/69: creat d2/d8/db/f13 x:0 0 0 2024-08-18T22:41:31.396 INFO:tasks.workunit.client.0.smithi121.stdout:2/70: truncate d2/f6 1442110 0 2024-08-18T22:41:31.397 INFO:tasks.workunit.client.0.smithi121.stdout:5/148: mkdir d3/d5/d13/d19/d24/d32 0 2024-08-18T22:41:31.399 INFO:tasks.workunit.client.0.smithi121.stdout:2/71: mknod d2/d8/db/c14 0 2024-08-18T22:41:31.401 INFO:tasks.workunit.client.0.smithi121.stdout:5/149: symlink d3/d5/d13/d19/d24/d32/l33 0 2024-08-18T22:41:31.402 INFO:tasks.workunit.client.0.smithi121.stdout:2/72: mknod d2/d8/db/dc/c15 0 2024-08-18T22:41:31.403 INFO:tasks.workunit.client.0.smithi121.stdout:5/150: creat d3/d5/d13/d23/f34 x:0 0 0 2024-08-18T22:41:31.404 INFO:tasks.workunit.client.0.smithi121.stdout:5/151: write d3/f2a [672133,104461] 0 2024-08-18T22:41:31.406 INFO:tasks.workunit.client.0.smithi121.stdout:9/345: dwrite d0/d38/d47/d4c/df/f20 [0,4194304] 0 2024-08-18T22:41:31.408 INFO:tasks.workunit.client.0.smithi121.stdout:2/73: dread d2/d3/fe [0,4194304] 0 2024-08-18T22:41:31.409 INFO:tasks.workunit.client.0.smithi121.stdout:2/74: write d2/d3/f4 [12273963,93655] 0 2024-08-18T22:41:31.411 INFO:tasks.workunit.client.0.smithi121.stdout:9/346: rmdir d0/d38 39 2024-08-18T22:41:31.412 INFO:tasks.workunit.client.0.smithi121.stdout:5/152: truncate d3/d5/f7 688723 0 2024-08-18T22:41:31.414 INFO:tasks.workunit.client.0.smithi121.stdout:2/75: write d2/d3/fe [1545836,52007] 0 2024-08-18T22:41:31.416 INFO:tasks.workunit.client.0.smithi121.stdout:2/76: dread - d2/d8/db/f13 zero size 2024-08-18T22:41:31.416 INFO:tasks.workunit.client.0.smithi121.stdout:9/347: creat d0/d5/dd/d3b/d48/f74 x:0 0 0 2024-08-18T22:41:31.417 INFO:tasks.workunit.client.0.smithi121.stdout:2/77: chown d2/d3/fe 426110164 1 2024-08-18T22:41:31.417 INFO:tasks.workunit.client.0.smithi121.stdout:5/153: mkdir d3/d5/d27/d35 0 2024-08-18T22:41:31.419 INFO:tasks.workunit.client.0.smithi121.stdout:9/348: creat d0/d5/dd/d3f/f75 x:0 0 0 2024-08-18T22:41:31.420 INFO:tasks.workunit.client.0.smithi121.stdout:2/78: symlink d2/d8/db/dc/l16 0 2024-08-18T22:41:31.425 INFO:tasks.workunit.client.0.smithi121.stdout:5/154: dwrite d3/f12 [0,4194304] 0 2024-08-18T22:41:31.425 INFO:tasks.workunit.client.0.smithi121.stdout:2/79: link d2/d8/db/dc/l10 d2/d8/db/l17 0 2024-08-18T22:41:31.428 INFO:tasks.workunit.client.0.smithi121.stdout:9/349: dwrite d0/d5/dd/d1a/f5c [0,4194304] 0 2024-08-18T22:41:31.428 INFO:tasks.workunit.client.0.smithi121.stdout:2/80: symlink d2/d3/l18 0 2024-08-18T22:41:31.435 INFO:tasks.workunit.client.0.smithi121.stdout:9/350: dread d0/d38/f4e [0,4194304] 0 2024-08-18T22:41:31.437 INFO:tasks.workunit.client.0.smithi121.stdout:9/351: dread - d0/d5/dd/d1a/d55/f70 zero size 2024-08-18T22:41:31.438 INFO:tasks.workunit.client.0.smithi121.stdout:9/352: chown d0 0 1 2024-08-18T22:41:31.439 INFO:tasks.workunit.client.0.smithi121.stdout:2/81: rmdir d2/d11 0 2024-08-18T22:41:31.440 INFO:tasks.workunit.client.0.smithi121.stdout:9/353: readlink d0/d38/d47/l22 0 2024-08-18T22:41:31.442 INFO:tasks.workunit.client.0.smithi121.stdout:2/82: rename d2/d8/db to d2/d8/d19 0 2024-08-18T22:41:31.443 INFO:tasks.workunit.client.0.smithi121.stdout:9/354: mknod d0/d38/d47/d4c/d18/c76 0 2024-08-18T22:41:31.444 INFO:tasks.workunit.client.0.smithi121.stdout:5/155: truncate d3/f1c 968661 0 2024-08-18T22:41:31.447 INFO:tasks.workunit.client.0.smithi121.stdout:9/355: creat d0/d5/dd/d1a/d55/f77 x:0 0 0 2024-08-18T22:41:31.450 INFO:tasks.workunit.client.0.smithi121.stdout:5/156: rename d3/d5/d13/f18 to d3/d5/d27/d35/f36 0 2024-08-18T22:41:31.450 INFO:tasks.workunit.client.0.smithi121.stdout:5/157: readlink d3/d5/d13/l20 0 2024-08-18T22:41:31.451 INFO:tasks.workunit.client.0.smithi121.stdout:2/83: link d2/l5 d2/d8/l1a 0 2024-08-18T22:41:31.454 INFO:tasks.workunit.client.0.smithi121.stdout:2/84: symlink d2/d3/l1b 0 2024-08-18T22:41:31.455 INFO:tasks.workunit.client.0.smithi121.stdout:2/85: symlink d2/d3/l1c 0 2024-08-18T22:41:31.461 INFO:tasks.workunit.client.0.smithi121.stdout:9/356: truncate d0/f1e 4208075 0 2024-08-18T22:41:31.464 INFO:tasks.workunit.client.0.smithi121.stdout:9/357: rename d0/d5/c53 to d0/d38/d47/d4c/df/d61/c78 0 2024-08-18T22:41:31.466 INFO:tasks.workunit.client.0.smithi121.stdout:9/358: truncate d0/d38/d47/f3a 4898432 0 2024-08-18T22:41:31.467 INFO:tasks.workunit.client.0.smithi121.stdout:5/158: dwrite d3/d5/f7 [0,4194304] 0 2024-08-18T22:41:31.468 INFO:tasks.workunit.client.0.smithi121.stdout:9/359: stat d0/d38/d47/d4c/d45 0 2024-08-18T22:41:31.468 INFO:tasks.workunit.client.0.smithi121.stdout:5/159: chown d3/d5/d13/d22 5 1 2024-08-18T22:41:31.477 INFO:tasks.workunit.client.0.smithi121.stdout:9/360: dwrite d0/d5/dd/d3b/d48/f74 [0,4194304] 0 2024-08-18T22:41:31.484 INFO:tasks.workunit.client.0.smithi121.stdout:5/160: truncate d3/f14 2428678 0 2024-08-18T22:41:31.484 INFO:tasks.workunit.client.0.smithi121.stdout:9/361: dwrite d0/d5/dd/d3f/f46 [0,4194304] 0 2024-08-18T22:41:31.487 INFO:tasks.workunit.client.0.smithi121.stdout:5/161: creat d3/d5/d13/d23/f37 x:0 0 0 2024-08-18T22:41:31.489 INFO:tasks.workunit.client.0.smithi121.stdout:5/162: mkdir d3/d5/d13/d19/d24/d32/d38 0 2024-08-18T22:41:31.490 INFO:tasks.workunit.client.0.smithi121.stdout:5/163: creat d3/d5/d13/d22/f39 x:0 0 0 2024-08-18T22:41:31.492 INFO:tasks.workunit.client.0.smithi121.stdout:5/164: write d3/d5/d13/d22/f25 [1177768,56383] 0 2024-08-18T22:41:31.494 INFO:tasks.workunit.client.0.smithi121.stdout:5/165: mknod d3/d5/d27/d35/c3a 0 2024-08-18T22:41:31.497 INFO:tasks.workunit.client.0.smithi121.stdout:9/362: write d0/d5/f30 [1077439,19301] 0 2024-08-18T22:41:31.501 INFO:tasks.workunit.client.0.smithi121.stdout:5/166: dwrite d3/d5/f1d [0,4194304] 0 2024-08-18T22:41:31.508 INFO:tasks.workunit.client.0.smithi121.stdout:5/167: dwrite d3/f26 [0,4194304] 0 2024-08-18T22:41:31.737 INFO:tasks.workunit.client.0.smithi121.stdout:4/159: sync 2024-08-18T22:41:31.738 INFO:tasks.workunit.client.0.smithi121.stdout:4/160: readlink d2/l10 0 2024-08-18T22:41:31.739 INFO:tasks.workunit.client.0.smithi121.stdout:4/161: mkdir d2/dc/d16/d22/d29/d30 0 2024-08-18T22:41:31.746 INFO:tasks.workunit.client.0.smithi121.stdout:4/162: dwrite d2/dc/d16/d22/d29/f26 [0,4194304] 0 2024-08-18T22:41:31.803 INFO:tasks.workunit.client.0.smithi121.stdout:0/167: sync 2024-08-18T22:41:31.811 INFO:tasks.workunit.client.0.smithi121.stdout:0/168: dwrite d1/d4/db/d18/f22 [0,4194304] 0 2024-08-18T22:41:31.813 INFO:tasks.workunit.client.0.smithi121.stdout:0/169: fdatasync d1/d4/db/d24/f29 0 2024-08-18T22:41:31.813 INFO:tasks.workunit.client.0.smithi121.stdout:0/170: chown d1/d4/da/d2f 33 1 2024-08-18T22:41:31.815 INFO:tasks.workunit.client.0.smithi121.stdout:0/171: write d1/d4/db/d24/df/d8/d32/f34 [1739,59107] 0 2024-08-18T22:41:31.817 INFO:tasks.workunit.client.0.smithi121.stdout:0/172: mkdir d1/d4/db/d24/d39 0 2024-08-18T22:41:31.818 INFO:tasks.workunit.client.0.smithi121.stdout:0/173: write d1/d4/db/d24/f2b [663422,29544] 0 2024-08-18T22:41:31.832 INFO:tasks.workunit.client.0.smithi121.stdout:3/238: sync 2024-08-18T22:41:31.832 INFO:tasks.workunit.client.0.smithi121.stdout:7/201: sync 2024-08-18T22:41:31.832 INFO:tasks.workunit.client.0.smithi121.stdout:9/363: sync 2024-08-18T22:41:31.832 INFO:tasks.workunit.client.0.smithi121.stdout:4/163: sync 2024-08-18T22:41:31.832 INFO:tasks.workunit.client.0.smithi121.stdout:2/86: sync 2024-08-18T22:41:31.832 INFO:tasks.workunit.client.0.smithi121.stdout:8/287: sync 2024-08-18T22:41:31.833 INFO:tasks.workunit.client.0.smithi121.stdout:1/264: sync 2024-08-18T22:41:31.833 INFO:tasks.workunit.client.0.smithi121.stdout:5/168: sync 2024-08-18T22:41:31.834 INFO:tasks.workunit.client.0.smithi121.stdout:5/169: fdatasync d3/fa 0 2024-08-18T22:41:31.835 INFO:tasks.workunit.client.0.smithi121.stdout:9/364: mknod d0/d5/c79 0 2024-08-18T22:41:31.839 INFO:tasks.workunit.client.0.smithi121.stdout:4/164: mknod d2/dc/d16/d22/d29/c31 0 2024-08-18T22:41:31.840 INFO:tasks.workunit.client.0.smithi121.stdout:3/239: creat d1e/d1f/d25/d2e/d30/f59 x:0 0 0 2024-08-18T22:41:31.841 INFO:tasks.workunit.client.0.smithi121.stdout:7/202: creat de/d13/f49 x:0 0 0 2024-08-18T22:41:31.842 INFO:tasks.workunit.client.0.smithi121.stdout:9/365: read - d0/d5/dd/d1a/d55/f70 zero size 2024-08-18T22:41:31.843 INFO:tasks.workunit.client.0.smithi121.stdout:5/170: creat d3/d5/d13/d19/d24/d32/f3b x:0 0 0 2024-08-18T22:41:31.845 INFO:tasks.workunit.client.0.smithi121.stdout:7/203: fsync de/d13/f17 0 2024-08-18T22:41:31.846 INFO:tasks.workunit.client.0.smithi121.stdout:8/288: link d6/d1e/d2d/f3d d6/dd/d3b/f64 0 2024-08-18T22:41:31.846 INFO:tasks.workunit.client.0.smithi121.stdout:2/87: dread d2/d3/f4 [4194304,4194304] 0 2024-08-18T22:41:31.846 INFO:tasks.workunit.client.0.smithi121.stdout:0/174: dread d1/d4/db/d24/df/d8/f20 [0,4194304] 0 2024-08-18T22:41:31.847 INFO:tasks.workunit.client.0.smithi121.stdout:3/240: mknod d1e/c5a 0 2024-08-18T22:41:31.847 INFO:tasks.workunit.client.0.smithi121.stdout:7/204: stat de/f28 0 2024-08-18T22:41:31.848 INFO:tasks.workunit.client.0.smithi121.stdout:5/171: write d3/d5/d27/f2e [677999,130301] 0 2024-08-18T22:41:31.849 INFO:tasks.workunit.client.0.smithi121.stdout:4/165: creat d2/dc/f32 x:0 0 0 2024-08-18T22:41:31.849 INFO:tasks.workunit.client.0.smithi121.stdout:2/88: stat d2/d8/d19/dc/c15 0 2024-08-18T22:41:31.849 INFO:tasks.workunit.client.0.smithi121.stdout:1/265: dwrite d5/df/d15/d28/d3d/f43 [0,4194304] 0 2024-08-18T22:41:31.851 INFO:tasks.workunit.client.0.smithi121.stdout:8/289: rmdir d6/d17 39 2024-08-18T22:41:31.852 INFO:tasks.workunit.client.0.smithi121.stdout:7/205: read de/d13/d18/d23/f3d [352062,41055] 0 2024-08-18T22:41:31.854 INFO:tasks.workunit.client.0.smithi121.stdout:0/175: write d1/d4/db/d18/f22 [1810466,99501] 0 2024-08-18T22:41:31.854 INFO:tasks.workunit.client.0.smithi121.stdout:5/172: mkdir d3/d5/d3c 0 2024-08-18T22:41:31.855 INFO:tasks.workunit.client.0.smithi121.stdout:3/241: write d1e/d1f/d25/f4c [618199,111456] 0 2024-08-18T22:41:31.857 INFO:tasks.workunit.client.0.smithi121.stdout:4/166: creat d2/dc/d1c/f33 x:0 0 0 2024-08-18T22:41:31.857 INFO:tasks.workunit.client.0.smithi121.stdout:5/173: fdatasync d3/d5/f1d 0 2024-08-18T22:41:31.858 INFO:tasks.workunit.client.0.smithi121.stdout:7/206: write de/d13/d18/d23/f41 [14298,29020] 0 2024-08-18T22:41:31.858 INFO:tasks.workunit.client.0.smithi121.stdout:2/89: creat d2/f1d x:0 0 0 2024-08-18T22:41:31.861 INFO:tasks.workunit.client.0.smithi121.stdout:9/366: rename d0/d38/d47/f3a to d0/d38/d47/d4c/df/d61/f7a 0 2024-08-18T22:41:31.863 INFO:tasks.workunit.client.0.smithi121.stdout:1/266: dread d5/d10/d14/d2a/f2f [0,4194304] 0 2024-08-18T22:41:31.863 INFO:tasks.workunit.client.0.smithi121.stdout:5/174: stat d3/d5/d13/f16 0 2024-08-18T22:41:31.866 INFO:tasks.workunit.client.0.smithi121.stdout:4/167: creat d2/dc/d16/d22/d29/f34 x:0 0 0 2024-08-18T22:41:31.867 INFO:tasks.workunit.client.0.smithi121.stdout:7/207: rmdir de/d1a/d34 39 2024-08-18T22:41:31.867 INFO:tasks.workunit.client.0.smithi121.stdout:9/367: read d0/d5/dd/d1a/d55/f6c [822390,37386] 0 2024-08-18T22:41:31.869 INFO:tasks.workunit.client.0.smithi121.stdout:0/176: dread d1/fd [0,4194304] 0 2024-08-18T22:41:31.870 INFO:tasks.workunit.client.0.smithi121.stdout:2/90: mknod d2/d8/d19/dc/c1e 0 2024-08-18T22:41:31.871 INFO:tasks.workunit.client.0.smithi121.stdout:9/368: write d0/d5/dd/f41 [4173990,95655] 0 2024-08-18T22:41:31.875 INFO:tasks.workunit.client.0.smithi121.stdout:3/242: dwrite d1e/d1f/d25/f41 [0,4194304] 0 2024-08-18T22:41:31.876 INFO:tasks.workunit.client.0.smithi121.stdout:1/267: symlink d5/df/d15/d28/d3d/l59 0 2024-08-18T22:41:31.877 INFO:tasks.workunit.client.0.smithi121.stdout:8/290: link d6/d1e/d2d/c62 d6/dd/d3b/c65 0 2024-08-18T22:41:31.879 INFO:tasks.workunit.client.0.smithi121.stdout:0/177: write d1/d4/db/d18/f22 [368535,32417] 0 2024-08-18T22:41:31.882 INFO:tasks.workunit.client.0.smithi121.stdout:3/243: symlink d1e/d1f/d2a/l5b 0 2024-08-18T22:41:31.885 INFO:tasks.workunit.client.0.smithi121.stdout:1/268: write d5/d10/d14/f45 [763978,44829] 0 2024-08-18T22:41:31.886 INFO:tasks.workunit.client.0.smithi121.stdout:4/168: dwrite d2/dc/f13 [0,4194304] 0 2024-08-18T22:41:31.889 INFO:tasks.workunit.client.0.smithi121.stdout:0/178: creat d1/d4/db/d18/f3a x:0 0 0 2024-08-18T22:41:31.890 INFO:tasks.workunit.client.0.smithi121.stdout:7/208: write de/f1c [1534265,15297] 0 2024-08-18T22:41:31.890 INFO:tasks.workunit.client.0.smithi121.stdout:8/291: creat d6/d17/d60/f66 x:0 0 0 2024-08-18T22:41:31.890 INFO:tasks.workunit.client.0.smithi121.stdout:5/175: write d3/d5/f11 [150447,45132] 0 2024-08-18T22:41:31.894 INFO:tasks.workunit.client.0.smithi121.stdout:2/91: dwrite d2/d8/d19/f13 [0,4194304] 0 2024-08-18T22:41:31.894 INFO:tasks.workunit.client.0.smithi121.stdout:3/244: creat d1e/d1f/d25/f5c x:0 0 0 2024-08-18T22:41:31.895 INFO:tasks.workunit.client.0.smithi121.stdout:4/169: dread - d2/dc/d1c/f33 zero size 2024-08-18T22:41:31.897 INFO:tasks.workunit.client.0.smithi121.stdout:0/179: creat d1/d4/db/d24/d30/f3b x:0 0 0 2024-08-18T22:41:31.899 INFO:tasks.workunit.client.0.smithi121.stdout:8/292: chown d6/d17/d18/c1f 560034 1 2024-08-18T22:41:31.899 INFO:tasks.workunit.client.0.smithi121.stdout:2/92: stat d2/d8/d19/l17 0 2024-08-18T22:41:31.899 INFO:tasks.workunit.client.0.smithi121.stdout:3/245: chown d1e/d1f/f52 0 1 2024-08-18T22:41:31.899 INFO:tasks.workunit.client.0.smithi121.stdout:5/176: readlink d3/d5/d13/d19/d24/l2b 0 2024-08-18T22:41:31.900 INFO:tasks.workunit.client.0.smithi121.stdout:9/369: dwrite d0/d38/d47/d4c/df/f20 [0,4194304] 0 2024-08-18T22:41:31.901 INFO:tasks.workunit.client.0.smithi121.stdout:4/170: creat d2/dc/d16/f35 x:0 0 0 2024-08-18T22:41:31.902 INFO:tasks.workunit.client.0.smithi121.stdout:0/180: write d1/d4/db/f1a [4719789,8724] 0 2024-08-18T22:41:31.902 INFO:tasks.workunit.client.0.smithi121.stdout:1/269: link d5/c9 d5/d10/c5a 0 2024-08-18T22:41:31.902 INFO:tasks.workunit.client.0.smithi121.stdout:5/177: chown d3/d5/d13/d19/f30 3097 1 2024-08-18T22:41:31.905 INFO:tasks.workunit.client.0.smithi121.stdout:7/209: getdents de 0 2024-08-18T22:41:31.905 INFO:tasks.workunit.client.0.smithi121.stdout:8/293: truncate d6/d17/f51 714727 0 2024-08-18T22:41:31.908 INFO:tasks.workunit.client.0.smithi121.stdout:1/270: unlink f3 0 2024-08-18T22:41:31.910 INFO:tasks.workunit.client.0.smithi121.stdout:4/171: creat d2/dc/d16/f36 x:0 0 0 2024-08-18T22:41:31.910 INFO:tasks.workunit.client.0.smithi121.stdout:3/246: dread d1e/d1f/f52 [0,4194304] 0 2024-08-18T22:41:31.912 INFO:tasks.workunit.client.0.smithi121.stdout:0/181: creat d1/d4/db/f3c x:0 0 0 2024-08-18T22:41:31.912 INFO:tasks.workunit.client.0.smithi121.stdout:7/210: write de/d13/f49 [159231,76945] 0 2024-08-18T22:41:31.913 INFO:tasks.workunit.client.0.smithi121.stdout:5/178: write d3/d5/d13/d22/f39 [460274,122996] 0 2024-08-18T22:41:31.915 INFO:tasks.workunit.client.0.smithi121.stdout:7/211: fdatasync f8 0 2024-08-18T22:41:31.916 INFO:tasks.workunit.client.0.smithi121.stdout:1/271: write d5/d10/d14/f4b [658980,3860] 0 2024-08-18T22:41:31.918 INFO:tasks.workunit.client.0.smithi121.stdout:9/370: mkdir d0/d38/d47/d4c/df/d73/d7b 0 2024-08-18T22:41:31.919 INFO:tasks.workunit.client.0.smithi121.stdout:3/247: write d1e/d1f/d25/f41 [3976649,37921] 0 2024-08-18T22:41:31.920 INFO:tasks.workunit.client.0.smithi121.stdout:1/272: fdatasync d5/d10/d14/f50 0 2024-08-18T22:41:31.920 INFO:tasks.workunit.client.0.smithi121.stdout:2/93: dwrite d2/f6 [0,4194304] 0 2024-08-18T22:41:31.926 INFO:tasks.workunit.client.0.smithi121.stdout:2/94: chown d2 487826 1 2024-08-18T22:41:31.930 INFO:tasks.workunit.client.0.smithi121.stdout:8/294: link d6/d17/d18/c33 d6/d1e/c67 0 2024-08-18T22:41:31.930 INFO:tasks.workunit.client.0.smithi121.stdout:1/273: truncate d5/df/d15/f2b 2818880 0 2024-08-18T22:41:31.933 INFO:tasks.workunit.client.0.smithi121.stdout:3/248: symlink d1e/d1f/d2a/l5d 0 2024-08-18T22:41:31.934 INFO:tasks.workunit.client.0.smithi121.stdout:7/212: mknod de/d1a/d34/d38/c4a 0 2024-08-18T22:41:31.934 INFO:tasks.workunit.client.0.smithi121.stdout:4/172: dwrite d2/f3 [0,4194304] 0 2024-08-18T22:41:31.935 INFO:tasks.workunit.client.0.smithi121.stdout:2/95: mkdir d2/d8/d1f 0 2024-08-18T22:41:31.936 INFO:tasks.workunit.client.0.smithi121.stdout:9/371: mkdir d0/d5/dd/d1a/d55/d7c 0 2024-08-18T22:41:31.936 INFO:tasks.workunit.client.0.smithi121.stdout:5/179: dwrite d3/d5/d27/f2e [0,4194304] 0 2024-08-18T22:41:31.940 INFO:tasks.workunit.client.0.smithi121.stdout:3/249: chown c18 98574 1 2024-08-18T22:41:31.943 INFO:tasks.workunit.client.0.smithi121.stdout:7/213: mkdir de/d1a/d2f/d4b 0 2024-08-18T22:41:31.946 INFO:tasks.workunit.client.0.smithi121.stdout:1/274: creat d5/df/d15/f5b x:0 0 0 2024-08-18T22:41:31.947 INFO:tasks.workunit.client.0.smithi121.stdout:3/250: write d1e/d1f/f52 [1432937,27887] 0 2024-08-18T22:41:31.951 INFO:tasks.workunit.client.0.smithi121.stdout:8/295: dwrite d6/d1e/f4d [0,4194304] 0 2024-08-18T22:41:31.953 INFO:tasks.workunit.client.0.smithi121.stdout:0/182: truncate d1/d4/db/d24/f2b 2134819 0 2024-08-18T22:41:31.955 INFO:tasks.workunit.client.0.smithi121.stdout:3/251: unlink c15 0 2024-08-18T22:41:31.956 INFO:tasks.workunit.client.0.smithi121.stdout:8/296: rmdir d6/dd 39 2024-08-18T22:41:31.958 INFO:tasks.workunit.client.0.smithi121.stdout:0/183: read d1/fd [755082,112869] 0 2024-08-18T22:41:31.960 INFO:tasks.workunit.client.0.smithi121.stdout:1/275: rename d5/d10/f46 to d5/d10/d14/f5c 0 2024-08-18T22:41:31.960 INFO:tasks.workunit.client.0.smithi121.stdout:5/180: dwrite d3/fd [0,4194304] 0 2024-08-18T22:41:31.961 INFO:tasks.workunit.client.0.smithi121.stdout:2/96: dwrite d2/d3/fe [0,4194304] 0 2024-08-18T22:41:31.961 INFO:tasks.workunit.client.0.smithi121.stdout:3/252: mkdir d1e/d1f/d5e 0 2024-08-18T22:41:31.963 INFO:tasks.workunit.client.0.smithi121.stdout:9/372: dwrite d0/d38/d47/d4c/df/d61/f7a [0,4194304] 0 2024-08-18T22:41:31.966 INFO:tasks.workunit.client.0.smithi121.stdout:2/97: symlink d2/d8/d19/l20 0 2024-08-18T22:41:31.967 INFO:tasks.workunit.client.0.smithi121.stdout:1/276: creat d5/d10/d14/d2a/f5d x:0 0 0 2024-08-18T22:41:31.997 INFO:tasks.workunit.client.0.smithi121.stdout:9/373: creat d0/d5/f7d x:0 0 0 2024-08-18T22:41:31.998 INFO:tasks.workunit.client.0.smithi121.stdout:3/253: mkdir d1e/d1f/d25/d2e/d36/d5f 0 2024-08-18T22:41:31.999 INFO:tasks.workunit.client.0.smithi121.stdout:1/277: symlink d5/d10/d36/l5e 0 2024-08-18T22:41:31.999 INFO:tasks.workunit.client.0.smithi121.stdout:0/184: dread d1/d4/db/d24/f29 [0,4194304] 0 2024-08-18T22:41:32.000 INFO:tasks.workunit.client.0.smithi121.stdout:3/254: chown d1e/d1f/d3e/d42/l51 125 1 2024-08-18T22:41:32.001 INFO:tasks.workunit.client.0.smithi121.stdout:9/374: unlink d0/d5/dd/d3f/f46 0 2024-08-18T22:41:32.002 INFO:tasks.workunit.client.0.smithi121.stdout:9/375: readlink d0/d5/l1c 0 2024-08-18T22:41:32.003 INFO:tasks.workunit.client.0.smithi121.stdout:7/214: dread de/f1d [0,4194304] 0 2024-08-18T22:41:32.006 INFO:tasks.workunit.client.0.smithi121.stdout:9/376: mkdir d0/d5/dd/d1a/d55/d7e 0 2024-08-18T22:41:32.006 INFO:tasks.workunit.client.0.smithi121.stdout:0/185: dread d1/d4/db/d18/f22 [0,4194304] 0 2024-08-18T22:41:32.006 INFO:tasks.workunit.client.0.smithi121.stdout:7/215: mknod de/c4c 0 2024-08-18T22:41:32.007 INFO:tasks.workunit.client.0.smithi121.stdout:9/377: fsync d0/f3 0 2024-08-18T22:41:32.007 INFO:tasks.workunit.client.0.smithi121.stdout:1/278: link d5/df/d15/d28/d3d/l59 d5/d10/d14/d2a/l5f 0 2024-08-18T22:41:32.008 INFO:tasks.workunit.client.0.smithi121.stdout:9/378: read d0/d5/dd/d1a/f5c [3959959,116291] 0 2024-08-18T22:41:32.008 INFO:tasks.workunit.client.0.smithi121.stdout:1/279: truncate d5/d10/f20 276931 0 2024-08-18T22:41:32.010 INFO:tasks.workunit.client.0.smithi121.stdout:7/216: creat de/d13/d18/d23/d24/d29/f4d x:0 0 0 2024-08-18T22:41:32.011 INFO:tasks.workunit.client.0.smithi121.stdout:0/186: creat d1/d4/db/d18/d2e/f3d x:0 0 0 2024-08-18T22:41:32.012 INFO:tasks.workunit.client.0.smithi121.stdout:7/217: readlink de/d13/d18/d23/l45 0 2024-08-18T22:41:32.012 INFO:tasks.workunit.client.0.smithi121.stdout:1/280: unlink d5/d10/c13 0 2024-08-18T22:41:32.016 INFO:tasks.workunit.client.0.smithi121.stdout:1/281: creat d5/d10/d14/d2a/f60 x:0 0 0 2024-08-18T22:41:32.017 INFO:tasks.workunit.client.0.smithi121.stdout:9/379: dwrite d0/d38/d47/d4c/df/d61/f6e [0,4194304] 0 2024-08-18T22:41:32.017 INFO:tasks.workunit.client.0.smithi121.stdout:7/218: rename de/d1a/d34/d38/f46 to de/d13/d18/d23/f4e 0 2024-08-18T22:41:32.018 INFO:tasks.workunit.client.0.smithi121.stdout:1/282: stat d5/f7 0 2024-08-18T22:41:32.018 INFO:tasks.workunit.client.0.smithi121.stdout:7/219: fsync de/f1f 0 2024-08-18T22:41:32.019 INFO:tasks.workunit.client.0.smithi121.stdout:9/380: fdatasync d0/d5/dd/d1a/d55/f70 0 2024-08-18T22:41:32.019 INFO:tasks.workunit.client.0.smithi121.stdout:7/220: readlink de/d13/l48 0 2024-08-18T22:41:32.022 INFO:tasks.workunit.client.0.smithi121.stdout:9/381: mkdir d0/d38/d44/d7f 0 2024-08-18T22:41:32.022 INFO:tasks.workunit.client.0.smithi121.stdout:7/221: mkdir de/d1a/d4f 0 2024-08-18T22:41:32.023 INFO:tasks.workunit.client.0.smithi121.stdout:9/382: fsync d0/d38/d47/d4c/fc 0 2024-08-18T22:41:32.023 INFO:tasks.workunit.client.0.smithi121.stdout:7/222: read de/f1d [3475519,63416] 0 2024-08-18T22:41:32.024 INFO:tasks.workunit.client.0.smithi121.stdout:7/223: mkdir de/d2d/d50 0 2024-08-18T22:41:32.025 INFO:tasks.workunit.client.0.smithi121.stdout:7/224: read de/ff [620705,73242] 0 2024-08-18T22:41:32.027 INFO:tasks.workunit.client.0.smithi121.stdout:7/225: mknod de/d13/d18/d23/d24/d29/c51 0 2024-08-18T22:41:32.027 INFO:tasks.workunit.client.0.smithi121.stdout:7/226: stat de/d1a/d20/c26 0 2024-08-18T22:41:32.029 INFO:tasks.workunit.client.0.smithi121.stdout:7/227: mknod de/d13/d18/d23/c52 0 2024-08-18T22:41:32.034 INFO:tasks.workunit.client.0.smithi121.stdout:7/228: dwrite de/f14 [0,4194304] 0 2024-08-18T22:41:32.040 INFO:tasks.workunit.client.0.smithi121.stdout:7/229: dwrite de/f1d [4194304,4194304] 0 2024-08-18T22:41:32.041 INFO:tasks.workunit.client.0.smithi121.stdout:7/230: write de/f14 [2368403,82253] 0 2024-08-18T22:41:32.042 INFO:tasks.workunit.client.0.smithi121.stdout:7/231: write de/f28 [1190507,38680] 0 2024-08-18T22:41:32.045 INFO:tasks.workunit.client.0.smithi121.stdout:7/232: rename de/d13/c21 to de/d2d/c53 0 2024-08-18T22:41:32.046 INFO:tasks.workunit.client.0.smithi121.stdout:7/233: dread - de/d13/d18/d23/d24/d29/f4d zero size 2024-08-18T22:41:32.047 INFO:tasks.workunit.client.0.smithi121.stdout:7/234: rmdir de/d1a/d2f 39 2024-08-18T22:41:32.108 INFO:tasks.workunit.client.0.smithi121.stdout:4/173: truncate d2/f8 302751 0 2024-08-18T22:41:32.111 INFO:tasks.workunit.client.0.smithi121.stdout:4/174: mknod d2/dc/d1c/c37 0 2024-08-18T22:41:32.114 INFO:tasks.workunit.client.0.smithi121.stdout:4/175: creat d2/dc/d16/d22/d29/f38 x:0 0 0 2024-08-18T22:41:32.116 INFO:tasks.workunit.client.0.smithi121.stdout:4/176: dread - d2/dc/d16/d22/d29/f20 zero size 2024-08-18T22:41:32.118 INFO:tasks.workunit.client.0.smithi121.stdout:4/177: creat d2/dc/d16/d22/f39 x:0 0 0 2024-08-18T22:41:32.121 INFO:tasks.workunit.client.0.smithi121.stdout:3/255: dread d1e/d1f/d25/d2e/d36/f37 [0,4194304] 0 2024-08-18T22:41:32.123 INFO:tasks.workunit.client.0.smithi121.stdout:3/256: write d1e/d1f/d25/f27 [646881,1977] 0 2024-08-18T22:41:32.127 INFO:tasks.workunit.client.0.smithi121.stdout:8/297: truncate d6/d17/f40 2823558 0 2024-08-18T22:41:32.130 INFO:tasks.workunit.client.0.smithi121.stdout:8/298: unlink d6/c48 0 2024-08-18T22:41:32.133 INFO:tasks.workunit.client.0.smithi121.stdout:2/98: truncate d2/f6 3056849 0 2024-08-18T22:41:32.134 INFO:tasks.workunit.client.0.smithi121.stdout:8/299: rmdir d6/d1e/d2d 39 2024-08-18T22:41:32.134 INFO:tasks.workunit.client.0.smithi121.stdout:2/99: fsync d2/f1d 0 2024-08-18T22:41:32.137 INFO:tasks.workunit.client.0.smithi121.stdout:2/100: fsync d2/d3/f4 0 2024-08-18T22:41:32.138 INFO:tasks.workunit.client.0.smithi121.stdout:8/300: chown d6/dd/d3b/c65 2 1 2024-08-18T22:41:32.142 INFO:tasks.workunit.client.0.smithi121.stdout:8/301: dread d6/d17/d42/f58 [0,4194304] 0 2024-08-18T22:41:32.144 INFO:tasks.workunit.client.0.smithi121.stdout:7/235: rename de/d13/d18/d23/f4e to de/d1a/d2f/d36/f54 0 2024-08-18T22:41:32.146 INFO:tasks.workunit.client.0.smithi121.stdout:1/283: dread d5/f3c [0,4194304] 0 2024-08-18T22:41:32.147 INFO:tasks.workunit.client.0.smithi121.stdout:3/257: rename d1e/d1f/d3e/d42/l4d to d1e/d1f/d25/d2e/d30/l60 0 2024-08-18T22:41:32.150 INFO:tasks.workunit.client.0.smithi121.stdout:1/284: write d5/fd [3295469,42028] 0 2024-08-18T22:41:32.151 INFO:tasks.workunit.client.0.smithi121.stdout:3/258: dread d1e/f46 [0,4194304] 0 2024-08-18T22:41:32.152 INFO:tasks.workunit.client.0.smithi121.stdout:2/101: rename d2/d3/l1b to d2/l21 0 2024-08-18T22:41:32.153 INFO:tasks.workunit.client.0.smithi121.stdout:7/236: link de/f1f de/d13/d18/d23/d24/d25/f55 0 2024-08-18T22:41:32.155 INFO:tasks.workunit.client.0.smithi121.stdout:1/285: stat d5/df/d15/l33 0 2024-08-18T22:41:32.156 INFO:tasks.workunit.client.0.smithi121.stdout:2/102: mkdir d2/d22 0 2024-08-18T22:41:32.158 INFO:tasks.workunit.client.0.smithi121.stdout:7/237: unlink de/d13/d18/d23/c3b 0 2024-08-18T22:41:32.159 INFO:tasks.workunit.client.0.smithi121.stdout:7/238: chown de/d13/d18/d23/d24/d29/f4d 979508275 1 2024-08-18T22:41:32.160 INFO:tasks.workunit.client.0.smithi121.stdout:3/259: creat d1e/d1f/d25/d2e/d36/d5f/f61 x:0 0 0 2024-08-18T22:41:32.160 INFO:tasks.workunit.client.0.smithi121.stdout:3/260: chown d1e/d1f/d25/f41 651346176 1 2024-08-18T22:41:32.161 INFO:tasks.workunit.client.0.smithi121.stdout:7/239: write de/d13/d18/d23/f41 [467842,93081] 0 2024-08-18T22:41:32.162 INFO:tasks.workunit.client.0.smithi121.stdout:2/103: symlink d2/d3/l23 0 2024-08-18T22:41:32.162 INFO:tasks.workunit.client.0.smithi121.stdout:3/261: fsync d1e/d1f/d25/f5c 0 2024-08-18T22:41:32.162 INFO:tasks.workunit.client.0.smithi121.stdout:7/240: chown de/d13/d18/d23/f3d 12759523 1 2024-08-18T22:41:32.163 INFO:tasks.workunit.client.0.smithi121.stdout:1/286: mknod d5/df/d15/c61 0 2024-08-18T22:41:32.164 INFO:tasks.workunit.client.0.smithi121.stdout:2/104: creat d2/d8/d19/f24 x:0 0 0 2024-08-18T22:41:32.164 INFO:tasks.workunit.client.0.smithi121.stdout:3/262: mknod d1e/d1f/d3e/d42/c62 0 2024-08-18T22:41:32.166 INFO:tasks.workunit.client.0.smithi121.stdout:1/287: mknod d5/df/d48/c62 0 2024-08-18T22:41:32.168 INFO:tasks.workunit.client.0.smithi121.stdout:2/105: unlink d2/cf 0 2024-08-18T22:41:32.168 INFO:tasks.workunit.client.0.smithi121.stdout:2/106: chown d2/d22 2 1 2024-08-18T22:41:32.169 INFO:tasks.workunit.client.0.smithi121.stdout:2/107: chown d2/d8 13 1 2024-08-18T22:41:32.173 INFO:tasks.workunit.client.0.smithi121.stdout:7/241: creat de/d13/d18/d23/d24/f56 x:0 0 0 2024-08-18T22:41:32.174 INFO:tasks.workunit.client.0.smithi121.stdout:7/242: dread - de/d13/d18/f3c zero size 2024-08-18T22:41:32.176 INFO:tasks.workunit.client.0.smithi121.stdout:2/108: rename d2/d3/fe to d2/d8/d1f/f25 0 2024-08-18T22:41:32.178 INFO:tasks.workunit.client.0.smithi121.stdout:2/109: dread - d2/d8/d19/f24 zero size 2024-08-18T22:41:32.179 INFO:tasks.workunit.client.0.smithi121.stdout:1/288: link d5/df/d15/f2b d5/d10/d14/d34/f63 0 2024-08-18T22:41:32.181 INFO:tasks.workunit.client.0.smithi121.stdout:1/289: truncate d5/f49 1119649 0 2024-08-18T22:41:32.181 INFO:tasks.workunit.client.0.smithi121.stdout:7/243: dwrite de/f1d [0,4194304] 0 2024-08-18T22:41:32.182 INFO:tasks.workunit.client.0.smithi121.stdout:1/290: fdatasync d5/df/d15/d28/d3d/f43 0 2024-08-18T22:41:32.183 INFO:tasks.workunit.client.0.smithi121.stdout:7/244: write de/d1a/d20/f3f [227429,31983] 0 2024-08-18T22:41:32.186 INFO:tasks.workunit.client.0.smithi121.stdout:2/110: write d2/d8/d1f/f25 [5039920,46666] 0 2024-08-18T22:41:32.188 INFO:tasks.workunit.client.0.smithi121.stdout:2/111: write d2/d8/d1f/f25 [521634,39799] 0 2024-08-18T22:41:32.188 INFO:tasks.workunit.client.0.smithi121.stdout:3/263: link d1e/l26 d1e/d1f/d25/d58/l63 0 2024-08-18T22:41:32.192 INFO:tasks.workunit.client.0.smithi121.stdout:5/181: sync 2024-08-18T22:41:32.193 INFO:tasks.workunit.client.0.smithi121.stdout:7/245: symlink de/d13/d18/d23/d24/d29/d43/l57 0 2024-08-18T22:41:32.196 INFO:tasks.workunit.client.0.smithi121.stdout:7/246: dread de/d13/d18/d23/f41 [0,4194304] 0 2024-08-18T22:41:32.198 INFO:tasks.workunit.client.0.smithi121.stdout:1/291: mknod d5/c64 0 2024-08-18T22:41:32.200 INFO:tasks.workunit.client.0.smithi121.stdout:2/112: creat d2/d22/f26 x:0 0 0 2024-08-18T22:41:32.201 INFO:tasks.workunit.client.0.smithi121.stdout:5/182: dwrite d3/d5/d13/d22/f29 [0,4194304] 0 2024-08-18T22:41:32.205 INFO:tasks.workunit.client.0.smithi121.stdout:7/247: mknod de/d13/d18/c58 0 2024-08-18T22:41:32.207 INFO:tasks.workunit.client.0.smithi121.stdout:2/113: dread d2/d8/d19/f13 [0,4194304] 0 2024-08-18T22:41:32.209 INFO:tasks.workunit.client.0.smithi121.stdout:1/292: mknod d5/d10/d14/d2a/d3a/c65 0 2024-08-18T22:41:32.211 INFO:tasks.workunit.client.0.smithi121.stdout:2/114: mknod d2/c27 0 2024-08-18T22:41:32.211 INFO:tasks.workunit.client.0.smithi121.stdout:8/302: dwrite d6/d17/f40 [0,4194304] 0 2024-08-18T22:41:32.212 INFO:tasks.workunit.client.0.smithi121.stdout:3/264: rmdir d1e/d1f/d25 39 2024-08-18T22:41:32.214 INFO:tasks.workunit.client.0.smithi121.stdout:7/248: rename de/d13/d18/d23/d24/d29/d43/c44 to de/d1a/d20/d39/c59 0 2024-08-18T22:41:32.215 INFO:tasks.workunit.client.0.smithi121.stdout:4/178: truncate d2/dc/fd 25628 0 2024-08-18T22:41:32.218 INFO:tasks.workunit.client.0.smithi121.stdout:4/179: write d2/dc/d1c/f23 [800218,67204] 0 2024-08-18T22:41:32.221 INFO:tasks.workunit.client.0.smithi121.stdout:7/249: rmdir de/d13/d18/d2e 39 2024-08-18T22:41:32.223 INFO:tasks.workunit.client.0.smithi121.stdout:4/180: stat d2/dc/d16/d22/d29/f34 0 2024-08-18T22:41:32.225 INFO:tasks.workunit.client.0.smithi121.stdout:2/115: dwrite d2/d8/d19/f13 [0,4194304] 0 2024-08-18T22:41:32.226 INFO:tasks.workunit.client.0.smithi121.stdout:1/293: rename d5/fd to d5/d10/d14/d2a/d3a/f66 0 2024-08-18T22:41:32.229 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:41:31 smithi195 ceph-mon[23370]: pgmap v241: 65 pgs: 65 active+clean; 262 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 117 KiB/s rd, 11 MiB/s wr, 448 op/s 2024-08-18T22:41:32.229 INFO:tasks.workunit.client.0.smithi121.stdout:8/303: dread d6/d1e/d2d/f3d [0,4194304] 0 2024-08-18T22:41:32.230 INFO:tasks.workunit.client.0.smithi121.stdout:7/250: creat de/d13/d18/d23/d24/d29/d43/f5a x:0 0 0 2024-08-18T22:41:32.232 INFO:tasks.workunit.client.0.smithi121.stdout:2/116: creat d2/d8/d1f/f28 x:0 0 0 2024-08-18T22:41:32.233 INFO:tasks.workunit.client.0.smithi121.stdout:3/265: link ff d1e/d1f/d3e/f64 0 2024-08-18T22:41:32.233 INFO:tasks.workunit.client.0.smithi121.stdout:8/304: write d6/d17/f5f [1047524,85187] 0 2024-08-18T22:41:32.236 INFO:tasks.workunit.client.0.smithi121.stdout:4/181: dwrite d2/f19 [0,4194304] 0 2024-08-18T22:41:32.239 INFO:tasks.workunit.client.0.smithi121.stdout:7/251: mknod de/c5b 0 2024-08-18T22:41:32.240 INFO:tasks.workunit.client.0.smithi121.stdout:2/117: mknod d2/c29 0 2024-08-18T22:41:32.244 INFO:tasks.workunit.client.0.smithi121.stdout:3/266: creat d1e/d1f/d2a/f65 x:0 0 0 2024-08-18T22:41:32.244 INFO:tasks.workunit.client.0.smithi121.stdout:7/252: dread de/d2d/f42 [0,4194304] 0 2024-08-18T22:41:32.245 INFO:tasks.workunit.client.0.smithi121.stdout:8/305: creat d6/d17/d18/f68 x:0 0 0 2024-08-18T22:41:32.248 INFO:tasks.workunit.client.0.smithi121.stdout:2/118: creat d2/d3/f2a x:0 0 0 2024-08-18T22:41:32.249 INFO:tasks.workunit.client.0.smithi121.stdout:2/119: chown d2/d8/d19/f24 369 1 2024-08-18T22:41:32.250 INFO:tasks.workunit.client.0.smithi121.stdout:2/120: write d2/d8/d1f/f25 [2488735,108473] 0 2024-08-18T22:41:32.252 INFO:tasks.workunit.client.0.smithi121.stdout:7/253: unlink de/f14 0 2024-08-18T22:41:32.252 INFO:tasks.workunit.client.0.smithi121.stdout:7/254: readlink de/d13/l48 0 2024-08-18T22:41:32.253 INFO:tasks.workunit.client.0.smithi121.stdout:4/182: chown d2/f8 108 1 2024-08-18T22:41:32.254 INFO:tasks.workunit.client.0.smithi121.stdout:8/306: mkdir d6/d20/d69 0 2024-08-18T22:41:32.255 INFO:tasks.workunit.client.0.smithi121.stdout:8/307: fdatasync d6/d17/d37/f50 0 2024-08-18T22:41:32.256 INFO:tasks.workunit.client.0.smithi121.stdout:3/267: mkdir d1e/d1f/d25/d2e/d30/d66 0 2024-08-18T22:41:32.257 INFO:tasks.workunit.client.0.smithi121.stdout:8/308: fdatasync d6/dd/f16 0 2024-08-18T22:41:32.259 INFO:tasks.workunit.client.0.smithi121.stdout:2/121: symlink d2/d3/l2b 0 2024-08-18T22:41:32.259 INFO:tasks.workunit.client.0.smithi121.stdout:8/309: fdatasync d6/d1e/f4e 0 2024-08-18T22:41:32.260 INFO:tasks.workunit.client.0.smithi121.stdout:7/255: unlink de/d13/d18/d23/f41 0 2024-08-18T22:41:32.261 INFO:tasks.workunit.client.0.smithi121.stdout:1/294: getdents d5/df/d15/d28 0 2024-08-18T22:41:32.261 INFO:tasks.workunit.client.0.smithi121.stdout:4/183: dwrite d2/f2e [0,4194304] 0 2024-08-18T22:41:32.263 INFO:tasks.workunit.client.0.smithi121.stdout:7/256: stat de/d13/d18/f3c 0 2024-08-18T22:41:32.271 INFO:tasks.workunit.client.0.smithi121.stdout:8/310: dwrite d6/d17/d18/f32 [0,4194304] 0 2024-08-18T22:41:32.271 INFO:tasks.workunit.client.0.smithi121.stdout:7/257: write de/d13/d18/d2e/f47 [594546,57607] 0 2024-08-18T22:41:32.272 INFO:tasks.workunit.client.0.smithi121.stdout:2/122: link d2/d8/d1f/f28 d2/f2c 0 2024-08-18T22:41:32.274 INFO:tasks.workunit.client.0.smithi121.stdout:1/295: dwrite d5/d10/d14/d34/f44 [0,4194304] 0 2024-08-18T22:41:32.276 INFO:tasks.workunit.client.0.smithi121.stdout:2/123: write d2/d3/f4 [8115649,129070] 0 2024-08-18T22:41:32.277 INFO:tasks.workunit.client.0.smithi121.stdout:1/296: write d5/f49 [1367343,16899] 0 2024-08-18T22:41:32.278 INFO:tasks.workunit.client.0.smithi121.stdout:2/124: chown d2/d3/l2b 1936 1 2024-08-18T22:41:32.278 INFO:tasks.workunit.client.0.smithi121.stdout:8/311: truncate d6/d17/d18/f2c 84909 0 2024-08-18T22:41:32.278 INFO:tasks.workunit.client.0.smithi121.stdout:4/184: rename d2/f7 to d2/dc/f3a 0 2024-08-18T22:41:32.279 INFO:tasks.workunit.client.0.smithi121.stdout:8/312: chown d6/d1e/f5d 38697165 1 2024-08-18T22:41:32.281 INFO:tasks.workunit.client.0.smithi121.stdout:2/125: chown d2/f6 14924 1 2024-08-18T22:41:32.281 INFO:tasks.workunit.client.0.smithi121.stdout:2/126: chown d2/d8 170306 1 2024-08-18T22:41:32.283 INFO:tasks.workunit.client.0.smithi121.stdout:4/185: rename d2/f3 to d2/dc/d16/d22/d29/f3b 0 2024-08-18T22:41:32.285 INFO:tasks.workunit.client.0.smithi121.stdout:7/258: read de/f1f [382272,110961] 0 2024-08-18T22:41:32.292 INFO:tasks.workunit.client.0.smithi121.stdout:7/259: rename fb to de/d13/d18/d23/d24/d29/f5c 0 2024-08-18T22:41:32.293 INFO:tasks.workunit.client.0.smithi121.stdout:8/313: dwrite d6/d17/d42/f58 [4194304,4194304] 0 2024-08-18T22:41:32.298 INFO:tasks.workunit.client.0.smithi121.stdout:7/260: creat de/d2d/f5d x:0 0 0 2024-08-18T22:41:32.298 INFO:tasks.workunit.client.0.smithi121.stdout:4/186: dread d2/dc/d16/d22/d29/f3b [0,4194304] 0 2024-08-18T22:41:32.305 INFO:tasks.workunit.client.0.smithi121.stdout:4/187: write d2/dc/d16/d22/d29/f38 [543652,48184] 0 2024-08-18T22:41:32.306 INFO:tasks.workunit.client.0.smithi121.stdout:3/268: dwrite f12 [0,4194304] 0 2024-08-18T22:41:32.307 INFO:tasks.workunit.client.0.smithi121.stdout:8/314: dread d6/d20/f29 [0,4194304] 0 2024-08-18T22:41:32.308 INFO:tasks.workunit.client.0.smithi121.stdout:2/127: dwrite d2/d8/d1f/f28 [0,4194304] 0 2024-08-18T22:41:32.308 INFO:tasks.workunit.client.0.smithi121.stdout:7/261: getdents de/d13 0 2024-08-18T22:41:32.308 INFO:tasks.workunit.client.0.smithi121.stdout:4/188: chown d2/f2d 63 1 2024-08-18T22:41:32.311 INFO:tasks.workunit.client.0.smithi121.stdout:3/269: write d1e/d1f/d25/f27 [1689960,42919] 0 2024-08-18T22:41:32.314 INFO:tasks.workunit.client.0.smithi121.stdout:3/270: fdatasync d1e/d1f/d25/d2e/d30/f59 0 2024-08-18T22:41:32.314 INFO:tasks.workunit.client.0.smithi121.stdout:4/189: rename d2/dc/d16/d22/d29/f34 to d2/dc/d1c/f3c 0 2024-08-18T22:41:32.316 INFO:tasks.workunit.client.0.smithi121.stdout:7/262: symlink de/d13/d18/d23/l5e 0 2024-08-18T22:41:32.317 INFO:tasks.workunit.client.0.smithi121.stdout:7/263: chown f8 4841480 1 2024-08-18T22:41:32.318 INFO:tasks.workunit.client.0.smithi121.stdout:8/315: creat d6/d20/d69/f6a x:0 0 0 2024-08-18T22:41:32.318 INFO:tasks.workunit.client.0.smithi121.stdout:2/128: truncate d2/d8/d19/f24 514819 0 2024-08-18T22:41:32.318 INFO:tasks.workunit.client.0.smithi121.stdout:3/271: write d1e/d1f/d25/d2e/d36/f3c [657873,77133] 0 2024-08-18T22:41:32.318 INFO:tasks.workunit.client.0.smithi121.stdout:7/264: chown de/d13 3872268 1 2024-08-18T22:41:32.321 INFO:tasks.workunit.client.0.smithi121.stdout:4/190: link d2/dc/d16/f35 d2/dc/d16/d22/f3d 0 2024-08-18T22:41:32.322 INFO:tasks.workunit.client.0.smithi121.stdout:3/272: dread f11 [0,4194304] 0 2024-08-18T22:41:32.323 INFO:tasks.workunit.client.0.smithi121.stdout:2/129: creat d2/d8/d19/dc/f2d x:0 0 0 2024-08-18T22:41:32.323 INFO:tasks.workunit.client.0.smithi121.stdout:8/316: creat d6/d17/d18/f6b x:0 0 0 2024-08-18T22:41:32.324 INFO:tasks.workunit.client.0.smithi121.stdout:7/265: mkdir de/d1a/d34/d38/d5f 0 2024-08-18T22:41:32.325 INFO:tasks.workunit.client.0.smithi121.stdout:3/273: truncate d1e/d1f/f52 2304089 0 2024-08-18T22:41:32.326 INFO:tasks.workunit.client.0.smithi121.stdout:2/130: symlink d2/d8/d19/dc/l2e 0 2024-08-18T22:41:32.327 INFO:tasks.workunit.client.0.smithi121.stdout:8/317: creat d6/d17/d42/f6c x:0 0 0 2024-08-18T22:41:32.329 INFO:tasks.workunit.client.0.smithi121.stdout:3/274: unlink d1e/d1f/d2a/l32 0 2024-08-18T22:41:32.329 INFO:tasks.workunit.client.0.smithi121.stdout:2/131: symlink d2/d3/l2f 0 2024-08-18T22:41:32.331 INFO:tasks.workunit.client.0.smithi121.stdout:8/318: fdatasync d6/d1e/d2d/f3d 0 2024-08-18T22:41:32.332 INFO:tasks.workunit.client.0.smithi121.stdout:4/191: link d2/dc/c1f d2/dc/c3e 0 2024-08-18T22:41:32.333 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:41:31 smithi121 ceph-mon[16788]: pgmap v241: 65 pgs: 65 active+clean; 262 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 117 KiB/s rd, 11 MiB/s wr, 448 op/s 2024-08-18T22:41:32.333 INFO:tasks.workunit.client.0.smithi121.stdout:7/266: dread de/f1f [0,4194304] 0 2024-08-18T22:41:32.341 INFO:tasks.workunit.client.0.smithi121.stdout:2/132: dwrite d2/f1d [0,4194304] 0 2024-08-18T22:41:32.342 INFO:tasks.workunit.client.0.smithi121.stdout:3/275: write fd [4596481,74803] 0 2024-08-18T22:41:32.347 INFO:tasks.workunit.client.0.smithi121.stdout:3/276: read - d1e/d1f/d25/d2e/d30/f59 zero size 2024-08-18T22:41:32.347 INFO:tasks.workunit.client.0.smithi121.stdout:4/192: dwrite d2/dc/d16/d22/f39 [0,4194304] 0 2024-08-18T22:41:32.347 INFO:tasks.workunit.client.0.smithi121.stdout:8/319: dwrite d6/d17/f5f [0,4194304] 0 2024-08-18T22:41:32.350 INFO:tasks.workunit.client.0.smithi121.stdout:4/193: read d2/dc/d16/d22/d29/f3b [1106660,60874] 0 2024-08-18T22:41:32.352 INFO:tasks.workunit.client.0.smithi121.stdout:4/194: write d2/dc/d16/d22/f25 [143832,104122] 0 2024-08-18T22:41:32.353 INFO:tasks.workunit.client.0.smithi121.stdout:8/320: getdents d6/d20/d69 0 2024-08-18T22:41:32.356 INFO:tasks.workunit.client.0.smithi121.stdout:8/321: truncate d6/dd/d3b/f64 1820716 0 2024-08-18T22:41:32.363 INFO:tasks.workunit.client.0.smithi121.stdout:0/187: sync 2024-08-18T22:41:32.363 INFO:tasks.workunit.client.0.smithi121.stdout:9/383: sync 2024-08-18T22:41:32.363 INFO:tasks.workunit.client.0.smithi121.stdout:8/322: dwrite d6/d17/f5f [0,4194304] 0 2024-08-18T22:41:32.366 INFO:tasks.workunit.client.0.smithi121.stdout:4/195: truncate d2/dc/d1c/f23 404786 0 2024-08-18T22:41:32.369 INFO:tasks.workunit.client.0.smithi121.stdout:0/188: fsync d1/d4/db/d24/df/f7 0 2024-08-18T22:41:32.372 INFO:tasks.workunit.client.0.smithi121.stdout:3/277: dread f16 [0,4194304] 0 2024-08-18T22:41:32.373 INFO:tasks.workunit.client.0.smithi121.stdout:8/323: dwrite d6/d17/f40 [0,4194304] 0 2024-08-18T22:41:32.373 INFO:tasks.workunit.client.0.smithi121.stdout:4/196: creat d2/f3f x:0 0 0 2024-08-18T22:41:32.374 INFO:tasks.workunit.client.0.smithi121.stdout:0/189: write d1/d4/db/f37 [1020539,7734] 0 2024-08-18T22:41:32.376 INFO:tasks.workunit.client.0.smithi121.stdout:9/384: rename d0/d38/d47/d4c/c32 to d0/c80 0 2024-08-18T22:41:32.377 INFO:tasks.workunit.client.0.smithi121.stdout:0/190: truncate d1/d4/db/d18/d2e/f3d 254166 0 2024-08-18T22:41:32.379 INFO:tasks.workunit.client.0.smithi121.stdout:8/324: symlink d6/dd/l6d 0 2024-08-18T22:41:32.383 INFO:tasks.workunit.client.0.smithi121.stdout:0/191: unlink d1/d4/db/d24/df/d8/d32/c33 0 2024-08-18T22:41:32.389 INFO:tasks.workunit.client.0.smithi121.stdout:0/192: mkdir d1/d4/db/d24/df/d8/d32/d3e 0 2024-08-18T22:41:32.390 INFO:tasks.workunit.client.0.smithi121.stdout:3/278: getdents d1e/d1f 0 2024-08-18T22:41:32.391 INFO:tasks.workunit.client.0.smithi121.stdout:4/197: write d2/dc/d16/f35 [580842,108514] 0 2024-08-18T22:41:32.394 INFO:tasks.workunit.client.0.smithi121.stdout:9/385: link d0/d38/d52/l5d d0/d5/dd/d3b/l81 0 2024-08-18T22:41:32.395 INFO:tasks.workunit.client.0.smithi121.stdout:3/279: mkdir d1e/d1f/d25/d67 0 2024-08-18T22:41:32.396 INFO:tasks.workunit.client.0.smithi121.stdout:8/325: getdents d6/d17/d60 0 2024-08-18T22:41:32.398 INFO:tasks.workunit.client.0.smithi121.stdout:3/280: creat d1e/d1f/d25/d2e/d36/f68 x:0 0 0 2024-08-18T22:41:32.401 INFO:tasks.workunit.client.0.smithi121.stdout:4/198: getdents d2/dc/d16/d22/d29 0 2024-08-18T22:41:32.403 INFO:tasks.workunit.client.0.smithi121.stdout:4/199: fsync d2/dc/d16/f35 0 2024-08-18T22:41:32.404 INFO:tasks.workunit.client.0.smithi121.stdout:0/193: dread d1/d4/db/f1a [0,4194304] 0 2024-08-18T22:41:32.406 INFO:tasks.workunit.client.0.smithi121.stdout:3/281: dwrite d1e/d1f/d25/f54 [0,4194304] 0 2024-08-18T22:41:32.407 INFO:tasks.workunit.client.0.smithi121.stdout:0/194: truncate d1/d4/db/d18/d1c/f36 855531 0 2024-08-18T22:41:32.410 INFO:tasks.workunit.client.0.smithi121.stdout:4/200: write d2/f8 [23636,91458] 0 2024-08-18T22:41:32.410 INFO:tasks.workunit.client.0.smithi121.stdout:4/201: fsync d2/f2d 0 2024-08-18T22:41:32.411 INFO:tasks.workunit.client.0.smithi121.stdout:0/195: rename d1/d4/db/d24/d39 to d1/d4/db/d3f 0 2024-08-18T22:41:32.414 INFO:tasks.workunit.client.0.smithi121.stdout:0/196: mkdir d1/d4/db/d18/d40 0 2024-08-18T22:41:32.416 INFO:tasks.workunit.client.0.smithi121.stdout:3/282: write ff [1417643,54950] 0 2024-08-18T22:41:32.417 INFO:tasks.workunit.client.0.smithi121.stdout:9/386: dread d0/f1e [0,4194304] 0 2024-08-18T22:41:32.419 INFO:tasks.workunit.client.0.smithi121.stdout:4/202: dwrite d2/dc/fd [0,4194304] 0 2024-08-18T22:41:32.425 INFO:tasks.workunit.client.0.smithi121.stdout:0/197: link d1/d4/db/d18/d2e/f3d d1/d4/db/d18/d40/f41 0 2024-08-18T22:41:32.425 INFO:tasks.workunit.client.0.smithi121.stdout:3/283: getdents d1e/d1f/d25/d2e/d30/d66 0 2024-08-18T22:41:32.426 INFO:tasks.workunit.client.0.smithi121.stdout:9/387: dread d0/d38/d47/d4c/d18/f1d [0,4194304] 0 2024-08-18T22:41:32.426 INFO:tasks.workunit.client.0.smithi121.stdout:0/198: write d1/fd [3152458,10741] 0 2024-08-18T22:41:32.427 INFO:tasks.workunit.client.0.smithi121.stdout:4/203: creat d2/f40 x:0 0 0 2024-08-18T22:41:32.428 INFO:tasks.workunit.client.0.smithi121.stdout:0/199: chown d1/d4/c1e 1728389 1 2024-08-18T22:41:32.428 INFO:tasks.workunit.client.0.smithi121.stdout:3/284: rmdir d1e/d1f/d25/d2e/d36/d5f 39 2024-08-18T22:41:32.429 INFO:tasks.workunit.client.0.smithi121.stdout:0/200: readlink d1/d4/db/d24/df/l6 0 2024-08-18T22:41:32.431 INFO:tasks.workunit.client.0.smithi121.stdout:3/285: symlink d1e/d1f/d25/d67/l69 0 2024-08-18T22:41:32.432 INFO:tasks.workunit.client.0.smithi121.stdout:0/201: write d1/d4/db/f38 [341443,123899] 0 2024-08-18T22:41:32.435 INFO:tasks.workunit.client.0.smithi121.stdout:3/286: symlink d1e/d1f/d25/l6a 0 2024-08-18T22:41:32.437 INFO:tasks.workunit.client.0.smithi121.stdout:4/204: dwrite d2/f19 [0,4194304] 0 2024-08-18T22:41:32.437 INFO:tasks.workunit.client.0.smithi121.stdout:0/202: truncate d1/d4/db/d18/f2d 625701 0 2024-08-18T22:41:32.437 INFO:tasks.workunit.client.0.smithi121.stdout:9/388: dwrite d0/d38/d47/d4c/d18/f59 [0,4194304] 0 2024-08-18T22:41:32.439 INFO:tasks.workunit.client.0.smithi121.stdout:0/203: chown d1/d4/da/d2f 0 1 2024-08-18T22:41:32.439 INFO:tasks.workunit.client.0.smithi121.stdout:4/205: chown d2/f40 29 1 2024-08-18T22:41:32.439 INFO:tasks.workunit.client.0.smithi121.stdout:9/389: dread - d0/d5/f7d zero size 2024-08-18T22:41:32.442 INFO:tasks.workunit.client.0.smithi121.stdout:4/206: write d2/dc/fd [3710382,28378] 0 2024-08-18T22:41:32.442 INFO:tasks.workunit.client.0.smithi121.stdout:3/287: rename d1e/d1f/d25/d2e/d30 to d1e/d1f/d25/d6b 0 2024-08-18T22:41:32.444 INFO:tasks.workunit.client.0.smithi121.stdout:9/390: mknod d0/d38/d47/d4c/df/d61/c82 0 2024-08-18T22:41:32.453 INFO:tasks.workunit.client.0.smithi121.stdout:0/204: dwrite d1/d4/db/d18/f2d [0,4194304] 0 2024-08-18T22:41:32.456 INFO:tasks.workunit.client.0.smithi121.stdout:9/391: symlink d0/d5/dd/d3f/l83 0 2024-08-18T22:41:32.456 INFO:tasks.workunit.client.0.smithi121.stdout:4/207: dwrite d2/dc/d16/d22/d29/f26 [0,4194304] 0 2024-08-18T22:41:32.460 INFO:tasks.workunit.client.0.smithi121.stdout:3/288: dwrite d1e/d1f/d25/f54 [0,4194304] 0 2024-08-18T22:41:32.465 INFO:tasks.workunit.client.0.smithi121.stdout:9/392: write d0/d38/d47/d4c/df/f40 [1361657,55255] 0 2024-08-18T22:41:32.469 INFO:tasks.workunit.client.0.smithi121.stdout:0/205: dwrite d1/d4/db/d18/f2d [0,4194304] 0 2024-08-18T22:41:32.474 INFO:tasks.workunit.client.0.smithi121.stdout:4/208: rename d2/dc/d16/f35 to d2/dc/d16/d22/d29/f41 0 2024-08-18T22:41:32.474 INFO:tasks.workunit.client.0.smithi121.stdout:0/206: truncate d1/d4/db/d18/d40/f41 285625 0 2024-08-18T22:41:32.474 INFO:tasks.workunit.client.0.smithi121.stdout:3/289: getdents d1e 0 2024-08-18T22:41:32.477 INFO:tasks.workunit.client.0.smithi121.stdout:3/290: mknod d1e/d1f/d25/d2e/c6c 0 2024-08-18T22:41:32.478 INFO:tasks.workunit.client.0.smithi121.stdout:3/291: chown ff 486315 1 2024-08-18T22:41:32.478 INFO:tasks.workunit.client.0.smithi121.stdout:4/209: creat d2/f42 x:0 0 0 2024-08-18T22:41:32.480 INFO:tasks.workunit.client.0.smithi121.stdout:4/210: read d2/dc/f13 [3859413,75573] 0 2024-08-18T22:41:32.481 INFO:tasks.workunit.client.0.smithi121.stdout:0/207: creat d1/d4/db/d24/f42 x:0 0 0 2024-08-18T22:41:32.483 INFO:tasks.workunit.client.0.smithi121.stdout:3/292: write d1e/d1f/d25/d2e/d36/f57 [1825542,59545] 0 2024-08-18T22:41:32.487 INFO:tasks.workunit.client.0.smithi121.stdout:9/393: dwrite d0/f1e [0,4194304] 0 2024-08-18T22:41:32.491 INFO:tasks.workunit.client.0.smithi121.stdout:9/394: chown d0/d5/l1c 59185 1 2024-08-18T22:41:32.494 INFO:tasks.workunit.client.0.smithi121.stdout:4/211: dwrite d2/f4 [0,4194304] 0 2024-08-18T22:41:32.495 INFO:tasks.workunit.client.0.smithi121.stdout:4/212: fsync d2/f21 0 2024-08-18T22:41:32.500 INFO:tasks.workunit.client.0.smithi121.stdout:0/208: dwrite d1/d4/db/d24/df/d8/d32/f34 [0,4194304] 0 2024-08-18T22:41:32.500 INFO:tasks.workunit.client.0.smithi121.stdout:3/293: dwrite d1e/d1f/f52 [0,4194304] 0 2024-08-18T22:41:32.502 INFO:tasks.workunit.client.0.smithi121.stdout:9/395: stat d0/d5/dd/d2f/c4a 0 2024-08-18T22:41:32.505 INFO:tasks.workunit.client.0.smithi121.stdout:4/213: mknod d2/dc/d16/d22/d2c/c43 0 2024-08-18T22:41:32.505 INFO:tasks.workunit.client.0.smithi121.stdout:3/294: symlink d1e/d1f/d2a/l6d 0 2024-08-18T22:41:32.510 INFO:tasks.workunit.client.0.smithi121.stdout:9/396: link d0/d5/fa d0/d5/dd/d1a/d55/f84 0 2024-08-18T22:41:32.512 INFO:tasks.workunit.client.0.smithi121.stdout:3/295: truncate d1e/d1f/d25/d2e/d36/d5f/f61 459403 0 2024-08-18T22:41:32.512 INFO:tasks.workunit.client.0.smithi121.stdout:0/209: dread d1/d4/db/d18/f2d [0,4194304] 0 2024-08-18T22:41:32.513 INFO:tasks.workunit.client.0.smithi121.stdout:9/397: truncate d0/d38/d47/d4c/d18/f56 968470 0 2024-08-18T22:41:32.514 INFO:tasks.workunit.client.0.smithi121.stdout:9/398: write d0/d38/d47/d4c/df/d61/f7a [857629,128139] 0 2024-08-18T22:41:32.515 INFO:tasks.workunit.client.0.smithi121.stdout:3/296: getdents d1e/d1f/d3e 0 2024-08-18T22:41:32.515 INFO:tasks.workunit.client.0.smithi121.stdout:3/297: readlink d1e/d1f/d25/l3f 0 2024-08-18T22:41:32.522 INFO:tasks.workunit.client.0.smithi121.stdout:3/298: dwrite f1a [0,4194304] 0 2024-08-18T22:41:32.524 INFO:tasks.workunit.client.0.smithi121.stdout:3/299: creat d1e/d1f/d25/d2e/d36/d5f/f6e x:0 0 0 2024-08-18T22:41:32.533 INFO:tasks.workunit.client.0.smithi121.stdout:3/300: dwrite d1e/d1f/d3e/d42/f49 [0,4194304] 0 2024-08-18T22:41:32.535 INFO:tasks.workunit.client.0.smithi121.stdout:3/301: creat d1e/d1f/d3e/f6f x:0 0 0 2024-08-18T22:41:32.536 INFO:tasks.workunit.client.0.smithi121.stdout:3/302: symlink d1e/d1f/d3e/d42/l70 0 2024-08-18T22:41:32.537 INFO:tasks.workunit.client.0.smithi121.stdout:3/303: dread - d1e/d1f/d25/d6b/f59 zero size 2024-08-18T22:41:32.542 INFO:tasks.workunit.client.0.smithi121.stdout:3/304: dread d1e/d1f/d25/f4c [0,4194304] 0 2024-08-18T22:41:32.543 INFO:tasks.workunit.client.0.smithi121.stdout:3/305: chown d1e/d1f/d2a/c48 4170139 1 2024-08-18T22:41:32.544 INFO:tasks.workunit.client.0.smithi121.stdout:3/306: stat cc 0 2024-08-18T22:41:32.549 INFO:tasks.workunit.client.0.smithi121.stdout:3/307: dwrite d1e/d1f/d3e/f6f [0,4194304] 0 2024-08-18T22:41:32.550 INFO:tasks.workunit.client.0.smithi121.stdout:3/308: fdatasync d1e/d1f/f23 0 2024-08-18T22:41:32.552 INFO:tasks.workunit.client.0.smithi121.stdout:3/309: dread f16 [0,4194304] 0 2024-08-18T22:41:32.554 INFO:tasks.workunit.client.0.smithi121.stdout:3/310: truncate d1e/d1f/d25/d2e/d36/d5f/f6e 602696 0 2024-08-18T22:41:32.556 INFO:tasks.workunit.client.0.smithi121.stdout:3/311: mkdir d1e/d1f/d25/d67/d71 0 2024-08-18T22:41:32.558 INFO:tasks.workunit.client.0.smithi121.stdout:3/312: mknod d1e/d1f/d25/d2e/d36/d5f/c72 0 2024-08-18T22:41:32.559 INFO:tasks.workunit.client.0.smithi121.stdout:3/313: creat d1e/d1f/d3e/f73 x:0 0 0 2024-08-18T22:41:32.560 INFO:tasks.workunit.client.0.smithi121.stdout:3/314: write d1e/d1f/d25/f5c [280803,98544] 0 2024-08-18T22:41:32.560 INFO:tasks.workunit.client.0.smithi121.stdout:3/315: dread - d1e/d1f/d25/d6b/f59 zero size 2024-08-18T22:41:32.561 INFO:tasks.workunit.client.0.smithi121.stdout:3/316: read f1a [3959812,86731] 0 2024-08-18T22:41:32.561 INFO:tasks.workunit.client.0.smithi121.stdout:3/317: read f11 [867430,35277] 0 2024-08-18T22:41:32.565 INFO:tasks.workunit.client.0.smithi121.stdout:3/318: rename d1e/d1f/d3e/d42 to d1e/d1f/d25/d74 0 2024-08-18T22:41:32.573 INFO:tasks.workunit.client.0.smithi121.stdout:3/319: dwrite d1e/d1f/d25/d2e/d36/f37 [0,4194304] 0 2024-08-18T22:41:32.576 INFO:tasks.workunit.client.0.smithi121.stdout:3/320: mkdir d1e/d1f/d25/d58/d75 0 2024-08-18T22:41:32.577 INFO:tasks.workunit.client.0.smithi121.stdout:3/321: truncate d1e/d1f/f4f 890667 0 2024-08-18T22:41:32.578 INFO:tasks.workunit.client.0.smithi121.stdout:3/322: mkdir d1e/d1f/d3e/d76 0 2024-08-18T22:41:32.580 INFO:tasks.workunit.client.0.smithi121.stdout:3/323: rename c1d to d1e/d1f/c77 0 2024-08-18T22:41:32.580 INFO:tasks.workunit.client.0.smithi121.stdout:3/324: readlink d1e/d1f/d2a/l56 0 2024-08-18T22:41:32.586 INFO:tasks.workunit.client.0.smithi121.stdout:3/325: dwrite d1e/d1f/d25/d2e/d36/d5f/f61 [0,4194304] 0 2024-08-18T22:41:32.591 INFO:tasks.workunit.client.0.smithi121.stdout:3/326: rename d1e/d1f/d25/f41 to d1e/d1f/d3e/f78 0 2024-08-18T22:41:32.591 INFO:tasks.workunit.client.0.smithi121.stdout:3/327: fsync d1e/d1f/d3e/f73 0 2024-08-18T22:41:32.593 INFO:tasks.workunit.client.0.smithi121.stdout:3/328: creat d1e/d1f/d3e/f79 x:0 0 0 2024-08-18T22:41:32.594 INFO:tasks.workunit.client.0.smithi121.stdout:3/329: write d1e/d1f/d3e/f6f [1643689,8958] 0 2024-08-18T22:41:32.597 INFO:tasks.workunit.client.0.smithi121.stdout:3/330: dread d1e/d1f/d3e/f6f [0,4194304] 0 2024-08-18T22:41:32.601 INFO:tasks.workunit.client.0.smithi121.stdout:3/331: dread d1e/d1f/d25/f54 [0,4194304] 0 2024-08-18T22:41:32.603 INFO:tasks.workunit.client.0.smithi121.stdout:3/332: write d1e/d1f/d3e/f78 [3556059,43966] 0 2024-08-18T22:41:32.608 INFO:tasks.workunit.client.0.smithi121.stdout:3/333: dwrite f11 [0,4194304] 0 2024-08-18T22:41:32.609 INFO:tasks.workunit.client.0.smithi121.stdout:3/334: stat f16 0 2024-08-18T22:41:32.610 INFO:tasks.workunit.client.0.smithi121.stdout:3/335: mknod d1e/c7a 0 2024-08-18T22:41:32.616 INFO:tasks.workunit.client.0.smithi121.stdout:3/336: creat d1e/d1f/d25/f7b x:0 0 0 2024-08-18T22:41:32.619 INFO:tasks.workunit.client.0.smithi121.stdout:3/337: rename d1e/d1f/d25/l6a to d1e/d1f/d25/l7c 0 2024-08-18T22:41:32.620 INFO:tasks.workunit.client.0.smithi121.stdout:3/338: fsync d1e/d1f/d25/d2e/d36/d5f/f6e 0 2024-08-18T22:41:32.622 INFO:tasks.workunit.client.0.smithi121.stdout:3/339: creat d1e/d1f/d25/d2e/d36/d5f/f7d x:0 0 0 2024-08-18T22:41:32.624 INFO:tasks.workunit.client.0.smithi121.stdout:3/340: dread d1e/d1f/f4f [0,4194304] 0 2024-08-18T22:41:32.626 INFO:tasks.workunit.client.0.smithi121.stdout:3/341: mknod d1e/d1f/d25/d67/c7e 0 2024-08-18T22:41:32.627 INFO:tasks.workunit.client.0.smithi121.stdout:3/342: mknod d1e/d1f/d25/d6b/c7f 0 2024-08-18T22:41:32.628 INFO:tasks.workunit.client.0.smithi121.stdout:3/343: write d1e/d1f/d3e/f64 [2486664,31538] 0 2024-08-18T22:41:32.628 INFO:tasks.workunit.client.0.smithi121.stdout:3/344: chown d1e/d1f/f23 14719766 1 2024-08-18T22:41:32.646 INFO:tasks.workunit.client.0.smithi121.stdout:5/183: sync 2024-08-18T22:41:32.647 INFO:tasks.workunit.client.0.smithi121.stdout:5/184: chown d3/d5/d13/d19/f30 398924 1 2024-08-18T22:41:32.649 INFO:tasks.workunit.client.0.smithi121.stdout:5/185: creat d3/d5/d13/f3d x:0 0 0 2024-08-18T22:41:32.649 INFO:tasks.workunit.client.0.smithi121.stdout:5/186: read d3/d5/d13/f16 [2685474,25251] 0 2024-08-18T22:41:32.653 INFO:tasks.workunit.client.0.smithi121.stdout:5/187: dread d3/fd [0,4194304] 0 2024-08-18T22:41:32.656 INFO:tasks.workunit.client.0.smithi121.stdout:5/188: rename d3/d5/d13/d23/f37 to d3/d5/d13/d19/d24/d32/d38/f3e 0 2024-08-18T22:41:32.658 INFO:tasks.workunit.client.0.smithi121.stdout:5/189: mkdir d3/d5/d3c/d3f 0 2024-08-18T22:41:32.718 INFO:tasks.workunit.client.0.smithi121.stdout:1/297: sync 2024-08-18T22:41:32.724 INFO:tasks.workunit.client.0.smithi121.stdout:1/298: dwrite d5/d10/d14/f45 [0,4194304] 0 2024-08-18T22:41:32.725 INFO:tasks.workunit.client.0.smithi121.stdout:1/299: read - d5/df/d15/f52 zero size 2024-08-18T22:41:32.726 INFO:tasks.workunit.client.0.smithi121.stdout:1/300: mkdir d5/d10/d67 0 2024-08-18T22:41:32.728 INFO:tasks.workunit.client.0.smithi121.stdout:1/301: creat d5/d10/d14/d2a/f68 x:0 0 0 2024-08-18T22:41:32.730 INFO:tasks.workunit.client.0.smithi121.stdout:1/302: rename d5/df/d48/l56 to d5/df/d11/l69 0 2024-08-18T22:41:32.735 INFO:tasks.workunit.client.0.smithi121.stdout:1/303: dwrite d5/d10/d14/d34/f44 [0,4194304] 0 2024-08-18T22:41:32.737 INFO:tasks.workunit.client.0.smithi121.stdout:1/304: chown d5/df/d15/c2c 0 1 2024-08-18T22:41:32.738 INFO:tasks.workunit.client.0.smithi121.stdout:1/305: creat d5/df/d11/f6a x:0 0 0 2024-08-18T22:41:32.745 INFO:tasks.workunit.client.0.smithi121.stdout:1/306: dwrite d5/f1d [0,4194304] 0 2024-08-18T22:41:32.747 INFO:tasks.workunit.client.0.smithi121.stdout:1/307: truncate d5/d10/d14/d34/f44 5086802 0 2024-08-18T22:41:32.748 INFO:tasks.workunit.client.0.smithi121.stdout:1/308: chown d5/d10/d14/d2a/d3a 106839 1 2024-08-18T22:41:32.749 INFO:tasks.workunit.client.0.smithi121.stdout:1/309: dread - d5/df/d15/d28/d3d/f55 zero size 2024-08-18T22:41:32.763 INFO:tasks.workunit.client.0.smithi121.stdout:1/310: getdents d5/df/d11 0 2024-08-18T22:41:32.767 INFO:tasks.workunit.client.0.smithi121.stdout:1/311: creat d5/df/d15/f6b x:0 0 0 2024-08-18T22:41:32.773 INFO:tasks.workunit.client.0.smithi121.stdout:1/312: dwrite d5/df/d15/f52 [0,4194304] 0 2024-08-18T22:41:32.774 INFO:tasks.workunit.client.0.smithi121.stdout:1/313: write d5/d10/d14/d2a/f68 [653664,42204] 0 2024-08-18T22:41:32.775 INFO:tasks.workunit.client.0.smithi121.stdout:1/314: chown d5/df/d15/d28/d3d/f55 1593 1 2024-08-18T22:41:32.776 INFO:tasks.workunit.client.0.smithi121.stdout:1/315: readlink d5/l27 0 2024-08-18T22:41:32.778 INFO:tasks.workunit.client.0.smithi121.stdout:1/316: mkdir d5/df/d48/d6c 0 2024-08-18T22:41:32.779 INFO:tasks.workunit.client.0.smithi121.stdout:1/317: mknod d5/df/d15/d28/c6d 0 2024-08-18T22:41:32.780 INFO:tasks.workunit.client.0.smithi121.stdout:1/318: unlink d5/df/d11/c1e 0 2024-08-18T22:41:32.781 INFO:tasks.workunit.client.0.smithi121.stdout:1/319: chown d5/df/d48/f4c 987 1 2024-08-18T22:41:32.804 INFO:tasks.workunit.client.0.smithi121.stdout:7/267: sync 2024-08-18T22:41:32.806 INFO:tasks.workunit.client.0.smithi121.stdout:1/320: dwrite d5/f49 [0,4194304] 0 2024-08-18T22:41:32.807 INFO:tasks.workunit.client.0.smithi121.stdout:1/321: write d5/f1d [1265693,97502] 0 2024-08-18T22:41:32.808 INFO:tasks.workunit.client.0.smithi121.stdout:7/268: getdents de/d2d 0 2024-08-18T22:41:32.810 INFO:tasks.workunit.client.0.smithi121.stdout:7/269: write de/d1a/d20/f35 [1859253,44723] 0 2024-08-18T22:41:32.812 INFO:tasks.workunit.client.0.smithi121.stdout:1/322: dread d5/d10/d14/d2a/f68 [0,4194304] 0 2024-08-18T22:41:32.813 INFO:tasks.workunit.client.0.smithi121.stdout:1/323: stat d5/d10/d14/f4b 0 2024-08-18T22:41:32.883 INFO:tasks.workunit.client.0.smithi121.stdout:1/324: write d5/d10/f20 [1125022,108291] 0 2024-08-18T22:41:32.887 INFO:tasks.workunit.client.0.smithi121.stdout:7/270: dwrite de/d13/d18/d23/d24/d29/f5c [0,4194304] 0 2024-08-18T22:41:32.888 INFO:tasks.workunit.client.0.smithi121.stdout:1/325: link d5/df/d15/d28/d3d/l59 d5/d10/d14/d34/l6e 0 2024-08-18T22:41:32.889 INFO:tasks.workunit.client.0.smithi121.stdout:7/271: write de/f15 [336190,37290] 0 2024-08-18T22:41:32.889 INFO:tasks.workunit.client.0.smithi121.stdout:1/326: chown d5/df/d15/d28/d3d 1 1 2024-08-18T22:41:32.890 INFO:tasks.workunit.client.0.smithi121.stdout:7/272: chown de/d1a/d20/f35 0 1 2024-08-18T22:41:32.892 INFO:tasks.workunit.client.0.smithi121.stdout:7/273: chown de/d13/d18/d23/d24/d29/f4d 1145326 1 2024-08-18T22:41:32.892 INFO:tasks.workunit.client.0.smithi121.stdout:1/327: mkdir d5/df/d48/d6c/d6f 0 2024-08-18T22:41:32.894 INFO:tasks.workunit.client.0.smithi121.stdout:1/328: chown d5/d10/d14/d2a/d3a/f4d 1986 1 2024-08-18T22:41:32.894 INFO:tasks.workunit.client.0.smithi121.stdout:1/329: dread - d5/df/d15/f5b zero size 2024-08-18T22:41:32.897 INFO:tasks.workunit.client.0.smithi121.stdout:1/330: rename d5/df/d15/d28/d3d/f43 to d5/d10/d14/d34/f70 0 2024-08-18T22:41:32.900 INFO:tasks.workunit.client.0.smithi121.stdout:1/331: link d5/d10/d14/f4f d5/df/d15/d28/f71 0 2024-08-18T22:41:32.902 INFO:tasks.workunit.client.0.smithi121.stdout:1/332: creat d5/df/d15/d38/f72 x:0 0 0 2024-08-18T22:41:32.903 INFO:tasks.workunit.client.0.smithi121.stdout:7/274: write de/d13/d18/d23/f3d [510415,41682] 0 2024-08-18T22:41:32.905 INFO:tasks.workunit.client.0.smithi121.stdout:7/275: creat de/d13/d18/f60 x:0 0 0 2024-08-18T22:41:32.907 INFO:tasks.workunit.client.0.smithi121.stdout:1/333: link d5/df/d11/l69 d5/df/d15/d28/d3d/l73 0 2024-08-18T22:41:32.907 INFO:tasks.workunit.client.0.smithi121.stdout:1/334: fdatasync d5/df/d15/d38/f72 0 2024-08-18T22:41:32.908 INFO:tasks.workunit.client.0.smithi121.stdout:1/335: chown d5/df/d15 1633440522 1 2024-08-18T22:41:32.908 INFO:tasks.workunit.client.0.smithi121.stdout:2/133: sync 2024-08-18T22:41:32.910 INFO:tasks.workunit.client.0.smithi121.stdout:2/134: chown d2/d8/d19/dc 76843776 1 2024-08-18T22:41:32.910 INFO:tasks.workunit.client.0.smithi121.stdout:1/336: creat d5/df/d11/f74 x:0 0 0 2024-08-18T22:41:32.913 INFO:tasks.workunit.client.0.smithi121.stdout:7/276: dwrite de/d13/d18/f3c [0,4194304] 0 2024-08-18T22:41:32.915 INFO:tasks.workunit.client.0.smithi121.stdout:7/277: fsync de/d1a/d20/f3f 0 2024-08-18T22:41:32.919 INFO:tasks.workunit.client.0.smithi121.stdout:2/135: dwrite d2/f1d [0,4194304] 0 2024-08-18T22:41:32.921 INFO:tasks.workunit.client.0.smithi121.stdout:7/278: write de/f1f [1647745,2607] 0 2024-08-18T22:41:32.922 INFO:tasks.workunit.client.0.smithi121.stdout:2/136: mknod d2/d3/c30 0 2024-08-18T22:41:32.922 INFO:tasks.workunit.client.0.smithi121.stdout:1/337: dread d5/d10/d14/d34/f63 [0,4194304] 0 2024-08-18T22:41:32.924 INFO:tasks.workunit.client.0.smithi121.stdout:2/137: creat d2/d22/f31 x:0 0 0 2024-08-18T22:41:32.926 INFO:tasks.workunit.client.0.smithi121.stdout:2/138: write d2/d3/f4 [13625832,38848] 0 2024-08-18T22:41:32.931 INFO:tasks.workunit.client.0.smithi121.stdout:1/338: dread d5/f49 [0,4194304] 0 2024-08-18T22:41:32.933 INFO:tasks.workunit.client.0.smithi121.stdout:7/279: dwrite de/d1a/d2f/d36/f54 [0,4194304] 0 2024-08-18T22:41:32.934 INFO:tasks.workunit.client.0.smithi121.stdout:7/280: fdatasync de/d2d/f5d 0 2024-08-18T22:41:32.934 INFO:tasks.workunit.client.0.smithi121.stdout:2/139: link d2/d22/f31 d2/d8/d1f/f32 0 2024-08-18T22:41:32.934 INFO:tasks.workunit.client.0.smithi121.stdout:7/281: chown de/c5b 25937 1 2024-08-18T22:41:32.935 INFO:tasks.workunit.client.0.smithi121.stdout:1/339: creat d5/d10/d36/f75 x:0 0 0 2024-08-18T22:41:32.936 INFO:tasks.workunit.client.0.smithi121.stdout:7/282: fsync de/d13/f17 0 2024-08-18T22:41:32.937 INFO:tasks.workunit.client.0.smithi121.stdout:7/283: dread - de/d2d/f5d zero size 2024-08-18T22:41:32.937 INFO:tasks.workunit.client.0.smithi121.stdout:2/140: write d2/d8/d1f/f32 [840754,30422] 0 2024-08-18T22:41:32.942 INFO:tasks.workunit.client.0.smithi121.stdout:1/340: rename d5/df/d48 to d5/d76 0 2024-08-18T22:41:32.947 INFO:tasks.workunit.client.0.smithi121.stdout:7/284: dwrite de/f15 [0,4194304] 0 2024-08-18T22:41:32.949 INFO:tasks.workunit.client.0.smithi121.stdout:1/341: truncate d5/f1f 159834 0 2024-08-18T22:41:32.950 INFO:tasks.workunit.client.0.smithi121.stdout:2/141: dwrite d2/d3/f2a [0,4194304] 0 2024-08-18T22:41:32.952 INFO:tasks.workunit.client.0.smithi121.stdout:7/285: write de/d13/d18/d23/d24/d29/f4d [233039,128375] 0 2024-08-18T22:41:32.957 INFO:tasks.workunit.client.0.smithi121.stdout:2/142: creat d2/d8/d19/f33 x:0 0 0 2024-08-18T22:41:32.959 INFO:tasks.workunit.client.0.smithi121.stdout:2/143: stat d2/d8/d19/l20 0 2024-08-18T22:41:32.961 INFO:tasks.workunit.client.0.smithi121.stdout:7/286: creat de/d1a/f61 x:0 0 0 2024-08-18T22:41:32.962 INFO:tasks.workunit.client.0.smithi121.stdout:1/342: dwrite d5/df/d15/f37 [4194304,4194304] 0 2024-08-18T22:41:32.963 INFO:tasks.workunit.client.0.smithi121.stdout:2/144: unlink d2/d8/d19/f33 0 2024-08-18T22:41:32.965 INFO:tasks.workunit.client.0.smithi121.stdout:1/343: read d5/f7 [2388773,83564] 0 2024-08-18T22:41:32.972 INFO:tasks.workunit.client.0.smithi121.stdout:2/145: dwrite d2/d22/f26 [0,4194304] 0 2024-08-18T22:41:32.973 INFO:tasks.workunit.client.0.smithi121.stdout:4/214: sync 2024-08-18T22:41:32.973 INFO:tasks.workunit.client.0.smithi121.stdout:8/326: sync 2024-08-18T22:41:32.974 INFO:tasks.workunit.client.0.smithi121.stdout:7/287: truncate de/d13/d18/f19 180502 0 2024-08-18T22:41:32.976 INFO:tasks.workunit.client.0.smithi121.stdout:2/146: write d2/d8/d19/f24 [787383,124539] 0 2024-08-18T22:41:32.978 INFO:tasks.workunit.client.0.smithi121.stdout:1/344: dwrite d5/df/d15/d38/f72 [0,4194304] 0 2024-08-18T22:41:32.978 INFO:tasks.workunit.client.0.smithi121.stdout:8/327: write d6/d17/d18/f32 [2004514,101672] 0 2024-08-18T22:41:32.982 INFO:tasks.workunit.client.0.smithi121.stdout:4/215: mkdir d2/dc/d16/d22/d2c/d44 0 2024-08-18T22:41:32.984 INFO:tasks.workunit.client.0.smithi121.stdout:2/147: mknod d2/d8/d19/c34 0 2024-08-18T22:41:32.984 INFO:tasks.workunit.client.0.smithi121.stdout:4/216: dread - d2/dc/d1c/f3c zero size 2024-08-18T22:41:32.985 INFO:tasks.workunit.client.0.smithi121.stdout:2/148: readlink d2/d3/l7 0 2024-08-18T22:41:32.985 INFO:tasks.workunit.client.0.smithi121.stdout:4/217: stat d2/dc/f32 0 2024-08-18T22:41:32.986 INFO:tasks.workunit.client.0.smithi121.stdout:1/345: unlink d5/df/f42 0 2024-08-18T22:41:32.989 INFO:tasks.workunit.client.0.smithi121.stdout:8/328: dwrite f5 [0,4194304] 0 2024-08-18T22:41:32.992 INFO:tasks.workunit.client.0.smithi121.stdout:2/149: creat d2/d8/d1f/f35 x:0 0 0 2024-08-18T22:41:32.994 INFO:tasks.workunit.client.0.smithi121.stdout:4/218: unlink d2/f2d 0 2024-08-18T22:41:32.997 INFO:tasks.workunit.client.0.smithi121.stdout:2/150: creat d2/d8/d19/f36 x:0 0 0 2024-08-18T22:41:32.998 INFO:tasks.workunit.client.0.smithi121.stdout:1/346: creat d5/d76/d6c/d6f/f77 x:0 0 0 2024-08-18T22:41:32.998 INFO:tasks.workunit.client.0.smithi121.stdout:7/288: truncate de/f16 607663 0 2024-08-18T22:41:32.999 INFO:tasks.workunit.client.0.smithi121.stdout:1/347: readlink d5/df/l19 0 2024-08-18T22:41:32.999 INFO:tasks.workunit.client.0.smithi121.stdout:0/210: sync 2024-08-18T22:41:33.000 INFO:tasks.workunit.client.0.smithi121.stdout:3/345: sync 2024-08-18T22:41:33.000 INFO:tasks.workunit.client.0.smithi121.stdout:9/399: sync 2024-08-18T22:41:33.000 INFO:tasks.workunit.client.0.smithi121.stdout:5/190: sync 2024-08-18T22:41:33.000 INFO:tasks.workunit.client.0.smithi121.stdout:8/329: mkdir d6/d17/d60/d5b/d6e 0 2024-08-18T22:41:33.000 INFO:tasks.workunit.client.0.smithi121.stdout:7/289: chown de/f1c 21 1 2024-08-18T22:41:33.002 INFO:tasks.workunit.client.0.smithi121.stdout:1/348: read - d5/df/d15/f5b zero size 2024-08-18T22:41:33.003 INFO:tasks.workunit.client.0.smithi121.stdout:7/290: readlink de/d13/l2b 0 2024-08-18T22:41:33.003 INFO:tasks.workunit.client.0.smithi121.stdout:3/346: symlink d1e/d1f/d2a/l80 0 2024-08-18T22:41:33.005 INFO:tasks.workunit.client.0.smithi121.stdout:0/211: write d1/d4/db/d24/df/f7 [1140150,81316] 0 2024-08-18T22:41:33.006 INFO:tasks.workunit.client.0.smithi121.stdout:8/330: write d6/dd/f16 [945995,124053] 0 2024-08-18T22:41:33.008 INFO:tasks.workunit.client.0.smithi121.stdout:9/400: getdents d0/d38/d47 0 2024-08-18T22:41:33.010 INFO:tasks.workunit.client.0.smithi121.stdout:7/291: rmdir de/d1a 39 2024-08-18T22:41:33.010 INFO:tasks.workunit.client.0.smithi121.stdout:3/347: read d1e/d1f/f23 [1982496,35815] 0 2024-08-18T22:41:33.011 INFO:tasks.workunit.client.0.smithi121.stdout:5/191: fdatasync d3/d5/d13/d19/d24/d32/d38/f3e 0 2024-08-18T22:41:33.011 INFO:tasks.workunit.client.0.smithi121.stdout:1/349: truncate d5/df/d11/f6a 241868 0 2024-08-18T22:41:33.014 INFO:tasks.workunit.client.0.smithi121.stdout:2/151: dwrite d2/d8/d19/dc/f2d [0,4194304] 0 2024-08-18T22:41:33.015 INFO:tasks.workunit.client.0.smithi121.stdout:9/401: chown d0/d5/dd/d3b/d48/f57 7147893 1 2024-08-18T22:41:33.015 INFO:tasks.workunit.client.0.smithi121.stdout:8/331: creat d6/d17/d60/d5b/f6f x:0 0 0 2024-08-18T22:41:33.017 INFO:tasks.workunit.client.0.smithi121.stdout:4/219: dwrite d2/dc/d16/d22/d29/f3b [0,4194304] 0 2024-08-18T22:41:33.018 INFO:tasks.workunit.client.0.smithi121.stdout:0/212: symlink d1/d4/db/d18/d2e/l43 0 2024-08-18T22:41:33.021 INFO:tasks.workunit.client.0.smithi121.stdout:7/292: unlink de/d1a/f1e 0 2024-08-18T22:41:33.021 INFO:tasks.workunit.client.0.smithi121.stdout:3/348: rmdir d1e/d1f/d25/d67 39 2024-08-18T22:41:33.023 INFO:tasks.workunit.client.0.smithi121.stdout:5/192: mknod d3/d5/d13/d19/d24/d32/d38/c40 0 2024-08-18T22:41:33.023 INFO:tasks.workunit.client.0.smithi121.stdout:9/402: write d0/d38/d47/d4c/d18/f1d [996908,33220] 0 2024-08-18T22:41:33.023 INFO:tasks.workunit.client.0.smithi121.stdout:4/220: stat d2/dc/d16/d22/l27 0 2024-08-18T22:41:33.024 INFO:tasks.workunit.client.0.smithi121.stdout:1/350: truncate d5/d10/d14/f50 1025671 0 2024-08-18T22:41:33.024 INFO:tasks.workunit.client.0.smithi121.stdout:7/293: write de/d13/f17 [616394,112655] 0 2024-08-18T22:41:33.024 INFO:tasks.workunit.client.0.smithi121.stdout:9/403: stat d0/c4b 0 2024-08-18T22:41:33.024 INFO:tasks.workunit.client.0.smithi121.stdout:2/152: mknod d2/d8/d19/c37 0 2024-08-18T22:41:33.025 INFO:tasks.workunit.client.0.smithi121.stdout:8/332: symlink d6/d17/d37/l70 0 2024-08-18T22:41:33.027 INFO:tasks.workunit.client.0.smithi121.stdout:0/213: creat d1/d4/db/d24/df/d8/d32/f44 x:0 0 0 2024-08-18T22:41:33.028 INFO:tasks.workunit.client.0.smithi121.stdout:9/404: readlink d0/d38/d47/l22 0 2024-08-18T22:41:33.028 INFO:tasks.workunit.client.0.smithi121.stdout:7/294: mknod de/d1a/d20/c62 0 2024-08-18T22:41:33.029 INFO:tasks.workunit.client.0.smithi121.stdout:5/193: read d3/d5/d27/d35/f36 [657073,92316] 0 2024-08-18T22:41:33.030 INFO:tasks.workunit.client.0.smithi121.stdout:1/351: mknod d5/d10/d67/c78 0 2024-08-18T22:41:33.031 INFO:tasks.workunit.client.0.smithi121.stdout:3/349: dread d1e/d1f/d25/d2e/d36/d5f/f6e [0,4194304] 0 2024-08-18T22:41:33.032 INFO:tasks.workunit.client.0.smithi121.stdout:3/350: stat f1a 0 2024-08-18T22:41:33.033 INFO:tasks.workunit.client.0.smithi121.stdout:5/194: write d3/f12 [2135717,48454] 0 2024-08-18T22:41:33.034 INFO:tasks.workunit.client.0.smithi121.stdout:0/214: fsync d1/d4/db/d18/f2d 0 2024-08-18T22:41:33.038 INFO:tasks.workunit.client.0.smithi121.stdout:3/351: read d1e/d1f/d25/d2e/d36/f37 [3907656,34245] 0 2024-08-18T22:41:33.038 INFO:tasks.workunit.client.0.smithi121.stdout:8/333: link d6/d17/l44 d6/d17/d60/l71 0 2024-08-18T22:41:33.038 INFO:tasks.workunit.client.0.smithi121.stdout:7/295: mkdir de/d1a/d63 0 2024-08-18T22:41:33.039 INFO:tasks.workunit.client.0.smithi121.stdout:1/352: mkdir d5/d76/d6c/d6f/d79 0 2024-08-18T22:41:33.041 INFO:tasks.workunit.client.0.smithi121.stdout:4/221: rename d2/dc/d16/d22/d2c/c43 to d2/c45 0 2024-08-18T22:41:33.041 INFO:tasks.workunit.client.0.smithi121.stdout:2/153: dwrite d2/d22/f26 [0,4194304] 0 2024-08-18T22:41:33.043 INFO:tasks.workunit.client.0.smithi121.stdout:5/195: mknod d3/d5/d13/d19/d24/c41 0 2024-08-18T22:41:33.045 INFO:tasks.workunit.client.0.smithi121.stdout:0/215: symlink d1/d4/db/d24/df/d8/d32/l45 0 2024-08-18T22:41:33.047 INFO:tasks.workunit.client.0.smithi121.stdout:2/154: write d2/d8/d19/f13 [1649234,53451] 0 2024-08-18T22:41:33.048 INFO:tasks.workunit.client.0.smithi121.stdout:5/196: write d3/d5/d13/d23/f34 [1505,2016] 0 2024-08-18T22:41:33.048 INFO:tasks.workunit.client.0.smithi121.stdout:8/334: write d6/d17/f1d [664359,107077] 0 2024-08-18T22:41:33.048 INFO:tasks.workunit.client.0.smithi121.stdout:3/352: mkdir d1e/d1f/d25/d6b/d81 0 2024-08-18T22:41:33.051 INFO:tasks.workunit.client.0.smithi121.stdout:2/155: fsync d2/d8/d1f/f25 0 2024-08-18T22:41:33.054 INFO:tasks.workunit.client.0.smithi121.stdout:2/156: rename d2/d8 to d2/d8/d19/d38 22 2024-08-18T22:41:33.055 INFO:tasks.workunit.client.0.smithi121.stdout:1/353: dwrite d5/d10/d14/f4b [0,4194304] 0 2024-08-18T22:41:33.059 INFO:tasks.workunit.client.0.smithi121.stdout:3/353: stat c7 0 2024-08-18T22:41:33.062 INFO:tasks.workunit.client.0.smithi121.stdout:8/335: rmdir d6/d17/d42/d45 39 2024-08-18T22:41:33.062 INFO:tasks.workunit.client.0.smithi121.stdout:4/222: dwrite d2/dc/d16/d22/d29/f41 [0,4194304] 0 2024-08-18T22:41:33.064 INFO:tasks.workunit.client.0.smithi121.stdout:7/296: link de/d13/d18/d23/d24/d29/d43/f5a de/d1a/d2f/d4b/f64 0 2024-08-18T22:41:33.064 INFO:tasks.workunit.client.0.smithi121.stdout:9/405: dread d0/d5/dd/d1a/f5c [0,4194304] 0 2024-08-18T22:41:33.065 INFO:tasks.workunit.client.0.smithi121.stdout:9/406: fdatasync d0/d5/dd/d2f/f3c 0 2024-08-18T22:41:33.066 INFO:tasks.workunit.client.0.smithi121.stdout:2/157: creat d2/d8/f39 x:0 0 0 2024-08-18T22:41:33.066 INFO:tasks.workunit.client.0.smithi121.stdout:7/297: write de/d13/d18/d2e/f47 [822655,116734] 0 2024-08-18T22:41:33.067 INFO:tasks.workunit.client.0.smithi121.stdout:2/158: dread - d2/d8/d1f/f35 zero size 2024-08-18T22:41:33.067 INFO:tasks.workunit.client.0.smithi121.stdout:1/354: unlink d5/df/l3b 0 2024-08-18T22:41:33.070 INFO:tasks.workunit.client.0.smithi121.stdout:9/407: stat d0/d38/d47/d4c/df/f40 0 2024-08-18T22:41:33.072 INFO:tasks.workunit.client.0.smithi121.stdout:5/197: creat d3/d5/d3c/d3f/f42 x:0 0 0 2024-08-18T22:41:33.072 INFO:tasks.workunit.client.0.smithi121.stdout:0/216: rmdir d1/d4/db 39 2024-08-18T22:41:33.073 INFO:tasks.workunit.client.0.smithi121.stdout:4/223: mknod d2/dc/d1c/c46 0 2024-08-18T22:41:33.076 INFO:tasks.workunit.client.0.smithi121.stdout:2/159: creat d2/d8/d1f/f3a x:0 0 0 2024-08-18T22:41:33.078 INFO:tasks.workunit.client.0.smithi121.stdout:1/355: creat d5/d10/d14/d2a/d3a/f7a x:0 0 0 2024-08-18T22:41:33.080 INFO:tasks.workunit.client.0.smithi121.stdout:4/224: truncate d2/dc/d16/f36 398463 0 2024-08-18T22:41:33.080 INFO:tasks.workunit.client.0.smithi121.stdout:2/160: stat d2/d8/d1f/f28 0 2024-08-18T22:41:33.085 INFO:tasks.workunit.client.0.smithi121.stdout:9/408: dwrite d0/d38/d47/d4c/d18/f59 [0,4194304] 0 2024-08-18T22:41:33.085 INFO:tasks.workunit.client.0.smithi121.stdout:2/161: rmdir d2/d3 39 2024-08-18T22:41:33.089 INFO:tasks.workunit.client.0.smithi121.stdout:5/198: dwrite d3/d5/d13/f3d [0,4194304] 0 2024-08-18T22:41:33.090 INFO:tasks.workunit.client.0.smithi121.stdout:9/409: stat d0/d5/dd/d1a/d55/c68 0 2024-08-18T22:41:33.090 INFO:tasks.workunit.client.0.smithi121.stdout:2/162: write d2/d8/d19/f36 [445086,49007] 0 2024-08-18T22:41:33.092 INFO:tasks.workunit.client.0.smithi121.stdout:0/217: rmdir d1/d4/db/d18/d1c 39 2024-08-18T22:41:33.092 INFO:tasks.workunit.client.0.smithi121.stdout:1/356: symlink d5/df/d15/d28/d3d/l7b 0 2024-08-18T22:41:33.092 INFO:tasks.workunit.client.0.smithi121.stdout:8/336: dread d6/f8 [0,4194304] 0 2024-08-18T22:41:33.095 INFO:tasks.workunit.client.0.smithi121.stdout:2/163: rmdir d2/d8 39 2024-08-18T22:41:33.096 INFO:tasks.workunit.client.0.smithi121.stdout:3/354: write d1e/f31 [1620567,107412] 0 2024-08-18T22:41:33.098 INFO:tasks.workunit.client.0.smithi121.stdout:7/298: truncate de/d2d/f42 3915413 0 2024-08-18T22:41:33.099 INFO:tasks.workunit.client.0.smithi121.stdout:9/410: creat d0/d38/d47/d4c/df/d61/f85 x:0 0 0 2024-08-18T22:41:33.102 INFO:tasks.workunit.client.0.smithi121.stdout:2/164: creat d2/d22/f3b x:0 0 0 2024-08-18T22:41:33.102 INFO:tasks.workunit.client.0.smithi121.stdout:4/225: rmdir d2/dc/d16/d22/d29/d30 0 2024-08-18T22:41:33.103 INFO:tasks.workunit.client.0.smithi121.stdout:0/218: dread d1/d4/db/d18/d40/f41 [0,4194304] 0 2024-08-18T22:41:33.103 INFO:tasks.workunit.client.0.smithi121.stdout:4/226: readlink d2/dc/l18 0 2024-08-18T22:41:33.104 INFO:tasks.workunit.client.0.smithi121.stdout:3/355: unlink d1e/d1f/d2a/l6d 0 2024-08-18T22:41:33.107 INFO:tasks.workunit.client.0.smithi121.stdout:8/337: symlink d6/d17/l72 0 2024-08-18T22:41:33.108 INFO:tasks.workunit.client.0.smithi121.stdout:9/411: creat d0/d5/dd/d3b/f86 x:0 0 0 2024-08-18T22:41:33.109 INFO:tasks.workunit.client.0.smithi121.stdout:4/227: mkdir d2/dc/d16/d47 0 2024-08-18T22:41:33.110 INFO:tasks.workunit.client.0.smithi121.stdout:0/219: creat d1/d4/db/d3f/f46 x:0 0 0 2024-08-18T22:41:33.111 INFO:tasks.workunit.client.0.smithi121.stdout:3/356: mknod d1e/d1f/d2a/c82 0 2024-08-18T22:41:33.111 INFO:tasks.workunit.client.0.smithi121.stdout:5/199: link d3/c10 d3/d5/d13/d19/c43 0 2024-08-18T22:41:33.113 INFO:tasks.workunit.client.0.smithi121.stdout:7/299: mkdir de/d65 0 2024-08-18T22:41:33.114 INFO:tasks.workunit.client.0.smithi121.stdout:1/357: creat d5/d10/d14/f7c x:0 0 0 2024-08-18T22:41:33.114 INFO:tasks.workunit.client.0.smithi121.stdout:8/338: rmdir d6/d17/d37 39 2024-08-18T22:41:33.118 INFO:tasks.workunit.client.0.smithi121.stdout:2/165: creat d2/d8/d19/dc/f3c x:0 0 0 2024-08-18T22:41:33.122 INFO:tasks.workunit.client.0.smithi121.stdout:8/339: fdatasync d6/d17/d18/f2c 0 2024-08-18T22:41:33.122 INFO:tasks.workunit.client.0.smithi121.stdout:0/220: dwrite d1/d4/db/f3c [0,4194304] 0 2024-08-18T22:41:33.122 INFO:tasks.workunit.client.0.smithi121.stdout:9/412: creat d0/d38/d47/d4c/df/d61/f87 x:0 0 0 2024-08-18T22:41:33.123 INFO:tasks.workunit.client.0.smithi121.stdout:0/221: write d1/d4/db/f3c [1244028,108065] 0 2024-08-18T22:41:33.127 INFO:tasks.workunit.client.0.smithi121.stdout:8/340: write d6/d17/f1d [1202561,33103] 0 2024-08-18T22:41:33.129 INFO:tasks.workunit.client.0.smithi121.stdout:0/222: write d1/d4/da/f28 [448576,88242] 0 2024-08-18T22:41:33.131 INFO:tasks.workunit.client.0.smithi121.stdout:7/300: creat de/d1a/d34/d38/d5f/f66 x:0 0 0 2024-08-18T22:41:33.132 INFO:tasks.workunit.client.0.smithi121.stdout:4/228: dread d2/f2e [0,4194304] 0 2024-08-18T22:41:33.134 INFO:tasks.workunit.client.0.smithi121.stdout:1/358: dwrite d5/df/f51 [0,4194304] 0 2024-08-18T22:41:33.136 INFO:tasks.workunit.client.0.smithi121.stdout:9/413: mknod d0/d5/dd/d1a/d55/c88 0 2024-08-18T22:41:33.138 INFO:tasks.workunit.client.0.smithi121.stdout:5/200: truncate d3/f1c 389648 0 2024-08-18T22:41:33.143 INFO:tasks.workunit.client.0.smithi121.stdout:7/301: dwrite de/f1c [4194304,4194304] 0 2024-08-18T22:41:33.144 INFO:tasks.workunit.client.0.smithi121.stdout:7/302: fdatasync de/d2d/f5d 0 2024-08-18T22:41:33.145 INFO:tasks.workunit.client.0.smithi121.stdout:2/166: getdents d2/d3 0 2024-08-18T22:41:33.145 INFO:tasks.workunit.client.0.smithi121.stdout:2/167: fsync d2/f2c 0 2024-08-18T22:41:33.145 INFO:tasks.workunit.client.0.smithi121.stdout:5/201: unlink d3/d5/d13/d23/c2d 0 2024-08-18T22:41:33.147 INFO:tasks.workunit.client.0.smithi121.stdout:5/202: readlink d3/d5/d13/l20 0 2024-08-18T22:41:33.147 INFO:tasks.workunit.client.0.smithi121.stdout:7/303: truncate de/d1a/d20/f35 9088663 0 2024-08-18T22:41:33.149 INFO:tasks.workunit.client.0.smithi121.stdout:4/229: creat d2/dc/f48 x:0 0 0 2024-08-18T22:41:33.150 INFO:tasks.workunit.client.0.smithi121.stdout:1/359: creat d5/f7d x:0 0 0 2024-08-18T22:41:33.152 INFO:tasks.workunit.client.0.smithi121.stdout:7/304: symlink de/d2d/l67 0 2024-08-18T22:41:33.155 INFO:tasks.workunit.client.0.smithi121.stdout:5/203: creat d3/d5/d13/d19/d24/d32/f44 x:0 0 0 2024-08-18T22:41:33.157 INFO:tasks.workunit.client.0.smithi121.stdout:3/357: write f1a [4035616,97465] 0 2024-08-18T22:41:33.157 INFO:tasks.workunit.client.0.smithi121.stdout:4/230: fdatasync d2/dc/d1c/f3c 0 2024-08-18T22:41:33.159 INFO:tasks.workunit.client.0.smithi121.stdout:5/204: write d3/f1a [850152,115169] 0 2024-08-18T22:41:33.159 INFO:tasks.workunit.client.0.smithi121.stdout:2/168: dwrite d2/d8/d19/dc/f3c [0,4194304] 0 2024-08-18T22:41:33.165 INFO:tasks.workunit.client.0.smithi121.stdout:3/358: unlink d1e/d1f/d25/l44 0 2024-08-18T22:41:33.167 INFO:tasks.workunit.client.0.smithi121.stdout:2/169: read d2/d22/f31 [790563,31114] 0 2024-08-18T22:41:33.167 INFO:tasks.workunit.client.0.smithi121.stdout:5/205: fdatasync d3/d5/d13/d19/d24/d32/d38/f3e 0 2024-08-18T22:41:33.169 INFO:tasks.workunit.client.0.smithi121.stdout:7/305: dwrite de/f1f [0,4194304] 0 2024-08-18T22:41:33.170 INFO:tasks.workunit.client.0.smithi121.stdout:3/359: dread - d1e/d1f/d25/d2e/d36/d5f/f7d zero size 2024-08-18T22:41:33.171 INFO:tasks.workunit.client.0.smithi121.stdout:3/360: stat d1e/d1f/f3a 0 2024-08-18T22:41:33.172 INFO:tasks.workunit.client.0.smithi121.stdout:4/231: symlink d2/dc/d16/d22/d2c/d44/l49 0 2024-08-18T22:41:33.173 INFO:tasks.workunit.client.0.smithi121.stdout:1/360: link d5/df/c17 d5/d10/d14/c7e 0 2024-08-18T22:41:33.174 INFO:tasks.workunit.client.0.smithi121.stdout:1/361: rename d5 to d5/df/d11/d7f 22 2024-08-18T22:41:33.175 INFO:tasks.workunit.client.0.smithi121.stdout:7/306: creat de/d1a/d34/d38/f68 x:0 0 0 2024-08-18T22:41:33.176 INFO:tasks.workunit.client.0.smithi121.stdout:3/361: mkdir d1e/d1f/d25/d6b/d83 0 2024-08-18T22:41:33.178 INFO:tasks.workunit.client.0.smithi121.stdout:4/232: symlink d2/dc/d16/d22/d29/l4a 0 2024-08-18T22:41:33.178 INFO:tasks.workunit.client.0.smithi121.stdout:7/307: stat de/d13/d18/d23/d24/d29/c2c 0 2024-08-18T22:41:33.179 INFO:tasks.workunit.client.0.smithi121.stdout:1/362: write d5/d10/d14/d34/f70 [3099217,60573] 0 2024-08-18T22:41:33.180 INFO:tasks.workunit.client.0.smithi121.stdout:3/362: symlink d1e/d1f/d3e/d76/l84 0 2024-08-18T22:41:33.182 INFO:tasks.workunit.client.0.smithi121.stdout:9/414: dread d0/d5/dd/d3b/d48/f74 [0,4194304] 0 2024-08-18T22:41:33.182 INFO:tasks.workunit.client.0.smithi121.stdout:3/363: chown ca 498 1 2024-08-18T22:41:33.182 INFO:tasks.workunit.client.0.smithi121.stdout:4/233: creat d2/dc/d1c/f4b x:0 0 0 2024-08-18T22:41:33.182 INFO:tasks.workunit.client.0.smithi121.stdout:7/308: mknod de/d13/d18/c69 0 2024-08-18T22:41:33.184 INFO:tasks.workunit.client.0.smithi121.stdout:9/415: fsync d0/d38/d47/d4c/df/d61/f87 0 2024-08-18T22:41:33.185 INFO:tasks.workunit.client.0.smithi121.stdout:1/363: getdents d5/d76/d6c 0 2024-08-18T22:41:33.186 INFO:tasks.workunit.client.0.smithi121.stdout:7/309: symlink de/d1a/d20/l6a 0 2024-08-18T22:41:33.187 INFO:tasks.workunit.client.0.smithi121.stdout:3/364: mkdir d1e/d1f/d25/d74/d85 0 2024-08-18T22:41:33.188 INFO:tasks.workunit.client.0.smithi121.stdout:9/416: mkdir d0/d38/d47/d4c/df/d3d/d89 0 2024-08-18T22:41:33.188 INFO:tasks.workunit.client.0.smithi121.stdout:2/170: dread d2/d8/d19/f13 [0,4194304] 0 2024-08-18T22:41:33.188 INFO:tasks.workunit.client.0.smithi121.stdout:1/364: chown d5/d10/d14/d34/f63 0 1 2024-08-18T22:41:33.190 INFO:tasks.workunit.client.0.smithi121.stdout:3/365: read d1e/d1f/f52 [1218921,123894] 0 2024-08-18T22:41:33.193 INFO:tasks.workunit.client.0.smithi121.stdout:3/366: dread - d1e/d1f/d2a/f65 zero size 2024-08-18T22:41:33.194 INFO:tasks.workunit.client.0.smithi121.stdout:9/417: write d0/d5/dd/d3b/d48/f69 [355282,25473] 0 2024-08-18T22:41:33.195 INFO:tasks.workunit.client.0.smithi121.stdout:2/171: truncate d2/d8/d19/f24 1658839 0 2024-08-18T22:41:33.196 INFO:tasks.workunit.client.0.smithi121.stdout:4/234: dwrite d2/dc/d1c/f33 [0,4194304] 0 2024-08-18T22:41:33.196 INFO:tasks.workunit.client.0.smithi121.stdout:7/310: getdents de/d1a/d2f/d36 0 2024-08-18T22:41:33.196 INFO:tasks.workunit.client.0.smithi121.stdout:3/367: fsync d1e/d1f/f23 0 2024-08-18T22:41:33.197 INFO:tasks.workunit.client.0.smithi121.stdout:7/311: readlink de/l2a 0 2024-08-18T22:41:33.199 INFO:tasks.workunit.client.0.smithi121.stdout:3/368: stat d1e/f31 0 2024-08-18T22:41:33.199 INFO:tasks.workunit.client.0.smithi121.stdout:9/418: creat d0/d38/d47/f8a x:0 0 0 2024-08-18T22:41:33.203 INFO:tasks.workunit.client.0.smithi121.stdout:2/172: symlink d2/d8/d1f/l3d 0 2024-08-18T22:41:33.204 INFO:tasks.workunit.client.0.smithi121.stdout:9/419: mkdir d0/d5/dd/d2f/d8b 0 2024-08-18T22:41:33.205 INFO:tasks.workunit.client.0.smithi121.stdout:1/365: dwrite d5/d76/f4c [0,4194304] 0 2024-08-18T22:41:33.205 INFO:tasks.workunit.client.0.smithi121.stdout:7/312: truncate de/d1a/d34/d38/d5f/f66 932004 0 2024-08-18T22:41:33.208 INFO:tasks.workunit.client.0.smithi121.stdout:7/313: fsync de/d13/d18/d23/f3d 0 2024-08-18T22:41:33.210 INFO:tasks.workunit.client.0.smithi121.stdout:3/369: creat d1e/d1f/d25/d2e/d36/f86 x:0 0 0 2024-08-18T22:41:33.210 INFO:tasks.workunit.client.0.smithi121.stdout:2/173: read d2/f6 [872313,23138] 0 2024-08-18T22:41:33.213 INFO:tasks.workunit.client.0.smithi121.stdout:4/235: dwrite d2/dc/d16/d22/d29/f41 [0,4194304] 0 2024-08-18T22:41:33.216 INFO:tasks.workunit.client.0.smithi121.stdout:2/174: mknod d2/d8/c3e 0 2024-08-18T22:41:33.217 INFO:tasks.workunit.client.0.smithi121.stdout:1/366: write d5/df/d15/f2b [2212578,34605] 0 2024-08-18T22:41:33.220 INFO:tasks.workunit.client.0.smithi121.stdout:4/236: mknod d2/dc/d16/d22/d2c/c4c 0 2024-08-18T22:41:33.221 INFO:tasks.workunit.client.0.smithi121.stdout:7/314: dwrite f8 [8388608,4194304] 0 2024-08-18T22:41:33.225 INFO:tasks.workunit.client.0.smithi121.stdout:1/367: write d5/d10/d14/f45 [745900,33417] 0 2024-08-18T22:41:33.226 INFO:tasks.workunit.client.0.smithi121.stdout:3/370: link d1e/d1f/d25/d6b/f59 d1e/d1f/d25/d58/f87 0 2024-08-18T22:41:33.226 INFO:tasks.workunit.client.0.smithi121.stdout:4/237: creat d2/dc/d16/d22/d2c/d44/f4d x:0 0 0 2024-08-18T22:41:33.227 INFO:tasks.workunit.client.0.smithi121.stdout:7/315: write de/d1a/d34/d38/f68 [274657,58865] 0 2024-08-18T22:41:33.227 INFO:tasks.workunit.client.0.smithi121.stdout:1/368: write d5/d10/d14/d2a/f60 [267214,87565] 0 2024-08-18T22:41:33.233 INFO:tasks.workunit.client.0.smithi121.stdout:1/369: truncate d5/d10/d14/d2a/f68 1509676 0 2024-08-18T22:41:33.235 INFO:tasks.workunit.client.0.smithi121.stdout:3/371: link d1e/d1f/d25/d2e/c6c d1e/d1f/d25/d67/d71/c88 0 2024-08-18T22:41:33.236 INFO:tasks.workunit.client.0.smithi121.stdout:3/372: readlink d1e/d1f/d3e/d76/l84 0 2024-08-18T22:41:33.237 INFO:tasks.workunit.client.0.smithi121.stdout:4/238: dwrite d2/dc/d16/d22/d29/f26 [4194304,4194304] 0 2024-08-18T22:41:33.237 INFO:tasks.workunit.client.0.smithi121.stdout:1/370: truncate d5/d10/d14/d2a/d3a/f47 983625 0 2024-08-18T22:41:33.241 INFO:tasks.workunit.client.0.smithi121.stdout:3/373: mknod d1e/d1f/d25/d67/d71/c89 0 2024-08-18T22:41:33.241 INFO:tasks.workunit.client.0.smithi121.stdout:1/371: dread d5/f49 [0,4194304] 0 2024-08-18T22:41:33.245 INFO:tasks.workunit.client.0.smithi121.stdout:3/374: dread - d1e/d1f/d25/d58/f87 zero size 2024-08-18T22:41:33.246 INFO:tasks.workunit.client.0.smithi121.stdout:7/316: dread de/d13/d18/d2e/f47 [0,4194304] 0 2024-08-18T22:41:33.248 INFO:tasks.workunit.client.0.smithi121.stdout:1/372: fsync d5/f1f 0 2024-08-18T22:41:33.249 INFO:tasks.workunit.client.0.smithi121.stdout:4/239: dwrite d2/dc/d16/d22/d2c/d44/f4d [0,4194304] 0 2024-08-18T22:41:33.251 INFO:tasks.workunit.client.0.smithi121.stdout:2/175: truncate d2/d3/f2a 129629 0 2024-08-18T22:41:33.254 INFO:tasks.workunit.client.0.smithi121.stdout:2/176: write d2/d8/d19/dc/f2d [2500261,46817] 0 2024-08-18T22:41:33.257 INFO:tasks.workunit.client.0.smithi121.stdout:3/375: creat d1e/d1f/d5e/f8a x:0 0 0 2024-08-18T22:41:33.258 INFO:tasks.workunit.client.0.smithi121.stdout:3/376: chown d1e/d1f/d25/d58 85 1 2024-08-18T22:41:33.258 INFO:tasks.workunit.client.0.smithi121.stdout:7/317: truncate de/d2d/f42 3754264 0 2024-08-18T22:41:33.258 INFO:tasks.workunit.client.0.smithi121.stdout:4/240: dwrite d2/dc/d16/d22/f39 [0,4194304] 0 2024-08-18T22:41:33.259 INFO:tasks.workunit.client.0.smithi121.stdout:1/373: mknod d5/d76/d6c/d6f/d79/c80 0 2024-08-18T22:41:33.275 INFO:tasks.workunit.client.0.smithi121.stdout:4/241: readlink d2/dc/d16/d22/d29/l4a 0 2024-08-18T22:41:33.301 INFO:tasks.workunit.client.0.smithi121.stdout:3/377: rmdir d1e/d1f/d25/d2e/d36/d5f 39 2024-08-18T22:41:33.303 INFO:tasks.workunit.client.0.smithi121.stdout:7/318: rename de/d1a/d20/f35 to de/d1a/d63/f6b 0 2024-08-18T22:41:33.307 INFO:tasks.workunit.client.0.smithi121.stdout:2/177: link d2/d8/d19/dc/f2d d2/d8/f3f 0 2024-08-18T22:41:33.309 INFO:tasks.workunit.client.0.smithi121.stdout:3/378: rmdir d1e/d1f/d25/d2e 39 2024-08-18T22:41:33.310 INFO:tasks.workunit.client.0.smithi121.stdout:3/379: chown d1e/d1f 497 1 2024-08-18T22:41:33.311 INFO:tasks.workunit.client.0.smithi121.stdout:1/374: dwrite d5/d10/d14/d2a/f68 [0,4194304] 0 2024-08-18T22:41:33.311 INFO:tasks.workunit.client.0.smithi121.stdout:7/319: mkdir de/d1a/d34/d6c 0 2024-08-18T22:41:33.313 INFO:tasks.workunit.client.0.smithi121.stdout:4/242: dread d2/dc/f3a [0,4194304] 0 2024-08-18T22:41:33.314 INFO:tasks.workunit.client.0.smithi121.stdout:4/243: truncate d2/f3f 82334 0 2024-08-18T22:41:33.315 INFO:tasks.workunit.client.0.smithi121.stdout:3/380: fdatasync d1e/d1f/d25/d2e/d36/f3c 0 2024-08-18T22:41:33.320 INFO:tasks.workunit.client.0.smithi121.stdout:4/244: symlink d2/dc/d16/d22/d2c/d44/l4e 0 2024-08-18T22:41:33.321 INFO:tasks.workunit.client.0.smithi121.stdout:3/381: chown d1e/c5a 0 1 2024-08-18T22:41:33.322 INFO:tasks.workunit.client.0.smithi121.stdout:7/320: mkdir de/d1a/d2f/d4b/d6d 0 2024-08-18T22:41:33.322 INFO:tasks.workunit.client.0.smithi121.stdout:4/245: rename d2 to d2/dc/d4f 22 2024-08-18T22:41:33.323 INFO:tasks.workunit.client.0.smithi121.stdout:2/178: link d2/d8/d1f/l3d d2/d8/d19/dc/l40 0 2024-08-18T22:41:33.323 INFO:tasks.workunit.client.0.smithi121.stdout:7/321: chown de/c5b 6 1 2024-08-18T22:41:33.325 INFO:tasks.workunit.client.0.smithi121.stdout:3/382: unlink fd 0 2024-08-18T22:41:33.325 INFO:tasks.workunit.client.0.smithi121.stdout:4/246: chown d2/dc/c1f 2052865 1 2024-08-18T22:41:33.326 INFO:tasks.workunit.client.0.smithi121.stdout:1/375: getdents d5/d10/d14/d34 0 2024-08-18T22:41:33.328 INFO:tasks.workunit.client.0.smithi121.stdout:2/179: creat d2/d8/d1f/f41 x:0 0 0 2024-08-18T22:41:33.330 INFO:tasks.workunit.client.0.smithi121.stdout:1/376: symlink d5/d10/d36/l81 0 2024-08-18T22:41:33.331 INFO:tasks.workunit.client.0.smithi121.stdout:4/247: creat d2/dc/d16/d22/f50 x:0 0 0 2024-08-18T22:41:33.332 INFO:tasks.workunit.client.0.smithi121.stdout:7/322: truncate de/f16 508896 0 2024-08-18T22:41:33.333 INFO:tasks.workunit.client.0.smithi121.stdout:2/180: chown d2/d8/d19/dc/l40 632302 1 2024-08-18T22:41:33.334 INFO:tasks.workunit.client.0.smithi121.stdout:3/383: rename cc to d1e/d1f/d25/d2e/d36/d5f/c8b 0 2024-08-18T22:41:33.336 INFO:tasks.workunit.client.0.smithi121.stdout:1/377: dread d5/d10/d14/f4b [0,4194304] 0 2024-08-18T22:41:33.337 INFO:tasks.workunit.client.0.smithi121.stdout:4/248: rename d2/dc/d16/d22/d2c/d44/l49 to d2/dc/d16/d22/d2c/d44/l51 0 2024-08-18T22:41:33.338 INFO:tasks.workunit.client.0.smithi121.stdout:4/249: stat d2/dc/f3a 0 2024-08-18T22:41:33.338 INFO:tasks.workunit.client.0.smithi121.stdout:7/323: getdents de/d1a/d2f/d36 0 2024-08-18T22:41:33.340 INFO:tasks.workunit.client.0.smithi121.stdout:4/250: chown d2/dc/d16/d22/l27 17 1 2024-08-18T22:41:33.342 INFO:tasks.workunit.client.0.smithi121.stdout:4/251: readlink d2/dc/l1b 0 2024-08-18T22:41:33.343 INFO:tasks.workunit.client.0.smithi121.stdout:4/252: dread - d2/dc/d16/d22/f50 zero size 2024-08-18T22:41:33.343 INFO:tasks.workunit.client.0.smithi121.stdout:3/384: dwrite d1e/d1f/d25/f27 [0,4194304] 0 2024-08-18T22:41:33.353 INFO:tasks.workunit.client.0.smithi121.stdout:7/324: creat de/f6e x:0 0 0 2024-08-18T22:41:33.353 INFO:tasks.workunit.client.0.smithi121.stdout:3/385: dwrite d1e/d1f/f3a [0,4194304] 0 2024-08-18T22:41:33.355 INFO:tasks.workunit.client.0.smithi121.stdout:3/386: chown c7 304939 1 2024-08-18T22:41:33.355 INFO:tasks.workunit.client.0.smithi121.stdout:2/181: dread d2/d3/f4 [4194304,4194304] 0 2024-08-18T22:41:33.357 INFO:tasks.workunit.client.0.smithi121.stdout:3/387: fdatasync d1e/d1f/f52 0 2024-08-18T22:41:33.358 INFO:tasks.workunit.client.0.smithi121.stdout:2/182: creat d2/d22/f42 x:0 0 0 2024-08-18T22:41:33.359 INFO:tasks.workunit.client.0.smithi121.stdout:2/183: stat d2/d3/l18 0 2024-08-18T22:41:33.360 INFO:tasks.workunit.client.0.smithi121.stdout:2/184: fsync d2/d8/d19/f24 0 2024-08-18T22:41:33.361 INFO:tasks.workunit.client.0.smithi121.stdout:4/253: link d2/dc/d1c/f23 d2/dc/f52 0 2024-08-18T22:41:33.362 INFO:tasks.workunit.client.0.smithi121.stdout:3/388: read d1e/f46 [1780106,92228] 0 2024-08-18T22:41:33.365 INFO:tasks.workunit.client.0.smithi121.stdout:2/185: unlink d2/d8/d19/dc/c15 0 2024-08-18T22:41:33.368 INFO:tasks.workunit.client.0.smithi121.stdout:7/325: write de/d13/d18/f19 [974967,89983] 0 2024-08-18T22:41:33.370 INFO:tasks.workunit.client.0.smithi121.stdout:4/254: dwrite d2/dc/d1c/f3c [0,4194304] 0 2024-08-18T22:41:33.370 INFO:tasks.workunit.client.0.smithi121.stdout:2/186: rename d2/d8/d19/l17 to d2/d22/l43 0 2024-08-18T22:41:33.373 INFO:tasks.workunit.client.0.smithi121.stdout:4/255: write d2/f42 [254727,23762] 0 2024-08-18T22:41:33.375 INFO:tasks.workunit.client.0.smithi121.stdout:7/326: creat de/d1a/d34/d6c/f6f x:0 0 0 2024-08-18T22:41:33.377 INFO:tasks.workunit.client.0.smithi121.stdout:2/187: rename d2/d8/d19/l12 to d2/d3/l44 0 2024-08-18T22:41:33.377 INFO:tasks.workunit.client.0.smithi121.stdout:3/389: dwrite d1e/d1f/d25/d2e/d36/f68 [0,4194304] 0 2024-08-18T22:41:33.380 INFO:tasks.workunit.client.0.smithi121.stdout:2/188: truncate d2/d8/d1f/f35 730598 0 2024-08-18T22:41:33.381 INFO:tasks.workunit.client.0.smithi121.stdout:4/256: rename d2/dc/c1f to d2/dc/d1c/c53 0 2024-08-18T22:41:33.384 INFO:tasks.workunit.client.0.smithi121.stdout:3/390: mkdir d1e/d1f/d25/d58/d75/d8c 0 2024-08-18T22:41:33.385 INFO:tasks.workunit.client.0.smithi121.stdout:2/189: rename d2/d8/d19/f36 to d2/d8/d19/f45 0 2024-08-18T22:41:33.386 INFO:tasks.workunit.client.0.smithi121.stdout:4/257: symlink d2/dc/d16/d22/d2c/d44/l54 0 2024-08-18T22:41:33.386 INFO:tasks.workunit.client.0.smithi121.stdout:2/190: truncate d2/f2c 5167476 0 2024-08-18T22:41:33.389 INFO:tasks.workunit.client.0.smithi121.stdout:2/191: creat d2/d8/d19/f46 x:0 0 0 2024-08-18T22:41:33.390 INFO:tasks.workunit.client.0.smithi121.stdout:4/258: creat d2/dc/d16/d22/f55 x:0 0 0 2024-08-18T22:41:33.391 INFO:tasks.workunit.client.0.smithi121.stdout:4/259: fdatasync d2/f42 0 2024-08-18T22:41:33.392 INFO:tasks.workunit.client.0.smithi121.stdout:2/192: write d2/d8/d19/f46 [807540,27009] 0 2024-08-18T22:41:33.393 INFO:tasks.workunit.client.0.smithi121.stdout:3/391: dwrite d1e/d1f/d3e/f64 [0,4194304] 0 2024-08-18T22:41:33.397 INFO:tasks.workunit.client.0.smithi121.stdout:4/260: symlink d2/dc/l56 0 2024-08-18T22:41:33.397 INFO:tasks.workunit.client.0.smithi121.stdout:2/193: creat d2/d8/d19/f47 x:0 0 0 2024-08-18T22:41:33.398 INFO:tasks.workunit.client.0.smithi121.stdout:3/392: mknod d1e/c8d 0 2024-08-18T22:41:33.399 INFO:tasks.workunit.client.0.smithi121.stdout:2/194: fdatasync d2/d8/d1f/f25 0 2024-08-18T22:41:33.399 INFO:tasks.workunit.client.0.smithi121.stdout:4/261: creat d2/dc/d16/d22/d2c/d44/f57 x:0 0 0 2024-08-18T22:41:33.400 INFO:tasks.workunit.client.0.smithi121.stdout:7/327: dread de/d13/f17 [0,4194304] 0 2024-08-18T22:41:33.401 INFO:tasks.workunit.client.0.smithi121.stdout:2/195: chown d2/d22/f31 14 1 2024-08-18T22:41:33.401 INFO:tasks.workunit.client.0.smithi121.stdout:7/328: chown de/f1f 2458 1 2024-08-18T22:41:33.402 INFO:tasks.workunit.client.0.smithi121.stdout:4/262: truncate d2/dc/f3a 2233266 0 2024-08-18T22:41:33.403 INFO:tasks.workunit.client.0.smithi121.stdout:4/263: chown d2/f9 435031 1 2024-08-18T22:41:33.403 INFO:tasks.workunit.client.0.smithi121.stdout:3/393: rename d1e/d1f/d25/d67/d71 to d1e/d1f/d25/d67/d8e 0 2024-08-18T22:41:33.405 INFO:tasks.workunit.client.0.smithi121.stdout:7/329: unlink de/f1f 0 2024-08-18T22:41:33.407 INFO:tasks.workunit.client.0.smithi121.stdout:4/264: rename d2/dc/l1b to d2/dc/d16/d22/d2c/d44/l58 0 2024-08-18T22:41:33.408 INFO:tasks.workunit.client.0.smithi121.stdout:3/394: creat d1e/d1f/d25/d58/d75/d8c/f8f x:0 0 0 2024-08-18T22:41:33.411 INFO:tasks.workunit.client.0.smithi121.stdout:7/330: dwrite de/f11 [0,4194304] 0 2024-08-18T22:41:33.411 INFO:tasks.workunit.client.0.smithi121.stdout:3/395: chown d1e/d1f/d25/d2e/d36/f3c 12206468 1 2024-08-18T22:41:33.417 INFO:tasks.workunit.client.0.smithi121.stdout:7/331: unlink de/d13/d18/d23/d24/d29/d43/f5a 0 2024-08-18T22:41:33.417 INFO:tasks.workunit.client.0.smithi121.stdout:4/265: dwrite d2/dc/d16/d22/d29/f20 [0,4194304] 0 2024-08-18T22:41:33.421 INFO:tasks.workunit.client.0.smithi121.stdout:3/396: link d1e/d1f/d2a/c2c d1e/c90 0 2024-08-18T22:41:33.421 INFO:tasks.workunit.client.0.smithi121.stdout:3/397: chown d1e/d1f/d2a/l56 19 1 2024-08-18T22:41:33.421 INFO:tasks.workunit.client.0.smithi121.stdout:4/266: mkdir d2/dc/d16/d59 0 2024-08-18T22:41:33.423 INFO:tasks.workunit.client.0.smithi121.stdout:7/332: read de/d13/d18/d23/d24/d29/f5c [176313,118529] 0 2024-08-18T22:41:33.423 INFO:tasks.workunit.client.0.smithi121.stdout:4/267: dread d2/f3f [0,4194304] 0 2024-08-18T22:41:33.424 INFO:tasks.workunit.client.0.smithi121.stdout:3/398: creat d1e/d1f/d25/d2e/f91 x:0 0 0 2024-08-18T22:41:33.425 INFO:tasks.workunit.client.0.smithi121.stdout:4/268: chown d2/dc/d16/d22/d29/f3b 422936 1 2024-08-18T22:41:33.426 INFO:tasks.workunit.client.0.smithi121.stdout:7/333: fdatasync de/d1a/d63/f6b 0 2024-08-18T22:41:33.428 INFO:tasks.workunit.client.0.smithi121.stdout:3/399: mkdir d1e/d1f/d25/d67/d92 0 2024-08-18T22:41:33.430 INFO:tasks.workunit.client.0.smithi121.stdout:3/400: write d1e/d1f/d3e/f78 [2222928,43083] 0 2024-08-18T22:41:33.431 INFO:tasks.workunit.client.0.smithi121.stdout:4/269: dread d2/dc/d16/d22/d29/f3b [0,4194304] 0 2024-08-18T22:41:33.432 INFO:tasks.workunit.client.0.smithi121.stdout:4/270: chown d2/f2e 107583050 1 2024-08-18T22:41:33.433 INFO:tasks.workunit.client.0.smithi121.stdout:4/271: read d2/f21 [3618819,23632] 0 2024-08-18T22:41:33.434 INFO:tasks.workunit.client.0.smithi121.stdout:7/334: truncate de/f16 1121318 0 2024-08-18T22:41:33.435 INFO:tasks.workunit.client.0.smithi121.stdout:7/335: chown de/d1a/d34/d38/f68 3906689 1 2024-08-18T22:41:33.436 INFO:tasks.workunit.client.0.smithi121.stdout:3/401: mknod d1e/d1f/d25/d58/d75/d8c/c93 0 2024-08-18T22:41:33.437 INFO:tasks.workunit.client.0.smithi121.stdout:3/402: fdatasync d1e/d1f/d3e/f64 0 2024-08-18T22:41:33.439 INFO:tasks.workunit.client.0.smithi121.stdout:4/272: symlink d2/dc/d16/d22/d2c/d44/l5a 0 2024-08-18T22:41:33.439 INFO:tasks.workunit.client.0.smithi121.stdout:7/336: dread de/d2d/f42 [0,4194304] 0 2024-08-18T22:41:33.441 INFO:tasks.workunit.client.0.smithi121.stdout:7/337: readlink de/d13/d18/d23/d24/d29/d43/l57 0 2024-08-18T22:41:33.442 INFO:tasks.workunit.client.0.smithi121.stdout:7/338: write f8 [10003447,129055] 0 2024-08-18T22:41:33.443 INFO:tasks.workunit.client.0.smithi121.stdout:4/273: readlink d2/dc/d16/d22/d2c/d44/l58 0 2024-08-18T22:41:33.448 INFO:tasks.workunit.client.0.smithi121.stdout:7/339: mknod de/d65/c70 0 2024-08-18T22:41:33.452 INFO:tasks.workunit.client.0.smithi121.stdout:4/274: dwrite d2/dc/d16/d22/f50 [0,4194304] 0 2024-08-18T22:41:33.456 INFO:tasks.workunit.client.0.smithi121.stdout:3/403: dread d1e/f31 [0,4194304] 0 2024-08-18T22:41:33.458 INFO:tasks.workunit.client.0.smithi121.stdout:3/404: write d1e/d1f/d3e/f78 [1260489,119349] 0 2024-08-18T22:41:33.460 INFO:tasks.workunit.client.0.smithi121.stdout:7/340: truncate de/f1d 5884344 0 2024-08-18T22:41:33.462 INFO:tasks.workunit.client.0.smithi121.stdout:3/405: mkdir d1e/d1f/d25/d74/d85/d94 0 2024-08-18T22:41:33.464 INFO:tasks.workunit.client.0.smithi121.stdout:4/275: getdents d2/dc/d1c 0 2024-08-18T22:41:33.465 INFO:tasks.workunit.client.0.smithi121.stdout:3/406: creat d1e/d1f/d25/d67/d8e/f95 x:0 0 0 2024-08-18T22:41:33.466 INFO:tasks.workunit.client.0.smithi121.stdout:7/341: getdents de/d1a/d34/d38 0 2024-08-18T22:41:33.469 INFO:tasks.workunit.client.0.smithi121.stdout:7/342: getdents de/d13 0 2024-08-18T22:41:33.471 INFO:tasks.workunit.client.0.smithi121.stdout:7/343: creat de/d2d/d50/f71 x:0 0 0 2024-08-18T22:41:33.471 INFO:tasks.workunit.client.0.smithi121.stdout:4/276: dwrite d2/dc/f13 [0,4194304] 0 2024-08-18T22:41:33.477 INFO:tasks.workunit.client.0.smithi121.stdout:7/344: link de/d1a/d34/d6c/f6f de/d1a/d2f/f72 0 2024-08-18T22:41:33.478 INFO:tasks.workunit.client.0.smithi121.stdout:4/277: dwrite d2/dc/d16/d22/d29/f38 [0,4194304] 0 2024-08-18T22:41:33.480 INFO:tasks.workunit.client.0.smithi121.stdout:7/345: mkdir de/d1a/d34/d38/d73 0 2024-08-18T22:41:33.484 INFO:tasks.workunit.client.0.smithi121.stdout:4/278: rename d2/dc/d16/d22/d2c/d44/l51 to d2/l5b 0 2024-08-18T22:41:33.485 INFO:tasks.workunit.client.0.smithi121.stdout:4/279: fdatasync d2/dc/d16/d22/f3d 0 2024-08-18T22:41:33.487 INFO:tasks.workunit.client.0.smithi121.stdout:7/346: rename de/d1a/d34/d38/f68 to de/d13/d18/d23/d24/d29/f74 0 2024-08-18T22:41:33.490 INFO:tasks.workunit.client.0.smithi121.stdout:7/347: creat de/d1a/d4f/f75 x:0 0 0 2024-08-18T22:41:33.491 INFO:tasks.workunit.client.0.smithi121.stdout:7/348: write de/d13/d18/f3c [448097,69234] 0 2024-08-18T22:41:33.497 INFO:tasks.workunit.client.0.smithi121.stdout:7/349: rmdir de/d13/d18/d23/d24/d29 39 2024-08-18T22:41:33.498 INFO:tasks.workunit.client.0.smithi121.stdout:4/280: truncate d2/dc/d16/d22/f3d 3698500 0 2024-08-18T22:41:33.500 INFO:tasks.workunit.client.0.smithi121.stdout:4/281: rmdir d2/dc/d16/d22/d2c/d44 39 2024-08-18T22:41:33.502 INFO:tasks.workunit.client.0.smithi121.stdout:7/350: dwrite de/d13/f49 [0,4194304] 0 2024-08-18T22:41:33.503 INFO:tasks.workunit.client.0.smithi121.stdout:4/282: mknod d2/c5c 0 2024-08-18T22:41:33.506 INFO:tasks.workunit.client.0.smithi121.stdout:7/351: write de/d13/f17 [4585264,49536] 0 2024-08-18T22:41:33.507 INFO:tasks.workunit.client.0.smithi121.stdout:7/352: readlink de/d1a/d20/l6a 0 2024-08-18T22:41:33.507 INFO:tasks.workunit.client.0.smithi121.stdout:7/353: dread - de/d2d/f5d zero size 2024-08-18T22:41:33.509 INFO:tasks.workunit.client.0.smithi121.stdout:4/283: truncate d2/dc/f52 804539 0 2024-08-18T22:41:33.512 INFO:tasks.workunit.client.0.smithi121.stdout:4/284: creat d2/dc/f5d x:0 0 0 2024-08-18T22:41:33.514 INFO:tasks.workunit.client.0.smithi121.stdout:7/354: dwrite de/d2d/f5d [0,4194304] 0 2024-08-18T22:41:33.515 INFO:tasks.workunit.client.0.smithi121.stdout:7/355: fsync de/d13/d18/d23/f3d 0 2024-08-18T22:41:33.519 INFO:tasks.workunit.client.0.smithi121.stdout:8/341: sync 2024-08-18T22:41:33.521 INFO:tasks.workunit.client.0.smithi121.stdout:7/356: mknod de/d13/d18/d23/d24/d25/c76 0 2024-08-18T22:41:33.522 INFO:tasks.workunit.client.0.smithi121.stdout:4/285: dwrite d2/dc/d16/d22/d2c/d44/f4d [0,4194304] 0 2024-08-18T22:41:33.522 INFO:tasks.workunit.client.0.smithi121.stdout:8/342: mknod d6/d20/d69/c73 0 2024-08-18T22:41:33.527 INFO:tasks.workunit.client.0.smithi121.stdout:8/343: fdatasync d6/d17/d42/d45/f59 0 2024-08-18T22:41:33.529 INFO:tasks.workunit.client.0.smithi121.stdout:8/344: symlink d6/d17/d42/d45/l74 0 2024-08-18T22:41:33.530 INFO:tasks.workunit.client.0.smithi121.stdout:8/345: write d6/d17/f1d [1861263,67938] 0 2024-08-18T22:41:33.531 INFO:tasks.workunit.client.0.smithi121.stdout:8/346: chown d6/d20/f29 263 1 2024-08-18T22:41:33.533 INFO:tasks.workunit.client.0.smithi121.stdout:8/347: chown d6/d17/d42/d45/f53 5101 1 2024-08-18T22:41:33.533 INFO:tasks.workunit.client.0.smithi121.stdout:7/357: dwrite de/ff [0,4194304] 0 2024-08-18T22:41:33.535 INFO:tasks.workunit.client.0.smithi121.stdout:7/358: dread - de/d13/d18/d23/d24/f56 zero size 2024-08-18T22:41:33.536 INFO:tasks.workunit.client.0.smithi121.stdout:7/359: chown de/d13/d18/c69 2810 1 2024-08-18T22:41:33.538 INFO:tasks.workunit.client.0.smithi121.stdout:8/348: rename d6/d17/f5f to d6/d17/d60/d5b/d6e/f75 0 2024-08-18T22:41:33.539 INFO:tasks.workunit.client.0.smithi121.stdout:8/349: chown d6/d20/c22 2 1 2024-08-18T22:41:33.542 INFO:tasks.workunit.client.0.smithi121.stdout:7/360: getdents de/d2d 0 2024-08-18T22:41:33.543 INFO:tasks.workunit.client.0.smithi121.stdout:8/350: fsync d6/d1e/d2d/f3d 0 2024-08-18T22:41:33.546 INFO:tasks.workunit.client.0.smithi121.stdout:8/351: creat d6/d17/d18/f76 x:0 0 0 2024-08-18T22:41:33.547 INFO:tasks.workunit.client.0.smithi121.stdout:7/361: symlink de/d1a/d2f/d4b/d6d/l77 0 2024-08-18T22:41:33.549 INFO:tasks.workunit.client.0.smithi121.stdout:8/352: dread d6/dd/d3b/f43 [0,4194304] 0 2024-08-18T22:41:33.550 INFO:tasks.workunit.client.0.smithi121.stdout:8/353: mkdir d6/d20/d69/d77 0 2024-08-18T22:41:33.556 INFO:tasks.workunit.client.0.smithi121.stdout:8/354: rename d6/d17/d42 to d6/d1e/d2d/d78 0 2024-08-18T22:41:33.558 INFO:tasks.workunit.client.0.smithi121.stdout:8/355: chown d6/dd/d3b/l52 222420 1 2024-08-18T22:41:33.561 INFO:tasks.workunit.client.0.smithi121.stdout:8/356: link d6/d1e/d2d/c62 d6/d17/c79 0 2024-08-18T22:41:33.561 INFO:tasks.workunit.client.0.smithi121.stdout:8/357: fdatasync d6/d20/d69/f6a 0 2024-08-18T22:41:33.562 INFO:tasks.workunit.client.0.smithi121.stdout:8/358: chown d6/d17/d60/d5b/d6e 222821047 1 2024-08-18T22:41:33.657 INFO:tasks.workunit.client.0.smithi121.stdout:5/206: sync 2024-08-18T22:41:33.658 INFO:tasks.workunit.client.0.smithi121.stdout:9/420: sync 2024-08-18T22:41:33.658 INFO:tasks.workunit.client.0.smithi121.stdout:0/223: sync 2024-08-18T22:41:33.659 INFO:tasks.workunit.client.0.smithi121.stdout:5/207: fdatasync d3/d5/f1d 0 2024-08-18T22:41:33.659 INFO:tasks.workunit.client.0.smithi121.stdout:0/224: readlink d1/d4/db/d24/l14 0 2024-08-18T22:41:33.660 INFO:tasks.workunit.client.0.smithi121.stdout:5/208: creat d3/d5/f45 x:0 0 0 2024-08-18T22:41:33.661 INFO:tasks.workunit.client.0.smithi121.stdout:5/209: dread - d3/d5/d13/d19/f30 zero size 2024-08-18T22:41:33.661 INFO:tasks.workunit.client.0.smithi121.stdout:0/225: rmdir d1/d4/db/d24/df/d8/d32 39 2024-08-18T22:41:33.667 INFO:tasks.workunit.client.0.smithi121.stdout:0/226: mkdir d1/d47 0 2024-08-18T22:41:33.667 INFO:tasks.workunit.client.0.smithi121.stdout:9/421: link d0/d38/d47/d4c/d18/l42 d0/d38/d44/d7f/l8c 0 2024-08-18T22:41:33.668 INFO:tasks.workunit.client.0.smithi121.stdout:0/227: write d1/d4/db/f37 [1202177,114037] 0 2024-08-18T22:41:33.674 INFO:tasks.workunit.client.0.smithi121.stdout:9/422: dwrite d0/d5/f7d [0,4194304] 0 2024-08-18T22:41:33.679 INFO:tasks.workunit.client.0.smithi121.stdout:5/210: dread d3/fa [4194304,4194304] 0 2024-08-18T22:41:33.680 INFO:tasks.workunit.client.0.smithi121.stdout:0/228: dwrite d1/d4/db/d18/d1c/f36 [0,4194304] 0 2024-08-18T22:41:33.681 INFO:tasks.workunit.client.0.smithi121.stdout:9/423: symlink d0/d5/dd/d2f/d8b/l8d 0 2024-08-18T22:41:33.683 INFO:tasks.workunit.client.0.smithi121.stdout:9/424: write d0/d5/dd/d1a/f37 [581654,17420] 0 2024-08-18T22:41:33.686 INFO:tasks.workunit.client.0.smithi121.stdout:9/425: dread - d0/d38/d47/f51 zero size 2024-08-18T22:41:33.686 INFO:tasks.workunit.client.0.smithi121.stdout:5/211: dread d3/d5/d13/f3d [0,4194304] 0 2024-08-18T22:41:33.689 INFO:tasks.workunit.client.0.smithi121.stdout:5/212: chown d3/d5/d13/d19/d24/l31 461652924 1 2024-08-18T22:41:33.690 INFO:tasks.workunit.client.0.smithi121.stdout:0/229: dwrite d1/d4/f1f [0,4194304] 0 2024-08-18T22:41:33.691 INFO:tasks.workunit.client.0.smithi121.stdout:9/426: creat d0/d38/d52/d5f/f8e x:0 0 0 2024-08-18T22:41:33.692 INFO:tasks.workunit.client.0.smithi121.stdout:0/230: fdatasync d1/d4/db/d3f/f46 0 2024-08-18T22:41:33.693 INFO:tasks.workunit.client.0.smithi121.stdout:0/231: chown d1 804 1 2024-08-18T22:41:33.695 INFO:tasks.workunit.client.0.smithi121.stdout:5/213: readlink d3/d5/d13/d19/d24/l2f 0 2024-08-18T22:41:33.697 INFO:tasks.workunit.client.0.smithi121.stdout:5/214: write d3/d5/f1d [3410059,98384] 0 2024-08-18T22:41:33.698 INFO:tasks.workunit.client.0.smithi121.stdout:5/215: fsync d3/f2c 0 2024-08-18T22:41:33.698 INFO:tasks.workunit.client.0.smithi121.stdout:0/232: unlink d1/d4/db/d24/df/l6 0 2024-08-18T22:41:33.700 INFO:tasks.workunit.client.0.smithi121.stdout:9/427: dwrite d0/d5/dd/d3b/d48/f57 [4194304,4194304] 0 2024-08-18T22:41:33.702 INFO:tasks.workunit.client.0.smithi121.stdout:5/216: unlink d3/d5/d13/d22/f39 0 2024-08-18T22:41:33.705 INFO:tasks.workunit.client.0.smithi121.stdout:5/217: write d3/d5/d13/d19/f1e [4074811,18476] 0 2024-08-18T22:41:33.706 INFO:tasks.workunit.client.0.smithi121.stdout:5/218: write d3/d5/f1d [1082659,66748] 0 2024-08-18T22:41:33.707 INFO:tasks.workunit.client.0.smithi121.stdout:9/428: mknod d0/d5/dd/d1a/d55/d7c/c8f 0 2024-08-18T22:41:33.708 INFO:tasks.workunit.client.0.smithi121.stdout:0/233: dread d1/d4/db/d18/d1c/f36 [0,4194304] 0 2024-08-18T22:41:33.710 INFO:tasks.workunit.client.0.smithi121.stdout:5/219: unlink d3/fa 0 2024-08-18T22:41:33.710 INFO:tasks.workunit.client.0.smithi121.stdout:0/234: chown d1/d4/db/d24/f29 224403 1 2024-08-18T22:41:33.712 INFO:tasks.workunit.client.0.smithi121.stdout:5/220: chown d3/d5/d13/d22/f29 3177579 1 2024-08-18T22:41:33.712 INFO:tasks.workunit.client.0.smithi121.stdout:5/221: chown d3/d5/d3c/d3f 498 1 2024-08-18T22:41:33.713 INFO:tasks.workunit.client.0.smithi121.stdout:9/429: chown d0/d38/d47/d4c/df/d61/c78 3 1 2024-08-18T22:41:33.715 INFO:tasks.workunit.client.0.smithi121.stdout:0/235: getdents d1/d47 0 2024-08-18T22:41:33.715 INFO:tasks.workunit.client.0.smithi121.stdout:9/430: read d0/d38/d47/d4c/d18/f1d [1479979,110570] 0 2024-08-18T22:41:33.730 INFO:tasks.workunit.client.0.smithi121.stdout:5/222: dread d3/d5/d27/f2e [0,4194304] 0 2024-08-18T22:41:33.731 INFO:tasks.workunit.client.0.smithi121.stdout:5/223: write d3/f2a [1462964,65844] 0 2024-08-18T22:41:33.736 INFO:tasks.workunit.client.0.smithi121.stdout:5/224: dread d3/f2a [0,4194304] 0 2024-08-18T22:41:33.737 INFO:tasks.workunit.client.0.smithi121.stdout:5/225: chown d3/d5/d27/f2e 504 1 2024-08-18T22:41:33.744 INFO:tasks.workunit.client.0.smithi121.stdout:5/226: dwrite d3/f14 [0,4194304] 0 2024-08-18T22:41:33.747 INFO:tasks.workunit.client.0.smithi121.stdout:5/227: creat d3/f46 x:0 0 0 2024-08-18T22:41:33.803 INFO:tasks.workunit.client.0.smithi121.stdout:1/378: sync 2024-08-18T22:41:33.803 INFO:tasks.workunit.client.0.smithi121.stdout:2/196: sync 2024-08-18T22:41:33.807 INFO:tasks.workunit.client.0.smithi121.stdout:1/379: rename d5/df to d5/d76/d6c/d6f/d82 0 2024-08-18T22:41:33.808 INFO:tasks.workunit.client.0.smithi121.stdout:2/197: dwrite d2/d8/d1f/f28 [0,4194304] 0 2024-08-18T22:41:33.810 INFO:tasks.workunit.client.0.smithi121.stdout:1/380: rename d5/c1a to d5/d76/c83 0 2024-08-18T22:41:33.812 INFO:tasks.workunit.client.0.smithi121.stdout:1/381: chown d5/d76/d6c/d6f/d82/d15/f5b 54243 1 2024-08-18T22:41:33.812 INFO:tasks.workunit.client.0.smithi121.stdout:2/198: unlink d2/d8/d19/f45 0 2024-08-18T22:41:33.814 INFO:tasks.workunit.client.0.smithi121.stdout:1/382: write d5/d10/d14/d34/f70 [4075072,13420] 0 2024-08-18T22:41:33.814 INFO:tasks.workunit.client.0.smithi121.stdout:2/199: mkdir d2/d3/d48 0 2024-08-18T22:41:33.816 INFO:tasks.workunit.client.0.smithi121.stdout:1/383: creat d5/d10/d36/f84 x:0 0 0 2024-08-18T22:41:33.817 INFO:tasks.workunit.client.0.smithi121.stdout:2/200: creat d2/d3/f49 x:0 0 0 2024-08-18T22:41:33.817 INFO:tasks.workunit.client.0.smithi121.stdout:2/201: stat d2/d3/l23 0 2024-08-18T22:41:33.819 INFO:tasks.workunit.client.0.smithi121.stdout:1/384: rmdir d5/d10/d14 39 2024-08-18T22:41:33.820 INFO:tasks.workunit.client.0.smithi121.stdout:1/385: creat d5/d10/d67/f85 x:0 0 0 2024-08-18T22:41:33.824 INFO:tasks.workunit.client.0.smithi121.stdout:1/386: creat d5/d10/d14/f86 x:0 0 0 2024-08-18T22:41:33.825 INFO:tasks.workunit.client.0.smithi121.stdout:1/387: readlink d5/lc 0 2024-08-18T22:41:33.826 INFO:tasks.workunit.client.0.smithi121.stdout:1/388: write d5/d76/d6c/d6f/d82/d11/f26 [36437,65218] 0 2024-08-18T22:41:33.827 INFO:tasks.workunit.client.0.smithi121.stdout:1/389: readlink d5/d76/d6c/d6f/d82/d15/l33 0 2024-08-18T22:41:33.838 INFO:tasks.workunit.client.0.smithi121.stdout:1/390: dread d5/f7 [0,4194304] 0 2024-08-18T22:41:33.839 INFO:tasks.workunit.client.0.smithi121.stdout:1/391: read d5/d10/d14/f45 [3552625,61832] 0 2024-08-18T22:41:33.840 INFO:tasks.workunit.client.0.smithi121.stdout:1/392: fdatasync d5/d76/d6c/d6f/d82/d11/f26 0 2024-08-18T22:41:33.845 INFO:tasks.workunit.client.0.smithi121.stdout:1/393: dwrite d5/d76/d6c/d6f/d82/d11/f6a [0,4194304] 0 2024-08-18T22:41:33.848 INFO:tasks.workunit.client.0.smithi121.stdout:1/394: rmdir d5/d10/d36 39 2024-08-18T22:41:33.850 INFO:tasks.workunit.client.0.smithi121.stdout:1/395: rename d5/d76 to d5/d10/d14/d2a/d3a/d87 0 2024-08-18T22:41:33.861 INFO:tasks.workunit.client.0.smithi121.stdout:1/396: dwrite d5/d10/d14/d2a/d3a/d87/d6c/d6f/d82/d15/d28/f71 [0,4194304] 0 2024-08-18T22:41:33.864 INFO:tasks.workunit.client.0.smithi121.stdout:1/397: read d5/d10/d14/d2a/d3a/f66 [1641577,29744] 0 2024-08-18T22:41:33.866 INFO:tasks.workunit.client.0.smithi121.stdout:1/398: creat d5/d10/f88 x:0 0 0 2024-08-18T22:41:33.868 INFO:tasks.workunit.client.0.smithi121.stdout:1/399: mknod d5/d10/c89 0 2024-08-18T22:41:33.869 INFO:tasks.workunit.client.0.smithi121.stdout:1/400: unlink f4 0 2024-08-18T22:41:33.871 INFO:tasks.workunit.client.0.smithi121.stdout:1/401: symlink d5/d10/d14/d2a/l8a 0 2024-08-18T22:41:33.873 INFO:tasks.workunit.client.0.smithi121.stdout:1/402: unlink d5/d10/d14/d34/f44 0 2024-08-18T22:41:33.875 INFO:tasks.workunit.client.0.smithi121.stdout:1/403: unlink d5/d10/d14/d2a/f58 0 2024-08-18T22:41:33.877 INFO:tasks.workunit.client.0.smithi121.stdout:1/404: creat d5/d10/f8b x:0 0 0 2024-08-18T22:41:33.885 INFO:tasks.workunit.client.0.smithi121.stdout:1/405: link d5/d10/d14/d2a/d3a/d87/d6c/d6f/d82/d15/d28/d3d/l7b d5/d10/d36/l8c 0 2024-08-18T22:41:33.886 INFO:tasks.workunit.client.0.smithi121.stdout:1/406: creat d5/d10/d14/d2a/f8d x:0 0 0 2024-08-18T22:41:33.891 INFO:tasks.workunit.client.0.smithi121.stdout:1/407: dread d5/d10/d14/d34/f63 [0,4194304] 0 2024-08-18T22:41:33.897 INFO:tasks.workunit.client.0.smithi121.stdout:1/408: dwrite d5/d10/d14/d34/f63 [0,4194304] 0 2024-08-18T22:41:33.900 INFO:tasks.workunit.client.0.smithi121.stdout:1/409: mkdir d5/d10/d14/d2a/d3a/d87/d6c/d6f/d82/d15/d38/d8e 0 2024-08-18T22:41:33.904 INFO:tasks.workunit.client.0.smithi121.stdout:1/410: link d5/d10/d14/d2a/d3a/d87/d6c/d6f/d82/d15/f5b d5/d10/d14/d2a/d3a/d87/d6c/d6f/f8f 0 2024-08-18T22:41:33.905 INFO:tasks.workunit.client.0.smithi121.stdout:8/359: sync 2024-08-18T22:41:33.905 INFO:tasks.workunit.client.0.smithi121.stdout:0/236: sync 2024-08-18T22:41:33.905 INFO:tasks.workunit.client.0.smithi121.stdout:4/286: sync 2024-08-18T22:41:33.906 INFO:tasks.workunit.client.0.smithi121.stdout:7/362: sync 2024-08-18T22:41:33.906 INFO:tasks.workunit.client.0.smithi121.stdout:3/407: sync 2024-08-18T22:41:33.910 INFO:tasks.workunit.client.0.smithi121.stdout:1/411: creat d5/d10/d14/f90 x:0 0 0 2024-08-18T22:41:33.910 INFO:tasks.workunit.client.0.smithi121.stdout:8/360: dread - d6/d1e/f47 zero size 2024-08-18T22:41:33.910 INFO:tasks.workunit.client.0.smithi121.stdout:4/287: write d2/f19 [98985,101223] 0 2024-08-18T22:41:33.910 INFO:tasks.workunit.client.0.smithi121.stdout:1/412: mkdir d5/d10/d14/d2a/d91 0 2024-08-18T22:41:33.910 INFO:tasks.workunit.client.0.smithi121.stdout:3/408: write d1e/d1f/d25/d2e/d36/d5f/f61 [3861212,102753] 0 2024-08-18T22:41:33.911 INFO:tasks.workunit.client.0.smithi121.stdout:8/361: read - d6/d1e/d2d/d78/d45/f53 zero size 2024-08-18T22:41:33.912 INFO:tasks.workunit.client.0.smithi121.stdout:0/237: unlink d1/d4/db/d18/d1c/c35 0 2024-08-18T22:41:33.914 INFO:tasks.workunit.client.0.smithi121.stdout:4/288: dread - d2/dc/d16/d22/d2c/d44/f57 zero size 2024-08-18T22:41:33.915 INFO:tasks.workunit.client.0.smithi121.stdout:8/362: chown d6/dd/c28 87440 1 2024-08-18T22:41:33.915 INFO:tasks.workunit.client.0.smithi121.stdout:0/238: chown d1/l15 39233 1 2024-08-18T22:41:33.916 INFO:tasks.workunit.client.0.smithi121.stdout:7/363: dwrite de/f6e [0,4194304] 0 2024-08-18T22:41:33.918 INFO:tasks.workunit.client.0.smithi121.stdout:4/289: write d2/dc/f12 [498103,26493] 0 2024-08-18T22:41:33.919 INFO:tasks.workunit.client.0.smithi121.stdout:1/413: mkdir d5/d10/d14/d92 0 2024-08-18T22:41:33.920 INFO:tasks.workunit.client.0.smithi121.stdout:7/364: chown de/d13/d18/d23/c31 0 1 2024-08-18T22:41:33.920 INFO:tasks.workunit.client.0.smithi121.stdout:4/290: write d2/f19 [3355464,21921] 0 2024-08-18T22:41:33.923 INFO:tasks.workunit.client.0.smithi121.stdout:3/409: dread d1e/d1f/d25/f27 [0,4194304] 0 2024-08-18T22:41:33.927 INFO:tasks.workunit.client.0.smithi121.stdout:3/410: stat d1e/d1f/d25/d58/d75 0 2024-08-18T22:41:33.928 INFO:tasks.workunit.client.0.smithi121.stdout:5/228: sync 2024-08-18T22:41:33.928 INFO:tasks.workunit.client.0.smithi121.stdout:9/431: sync 2024-08-18T22:41:33.928 INFO:tasks.workunit.client.0.smithi121.stdout:2/202: sync 2024-08-18T22:41:33.928 INFO:tasks.workunit.client.0.smithi121.stdout:8/363: creat d6/d17/f7a x:0 0 0 2024-08-18T22:41:33.931 INFO:tasks.workunit.client.0.smithi121.stdout:0/239: dwrite d1/d4/db/d24/d30/f3b [0,4194304] 0 2024-08-18T22:41:33.931 INFO:tasks.workunit.client.0.smithi121.stdout:8/364: fdatasync d6/f9 0 2024-08-18T22:41:33.932 INFO:tasks.workunit.client.0.smithi121.stdout:7/365: unlink de/d13/d18/d23/d24/d29/c2c 0 2024-08-18T22:41:33.933 INFO:tasks.workunit.client.0.smithi121.stdout:2/203: stat d2/d8/d19/dc/f3c 0 2024-08-18T22:41:33.934 INFO:tasks.workunit.client.0.smithi121.stdout:8/365: chown d6/d1e/d2d/d78 382992852 1 2024-08-18T22:41:33.934 INFO:tasks.workunit.client.0.smithi121.stdout:9/432: stat d0/d38/d52/d5f/f66 0 2024-08-18T22:41:33.937 INFO:tasks.workunit.client.0.smithi121.stdout:2/204: stat d2/d8/d19/c37 0 2024-08-18T22:41:33.938 INFO:tasks.workunit.client.0.smithi121.stdout:4/291: rename d2/dc/d16/d22/d2c/d44/f4d to d2/dc/f5e 0 2024-08-18T22:41:33.941 INFO:tasks.workunit.client.0.smithi121.stdout:1/414: dwrite d5/d10/d14/d2a/d3a/d87/d6c/d6f/d82/d15/d28/d3d/f55 [0,4194304] 0 2024-08-18T22:41:33.944 INFO:tasks.workunit.client.0.smithi121.stdout:2/205: mkdir d2/d8/d19/d4a 0 2024-08-18T22:41:33.945 INFO:tasks.workunit.client.0.smithi121.stdout:7/366: mknod de/d1a/d2f/d4b/c78 0 2024-08-18T22:41:33.947 INFO:tasks.workunit.client.0.smithi121.stdout:5/229: rename d3/f26 to d3/d5/d13/d19/d24/f47 0 2024-08-18T22:41:33.952 INFO:tasks.workunit.client.0.smithi121.stdout:0/240: creat d1/d4/db/d24/f48 x:0 0 0 2024-08-18T22:41:33.953 INFO:tasks.workunit.client.0.smithi121.stdout:9/433: dwrite d0/d38/d47/f8a [0,4194304] 0 2024-08-18T22:41:33.953 INFO:tasks.workunit.client.0.smithi121.stdout:1/415: symlink d5/d10/d14/d2a/d3a/d87/d6c/l93 0 2024-08-18T22:41:33.957 INFO:tasks.workunit.client.0.smithi121.stdout:2/206: readlink d2/d8/d19/dc/l10 0 2024-08-18T22:41:33.958 INFO:tasks.workunit.client.0.smithi121.stdout:0/241: write d1/d4/db/d3f/f46 [668619,57551] 0 2024-08-18T22:41:33.958 INFO:tasks.workunit.client.0.smithi121.stdout:3/411: dread d1e/d1f/d3e/f78 [0,4194304] 0 2024-08-18T22:41:33.959 INFO:tasks.workunit.client.0.smithi121.stdout:1/416: write d5/d10/d14/d2a/f8d [226276,55191] 0 2024-08-18T22:41:33.960 INFO:tasks.workunit.client.0.smithi121.stdout:8/366: link d6/d1e/c67 d6/dd/d3b/c7b 0 2024-08-18T22:41:33.960 INFO:tasks.workunit.client.0.smithi121.stdout:7/367: dwrite de/f28 [0,4194304] 0 2024-08-18T22:41:33.962 INFO:tasks.workunit.client.0.smithi121.stdout:5/230: rename d3/d5/d13/l20 to d3/d5/d27/d35/l48 0 2024-08-18T22:41:33.962 INFO:tasks.workunit.client.0.smithi121.stdout:8/367: stat d6/d17/f7a 0 2024-08-18T22:41:33.963 INFO:tasks.workunit.client.0.smithi121.stdout:9/434: write d0/d5/dd/d1a/d55/f70 [444213,96926] 0 2024-08-18T22:41:33.964 INFO:tasks.workunit.client.0.smithi121.stdout:4/292: dread d2/dc/d16/d22/d29/f3b [0,4194304] 0 2024-08-18T22:41:33.966 INFO:tasks.workunit.client.0.smithi121.stdout:8/368: dread - d6/d17/f7a zero size 2024-08-18T22:41:33.968 INFO:tasks.workunit.client.0.smithi121.stdout:9/435: write d0/d5/dd/d2f/f5e [3147584,45524] 0 2024-08-18T22:41:33.970 INFO:tasks.workunit.client.0.smithi121.stdout:0/242: mknod d1/d4/c49 0 2024-08-18T22:41:33.973 INFO:tasks.workunit.client.0.smithi121.stdout:2/207: creat d2/f4b x:0 0 0 2024-08-18T22:41:33.974 INFO:tasks.workunit.client.0.smithi121.stdout:1/417: read d5/d10/d14/d2a/d3a/d87/d6c/d6f/d82/d15/f2d [796763,116037] 0 2024-08-18T22:41:33.975 INFO:tasks.workunit.client.0.smithi121.stdout:3/412: link d1e/d1f/d2a/c34 d1e/d1f/d25/d6b/d66/c96 0 2024-08-18T22:41:33.976 INFO:tasks.workunit.client.0.smithi121.stdout:1/418: readlink d5/d10/l53 0 2024-08-18T22:41:33.977 INFO:tasks.workunit.client.0.smithi121.stdout:2/208: chown d2/d8/d1f/f28 62336707 1 2024-08-18T22:41:33.978 INFO:tasks.workunit.client.0.smithi121.stdout:1/419: chown d5/lc 21 1 2024-08-18T22:41:33.979 INFO:tasks.workunit.client.0.smithi121.stdout:9/436: rename d0/d5/dd/d1a/d55 to d0/d38/d47/d4c/df/d61/d90 0 2024-08-18T22:41:33.980 INFO:tasks.workunit.client.0.smithi121.stdout:5/231: dwrite d3/d5/d13/d23/f34 [0,4194304] 0 2024-08-18T22:41:33.980 INFO:tasks.workunit.client.0.smithi121.stdout:4/293: dread d2/dc/d16/d22/d29/f38 [0,4194304] 0 2024-08-18T22:41:33.981 INFO:tasks.workunit.client.0.smithi121.stdout:7/368: getdents de/d1a/d20 0 2024-08-18T22:41:33.983 INFO:tasks.workunit.client.0.smithi121.stdout:2/209: read d2/d8/d1f/f25 [2661938,72857] 0 2024-08-18T22:41:33.983 INFO:tasks.workunit.client.0.smithi121.stdout:8/369: creat d6/f7c x:0 0 0 2024-08-18T22:41:33.984 INFO:tasks.workunit.client.0.smithi121.stdout:9/437: fdatasync d0/d38/d47/d4c/df/f40 0 2024-08-18T22:41:33.986 INFO:tasks.workunit.client.0.smithi121.stdout:1/420: truncate d5/d10/d14/d2a/d3a/d87/d6c/d6f/f77 80541 0 2024-08-18T22:41:33.988 INFO:tasks.workunit.client.0.smithi121.stdout:5/232: rmdir d3/d5/d13/d23 39 2024-08-18T22:41:33.989 INFO:tasks.workunit.client.0.smithi121.stdout:7/369: truncate de/d2d/f42 649259 0 2024-08-18T22:41:33.992 INFO:tasks.workunit.client.0.smithi121.stdout:8/370: symlink d6/d1e/d2d/l7d 0 2024-08-18T22:41:33.993 INFO:tasks.workunit.client.0.smithi121.stdout:5/233: write d3/d5/f1d [2921583,27127] 0 2024-08-18T22:41:33.995 INFO:tasks.workunit.client.0.smithi121.stdout:0/243: rename d1/d4/db/d24/l14 to d1/d4/db/d24/df/d8/d32/d3e/l4a 0 2024-08-18T22:41:33.995 INFO:tasks.workunit.client.0.smithi121.stdout:8/371: fsync d6/d17/f40 0 2024-08-18T22:41:33.996 INFO:tasks.workunit.client.0.smithi121.stdout:2/210: dwrite d2/f4b [0,4194304] 0 2024-08-18T22:41:33.997 INFO:tasks.workunit.client.0.smithi121.stdout:5/234: chown d3/d5/d13/d19/f30 50800622 1 2024-08-18T22:41:33.997 INFO:tasks.workunit.client.0.smithi121.stdout:0/244: stat d1/d4/db/d3f 0 2024-08-18T22:41:34.002 INFO:tasks.workunit.client.0.smithi121.stdout:1/421: symlink d5/d10/d14/d2a/d3a/d87/d6c/l94 0 2024-08-18T22:41:34.002 INFO:tasks.workunit.client.0.smithi121.stdout:9/438: creat d0/d38/d44/d7f/f91 x:0 0 0 2024-08-18T22:41:34.003 INFO:tasks.workunit.client.0.smithi121.stdout:3/413: getdents d1e/d1f 0 2024-08-18T22:41:34.003 INFO:tasks.workunit.client.0.smithi121.stdout:4/294: rename d2/dc/l2a to d2/dc/d16/d22/d2c/d44/l5f 0 2024-08-18T22:41:34.005 INFO:tasks.workunit.client.0.smithi121.stdout:0/245: fdatasync d1/d4/db/d24/d30/f31 0 2024-08-18T22:41:34.007 INFO:tasks.workunit.client.0.smithi121.stdout:7/370: dread de/f16 [0,4194304] 0 2024-08-18T22:41:34.007 INFO:tasks.workunit.client.0.smithi121.stdout:5/235: rmdir d3/d5 39 2024-08-18T22:41:34.008 INFO:tasks.workunit.client.0.smithi121.stdout:7/371: write de/d1a/d34/d38/d5f/f66 [728210,8814] 0 2024-08-18T22:41:34.010 INFO:tasks.workunit.client.0.smithi121.stdout:4/295: creat d2/dc/d1c/f60 x:0 0 0 2024-08-18T22:41:34.012 INFO:tasks.workunit.client.0.smithi121.stdout:1/422: creat d5/d10/d14/d2a/d3a/d87/f95 x:0 0 0 2024-08-18T22:41:34.013 INFO:tasks.workunit.client.0.smithi121.stdout:0/246: symlink d1/d4/da/d2f/l4b 0 2024-08-18T22:41:34.014 INFO:tasks.workunit.client.0.smithi121.stdout:3/414: dread f16 [0,4194304] 0 2024-08-18T22:41:34.015 INFO:tasks.workunit.client.0.smithi121.stdout:7/372: dread de/f11 [0,4194304] 0 2024-08-18T22:41:34.019 INFO:tasks.workunit.client.0.smithi121.stdout:5/236: mknod d3/d5/d27/c49 0 2024-08-18T22:41:34.020 INFO:tasks.workunit.client.0.smithi121.stdout:3/415: mkdir d1e/d1f/d25/d74/d97 0 2024-08-18T22:41:34.021 INFO:tasks.workunit.client.0.smithi121.stdout:3/416: truncate d1e/d1f/d5e/f8a 1002669 0 2024-08-18T22:41:34.022 INFO:tasks.workunit.client.0.smithi121.stdout:3/417: chown d1e/d1f/d2a/l5b 56845 1 2024-08-18T22:41:34.023 INFO:tasks.workunit.client.0.smithi121.stdout:3/418: dread - d1e/d1f/d25/d6b/f59 zero size 2024-08-18T22:41:34.023 INFO:tasks.workunit.client.0.smithi121.stdout:0/247: mknod d1/d4/c4c 0 2024-08-18T22:41:34.024 INFO:tasks.workunit.client.0.smithi121.stdout:3/419: dread - d1e/d1f/d25/d58/d75/d8c/f8f zero size 2024-08-18T22:41:34.025 INFO:tasks.workunit.client.0.smithi121.stdout:2/211: getdents d2/d3 0 2024-08-18T22:41:34.026 INFO:tasks.workunit.client.0.smithi121.stdout:1/423: creat d5/d10/d14/d2a/d3a/d87/d6c/d6f/d82/d15/d38/d8e/f96 x:0 0 0 2024-08-18T22:41:34.026 INFO:tasks.workunit.client.0.smithi121.stdout:3/420: write d1e/d1f/d5e/f8a [1180172,102258] 0 2024-08-18T22:41:34.028 INFO:tasks.workunit.client.0.smithi121.stdout:8/372: getdents d6/d17/d18 0 2024-08-18T22:41:34.029 INFO:tasks.workunit.client.0.smithi121.stdout:1/424: fsync d5/d10/d14/d2a/d3a/d87/d6c/d6f/d82/d15/f37 0 2024-08-18T22:41:34.033 INFO:tasks.workunit.client.0.smithi121.stdout:3/421: dread - d1e/d1f/d25/d2e/d36/f86 zero size 2024-08-18T22:41:34.034 INFO:tasks.workunit.client.0.smithi121.stdout:8/373: mknod d6/d17/d60/d5b/d6e/c7e 0 2024-08-18T22:41:34.035 INFO:tasks.workunit.client.0.smithi121.stdout:7/373: link de/d65/c70 de/d1a/d2f/d36/c79 0 2024-08-18T22:41:34.036 INFO:tasks.workunit.client.0.smithi121.stdout:7/374: stat de/c4c 0 2024-08-18T22:41:34.038 INFO:tasks.workunit.client.0.smithi121.stdout:0/248: link d1/d4/db/d24/df/d8/d32/f44 d1/d4/db/f4d 0 2024-08-18T22:41:34.039 INFO:tasks.workunit.client.0.smithi121.stdout:2/212: dwrite d2/d8/d19/f13 [0,4194304] 0 2024-08-18T22:41:34.042 INFO:tasks.workunit.client.0.smithi121.stdout:5/237: write d3/f1c [946081,75083] 0 2024-08-18T22:41:34.045 INFO:tasks.workunit.client.0.smithi121.stdout:1/425: rename d5/d10/d14/d2a/d3a/d87/d6c/d6f/d79/c80 to d5/d10/d14/d2a/d3a/d87/d6c/d6f/d82/c97 0 2024-08-18T22:41:34.050 INFO:tasks.workunit.client.0.smithi121.stdout:8/374: dwrite d6/d1e/d2d/d78/d45/f53 [0,4194304] 0 2024-08-18T22:41:34.051 INFO:tasks.workunit.client.0.smithi121.stdout:2/213: write d2/d8/d19/dc/f2d [3065768,93157] 0 2024-08-18T22:41:34.056 INFO:tasks.workunit.client.0.smithi121.stdout:5/238: dread d3/d5/d13/d22/f25 [0,4194304] 0 2024-08-18T22:41:34.056 INFO:tasks.workunit.client.0.smithi121.stdout:7/375: write de/d13/d18/d23/d24/d25/f55 [1549825,98328] 0 2024-08-18T22:41:34.058 INFO:tasks.workunit.client.0.smithi121.stdout:0/249: link d1/d4/db/d18/d1c/l27 d1/d4/db/d24/df/d8/l4e 0 2024-08-18T22:41:34.060 INFO:tasks.workunit.client.0.smithi121.stdout:3/422: dread d1e/d1f/d25/d74/f49 [0,4194304] 0 2024-08-18T22:41:34.061 INFO:tasks.workunit.client.0.smithi121.stdout:5/239: dread - d3/d5/d3c/d3f/f42 zero size 2024-08-18T22:41:34.061 INFO:tasks.workunit.client.0.smithi121.stdout:0/250: write d1/d4/db/f38 [848864,102854] 0 2024-08-18T22:41:34.064 INFO:tasks.workunit.client.0.smithi121.stdout:5/240: write d3/f12 [3504615,30926] 0 2024-08-18T22:41:34.065 INFO:tasks.workunit.client.0.smithi121.stdout:7/376: truncate de/d13/d18/d23/f3d 1574185 0 2024-08-18T22:41:34.065 INFO:tasks.workunit.client.0.smithi121.stdout:1/426: dwrite d5/d10/d14/d2a/d3a/d87/d6c/d6f/d82/d11/f26 [0,4194304] 0 2024-08-18T22:41:34.067 INFO:tasks.workunit.client.0.smithi121.stdout:3/423: chown d1e/d1f/d25/d2e/d36/c50 705 1 2024-08-18T22:41:34.068 INFO:tasks.workunit.client.0.smithi121.stdout:1/427: chown d5/d10/d14/d2a/d91 5915324 1 2024-08-18T22:41:34.068 INFO:tasks.workunit.client.0.smithi121.stdout:3/424: fdatasync ff 0 2024-08-18T22:41:34.068 INFO:tasks.workunit.client.0.smithi121.stdout:1/428: truncate d5/f7 5072391 0 2024-08-18T22:41:34.068 INFO:tasks.workunit.client.0.smithi121.stdout:5/241: unlink d3/d5/f45 0 2024-08-18T22:41:34.071 INFO:tasks.workunit.client.0.smithi121.stdout:5/242: fsync d3/d5/d13/d19/f30 0 2024-08-18T22:41:34.072 INFO:tasks.workunit.client.0.smithi121.stdout:2/214: write d2/d3/f2a [1097154,112365] 0 2024-08-18T22:41:34.072 INFO:tasks.workunit.client.0.smithi121.stdout:7/377: truncate de/d1a/d2f/d4b/f64 104664 0 2024-08-18T22:41:34.073 INFO:tasks.workunit.client.0.smithi121.stdout:3/425: creat d1e/d1f/d25/d58/f98 x:0 0 0 2024-08-18T22:41:34.074 INFO:tasks.workunit.client.0.smithi121.stdout:8/375: truncate d6/d17/f1d 879490 0 2024-08-18T22:41:34.075 INFO:tasks.workunit.client.0.smithi121.stdout:1/429: creat d5/d10/d14/d34/f98 x:0 0 0 2024-08-18T22:41:34.079 INFO:tasks.workunit.client.0.smithi121.stdout:2/215: mknod d2/d8/d1f/c4c 0 2024-08-18T22:41:34.080 INFO:tasks.workunit.client.0.smithi121.stdout:8/376: chown d6/d17/d18/c33 2 1 2024-08-18T22:41:34.080 INFO:tasks.workunit.client.0.smithi121.stdout:1/430: dread d5/d10/d14/f4f [0,4194304] 0 2024-08-18T22:41:34.082 INFO:tasks.workunit.client.0.smithi121.stdout:1/431: write d5/d10/f18 [609751,23072] 0 2024-08-18T22:41:34.082 INFO:tasks.workunit.client.0.smithi121.stdout:7/378: creat de/f7a x:0 0 0 2024-08-18T22:41:34.084 INFO:tasks.workunit.client.0.smithi121.stdout:7/379: chown de/d1a/d20/l6a 3508 1 2024-08-18T22:41:34.085 INFO:tasks.workunit.client.0.smithi121.stdout:8/377: creat d6/d1e/d2d/f7f x:0 0 0 2024-08-18T22:41:34.086 INFO:tasks.workunit.client.0.smithi121.stdout:8/378: fdatasync d6/d20/d69/f6a 0 2024-08-18T22:41:34.086 INFO:tasks.workunit.client.0.smithi121.stdout:7/380: dread de/d1a/d2f/d4b/f64 [0,4194304] 0 2024-08-18T22:41:34.086 INFO:tasks.workunit.client.0.smithi121.stdout:0/251: truncate d1/d4/db/f3c 2901791 0 2024-08-18T22:41:34.088 INFO:tasks.workunit.client.0.smithi121.stdout:7/381: chown de/d13/d18/d23/d24/d25 18 1 2024-08-18T22:41:34.088 INFO:tasks.workunit.client.0.smithi121.stdout:2/216: link d2/d8/d19/f47 d2/d8/d19/d4a/f4d 0 2024-08-18T22:41:34.089 INFO:tasks.workunit.client.0.smithi121.stdout:1/432: write d5/d10/d14/f4b [4956089,104321] 0 2024-08-18T22:41:34.089 INFO:tasks.workunit.client.0.smithi121.stdout:7/382: dread - de/d1a/d34/d6c/f6f zero size 2024-08-18T22:41:34.090 INFO:tasks.workunit.client.0.smithi121.stdout:1/433: stat d5/lc 0 2024-08-18T22:41:34.094 INFO:tasks.workunit.client.0.smithi121.stdout:0/252: readlink d1/d4/db/d24/df/d8/d32/d3e/l4a 0 2024-08-18T22:41:34.098 INFO:tasks.workunit.client.0.smithi121.stdout:8/379: symlink d6/dd/d25/d56/l80 0 2024-08-18T22:41:34.098 INFO:tasks.workunit.client.0.smithi121.stdout:2/217: rmdir d2 39 2024-08-18T22:41:34.099 INFO:tasks.workunit.client.0.smithi121.stdout:8/380: write d6/d1e/d2d/d78/d45/f59 [1149844,50575] 0 2024-08-18T22:41:34.100 INFO:tasks.workunit.client.0.smithi121.stdout:0/253: fsync d1/d4/db/d24/df/d8/f20 0 2024-08-18T22:41:34.103 INFO:tasks.workunit.client.0.smithi121.stdout:8/381: creat d6/d1e/d2d/f81 x:0 0 0 2024-08-18T22:41:34.105 INFO:tasks.workunit.client.0.smithi121.stdout:8/382: chown d6/d1e/d2d/c39 30170249 1 2024-08-18T22:41:34.109 INFO:tasks.workunit.client.0.smithi121.stdout:1/434: getdents d5/d10/d14/d2a 0 2024-08-18T22:41:34.114 INFO:tasks.workunit.client.0.smithi121.stdout:2/218: dwrite d2/d22/f3b [0,4194304] 0 2024-08-18T22:41:34.114 INFO:tasks.workunit.client.0.smithi121.stdout:2/219: chown d2/d22/l43 1149 1 2024-08-18T22:41:34.114 INFO:tasks.workunit.client.0.smithi121.stdout:8/383: mknod d6/d17/c82 0 2024-08-18T22:41:34.114 INFO:tasks.workunit.client.0.smithi121.stdout:7/383: dread de/d13/d18/d2e/f32 [0,4194304] 0 2024-08-18T22:41:34.117 INFO:tasks.workunit.client.0.smithi121.stdout:0/254: getdents d1/d4/db/d24/df/d8/d32/d3e 0 2024-08-18T22:41:34.121 INFO:tasks.workunit.client.0.smithi121.stdout:8/384: mkdir d6/d17/d18/d83 0 2024-08-18T22:41:34.122 INFO:tasks.workunit.client.0.smithi121.stdout:0/255: rmdir d1/d4/db/d24/df 39 2024-08-18T22:41:34.122 INFO:tasks.workunit.client.0.smithi121.stdout:8/385: fsync d6/d17/d60/f66 0 2024-08-18T22:41:34.123 INFO:tasks.workunit.client.0.smithi121.stdout:2/220: dread d2/d22/f3b [0,4194304] 0 2024-08-18T22:41:34.124 INFO:tasks.workunit.client.0.smithi121.stdout:2/221: chown d2/f4b 31569231 1 2024-08-18T22:41:34.125 INFO:tasks.workunit.client.0.smithi121.stdout:0/256: mknod d1/d47/c4f 0 2024-08-18T22:41:34.127 INFO:tasks.workunit.client.0.smithi121.stdout:8/386: rmdir d6/d17/d37 39 2024-08-18T22:41:34.130 INFO:tasks.workunit.client.0.smithi121.stdout:1/435: write d5/d10/d14/d2a/d3a/d87/d6c/d6f/d82/d15/f5b [410788,36920] 0 2024-08-18T22:41:34.131 INFO:tasks.workunit.client.0.smithi121.stdout:7/384: dread de/d13/d18/f3c [0,4194304] 0 2024-08-18T22:41:34.132 INFO:tasks.workunit.client.0.smithi121.stdout:2/222: write d2/d8/d19/d4a/f4d [504039,65795] 0 2024-08-18T22:41:34.134 INFO:tasks.workunit.client.0.smithi121.stdout:1/436: write d5/d10/d14/d2a/d3a/d87/d6c/d6f/d82/d15/f37 [3672727,40739] 0 2024-08-18T22:41:34.136 INFO:tasks.workunit.client.0.smithi121.stdout:2/223: creat d2/d3/d48/f4e x:0 0 0 2024-08-18T22:41:34.136 INFO:tasks.workunit.client.0.smithi121.stdout:1/437: read - d5/d10/d36/f84 zero size 2024-08-18T22:41:34.137 INFO:tasks.workunit.client.0.smithi121.stdout:2/224: dread - d2/d8/d1f/f3a zero size 2024-08-18T22:41:34.139 INFO:tasks.workunit.client.0.smithi121.stdout:8/387: dread d6/f8 [0,4194304] 0 2024-08-18T22:41:34.140 INFO:tasks.workunit.client.0.smithi121.stdout:1/438: rmdir d5/d10/d14/d34 39 2024-08-18T22:41:34.141 INFO:tasks.workunit.client.0.smithi121.stdout:8/388: write d6/f7c [547040,40939] 0 2024-08-18T22:41:34.142 INFO:tasks.workunit.client.0.smithi121.stdout:1/439: write d5/f7d [212739,87395] 0 2024-08-18T22:41:34.144 INFO:tasks.workunit.client.0.smithi121.stdout:1/440: stat d5/d10/d14/d92 0 2024-08-18T22:41:34.147 INFO:tasks.workunit.client.0.smithi121.stdout:1/441: write d5/d10/f88 [557491,63556] 0 2024-08-18T22:41:34.148 INFO:tasks.workunit.client.0.smithi121.stdout:2/225: dwrite d2/d8/d19/f47 [0,4194304] 0 2024-08-18T22:41:34.149 INFO:tasks.workunit.client.0.smithi121.stdout:0/257: dread d1/d4/db/d18/f2d [0,4194304] 0 2024-08-18T22:41:34.149 INFO:tasks.workunit.client.0.smithi121.stdout:8/389: rename d6/d1e/d2d/d78/d45/c4a to d6/d17/d37/c84 0 2024-08-18T22:41:34.150 INFO:tasks.workunit.client.0.smithi121.stdout:8/390: chown d6/d17/f51 5875 1 2024-08-18T22:41:34.151 INFO:tasks.workunit.client.0.smithi121.stdout:0/258: chown d1/d4/db/d18/d40 1860893635 1 2024-08-18T22:41:34.152 INFO:tasks.workunit.client.0.smithi121.stdout:7/385: dread de/d1a/d63/f6b [4194304,4194304] 0 2024-08-18T22:41:34.153 INFO:tasks.workunit.client.0.smithi121.stdout:7/386: stat de/f16 0 2024-08-18T22:41:34.153 INFO:tasks.workunit.client.0.smithi121.stdout:2/226: symlink d2/d8/d19/d4a/l4f 0 2024-08-18T22:41:34.154 INFO:tasks.workunit.client.0.smithi121.stdout:8/391: mkdir d6/d1e/d2d/d78/d85 0 2024-08-18T22:41:34.155 INFO:tasks.workunit.client.0.smithi121.stdout:8/392: stat d6/d20/d69/c73 0 2024-08-18T22:41:34.156 INFO:tasks.workunit.client.0.smithi121.stdout:2/227: dread - d2/d3/d48/f4e zero size 2024-08-18T22:41:34.156 INFO:tasks.workunit.client.0.smithi121.stdout:0/259: creat d1/d4/db/d24/df/d8/d32/d3e/f50 x:0 0 0 2024-08-18T22:41:34.156 INFO:tasks.workunit.client.0.smithi121.stdout:8/393: readlink d6/d17/l2f 0 2024-08-18T22:41:34.156 INFO:tasks.workunit.client.0.smithi121.stdout:2/228: fdatasync d2/d8/f39 0 2024-08-18T22:41:34.157 INFO:tasks.workunit.client.0.smithi121.stdout:7/387: unlink de/d13/d18/c58 0 2024-08-18T22:41:34.157 INFO:tasks.workunit.client.0.smithi121.stdout:8/394: chown d6/d17/d18 230274 1 2024-08-18T22:41:34.159 INFO:tasks.workunit.client.0.smithi121.stdout:8/395: fsync d6/d20/d69/f6a 0 2024-08-18T22:41:34.161 INFO:tasks.workunit.client.0.smithi121.stdout:8/396: write d6/d1e/f47 [732862,55890] 0 2024-08-18T22:41:34.162 INFO:tasks.workunit.client.0.smithi121.stdout:0/260: rename d1/d4/db/f38 to d1/d4/db/d24/df/d8/d32/d3e/f51 0 2024-08-18T22:41:34.164 INFO:tasks.workunit.client.0.smithi121.stdout:2/229: dread d2/d8/d19/d4a/f4d [0,4194304] 0 2024-08-18T22:41:34.165 INFO:tasks.workunit.client.0.smithi121.stdout:8/397: truncate d6/d1e/d2d/d78/f6c 140310 0 2024-08-18T22:41:34.167 INFO:tasks.workunit.client.0.smithi121.stdout:2/230: symlink d2/d8/d19/l50 0 2024-08-18T22:41:34.167 INFO:tasks.workunit.client.0.smithi121.stdout:8/398: dread d6/d1e/f54 [0,4194304] 0 2024-08-18T22:41:34.169 INFO:tasks.workunit.client.0.smithi121.stdout:0/261: rename d1/d4/db/d3f to d1/d4/db/d24/d30/d52 0 2024-08-18T22:41:34.171 INFO:tasks.workunit.client.0.smithi121.stdout:2/231: dread d2/d8/d19/f46 [0,4194304] 0 2024-08-18T22:41:34.172 INFO:tasks.workunit.client.0.smithi121.stdout:8/399: mkdir d6/d1e/d2d/d78/d45/d86 0 2024-08-18T22:41:34.174 INFO:tasks.workunit.client.0.smithi121.stdout:2/232: rmdir d2/d8/d19 39 2024-08-18T22:41:34.174 INFO:tasks.workunit.client.0.smithi121.stdout:0/262: mkdir d1/d4/d53 0 2024-08-18T22:41:34.175 INFO:tasks.workunit.client.0.smithi121.stdout:2/233: chown d2/d3/c30 0 1 2024-08-18T22:41:34.177 INFO:tasks.workunit.client.0.smithi121.stdout:7/388: dread de/f15 [0,4194304] 0 2024-08-18T22:41:34.177 INFO:tasks.workunit.client.0.smithi121.stdout:2/234: mkdir d2/d3/d51 0 2024-08-18T22:41:34.180 INFO:tasks.workunit.client.0.smithi121.stdout:8/400: dwrite d6/d17/d60/f66 [0,4194304] 0 2024-08-18T22:41:34.182 INFO:tasks.workunit.client.0.smithi121.stdout:7/389: creat de/d1a/f7b x:0 0 0 2024-08-18T22:41:34.184 INFO:tasks.workunit.client.0.smithi121.stdout:7/390: fsync de/d1a/d20/f3f 0 2024-08-18T22:41:34.184 INFO:tasks.workunit.client.0.smithi121.stdout:8/401: symlink d6/dd/d3b/l87 0 2024-08-18T22:41:34.186 INFO:tasks.workunit.client.0.smithi121.stdout:0/263: truncate d1/d4/f1f 21086 0 2024-08-18T22:41:34.189 INFO:tasks.workunit.client.0.smithi121.stdout:2/235: dwrite d2/d22/f3b [4194304,4194304] 0 2024-08-18T22:41:34.190 INFO:tasks.workunit.client.0.smithi121.stdout:0/264: symlink d1/d4/db/d24/d30/l54 0 2024-08-18T22:41:34.193 INFO:tasks.workunit.client.0.smithi121.stdout:2/236: read d2/d8/d19/f47 [2410049,86192] 0 2024-08-18T22:41:34.195 INFO:tasks.workunit.client.0.smithi121.stdout:0/265: write d1/d4/db/d24/f48 [517563,17262] 0 2024-08-18T22:41:34.196 INFO:tasks.workunit.client.0.smithi121.stdout:8/402: dwrite d6/d20/d69/f6a [0,4194304] 0 2024-08-18T22:41:34.198 INFO:tasks.workunit.client.0.smithi121.stdout:7/391: truncate de/f1c 4966834 0 2024-08-18T22:41:34.200 INFO:tasks.workunit.client.0.smithi121.stdout:0/266: rename d1/c25 to d1/d4/db/d24/d30/d52/c55 0 2024-08-18T22:41:34.200 INFO:tasks.workunit.client.0.smithi121.stdout:7/392: write de/d13/d18/f19 [242964,107120] 0 2024-08-18T22:41:34.203 INFO:tasks.workunit.client.0.smithi121.stdout:0/267: truncate d1/d4/db/f2c 332832 0 2024-08-18T22:41:34.206 INFO:tasks.workunit.client.0.smithi121.stdout:8/403: dwrite d6/d17/d18/f2c [0,4194304] 0 2024-08-18T22:41:34.208 INFO:tasks.workunit.client.0.smithi121.stdout:0/268: mknod d1/d4/db/d24/d30/d52/c56 0 2024-08-18T22:41:34.212 INFO:tasks.workunit.client.0.smithi121.stdout:7/393: dwrite de/d1a/d2f/d36/f54 [0,4194304] 0 2024-08-18T22:41:34.216 INFO:tasks.workunit.client.0.smithi121.stdout:8/404: dwrite d6/dd/f16 [0,4194304] 0 2024-08-18T22:41:34.220 INFO:tasks.workunit.client.0.smithi121.stdout:7/394: write de/f16 [1957724,12665] 0 2024-08-18T22:41:34.221 INFO:tasks.workunit.client.0.smithi121.stdout:0/269: dwrite d1/d4/db/d18/f22 [0,4194304] 0 2024-08-18T22:41:34.224 INFO:tasks.workunit.client.0.smithi121.stdout:7/395: rmdir de/d1a/d34/d38/d5f 39 2024-08-18T22:41:34.225 INFO:tasks.workunit.client.0.smithi121.stdout:7/396: readlink de/d13/d18/d23/d24/d29/d43/l57 0 2024-08-18T22:41:34.226 INFO:tasks.workunit.client.0.smithi121.stdout:0/270: read d1/d4/f1f [17720,70825] 0 2024-08-18T22:41:34.227 INFO:tasks.workunit.client.0.smithi121.stdout:7/397: write de/d13/f49 [3288525,92231] 0 2024-08-18T22:41:34.232 INFO:tasks.workunit.client.0.smithi121.stdout:7/398: creat de/f7c x:0 0 0 2024-08-18T22:41:34.240 INFO:tasks.workunit.client.0.smithi121.stdout:7/399: dwrite de/d1a/f7b [0,4194304] 0 2024-08-18T22:41:34.243 INFO:tasks.workunit.client.0.smithi121.stdout:7/400: rename de/f6e to de/d13/d18/d23/f7d 0 2024-08-18T22:41:34.246 INFO:tasks.workunit.client.0.smithi121.stdout:7/401: creat de/d13/d18/f7e x:0 0 0 2024-08-18T22:41:34.247 INFO:tasks.workunit.client.0.smithi121.stdout:0/271: dread d1/d4/db/d24/df/f7 [0,4194304] 0 2024-08-18T22:41:34.250 INFO:tasks.workunit.client.0.smithi121.stdout:0/272: mknod d1/d4/db/d18/d40/c57 0 2024-08-18T22:41:34.251 INFO:tasks.workunit.client.0.smithi121.stdout:7/402: truncate de/d13/d18/d23/d24/d29/f5c 1332319 0 2024-08-18T22:41:34.251 INFO:tasks.workunit.client.0.smithi121.stdout:0/273: readlink d1/d4/da/l1d 0 2024-08-18T22:41:34.253 INFO:tasks.workunit.client.0.smithi121.stdout:7/403: mkdir de/d13/d18/d23/d24/d29/d43/d7f 0 2024-08-18T22:41:34.255 INFO:tasks.workunit.client.0.smithi121.stdout:0/274: link d1/d4/db/d24/df/d8/d32/d3e/f51 d1/d4/db/d18/f58 0 2024-08-18T22:41:34.257 INFO:tasks.workunit.client.0.smithi121.stdout:0/275: creat d1/d4/db/d18/d1c/f59 x:0 0 0 2024-08-18T22:41:34.258 INFO:tasks.workunit.client.0.smithi121.stdout:0/276: creat d1/d4/db/f5a x:0 0 0 2024-08-18T22:41:34.260 INFO:tasks.workunit.client.0.smithi121.stdout:0/277: mkdir d1/d4/db/d24/d30/d52/d5b 0 2024-08-18T22:41:34.262 INFO:tasks.workunit.client.0.smithi121.stdout:0/278: dread d1/d4/db/d24/f48 [0,4194304] 0 2024-08-18T22:41:34.263 INFO:tasks.workunit.client.0.smithi121.stdout:0/279: fsync d1/d4/db/d24/df/d8/d32/d3e/f50 0 2024-08-18T22:41:34.273 INFO:tasks.workunit.client.0.smithi121.stdout:0/280: dwrite d1/d4/db/f4d [0,4194304] 0 2024-08-18T22:41:34.275 INFO:tasks.workunit.client.0.smithi121.stdout:0/281: fsync d1/d4/db/d18/d2e/f3d 0 2024-08-18T22:41:34.278 INFO:tasks.workunit.client.0.smithi121.stdout:0/282: rmdir d1/d4/db/d24/df/d8 39 2024-08-18T22:41:34.280 INFO:tasks.workunit.client.0.smithi121.stdout:0/283: write d1/d4/db/d24/f48 [835490,123268] 0 2024-08-18T22:41:34.290 INFO:tasks.workunit.client.0.smithi121.stdout:0/284: dread d1/d4/db/f1a [0,4194304] 0 2024-08-18T22:41:34.294 INFO:tasks.workunit.client.0.smithi121.stdout:0/285: rename d1/d4/db/f4d to d1/d4/db/d24/df/d8/d32/f5c 0 2024-08-18T22:41:34.296 INFO:tasks.workunit.client.0.smithi121.stdout:0/286: unlink d1/d4/db/d24/df/d8/d32/d3e/f50 0 2024-08-18T22:41:34.299 INFO:tasks.workunit.client.0.smithi121.stdout:0/287: dread d1/d4/db/d24/df/d8/d32/f5c [0,4194304] 0 2024-08-18T22:41:34.333 INFO:tasks.workunit.client.0.smithi121.stdout:9/439: sync 2024-08-18T22:41:34.333 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:41:33 smithi121 ceph-mon[16788]: pgmap v242: 65 pgs: 65 active+clean; 678 MiB data, 3.7 GiB used, 533 GiB / 536 GiB avail; 2.8 MiB/s rd, 71 MiB/s wr, 524 op/s 2024-08-18T22:41:34.334 INFO:tasks.workunit.client.0.smithi121.stdout:9/440: chown d0/d38/d47/d4c/df/d61/d90/f77 232435702 1 2024-08-18T22:41:34.341 INFO:tasks.workunit.client.0.smithi121.stdout:0/288: creat d1/d4/db/d24/d30/d52/f5d x:0 0 0 2024-08-18T22:41:34.342 INFO:tasks.workunit.client.0.smithi121.stdout:0/289: chown d1/d4/da/d2f/l4b 20784580 1 2024-08-18T22:41:34.342 INFO:tasks.workunit.client.0.smithi121.stdout:9/441: mkdir d0/d38/d47/d4c/df/d3d/d89/d92 0 2024-08-18T22:41:34.342 INFO:tasks.workunit.client.0.smithi121.stdout:0/290: fdatasync d1/d4/db/d18/f23 0 2024-08-18T22:41:34.344 INFO:tasks.workunit.client.0.smithi121.stdout:9/442: unlink d0/d5/dd/d3b/f86 0 2024-08-18T22:41:34.346 INFO:tasks.workunit.client.0.smithi121.stdout:0/291: creat d1/d4/da/d2f/f5e x:0 0 0 2024-08-18T22:41:34.348 INFO:tasks.workunit.client.0.smithi121.stdout:9/443: rename d0/d38/d47/d4c/df/d61/d90/d7e to d0/d5/dd/d1a/d93 0 2024-08-18T22:41:34.351 INFO:tasks.workunit.client.0.smithi121.stdout:9/444: unlink d0/d38/d47/f34 0 2024-08-18T22:41:34.353 INFO:tasks.workunit.client.0.smithi121.stdout:9/445: unlink d0/d5/dd/d1a/f5c 0 2024-08-18T22:41:34.354 INFO:tasks.workunit.client.0.smithi121.stdout:9/446: creat d0/d5/dd/d1a/d93/f94 x:0 0 0 2024-08-18T22:41:34.357 INFO:tasks.workunit.client.0.smithi121.stdout:9/447: rmdir d0/d38/d47/d4c/df/d73/d7b 0 2024-08-18T22:41:34.368 INFO:tasks.workunit.client.0.smithi121.stdout:9/448: dwrite d0/d38/d47/d4c/df/d61/d90/f84 [0,4194304] 0 2024-08-18T22:41:34.409 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:41:33 smithi195 ceph-mon[23370]: pgmap v242: 65 pgs: 65 active+clean; 678 MiB data, 3.7 GiB used, 533 GiB / 536 GiB avail; 2.8 MiB/s rd, 71 MiB/s wr, 524 op/s 2024-08-18T22:41:34.471 INFO:tasks.workunit.client.1.smithi195.stdout:6/0: sync 2024-08-18T22:41:34.473 INFO:tasks.workunit.client.1.smithi195.stdout:6/1: creat f0 x:0 0 0 2024-08-18T22:41:34.474 INFO:tasks.workunit.client.1.smithi195.stdout:6/2: symlink l1 0 2024-08-18T22:41:34.477 INFO:tasks.workunit.client.0.smithi121.stdout:5/243: sync 2024-08-18T22:41:34.478 INFO:tasks.workunit.client.0.smithi121.stdout:3/426: sync 2024-08-18T22:41:34.478 INFO:tasks.workunit.client.0.smithi121.stdout:4/296: sync 2024-08-18T22:41:34.478 INFO:tasks.workunit.client.0.smithi121.stdout:1/442: sync 2024-08-18T22:41:34.478 INFO:tasks.workunit.client.0.smithi121.stdout:2/237: sync 2024-08-18T22:41:34.479 INFO:tasks.workunit.client.0.smithi121.stdout:3/427: chown d1e/d1f/d25/c4e 4 1 2024-08-18T22:41:34.479 INFO:tasks.workunit.client.0.smithi121.stdout:2/238: chown d2/d8/d1f/f25 7 1 2024-08-18T22:41:34.482 INFO:tasks.workunit.client.0.smithi121.stdout:2/239: creat d2/d8/d19/f52 x:0 0 0 2024-08-18T22:41:34.483 INFO:tasks.workunit.client.0.smithi121.stdout:1/443: symlink d5/d10/d14/d2a/d3a/d87/d6c/d6f/d82/d15/d28/d3d/l99 0 2024-08-18T22:41:34.484 INFO:tasks.workunit.client.0.smithi121.stdout:2/240: write d2/d8/d1f/f35 [1263077,7568] 0 2024-08-18T22:41:34.484 INFO:tasks.workunit.client.0.smithi121.stdout:5/244: truncate d3/fd 3478487 0 2024-08-18T22:41:34.485 INFO:tasks.workunit.client.0.smithi121.stdout:1/444: stat d5/d10/d14/d2a/d3a/d87/d6c/d6f/d82/f51 0 2024-08-18T22:41:34.486 INFO:tasks.workunit.client.0.smithi121.stdout:2/241: read d2/d8/d19/f46 [474604,18345] 0 2024-08-18T22:41:34.487 INFO:tasks.workunit.client.0.smithi121.stdout:5/245: creat d3/d5/d13/d19/f4a x:0 0 0 2024-08-18T22:41:34.488 INFO:tasks.workunit.client.0.smithi121.stdout:2/242: mkdir d2/d3/d53 0 2024-08-18T22:41:34.489 INFO:tasks.workunit.client.0.smithi121.stdout:5/246: read d3/fc [191826,58002] 0 2024-08-18T22:41:34.490 INFO:tasks.workunit.client.0.smithi121.stdout:1/445: mkdir d5/d10/d14/d2a/d3a/d87/d6c/d6f/d82/d15/d28/d3d/d9a 0 2024-08-18T22:41:34.491 INFO:tasks.workunit.client.0.smithi121.stdout:4/297: dread d2/f2e [0,4194304] 0 2024-08-18T22:41:34.492 INFO:tasks.workunit.client.0.smithi121.stdout:5/247: creat d3/d5/d13/d22/f4b x:0 0 0 2024-08-18T22:41:34.493 INFO:tasks.workunit.client.0.smithi121.stdout:1/446: mknod d5/d10/d14/d2a/d3a/d87/d6c/c9b 0 2024-08-18T22:41:34.494 INFO:tasks.workunit.client.0.smithi121.stdout:2/243: creat d2/f54 x:0 0 0 2024-08-18T22:41:34.495 INFO:tasks.workunit.client.0.smithi121.stdout:2/244: write d2/d8/d19/f52 [1043132,2457] 0 2024-08-18T22:41:34.497 INFO:tasks.workunit.client.0.smithi121.stdout:2/245: chown d2/d8/d19/dc/f2d 621858778 1 2024-08-18T22:41:34.498 INFO:tasks.workunit.client.0.smithi121.stdout:5/248: mknod d3/d5/d13/c4c 0 2024-08-18T22:41:34.500 INFO:tasks.workunit.client.0.smithi121.stdout:2/246: mkdir d2/d8/d19/d55 0 2024-08-18T22:41:34.502 INFO:tasks.workunit.client.0.smithi121.stdout:1/447: dwrite d5/d10/d14/d2a/d3a/d87/f4c [4194304,4194304] 0 2024-08-18T22:41:34.503 INFO:tasks.workunit.client.0.smithi121.stdout:5/249: mkdir d3/d5/d13/d19/d24/d4d 0 2024-08-18T22:41:34.506 INFO:tasks.workunit.client.0.smithi121.stdout:2/247: dread d2/d8/d19/f13 [0,4194304] 0 2024-08-18T22:41:34.507 INFO:tasks.workunit.client.0.smithi121.stdout:5/250: creat d3/d5/d13/d19/d24/d32/d38/f4e x:0 0 0 2024-08-18T22:41:34.508 INFO:tasks.workunit.client.0.smithi121.stdout:1/448: creat d5/d10/d14/d34/f9c x:0 0 0 2024-08-18T22:41:34.509 INFO:tasks.workunit.client.1.smithi195.stdout:3/32: sync 2024-08-18T22:41:34.509 INFO:tasks.workunit.client.1.smithi195.stdout:9/14: sync 2024-08-18T22:41:34.509 INFO:tasks.workunit.client.1.smithi195.stdout:0/108: sync 2024-08-18T22:41:34.509 INFO:tasks.workunit.client.1.smithi195.stdout:2/81: sync 2024-08-18T22:41:34.510 INFO:tasks.workunit.client.0.smithi121.stdout:5/251: truncate d3/d5/d13/d19/d24/d32/f3b 630502 0 2024-08-18T22:41:34.510 INFO:tasks.workunit.client.1.smithi195.stdout:4/3: sync 2024-08-18T22:41:34.510 INFO:tasks.workunit.client.1.smithi195.stdout:4/4: dread - no filename 2024-08-18T22:41:34.510 INFO:tasks.workunit.client.1.smithi195.stdout:8/8: sync 2024-08-18T22:41:34.510 INFO:tasks.workunit.client.1.smithi195.stdout:1/172: sync 2024-08-18T22:41:34.511 INFO:tasks.workunit.client.1.smithi195.stdout:7/30: sync 2024-08-18T22:41:34.511 INFO:tasks.workunit.client.1.smithi195.stdout:5/18: sync 2024-08-18T22:41:34.511 INFO:tasks.workunit.client.0.smithi121.stdout:2/248: getdents d2/d3/d53 0 2024-08-18T22:41:34.513 INFO:tasks.workunit.client.1.smithi195.stdout:7/31: write f1 [889026,118673] 0 2024-08-18T22:41:34.513 INFO:tasks.workunit.client.1.smithi195.stdout:9/15: write f0 [159675,47370] 0 2024-08-18T22:41:34.515 INFO:tasks.workunit.client.0.smithi121.stdout:2/249: unlink d2/d8/d19/l20 0 2024-08-18T22:41:34.516 INFO:tasks.workunit.client.1.smithi195.stdout:5/19: mkdir d0/d3/d8 0 2024-08-18T22:41:34.517 INFO:tasks.workunit.client.1.smithi195.stdout:0/109: dread d0/dc/d11/f15 [4194304,4194304] 0 2024-08-18T22:41:34.517 INFO:tasks.workunit.client.1.smithi195.stdout:3/33: mkdir d7/da 0 2024-08-18T22:41:34.517 INFO:tasks.workunit.client.0.smithi121.stdout:4/298: dwrite d2/dc/d1c/f23 [0,4194304] 0 2024-08-18T22:41:34.518 INFO:tasks.workunit.client.0.smithi121.stdout:2/250: readlink d2/d8/d19/dc/l16 0 2024-08-18T22:41:34.522 INFO:tasks.workunit.client.1.smithi195.stdout:0/110: stat d0/dc/l17 0 2024-08-18T22:41:34.522 INFO:tasks.workunit.client.1.smithi195.stdout:2/82: rmdir d1/d9 39 2024-08-18T22:41:34.522 INFO:tasks.workunit.client.1.smithi195.stdout:8/9: dread f0 [0,4194304] 0 2024-08-18T22:41:34.522 INFO:tasks.workunit.client.1.smithi195.stdout:0/111: stat d0/dc/f21 0 2024-08-18T22:41:34.523 INFO:tasks.workunit.client.0.smithi121.stdout:5/252: rmdir d3/d5/d13/d19/d24/d32/d38 39 2024-08-18T22:41:34.523 INFO:tasks.workunit.client.0.smithi121.stdout:2/251: rename d2/d3/f4 to d2/d3/f56 0 2024-08-18T22:41:34.524 INFO:tasks.workunit.client.0.smithi121.stdout:2/252: fsync d2/d8/d19/f52 0 2024-08-18T22:41:34.524 INFO:tasks.workunit.client.0.smithi121.stdout:4/299: symlink d2/dc/l61 0 2024-08-18T22:41:34.527 INFO:tasks.workunit.client.1.smithi195.stdout:4/5: getdents d0 0 2024-08-18T22:41:34.527 INFO:tasks.workunit.client.0.smithi121.stdout:5/253: creat d3/d5/d13/d19/d24/d4d/f4f x:0 0 0 2024-08-18T22:41:34.527 INFO:tasks.workunit.client.0.smithi121.stdout:4/300: mkdir d2/dc/d1c/d62 0 2024-08-18T22:41:34.528 INFO:tasks.workunit.client.1.smithi195.stdout:7/32: dwrite fb [0,4194304] 0 2024-08-18T22:41:34.528 INFO:tasks.workunit.client.1.smithi195.stdout:4/6: rename d0 to d0/d1 22 2024-08-18T22:41:34.529 INFO:tasks.workunit.client.1.smithi195.stdout:4/7: read - no filename 2024-08-18T22:41:34.529 INFO:tasks.workunit.client.1.smithi195.stdout:4/8: link - no file 2024-08-18T22:41:34.529 INFO:tasks.workunit.client.1.smithi195.stdout:4/9: dread - no filename 2024-08-18T22:41:34.530 INFO:tasks.workunit.client.1.smithi195.stdout:8/10: chown d1/f2 3764 1 2024-08-18T22:41:34.530 INFO:tasks.workunit.client.1.smithi195.stdout:9/16: dread f0 [4194304,4194304] 0 2024-08-18T22:41:34.530 INFO:tasks.workunit.client.1.smithi195.stdout:4/10: rename d0 to d0/d2 22 2024-08-18T22:41:34.530 INFO:tasks.workunit.client.0.smithi121.stdout:4/301: fsync d2/dc/f32 0 2024-08-18T22:41:34.532 INFO:tasks.workunit.client.0.smithi121.stdout:1/449: dread d5/f3c [0,4194304] 0 2024-08-18T22:41:34.533 INFO:tasks.workunit.client.0.smithi121.stdout:5/254: rename d3/d5/d13/c4c to d3/d5/d27/c50 0 2024-08-18T22:41:34.533 INFO:tasks.workunit.client.0.smithi121.stdout:2/253: dwrite d2/d8/f39 [0,4194304] 0 2024-08-18T22:41:34.533 INFO:tasks.workunit.client.1.smithi195.stdout:2/83: rmdir d1/d9 39 2024-08-18T22:41:34.534 INFO:tasks.workunit.client.0.smithi121.stdout:5/255: fdatasync d3/f2c 0 2024-08-18T22:41:34.535 INFO:tasks.workunit.client.0.smithi121.stdout:4/302: mknod d2/dc/d16/c63 0 2024-08-18T22:41:34.535 INFO:tasks.workunit.client.1.smithi195.stdout:2/84: write d1/f1b [548157,55069] 0 2024-08-18T22:41:34.535 INFO:tasks.workunit.client.1.smithi195.stdout:7/33: rmdir dc 39 2024-08-18T22:41:34.537 INFO:tasks.workunit.client.1.smithi195.stdout:8/11: fsync f0 0 2024-08-18T22:41:34.537 INFO:tasks.workunit.client.0.smithi121.stdout:5/256: chown d3/d5/d13/d22/f4b 886841872 1 2024-08-18T22:41:34.539 INFO:tasks.workunit.client.0.smithi121.stdout:2/254: read d2/d8/d19/dc/f2d [2416410,102270] 0 2024-08-18T22:41:34.540 INFO:tasks.workunit.client.0.smithi121.stdout:4/303: chown d2/dc/d16/d22/d29/f41 98339012 1 2024-08-18T22:41:34.540 INFO:tasks.workunit.client.1.smithi195.stdout:5/20: creat d0/f9 x:0 0 0 2024-08-18T22:41:34.541 INFO:tasks.workunit.client.1.smithi195.stdout:8/12: write d1/f2 [900641,130082] 0 2024-08-18T22:41:34.542 INFO:tasks.workunit.client.1.smithi195.stdout:3/34: creat d7/da/fb x:0 0 0 2024-08-18T22:41:34.544 INFO:tasks.workunit.client.0.smithi121.stdout:2/255: mknod d2/d8/d19/d4a/c57 0 2024-08-18T22:41:34.545 INFO:tasks.workunit.client.1.smithi195.stdout:4/11: creat d0/f3 x:0 0 0 2024-08-18T22:41:34.547 INFO:tasks.workunit.client.1.smithi195.stdout:0/112: dwrite d0/f1c [4194304,4194304] 0 2024-08-18T22:41:34.547 INFO:tasks.workunit.client.0.smithi121.stdout:2/256: chown d2/d8/d19/f52 699368668 1 2024-08-18T22:41:34.548 INFO:tasks.workunit.client.0.smithi121.stdout:1/450: dwrite d5/d10/d14/d2a/d3a/d87/d6c/d6f/f77 [0,4194304] 0 2024-08-18T22:41:34.548 INFO:tasks.workunit.client.0.smithi121.stdout:4/304: getdents d2/dc 0 2024-08-18T22:41:34.550 INFO:tasks.workunit.client.1.smithi195.stdout:2/85: rmdir d1/d9 39 2024-08-18T22:41:34.551 INFO:tasks.workunit.client.0.smithi121.stdout:2/257: creat d2/d8/d19/d55/f58 x:0 0 0 2024-08-18T22:41:34.552 INFO:tasks.workunit.client.1.smithi195.stdout:4/12: creat d0/f4 x:0 0 0 2024-08-18T22:41:34.553 INFO:tasks.workunit.client.1.smithi195.stdout:5/21: unlink d0/d2/f6 0 2024-08-18T22:41:34.555 INFO:tasks.workunit.client.0.smithi121.stdout:1/451: truncate d5/d10/d14/d2a/d3a/d87/d6c/d6f/d82/d11/f74 977484 0 2024-08-18T22:41:34.555 INFO:tasks.workunit.client.0.smithi121.stdout:2/258: symlink d2/d3/d51/l59 0 2024-08-18T22:41:34.555 INFO:tasks.workunit.client.1.smithi195.stdout:9/17: dwrite f0 [4194304,4194304] 0 2024-08-18T22:41:34.558 INFO:tasks.workunit.client.1.smithi195.stdout:8/13: creat d1/d3/f4 x:0 0 0 2024-08-18T22:41:34.558 INFO:tasks.workunit.client.1.smithi195.stdout:4/13: write d0/f3 [273430,97433] 0 2024-08-18T22:41:34.558 INFO:tasks.workunit.client.0.smithi121.stdout:7/404: sync 2024-08-18T22:41:34.559 INFO:tasks.workunit.client.0.smithi121.stdout:8/405: sync 2024-08-18T22:41:34.559 INFO:tasks.workunit.client.1.smithi195.stdout:3/35: dwrite f6 [0,4194304] 0 2024-08-18T22:41:34.561 INFO:tasks.workunit.client.0.smithi121.stdout:7/405: fdatasync de/d1a/d2f/d36/f54 0 2024-08-18T22:41:34.562 INFO:tasks.workunit.client.0.smithi121.stdout:7/406: chown de/d1a/d34/d38/c3a 3 1 2024-08-18T22:41:34.562 INFO:tasks.workunit.client.1.smithi195.stdout:9/18: mknod c7 0 2024-08-18T22:41:34.563 INFO:tasks.workunit.client.1.smithi195.stdout:0/113: dread d0/f1c [0,4194304] 0 2024-08-18T22:41:34.563 INFO:tasks.workunit.client.1.smithi195.stdout:9/19: fdatasync f3 0 2024-08-18T22:41:34.566 INFO:tasks.workunit.client.1.smithi195.stdout:2/86: readlink d1/d9/l14 0 2024-08-18T22:41:34.566 INFO:tasks.workunit.client.1.smithi195.stdout:9/20: dread - f3 zero size 2024-08-18T22:41:34.566 INFO:tasks.workunit.client.0.smithi121.stdout:7/407: read de/d13/d18/d23/d24/d29/f74 [299446,46949] 0 2024-08-18T22:41:34.567 INFO:tasks.workunit.client.1.smithi195.stdout:5/22: rename d0/d3/d5 to d0/d3/d8/da 0 2024-08-18T22:41:34.568 INFO:tasks.workunit.client.1.smithi195.stdout:2/87: write d1/d9/fc [717974,50386] 0 2024-08-18T22:41:34.568 INFO:tasks.workunit.client.1.smithi195.stdout:4/14: mknod d0/c5 0 2024-08-18T22:41:34.569 INFO:tasks.workunit.client.1.smithi195.stdout:7/34: link dc/l12 dc/l13 0 2024-08-18T22:41:34.572 INFO:tasks.workunit.client.1.smithi195.stdout:2/88: readlink d1/d9/l14 0 2024-08-18T22:41:34.573 INFO:tasks.workunit.client.1.smithi195.stdout:3/36: dwrite f4 [0,4194304] 0 2024-08-18T22:41:34.575 INFO:tasks.workunit.client.1.smithi195.stdout:2/89: write d1/f15 [5094047,18017] 0 2024-08-18T22:41:34.576 INFO:tasks.workunit.client.1.smithi195.stdout:4/15: mknod d0/c6 0 2024-08-18T22:41:34.577 INFO:tasks.workunit.client.0.smithi121.stdout:2/259: dread d2/d3/f56 [4194304,4194304] 0 2024-08-18T22:41:34.579 INFO:tasks.workunit.client.0.smithi121.stdout:2/260: truncate d2/d3/f49 241495 0 2024-08-18T22:41:34.580 INFO:tasks.workunit.client.0.smithi121.stdout:4/305: dwrite d2/fb [4194304,4194304] 0 2024-08-18T22:41:34.580 INFO:tasks.workunit.client.0.smithi121.stdout:7/408: creat de/d13/d18/d23/d24/d29/d43/d7f/f80 x:0 0 0 2024-08-18T22:41:34.584 INFO:tasks.workunit.client.0.smithi121.stdout:4/306: rmdir d2/dc/d16/d22/d29 39 2024-08-18T22:41:34.584 INFO:tasks.workunit.client.1.smithi195.stdout:8/14: rename d1/d3/f4 to d1/f5 0 2024-08-18T22:41:34.586 INFO:tasks.workunit.client.1.smithi195.stdout:7/35: truncate f2 217985 0 2024-08-18T22:41:34.587 INFO:tasks.workunit.client.0.smithi121.stdout:4/307: truncate d2/dc/f52 4742081 0 2024-08-18T22:41:34.588 INFO:tasks.workunit.client.0.smithi121.stdout:5/257: dread d3/f2c [0,4194304] 0 2024-08-18T22:41:34.588 INFO:tasks.workunit.client.1.smithi195.stdout:2/90: fdatasync d1/d9/fa 0 2024-08-18T22:41:34.589 INFO:tasks.workunit.client.1.smithi195.stdout:5/23: mkdir d0/db 0 2024-08-18T22:41:34.589 INFO:tasks.workunit.client.0.smithi121.stdout:7/409: dread de/d13/d18/d2e/f32 [0,4194304] 0 2024-08-18T22:41:34.590 INFO:tasks.workunit.client.0.smithi121.stdout:2/261: dread d2/d8/f39 [0,4194304] 0 2024-08-18T22:41:34.590 INFO:tasks.workunit.client.1.smithi195.stdout:0/114: dwrite d0/f1c [4194304,4194304] 0 2024-08-18T22:41:34.591 INFO:tasks.workunit.client.0.smithi121.stdout:5/258: write d3/fc [39891,130989] 0 2024-08-18T22:41:34.591 INFO:tasks.workunit.client.1.smithi195.stdout:4/16: mkdir d0/d7 0 2024-08-18T22:41:34.591 INFO:tasks.workunit.client.0.smithi121.stdout:4/308: symlink d2/dc/d16/d59/l64 0 2024-08-18T22:41:34.592 INFO:tasks.workunit.client.0.smithi121.stdout:2/262: chown d2/d8/d19/dc/c1e 1381656 1 2024-08-18T22:41:34.592 INFO:tasks.workunit.client.0.smithi121.stdout:4/309: fdatasync d2/dc/d1c/f4b 0 2024-08-18T22:41:34.593 INFO:tasks.workunit.client.1.smithi195.stdout:2/91: dread - d1/d9/f18 zero size 2024-08-18T22:41:34.594 INFO:tasks.workunit.client.1.smithi195.stdout:4/17: chown d0/c5 0 1 2024-08-18T22:41:34.594 INFO:tasks.workunit.client.1.smithi195.stdout:4/18: readlink - no filename 2024-08-18T22:41:34.595 INFO:tasks.workunit.client.0.smithi121.stdout:5/259: symlink d3/d5/d13/d19/l51 0 2024-08-18T22:41:34.596 INFO:tasks.workunit.client.1.smithi195.stdout:5/24: dread - d0/f9 zero size 2024-08-18T22:41:34.596 INFO:tasks.workunit.client.1.smithi195.stdout:3/37: dread f4 [0,4194304] 0 2024-08-18T22:41:34.596 INFO:tasks.workunit.client.1.smithi195.stdout:7/36: mkdir dc/d14 0 2024-08-18T22:41:34.597 INFO:tasks.workunit.client.0.smithi121.stdout:4/310: symlink d2/dc/d1c/d62/l65 0 2024-08-18T22:41:34.597 INFO:tasks.workunit.client.1.smithi195.stdout:9/21: link l5 l8 0 2024-08-18T22:41:34.598 INFO:tasks.workunit.client.0.smithi121.stdout:7/410: dread de/d13/d18/d2e/f32 [0,4194304] 0 2024-08-18T22:41:34.601 INFO:tasks.workunit.client.1.smithi195.stdout:0/115: chown d0/dc/d11/f20 851102 1 2024-08-18T22:41:34.601 INFO:tasks.workunit.client.1.smithi195.stdout:2/92: dread - d1/d8/f1a zero size 2024-08-18T22:41:34.601 INFO:tasks.workunit.client.1.smithi195.stdout:5/25: write d0/f9 [977607,9190] 0 2024-08-18T22:41:34.603 INFO:tasks.workunit.client.0.smithi121.stdout:7/411: mkdir de/d1a/d34/d81 0 2024-08-18T22:41:34.603 INFO:tasks.workunit.client.0.smithi121.stdout:2/263: dwrite d2/d8/d19/d55/f58 [0,4194304] 0 2024-08-18T22:41:34.603 INFO:tasks.workunit.client.1.smithi195.stdout:3/38: creat d7/fc x:0 0 0 2024-08-18T22:41:34.604 INFO:tasks.workunit.client.1.smithi195.stdout:8/15: dwrite f0 [0,4194304] 0 2024-08-18T22:41:34.605 INFO:tasks.workunit.client.1.smithi195.stdout:7/37: mkdir dc/d14/d15 0 2024-08-18T22:41:34.606 INFO:tasks.workunit.client.0.smithi121.stdout:8/406: dread d6/d20/f26 [0,4194304] 0 2024-08-18T22:41:34.606 INFO:tasks.workunit.client.0.smithi121.stdout:4/311: write d2/f2e [667480,2501] 0 2024-08-18T22:41:34.606 INFO:tasks.workunit.client.0.smithi121.stdout:8/407: chown d6/d1e 4912 1 2024-08-18T22:41:34.609 INFO:tasks.workunit.client.1.smithi195.stdout:2/93: readlink d1/l3 0 2024-08-18T22:41:34.610 INFO:tasks.workunit.client.0.smithi121.stdout:7/412: write de/d13/d18/f19 [1093788,97893] 0 2024-08-18T22:41:34.610 INFO:tasks.workunit.client.0.smithi121.stdout:2/264: write d2/d3/f56 [10016833,117052] 0 2024-08-18T22:41:34.611 INFO:tasks.workunit.client.0.smithi121.stdout:5/260: dread d3/d5/d13/d23/f34 [0,4194304] 0 2024-08-18T22:41:34.615 INFO:tasks.workunit.client.0.smithi121.stdout:5/261: creat d3/d5/d13/d23/f52 x:0 0 0 2024-08-18T22:41:34.616 INFO:tasks.workunit.client.1.smithi195.stdout:5/26: dread d0/f9 [0,4194304] 0 2024-08-18T22:41:34.616 INFO:tasks.workunit.client.0.smithi121.stdout:5/262: chown d3/d5/f1d 407 1 2024-08-18T22:41:34.617 INFO:tasks.workunit.client.1.smithi195.stdout:8/16: creat d1/d3/f6 x:0 0 0 2024-08-18T22:41:34.617 INFO:tasks.workunit.client.0.smithi121.stdout:7/413: mknod de/d1a/d34/d38/d5f/c82 0 2024-08-18T22:41:34.618 INFO:tasks.workunit.client.0.smithi121.stdout:2/265: mknod d2/d3/d53/c5a 0 2024-08-18T22:41:34.618 INFO:tasks.workunit.client.0.smithi121.stdout:5/263: rmdir d3/d5/d27 39 2024-08-18T22:41:34.620 INFO:tasks.workunit.client.1.smithi195.stdout:4/19: dwrite d0/f3 [0,4194304] 0 2024-08-18T22:41:34.620 INFO:tasks.workunit.client.0.smithi121.stdout:2/266: unlink d2/d8/d19/d4a/l4f 0 2024-08-18T22:41:34.622 INFO:tasks.workunit.client.0.smithi121.stdout:2/267: write d2/f54 [688353,21385] 0 2024-08-18T22:41:34.623 INFO:tasks.workunit.client.1.smithi195.stdout:8/17: symlink d1/l7 0 2024-08-18T22:41:34.623 INFO:tasks.workunit.client.1.smithi195.stdout:4/20: write d0/f4 [660048,71879] 0 2024-08-18T22:41:34.624 INFO:tasks.workunit.client.0.smithi121.stdout:5/264: mkdir d3/d5/d27/d35/d53 0 2024-08-18T22:41:34.625 INFO:tasks.workunit.client.1.smithi195.stdout:5/27: write d0/f9 [1146366,36064] 0 2024-08-18T22:41:34.625 INFO:tasks.workunit.client.1.smithi195.stdout:0/116: dwrite d0/f1c [4194304,4194304] 0 2024-08-18T22:41:34.626 INFO:tasks.workunit.client.0.smithi121.stdout:7/414: dwrite de/d13/d18/d23/d24/d25/f55 [0,4194304] 0 2024-08-18T22:41:34.626 INFO:tasks.workunit.client.0.smithi121.stdout:5/265: fdatasync d3/f2c 0 2024-08-18T22:41:34.626 INFO:tasks.workunit.client.1.smithi195.stdout:8/18: rmdir d1 39 2024-08-18T22:41:34.628 INFO:tasks.workunit.client.0.smithi121.stdout:2/268: write d2/d8/f39 [3767616,5747] 0 2024-08-18T22:41:34.628 INFO:tasks.workunit.client.0.smithi121.stdout:5/266: read d3/d5/d27/d35/f36 [343117,64801] 0 2024-08-18T22:41:34.629 INFO:tasks.workunit.client.0.smithi121.stdout:7/415: chown de/d1a/d20/c62 36 1 2024-08-18T22:41:34.630 INFO:tasks.workunit.client.1.smithi195.stdout:8/19: chown d1 336 1 2024-08-18T22:41:34.631 INFO:tasks.workunit.client.0.smithi121.stdout:4/312: truncate d2/dc/d1c/f33 1561908 0 2024-08-18T22:41:34.632 INFO:tasks.workunit.client.1.smithi195.stdout:5/28: symlink d0/d3/lc 0 2024-08-18T22:41:34.632 INFO:tasks.workunit.client.0.smithi121.stdout:5/267: write d3/fc [1339472,61804] 0 2024-08-18T22:41:34.633 INFO:tasks.workunit.client.1.smithi195.stdout:4/21: link d0/f3 d0/f8 0 2024-08-18T22:41:34.635 INFO:tasks.workunit.client.0.smithi121.stdout:7/416: creat de/d1a/d2f/d4b/d6d/f83 x:0 0 0 2024-08-18T22:41:34.637 INFO:tasks.workunit.client.0.smithi121.stdout:4/313: mkdir d2/dc/d16/d22/d2c/d44/d66 0 2024-08-18T22:41:34.637 INFO:tasks.workunit.client.1.smithi195.stdout:0/117: dwrite d0/f1c [4194304,4194304] 0 2024-08-18T22:41:34.637 INFO:tasks.workunit.client.1.smithi195.stdout:8/20: symlink d1/l8 0 2024-08-18T22:41:34.638 INFO:tasks.workunit.client.1.smithi195.stdout:5/29: dread d0/f9 [0,4194304] 0 2024-08-18T22:41:34.641 INFO:tasks.workunit.client.1.smithi195.stdout:8/21: unlink f0 0 2024-08-18T22:41:34.642 INFO:tasks.workunit.client.0.smithi121.stdout:8/408: dwrite d6/d1e/f35 [0,4194304] 0 2024-08-18T22:41:34.642 INFO:tasks.workunit.client.1.smithi195.stdout:0/118: symlink d0/dc/d11/d1b/l22 0 2024-08-18T22:41:34.643 INFO:tasks.workunit.client.0.smithi121.stdout:2/269: dwrite d2/d8/d19/f52 [0,4194304] 0 2024-08-18T22:41:34.644 INFO:tasks.workunit.client.1.smithi195.stdout:0/119: write d0/f1c [5356840,65570] 0 2024-08-18T22:41:34.645 INFO:tasks.workunit.client.0.smithi121.stdout:4/314: rmdir d2/dc/d1c/d62 39 2024-08-18T22:41:34.645 INFO:tasks.workunit.client.0.smithi121.stdout:5/268: stat d3/d5/d13/d19/d24/d32/d38/f4e 0 2024-08-18T22:41:34.645 INFO:tasks.workunit.client.1.smithi195.stdout:8/22: symlink d1/d3/l9 0 2024-08-18T22:41:34.648 INFO:tasks.workunit.client.1.smithi195.stdout:0/120: mkdir d0/dc/d11/d23 0 2024-08-18T22:41:34.648 INFO:tasks.workunit.client.0.smithi121.stdout:4/315: write d2/dc/d16/d22/d2c/d44/f57 [223326,116093] 0 2024-08-18T22:41:34.649 INFO:tasks.workunit.client.1.smithi195.stdout:5/30: link d0/d3/l7 d0/d3/d8/ld 0 2024-08-18T22:41:34.651 INFO:tasks.workunit.client.0.smithi121.stdout:8/409: dread - d6/d17/d18/f76 zero size 2024-08-18T22:41:34.653 INFO:tasks.workunit.client.0.smithi121.stdout:2/270: mknod d2/d8/d19/c5b 0 2024-08-18T22:41:34.654 INFO:tasks.workunit.client.0.smithi121.stdout:7/417: rmdir de/d1a/d34/d81 0 2024-08-18T22:41:34.655 INFO:tasks.workunit.client.1.smithi195.stdout:0/121: dwrite d0/dc/d11/f15 [0,4194304] 0 2024-08-18T22:41:34.656 INFO:tasks.workunit.client.0.smithi121.stdout:4/316: mkdir d2/dc/d16/d22/d2c/d44/d67 0 2024-08-18T22:41:34.660 INFO:tasks.workunit.client.0.smithi121.stdout:7/418: creat de/d2d/d50/f84 x:0 0 0 2024-08-18T22:41:34.662 INFO:tasks.workunit.client.1.smithi195.stdout:0/122: dread d0/f1c [0,4194304] 0 2024-08-18T22:41:34.663 INFO:tasks.workunit.client.0.smithi121.stdout:7/419: truncate de/d1a/d2f/d4b/d6d/f83 179732 0 2024-08-18T22:41:34.665 INFO:tasks.workunit.client.0.smithi121.stdout:5/269: getdents d3 0 2024-08-18T22:41:34.666 INFO:tasks.workunit.client.0.smithi121.stdout:2/271: symlink d2/l5c 0 2024-08-18T22:41:34.667 INFO:tasks.workunit.client.0.smithi121.stdout:2/272: write d2/d8/d19/dc/f3c [2578031,6248] 0 2024-08-18T22:41:34.670 INFO:tasks.workunit.client.0.smithi121.stdout:5/270: dread d3/d5/d13/d19/d24/d32/f3b [0,4194304] 0 2024-08-18T22:41:34.670 INFO:tasks.workunit.client.0.smithi121.stdout:2/273: rmdir d2/d22 39 2024-08-18T22:41:34.671 INFO:tasks.workunit.client.0.smithi121.stdout:5/271: write d3/f1c [700514,106500] 0 2024-08-18T22:41:34.672 INFO:tasks.workunit.client.0.smithi121.stdout:9/449: sync 2024-08-18T22:41:34.672 INFO:tasks.workunit.client.0.smithi121.stdout:0/292: sync 2024-08-18T22:41:34.672 INFO:tasks.workunit.client.0.smithi121.stdout:3/428: sync 2024-08-18T22:41:34.674 INFO:tasks.workunit.client.0.smithi121.stdout:2/274: symlink d2/d8/l5d 0 2024-08-18T22:41:34.675 INFO:tasks.workunit.client.0.smithi121.stdout:3/429: truncate d1e/d1f/d25/f4c 1610253 0 2024-08-18T22:41:34.676 INFO:tasks.workunit.client.0.smithi121.stdout:0/293: unlink d1/d4/db/d18/d2e/l43 0 2024-08-18T22:41:34.680 INFO:tasks.workunit.client.0.smithi121.stdout:8/410: dread d6/d1e/d2d/d78/d45/f59 [0,4194304] 0 2024-08-18T22:41:34.680 INFO:tasks.workunit.client.0.smithi121.stdout:3/430: truncate d1e/d1f/d25/d2e/d36/d5f/f61 4531548 0 2024-08-18T22:41:34.682 INFO:tasks.workunit.client.0.smithi121.stdout:4/317: dread d2/dc/f13 [0,4194304] 0 2024-08-18T22:41:34.682 INFO:tasks.workunit.client.0.smithi121.stdout:0/294: rmdir d1/d4/db/d24/df/d8/d32/d3e 39 2024-08-18T22:41:34.683 INFO:tasks.workunit.client.0.smithi121.stdout:9/450: getdents d0/d5/dd/d3b/d48 0 2024-08-18T22:41:34.685 INFO:tasks.workunit.client.0.smithi121.stdout:0/295: mkdir d1/d4/db/d18/d1c/d5f 0 2024-08-18T22:41:34.689 INFO:tasks.workunit.client.0.smithi121.stdout:3/431: dread d1e/d1f/d3e/f78 [0,4194304] 0 2024-08-18T22:41:34.690 INFO:tasks.workunit.client.0.smithi121.stdout:4/318: rename d2/dc/f3a to d2/dc/d16/f68 0 2024-08-18T22:41:34.690 INFO:tasks.workunit.client.0.smithi121.stdout:8/411: dwrite d6/f7c [0,4194304] 0 2024-08-18T22:41:34.691 INFO:tasks.workunit.client.0.smithi121.stdout:9/451: dread d0/d38/d47/d4c/df/d61/d90/f6c [0,4194304] 0 2024-08-18T22:41:34.697 INFO:tasks.workunit.client.0.smithi121.stdout:2/275: dread d2/d8/d19/f24 [0,4194304] 0 2024-08-18T22:41:34.698 INFO:tasks.workunit.client.0.smithi121.stdout:0/296: dread d1/d4/db/d24/df/d8/d32/f44 [0,4194304] 0 2024-08-18T22:41:34.698 INFO:tasks.workunit.client.0.smithi121.stdout:2/276: fdatasync d2/d8/d19/f52 0 2024-08-18T22:41:34.699 INFO:tasks.workunit.client.0.smithi121.stdout:4/319: creat d2/dc/d16/d22/f69 x:0 0 0 2024-08-18T22:41:34.700 INFO:tasks.workunit.client.0.smithi121.stdout:8/412: creat d6/d20/d69/d77/f88 x:0 0 0 2024-08-18T22:41:34.701 INFO:tasks.workunit.client.0.smithi121.stdout:9/452: creat d0/d38/d47/d4c/df/d3d/f95 x:0 0 0 2024-08-18T22:41:34.703 INFO:tasks.workunit.client.0.smithi121.stdout:9/453: truncate d0/d5/dd/d3b/d48/f74 4767286 0 2024-08-18T22:41:34.704 INFO:tasks.workunit.client.0.smithi121.stdout:1/452: sync 2024-08-18T22:41:34.706 INFO:tasks.workunit.client.0.smithi121.stdout:7/420: write fc [52076,115215] 0 2024-08-18T22:41:34.707 INFO:tasks.workunit.client.0.smithi121.stdout:8/413: rename d6/d1e/l4c to d6/dd/l89 0 2024-08-18T22:41:34.708 INFO:tasks.workunit.client.0.smithi121.stdout:8/414: truncate d6/d1e/f3f 5237548 0 2024-08-18T22:41:34.709 INFO:tasks.workunit.client.0.smithi121.stdout:9/454: write d0/d38/f4e [702200,52911] 0 2024-08-18T22:41:34.710 INFO:tasks.workunit.client.0.smithi121.stdout:5/272: truncate d3/d5/d13/d22/f29 3360025 0 2024-08-18T22:41:34.711 INFO:tasks.workunit.client.0.smithi121.stdout:2/277: mknod d2/c5e 0 2024-08-18T22:41:34.711 INFO:tasks.workunit.client.0.smithi121.stdout:5/273: write d3/d5/f11 [99707,121110] 0 2024-08-18T22:41:34.715 INFO:tasks.workunit.client.0.smithi121.stdout:1/453: unlink d5/d10/d14/d2a/d3a/d87/d6c/d6f/d82/d11/c4a 0 2024-08-18T22:41:34.717 INFO:tasks.workunit.client.0.smithi121.stdout:3/432: getdents d1e/d1f/d25/d74/d85 0 2024-08-18T22:41:34.719 INFO:tasks.workunit.client.0.smithi121.stdout:3/433: dread f16 [0,4194304] 0 2024-08-18T22:41:34.719 INFO:tasks.workunit.client.0.smithi121.stdout:9/455: mkdir d0/d5/dd/d1a/d96 0 2024-08-18T22:41:34.720 INFO:tasks.workunit.client.0.smithi121.stdout:2/278: mknod d2/d8/d19/d4a/c5f 0 2024-08-18T22:41:34.726 INFO:tasks.workunit.client.0.smithi121.stdout:5/274: rename d3/d5/d3c/d3f/f42 to d3/d5/d27/f54 0 2024-08-18T22:41:34.726 INFO:tasks.workunit.client.0.smithi121.stdout:0/297: write d1/d4/db/d24/df/d8/d32/d3e/f51 [1488462,71578] 0 2024-08-18T22:41:34.726 INFO:tasks.workunit.client.0.smithi121.stdout:4/320: creat d2/dc/d1c/f6a x:0 0 0 2024-08-18T22:41:34.726 INFO:tasks.workunit.client.0.smithi121.stdout:7/421: mkdir de/d13/d18/d23/d24/d85 0 2024-08-18T22:41:34.727 INFO:tasks.workunit.client.0.smithi121.stdout:1/454: symlink d5/d10/d14/d2a/d3a/d87/d6c/d6f/d82/d15/d38/l9d 0 2024-08-18T22:41:34.728 INFO:tasks.workunit.client.0.smithi121.stdout:8/415: creat d6/d17/d18/d83/f8a x:0 0 0 2024-08-18T22:41:34.730 INFO:tasks.workunit.client.0.smithi121.stdout:2/279: symlink d2/d3/l60 0 2024-08-18T22:41:34.731 INFO:tasks.workunit.client.0.smithi121.stdout:5/275: dwrite d3/d5/f1d [0,4194304] 0 2024-08-18T22:41:34.733 INFO:tasks.workunit.client.0.smithi121.stdout:5/276: fsync d3/d5/d13/d19/f30 0 2024-08-18T22:41:34.733 INFO:tasks.workunit.client.0.smithi121.stdout:2/280: write d2/f4b [3015536,3920] 0 2024-08-18T22:41:34.733 INFO:tasks.workunit.client.0.smithi121.stdout:4/321: mknod d2/dc/d16/c6b 0 2024-08-18T22:41:34.734 INFO:tasks.workunit.client.0.smithi121.stdout:0/298: creat d1/d4/db/f60 x:0 0 0 2024-08-18T22:41:34.735 INFO:tasks.workunit.client.0.smithi121.stdout:9/456: mknod d0/d38/d47/d4c/d45/c97 0 2024-08-18T22:41:34.738 INFO:tasks.workunit.client.0.smithi121.stdout:5/277: read d3/f14 [3275586,118288] 0 2024-08-18T22:41:34.738 INFO:tasks.workunit.client.0.smithi121.stdout:7/422: mknod de/d13/d18/c86 0 2024-08-18T22:41:34.738 INFO:tasks.workunit.client.0.smithi121.stdout:3/434: dwrite d1e/f31 [0,4194304] 0 2024-08-18T22:41:34.740 INFO:tasks.workunit.client.0.smithi121.stdout:9/457: write d0/d5/fa [4858585,23557] 0 2024-08-18T22:41:34.742 INFO:tasks.workunit.client.0.smithi121.stdout:2/281: mknod d2/d8/d19/c61 0 2024-08-18T22:41:34.745 INFO:tasks.workunit.client.0.smithi121.stdout:3/435: write d1e/d1f/d25/d2e/d36/d5f/f6e [359464,76448] 0 2024-08-18T22:41:34.747 INFO:tasks.workunit.client.0.smithi121.stdout:1/455: creat d5/d10/d14/d2a/d3a/d87/d6c/d6f/d82/d15/f9e x:0 0 0 2024-08-18T22:41:34.749 INFO:tasks.workunit.client.0.smithi121.stdout:8/416: getdents d6/dd 0 2024-08-18T22:41:34.751 INFO:tasks.workunit.client.0.smithi121.stdout:0/299: truncate d1/d4/db/d18/d2e/f3d 1001408 0 2024-08-18T22:41:34.757 INFO:tasks.workunit.client.0.smithi121.stdout:5/278: unlink d3/d5/d27/c50 0 2024-08-18T22:41:34.759 INFO:tasks.workunit.client.0.smithi121.stdout:2/282: dread d2/d3/f2a [0,4194304] 0 2024-08-18T22:41:34.760 INFO:tasks.workunit.client.0.smithi121.stdout:3/436: rename d1e/d1f/d25/d2e/d36/d5f/f7d to d1e/d1f/d25/d58/f99 0 2024-08-18T22:41:34.761 INFO:tasks.workunit.client.0.smithi121.stdout:9/458: dwrite d0/d38/d47/f8a [4194304,4194304] 0 2024-08-18T22:41:34.763 INFO:tasks.workunit.client.0.smithi121.stdout:7/423: dwrite de/d1a/d2f/d4b/d6d/f83 [0,4194304] 0 2024-08-18T22:41:34.767 INFO:tasks.workunit.client.0.smithi121.stdout:0/300: mkdir d1/d4/d53/d61 0 2024-08-18T22:41:34.767 INFO:tasks.workunit.client.0.smithi121.stdout:5/279: chown d3/d5/d13/d19/d24/d32 6 1 2024-08-18T22:41:34.767 INFO:tasks.workunit.client.0.smithi121.stdout:4/322: write d2/f3f [851318,95872] 0 2024-08-18T22:41:34.768 INFO:tasks.workunit.client.0.smithi121.stdout:9/459: chown d0/d38/d52/d5f/f8e 2 1 2024-08-18T22:41:34.769 INFO:tasks.workunit.client.0.smithi121.stdout:1/456: dwrite d5/d10/d14/f4b [0,4194304] 0 2024-08-18T22:41:34.772 INFO:tasks.workunit.client.0.smithi121.stdout:3/437: mkdir d1e/d1f/d5e/d9a 0 2024-08-18T22:41:34.772 INFO:tasks.workunit.client.0.smithi121.stdout:4/323: write d2/f8 [3285534,36684] 0 2024-08-18T22:41:34.776 INFO:tasks.workunit.client.0.smithi121.stdout:9/460: creat d0/d5/f98 x:0 0 0 2024-08-18T22:41:34.777 INFO:tasks.workunit.client.0.smithi121.stdout:0/301: chown d1/d4/db/d18/d1c/l27 1 1 2024-08-18T22:41:34.777 INFO:tasks.workunit.client.0.smithi121.stdout:8/417: dread d6/d17/d18/f32 [0,4194304] 0 2024-08-18T22:41:34.779 INFO:tasks.workunit.client.0.smithi121.stdout:1/457: dread d5/f7d [0,4194304] 0 2024-08-18T22:41:34.781 INFO:tasks.workunit.client.0.smithi121.stdout:5/280: symlink d3/d5/d3c/d3f/l55 0 2024-08-18T22:41:34.782 INFO:tasks.workunit.client.0.smithi121.stdout:7/424: creat de/f87 x:0 0 0 2024-08-18T22:41:34.782 INFO:tasks.workunit.client.0.smithi121.stdout:7/425: fdatasync fc 0 2024-08-18T22:41:34.784 INFO:tasks.workunit.client.0.smithi121.stdout:3/438: rename d1e/d1f/d25/d74/c62 to d1e/d1f/d25/d74/d85/c9b 0 2024-08-18T22:41:34.786 INFO:tasks.workunit.client.0.smithi121.stdout:8/418: rmdir d6/d1e/d2d/d78 39 2024-08-18T22:41:34.787 INFO:tasks.workunit.client.0.smithi121.stdout:8/419: write d6/d1e/f35 [2067588,33262] 0 2024-08-18T22:41:34.789 INFO:tasks.workunit.client.0.smithi121.stdout:2/283: truncate d2/d8/d1f/f28 1593247 0 2024-08-18T22:41:34.789 INFO:tasks.workunit.client.0.smithi121.stdout:5/281: write d3/d5/d13/d19/d24/f47 [5065268,103530] 0 2024-08-18T22:41:34.790 INFO:tasks.workunit.client.0.smithi121.stdout:7/426: unlink de/d13/d18/d23/c31 0 2024-08-18T22:41:34.791 INFO:tasks.workunit.client.0.smithi121.stdout:9/461: creat d0/d38/d47/d4c/df/d61/d90/d60/f99 x:0 0 0 2024-08-18T22:41:34.792 INFO:tasks.workunit.client.1.smithi195.stdout:6/3: fsync f0 0 2024-08-18T22:41:34.793 INFO:tasks.workunit.client.1.smithi195.stdout:6/4: read - f0 zero size 2024-08-18T22:41:34.793 INFO:tasks.workunit.client.0.smithi121.stdout:4/324: creat d2/dc/d16/d22/f6c x:0 0 0 2024-08-18T22:41:34.793 INFO:tasks.workunit.client.1.smithi195.stdout:6/5: chown f0 475900123 1 2024-08-18T22:41:34.794 INFO:tasks.workunit.client.0.smithi121.stdout:9/462: fsync d0/d5/dd/d1a/d93/f94 0 2024-08-18T22:41:34.794 INFO:tasks.workunit.client.0.smithi121.stdout:5/282: mknod d3/c56 0 2024-08-18T22:41:34.796 INFO:tasks.workunit.client.0.smithi121.stdout:2/284: dread d2/d8/d19/f13 [0,4194304] 0 2024-08-18T22:41:34.796 INFO:tasks.workunit.client.1.smithi195.stdout:1/173: truncate da/fe 3153951 0 2024-08-18T22:41:34.797 INFO:tasks.workunit.client.1.smithi195.stdout:5/31: fsync d0/f9 0 2024-08-18T22:41:34.797 INFO:tasks.workunit.client.0.smithi121.stdout:7/427: symlink de/d1a/d34/d38/d5f/l88 0 2024-08-18T22:41:34.797 INFO:tasks.workunit.client.0.smithi121.stdout:4/325: write d2/dc/d16/d22/f6c [117,7883] 0 2024-08-18T22:41:34.797 INFO:tasks.workunit.client.0.smithi121.stdout:0/302: getdents d1/d4/db/d24 0 2024-08-18T22:41:34.798 INFO:tasks.workunit.client.0.smithi121.stdout:8/420: symlink d6/d1e/d2d/d78/d45/d86/l8b 0 2024-08-18T22:41:34.799 INFO:tasks.workunit.client.1.smithi195.stdout:1/174: truncate da/d18/f1f 5241469 0 2024-08-18T22:41:34.800 INFO:tasks.workunit.client.0.smithi121.stdout:9/463: write d0/d38/d47/d4c/df/f20 [3671388,125424] 0 2024-08-18T22:41:34.802 INFO:tasks.workunit.client.1.smithi195.stdout:6/6: dwrite f0 [0,4194304] 0 2024-08-18T22:41:34.802 INFO:tasks.workunit.client.1.smithi195.stdout:5/32: chown d0/d3/d8/ld 108 1 2024-08-18T22:41:34.804 INFO:tasks.workunit.client.1.smithi195.stdout:1/175: mkdir da/d3d 0 2024-08-18T22:41:34.805 INFO:tasks.workunit.client.0.smithi121.stdout:2/285: dread d2/d8/d19/d55/f58 [0,4194304] 0 2024-08-18T22:41:34.807 INFO:tasks.workunit.client.0.smithi121.stdout:0/303: mknod d1/d4/c62 0 2024-08-18T22:41:34.809 INFO:tasks.workunit.client.0.smithi121.stdout:9/464: rmdir d0/d5/dd/d3b/d48 39 2024-08-18T22:41:34.812 INFO:tasks.workunit.client.1.smithi195.stdout:5/33: dwrite d0/f9 [0,4194304] 0 2024-08-18T22:41:34.812 INFO:tasks.workunit.client.1.smithi195.stdout:6/7: getdents . 0 2024-08-18T22:41:34.812 INFO:tasks.workunit.client.0.smithi121.stdout:4/326: creat d2/dc/d16/d22/d2c/d44/d66/f6d x:0 0 0 2024-08-18T22:41:34.813 INFO:tasks.workunit.client.0.smithi121.stdout:9/465: write d0/d38/d52/d5f/f8e [683979,62991] 0 2024-08-18T22:41:34.813 INFO:tasks.workunit.client.0.smithi121.stdout:3/439: dread d1e/d1f/d25/f27 [0,4194304] 0 2024-08-18T22:41:34.814 INFO:tasks.workunit.client.0.smithi121.stdout:2/286: rename d2/d8/d1f/f3a to d2/d3/d53/f62 0 2024-08-18T22:41:34.815 INFO:tasks.workunit.client.1.smithi195.stdout:1/176: truncate da/d18/d28/d31/d3b/f3a 197015 0 2024-08-18T22:41:34.815 INFO:tasks.workunit.client.0.smithi121.stdout:9/466: chown d0/d5/dd/d1a 334055 1 2024-08-18T22:41:34.816 INFO:tasks.workunit.client.1.smithi195.stdout:5/34: readlink d0/d3/l7 0 2024-08-18T22:41:34.816 INFO:tasks.workunit.client.0.smithi121.stdout:8/421: creat d6/f8c x:0 0 0 2024-08-18T22:41:34.817 INFO:tasks.workunit.client.1.smithi195.stdout:9/22: getdents . 0 2024-08-18T22:41:34.818 INFO:tasks.workunit.client.1.smithi195.stdout:5/35: write d0/f9 [586604,28947] 0 2024-08-18T22:41:34.819 INFO:tasks.workunit.client.0.smithi121.stdout:0/304: dwrite d1/d4/db/d18/f22 [0,4194304] 0 2024-08-18T22:41:34.823 INFO:tasks.workunit.client.0.smithi121.stdout:3/440: write d1e/d1f/d3e/f6f [2552828,88489] 0 2024-08-18T22:41:34.823 INFO:tasks.workunit.client.1.smithi195.stdout:5/36: dread d0/f9 [0,4194304] 0 2024-08-18T22:41:34.824 INFO:tasks.workunit.client.1.smithi195.stdout:9/23: creat f9 x:0 0 0 2024-08-18T22:41:34.825 INFO:tasks.workunit.client.0.smithi121.stdout:7/428: getdents de/d1a 0 2024-08-18T22:41:34.827 INFO:tasks.workunit.client.0.smithi121.stdout:5/283: dread d3/d5/f11 [0,4194304] 0 2024-08-18T22:41:34.829 INFO:tasks.workunit.client.0.smithi121.stdout:4/327: creat d2/dc/d16/d22/d2c/f6e x:0 0 0 2024-08-18T22:41:34.830 INFO:tasks.workunit.client.1.smithi195.stdout:3/39: truncate f6 3022566 0 2024-08-18T22:41:34.831 INFO:tasks.workunit.client.1.smithi195.stdout:9/24: mknod ca 0 2024-08-18T22:41:34.833 INFO:tasks.workunit.client.0.smithi121.stdout:7/429: mknod de/d13/d18/d23/d24/d29/d43/c89 0 2024-08-18T22:41:34.837 INFO:tasks.workunit.client.0.smithi121.stdout:5/284: chown d3/d5/d13/d19/d24/d32 628 1 2024-08-18T22:41:34.837 INFO:tasks.workunit.client.0.smithi121.stdout:9/467: dwrite d0/d38/d44/d7f/f91 [0,4194304] 0 2024-08-18T22:41:34.837 INFO:tasks.workunit.client.0.smithi121.stdout:3/441: creat d1e/f9c x:0 0 0 2024-08-18T22:41:34.837 INFO:tasks.workunit.client.1.smithi195.stdout:9/25: creat fb x:0 0 0 2024-08-18T22:41:34.837 INFO:tasks.workunit.client.0.smithi121.stdout:4/328: unlink d2/dc/d16/d59/l64 0 2024-08-18T22:41:34.839 INFO:tasks.workunit.client.0.smithi121.stdout:8/422: dwrite d6/d17/d60/d5b/f6f [0,4194304] 0 2024-08-18T22:41:34.839 INFO:tasks.workunit.client.0.smithi121.stdout:7/430: dread - de/d13/d18/f60 zero size 2024-08-18T22:41:34.840 INFO:tasks.workunit.client.1.smithi195.stdout:2/94: dwrite d1/d8/f11 [0,4194304] 0 2024-08-18T22:41:34.842 INFO:tasks.workunit.client.1.smithi195.stdout:8/23: truncate d1/f2 663605 0 2024-08-18T22:41:34.843 INFO:tasks.workunit.client.1.smithi195.stdout:9/26: symlink lc 0 2024-08-18T22:41:34.843 INFO:tasks.workunit.client.0.smithi121.stdout:7/431: chown de/d13/d18/d23/d24/d29/f74 122 1 2024-08-18T22:41:34.843 INFO:tasks.workunit.client.0.smithi121.stdout:9/468: unlink d0/f1e 0 2024-08-18T22:41:34.844 INFO:tasks.workunit.client.1.smithi195.stdout:2/95: truncate d1/d9/f19 321060 0 2024-08-18T22:41:34.845 INFO:tasks.workunit.client.1.smithi195.stdout:3/40: dwrite d7/f9 [0,4194304] 0 2024-08-18T22:41:34.846 INFO:tasks.workunit.client.1.smithi195.stdout:2/96: chown d1/d8/f11 0 1 2024-08-18T22:41:34.846 INFO:tasks.workunit.client.0.smithi121.stdout:7/432: chown de/f87 920 1 2024-08-18T22:41:34.847 INFO:tasks.workunit.client.0.smithi121.stdout:3/442: rename d1e/d1f/d25/d67/d8e/c89 to d1e/d1f/d5e/d9a/c9d 0 2024-08-18T22:41:34.851 INFO:tasks.workunit.client.0.smithi121.stdout:7/433: mkdir de/d1a/d34/d38/d73/d8a 0 2024-08-18T22:41:34.851 INFO:tasks.workunit.client.0.smithi121.stdout:0/305: dread d1/d4/db/d18/d1c/f36 [0,4194304] 0 2024-08-18T22:41:34.852 INFO:tasks.workunit.client.0.smithi121.stdout:5/285: dwrite d3/d5/d13/d19/d24/d32/d38/f3e [0,4194304] 0 2024-08-18T22:41:34.852 INFO:tasks.workunit.client.0.smithi121.stdout:3/443: mknod d1e/d1f/d25/d2e/c9e 0 2024-08-18T22:41:34.854 INFO:tasks.workunit.client.1.smithi195.stdout:8/24: mknod d1/d3/ca 0 2024-08-18T22:41:34.854 INFO:tasks.workunit.client.0.smithi121.stdout:9/469: creat d0/d38/d47/d4c/df/d3d/d89/d92/f9a x:0 0 0 2024-08-18T22:41:34.855 INFO:tasks.workunit.client.1.smithi195.stdout:3/41: symlink d7/da/ld 0 2024-08-18T22:41:34.855 INFO:tasks.workunit.client.1.smithi195.stdout:9/27: dread - f3 zero size 2024-08-18T22:41:34.855 INFO:tasks.workunit.client.0.smithi121.stdout:4/329: dread d2/f14 [0,4194304] 0 2024-08-18T22:41:34.857 INFO:tasks.workunit.client.1.smithi195.stdout:6/8: truncate f0 234612 0 2024-08-18T22:41:34.858 INFO:tasks.workunit.client.1.smithi195.stdout:7/38: dwrite f2 [0,4194304] 0 2024-08-18T22:41:34.858 INFO:tasks.workunit.client.0.smithi121.stdout:4/330: fdatasync d2/dc/d1c/f3c 0 2024-08-18T22:41:34.858 INFO:tasks.workunit.client.0.smithi121.stdout:0/306: write d1/d4/db/d18/f22 [684896,22800] 0 2024-08-18T22:41:34.859 INFO:tasks.workunit.client.0.smithi121.stdout:7/434: mkdir de/d13/d18/d23/d24/d29/d43/d8b 0 2024-08-18T22:41:34.860 INFO:tasks.workunit.client.1.smithi195.stdout:7/39: write f5 [1790146,89801] 0 2024-08-18T22:41:34.860 INFO:tasks.workunit.client.1.smithi195.stdout:2/97: creat d1/d9/f1c x:0 0 0 2024-08-18T22:41:34.861 INFO:tasks.workunit.client.0.smithi121.stdout:7/435: readlink de/d1a/d34/d38/d5f/l88 0 2024-08-18T22:41:34.861 INFO:tasks.workunit.client.0.smithi121.stdout:5/286: symlink d3/d5/d13/d22/l57 0 2024-08-18T22:41:34.863 INFO:tasks.workunit.client.1.smithi195.stdout:3/42: truncate d7/da/fb 770462 0 2024-08-18T22:41:34.864 INFO:tasks.workunit.client.1.smithi195.stdout:1/177: truncate da/f24 3828007 0 2024-08-18T22:41:34.864 INFO:tasks.workunit.client.0.smithi121.stdout:3/444: rename d1e/d1f/d25/l3f to d1e/d1f/d25/d67/l9f 0 2024-08-18T22:41:34.864 INFO:tasks.workunit.client.0.smithi121.stdout:0/307: write d1/d4/db/d18/f23 [2491884,77112] 0 2024-08-18T22:41:34.866 INFO:tasks.workunit.client.0.smithi121.stdout:0/308: readlink d1/d4/db/d24/d30/l54 0 2024-08-18T22:41:34.866 INFO:tasks.workunit.client.0.smithi121.stdout:3/445: chown d1e/d1f/d25/d2e/c35 219633 1 2024-08-18T22:41:34.867 INFO:tasks.workunit.client.0.smithi121.stdout:9/470: dwrite d0/d38/f4e [0,4194304] 0 2024-08-18T22:41:34.867 INFO:tasks.workunit.client.0.smithi121.stdout:5/287: mkdir d3/d5/d27/d35/d58 0 2024-08-18T22:41:34.867 INFO:tasks.workunit.client.1.smithi195.stdout:3/43: chown d7/da/ld 14609 1 2024-08-18T22:41:34.868 INFO:tasks.workunit.client.0.smithi121.stdout:4/331: write d2/dc/d16/d22/d29/f26 [1712006,31982] 0 2024-08-18T22:41:34.872 INFO:tasks.workunit.client.0.smithi121.stdout:0/309: write d1/d4/db/f37 [1777677,107813] 0 2024-08-18T22:41:34.872 INFO:tasks.workunit.client.1.smithi195.stdout:7/40: dwrite f1 [0,4194304] 0 2024-08-18T22:41:34.873 INFO:tasks.workunit.client.0.smithi121.stdout:9/471: creat d0/d5/f9b x:0 0 0 2024-08-18T22:41:34.875 INFO:tasks.workunit.client.0.smithi121.stdout:0/310: dread - d1/d4/db/d24/f42 zero size 2024-08-18T22:41:34.875 INFO:tasks.workunit.client.1.smithi195.stdout:7/41: chown dc/ff 395091107 1 2024-08-18T22:41:34.876 INFO:tasks.workunit.client.0.smithi121.stdout:3/446: mkdir d1e/d1f/d25/d67/d92/da0 0 2024-08-18T22:41:34.878 INFO:tasks.workunit.client.0.smithi121.stdout:7/436: getdents de/d13/d18 0 2024-08-18T22:41:34.878 INFO:tasks.workunit.client.0.smithi121.stdout:0/311: symlink d1/d47/l63 0 2024-08-18T22:41:34.878 INFO:tasks.workunit.client.0.smithi121.stdout:9/472: write d0/d38/d47/d4c/df/d61/d90/d60/f99 [749811,81886] 0 2024-08-18T22:41:34.879 INFO:tasks.workunit.client.1.smithi195.stdout:6/9: rename l1 to l2 0 2024-08-18T22:41:34.881 INFO:tasks.workunit.client.1.smithi195.stdout:1/178: fsync f7 0 2024-08-18T22:41:34.881 INFO:tasks.workunit.client.1.smithi195.stdout:2/98: rename d1/d9/ff to d1/d9/f1d 0 2024-08-18T22:41:34.881 INFO:tasks.workunit.client.0.smithi121.stdout:7/437: fdatasync de/d13/d18/d23/d24/d25/f55 0 2024-08-18T22:41:34.882 INFO:tasks.workunit.client.0.smithi121.stdout:9/473: stat d0/d38/d44/l6b 0 2024-08-18T22:41:34.882 INFO:tasks.workunit.client.0.smithi121.stdout:3/447: unlink d1e/d1f/d25/d2e/d36/d5f/f6e 0 2024-08-18T22:41:34.882 INFO:tasks.workunit.client.1.smithi195.stdout:8/25: fsync d1/f5 0 2024-08-18T22:41:34.883 INFO:tasks.workunit.client.0.smithi121.stdout:7/438: truncate de/d1a/d4f/f75 410042 0 2024-08-18T22:41:34.883 INFO:tasks.workunit.client.0.smithi121.stdout:0/312: symlink d1/d4/db/d18/d2e/l64 0 2024-08-18T22:41:34.883 INFO:tasks.workunit.client.0.smithi121.stdout:3/448: readlink d1e/d1f/d25/d67/l69 0 2024-08-18T22:41:34.884 INFO:tasks.workunit.client.1.smithi195.stdout:8/26: chown d1 151000 1 2024-08-18T22:41:34.885 INFO:tasks.workunit.client.1.smithi195.stdout:3/44: mknod d7/ce 0 2024-08-18T22:41:34.887 INFO:tasks.workunit.client.1.smithi195.stdout:9/28: dwrite f0 [4194304,4194304] 0 2024-08-18T22:41:34.887 INFO:tasks.workunit.client.1.smithi195.stdout:8/27: write d1/d3/f6 [1024969,66127] 0 2024-08-18T22:41:34.888 INFO:tasks.workunit.client.1.smithi195.stdout:9/29: fdatasync f3 0 2024-08-18T22:41:34.890 INFO:tasks.workunit.client.1.smithi195.stdout:8/28: chown d1/d3/f6 1 1 2024-08-18T22:41:34.890 INFO:tasks.workunit.client.0.smithi121.stdout:9/474: readlink d0/d38/d44/d7f/l8c 0 2024-08-18T22:41:34.891 INFO:tasks.workunit.client.1.smithi195.stdout:9/30: write f0 [5463649,19453] 0 2024-08-18T22:41:34.891 INFO:tasks.workunit.client.0.smithi121.stdout:7/439: chown de/d1a/d20/d39/c59 23 1 2024-08-18T22:41:34.891 INFO:tasks.workunit.client.0.smithi121.stdout:3/449: chown d1e/d1f/d25/d58/d75/d8c 3476017 1 2024-08-18T22:41:34.892 INFO:tasks.workunit.client.0.smithi121.stdout:0/313: mknod d1/d4/db/d18/d40/c65 0 2024-08-18T22:41:34.893 INFO:tasks.workunit.client.0.smithi121.stdout:0/314: fdatasync d1/d4/db/f2c 0 2024-08-18T22:41:34.894 INFO:tasks.workunit.client.1.smithi195.stdout:2/99: mknod d1/d8/c1e 0 2024-08-18T22:41:34.895 INFO:tasks.workunit.client.1.smithi195.stdout:2/100: dread - d1/d9/f1c zero size 2024-08-18T22:41:34.895 INFO:tasks.workunit.client.1.smithi195.stdout:3/45: chown d7/c8 93 1 2024-08-18T22:41:34.896 INFO:tasks.workunit.client.1.smithi195.stdout:7/42: dread f5 [0,4194304] 0 2024-08-18T22:41:34.899 INFO:tasks.workunit.client.0.smithi121.stdout:7/440: symlink de/d1a/d34/d38/l8c 0 2024-08-18T22:41:34.900 INFO:tasks.workunit.client.1.smithi195.stdout:1/179: rename da/d18/l19 to da/d18/d28/d31/d3b/l3e 0 2024-08-18T22:41:34.901 INFO:tasks.workunit.client.1.smithi195.stdout:1/180: read - da/f29 zero size 2024-08-18T22:41:34.902 INFO:tasks.workunit.client.1.smithi195.stdout:3/46: mkdir d7/da/df 0 2024-08-18T22:41:34.904 INFO:tasks.workunit.client.1.smithi195.stdout:7/43: unlink l9 0 2024-08-18T22:41:34.909 INFO:tasks.workunit.client.1.smithi195.stdout:7/44: dread f2 [0,4194304] 0 2024-08-18T22:41:34.911 INFO:tasks.workunit.client.1.smithi195.stdout:3/47: creat d7/f10 x:0 0 0 2024-08-18T22:41:34.911 INFO:tasks.workunit.client.1.smithi195.stdout:3/48: stat l5 0 2024-08-18T22:41:34.914 INFO:tasks.workunit.client.1.smithi195.stdout:6/10: dread f0 [0,4194304] 0 2024-08-18T22:41:34.914 INFO:tasks.workunit.client.1.smithi195.stdout:6/11: read f0 [160621,1160] 0 2024-08-18T22:41:34.915 INFO:tasks.workunit.client.1.smithi195.stdout:9/31: creat fd x:0 0 0 2024-08-18T22:41:34.916 INFO:tasks.workunit.client.1.smithi195.stdout:2/101: creat d1/f1f x:0 0 0 2024-08-18T22:41:34.919 INFO:tasks.workunit.client.1.smithi195.stdout:7/45: rename dc/ff to dc/d14/d15/f16 0 2024-08-18T22:41:34.920 INFO:tasks.workunit.client.1.smithi195.stdout:3/49: symlink d7/l11 0 2024-08-18T22:41:34.920 INFO:tasks.workunit.client.1.smithi195.stdout:7/46: dread - dc/f10 zero size 2024-08-18T22:41:34.923 INFO:tasks.workunit.client.1.smithi195.stdout:2/102: dwrite d1/d9/fa [0,4194304] 0 2024-08-18T22:41:34.926 INFO:tasks.workunit.client.1.smithi195.stdout:1/181: fsync da/d18/d28/d31/d3b/f3a 0 2024-08-18T22:41:34.926 INFO:tasks.workunit.client.1.smithi195.stdout:8/29: dread d1/f2 [0,4194304] 0 2024-08-18T22:41:34.930 INFO:tasks.workunit.client.1.smithi195.stdout:7/47: mkdir dc/d14/d15/d17 0 2024-08-18T22:41:34.930 INFO:tasks.workunit.client.1.smithi195.stdout:2/103: dread d1/d9/f1d [0,4194304] 0 2024-08-18T22:41:34.931 INFO:tasks.workunit.client.1.smithi195.stdout:6/12: truncate f0 943175 0 2024-08-18T22:41:34.931 INFO:tasks.workunit.client.1.smithi195.stdout:1/182: truncate da/d18/f2a 31232 0 2024-08-18T22:41:34.933 INFO:tasks.workunit.client.1.smithi195.stdout:1/183: rename da/d18/d28/d31 to da/d18/d28/d31/d3f 22 2024-08-18T22:41:34.934 INFO:tasks.workunit.client.1.smithi195.stdout:7/48: fdatasync f5 0 2024-08-18T22:41:34.935 INFO:tasks.workunit.client.1.smithi195.stdout:8/30: dread d1/d3/f6 [0,4194304] 0 2024-08-18T22:41:34.935 INFO:tasks.workunit.client.1.smithi195.stdout:1/184: chown da/f10 286940863 1 2024-08-18T22:41:34.935 INFO:tasks.workunit.client.0.smithi121.stdout:8/423: truncate d6/d1e/f47 2748 0 2024-08-18T22:41:34.936 INFO:tasks.workunit.client.1.smithi195.stdout:2/104: unlink l0 0 2024-08-18T22:41:34.938 INFO:tasks.workunit.client.0.smithi121.stdout:3/450: dwrite d1e/d1f/d3e/f79 [0,4194304] 0 2024-08-18T22:41:34.938 INFO:tasks.workunit.client.1.smithi195.stdout:6/13: creat f3 x:0 0 0 2024-08-18T22:41:34.938 INFO:tasks.workunit.client.1.smithi195.stdout:6/14: rmdir - no directory 2024-08-18T22:41:34.939 INFO:tasks.workunit.client.1.smithi195.stdout:8/31: mkdir d1/d3/db 0 2024-08-18T22:41:34.941 INFO:tasks.workunit.client.0.smithi121.stdout:8/424: write d6/d17/f40 [5048223,29898] 0 2024-08-18T22:41:34.943 INFO:tasks.workunit.client.1.smithi195.stdout:9/32: getdents . 0 2024-08-18T22:41:34.943 INFO:tasks.workunit.client.1.smithi195.stdout:9/33: fsync f3 0 2024-08-18T22:41:34.943 INFO:tasks.workunit.client.0.smithi121.stdout:9/475: rmdir d0/d5/dd/d1a/d96 0 2024-08-18T22:41:34.943 INFO:tasks.workunit.client.0.smithi121.stdout:7/441: rmdir de/d1a/d34/d38/d73 39 2024-08-18T22:41:34.943 INFO:tasks.workunit.client.1.smithi195.stdout:6/15: mknod c4 0 2024-08-18T22:41:34.944 INFO:tasks.workunit.client.1.smithi195.stdout:3/50: truncate d7/da/fb 680763 0 2024-08-18T22:41:34.946 INFO:tasks.workunit.client.0.smithi121.stdout:3/451: mknod d1e/d1f/d25/ca1 0 2024-08-18T22:41:34.947 INFO:tasks.workunit.client.0.smithi121.stdout:4/332: dread d2/dc/fd [0,4194304] 0 2024-08-18T22:41:34.949 INFO:tasks.workunit.client.1.smithi195.stdout:9/34: symlink le 0 2024-08-18T22:41:34.949 INFO:tasks.workunit.client.1.smithi195.stdout:7/49: write f2 [3622883,91663] 0 2024-08-18T22:41:34.949 INFO:tasks.workunit.client.1.smithi195.stdout:2/105: link d1/f5 d1/d9/f20 0 2024-08-18T22:41:34.950 INFO:tasks.workunit.client.1.smithi195.stdout:7/50: fdatasync dc/f10 0 2024-08-18T22:41:34.950 INFO:tasks.workunit.client.1.smithi195.stdout:2/106: chown d1/f1b 3578 1 2024-08-18T22:41:34.951 INFO:tasks.workunit.client.0.smithi121.stdout:5/288: dwrite d3/d5/d13/d19/d24/d32/f3b [0,4194304] 0 2024-08-18T22:41:34.952 INFO:tasks.workunit.client.1.smithi195.stdout:8/32: mkdir d1/d3/db/dc 0 2024-08-18T22:41:34.953 INFO:tasks.workunit.client.0.smithi121.stdout:9/476: getdents d0/d5/dd/d3f 0 2024-08-18T22:41:34.953 INFO:tasks.workunit.client.1.smithi195.stdout:9/35: read - f3 zero size 2024-08-18T22:41:34.954 INFO:tasks.workunit.client.1.smithi195.stdout:9/36: fdatasync f3 0 2024-08-18T22:41:34.954 INFO:tasks.workunit.client.1.smithi195.stdout:9/37: rmdir - no directory 2024-08-18T22:41:34.954 INFO:tasks.workunit.client.0.smithi121.stdout:3/452: mknod d1e/d1f/d25/d6b/d81/ca2 0 2024-08-18T22:41:34.959 INFO:tasks.workunit.client.0.smithi121.stdout:7/442: dwrite de/d2d/d50/f71 [0,4194304] 0 2024-08-18T22:41:34.960 INFO:tasks.workunit.client.0.smithi121.stdout:3/453: fsync d1e/d1f/d3e/f64 0 2024-08-18T22:41:34.962 INFO:tasks.workunit.client.0.smithi121.stdout:7/443: chown de/d1a/f61 127230 1 2024-08-18T22:41:34.962 INFO:tasks.workunit.client.0.smithi121.stdout:8/425: dwrite d6/d17/d18/f68 [0,4194304] 0 2024-08-18T22:41:34.963 INFO:tasks.workunit.client.0.smithi121.stdout:5/289: write d3/d5/d13/d19/d24/d32/f3b [3480232,11789] 0 2024-08-18T22:41:34.964 INFO:tasks.workunit.client.0.smithi121.stdout:7/444: chown de/d13/d18 6969 1 2024-08-18T22:41:34.966 INFO:tasks.workunit.client.0.smithi121.stdout:9/477: creat d0/d5/dd/f9c x:0 0 0 2024-08-18T22:41:34.967 INFO:tasks.workunit.client.0.smithi121.stdout:4/333: dread d2/fb [4194304,4194304] 0 2024-08-18T22:41:34.968 INFO:tasks.workunit.client.0.smithi121.stdout:9/478: stat d0/d38/d47 0 2024-08-18T22:41:34.968 INFO:tasks.workunit.client.0.smithi121.stdout:8/426: symlink d6/d17/d60/d5b/l8d 0 2024-08-18T22:41:34.969 INFO:tasks.workunit.client.0.smithi121.stdout:3/454: mknod d1e/d1f/d25/d6b/ca3 0 2024-08-18T22:41:34.971 INFO:tasks.workunit.client.0.smithi121.stdout:4/334: write d2/dc/d16/d22/d29/f20 [3475344,59844] 0 2024-08-18T22:41:34.972 INFO:tasks.workunit.client.0.smithi121.stdout:7/445: truncate de/d13/d18/d23/d24/d29/f4d 1176170 0 2024-08-18T22:41:34.973 INFO:tasks.workunit.client.0.smithi121.stdout:9/479: mknod d0/d38/d47/d4c/d45/c9d 0 2024-08-18T22:41:34.975 INFO:tasks.workunit.client.0.smithi121.stdout:3/455: mknod d1e/d1f/d25/d74/d97/ca4 0 2024-08-18T22:41:34.975 INFO:tasks.workunit.client.0.smithi121.stdout:7/446: chown de/d13/d18/d23/d24/d29/d43/d8b 0 1 2024-08-18T22:41:34.979 INFO:tasks.workunit.client.0.smithi121.stdout:7/447: read f8 [4385158,104253] 0 2024-08-18T22:41:34.979 INFO:tasks.workunit.client.0.smithi121.stdout:4/335: mknod d2/dc/d16/d22/d2c/c6f 0 2024-08-18T22:41:34.981 INFO:tasks.workunit.client.0.smithi121.stdout:8/427: dwrite d6/d17/d18/f76 [0,4194304] 0 2024-08-18T22:41:34.982 INFO:tasks.workunit.client.0.smithi121.stdout:8/428: chown d6/f8 3937 1 2024-08-18T22:41:34.984 INFO:tasks.workunit.client.0.smithi121.stdout:3/456: mknod d1e/d1f/d25/d74/d85/ca5 0 2024-08-18T22:41:34.985 INFO:tasks.workunit.client.0.smithi121.stdout:4/336: creat d2/dc/d16/f70 x:0 0 0 2024-08-18T22:41:34.985 INFO:tasks.workunit.client.0.smithi121.stdout:3/457: write f16 [522109,35324] 0 2024-08-18T22:41:34.986 INFO:tasks.workunit.client.0.smithi121.stdout:9/480: rename d0/d38/d47/d4c to d0/d38/d9e 0 2024-08-18T22:41:34.988 INFO:tasks.workunit.client.0.smithi121.stdout:8/429: read d6/d20/f29 [474390,125930] 0 2024-08-18T22:41:34.990 INFO:tasks.workunit.client.0.smithi121.stdout:4/337: symlink d2/dc/d16/d22/d29/l71 0 2024-08-18T22:41:34.990 INFO:tasks.workunit.client.0.smithi121.stdout:7/448: dwrite de/d1a/d2f/d36/f54 [0,4194304] 0 2024-08-18T22:41:34.993 INFO:tasks.workunit.client.0.smithi121.stdout:7/449: chown de/d13/d18/d23/d24 4710 1 2024-08-18T22:41:34.993 INFO:tasks.workunit.client.0.smithi121.stdout:9/481: truncate d0/d38/d52/d5f/f8e 1768986 0 2024-08-18T22:41:34.995 INFO:tasks.workunit.client.0.smithi121.stdout:4/338: fsync d2/dc/f13 0 2024-08-18T22:41:34.995 INFO:tasks.workunit.client.0.smithi121.stdout:5/290: dread d3/fd [0,4194304] 0 2024-08-18T22:41:34.996 INFO:tasks.workunit.client.0.smithi121.stdout:7/450: write de/d13/d18/f60 [344119,15603] 0 2024-08-18T22:41:34.997 INFO:tasks.workunit.client.0.smithi121.stdout:7/451: readlink de/d1a/d34/l40 0 2024-08-18T22:41:34.998 INFO:tasks.workunit.client.0.smithi121.stdout:9/482: symlink d0/d38/d9e/df/d3d/d89/l9f 0 2024-08-18T22:41:34.999 INFO:tasks.workunit.client.0.smithi121.stdout:4/339: creat d2/f72 x:0 0 0 2024-08-18T22:41:35.002 INFO:tasks.workunit.client.0.smithi121.stdout:5/291: truncate d3/d5/d13/d19/d24/d32/f44 784355 0 2024-08-18T22:41:35.002 INFO:tasks.workunit.client.0.smithi121.stdout:9/483: read d0/d38/d44/d7f/f91 [4075183,89036] 0 2024-08-18T22:41:35.003 INFO:tasks.workunit.client.0.smithi121.stdout:8/430: dwrite d6/d17/d60/d5b/d6e/f75 [4194304,4194304] 0 2024-08-18T22:41:35.003 INFO:tasks.workunit.client.0.smithi121.stdout:4/340: write d2/dc/d1c/f3c [1080202,115038] 0 2024-08-18T22:41:35.004 INFO:tasks.workunit.client.0.smithi121.stdout:8/431: readlink d6/dd/d25/d56/l80 0 2024-08-18T22:41:35.004 INFO:tasks.workunit.client.0.smithi121.stdout:4/341: dread - d2/dc/f32 zero size 2024-08-18T22:41:35.005 INFO:tasks.workunit.client.0.smithi121.stdout:8/432: stat d6/dd/c28 0 2024-08-18T22:41:35.008 INFO:tasks.workunit.client.0.smithi121.stdout:9/484: rename d0/d38/d9e/df/d61/f87 to d0/d38/d9e/df/d61/d90/fa0 0 2024-08-18T22:41:35.009 INFO:tasks.workunit.client.0.smithi121.stdout:9/485: stat d0/c4b 0 2024-08-18T22:41:35.012 INFO:tasks.workunit.client.0.smithi121.stdout:9/486: chown d0/d5/dd/l11 5810388 1 2024-08-18T22:41:35.013 INFO:tasks.workunit.client.0.smithi121.stdout:4/342: getdents d2/dc/d1c/d62 0 2024-08-18T22:41:35.013 INFO:tasks.workunit.client.0.smithi121.stdout:5/292: dwrite d3/d5/f1d [0,4194304] 0 2024-08-18T22:41:35.015 INFO:tasks.workunit.client.0.smithi121.stdout:8/433: dwrite d6/d17/d60/d5b/d6e/f75 [4194304,4194304] 0 2024-08-18T22:41:35.016 INFO:tasks.workunit.client.0.smithi121.stdout:9/487: mknod d0/d38/d9e/d45/ca1 0 2024-08-18T22:41:35.017 INFO:tasks.workunit.client.0.smithi121.stdout:4/343: symlink d2/dc/d16/d22/d2c/d44/d66/l73 0 2024-08-18T22:41:35.021 INFO:tasks.workunit.client.0.smithi121.stdout:5/293: link d3/d5/d3c/d3f/l55 d3/l59 0 2024-08-18T22:41:35.023 INFO:tasks.workunit.client.0.smithi121.stdout:8/434: link d6/d17/f1d d6/f8e 0 2024-08-18T22:41:35.026 INFO:tasks.workunit.client.0.smithi121.stdout:5/294: truncate d3/d5/d13/d22/f29 347892 0 2024-08-18T22:41:35.027 INFO:tasks.workunit.client.0.smithi121.stdout:5/295: mknod d3/d5/d27/d35/c5a 0 2024-08-18T22:41:35.029 INFO:tasks.workunit.client.0.smithi121.stdout:5/296: creat d3/d5/d13/d22/f5b x:0 0 0 2024-08-18T22:41:35.029 INFO:tasks.workunit.client.0.smithi121.stdout:5/297: dread - d3/d5/d13/d19/f4a zero size 2024-08-18T22:41:35.034 INFO:tasks.workunit.client.0.smithi121.stdout:5/298: dwrite d3/d5/d13/f3d [0,4194304] 0 2024-08-18T22:41:35.037 INFO:tasks.workunit.client.0.smithi121.stdout:5/299: mkdir d3/d5c 0 2024-08-18T22:41:35.041 INFO:tasks.workunit.client.0.smithi121.stdout:5/300: link d3/f1a d3/d5/d27/d35/f5d 0 2024-08-18T22:41:35.042 INFO:tasks.workunit.client.0.smithi121.stdout:5/301: creat d3/d5/d13/d22/f5e x:0 0 0 2024-08-18T22:41:35.050 INFO:tasks.workunit.client.0.smithi121.stdout:5/302: dwrite d3/d5/d27/f54 [0,4194304] 0 2024-08-18T22:41:35.051 INFO:tasks.workunit.client.0.smithi121.stdout:5/303: dread - d3/d5/d13/d19/d24/d4d/f4f zero size 2024-08-18T22:41:35.059 INFO:tasks.workunit.client.0.smithi121.stdout:5/304: dwrite d3/d5/d13/d23/f34 [0,4194304] 0 2024-08-18T22:41:35.061 INFO:tasks.workunit.client.0.smithi121.stdout:5/305: fsync d3/d5/d13/d19/d24/f47 0 2024-08-18T22:41:35.067 INFO:tasks.workunit.client.0.smithi121.stdout:3/458: write d1e/d1f/d25/d2e/d36/f37 [3762559,30511] 0 2024-08-18T22:41:35.070 INFO:tasks.workunit.client.0.smithi121.stdout:7/452: write de/d2d/f42 [1156585,90360] 0 2024-08-18T22:41:35.070 INFO:tasks.workunit.client.0.smithi121.stdout:3/459: read - d1e/d1f/d25/d2e/d36/f86 zero size 2024-08-18T22:41:35.072 INFO:tasks.workunit.client.0.smithi121.stdout:5/306: dwrite d3/d5/d13/d22/f4b [0,4194304] 0 2024-08-18T22:41:35.075 INFO:tasks.workunit.client.1.smithi195.stdout:6/16: rename f3 to f5 0 2024-08-18T22:41:35.075 INFO:tasks.workunit.client.0.smithi121.stdout:3/460: mkdir d1e/d1f/da6 0 2024-08-18T22:41:35.075 INFO:tasks.workunit.client.0.smithi121.stdout:9/488: write d0/d38/d9e/f1f [13238,45613] 0 2024-08-18T22:41:35.075 INFO:tasks.workunit.client.1.smithi195.stdout:3/51: creat d7/da/df/f12 x:0 0 0 2024-08-18T22:41:35.075 INFO:tasks.workunit.client.1.smithi195.stdout:1/185: getdents da/d18 0 2024-08-18T22:41:35.076 INFO:tasks.workunit.client.1.smithi195.stdout:8/33: creat d1/d3/db/fd x:0 0 0 2024-08-18T22:41:35.076 INFO:tasks.workunit.client.1.smithi195.stdout:8/34: chown d1 50648956 1 2024-08-18T22:41:35.077 INFO:tasks.workunit.client.0.smithi121.stdout:3/461: write ff [2523836,43155] 0 2024-08-18T22:41:35.077 INFO:tasks.workunit.client.1.smithi195.stdout:9/38: fdatasync fd 0 2024-08-18T22:41:35.077 INFO:tasks.workunit.client.1.smithi195.stdout:3/52: chown d7/fc 3661 1 2024-08-18T22:41:35.078 INFO:tasks.workunit.client.0.smithi121.stdout:5/307: mknod d3/d5/d27/d35/c5f 0 2024-08-18T22:41:35.079 INFO:tasks.workunit.client.0.smithi121.stdout:3/462: chown d1e/d1f/d2a/l5b 14153292 1 2024-08-18T22:41:35.079 INFO:tasks.workunit.client.1.smithi195.stdout:7/51: mkdir dc/d14/d15/d17/d18 0 2024-08-18T22:41:35.079 INFO:tasks.workunit.client.0.smithi121.stdout:8/435: truncate d6/f7c 2256840 0 2024-08-18T22:41:35.080 INFO:tasks.workunit.client.1.smithi195.stdout:1/186: rmdir da/d18/d28/d31 39 2024-08-18T22:41:35.080 INFO:tasks.workunit.client.1.smithi195.stdout:3/53: mknod d7/c13 0 2024-08-18T22:41:35.080 INFO:tasks.workunit.client.1.smithi195.stdout:7/52: fdatasync dc/f10 0 2024-08-18T22:41:35.081 INFO:tasks.workunit.client.1.smithi195.stdout:7/53: write f3 [162417,52307] 0 2024-08-18T22:41:35.083 INFO:tasks.workunit.client.1.smithi195.stdout:8/35: rename d1/d3/db/dc to d1/de 0 2024-08-18T22:41:35.084 INFO:tasks.workunit.client.0.smithi121.stdout:9/489: readlink d0/d38/d47/l22 0 2024-08-18T22:41:35.084 INFO:tasks.workunit.client.1.smithi195.stdout:7/54: write dc/f10 [591944,77248] 0 2024-08-18T22:41:35.085 INFO:tasks.workunit.client.0.smithi121.stdout:3/463: symlink d1e/d1f/d25/d67/d8e/la7 0 2024-08-18T22:41:35.086 INFO:tasks.workunit.client.0.smithi121.stdout:7/453: link de/d1a/d34/d38/d5f/c82 de/d1a/d4f/c8d 0 2024-08-18T22:41:35.088 INFO:tasks.workunit.client.0.smithi121.stdout:7/454: stat de/f7a 0 2024-08-18T22:41:35.089 INFO:tasks.workunit.client.0.smithi121.stdout:8/436: rename d6/d1e/c67 to d6/d20/c8f 0 2024-08-18T22:41:35.090 INFO:tasks.workunit.client.0.smithi121.stdout:7/455: chown de/d1a/d34/d38/c4a 0 1 2024-08-18T22:41:35.090 INFO:tasks.workunit.client.1.smithi195.stdout:1/187: creat da/d3d/f40 x:0 0 0 2024-08-18T22:41:35.090 INFO:tasks.workunit.client.1.smithi195.stdout:8/36: dread d1/d3/f6 [0,4194304] 0 2024-08-18T22:41:35.091 INFO:tasks.workunit.client.0.smithi121.stdout:5/308: dwrite d3/d5/d13/d19/d24/d32/d38/f3e [0,4194304] 0 2024-08-18T22:41:35.091 INFO:tasks.workunit.client.0.smithi121.stdout:7/456: fdatasync de/f28 0 2024-08-18T22:41:35.091 INFO:tasks.workunit.client.1.smithi195.stdout:6/17: getdents . 0 2024-08-18T22:41:35.091 INFO:tasks.workunit.client.1.smithi195.stdout:2/107: dread d1/d9/fc [0,4194304] 0 2024-08-18T22:41:35.092 INFO:tasks.workunit.client.1.smithi195.stdout:9/39: dwrite f0 [4194304,4194304] 0 2024-08-18T22:41:35.094 INFO:tasks.workunit.client.1.smithi195.stdout:7/55: dread f5 [0,4194304] 0 2024-08-18T22:41:35.094 INFO:tasks.workunit.client.1.smithi195.stdout:1/188: write da/f12 [417906,84048] 0 2024-08-18T22:41:35.095 INFO:tasks.workunit.client.0.smithi121.stdout:9/490: readlink d0/d38/d9e/df/l36 0 2024-08-18T22:41:35.095 INFO:tasks.workunit.client.1.smithi195.stdout:6/18: creat f6 x:0 0 0 2024-08-18T22:41:35.096 INFO:tasks.workunit.client.1.smithi195.stdout:8/37: mkdir d1/de/df 0 2024-08-18T22:41:35.098 INFO:tasks.workunit.client.1.smithi195.stdout:6/19: creat f7 x:0 0 0 2024-08-18T22:41:35.098 INFO:tasks.workunit.client.1.smithi195.stdout:1/189: fdatasync da/d18/d28/f2e 0 2024-08-18T22:41:35.099 INFO:tasks.workunit.client.0.smithi121.stdout:5/309: unlink d3/d5/lb 0 2024-08-18T22:41:35.100 INFO:tasks.workunit.client.1.smithi195.stdout:3/54: dwrite f1 [0,4194304] 0 2024-08-18T22:41:35.102 INFO:tasks.workunit.client.1.smithi195.stdout:8/38: unlink d1/l8 0 2024-08-18T22:41:35.103 INFO:tasks.workunit.client.0.smithi121.stdout:7/457: dwrite de/d13/d18/f7e [0,4194304] 0 2024-08-18T22:41:35.103 INFO:tasks.workunit.client.0.smithi121.stdout:8/437: rename d6/d1e/d2d/d78/d45/f59 to d6/dd/f90 0 2024-08-18T22:41:35.104 INFO:tasks.workunit.client.1.smithi195.stdout:7/56: creat dc/d14/d15/d17/f19 x:0 0 0 2024-08-18T22:41:35.105 INFO:tasks.workunit.client.0.smithi121.stdout:7/458: write de/d13/d18/d23/f3d [903132,79032] 0 2024-08-18T22:41:35.106 INFO:tasks.workunit.client.0.smithi121.stdout:3/464: creat d1e/d1f/d25/d67/d92/da0/fa8 x:0 0 0 2024-08-18T22:41:35.107 INFO:tasks.workunit.client.1.smithi195.stdout:9/40: link f0 ff 0 2024-08-18T22:41:35.108 INFO:tasks.workunit.client.1.smithi195.stdout:6/20: fsync f5 0 2024-08-18T22:41:35.110 INFO:tasks.workunit.client.1.smithi195.stdout:2/108: link d1/f1f d1/f21 0 2024-08-18T22:41:35.110 INFO:tasks.workunit.client.0.smithi121.stdout:5/310: symlink d3/d5/d3c/d3f/l60 0 2024-08-18T22:41:35.111 INFO:tasks.workunit.client.1.smithi195.stdout:1/190: truncate da/d18/f1a 1033763 0 2024-08-18T22:41:35.113 INFO:tasks.workunit.client.1.smithi195.stdout:7/57: creat dc/d14/d15/d17/f1a x:0 0 0 2024-08-18T22:41:35.114 INFO:tasks.workunit.client.0.smithi121.stdout:8/438: dwrite d6/d17/d18/f2c [0,4194304] 0 2024-08-18T22:41:35.116 INFO:tasks.workunit.client.0.smithi121.stdout:3/465: fsync d1e/d1f/d3e/f78 0 2024-08-18T22:41:35.117 INFO:tasks.workunit.client.0.smithi121.stdout:7/459: creat de/d13/d18/d23/d24/d29/f8e x:0 0 0 2024-08-18T22:41:35.119 INFO:tasks.workunit.client.0.smithi121.stdout:7/460: truncate de/d13/d18/d23/d24/f56 444885 0 2024-08-18T22:41:35.120 INFO:tasks.workunit.client.0.smithi121.stdout:8/439: mknod d6/d17/d18/c91 0 2024-08-18T22:41:35.121 INFO:tasks.workunit.client.1.smithi195.stdout:8/39: dwrite d1/d3/f6 [0,4194304] 0 2024-08-18T22:41:35.122 INFO:tasks.workunit.client.1.smithi195.stdout:2/109: rmdir d1/d9 39 2024-08-18T22:41:35.122 INFO:tasks.workunit.client.0.smithi121.stdout:7/461: rmdir de/d13/d18 39 2024-08-18T22:41:35.123 INFO:tasks.workunit.client.1.smithi195.stdout:7/58: dread f2 [0,4194304] 0 2024-08-18T22:41:35.127 INFO:tasks.workunit.client.0.smithi121.stdout:8/440: rename d6/dd/f90 to d6/d17/d60/d5b/f92 0 2024-08-18T22:41:35.128 INFO:tasks.workunit.client.1.smithi195.stdout:1/191: creat da/d3d/f41 x:0 0 0 2024-08-18T22:41:35.128 INFO:tasks.workunit.client.1.smithi195.stdout:6/21: write f5 [510855,14639] 0 2024-08-18T22:41:35.129 INFO:tasks.workunit.client.0.smithi121.stdout:3/466: dwrite d1e/f46 [0,4194304] 0 2024-08-18T22:41:35.130 INFO:tasks.workunit.client.1.smithi195.stdout:8/40: creat d1/d3/db/f10 x:0 0 0 2024-08-18T22:41:35.134 INFO:tasks.workunit.client.0.smithi121.stdout:7/462: rename de/d13/c22 to de/d1a/d63/c8f 0 2024-08-18T22:41:35.134 INFO:tasks.workunit.client.1.smithi195.stdout:7/59: readlink dc/le 0 2024-08-18T22:41:35.134 INFO:tasks.workunit.client.1.smithi195.stdout:2/110: dread d1/f10 [0,4194304] 0 2024-08-18T22:41:35.135 INFO:tasks.workunit.client.1.smithi195.stdout:8/41: mkdir d1/d11 0 2024-08-18T22:41:35.135 INFO:tasks.workunit.client.0.smithi121.stdout:3/467: rmdir d1e/d1f/d25/d2e/d36/d5f 39 2024-08-18T22:41:35.136 INFO:tasks.workunit.client.0.smithi121.stdout:1/458: sync 2024-08-18T22:41:35.136 INFO:tasks.workunit.client.1.smithi195.stdout:9/41: rename ca to c10 0 2024-08-18T22:41:35.138 INFO:tasks.workunit.client.1.smithi195.stdout:6/22: link l2 l8 0 2024-08-18T22:41:35.139 INFO:tasks.workunit.client.1.smithi195.stdout:8/42: symlink d1/de/df/l12 0 2024-08-18T22:41:35.141 INFO:tasks.workunit.client.1.smithi195.stdout:7/60: dwrite dc/f10 [0,4194304] 0 2024-08-18T22:41:35.141 INFO:tasks.workunit.client.1.smithi195.stdout:7/61: stat dc/d14/d15 0 2024-08-18T22:41:35.143 INFO:tasks.workunit.client.1.smithi195.stdout:9/42: creat f11 x:0 0 0 2024-08-18T22:41:35.144 INFO:tasks.workunit.client.1.smithi195.stdout:6/23: rename l2 to l9 0 2024-08-18T22:41:35.145 INFO:tasks.workunit.client.0.smithi121.stdout:3/468: link d1e/d1f/d25/f5c d1e/d1f/d25/d58/d75/fa9 0 2024-08-18T22:41:35.145 INFO:tasks.workunit.client.0.smithi121.stdout:8/441: getdents d6/d17/d60 0 2024-08-18T22:41:35.146 INFO:tasks.workunit.client.1.smithi195.stdout:7/62: symlink dc/l1b 0 2024-08-18T22:41:35.147 INFO:tasks.workunit.client.1.smithi195.stdout:9/43: truncate fb 179374 0 2024-08-18T22:41:35.147 INFO:tasks.workunit.client.0.smithi121.stdout:1/459: getdents d5 0 2024-08-18T22:41:35.148 INFO:tasks.workunit.client.1.smithi195.stdout:6/24: mkdir da 0 2024-08-18T22:41:35.148 INFO:tasks.workunit.client.0.smithi121.stdout:7/463: dwrite de/d13/d18/f7e [4194304,4194304] 0 2024-08-18T22:41:35.149 INFO:tasks.workunit.client.1.smithi195.stdout:6/25: dread - f7 zero size 2024-08-18T22:41:35.150 INFO:tasks.workunit.client.0.smithi121.stdout:7/464: dread - de/d1a/f61 zero size 2024-08-18T22:41:35.152 INFO:tasks.workunit.client.1.smithi195.stdout:7/63: link f1 dc/d14/d15/d17/d18/f1c 0 2024-08-18T22:41:35.153 INFO:tasks.workunit.client.0.smithi121.stdout:3/469: write d1e/d1f/d25/f5c [1321135,3837] 0 2024-08-18T22:41:35.154 INFO:tasks.workunit.client.1.smithi195.stdout:9/44: mknod c12 0 2024-08-18T22:41:35.155 INFO:tasks.workunit.client.0.smithi121.stdout:7/465: symlink de/d13/d18/l90 0 2024-08-18T22:41:35.155 INFO:tasks.workunit.client.1.smithi195.stdout:6/26: mkdir da/db 0 2024-08-18T22:41:35.156 INFO:tasks.workunit.client.0.smithi121.stdout:1/460: mkdir d5/d10/d14/d92/d9f 0 2024-08-18T22:41:35.156 INFO:tasks.workunit.client.1.smithi195.stdout:9/45: stat c7 0 2024-08-18T22:41:35.156 INFO:tasks.workunit.client.1.smithi195.stdout:6/27: chown da 128218186 1 2024-08-18T22:41:35.158 INFO:tasks.workunit.client.0.smithi121.stdout:3/470: mknod d1e/d1f/d25/d67/caa 0 2024-08-18T22:41:35.158 INFO:tasks.workunit.client.0.smithi121.stdout:7/466: creat de/d1a/d4f/f91 x:0 0 0 2024-08-18T22:41:35.159 INFO:tasks.workunit.client.0.smithi121.stdout:3/471: fsync d1e/d1f/d3e/f78 0 2024-08-18T22:41:35.159 INFO:tasks.workunit.client.0.smithi121.stdout:1/461: symlink d5/d10/d14/d2a/d3a/la0 0 2024-08-18T22:41:35.161 INFO:tasks.workunit.client.1.smithi195.stdout:9/46: creat f13 x:0 0 0 2024-08-18T22:41:35.161 INFO:tasks.workunit.client.0.smithi121.stdout:3/472: write f1a [969125,5636] 0 2024-08-18T22:41:35.161 INFO:tasks.workunit.client.0.smithi121.stdout:1/462: rename d5 to d5/d10/d14/d92/d9f/da1 22 2024-08-18T22:41:35.165 INFO:tasks.workunit.client.1.smithi195.stdout:9/47: rename ff to f14 0 2024-08-18T22:41:35.168 INFO:tasks.workunit.client.0.smithi121.stdout:7/467: dread de/d1a/d63/f6b [4194304,4194304] 0 2024-08-18T22:41:35.168 INFO:tasks.workunit.client.0.smithi121.stdout:1/463: getdents d5/d10/d14/d2a/d3a/d87/d6c/d6f/d82/d15/d28/d3d 0 2024-08-18T22:41:35.168 INFO:tasks.workunit.client.1.smithi195.stdout:9/48: creat f15 x:0 0 0 2024-08-18T22:41:35.168 INFO:tasks.workunit.client.1.smithi195.stdout:3/55: dwrite d7/da/fb [0,4194304] 0 2024-08-18T22:41:35.172 INFO:tasks.workunit.client.1.smithi195.stdout:3/56: getdents d7 0 2024-08-18T22:41:35.172 INFO:tasks.workunit.client.1.smithi195.stdout:9/49: dread f14 [4194304,4194304] 0 2024-08-18T22:41:35.174 INFO:tasks.workunit.client.1.smithi195.stdout:3/57: creat d7/da/f14 x:0 0 0 2024-08-18T22:41:35.175 INFO:tasks.workunit.client.1.smithi195.stdout:9/50: creat f16 x:0 0 0 2024-08-18T22:41:35.176 INFO:tasks.workunit.client.1.smithi195.stdout:3/58: symlink d7/l15 0 2024-08-18T22:41:35.176 INFO:tasks.workunit.client.1.smithi195.stdout:9/51: chown f0 6 1 2024-08-18T22:41:35.177 INFO:tasks.workunit.client.0.smithi121.stdout:3/473: dread d1e/d1f/d25/d2e/d36/f3c [0,4194304] 0 2024-08-18T22:41:35.177 INFO:tasks.workunit.client.1.smithi195.stdout:9/52: dread - f9 zero size 2024-08-18T22:41:35.178 INFO:tasks.workunit.client.0.smithi121.stdout:3/474: dread - d1e/d1f/d25/d2e/d36/f86 zero size 2024-08-18T22:41:35.180 INFO:tasks.workunit.client.0.smithi121.stdout:3/475: write d1e/d1f/d3e/f64 [674879,32555] 0 2024-08-18T22:41:35.180 INFO:tasks.workunit.client.1.smithi195.stdout:8/43: fdatasync d1/d3/f6 0 2024-08-18T22:41:35.183 INFO:tasks.workunit.client.0.smithi121.stdout:3/476: rename d1e/d1f/f52 to d1e/d1f/d25/d74/d85/d94/fab 0 2024-08-18T22:41:35.185 INFO:tasks.workunit.client.1.smithi195.stdout:3/59: link d7/l15 d7/da/df/l16 0 2024-08-18T22:41:35.185 INFO:tasks.workunit.client.0.smithi121.stdout:3/477: write d1e/d1f/d25/f5c [2277153,92564] 0 2024-08-18T22:41:35.187 INFO:tasks.workunit.client.0.smithi121.stdout:8/442: truncate d6/d20/d69/f6a 2865356 0 2024-08-18T22:41:35.189 INFO:tasks.workunit.client.1.smithi195.stdout:6/28: write f0 [1105647,73035] 0 2024-08-18T22:41:35.190 INFO:tasks.workunit.client.0.smithi121.stdout:8/443: rmdir d6/d20/d69/d77 39 2024-08-18T22:41:35.190 INFO:tasks.workunit.client.1.smithi195.stdout:8/44: mknod d1/de/df/c13 0 2024-08-18T22:41:35.191 INFO:tasks.workunit.client.0.smithi121.stdout:8/444: chown d6/d20/c22 62536207 1 2024-08-18T22:41:35.192 INFO:tasks.workunit.client.1.smithi195.stdout:3/60: creat d7/f17 x:0 0 0 2024-08-18T22:41:35.195 INFO:tasks.workunit.client.1.smithi195.stdout:1/192: dwrite da/d18/d28/f2d [0,4194304] 0 2024-08-18T22:41:35.195 INFO:tasks.workunit.client.1.smithi195.stdout:8/45: symlink d1/d3/l14 0 2024-08-18T22:41:35.198 INFO:tasks.workunit.client.0.smithi121.stdout:8/445: truncate d6/d17/d60/f66 1958848 0 2024-08-18T22:41:35.200 INFO:tasks.workunit.client.1.smithi195.stdout:9/53: getdents . 0 2024-08-18T22:41:35.203 INFO:tasks.workunit.client.1.smithi195.stdout:8/46: getdents d1/d11 0 2024-08-18T22:41:35.204 INFO:tasks.workunit.client.0.smithi121.stdout:8/446: stat d6/d20/d69/f6a 0 2024-08-18T22:41:35.206 INFO:tasks.workunit.client.1.smithi195.stdout:9/54: write f14 [1591659,127939] 0 2024-08-18T22:41:35.206 INFO:tasks.workunit.client.0.smithi121.stdout:8/447: unlink d6/d17/f7a 0 2024-08-18T22:41:35.207 INFO:tasks.workunit.client.1.smithi195.stdout:1/193: link da/d18/d28/f2e da/d18/f42 0 2024-08-18T22:41:35.207 INFO:tasks.workunit.client.1.smithi195.stdout:6/29: dwrite f0 [0,4194304] 0 2024-08-18T22:41:35.207 INFO:tasks.workunit.client.1.smithi195.stdout:3/61: dwrite d7/fc [0,4194304] 0 2024-08-18T22:41:35.209 INFO:tasks.workunit.client.1.smithi195.stdout:8/47: mknod d1/de/df/c15 0 2024-08-18T22:41:35.210 INFO:tasks.workunit.client.1.smithi195.stdout:9/55: write f14 [7086096,42719] 0 2024-08-18T22:41:35.212 INFO:tasks.workunit.client.1.smithi195.stdout:3/62: creat d7/f18 x:0 0 0 2024-08-18T22:41:35.212 INFO:tasks.workunit.client.0.smithi121.stdout:8/448: dwrite d6/d17/d60/d5b/f6f [0,4194304] 0 2024-08-18T22:41:35.214 INFO:tasks.workunit.client.1.smithi195.stdout:8/48: mkdir d1/d3/d16 0 2024-08-18T22:41:35.215 INFO:tasks.workunit.client.0.smithi121.stdout:8/449: symlink d6/d17/d60/d5b/d6e/l93 0 2024-08-18T22:41:35.219 INFO:tasks.workunit.client.0.smithi121.stdout:8/450: creat d6/d17/d37/f94 x:0 0 0 2024-08-18T22:41:35.220 INFO:tasks.workunit.client.1.smithi195.stdout:6/30: mknod da/db/cc 0 2024-08-18T22:41:35.220 INFO:tasks.workunit.client.1.smithi195.stdout:8/49: write d1/d3/db/f10 [667653,29815] 0 2024-08-18T22:41:35.221 INFO:tasks.workunit.client.0.smithi121.stdout:8/451: unlink d6/d1e/d2d/d78/d45/d86/l8b 0 2024-08-18T22:41:35.222 INFO:tasks.workunit.client.1.smithi195.stdout:3/63: link d7/f17 d7/f19 0 2024-08-18T22:41:35.224 INFO:tasks.workunit.client.0.smithi121.stdout:8/452: rename d6/dd/f1b to d6/d17/d60/d5b/f95 0 2024-08-18T22:41:35.225 INFO:tasks.workunit.client.1.smithi195.stdout:6/31: rmdir da/db 39 2024-08-18T22:41:35.225 INFO:tasks.workunit.client.1.smithi195.stdout:9/56: dwrite f3 [0,4194304] 0 2024-08-18T22:41:35.225 INFO:tasks.workunit.client.0.smithi121.stdout:8/453: chown d6/dd/d3b/f43 3 1 2024-08-18T22:41:35.226 INFO:tasks.workunit.client.0.smithi121.stdout:8/454: symlink d6/d20/d69/l96 0 2024-08-18T22:41:35.227 INFO:tasks.workunit.client.1.smithi195.stdout:3/64: write d7/f19 [229035,34947] 0 2024-08-18T22:41:35.227 INFO:tasks.workunit.client.1.smithi195.stdout:9/57: read fb [46263,37622] 0 2024-08-18T22:41:35.229 INFO:tasks.workunit.client.1.smithi195.stdout:8/50: creat d1/d3/db/f17 x:0 0 0 2024-08-18T22:41:35.229 INFO:tasks.workunit.client.1.smithi195.stdout:8/51: readlink d1/d3/l14 0 2024-08-18T22:41:35.233 INFO:tasks.workunit.client.1.smithi195.stdout:9/58: readlink l5 0 2024-08-18T22:41:35.233 INFO:tasks.workunit.client.1.smithi195.stdout:9/59: rmdir - no directory 2024-08-18T22:41:35.233 INFO:tasks.workunit.client.1.smithi195.stdout:3/65: creat d7/da/df/f1a x:0 0 0 2024-08-18T22:41:35.234 INFO:tasks.workunit.client.0.smithi121.stdout:8/455: dwrite d6/d20/f29 [0,4194304] 0 2024-08-18T22:41:35.234 INFO:tasks.workunit.client.1.smithi195.stdout:1/194: mkdir da/d18/d43 0 2024-08-18T22:41:35.235 INFO:tasks.workunit.client.1.smithi195.stdout:8/52: mkdir d1/de/df/d18 0 2024-08-18T22:41:35.237 INFO:tasks.workunit.client.1.smithi195.stdout:9/60: creat f17 x:0 0 0 2024-08-18T22:41:35.238 INFO:tasks.workunit.client.0.smithi121.stdout:8/456: creat d6/d1e/d2d/f97 x:0 0 0 2024-08-18T22:41:35.242 INFO:tasks.workunit.client.1.smithi195.stdout:6/32: creat da/fd x:0 0 0 2024-08-18T22:41:35.245 INFO:tasks.workunit.client.1.smithi195.stdout:8/53: creat d1/de/df/f19 x:0 0 0 2024-08-18T22:41:35.248 INFO:tasks.workunit.client.1.smithi195.stdout:6/33: write f7 [569921,89090] 0 2024-08-18T22:41:35.249 INFO:tasks.workunit.client.1.smithi195.stdout:9/61: write f9 [246093,97026] 0 2024-08-18T22:41:35.251 INFO:tasks.workunit.client.0.smithi121.stdout:8/457: chown d6/d17/d60/f66 43883009 1 2024-08-18T22:41:35.251 INFO:tasks.workunit.client.1.smithi195.stdout:1/195: fdatasync da/d18/d28/f2e 0 2024-08-18T22:41:35.252 INFO:tasks.workunit.client.1.smithi195.stdout:3/66: dwrite d7/da/fb [0,4194304] 0 2024-08-18T22:41:35.253 INFO:tasks.workunit.client.1.smithi195.stdout:9/62: symlink l18 0 2024-08-18T22:41:35.254 INFO:tasks.workunit.client.0.smithi121.stdout:8/458: getdents d6/d1e/d2d/d78 0 2024-08-18T22:41:35.255 INFO:tasks.workunit.client.0.smithi121.stdout:8/459: read d6/dd/f16 [2756453,74657] 0 2024-08-18T22:41:35.256 INFO:tasks.workunit.client.0.smithi121.stdout:8/460: fsync f5 0 2024-08-18T22:41:35.257 INFO:tasks.workunit.client.1.smithi195.stdout:1/196: creat da/d18/d43/f44 x:0 0 0 2024-08-18T22:41:35.258 INFO:tasks.workunit.client.1.smithi195.stdout:9/63: creat f19 x:0 0 0 2024-08-18T22:41:35.259 INFO:tasks.workunit.client.0.smithi121.stdout:8/461: rename d6/d17/d18/f68 to d6/d17/d18/f98 0 2024-08-18T22:41:35.262 INFO:tasks.workunit.client.0.smithi121.stdout:8/462: mkdir d6/d17/d18/d99 0 2024-08-18T22:41:35.264 INFO:tasks.workunit.client.0.smithi121.stdout:8/463: write d6/d1e/d2d/d78/f58 [4098233,104088] 0 2024-08-18T22:41:35.266 INFO:tasks.workunit.client.0.smithi121.stdout:8/464: creat d6/d17/d60/d5b/f9a x:0 0 0 2024-08-18T22:41:35.267 INFO:tasks.workunit.client.0.smithi121.stdout:8/465: write d6/d1e/f4d [1337970,58188] 0 2024-08-18T22:41:35.269 INFO:tasks.workunit.client.1.smithi195.stdout:6/34: dwrite da/fd [0,4194304] 0 2024-08-18T22:41:35.269 INFO:tasks.workunit.client.1.smithi195.stdout:8/54: dwrite d1/de/df/f19 [0,4194304] 0 2024-08-18T22:41:35.270 INFO:tasks.workunit.client.1.smithi195.stdout:1/197: creat da/d18/d28/d31/f45 x:0 0 0 2024-08-18T22:41:35.272 INFO:tasks.workunit.client.1.smithi195.stdout:3/67: dwrite d7/fc [0,4194304] 0 2024-08-18T22:41:35.275 INFO:tasks.workunit.client.0.smithi121.stdout:8/466: dwrite d6/d1e/d2d/d78/f6c [0,4194304] 0 2024-08-18T22:41:35.275 INFO:tasks.workunit.client.1.smithi195.stdout:8/55: write d1/d3/db/f17 [984367,34635] 0 2024-08-18T22:41:35.277 INFO:tasks.workunit.client.1.smithi195.stdout:3/68: mknod d7/c1b 0 2024-08-18T22:41:35.278 INFO:tasks.workunit.client.1.smithi195.stdout:9/64: dwrite f14 [4194304,4194304] 0 2024-08-18T22:41:35.280 INFO:tasks.workunit.client.1.smithi195.stdout:6/35: creat da/db/fe x:0 0 0 2024-08-18T22:41:35.282 INFO:tasks.workunit.client.1.smithi195.stdout:1/198: dread da/fe [0,4194304] 0 2024-08-18T22:41:35.283 INFO:tasks.workunit.client.1.smithi195.stdout:3/69: rmdir d7/da 39 2024-08-18T22:41:35.284 INFO:tasks.workunit.client.1.smithi195.stdout:6/36: mknod da/db/cf 0 2024-08-18T22:41:35.285 INFO:tasks.workunit.client.1.smithi195.stdout:9/65: mknod c1a 0 2024-08-18T22:41:35.288 INFO:tasks.workunit.client.1.smithi195.stdout:1/199: creat da/d18/d28/d31/f46 x:0 0 0 2024-08-18T22:41:35.290 INFO:tasks.workunit.client.1.smithi195.stdout:6/37: mkdir da/db/d10 0 2024-08-18T22:41:35.291 INFO:tasks.workunit.client.1.smithi195.stdout:6/38: fdatasync da/db/fe 0 2024-08-18T22:41:35.293 INFO:tasks.workunit.client.1.smithi195.stdout:6/39: truncate f0 5172994 0 2024-08-18T22:41:35.293 INFO:tasks.workunit.client.1.smithi195.stdout:8/56: link d1/de/df/c15 d1/d3/db/c1a 0 2024-08-18T22:41:35.295 INFO:tasks.workunit.client.1.smithi195.stdout:1/200: creat da/d18/f47 x:0 0 0 2024-08-18T22:41:35.295 INFO:tasks.workunit.client.1.smithi195.stdout:6/40: truncate da/fd 4707316 0 2024-08-18T22:41:35.297 INFO:tasks.workunit.client.1.smithi195.stdout:1/201: write da/d18/d28/f2d [1712195,123680] 0 2024-08-18T22:41:35.305 INFO:tasks.workunit.client.0.smithi121.stdout:2/287: sync 2024-08-18T22:41:35.308 INFO:tasks.workunit.client.0.smithi121.stdout:8/467: creat d6/d20/d69/f9b x:0 0 0 2024-08-18T22:41:35.309 INFO:tasks.workunit.client.1.smithi195.stdout:9/66: rename c7 to c1b 0 2024-08-18T22:41:35.309 INFO:tasks.workunit.client.0.smithi121.stdout:8/468: chown d6/dd/c28 0 1 2024-08-18T22:41:35.311 INFO:tasks.workunit.client.1.smithi195.stdout:9/67: write f9 [524131,12136] 0 2024-08-18T22:41:35.312 INFO:tasks.workunit.client.1.smithi195.stdout:6/41: symlink da/db/d10/l11 0 2024-08-18T22:41:35.315 INFO:tasks.workunit.client.1.smithi195.stdout:8/57: link d1/l7 d1/de/df/l1b 0 2024-08-18T22:41:35.316 INFO:tasks.workunit.client.0.smithi121.stdout:8/469: creat d6/d1e/d2d/d78/d85/f9c x:0 0 0 2024-08-18T22:41:35.317 INFO:tasks.workunit.client.0.smithi121.stdout:2/288: dwrite d2/d8/d19/d4a/f4d [0,4194304] 0 2024-08-18T22:41:35.319 INFO:tasks.workunit.client.1.smithi195.stdout:1/202: link da/d18/d28/d31/f45 da/d3d/f48 0 2024-08-18T22:41:35.324 INFO:tasks.workunit.client.0.smithi121.stdout:8/470: getdents d6/d17/d37 0 2024-08-18T22:41:35.324 INFO:tasks.workunit.client.1.smithi195.stdout:9/68: dwrite f16 [0,4194304] 0 2024-08-18T22:41:35.326 INFO:tasks.workunit.client.1.smithi195.stdout:8/58: rmdir d1/d11 0 2024-08-18T22:41:35.330 INFO:tasks.workunit.client.1.smithi195.stdout:1/203: dwrite da/d3d/f41 [0,4194304] 0 2024-08-18T22:41:35.337 INFO:tasks.workunit.client.1.smithi195.stdout:6/42: truncate f7 366151 0 2024-08-18T22:41:35.338 INFO:tasks.workunit.client.1.smithi195.stdout:1/204: mknod da/d18/d28/c49 0 2024-08-18T22:41:35.338 INFO:tasks.workunit.client.1.smithi195.stdout:8/59: dread d1/d3/db/f10 [0,4194304] 0 2024-08-18T22:41:35.340 INFO:tasks.workunit.client.1.smithi195.stdout:6/43: chown da/db/cf 158610160 1 2024-08-18T22:41:35.340 INFO:tasks.workunit.client.1.smithi195.stdout:9/69: getdents . 0 2024-08-18T22:41:35.340 INFO:tasks.workunit.client.1.smithi195.stdout:9/70: readlink l18 0 2024-08-18T22:41:35.342 INFO:tasks.workunit.client.1.smithi195.stdout:1/205: unlink da/l33 0 2024-08-18T22:41:35.342 INFO:tasks.workunit.client.1.smithi195.stdout:1/206: readlink da/lf 0 2024-08-18T22:41:35.344 INFO:tasks.workunit.client.1.smithi195.stdout:9/71: getdents . 0 2024-08-18T22:41:35.345 INFO:tasks.workunit.client.1.smithi195.stdout:9/72: write f15 [711700,64736] 0 2024-08-18T22:41:35.347 INFO:tasks.workunit.client.1.smithi195.stdout:1/207: symlink da/d18/l4a 0 2024-08-18T22:41:35.347 INFO:tasks.workunit.client.1.smithi195.stdout:1/208: stat da/lc 0 2024-08-18T22:41:35.348 INFO:tasks.workunit.client.1.smithi195.stdout:9/73: mkdir d1c 0 2024-08-18T22:41:35.348 INFO:tasks.workunit.client.1.smithi195.stdout:8/60: getdents d1/d3/db 0 2024-08-18T22:41:35.349 INFO:tasks.workunit.client.1.smithi195.stdout:1/209: chown da/d18/d28/l22 1 1 2024-08-18T22:41:35.350 INFO:tasks.workunit.client.1.smithi195.stdout:8/61: mkdir d1/d3/d1c 0 2024-08-18T22:41:35.352 INFO:tasks.workunit.client.1.smithi195.stdout:9/74: creat d1c/f1d x:0 0 0 2024-08-18T22:41:35.353 INFO:tasks.workunit.client.1.smithi195.stdout:1/210: rmdir da/d18/d28/d31/d3b 39 2024-08-18T22:41:35.355 INFO:tasks.workunit.client.0.smithi121.stdout:8/471: write d6/f7c [2197212,77406] 0 2024-08-18T22:41:35.357 INFO:tasks.workunit.client.1.smithi195.stdout:8/62: mkdir d1/de/df/d1d 0 2024-08-18T22:41:35.357 INFO:tasks.workunit.client.1.smithi195.stdout:6/44: truncate f5 309926 0 2024-08-18T22:41:35.358 INFO:tasks.workunit.client.0.smithi121.stdout:8/472: symlink d6/dd/d25/l9d 0 2024-08-18T22:41:35.358 INFO:tasks.workunit.client.1.smithi195.stdout:9/75: dread f9 [0,4194304] 0 2024-08-18T22:41:35.359 INFO:tasks.workunit.client.0.smithi121.stdout:2/289: link d2/d8/d19/d4a/c5f d2/c63 0 2024-08-18T22:41:35.359 INFO:tasks.workunit.client.1.smithi195.stdout:9/76: chown l18 285417 1 2024-08-18T22:41:35.360 INFO:tasks.workunit.client.1.smithi195.stdout:6/45: unlink da/db/fe 0 2024-08-18T22:41:35.360 INFO:tasks.workunit.client.1.smithi195.stdout:8/63: read d1/d3/db/f17 [897387,119621] 0 2024-08-18T22:41:35.361 INFO:tasks.workunit.client.0.smithi121.stdout:8/473: mknod d6/d17/c9e 0 2024-08-18T22:41:35.362 INFO:tasks.workunit.client.0.smithi121.stdout:0/315: sync 2024-08-18T22:41:35.362 INFO:tasks.workunit.client.0.smithi121.stdout:8/474: mknod d6/d1e/d2d/d78/d45/d86/c9f 0 2024-08-18T22:41:35.363 INFO:tasks.workunit.client.1.smithi195.stdout:9/77: symlink d1c/l1e 0 2024-08-18T22:41:35.363 INFO:tasks.workunit.client.1.smithi195.stdout:9/78: dread - f13 zero size 2024-08-18T22:41:35.363 INFO:tasks.workunit.client.1.smithi195.stdout:9/79: dread - f11 zero size 2024-08-18T22:41:35.364 INFO:tasks.workunit.client.0.smithi121.stdout:2/290: getdents d2/d8/d19 0 2024-08-18T22:41:35.364 INFO:tasks.workunit.client.1.smithi195.stdout:9/80: readlink l5 0 2024-08-18T22:41:35.364 INFO:tasks.workunit.client.1.smithi195.stdout:9/81: dread - f11 zero size 2024-08-18T22:41:35.365 INFO:tasks.workunit.client.1.smithi195.stdout:9/82: chown le 50555056 1 2024-08-18T22:41:35.365 INFO:tasks.workunit.client.0.smithi121.stdout:8/475: mkdir d6/d17/d18/d99/da0 0 2024-08-18T22:41:35.365 INFO:tasks.workunit.client.1.smithi195.stdout:6/46: unlink l9 0 2024-08-18T22:41:35.366 INFO:tasks.workunit.client.0.smithi121.stdout:2/291: mkdir d2/d8/d19/d4a/d64 0 2024-08-18T22:41:35.366 INFO:tasks.workunit.client.0.smithi121.stdout:8/476: chown d6/dd/c31 678 1 2024-08-18T22:41:35.368 INFO:tasks.workunit.client.1.smithi195.stdout:8/64: link d1/f5 d1/de/df/f1e 0 2024-08-18T22:41:35.368 INFO:tasks.workunit.client.1.smithi195.stdout:4/22: sync 2024-08-18T22:41:35.368 INFO:tasks.workunit.client.1.smithi195.stdout:4/23: readlink - no filename 2024-08-18T22:41:35.368 INFO:tasks.workunit.client.1.smithi195.stdout:5/37: sync 2024-08-18T22:41:35.368 INFO:tasks.workunit.client.1.smithi195.stdout:0/123: sync 2024-08-18T22:41:35.369 INFO:tasks.workunit.client.0.smithi121.stdout:2/292: mknod d2/d8/d19/dc/c65 0 2024-08-18T22:41:35.369 INFO:tasks.workunit.client.1.smithi195.stdout:9/83: dread f16 [0,4194304] 0 2024-08-18T22:41:35.370 INFO:tasks.workunit.client.0.smithi121.stdout:0/316: dwrite d1/d4/db/d18/f3a [0,4194304] 0 2024-08-18T22:41:35.370 INFO:tasks.workunit.client.1.smithi195.stdout:4/24: write d0/f4 [17347,65814] 0 2024-08-18T22:41:35.370 INFO:tasks.workunit.client.1.smithi195.stdout:8/65: truncate d1/de/df/f19 4598942 0 2024-08-18T22:41:35.371 INFO:tasks.workunit.client.1.smithi195.stdout:6/47: rename f0 to da/db/d10/f12 0 2024-08-18T22:41:35.371 INFO:tasks.workunit.client.0.smithi121.stdout:2/293: chown d2/d8/d19/f24 14 1 2024-08-18T22:41:35.371 INFO:tasks.workunit.client.0.smithi121.stdout:0/317: chown d1/d4/da/l16 1 1 2024-08-18T22:41:35.372 INFO:tasks.workunit.client.1.smithi195.stdout:6/48: stat c4 0 2024-08-18T22:41:35.372 INFO:tasks.workunit.client.1.smithi195.stdout:4/25: write d0/f4 [1627080,97751] 0 2024-08-18T22:41:35.372 INFO:tasks.workunit.client.1.smithi195.stdout:1/211: write da/f29 [1026774,7634] 0 2024-08-18T22:41:35.373 INFO:tasks.workunit.client.1.smithi195.stdout:8/66: readlink d1/d3/l14 0 2024-08-18T22:41:35.374 INFO:tasks.workunit.client.1.smithi195.stdout:1/212: stat da/f15 0 2024-08-18T22:41:35.375 INFO:tasks.workunit.client.0.smithi121.stdout:0/318: creat d1/d47/f66 x:0 0 0 2024-08-18T22:41:35.375 INFO:tasks.workunit.client.1.smithi195.stdout:4/26: read d0/f4 [507778,95692] 0 2024-08-18T22:41:35.378 INFO:tasks.workunit.client.0.smithi121.stdout:8/477: link d6/d17/d60/l71 d6/d17/d37/la1 0 2024-08-18T22:41:35.379 INFO:tasks.workunit.client.1.smithi195.stdout:8/67: chown d1/d3/l9 0 1 2024-08-18T22:41:35.380 INFO:tasks.workunit.client.1.smithi195.stdout:9/84: creat d1c/f1f x:0 0 0 2024-08-18T22:41:35.380 INFO:tasks.workunit.client.0.smithi121.stdout:2/294: dwrite d2/d3/f2a [0,4194304] 0 2024-08-18T22:41:35.382 INFO:tasks.workunit.client.1.smithi195.stdout:0/124: dread d0/dc/df/f12 [0,4194304] 0 2024-08-18T22:41:35.383 INFO:tasks.workunit.client.0.smithi121.stdout:0/319: creat d1/f67 x:0 0 0 2024-08-18T22:41:35.385 INFO:tasks.workunit.client.0.smithi121.stdout:2/295: dread - d2/d22/f42 zero size 2024-08-18T22:41:35.386 INFO:tasks.workunit.client.1.smithi195.stdout:4/27: mkdir d0/d9 0 2024-08-18T22:41:35.388 INFO:tasks.workunit.client.1.smithi195.stdout:6/49: write da/db/d10/f12 [2963855,51549] 0 2024-08-18T22:41:35.389 INFO:tasks.workunit.client.0.smithi121.stdout:8/478: dwrite d6/d17/d60/d5b/f9a [0,4194304] 0 2024-08-18T22:41:35.391 INFO:tasks.workunit.client.0.smithi121.stdout:2/296: creat d2/d3/d53/f66 x:0 0 0 2024-08-18T22:41:35.391 INFO:tasks.workunit.client.0.smithi121.stdout:8/479: fdatasync f5 0 2024-08-18T22:41:35.392 INFO:tasks.workunit.client.1.smithi195.stdout:5/38: dwrite d0/f9 [0,4194304] 0 2024-08-18T22:41:35.393 INFO:tasks.workunit.client.0.smithi121.stdout:2/297: mkdir d2/d8/d19/dc/d67 0 2024-08-18T22:41:35.393 INFO:tasks.workunit.client.1.smithi195.stdout:0/125: fdatasync d0/dc/d11/d1b/f1e 0 2024-08-18T22:41:35.394 INFO:tasks.workunit.client.0.smithi121.stdout:2/298: fdatasync d2/f4b 0 2024-08-18T22:41:35.395 INFO:tasks.workunit.client.0.smithi121.stdout:2/299: chown d2/c5e 114896759 1 2024-08-18T22:41:35.397 INFO:tasks.workunit.client.0.smithi121.stdout:8/480: truncate d6/d17/d18/f3a 1211780 0 2024-08-18T22:41:35.400 INFO:tasks.workunit.client.0.smithi121.stdout:0/320: getdents d1 0 2024-08-18T22:41:35.401 INFO:tasks.workunit.client.0.smithi121.stdout:0/321: chown d1/d4/db/d18/d1c/f36 159 1 2024-08-18T22:41:35.404 INFO:tasks.workunit.client.0.smithi121.stdout:0/322: creat d1/d4/db/d18/d2e/f68 x:0 0 0 2024-08-18T22:41:35.405 INFO:tasks.workunit.client.0.smithi121.stdout:0/323: creat d1/f69 x:0 0 0 2024-08-18T22:41:35.408 INFO:tasks.workunit.client.0.smithi121.stdout:0/324: unlink d1/d4/db/f2c 0 2024-08-18T22:41:35.413 INFO:tasks.workunit.client.0.smithi121.stdout:2/300: getdents d2/d8/d19/dc 0 2024-08-18T22:41:35.414 INFO:tasks.workunit.client.0.smithi121.stdout:8/481: dread d6/d17/d60/d5b/f95 [0,4194304] 0 2024-08-18T22:41:35.414 INFO:tasks.workunit.client.0.smithi121.stdout:0/325: dread d1/d4/db/d24/d30/d52/f46 [0,4194304] 0 2024-08-18T22:41:35.415 INFO:tasks.workunit.client.0.smithi121.stdout:2/301: mknod d2/d8/d19/dc/c68 0 2024-08-18T22:41:35.416 INFO:tasks.workunit.client.0.smithi121.stdout:0/326: chown d1/d4/db/d24/df/d8/l4e 0 1 2024-08-18T22:41:35.417 INFO:tasks.workunit.client.0.smithi121.stdout:2/302: write d2/d22/f42 [588160,104081] 0 2024-08-18T22:41:35.419 INFO:tasks.workunit.client.0.smithi121.stdout:8/482: dread d6/d17/d18/f98 [0,4194304] 0 2024-08-18T22:41:35.421 INFO:tasks.workunit.client.0.smithi121.stdout:0/327: rename d1/d4/db/d24/df/d8/d32 to d1/d4/db/d24/d30/d52/d6a 0 2024-08-18T22:41:35.422 INFO:tasks.workunit.client.0.smithi121.stdout:8/483: creat d6/d17/d60/d5b/fa2 x:0 0 0 2024-08-18T22:41:35.422 INFO:tasks.workunit.client.0.smithi121.stdout:0/328: chown d1/d4 27787544 1 2024-08-18T22:41:35.424 INFO:tasks.workunit.client.0.smithi121.stdout:8/484: mkdir d6/dd/d3b/da3 0 2024-08-18T22:41:35.425 INFO:tasks.workunit.client.0.smithi121.stdout:0/329: write d1/d4/db/d24/d30/d52/d6a/f34 [1876658,20449] 0 2024-08-18T22:41:35.425 INFO:tasks.workunit.client.0.smithi121.stdout:2/303: dwrite d2/d8/d19/d55/f58 [0,4194304] 0 2024-08-18T22:41:35.428 INFO:tasks.workunit.client.0.smithi121.stdout:0/330: write d1/d4/db/d18/f2d [1285521,100009] 0 2024-08-18T22:41:35.428 INFO:tasks.workunit.client.0.smithi121.stdout:2/304: write d2/d8/d19/dc/f2d [4942036,23210] 0 2024-08-18T22:41:35.433 INFO:tasks.workunit.client.0.smithi121.stdout:0/331: readlink d1/d4/db/d24/d30/d52/d6a/l45 0 2024-08-18T22:41:35.435 INFO:tasks.workunit.client.0.smithi121.stdout:8/485: dwrite d6/d1e/d2d/d78/f6c [0,4194304] 0 2024-08-18T22:41:35.436 INFO:tasks.workunit.client.0.smithi121.stdout:0/332: write d1/d4/db/d24/d30/d52/d6a/d3e/f51 [172216,113196] 0 2024-08-18T22:41:35.437 INFO:tasks.workunit.client.0.smithi121.stdout:2/305: dread d2/d8/d19/f52 [0,4194304] 0 2024-08-18T22:41:35.439 INFO:tasks.workunit.client.0.smithi121.stdout:0/333: creat d1/d4/db/d24/d30/d52/f6b x:0 0 0 2024-08-18T22:41:35.441 INFO:tasks.workunit.client.0.smithi121.stdout:8/486: truncate f5 6036252 0 2024-08-18T22:41:35.443 INFO:tasks.workunit.client.0.smithi121.stdout:2/306: rename d2/c27 to d2/d8/d19/d55/c69 0 2024-08-18T22:41:35.445 INFO:tasks.workunit.client.0.smithi121.stdout:2/307: fdatasync d2/d8/d19/f46 0 2024-08-18T22:41:35.446 INFO:tasks.workunit.client.0.smithi121.stdout:8/487: read d6/f8e [786474,83783] 0 2024-08-18T22:41:35.446 INFO:tasks.workunit.client.0.smithi121.stdout:0/334: getdents d1/d4/db/d24 0 2024-08-18T22:41:35.448 INFO:tasks.workunit.client.0.smithi121.stdout:2/308: rename d2/d22/f31 to d2/d8/d19/f6a 0 2024-08-18T22:41:35.449 INFO:tasks.workunit.client.0.smithi121.stdout:0/335: dread d1/d4/db/d24/d30/d52/f46 [0,4194304] 0 2024-08-18T22:41:35.449 INFO:tasks.workunit.client.0.smithi121.stdout:8/488: mknod d6/d1e/d2d/d78/ca4 0 2024-08-18T22:41:35.450 INFO:tasks.workunit.client.0.smithi121.stdout:8/489: chown d6/dd 1120372 1 2024-08-18T22:41:35.453 INFO:tasks.workunit.client.0.smithi121.stdout:2/309: link d2/d8/d19/c5b d2/d8/d19/d4a/c6b 0 2024-08-18T22:41:35.456 INFO:tasks.workunit.client.0.smithi121.stdout:0/336: dwrite d1/d4/db/d18/f3a [0,4194304] 0 2024-08-18T22:41:35.457 INFO:tasks.workunit.client.0.smithi121.stdout:0/337: chown d1/d4/d53 1305 1 2024-08-18T22:41:35.458 INFO:tasks.workunit.client.0.smithi121.stdout:2/310: getdents d2/d8/d19/d4a/d64 0 2024-08-18T22:41:35.459 INFO:tasks.workunit.client.0.smithi121.stdout:2/311: fdatasync d2/d8/d19/f47 0 2024-08-18T22:41:35.460 INFO:tasks.workunit.client.0.smithi121.stdout:8/490: creat d6/d1e/d2d/d78/d45/fa5 x:0 0 0 2024-08-18T22:41:35.460 INFO:tasks.workunit.client.1.smithi195.stdout:1/213: dwrite da/d18/d28/d31/f46 [0,4194304] 0 2024-08-18T22:41:35.460 INFO:tasks.workunit.client.1.smithi195.stdout:8/68: mkdir d1/de/df/d1d/d1f 0 2024-08-18T22:41:35.460 INFO:tasks.workunit.client.1.smithi195.stdout:0/126: readlink d0/l2 0 2024-08-18T22:41:35.461 INFO:tasks.workunit.client.0.smithi121.stdout:2/312: symlink d2/d3/d51/l6c 0 2024-08-18T22:41:35.462 INFO:tasks.workunit.client.1.smithi195.stdout:5/39: write d0/f9 [988523,71062] 0 2024-08-18T22:41:35.465 INFO:tasks.workunit.client.0.smithi121.stdout:0/338: dwrite d1/d4/db/d18/d1c/f59 [0,4194304] 0 2024-08-18T22:41:35.467 INFO:tasks.workunit.client.1.smithi195.stdout:4/28: symlink d0/d9/la 0 2024-08-18T22:41:35.467 INFO:tasks.workunit.client.1.smithi195.stdout:9/85: dwrite f15 [0,4194304] 0 2024-08-18T22:41:35.467 INFO:tasks.workunit.client.1.smithi195.stdout:1/214: chown da/d18/d43/f44 304 1 2024-08-18T22:41:35.468 INFO:tasks.workunit.client.0.smithi121.stdout:0/339: fdatasync d1/d4/db/d24/f48 0 2024-08-18T22:41:35.468 INFO:tasks.workunit.client.1.smithi195.stdout:8/69: read d1/d3/db/f10 [191511,89358] 0 2024-08-18T22:41:35.472 INFO:tasks.workunit.client.1.smithi195.stdout:6/50: creat da/f13 x:0 0 0 2024-08-18T22:41:35.472 INFO:tasks.workunit.client.1.smithi195.stdout:4/29: write d0/f8 [2387227,39198] 0 2024-08-18T22:41:35.472 INFO:tasks.workunit.client.1.smithi195.stdout:9/86: creat d1c/f20 x:0 0 0 2024-08-18T22:41:35.472 INFO:tasks.workunit.client.1.smithi195.stdout:0/127: symlink d0/dc/d11/d1b/l24 0 2024-08-18T22:41:35.473 INFO:tasks.workunit.client.0.smithi121.stdout:2/313: dwrite d2/d3/d53/f66 [0,4194304] 0 2024-08-18T22:41:35.473 INFO:tasks.workunit.client.1.smithi195.stdout:6/51: chown da/db/d10/l11 207948750 1 2024-08-18T22:41:35.474 INFO:tasks.workunit.client.1.smithi195.stdout:8/70: mkdir d1/de/d20 0 2024-08-18T22:41:35.476 INFO:tasks.workunit.client.1.smithi195.stdout:1/215: symlink da/d18/d28/d31/l4b 0 2024-08-18T22:41:35.478 INFO:tasks.workunit.client.1.smithi195.stdout:9/87: creat d1c/f21 x:0 0 0 2024-08-18T22:41:35.479 INFO:tasks.workunit.client.1.smithi195.stdout:6/52: write f6 [622311,119512] 0 2024-08-18T22:41:35.482 INFO:tasks.workunit.client.1.smithi195.stdout:8/71: unlink d1/d3/db/f10 0 2024-08-18T22:41:35.483 INFO:tasks.workunit.client.1.smithi195.stdout:4/30: symlink d0/d7/lb 0 2024-08-18T22:41:35.484 INFO:tasks.workunit.client.1.smithi195.stdout:4/31: write d0/f8 [97073,87907] 0 2024-08-18T22:41:35.484 INFO:tasks.workunit.client.1.smithi195.stdout:9/88: creat d1c/f22 x:0 0 0 2024-08-18T22:41:35.485 INFO:tasks.workunit.client.1.smithi195.stdout:9/89: dread - d1c/f22 zero size 2024-08-18T22:41:35.485 INFO:tasks.workunit.client.1.smithi195.stdout:1/216: mkdir da/d4c 0 2024-08-18T22:41:35.492 INFO:tasks.workunit.client.1.smithi195.stdout:4/32: dwrite d0/f8 [0,4194304] 0 2024-08-18T22:41:35.492 INFO:tasks.workunit.client.1.smithi195.stdout:1/217: chown da/f24 4181886 1 2024-08-18T22:41:35.493 INFO:tasks.workunit.client.1.smithi195.stdout:4/33: write d0/f8 [5199683,37659] 0 2024-08-18T22:41:35.494 INFO:tasks.workunit.client.1.smithi195.stdout:4/34: chown d0/f3 230 1 2024-08-18T22:41:35.497 INFO:tasks.workunit.client.1.smithi195.stdout:4/35: getdents d0/d9 0 2024-08-18T22:41:35.498 INFO:tasks.workunit.client.1.smithi195.stdout:6/53: getdents da 0 2024-08-18T22:41:35.499 INFO:tasks.workunit.client.1.smithi195.stdout:0/128: rename d0/dc/d11/d1b to d0/dc/d25 0 2024-08-18T22:41:35.500 INFO:tasks.workunit.client.1.smithi195.stdout:1/218: dread da/d18/f39 [0,4194304] 0 2024-08-18T22:41:35.500 INFO:tasks.workunit.client.1.smithi195.stdout:4/36: symlink d0/d9/lc 0 2024-08-18T22:41:35.501 INFO:tasks.workunit.client.1.smithi195.stdout:6/54: rename da/db/d10/l11 to da/db/d10/l14 0 2024-08-18T22:41:35.503 INFO:tasks.workunit.client.1.smithi195.stdout:4/37: fdatasync d0/f4 0 2024-08-18T22:41:35.503 INFO:tasks.workunit.client.1.smithi195.stdout:0/129: mknod d0/dc/d11/d23/c26 0 2024-08-18T22:41:35.504 INFO:tasks.workunit.client.0.smithi121.stdout:8/491: dwrite d6/d17/d60/f66 [0,4194304] 0 2024-08-18T22:41:35.504 INFO:tasks.workunit.client.1.smithi195.stdout:0/130: stat d0/c7 0 2024-08-18T22:41:35.505 INFO:tasks.workunit.client.0.smithi121.stdout:0/340: dwrite d1/d4/db/d18/d2e/f3d [0,4194304] 0 2024-08-18T22:41:35.505 INFO:tasks.workunit.client.0.smithi121.stdout:8/492: readlink d6/d1e/d2d/d78/d45/l74 0 2024-08-18T22:41:35.506 INFO:tasks.workunit.client.1.smithi195.stdout:0/131: fdatasync d0/dc/df/f12 0 2024-08-18T22:41:35.507 INFO:tasks.workunit.client.1.smithi195.stdout:0/132: read d0/dc/d11/f15 [6339637,66197] 0 2024-08-18T22:41:35.511 INFO:tasks.workunit.client.1.smithi195.stdout:5/40: truncate d0/f9 676497 0 2024-08-18T22:41:35.512 INFO:tasks.workunit.client.0.smithi121.stdout:0/341: getdents d1/d4/db/d24/d30/d52/d5b 0 2024-08-18T22:41:35.513 INFO:tasks.workunit.client.0.smithi121.stdout:8/493: write d6/dd/d3b/f64 [1912103,72397] 0 2024-08-18T22:41:35.514 INFO:tasks.workunit.client.0.smithi121.stdout:0/342: stat d1/d4/db/d24/d30/d52/d6a/d3e/l4a 0 2024-08-18T22:41:35.516 INFO:tasks.workunit.client.0.smithi121.stdout:0/343: write d1/d4/db/d18/f3a [1140216,5144] 0 2024-08-18T22:41:35.520 INFO:tasks.workunit.client.1.smithi195.stdout:9/90: rmdir d1c 39 2024-08-18T22:41:35.520 INFO:tasks.workunit.client.0.smithi121.stdout:0/344: rmdir d1/d47 39 2024-08-18T22:41:35.521 INFO:tasks.workunit.client.0.smithi121.stdout:8/494: dread d6/d1e/d2d/f3d [0,4194304] 0 2024-08-18T22:41:35.524 INFO:tasks.workunit.client.0.smithi121.stdout:0/345: rename d1/d4/db/d24/d30/d52/d6a/d3e to d1/d4/db/d24/d30/d6c 0 2024-08-18T22:41:35.524 INFO:tasks.workunit.client.1.smithi195.stdout:9/91: write f17 [845946,44243] 0 2024-08-18T22:41:35.525 INFO:tasks.workunit.client.0.smithi121.stdout:8/495: mkdir d6/d1e/d2d/d78/d85/da6 0 2024-08-18T22:41:35.525 INFO:tasks.workunit.client.1.smithi195.stdout:1/219: write da/d18/f42 [1452917,41439] 0 2024-08-18T22:41:35.526 INFO:tasks.workunit.client.0.smithi121.stdout:8/496: mknod d6/dd/d25/d56/ca7 0 2024-08-18T22:41:35.527 INFO:tasks.workunit.client.0.smithi121.stdout:0/346: dread d1/d4/f1f [0,4194304] 0 2024-08-18T22:41:35.528 INFO:tasks.workunit.client.1.smithi195.stdout:6/55: write f7 [521102,17954] 0 2024-08-18T22:41:35.528 INFO:tasks.workunit.client.0.smithi121.stdout:8/497: truncate d6/d1e/d2d/f81 594286 0 2024-08-18T22:41:35.529 INFO:tasks.workunit.client.1.smithi195.stdout:6/56: stat da/fd 0 2024-08-18T22:41:35.529 INFO:tasks.workunit.client.1.smithi195.stdout:5/41: dread d0/f9 [0,4194304] 0 2024-08-18T22:41:35.530 INFO:tasks.workunit.client.0.smithi121.stdout:0/347: truncate d1/d4/db/d24/f48 1157406 0 2024-08-18T22:41:35.531 INFO:tasks.workunit.client.0.smithi121.stdout:8/498: write d6/d17/d18/f32 [2788217,68745] 0 2024-08-18T22:41:35.531 INFO:tasks.workunit.client.1.smithi195.stdout:9/92: creat d1c/f23 x:0 0 0 2024-08-18T22:41:35.531 INFO:tasks.workunit.client.1.smithi195.stdout:8/72: dwrite d1/f2 [0,4194304] 0 2024-08-18T22:41:35.533 INFO:tasks.workunit.client.1.smithi195.stdout:6/57: mkdir da/d15 0 2024-08-18T22:41:35.533 INFO:tasks.workunit.client.1.smithi195.stdout:1/220: creat da/d18/f4d x:0 0 0 2024-08-18T22:41:35.533 INFO:tasks.workunit.client.1.smithi195.stdout:8/73: dread - d1/f5 zero size 2024-08-18T22:41:35.533 INFO:tasks.workunit.client.0.smithi121.stdout:0/348: creat d1/d4/db/d18/d2e/f6d x:0 0 0 2024-08-18T22:41:35.535 INFO:tasks.workunit.client.0.smithi121.stdout:8/499: creat d6/d1e/d2d/d78/fa8 x:0 0 0 2024-08-18T22:41:35.535 INFO:tasks.workunit.client.0.smithi121.stdout:0/349: symlink d1/d4/db/d24/d30/l6e 0 2024-08-18T22:41:35.537 INFO:tasks.workunit.client.0.smithi121.stdout:8/500: creat d6/d17/d18/d83/fa9 x:0 0 0 2024-08-18T22:41:35.537 INFO:tasks.workunit.client.0.smithi121.stdout:0/350: fsync d1/d4/db/d24/d30/d52/d6a/f34 0 2024-08-18T22:41:35.537 INFO:tasks.workunit.client.1.smithi195.stdout:5/42: write d0/f9 [379912,35599] 0 2024-08-18T22:41:35.538 INFO:tasks.workunit.client.0.smithi121.stdout:8/501: write d6/d17/f51 [658265,69215] 0 2024-08-18T22:41:35.541 INFO:tasks.workunit.client.0.smithi121.stdout:8/502: symlink d6/d1e/d2d/d78/laa 0 2024-08-18T22:41:35.542 INFO:tasks.workunit.client.0.smithi121.stdout:0/351: dread d1/d4/db/d18/d2e/f3d [0,4194304] 0 2024-08-18T22:41:35.542 INFO:tasks.workunit.client.1.smithi195.stdout:5/43: chown d0/db 1206242069 1 2024-08-18T22:41:35.543 INFO:tasks.workunit.client.0.smithi121.stdout:8/503: creat d6/d17/d60/d5b/d6e/fab x:0 0 0 2024-08-18T22:41:35.544 INFO:tasks.workunit.client.1.smithi195.stdout:1/221: unlink da/d18/f37 0 2024-08-18T22:41:35.545 INFO:tasks.workunit.client.0.smithi121.stdout:8/504: truncate d6/d17/f40 5339173 0 2024-08-18T22:41:35.545 INFO:tasks.workunit.client.0.smithi121.stdout:0/352: fsync d1/d4/db/d24/d30/d52/d6a/f5c 0 2024-08-18T22:41:35.546 INFO:tasks.workunit.client.0.smithi121.stdout:0/353: write d1/d4/db/d18/f22 [1499933,109523] 0 2024-08-18T22:41:35.548 INFO:tasks.workunit.client.1.smithi195.stdout:8/74: getdents d1/de/df/d1d 0 2024-08-18T22:41:35.549 INFO:tasks.workunit.client.0.smithi121.stdout:0/354: creat d1/d4/db/d24/f6f x:0 0 0 2024-08-18T22:41:35.552 INFO:tasks.workunit.client.1.smithi195.stdout:9/93: dwrite d1c/f1d [0,4194304] 0 2024-08-18T22:41:35.553 INFO:tasks.workunit.client.0.smithi121.stdout:8/505: dwrite d6/dd/d3b/f64 [0,4194304] 0 2024-08-18T22:41:35.554 INFO:tasks.workunit.client.1.smithi195.stdout:8/75: dread - d1/d3/db/fd zero size 2024-08-18T22:41:35.555 INFO:tasks.workunit.client.1.smithi195.stdout:6/58: dwrite f6 [0,4194304] 0 2024-08-18T22:41:35.555 INFO:tasks.workunit.client.1.smithi195.stdout:5/44: truncate d0/f9 297923 0 2024-08-18T22:41:35.556 INFO:tasks.workunit.client.1.smithi195.stdout:9/94: truncate f11 764187 0 2024-08-18T22:41:35.556 INFO:tasks.workunit.client.1.smithi195.stdout:8/76: fsync d1/f2 0 2024-08-18T22:41:35.556 INFO:tasks.workunit.client.1.smithi195.stdout:1/222: truncate da/d18/d28/d31/d3b/f3c 899234 0 2024-08-18T22:41:35.557 INFO:tasks.workunit.client.1.smithi195.stdout:9/95: fsync d1c/f1f 0 2024-08-18T22:41:35.558 INFO:tasks.workunit.client.1.smithi195.stdout:8/77: stat d1/d3/db/f17 0 2024-08-18T22:41:35.558 INFO:tasks.workunit.client.0.smithi121.stdout:0/355: dwrite d1/f69 [0,4194304] 0 2024-08-18T22:41:35.559 INFO:tasks.workunit.client.0.smithi121.stdout:8/506: creat d6/d1e/fac x:0 0 0 2024-08-18T22:41:35.561 INFO:tasks.workunit.client.1.smithi195.stdout:9/96: read - d1c/f1f zero size 2024-08-18T22:41:35.565 INFO:tasks.workunit.client.0.smithi121.stdout:0/356: creat d1/d4/db/d24/d30/d52/f70 x:0 0 0 2024-08-18T22:41:35.566 INFO:tasks.workunit.client.1.smithi195.stdout:9/97: creat d1c/f24 x:0 0 0 2024-08-18T22:41:35.571 INFO:tasks.workunit.client.0.smithi121.stdout:0/357: write d1/d4/db/d18/d1c/f36 [2175231,114265] 0 2024-08-18T22:41:35.571 INFO:tasks.workunit.client.1.smithi195.stdout:6/59: dwrite f6 [4194304,4194304] 0 2024-08-18T22:41:35.572 INFO:tasks.workunit.client.1.smithi195.stdout:1/223: dread f7 [0,4194304] 0 2024-08-18T22:41:35.573 INFO:tasks.workunit.client.0.smithi121.stdout:8/507: dwrite d6/d17/d60/d5b/d6e/fab [0,4194304] 0 2024-08-18T22:41:35.574 INFO:tasks.workunit.client.1.smithi195.stdout:6/60: chown da 258 1 2024-08-18T22:41:35.577 INFO:tasks.workunit.client.0.smithi121.stdout:8/508: creat d6/d1e/d2d/d78/d85/fad x:0 0 0 2024-08-18T22:41:35.578 INFO:tasks.workunit.client.0.smithi121.stdout:8/509: stat d6/d20/d69/l96 0 2024-08-18T22:41:35.578 INFO:tasks.workunit.client.1.smithi195.stdout:1/224: mkdir da/d18/d28/d31/d3b/d4e 0 2024-08-18T22:41:35.580 INFO:tasks.workunit.client.0.smithi121.stdout:8/510: creat d6/d17/d18/d83/fae x:0 0 0 2024-08-18T22:41:35.581 INFO:tasks.workunit.client.1.smithi195.stdout:8/78: dread d1/de/df/f19 [0,4194304] 0 2024-08-18T22:41:35.583 INFO:tasks.workunit.client.1.smithi195.stdout:6/61: symlink da/db/d10/l16 0 2024-08-18T22:41:35.584 INFO:tasks.workunit.client.0.smithi121.stdout:8/511: getdents d6/d1e/d2d 0 2024-08-18T22:41:35.584 INFO:tasks.workunit.client.0.smithi121.stdout:8/512: stat d6/d17/d60/d5b/f6f 0 2024-08-18T22:41:35.586 INFO:tasks.workunit.client.1.smithi195.stdout:6/62: write f6 [7633280,103406] 0 2024-08-18T22:41:35.587 INFO:tasks.workunit.client.1.smithi195.stdout:9/98: dwrite d1c/f1d [0,4194304] 0 2024-08-18T22:41:35.589 INFO:tasks.workunit.client.1.smithi195.stdout:9/99: readlink l6 0 2024-08-18T22:41:35.592 INFO:tasks.workunit.client.1.smithi195.stdout:9/100: mknod d1c/c25 0 2024-08-18T22:41:35.594 INFO:tasks.workunit.client.0.smithi121.stdout:4/344: sync 2024-08-18T22:41:35.594 INFO:tasks.workunit.client.1.smithi195.stdout:9/101: dread - f19 zero size 2024-08-18T22:41:35.594 INFO:tasks.workunit.client.1.smithi195.stdout:1/225: dwrite da/d18/d43/f44 [0,4194304] 0 2024-08-18T22:41:35.597 INFO:tasks.workunit.client.1.smithi195.stdout:8/79: dwrite d1/d3/db/fd [0,4194304] 0 2024-08-18T22:41:35.598 INFO:tasks.workunit.client.0.smithi121.stdout:4/345: getdents d2/dc 0 2024-08-18T22:41:35.598 INFO:tasks.workunit.client.1.smithi195.stdout:9/102: write f9 [968142,114921] 0 2024-08-18T22:41:35.600 INFO:tasks.workunit.client.1.smithi195.stdout:1/226: mknod da/d18/d43/c4f 0 2024-08-18T22:41:35.601 INFO:tasks.workunit.client.1.smithi195.stdout:1/227: chown da/l14 54 1 2024-08-18T22:41:35.602 INFO:tasks.workunit.client.1.smithi195.stdout:9/103: creat d1c/f26 x:0 0 0 2024-08-18T22:41:35.603 INFO:tasks.workunit.client.1.smithi195.stdout:8/80: mkdir d1/d3/d1c/d21 0 2024-08-18T22:41:35.605 INFO:tasks.workunit.client.1.smithi195.stdout:9/104: creat d1c/f27 x:0 0 0 2024-08-18T22:41:35.606 INFO:tasks.workunit.client.1.smithi195.stdout:8/81: chown d1/l7 5743392 1 2024-08-18T22:41:35.607 INFO:tasks.workunit.client.1.smithi195.stdout:9/105: creat d1c/f28 x:0 0 0 2024-08-18T22:41:35.608 INFO:tasks.workunit.client.1.smithi195.stdout:9/106: read f15 [1194679,59650] 0 2024-08-18T22:41:35.608 INFO:tasks.workunit.client.1.smithi195.stdout:8/82: write d1/d3/db/f17 [758985,57848] 0 2024-08-18T22:41:35.619 INFO:tasks.workunit.client.1.smithi195.stdout:8/83: dread d1/de/df/f19 [0,4194304] 0 2024-08-18T22:41:35.619 INFO:tasks.workunit.client.1.smithi195.stdout:5/45: dwrite d0/f9 [0,4194304] 0 2024-08-18T22:41:35.621 INFO:tasks.workunit.client.1.smithi195.stdout:8/84: fdatasync d1/f5 0 2024-08-18T22:41:35.624 INFO:tasks.workunit.client.0.smithi121.stdout:0/358: truncate d1/fd 1154109 0 2024-08-18T22:41:35.625 INFO:tasks.workunit.client.1.smithi195.stdout:5/46: dread d0/f9 [0,4194304] 0 2024-08-18T22:41:35.626 INFO:tasks.workunit.client.1.smithi195.stdout:8/85: fdatasync d1/f5 0 2024-08-18T22:41:35.628 INFO:tasks.workunit.client.1.smithi195.stdout:5/47: write d0/f9 [832260,69075] 0 2024-08-18T22:41:35.630 INFO:tasks.workunit.client.0.smithi121.stdout:4/346: dwrite d2/dc/d16/f68 [0,4194304] 0 2024-08-18T22:41:35.631 INFO:tasks.workunit.client.1.smithi195.stdout:8/86: rename d1/f2 to d1/d3/d1c/d21/f22 0 2024-08-18T22:41:35.631 INFO:tasks.workunit.client.1.smithi195.stdout:8/87: dread - d1/f5 zero size 2024-08-18T22:41:35.632 INFO:tasks.workunit.client.1.smithi195.stdout:5/48: readlink d0/d3/l7 0 2024-08-18T22:41:35.632 INFO:tasks.workunit.client.1.smithi195.stdout:8/88: readlink d1/d3/l14 0 2024-08-18T22:41:35.633 INFO:tasks.workunit.client.1.smithi195.stdout:8/89: dread - d1/f5 zero size 2024-08-18T22:41:35.633 INFO:tasks.workunit.client.0.smithi121.stdout:4/347: write d2/dc/d1c/f6a [436508,116490] 0 2024-08-18T22:41:35.633 INFO:tasks.workunit.client.0.smithi121.stdout:0/359: dwrite d1/d4/db/d24/d30/d52/f70 [0,4194304] 0 2024-08-18T22:41:35.633 INFO:tasks.workunit.client.1.smithi195.stdout:5/49: chown d0/d3/d8/ld 448 1 2024-08-18T22:41:35.635 INFO:tasks.workunit.client.0.smithi121.stdout:0/360: write d1/d4/db/d24/f29 [4641495,49199] 0 2024-08-18T22:41:35.636 INFO:tasks.workunit.client.1.smithi195.stdout:9/107: truncate f3 997481 0 2024-08-18T22:41:35.637 INFO:tasks.workunit.client.1.smithi195.stdout:8/90: fdatasync d1/f5 0 2024-08-18T22:41:35.638 INFO:tasks.workunit.client.1.smithi195.stdout:9/108: chown c10 28 1 2024-08-18T22:41:35.639 INFO:tasks.workunit.client.1.smithi195.stdout:5/50: mknod d0/d2/ce 0 2024-08-18T22:41:35.640 INFO:tasks.workunit.client.0.smithi121.stdout:0/361: mkdir d1/d4/db/d24/df/d8/d71 0 2024-08-18T22:41:35.641 INFO:tasks.workunit.client.0.smithi121.stdout:4/348: dwrite d2/dc/d16/d22/f39 [0,4194304] 0 2024-08-18T22:41:35.649 INFO:tasks.workunit.client.1.smithi195.stdout:1/228: dwrite da/d3d/f48 [0,4194304] 0 2024-08-18T22:41:35.652 INFO:tasks.workunit.client.1.smithi195.stdout:9/109: dread f0 [4194304,4194304] 0 2024-08-18T22:41:35.655 INFO:tasks.workunit.client.1.smithi195.stdout:8/91: dread d1/d3/db/fd [0,4194304] 0 2024-08-18T22:41:35.655 INFO:tasks.workunit.client.1.smithi195.stdout:5/51: dread d0/f9 [0,4194304] 0 2024-08-18T22:41:35.658 INFO:tasks.workunit.client.0.smithi121.stdout:4/349: dread d2/f4 [0,4194304] 0 2024-08-18T22:41:35.658 INFO:tasks.workunit.client.1.smithi195.stdout:9/110: symlink d1c/l29 0 2024-08-18T22:41:35.659 INFO:tasks.workunit.client.0.smithi121.stdout:4/350: symlink d2/dc/d16/l74 0 2024-08-18T22:41:35.660 INFO:tasks.workunit.client.1.smithi195.stdout:9/111: truncate d1c/f24 245884 0 2024-08-18T22:41:35.660 INFO:tasks.workunit.client.1.smithi195.stdout:5/52: rename d0/d3/d8/da to d0/d3/df 0 2024-08-18T22:41:35.661 INFO:tasks.workunit.client.1.smithi195.stdout:5/53: chown d0/d3/df 22441181 1 2024-08-18T22:41:35.663 INFO:tasks.workunit.client.1.smithi195.stdout:5/54: chown d0/d3/df 1917990567 1 2024-08-18T22:41:35.663 INFO:tasks.workunit.client.1.smithi195.stdout:9/112: write d1c/f20 [996435,36166] 0 2024-08-18T22:41:35.665 INFO:tasks.workunit.client.0.smithi121.stdout:4/351: dwrite d2/dc/d1c/f23 [0,4194304] 0 2024-08-18T22:41:35.666 INFO:tasks.workunit.client.0.smithi121.stdout:4/352: fdatasync d2/f72 0 2024-08-18T22:41:35.667 INFO:tasks.workunit.client.1.smithi195.stdout:9/113: fdatasync f15 0 2024-08-18T22:41:35.669 INFO:tasks.workunit.client.0.smithi121.stdout:0/362: dread d1/d4/db/d18/f23 [0,4194304] 0 2024-08-18T22:41:35.669 INFO:tasks.workunit.client.0.smithi121.stdout:4/353: creat d2/dc/d16/f75 x:0 0 0 2024-08-18T22:41:35.671 INFO:tasks.workunit.client.1.smithi195.stdout:8/92: dwrite d1/d3/f6 [0,4194304] 0 2024-08-18T22:41:35.672 INFO:tasks.workunit.client.0.smithi121.stdout:0/363: creat d1/d4/f72 x:0 0 0 2024-08-18T22:41:35.674 INFO:tasks.workunit.client.1.smithi195.stdout:9/114: creat d1c/f2a x:0 0 0 2024-08-18T22:41:35.675 INFO:tasks.workunit.client.1.smithi195.stdout:8/93: symlink d1/d3/l23 0 2024-08-18T22:41:35.680 INFO:tasks.workunit.client.1.smithi195.stdout:5/55: dwrite d0/f9 [0,4194304] 0 2024-08-18T22:41:35.680 INFO:tasks.workunit.client.1.smithi195.stdout:9/115: dread - d1c/f22 zero size 2024-08-18T22:41:35.683 INFO:tasks.workunit.client.1.smithi195.stdout:5/56: read d0/f9 [2813388,98619] 0 2024-08-18T22:41:35.683 INFO:tasks.workunit.client.1.smithi195.stdout:1/229: dwrite da/f1b [0,4194304] 0 2024-08-18T22:41:35.685 INFO:tasks.workunit.client.1.smithi195.stdout:8/94: creat d1/de/df/d1d/d1f/f24 x:0 0 0 2024-08-18T22:41:35.686 INFO:tasks.workunit.client.1.smithi195.stdout:9/116: creat d1c/f2b x:0 0 0 2024-08-18T22:41:35.687 INFO:tasks.workunit.client.0.smithi121.stdout:0/364: dwrite d1/d4/f1f [0,4194304] 0 2024-08-18T22:41:35.687 INFO:tasks.workunit.client.1.smithi195.stdout:5/57: write d0/f9 [1974458,98396] 0 2024-08-18T22:41:35.691 INFO:tasks.workunit.client.1.smithi195.stdout:8/95: rename d1/d3/l9 to d1/de/df/d1d/d1f/l25 0 2024-08-18T22:41:35.693 INFO:tasks.workunit.client.1.smithi195.stdout:5/58: symlink d0/d2/l10 0 2024-08-18T22:41:35.693 INFO:tasks.workunit.client.0.smithi121.stdout:4/354: dread d2/dc/d16/d22/d29/f20 [0,4194304] 0 2024-08-18T22:41:35.693 INFO:tasks.workunit.client.1.smithi195.stdout:8/96: symlink d1/de/df/d1d/l26 0 2024-08-18T22:41:35.694 INFO:tasks.workunit.client.0.smithi121.stdout:4/355: chown d2/dc/d16/d22/d2c/d44/d67 181373 1 2024-08-18T22:41:35.694 INFO:tasks.workunit.client.1.smithi195.stdout:5/59: write d0/f9 [3641208,33653] 0 2024-08-18T22:41:35.695 INFO:tasks.workunit.client.1.smithi195.stdout:5/60: write d0/f9 [4762327,27249] 0 2024-08-18T22:41:35.697 INFO:tasks.workunit.client.1.smithi195.stdout:1/230: link f5 da/d18/d28/f50 0 2024-08-18T22:41:35.697 INFO:tasks.workunit.client.1.smithi195.stdout:8/97: fdatasync d1/d3/db/fd 0 2024-08-18T22:41:35.701 INFO:tasks.workunit.client.1.smithi195.stdout:1/231: rename f5 to da/d18/d28/d31/d3b/d4e/f51 0 2024-08-18T22:41:35.703 INFO:tasks.workunit.client.1.smithi195.stdout:1/232: mknod da/d18/d28/d31/d3b/c52 0 2024-08-18T22:41:35.715 INFO:tasks.workunit.client.0.smithi121.stdout:9/491: sync 2024-08-18T22:41:35.715 INFO:tasks.workunit.client.0.smithi121.stdout:5/311: sync 2024-08-18T22:41:35.715 INFO:tasks.workunit.client.0.smithi121.stdout:1/464: sync 2024-08-18T22:41:35.715 INFO:tasks.workunit.client.0.smithi121.stdout:7/468: sync 2024-08-18T22:41:35.716 INFO:tasks.workunit.client.1.smithi195.stdout:8/98: rmdir d1/de/df/d1d/d1f 39 2024-08-18T22:41:35.717 INFO:tasks.workunit.client.1.smithi195.stdout:8/99: mkdir d1/de/d27 0 2024-08-18T22:41:35.717 INFO:tasks.workunit.client.0.smithi121.stdout:9/492: write d0/d38/d9e/df/d61/d90/f70 [522424,116549] 0 2024-08-18T22:41:35.717 INFO:tasks.workunit.client.0.smithi121.stdout:1/465: chown d5/d10/d14/d2a/d3a/d87/d6c/d6f/f8f 194812627 1 2024-08-18T22:41:35.718 INFO:tasks.workunit.client.0.smithi121.stdout:5/312: unlink d3/f1a 0 2024-08-18T22:41:35.719 INFO:tasks.workunit.client.1.smithi195.stdout:1/233: getdents da/d18/d28 0 2024-08-18T22:41:35.720 INFO:tasks.workunit.client.0.smithi121.stdout:9/493: symlink d0/d38/d44/la2 0 2024-08-18T22:41:35.720 INFO:tasks.workunit.client.1.smithi195.stdout:8/100: creat d1/d3/d1c/d21/f28 x:0 0 0 2024-08-18T22:41:35.722 INFO:tasks.workunit.client.0.smithi121.stdout:7/469: creat de/d13/d18/d23/d24/d29/d43/d7f/f92 x:0 0 0 2024-08-18T22:41:35.722 INFO:tasks.workunit.client.1.smithi195.stdout:1/234: dread da/fe [0,4194304] 0 2024-08-18T22:41:35.722 INFO:tasks.workunit.client.1.smithi195.stdout:8/101: creat d1/de/d27/f29 x:0 0 0 2024-08-18T22:41:35.723 INFO:tasks.workunit.client.1.smithi195.stdout:1/235: fdatasync da/d18/f4d 0 2024-08-18T22:41:35.723 INFO:tasks.workunit.client.0.smithi121.stdout:5/313: symlink d3/d5/l61 0 2024-08-18T22:41:35.724 INFO:tasks.workunit.client.0.smithi121.stdout:9/494: read d0/d38/d47/f8a [3021943,96995] 0 2024-08-18T22:41:35.724 INFO:tasks.workunit.client.1.smithi195.stdout:8/102: creat d1/f2a x:0 0 0 2024-08-18T22:41:35.724 INFO:tasks.workunit.client.1.smithi195.stdout:1/236: fdatasync da/d18/d28/f27 0 2024-08-18T22:41:35.725 INFO:tasks.workunit.client.0.smithi121.stdout:1/466: dread d5/d10/d14/d2a/d3a/d87/d6c/d6f/d82/d15/f5b [0,4194304] 0 2024-08-18T22:41:35.727 INFO:tasks.workunit.client.0.smithi121.stdout:0/365: dread d1/d4/db/d24/f29 [0,4194304] 0 2024-08-18T22:41:35.727 INFO:tasks.workunit.client.1.smithi195.stdout:1/237: link da/f24 da/f53 0 2024-08-18T22:41:35.728 INFO:tasks.workunit.client.0.smithi121.stdout:7/470: truncate de/f1d 4496819 0 2024-08-18T22:41:35.729 INFO:tasks.workunit.client.1.smithi195.stdout:1/238: mknod da/d18/d43/c54 0 2024-08-18T22:41:35.729 INFO:tasks.workunit.client.1.smithi195.stdout:8/103: dwrite d1/d3/db/fd [0,4194304] 0 2024-08-18T22:41:35.730 INFO:tasks.workunit.client.0.smithi121.stdout:5/314: creat d3/d5/f62 x:0 0 0 2024-08-18T22:41:35.731 INFO:tasks.workunit.client.1.smithi195.stdout:1/239: read da/d18/d28/d31/d3b/f3a [637655,32305] 0 2024-08-18T22:41:35.732 INFO:tasks.workunit.client.0.smithi121.stdout:5/315: fdatasync d3/d5/d13/d19/f30 0 2024-08-18T22:41:35.734 INFO:tasks.workunit.client.1.smithi195.stdout:1/240: rename da/c1e to da/d3d/c55 0 2024-08-18T22:41:35.736 INFO:tasks.workunit.client.1.smithi195.stdout:8/104: dwrite d1/d3/f6 [4194304,4194304] 0 2024-08-18T22:41:35.737 INFO:tasks.workunit.client.1.smithi195.stdout:8/105: chown d1/de/df/d1d 2 1 2024-08-18T22:41:35.738 INFO:tasks.workunit.client.1.smithi195.stdout:8/106: write d1/d3/db/f17 [910338,92459] 0 2024-08-18T22:41:35.739 INFO:tasks.workunit.client.1.smithi195.stdout:1/241: dread da/f11 [0,4194304] 0 2024-08-18T22:41:35.745 INFO:tasks.workunit.client.0.smithi121.stdout:5/316: dread d3/d5/d13/d19/d24/d32/f44 [0,4194304] 0 2024-08-18T22:41:35.745 INFO:tasks.workunit.client.0.smithi121.stdout:1/467: dwrite d5/d10/d14/f4f [4194304,4194304] 0 2024-08-18T22:41:35.746 INFO:tasks.workunit.client.1.smithi195.stdout:1/242: symlink da/d18/l56 0 2024-08-18T22:41:35.746 INFO:tasks.workunit.client.0.smithi121.stdout:9/495: dread d0/d5/f25 [0,4194304] 0 2024-08-18T22:41:35.747 INFO:tasks.workunit.client.1.smithi195.stdout:1/243: mknod da/c57 0 2024-08-18T22:41:35.748 INFO:tasks.workunit.client.0.smithi121.stdout:5/317: chown d3/d5/d27/f2e 955842 1 2024-08-18T22:41:35.748 INFO:tasks.workunit.client.0.smithi121.stdout:0/366: dwrite d1/d4/db/d18/d40/f41 [0,4194304] 0 2024-08-18T22:41:35.749 INFO:tasks.workunit.client.1.smithi195.stdout:1/244: write da/d18/f47 [612742,68335] 0 2024-08-18T22:41:35.749 INFO:tasks.workunit.client.0.smithi121.stdout:1/468: creat d5/d10/d14/d34/fa2 x:0 0 0 2024-08-18T22:41:35.750 INFO:tasks.workunit.client.0.smithi121.stdout:7/471: dread de/d13/f17 [0,4194304] 0 2024-08-18T22:41:35.751 INFO:tasks.workunit.client.1.smithi195.stdout:1/245: write da/d18/d28/f34 [1190135,27815] 0 2024-08-18T22:41:35.751 INFO:tasks.workunit.client.0.smithi121.stdout:0/367: dread - d1/d4/db/f60 zero size 2024-08-18T22:41:35.756 INFO:tasks.workunit.client.0.smithi121.stdout:7/472: mknod de/d13/c93 0 2024-08-18T22:41:35.756 INFO:tasks.workunit.client.0.smithi121.stdout:9/496: creat d0/d38/d47/fa3 x:0 0 0 2024-08-18T22:41:35.756 INFO:tasks.workunit.client.0.smithi121.stdout:5/318: dread d3/d5/f1d [0,4194304] 0 2024-08-18T22:41:35.760 INFO:tasks.workunit.client.0.smithi121.stdout:0/368: dread d1/f69 [0,4194304] 0 2024-08-18T22:41:35.761 INFO:tasks.workunit.client.0.smithi121.stdout:1/469: symlink d5/d10/d14/d2a/d3a/d87/d6c/d6f/d82/d15/la3 0 2024-08-18T22:41:35.763 INFO:tasks.workunit.client.1.smithi195.stdout:8/107: dwrite d1/de/df/f1e [0,4194304] 0 2024-08-18T22:41:35.763 INFO:tasks.workunit.client.0.smithi121.stdout:9/497: symlink d0/d5/dd/d1a/la4 0 2024-08-18T22:41:35.764 INFO:tasks.workunit.client.1.smithi195.stdout:8/108: creat d1/d3/f2b x:0 0 0 2024-08-18T22:41:35.767 INFO:tasks.workunit.client.0.smithi121.stdout:9/498: write d0/d38/d9e/df/f40 [4304562,62214] 0 2024-08-18T22:41:35.768 INFO:tasks.workunit.client.0.smithi121.stdout:5/319: dwrite d3/d5/f7 [0,4194304] 0 2024-08-18T22:41:35.768 INFO:tasks.workunit.client.0.smithi121.stdout:7/473: dread de/d2d/d50/f71 [0,4194304] 0 2024-08-18T22:41:35.769 INFO:tasks.workunit.client.0.smithi121.stdout:1/470: write d5/d10/d14/d2a/d3a/d87/d6c/d6f/d82/f51 [8912103,46706] 0 2024-08-18T22:41:35.773 INFO:tasks.workunit.client.1.smithi195.stdout:8/109: dwrite d1/d3/d1c/d21/f22 [0,4194304] 0 2024-08-18T22:41:35.776 INFO:tasks.workunit.client.1.smithi195.stdout:8/110: fdatasync d1/de/df/f19 0 2024-08-18T22:41:35.776 INFO:tasks.workunit.client.0.smithi121.stdout:0/369: dwrite d1/d4/db/d24/d30/d52/f70 [0,4194304] 0 2024-08-18T22:41:35.779 INFO:tasks.workunit.client.0.smithi121.stdout:7/474: creat de/d1a/d34/d38/d5f/f94 x:0 0 0 2024-08-18T22:41:35.779 INFO:tasks.workunit.client.0.smithi121.stdout:5/320: mkdir d3/d5/d13/d19/d24/d32/d38/d63 0 2024-08-18T22:41:35.780 INFO:tasks.workunit.client.0.smithi121.stdout:9/499: link d0/d38/d9e/df/f40 d0/d38/d9e/df/d73/fa5 0 2024-08-18T22:41:35.781 INFO:tasks.workunit.client.0.smithi121.stdout:7/475: symlink de/d2d/l95 0 2024-08-18T22:41:35.782 INFO:tasks.workunit.client.0.smithi121.stdout:0/370: mknod d1/d4/d53/d61/c73 0 2024-08-18T22:41:35.783 INFO:tasks.workunit.client.1.smithi195.stdout:8/111: dread d1/d3/db/fd [0,4194304] 0 2024-08-18T22:41:35.784 INFO:tasks.workunit.client.0.smithi121.stdout:5/321: symlink d3/d5/d13/d19/d24/d32/d38/d63/l64 0 2024-08-18T22:41:35.784 INFO:tasks.workunit.client.0.smithi121.stdout:9/500: getdents d0/d5/dd/d3f 0 2024-08-18T22:41:35.785 INFO:tasks.workunit.client.0.smithi121.stdout:1/471: dwrite d5/d10/d14/d2a/d3a/d87/d6c/d6f/d82/d15/d28/f71 [0,4194304] 0 2024-08-18T22:41:35.785 INFO:tasks.workunit.client.0.smithi121.stdout:0/371: read d1/d4/db/d18/d2e/f3d [1259149,70351] 0 2024-08-18T22:41:35.787 INFO:tasks.workunit.client.0.smithi121.stdout:1/472: stat d5/d10/d14 0 2024-08-18T22:41:35.788 INFO:tasks.workunit.client.1.smithi195.stdout:8/112: mknod d1/de/df/d18/c2c 0 2024-08-18T22:41:35.789 INFO:tasks.workunit.client.0.smithi121.stdout:1/473: dread - d5/d10/d14/d2a/d3a/f4d zero size 2024-08-18T22:41:35.789 INFO:tasks.workunit.client.0.smithi121.stdout:7/476: dread de/d1a/d63/f6b [4194304,4194304] 0 2024-08-18T22:41:35.789 INFO:tasks.workunit.client.0.smithi121.stdout:9/501: unlink d0/d38/f4e 0 2024-08-18T22:41:35.790 INFO:tasks.workunit.client.1.smithi195.stdout:8/113: write d1/d3/f2b [582894,112442] 0 2024-08-18T22:41:35.790 INFO:tasks.workunit.client.0.smithi121.stdout:5/322: mknod d3/d5/d13/d19/c65 0 2024-08-18T22:41:35.792 INFO:tasks.workunit.client.0.smithi121.stdout:0/372: mknod d1/d4/db/d24/d30/d52/d5b/c74 0 2024-08-18T22:41:35.794 INFO:tasks.workunit.client.0.smithi121.stdout:0/373: stat d1/d4/db/d24/d30/d52/d6a 0 2024-08-18T22:41:35.794 INFO:tasks.workunit.client.0.smithi121.stdout:5/323: mkdir d3/d5/d13/d23/d66 0 2024-08-18T22:41:35.794 INFO:tasks.workunit.client.0.smithi121.stdout:7/477: truncate de/f1c 682890 0 2024-08-18T22:41:35.797 INFO:tasks.workunit.client.0.smithi121.stdout:1/474: rename d5/d10/d14/d2a/l5f to d5/d10/d14/d2a/d3a/d87/d6c/d6f/la4 0 2024-08-18T22:41:35.797 INFO:tasks.workunit.client.1.smithi195.stdout:8/114: dwrite d1/f2a [0,4194304] 0 2024-08-18T22:41:35.798 INFO:tasks.workunit.client.0.smithi121.stdout:0/374: rmdir d1/d4/db/d24/df/d8 39 2024-08-18T22:41:35.798 INFO:tasks.workunit.client.1.smithi195.stdout:8/115: stat d1/d3/d1c/d21/f22 0 2024-08-18T22:41:35.800 INFO:tasks.workunit.client.0.smithi121.stdout:1/475: creat d5/d10/d36/fa5 x:0 0 0 2024-08-18T22:41:35.801 INFO:tasks.workunit.client.1.smithi195.stdout:8/116: read - d1/de/df/d1d/d1f/f24 zero size 2024-08-18T22:41:35.801 INFO:tasks.workunit.client.1.smithi195.stdout:8/117: readlink d1/l7 0 2024-08-18T22:41:35.802 INFO:tasks.workunit.client.0.smithi121.stdout:9/502: rename d0/d38/d47/l58 to d0/d38/d9e/df/d3d/d89/d92/la6 0 2024-08-18T22:41:35.802 INFO:tasks.workunit.client.0.smithi121.stdout:0/375: mknod d1/d4/db/d24/df/d8/d71/c75 0 2024-08-18T22:41:35.803 INFO:tasks.workunit.client.0.smithi121.stdout:9/503: chown d0/d38/d44/d7f/l8c 40327707 1 2024-08-18T22:41:35.803 INFO:tasks.workunit.client.1.smithi195.stdout:8/118: symlink d1/d3/l2d 0 2024-08-18T22:41:35.805 INFO:tasks.workunit.client.0.smithi121.stdout:9/504: truncate d0/d38/d52/d5f/f8e 1830654 0 2024-08-18T22:41:35.805 INFO:tasks.workunit.client.1.smithi195.stdout:8/119: truncate d1/de/df/d1d/d1f/f24 371303 0 2024-08-18T22:41:35.805 INFO:tasks.workunit.client.0.smithi121.stdout:9/505: stat d0/d5/fe 0 2024-08-18T22:41:35.807 INFO:tasks.workunit.client.1.smithi195.stdout:8/120: mkdir d1/de/df/d18/d2e 0 2024-08-18T22:41:35.809 INFO:tasks.workunit.client.1.smithi195.stdout:8/121: getdents d1/d3/d1c/d21 0 2024-08-18T22:41:35.817 INFO:tasks.workunit.client.0.smithi121.stdout:0/376: dread d1/d4/db/d18/f22 [0,4194304] 0 2024-08-18T22:41:35.823 INFO:tasks.workunit.client.0.smithi121.stdout:2/314: sync 2024-08-18T22:41:35.823 INFO:tasks.workunit.client.0.smithi121.stdout:8/513: sync 2024-08-18T22:41:35.823 INFO:tasks.workunit.client.0.smithi121.stdout:3/478: sync 2024-08-18T22:41:35.843 INFO:tasks.workunit.client.0.smithi121.stdout:7/478: rename de/d1a/d4f/f91 to de/d1a/d2f/d4b/f96 0 2024-08-18T22:41:35.845 INFO:tasks.workunit.client.0.smithi121.stdout:8/514: dread - d6/d1e/d2d/f7f zero size 2024-08-18T22:41:35.846 INFO:tasks.workunit.client.0.smithi121.stdout:7/479: stat de/d13/d18/d23/d24/d29/c51 0 2024-08-18T22:41:35.846 INFO:tasks.workunit.client.0.smithi121.stdout:2/315: creat d2/d22/f6d x:0 0 0 2024-08-18T22:41:35.846 INFO:tasks.workunit.client.0.smithi121.stdout:0/377: symlink d1/l76 0 2024-08-18T22:41:35.850 INFO:tasks.workunit.client.0.smithi121.stdout:5/324: rename d3/d5/d13/d22 to d3/d5/d27/d35/d67 0 2024-08-18T22:41:35.851 INFO:tasks.workunit.client.0.smithi121.stdout:3/479: dwrite d1e/d1f/d3e/f78 [0,4194304] 0 2024-08-18T22:41:35.851 INFO:tasks.workunit.client.0.smithi121.stdout:2/316: symlink d2/d3/d53/l6e 0 2024-08-18T22:41:35.853 INFO:tasks.workunit.client.0.smithi121.stdout:8/515: symlink d6/d1e/d2d/d78/d45/laf 0 2024-08-18T22:41:35.853 INFO:tasks.workunit.client.0.smithi121.stdout:2/317: readlink d2/d3/d51/l59 0 2024-08-18T22:41:35.855 INFO:tasks.workunit.client.0.smithi121.stdout:5/325: truncate d3/d5/d13/d19/f4a 877878 0 2024-08-18T22:41:35.855 INFO:tasks.workunit.client.0.smithi121.stdout:3/480: chown d1e/d1f/d3e/f79 1747 1 2024-08-18T22:41:35.857 INFO:tasks.workunit.client.0.smithi121.stdout:2/318: truncate d2/d8/d19/f46 1699263 0 2024-08-18T22:41:35.859 INFO:tasks.workunit.client.0.smithi121.stdout:0/378: mknod d1/d4/db/d24/df/c77 0 2024-08-18T22:41:35.861 INFO:tasks.workunit.client.0.smithi121.stdout:8/516: dread d6/dd/d3b/f43 [0,4194304] 0 2024-08-18T22:41:35.861 INFO:tasks.workunit.client.0.smithi121.stdout:9/506: rename d0/d5/fe to d0/d5/dd/d3f/fa7 0 2024-08-18T22:41:35.865 INFO:tasks.workunit.client.0.smithi121.stdout:5/326: mkdir d3/d5/d27/d68 0 2024-08-18T22:41:35.866 INFO:tasks.workunit.client.0.smithi121.stdout:7/480: dread de/d1a/d2f/d4b/d6d/f83 [0,4194304] 0 2024-08-18T22:41:35.868 INFO:tasks.workunit.client.0.smithi121.stdout:0/379: mkdir d1/d4/db/d24/df/d8/d78 0 2024-08-18T22:41:35.868 INFO:tasks.workunit.client.0.smithi121.stdout:3/481: dread d1e/d1f/d25/f27 [0,4194304] 0 2024-08-18T22:41:35.869 INFO:tasks.workunit.client.0.smithi121.stdout:8/517: creat d6/d17/d60/fb0 x:0 0 0 2024-08-18T22:41:35.870 INFO:tasks.workunit.client.0.smithi121.stdout:2/319: dwrite d2/f1d [0,4194304] 0 2024-08-18T22:41:35.871 INFO:tasks.workunit.client.0.smithi121.stdout:7/481: chown de/d13/d18/d23/d24/d29 54330 1 2024-08-18T22:41:35.874 INFO:tasks.workunit.client.0.smithi121.stdout:3/482: truncate d1e/d1f/d25/d2e/f91 185510 0 2024-08-18T22:41:35.876 INFO:tasks.workunit.client.0.smithi121.stdout:7/482: symlink de/d2d/l97 0 2024-08-18T22:41:35.878 INFO:tasks.workunit.client.0.smithi121.stdout:2/320: chown d2/d8/d1f/f32 0 1 2024-08-18T22:41:35.879 INFO:tasks.workunit.client.0.smithi121.stdout:0/380: mkdir d1/d4/db/d24/df/d8/d71/d79 0 2024-08-18T22:41:35.883 INFO:tasks.workunit.client.0.smithi121.stdout:0/381: dread d1/d4/da/f28 [0,4194304] 0 2024-08-18T22:41:35.883 INFO:tasks.workunit.client.0.smithi121.stdout:7/483: unlink de/d13/d18/d23/d24/d29/f5c 0 2024-08-18T22:41:35.884 INFO:tasks.workunit.client.0.smithi121.stdout:8/518: mknod d6/d20/d69/cb1 0 2024-08-18T22:41:35.885 INFO:tasks.workunit.client.0.smithi121.stdout:8/519: fsync d6/d1e/d2d/f7f 0 2024-08-18T22:41:35.886 INFO:tasks.workunit.client.0.smithi121.stdout:9/507: getdents d0/d38/d9e/df/d3d/d89/d92 0 2024-08-18T22:41:35.886 INFO:tasks.workunit.client.0.smithi121.stdout:9/508: fdatasync d0/d38/d52/f6d 0 2024-08-18T22:41:35.889 INFO:tasks.workunit.client.0.smithi121.stdout:5/327: fsync d3/d5/d27/d35/d67/f5b 0 2024-08-18T22:41:35.896 INFO:tasks.workunit.client.0.smithi121.stdout:3/483: creat d1e/d1f/d25/d2e/d36/fac x:0 0 0 2024-08-18T22:41:35.902 INFO:tasks.workunit.client.0.smithi121.stdout:0/382: creat d1/d4/db/d24/df/d8/d78/f7a x:0 0 0 2024-08-18T22:41:35.902 INFO:tasks.workunit.client.0.smithi121.stdout:2/321: link d2/d8/d19/dc/c65 d2/d8/d19/dc/c6f 0 2024-08-18T22:41:35.904 INFO:tasks.workunit.client.0.smithi121.stdout:3/484: symlink d1e/d1f/d5e/lad 0 2024-08-18T22:41:35.905 INFO:tasks.workunit.client.0.smithi121.stdout:5/328: dwrite d3/f12 [4194304,4194304] 0 2024-08-18T22:41:35.905 INFO:tasks.workunit.client.0.smithi121.stdout:0/383: write d1/d4/db/d24/d30/d52/f70 [4589990,66259] 0 2024-08-18T22:41:35.909 INFO:tasks.workunit.client.0.smithi121.stdout:0/384: chown d1/d4/db/d18/d40/c57 479 1 2024-08-18T22:41:35.912 INFO:tasks.workunit.client.0.smithi121.stdout:7/484: fsync de/f1c 0 2024-08-18T22:41:35.912 INFO:tasks.workunit.client.0.smithi121.stdout:2/322: dwrite d2/d8/d19/dc/f2d [0,4194304] 0 2024-08-18T22:41:35.915 INFO:tasks.workunit.client.0.smithi121.stdout:5/329: unlink d3/d5/d13/c15 0 2024-08-18T22:41:35.916 INFO:tasks.workunit.client.0.smithi121.stdout:9/509: write d0/d5/dd/d3f/fa7 [4163713,89590] 0 2024-08-18T22:41:35.918 INFO:tasks.workunit.client.0.smithi121.stdout:3/485: mkdir d1e/d1f/d25/d67/d8e/dae 0 2024-08-18T22:41:35.920 INFO:tasks.workunit.client.0.smithi121.stdout:0/385: creat d1/d4/db/d24/d30/d52/d5b/f7b x:0 0 0 2024-08-18T22:41:35.921 INFO:tasks.workunit.client.0.smithi121.stdout:0/386: dread - d1/d4/db/d24/df/d8/d78/f7a zero size 2024-08-18T22:41:35.922 INFO:tasks.workunit.client.0.smithi121.stdout:2/323: creat d2/d8/d19/d55/f70 x:0 0 0 2024-08-18T22:41:35.926 INFO:tasks.workunit.client.0.smithi121.stdout:7/485: mkdir de/d98 0 2024-08-18T22:41:35.926 INFO:tasks.workunit.client.0.smithi121.stdout:9/510: mknod d0/d5/dd/d3b/ca8 0 2024-08-18T22:41:35.928 INFO:tasks.workunit.client.0.smithi121.stdout:3/486: rename d1e/d1f/d25/d6b/l60 to d1e/d1f/d25/d67/d8e/laf 0 2024-08-18T22:41:35.930 INFO:tasks.workunit.client.0.smithi121.stdout:5/330: dread d3/d5/d27/d35/f36 [0,4194304] 0 2024-08-18T22:41:35.932 INFO:tasks.workunit.client.0.smithi121.stdout:9/511: symlink d0/d38/d44/d7f/la9 0 2024-08-18T22:41:35.933 INFO:tasks.workunit.client.0.smithi121.stdout:7/486: write de/d13/d18/d2e/f32 [2705607,87786] 0 2024-08-18T22:41:35.933 INFO:tasks.workunit.client.0.smithi121.stdout:5/331: chown d3/c56 98776991 1 2024-08-18T22:41:35.934 INFO:tasks.workunit.client.0.smithi121.stdout:0/387: dwrite d1/d4/db/d24/d30/d52/d6a/f34 [0,4194304] 0 2024-08-18T22:41:35.934 INFO:tasks.workunit.client.0.smithi121.stdout:2/324: dwrite d2/d8/d19/d4a/f4d [0,4194304] 0 2024-08-18T22:41:35.936 INFO:tasks.workunit.client.0.smithi121.stdout:9/512: dread - d0/d5/dd/f9c zero size 2024-08-18T22:41:35.937 INFO:tasks.workunit.client.0.smithi121.stdout:2/325: chown d2/d3/l2b 493691 1 2024-08-18T22:41:35.938 INFO:tasks.workunit.client.0.smithi121.stdout:2/326: chown d2 0 1 2024-08-18T22:41:35.940 INFO:tasks.workunit.client.0.smithi121.stdout:7/487: chown de/d13/d18/d23/d24/d29/d43/l57 0 1 2024-08-18T22:41:35.941 INFO:tasks.workunit.client.0.smithi121.stdout:5/332: creat d3/d5c/f69 x:0 0 0 2024-08-18T22:41:35.942 INFO:tasks.workunit.client.0.smithi121.stdout:9/513: creat d0/d38/d9e/df/d3d/d89/faa x:0 0 0 2024-08-18T22:41:35.942 INFO:tasks.workunit.client.0.smithi121.stdout:3/487: link d1e/d1f/d25/d74/l51 d1e/d1f/d5e/lb0 0 2024-08-18T22:41:35.946 INFO:tasks.workunit.client.0.smithi121.stdout:9/514: symlink d0/d5/dd/d2f/d8b/lab 0 2024-08-18T22:41:35.950 INFO:tasks.workunit.client.0.smithi121.stdout:5/333: symlink d3/l6a 0 2024-08-18T22:41:35.950 INFO:tasks.workunit.client.0.smithi121.stdout:2/327: dwrite d2/d8/d19/f47 [4194304,4194304] 0 2024-08-18T22:41:35.950 INFO:tasks.workunit.client.0.smithi121.stdout:3/488: mknod d1e/d1f/d25/d67/d92/cb1 0 2024-08-18T22:41:35.951 INFO:tasks.workunit.client.0.smithi121.stdout:2/328: read d2/d8/d19/f13 [3091553,19953] 0 2024-08-18T22:41:35.952 INFO:tasks.workunit.client.0.smithi121.stdout:9/515: stat d0/d5/dd/d3b/d48/f74 0 2024-08-18T22:41:35.953 INFO:tasks.workunit.client.0.smithi121.stdout:5/334: rename d3/d5/d13/d19/c65 to d3/d5/d13/d23/c6b 0 2024-08-18T22:41:35.956 INFO:tasks.workunit.client.0.smithi121.stdout:2/329: chown d2/d8/d19/dc/l2e 2107 1 2024-08-18T22:41:35.958 INFO:tasks.workunit.client.0.smithi121.stdout:9/516: write d0/d38/d44/d7f/f91 [1326057,81450] 0 2024-08-18T22:41:35.959 INFO:tasks.workunit.client.0.smithi121.stdout:5/335: creat d3/d5/d13/d23/f6c x:0 0 0 2024-08-18T22:41:35.961 INFO:tasks.workunit.client.0.smithi121.stdout:7/488: write de/d1a/d34/d6c/f6f [971782,83028] 0 2024-08-18T22:41:35.961 INFO:tasks.workunit.client.0.smithi121.stdout:3/489: dwrite d1e/d1f/d25/d67/d8e/f95 [0,4194304] 0 2024-08-18T22:41:35.962 INFO:tasks.workunit.client.0.smithi121.stdout:9/517: chown d0/d38/d9e/d45/c9d 13 1 2024-08-18T22:41:35.963 INFO:tasks.workunit.client.0.smithi121.stdout:3/490: fdatasync d1e/d1f/d3e/f78 0 2024-08-18T22:41:35.964 INFO:tasks.workunit.client.0.smithi121.stdout:2/330: rename d2/d8/d19/f6a to d2/d3/d48/f71 0 2024-08-18T22:41:35.964 INFO:tasks.workunit.client.0.smithi121.stdout:7/489: readlink de/d1a/d34/l40 0 2024-08-18T22:41:35.965 INFO:tasks.workunit.client.0.smithi121.stdout:5/336: creat d3/d5/d27/f6d x:0 0 0 2024-08-18T22:41:35.967 INFO:tasks.workunit.client.0.smithi121.stdout:9/518: dread - d0/d5/dd/d3f/f75 zero size 2024-08-18T22:41:35.973 INFO:tasks.workunit.client.0.smithi121.stdout:0/388: dread d1/d4/db/f3c [0,4194304] 0 2024-08-18T22:41:35.975 INFO:tasks.workunit.client.0.smithi121.stdout:5/337: rename d3/d5/d13/d23/f6c to d3/d5/d3c/d3f/f6e 0 2024-08-18T22:41:35.979 INFO:tasks.workunit.client.0.smithi121.stdout:2/331: dwrite d2/d8/d19/f52 [0,4194304] 0 2024-08-18T22:41:35.982 INFO:tasks.workunit.client.0.smithi121.stdout:4/356: sync 2024-08-18T22:41:35.983 INFO:tasks.workunit.client.0.smithi121.stdout:7/490: dwrite de/f1c [0,4194304] 0 2024-08-18T22:41:35.984 INFO:tasks.workunit.client.0.smithi121.stdout:0/389: mkdir d1/d4/db/d24/df/d8/d78/d7c 0 2024-08-18T22:41:35.984 INFO:tasks.workunit.client.0.smithi121.stdout:2/332: readlink d2/d3/d51/l6c 0 2024-08-18T22:41:35.985 INFO:tasks.workunit.client.0.smithi121.stdout:3/491: dwrite d1e/d1f/d25/f27 [0,4194304] 0 2024-08-18T22:41:35.988 INFO:tasks.workunit.client.0.smithi121.stdout:5/338: chown d3/d5/d13/d19/d24/d32/d38/c40 1 1 2024-08-18T22:41:35.989 INFO:tasks.workunit.client.0.smithi121.stdout:9/519: dwrite d0/d38/d9e/df/d61/f6e [0,4194304] 0 2024-08-18T22:41:35.990 INFO:tasks.workunit.client.0.smithi121.stdout:4/357: mknod d2/dc/d16/d59/c76 0 2024-08-18T22:41:35.995 INFO:tasks.workunit.client.0.smithi121.stdout:2/333: mknod d2/c72 0 2024-08-18T22:41:35.995 INFO:tasks.workunit.client.0.smithi121.stdout:5/339: read d3/d5/d13/f3d [1757896,39346] 0 2024-08-18T22:41:35.995 INFO:tasks.workunit.client.0.smithi121.stdout:2/334: chown d2/c5e 1226793308 1 2024-08-18T22:41:35.996 INFO:tasks.workunit.client.0.smithi121.stdout:3/492: stat d1e/d1f/d25/d67/d8e/laf 0 2024-08-18T22:41:35.999 INFO:tasks.workunit.client.0.smithi121.stdout:0/390: link d1/d4/db/d24/d30/d52/f70 d1/d4/db/f7d 0 2024-08-18T22:41:35.999 INFO:tasks.workunit.client.1.smithi195.stdout:3/70: sync 2024-08-18T22:41:35.999 INFO:tasks.workunit.client.1.smithi195.stdout:7/64: sync 2024-08-18T22:41:35.999 INFO:tasks.workunit.client.1.smithi195.stdout:4/38: sync 2024-08-18T22:41:35.999 INFO:tasks.workunit.client.1.smithi195.stdout:2/111: sync 2024-08-18T22:41:36.000 INFO:tasks.workunit.client.1.smithi195.stdout:3/71: read - d7/f10 zero size 2024-08-18T22:41:36.000 INFO:tasks.workunit.client.0.smithi121.stdout:5/340: truncate d3/f1c 1941255 0 2024-08-18T22:41:36.001 INFO:tasks.workunit.client.1.smithi195.stdout:7/65: mkdir dc/d1d 0 2024-08-18T22:41:36.001 INFO:tasks.workunit.client.0.smithi121.stdout:4/358: creat d2/dc/d16/d47/f77 x:0 0 0 2024-08-18T22:41:36.002 INFO:tasks.workunit.client.0.smithi121.stdout:3/493: unlink d1e/d1f/d25/d6b/ca3 0 2024-08-18T22:41:36.003 INFO:tasks.workunit.client.1.smithi195.stdout:2/112: mkdir d1/d22 0 2024-08-18T22:41:36.004 INFO:tasks.workunit.client.0.smithi121.stdout:5/341: write d3/f1c [1584074,124918] 0 2024-08-18T22:41:36.006 INFO:tasks.workunit.client.0.smithi121.stdout:0/391: truncate d1/d4/db/d24/d30/d52/d5b/f7b 1041157 0 2024-08-18T22:41:36.006 INFO:tasks.workunit.client.0.smithi121.stdout:9/520: dwrite d0/d5/f30 [0,4194304] 0 2024-08-18T22:41:36.006 INFO:tasks.workunit.client.0.smithi121.stdout:7/491: link de/d1a/d20/d39/c59 de/d1a/c99 0 2024-08-18T22:41:36.007 INFO:tasks.workunit.client.1.smithi195.stdout:7/66: link fb dc/f1e 0 2024-08-18T22:41:36.008 INFO:tasks.workunit.client.1.smithi195.stdout:3/72: mkdir d7/da/df/d1c 0 2024-08-18T22:41:36.008 INFO:tasks.workunit.client.0.smithi121.stdout:4/359: truncate d2/dc/d1c/f60 534894 0 2024-08-18T22:41:36.008 INFO:tasks.workunit.client.0.smithi121.stdout:5/342: read - d3/d5/d13/d23/f52 zero size 2024-08-18T22:41:36.009 INFO:tasks.workunit.client.0.smithi121.stdout:0/392: dread - d1/d4/db/d24/f42 zero size 2024-08-18T22:41:36.010 INFO:tasks.workunit.client.1.smithi195.stdout:3/73: unlink d7/c1b 0 2024-08-18T22:41:36.011 INFO:tasks.workunit.client.0.smithi121.stdout:3/494: rename d1e/d1f/d25/d67/d8e to d1e/d1f/d3e/db2 0 2024-08-18T22:41:36.011 INFO:tasks.workunit.client.1.smithi195.stdout:7/67: mknod dc/d14/d15/c1f 0 2024-08-18T22:41:36.012 INFO:tasks.workunit.client.0.smithi121.stdout:9/521: creat d0/d38/d52/d5f/fac x:0 0 0 2024-08-18T22:41:36.013 INFO:tasks.workunit.client.1.smithi195.stdout:7/68: chown dc/d14/d15/c1f 1 1 2024-08-18T22:41:36.014 INFO:tasks.workunit.client.0.smithi121.stdout:9/522: truncate d0/d38/d9e/f1f 488736 0 2024-08-18T22:41:36.015 INFO:tasks.workunit.client.0.smithi121.stdout:4/360: creat d2/dc/d16/d22/d2c/d44/f78 x:0 0 0 2024-08-18T22:41:36.015 INFO:tasks.workunit.client.1.smithi195.stdout:2/113: dwrite d1/d8/f17 [0,4194304] 0 2024-08-18T22:41:36.015 INFO:tasks.workunit.client.1.smithi195.stdout:3/74: symlink d7/da/df/d1c/l1d 0 2024-08-18T22:41:36.015 INFO:tasks.workunit.client.1.smithi195.stdout:7/69: fsync dc/f10 0 2024-08-18T22:41:36.016 INFO:tasks.workunit.client.1.smithi195.stdout:4/39: write d0/f4 [1048385,70581] 0 2024-08-18T22:41:36.016 INFO:tasks.workunit.client.0.smithi121.stdout:4/361: stat d2/dc/c28 0 2024-08-18T22:41:36.016 INFO:tasks.workunit.client.0.smithi121.stdout:0/393: creat d1/d4/db/d24/d30/d52/f7e x:0 0 0 2024-08-18T22:41:36.016 INFO:tasks.workunit.client.0.smithi121.stdout:9/523: write d0/d38/d9e/df/d3d/f64 [508639,90667] 0 2024-08-18T22:41:36.017 INFO:tasks.workunit.client.0.smithi121.stdout:4/362: chown d2/dc/d16/d59 1734941224 1 2024-08-18T22:41:36.018 INFO:tasks.workunit.client.0.smithi121.stdout:3/495: creat d1e/d1f/d25/d6b/d66/fb3 x:0 0 0 2024-08-18T22:41:36.019 INFO:tasks.workunit.client.1.smithi195.stdout:3/75: unlink d7/da/df/d1c/l1d 0 2024-08-18T22:41:36.019 INFO:tasks.workunit.client.0.smithi121.stdout:2/335: getdents d2 0 2024-08-18T22:41:36.020 INFO:tasks.workunit.client.0.smithi121.stdout:9/524: fdatasync d0/d5/dd/d3f/fa7 0 2024-08-18T22:41:36.021 INFO:tasks.workunit.client.1.smithi195.stdout:4/40: dread d0/f3 [0,4194304] 0 2024-08-18T22:41:36.022 INFO:tasks.workunit.client.1.smithi195.stdout:7/70: mknod dc/d1d/c20 0 2024-08-18T22:41:36.022 INFO:tasks.workunit.client.0.smithi121.stdout:3/496: write d1e/d1f/d25/d6b/d66/fb3 [950654,88472] 0 2024-08-18T22:41:36.023 INFO:tasks.workunit.client.1.smithi195.stdout:3/76: symlink d7/da/df/l1e 0 2024-08-18T22:41:36.023 INFO:tasks.workunit.client.0.smithi121.stdout:9/525: chown d0/d38/d9e/df/d61/d90/f77 25 1 2024-08-18T22:41:36.023 INFO:tasks.workunit.client.0.smithi121.stdout:1/476: sync 2024-08-18T22:41:36.025 INFO:tasks.workunit.client.1.smithi195.stdout:2/114: unlink d1/d9/f19 0 2024-08-18T22:41:36.025 INFO:tasks.workunit.client.0.smithi121.stdout:4/363: creat d2/dc/d16/f79 x:0 0 0 2024-08-18T22:41:36.026 INFO:tasks.workunit.client.0.smithi121.stdout:2/336: mkdir d2/d73 0 2024-08-18T22:41:36.027 INFO:tasks.workunit.client.0.smithi121.stdout:9/526: fdatasync d0/d38/d9e/df/d61/d90/f70 0 2024-08-18T22:41:36.027 INFO:tasks.workunit.client.0.smithi121.stdout:0/394: mknod d1/d4/db/d24/df/d8/c7f 0 2024-08-18T22:41:36.028 INFO:tasks.workunit.client.1.smithi195.stdout:4/41: rmdir d0/d9 39 2024-08-18T22:41:36.029 INFO:tasks.workunit.client.0.smithi121.stdout:1/477: creat d5/d10/d14/d2a/fa6 x:0 0 0 2024-08-18T22:41:36.029 INFO:tasks.workunit.client.1.smithi195.stdout:4/42: read d0/f3 [2952492,128215] 0 2024-08-18T22:41:36.031 INFO:tasks.workunit.client.0.smithi121.stdout:0/395: write d1/d4/db/d24/d30/d52/f5d [796520,38458] 0 2024-08-18T22:41:36.031 INFO:tasks.workunit.client.0.smithi121.stdout:9/527: write d0/d38/d9e/df/d3d/d89/faa [731456,128223] 0 2024-08-18T22:41:36.032 INFO:tasks.workunit.client.0.smithi121.stdout:3/497: rename d1e/d1f/d25/d74/d85 to d1e/d1f/d25/d6b/db4 0 2024-08-18T22:41:36.032 INFO:tasks.workunit.client.0.smithi121.stdout:9/528: chown d0 87 1 2024-08-18T22:41:36.032 INFO:tasks.workunit.client.1.smithi195.stdout:2/115: dwrite d1/d8/f11 [0,4194304] 0 2024-08-18T22:41:36.033 INFO:tasks.workunit.client.0.smithi121.stdout:7/492: creat de/d1a/d20/d39/f9a x:0 0 0 2024-08-18T22:41:36.035 INFO:tasks.workunit.client.0.smithi121.stdout:0/396: write d1/d4/db/d18/d1c/f59 [1591771,36288] 0 2024-08-18T22:41:36.035 INFO:tasks.workunit.client.0.smithi121.stdout:2/337: symlink d2/d8/d19/dc/l74 0 2024-08-18T22:41:36.036 INFO:tasks.workunit.client.0.smithi121.stdout:9/529: write d0/d38/d9e/f1f [876759,225] 0 2024-08-18T22:41:36.037 INFO:tasks.workunit.client.0.smithi121.stdout:7/493: readlink de/d13/d18/d2e/l3e 0 2024-08-18T22:41:36.037 INFO:tasks.workunit.client.0.smithi121.stdout:4/364: mkdir d2/dc/d16/d22/d2c/d7a 0 2024-08-18T22:41:36.037 INFO:tasks.workunit.client.0.smithi121.stdout:3/498: dread - d1e/d1f/d25/d67/d92/da0/fa8 zero size 2024-08-18T22:41:36.038 INFO:tasks.workunit.client.1.smithi195.stdout:2/116: readlink d1/l4 0 2024-08-18T22:41:36.038 INFO:tasks.workunit.client.1.smithi195.stdout:2/117: chown d1/d9/fc 18 1 2024-08-18T22:41:36.039 INFO:tasks.workunit.client.0.smithi121.stdout:1/478: write d5/d10/d14/d2a/d3a/d87/d6c/d6f/d82/d15/f5b [215350,124884] 0 2024-08-18T22:41:36.040 INFO:tasks.workunit.client.1.smithi195.stdout:7/71: write f1 [2526253,67622] 0 2024-08-18T22:41:36.041 INFO:tasks.workunit.client.1.smithi195.stdout:4/43: creat d0/fd x:0 0 0 2024-08-18T22:41:36.042 INFO:tasks.workunit.client.0.smithi121.stdout:0/397: write d1/d4/db/d18/d2e/f68 [210969,93814] 0 2024-08-18T22:41:36.043 INFO:tasks.workunit.client.1.smithi195.stdout:3/77: truncate d7/da/fb 1238502 0 2024-08-18T22:41:36.043 INFO:tasks.workunit.client.0.smithi121.stdout:5/343: dread d3/d5/d13/f3d [0,4194304] 0 2024-08-18T22:41:36.045 INFO:tasks.workunit.client.1.smithi195.stdout:2/118: rename d1/l4 to d1/l23 0 2024-08-18T22:41:36.045 INFO:tasks.workunit.client.0.smithi121.stdout:5/344: dread - d3/d5/d27/d35/d67/f5b zero size 2024-08-18T22:41:36.045 INFO:tasks.workunit.client.0.smithi121.stdout:3/499: mknod d1e/d1f/da6/cb5 0 2024-08-18T22:41:36.045 INFO:tasks.workunit.client.0.smithi121.stdout:7/494: truncate de/d1a/d20/d39/f9a 302266 0 2024-08-18T22:41:36.046 INFO:tasks.workunit.client.1.smithi195.stdout:4/44: chown d0/d9/lc 989594452 1 2024-08-18T22:41:36.047 INFO:tasks.workunit.client.0.smithi121.stdout:5/345: fsync d3/d5/d13/d19/f1e 0 2024-08-18T22:41:36.048 INFO:tasks.workunit.client.0.smithi121.stdout:2/338: symlink d2/d3/d48/l75 0 2024-08-18T22:41:36.048 INFO:tasks.workunit.client.1.smithi195.stdout:3/78: mkdir d7/d1f 0 2024-08-18T22:41:36.048 INFO:tasks.workunit.client.0.smithi121.stdout:5/346: stat d3/d5/d27/d35/d67/f4b 0 2024-08-18T22:41:36.049 INFO:tasks.workunit.client.1.smithi195.stdout:3/79: fsync d7/f19 0 2024-08-18T22:41:36.049 INFO:tasks.workunit.client.1.smithi195.stdout:7/72: dwrite dc/d14/d15/d17/f19 [0,4194304] 0 2024-08-18T22:41:36.049 INFO:tasks.workunit.client.1.smithi195.stdout:4/45: creat d0/d9/fe x:0 0 0 2024-08-18T22:41:36.050 INFO:tasks.workunit.client.0.smithi121.stdout:9/530: creat d0/fad x:0 0 0 2024-08-18T22:41:36.051 INFO:tasks.workunit.client.1.smithi195.stdout:3/80: write d7/f9 [1912845,30731] 0 2024-08-18T22:41:36.052 INFO:tasks.workunit.client.1.smithi195.stdout:3/81: readlink d7/da/df/l1e 0 2024-08-18T22:41:36.052 INFO:tasks.workunit.client.0.smithi121.stdout:3/500: dread d1e/d1f/d3e/db2/f95 [0,4194304] 0 2024-08-18T22:41:36.052 INFO:tasks.workunit.client.0.smithi121.stdout:4/365: rename d2/dc/l56 to d2/dc/d16/d22/l7b 0 2024-08-18T22:41:36.053 INFO:tasks.workunit.client.1.smithi195.stdout:3/82: chown d7/da/ld 21274175 1 2024-08-18T22:41:36.054 INFO:tasks.workunit.client.0.smithi121.stdout:3/501: write d1e/d1f/d25/f7b [183524,125378] 0 2024-08-18T22:41:36.054 INFO:tasks.workunit.client.1.smithi195.stdout:7/73: creat dc/d14/f21 x:0 0 0 2024-08-18T22:41:36.054 INFO:tasks.workunit.client.0.smithi121.stdout:7/495: chown de/d1a/d2f/d4b/f64 0 1 2024-08-18T22:41:36.055 INFO:tasks.workunit.client.0.smithi121.stdout:7/496: fdatasync de/f28 0 2024-08-18T22:41:36.056 INFO:tasks.workunit.client.1.smithi195.stdout:7/74: mkdir dc/d22 0 2024-08-18T22:41:36.057 INFO:tasks.workunit.client.1.smithi195.stdout:7/75: chown dc/l1b 2 1 2024-08-18T22:41:36.057 INFO:tasks.workunit.client.0.smithi121.stdout:3/502: dread d1e/d1f/d25/d2e/f91 [0,4194304] 0 2024-08-18T22:41:36.058 INFO:tasks.workunit.client.1.smithi195.stdout:4/46: creat d0/ff x:0 0 0 2024-08-18T22:41:36.058 INFO:tasks.workunit.client.1.smithi195.stdout:7/76: chown dc/d14/d15/d17/d18 1758209 1 2024-08-18T22:41:36.059 INFO:tasks.workunit.client.1.smithi195.stdout:3/83: getdents d7/d1f 0 2024-08-18T22:41:36.059 INFO:tasks.workunit.client.1.smithi195.stdout:4/47: read d0/f4 [1427589,75176] 0 2024-08-18T22:41:36.060 INFO:tasks.workunit.client.0.smithi121.stdout:3/503: rename d1e/d1f to d1e/d1f/d3e/db2/db6 22 2024-08-18T22:41:36.060 INFO:tasks.workunit.client.1.smithi195.stdout:7/77: mknod dc/d14/d15/c23 0 2024-08-18T22:41:36.062 INFO:tasks.workunit.client.0.smithi121.stdout:5/347: write d3/d5/d3c/d3f/f6e [460126,17345] 0 2024-08-18T22:41:36.062 INFO:tasks.workunit.client.1.smithi195.stdout:5/61: sync 2024-08-18T22:41:36.062 INFO:tasks.workunit.client.1.smithi195.stdout:8/122: sync 2024-08-18T22:41:36.063 INFO:tasks.workunit.client.1.smithi195.stdout:6/63: sync 2024-08-18T22:41:36.063 INFO:tasks.workunit.client.1.smithi195.stdout:0/133: sync 2024-08-18T22:41:36.063 INFO:tasks.workunit.client.1.smithi195.stdout:9/117: sync 2024-08-18T22:41:36.063 INFO:tasks.workunit.client.1.smithi195.stdout:1/246: sync 2024-08-18T22:41:36.063 INFO:tasks.workunit.client.1.smithi195.stdout:3/84: creat d7/da/df/f20 x:0 0 0 2024-08-18T22:41:36.063 INFO:tasks.workunit.client.0.smithi121.stdout:0/398: mknod d1/d4/db/d24/df/c80 0 2024-08-18T22:41:36.063 INFO:tasks.workunit.client.0.smithi121.stdout:0/399: fdatasync d1/d4/f72 0 2024-08-18T22:41:36.064 INFO:tasks.workunit.client.1.smithi195.stdout:9/118: stat d1c/l29 0 2024-08-18T22:41:36.064 INFO:tasks.workunit.client.1.smithi195.stdout:0/134: chown d0 145212 1 2024-08-18T22:41:36.067 INFO:tasks.workunit.client.1.smithi195.stdout:9/119: dread - f19 zero size 2024-08-18T22:41:36.068 INFO:tasks.workunit.client.0.smithi121.stdout:1/479: truncate d5/d10/d14/f45 642621 0 2024-08-18T22:41:36.068 INFO:tasks.workunit.client.1.smithi195.stdout:5/62: creat d0/f11 x:0 0 0 2024-08-18T22:41:36.069 INFO:tasks.workunit.client.0.smithi121.stdout:4/366: mkdir d2/d7c 0 2024-08-18T22:41:36.069 INFO:tasks.workunit.client.0.smithi121.stdout:1/480: chown d5/d10/d14/d2a/d91 36 1 2024-08-18T22:41:36.070 INFO:tasks.workunit.client.0.smithi121.stdout:7/497: mknod de/d1a/d2f/d4b/c9b 0 2024-08-18T22:41:36.070 INFO:tasks.workunit.client.0.smithi121.stdout:4/367: write d2/dc/d1c/f6a [97732,4409] 0 2024-08-18T22:41:36.071 INFO:tasks.workunit.client.0.smithi121.stdout:2/339: truncate d2/f4b 3990536 0 2024-08-18T22:41:36.072 INFO:tasks.workunit.client.1.smithi195.stdout:6/64: read da/fd [4536607,48380] 0 2024-08-18T22:41:36.072 INFO:tasks.workunit.client.1.smithi195.stdout:8/123: mknod d1/de/d27/c2f 0 2024-08-18T22:41:36.073 INFO:tasks.workunit.client.1.smithi195.stdout:0/135: write d0/f1c [656495,69159] 0 2024-08-18T22:41:36.074 INFO:tasks.workunit.client.0.smithi121.stdout:9/531: creat d0/d5/dd/d3b/fae x:0 0 0 2024-08-18T22:41:36.074 INFO:tasks.workunit.client.0.smithi121.stdout:1/481: mkdir d5/d10/d67/da7 0 2024-08-18T22:41:36.075 INFO:tasks.workunit.client.1.smithi195.stdout:9/120: chown c1b 109960998 1 2024-08-18T22:41:36.075 INFO:tasks.workunit.client.0.smithi121.stdout:7/498: rmdir de/d13/d18/d23/d24/d25 39 2024-08-18T22:41:36.077 INFO:tasks.workunit.client.0.smithi121.stdout:1/482: write d5/d10/d14/d2a/d3a/d87/d6c/d6f/f8f [1174306,22898] 0 2024-08-18T22:41:36.077 INFO:tasks.workunit.client.1.smithi195.stdout:8/124: chown d1/de/df/d18/c2c 95966 1 2024-08-18T22:41:36.080 INFO:tasks.workunit.client.0.smithi121.stdout:8/520: sync 2024-08-18T22:41:36.080 INFO:tasks.workunit.client.0.smithi121.stdout:5/348: creat d3/d5/d13/f6f x:0 0 0 2024-08-18T22:41:36.084 INFO:tasks.workunit.client.0.smithi121.stdout:9/532: rename d0/d38/d9e/d18/f59 to d0/d38/d9e/df/d3d/faf 0 2024-08-18T22:41:36.085 INFO:tasks.workunit.client.1.smithi195.stdout:4/48: dwrite d0/d9/fe [0,4194304] 0 2024-08-18T22:41:36.085 INFO:tasks.workunit.client.1.smithi195.stdout:0/136: creat d0/dc/d11/f27 x:0 0 0 2024-08-18T22:41:36.086 INFO:tasks.workunit.client.0.smithi121.stdout:3/504: getdents d1e/d1f/d25 0 2024-08-18T22:41:36.087 INFO:tasks.workunit.client.0.smithi121.stdout:7/499: rmdir de/d1a/d2f/d36 39 2024-08-18T22:41:36.088 INFO:tasks.workunit.client.0.smithi121.stdout:8/521: dwrite d6/d17/f51 [0,4194304] 0 2024-08-18T22:41:36.089 INFO:tasks.workunit.client.0.smithi121.stdout:8/522: chown d6/d17/d18/d83 3634466 1 2024-08-18T22:41:36.090 INFO:tasks.workunit.client.1.smithi195.stdout:9/121: fdatasync f3 0 2024-08-18T22:41:36.091 INFO:tasks.workunit.client.1.smithi195.stdout:0/137: fdatasync d0/dc/d11/f15 0 2024-08-18T22:41:36.091 INFO:tasks.workunit.client.0.smithi121.stdout:0/400: getdents d1/d4/da 0 2024-08-18T22:41:36.092 INFO:tasks.workunit.client.0.smithi121.stdout:5/349: creat d3/d5/d13/d19/d24/d32/d38/f70 x:0 0 0 2024-08-18T22:41:36.093 INFO:tasks.workunit.client.1.smithi195.stdout:6/65: creat da/db/f17 x:0 0 0 2024-08-18T22:41:36.095 INFO:tasks.workunit.client.0.smithi121.stdout:4/368: link d2/dc/d16/f36 d2/dc/d1c/f7d 0 2024-08-18T22:41:36.096 INFO:tasks.workunit.client.0.smithi121.stdout:2/340: dread d2/d8/f39 [0,4194304] 0 2024-08-18T22:41:36.098 INFO:tasks.workunit.client.0.smithi121.stdout:3/505: dwrite d1e/d1f/d3e/f73 [0,4194304] 0 2024-08-18T22:41:36.101 INFO:tasks.workunit.client.1.smithi195.stdout:3/85: dwrite d7/f18 [0,4194304] 0 2024-08-18T22:41:36.102 INFO:tasks.workunit.client.1.smithi195.stdout:5/63: truncate d0/f9 4165503 0 2024-08-18T22:41:36.102 INFO:tasks.workunit.client.1.smithi195.stdout:1/247: dwrite da/d3d/f48 [0,4194304] 0 2024-08-18T22:41:36.107 INFO:tasks.workunit.client.0.smithi121.stdout:7/500: dread de/d13/d18/f60 [0,4194304] 0 2024-08-18T22:41:36.107 INFO:tasks.workunit.client.0.smithi121.stdout:5/350: write d3/d5/d27/f2e [4738667,96946] 0 2024-08-18T22:41:36.109 INFO:tasks.workunit.client.0.smithi121.stdout:2/341: rename d2/d3/d53/f62 to d2/d8/d1f/f76 0 2024-08-18T22:41:36.111 INFO:tasks.workunit.client.1.smithi195.stdout:9/122: creat d1c/f2c x:0 0 0 2024-08-18T22:41:36.112 INFO:tasks.workunit.client.0.smithi121.stdout:1/483: getdents d5/d10 0 2024-08-18T22:41:36.115 INFO:tasks.workunit.client.1.smithi195.stdout:5/64: chown d0/d2/l10 17 1 2024-08-18T22:41:36.115 INFO:tasks.workunit.client.0.smithi121.stdout:4/369: dwrite d2/dc/f52 [0,4194304] 0 2024-08-18T22:41:36.115 INFO:tasks.workunit.client.1.smithi195.stdout:8/125: dwrite d1/f5 [0,4194304] 0 2024-08-18T22:41:36.119 INFO:tasks.workunit.client.0.smithi121.stdout:0/401: dwrite d1/d4/db/d18/d1c/f36 [4194304,4194304] 0 2024-08-18T22:41:36.120 INFO:tasks.workunit.client.1.smithi195.stdout:6/66: creat da/db/f18 x:0 0 0 2024-08-18T22:41:36.120 INFO:tasks.workunit.client.1.smithi195.stdout:3/86: write d7/da/df/f20 [890433,84212] 0 2024-08-18T22:41:36.120 INFO:tasks.workunit.client.1.smithi195.stdout:9/123: truncate d1c/f22 673586 0 2024-08-18T22:41:36.120 INFO:tasks.workunit.client.1.smithi195.stdout:5/65: dread - d0/f11 zero size 2024-08-18T22:41:36.120 INFO:tasks.workunit.client.1.smithi195.stdout:1/248: unlink da/d18/d28/d31/d3b/c52 0 2024-08-18T22:41:36.122 INFO:tasks.workunit.client.0.smithi121.stdout:2/342: truncate d2/d22/f42 836779 0 2024-08-18T22:41:36.122 INFO:tasks.workunit.client.0.smithi121.stdout:8/523: write d6/f8e [1290379,18989] 0 2024-08-18T22:41:36.124 INFO:tasks.workunit.client.0.smithi121.stdout:2/343: chown d2/d8/f39 43461915 1 2024-08-18T22:41:36.124 INFO:tasks.workunit.client.0.smithi121.stdout:1/484: dread - d5/d10/d14/d2a/d3a/d87/d6c/d6f/d82/f39 zero size 2024-08-18T22:41:36.125 INFO:tasks.workunit.client.1.smithi195.stdout:6/67: readlink da/db/d10/l16 0 2024-08-18T22:41:36.125 INFO:tasks.workunit.client.1.smithi195.stdout:4/49: dwrite d0/f4 [0,4194304] 0 2024-08-18T22:41:36.126 INFO:tasks.workunit.client.0.smithi121.stdout:0/402: readlink d1/d47/l63 0 2024-08-18T22:41:36.126 INFO:tasks.workunit.client.0.smithi121.stdout:9/533: dread d0/d38/d9e/d18/f4f [0,4194304] 0 2024-08-18T22:41:36.130 INFO:tasks.workunit.client.1.smithi195.stdout:9/124: unlink c1a 0 2024-08-18T22:41:36.131 INFO:tasks.workunit.client.1.smithi195.stdout:3/87: fsync d7/da/df/f20 0 2024-08-18T22:41:36.131 INFO:tasks.workunit.client.0.smithi121.stdout:4/370: rename d2/dc/d16/d22/d2c/d44/f57 to d2/dc/d1c/f7e 0 2024-08-18T22:41:36.131 INFO:tasks.workunit.client.0.smithi121.stdout:1/485: rmdir d5 39 2024-08-18T22:41:36.132 INFO:tasks.workunit.client.1.smithi195.stdout:0/138: getdents d0/dc/df 0 2024-08-18T22:41:36.133 INFO:tasks.workunit.client.1.smithi195.stdout:5/66: mknod d0/d3/d8/c12 0 2024-08-18T22:41:36.133 INFO:tasks.workunit.client.0.smithi121.stdout:5/351: dread d3/f2a [0,4194304] 0 2024-08-18T22:41:36.137 INFO:tasks.workunit.client.0.smithi121.stdout:9/534: mknod d0/d5/dd/d2f/cb0 0 2024-08-18T22:41:36.138 INFO:tasks.workunit.client.1.smithi195.stdout:8/126: rmdir d1/de/d20 0 2024-08-18T22:41:36.140 INFO:tasks.workunit.client.1.smithi195.stdout:3/88: mknod d7/da/df/c21 0 2024-08-18T22:41:36.142 INFO:tasks.workunit.client.1.smithi195.stdout:0/139: mknod d0/dc/df/c28 0 2024-08-18T22:41:36.142 INFO:tasks.workunit.client.1.smithi195.stdout:8/127: rmdir d1/d3 39 2024-08-18T22:41:36.143 INFO:tasks.workunit.client.0.smithi121.stdout:5/352: chown d3/d5/d27/d68 4348908 1 2024-08-18T22:41:36.143 INFO:tasks.workunit.client.0.smithi121.stdout:0/403: creat d1/d47/f81 x:0 0 0 2024-08-18T22:41:36.144 INFO:tasks.workunit.client.0.smithi121.stdout:2/344: dwrite d2/d8/d19/f47 [4194304,4194304] 0 2024-08-18T22:41:36.145 INFO:tasks.workunit.client.1.smithi195.stdout:3/89: readlink d7/da/df/l16 0 2024-08-18T22:41:36.146 INFO:tasks.workunit.client.1.smithi195.stdout:1/249: rename da/c57 to da/d18/d28/d31/c58 0 2024-08-18T22:41:36.148 INFO:tasks.workunit.client.1.smithi195.stdout:4/50: dwrite d0/f3 [4194304,4194304] 0 2024-08-18T22:41:36.148 INFO:tasks.workunit.client.1.smithi195.stdout:3/90: write d7/da/df/f1a [683244,57471] 0 2024-08-18T22:41:36.149 INFO:tasks.workunit.client.1.smithi195.stdout:1/250: chown da/d18/d28/f34 21944 1 2024-08-18T22:41:36.150 INFO:tasks.workunit.client.0.smithi121.stdout:5/353: dread - d3/d5/d13/d19/f30 zero size 2024-08-18T22:41:36.150 INFO:tasks.workunit.client.0.smithi121.stdout:7/501: dwrite de/d1a/d63/f6b [8388608,4194304] 0 2024-08-18T22:41:36.151 INFO:tasks.workunit.client.0.smithi121.stdout:1/486: chown d5/d10/d14/d34/f9c 5664268 1 2024-08-18T22:41:36.154 INFO:tasks.workunit.client.0.smithi121.stdout:4/371: creat d2/d7c/f7f x:0 0 0 2024-08-18T22:41:36.154 INFO:tasks.workunit.client.1.smithi195.stdout:9/125: getdents d1c 0 2024-08-18T22:41:36.154 INFO:tasks.workunit.client.1.smithi195.stdout:1/251: truncate da/d18/d28/f2f 287876 0 2024-08-18T22:41:36.154 INFO:tasks.workunit.client.1.smithi195.stdout:8/128: symlink d1/l30 0 2024-08-18T22:41:36.155 INFO:tasks.workunit.client.0.smithi121.stdout:2/345: rename d2/d22 to d2/d3/d48/d77 0 2024-08-18T22:41:36.155 INFO:tasks.workunit.client.0.smithi121.stdout:3/506: dread d1e/d1f/d3e/f79 [0,4194304] 0 2024-08-18T22:41:36.155 INFO:tasks.workunit.client.1.smithi195.stdout:0/140: creat d0/dc/dd/f29 x:0 0 0 2024-08-18T22:41:36.157 INFO:tasks.workunit.client.0.smithi121.stdout:4/372: chown d2/dc/d16/c17 328487 1 2024-08-18T22:41:36.158 INFO:tasks.workunit.client.1.smithi195.stdout:4/51: mknod d0/d7/c10 0 2024-08-18T22:41:36.158 INFO:tasks.workunit.client.0.smithi121.stdout:9/535: dwrite d0/d5/f98 [0,4194304] 0 2024-08-18T22:41:36.158 INFO:tasks.workunit.client.0.smithi121.stdout:0/404: symlink d1/d4/db/d24/d30/d52/d6a/l82 0 2024-08-18T22:41:36.158 INFO:tasks.workunit.client.0.smithi121.stdout:3/507: write ff [3587312,130151] 0 2024-08-18T22:41:36.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:41:35 smithi195 ceph-mon[23370]: pgmap v243: 65 pgs: 65 active+clean; 787 MiB data, 4.0 GiB used, 532 GiB / 536 GiB avail; 4.1 MiB/s rd, 88 MiB/s wr, 353 op/s 2024-08-18T22:41:36.159 INFO:tasks.workunit.client.1.smithi195.stdout:9/126: symlink d1c/l2d 0 2024-08-18T22:41:36.159 INFO:tasks.workunit.client.1.smithi195.stdout:4/52: write d0/f3 [258978,96744] 0 2024-08-18T22:41:36.161 INFO:tasks.workunit.client.1.smithi195.stdout:8/129: mkdir d1/de/d31 0 2024-08-18T22:41:36.163 INFO:tasks.workunit.client.0.smithi121.stdout:1/487: mknod d5/d10/ca8 0 2024-08-18T22:41:36.164 INFO:tasks.workunit.client.1.smithi195.stdout:4/53: write d0/f3 [9421409,117687] 0 2024-08-18T22:41:36.164 INFO:tasks.workunit.client.1.smithi195.stdout:1/252: symlink da/d3d/l59 0 2024-08-18T22:41:36.164 INFO:tasks.workunit.client.1.smithi195.stdout:0/141: unlink d0/dc/df/c13 0 2024-08-18T22:41:36.165 INFO:tasks.workunit.client.0.smithi121.stdout:4/373: read - d2/dc/d16/f75 zero size 2024-08-18T22:41:36.166 INFO:tasks.workunit.client.1.smithi195.stdout:0/142: truncate d0/dc/d11/f27 18494 0 2024-08-18T22:41:36.166 INFO:tasks.workunit.client.1.smithi195.stdout:3/91: symlink d7/l22 0 2024-08-18T22:41:36.167 INFO:tasks.workunit.client.0.smithi121.stdout:7/502: mkdir de/d1a/d34/d38/d5f/d9c 0 2024-08-18T22:41:36.168 INFO:tasks.workunit.client.0.smithi121.stdout:0/405: mkdir d1/d4/db/d18/d40/d83 0 2024-08-18T22:41:36.170 INFO:tasks.workunit.client.0.smithi121.stdout:4/374: write d2/f3f [970226,32372] 0 2024-08-18T22:41:36.171 INFO:tasks.workunit.client.1.smithi195.stdout:9/127: unlink d1c/f2b 0 2024-08-18T22:41:36.172 INFO:tasks.workunit.client.0.smithi121.stdout:8/524: dwrite d6/d17/d18/f3a [0,4194304] 0 2024-08-18T22:41:36.174 INFO:tasks.workunit.client.0.smithi121.stdout:9/536: creat d0/d38/d9e/df/d3d/d89/fb1 x:0 0 0 2024-08-18T22:41:36.176 INFO:tasks.workunit.client.0.smithi121.stdout:0/406: write d1/d4/db/d24/f6f [435831,129643] 0 2024-08-18T22:41:36.177 INFO:tasks.workunit.client.1.smithi195.stdout:6/68: truncate da/db/d10/f12 4409020 0 2024-08-18T22:41:36.177 INFO:tasks.workunit.client.0.smithi121.stdout:7/503: truncate de/d13/d18/d23/d24/d29/d43/d7f/f80 238786 0 2024-08-18T22:41:36.179 INFO:tasks.workunit.client.0.smithi121.stdout:2/346: getdents d2/d8/d19/d4a 0 2024-08-18T22:41:36.179 INFO:tasks.workunit.client.1.smithi195.stdout:0/143: mknod d0/dc/dd/c2a 0 2024-08-18T22:41:36.179 INFO:tasks.workunit.client.1.smithi195.stdout:3/92: rmdir d7/da 39 2024-08-18T22:41:36.181 INFO:tasks.workunit.client.1.smithi195.stdout:9/128: symlink d1c/l2e 0 2024-08-18T22:41:36.181 INFO:tasks.workunit.client.1.smithi195.stdout:8/130: rmdir d1/d3 39 2024-08-18T22:41:36.182 INFO:tasks.workunit.client.1.smithi195.stdout:1/253: dwrite da/f13 [0,4194304] 0 2024-08-18T22:41:36.182 INFO:tasks.workunit.client.0.smithi121.stdout:8/525: read f5 [2822423,82315] 0 2024-08-18T22:41:36.183 INFO:tasks.workunit.client.0.smithi121.stdout:7/504: stat de/d2d/l67 0 2024-08-18T22:41:36.183 INFO:tasks.workunit.client.1.smithi195.stdout:6/69: chown c4 132434815 1 2024-08-18T22:41:36.184 INFO:tasks.workunit.client.1.smithi195.stdout:0/144: write d0/dc/dd/f29 [28930,117914] 0 2024-08-18T22:41:36.184 INFO:tasks.workunit.client.0.smithi121.stdout:0/407: write d1/d4/db/d24/df/d8/d78/f7a [376577,90215] 0 2024-08-18T22:41:36.186 INFO:tasks.workunit.client.1.smithi195.stdout:8/131: fdatasync d1/d3/f2b 0 2024-08-18T22:41:36.187 INFO:tasks.workunit.client.1.smithi195.stdout:6/70: mkdir da/db/d19 0 2024-08-18T22:41:36.187 INFO:tasks.workunit.client.0.smithi121.stdout:9/537: dwrite d0/fad [0,4194304] 0 2024-08-18T22:41:36.188 INFO:tasks.workunit.client.1.smithi195.stdout:6/71: write f6 [6779166,116401] 0 2024-08-18T22:41:36.188 INFO:tasks.workunit.client.1.smithi195.stdout:3/93: rename f4 to d7/da/df/d1c/f23 0 2024-08-18T22:41:36.189 INFO:tasks.workunit.client.0.smithi121.stdout:7/505: mkdir de/d13/d18/d9d 0 2024-08-18T22:41:36.191 INFO:tasks.workunit.client.0.smithi121.stdout:8/526: truncate d6/d1e/f47 368330 0 2024-08-18T22:41:36.193 INFO:tasks.workunit.client.1.smithi195.stdout:8/132: rmdir d1/de/df/d18 39 2024-08-18T22:41:36.193 INFO:tasks.workunit.client.1.smithi195.stdout:4/54: fsync d0/f3 0 2024-08-18T22:41:36.194 INFO:tasks.workunit.client.1.smithi195.stdout:6/72: readlink da/db/d10/l14 0 2024-08-18T22:41:36.195 INFO:tasks.workunit.client.0.smithi121.stdout:9/538: rename d0/d38/d47 to d0/d38/d9e/df/d61/db2 0 2024-08-18T22:41:36.195 INFO:tasks.workunit.client.0.smithi121.stdout:7/506: read de/d13/d18/d23/d24/d29/f4d [159380,56280] 0 2024-08-18T22:41:36.195 INFO:tasks.workunit.client.1.smithi195.stdout:4/55: write d0/f8 [9740863,48357] 0 2024-08-18T22:41:36.198 INFO:tasks.workunit.client.1.smithi195.stdout:6/73: write f7 [250026,62048] 0 2024-08-18T22:41:36.200 INFO:tasks.workunit.client.1.smithi195.stdout:4/56: rmdir d0/d7 39 2024-08-18T22:41:36.203 INFO:tasks.workunit.client.0.smithi121.stdout:8/527: rename d6/d17/d37/la1 to d6/d1e/d2d/d78/d45/lb2 0 2024-08-18T22:41:36.203 INFO:tasks.workunit.client.1.smithi195.stdout:8/133: creat d1/de/df/d1d/f32 x:0 0 0 2024-08-18T22:41:36.206 INFO:tasks.workunit.client.1.smithi195.stdout:6/74: symlink da/l1a 0 2024-08-18T22:41:36.206 INFO:tasks.workunit.client.1.smithi195.stdout:5/67: dwrite d0/f9 [0,4194304] 0 2024-08-18T22:41:36.207 INFO:tasks.workunit.client.0.smithi121.stdout:2/347: dread d2/f4b [0,4194304] 0 2024-08-18T22:41:36.208 INFO:tasks.workunit.client.0.smithi121.stdout:2/348: write d2/d8/d1f/f35 [962467,52223] 0 2024-08-18T22:41:36.208 INFO:tasks.workunit.client.1.smithi195.stdout:2/119: sync 2024-08-18T22:41:36.208 INFO:tasks.workunit.client.1.smithi195.stdout:7/78: sync 2024-08-18T22:41:36.209 INFO:tasks.workunit.client.1.smithi195.stdout:4/57: mkdir d0/d9/d11 0 2024-08-18T22:41:36.210 INFO:tasks.workunit.client.0.smithi121.stdout:2/349: fsync d2/d3/d48/d77/f26 0 2024-08-18T22:41:36.210 INFO:tasks.workunit.client.0.smithi121.stdout:8/528: symlink d6/d1e/d2d/d78/lb3 0 2024-08-18T22:41:36.211 INFO:tasks.workunit.client.0.smithi121.stdout:7/507: link de/d13/d18/d23/d24/d29/d43/c89 de/d13/d18/d23/d24/d29/d43/c9e 0 2024-08-18T22:41:36.213 INFO:tasks.workunit.client.1.smithi195.stdout:7/79: chown dc/d22 93 1 2024-08-18T22:41:36.214 INFO:tasks.workunit.client.0.smithi121.stdout:8/529: mknod d6/d17/d18/d99/cb4 0 2024-08-18T22:41:36.216 INFO:tasks.workunit.client.0.smithi121.stdout:7/508: dread de/d1a/d2f/d4b/f64 [0,4194304] 0 2024-08-18T22:41:36.217 INFO:tasks.workunit.client.0.smithi121.stdout:4/375: dwrite d2/dc/d1c/f33 [0,4194304] 0 2024-08-18T22:41:36.217 INFO:tasks.workunit.client.0.smithi121.stdout:9/539: getdents d0/d38/d9e/df/d61 0 2024-08-18T22:41:36.217 INFO:tasks.workunit.client.1.smithi195.stdout:0/145: rmdir d0/dc 39 2024-08-18T22:41:36.217 INFO:tasks.workunit.client.1.smithi195.stdout:8/134: dwrite d1/de/d27/f29 [0,4194304] 0 2024-08-18T22:41:36.217 INFO:tasks.workunit.client.1.smithi195.stdout:6/75: mknod da/db/c1b 0 2024-08-18T22:41:36.217 INFO:tasks.workunit.client.1.smithi195.stdout:7/80: fsync dc/d14/d15/d17/d18/f1c 0 2024-08-18T22:41:36.219 INFO:tasks.workunit.client.0.smithi121.stdout:7/509: fsync de/f16 0 2024-08-18T22:41:36.220 INFO:tasks.workunit.client.1.smithi195.stdout:9/129: getdents d1c 0 2024-08-18T22:41:36.221 INFO:tasks.workunit.client.1.smithi195.stdout:6/76: fdatasync da/db/f18 0 2024-08-18T22:41:36.223 INFO:tasks.workunit.client.0.smithi121.stdout:9/540: dread - d0/d5/dd/f9c zero size 2024-08-18T22:41:36.223 INFO:tasks.workunit.client.0.smithi121.stdout:0/408: dread d1/d4/db/d24/d30/f3b [0,4194304] 0 2024-08-18T22:41:36.224 INFO:tasks.workunit.client.1.smithi195.stdout:5/68: getdents d0/d3/df 0 2024-08-18T22:41:36.224 INFO:tasks.workunit.client.1.smithi195.stdout:4/58: mknod d0/c12 0 2024-08-18T22:41:36.224 INFO:tasks.workunit.client.1.smithi195.stdout:8/135: write d1/d3/d1c/d21/f22 [1926073,30270] 0 2024-08-18T22:41:36.225 INFO:tasks.workunit.client.0.smithi121.stdout:4/376: creat d2/dc/d16/d22/d2c/d44/d66/f80 x:0 0 0 2024-08-18T22:41:36.225 INFO:tasks.workunit.client.0.smithi121.stdout:7/510: read fc [129758,102408] 0 2024-08-18T22:41:36.226 INFO:tasks.workunit.client.1.smithi195.stdout:3/94: truncate f1 1008400 0 2024-08-18T22:41:36.227 INFO:tasks.workunit.client.0.smithi121.stdout:0/409: chown d1/d4/db/d24/d30/f31 98088 1 2024-08-18T22:41:36.228 INFO:tasks.workunit.client.0.smithi121.stdout:4/377: rmdir d2/d7c 39 2024-08-18T22:41:36.229 INFO:tasks.workunit.client.0.smithi121.stdout:7/511: chown de/d1a/d2f/f72 671869 1 2024-08-18T22:41:36.230 INFO:tasks.workunit.client.0.smithi121.stdout:9/541: mkdir d0/d5/dd/d2f/d8b/db3 0 2024-08-18T22:41:36.233 INFO:tasks.workunit.client.0.smithi121.stdout:0/410: symlink d1/d4/db/d18/l84 0 2024-08-18T22:41:36.234 INFO:tasks.workunit.client.0.smithi121.stdout:8/530: dwrite d6/d1e/d2d/d78/f58 [0,4194304] 0 2024-08-18T22:41:36.234 INFO:tasks.workunit.client.0.smithi121.stdout:4/378: dread d2/dc/d16/d22/f25 [0,4194304] 0 2024-08-18T22:41:36.235 INFO:tasks.workunit.client.0.smithi121.stdout:9/542: mknod d0/d38/d9e/df/d61/d90/cb4 0 2024-08-18T22:41:36.237 INFO:tasks.workunit.client.0.smithi121.stdout:3/508: dread d1e/d1f/d3e/f64 [0,4194304] 0 2024-08-18T22:41:36.237 INFO:tasks.workunit.client.0.smithi121.stdout:7/512: symlink de/d1a/d2f/d4b/d6d/l9f 0 2024-08-18T22:41:36.237 INFO:tasks.workunit.client.0.smithi121.stdout:9/543: readlink d0/d5/dd/l11 0 2024-08-18T22:41:36.239 INFO:tasks.workunit.client.0.smithi121.stdout:4/379: mknod d2/dc/d1c/d62/c81 0 2024-08-18T22:41:36.244 INFO:tasks.workunit.client.0.smithi121.stdout:0/411: creat d1/d4/db/d24/df/d8/f85 x:0 0 0 2024-08-18T22:41:36.245 INFO:tasks.workunit.client.0.smithi121.stdout:7/513: mkdir de/d13/da0 0 2024-08-18T22:41:36.247 INFO:tasks.workunit.client.0.smithi121.stdout:9/544: truncate d0/d38/d9e/fc 3957712 0 2024-08-18T22:41:36.249 INFO:tasks.workunit.client.0.smithi121.stdout:8/531: dwrite d6/d17/d37/f94 [0,4194304] 0 2024-08-18T22:41:36.250 INFO:tasks.workunit.client.0.smithi121.stdout:3/509: dread d1e/d1f/d3e/f79 [0,4194304] 0 2024-08-18T22:41:36.251 INFO:tasks.workunit.client.0.smithi121.stdout:4/380: dread d2/dc/f12 [0,4194304] 0 2024-08-18T22:41:36.254 INFO:tasks.workunit.client.0.smithi121.stdout:8/532: chown d6/d1e/fac 190553 1 2024-08-18T22:41:36.254 INFO:tasks.workunit.client.0.smithi121.stdout:3/510: write f12 [2776474,122913] 0 2024-08-18T22:41:36.257 INFO:tasks.workunit.client.0.smithi121.stdout:4/381: symlink d2/dc/d16/d22/d2c/d44/d66/l82 0 2024-08-18T22:41:36.264 INFO:tasks.workunit.client.0.smithi121.stdout:7/514: link de/d2d/l95 de/d2d/la1 0 2024-08-18T22:41:36.265 INFO:tasks.workunit.client.0.smithi121.stdout:3/511: symlink d1e/d1f/d25/d58/d75/d8c/lb7 0 2024-08-18T22:41:36.266 INFO:tasks.workunit.client.0.smithi121.stdout:8/533: symlink d6/dd/d3b/da3/lb5 0 2024-08-18T22:41:36.267 INFO:tasks.workunit.client.0.smithi121.stdout:0/412: dwrite d1/d4/db/d24/f6f [0,4194304] 0 2024-08-18T22:41:36.268 INFO:tasks.workunit.client.0.smithi121.stdout:3/512: dread - d1e/d1f/d25/d2e/d36/fac zero size 2024-08-18T22:41:36.270 INFO:tasks.workunit.client.0.smithi121.stdout:7/515: mkdir de/d1a/d34/d38/d73/da2 0 2024-08-18T22:41:36.270 INFO:tasks.workunit.client.0.smithi121.stdout:8/534: truncate d6/d1e/d2d/f97 389923 0 2024-08-18T22:41:36.273 INFO:tasks.workunit.client.0.smithi121.stdout:3/513: stat d1e/d1f/d25/l7c 0 2024-08-18T22:41:36.276 INFO:tasks.workunit.client.0.smithi121.stdout:4/382: dwrite d2/dc/d16/d22/d29/f38 [0,4194304] 0 2024-08-18T22:41:36.278 INFO:tasks.workunit.client.0.smithi121.stdout:8/535: write d6/d1e/d2d/d78/d85/f9c [932475,13394] 0 2024-08-18T22:41:36.279 INFO:tasks.workunit.client.0.smithi121.stdout:3/514: mkdir d1e/d1f/d3e/db2/db8 0 2024-08-18T22:41:36.279 INFO:tasks.workunit.client.0.smithi121.stdout:8/536: read - d6/d20/d69/f9b zero size 2024-08-18T22:41:36.282 INFO:tasks.workunit.client.0.smithi121.stdout:7/516: rename de/f7a to de/d2d/fa3 0 2024-08-18T22:41:36.283 INFO:tasks.workunit.client.0.smithi121.stdout:4/383: mkdir d2/dc/d16/d59/d83 0 2024-08-18T22:41:36.284 INFO:tasks.workunit.client.0.smithi121.stdout:3/515: symlink d1e/d1f/d25/d58/d75/lb9 0 2024-08-18T22:41:36.285 INFO:tasks.workunit.client.0.smithi121.stdout:8/537: creat d6/d1e/d2d/d78/d45/d86/fb6 x:0 0 0 2024-08-18T22:41:36.285 INFO:tasks.workunit.client.0.smithi121.stdout:7/517: dread de/d13/f17 [4194304,4194304] 0 2024-08-18T22:41:36.286 INFO:tasks.workunit.client.0.smithi121.stdout:4/384: write d2/f42 [360140,86335] 0 2024-08-18T22:41:36.288 INFO:tasks.workunit.client.0.smithi121.stdout:7/518: write de/f16 [295690,101610] 0 2024-08-18T22:41:36.289 INFO:tasks.workunit.client.0.smithi121.stdout:8/538: mknod d6/dd/d25/cb7 0 2024-08-18T22:41:36.291 INFO:tasks.workunit.client.0.smithi121.stdout:8/539: readlink d6/dd/l61 0 2024-08-18T22:41:36.291 INFO:tasks.workunit.client.0.smithi121.stdout:4/385: creat d2/dc/d16/d22/d2c/f84 x:0 0 0 2024-08-18T22:41:36.292 INFO:tasks.workunit.client.0.smithi121.stdout:9/545: dread d0/d5/dd/d3f/fa7 [4194304,4194304] 0 2024-08-18T22:41:36.293 INFO:tasks.workunit.client.0.smithi121.stdout:7/519: truncate de/d13/d18/d23/d24/d29/f4d 42003 0 2024-08-18T22:41:36.295 INFO:tasks.workunit.client.0.smithi121.stdout:9/546: readlink d0/d5/dd/d1a/l71 0 2024-08-18T22:41:36.296 INFO:tasks.workunit.client.0.smithi121.stdout:9/547: chown d0/d38/d9e/df/d61/c78 0 1 2024-08-18T22:41:36.297 INFO:tasks.workunit.client.0.smithi121.stdout:4/386: symlink d2/dc/d16/d59/d83/l85 0 2024-08-18T22:41:36.297 INFO:tasks.workunit.client.0.smithi121.stdout:7/520: mkdir de/da4 0 2024-08-18T22:41:36.298 INFO:tasks.workunit.client.0.smithi121.stdout:7/521: write de/f1c [3759095,24160] 0 2024-08-18T22:41:36.300 INFO:tasks.workunit.client.0.smithi121.stdout:9/548: symlink d0/d38/d44/d7f/lb5 0 2024-08-18T22:41:36.301 INFO:tasks.workunit.client.0.smithi121.stdout:8/540: dread d6/d1e/d2d/d78/d85/f9c [0,4194304] 0 2024-08-18T22:41:36.303 INFO:tasks.workunit.client.0.smithi121.stdout:4/387: link d2/dc/d1c/f3c d2/dc/d16/d47/f86 0 2024-08-18T22:41:36.304 INFO:tasks.workunit.client.0.smithi121.stdout:9/549: fsync d0/d38/d9e/df/d61/db2/f8a 0 2024-08-18T22:41:36.305 INFO:tasks.workunit.client.0.smithi121.stdout:8/541: symlink d6/dd/d3b/lb8 0 2024-08-18T22:41:36.306 INFO:tasks.workunit.client.0.smithi121.stdout:8/542: write d6/dd/d3b/f64 [4171560,73109] 0 2024-08-18T22:41:36.310 INFO:tasks.workunit.client.0.smithi121.stdout:7/522: getdents de/d1a/d34 0 2024-08-18T22:41:36.311 INFO:tasks.workunit.client.0.smithi121.stdout:8/543: dread d6/f8 [4194304,4194304] 0 2024-08-18T22:41:36.313 INFO:tasks.workunit.client.1.smithi195.stdout:6/77: unlink da/db/d10/l16 0 2024-08-18T22:41:36.314 INFO:tasks.workunit.client.0.smithi121.stdout:7/523: symlink de/d13/d18/d2e/la5 0 2024-08-18T22:41:36.315 INFO:tasks.workunit.client.1.smithi195.stdout:6/78: fdatasync f7 0 2024-08-18T22:41:36.316 INFO:tasks.workunit.client.0.smithi121.stdout:7/524: chown de/d1a/d34/d38/d5f/f66 3070 1 2024-08-18T22:41:36.316 INFO:tasks.workunit.client.0.smithi121.stdout:3/516: dread d1e/d1f/d25/d6b/db4/d94/fab [0,4194304] 0 2024-08-18T22:41:36.316 INFO:tasks.workunit.client.1.smithi195.stdout:5/69: creat d0/d3/d8/f13 x:0 0 0 2024-08-18T22:41:36.318 INFO:tasks.workunit.client.0.smithi121.stdout:3/517: chown d1e/d1f/c55 460 1 2024-08-18T22:41:36.320 INFO:tasks.workunit.client.0.smithi121.stdout:3/518: truncate d1e/d1f/d25/f5c 2474677 0 2024-08-18T22:41:36.320 INFO:tasks.workunit.client.1.smithi195.stdout:7/81: mknod dc/d14/d15/d17/d18/c24 0 2024-08-18T22:41:36.321 INFO:tasks.workunit.client.0.smithi121.stdout:9/550: getdents d0/d38/d44/d7f 0 2024-08-18T22:41:36.321 INFO:tasks.workunit.client.1.smithi195.stdout:1/254: dwrite da/d18/f1a [0,4194304] 0 2024-08-18T22:41:36.321 INFO:tasks.workunit.client.1.smithi195.stdout:3/95: creat d7/da/df/f24 x:0 0 0 2024-08-18T22:41:36.322 INFO:tasks.workunit.client.1.smithi195.stdout:0/146: mknod d0/dc/c2b 0 2024-08-18T22:41:36.322 INFO:tasks.workunit.client.1.smithi195.stdout:4/59: dwrite d0/f4 [0,4194304] 0 2024-08-18T22:41:36.324 INFO:tasks.workunit.client.1.smithi195.stdout:6/79: unlink f7 0 2024-08-18T22:41:36.324 INFO:tasks.workunit.client.0.smithi121.stdout:3/519: mkdir d1e/d1f/dba 0 2024-08-18T22:41:36.325 INFO:tasks.workunit.client.0.smithi121.stdout:4/388: truncate d2/dc/d16/d22/d29/f3b 3933525 0 2024-08-18T22:41:36.325 INFO:tasks.workunit.client.1.smithi195.stdout:1/255: stat da/d18/d43/c54 0 2024-08-18T22:41:36.326 INFO:tasks.workunit.client.0.smithi121.stdout:7/525: dwrite de/d1a/d2f/d4b/d6d/f83 [0,4194304] 0 2024-08-18T22:41:36.327 INFO:tasks.workunit.client.0.smithi121.stdout:3/520: fdatasync d1e/d1f/d25/d6b/d66/fb3 0 2024-08-18T22:41:36.327 INFO:tasks.workunit.client.1.smithi195.stdout:7/82: chown dc/l12 4187655 1 2024-08-18T22:41:36.330 INFO:tasks.workunit.client.1.smithi195.stdout:1/256: fdatasync da/d18/d28/d31/d3b/f3c 0 2024-08-18T22:41:36.332 INFO:tasks.workunit.client.1.smithi195.stdout:7/83: chown dc/d1d/c20 888 1 2024-08-18T22:41:36.335 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:41:35 smithi121 ceph-mon[16788]: pgmap v243: 65 pgs: 65 active+clean; 787 MiB data, 4.0 GiB used, 532 GiB / 536 GiB avail; 4.1 MiB/s rd, 88 MiB/s wr, 353 op/s 2024-08-18T22:41:36.335 INFO:tasks.workunit.client.0.smithi121.stdout:8/544: dread d6/d1e/f35 [0,4194304] 0 2024-08-18T22:41:36.335 INFO:tasks.workunit.client.0.smithi121.stdout:8/545: readlink d6/d1e/l34 0 2024-08-18T22:41:36.335 INFO:tasks.workunit.client.0.smithi121.stdout:3/521: rename d1e/d1f/d25/d58/l63 to d1e/d1f/d25/d6b/db4/lbb 0 2024-08-18T22:41:36.336 INFO:tasks.workunit.client.1.smithi195.stdout:7/84: chown dc 9997705 1 2024-08-18T22:41:36.336 INFO:tasks.workunit.client.0.smithi121.stdout:4/389: creat d2/dc/d1c/f87 x:0 0 0 2024-08-18T22:41:36.337 INFO:tasks.workunit.client.1.smithi195.stdout:8/136: link d1/d3/l2d d1/de/df/d18/l33 0 2024-08-18T22:41:36.338 INFO:tasks.workunit.client.0.smithi121.stdout:4/390: readlink d2/dc/d16/d22/d2c/d44/l5a 0 2024-08-18T22:41:36.338 INFO:tasks.workunit.client.1.smithi195.stdout:7/85: fsync f5 0 2024-08-18T22:41:36.341 INFO:tasks.workunit.client.0.smithi121.stdout:8/546: rename d6/d17/f51 to d6/d1e/d2d/d78/fb9 0 2024-08-18T22:41:36.342 INFO:tasks.workunit.client.0.smithi121.stdout:4/391: getdents d2/dc/d16/d22/d2c/d44/d67 0 2024-08-18T22:41:36.343 INFO:tasks.workunit.client.1.smithi195.stdout:0/147: dread d0/f1c [4194304,4194304] 0 2024-08-18T22:41:36.343 INFO:tasks.workunit.client.1.smithi195.stdout:5/70: dwrite d0/d3/d8/f13 [0,4194304] 0 2024-08-18T22:41:36.346 INFO:tasks.workunit.client.0.smithi121.stdout:4/392: creat d2/dc/d1c/d62/f88 x:0 0 0 2024-08-18T22:41:36.346 INFO:tasks.workunit.client.0.smithi121.stdout:8/547: link d6/dd/c11 d6/dd/d25/d56/cba 0 2024-08-18T22:41:36.348 INFO:tasks.workunit.client.1.smithi195.stdout:6/80: dread f5 [0,4194304] 0 2024-08-18T22:41:36.349 INFO:tasks.workunit.client.0.smithi121.stdout:8/548: rename d6/dd/d25/d56/l80 to d6/d1e/d2d/lbb 0 2024-08-18T22:41:36.351 INFO:tasks.workunit.client.1.smithi195.stdout:2/120: dread d1/f15 [0,4194304] 0 2024-08-18T22:41:36.352 INFO:tasks.workunit.client.0.smithi121.stdout:8/549: mknod d6/d17/d18/d99/da0/cbc 0 2024-08-18T22:41:36.352 INFO:tasks.workunit.client.0.smithi121.stdout:8/550: readlink d6/dd/l6d 0 2024-08-18T22:41:36.352 INFO:tasks.workunit.client.1.smithi195.stdout:8/137: write d1/d3/f6 [3678521,125377] 0 2024-08-18T22:41:36.352 INFO:tasks.workunit.client.1.smithi195.stdout:5/71: truncate d0/f11 195414 0 2024-08-18T22:41:36.354 INFO:tasks.workunit.client.1.smithi195.stdout:4/60: dwrite d0/fd [0,4194304] 0 2024-08-18T22:41:36.355 INFO:tasks.workunit.client.0.smithi121.stdout:8/551: creat d6/d17/d18/d99/da0/fbd x:0 0 0 2024-08-18T22:41:36.358 INFO:tasks.workunit.client.0.smithi121.stdout:7/526: dread de/f28 [0,4194304] 0 2024-08-18T22:41:36.358 INFO:tasks.workunit.client.1.smithi195.stdout:4/61: chown d0/f8 632994 1 2024-08-18T22:41:36.359 INFO:tasks.workunit.client.1.smithi195.stdout:5/72: write d0/f9 [901070,3669] 0 2024-08-18T22:41:36.359 INFO:tasks.workunit.client.0.smithi121.stdout:7/527: write de/d1a/d20/d39/f9a [133016,2271] 0 2024-08-18T22:41:36.360 INFO:tasks.workunit.client.0.smithi121.stdout:8/552: rename d6/d17/d60/d5b/d6e/f75 to d6/d17/d60/d5b/d6e/fbe 0 2024-08-18T22:41:36.362 INFO:tasks.workunit.client.1.smithi195.stdout:3/96: dwrite d7/f18 [0,4194304] 0 2024-08-18T22:41:36.363 INFO:tasks.workunit.client.0.smithi121.stdout:7/528: mknod de/d1a/d63/ca6 0 2024-08-18T22:41:36.364 INFO:tasks.workunit.client.0.smithi121.stdout:8/553: mknod d6/dd/d3b/da3/cbf 0 2024-08-18T22:41:36.365 INFO:tasks.workunit.client.1.smithi195.stdout:1/257: dread da/d18/d28/d31/f45 [0,4194304] 0 2024-08-18T22:41:36.365 INFO:tasks.workunit.client.1.smithi195.stdout:8/138: fsync d1/de/df/f19 0 2024-08-18T22:41:36.366 INFO:tasks.workunit.client.0.smithi121.stdout:8/554: chown d6/d17/d60/d5b/f9a 13 1 2024-08-18T22:41:36.366 INFO:tasks.workunit.client.1.smithi195.stdout:4/62: symlink d0/l13 0 2024-08-18T22:41:36.366 INFO:tasks.workunit.client.1.smithi195.stdout:2/121: readlink d1/d8/l16 0 2024-08-18T22:41:36.367 INFO:tasks.workunit.client.1.smithi195.stdout:5/73: creat d0/d3/d8/f14 x:0 0 0 2024-08-18T22:41:36.369 INFO:tasks.workunit.client.1.smithi195.stdout:8/139: write d1/d3/f2b [865183,67874] 0 2024-08-18T22:41:36.372 INFO:tasks.workunit.client.1.smithi195.stdout:3/97: dread f1 [0,4194304] 0 2024-08-18T22:41:36.373 INFO:tasks.workunit.client.0.smithi121.stdout:7/529: dwrite de/d2d/d50/f71 [0,4194304] 0 2024-08-18T22:41:36.373 INFO:tasks.workunit.client.1.smithi195.stdout:5/74: creat d0/d3/f15 x:0 0 0 2024-08-18T22:41:36.374 INFO:tasks.workunit.client.1.smithi195.stdout:6/81: dread da/db/d10/f12 [0,4194304] 0 2024-08-18T22:41:36.376 INFO:tasks.workunit.client.0.smithi121.stdout:8/555: chown d6/d1e/d2d/d78/l57 7 1 2024-08-18T22:41:36.377 INFO:tasks.workunit.client.1.smithi195.stdout:1/258: link da/cb da/d3d/c5a 0 2024-08-18T22:41:36.377 INFO:tasks.workunit.client.0.smithi121.stdout:7/530: mknod de/d13/d18/d23/d24/d29/ca7 0 2024-08-18T22:41:36.380 INFO:tasks.workunit.client.0.smithi121.stdout:8/556: creat d6/d17/fc0 x:0 0 0 2024-08-18T22:41:36.383 INFO:tasks.workunit.client.1.smithi195.stdout:5/75: link d0/f11 d0/d3/df/f16 0 2024-08-18T22:41:36.384 INFO:tasks.workunit.client.0.smithi121.stdout:7/531: getdents de/d1a/d2f/d4b/d6d 0 2024-08-18T22:41:36.384 INFO:tasks.workunit.client.0.smithi121.stdout:4/393: dread d2/f19 [0,4194304] 0 2024-08-18T22:41:36.387 INFO:tasks.workunit.client.1.smithi195.stdout:6/82: rename da/db/d10 to da/d15/d1c 0 2024-08-18T22:41:36.389 INFO:tasks.workunit.client.1.smithi195.stdout:4/63: rmdir d0 39 2024-08-18T22:41:36.392 INFO:tasks.workunit.client.0.smithi121.stdout:8/557: dwrite d6/d20/d69/d77/f88 [0,4194304] 0 2024-08-18T22:41:36.392 INFO:tasks.workunit.client.1.smithi195.stdout:0/148: dwrite d0/f3 [0,4194304] 0 2024-08-18T22:41:36.393 INFO:tasks.workunit.client.0.smithi121.stdout:8/558: dread - d6/f8c zero size 2024-08-18T22:41:36.394 INFO:tasks.workunit.client.1.smithi195.stdout:2/122: dwrite d1/d9/f20 [0,4194304] 0 2024-08-18T22:41:36.394 INFO:tasks.workunit.client.1.smithi195.stdout:8/140: dwrite d1/f2a [0,4194304] 0 2024-08-18T22:41:36.395 INFO:tasks.workunit.client.0.smithi121.stdout:4/394: dwrite d2/dc/d1c/f87 [0,4194304] 0 2024-08-18T22:41:36.396 INFO:tasks.workunit.client.0.smithi121.stdout:4/395: chown d2/dc/d1c/f87 75249675 1 2024-08-18T22:41:36.398 INFO:tasks.workunit.client.1.smithi195.stdout:0/149: rmdir d0 39 2024-08-18T22:41:36.398 INFO:tasks.workunit.client.1.smithi195.stdout:1/259: write da/d18/d28/d31/f45 [4757953,47523] 0 2024-08-18T22:41:36.401 INFO:tasks.workunit.client.0.smithi121.stdout:4/396: truncate d2/dc/d16/d22/d2c/d44/d66/f6d 768975 0 2024-08-18T22:41:36.403 INFO:tasks.workunit.client.1.smithi195.stdout:3/98: dread d7/f9 [0,4194304] 0 2024-08-18T22:41:36.405 INFO:tasks.workunit.client.0.smithi121.stdout:8/559: dwrite d6/d1e/d2d/f3d [0,4194304] 0 2024-08-18T22:41:36.408 INFO:tasks.workunit.client.1.smithi195.stdout:2/123: mkdir d1/d24 0 2024-08-18T22:41:36.408 INFO:tasks.workunit.client.1.smithi195.stdout:8/141: rename d1/d3/d1c/d21/f22 to d1/d3/db/f34 0 2024-08-18T22:41:36.410 INFO:tasks.workunit.client.1.smithi195.stdout:5/76: link d0/d2/l10 d0/d3/df/l17 0 2024-08-18T22:41:36.412 INFO:tasks.workunit.client.0.smithi121.stdout:4/397: dwrite d2/dc/d1c/d62/f88 [0,4194304] 0 2024-08-18T22:41:36.412 INFO:tasks.workunit.client.1.smithi195.stdout:0/150: symlink d0/dc/l2c 0 2024-08-18T22:41:36.413 INFO:tasks.workunit.client.1.smithi195.stdout:6/83: dwrite da/db/f17 [0,4194304] 0 2024-08-18T22:41:36.413 INFO:tasks.workunit.client.1.smithi195.stdout:1/260: creat da/d18/d43/f5b x:0 0 0 2024-08-18T22:41:36.416 INFO:tasks.workunit.client.1.smithi195.stdout:2/124: write d1/d8/f17 [4727396,91581] 0 2024-08-18T22:41:36.417 INFO:tasks.workunit.client.1.smithi195.stdout:8/142: truncate d1/d3/f2b 1764373 0 2024-08-18T22:41:36.419 INFO:tasks.workunit.client.0.smithi121.stdout:4/398: link d2/dc/d16/d22/d2c/d44/d66/f80 d2/dc/f89 0 2024-08-18T22:41:36.420 INFO:tasks.workunit.client.1.smithi195.stdout:1/261: chown c2 21209 1 2024-08-18T22:41:36.420 INFO:tasks.workunit.client.1.smithi195.stdout:4/64: dwrite d0/f3 [4194304,4194304] 0 2024-08-18T22:41:36.422 INFO:tasks.workunit.client.0.smithi121.stdout:4/399: rmdir d2/dc/d16/d22/d29 39 2024-08-18T22:41:36.426 INFO:tasks.workunit.client.0.smithi121.stdout:4/400: mkdir d2/dc/d16/d59/d8a 0 2024-08-18T22:41:36.428 INFO:tasks.workunit.client.1.smithi195.stdout:0/151: creat d0/dc/df/f2d x:0 0 0 2024-08-18T22:41:36.429 INFO:tasks.workunit.client.0.smithi121.stdout:7/532: dread de/d2d/f5d [0,4194304] 0 2024-08-18T22:41:36.430 INFO:tasks.workunit.client.1.smithi195.stdout:8/143: mkdir d1/d3/db/d35 0 2024-08-18T22:41:36.431 INFO:tasks.workunit.client.1.smithi195.stdout:0/152: write d0/f3 [2631612,106160] 0 2024-08-18T22:41:36.432 INFO:tasks.workunit.client.0.smithi121.stdout:7/533: symlink de/d1a/d20/la8 0 2024-08-18T22:41:36.433 INFO:tasks.workunit.client.1.smithi195.stdout:4/65: mknod d0/d9/d11/c14 0 2024-08-18T22:41:36.433 INFO:tasks.workunit.client.1.smithi195.stdout:2/125: link d1/d9/fa d1/d8/f25 0 2024-08-18T22:41:36.434 INFO:tasks.workunit.client.1.smithi195.stdout:3/99: dwrite d7/f9 [0,4194304] 0 2024-08-18T22:41:36.434 INFO:tasks.workunit.client.0.smithi121.stdout:7/534: chown de/d1a/d34/d38/d5f/c82 172 1 2024-08-18T22:41:36.436 INFO:tasks.workunit.client.1.smithi195.stdout:8/144: write d1/d3/f6 [1190867,54107] 0 2024-08-18T22:41:36.436 INFO:tasks.workunit.client.1.smithi195.stdout:1/262: creat da/d18/f5c x:0 0 0 2024-08-18T22:41:36.437 INFO:tasks.workunit.client.1.smithi195.stdout:8/145: fsync d1/d3/f2b 0 2024-08-18T22:41:36.437 INFO:tasks.workunit.client.0.smithi121.stdout:7/535: getdents de/d1a/d34/d38 0 2024-08-18T22:41:36.438 INFO:tasks.workunit.client.1.smithi195.stdout:0/153: symlink d0/l2e 0 2024-08-18T22:41:36.438 INFO:tasks.workunit.client.1.smithi195.stdout:3/100: rmdir d7/da/df/d1c 39 2024-08-18T22:41:36.439 INFO:tasks.workunit.client.1.smithi195.stdout:8/146: read d1/de/df/f1e [720956,105012] 0 2024-08-18T22:41:36.440 INFO:tasks.workunit.client.0.smithi121.stdout:7/536: mknod de/d1a/d2f/d4b/ca9 0 2024-08-18T22:41:36.440 INFO:tasks.workunit.client.0.smithi121.stdout:7/537: dread - de/f87 zero size 2024-08-18T22:41:36.440 INFO:tasks.workunit.client.1.smithi195.stdout:8/147: readlink d1/l30 0 2024-08-18T22:41:36.442 INFO:tasks.workunit.client.0.smithi121.stdout:4/401: dread d2/dc/d16/d22/d29/f20 [0,4194304] 0 2024-08-18T22:41:36.442 INFO:tasks.workunit.client.1.smithi195.stdout:4/66: creat d0/d9/d11/f15 x:0 0 0 2024-08-18T22:41:36.443 INFO:tasks.workunit.client.1.smithi195.stdout:2/126: mkdir d1/d24/d26 0 2024-08-18T22:41:36.443 INFO:tasks.workunit.client.0.smithi121.stdout:4/402: mknod d2/dc/d16/c8b 0 2024-08-18T22:41:36.445 INFO:tasks.workunit.client.1.smithi195.stdout:8/148: creat d1/de/f36 x:0 0 0 2024-08-18T22:41:36.446 INFO:tasks.workunit.client.0.smithi121.stdout:4/403: dread d2/f19 [0,4194304] 0 2024-08-18T22:41:36.449 INFO:tasks.workunit.client.1.smithi195.stdout:2/127: mkdir d1/d8/d27 0 2024-08-18T22:41:36.449 INFO:tasks.workunit.client.1.smithi195.stdout:8/149: symlink d1/de/l37 0 2024-08-18T22:41:36.450 INFO:tasks.workunit.client.0.smithi121.stdout:4/404: rename d2/dc/d16/d22/d2c/d44/d67 to d2/dc/d16/d22/d2c/d44/d8c 0 2024-08-18T22:41:36.451 INFO:tasks.workunit.client.1.smithi195.stdout:3/101: dwrite d7/f17 [0,4194304] 0 2024-08-18T22:41:36.451 INFO:tasks.workunit.client.0.smithi121.stdout:4/405: mkdir d2/dc/d8d 0 2024-08-18T22:41:36.452 INFO:tasks.workunit.client.1.smithi195.stdout:2/128: dread - d1/d9/f18 zero size 2024-08-18T22:41:36.452 INFO:tasks.workunit.client.0.smithi121.stdout:4/406: rmdir d2/dc/d1c 39 2024-08-18T22:41:36.454 INFO:tasks.workunit.client.1.smithi195.stdout:8/150: mknod d1/de/df/d18/c38 0 2024-08-18T22:41:36.458 INFO:tasks.workunit.client.1.smithi195.stdout:4/67: dread d0/d9/fe [0,4194304] 0 2024-08-18T22:41:36.458 INFO:tasks.workunit.client.1.smithi195.stdout:2/129: rename d1/d8/cd to d1/d24/c28 0 2024-08-18T22:41:36.460 INFO:tasks.workunit.client.1.smithi195.stdout:5/77: write d0/f11 [1168335,51565] 0 2024-08-18T22:41:36.460 INFO:tasks.workunit.client.1.smithi195.stdout:6/84: write f5 [1340807,127853] 0 2024-08-18T22:41:36.460 INFO:tasks.workunit.client.0.smithi121.stdout:4/407: dwrite d2/dc/d16/d22/f6c [0,4194304] 0 2024-08-18T22:41:36.461 INFO:tasks.workunit.client.1.smithi195.stdout:4/68: mkdir d0/d9/d11/d16 0 2024-08-18T22:41:36.462 INFO:tasks.workunit.client.1.smithi195.stdout:6/85: fdatasync da/db/f18 0 2024-08-18T22:41:36.465 INFO:tasks.workunit.client.0.smithi121.stdout:4/408: creat d2/dc/d16/d59/f8e x:0 0 0 2024-08-18T22:41:36.465 INFO:tasks.workunit.client.1.smithi195.stdout:4/69: stat d0/d7 0 2024-08-18T22:41:36.466 INFO:tasks.workunit.client.0.smithi121.stdout:4/409: dread - d2/dc/d16/d22/d2c/f84 zero size 2024-08-18T22:41:36.466 INFO:tasks.workunit.client.0.smithi121.stdout:8/560: dread d6/d17/d60/d5b/f9a [0,4194304] 0 2024-08-18T22:41:36.468 INFO:tasks.workunit.client.1.smithi195.stdout:6/86: creat da/db/d19/f1d x:0 0 0 2024-08-18T22:41:36.470 INFO:tasks.workunit.client.0.smithi121.stdout:8/561: creat d6/d1e/fc1 x:0 0 0 2024-08-18T22:41:36.470 INFO:tasks.workunit.client.1.smithi195.stdout:4/70: chown d0/f8 25 1 2024-08-18T22:41:36.471 INFO:tasks.workunit.client.1.smithi195.stdout:5/78: dwrite d0/f9 [0,4194304] 0 2024-08-18T22:41:36.471 INFO:tasks.workunit.client.1.smithi195.stdout:6/87: fdatasync da/db/f17 0 2024-08-18T22:41:36.471 INFO:tasks.workunit.client.0.smithi121.stdout:8/562: symlink d6/d17/d37/lc2 0 2024-08-18T22:41:36.471 INFO:tasks.workunit.client.1.smithi195.stdout:4/71: chown d0/d7 32564909 1 2024-08-18T22:41:36.472 INFO:tasks.workunit.client.1.smithi195.stdout:5/79: chown d0/d3 170229 1 2024-08-18T22:41:36.473 INFO:tasks.workunit.client.1.smithi195.stdout:4/72: fsync d0/f3 0 2024-08-18T22:41:36.473 INFO:tasks.workunit.client.1.smithi195.stdout:3/102: dread f6 [0,4194304] 0 2024-08-18T22:41:36.474 INFO:tasks.workunit.client.0.smithi121.stdout:8/563: mknod d6/d1e/d2d/d78/d45/d86/cc3 0 2024-08-18T22:41:36.474 INFO:tasks.workunit.client.1.smithi195.stdout:6/88: symlink da/db/l1e 0 2024-08-18T22:41:36.476 INFO:tasks.workunit.client.1.smithi195.stdout:1/263: truncate da/f11 2048050 0 2024-08-18T22:41:36.477 INFO:tasks.workunit.client.1.smithi195.stdout:4/73: symlink d0/d7/l17 0 2024-08-18T22:41:36.478 INFO:tasks.workunit.client.0.smithi121.stdout:4/410: dwrite d2/dc/d16/f36 [0,4194304] 0 2024-08-18T22:41:36.479 INFO:tasks.workunit.client.0.smithi121.stdout:4/411: stat d2/dc/d16 0 2024-08-18T22:41:36.479 INFO:tasks.workunit.client.1.smithi195.stdout:5/80: creat d0/d3/df/f18 x:0 0 0 2024-08-18T22:41:36.480 INFO:tasks.workunit.client.1.smithi195.stdout:6/89: chown c4 17 1 2024-08-18T22:41:36.481 INFO:tasks.workunit.client.0.smithi121.stdout:4/412: mknod d2/dc/c8f 0 2024-08-18T22:41:36.482 INFO:tasks.workunit.client.1.smithi195.stdout:8/151: rename d1/de/df/d18 to d1/d3/db/d39 0 2024-08-18T22:41:36.483 INFO:tasks.workunit.client.1.smithi195.stdout:5/81: write d0/d3/df/f16 [925828,34523] 0 2024-08-18T22:41:36.483 INFO:tasks.workunit.client.0.smithi121.stdout:4/413: fdatasync d2/dc/d1c/f33 0 2024-08-18T22:41:36.485 INFO:tasks.workunit.client.0.smithi121.stdout:4/414: mkdir d2/dc/d1c/d62/d90 0 2024-08-18T22:41:36.486 INFO:tasks.workunit.client.1.smithi195.stdout:1/264: dwrite da/d3d/f48 [0,4194304] 0 2024-08-18T22:41:36.486 INFO:tasks.workunit.client.1.smithi195.stdout:4/74: creat d0/d9/d11/f18 x:0 0 0 2024-08-18T22:41:36.487 INFO:tasks.workunit.client.1.smithi195.stdout:1/265: stat da/f53 0 2024-08-18T22:41:36.491 INFO:tasks.workunit.client.0.smithi121.stdout:4/415: dwrite d2/dc/fd [0,4194304] 0 2024-08-18T22:41:36.493 INFO:tasks.workunit.client.1.smithi195.stdout:6/90: mknod da/d15/c1f 0 2024-08-18T22:41:36.494 INFO:tasks.workunit.client.1.smithi195.stdout:4/75: dread d0/d9/fe [0,4194304] 0 2024-08-18T22:41:36.494 INFO:tasks.workunit.client.1.smithi195.stdout:1/266: dread da/d3d/f41 [0,4194304] 0 2024-08-18T22:41:36.496 INFO:tasks.workunit.client.1.smithi195.stdout:2/130: rename d1/d9 to d1/d22/d29 0 2024-08-18T22:41:36.498 INFO:tasks.workunit.client.0.smithi121.stdout:4/416: dwrite d2/f72 [0,4194304] 0 2024-08-18T22:41:36.499 INFO:tasks.workunit.client.1.smithi195.stdout:3/103: link d7/da/df/f12 d7/da/df/d1c/f25 0 2024-08-18T22:41:36.499 INFO:tasks.workunit.client.0.smithi121.stdout:4/417: truncate d2/dc/f48 615890 0 2024-08-18T22:41:36.502 INFO:tasks.workunit.client.0.smithi121.stdout:4/418: creat d2/dc/d16/d22/d2c/d44/d66/f91 x:0 0 0 2024-08-18T22:41:36.503 INFO:tasks.workunit.client.1.smithi195.stdout:5/82: rename d0/d3/df/f18 to d0/db/f19 0 2024-08-18T22:41:36.509 INFO:tasks.workunit.client.0.smithi121.stdout:4/419: truncate d2/dc/d16/f68 3716616 0 2024-08-18T22:41:36.509 INFO:tasks.workunit.client.1.smithi195.stdout:4/76: truncate d0/f8 8868153 0 2024-08-18T22:41:36.510 INFO:tasks.workunit.client.1.smithi195.stdout:4/77: chown d0/f8 13555744 1 2024-08-18T22:41:36.511 INFO:tasks.workunit.client.1.smithi195.stdout:1/267: mkdir da/d4c/d5d 0 2024-08-18T22:41:36.511 INFO:tasks.workunit.client.0.smithi121.stdout:4/420: symlink d2/dc/d16/d59/d83/l92 0 2024-08-18T22:41:36.511 INFO:tasks.workunit.client.1.smithi195.stdout:4/78: stat d0/fd 0 2024-08-18T22:41:36.512 INFO:tasks.workunit.client.1.smithi195.stdout:1/268: truncate da/d18/f5c 314013 0 2024-08-18T22:41:36.512 INFO:tasks.workunit.client.1.smithi195.stdout:8/152: rmdir d1/de 39 2024-08-18T22:41:36.513 INFO:tasks.workunit.client.0.smithi121.stdout:4/421: link d2/dc/f32 d2/dc/f93 0 2024-08-18T22:41:36.515 INFO:tasks.workunit.client.1.smithi195.stdout:3/104: creat d7/d1f/f26 x:0 0 0 2024-08-18T22:41:36.516 INFO:tasks.workunit.client.0.smithi121.stdout:4/422: link d2/f21 d2/dc/f94 0 2024-08-18T22:41:36.517 INFO:tasks.workunit.client.0.smithi121.stdout:4/423: write d2/dc/d1c/f7e [1321666,73412] 0 2024-08-18T22:41:36.518 INFO:tasks.workunit.client.1.smithi195.stdout:4/79: symlink d0/d7/l19 0 2024-08-18T22:41:36.518 INFO:tasks.workunit.client.0.smithi121.stdout:4/424: readlink d2/l5b 0 2024-08-18T22:41:36.519 INFO:tasks.workunit.client.1.smithi195.stdout:4/80: dread - d0/ff zero size 2024-08-18T22:41:36.520 INFO:tasks.workunit.client.1.smithi195.stdout:8/153: fsync d1/d3/db/f34 0 2024-08-18T22:41:36.521 INFO:tasks.workunit.client.0.smithi121.stdout:4/425: dread d2/dc/d16/d22/d2c/d44/d66/f6d [0,4194304] 0 2024-08-18T22:41:36.521 INFO:tasks.workunit.client.1.smithi195.stdout:8/154: write d1/d3/f2b [1127478,5138] 0 2024-08-18T22:41:36.522 INFO:tasks.workunit.client.1.smithi195.stdout:2/131: write d1/f21 [605944,100121] 0 2024-08-18T22:41:36.523 INFO:tasks.workunit.client.1.smithi195.stdout:2/132: readlink d1/d8/l16 0 2024-08-18T22:41:36.523 INFO:tasks.workunit.client.1.smithi195.stdout:8/155: fsync d1/d3/d1c/d21/f28 0 2024-08-18T22:41:36.524 INFO:tasks.workunit.client.0.smithi121.stdout:4/426: link d2/dc/d16/c17 d2/dc/d16/d22/c95 0 2024-08-18T22:41:36.524 INFO:tasks.workunit.client.1.smithi195.stdout:4/81: rename d0/fd to d0/d9/f1a 0 2024-08-18T22:41:36.525 INFO:tasks.workunit.client.0.smithi121.stdout:4/427: truncate d2/dc/d16/d22/d2c/f6e 746349 0 2024-08-18T22:41:36.529 INFO:tasks.workunit.client.1.smithi195.stdout:8/156: dread d1/d3/f6 [0,4194304] 0 2024-08-18T22:41:36.530 INFO:tasks.workunit.client.1.smithi195.stdout:5/83: getdents d0/d3/d8 0 2024-08-18T22:41:36.531 INFO:tasks.workunit.client.1.smithi195.stdout:6/91: truncate f6 925800 0 2024-08-18T22:41:36.532 INFO:tasks.workunit.client.0.smithi121.stdout:4/428: write d2/dc/d1c/f3c [2221910,116453] 0 2024-08-18T22:41:36.535 INFO:tasks.workunit.client.0.smithi121.stdout:4/429: creat d2/dc/d1c/f96 x:0 0 0 2024-08-18T22:41:36.535 INFO:tasks.workunit.client.1.smithi195.stdout:3/105: creat d7/da/df/f27 x:0 0 0 2024-08-18T22:41:36.536 INFO:tasks.workunit.client.0.smithi121.stdout:4/430: mknod d2/dc/d16/d47/c97 0 2024-08-18T22:41:36.537 INFO:tasks.workunit.client.1.smithi195.stdout:3/106: dread - d7/da/df/f24 zero size 2024-08-18T22:41:36.537 INFO:tasks.workunit.client.1.smithi195.stdout:8/157: mknod d1/d3/d1c/d21/c3a 0 2024-08-18T22:41:36.539 INFO:tasks.workunit.client.1.smithi195.stdout:5/84: mkdir d0/d3/df/d1a 0 2024-08-18T22:41:36.539 INFO:tasks.workunit.client.1.smithi195.stdout:6/92: dwrite da/db/f18 [0,4194304] 0 2024-08-18T22:41:36.541 INFO:tasks.workunit.client.0.smithi121.stdout:4/431: dwrite d2/f9 [0,4194304] 0 2024-08-18T22:41:36.542 INFO:tasks.workunit.client.1.smithi195.stdout:3/107: truncate d7/da/df/f27 80038 0 2024-08-18T22:41:36.543 INFO:tasks.workunit.client.0.smithi121.stdout:4/432: write d2/dc/f48 [109962,1381] 0 2024-08-18T22:41:36.544 INFO:tasks.workunit.client.1.smithi195.stdout:4/82: creat d0/d9/d11/d16/f1b x:0 0 0 2024-08-18T22:41:36.544 INFO:tasks.workunit.client.1.smithi195.stdout:1/269: read da/f11 [1177645,51248] 0 2024-08-18T22:41:36.547 INFO:tasks.workunit.client.1.smithi195.stdout:3/108: truncate d7/d1f/f26 1006694 0 2024-08-18T22:41:36.547 INFO:tasks.workunit.client.1.smithi195.stdout:4/83: rename d0/d9/fe to d0/d9/f1c 0 2024-08-18T22:41:36.548 INFO:tasks.workunit.client.1.smithi195.stdout:5/85: dread d0/f11 [0,4194304] 0 2024-08-18T22:41:36.548 INFO:tasks.workunit.client.1.smithi195.stdout:1/270: readlink da/d18/l20 0 2024-08-18T22:41:36.550 INFO:tasks.workunit.client.1.smithi195.stdout:1/271: chown da/f11 447357 1 2024-08-18T22:41:36.552 INFO:tasks.workunit.client.1.smithi195.stdout:4/84: mkdir d0/d7/d1d 0 2024-08-18T22:41:36.552 INFO:tasks.workunit.client.1.smithi195.stdout:1/272: write da/d18/d28/d31/d3b/f3c [1509960,53506] 0 2024-08-18T22:41:36.555 INFO:tasks.workunit.client.1.smithi195.stdout:6/93: truncate da/db/f17 170904 0 2024-08-18T22:41:36.556 INFO:tasks.workunit.client.1.smithi195.stdout:5/86: mknod d0/d2/c1b 0 2024-08-18T22:41:36.556 INFO:tasks.workunit.client.1.smithi195.stdout:8/158: dread d1/d3/db/f17 [0,4194304] 0 2024-08-18T22:41:36.558 INFO:tasks.workunit.client.1.smithi195.stdout:1/273: mknod da/d18/d28/d31/d3b/c5e 0 2024-08-18T22:41:36.562 INFO:tasks.workunit.client.1.smithi195.stdout:1/274: mknod da/d4c/c5f 0 2024-08-18T22:41:36.562 INFO:tasks.workunit.client.1.smithi195.stdout:1/275: stat da/d18/f39 0 2024-08-18T22:41:36.562 INFO:tasks.workunit.client.1.smithi195.stdout:6/94: mknod da/c20 0 2024-08-18T22:41:36.562 INFO:tasks.workunit.client.1.smithi195.stdout:8/159: creat d1/de/f3b x:0 0 0 2024-08-18T22:41:36.563 INFO:tasks.workunit.client.1.smithi195.stdout:5/87: getdents d0/d3/df/d1a 0 2024-08-18T22:41:36.565 INFO:tasks.workunit.client.1.smithi195.stdout:6/95: rmdir da/d15/d1c 39 2024-08-18T22:41:36.567 INFO:tasks.workunit.client.1.smithi195.stdout:4/85: getdents d0/d9/d11 0 2024-08-18T22:41:36.567 INFO:tasks.workunit.client.1.smithi195.stdout:5/88: mknod d0/d3/d8/c1c 0 2024-08-18T22:41:36.570 INFO:tasks.workunit.client.1.smithi195.stdout:6/96: unlink da/db/f18 0 2024-08-18T22:41:36.571 INFO:tasks.workunit.client.1.smithi195.stdout:3/109: truncate d7/fc 426583 0 2024-08-18T22:41:36.571 INFO:tasks.workunit.client.1.smithi195.stdout:8/160: dwrite d1/de/df/d1d/f32 [0,4194304] 0 2024-08-18T22:41:36.576 INFO:tasks.workunit.client.1.smithi195.stdout:1/276: rename da/f1b to da/f60 0 2024-08-18T22:41:36.577 INFO:tasks.workunit.client.1.smithi195.stdout:5/89: stat d0/d2/l10 0 2024-08-18T22:41:36.579 INFO:tasks.workunit.client.1.smithi195.stdout:5/90: dread - d0/d3/f15 zero size 2024-08-18T22:41:36.579 INFO:tasks.workunit.client.1.smithi195.stdout:6/97: creat da/db/f21 x:0 0 0 2024-08-18T22:41:36.580 INFO:tasks.workunit.client.1.smithi195.stdout:3/110: mknod d7/d1f/c28 0 2024-08-18T22:41:36.582 INFO:tasks.workunit.client.1.smithi195.stdout:8/161: dwrite d1/de/f3b [0,4194304] 0 2024-08-18T22:41:36.587 INFO:tasks.workunit.client.1.smithi195.stdout:3/111: mknod d7/d1f/c29 0 2024-08-18T22:41:36.589 INFO:tasks.workunit.client.1.smithi195.stdout:6/98: dread da/db/f17 [0,4194304] 0 2024-08-18T22:41:36.591 INFO:tasks.workunit.client.1.smithi195.stdout:5/91: dwrite d0/d3/f15 [0,4194304] 0 2024-08-18T22:41:36.591 INFO:tasks.workunit.client.1.smithi195.stdout:1/277: unlink da/cb 0 2024-08-18T22:41:36.592 INFO:tasks.workunit.client.1.smithi195.stdout:1/278: chown da/d18/d28/d31/d3b/d4e 0 1 2024-08-18T22:41:36.593 INFO:tasks.workunit.client.1.smithi195.stdout:4/86: getdents d0/d7 0 2024-08-18T22:41:36.593 INFO:tasks.workunit.client.1.smithi195.stdout:5/92: dread d0/d3/df/f16 [0,4194304] 0 2024-08-18T22:41:36.594 INFO:tasks.workunit.client.1.smithi195.stdout:1/279: dread da/d18/f5c [0,4194304] 0 2024-08-18T22:41:36.595 INFO:tasks.workunit.client.1.smithi195.stdout:8/162: symlink d1/de/df/d1d/l3c 0 2024-08-18T22:41:36.596 INFO:tasks.workunit.client.1.smithi195.stdout:6/99: read - da/f13 zero size 2024-08-18T22:41:36.596 INFO:tasks.workunit.client.1.smithi195.stdout:5/93: dread d0/d3/df/f16 [0,4194304] 0 2024-08-18T22:41:36.597 INFO:tasks.workunit.client.1.smithi195.stdout:6/100: dread da/db/f17 [0,4194304] 0 2024-08-18T22:41:36.598 INFO:tasks.workunit.client.1.smithi195.stdout:8/163: rmdir d1/d3 39 2024-08-18T22:41:36.608 INFO:tasks.workunit.client.1.smithi195.stdout:5/94: dwrite d0/db/f19 [0,4194304] 0 2024-08-18T22:41:36.610 INFO:tasks.workunit.client.1.smithi195.stdout:8/164: link d1/de/df/c13 d1/d3/d1c/d21/c3d 0 2024-08-18T22:41:36.612 INFO:tasks.workunit.client.1.smithi195.stdout:8/165: chown d1/de/df/l1b 3468149 1 2024-08-18T22:41:36.612 INFO:tasks.workunit.client.1.smithi195.stdout:4/87: write d0/f3 [5796223,56746] 0 2024-08-18T22:41:36.614 INFO:tasks.workunit.client.0.smithi121.stdout:5/354: sync 2024-08-18T22:41:36.615 INFO:tasks.workunit.client.1.smithi195.stdout:5/95: dread d0/d3/d8/f13 [0,4194304] 0 2024-08-18T22:41:36.615 INFO:tasks.workunit.client.0.smithi121.stdout:5/355: write d3/d5/d13/d19/f4a [310409,49580] 0 2024-08-18T22:41:36.616 INFO:tasks.workunit.client.1.smithi195.stdout:4/88: symlink d0/d9/d11/l1e 0 2024-08-18T22:41:36.618 INFO:tasks.workunit.client.0.smithi121.stdout:5/356: link d3/d5/d13/d19/f1e d3/d5/d13/d23/f71 0 2024-08-18T22:41:36.619 INFO:tasks.workunit.client.1.smithi195.stdout:4/89: rmdir d0/d9/d11/d16 39 2024-08-18T22:41:36.620 INFO:tasks.workunit.client.1.smithi195.stdout:4/90: write d0/f8 [7792066,48551] 0 2024-08-18T22:41:36.620 INFO:tasks.workunit.client.0.smithi121.stdout:5/357: creat d3/d5/d27/d35/f72 x:0 0 0 2024-08-18T22:41:36.621 INFO:tasks.workunit.client.1.smithi195.stdout:5/96: dread d0/d3/d8/f13 [0,4194304] 0 2024-08-18T22:41:36.622 INFO:tasks.workunit.client.1.smithi195.stdout:8/166: rename d1/de/df/f1e to d1/de/df/d1d/f3e 0 2024-08-18T22:41:36.622 INFO:tasks.workunit.client.0.smithi121.stdout:5/358: symlink d3/d5/d13/l73 0 2024-08-18T22:41:36.627 INFO:tasks.workunit.client.1.smithi195.stdout:4/91: rename d0/c6 to d0/c1f 0 2024-08-18T22:41:36.628 INFO:tasks.workunit.client.0.smithi121.stdout:5/359: rmdir d3/d5/d13/d23 39 2024-08-18T22:41:36.628 INFO:tasks.workunit.client.1.smithi195.stdout:5/97: creat d0/f1d x:0 0 0 2024-08-18T22:41:36.629 INFO:tasks.workunit.client.0.smithi121.stdout:5/360: chown d3/d5/d13/d19 2518 1 2024-08-18T22:41:36.630 INFO:tasks.workunit.client.1.smithi195.stdout:5/98: chown d0/d3/d8/f13 5421 1 2024-08-18T22:41:36.630 INFO:tasks.workunit.client.1.smithi195.stdout:3/112: dwrite d7/fc [0,4194304] 0 2024-08-18T22:41:36.631 INFO:tasks.workunit.client.1.smithi195.stdout:8/167: truncate d1/f2a 3326416 0 2024-08-18T22:41:36.633 INFO:tasks.workunit.client.1.smithi195.stdout:5/99: fdatasync d0/d3/d8/f13 0 2024-08-18T22:41:36.634 INFO:tasks.workunit.client.1.smithi195.stdout:5/100: fsync d0/d3/f15 0 2024-08-18T22:41:36.634 INFO:tasks.workunit.client.1.smithi195.stdout:3/113: mknod d7/da/df/d1c/c2a 0 2024-08-18T22:41:36.689 INFO:tasks.workunit.client.1.smithi195.stdout:8/168: creat d1/d3/d1c/d21/f3f x:0 0 0 2024-08-18T22:41:36.690 INFO:tasks.workunit.client.1.smithi195.stdout:4/92: dwrite d0/f3 [0,4194304] 0 2024-08-18T22:41:36.691 INFO:tasks.workunit.client.1.smithi195.stdout:5/101: rmdir d0/d3 39 2024-08-18T22:41:36.693 INFO:tasks.workunit.client.0.smithi121.stdout:5/361: creat d3/d5/d27/d35/f74 x:0 0 0 2024-08-18T22:41:36.693 INFO:tasks.workunit.client.1.smithi195.stdout:8/169: symlink d1/d3/d1c/l40 0 2024-08-18T22:41:36.695 INFO:tasks.workunit.client.0.smithi121.stdout:5/362: read d3/d5/d13/d19/d24/d32/f3b [3044146,3543] 0 2024-08-18T22:41:36.698 INFO:tasks.workunit.client.0.smithi121.stdout:5/363: mkdir d3/d5/d13/d19/d75 0 2024-08-18T22:41:36.698 INFO:tasks.workunit.client.0.smithi121.stdout:5/364: chown d3/c56 115733 1 2024-08-18T22:41:36.701 INFO:tasks.workunit.client.0.smithi121.stdout:5/365: getdents d3/d5/d3c 0 2024-08-18T22:41:36.701 INFO:tasks.workunit.client.1.smithi195.stdout:4/93: creat d0/f20 x:0 0 0 2024-08-18T22:41:36.702 INFO:tasks.workunit.client.0.smithi121.stdout:5/366: read - d3/d5/d13/d19/d24/d32/d38/f70 zero size 2024-08-18T22:41:36.703 INFO:tasks.workunit.client.1.smithi195.stdout:8/170: mknod d1/de/d31/c41 0 2024-08-18T22:41:36.704 INFO:tasks.workunit.client.1.smithi195.stdout:3/114: dwrite f6 [0,4194304] 0 2024-08-18T22:41:36.704 INFO:tasks.workunit.client.1.smithi195.stdout:5/102: dwrite d0/db/f19 [0,4194304] 0 2024-08-18T22:41:36.704 INFO:tasks.workunit.client.0.smithi121.stdout:5/367: mknod d3/d5/d27/d35/d53/c76 0 2024-08-18T22:41:36.705 INFO:tasks.workunit.client.1.smithi195.stdout:4/94: symlink d0/l21 0 2024-08-18T22:41:36.706 INFO:tasks.workunit.client.1.smithi195.stdout:4/95: dread - d0/d9/d11/f15 zero size 2024-08-18T22:41:36.707 INFO:tasks.workunit.client.1.smithi195.stdout:4/96: read - d0/f20 zero size 2024-08-18T22:41:36.712 INFO:tasks.workunit.client.1.smithi195.stdout:5/103: rename d0/f9 to d0/d3/f1e 0 2024-08-18T22:41:36.713 INFO:tasks.workunit.client.1.smithi195.stdout:4/97: dread d0/f3 [4194304,4194304] 0 2024-08-18T22:41:36.718 INFO:tasks.workunit.client.0.smithi121.stdout:5/368: getdents d3/d5/d27/d35/d53 0 2024-08-18T22:41:36.719 INFO:tasks.workunit.client.1.smithi195.stdout:4/98: rename d0/d9/f1a to d0/f22 0 2024-08-18T22:41:36.719 INFO:tasks.workunit.client.0.smithi121.stdout:5/369: chown d3/d5/d27/d35/f72 92 1 2024-08-18T22:41:36.721 INFO:tasks.workunit.client.1.smithi195.stdout:4/99: read d0/d9/f1c [2476806,17630] 0 2024-08-18T22:41:36.721 INFO:tasks.workunit.client.1.smithi195.stdout:5/104: rename d0/d3/d8/c12 to d0/d3/c1f 0 2024-08-18T22:41:36.722 INFO:tasks.workunit.client.0.smithi121.stdout:5/370: rename d3/d5/f1d to d3/d5/d27/d35/d58/f77 0 2024-08-18T22:41:36.726 INFO:tasks.workunit.client.0.smithi121.stdout:1/488: sync 2024-08-18T22:41:36.726 INFO:tasks.workunit.client.0.smithi121.stdout:2/350: sync 2024-08-18T22:41:36.729 INFO:tasks.workunit.client.0.smithi121.stdout:2/351: rename d2/d3/f2a to d2/d8/d19/d55/f78 0 2024-08-18T22:41:36.729 INFO:tasks.workunit.client.1.smithi195.stdout:3/115: dwrite d7/da/df/d1c/f23 [0,4194304] 0 2024-08-18T22:41:36.730 INFO:tasks.workunit.client.1.smithi195.stdout:8/171: dwrite d1/de/df/f19 [0,4194304] 0 2024-08-18T22:41:36.735 INFO:tasks.workunit.client.0.smithi121.stdout:2/352: getdents d2/d3/d53 0 2024-08-18T22:41:36.735 INFO:tasks.workunit.client.1.smithi195.stdout:3/116: rmdir d7/da 39 2024-08-18T22:41:36.738 INFO:tasks.workunit.client.0.smithi121.stdout:5/371: dwrite d3/d5/d13/d19/d24/d32/f44 [0,4194304] 0 2024-08-18T22:41:36.739 INFO:tasks.workunit.client.1.smithi195.stdout:5/105: dwrite d0/d3/df/f16 [0,4194304] 0 2024-08-18T22:41:36.739 INFO:tasks.workunit.client.0.smithi121.stdout:1/489: dwrite d5/d10/d14/d2a/d3a/d87/d6c/d6f/d82/d15/d28/d3d/f55 [0,4194304] 0 2024-08-18T22:41:36.740 INFO:tasks.workunit.client.1.smithi195.stdout:4/100: dwrite d0/d9/d11/f18 [0,4194304] 0 2024-08-18T22:41:36.741 INFO:tasks.workunit.client.0.smithi121.stdout:5/372: write d3/d5/d13/d19/d24/d32/d38/f70 [910774,115559] 0 2024-08-18T22:41:36.743 INFO:tasks.workunit.client.1.smithi195.stdout:3/117: creat d7/f2b x:0 0 0 2024-08-18T22:41:36.743 INFO:tasks.workunit.client.1.smithi195.stdout:5/106: chown d0/f1d 30 1 2024-08-18T22:41:36.744 INFO:tasks.workunit.client.0.smithi121.stdout:2/353: creat d2/d8/d19/d4a/d64/f79 x:0 0 0 2024-08-18T22:41:36.748 INFO:tasks.workunit.client.1.smithi195.stdout:4/101: unlink d0/f20 0 2024-08-18T22:41:36.749 INFO:tasks.workunit.client.0.smithi121.stdout:1/490: rmdir d5/d10/d67 39 2024-08-18T22:41:36.751 INFO:tasks.workunit.client.1.smithi195.stdout:5/107: rename d0/d3/df/l17 to d0/db/l20 0 2024-08-18T22:41:36.752 INFO:tasks.workunit.client.1.smithi195.stdout:8/172: dwrite d1/de/d27/f29 [0,4194304] 0 2024-08-18T22:41:36.754 INFO:tasks.workunit.client.0.smithi121.stdout:2/354: dread d2/d3/d48/d77/f42 [0,4194304] 0 2024-08-18T22:41:36.755 INFO:tasks.workunit.client.0.smithi121.stdout:2/355: dread - d2/d8/d1f/f76 zero size 2024-08-18T22:41:36.756 INFO:tasks.workunit.client.1.smithi195.stdout:3/118: mknod d7/da/df/d1c/c2c 0 2024-08-18T22:41:36.757 INFO:tasks.workunit.client.0.smithi121.stdout:2/356: write d2/d8/d19/d4a/d64/f79 [614366,91715] 0 2024-08-18T22:41:36.758 INFO:tasks.workunit.client.0.smithi121.stdout:2/357: readlink d2/d3/l18 0 2024-08-18T22:41:36.758 INFO:tasks.workunit.client.1.smithi195.stdout:5/108: rmdir d0/d3/df 39 2024-08-18T22:41:36.759 INFO:tasks.workunit.client.0.smithi121.stdout:1/491: mknod d5/d10/d36/ca9 0 2024-08-18T22:41:36.761 INFO:tasks.workunit.client.0.smithi121.stdout:1/492: creat d5/d10/d14/d92/faa x:0 0 0 2024-08-18T22:41:36.765 INFO:tasks.workunit.client.0.smithi121.stdout:1/493: write d5/d10/f20 [2203899,83282] 0 2024-08-18T22:41:36.766 INFO:tasks.workunit.client.0.smithi121.stdout:1/494: write d5/d10/d14/d2a/d3a/d87/d6c/d6f/d82/d15/d38/f72 [1460050,107636] 0 2024-08-18T22:41:36.766 INFO:tasks.workunit.client.1.smithi195.stdout:8/173: creat d1/d3/db/d35/f42 x:0 0 0 2024-08-18T22:41:36.766 INFO:tasks.workunit.client.1.smithi195.stdout:4/102: dwrite d0/f22 [0,4194304] 0 2024-08-18T22:41:36.770 INFO:tasks.workunit.client.1.smithi195.stdout:8/174: symlink d1/d3/l43 0 2024-08-18T22:41:36.771 INFO:tasks.workunit.client.1.smithi195.stdout:3/119: link d7/ce d7/da/df/d1c/c2d 0 2024-08-18T22:41:36.772 INFO:tasks.workunit.client.0.smithi121.stdout:2/358: dread d2/d8/d1f/f32 [0,4194304] 0 2024-08-18T22:41:36.772 INFO:tasks.workunit.client.1.smithi195.stdout:8/175: rmdir d1/de/df/d1d/d1f 39 2024-08-18T22:41:36.774 INFO:tasks.workunit.client.1.smithi195.stdout:3/120: fdatasync d7/da/df/d1c/f25 0 2024-08-18T22:41:36.775 INFO:tasks.workunit.client.0.smithi121.stdout:9/551: sync 2024-08-18T22:41:36.775 INFO:tasks.workunit.client.0.smithi121.stdout:0/413: sync 2024-08-18T22:41:36.776 INFO:tasks.workunit.client.1.smithi195.stdout:8/176: mkdir d1/d3/db/d39/d44 0 2024-08-18T22:41:36.778 INFO:tasks.workunit.client.1.smithi195.stdout:8/177: unlink d1/d3/l23 0 2024-08-18T22:41:36.779 INFO:tasks.workunit.client.0.smithi121.stdout:9/552: getdents d0/d5/dd/d2f 0 2024-08-18T22:41:36.780 INFO:tasks.workunit.client.1.smithi195.stdout:8/178: write d1/de/df/f19 [5525769,91485] 0 2024-08-18T22:41:36.781 INFO:tasks.workunit.client.1.smithi195.stdout:3/121: dwrite d7/fc [0,4194304] 0 2024-08-18T22:41:36.782 INFO:tasks.workunit.client.0.smithi121.stdout:9/553: symlink d0/d38/d9e/df/d61/d90/d7c/lb6 0 2024-08-18T22:41:36.783 INFO:tasks.workunit.client.0.smithi121.stdout:9/554: fdatasync d0/d5/dd/d3f/fa7 0 2024-08-18T22:41:36.785 INFO:tasks.workunit.client.0.smithi121.stdout:9/555: mknod d0/d5/dd/d2f/d8b/db3/cb7 0 2024-08-18T22:41:36.786 INFO:tasks.workunit.client.1.smithi195.stdout:3/122: dread d7/da/df/d1c/f23 [0,4194304] 0 2024-08-18T22:41:36.788 INFO:tasks.workunit.client.1.smithi195.stdout:3/123: dread d7/da/df/f27 [0,4194304] 0 2024-08-18T22:41:36.790 INFO:tasks.workunit.client.1.smithi195.stdout:3/124: symlink d7/da/df/d1c/l2e 0 2024-08-18T22:41:36.794 INFO:tasks.workunit.client.0.smithi121.stdout:9/556: dwrite d0/d5/f25 [0,4194304] 0 2024-08-18T22:41:36.794 INFO:tasks.workunit.client.1.smithi195.stdout:3/125: rename d7/l11 to d7/da/df/l2f 0 2024-08-18T22:41:36.795 INFO:tasks.workunit.client.0.smithi121.stdout:1/495: rename d5/d10/d36 to d5/d10/d14/d2a/d3a/d87/d6c/d6f/d79/dab 0 2024-08-18T22:41:36.796 INFO:tasks.workunit.client.1.smithi195.stdout:5/109: getdents d0/db 0 2024-08-18T22:41:36.798 INFO:tasks.workunit.client.0.smithi121.stdout:1/496: write d5/d10/d14/d2a/d3a/d87/d6c/d6f/f77 [1334931,36505] 0 2024-08-18T22:41:36.799 INFO:tasks.workunit.client.1.smithi195.stdout:5/110: write d0/d3/f1e [3228344,43247] 0 2024-08-18T22:41:36.800 INFO:tasks.workunit.client.1.smithi195.stdout:3/126: getdents d7/d1f 0 2024-08-18T22:41:36.800 INFO:tasks.workunit.client.1.smithi195.stdout:4/103: fsync d0/f22 0 2024-08-18T22:41:36.801 INFO:tasks.workunit.client.0.smithi121.stdout:9/557: truncate d0/d38/d9e/df/f40 8164548 0 2024-08-18T22:41:36.801 INFO:tasks.workunit.client.0.smithi121.stdout:1/497: chown d5/d10/d14/d2a/d3a/d87/d6c/d6f/d82/d11/f6a 0 1 2024-08-18T22:41:36.802 INFO:tasks.workunit.client.1.smithi195.stdout:5/111: write d0/d3/d8/f14 [709142,113773] 0 2024-08-18T22:41:36.802 INFO:tasks.workunit.client.0.smithi121.stdout:9/558: fsync d0/d38/d52/d5f/f66 0 2024-08-18T22:41:36.803 INFO:tasks.workunit.client.1.smithi195.stdout:4/104: write d0/f22 [4460378,73484] 0 2024-08-18T22:41:36.804 INFO:tasks.workunit.client.0.smithi121.stdout:1/498: chown d5/d10/d14/d2a/d3a/d87/d6c/d6f/d82/d15/d38/f72 1280539 1 2024-08-18T22:41:36.805 INFO:tasks.workunit.client.0.smithi121.stdout:9/559: symlink d0/d38/d9e/df/d3d/lb8 0 2024-08-18T22:41:36.807 INFO:tasks.workunit.client.0.smithi121.stdout:9/560: write d0/d5/dd/d2f/f50 [258673,9679] 0 2024-08-18T22:41:36.807 INFO:tasks.workunit.client.1.smithi195.stdout:4/105: chown d0/d9/f1c 124 1 2024-08-18T22:41:36.807 INFO:tasks.workunit.client.1.smithi195.stdout:5/112: symlink d0/db/l21 0 2024-08-18T22:41:36.808 INFO:tasks.workunit.client.1.smithi195.stdout:5/113: stat d0/d2 0 2024-08-18T22:41:36.810 INFO:tasks.workunit.client.0.smithi121.stdout:9/561: write d0/d5/dd/f9c [729418,73645] 0 2024-08-18T22:41:36.810 INFO:tasks.workunit.client.1.smithi195.stdout:8/179: write d1/de/df/d1d/f3e [694677,103815] 0 2024-08-18T22:41:36.812 INFO:tasks.workunit.client.1.smithi195.stdout:5/114: creat d0/d2/f22 x:0 0 0 2024-08-18T22:41:36.812 INFO:tasks.workunit.client.0.smithi121.stdout:9/562: write d0/fad [262345,113320] 0 2024-08-18T22:41:36.813 INFO:tasks.workunit.client.1.smithi195.stdout:3/127: getdents d7/da/df/d1c 0 2024-08-18T22:41:36.814 INFO:tasks.workunit.client.0.smithi121.stdout:1/499: dwrite d5/d10/d14/f90 [0,4194304] 0 2024-08-18T22:41:36.816 INFO:tasks.workunit.client.1.smithi195.stdout:8/180: creat d1/d3/d1c/f45 x:0 0 0 2024-08-18T22:41:36.816 INFO:tasks.workunit.client.0.smithi121.stdout:1/500: write d5/d10/d14/d34/f9c [512410,84116] 0 2024-08-18T22:41:36.817 INFO:tasks.workunit.client.1.smithi195.stdout:5/115: dread d0/d3/f15 [0,4194304] 0 2024-08-18T22:41:36.817 INFO:tasks.workunit.client.1.smithi195.stdout:8/181: readlink d1/d3/d1c/l40 0 2024-08-18T22:41:36.817 INFO:tasks.workunit.client.1.smithi195.stdout:4/106: link d0/d9/d11/d16/f1b d0/d9/f23 0 2024-08-18T22:41:36.818 INFO:tasks.workunit.client.1.smithi195.stdout:4/107: chown d0/d9/d11 7437 1 2024-08-18T22:41:36.818 INFO:tasks.workunit.client.1.smithi195.stdout:4/108: chown d0/f4 177553 1 2024-08-18T22:41:36.819 INFO:tasks.workunit.client.0.smithi121.stdout:9/563: rename d0/d5/dd/d3b/d48/f69 to d0/d38/d9e/d18/fb9 0 2024-08-18T22:41:36.821 INFO:tasks.workunit.client.1.smithi195.stdout:5/116: mknod d0/d3/d8/c23 0 2024-08-18T22:41:36.824 INFO:tasks.workunit.client.1.smithi195.stdout:8/182: symlink d1/l46 0 2024-08-18T22:41:36.825 INFO:tasks.workunit.client.0.smithi121.stdout:5/373: dread d3/d5/d27/d35/d67/f4b [0,4194304] 0 2024-08-18T22:41:36.825 INFO:tasks.workunit.client.1.smithi195.stdout:5/117: chown d0/d2/l10 0 1 2024-08-18T22:41:36.826 INFO:tasks.workunit.client.1.smithi195.stdout:3/128: link d7/da/df/d1c/c2d d7/da/c30 0 2024-08-18T22:41:36.828 INFO:tasks.workunit.client.0.smithi121.stdout:1/501: dwrite d5/d10/f20 [0,4194304] 0 2024-08-18T22:41:36.828 INFO:tasks.workunit.client.0.smithi121.stdout:2/359: dread d2/d3/d53/f66 [0,4194304] 0 2024-08-18T22:41:36.829 INFO:tasks.workunit.client.1.smithi195.stdout:5/118: unlink d0/d3/f1e 0 2024-08-18T22:41:36.830 INFO:tasks.workunit.client.0.smithi121.stdout:5/374: write d3/d5/d13/d19/d24/d4d/f4f [1000155,58546] 0 2024-08-18T22:41:36.830 INFO:tasks.workunit.client.1.smithi195.stdout:4/109: dwrite d0/f3 [4194304,4194304] 0 2024-08-18T22:41:36.830 INFO:tasks.workunit.client.1.smithi195.stdout:3/129: rmdir d7/da/df 39 2024-08-18T22:41:36.832 INFO:tasks.workunit.client.0.smithi121.stdout:2/360: dread - d2/d3/d48/d77/f6d zero size 2024-08-18T22:41:36.833 INFO:tasks.workunit.client.0.smithi121.stdout:1/502: truncate d5/d10/d14/d2a/f68 5081645 0 2024-08-18T22:41:36.834 INFO:tasks.workunit.client.0.smithi121.stdout:9/564: dwrite d0/d5/dd/d3b/d48/f57 [4194304,4194304] 0 2024-08-18T22:41:36.834 INFO:tasks.workunit.client.0.smithi121.stdout:5/375: write d3/fc [1653596,9610] 0 2024-08-18T22:41:36.835 INFO:tasks.workunit.client.1.smithi195.stdout:3/130: dread - d7/da/df/d1c/f25 zero size 2024-08-18T22:41:36.836 INFO:tasks.workunit.client.1.smithi195.stdout:8/183: dwrite d1/d3/f6 [4194304,4194304] 0 2024-08-18T22:41:36.836 INFO:tasks.workunit.client.1.smithi195.stdout:3/131: write d7/f9 [560117,49671] 0 2024-08-18T22:41:36.837 INFO:tasks.workunit.client.0.smithi121.stdout:9/565: readlink d0/d5/dd/l31 0 2024-08-18T22:41:36.838 INFO:tasks.workunit.client.0.smithi121.stdout:9/566: write d0/d5/f98 [175595,46095] 0 2024-08-18T22:41:36.838 INFO:tasks.workunit.client.0.smithi121.stdout:5/376: dread - d3/f46 zero size 2024-08-18T22:41:36.839 INFO:tasks.workunit.client.1.smithi195.stdout:3/132: chown d7/da/df/f27 51525145 1 2024-08-18T22:41:36.839 INFO:tasks.workunit.client.1.smithi195.stdout:4/110: link d0/d9/lc d0/l24 0 2024-08-18T22:41:36.839 INFO:tasks.workunit.client.1.smithi195.stdout:5/119: dread d0/d3/f15 [0,4194304] 0 2024-08-18T22:41:36.842 INFO:tasks.workunit.client.0.smithi121.stdout:5/377: write d3/d5/d13/f16 [1769831,53765] 0 2024-08-18T22:41:36.843 INFO:tasks.workunit.client.0.smithi121.stdout:9/567: mkdir d0/d38/d9e/d45/dba 0 2024-08-18T22:41:36.844 INFO:tasks.workunit.client.0.smithi121.stdout:2/361: getdents d2/d3/d51 0 2024-08-18T22:41:36.844 INFO:tasks.workunit.client.0.smithi121.stdout:5/378: mkdir d3/d5c/d78 0 2024-08-18T22:41:36.845 INFO:tasks.workunit.client.1.smithi195.stdout:3/133: mknod d7/c31 0 2024-08-18T22:41:36.846 INFO:tasks.workunit.client.0.smithi121.stdout:5/379: fdatasync d3/f1c 0 2024-08-18T22:41:36.847 INFO:tasks.workunit.client.0.smithi121.stdout:2/362: write d2/d8/d19/f46 [1370819,87992] 0 2024-08-18T22:41:36.847 INFO:tasks.workunit.client.1.smithi195.stdout:8/184: dwrite d1/d3/d1c/d21/f28 [0,4194304] 0 2024-08-18T22:41:36.849 INFO:tasks.workunit.client.1.smithi195.stdout:4/111: creat d0/f25 x:0 0 0 2024-08-18T22:41:36.850 INFO:tasks.workunit.client.1.smithi195.stdout:5/120: creat d0/d3/df/d1a/f24 x:0 0 0 2024-08-18T22:41:36.850 INFO:tasks.workunit.client.0.smithi121.stdout:9/568: creat d0/d38/d9e/d45/dba/fbb x:0 0 0 2024-08-18T22:41:36.851 INFO:tasks.workunit.client.1.smithi195.stdout:8/185: creat d1/d3/db/d35/f47 x:0 0 0 2024-08-18T22:41:36.852 INFO:tasks.workunit.client.0.smithi121.stdout:2/363: mknod d2/d3/d48/c7a 0 2024-08-18T22:41:36.853 INFO:tasks.workunit.client.1.smithi195.stdout:8/186: fsync d1/d3/db/f34 0 2024-08-18T22:41:36.854 INFO:tasks.workunit.client.1.smithi195.stdout:5/121: unlink d0/d2/ce 0 2024-08-18T22:41:36.855 INFO:tasks.workunit.client.0.smithi121.stdout:5/380: unlink d3/f14 0 2024-08-18T22:41:36.855 INFO:tasks.workunit.client.0.smithi121.stdout:2/364: write d2/d8/d19/d4a/d64/f79 [616092,102983] 0 2024-08-18T22:41:36.855 INFO:tasks.workunit.client.1.smithi195.stdout:8/187: fdatasync d1/de/df/f19 0 2024-08-18T22:41:36.857 INFO:tasks.workunit.client.1.smithi195.stdout:5/122: fdatasync d0/d3/df/d1a/f24 0 2024-08-18T22:41:36.859 INFO:tasks.workunit.client.1.smithi195.stdout:4/112: getdents d0/d9/d11 0 2024-08-18T22:41:36.859 INFO:tasks.workunit.client.0.smithi121.stdout:9/569: dwrite d0/d5/f9b [0,4194304] 0 2024-08-18T22:41:36.859 INFO:tasks.workunit.client.1.smithi195.stdout:3/134: dwrite d7/da/df/f20 [0,4194304] 0 2024-08-18T22:41:36.860 INFO:tasks.workunit.client.0.smithi121.stdout:2/365: creat d2/d8/d19/f7b x:0 0 0 2024-08-18T22:41:36.860 INFO:tasks.workunit.client.1.smithi195.stdout:3/135: fdatasync d7/f18 0 2024-08-18T22:41:36.862 INFO:tasks.workunit.client.1.smithi195.stdout:8/188: rmdir d1/d3/d16 0 2024-08-18T22:41:36.863 INFO:tasks.workunit.client.0.smithi121.stdout:9/570: write d0/d5/dd/f9c [936941,121775] 0 2024-08-18T22:41:36.863 INFO:tasks.workunit.client.0.smithi121.stdout:2/366: write d2/d3/d48/d77/f26 [3675315,100686] 0 2024-08-18T22:41:36.864 INFO:tasks.workunit.client.1.smithi195.stdout:3/136: symlink d7/da/df/d1c/l32 0 2024-08-18T22:41:36.865 INFO:tasks.workunit.client.1.smithi195.stdout:8/189: fsync d1/d3/db/f17 0 2024-08-18T22:41:36.866 INFO:tasks.workunit.client.0.smithi121.stdout:2/367: mknod d2/d8/c7c 0 2024-08-18T22:41:36.869 INFO:tasks.workunit.client.1.smithi195.stdout:3/137: mknod d7/c33 0 2024-08-18T22:41:36.869 INFO:tasks.workunit.client.0.smithi121.stdout:2/368: truncate d2/f2c 1750929 0 2024-08-18T22:41:36.870 INFO:tasks.workunit.client.1.smithi195.stdout:3/138: chown l5 0 1 2024-08-18T22:41:36.871 INFO:tasks.workunit.client.1.smithi195.stdout:9/130: sync 2024-08-18T22:41:36.872 INFO:tasks.workunit.client.1.smithi195.stdout:5/123: dwrite d0/d3/df/d1a/f24 [0,4194304] 0 2024-08-18T22:41:36.873 INFO:tasks.workunit.client.1.smithi195.stdout:9/131: write d1c/f1d [4640352,49843] 0 2024-08-18T22:41:36.874 INFO:tasks.workunit.client.1.smithi195.stdout:3/139: creat d7/d1f/f34 x:0 0 0 2024-08-18T22:41:36.875 INFO:tasks.workunit.client.1.smithi195.stdout:5/124: chown d0/d3/df/d1a/f24 31812054 1 2024-08-18T22:41:36.876 INFO:tasks.workunit.client.1.smithi195.stdout:8/190: getdents d1/de/df/d1d/d1f 0 2024-08-18T22:41:36.877 INFO:tasks.workunit.client.1.smithi195.stdout:5/125: stat d0/db 0 2024-08-18T22:41:36.877 INFO:tasks.workunit.client.1.smithi195.stdout:5/126: write d0/f1d [960663,45640] 0 2024-08-18T22:41:36.878 INFO:tasks.workunit.client.0.smithi121.stdout:2/369: dwrite d2/d3/d53/f66 [4194304,4194304] 0 2024-08-18T22:41:36.879 INFO:tasks.workunit.client.1.smithi195.stdout:3/140: dread d7/d1f/f26 [0,4194304] 0 2024-08-18T22:41:36.881 INFO:tasks.workunit.client.1.smithi195.stdout:3/141: write f6 [1163353,125268] 0 2024-08-18T22:41:36.881 INFO:tasks.workunit.client.1.smithi195.stdout:9/132: link l18 d1c/l2f 0 2024-08-18T22:41:36.882 INFO:tasks.workunit.client.0.smithi121.stdout:2/370: symlink d2/d8/l7d 0 2024-08-18T22:41:36.883 INFO:tasks.workunit.client.1.smithi195.stdout:9/133: fsync f0 0 2024-08-18T22:41:36.884 INFO:tasks.workunit.client.0.smithi121.stdout:2/371: symlink d2/d73/l7e 0 2024-08-18T22:41:36.886 INFO:tasks.workunit.client.0.smithi121.stdout:2/372: chown d2/d8/d19/d55/c69 0 1 2024-08-18T22:41:36.886 INFO:tasks.workunit.client.1.smithi195.stdout:9/134: symlink d1c/l30 0 2024-08-18T22:41:36.887 INFO:tasks.workunit.client.0.smithi121.stdout:2/373: fsync d2/d8/d19/dc/f2d 0 2024-08-18T22:41:36.888 INFO:tasks.workunit.client.1.smithi195.stdout:9/135: dread - d1c/f1f zero size 2024-08-18T22:41:36.889 INFO:tasks.workunit.client.0.smithi121.stdout:2/374: symlink d2/d73/l7f 0 2024-08-18T22:41:36.889 INFO:tasks.workunit.client.1.smithi195.stdout:9/136: chown l6 3445032 1 2024-08-18T22:41:36.890 INFO:tasks.workunit.client.1.smithi195.stdout:3/142: getdents d7/da/df 0 2024-08-18T22:41:36.892 INFO:tasks.workunit.client.1.smithi195.stdout:3/143: mknod d7/d1f/c35 0 2024-08-18T22:41:36.897 INFO:tasks.workunit.client.0.smithi121.stdout:8/564: sync 2024-08-18T22:41:36.897 INFO:tasks.workunit.client.0.smithi121.stdout:7/538: sync 2024-08-18T22:41:36.897 INFO:tasks.workunit.client.0.smithi121.stdout:3/522: sync 2024-08-18T22:41:36.897 INFO:tasks.workunit.client.0.smithi121.stdout:4/433: sync 2024-08-18T22:41:36.898 INFO:tasks.workunit.client.1.smithi195.stdout:9/137: dwrite d1c/f24 [0,4194304] 0 2024-08-18T22:41:36.901 INFO:tasks.workunit.client.1.smithi195.stdout:9/138: creat d1c/f31 x:0 0 0 2024-08-18T22:41:36.901 INFO:tasks.workunit.client.0.smithi121.stdout:3/523: chown d1e/d1f/d25/d2e/d36/f3c 5 1 2024-08-18T22:41:36.902 INFO:tasks.workunit.client.1.smithi195.stdout:3/144: dwrite d7/f17 [4194304,4194304] 0 2024-08-18T22:41:36.902 INFO:tasks.workunit.client.1.smithi195.stdout:4/113: fsync d0/f25 0 2024-08-18T22:41:36.903 INFO:tasks.workunit.client.0.smithi121.stdout:3/524: write d1e/d1f/d25/f27 [3963731,41036] 0 2024-08-18T22:41:36.905 INFO:tasks.workunit.client.1.smithi195.stdout:9/139: mkdir d1c/d32 0 2024-08-18T22:41:36.905 INFO:tasks.workunit.client.0.smithi121.stdout:8/565: creat d6/d1e/d2d/d78/d45/d86/fc4 x:0 0 0 2024-08-18T22:41:36.906 INFO:tasks.workunit.client.0.smithi121.stdout:3/525: write d1e/d1f/d25/d2e/d36/f37 [4364796,39646] 0 2024-08-18T22:41:36.907 INFO:tasks.workunit.client.1.smithi195.stdout:4/114: rename d0/f4 to d0/d9/d11/d16/f26 0 2024-08-18T22:41:36.908 INFO:tasks.workunit.client.0.smithi121.stdout:2/375: rmdir d2/d3/d48 39 2024-08-18T22:41:36.909 INFO:tasks.workunit.client.0.smithi121.stdout:7/539: dread fc [0,4194304] 0 2024-08-18T22:41:36.909 INFO:tasks.workunit.client.1.smithi195.stdout:9/140: creat d1c/f33 x:0 0 0 2024-08-18T22:41:36.909 INFO:tasks.workunit.client.0.smithi121.stdout:4/434: link d2/f72 d2/dc/d16/d59/d83/f98 0 2024-08-18T22:41:36.910 INFO:tasks.workunit.client.1.smithi195.stdout:9/141: write d1c/f23 [841946,11116] 0 2024-08-18T22:41:36.911 INFO:tasks.workunit.client.0.smithi121.stdout:5/381: write d3/d5/d27/d35/f5d [2941,106796] 0 2024-08-18T22:41:36.913 INFO:tasks.workunit.client.1.smithi195.stdout:3/145: creat d7/da/f36 x:0 0 0 2024-08-18T22:41:36.913 INFO:tasks.workunit.client.0.smithi121.stdout:7/540: readlink de/d1a/d20/la8 0 2024-08-18T22:41:36.914 INFO:tasks.workunit.client.1.smithi195.stdout:8/191: write d1/f2a [1407850,23341] 0 2024-08-18T22:41:36.915 INFO:tasks.workunit.client.1.smithi195.stdout:8/192: chown d1/de/d31 12 1 2024-08-18T22:41:36.917 INFO:tasks.workunit.client.0.smithi121.stdout:3/526: mkdir d1e/d1f/d5e/dbc 0 2024-08-18T22:41:36.918 INFO:tasks.workunit.client.1.smithi195.stdout:3/146: creat d7/d1f/f37 x:0 0 0 2024-08-18T22:41:36.919 INFO:tasks.workunit.client.1.smithi195.stdout:9/142: mknod d1c/d32/c34 0 2024-08-18T22:41:36.919 INFO:tasks.workunit.client.1.smithi195.stdout:3/147: write f6 [1932717,43761] 0 2024-08-18T22:41:36.920 INFO:tasks.workunit.client.1.smithi195.stdout:4/115: link d0/d9/f23 d0/d7/d1d/f27 0 2024-08-18T22:41:36.920 INFO:tasks.workunit.client.0.smithi121.stdout:1/503: dread d5/f49 [0,4194304] 0 2024-08-18T22:41:36.920 INFO:tasks.workunit.client.0.smithi121.stdout:8/566: dwrite d6/d17/d18/f76 [0,4194304] 0 2024-08-18T22:41:36.922 INFO:tasks.workunit.client.0.smithi121.stdout:4/435: rename d2/dc/d1c/f33 to d2/dc/d16/d22/d2c/d44/d8c/f99 0 2024-08-18T22:41:36.922 INFO:tasks.workunit.client.0.smithi121.stdout:7/541: rename de to de/d1a/d4f/daa 22 2024-08-18T22:41:36.923 INFO:tasks.workunit.client.1.smithi195.stdout:9/143: unlink f9 0 2024-08-18T22:41:36.923 INFO:tasks.workunit.client.1.smithi195.stdout:3/148: mkdir d7/da/df/d38 0 2024-08-18T22:41:36.924 INFO:tasks.workunit.client.0.smithi121.stdout:7/542: chown de/f7c 2967484 1 2024-08-18T22:41:36.924 INFO:tasks.workunit.client.1.smithi195.stdout:3/149: write d7/da/f14 [559282,126799] 0 2024-08-18T22:41:36.925 INFO:tasks.workunit.client.1.smithi195.stdout:3/150: chown c2 8841 1 2024-08-18T22:41:36.925 INFO:tasks.workunit.client.1.smithi195.stdout:3/151: readlink d7/da/ld 0 2024-08-18T22:41:36.926 INFO:tasks.workunit.client.0.smithi121.stdout:3/527: rename d1e/d1f/d3e/d76 to d1e/d1f/d25/d67/d92/dbd 0 2024-08-18T22:41:36.927 INFO:tasks.workunit.client.1.smithi195.stdout:4/116: rename d0/d9/d11/f15 to d0/d7/d1d/f28 0 2024-08-18T22:41:36.927 INFO:tasks.workunit.client.0.smithi121.stdout:1/504: mkdir d5/d10/d14/d2a/d3a/d87/d6c/d6f/d82/d15/d28/d3d/d9a/dac 0 2024-08-18T22:41:36.928 INFO:tasks.workunit.client.1.smithi195.stdout:3/152: truncate d7/d1f/f37 286098 0 2024-08-18T22:41:36.929 INFO:tasks.workunit.client.0.smithi121.stdout:1/505: write d5/d10/d14/f4b [604851,7598] 0 2024-08-18T22:41:36.930 INFO:tasks.workunit.client.1.smithi195.stdout:8/193: link d1/de/df/l1b d1/de/df/l48 0 2024-08-18T22:41:36.931 INFO:tasks.workunit.client.1.smithi195.stdout:8/194: readlink d1/de/df/d1d/d1f/l25 0 2024-08-18T22:41:36.932 INFO:tasks.workunit.client.0.smithi121.stdout:3/528: creat d1e/d1f/d25/d58/fbe x:0 0 0 2024-08-18T22:41:36.932 INFO:tasks.workunit.client.1.smithi195.stdout:4/117: getdents d0/d7 0 2024-08-18T22:41:36.933 INFO:tasks.workunit.client.1.smithi195.stdout:8/195: read d1/de/df/d1d/f3e [2423666,10120] 0 2024-08-18T22:41:36.933 INFO:tasks.workunit.client.0.smithi121.stdout:4/436: link d2/dc/d16/d22/d2c/d44/d8c/f99 d2/dc/d16/d47/f9a 0 2024-08-18T22:41:36.935 INFO:tasks.workunit.client.0.smithi121.stdout:7/543: mknod de/d13/d18/d23/d24/d25/cab 0 2024-08-18T22:41:36.936 INFO:tasks.workunit.client.0.smithi121.stdout:1/506: creat d5/d10/d14/d34/fad x:0 0 0 2024-08-18T22:41:36.937 INFO:tasks.workunit.client.1.smithi195.stdout:8/196: mkdir d1/d3/d1c/d49 0 2024-08-18T22:41:36.937 INFO:tasks.workunit.client.0.smithi121.stdout:7/544: dread de/d13/d18/f60 [0,4194304] 0 2024-08-18T22:41:36.938 INFO:tasks.workunit.client.0.smithi121.stdout:3/529: rename d1e/d1f/d3e/db2/f95 to d1e/d1f/d25/d2e/fbf 0 2024-08-18T22:41:36.938 INFO:tasks.workunit.client.0.smithi121.stdout:7/545: readlink de/d1a/d34/l40 0 2024-08-18T22:41:36.939 INFO:tasks.workunit.client.0.smithi121.stdout:1/507: stat d5/d10/d14/d2a/d3a/d87/d6c/d6f/d82/d15/d38/d8e 0 2024-08-18T22:41:36.939 INFO:tasks.workunit.client.0.smithi121.stdout:4/437: truncate d2/dc/d16/d22/d2c/d44/d66/f6d 590363 0 2024-08-18T22:41:36.941 INFO:tasks.workunit.client.0.smithi121.stdout:3/530: chown d1e/d1f/d25/d2e/c6c 152180 1 2024-08-18T22:41:36.943 INFO:tasks.workunit.client.0.smithi121.stdout:1/508: unlink d5/d10/d14/d2a/fa6 0 2024-08-18T22:41:36.944 INFO:tasks.workunit.client.0.smithi121.stdout:3/531: write d1e/d1f/d25/d2e/d36/f86 [924142,93386] 0 2024-08-18T22:41:36.945 INFO:tasks.workunit.client.1.smithi195.stdout:8/197: dwrite d1/de/df/d1d/f3e [0,4194304] 0 2024-08-18T22:41:36.945 INFO:tasks.workunit.client.1.smithi195.stdout:3/153: mknod d7/da/df/d38/c39 0 2024-08-18T22:41:36.947 INFO:tasks.workunit.client.0.smithi121.stdout:4/438: rename d2/dc/d1c/f7e to d2/dc/d16/d22/d2c/d44/d66/f9b 0 2024-08-18T22:41:36.950 INFO:tasks.workunit.client.1.smithi195.stdout:4/118: dread d0/d9/d11/f18 [0,4194304] 0 2024-08-18T22:41:36.952 INFO:tasks.workunit.client.1.smithi195.stdout:4/119: mknod d0/d7/d1d/c29 0 2024-08-18T22:41:36.952 INFO:tasks.workunit.client.0.smithi121.stdout:3/532: rmdir d1e/d1f/d25/d2e 39 2024-08-18T22:41:36.956 INFO:tasks.workunit.client.0.smithi121.stdout:7/546: link de/d1a/d2f/d4b/d6d/l9f de/d1a/d20/d39/lac 0 2024-08-18T22:41:36.956 INFO:tasks.workunit.client.1.smithi195.stdout:4/120: unlink d0/d9/d11/d16/f26 0 2024-08-18T22:41:36.956 INFO:tasks.workunit.client.1.smithi195.stdout:3/154: write d7/da/df/d1c/f25 [1013099,58910] 0 2024-08-18T22:41:36.957 INFO:tasks.workunit.client.0.smithi121.stdout:1/509: dwrite d5/d10/d14/d2a/d3a/d87/d6c/d6f/d82/d15/d38/f72 [0,4194304] 0 2024-08-18T22:41:36.959 INFO:tasks.workunit.client.1.smithi195.stdout:4/121: mknod d0/d9/d11/c2a 0 2024-08-18T22:41:36.959 INFO:tasks.workunit.client.1.smithi195.stdout:3/155: symlink d7/da/df/l3a 0 2024-08-18T22:41:36.960 INFO:tasks.workunit.client.1.smithi195.stdout:3/156: chown d7/f19 6129 1 2024-08-18T22:41:36.960 INFO:tasks.workunit.client.1.smithi195.stdout:4/122: chown d0/d9/lc 338073 1 2024-08-18T22:41:36.960 INFO:tasks.workunit.client.0.smithi121.stdout:5/382: dread d3/d5/d13/d19/d24/d32/d38/f3e [0,4194304] 0 2024-08-18T22:41:36.962 INFO:tasks.workunit.client.1.smithi195.stdout:4/123: unlink d0/d7/l17 0 2024-08-18T22:41:36.963 INFO:tasks.workunit.client.0.smithi121.stdout:2/376: dread d2/d8/d19/d55/f78 [0,4194304] 0 2024-08-18T22:41:36.963 INFO:tasks.workunit.client.0.smithi121.stdout:8/567: dwrite f5 [4194304,4194304] 0 2024-08-18T22:41:36.965 INFO:tasks.workunit.client.1.smithi195.stdout:4/124: chown d0/d7/d1d/f27 206438 1 2024-08-18T22:41:36.965 INFO:tasks.workunit.client.0.smithi121.stdout:7/547: mknod de/d13/d18/d9d/cad 0 2024-08-18T22:41:36.965 INFO:tasks.workunit.client.0.smithi121.stdout:3/533: write d1e/d1f/d25/f27 [3673529,48960] 0 2024-08-18T22:41:36.970 INFO:tasks.workunit.client.0.smithi121.stdout:1/510: write d5/d10/d14/d34/f63 [1217266,38866] 0 2024-08-18T22:41:36.970 INFO:tasks.workunit.client.1.smithi195.stdout:4/125: mknod d0/d7/d1d/c2b 0 2024-08-18T22:41:36.970 INFO:tasks.workunit.client.1.smithi195.stdout:3/157: dwrite d7/da/f36 [0,4194304] 0 2024-08-18T22:41:36.971 INFO:tasks.workunit.client.1.smithi195.stdout:3/158: truncate d7/f2b 795706 0 2024-08-18T22:41:36.972 INFO:tasks.workunit.client.0.smithi121.stdout:1/511: write d5/d10/d14/d34/f63 [2940905,14239] 0 2024-08-18T22:41:36.972 INFO:tasks.workunit.client.0.smithi121.stdout:8/568: dread d6/d1e/d2d/d78/d85/f9c [0,4194304] 0 2024-08-18T22:41:36.974 INFO:tasks.workunit.client.0.smithi121.stdout:0/414: sync 2024-08-18T22:41:36.974 INFO:tasks.workunit.client.0.smithi121.stdout:8/569: readlink d6/d17/d60/d5b/l8d 0 2024-08-18T22:41:36.974 INFO:tasks.workunit.client.1.smithi195.stdout:4/126: unlink d0/d9/d11/c2a 0 2024-08-18T22:41:36.975 INFO:tasks.workunit.client.0.smithi121.stdout:3/534: readlink d1e/d1f/d25/l40 0 2024-08-18T22:41:36.975 INFO:tasks.workunit.client.0.smithi121.stdout:2/377: fdatasync d2/d3/d48/f71 0 2024-08-18T22:41:36.977 INFO:tasks.workunit.client.0.smithi121.stdout:5/383: dread d3/d5/d27/d35/d67/f25 [0,4194304] 0 2024-08-18T22:41:36.979 INFO:tasks.workunit.client.0.smithi121.stdout:1/512: creat d5/d10/d14/d34/fae x:0 0 0 2024-08-18T22:41:36.979 INFO:tasks.workunit.client.1.smithi195.stdout:4/127: dread d0/f22 [0,4194304] 0 2024-08-18T22:41:36.980 INFO:tasks.workunit.client.1.smithi195.stdout:4/128: stat d0/l21 0 2024-08-18T22:41:36.980 INFO:tasks.workunit.client.1.smithi195.stdout:3/159: creat d7/da/df/f3b x:0 0 0 2024-08-18T22:41:36.981 INFO:tasks.workunit.client.0.smithi121.stdout:0/415: creat d1/d4/db/d24/d30/f86 x:0 0 0 2024-08-18T22:41:36.981 INFO:tasks.workunit.client.0.smithi121.stdout:4/439: dread d2/dc/d16/d22/f50 [0,4194304] 0 2024-08-18T22:41:36.983 INFO:tasks.workunit.client.1.smithi195.stdout:3/160: symlink d7/l3c 0 2024-08-18T22:41:36.985 INFO:tasks.workunit.client.1.smithi195.stdout:3/161: write d7/da/df/d1c/f25 [1313579,105360] 0 2024-08-18T22:41:36.985 INFO:tasks.workunit.client.0.smithi121.stdout:7/548: link de/d1a/d2f/d4b/d6d/f83 de/d13/d18/d23/d24/d29/d43/d8b/fae 0 2024-08-18T22:41:36.987 INFO:tasks.workunit.client.0.smithi121.stdout:4/440: unlink d2/dc/c8f 0 2024-08-18T22:41:36.987 INFO:tasks.workunit.client.0.smithi121.stdout:0/416: chown d1/d4/db/d18/d2e/f3d 34 1 2024-08-18T22:41:36.992 INFO:tasks.workunit.client.1.smithi195.stdout:3/162: dwrite d7/da/df/f1a [0,4194304] 0 2024-08-18T22:41:36.997 INFO:tasks.workunit.client.1.smithi195.stdout:3/163: creat d7/da/f3d x:0 0 0 2024-08-18T22:41:36.997 INFO:tasks.workunit.client.0.smithi121.stdout:2/378: dwrite d2/d8/d19/d55/f78 [0,4194304] 0 2024-08-18T22:41:36.998 INFO:tasks.workunit.client.1.smithi195.stdout:3/164: write d7/f10 [759390,35636] 0 2024-08-18T22:41:36.999 INFO:tasks.workunit.client.0.smithi121.stdout:0/417: write d1/d4/db/d24/f48 [1921676,62370] 0 2024-08-18T22:41:36.999 INFO:tasks.workunit.client.0.smithi121.stdout:1/513: read - d5/d10/d14/d2a/d3a/d87/d6c/d6f/d79/dab/f75 zero size 2024-08-18T22:41:37.005 INFO:tasks.workunit.client.1.smithi195.stdout:4/129: write d0/d7/d1d/f27 [30997,2068] 0 2024-08-18T22:41:37.006 INFO:tasks.workunit.client.1.smithi195.stdout:4/130: dread - d0/f25 zero size 2024-08-18T22:41:37.006 INFO:tasks.workunit.client.0.smithi121.stdout:7/549: dwrite de/d13/f49 [0,4194304] 0 2024-08-18T22:41:37.007 INFO:tasks.workunit.client.1.smithi195.stdout:3/165: dwrite d7/da/df/f12 [0,4194304] 0 2024-08-18T22:41:37.007 INFO:tasks.workunit.client.1.smithi195.stdout:4/131: dread - d0/ff zero size 2024-08-18T22:41:37.011 INFO:tasks.workunit.client.0.smithi121.stdout:0/418: creat d1/d4/db/d24/d30/d52/f87 x:0 0 0 2024-08-18T22:41:37.015 INFO:tasks.workunit.client.0.smithi121.stdout:8/570: truncate d6/d17/d60/d5b/f9a 416517 0 2024-08-18T22:41:37.016 INFO:tasks.workunit.client.0.smithi121.stdout:5/384: dread d3/fd [0,4194304] 0 2024-08-18T22:41:37.016 INFO:tasks.workunit.client.1.smithi195.stdout:3/166: dwrite d7/da/f3d [0,4194304] 0 2024-08-18T22:41:37.016 INFO:tasks.workunit.client.0.smithi121.stdout:2/379: dwrite d2/d8/d19/d55/f78 [0,4194304] 0 2024-08-18T22:41:37.017 INFO:tasks.workunit.client.1.smithi195.stdout:4/132: dwrite d0/d9/f23 [0,4194304] 0 2024-08-18T22:41:37.017 INFO:tasks.workunit.client.0.smithi121.stdout:7/550: mkdir de/d1a/d2f/d4b/daf 0 2024-08-18T22:41:37.019 INFO:tasks.workunit.client.1.smithi195.stdout:3/167: mknod d7/d1f/c3e 0 2024-08-18T22:41:37.020 INFO:tasks.workunit.client.1.smithi195.stdout:3/168: stat d7/f9 0 2024-08-18T22:41:37.023 INFO:tasks.workunit.client.0.smithi121.stdout:5/385: write d3/d5/d3c/d3f/f6e [1098062,59989] 0 2024-08-18T22:41:37.025 INFO:tasks.workunit.client.1.smithi195.stdout:4/133: dread d0/d9/f1c [0,4194304] 0 2024-08-18T22:41:37.028 INFO:tasks.workunit.client.0.smithi121.stdout:9/571: sync 2024-08-18T22:41:37.028 INFO:tasks.workunit.client.0.smithi121.stdout:3/535: dwrite d1e/d1f/d25/d2e/f91 [0,4194304] 0 2024-08-18T22:41:37.029 INFO:tasks.workunit.client.0.smithi121.stdout:8/571: rename d6/d17/d60/d5b/l8d to d6/d17/d18/d83/lc5 0 2024-08-18T22:41:37.032 INFO:tasks.workunit.client.0.smithi121.stdout:1/514: dwrite d5/d10/d14/d2a/d3a/d87/d6c/d6f/f77 [0,4194304] 0 2024-08-18T22:41:37.032 INFO:tasks.workunit.client.1.smithi195.stdout:3/169: rename d7/da/f36 to d7/da/df/d38/f3f 0 2024-08-18T22:41:37.033 INFO:tasks.workunit.client.0.smithi121.stdout:3/536: chown d1e/d1f/d25/f54 585 1 2024-08-18T22:41:37.036 INFO:tasks.workunit.client.1.smithi195.stdout:3/170: dread - d7/d1f/f34 zero size 2024-08-18T22:41:37.036 INFO:tasks.workunit.client.0.smithi121.stdout:9/572: mknod d0/d5/dd/d3b/cbc 0 2024-08-18T22:41:37.038 INFO:tasks.workunit.client.1.smithi195.stdout:3/171: write d7/fc [4284767,92696] 0 2024-08-18T22:41:37.040 INFO:tasks.workunit.client.1.smithi195.stdout:4/134: dwrite d0/f3 [0,4194304] 0 2024-08-18T22:41:37.041 INFO:tasks.workunit.client.0.smithi121.stdout:8/572: write d6/d1e/d2d/d78/fa8 [391643,69359] 0 2024-08-18T22:41:37.041 INFO:tasks.workunit.client.0.smithi121.stdout:7/551: getdents de/d1a/d2f 0 2024-08-18T22:41:37.043 INFO:tasks.workunit.client.1.smithi195.stdout:3/172: truncate d7/d1f/f26 428794 0 2024-08-18T22:41:37.044 INFO:tasks.workunit.client.0.smithi121.stdout:5/386: creat d3/d5/d13/d23/d66/f79 x:0 0 0 2024-08-18T22:41:37.044 INFO:tasks.workunit.client.0.smithi121.stdout:4/441: dwrite d2/fb [0,4194304] 0 2024-08-18T22:41:37.044 INFO:tasks.workunit.client.0.smithi121.stdout:9/573: dread - d0/d38/d52/f6d zero size 2024-08-18T22:41:37.044 INFO:tasks.workunit.client.0.smithi121.stdout:1/515: chown d5/d10/d14/d2a/d3a/d87/d6c/d6f/d79/dab 7570147 1 2024-08-18T22:41:37.044 INFO:tasks.workunit.client.0.smithi121.stdout:2/380: dwrite d2/d8/d19/f7b [0,4194304] 0 2024-08-18T22:41:37.049 INFO:tasks.workunit.client.1.smithi195.stdout:3/173: mknod d7/da/c40 0 2024-08-18T22:41:37.049 INFO:tasks.workunit.client.0.smithi121.stdout:7/552: read de/f28 [3871659,89392] 0 2024-08-18T22:41:37.049 INFO:tasks.workunit.client.1.smithi195.stdout:4/135: dwrite d0/f25 [0,4194304] 0 2024-08-18T22:41:37.051 INFO:tasks.workunit.client.0.smithi121.stdout:1/516: readlink d5/d10/d14/d2a/d3a/d87/d6c/d6f/d82/d15/la3 0 2024-08-18T22:41:37.054 INFO:tasks.workunit.client.0.smithi121.stdout:3/537: mknod d1e/d1f/d25/d67/d92/dbd/cc0 0 2024-08-18T22:41:37.054 INFO:tasks.workunit.client.0.smithi121.stdout:2/381: symlink d2/d3/d51/l80 0 2024-08-18T22:41:37.056 INFO:tasks.workunit.client.1.smithi195.stdout:4/136: mkdir d0/d9/d11/d2c 0 2024-08-18T22:41:37.058 INFO:tasks.workunit.client.1.smithi195.stdout:4/137: symlink d0/d7/d1d/l2d 0 2024-08-18T22:41:37.058 INFO:tasks.workunit.client.1.smithi195.stdout:3/174: dread d7/da/df/f20 [0,4194304] 0 2024-08-18T22:41:37.060 INFO:tasks.workunit.client.0.smithi121.stdout:5/387: unlink d3/d5/d13/d19/d24/d32/d38/f70 0 2024-08-18T22:41:37.060 INFO:tasks.workunit.client.0.smithi121.stdout:4/442: creat d2/dc/d16/d59/d83/f9c x:0 0 0 2024-08-18T22:41:37.061 INFO:tasks.workunit.client.1.smithi195.stdout:4/138: creat d0/d9/f2e x:0 0 0 2024-08-18T22:41:37.062 INFO:tasks.workunit.client.0.smithi121.stdout:9/574: rename d0/d38/d9e/df/d61/d90/f70 to d0/d38/d9e/df/d3d/fbd 0 2024-08-18T22:41:37.063 INFO:tasks.workunit.client.0.smithi121.stdout:7/553: dread de/d13/d18/d23/d24/d29/d43/d8b/fae [0,4194304] 0 2024-08-18T22:41:37.063 INFO:tasks.workunit.client.0.smithi121.stdout:2/382: creat d2/d3/d51/f81 x:0 0 0 2024-08-18T22:41:37.065 INFO:tasks.workunit.client.1.smithi195.stdout:4/139: creat d0/d7/d1d/f2f x:0 0 0 2024-08-18T22:41:37.066 INFO:tasks.workunit.client.0.smithi121.stdout:1/517: dwrite d5/d10/d14/d2a/f8d [0,4194304] 0 2024-08-18T22:41:37.067 INFO:tasks.workunit.client.0.smithi121.stdout:4/443: dread - d2/dc/d16/d22/f55 zero size 2024-08-18T22:41:37.067 INFO:tasks.workunit.client.1.smithi195.stdout:3/175: dwrite d7/d1f/f37 [0,4194304] 0 2024-08-18T22:41:37.070 INFO:tasks.workunit.client.1.smithi195.stdout:3/176: creat d7/da/df/d1c/f41 x:0 0 0 2024-08-18T22:41:37.071 INFO:tasks.workunit.client.0.smithi121.stdout:0/419: dread d1/d4/db/d18/f3a [0,4194304] 0 2024-08-18T22:41:37.073 INFO:tasks.workunit.client.0.smithi121.stdout:3/538: creat d1e/d1f/d25/d58/fc1 x:0 0 0 2024-08-18T22:41:37.073 INFO:tasks.workunit.client.0.smithi121.stdout:1/518: mkdir d5/d10/d14/d2a/daf 0 2024-08-18T22:41:37.074 INFO:tasks.workunit.client.0.smithi121.stdout:0/420: chown d1/d4/c62 31780 1 2024-08-18T22:41:37.077 INFO:tasks.workunit.client.0.smithi121.stdout:2/383: symlink d2/d8/d19/d55/l82 0 2024-08-18T22:41:37.077 INFO:tasks.workunit.client.1.smithi195.stdout:3/177: unlink d7/da/df/d1c/l2e 0 2024-08-18T22:41:37.078 INFO:tasks.workunit.client.0.smithi121.stdout:7/554: creat de/d13/d18/d9d/fb0 x:0 0 0 2024-08-18T22:41:37.078 INFO:tasks.workunit.client.0.smithi121.stdout:4/444: mknod d2/dc/d1c/c9d 0 2024-08-18T22:41:37.078 INFO:tasks.workunit.client.1.smithi195.stdout:4/140: dwrite d0/d9/f2e [0,4194304] 0 2024-08-18T22:41:37.082 INFO:tasks.workunit.client.0.smithi121.stdout:3/539: write d1e/d1f/d25/d2e/d36/f3c [698543,114232] 0 2024-08-18T22:41:37.083 INFO:tasks.workunit.client.1.smithi195.stdout:3/178: mknod d7/c42 0 2024-08-18T22:41:37.083 INFO:tasks.workunit.client.1.smithi195.stdout:4/141: creat d0/d9/d11/d2c/f30 x:0 0 0 2024-08-18T22:41:37.084 INFO:tasks.workunit.client.0.smithi121.stdout:0/421: unlink d1/d4/c49 0 2024-08-18T22:41:37.084 INFO:tasks.workunit.client.0.smithi121.stdout:2/384: symlink d2/l83 0 2024-08-18T22:41:37.084 INFO:tasks.workunit.client.1.smithi195.stdout:3/179: write d7/da/df/d1c/f41 [570230,60506] 0 2024-08-18T22:41:37.085 INFO:tasks.workunit.client.0.smithi121.stdout:9/575: dwrite d0/d38/d9e/f1f [0,4194304] 0 2024-08-18T22:41:37.086 INFO:tasks.workunit.client.1.smithi195.stdout:4/142: write d0/f22 [5412927,4525] 0 2024-08-18T22:41:37.090 INFO:tasks.workunit.client.1.smithi195.stdout:3/180: dread d7/d1f/f37 [0,4194304] 0 2024-08-18T22:41:37.091 INFO:tasks.workunit.client.0.smithi121.stdout:9/576: read d0/d5/dd/d3f/fa7 [6441677,23059] 0 2024-08-18T22:41:37.093 INFO:tasks.workunit.client.1.smithi195.stdout:3/181: write d7/da/df/d38/f3f [3853918,51904] 0 2024-08-18T22:41:37.095 INFO:tasks.workunit.client.0.smithi121.stdout:3/540: rename d1e/d1f/d25/d2e/d36/f3c to d1e/d1f/d3e/db2/dae/fc2 0 2024-08-18T22:41:37.098 INFO:tasks.workunit.client.0.smithi121.stdout:3/541: stat d1e/d1f/d25/d67/d92/dbd 0 2024-08-18T22:41:37.098 INFO:tasks.workunit.client.0.smithi121.stdout:9/577: dread d0/d5/dd/f9c [0,4194304] 0 2024-08-18T22:41:37.099 INFO:tasks.workunit.client.0.smithi121.stdout:2/385: dwrite d2/d8/d19/f52 [0,4194304] 0 2024-08-18T22:41:37.099 INFO:tasks.workunit.client.0.smithi121.stdout:0/422: creat d1/d4/f88 x:0 0 0 2024-08-18T22:41:37.103 INFO:tasks.workunit.client.0.smithi121.stdout:0/423: stat d1/d4/db/d24/d30/d52/d6a/l82 0 2024-08-18T22:41:37.105 INFO:tasks.workunit.client.0.smithi121.stdout:9/578: chown d0/f3 44 1 2024-08-18T22:41:37.108 INFO:tasks.workunit.client.0.smithi121.stdout:3/542: creat d1e/d1f/fc3 x:0 0 0 2024-08-18T22:41:37.111 INFO:tasks.workunit.client.0.smithi121.stdout:9/579: rmdir d0/d38/d52 39 2024-08-18T22:41:37.112 INFO:tasks.workunit.client.0.smithi121.stdout:9/580: chown d0/d38/d9e/df/d61/d90/f6c 135 1 2024-08-18T22:41:37.114 INFO:tasks.workunit.client.0.smithi121.stdout:3/543: unlink d1e/d1f/d25/d2e/c9e 0 2024-08-18T22:41:37.115 INFO:tasks.workunit.client.0.smithi121.stdout:0/424: symlink d1/d4/db/d18/l89 0 2024-08-18T22:41:37.116 INFO:tasks.workunit.client.0.smithi121.stdout:1/519: link d5/d10/d14/d2a/d3a/d87/d6c/d6f/d82/d15/d28/d3d/l59 d5/d10/d14/d2a/d3a/d87/d6c/d6f/d82/d15/d38/d8e/lb0 0 2024-08-18T22:41:37.116 INFO:tasks.workunit.client.0.smithi121.stdout:0/425: write d1/d4/db/f5a [833059,79166] 0 2024-08-18T22:41:37.119 INFO:tasks.workunit.client.0.smithi121.stdout:9/581: creat d0/d38/d9e/fbe x:0 0 0 2024-08-18T22:41:37.120 INFO:tasks.workunit.client.0.smithi121.stdout:3/544: symlink d1e/d1f/d25/d6b/d66/lc4 0 2024-08-18T22:41:37.120 INFO:tasks.workunit.client.0.smithi121.stdout:0/426: mkdir d1/d8a 0 2024-08-18T22:41:37.122 INFO:tasks.workunit.client.0.smithi121.stdout:1/520: rename d5/d10/d14/d34/f70 to d5/d10/d14/d2a/daf/fb1 0 2024-08-18T22:41:37.123 INFO:tasks.workunit.client.0.smithi121.stdout:3/545: chown d1e/l26 109249 1 2024-08-18T22:41:37.124 INFO:tasks.workunit.client.0.smithi121.stdout:1/521: chown d5/d10/d14/d2a/d3a/d87/d6c/d6f/d82/d15/d38/d8e 1225 1 2024-08-18T22:41:37.126 INFO:tasks.workunit.client.0.smithi121.stdout:3/546: readlink d1e/d1f/d25/d67/d92/dbd/l84 0 2024-08-18T22:41:37.126 INFO:tasks.workunit.client.0.smithi121.stdout:1/522: write d5/d10/d14/d92/faa [80456,38310] 0 2024-08-18T22:41:37.128 INFO:tasks.workunit.client.0.smithi121.stdout:3/547: fdatasync d1e/d1f/d25/d58/d75/fa9 0 2024-08-18T22:41:37.129 INFO:tasks.workunit.client.0.smithi121.stdout:0/427: mknod d1/d4/db/d24/d30/d52/d6a/c8b 0 2024-08-18T22:41:37.130 INFO:tasks.workunit.client.0.smithi121.stdout:0/428: readlink d1/d4/da/d2f/l4b 0 2024-08-18T22:41:37.130 INFO:tasks.workunit.client.0.smithi121.stdout:1/523: chown d5/d10/d14/d2a/d3a/d87/d6c/d6f/d82/f51 0 1 2024-08-18T22:41:37.130 INFO:tasks.workunit.client.1.smithi195.stdout:4/143: truncate d0/f22 1116925 0 2024-08-18T22:41:37.131 INFO:tasks.workunit.client.1.smithi195.stdout:3/182: truncate d7/da/df/d1c/f41 75671 0 2024-08-18T22:41:37.131 INFO:tasks.workunit.client.0.smithi121.stdout:9/582: rename d0/d38/d9e/df/d61/d90 to d0/d38/d44/dbf 0 2024-08-18T22:41:37.132 INFO:tasks.workunit.client.0.smithi121.stdout:9/583: fsync d0/d5/fa 0 2024-08-18T22:41:37.133 INFO:tasks.workunit.client.1.smithi195.stdout:4/144: creat d0/d7/d1d/f31 x:0 0 0 2024-08-18T22:41:37.133 INFO:tasks.workunit.client.1.smithi195.stdout:3/183: fdatasync d7/da/df/d1c/f23 0 2024-08-18T22:41:37.133 INFO:tasks.workunit.client.0.smithi121.stdout:3/548: creat d1e/d1f/d3e/db2/dae/fc5 x:0 0 0 2024-08-18T22:41:37.134 INFO:tasks.workunit.client.0.smithi121.stdout:0/429: unlink d1/d4/db/d24/d30/d52/f5d 0 2024-08-18T22:41:37.136 INFO:tasks.workunit.client.1.smithi195.stdout:3/184: dread d7/f10 [0,4194304] 0 2024-08-18T22:41:37.136 INFO:tasks.workunit.client.1.smithi195.stdout:4/145: write d0/f22 [123339,111329] 0 2024-08-18T22:41:37.140 INFO:tasks.workunit.client.0.smithi121.stdout:3/549: rename d1e/d1f/d25/d67/c7e to d1e/d1f/d25/d6b/d66/cc6 0 2024-08-18T22:41:37.141 INFO:tasks.workunit.client.1.smithi195.stdout:4/146: unlink d0/d9/f23 0 2024-08-18T22:41:37.142 INFO:tasks.workunit.client.1.smithi195.stdout:3/185: rename d7/da/df to d7/da/df/d43 22 2024-08-18T22:41:37.143 INFO:tasks.workunit.client.0.smithi121.stdout:7/555: fsync de/d13/d18/d9d/fb0 0 2024-08-18T22:41:37.143 INFO:tasks.workunit.client.1.smithi195.stdout:4/147: symlink d0/d9/l32 0 2024-08-18T22:41:37.143 INFO:tasks.workunit.client.1.smithi195.stdout:4/148: readlink d0/l21 0 2024-08-18T22:41:37.144 INFO:tasks.workunit.client.0.smithi121.stdout:1/524: rename d5/d10/d14/d2a/d3a/d87/d6c/d6f/d82/d15/d28/d3d/l59 to d5/d10/d14/d2a/d3a/d87/d6c/d6f/d82/d15/d38/d8e/lb2 0 2024-08-18T22:41:37.146 INFO:tasks.workunit.client.1.smithi195.stdout:3/186: dread d7/da/df/f20 [0,4194304] 0 2024-08-18T22:41:37.148 INFO:tasks.workunit.client.0.smithi121.stdout:0/430: rename d1/d4/db/f3c to d1/d4/db/d18/d2e/f8c 0 2024-08-18T22:41:37.148 INFO:tasks.workunit.client.0.smithi121.stdout:4/445: write d2/f72 [5242659,43296] 0 2024-08-18T22:41:37.149 INFO:tasks.workunit.client.0.smithi121.stdout:0/431: write d1/d4/f88 [608047,129519] 0 2024-08-18T22:41:37.151 INFO:tasks.workunit.client.1.smithi195.stdout:3/187: rename d7/c8 to d7/da/df/d1c/c44 0 2024-08-18T22:41:37.151 INFO:tasks.workunit.client.0.smithi121.stdout:7/556: dread de/d13/d18/d2e/f47 [0,4194304] 0 2024-08-18T22:41:37.151 INFO:tasks.workunit.client.0.smithi121.stdout:0/432: write d1/d4/db/f37 [549227,44148] 0 2024-08-18T22:41:37.154 INFO:tasks.workunit.client.1.smithi195.stdout:4/149: dwrite d0/d9/d11/f18 [4194304,4194304] 0 2024-08-18T22:41:37.154 INFO:tasks.workunit.client.0.smithi121.stdout:0/433: truncate d1/d4/db/d24/f48 2531371 0 2024-08-18T22:41:37.154 INFO:tasks.workunit.client.0.smithi121.stdout:4/446: symlink d2/dc/d1c/l9e 0 2024-08-18T22:41:37.156 INFO:tasks.workunit.client.0.smithi121.stdout:7/557: creat de/d65/fb1 x:0 0 0 2024-08-18T22:41:37.157 INFO:tasks.workunit.client.1.smithi195.stdout:4/150: dread d0/f8 [4194304,4194304] 0 2024-08-18T22:41:37.157 INFO:tasks.workunit.client.0.smithi121.stdout:7/558: fdatasync de/d13/d18/d23/d24/d29/d43/d7f/f80 0 2024-08-18T22:41:37.159 INFO:tasks.workunit.client.1.smithi195.stdout:3/188: write d7/d1f/f26 [295662,19773] 0 2024-08-18T22:41:37.159 INFO:tasks.workunit.client.0.smithi121.stdout:0/434: mknod d1/d4/db/d24/c8d 0 2024-08-18T22:41:37.160 INFO:tasks.workunit.client.1.smithi195.stdout:4/151: creat d0/f33 x:0 0 0 2024-08-18T22:41:37.161 INFO:tasks.workunit.client.1.smithi195.stdout:4/152: truncate d0/d7/d1d/f31 34917 0 2024-08-18T22:41:37.162 INFO:tasks.workunit.client.1.smithi195.stdout:3/189: creat d7/da/df/d38/f45 x:0 0 0 2024-08-18T22:41:37.162 INFO:tasks.workunit.client.0.smithi121.stdout:2/386: truncate d2/d3/d53/f66 7126148 0 2024-08-18T22:41:37.164 INFO:tasks.workunit.client.1.smithi195.stdout:3/190: mknod d7/da/c46 0 2024-08-18T22:41:37.164 INFO:tasks.workunit.client.0.smithi121.stdout:7/559: mknod de/d1a/d34/d38/d73/cb2 0 2024-08-18T22:41:37.165 INFO:tasks.workunit.client.1.smithi195.stdout:3/191: stat d7/da/f14 0 2024-08-18T22:41:37.165 INFO:tasks.workunit.client.1.smithi195.stdout:4/153: getdents d0/d9 0 2024-08-18T22:41:37.166 INFO:tasks.workunit.client.1.smithi195.stdout:4/154: dread - d0/d7/d1d/f2f zero size 2024-08-18T22:41:37.167 INFO:tasks.workunit.client.0.smithi121.stdout:7/560: dread - de/d1a/f61 zero size 2024-08-18T22:41:37.167 INFO:tasks.workunit.client.1.smithi195.stdout:3/192: mkdir d7/da/df/d47 0 2024-08-18T22:41:37.167 INFO:tasks.workunit.client.1.smithi195.stdout:4/155: write d0/d7/d1d/f31 [580966,117267] 0 2024-08-18T22:41:37.170 INFO:tasks.workunit.client.0.smithi121.stdout:2/387: dwrite d2/d3/d51/f81 [0,4194304] 0 2024-08-18T22:41:37.171 INFO:tasks.workunit.client.1.smithi195.stdout:3/193: creat d7/da/f48 x:0 0 0 2024-08-18T22:41:37.172 INFO:tasks.workunit.client.0.smithi121.stdout:7/561: mkdir de/d1a/d2f/d4b/d6d/db3 0 2024-08-18T22:41:37.172 INFO:tasks.workunit.client.1.smithi195.stdout:3/194: write d7/da/df/d1c/f25 [2026270,106767] 0 2024-08-18T22:41:37.173 INFO:tasks.workunit.client.0.smithi121.stdout:3/550: rename d1e/d1f/d3e/db2 to d1e/d1f/da6/dc7 0 2024-08-18T22:41:37.173 INFO:tasks.workunit.client.1.smithi195.stdout:3/195: write d7/f18 [3602259,15630] 0 2024-08-18T22:41:37.176 INFO:tasks.workunit.client.1.smithi195.stdout:3/196: mkdir d7/d1f/d49 0 2024-08-18T22:41:37.176 INFO:tasks.workunit.client.0.smithi121.stdout:3/551: creat d1e/d1f/d25/d67/d92/fc8 x:0 0 0 2024-08-18T22:41:37.178 INFO:tasks.workunit.client.1.smithi195.stdout:3/197: creat d7/da/df/d38/f4a x:0 0 0 2024-08-18T22:41:37.178 INFO:tasks.workunit.client.0.smithi121.stdout:9/584: write d0/d38/d9e/d18/f1d [1300373,53126] 0 2024-08-18T22:41:37.180 INFO:tasks.workunit.client.1.smithi195.stdout:4/156: truncate d0/d9/d11/f18 644438 0 2024-08-18T22:41:37.182 INFO:tasks.workunit.client.1.smithi195.stdout:4/157: write d0/d7/d1d/f28 [522373,104834] 0 2024-08-18T22:41:37.184 INFO:tasks.workunit.client.1.smithi195.stdout:4/158: chown d0/d7/d1d/c2b 41173899 1 2024-08-18T22:41:37.185 INFO:tasks.workunit.client.1.smithi195.stdout:3/198: dwrite d7/da/f48 [0,4194304] 0 2024-08-18T22:41:37.186 INFO:tasks.workunit.client.0.smithi121.stdout:4/447: write d2/dc/d16/d22/d2c/d44/d8c/f99 [851987,9560] 0 2024-08-18T22:41:37.189 INFO:tasks.workunit.client.0.smithi121.stdout:3/552: dwrite f12 [0,4194304] 0 2024-08-18T22:41:37.191 INFO:tasks.workunit.client.0.smithi121.stdout:2/388: write d2/d8/d1f/f28 [1665490,112586] 0 2024-08-18T22:41:37.192 INFO:tasks.workunit.client.1.smithi195.stdout:3/199: write d7/da/df/d1c/f41 [905113,27235] 0 2024-08-18T22:41:37.194 INFO:tasks.workunit.client.0.smithi121.stdout:0/435: dread d1/d4/db/d24/d30/d52/d6a/f5c [0,4194304] 0 2024-08-18T22:41:37.195 INFO:tasks.workunit.client.0.smithi121.stdout:3/553: fdatasync d1e/d1f/d25/f27 0 2024-08-18T22:41:37.195 INFO:tasks.workunit.client.1.smithi195.stdout:4/159: dwrite d0/d7/d1d/f31 [0,4194304] 0 2024-08-18T22:41:37.197 INFO:tasks.workunit.client.1.smithi195.stdout:4/160: stat d0/d9/d11/d2c 0 2024-08-18T22:41:37.198 INFO:tasks.workunit.client.0.smithi121.stdout:4/448: mknod d2/dc/d16/d22/d2c/d44/d8c/c9f 0 2024-08-18T22:41:37.198 INFO:tasks.workunit.client.0.smithi121.stdout:1/525: dwrite d5/d10/d14/d2a/d3a/d87/d6c/d6f/d82/f39 [0,4194304] 0 2024-08-18T22:41:37.198 INFO:tasks.workunit.client.0.smithi121.stdout:2/389: chown d2/d3/d51/l6c 190855 1 2024-08-18T22:41:37.198 INFO:tasks.workunit.client.0.smithi121.stdout:0/436: truncate d1/d47/f66 994308 0 2024-08-18T22:41:37.201 INFO:tasks.workunit.client.1.smithi195.stdout:3/200: dwrite d7/da/df/d38/f4a [0,4194304] 0 2024-08-18T22:41:37.201 INFO:tasks.workunit.client.0.smithi121.stdout:3/554: fdatasync d1e/d1f/d25/f54 0 2024-08-18T22:41:37.202 INFO:tasks.workunit.client.1.smithi195.stdout:3/201: write f6 [2553502,16334] 0 2024-08-18T22:41:37.203 INFO:tasks.workunit.client.0.smithi121.stdout:9/585: dwrite d0/d38/d9e/d45/dba/fbb [0,4194304] 0 2024-08-18T22:41:37.204 INFO:tasks.workunit.client.1.smithi195.stdout:4/161: rename d0/d9/la to d0/d9/l34 0 2024-08-18T22:41:37.206 INFO:tasks.workunit.client.0.smithi121.stdout:9/586: readlink d0/d38/d9e/d18/l42 0 2024-08-18T22:41:37.207 INFO:tasks.workunit.client.1.smithi195.stdout:3/202: symlink d7/d1f/l4b 0 2024-08-18T22:41:37.208 INFO:tasks.workunit.client.0.smithi121.stdout:3/555: chown d1e/d1f/c55 858720 1 2024-08-18T22:41:37.208 INFO:tasks.workunit.client.0.smithi121.stdout:9/587: dread - d0/d38/d44/dbf/fa0 zero size 2024-08-18T22:41:37.211 INFO:tasks.workunit.client.0.smithi121.stdout:9/588: write d0/d5/dd/d1a/d93/f94 [181003,30997] 0 2024-08-18T22:41:37.213 INFO:tasks.workunit.client.0.smithi121.stdout:1/526: rename d5/d10/d14/d2a/d3a/d87/d6c/c9b to d5/d10/d14/d2a/d3a/d87/d6c/d6f/d82/d15/d28/d3d/cb3 0 2024-08-18T22:41:37.213 INFO:tasks.workunit.client.0.smithi121.stdout:3/556: write d1e/d1f/d25/d2e/d36/d5f/f61 [2742199,97892] 0 2024-08-18T22:41:37.215 INFO:tasks.workunit.client.1.smithi195.stdout:3/203: dwrite d7/f18 [0,4194304] 0 2024-08-18T22:41:37.216 INFO:tasks.workunit.client.0.smithi121.stdout:3/557: mknod d1e/d1f/d3e/cc9 0 2024-08-18T22:41:37.217 INFO:tasks.workunit.client.1.smithi195.stdout:3/204: read d7/da/df/f12 [4179865,105398] 0 2024-08-18T22:41:37.217 INFO:tasks.workunit.client.0.smithi121.stdout:3/558: write d1e/d1f/d25/d67/d92/fc8 [839085,47637] 0 2024-08-18T22:41:37.217 INFO:tasks.workunit.client.1.smithi195.stdout:3/205: fdatasync d7/da/df/d38/f45 0 2024-08-18T22:41:37.218 INFO:tasks.workunit.client.0.smithi121.stdout:9/589: creat d0/d38/d9e/df/d61/db2/fc0 x:0 0 0 2024-08-18T22:41:37.218 INFO:tasks.workunit.client.0.smithi121.stdout:3/559: readlink d1e/d1f/d25/d58/d75/d8c/lb7 0 2024-08-18T22:41:37.220 INFO:tasks.workunit.client.1.smithi195.stdout:3/206: truncate d7/da/f14 998190 0 2024-08-18T22:41:37.221 INFO:tasks.workunit.client.0.smithi121.stdout:9/590: symlink d0/d38/d9e/d45/dba/lc1 0 2024-08-18T22:41:37.221 INFO:tasks.workunit.client.0.smithi121.stdout:3/560: fsync d1e/d1f/d25/d74/f49 0 2024-08-18T22:41:37.223 INFO:tasks.workunit.client.0.smithi121.stdout:9/591: mknod d0/d38/d44/dbf/cc2 0 2024-08-18T22:41:37.225 INFO:tasks.workunit.client.0.smithi121.stdout:9/592: truncate d0/f3 5945083 0 2024-08-18T22:41:37.227 INFO:tasks.workunit.client.0.smithi121.stdout:9/593: mknod d0/d5/dd/d2f/cc3 0 2024-08-18T22:41:37.229 INFO:tasks.workunit.client.0.smithi121.stdout:9/594: rmdir d0/d38/d52 39 2024-08-18T22:41:37.229 INFO:tasks.workunit.client.0.smithi121.stdout:9/595: chown d0/d5/dd/d3b/ca8 30 1 2024-08-18T22:41:37.235 INFO:tasks.workunit.client.0.smithi121.stdout:0/437: write d1/fd [2025090,120198] 0 2024-08-18T22:41:37.236 INFO:tasks.workunit.client.0.smithi121.stdout:9/596: dwrite d0/d38/d9e/df/d3d/d89/faa [0,4194304] 0 2024-08-18T22:41:37.236 INFO:tasks.workunit.client.0.smithi121.stdout:4/449: truncate d2/dc/d1c/f6a 242355 0 2024-08-18T22:41:37.237 INFO:tasks.workunit.client.1.smithi195.stdout:4/162: unlink d0/d9/l34 0 2024-08-18T22:41:37.238 INFO:tasks.workunit.client.1.smithi195.stdout:4/163: fsync d0/d9/d11/d2c/f30 0 2024-08-18T22:41:37.239 INFO:tasks.workunit.client.1.smithi195.stdout:3/207: truncate d7/f9 3915559 0 2024-08-18T22:41:37.239 INFO:tasks.workunit.client.1.smithi195.stdout:4/164: stat d0/f8 0 2024-08-18T22:41:37.240 INFO:tasks.workunit.client.0.smithi121.stdout:3/561: truncate d1e/f46 2293811 0 2024-08-18T22:41:37.240 INFO:tasks.workunit.client.0.smithi121.stdout:0/438: read d1/d4/db/d24/d30/d52/f70 [2424208,83471] 0 2024-08-18T22:41:37.240 INFO:tasks.workunit.client.1.smithi195.stdout:7/86: sync 2024-08-18T22:41:37.240 INFO:tasks.workunit.client.1.smithi195.stdout:0/154: sync 2024-08-18T22:41:37.242 INFO:tasks.workunit.client.0.smithi121.stdout:4/450: mkdir d2/dc/d16/d22/d2c/d7a/da0 0 2024-08-18T22:41:37.242 INFO:tasks.workunit.client.1.smithi195.stdout:7/87: dread - dc/d14/d15/d17/f1a zero size 2024-08-18T22:41:37.244 INFO:tasks.workunit.client.0.smithi121.stdout:4/451: write d2/dc/d16/d59/f8e [919384,14066] 0 2024-08-18T22:41:37.244 INFO:tasks.workunit.client.1.smithi195.stdout:0/155: dread - d0/dc/d25/f1f zero size 2024-08-18T22:41:37.245 INFO:tasks.workunit.client.0.smithi121.stdout:9/597: rename d0/d5/dd/d2f/d8b/lab to d0/d5/dd/d3b/lc4 0 2024-08-18T22:41:37.249 INFO:tasks.workunit.client.0.smithi121.stdout:0/439: creat d1/f8e x:0 0 0 2024-08-18T22:41:37.250 INFO:tasks.workunit.client.1.smithi195.stdout:7/88: getdents dc/d1d 0 2024-08-18T22:41:37.251 INFO:tasks.workunit.client.0.smithi121.stdout:0/440: truncate d1/d47/f81 493576 0 2024-08-18T22:41:37.252 INFO:tasks.workunit.client.1.smithi195.stdout:4/165: dwrite d0/f33 [0,4194304] 0 2024-08-18T22:41:37.336 INFO:tasks.workunit.client.0.smithi121.stdout:9/598: dread - d0/d38/d52/f6d zero size 2024-08-18T22:41:37.336 INFO:tasks.workunit.client.0.smithi121.stdout:9/599: dread - d0/d38/d52/d5f/fac zero size 2024-08-18T22:41:37.336 INFO:tasks.workunit.client.0.smithi121.stdout:9/600: fsync d0/d5/dd/d1a/d93/f94 0 2024-08-18T22:41:37.336 INFO:tasks.workunit.client.0.smithi121.stdout:4/452: link d2/dc/d16/d22/f39 d2/dc/d16/d22/d2c/fa1 0 2024-08-18T22:41:37.336 INFO:tasks.workunit.client.0.smithi121.stdout:4/453: chown d2/dc/d16/d59 859409 1 2024-08-18T22:41:37.336 INFO:tasks.workunit.client.0.smithi121.stdout:0/441: symlink d1/d4/db/d18/d40/d83/l8f 0 2024-08-18T22:41:37.336 INFO:tasks.workunit.client.0.smithi121.stdout:9/601: dwrite d0/d38/d9e/f1f [0,4194304] 0 2024-08-18T22:41:37.337 INFO:tasks.workunit.client.0.smithi121.stdout:0/442: mkdir d1/d4/db/d24/d30/d52/d90 0 2024-08-18T22:41:37.337 INFO:tasks.workunit.client.0.smithi121.stdout:3/562: truncate d1e/d1f/f3a 4189756 0 2024-08-18T22:41:37.337 INFO:tasks.workunit.client.0.smithi121.stdout:9/602: dread - d0/d38/d44/dbf/f77 zero size 2024-08-18T22:41:37.337 INFO:tasks.workunit.client.0.smithi121.stdout:3/563: symlink d1e/d1f/d2a/lca 0 2024-08-18T22:41:37.337 INFO:tasks.workunit.client.0.smithi121.stdout:9/603: write d0/d5/f98 [4700338,50283] 0 2024-08-18T22:41:37.337 INFO:tasks.workunit.client.0.smithi121.stdout:0/443: dwrite d1/d4/db/d18/d2e/f6d [0,4194304] 0 2024-08-18T22:41:37.337 INFO:tasks.workunit.client.0.smithi121.stdout:3/564: truncate d1e/d1f/d25/f27 3562688 0 2024-08-18T22:41:37.337 INFO:tasks.workunit.client.0.smithi121.stdout:0/444: symlink d1/d4/db/d24/df/d8/d71/d79/l91 0 2024-08-18T22:41:37.337 INFO:tasks.workunit.client.0.smithi121.stdout:9/604: dread d0/d5/dd/d2f/f3c [0,4194304] 0 2024-08-18T22:41:37.337 INFO:tasks.workunit.client.0.smithi121.stdout:8/573: sync 2024-08-18T22:41:37.337 INFO:tasks.workunit.client.0.smithi121.stdout:3/565: mkdir d1e/d1f/d5e/dbc/dcb 0 2024-08-18T22:41:37.337 INFO:tasks.workunit.client.0.smithi121.stdout:4/454: dwrite d2/f14 [0,4194304] 0 2024-08-18T22:41:37.337 INFO:tasks.workunit.client.0.smithi121.stdout:8/574: dread - d6/d17/d18/d83/fae zero size 2024-08-18T22:41:37.338 INFO:tasks.workunit.client.0.smithi121.stdout:9/605: fsync d0/d38/d9e/d18/f56 0 2024-08-18T22:41:37.338 INFO:tasks.workunit.client.0.smithi121.stdout:0/445: creat d1/d4/db/d24/df/d8/d71/d79/f92 x:0 0 0 2024-08-18T22:41:37.338 INFO:tasks.workunit.client.0.smithi121.stdout:3/566: rmdir d1e/d1f/d25/d67 39 2024-08-18T22:41:37.338 INFO:tasks.workunit.client.0.smithi121.stdout:4/455: symlink d2/d7c/la2 0 2024-08-18T22:41:37.338 INFO:tasks.workunit.client.0.smithi121.stdout:3/567: read d1e/d1f/d25/d2e/d36/f68 [2419766,21829] 0 2024-08-18T22:41:37.338 INFO:tasks.workunit.client.0.smithi121.stdout:8/575: creat d6/dd/d25/d56/fc6 x:0 0 0 2024-08-18T22:41:37.338 INFO:tasks.workunit.client.0.smithi121.stdout:4/456: creat d2/dc/d16/d22/d2c/d7a/fa3 x:0 0 0 2024-08-18T22:41:37.338 INFO:tasks.workunit.client.0.smithi121.stdout:9/606: getdents d0/d5/dd/d2f/d8b 0 2024-08-18T22:41:37.338 INFO:tasks.workunit.client.0.smithi121.stdout:9/607: read d0/d38/d9e/df/d3d/d89/faa [3209568,84334] 0 2024-08-18T22:41:37.338 INFO:tasks.workunit.client.0.smithi121.stdout:4/457: mkdir d2/dc/d8d/da4 0 2024-08-18T22:41:37.338 INFO:tasks.workunit.client.0.smithi121.stdout:8/576: rename d6/d17/d37/c84 to d6/d17/cc7 0 2024-08-18T22:41:37.338 INFO:tasks.workunit.client.0.smithi121.stdout:0/446: getdents d1/d4/db/d24/d30/d52/d5b 0 2024-08-18T22:41:37.338 INFO:tasks.workunit.client.0.smithi121.stdout:8/577: mkdir d6/dd/d25/dc8 0 2024-08-18T22:41:37.339 INFO:tasks.workunit.client.0.smithi121.stdout:4/458: dread d2/f72 [0,4194304] 0 2024-08-18T22:41:37.339 INFO:tasks.workunit.client.0.smithi121.stdout:4/459: chown d2/f19 0 1 2024-08-18T22:41:37.339 INFO:tasks.workunit.client.0.smithi121.stdout:4/460: write d2/dc/d1c/d62/f88 [3663843,32587] 0 2024-08-18T22:41:37.339 INFO:tasks.workunit.client.0.smithi121.stdout:4/461: chown d2/dc/f5d 605139 1 2024-08-18T22:41:37.339 INFO:tasks.workunit.client.0.smithi121.stdout:4/462: dread - d2/dc/d16/d22/d2c/d44/f78 zero size 2024-08-18T22:41:37.339 INFO:tasks.workunit.client.0.smithi121.stdout:9/608: getdents d0 0 2024-08-18T22:41:37.339 INFO:tasks.workunit.client.0.smithi121.stdout:8/578: rmdir d6/d17 39 2024-08-18T22:41:37.339 INFO:tasks.workunit.client.0.smithi121.stdout:4/463: dwrite d2/dc/d16/d59/f8e [0,4194304] 0 2024-08-18T22:41:37.340 INFO:tasks.workunit.client.1.smithi195.stdout:3/208: dwrite f1 [4194304,4194304] 0 2024-08-18T22:41:37.340 INFO:tasks.workunit.client.1.smithi195.stdout:7/89: unlink dc/d14/d15/c1f 0 2024-08-18T22:41:37.340 INFO:tasks.workunit.client.1.smithi195.stdout:4/166: truncate d0/d7/d1d/f2f 34842 0 2024-08-18T22:41:37.340 INFO:tasks.workunit.client.1.smithi195.stdout:7/90: creat dc/f25 x:0 0 0 2024-08-18T22:41:37.340 INFO:tasks.workunit.client.1.smithi195.stdout:4/167: creat d0/d9/d11/d2c/f35 x:0 0 0 2024-08-18T22:41:37.340 INFO:tasks.workunit.client.1.smithi195.stdout:0/156: dwrite d0/dc/d11/f15 [0,4194304] 0 2024-08-18T22:41:37.340 INFO:tasks.workunit.client.1.smithi195.stdout:2/133: sync 2024-08-18T22:41:37.340 INFO:tasks.workunit.client.1.smithi195.stdout:6/101: sync 2024-08-18T22:41:37.340 INFO:tasks.workunit.client.1.smithi195.stdout:5/127: sync 2024-08-18T22:41:37.341 INFO:tasks.workunit.client.1.smithi195.stdout:1/280: sync 2024-08-18T22:41:37.341 INFO:tasks.workunit.client.1.smithi195.stdout:8/198: sync 2024-08-18T22:41:37.341 INFO:tasks.workunit.client.1.smithi195.stdout:9/144: sync 2024-08-18T22:41:37.341 INFO:tasks.workunit.client.1.smithi195.stdout:3/209: creat d7/f4c x:0 0 0 2024-08-18T22:41:37.341 INFO:tasks.workunit.client.1.smithi195.stdout:4/168: mkdir d0/d36 0 2024-08-18T22:41:37.341 INFO:tasks.workunit.client.1.smithi195.stdout:9/145: rmdir d1c 39 2024-08-18T22:41:37.341 INFO:tasks.workunit.client.1.smithi195.stdout:7/91: write dc/d14/d15/f16 [86221,45019] 0 2024-08-18T22:41:37.341 INFO:tasks.workunit.client.1.smithi195.stdout:4/169: mkdir d0/d9/d11/d16/d37 0 2024-08-18T22:41:37.341 INFO:tasks.workunit.client.1.smithi195.stdout:5/128: dread d0/d3/df/f16 [0,4194304] 0 2024-08-18T22:41:37.342 INFO:tasks.workunit.client.1.smithi195.stdout:0/157: dread d0/f1c [4194304,4194304] 0 2024-08-18T22:41:37.342 INFO:tasks.workunit.client.1.smithi195.stdout:7/92: mknod dc/d14/c26 0 2024-08-18T22:41:37.342 INFO:tasks.workunit.client.1.smithi195.stdout:1/281: write da/f15 [3444223,7212] 0 2024-08-18T22:41:37.342 INFO:tasks.workunit.client.1.smithi195.stdout:4/170: creat d0/d9/d11/d16/f38 x:0 0 0 2024-08-18T22:41:37.342 INFO:tasks.workunit.client.1.smithi195.stdout:0/158: readlink d0/dc/l19 0 2024-08-18T22:41:37.342 INFO:tasks.workunit.client.1.smithi195.stdout:5/129: unlink d0/d2/f22 0 2024-08-18T22:41:37.342 INFO:tasks.workunit.client.1.smithi195.stdout:4/171: readlink d0/l24 0 2024-08-18T22:41:37.342 INFO:tasks.workunit.client.1.smithi195.stdout:9/146: dwrite fd [0,4194304] 0 2024-08-18T22:41:37.342 INFO:tasks.workunit.client.1.smithi195.stdout:8/199: dwrite d1/d3/db/fd [4194304,4194304] 0 2024-08-18T22:41:37.342 INFO:tasks.workunit.client.1.smithi195.stdout:3/210: dread d7/f17 [0,4194304] 0 2024-08-18T22:41:37.342 INFO:tasks.workunit.client.1.smithi195.stdout:7/93: write dc/d14/d15/d17/d18/f1c [614871,93824] 0 2024-08-18T22:41:37.342 INFO:tasks.workunit.client.1.smithi195.stdout:1/282: symlink da/d3d/l61 0 2024-08-18T22:41:37.343 INFO:tasks.workunit.client.1.smithi195.stdout:4/172: mknod d0/d7/c39 0 2024-08-18T22:41:37.343 INFO:tasks.workunit.client.1.smithi195.stdout:0/159: mknod d0/dc/d11/d23/c2f 0 2024-08-18T22:41:37.343 INFO:tasks.workunit.client.1.smithi195.stdout:9/147: write f16 [2110532,56629] 0 2024-08-18T22:41:37.343 INFO:tasks.workunit.client.1.smithi195.stdout:3/211: mkdir d7/da/d4d 0 2024-08-18T22:41:37.343 INFO:tasks.workunit.client.1.smithi195.stdout:2/134: dwrite d1/d22/d29/f1d [4194304,4194304] 0 2024-08-18T22:41:37.343 INFO:tasks.workunit.client.1.smithi195.stdout:1/283: mknod da/d18/c62 0 2024-08-18T22:41:37.343 INFO:tasks.workunit.client.1.smithi195.stdout:0/160: rmdir d0/dc/d11 39 2024-08-18T22:41:37.343 INFO:tasks.workunit.client.1.smithi195.stdout:7/94: dread f5 [0,4194304] 0 2024-08-18T22:41:37.343 INFO:tasks.workunit.client.1.smithi195.stdout:2/135: truncate d1/d22/d29/fa 4465402 0 2024-08-18T22:41:37.343 INFO:tasks.workunit.client.1.smithi195.stdout:7/95: fdatasync dc/f10 0 2024-08-18T22:41:37.343 INFO:tasks.workunit.client.1.smithi195.stdout:0/161: readlink d0/dc/d25/l24 0 2024-08-18T22:41:37.343 INFO:tasks.workunit.client.1.smithi195.stdout:5/130: dwrite d0/d3/d8/f14 [0,4194304] 0 2024-08-18T22:41:37.343 INFO:tasks.workunit.client.1.smithi195.stdout:7/96: stat f1 0 2024-08-18T22:41:37.344 INFO:tasks.workunit.client.1.smithi195.stdout:2/136: mknod d1/d22/c2a 0 2024-08-18T22:41:37.344 INFO:tasks.workunit.client.1.smithi195.stdout:8/200: link d1/d3/d1c/l40 d1/l4a 0 2024-08-18T22:41:37.344 INFO:tasks.workunit.client.1.smithi195.stdout:4/173: link d0/d9/d11/f18 d0/d9/d11/f3a 0 2024-08-18T22:41:37.344 INFO:tasks.workunit.client.1.smithi195.stdout:1/284: mkdir da/d4c/d5d/d63 0 2024-08-18T22:41:37.344 INFO:tasks.workunit.client.1.smithi195.stdout:5/131: mkdir d0/d25 0 2024-08-18T22:41:37.344 INFO:tasks.workunit.client.1.smithi195.stdout:2/137: write d1/d22/d29/f18 [1043872,121981] 0 2024-08-18T22:41:37.344 INFO:tasks.workunit.client.1.smithi195.stdout:0/162: mkdir d0/dc/d11/d30 0 2024-08-18T22:41:37.344 INFO:tasks.workunit.client.1.smithi195.stdout:8/201: mkdir d1/d4b 0 2024-08-18T22:41:37.345 INFO:tasks.workunit.client.0.smithi121.stdout:4/464: mkdir d2/dc/d16/d59/d83/da5 0 2024-08-18T22:41:37.345 INFO:tasks.workunit.client.0.smithi121.stdout:9/609: dwrite d0/d38/d44/dbf/d60/f99 [0,4194304] 0 2024-08-18T22:41:37.346 INFO:tasks.workunit.client.1.smithi195.stdout:4/174: mkdir d0/d9/d3b 0 2024-08-18T22:41:37.346 INFO:tasks.workunit.client.1.smithi195.stdout:8/202: dread - d1/de/f36 zero size 2024-08-18T22:41:37.346 INFO:tasks.workunit.client.1.smithi195.stdout:9/148: dwrite d1c/f22 [0,4194304] 0 2024-08-18T22:41:37.346 INFO:tasks.workunit.client.1.smithi195.stdout:5/132: write d0/d3/df/d1a/f24 [3726462,22455] 0 2024-08-18T22:41:37.346 INFO:tasks.workunit.client.1.smithi195.stdout:2/138: chown d1/l3 346283 1 2024-08-18T22:41:37.346 INFO:tasks.workunit.client.0.smithi121.stdout:0/447: dread d1/d4/db/d24/f2b [0,4194304] 0 2024-08-18T22:41:37.347 INFO:tasks.workunit.client.1.smithi195.stdout:4/175: stat d0/f33 0 2024-08-18T22:41:37.347 INFO:tasks.workunit.client.1.smithi195.stdout:3/212: dwrite d7/f19 [4194304,4194304] 0 2024-08-18T22:41:37.349 INFO:tasks.workunit.client.0.smithi121.stdout:4/465: mknod d2/dc/d16/d59/d83/ca6 0 2024-08-18T22:41:37.350 INFO:tasks.workunit.client.0.smithi121.stdout:9/610: creat d0/d38/d52/d5f/fc5 x:0 0 0 2024-08-18T22:41:37.351 INFO:tasks.workunit.client.0.smithi121.stdout:0/448: symlink d1/d4/db/d18/d2e/l93 0 2024-08-18T22:41:37.352 INFO:tasks.workunit.client.0.smithi121.stdout:8/579: dwrite d6/d17/d60/d5b/f92 [0,4194304] 0 2024-08-18T22:41:37.354 INFO:tasks.workunit.client.1.smithi195.stdout:2/139: rmdir d1/d22 39 2024-08-18T22:41:37.354 INFO:tasks.workunit.client.1.smithi195.stdout:4/176: chown d0/ff 475 1 2024-08-18T22:41:37.354 INFO:tasks.workunit.client.0.smithi121.stdout:0/449: mknod d1/d47/c94 0 2024-08-18T22:41:37.355 INFO:tasks.workunit.client.0.smithi121.stdout:9/611: write d0/d38/d9e/df/d3d/faf [1668260,108036] 0 2024-08-18T22:41:37.357 INFO:tasks.workunit.client.0.smithi121.stdout:4/466: mkdir d2/dc/d16/d22/d2c/d44/da7 0 2024-08-18T22:41:37.360 INFO:tasks.workunit.client.1.smithi195.stdout:6/102: dread da/fd [0,4194304] 0 2024-08-18T22:41:37.362 INFO:tasks.workunit.client.1.smithi195.stdout:7/97: dwrite dc/d14/d15/d17/f1a [0,4194304] 0 2024-08-18T22:41:37.365 INFO:tasks.workunit.client.0.smithi121.stdout:9/612: mkdir d0/d38/d9e/df/d3d/d89/d92/dc6 0 2024-08-18T22:41:37.366 INFO:tasks.workunit.client.0.smithi121.stdout:8/580: dwrite d6/d1e/f4d [0,4194304] 0 2024-08-18T22:41:37.367 INFO:tasks.workunit.client.1.smithi195.stdout:6/103: chown da/l1a 156282 1 2024-08-18T22:41:37.367 INFO:tasks.workunit.client.1.smithi195.stdout:8/203: creat d1/d3/db/d39/d2e/f4c x:0 0 0 2024-08-18T22:41:37.367 INFO:tasks.workunit.client.0.smithi121.stdout:4/467: creat d2/dc/d16/d59/fa8 x:0 0 0 2024-08-18T22:41:37.369 INFO:tasks.workunit.client.0.smithi121.stdout:9/613: truncate d0/d38/d44/dbf/fa0 417119 0 2024-08-18T22:41:37.369 INFO:tasks.workunit.client.0.smithi121.stdout:8/581: rmdir d6 39 2024-08-18T22:41:37.370 INFO:tasks.workunit.client.0.smithi121.stdout:9/614: chown d0/d5/dd 30347446 1 2024-08-18T22:41:37.372 INFO:tasks.workunit.client.0.smithi121.stdout:4/468: mkdir d2/dc/d16/d22/d2c/d44/da9 0 2024-08-18T22:41:37.373 INFO:tasks.workunit.client.0.smithi121.stdout:0/450: getdents d1/d4/db/d24/d30/d52 0 2024-08-18T22:41:37.374 INFO:tasks.workunit.client.0.smithi121.stdout:9/615: creat d0/d5/dd/d3b/d48/fc7 x:0 0 0 2024-08-18T22:41:37.375 INFO:tasks.workunit.client.1.smithi195.stdout:0/163: dwrite d0/dc/d11/f27 [0,4194304] 0 2024-08-18T22:41:37.375 INFO:tasks.workunit.client.0.smithi121.stdout:4/469: write d2/dc/d1c/f3c [1043019,123303] 0 2024-08-18T22:41:37.377 INFO:tasks.workunit.client.0.smithi121.stdout:4/470: chown d2/f72 3915959 1 2024-08-18T22:41:37.377 INFO:tasks.workunit.client.1.smithi195.stdout:1/285: dwrite da/f12 [0,4194304] 0 2024-08-18T22:41:37.377 INFO:tasks.workunit.client.0.smithi121.stdout:9/616: mkdir d0/d5/dd/d1a/dc8 0 2024-08-18T22:41:37.378 INFO:tasks.workunit.client.0.smithi121.stdout:4/471: dread - d2/dc/d1c/f4b zero size 2024-08-18T22:41:37.378 INFO:tasks.workunit.client.1.smithi195.stdout:6/104: mkdir da/d22 0 2024-08-18T22:41:37.379 INFO:tasks.workunit.client.1.smithi195.stdout:5/133: dread d0/d3/f15 [0,4194304] 0 2024-08-18T22:41:37.379 INFO:tasks.workunit.client.1.smithi195.stdout:5/134: read d0/f11 [454209,68265] 0 2024-08-18T22:41:37.381 INFO:tasks.workunit.client.1.smithi195.stdout:4/177: rename d0/d7/d1d/l2d to d0/l3c 0 2024-08-18T22:41:37.381 INFO:tasks.workunit.client.0.smithi121.stdout:8/582: rename d6/d17/d18/f76 to d6/fc9 0 2024-08-18T22:41:37.382 INFO:tasks.workunit.client.1.smithi195.stdout:0/164: mknod d0/dc/d11/d23/c31 0 2024-08-18T22:41:37.383 INFO:tasks.workunit.client.1.smithi195.stdout:3/213: dread d7/f2b [0,4194304] 0 2024-08-18T22:41:37.384 INFO:tasks.workunit.client.1.smithi195.stdout:6/105: creat da/db/d19/f23 x:0 0 0 2024-08-18T22:41:37.385 INFO:tasks.workunit.client.0.smithi121.stdout:9/617: link d0/d5/f98 d0/d38/d9e/fc9 0 2024-08-18T22:41:37.385 INFO:tasks.workunit.client.1.smithi195.stdout:8/204: mkdir d1/d3/db/d35/d4d 0 2024-08-18T22:41:37.386 INFO:tasks.workunit.client.1.smithi195.stdout:5/135: mkdir d0/db/d26 0 2024-08-18T22:41:37.387 INFO:tasks.workunit.client.1.smithi195.stdout:6/106: write f5 [1598958,60748] 0 2024-08-18T22:41:37.387 INFO:tasks.workunit.client.1.smithi195.stdout:7/98: rename dc/le to dc/d14/l27 0 2024-08-18T22:41:37.388 INFO:tasks.workunit.client.0.smithi121.stdout:4/472: dwrite d2/dc/d16/d47/f77 [0,4194304] 0 2024-08-18T22:41:37.389 INFO:tasks.workunit.client.1.smithi195.stdout:0/165: dread - d0/dc/d25/f1e zero size 2024-08-18T22:41:37.389 INFO:tasks.workunit.client.0.smithi121.stdout:9/618: write d0/d5/dd/d3f/f75 [346776,77363] 0 2024-08-18T22:41:37.390 INFO:tasks.workunit.client.1.smithi195.stdout:4/178: creat d0/d7/d1d/f3d x:0 0 0 2024-08-18T22:41:37.392 INFO:tasks.workunit.client.1.smithi195.stdout:8/205: chown d1/d3/db/c1a 5004 1 2024-08-18T22:41:37.393 INFO:tasks.workunit.client.0.smithi121.stdout:9/619: chown d0/d38/d9e/df/d3d/faf 747 1 2024-08-18T22:41:37.393 INFO:tasks.workunit.client.1.smithi195.stdout:3/214: symlink d7/d1f/d49/l4e 0 2024-08-18T22:41:37.395 INFO:tasks.workunit.client.0.smithi121.stdout:9/620: readlink d0/d38/d9e/df/d3d/lb8 0 2024-08-18T22:41:37.396 INFO:tasks.workunit.client.1.smithi195.stdout:4/179: chown d0/c12 32632202 1 2024-08-18T22:41:37.396 INFO:tasks.workunit.client.0.smithi121.stdout:9/621: chown d0/d38/d9e/fbe 252297 1 2024-08-18T22:41:37.398 INFO:tasks.workunit.client.1.smithi195.stdout:1/286: dwrite da/d18/f1f [0,4194304] 0 2024-08-18T22:41:37.399 INFO:tasks.workunit.client.1.smithi195.stdout:7/99: symlink dc/d22/l28 0 2024-08-18T22:41:37.400 INFO:tasks.workunit.client.0.smithi121.stdout:9/622: fdatasync d0/d38/d44/d7f/f91 0 2024-08-18T22:41:37.400 INFO:tasks.workunit.client.0.smithi121.stdout:4/473: dwrite d2/dc/d16/d22/d2c/f84 [0,4194304] 0 2024-08-18T22:41:37.403 INFO:tasks.workunit.client.0.smithi121.stdout:9/623: symlink d0/d38/d9e/d45/dba/lca 0 2024-08-18T22:41:37.405 INFO:tasks.workunit.client.0.smithi121.stdout:4/474: truncate d2/dc/d16/d22/d2c/fa1 2496380 0 2024-08-18T22:41:37.406 INFO:tasks.workunit.client.0.smithi121.stdout:9/624: truncate d0/d38/d52/d5f/f8e 2559367 0 2024-08-18T22:41:37.408 INFO:tasks.workunit.client.0.smithi121.stdout:9/625: write d0/d5/dd/d3b/fae [916982,43407] 0 2024-08-18T22:41:37.411 INFO:tasks.workunit.client.0.smithi121.stdout:9/626: mkdir d0/d38/d9e/df/dcb 0 2024-08-18T22:41:37.412 INFO:tasks.workunit.client.0.smithi121.stdout:4/475: dwrite d2/dc/fd [0,4194304] 0 2024-08-18T22:41:37.412 INFO:tasks.workunit.client.0.smithi121.stdout:0/451: dread d1/d4/db/d24/d30/d6c/f51 [0,4194304] 0 2024-08-18T22:41:37.413 INFO:tasks.workunit.client.1.smithi195.stdout:6/107: truncate da/fd 2203320 0 2024-08-18T22:41:37.413 INFO:tasks.workunit.client.1.smithi195.stdout:4/180: chown d0/f3 10801 1 2024-08-18T22:41:37.415 INFO:tasks.workunit.client.0.smithi121.stdout:9/627: write d0/d38/d9e/df/d61/db2/f51 [753308,67909] 0 2024-08-18T22:41:37.416 INFO:tasks.workunit.client.0.smithi121.stdout:9/628: fsync d0/d5/f25 0 2024-08-18T22:41:37.419 INFO:tasks.workunit.client.1.smithi195.stdout:5/136: rmdir d0/d25 0 2024-08-18T22:41:37.420 INFO:tasks.workunit.client.1.smithi195.stdout:8/206: write d1/de/df/d1d/d1f/f24 [774035,85541] 0 2024-08-18T22:41:37.420 INFO:tasks.workunit.client.0.smithi121.stdout:4/476: mkdir d2/dc/d1c/daa 0 2024-08-18T22:41:37.422 INFO:tasks.workunit.client.0.smithi121.stdout:4/477: fdatasync d2/dc/d16/d47/f9a 0 2024-08-18T22:41:37.423 INFO:tasks.workunit.client.0.smithi121.stdout:4/478: chown d2/dc/d16/d22/d29 394 1 2024-08-18T22:41:37.425 INFO:tasks.workunit.client.0.smithi121.stdout:0/452: getdents d1/d4 0 2024-08-18T22:41:37.426 INFO:tasks.workunit.client.1.smithi195.stdout:0/166: dwrite d0/dc/df/f2d [0,4194304] 0 2024-08-18T22:41:37.426 INFO:tasks.workunit.client.0.smithi121.stdout:0/453: dread - d1/d4/db/d24/f42 zero size 2024-08-18T22:41:37.430 INFO:tasks.workunit.client.0.smithi121.stdout:4/479: getdents d2/dc/d16/d22/d2c/d44 0 2024-08-18T22:41:37.432 INFO:tasks.workunit.client.0.smithi121.stdout:8/583: rename d6/d17 to d6/dd/d3b/da3/dca 0 2024-08-18T22:41:37.435 INFO:tasks.workunit.client.1.smithi195.stdout:7/100: dwrite dc/f25 [0,4194304] 0 2024-08-18T22:41:37.437 INFO:tasks.workunit.client.0.smithi121.stdout:0/454: rename d1/d4/db/d24/d30/d52/d6a/l45 to d1/d4/l95 0 2024-08-18T22:41:37.437 INFO:tasks.workunit.client.1.smithi195.stdout:2/140: dwrite d1/d22/d29/fa [4194304,4194304] 0 2024-08-18T22:41:37.439 INFO:tasks.workunit.client.1.smithi195.stdout:9/149: dread f15 [0,4194304] 0 2024-08-18T22:41:37.440 INFO:tasks.workunit.client.0.smithi121.stdout:4/480: dwrite d2/dc/f52 [0,4194304] 0 2024-08-18T22:41:37.442 INFO:tasks.workunit.client.0.smithi121.stdout:4/481: read d2/f3f [578894,30075] 0 2024-08-18T22:41:37.443 INFO:tasks.workunit.client.1.smithi195.stdout:0/167: stat d0/dc/d25/l24 0 2024-08-18T22:41:37.443 INFO:tasks.workunit.client.0.smithi121.stdout:4/482: chown d2/dc/d16/d22/d2c/d44/d66/f9b 160585754 1 2024-08-18T22:41:37.449 INFO:tasks.workunit.client.0.smithi121.stdout:4/483: link d2/dc/d1c/f6a d2/d7c/fab 0 2024-08-18T22:41:37.451 INFO:tasks.workunit.client.1.smithi195.stdout:3/215: dwrite d7/da/df/d1c/f25 [4194304,4194304] 0 2024-08-18T22:41:37.451 INFO:tasks.workunit.client.1.smithi195.stdout:7/101: dread f5 [0,4194304] 0 2024-08-18T22:41:37.452 INFO:tasks.workunit.client.0.smithi121.stdout:4/484: creat d2/dc/d1c/daa/fac x:0 0 0 2024-08-18T22:41:37.453 INFO:tasks.workunit.client.1.smithi195.stdout:4/181: dread d0/f25 [0,4194304] 0 2024-08-18T22:41:37.453 INFO:tasks.workunit.client.0.smithi121.stdout:4/485: creat d2/dc/d16/fad x:0 0 0 2024-08-18T22:41:37.454 INFO:tasks.workunit.client.1.smithi195.stdout:2/141: read d1/d22/d29/fa [3927395,87419] 0 2024-08-18T22:41:37.457 INFO:tasks.workunit.client.0.smithi121.stdout:4/486: mkdir d2/dc/d16/d22/d2c/d44/da9/dae 0 2024-08-18T22:41:37.458 INFO:tasks.workunit.client.0.smithi121.stdout:9/629: dread d0/d38/d44/d7f/f91 [0,4194304] 0 2024-08-18T22:41:37.458 INFO:tasks.workunit.client.1.smithi195.stdout:8/207: creat d1/de/f4e x:0 0 0 2024-08-18T22:41:37.459 INFO:tasks.workunit.client.1.smithi195.stdout:1/287: fdatasync da/d3d/f41 0 2024-08-18T22:41:37.460 INFO:tasks.workunit.client.1.smithi195.stdout:0/168: fsync d0/dc/d11/f15 0 2024-08-18T22:41:37.461 INFO:tasks.workunit.client.0.smithi121.stdout:9/630: creat d0/d38/d9e/df/d73/fcc x:0 0 0 2024-08-18T22:41:37.463 INFO:tasks.workunit.client.1.smithi195.stdout:9/150: creat d1c/f35 x:0 0 0 2024-08-18T22:41:37.463 INFO:tasks.workunit.client.1.smithi195.stdout:7/102: mkdir dc/d1d/d29 0 2024-08-18T22:41:37.464 INFO:tasks.workunit.client.0.smithi121.stdout:4/487: rename d2/dc/d16/d22/d2c/d44/l58 to d2/dc/d16/d22/d2c/d7a/da0/laf 0 2024-08-18T22:41:37.464 INFO:tasks.workunit.client.1.smithi195.stdout:5/137: dwrite d0/f11 [0,4194304] 0 2024-08-18T22:41:37.465 INFO:tasks.workunit.client.1.smithi195.stdout:6/108: getdents da/db/d19 0 2024-08-18T22:41:37.465 INFO:tasks.workunit.client.1.smithi195.stdout:0/169: stat d0/dc/d11/f20 0 2024-08-18T22:41:37.467 INFO:tasks.workunit.client.1.smithi195.stdout:8/208: read d1/de/f3b [3572564,62523] 0 2024-08-18T22:41:37.468 INFO:tasks.workunit.client.0.smithi121.stdout:9/631: mkdir d0/d5/dd/d2f/dcd 0 2024-08-18T22:41:37.468 INFO:tasks.workunit.client.1.smithi195.stdout:0/170: readlink d0/dc/d25/l22 0 2024-08-18T22:41:37.469 INFO:tasks.workunit.client.0.smithi121.stdout:4/488: dread d2/dc/d16/d22/d2c/f84 [0,4194304] 0 2024-08-18T22:41:37.469 INFO:tasks.workunit.client.1.smithi195.stdout:8/209: chown d1/d3/d1c/d49 11 1 2024-08-18T22:41:37.469 INFO:tasks.workunit.client.0.smithi121.stdout:0/455: link d1/d4/db/d18/d2e/f3d d1/d4/db/d18/d40/f96 0 2024-08-18T22:41:37.469 INFO:tasks.workunit.client.0.smithi121.stdout:9/632: rmdir d0/d38/d52 39 2024-08-18T22:41:37.470 INFO:tasks.workunit.client.1.smithi195.stdout:0/171: read d0/dc/d11/f27 [1829047,40817] 0 2024-08-18T22:41:37.475 INFO:tasks.workunit.client.0.smithi121.stdout:9/633: mkdir d0/d38/d9e/df/d61/db2/dce 0 2024-08-18T22:41:37.475 INFO:tasks.workunit.client.1.smithi195.stdout:3/216: symlink d7/da/df/l4f 0 2024-08-18T22:41:37.475 INFO:tasks.workunit.client.1.smithi195.stdout:9/151: unlink f19 0 2024-08-18T22:41:37.477 INFO:tasks.workunit.client.0.smithi121.stdout:0/456: dwrite d1/d4/db/d24/df/d8/d78/f7a [0,4194304] 0 2024-08-18T22:41:37.477 INFO:tasks.workunit.client.1.smithi195.stdout:8/210: dread d1/de/df/d1d/d1f/f24 [0,4194304] 0 2024-08-18T22:41:37.479 INFO:tasks.workunit.client.1.smithi195.stdout:6/109: fdatasync da/db/f17 0 2024-08-18T22:41:37.480 INFO:tasks.workunit.client.0.smithi121.stdout:9/634: truncate d0/d38/d9e/fc9 4110801 0 2024-08-18T22:41:37.481 INFO:tasks.workunit.client.0.smithi121.stdout:0/457: creat d1/d4/d53/f97 x:0 0 0 2024-08-18T22:41:37.482 INFO:tasks.workunit.client.1.smithi195.stdout:0/172: creat d0/dc/d11/f32 x:0 0 0 2024-08-18T22:41:37.482 INFO:tasks.workunit.client.1.smithi195.stdout:6/110: write da/db/d19/f23 [569865,67702] 0 2024-08-18T22:41:37.484 INFO:tasks.workunit.client.0.smithi121.stdout:9/635: symlink d0/d5/dd/d3f/lcf 0 2024-08-18T22:41:37.484 INFO:tasks.workunit.client.1.smithi195.stdout:2/142: dread d1/f10 [0,4194304] 0 2024-08-18T22:41:37.485 INFO:tasks.workunit.client.1.smithi195.stdout:2/143: chown d1/d22/d29 767 1 2024-08-18T22:41:37.486 INFO:tasks.workunit.client.1.smithi195.stdout:2/144: chown d1/d24/d26 38608127 1 2024-08-18T22:41:37.486 INFO:tasks.workunit.client.0.smithi121.stdout:5/388: sync 2024-08-18T22:41:37.487 INFO:tasks.workunit.client.1.smithi195.stdout:9/152: creat d1c/d32/f36 x:0 0 0 2024-08-18T22:41:37.488 INFO:tasks.workunit.client.1.smithi195.stdout:1/288: creat da/d4c/d5d/d63/f64 x:0 0 0 2024-08-18T22:41:37.489 INFO:tasks.workunit.client.0.smithi121.stdout:4/489: rmdir d2/dc 39 2024-08-18T22:41:37.490 INFO:tasks.workunit.client.1.smithi195.stdout:8/211: mkdir d1/de/d27/d4f 0 2024-08-18T22:41:37.490 INFO:tasks.workunit.client.1.smithi195.stdout:9/153: read f16 [3629005,89879] 0 2024-08-18T22:41:37.491 INFO:tasks.workunit.client.0.smithi121.stdout:8/584: dread d6/f8 [0,4194304] 0 2024-08-18T22:41:37.492 INFO:tasks.workunit.client.1.smithi195.stdout:9/154: fdatasync d1c/f33 0 2024-08-18T22:41:37.492 INFO:tasks.workunit.client.1.smithi195.stdout:0/173: dread - d0/dc/d11/f20 zero size 2024-08-18T22:41:37.493 INFO:tasks.workunit.client.0.smithi121.stdout:0/458: link d1/d4/db/d24/d30/d52/f7e d1/d4/db/d24/d30/d52/d90/f98 0 2024-08-18T22:41:37.494 INFO:tasks.workunit.client.1.smithi195.stdout:2/145: readlink d1/l23 0 2024-08-18T22:41:37.494 INFO:tasks.workunit.client.1.smithi195.stdout:7/103: dwrite f2 [0,4194304] 0 2024-08-18T22:41:37.494 INFO:tasks.workunit.client.0.smithi121.stdout:8/585: fsync d6/d20/f29 0 2024-08-18T22:41:37.494 INFO:tasks.workunit.client.0.smithi121.stdout:9/636: dwrite d0/d5/dd/d2f/f50 [0,4194304] 0 2024-08-18T22:41:37.496 INFO:tasks.workunit.client.1.smithi195.stdout:5/138: creat d0/d3/f27 x:0 0 0 2024-08-18T22:41:37.497 INFO:tasks.workunit.client.1.smithi195.stdout:5/139: stat d0/d3/f15 0 2024-08-18T22:41:37.499 INFO:tasks.workunit.client.1.smithi195.stdout:1/289: unlink da/d18/d28/d31/c36 0 2024-08-18T22:41:37.499 INFO:tasks.workunit.client.0.smithi121.stdout:4/490: rmdir d2/dc/d16/d22/d2c/d44 39 2024-08-18T22:41:37.503 INFO:tasks.workunit.client.0.smithi121.stdout:9/637: mknod d0/d5/dd/d2f/d8b/db3/cd0 0 2024-08-18T22:41:37.503 INFO:tasks.workunit.client.0.smithi121.stdout:5/389: dwrite d3/d5/d27/d35/d67/f25 [0,4194304] 0 2024-08-18T22:41:37.503 INFO:tasks.workunit.client.1.smithi195.stdout:9/155: unlink l6 0 2024-08-18T22:41:37.503 INFO:tasks.workunit.client.1.smithi195.stdout:3/217: link d7/da/ld d7/d1f/d49/l50 0 2024-08-18T22:41:37.504 INFO:tasks.workunit.client.1.smithi195.stdout:1/290: read da/d18/d28/d31/d3b/f3a [3576984,43212] 0 2024-08-18T22:41:37.504 INFO:tasks.workunit.client.0.smithi121.stdout:0/459: rename d1/d4/d53/f97 to d1/f99 0 2024-08-18T22:41:37.505 INFO:tasks.workunit.client.0.smithi121.stdout:8/586: mknod d6/dd/d3b/da3/dca/d18/d99/da0/ccb 0 2024-08-18T22:41:37.507 INFO:tasks.workunit.client.1.smithi195.stdout:5/140: dwrite d0/d3/df/d1a/f24 [0,4194304] 0 2024-08-18T22:41:37.508 INFO:tasks.workunit.client.1.smithi195.stdout:8/212: creat d1/d4b/f50 x:0 0 0 2024-08-18T22:41:37.511 INFO:tasks.workunit.client.1.smithi195.stdout:8/213: write d1/d4b/f50 [381610,128002] 0 2024-08-18T22:41:37.512 INFO:tasks.workunit.client.0.smithi121.stdout:9/638: creat d0/d38/d9e/df/d73/fd1 x:0 0 0 2024-08-18T22:41:37.512 INFO:tasks.workunit.client.0.smithi121.stdout:5/390: creat d3/d5/d13/d19/d24/f7a x:0 0 0 2024-08-18T22:41:37.513 INFO:tasks.workunit.client.1.smithi195.stdout:8/214: write d1/de/df/d1d/f3e [4891918,56059] 0 2024-08-18T22:41:37.514 INFO:tasks.workunit.client.0.smithi121.stdout:8/587: mkdir d6/dd/dcc 0 2024-08-18T22:41:37.516 INFO:tasks.workunit.client.1.smithi195.stdout:8/215: chown d1/d3/db/c1a 935558 1 2024-08-18T22:41:37.519 INFO:tasks.workunit.client.0.smithi121.stdout:9/639: read d0/d38/d44/dbf/fa0 [332290,742] 0 2024-08-18T22:41:37.519 INFO:tasks.workunit.client.0.smithi121.stdout:4/491: rename d2/dc/d1c/f23 to d2/dc/d16/d22/fb0 0 2024-08-18T22:41:37.520 INFO:tasks.workunit.client.0.smithi121.stdout:5/391: mknod d3/d5/d27/d35/d67/c7b 0 2024-08-18T22:41:37.520 INFO:tasks.workunit.client.1.smithi195.stdout:6/111: truncate f5 1250817 0 2024-08-18T22:41:37.521 INFO:tasks.workunit.client.1.smithi195.stdout:1/291: creat da/d4c/d5d/d63/f65 x:0 0 0 2024-08-18T22:41:37.523 INFO:tasks.workunit.client.1.smithi195.stdout:2/146: link d1/d22/d29/fc d1/d24/d26/f2b 0 2024-08-18T22:41:37.523 INFO:tasks.workunit.client.0.smithi121.stdout:9/640: mknod d0/d38/d44/dbf/d60/cd2 0 2024-08-18T22:41:37.524 INFO:tasks.workunit.client.0.smithi121.stdout:5/392: creat d3/d5/d13/d19/d24/d4d/f7c x:0 0 0 2024-08-18T22:41:37.525 INFO:tasks.workunit.client.1.smithi195.stdout:0/174: creat d0/dc/f33 x:0 0 0 2024-08-18T22:41:37.525 INFO:tasks.workunit.client.0.smithi121.stdout:9/641: fdatasync d0/d38/d9e/df/d61/f6e 0 2024-08-18T22:41:37.527 INFO:tasks.workunit.client.1.smithi195.stdout:0/175: chown d0/dc/d25/l22 521 1 2024-08-18T22:41:37.527 INFO:tasks.workunit.client.1.smithi195.stdout:5/141: symlink d0/d3/l28 0 2024-08-18T22:41:37.527 INFO:tasks.workunit.client.0.smithi121.stdout:8/588: rename l1 to d6/d1e/d2d/d78/lcd 0 2024-08-18T22:41:37.528 INFO:tasks.workunit.client.1.smithi195.stdout:6/112: rename da/c20 to da/d22/c24 0 2024-08-18T22:41:37.528 INFO:tasks.workunit.client.0.smithi121.stdout:5/393: write d3/d5/d13/d23/f34 [1377952,55162] 0 2024-08-18T22:41:37.529 INFO:tasks.workunit.client.1.smithi195.stdout:5/142: stat d0/db 0 2024-08-18T22:41:37.529 INFO:tasks.workunit.client.1.smithi195.stdout:9/156: dwrite f16 [0,4194304] 0 2024-08-18T22:41:37.530 INFO:tasks.workunit.client.1.smithi195.stdout:2/147: unlink d1/d8/f17 0 2024-08-18T22:41:37.531 INFO:tasks.workunit.client.1.smithi195.stdout:8/216: dwrite d1/d4b/f50 [0,4194304] 0 2024-08-18T22:41:37.531 INFO:tasks.workunit.client.1.smithi195.stdout:7/104: getdents dc/d14/d15 0 2024-08-18T22:41:37.532 INFO:tasks.workunit.client.0.smithi121.stdout:5/394: write d3/d5/d27/d35/f5d [1814663,71165] 0 2024-08-18T22:41:37.532 INFO:tasks.workunit.client.0.smithi121.stdout:4/492: dwrite d2/d7c/f7f [0,4194304] 0 2024-08-18T22:41:37.533 INFO:tasks.workunit.client.1.smithi195.stdout:9/157: fdatasync d1c/f1d 0 2024-08-18T22:41:37.533 INFO:tasks.workunit.client.1.smithi195.stdout:6/113: symlink da/d22/l25 0 2024-08-18T22:41:37.534 INFO:tasks.workunit.client.1.smithi195.stdout:5/143: write d0/db/f19 [3100832,21975] 0 2024-08-18T22:41:37.536 INFO:tasks.workunit.client.0.smithi121.stdout:4/493: chown d2/dc/d16/d22/d29/f20 48980 1 2024-08-18T22:41:37.536 INFO:tasks.workunit.client.0.smithi121.stdout:5/395: readlink d3/d5/d13/d19/l51 0 2024-08-18T22:41:37.537 INFO:tasks.workunit.client.1.smithi195.stdout:8/217: dread - d1/de/f4e zero size 2024-08-18T22:41:37.538 INFO:tasks.workunit.client.0.smithi121.stdout:9/642: truncate d0/d38/d44/dbf/f84 757375 0 2024-08-18T22:41:37.538 INFO:tasks.workunit.client.0.smithi121.stdout:5/396: write d3/d5/d27/d35/f72 [620096,32624] 0 2024-08-18T22:41:37.539 INFO:tasks.workunit.client.0.smithi121.stdout:0/460: dread d1/d4/f1f [0,4194304] 0 2024-08-18T22:41:37.543 INFO:tasks.workunit.client.1.smithi195.stdout:9/158: mkdir d1c/d32/d37 0 2024-08-18T22:41:37.544 INFO:tasks.workunit.client.0.smithi121.stdout:8/589: mkdir d6/dd/d25/dc8/dce 0 2024-08-18T22:41:37.544 INFO:tasks.workunit.client.1.smithi195.stdout:0/176: getdents d0/dc/d11/d30 0 2024-08-18T22:41:37.545 INFO:tasks.workunit.client.0.smithi121.stdout:9/643: creat d0/d38/d9e/df/d3d/fd3 x:0 0 0 2024-08-18T22:41:37.547 INFO:tasks.workunit.client.1.smithi195.stdout:5/144: mkdir d0/d2/d29 0 2024-08-18T22:41:37.548 INFO:tasks.workunit.client.0.smithi121.stdout:5/397: symlink d3/d5c/l7d 0 2024-08-18T22:41:37.549 INFO:tasks.workunit.client.1.smithi195.stdout:2/148: creat d1/d24/d26/f2c x:0 0 0 2024-08-18T22:41:37.550 INFO:tasks.workunit.client.0.smithi121.stdout:8/590: mkdir d6/d20/dcf 0 2024-08-18T22:41:37.552 INFO:tasks.workunit.client.0.smithi121.stdout:9/644: fdatasync d0/d38/d52/d5f/fc5 0 2024-08-18T22:41:37.552 INFO:tasks.workunit.client.1.smithi195.stdout:7/105: dwrite dc/d14/d15/f16 [0,4194304] 0 2024-08-18T22:41:37.553 INFO:tasks.workunit.client.1.smithi195.stdout:0/177: mknod d0/dc/d11/d23/c34 0 2024-08-18T22:41:37.555 INFO:tasks.workunit.client.1.smithi195.stdout:3/218: dwrite d7/d1f/f37 [0,4194304] 0 2024-08-18T22:41:37.557 INFO:tasks.workunit.client.1.smithi195.stdout:9/159: mknod d1c/d32/d37/c38 0 2024-08-18T22:41:37.559 INFO:tasks.workunit.client.0.smithi121.stdout:4/494: link d2/f3f d2/dc/d16/d22/d2c/d44/da7/fb1 0 2024-08-18T22:41:37.559 INFO:tasks.workunit.client.1.smithi195.stdout:7/106: write dc/d14/d15/f16 [1301625,103341] 0 2024-08-18T22:41:37.561 INFO:tasks.workunit.client.0.smithi121.stdout:8/591: rename d6/d20/d69/c73 to d6/cd0 0 2024-08-18T22:41:37.562 INFO:tasks.workunit.client.1.smithi195.stdout:0/178: dread d0/dc/dd/f29 [0,4194304] 0 2024-08-18T22:41:37.564 INFO:tasks.workunit.client.1.smithi195.stdout:9/160: creat d1c/f39 x:0 0 0 2024-08-18T22:41:37.565 INFO:tasks.workunit.client.1.smithi195.stdout:7/107: mkdir dc/d2a 0 2024-08-18T22:41:37.566 INFO:tasks.workunit.client.0.smithi121.stdout:9/645: dwrite d0/d38/d44/dbf/fa0 [0,4194304] 0 2024-08-18T22:41:37.569 INFO:tasks.workunit.client.1.smithi195.stdout:9/161: write d1c/f21 [973081,21489] 0 2024-08-18T22:41:37.570 INFO:tasks.workunit.client.1.smithi195.stdout:5/145: dread d0/d3/d8/f14 [0,4194304] 0 2024-08-18T22:41:37.571 INFO:tasks.workunit.client.0.smithi121.stdout:5/398: truncate d3/d5/d27/f54 166210 0 2024-08-18T22:41:37.571 INFO:tasks.workunit.client.1.smithi195.stdout:8/218: dread d1/d3/db/f34 [0,4194304] 0 2024-08-18T22:41:37.574 INFO:tasks.workunit.client.0.smithi121.stdout:5/399: write d3/d5/d27/d35/f5d [2365513,114893] 0 2024-08-18T22:41:37.574 INFO:tasks.workunit.client.1.smithi195.stdout:9/162: rmdir d1c/d32 39 2024-08-18T22:41:37.574 INFO:tasks.workunit.client.1.smithi195.stdout:2/149: write d1/f2 [1158450,126197] 0 2024-08-18T22:41:37.575 INFO:tasks.workunit.client.0.smithi121.stdout:7/562: sync 2024-08-18T22:41:37.576 INFO:tasks.workunit.client.1.smithi195.stdout:3/219: dwrite d7/da/df/f20 [0,4194304] 0 2024-08-18T22:41:37.576 INFO:tasks.workunit.client.1.smithi195.stdout:8/219: stat d1/d3/db/d35/f42 0 2024-08-18T22:41:37.577 INFO:tasks.workunit.client.1.smithi195.stdout:5/146: mknod d0/d3/df/c2a 0 2024-08-18T22:41:37.578 INFO:tasks.workunit.client.1.smithi195.stdout:2/150: chown d1/f2 34462295 1 2024-08-18T22:41:37.578 INFO:tasks.workunit.client.0.smithi121.stdout:9/646: creat d0/d38/d9e/df/d3d/d89/d92/dc6/fd4 x:0 0 0 2024-08-18T22:41:37.582 INFO:tasks.workunit.client.1.smithi195.stdout:9/163: truncate d1c/f26 75169 0 2024-08-18T22:41:37.582 INFO:tasks.workunit.client.0.smithi121.stdout:7/563: fdatasync de/d13/d18/d9d/fb0 0 2024-08-18T22:41:37.582 INFO:tasks.workunit.client.0.smithi121.stdout:4/495: dwrite d2/dc/d16/d59/d83/f98 [0,4194304] 0 2024-08-18T22:41:37.582 INFO:tasks.workunit.client.0.smithi121.stdout:5/400: truncate d3/d5/d13/d19/f30 122246 0 2024-08-18T22:41:37.584 INFO:tasks.workunit.client.0.smithi121.stdout:0/461: dread d1/d4/db/d24/f29 [0,4194304] 0 2024-08-18T22:41:37.585 INFO:tasks.workunit.client.0.smithi121.stdout:7/564: mknod de/d1a/d20/cb4 0 2024-08-18T22:41:37.587 INFO:tasks.workunit.client.1.smithi195.stdout:8/220: rename d1/de/df/d1d/d1f/l25 to d1/de/d27/l51 0 2024-08-18T22:41:37.592 INFO:tasks.workunit.client.0.smithi121.stdout:0/462: read d1/d4/db/d24/d30/f3b [2906376,67287] 0 2024-08-18T22:41:37.592 INFO:tasks.workunit.client.0.smithi121.stdout:7/565: write de/d13/d18/f3c [3877691,10738] 0 2024-08-18T22:41:37.594 INFO:tasks.workunit.client.0.smithi121.stdout:8/592: dwrite d6/f8 [0,4194304] 0 2024-08-18T22:41:37.594 INFO:tasks.workunit.client.0.smithi121.stdout:5/401: getdents d3/d5/d13/d19/d24 0 2024-08-18T22:41:37.596 INFO:tasks.workunit.client.0.smithi121.stdout:4/496: dread d2/dc/d16/d22/d29/f3b [0,4194304] 0 2024-08-18T22:41:37.597 INFO:tasks.workunit.client.1.smithi195.stdout:0/179: write d0/dc/d11/f20 [656538,88466] 0 2024-08-18T22:41:37.597 INFO:tasks.workunit.client.1.smithi195.stdout:5/147: dread d0/d3/d8/f14 [0,4194304] 0 2024-08-18T22:41:37.597 INFO:tasks.workunit.client.1.smithi195.stdout:3/220: dread d7/d1f/f37 [0,4194304] 0 2024-08-18T22:41:37.597 INFO:tasks.workunit.client.1.smithi195.stdout:8/221: dread - d1/d3/db/d39/d2e/f4c zero size 2024-08-18T22:41:37.598 INFO:tasks.workunit.client.0.smithi121.stdout:7/566: chown de/d1a/d2f/d4b/f64 6 1 2024-08-18T22:41:37.601 INFO:tasks.workunit.client.0.smithi121.stdout:5/402: mkdir d3/d5/d7e 0 2024-08-18T22:41:37.601 INFO:tasks.workunit.client.0.smithi121.stdout:4/497: chown d2/dc/d1c/f3c 26218569 1 2024-08-18T22:41:37.602 INFO:tasks.workunit.client.0.smithi121.stdout:5/403: chown d3/d5/d13/d23/f71 39269 1 2024-08-18T22:41:37.602 INFO:tasks.workunit.client.0.smithi121.stdout:5/404: fdatasync d3/d5/d3c/d3f/f6e 0 2024-08-18T22:41:37.603 INFO:tasks.workunit.client.0.smithi121.stdout:7/567: unlink de/d13/d18/d2e/la5 0 2024-08-18T22:41:37.603 INFO:tasks.workunit.client.1.smithi195.stdout:2/151: dwrite d1/f1f [0,4194304] 0 2024-08-18T22:41:37.605 INFO:tasks.workunit.client.1.smithi195.stdout:9/164: dread f16 [0,4194304] 0 2024-08-18T22:41:37.605 INFO:tasks.workunit.client.1.smithi195.stdout:8/222: stat d1/d3/db 0 2024-08-18T22:41:37.606 INFO:tasks.workunit.client.1.smithi195.stdout:3/221: chown d7/da/df/d1c/c2d 13694024 1 2024-08-18T22:41:37.606 INFO:tasks.workunit.client.0.smithi121.stdout:5/405: creat d3/d5/d3c/f7f x:0 0 0 2024-08-18T22:41:37.609 INFO:tasks.workunit.client.0.smithi121.stdout:4/498: dwrite d2/dc/f5d [0,4194304] 0 2024-08-18T22:41:37.610 INFO:tasks.workunit.client.1.smithi195.stdout:8/223: write d1/f2a [482970,64886] 0 2024-08-18T22:41:37.610 INFO:tasks.workunit.client.1.smithi195.stdout:1/292: dread da/fe [0,4194304] 0 2024-08-18T22:41:37.611 INFO:tasks.workunit.client.1.smithi195.stdout:5/148: unlink d0/d3/lc 0 2024-08-18T22:41:37.612 INFO:tasks.workunit.client.0.smithi121.stdout:5/406: write d3/d5/d13/d19/d24/d4d/f4f [1925664,91488] 0 2024-08-18T22:41:37.612 INFO:tasks.workunit.client.0.smithi121.stdout:4/499: fdatasync d2/dc/d16/fad 0 2024-08-18T22:41:37.612 INFO:tasks.workunit.client.1.smithi195.stdout:0/180: creat d0/dc/d11/d30/f35 x:0 0 0 2024-08-18T22:41:37.614 INFO:tasks.workunit.client.0.smithi121.stdout:7/568: mknod de/d1a/d2f/d4b/daf/cb5 0 2024-08-18T22:41:37.615 INFO:tasks.workunit.client.1.smithi195.stdout:8/224: creat d1/d3/d1c/f52 x:0 0 0 2024-08-18T22:41:37.616 INFO:tasks.workunit.client.0.smithi121.stdout:0/463: write d1/d4/db/d24/d30/d52/f7e [129653,96120] 0 2024-08-18T22:41:37.617 INFO:tasks.workunit.client.1.smithi195.stdout:1/293: chown da/d18/d43/c54 0 1 2024-08-18T22:41:37.617 INFO:tasks.workunit.client.1.smithi195.stdout:2/152: mknod d1/d22/d29/c2d 0 2024-08-18T22:41:37.618 INFO:tasks.workunit.client.1.smithi195.stdout:0/181: symlink d0/dc/dd/l36 0 2024-08-18T22:41:37.618 INFO:tasks.workunit.client.1.smithi195.stdout:3/222: dread d7/da/df/f27 [0,4194304] 0 2024-08-18T22:41:37.619 INFO:tasks.workunit.client.1.smithi195.stdout:5/149: mknod d0/d3/d8/c2b 0 2024-08-18T22:41:37.620 INFO:tasks.workunit.client.1.smithi195.stdout:5/150: write d0/db/f19 [4328051,55020] 0 2024-08-18T22:41:37.621 INFO:tasks.workunit.client.0.smithi121.stdout:9/647: dread d0/d38/d9e/fc9 [0,4194304] 0 2024-08-18T22:41:37.621 INFO:tasks.workunit.client.0.smithi121.stdout:7/569: symlink de/d1a/d2f/d4b/d6d/lb6 0 2024-08-18T22:41:37.621 INFO:tasks.workunit.client.1.smithi195.stdout:3/223: dread - d7/da/df/d38/f45 zero size 2024-08-18T22:41:37.622 INFO:tasks.workunit.client.1.smithi195.stdout:9/165: link d1c/f22 d1c/f3a 0 2024-08-18T22:41:37.622 INFO:tasks.workunit.client.1.smithi195.stdout:9/166: chown f16 37091498 1 2024-08-18T22:41:37.623 INFO:tasks.workunit.client.0.smithi121.stdout:5/407: creat d3/d5/d27/d35/d67/f80 x:0 0 0 2024-08-18T22:41:37.623 INFO:tasks.workunit.client.1.smithi195.stdout:1/294: creat da/d4c/f66 x:0 0 0 2024-08-18T22:41:37.625 INFO:tasks.workunit.client.0.smithi121.stdout:0/464: creat d1/d4/db/d18/d1c/d5f/f9a x:0 0 0 2024-08-18T22:41:37.625 INFO:tasks.workunit.client.0.smithi121.stdout:2/390: sync 2024-08-18T22:41:37.626 INFO:tasks.workunit.client.1.smithi195.stdout:2/153: unlink d1/f15 0 2024-08-18T22:41:37.629 INFO:tasks.workunit.client.0.smithi121.stdout:1/527: sync 2024-08-18T22:41:37.629 INFO:tasks.workunit.client.0.smithi121.stdout:3/568: sync 2024-08-18T22:41:37.630 INFO:tasks.workunit.client.0.smithi121.stdout:2/391: write d2/d8/d19/f52 [2723604,116530] 0 2024-08-18T22:41:37.630 INFO:tasks.workunit.client.1.smithi195.stdout:8/225: fsync d1/f2a 0 2024-08-18T22:41:37.630 INFO:tasks.workunit.client.1.smithi195.stdout:0/182: symlink d0/dc/dd/l37 0 2024-08-18T22:41:37.631 INFO:tasks.workunit.client.1.smithi195.stdout:3/224: dread d7/da/df/f1a [0,4194304] 0 2024-08-18T22:41:37.631 INFO:tasks.workunit.client.0.smithi121.stdout:9/648: rename d0/d5/dd/d2f/d8b to d0/d38/d9e/df/d3d/d89/d92/dc6/dd5 0 2024-08-18T22:41:37.635 INFO:tasks.workunit.client.1.smithi195.stdout:1/295: unlink da/d3d/c55 0 2024-08-18T22:41:37.636 INFO:tasks.workunit.client.1.smithi195.stdout:9/167: dwrite d1c/f2a [0,4194304] 0 2024-08-18T22:41:37.636 INFO:tasks.workunit.client.1.smithi195.stdout:7/108: dread dc/d14/d15/d17/f19 [0,4194304] 0 2024-08-18T22:41:37.637 INFO:tasks.workunit.client.1.smithi195.stdout:8/226: write d1/d3/db/d35/f42 [354847,12002] 0 2024-08-18T22:41:37.639 INFO:tasks.workunit.client.0.smithi121.stdout:9/649: chown d0/d38/d44/dbf/f6f 5795371 1 2024-08-18T22:41:37.641 INFO:tasks.workunit.client.0.smithi121.stdout:1/528: write d5/d10/d14/d34/fae [840895,60069] 0 2024-08-18T22:41:37.642 INFO:tasks.workunit.client.0.smithi121.stdout:7/570: dwrite de/d1a/d34/d38/d5f/f94 [0,4194304] 0 2024-08-18T22:41:37.648 INFO:tasks.workunit.client.0.smithi121.stdout:2/392: write d2/d8/d19/f13 [2769436,50156] 0 2024-08-18T22:41:37.649 INFO:tasks.workunit.client.0.smithi121.stdout:5/408: dwrite d3/d5/d27/d35/f74 [0,4194304] 0 2024-08-18T22:41:37.654 INFO:tasks.workunit.client.0.smithi121.stdout:8/593: dread d6/dd/d3b/da3/dca/d18/f3a [0,4194304] 0 2024-08-18T22:41:37.655 INFO:tasks.workunit.client.1.smithi195.stdout:2/154: rename d1/d22/d29/l14 to d1/d24/l2e 0 2024-08-18T22:41:37.656 INFO:tasks.workunit.client.0.smithi121.stdout:9/650: rename d0/d38/d9e/df/d3d/d89/fb1 to d0/d38/d44/dbf/d60/fd6 0 2024-08-18T22:41:37.656 INFO:tasks.workunit.client.0.smithi121.stdout:0/465: dwrite d1/f99 [0,4194304] 0 2024-08-18T22:41:37.657 INFO:tasks.workunit.client.0.smithi121.stdout:7/571: write de/d13/d18/d23/f3d [1176767,38011] 0 2024-08-18T22:41:37.658 INFO:tasks.workunit.client.1.smithi195.stdout:0/183: mknod d0/dc/d11/d30/c38 0 2024-08-18T22:41:37.658 INFO:tasks.workunit.client.0.smithi121.stdout:3/569: dwrite d1e/d1f/d25/d2e/d36/fac [0,4194304] 0 2024-08-18T22:41:37.658 INFO:tasks.workunit.client.0.smithi121.stdout:1/529: rename d5/d10/d14 to d5/d10/d14/d2a/db4 22 2024-08-18T22:41:37.659 INFO:tasks.workunit.client.0.smithi121.stdout:5/409: mkdir d3/d5/d13/d23/d81 0 2024-08-18T22:41:37.661 INFO:tasks.workunit.client.0.smithi121.stdout:8/594: creat d6/dd/d25/fd1 x:0 0 0 2024-08-18T22:41:37.661 INFO:tasks.workunit.client.1.smithi195.stdout:8/227: symlink d1/d3/db/d39/l53 0 2024-08-18T22:41:37.661 INFO:tasks.workunit.client.0.smithi121.stdout:9/651: rmdir d0/d38/d44/dbf 39 2024-08-18T22:41:37.663 INFO:tasks.workunit.client.0.smithi121.stdout:7/572: write de/d1a/d20/f3f [839652,57946] 0 2024-08-18T22:41:37.663 INFO:tasks.workunit.client.0.smithi121.stdout:5/410: symlink d3/d5c/l82 0 2024-08-18T22:41:37.664 INFO:tasks.workunit.client.0.smithi121.stdout:0/466: mknod d1/d4/db/d24/d30/d52/d5b/c9b 0 2024-08-18T22:41:37.668 INFO:tasks.workunit.client.1.smithi195.stdout:7/109: dread dc/f10 [0,4194304] 0 2024-08-18T22:41:37.671 INFO:tasks.workunit.client.0.smithi121.stdout:7/573: mkdir de/d2d/d50/db7 0 2024-08-18T22:41:37.671 INFO:tasks.workunit.client.0.smithi121.stdout:8/595: truncate d6/dd/d25/d56/fc6 637085 0 2024-08-18T22:41:37.672 INFO:tasks.workunit.client.0.smithi121.stdout:4/500: dread d2/dc/d16/d22/d29/f41 [0,4194304] 0 2024-08-18T22:41:37.672 INFO:tasks.workunit.client.0.smithi121.stdout:5/411: rmdir d3/d5/d13/d19/d24 39 2024-08-18T22:41:37.673 INFO:tasks.workunit.client.0.smithi121.stdout:0/467: symlink d1/d4/db/d18/d1c/d5f/l9c 0 2024-08-18T22:41:37.675 INFO:tasks.workunit.client.0.smithi121.stdout:3/570: getdents d1e/d1f/d25/d2e 0 2024-08-18T22:41:37.677 INFO:tasks.workunit.client.0.smithi121.stdout:4/501: write d2/dc/d16/d59/d83/f98 [1216174,129015] 0 2024-08-18T22:41:37.679 INFO:tasks.workunit.client.0.smithi121.stdout:9/652: dwrite d0/d38/d9e/df/d3d/d89/d92/dc6/fd4 [0,4194304] 0 2024-08-18T22:41:37.679 INFO:tasks.workunit.client.0.smithi121.stdout:8/596: creat d6/dd/d3b/da3/dca/d18/d99/da0/fd2 x:0 0 0 2024-08-18T22:41:37.679 INFO:tasks.workunit.client.0.smithi121.stdout:4/502: read - d2/dc/d1c/f96 zero size 2024-08-18T22:41:37.680 INFO:tasks.workunit.client.0.smithi121.stdout:7/574: unlink de/d13/d18/d23/l5e 0 2024-08-18T22:41:37.683 INFO:tasks.workunit.client.0.smithi121.stdout:5/412: stat d3/d5/d13/d19/d24/d32/d38/f4e 0 2024-08-18T22:41:37.684 INFO:tasks.workunit.client.0.smithi121.stdout:3/571: link d1e/d1f/f23 d1e/d1f/d25/d6b/d81/fcc 0 2024-08-18T22:41:37.684 INFO:tasks.workunit.client.0.smithi121.stdout:7/575: read de/f16 [1267422,91629] 0 2024-08-18T22:41:37.687 INFO:tasks.workunit.client.0.smithi121.stdout:4/503: rename d2/dc/f12 to d2/dc/d1c/d62/fb2 0 2024-08-18T22:41:37.687 INFO:tasks.workunit.client.0.smithi121.stdout:7/576: fdatasync de/d13/d18/d23/d24/f56 0 2024-08-18T22:41:37.688 INFO:tasks.workunit.client.0.smithi121.stdout:0/468: getdents d1/d4/db/d24/df/d8 0 2024-08-18T22:41:37.689 INFO:tasks.workunit.client.0.smithi121.stdout:4/504: write d2/dc/d1c/d62/f88 [5044936,49722] 0 2024-08-18T22:41:37.690 INFO:tasks.workunit.client.0.smithi121.stdout:5/413: creat d3/d5/d13/d19/d24/d32/d38/d63/f83 x:0 0 0 2024-08-18T22:41:37.692 INFO:tasks.workunit.client.0.smithi121.stdout:9/653: rename d0/d38/d9e/df/d61/db2/l22 to d0/d5/ld7 0 2024-08-18T22:41:37.693 INFO:tasks.workunit.client.0.smithi121.stdout:0/469: mkdir d1/d4/db/d18/d40/d83/d9d 0 2024-08-18T22:41:37.694 INFO:tasks.workunit.client.0.smithi121.stdout:9/654: readlink d0/d5/dd/d3f/l83 0 2024-08-18T22:41:37.694 INFO:tasks.workunit.client.0.smithi121.stdout:5/414: fsync d3/d5/d13/f3d 0 2024-08-18T22:41:37.696 INFO:tasks.workunit.client.0.smithi121.stdout:4/505: mkdir d2/dc/d1c/d62/d90/db3 0 2024-08-18T22:41:37.697 INFO:tasks.workunit.client.1.smithi195.stdout:2/155: creat d1/d8/f2f x:0 0 0 2024-08-18T22:41:37.698 INFO:tasks.workunit.client.1.smithi195.stdout:3/225: creat d7/f51 x:0 0 0 2024-08-18T22:41:37.698 INFO:tasks.workunit.client.0.smithi121.stdout:3/572: rename f1a to d1e/d1f/d25/d6b/fcd 0 2024-08-18T22:41:37.700 INFO:tasks.workunit.client.1.smithi195.stdout:3/226: write d7/da/df/d1c/f23 [880535,120929] 0 2024-08-18T22:41:37.702 INFO:tasks.workunit.client.1.smithi195.stdout:9/168: symlink d1c/d32/d37/l3b 0 2024-08-18T22:41:37.702 INFO:tasks.workunit.client.0.smithi121.stdout:0/470: chown d1/d4/db/d18/f58 36263 1 2024-08-18T22:41:37.703 INFO:tasks.workunit.client.1.smithi195.stdout:3/227: write d7/da/df/f12 [684503,122528] 0 2024-08-18T22:41:37.703 INFO:tasks.workunit.client.1.smithi195.stdout:9/169: stat d1c/f21 0 2024-08-18T22:41:37.704 INFO:tasks.workunit.client.0.smithi121.stdout:7/577: dwrite de/d13/d18/d23/d24/d25/f55 [4194304,4194304] 0 2024-08-18T22:41:37.704 INFO:tasks.workunit.client.1.smithi195.stdout:8/228: rmdir d1/de/df/d1d/d1f 39 2024-08-18T22:41:37.705 INFO:tasks.workunit.client.1.smithi195.stdout:3/228: stat d7/d1f/l4b 0 2024-08-18T22:41:37.707 INFO:tasks.workunit.client.1.smithi195.stdout:3/229: chown d7/da/c30 3927 1 2024-08-18T22:41:37.707 INFO:tasks.workunit.client.1.smithi195.stdout:7/110: mkdir dc/d14/d2b 0 2024-08-18T22:41:37.708 INFO:tasks.workunit.client.0.smithi121.stdout:3/573: creat d1e/d1f/d5e/fce x:0 0 0 2024-08-18T22:41:37.709 INFO:tasks.workunit.client.1.smithi195.stdout:0/184: dwrite d0/dc/d11/f27 [0,4194304] 0 2024-08-18T22:41:37.711 INFO:tasks.workunit.client.1.smithi195.stdout:0/185: fdatasync d0/f3 0 2024-08-18T22:41:37.712 INFO:tasks.workunit.client.1.smithi195.stdout:0/186: readlink d0/dc/l2c 0 2024-08-18T22:41:37.714 INFO:tasks.workunit.client.1.smithi195.stdout:3/230: dread d7/f18 [0,4194304] 0 2024-08-18T22:41:37.715 INFO:tasks.workunit.client.1.smithi195.stdout:3/231: write d7/da/f48 [3965896,103452] 0 2024-08-18T22:41:37.717 INFO:tasks.workunit.client.1.smithi195.stdout:3/232: write d7/d1f/f34 [694182,56113] 0 2024-08-18T22:41:37.719 INFO:tasks.workunit.client.0.smithi121.stdout:3/574: dread - d1e/d1f/d25/d58/f98 zero size 2024-08-18T22:41:37.720 INFO:tasks.workunit.client.1.smithi195.stdout:0/187: rename d0/dc/dd/c2a to d0/dc/d11/c39 0 2024-08-18T22:41:37.720 INFO:tasks.workunit.client.1.smithi195.stdout:1/296: getdents da/d4c/d5d/d63 0 2024-08-18T22:41:37.722 INFO:tasks.workunit.client.0.smithi121.stdout:8/597: dread d6/f7c [0,4194304] 0 2024-08-18T22:41:37.722 INFO:tasks.workunit.client.0.smithi121.stdout:5/415: dwrite d3/d5/d27/d35/d67/f80 [0,4194304] 0 2024-08-18T22:41:37.726 INFO:tasks.workunit.client.1.smithi195.stdout:8/229: getdents d1/de/df/d1d 0 2024-08-18T22:41:37.726 INFO:tasks.workunit.client.0.smithi121.stdout:4/506: creat d2/dc/d16/d22/d2c/fb4 x:0 0 0 2024-08-18T22:41:37.726 INFO:tasks.workunit.client.0.smithi121.stdout:0/471: dwrite d1/d4/db/d24/d30/d52/d6a/f34 [0,4194304] 0 2024-08-18T22:41:37.727 INFO:tasks.workunit.client.1.smithi195.stdout:8/230: stat d1/de/l37 0 2024-08-18T22:41:37.728 INFO:tasks.workunit.client.0.smithi121.stdout:8/598: write d6/d1e/fac [875456,60169] 0 2024-08-18T22:41:37.729 INFO:tasks.workunit.client.1.smithi195.stdout:1/297: rename da/fd to da/d18/d28/d31/d3b/d4e/f67 0 2024-08-18T22:41:37.730 INFO:tasks.workunit.client.0.smithi121.stdout:3/575: creat d1e/d1f/d5e/d9a/fcf x:0 0 0 2024-08-18T22:41:37.731 INFO:tasks.workunit.client.1.smithi195.stdout:1/298: chown da/f29 535302121 1 2024-08-18T22:41:37.732 INFO:tasks.workunit.client.0.smithi121.stdout:5/416: mknod d3/d5/d13/d23/c84 0 2024-08-18T22:41:37.733 INFO:tasks.workunit.client.0.smithi121.stdout:0/472: write d1/d4/db/d24/df/d8/f85 [409448,116960] 0 2024-08-18T22:41:37.734 INFO:tasks.workunit.client.0.smithi121.stdout:4/507: mknod d2/dc/d1c/d62/d90/cb5 0 2024-08-18T22:41:37.736 INFO:tasks.workunit.client.0.smithi121.stdout:3/576: getdents d1e/d1f/d5e/dbc/dcb 0 2024-08-18T22:41:37.736 INFO:tasks.workunit.client.0.smithi121.stdout:8/599: dread d6/d1e/f54 [0,4194304] 0 2024-08-18T22:41:37.738 INFO:tasks.workunit.client.1.smithi195.stdout:1/299: mkdir da/d68 0 2024-08-18T22:41:37.738 INFO:tasks.workunit.client.1.smithi195.stdout:9/170: rmdir d1c 39 2024-08-18T22:41:37.740 INFO:tasks.workunit.client.1.smithi195.stdout:1/300: chown da/d18/f47 1 1 2024-08-18T22:41:37.741 INFO:tasks.workunit.client.0.smithi121.stdout:7/578: dwrite de/d1a/d2f/d4b/f96 [0,4194304] 0 2024-08-18T22:41:37.742 INFO:tasks.workunit.client.1.smithi195.stdout:1/301: chown da/f1d 956734747 1 2024-08-18T22:41:37.744 INFO:tasks.workunit.client.1.smithi195.stdout:3/233: truncate d7/da/df/f1a 1114927 0 2024-08-18T22:41:37.746 INFO:tasks.workunit.client.1.smithi195.stdout:9/171: write f16 [4122157,20061] 0 2024-08-18T22:41:37.747 INFO:tasks.workunit.client.1.smithi195.stdout:0/188: dread d0/dc/df/f12 [0,4194304] 0 2024-08-18T22:41:37.750 INFO:tasks.workunit.client.0.smithi121.stdout:7/579: dwrite de/f1c [4194304,4194304] 0 2024-08-18T22:41:37.755 INFO:tasks.workunit.client.1.smithi195.stdout:3/234: mknod d7/d1f/d49/c52 0 2024-08-18T22:41:37.757 INFO:tasks.workunit.client.1.smithi195.stdout:7/111: dwrite dc/f1e [4194304,4194304] 0 2024-08-18T22:41:37.758 INFO:tasks.workunit.client.1.smithi195.stdout:0/189: write d0/dc/df/f2d [3660330,78301] 0 2024-08-18T22:41:37.760 INFO:tasks.workunit.client.1.smithi195.stdout:3/235: truncate d7/f4c 356312 0 2024-08-18T22:41:37.761 INFO:tasks.workunit.client.1.smithi195.stdout:3/236: fdatasync f1 0 2024-08-18T22:41:37.763 INFO:tasks.workunit.client.1.smithi195.stdout:8/231: dread d1/de/df/d1d/f32 [0,4194304] 0 2024-08-18T22:41:37.765 INFO:tasks.workunit.client.1.smithi195.stdout:7/112: creat dc/d22/f2c x:0 0 0 2024-08-18T22:41:37.765 INFO:tasks.workunit.client.1.smithi195.stdout:9/172: dread d1c/f2a [0,4194304] 0 2024-08-18T22:41:37.767 INFO:tasks.workunit.client.1.smithi195.stdout:7/113: fdatasync dc/d22/f2c 0 2024-08-18T22:41:37.768 INFO:tasks.workunit.client.1.smithi195.stdout:8/232: rmdir d1/d3/db/d39/d2e 39 2024-08-18T22:41:37.771 INFO:tasks.workunit.client.1.smithi195.stdout:9/173: unlink le 0 2024-08-18T22:41:37.772 INFO:tasks.workunit.client.1.smithi195.stdout:9/174: chown c1 6 1 2024-08-18T22:41:37.772 INFO:tasks.workunit.client.1.smithi195.stdout:9/175: readlink d1c/d32/d37/l3b 0 2024-08-18T22:41:37.773 INFO:tasks.workunit.client.1.smithi195.stdout:3/237: getdents d7/da/d4d 0 2024-08-18T22:41:37.774 INFO:tasks.workunit.client.1.smithi195.stdout:3/238: chown d7/d1f/c3e 277918 1 2024-08-18T22:41:37.774 INFO:tasks.workunit.client.1.smithi195.stdout:1/302: dread da/d3d/f41 [0,4194304] 0 2024-08-18T22:41:37.775 INFO:tasks.workunit.client.1.smithi195.stdout:3/239: chown f6 53436 1 2024-08-18T22:41:37.776 INFO:tasks.workunit.client.1.smithi195.stdout:7/114: creat dc/d14/d15/d17/d18/f2d x:0 0 0 2024-08-18T22:41:37.776 INFO:tasks.workunit.client.1.smithi195.stdout:8/233: creat d1/de/f54 x:0 0 0 2024-08-18T22:41:37.776 INFO:tasks.workunit.client.1.smithi195.stdout:3/240: readlink d7/da/df/l4f 0 2024-08-18T22:41:37.777 INFO:tasks.workunit.client.0.smithi121.stdout:0/473: creat d1/d4/db/d18/d40/d83/f9e x:0 0 0 2024-08-18T22:41:37.778 INFO:tasks.workunit.client.1.smithi195.stdout:9/176: unlink d1c/d32/d37/l3b 0 2024-08-18T22:41:37.778 INFO:tasks.workunit.client.0.smithi121.stdout:3/577: symlink d1e/d1f/d25/d74/d97/ld0 0 2024-08-18T22:41:37.779 INFO:tasks.workunit.client.1.smithi195.stdout:9/177: dread - f13 zero size 2024-08-18T22:41:37.779 INFO:tasks.workunit.client.1.smithi195.stdout:1/303: truncate da/d18/f1a 2159964 0 2024-08-18T22:41:37.780 INFO:tasks.workunit.client.1.smithi195.stdout:3/241: symlink d7/d1f/l53 0 2024-08-18T22:41:37.780 INFO:tasks.workunit.client.0.smithi121.stdout:5/417: rename d3/d5/d13/d19/f1e to d3/d5/d13/d19/d24/d32/d38/f85 0 2024-08-18T22:41:37.781 INFO:tasks.workunit.client.0.smithi121.stdout:5/418: stat d3/d5/d3c 0 2024-08-18T22:41:37.781 INFO:tasks.workunit.client.1.smithi195.stdout:0/190: write d0/dc/f21 [367673,66648] 0 2024-08-18T22:41:37.781 INFO:tasks.workunit.client.0.smithi121.stdout:5/419: chown d3/d5/d3c/d3f 0 1 2024-08-18T22:41:37.783 INFO:tasks.workunit.client.1.smithi195.stdout:1/304: rename da/d18/f5c to da/d4c/f69 0 2024-08-18T22:41:37.785 INFO:tasks.workunit.client.1.smithi195.stdout:8/234: mkdir d1/d3/d1c/d49/d55 0 2024-08-18T22:41:37.786 INFO:tasks.workunit.client.0.smithi121.stdout:3/578: creat d1e/d1f/d25/d6b/d66/fd1 x:0 0 0 2024-08-18T22:41:37.788 INFO:tasks.workunit.client.1.smithi195.stdout:0/191: mknod d0/dc/d25/c3a 0 2024-08-18T22:41:37.790 INFO:tasks.workunit.client.0.smithi121.stdout:7/580: dwrite de/d13/f17 [4194304,4194304] 0 2024-08-18T22:41:37.790 INFO:tasks.workunit.client.0.smithi121.stdout:3/579: chown d1e/d1f/d25/d6b/db4/d94 0 1 2024-08-18T22:41:37.791 INFO:tasks.workunit.client.1.smithi195.stdout:9/178: rename d1c/f24 to d1c/f3c 0 2024-08-18T22:41:37.791 INFO:tasks.workunit.client.0.smithi121.stdout:4/508: write d2/dc/d16/d22/d2c/d44/d66/f6d [1534624,130876] 0 2024-08-18T22:41:37.793 INFO:tasks.workunit.client.1.smithi195.stdout:8/235: mkdir d1/d3/db/d35/d56 0 2024-08-18T22:41:37.796 INFO:tasks.workunit.client.1.smithi195.stdout:1/305: truncate da/d18/d28/f50 1350619 0 2024-08-18T22:41:37.798 INFO:tasks.workunit.client.0.smithi121.stdout:5/420: symlink d3/l86 0 2024-08-18T22:41:37.798 INFO:tasks.workunit.client.1.smithi195.stdout:0/192: dwrite d0/dc/d11/f20 [0,4194304] 0 2024-08-18T22:41:37.798 INFO:tasks.workunit.client.1.smithi195.stdout:9/179: creat d1c/d32/d37/f3d x:0 0 0 2024-08-18T22:41:37.799 INFO:tasks.workunit.client.0.smithi121.stdout:8/600: getdents d6/d1e/d2d/d78/d45 0 2024-08-18T22:41:37.800 INFO:tasks.workunit.client.0.smithi121.stdout:7/581: readlink de/d1a/d20/d39/lac 0 2024-08-18T22:41:37.801 INFO:tasks.workunit.client.0.smithi121.stdout:0/474: link d1/d4/db/d24/df/c77 d1/d4/db/d24/df/c9f 0 2024-08-18T22:41:37.801 INFO:tasks.workunit.client.1.smithi195.stdout:0/193: write d0/f1c [2695564,94314] 0 2024-08-18T22:41:37.801 INFO:tasks.workunit.client.1.smithi195.stdout:9/180: write d1c/f20 [653768,12922] 0 2024-08-18T22:41:37.802 INFO:tasks.workunit.client.1.smithi195.stdout:0/194: fsync d0/f3 0 2024-08-18T22:41:37.803 INFO:tasks.workunit.client.1.smithi195.stdout:9/181: stat d1c/f23 0 2024-08-18T22:41:37.805 INFO:tasks.workunit.client.0.smithi121.stdout:7/582: dread de/d1a/d4f/f75 [0,4194304] 0 2024-08-18T22:41:37.808 INFO:tasks.workunit.client.0.smithi121.stdout:8/601: creat d6/dd/d25/dc8/fd3 x:0 0 0 2024-08-18T22:41:37.808 INFO:tasks.workunit.client.1.smithi195.stdout:3/242: getdents d7/da/df/d1c 0 2024-08-18T22:41:37.809 INFO:tasks.workunit.client.0.smithi121.stdout:7/583: chown de/d1a/d34/d38/d5f 546858 1 2024-08-18T22:41:37.812 INFO:tasks.workunit.client.0.smithi121.stdout:8/602: fsync d6/dd/d3b/da3/dca/d60/d5b/f95 0 2024-08-18T22:41:37.814 INFO:tasks.workunit.client.0.smithi121.stdout:7/584: truncate de/d13/d18/d23/d24/d29/f8e 776909 0 2024-08-18T22:41:37.816 INFO:tasks.workunit.client.0.smithi121.stdout:3/580: dread ff [0,4194304] 0 2024-08-18T22:41:37.816 INFO:tasks.workunit.client.0.smithi121.stdout:0/475: getdents d1/d4/db/d18/d1c/d5f 0 2024-08-18T22:41:37.817 INFO:tasks.workunit.client.1.smithi195.stdout:3/243: mkdir d7/d54 0 2024-08-18T22:41:37.817 INFO:tasks.workunit.client.0.smithi121.stdout:7/585: symlink de/d1a/d2f/d36/lb8 0 2024-08-18T22:41:37.820 INFO:tasks.workunit.client.1.smithi195.stdout:9/182: dwrite f13 [0,4194304] 0 2024-08-18T22:41:37.820 INFO:tasks.workunit.client.1.smithi195.stdout:1/306: link da/f13 da/d3d/f6a 0 2024-08-18T22:41:37.820 INFO:tasks.workunit.client.1.smithi195.stdout:0/195: dwrite d0/dc/d11/f20 [0,4194304] 0 2024-08-18T22:41:37.820 INFO:tasks.workunit.client.0.smithi121.stdout:3/581: mkdir d1e/d1f/d25/d2e/d36/d5f/dd2 0 2024-08-18T22:41:37.821 INFO:tasks.workunit.client.1.smithi195.stdout:1/307: fsync da/d18/f42 0 2024-08-18T22:41:37.822 INFO:tasks.workunit.client.0.smithi121.stdout:8/603: creat d6/d1e/fd4 x:0 0 0 2024-08-18T22:41:37.825 INFO:tasks.workunit.client.1.smithi195.stdout:0/196: unlink d0/dc/c10 0 2024-08-18T22:41:37.825 INFO:tasks.workunit.client.0.smithi121.stdout:0/476: rename d1/d4/db/d18/d2e to d1/d4/da/d2f/da0 0 2024-08-18T22:41:37.827 INFO:tasks.workunit.client.1.smithi195.stdout:8/236: dread d1/d3/f6 [4194304,4194304] 0 2024-08-18T22:41:37.828 INFO:tasks.workunit.client.0.smithi121.stdout:3/582: mkdir d1e/d1f/d25/d67/d92/da0/dd3 0 2024-08-18T22:41:37.828 INFO:tasks.workunit.client.1.smithi195.stdout:3/244: mknod d7/da/df/d38/c55 0 2024-08-18T22:41:37.829 INFO:tasks.workunit.client.1.smithi195.stdout:9/183: symlink d1c/l3e 0 2024-08-18T22:41:37.829 INFO:tasks.workunit.client.0.smithi121.stdout:4/509: write d2/dc/d16/d22/f39 [1579273,63830] 0 2024-08-18T22:41:37.832 INFO:tasks.workunit.client.1.smithi195.stdout:8/237: creat d1/d4b/f57 x:0 0 0 2024-08-18T22:41:37.833 INFO:tasks.workunit.client.0.smithi121.stdout:8/604: creat d6/dd/d3b/da3/dca/d60/fd5 x:0 0 0 2024-08-18T22:41:37.835 INFO:tasks.workunit.client.0.smithi121.stdout:7/586: dread de/f16 [0,4194304] 0 2024-08-18T22:41:37.836 INFO:tasks.workunit.client.1.smithi195.stdout:9/184: unlink d1c/f28 0 2024-08-18T22:41:37.836 INFO:tasks.workunit.client.0.smithi121.stdout:5/421: dwrite d3/d5/d13/f3d [0,4194304] 0 2024-08-18T22:41:37.836 INFO:tasks.workunit.client.1.smithi195.stdout:0/197: mknod d0/c3b 0 2024-08-18T22:41:37.839 INFO:tasks.workunit.client.0.smithi121.stdout:8/605: readlink d6/dd/l89 0 2024-08-18T22:41:37.840 INFO:tasks.workunit.client.1.smithi195.stdout:9/185: write d1c/f2a [2654935,36715] 0 2024-08-18T22:41:37.840 INFO:tasks.workunit.client.0.smithi121.stdout:3/583: truncate d1e/d1f/d25/d58/f87 744799 0 2024-08-18T22:41:37.841 INFO:tasks.workunit.client.1.smithi195.stdout:0/198: rmdir d0/dc/d11/d23 39 2024-08-18T22:41:37.841 INFO:tasks.workunit.client.1.smithi195.stdout:9/186: chown d1c/l2d 0 1 2024-08-18T22:41:37.842 INFO:tasks.workunit.client.0.smithi121.stdout:5/422: rmdir d3/d5/d13/d19/d24/d32 39 2024-08-18T22:41:37.843 INFO:tasks.workunit.client.0.smithi121.stdout:7/587: readlink de/d2d/l97 0 2024-08-18T22:41:37.844 INFO:tasks.workunit.client.1.smithi195.stdout:8/238: getdents d1/d3/d1c/d49 0 2024-08-18T22:41:37.844 INFO:tasks.workunit.client.0.smithi121.stdout:4/510: getdents d2/dc/d16/d22/d2c/d44/da9/dae 0 2024-08-18T22:41:37.845 INFO:tasks.workunit.client.1.smithi195.stdout:0/199: truncate d0/dc/d25/f1e 81451 0 2024-08-18T22:41:37.846 INFO:tasks.workunit.client.0.smithi121.stdout:0/477: getdents d1/d4/db/d24/d30/d52/d90 0 2024-08-18T22:41:37.847 INFO:tasks.workunit.client.1.smithi195.stdout:3/245: write d7/f18 [1023117,74035] 0 2024-08-18T22:41:37.847 INFO:tasks.workunit.client.1.smithi195.stdout:9/187: mknod d1c/d32/d37/c3f 0 2024-08-18T22:41:37.848 INFO:tasks.workunit.client.1.smithi195.stdout:0/200: dread - d0/dc/f33 zero size 2024-08-18T22:41:37.849 INFO:tasks.workunit.client.0.smithi121.stdout:3/584: rename d1e/d1f/d2a/l80 to d1e/d1f/d25/d67/d92/da0/ld4 0 2024-08-18T22:41:37.850 INFO:tasks.workunit.client.1.smithi195.stdout:0/201: write d0/f1c [4278965,51266] 0 2024-08-18T22:41:37.850 INFO:tasks.workunit.client.1.smithi195.stdout:0/202: chown d0/dc/d25 2 1 2024-08-18T22:41:37.851 INFO:tasks.workunit.client.1.smithi195.stdout:0/203: write d0/f3 [2437632,14560] 0 2024-08-18T22:41:37.853 INFO:tasks.workunit.client.1.smithi195.stdout:9/188: rename d1c/d32/c34 to d1c/d32/c40 0 2024-08-18T22:41:37.853 INFO:tasks.workunit.client.1.smithi195.stdout:8/239: link d1/d3/db/d35/f47 d1/de/df/f58 0 2024-08-18T22:41:37.854 INFO:tasks.workunit.client.0.smithi121.stdout:4/511: read d2/f19 [498259,40965] 0 2024-08-18T22:41:37.854 INFO:tasks.workunit.client.0.smithi121.stdout:7/588: symlink de/d1a/d2f/d4b/daf/lb9 0 2024-08-18T22:41:37.855 INFO:tasks.workunit.client.0.smithi121.stdout:0/478: creat d1/d4/d53/d61/fa1 x:0 0 0 2024-08-18T22:41:37.855 INFO:tasks.workunit.client.0.smithi121.stdout:3/585: mknod d1e/d1f/d25/d6b/cd5 0 2024-08-18T22:41:37.857 INFO:tasks.workunit.client.1.smithi195.stdout:3/246: rename d7/da/df/f24 to d7/f56 0 2024-08-18T22:41:37.858 INFO:tasks.workunit.client.0.smithi121.stdout:4/512: mknod d2/dc/d16/cb6 0 2024-08-18T22:41:37.858 INFO:tasks.workunit.client.0.smithi121.stdout:5/423: dread d3/d5/f11 [0,4194304] 0 2024-08-18T22:41:37.858 INFO:tasks.workunit.client.0.smithi121.stdout:5/424: read - d3/f46 zero size 2024-08-18T22:41:37.860 INFO:tasks.workunit.client.0.smithi121.stdout:7/589: write de/d13/d18/d23/d24/d29/f74 [449879,59891] 0 2024-08-18T22:41:37.861 INFO:tasks.workunit.client.0.smithi121.stdout:8/606: rmdir d6/d1e/d2d/d78/d85/da6 0 2024-08-18T22:41:37.862 INFO:tasks.workunit.client.1.smithi195.stdout:8/240: creat d1/d3/db/d39/f59 x:0 0 0 2024-08-18T22:41:37.863 INFO:tasks.workunit.client.1.smithi195.stdout:3/247: symlink d7/d1f/d49/l57 0 2024-08-18T22:41:37.863 INFO:tasks.workunit.client.1.smithi195.stdout:1/308: dread da/d18/d28/f27 [0,4194304] 0 2024-08-18T22:41:37.864 INFO:tasks.workunit.client.0.smithi121.stdout:0/479: dread d1/d4/db/d24/f2b [0,4194304] 0 2024-08-18T22:41:37.864 INFO:tasks.workunit.client.0.smithi121.stdout:3/586: truncate d1e/d1f/d25/d2e/fbf 441722 0 2024-08-18T22:41:37.864 INFO:tasks.workunit.client.1.smithi195.stdout:0/204: dwrite d0/dc/d11/f27 [0,4194304] 0 2024-08-18T22:41:37.865 INFO:tasks.workunit.client.1.smithi195.stdout:9/189: dwrite f14 [8388608,4194304] 0 2024-08-18T22:41:37.865 INFO:tasks.workunit.client.0.smithi121.stdout:5/425: creat d3/d5/d13/d19/d75/f87 x:0 0 0 2024-08-18T22:41:37.866 INFO:tasks.workunit.client.1.smithi195.stdout:9/190: readlink lc 0 2024-08-18T22:41:37.867 INFO:tasks.workunit.client.1.smithi195.stdout:9/191: readlink lc 0 2024-08-18T22:41:37.867 INFO:tasks.workunit.client.1.smithi195.stdout:9/192: stat d1c/c25 0 2024-08-18T22:41:37.868 INFO:tasks.workunit.client.1.smithi195.stdout:3/248: fdatasync d7/f2b 0 2024-08-18T22:41:37.868 INFO:tasks.workunit.client.0.smithi121.stdout:8/607: write d6/f7c [179547,5804] 0 2024-08-18T22:41:37.871 INFO:tasks.workunit.client.1.smithi195.stdout:8/241: rename d1/d4b to d1/de/d31/d5a 0 2024-08-18T22:41:37.873 INFO:tasks.workunit.client.1.smithi195.stdout:0/205: creat d0/dc/dd/f3c x:0 0 0 2024-08-18T22:41:37.874 INFO:tasks.workunit.client.1.smithi195.stdout:3/249: dread d7/f10 [0,4194304] 0 2024-08-18T22:41:37.875 INFO:tasks.workunit.client.0.smithi121.stdout:0/480: dread d1/f99 [0,4194304] 0 2024-08-18T22:41:37.876 INFO:tasks.workunit.client.1.smithi195.stdout:3/250: stat d7/d1f/c3e 0 2024-08-18T22:41:37.877 INFO:tasks.workunit.client.1.smithi195.stdout:0/206: dread - d0/dc/d25/f1f zero size 2024-08-18T22:41:37.877 INFO:tasks.workunit.client.0.smithi121.stdout:7/590: rename de/d13/d18/d23/f3d to de/d1a/d34/d38/fba 0 2024-08-18T22:41:37.878 INFO:tasks.workunit.client.1.smithi195.stdout:1/309: dwrite da/d18/f47 [0,4194304] 0 2024-08-18T22:41:37.879 INFO:tasks.workunit.client.0.smithi121.stdout:4/513: dwrite d2/dc/d16/d22/d2c/d44/d66/f9b [0,4194304] 0 2024-08-18T22:41:37.879 INFO:tasks.workunit.client.1.smithi195.stdout:0/207: stat d0/dc/df/l14 0 2024-08-18T22:41:37.879 INFO:tasks.workunit.client.0.smithi121.stdout:7/591: dread - de/d2d/fa3 zero size 2024-08-18T22:41:37.880 INFO:tasks.workunit.client.0.smithi121.stdout:7/592: fsync fc 0 2024-08-18T22:41:37.883 INFO:tasks.workunit.client.0.smithi121.stdout:7/593: write de/d13/d18/d9d/fb0 [689955,45626] 0 2024-08-18T22:41:37.884 INFO:tasks.workunit.client.1.smithi195.stdout:8/242: mknod d1/c5b 0 2024-08-18T22:41:37.885 INFO:tasks.workunit.client.0.smithi121.stdout:0/481: creat d1/d4/db/d18/d1c/d5f/fa2 x:0 0 0 2024-08-18T22:41:37.886 INFO:tasks.workunit.client.0.smithi121.stdout:8/608: chown d6/dd/d3b/da3/dca/d60/d5b/f9a 0 1 2024-08-18T22:41:37.888 INFO:tasks.workunit.client.0.smithi121.stdout:4/514: mknod d2/dc/d16/d47/cb7 0 2024-08-18T22:41:37.889 INFO:tasks.workunit.client.0.smithi121.stdout:4/515: write d2/dc/d16/d59/fa8 [315199,24337] 0 2024-08-18T22:41:37.891 INFO:tasks.workunit.client.0.smithi121.stdout:0/482: mknod d1/d4/db/d18/d40/ca3 0 2024-08-18T22:41:37.892 INFO:tasks.workunit.client.0.smithi121.stdout:8/609: creat d6/d1e/d2d/d78/d45/d86/fd6 x:0 0 0 2024-08-18T22:41:37.893 INFO:tasks.workunit.client.0.smithi121.stdout:0/483: rename d1 to d1/d4/db/d18/d40/da4 22 2024-08-18T22:41:37.893 INFO:tasks.workunit.client.0.smithi121.stdout:3/587: getdents d1e/d1f/d3e 0 2024-08-18T22:41:37.894 INFO:tasks.workunit.client.1.smithi195.stdout:1/310: creat da/d18/d28/d31/d3b/d4e/f6b x:0 0 0 2024-08-18T22:41:37.895 INFO:tasks.workunit.client.0.smithi121.stdout:3/588: chown d1e/d1f/d25/d2e/d36/fac 16586225 1 2024-08-18T22:41:37.897 INFO:tasks.workunit.client.0.smithi121.stdout:3/589: write d1e/d1f/d3e/f6f [342720,123946] 0 2024-08-18T22:41:37.897 INFO:tasks.workunit.client.1.smithi195.stdout:8/243: mkdir d1/d3/db/d35/d4d/d5c 0 2024-08-18T22:41:37.898 INFO:tasks.workunit.client.0.smithi121.stdout:3/590: chown d1e/d1f/da6 2051 1 2024-08-18T22:41:37.899 INFO:tasks.workunit.client.1.smithi195.stdout:3/251: write d7/da/df/f27 [612984,75063] 0 2024-08-18T22:41:37.901 INFO:tasks.workunit.client.1.smithi195.stdout:1/311: symlink da/d4c/d5d/l6c 0 2024-08-18T22:41:37.902 INFO:tasks.workunit.client.0.smithi121.stdout:4/516: link d2/fb d2/dc/d16/d22/d2c/d44/d8c/fb8 0 2024-08-18T22:41:37.903 INFO:tasks.workunit.client.0.smithi121.stdout:0/484: mkdir d1/d4/db/d24/d30/d52/d5b/da5 0 2024-08-18T22:41:37.903 INFO:tasks.workunit.client.1.smithi195.stdout:8/244: creat d1/d3/db/f5d x:0 0 0 2024-08-18T22:41:37.903 INFO:tasks.workunit.client.0.smithi121.stdout:0/485: chown d1/d8a 15 1 2024-08-18T22:41:37.905 INFO:tasks.workunit.client.1.smithi195.stdout:1/312: mknod da/d18/d43/c6d 0 2024-08-18T22:41:37.906 INFO:tasks.workunit.client.1.smithi195.stdout:8/245: symlink d1/d3/d1c/d49/l5e 0 2024-08-18T22:41:37.907 INFO:tasks.workunit.client.0.smithi121.stdout:4/517: mknod d2/dc/d16/d22/d2c/d44/d8c/cb9 0 2024-08-18T22:41:37.908 INFO:tasks.workunit.client.1.smithi195.stdout:9/193: dwrite f15 [0,4194304] 0 2024-08-18T22:41:37.908 INFO:tasks.workunit.client.0.smithi121.stdout:3/591: creat d1e/d1f/d25/d6b/d83/fd6 x:0 0 0 2024-08-18T22:41:37.909 INFO:tasks.workunit.client.0.smithi121.stdout:5/426: truncate d3/d5/d27/d35/d67/f4b 111742 0 2024-08-18T22:41:37.909 INFO:tasks.workunit.client.1.smithi195.stdout:9/194: fsync f13 0 2024-08-18T22:41:37.910 INFO:tasks.workunit.client.0.smithi121.stdout:3/592: dread - d1e/f9c zero size 2024-08-18T22:41:37.910 INFO:tasks.workunit.client.1.smithi195.stdout:8/246: truncate d1/d3/db/f5d 960095 0 2024-08-18T22:41:37.912 INFO:tasks.workunit.client.0.smithi121.stdout:4/518: rename d2/dc/d16/d59/d83/ca6 to d2/dc/d1c/d62/d90/db3/cba 0 2024-08-18T22:41:37.912 INFO:tasks.workunit.client.1.smithi195.stdout:0/208: dread d0/f3 [0,4194304] 0 2024-08-18T22:41:37.913 INFO:tasks.workunit.client.0.smithi121.stdout:8/610: write d6/dd/d3b/da3/dca/f55 [154411,77761] 0 2024-08-18T22:41:37.913 INFO:tasks.workunit.client.0.smithi121.stdout:0/486: link d1/d4/db/c26 d1/d4/d53/d61/ca6 0 2024-08-18T22:41:37.914 INFO:tasks.workunit.client.0.smithi121.stdout:5/427: creat d3/d5/d13/d23/d66/f88 x:0 0 0 2024-08-18T22:41:37.914 INFO:tasks.workunit.client.1.smithi195.stdout:8/247: symlink d1/d3/d1c/l5f 0 2024-08-18T22:41:37.915 INFO:tasks.workunit.client.1.smithi195.stdout:9/195: symlink d1c/l41 0 2024-08-18T22:41:37.917 INFO:tasks.workunit.client.1.smithi195.stdout:1/313: dwrite da/d18/d28/d31/d3b/f3c [0,4194304] 0 2024-08-18T22:41:37.917 INFO:tasks.workunit.client.0.smithi121.stdout:5/428: write d3/d5/d13/d23/d66/f88 [124402,19331] 0 2024-08-18T22:41:37.917 INFO:tasks.workunit.client.0.smithi121.stdout:3/593: mknod d1e/d1f/dba/cd7 0 2024-08-18T22:41:37.918 INFO:tasks.workunit.client.0.smithi121.stdout:8/611: fdatasync d6/d1e/d2d/d78/d45/fa5 0 2024-08-18T22:41:37.919 INFO:tasks.workunit.client.1.smithi195.stdout:8/248: creat d1/de/d27/d4f/f60 x:0 0 0 2024-08-18T22:41:37.919 INFO:tasks.workunit.client.0.smithi121.stdout:8/612: readlink d6/l3c 0 2024-08-18T22:41:37.920 INFO:tasks.workunit.client.1.smithi195.stdout:0/209: chown d0/dc/d11/d23/c34 1059655651 1 2024-08-18T22:41:37.922 INFO:tasks.workunit.client.0.smithi121.stdout:5/429: unlink d3/d5/d13/f3d 0 2024-08-18T22:41:37.924 INFO:tasks.workunit.client.0.smithi121.stdout:3/594: creat d1e/d1f/d25/d67/fd8 x:0 0 0 2024-08-18T22:41:37.926 INFO:tasks.workunit.client.0.smithi121.stdout:8/613: fsync d6/fc9 0 2024-08-18T22:41:37.926 INFO:tasks.workunit.client.1.smithi195.stdout:9/196: dwrite d1c/f27 [0,4194304] 0 2024-08-18T22:41:37.926 INFO:tasks.workunit.client.0.smithi121.stdout:8/614: chown d6/dd/d25/d56/ca7 679925072 1 2024-08-18T22:41:37.927 INFO:tasks.workunit.client.1.smithi195.stdout:9/197: chown d1c/f3a 565 1 2024-08-18T22:41:37.928 INFO:tasks.workunit.client.0.smithi121.stdout:8/615: fsync d6/dd/d3b/f64 0 2024-08-18T22:41:37.929 INFO:tasks.workunit.client.1.smithi195.stdout:0/210: symlink d0/dc/d11/l3d 0 2024-08-18T22:41:37.929 INFO:tasks.workunit.client.0.smithi121.stdout:8/616: stat d6/dd/c13 0 2024-08-18T22:41:37.931 INFO:tasks.workunit.client.0.smithi121.stdout:3/595: mkdir d1e/d1f/d25/d6b/d66/dd9 0 2024-08-18T22:41:37.931 INFO:tasks.workunit.client.1.smithi195.stdout:8/249: creat d1/d3/db/d39/d2e/f61 x:0 0 0 2024-08-18T22:41:37.931 INFO:tasks.workunit.client.1.smithi195.stdout:1/314: link da/d18/d28/l22 da/d18/l6e 0 2024-08-18T22:41:37.932 INFO:tasks.workunit.client.1.smithi195.stdout:0/211: symlink d0/dc/d11/d30/l3e 0 2024-08-18T22:41:37.933 INFO:tasks.workunit.client.0.smithi121.stdout:5/430: symlink d3/d5/d13/d19/d24/d32/d38/d63/l89 0 2024-08-18T22:41:37.933 INFO:tasks.workunit.client.1.smithi195.stdout:0/212: stat d0/f1c 0 2024-08-18T22:41:37.933 INFO:tasks.workunit.client.0.smithi121.stdout:0/487: dread d1/d4/db/d18/f3a [0,4194304] 0 2024-08-18T22:41:37.934 INFO:tasks.workunit.client.1.smithi195.stdout:8/250: fdatasync d1/d3/db/d35/f47 0 2024-08-18T22:41:37.934 INFO:tasks.workunit.client.0.smithi121.stdout:8/617: mkdir d6/dd/d3b/da3/dca/d18/d99/da0/dd7 0 2024-08-18T22:41:37.936 INFO:tasks.workunit.client.0.smithi121.stdout:3/596: mkdir d1e/d1f/d5e/d9a/dda 0 2024-08-18T22:41:37.938 INFO:tasks.workunit.client.1.smithi195.stdout:8/251: rmdir d1/de/d31 39 2024-08-18T22:41:37.939 INFO:tasks.workunit.client.1.smithi195.stdout:9/198: getdents d1c/d32 0 2024-08-18T22:41:37.940 INFO:tasks.workunit.client.1.smithi195.stdout:8/252: creat d1/d3/d1c/d21/f62 x:0 0 0 2024-08-18T22:41:37.941 INFO:tasks.workunit.client.1.smithi195.stdout:8/253: stat d1/de 0 2024-08-18T22:41:37.942 INFO:tasks.workunit.client.0.smithi121.stdout:5/431: mknod d3/d5/d27/d35/d53/c8a 0 2024-08-18T22:41:37.942 INFO:tasks.workunit.client.0.smithi121.stdout:5/432: chown d3/d5/f62 6817 1 2024-08-18T22:41:37.942 INFO:tasks.workunit.client.1.smithi195.stdout:9/199: creat d1c/d32/d37/f42 x:0 0 0 2024-08-18T22:41:37.943 INFO:tasks.workunit.client.0.smithi121.stdout:8/618: symlink d6/d1e/d2d/d78/d85/ld8 0 2024-08-18T22:41:37.943 INFO:tasks.workunit.client.0.smithi121.stdout:5/433: write d3/d5/d27/f2e [4123527,115657] 0 2024-08-18T22:41:37.943 INFO:tasks.workunit.client.1.smithi195.stdout:8/254: mknod d1/de/d27/c63 0 2024-08-18T22:41:37.944 INFO:tasks.workunit.client.1.smithi195.stdout:8/255: dread - d1/d3/d1c/f52 zero size 2024-08-18T22:41:37.945 INFO:tasks.workunit.client.0.smithi121.stdout:5/434: readlink d3/d5/d13/d19/d24/d32/l33 0 2024-08-18T22:41:37.946 INFO:tasks.workunit.client.1.smithi195.stdout:9/200: getdents d1c/d32 0 2024-08-18T22:41:37.946 INFO:tasks.workunit.client.0.smithi121.stdout:3/597: unlink d1e/d1f/d5e/fce 0 2024-08-18T22:41:37.947 INFO:tasks.workunit.client.1.smithi195.stdout:8/256: mkdir d1/d64 0 2024-08-18T22:41:37.949 INFO:tasks.workunit.client.1.smithi195.stdout:9/201: rename f11 to d1c/d32/f43 0 2024-08-18T22:41:37.950 INFO:tasks.workunit.client.0.smithi121.stdout:0/488: rename d1/d4/db/d24/d30/d52/d6a to d1/d4/d53/da7 0 2024-08-18T22:41:37.951 INFO:tasks.workunit.client.1.smithi195.stdout:9/202: chown d1c/f1f 4 1 2024-08-18T22:41:37.951 INFO:tasks.workunit.client.1.smithi195.stdout:1/315: dread da/d18/d28/f2e [0,4194304] 0 2024-08-18T22:41:37.952 INFO:tasks.workunit.client.1.smithi195.stdout:8/257: creat d1/d3/d1c/f65 x:0 0 0 2024-08-18T22:41:37.954 INFO:tasks.workunit.client.0.smithi121.stdout:8/619: mkdir d6/d1e/d2d/d78/d45/dd9 0 2024-08-18T22:41:37.954 INFO:tasks.workunit.client.1.smithi195.stdout:1/316: creat da/d18/d28/d31/d3b/d4e/f6f x:0 0 0 2024-08-18T22:41:37.955 INFO:tasks.workunit.client.0.smithi121.stdout:8/620: stat d6/dd/d3b/da3/dca/d18/d99/da0/cbc 0 2024-08-18T22:41:37.955 INFO:tasks.workunit.client.0.smithi121.stdout:5/435: mkdir d3/d5/d27/d35/d58/d8b 0 2024-08-18T22:41:37.956 INFO:tasks.workunit.client.1.smithi195.stdout:8/258: creat d1/de/df/d1d/d1f/f66 x:0 0 0 2024-08-18T22:41:37.957 INFO:tasks.workunit.client.1.smithi195.stdout:1/317: mkdir da/d18/d28/d31/d3b/d70 0 2024-08-18T22:41:37.959 INFO:tasks.workunit.client.0.smithi121.stdout:0/489: rename d1/d4/d53/d61/fa1 to d1/d4/db/d24/d30/d52/fa8 0 2024-08-18T22:41:37.960 INFO:tasks.workunit.client.1.smithi195.stdout:1/318: fdatasync da/f24 0 2024-08-18T22:41:37.962 INFO:tasks.workunit.client.0.smithi121.stdout:3/598: mkdir d1e/d1f/d25/d2e/d36/ddb 0 2024-08-18T22:41:37.963 INFO:tasks.workunit.client.1.smithi195.stdout:4/182: sync 2024-08-18T22:41:37.965 INFO:tasks.workunit.client.0.smithi121.stdout:4/519: dwrite d2/d7c/fab [0,4194304] 0 2024-08-18T22:41:37.965 INFO:tasks.workunit.client.1.smithi195.stdout:8/259: dwrite d1/d3/db/d39/d2e/f61 [0,4194304] 0 2024-08-18T22:41:37.968 INFO:tasks.workunit.client.1.smithi195.stdout:4/183: symlink d0/d7/d1d/l3e 0 2024-08-18T22:41:37.968 INFO:tasks.workunit.client.1.smithi195.stdout:1/319: dread da/d18/d28/f27 [0,4194304] 0 2024-08-18T22:41:37.969 INFO:tasks.workunit.client.0.smithi121.stdout:3/599: read d1e/d1f/d25/d58/d75/fa9 [164596,102285] 0 2024-08-18T22:41:37.969 INFO:tasks.workunit.client.0.smithi121.stdout:8/621: dwrite d6/f8e [0,4194304] 0 2024-08-18T22:41:37.971 INFO:tasks.workunit.client.1.smithi195.stdout:8/260: mkdir d1/de/d67 0 2024-08-18T22:41:37.972 INFO:tasks.workunit.client.0.smithi121.stdout:4/520: mknod d2/dc/d1c/d62/d90/db3/cbb 0 2024-08-18T22:41:37.973 INFO:tasks.workunit.client.0.smithi121.stdout:5/436: dwrite d3/d5/d27/d35/f72 [0,4194304] 0 2024-08-18T22:41:37.974 INFO:tasks.workunit.client.1.smithi195.stdout:1/320: symlink da/d4c/l71 0 2024-08-18T22:41:37.979 INFO:tasks.workunit.client.0.smithi121.stdout:8/622: mkdir d6/dd/d25/dda 0 2024-08-18T22:41:37.979 INFO:tasks.workunit.client.1.smithi195.stdout:9/203: dread d1c/f1d [0,4194304] 0 2024-08-18T22:41:37.981 INFO:tasks.workunit.client.0.smithi121.stdout:4/521: symlink d2/dc/d16/d22/d2c/d7a/lbc 0 2024-08-18T22:41:37.982 INFO:tasks.workunit.client.0.smithi121.stdout:3/600: dwrite d1e/d1f/d25/d74/f49 [0,4194304] 0 2024-08-18T22:41:37.984 INFO:tasks.workunit.client.0.smithi121.stdout:8/623: write d6/d1e/d2d/d78/f58 [371407,52390] 0 2024-08-18T22:41:37.986 INFO:tasks.workunit.client.1.smithi195.stdout:9/204: truncate fb 960267 0 2024-08-18T22:41:37.986 INFO:tasks.workunit.client.1.smithi195.stdout:4/184: dwrite d0/d7/d1d/f3d [0,4194304] 0 2024-08-18T22:41:37.987 INFO:tasks.workunit.client.0.smithi121.stdout:3/601: creat d1e/d1f/d25/d6b/fdc x:0 0 0 2024-08-18T22:41:37.988 INFO:tasks.workunit.client.0.smithi121.stdout:4/522: truncate d2/dc/d16/d22/f3d 3705611 0 2024-08-18T22:41:37.990 INFO:tasks.workunit.client.0.smithi121.stdout:3/602: symlink d1e/d1f/d25/d6b/d83/ldd 0 2024-08-18T22:41:37.990 INFO:tasks.workunit.client.1.smithi195.stdout:9/205: unlink c12 0 2024-08-18T22:41:37.994 INFO:tasks.workunit.client.1.smithi195.stdout:9/206: fdatasync d1c/f1f 0 2024-08-18T22:41:37.995 INFO:tasks.workunit.client.1.smithi195.stdout:8/261: dwrite d1/de/f3b [4194304,4194304] 0 2024-08-18T22:41:37.995 INFO:tasks.workunit.client.1.smithi195.stdout:9/207: dread - d1c/f31 zero size 2024-08-18T22:41:37.995 INFO:tasks.workunit.client.0.smithi121.stdout:3/603: mknod d1e/d1f/d25/d6b/d81/cde 0 2024-08-18T22:41:37.995 INFO:tasks.workunit.client.0.smithi121.stdout:0/490: dread d1/d4/db/f7d [0,4194304] 0 2024-08-18T22:41:37.998 INFO:tasks.workunit.client.0.smithi121.stdout:4/523: dwrite d2/dc/d1c/f3c [0,4194304] 0 2024-08-18T22:41:37.999 INFO:tasks.workunit.client.1.smithi195.stdout:4/185: creat d0/d9/d11/d16/d37/f3f x:0 0 0 2024-08-18T22:41:38.003 INFO:tasks.workunit.client.0.smithi121.stdout:0/491: rename d1/d4/db/d18/d40/d83/f9e to d1/d8a/fa9 0 2024-08-18T22:41:38.005 INFO:tasks.workunit.client.1.smithi195.stdout:4/186: rename d0/d9/d11/d2c/f30 to d0/d9/d11/d2c/f40 0 2024-08-18T22:41:38.005 INFO:tasks.workunit.client.1.smithi195.stdout:8/262: dwrite d1/d3/db/fd [4194304,4194304] 0 2024-08-18T22:41:38.006 INFO:tasks.workunit.client.0.smithi121.stdout:3/604: dread d1e/d1f/d5e/f8a [0,4194304] 0 2024-08-18T22:41:38.006 INFO:tasks.workunit.client.0.smithi121.stdout:4/524: dwrite d2/dc/d16/d59/fa8 [0,4194304] 0 2024-08-18T22:41:38.007 INFO:tasks.workunit.client.1.smithi195.stdout:8/263: write d1/d3/d1c/f65 [220559,100587] 0 2024-08-18T22:41:38.013 INFO:tasks.workunit.client.1.smithi195.stdout:4/187: mkdir d0/d9/d41 0 2024-08-18T22:41:38.015 INFO:tasks.workunit.client.1.smithi195.stdout:8/264: rename d1/d3/db/d39/c2c to d1/d3/db/d35/d56/c68 0 2024-08-18T22:41:38.016 INFO:tasks.workunit.client.0.smithi121.stdout:0/492: dwrite d1/d8a/fa9 [0,4194304] 0 2024-08-18T22:41:38.017 INFO:tasks.workunit.client.1.smithi195.stdout:4/188: creat d0/d9/d11/d16/f42 x:0 0 0 2024-08-18T22:41:38.018 INFO:tasks.workunit.client.1.smithi195.stdout:8/265: creat d1/d3/d1c/f69 x:0 0 0 2024-08-18T22:41:38.020 INFO:tasks.workunit.client.0.smithi121.stdout:0/493: write d1/d4/db/d18/f2d [4482925,46057] 0 2024-08-18T22:41:38.021 INFO:tasks.workunit.client.1.smithi195.stdout:9/208: dread d1c/f21 [0,4194304] 0 2024-08-18T22:41:38.022 INFO:tasks.workunit.client.1.smithi195.stdout:9/209: fdatasync f17 0 2024-08-18T22:41:38.022 INFO:tasks.workunit.client.1.smithi195.stdout:4/189: creat d0/d9/d11/d16/d37/f43 x:0 0 0 2024-08-18T22:41:38.023 INFO:tasks.workunit.client.1.smithi195.stdout:8/266: mkdir d1/d3/d1c/d6a 0 2024-08-18T22:41:38.023 INFO:tasks.workunit.client.0.smithi121.stdout:0/494: read d1/d4/db/d18/f23 [3262272,111643] 0 2024-08-18T22:41:38.024 INFO:tasks.workunit.client.0.smithi121.stdout:4/525: dwrite d2/dc/d16/d59/f8e [0,4194304] 0 2024-08-18T22:41:38.025 INFO:tasks.workunit.client.1.smithi195.stdout:8/267: write d1/de/f54 [119920,29318] 0 2024-08-18T22:41:38.026 INFO:tasks.workunit.client.1.smithi195.stdout:9/210: readlink l18 0 2024-08-18T22:41:38.026 INFO:tasks.workunit.client.1.smithi195.stdout:8/268: chown d1/d3/d1c/d49/d55 111324 1 2024-08-18T22:41:38.028 INFO:tasks.workunit.client.1.smithi195.stdout:8/269: fdatasync d1/de/df/d1d/f3e 0 2024-08-18T22:41:38.030 INFO:tasks.workunit.client.1.smithi195.stdout:4/190: getdents d0/d7 0 2024-08-18T22:41:38.031 INFO:tasks.workunit.client.1.smithi195.stdout:4/191: chown d0/d7/l19 2581 1 2024-08-18T22:41:38.032 INFO:tasks.workunit.client.1.smithi195.stdout:8/270: creat d1/d3/db/d39/d44/f6b x:0 0 0 2024-08-18T22:41:38.034 INFO:tasks.workunit.client.1.smithi195.stdout:8/271: write d1/f2a [2585382,68094] 0 2024-08-18T22:41:38.035 INFO:tasks.workunit.client.1.smithi195.stdout:9/211: creat d1c/f44 x:0 0 0 2024-08-18T22:41:38.038 INFO:tasks.workunit.client.1.smithi195.stdout:8/272: symlink d1/de/d31/d5a/l6c 0 2024-08-18T22:41:38.039 INFO:tasks.workunit.client.1.smithi195.stdout:4/192: dwrite d0/d7/d1d/f31 [0,4194304] 0 2024-08-18T22:41:38.040 INFO:tasks.workunit.client.1.smithi195.stdout:9/212: creat d1c/f45 x:0 0 0 2024-08-18T22:41:38.041 INFO:tasks.workunit.client.1.smithi195.stdout:9/213: chown d1c/f45 407716864 1 2024-08-18T22:41:38.041 INFO:tasks.workunit.client.0.smithi121.stdout:2/393: sync 2024-08-18T22:41:38.042 INFO:tasks.workunit.client.1.smithi195.stdout:8/273: write d1/de/d27/f29 [547533,39070] 0 2024-08-18T22:41:38.044 INFO:tasks.workunit.client.1.smithi195.stdout:9/214: write d1c/f39 [157029,97032] 0 2024-08-18T22:41:38.044 INFO:tasks.workunit.client.0.smithi121.stdout:0/495: dwrite d1/d4/db/d24/d30/d6c/f51 [0,4194304] 0 2024-08-18T22:41:38.045 INFO:tasks.workunit.client.1.smithi195.stdout:9/215: readlink d1c/l41 0 2024-08-18T22:41:38.046 INFO:tasks.workunit.client.0.smithi121.stdout:5/437: dwrite d3/d5/d27/d35/d67/f29 [0,4194304] 0 2024-08-18T22:41:38.049 INFO:tasks.workunit.client.0.smithi121.stdout:2/394: fsync d2/d8/d19/dc/f2d 0 2024-08-18T22:41:38.049 INFO:tasks.workunit.client.1.smithi195.stdout:8/274: dread d1/de/df/d1d/f32 [0,4194304] 0 2024-08-18T22:41:38.050 INFO:tasks.workunit.client.0.smithi121.stdout:2/395: fdatasync d2/d8/d19/f13 0 2024-08-18T22:41:38.051 INFO:tasks.workunit.client.0.smithi121.stdout:0/496: mknod d1/d4/db/d18/d1c/caa 0 2024-08-18T22:41:38.052 INFO:tasks.workunit.client.0.smithi121.stdout:0/497: readlink d1/d4/db/d18/l84 0 2024-08-18T22:41:38.053 INFO:tasks.workunit.client.1.smithi195.stdout:9/216: dwrite d1c/f26 [0,4194304] 0 2024-08-18T22:41:38.057 INFO:tasks.workunit.client.1.smithi195.stdout:9/217: dread d1c/f22 [0,4194304] 0 2024-08-18T22:41:38.057 INFO:tasks.workunit.client.0.smithi121.stdout:0/498: fsync d1/d4/da/d2f/da0/f3d 0 2024-08-18T22:41:38.061 INFO:tasks.workunit.client.0.smithi121.stdout:4/526: truncate d2/dc/f5e 3662904 0 2024-08-18T22:41:38.061 INFO:tasks.workunit.client.0.smithi121.stdout:2/396: mkdir d2/d3/d84 0 2024-08-18T22:41:38.062 INFO:tasks.workunit.client.0.smithi121.stdout:2/397: fdatasync d2/d8/d19/f24 0 2024-08-18T22:41:38.064 INFO:tasks.workunit.client.0.smithi121.stdout:0/499: rmdir d1/d4/d53/da7 39 2024-08-18T22:41:38.066 INFO:tasks.workunit.client.0.smithi121.stdout:2/398: symlink d2/d3/d51/l85 0 2024-08-18T22:41:38.069 INFO:tasks.workunit.client.0.smithi121.stdout:2/399: rmdir d2/d8 39 2024-08-18T22:41:38.071 INFO:tasks.workunit.client.0.smithi121.stdout:4/527: dwrite d2/dc/d16/d22/d2c/d7a/fa3 [0,4194304] 0 2024-08-18T22:41:38.074 INFO:tasks.workunit.client.0.smithi121.stdout:2/400: read d2/d8/d1f/f35 [860565,21972] 0 2024-08-18T22:41:38.075 INFO:tasks.workunit.client.1.smithi195.stdout:4/193: link d0/f33 d0/d9/f44 0 2024-08-18T22:41:38.077 INFO:tasks.workunit.client.1.smithi195.stdout:4/194: chown d0/d9/d11/d16/d37/f43 2 1 2024-08-18T22:41:38.077 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:41:37 smithi121 ceph-mon[16788]: pgmap v244: 65 pgs: 65 active+clean; 878 MiB data, 4.2 GiB used, 532 GiB / 536 GiB avail; 7.1 MiB/s rd, 103 MiB/s wr, 322 op/s 2024-08-18T22:41:38.077 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:41:37 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:41:38.078 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:41:37 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:41:38.078 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:41:37 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:41:38.078 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:41:37 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-18T22:41:38.078 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:41:37 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:41:38.078 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:41:37 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-18T22:41:38.078 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:41:37 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "mgr fail", "who": "smithi121.lopxqc"}]: dispatch 2024-08-18T22:41:38.078 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:41:37 smithi121 ceph-mon[16788]: Activating manager daemon smithi195.acttsj 2024-08-18T22:41:38.078 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:41:37 smithi121 ceph-mon[16788]: osdmap e48: 6 total, 6 up, 6 in 2024-08-18T22:41:38.078 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:41:37 smithi121 ceph-mon[16788]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd='[{"prefix": "mgr fail", "who": "smithi121.lopxqc"}]': finished 2024-08-18T22:41:38.078 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:41:37 smithi121 ceph-mon[16788]: mgrmap e21: smithi195.acttsj(active, starting, since 0.0359215s) 2024-08-18T22:41:38.078 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:41:37 smithi121 ceph-mon[16788]: from='mgr.24377 172.21.15.195:0/2331273060' entity='mgr.smithi195.acttsj' cmd=[{"prefix": "mon metadata", "id": "smithi121"}]: dispatch 2024-08-18T22:41:38.078 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:41:37 smithi121 ceph-mon[16788]: from='mgr.24377 172.21.15.195:0/2331273060' entity='mgr.smithi195.acttsj' cmd=[{"prefix": "mon metadata", "id": "smithi195"}]: dispatch 2024-08-18T22:41:38.079 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:41:37 smithi121 ceph-mon[16788]: from='mgr.24377 172.21.15.195:0/2331273060' entity='mgr.smithi195.acttsj' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi121.gbickb"}]: dispatch 2024-08-18T22:41:38.079 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:41:37 smithi121 ceph-mon[16788]: from='mgr.24377 172.21.15.195:0/2331273060' entity='mgr.smithi195.acttsj' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi121.xuzsdg"}]: dispatch 2024-08-18T22:41:38.079 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:41:37 smithi121 ceph-mon[16788]: from='mgr.24377 172.21.15.195:0/2331273060' entity='mgr.smithi195.acttsj' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi195.buqvbr"}]: dispatch 2024-08-18T22:41:38.079 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:41:37 smithi121 ceph-mon[16788]: from='mgr.24377 172.21.15.195:0/2331273060' entity='mgr.smithi195.acttsj' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi195.nptgyc"}]: dispatch 2024-08-18T22:41:38.079 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:41:37 smithi121 ceph-mon[16788]: from='mgr.24377 172.21.15.195:0/2331273060' entity='mgr.smithi195.acttsj' cmd=[{"prefix": "mgr metadata", "who": "smithi195.acttsj", "id": "smithi195.acttsj"}]: dispatch 2024-08-18T22:41:38.079 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:41:37 smithi121 ceph-mon[16788]: from='mgr.24377 172.21.15.195:0/2331273060' entity='mgr.smithi195.acttsj' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-08-18T22:41:38.079 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:41:37 smithi121 ceph-mon[16788]: from='mgr.24377 172.21.15.195:0/2331273060' entity='mgr.smithi195.acttsj' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-08-18T22:41:38.079 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:41:37 smithi121 ceph-mon[16788]: from='mgr.24377 172.21.15.195:0/2331273060' entity='mgr.smithi195.acttsj' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-08-18T22:41:38.079 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:41:37 smithi121 ceph-mon[16788]: from='mgr.24377 172.21.15.195:0/2331273060' entity='mgr.smithi195.acttsj' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-08-18T22:41:38.079 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:41:37 smithi121 ceph-mon[16788]: from='mgr.24377 172.21.15.195:0/2331273060' entity='mgr.smithi195.acttsj' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-08-18T22:41:38.079 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:41:37 smithi121 ceph-mon[16788]: from='mgr.24377 172.21.15.195:0/2331273060' entity='mgr.smithi195.acttsj' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-08-18T22:41:38.079 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:41:37 smithi121 ceph-mon[16788]: from='mgr.24377 172.21.15.195:0/2331273060' entity='mgr.smithi195.acttsj' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-08-18T22:41:38.079 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:41:37 smithi121 ceph-mon[16788]: from='mgr.24377 172.21.15.195:0/2331273060' entity='mgr.smithi195.acttsj' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-08-18T22:41:38.079 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:41:37 smithi121 ceph-mon[16788]: from='mgr.24377 172.21.15.195:0/2331273060' entity='mgr.smithi195.acttsj' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-08-18T22:41:38.080 INFO:tasks.workunit.client.0.smithi121.stdout:2/401: fsync d2/f54 0 2024-08-18T22:41:38.080 INFO:tasks.workunit.client.1.smithi195.stdout:9/218: write d1c/f21 [1738921,78016] 0 2024-08-18T22:41:38.081 INFO:tasks.workunit.client.0.smithi121.stdout:2/402: stat d2/d8/d19/f7b 0 2024-08-18T22:41:38.082 INFO:tasks.workunit.client.0.smithi121.stdout:4/528: creat d2/dc/d16/d22/fbd x:0 0 0 2024-08-18T22:41:38.083 INFO:tasks.workunit.client.1.smithi195.stdout:4/195: creat d0/d9/d11/d2c/f45 x:0 0 0 2024-08-18T22:41:38.087 INFO:tasks.workunit.client.0.smithi121.stdout:4/529: link d2/dc/d16/d22/d2c/d44/l54 d2/dc/d16/d22/d2c/d44/da9/lbe 0 2024-08-18T22:41:38.088 INFO:tasks.workunit.client.1.smithi195.stdout:9/219: dwrite d1c/f39 [0,4194304] 0 2024-08-18T22:41:38.090 INFO:tasks.workunit.client.1.smithi195.stdout:4/196: dread d0/d9/d11/f3a [0,4194304] 0 2024-08-18T22:41:38.090 INFO:tasks.workunit.client.0.smithi121.stdout:4/530: getdents d2/dc/d16/d22/d2c/d7a 0 2024-08-18T22:41:38.091 INFO:tasks.workunit.client.1.smithi195.stdout:4/197: chown d0/f8 361 1 2024-08-18T22:41:38.091 INFO:tasks.workunit.client.0.smithi121.stdout:4/531: readlink d2/dc/d16/d22/d2c/d44/l5a 0 2024-08-18T22:41:38.091 INFO:tasks.workunit.client.0.smithi121.stdout:4/532: chown d2/dc/d16/d59/d83 24007 1 2024-08-18T22:41:38.096 INFO:tasks.workunit.client.0.smithi121.stdout:4/533: getdents d2/dc/d16/d59/d83 0 2024-08-18T22:41:38.097 INFO:tasks.workunit.client.0.smithi121.stdout:4/534: read - d2/dc/d16/d22/f55 zero size 2024-08-18T22:41:38.100 INFO:tasks.workunit.client.0.smithi121.stdout:4/535: unlink d2/dc/d16/f75 0 2024-08-18T22:41:38.101 INFO:tasks.workunit.client.0.smithi121.stdout:4/536: write d2/f14 [784921,114233] 0 2024-08-18T22:41:38.105 INFO:tasks.workunit.client.0.smithi121.stdout:4/537: mkdir d2/dc/d16/d22/d2c/d7a/dbf 0 2024-08-18T22:41:38.105 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:38.104+0000 7fa3d9944640 1 -- 172.21.15.121:0/1520682360 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa3d40fe500 msgr2=0x7fa3d40fe910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:41:38.105 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:38.104+0000 7fa3d9944640 1 --2- 172.21.15.121:0/1520682360 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa3d40fe500 0x7fa3d40fe910 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fa3c40048d0 tx=0x7fa3c4009da0 comp rx=0 tx=0).stop 2024-08-18T22:41:38.105 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:38.104+0000 7fa3d9944640 1 -- 172.21.15.121:0/1520682360 shutdown_connections 2024-08-18T22:41:38.105 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:38.104+0000 7fa3d9944640 1 --2- 172.21.15.121:0/1520682360 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa3d40ff7d0 0x7fa3d40ffc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:41:38.106 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:38.104+0000 7fa3d9944640 1 --2- 172.21.15.121:0/1520682360 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa3d40fe500 0x7fa3d40fe910 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:41:38.106 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:38.104+0000 7fa3d9944640 1 -- 172.21.15.121:0/1520682360 >> 172.21.15.121:0/1520682360 conn(0x7fa3d40f9e00 msgr2=0x7fa3d40fc1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:41:38.106 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:38.104+0000 7fa3d9944640 1 -- 172.21.15.121:0/1520682360 shutdown_connections 2024-08-18T22:41:38.106 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:38.104+0000 7fa3d9944640 1 -- 172.21.15.121:0/1520682360 wait complete. 2024-08-18T22:41:38.106 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:38.105+0000 7fa3d9944640 1 Processor -- start 2024-08-18T22:41:38.106 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:38.105+0000 7fa3d9944640 1 -- start start 2024-08-18T22:41:38.107 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:38.106+0000 7fa3d9944640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa3d40fe500 0x7fa3d410f010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:41:38.107 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:38.106+0000 7fa3d9944640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa3d40ff7d0 0x7fa3d410f550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:41:38.108 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:38.106+0000 7fa3d9944640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3d410fba0 con 0x7fa3d40fe500 2024-08-18T22:41:38.108 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:38.106+0000 7fa3d9944640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3d41103c0 con 0x7fa3d40ff7d0 2024-08-18T22:41:38.108 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:38.106+0000 7fa3d27fc640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa3d40ff7d0 0x7fa3d410f550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:41:38.108 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:38.106+0000 7fa3d27fc640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa3d40ff7d0 0x7fa3d410f550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.121:34970/0 (socket says 172.21.15.121:34970) 2024-08-18T22:41:38.108 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:38.106+0000 7fa3d27fc640 1 -- 172.21.15.121:0/633220465 learned_addr learned my addr 172.21.15.121:0/633220465 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-18T22:41:38.108 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:38.106+0000 7fa3d2ffd640 1 --2- 172.21.15.121:0/633220465 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa3d40fe500 0x7fa3d410f010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:41:38.109 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:38.107+0000 7fa3d27fc640 1 -- 172.21.15.121:0/633220465 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa3d40fe500 msgr2=0x7fa3d410f010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:41:38.109 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:38.107+0000 7fa3d27fc640 1 --2- 172.21.15.121:0/633220465 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa3d40fe500 0x7fa3d410f010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:41:38.109 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:38.107+0000 7fa3d27fc640 1 -- 172.21.15.121:0/633220465 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3c4005040 con 0x7fa3d40ff7d0 2024-08-18T22:41:38.109 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:38.107+0000 7fa3d2ffd640 1 --2- 172.21.15.121:0/633220465 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa3d40fe500 0x7fa3d410f010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:41:38.109 INFO:tasks.workunit.client.0.smithi121.stdout:4/538: mknod d2/dc/d16/d22/d2c/d44/cc0 0 2024-08-18T22:41:38.110 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:38.108+0000 7fa3d27fc640 1 --2- 172.21.15.121:0/633220465 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa3d40ff7d0 0x7fa3d410f550 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fa3c800eb70 tx=0x7fa3c800b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:41:38.110 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:38.108+0000 7fa3bb7fe640 1 -- 172.21.15.121:0/633220465 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa3c8007c30 con 0x7fa3d40ff7d0 2024-08-18T22:41:38.110 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:38.108+0000 7fa3bb7fe640 1 -- 172.21.15.121:0/633220465 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fa3c800f040 con 0x7fa3d40ff7d0 2024-08-18T22:41:38.110 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:38.108+0000 7fa3bb7fe640 1 -- 172.21.15.121:0/633220465 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa3c80094e0 con 0x7fa3d40ff7d0 2024-08-18T22:41:38.110 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:38.108+0000 7fa3d9944640 1 -- 172.21.15.121:0/633220465 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3d41105f0 con 0x7fa3d40ff7d0 2024-08-18T22:41:38.111 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:38.108+0000 7fa3d9944640 1 -- 172.21.15.121:0/633220465 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3d4110ad0 con 0x7fa3d40ff7d0 2024-08-18T22:41:38.111 INFO:tasks.workunit.client.1.smithi195.stdout:9/220: write fb [1706172,130781] 0 2024-08-18T22:41:38.112 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:38.110+0000 7fa3bb7fe640 1 -- 172.21.15.121:0/633220465 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 21) v1 ==== 45818+0+0 (secure 0 0 0) 0x7fa3c80096a0 con 0x7fa3d40ff7d0 2024-08-18T22:41:38.112 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:38.110+0000 7fa3d9944640 1 -- 172.21.15.121:0/633220465 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3d40fd960 con 0x7fa3d40ff7d0 2024-08-18T22:41:38.112 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:38.110+0000 7fa3bb7fe640 1 -- 172.21.15.121:0/633220465 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5808+0+0 (secure 0 0 0) 0x7fa3c804c030 con 0x7fa3d40ff7d0 2024-08-18T22:41:38.112 INFO:tasks.workunit.client.0.smithi121.stdout:4/539: write d2/dc/d1c/f6a [2381212,105005] 0 2024-08-18T22:41:38.114 INFO:tasks.workunit.client.0.smithi121.stdout:4/540: mkdir d2/dc/d1c/dc1 0 2024-08-18T22:41:38.116 INFO:tasks.workunit.client.0.smithi121.stdout:4/541: rmdir d2/dc/d1c/daa 39 2024-08-18T22:41:38.118 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:38.117+0000 7fa3bb7fe640 1 -- 172.21.15.121:0/633220465 <== mon.1 v2:172.21.15.195:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fa3c8019020 con 0x7fa3d40ff7d0 2024-08-18T22:41:38.119 INFO:tasks.workunit.client.0.smithi121.stdout:4/542: symlink d2/dc/d1c/dc1/lc2 0 2024-08-18T22:41:38.127 INFO:tasks.workunit.client.0.smithi121.stdout:2/403: dread d2/d8/d19/f52 [0,4194304] 0 2024-08-18T22:41:38.128 INFO:tasks.workunit.client.0.smithi121.stdout:2/404: chown d2/d3/l2b 230 1 2024-08-18T22:41:38.130 INFO:tasks.workunit.client.0.smithi121.stdout:2/405: symlink d2/l86 0 2024-08-18T22:41:38.130 INFO:tasks.workunit.client.0.smithi121.stdout:2/406: dread - d2/d3/d48/f4e zero size 2024-08-18T22:41:38.132 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:41:37 smithi195 ceph-mon[23370]: pgmap v244: 65 pgs: 65 active+clean; 878 MiB data, 4.2 GiB used, 532 GiB / 536 GiB avail; 7.1 MiB/s rd, 103 MiB/s wr, 322 op/s 2024-08-18T22:41:38.132 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:41:37 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:41:38.132 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:41:37 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:41:38.132 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:41:37 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:41:38.132 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:41:37 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-18T22:41:38.132 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:41:37 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' 2024-08-18T22:41:38.132 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:41:37 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-18T22:41:38.132 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:41:37 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "mgr fail", "who": "smithi121.lopxqc"}]: dispatch 2024-08-18T22:41:38.132 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:41:37 smithi195 ceph-mon[23370]: Activating manager daemon smithi195.acttsj 2024-08-18T22:41:38.132 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:41:37 smithi195 ceph-mon[23370]: osdmap e48: 6 total, 6 up, 6 in 2024-08-18T22:41:38.133 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:41:37 smithi195 ceph-mon[23370]: from='mgr.14206 172.21.15.121:0/2201960761' entity='mgr.smithi121.lopxqc' cmd='[{"prefix": "mgr fail", "who": "smithi121.lopxqc"}]': finished 2024-08-18T22:41:38.133 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:41:37 smithi195 ceph-mon[23370]: mgrmap e21: smithi195.acttsj(active, starting, since 0.0359215s) 2024-08-18T22:41:38.133 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:41:37 smithi195 ceph-mon[23370]: from='mgr.24377 172.21.15.195:0/2331273060' entity='mgr.smithi195.acttsj' cmd=[{"prefix": "mon metadata", "id": "smithi121"}]: dispatch 2024-08-18T22:41:38.133 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:41:37 smithi195 ceph-mon[23370]: from='mgr.24377 172.21.15.195:0/2331273060' entity='mgr.smithi195.acttsj' cmd=[{"prefix": "mon metadata", "id": "smithi195"}]: dispatch 2024-08-18T22:41:38.133 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:41:37 smithi195 ceph-mon[23370]: from='mgr.24377 172.21.15.195:0/2331273060' entity='mgr.smithi195.acttsj' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi121.gbickb"}]: dispatch 2024-08-18T22:41:38.133 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:41:37 smithi195 ceph-mon[23370]: from='mgr.24377 172.21.15.195:0/2331273060' entity='mgr.smithi195.acttsj' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi121.xuzsdg"}]: dispatch 2024-08-18T22:41:38.133 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:41:37 smithi195 ceph-mon[23370]: from='mgr.24377 172.21.15.195:0/2331273060' entity='mgr.smithi195.acttsj' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi195.buqvbr"}]: dispatch 2024-08-18T22:41:38.133 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:41:37 smithi195 ceph-mon[23370]: from='mgr.24377 172.21.15.195:0/2331273060' entity='mgr.smithi195.acttsj' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi195.nptgyc"}]: dispatch 2024-08-18T22:41:38.133 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:41:37 smithi195 ceph-mon[23370]: from='mgr.24377 172.21.15.195:0/2331273060' entity='mgr.smithi195.acttsj' cmd=[{"prefix": "mgr metadata", "who": "smithi195.acttsj", "id": "smithi195.acttsj"}]: dispatch 2024-08-18T22:41:38.133 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:41:37 smithi195 ceph-mon[23370]: from='mgr.24377 172.21.15.195:0/2331273060' entity='mgr.smithi195.acttsj' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-08-18T22:41:38.133 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:41:37 smithi195 ceph-mon[23370]: from='mgr.24377 172.21.15.195:0/2331273060' entity='mgr.smithi195.acttsj' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-08-18T22:41:38.133 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:41:37 smithi195 ceph-mon[23370]: from='mgr.24377 172.21.15.195:0/2331273060' entity='mgr.smithi195.acttsj' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-08-18T22:41:38.133 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:41:37 smithi195 ceph-mon[23370]: from='mgr.24377 172.21.15.195:0/2331273060' entity='mgr.smithi195.acttsj' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-08-18T22:41:38.134 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:41:37 smithi195 ceph-mon[23370]: from='mgr.24377 172.21.15.195:0/2331273060' entity='mgr.smithi195.acttsj' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-08-18T22:41:38.134 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:41:37 smithi195 ceph-mon[23370]: from='mgr.24377 172.21.15.195:0/2331273060' entity='mgr.smithi195.acttsj' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-08-18T22:41:38.134 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:41:37 smithi195 ceph-mon[23370]: from='mgr.24377 172.21.15.195:0/2331273060' entity='mgr.smithi195.acttsj' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-08-18T22:41:38.134 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:41:37 smithi195 ceph-mon[23370]: from='mgr.24377 172.21.15.195:0/2331273060' entity='mgr.smithi195.acttsj' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-08-18T22:41:38.134 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:41:37 smithi195 ceph-mon[23370]: from='mgr.24377 172.21.15.195:0/2331273060' entity='mgr.smithi195.acttsj' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-08-18T22:41:38.140 INFO:tasks.workunit.client.0.smithi121.stdout:2/407: dwrite d2/d8/d1f/f35 [0,4194304] 0 2024-08-18T22:41:38.144 INFO:tasks.workunit.client.0.smithi121.stdout:2/408: symlink d2/d8/d19/dc/d67/l87 0 2024-08-18T22:41:38.151 INFO:tasks.workunit.client.0.smithi121.stdout:2/409: dwrite d2/d3/d48/d77/f6d [0,4194304] 0 2024-08-18T22:41:38.153 INFO:tasks.workunit.client.0.smithi121.stdout:2/410: mknod d2/d3/d48/c88 0 2024-08-18T22:41:38.156 INFO:tasks.workunit.client.0.smithi121.stdout:2/411: write d2/d8/f39 [1029816,124616] 0 2024-08-18T22:41:38.158 INFO:tasks.workunit.client.0.smithi121.stdout:2/412: chown d2/l21 1 1 2024-08-18T22:41:38.183 INFO:tasks.workunit.client.0.smithi121.stdout:2/413: dwrite d2/d8/d1f/f76 [0,4194304] 0 2024-08-18T22:41:38.188 INFO:tasks.workunit.client.0.smithi121.stdout:1/530: sync 2024-08-18T22:41:38.188 INFO:tasks.workunit.client.0.smithi121.stdout:9/655: sync 2024-08-18T22:41:38.192 INFO:tasks.workunit.client.0.smithi121.stdout:2/414: link d2/d3/d51/l85 d2/d3/d84/l89 0 2024-08-18T22:41:38.198 INFO:tasks.workunit.client.0.smithi121.stdout:9/656: dread d0/d5/dd/d3f/f75 [0,4194304] 0 2024-08-18T22:41:38.200 INFO:tasks.workunit.client.0.smithi121.stdout:1/531: dwrite d5/f1f [0,4194304] 0 2024-08-18T22:41:38.207 INFO:tasks.workunit.client.0.smithi121.stdout:1/532: dwrite d5/d10/d14/d2a/f8d [0,4194304] 0 2024-08-18T22:41:38.212 INFO:tasks.workunit.client.0.smithi121.stdout:9/657: creat d0/d38/d44/dbf/d60/fd8 x:0 0 0 2024-08-18T22:41:38.215 INFO:tasks.workunit.client.0.smithi121.stdout:1/533: unlink d5/d10/d14/d2a/d3a/d87/d6c/d6f/d82/d11/f74 0 2024-08-18T22:41:38.216 INFO:tasks.workunit.client.0.smithi121.stdout:9/658: symlink d0/d38/d52/d5f/ld9 0 2024-08-18T22:41:38.217 INFO:tasks.workunit.client.0.smithi121.stdout:1/534: symlink d5/d10/d14/d2a/d3a/d87/lb5 0 2024-08-18T22:41:38.218 INFO:tasks.workunit.client.0.smithi121.stdout:1/535: dread - d5/d10/d14/d34/fa2 zero size 2024-08-18T22:41:38.222 INFO:tasks.workunit.client.0.smithi121.stdout:1/536: creat d5/d10/d14/d2a/d3a/d87/d6c/d6f/d82/d15/d38/fb6 x:0 0 0 2024-08-18T22:41:38.225 INFO:tasks.workunit.client.0.smithi121.stdout:1/537: rename d5/d10/d14/d2a/l8a to d5/d10/d14/d92/d9f/lb7 0 2024-08-18T22:41:38.226 INFO:tasks.workunit.client.0.smithi121.stdout:1/538: read - d5/d10/d14/d2a/d3a/f7a zero size 2024-08-18T22:41:38.227 INFO:tasks.workunit.client.0.smithi121.stdout:1/539: dread - d5/d10/d14/d2a/d3a/d87/d6c/d6f/d82/d15/d38/d8e/f96 zero size 2024-08-18T22:41:38.229 INFO:tasks.workunit.client.0.smithi121.stdout:1/540: mknod d5/cb8 0 2024-08-18T22:41:38.230 INFO:tasks.workunit.client.0.smithi121.stdout:1/541: creat d5/d10/d14/d2a/d3a/d87/d6c/d6f/d79/fb9 x:0 0 0 2024-08-18T22:41:38.233 INFO:tasks.workunit.client.0.smithi121.stdout:1/542: creat d5/d10/d14/fba x:0 0 0 2024-08-18T22:41:38.245 INFO:tasks.workunit.client.0.smithi121.stdout:1/543: dwrite d5/d10/d14/f45 [0,4194304] 0 2024-08-18T22:41:38.249 INFO:tasks.workunit.client.0.smithi121.stdout:1/544: link d5/d10/d14/d2a/d3a/d87/d6c/d6f/d79/dab/l81 d5/d10/d14/d2a/d91/lbb 0 2024-08-18T22:41:38.250 INFO:tasks.workunit.client.1.smithi195.stdout:4/198: dwrite d0/d9/d11/f18 [0,4194304] 0 2024-08-18T22:41:38.250 INFO:tasks.workunit.client.0.smithi121.stdout:1/545: write d5/d10/d14/d2a/d3a/d87/d6c/d6f/d82/f51 [3991912,52039] 0 2024-08-18T22:41:38.254 INFO:tasks.workunit.client.1.smithi195.stdout:4/199: creat d0/d9/d11/d2c/f46 x:0 0 0 2024-08-18T22:41:38.254 INFO:tasks.workunit.client.1.smithi195.stdout:9/221: dwrite d1c/f27 [0,4194304] 0 2024-08-18T22:41:38.256 INFO:tasks.workunit.client.1.smithi195.stdout:9/222: write d1c/f45 [958585,15898] 0 2024-08-18T22:41:38.257 INFO:tasks.workunit.client.1.smithi195.stdout:9/223: write f0 [8418257,125458] 0 2024-08-18T22:41:38.257 INFO:tasks.workunit.client.1.smithi195.stdout:9/224: readlink l8 0 2024-08-18T22:41:38.259 INFO:tasks.workunit.client.1.smithi195.stdout:4/200: creat d0/d7/d1d/f47 x:0 0 0 2024-08-18T22:41:38.261 INFO:tasks.workunit.client.1.smithi195.stdout:9/225: unlink l8 0 2024-08-18T22:41:38.268 INFO:tasks.workunit.client.1.smithi195.stdout:9/226: dwrite f14 [8388608,4194304] 0 2024-08-18T22:41:38.271 INFO:tasks.workunit.client.1.smithi195.stdout:4/201: mkdir d0/d9/d11/d16/d37/d48 0 2024-08-18T22:41:38.271 INFO:tasks.workunit.client.1.smithi195.stdout:4/202: write d0/d9/d11/f18 [2494013,16303] 0 2024-08-18T22:41:38.277 INFO:tasks.workunit.client.1.smithi195.stdout:9/227: creat d1c/d32/f46 x:0 0 0 2024-08-18T22:41:38.285 INFO:tasks.workunit.client.1.smithi195.stdout:9/228: dwrite d1c/f2c [0,4194304] 0 2024-08-18T22:41:38.287 INFO:tasks.workunit.client.0.smithi121.stdout:1/546: write d5/d10/d14/d2a/d3a/d87/d6c/d6f/d82/d15/f52 [2259249,2264] 0 2024-08-18T22:41:38.293 INFO:tasks.workunit.client.0.smithi121.stdout:1/547: rename d5/d10/d14/d2a/d3a/d87/d6c/d6f/d82/d15/f52 to d5/d10/d14/d2a/d3a/d87/d6c/d6f/d82/d15/d28/d3d/d9a/fbc 0 2024-08-18T22:41:38.295 INFO:tasks.workunit.client.0.smithi121.stdout:1/548: write d5/d10/d14/d2a/d3a/d87/d6c/d6f/d82/d15/d38/d8e/f96 [172523,32188] 0 2024-08-18T22:41:38.297 INFO:tasks.workunit.client.1.smithi195.stdout:9/229: creat d1c/f47 x:0 0 0 2024-08-18T22:41:38.298 INFO:tasks.workunit.client.1.smithi195.stdout:4/203: rename d0/d9/d11/d2c to d0/d9/d11/d16/d49 0 2024-08-18T22:41:38.299 INFO:tasks.workunit.client.1.smithi195.stdout:6/114: sync 2024-08-18T22:41:38.299 INFO:tasks.workunit.client.1.smithi195.stdout:4/204: fsync d0/d9/d11/f18 0 2024-08-18T22:41:38.300 INFO:tasks.workunit.client.0.smithi121.stdout:1/549: mkdir d5/d10/d14/d2a/d3a/d87/d6c/d6f/d82/d15/d28/d3d/dbd 0 2024-08-18T22:41:38.304 INFO:tasks.workunit.client.0.smithi121.stdout:1/550: rename d5/d10/d14/d34/f9c to d5/d10/d14/d2a/d3a/fbe 0 2024-08-18T22:41:38.304 INFO:tasks.workunit.client.1.smithi195.stdout:9/230: symlink d1c/l48 0 2024-08-18T22:41:38.306 INFO:tasks.workunit.client.0.smithi121.stdout:1/551: rmdir d5/d10/d14/d2a/d3a/d87/d6c/d6f/d82/d15/d28/d3d 39 2024-08-18T22:41:38.307 INFO:tasks.workunit.client.0.smithi121.stdout:1/552: chown d5/d10/d14/d2a/d3a/d87/d6c 19 1 2024-08-18T22:41:38.309 INFO:tasks.workunit.client.0.smithi121.stdout:1/553: symlink d5/d10/d14/d92/lbf 0 2024-08-18T22:41:38.309 INFO:tasks.workunit.client.1.smithi195.stdout:9/231: rename d1c/f22 to d1c/d32/f49 0 2024-08-18T22:41:38.311 INFO:tasks.workunit.client.1.smithi195.stdout:4/205: creat d0/f4a x:0 0 0 2024-08-18T22:41:38.312 INFO:tasks.workunit.client.1.smithi195.stdout:4/206: write d0/f22 [423652,45019] 0 2024-08-18T22:41:38.312 INFO:tasks.workunit.client.0.smithi121.stdout:1/554: truncate d5/d10/d14/d2a/d3a/d87/d6c/d6f/d82/d15/d38/fb6 1015957 0 2024-08-18T22:41:38.313 INFO:tasks.workunit.client.0.smithi121.stdout:1/555: write d5/d10/d14/d34/f98 [59796,5087] 0 2024-08-18T22:41:38.315 INFO:tasks.workunit.client.0.smithi121.stdout:1/556: write d5/d10/d14/d2a/d3a/d87/d6c/d6f/d79/dab/f84 [482987,125759] 0 2024-08-18T22:41:38.315 INFO:tasks.workunit.client.1.smithi195.stdout:6/115: write f5 [14023,94512] 0 2024-08-18T22:41:38.316 INFO:tasks.workunit.client.1.smithi195.stdout:4/207: dread d0/d9/d11/f18 [0,4194304] 0 2024-08-18T22:41:38.316 INFO:tasks.workunit.client.0.smithi121.stdout:1/557: write d5/d10/d14/f4b [4740667,70343] 0 2024-08-18T22:41:38.317 INFO:tasks.workunit.client.1.smithi195.stdout:9/232: mknod d1c/d32/d37/c4a 0 2024-08-18T22:41:38.319 INFO:tasks.workunit.client.1.smithi195.stdout:6/116: fsync da/f13 0 2024-08-18T22:41:38.319 INFO:tasks.workunit.client.0.smithi121.stdout:1/558: symlink d5/d10/d14/d92/d9f/lc0 0 2024-08-18T22:41:38.321 INFO:tasks.workunit.client.1.smithi195.stdout:6/117: read - da/db/d19/f1d zero size 2024-08-18T22:41:38.322 INFO:tasks.workunit.client.1.smithi195.stdout:6/118: write da/db/f21 [787817,38192] 0 2024-08-18T22:41:38.323 INFO:tasks.workunit.client.0.smithi121.stdout:1/559: getdents d5/d10/d14/d2a 0 2024-08-18T22:41:38.324 INFO:tasks.workunit.client.1.smithi195.stdout:4/208: dread d0/d9/d11/f18 [0,4194304] 0 2024-08-18T22:41:38.326 INFO:tasks.workunit.client.1.smithi195.stdout:4/209: chown d0/d9/l32 42196997 1 2024-08-18T22:41:38.326 INFO:tasks.workunit.client.1.smithi195.stdout:4/210: chown d0/d7/d1d/c2b 5 1 2024-08-18T22:41:38.328 INFO:tasks.workunit.client.1.smithi195.stdout:4/211: rmdir d0/d9/d11/d16 39 2024-08-18T22:41:38.330 INFO:tasks.workunit.client.1.smithi195.stdout:9/233: getdents d1c/d32 0 2024-08-18T22:41:38.334 INFO:tasks.workunit.client.0.smithi121.stdout:1/560: dwrite d5/f1d [0,4194304] 0 2024-08-18T22:41:38.337 INFO:tasks.workunit.client.1.smithi195.stdout:6/119: dwrite da/db/f17 [0,4194304] 0 2024-08-18T22:41:38.340 INFO:tasks.workunit.client.1.smithi195.stdout:6/120: mkdir da/db/d26 0 2024-08-18T22:41:38.344 INFO:tasks.workunit.client.1.smithi195.stdout:6/121: stat da/d15/d1c 0 2024-08-18T22:41:38.346 INFO:tasks.workunit.client.1.smithi195.stdout:6/122: creat da/db/d19/f27 x:0 0 0 2024-08-18T22:41:38.356 INFO:tasks.workunit.client.1.smithi195.stdout:9/234: dread d1c/f3c [0,4194304] 0 2024-08-18T22:41:38.361 INFO:tasks.workunit.client.1.smithi195.stdout:6/123: dwrite da/fd [0,4194304] 0 2024-08-18T22:41:38.367 INFO:tasks.workunit.client.1.smithi195.stdout:9/235: dwrite f3 [0,4194304] 0 2024-08-18T22:41:38.368 INFO:tasks.workunit.client.1.smithi195.stdout:9/236: chown d1c/f47 106495 1 2024-08-18T22:41:38.378 INFO:tasks.workunit.client.1.smithi195.stdout:9/237: dwrite d1c/f33 [0,4194304] 0 2024-08-18T22:41:38.379 INFO:tasks.workunit.client.1.smithi195.stdout:6/124: dread da/db/f21 [0,4194304] 0 2024-08-18T22:41:38.382 INFO:tasks.workunit.client.1.smithi195.stdout:9/238: rmdir d1c 39 2024-08-18T22:41:38.386 INFO:tasks.workunit.client.1.smithi195.stdout:6/125: dwrite da/db/d19/f1d [0,4194304] 0 2024-08-18T22:41:38.389 INFO:tasks.workunit.client.1.smithi195.stdout:6/126: chown da/db/cf 245028 1 2024-08-18T22:41:38.392 INFO:tasks.workunit.client.1.smithi195.stdout:9/239: dread d1c/f2c [0,4194304] 0 2024-08-18T22:41:38.393 INFO:tasks.workunit.client.1.smithi195.stdout:9/240: write d1c/f45 [1638348,59196] 0 2024-08-18T22:41:38.397 INFO:tasks.workunit.client.0.smithi121.stdout:7/594: sync 2024-08-18T22:41:38.398 INFO:tasks.workunit.client.0.smithi121.stdout:7/595: chown de/d2d/l67 2269803 1 2024-08-18T22:41:38.400 INFO:tasks.workunit.client.1.smithi195.stdout:9/241: dwrite f0 [0,4194304] 0 2024-08-18T22:41:38.401 INFO:tasks.workunit.client.0.smithi121.stdout:1/561: truncate d5/d10/d14/d34/fae 529947 0 2024-08-18T22:41:38.401 INFO:tasks.workunit.client.1.smithi195.stdout:9/242: write d1c/f1d [844276,102355] 0 2024-08-18T22:41:38.403 INFO:tasks.workunit.client.1.smithi195.stdout:9/243: read d1c/f1d [2483001,13572] 0 2024-08-18T22:41:38.404 INFO:tasks.workunit.client.1.smithi195.stdout:9/244: truncate f17 1796747 0 2024-08-18T22:41:38.405 INFO:tasks.workunit.client.0.smithi121.stdout:1/562: mkdir d5/d10/d67/da7/dc1 0 2024-08-18T22:41:38.408 INFO:tasks.workunit.client.1.smithi195.stdout:6/127: fsync da/db/d19/f1d 0 2024-08-18T22:41:38.409 INFO:tasks.workunit.client.1.smithi195.stdout:6/128: stat da/d15/d1c/l14 0 2024-08-18T22:41:38.411 INFO:tasks.workunit.client.1.smithi195.stdout:6/129: dread - da/db/d19/f27 zero size 2024-08-18T22:41:38.411 INFO:tasks.workunit.client.1.smithi195.stdout:9/245: dwrite f3 [0,4194304] 0 2024-08-18T22:41:38.412 INFO:tasks.workunit.client.0.smithi121.stdout:1/563: truncate d5/d10/d14/d2a/d3a/d87/d6c/d6f/d82/d15/d28/d3d/d9a/fbc 4660923 0 2024-08-18T22:41:38.414 INFO:tasks.workunit.client.0.smithi121.stdout:1/564: write d5/d10/d14/d2a/d3a/d87/d6c/d6f/d82/d15/d38/fb6 [1509974,98887] 0 2024-08-18T22:41:38.417 INFO:tasks.workunit.client.1.smithi195.stdout:9/246: mkdir d1c/d32/d37/d4b 0 2024-08-18T22:41:38.417 INFO:tasks.workunit.client.0.smithi121.stdout:1/565: mkdir d5/d10/d67/dc2 0 2024-08-18T22:41:38.420 INFO:tasks.workunit.client.1.smithi195.stdout:9/247: fsync d1c/f3a 0 2024-08-18T22:41:38.421 INFO:tasks.workunit.client.0.smithi121.stdout:7/596: dread de/d1a/d2f/d36/f54 [0,4194304] 0 2024-08-18T22:41:38.421 INFO:tasks.workunit.client.1.smithi195.stdout:6/130: dwrite da/db/f17 [0,4194304] 0 2024-08-18T22:41:38.423 INFO:tasks.workunit.client.1.smithi195.stdout:9/248: dread - d1c/f1f zero size 2024-08-18T22:41:38.424 INFO:tasks.workunit.client.1.smithi195.stdout:9/249: chown d1c/f26 50928 1 2024-08-18T22:41:38.425 INFO:tasks.workunit.client.0.smithi121.stdout:7/597: write de/d1a/d34/d38/d5f/f94 [3701757,106679] 0 2024-08-18T22:41:38.426 INFO:tasks.workunit.client.0.smithi121.stdout:1/566: dwrite d5/d10/d14/d2a/d3a/d87/d6c/d6f/d82/d15/d38/f72 [0,4194304] 0 2024-08-18T22:41:38.429 INFO:tasks.workunit.client.0.smithi121.stdout:7/598: fdatasync f8 0 2024-08-18T22:41:38.431 INFO:tasks.workunit.client.1.smithi195.stdout:6/131: rename da/fd to da/d15/d1c/f28 0 2024-08-18T22:41:38.437 INFO:tasks.workunit.client.1.smithi195.stdout:6/132: dread da/d15/d1c/f28 [0,4194304] 0 2024-08-18T22:41:38.437 INFO:tasks.workunit.client.0.smithi121.stdout:7/599: unlink de/d13/d18/c69 0 2024-08-18T22:41:38.438 INFO:tasks.workunit.client.1.smithi195.stdout:6/133: read - da/db/d19/f27 zero size 2024-08-18T22:41:38.438 INFO:tasks.workunit.client.0.smithi121.stdout:1/567: dwrite d5/d10/d14/d2a/daf/fb1 [0,4194304] 0 2024-08-18T22:41:38.440 INFO:tasks.workunit.client.1.smithi195.stdout:9/250: truncate fb 1489960 0 2024-08-18T22:41:38.441 INFO:tasks.workunit.client.0.smithi121.stdout:1/568: rmdir d5/d10/d14/d2a/d3a/d87/d6c/d6f/d79 39 2024-08-18T22:41:38.442 INFO:tasks.workunit.client.1.smithi195.stdout:9/251: readlink l5 0 2024-08-18T22:41:38.444 INFO:tasks.workunit.client.0.smithi121.stdout:7/600: getdents de/d2d 0 2024-08-18T22:41:38.445 INFO:tasks.workunit.client.0.smithi121.stdout:7/601: rmdir de/d13 39 2024-08-18T22:41:38.448 INFO:tasks.workunit.client.0.smithi121.stdout:7/602: fdatasync de/d13/d18/f60 0 2024-08-18T22:41:38.448 INFO:tasks.workunit.client.0.smithi121.stdout:1/569: link d5/d10/d14/d2a/d3a/d87/d6c/d6f/d82/l19 d5/d10/d14/d92/lc3 0 2024-08-18T22:41:38.449 INFO:tasks.workunit.client.1.smithi195.stdout:6/134: dwrite da/db/d19/f23 [0,4194304] 0 2024-08-18T22:41:38.449 INFO:tasks.workunit.client.1.smithi195.stdout:9/252: mknod d1c/d32/d37/d4b/c4c 0 2024-08-18T22:41:38.450 INFO:tasks.workunit.client.1.smithi195.stdout:9/253: fsync f16 0 2024-08-18T22:41:38.451 INFO:tasks.workunit.client.0.smithi121.stdout:1/570: fsync d5/d10/d14/d2a/d3a/d87/d6c/d6f/d82/d11/f6a 0 2024-08-18T22:41:38.455 INFO:tasks.workunit.client.0.smithi121.stdout:7/603: rename de/d13/d18/d9d to de/d1a/d34/d38/d73/dbb 0 2024-08-18T22:41:38.457 INFO:tasks.workunit.client.1.smithi195.stdout:9/254: dread d1c/f3c [0,4194304] 0 2024-08-18T22:41:38.459 INFO:tasks.workunit.client.0.smithi121.stdout:7/604: unlink de/d13/d18/d23/d24/d29/f74 0 2024-08-18T22:41:38.459 INFO:tasks.workunit.client.1.smithi195.stdout:9/255: rmdir d1c/d32/d37 39 2024-08-18T22:41:38.463 INFO:tasks.workunit.client.0.smithi121.stdout:7/605: creat de/d1a/d63/fbc x:0 0 0 2024-08-18T22:41:38.464 INFO:tasks.workunit.client.0.smithi121.stdout:7/606: read - de/d1a/d63/fbc zero size 2024-08-18T22:41:38.465 INFO:tasks.workunit.client.1.smithi195.stdout:9/256: dwrite d1c/f2a [0,4194304] 0 2024-08-18T22:41:38.465 INFO:tasks.workunit.client.1.smithi195.stdout:6/135: write da/d15/d1c/f12 [719545,86921] 0 2024-08-18T22:41:38.466 INFO:tasks.workunit.client.1.smithi195.stdout:9/257: write d1c/f21 [2662535,45945] 0 2024-08-18T22:41:38.467 INFO:tasks.workunit.client.0.smithi121.stdout:1/571: rename d5/d10/d14/d34/fad to d5/d10/d14/d2a/d3a/d87/d6c/d6f/fc4 0 2024-08-18T22:41:38.467 INFO:tasks.workunit.client.1.smithi195.stdout:6/136: stat da/db/cf 0 2024-08-18T22:41:38.470 INFO:tasks.workunit.client.0.smithi121.stdout:7/607: creat de/d1a/d34/d38/d73/fbd x:0 0 0 2024-08-18T22:41:38.471 INFO:tasks.workunit.client.0.smithi121.stdout:7/608: readlink de/d13/d18/d23/l45 0 2024-08-18T22:41:38.473 INFO:tasks.workunit.client.1.smithi195.stdout:9/258: chown d1c/d32/d37/c3f 1885239913 1 2024-08-18T22:41:38.474 INFO:tasks.workunit.client.0.smithi121.stdout:7/609: creat de/d13/d18/d23/fbe x:0 0 0 2024-08-18T22:41:38.476 INFO:tasks.workunit.client.1.smithi195.stdout:5/151: sync 2024-08-18T22:41:38.476 INFO:tasks.workunit.client.1.smithi195.stdout:6/137: dwrite da/db/f17 [0,4194304] 0 2024-08-18T22:41:38.478 INFO:tasks.workunit.client.0.smithi121.stdout:7/610: rename de/d1a/d2f/d4b/d6d/db3 to de/d1a/d2f/dbf 0 2024-08-18T22:41:38.479 INFO:tasks.workunit.client.0.smithi121.stdout:7/611: write de/d1a/f61 [718866,27252] 0 2024-08-18T22:41:38.480 INFO:tasks.workunit.client.1.smithi195.stdout:9/259: link f15 d1c/d32/d37/f4d 0 2024-08-18T22:41:38.482 INFO:tasks.workunit.client.0.smithi121.stdout:7/612: symlink de/d1a/d34/d38/d73/da2/lc0 0 2024-08-18T22:41:38.484 INFO:tasks.workunit.client.0.smithi121.stdout:7/613: symlink de/d65/lc1 0 2024-08-18T22:41:38.484 INFO:tasks.workunit.client.1.smithi195.stdout:6/138: getdents da/d15 0 2024-08-18T22:41:38.486 INFO:tasks.workunit.client.1.smithi195.stdout:9/260: creat d1c/f4e x:0 0 0 2024-08-18T22:41:38.487 INFO:tasks.workunit.client.0.smithi121.stdout:7/614: creat de/d13/d18/d23/d24/d85/fc2 x:0 0 0 2024-08-18T22:41:38.492 INFO:tasks.workunit.client.0.smithi121.stdout:1/572: dread d5/d10/d14/d34/f63 [0,4194304] 0 2024-08-18T22:41:38.493 INFO:tasks.workunit.client.0.smithi121.stdout:1/573: chown d5/d10 31 1 2024-08-18T22:41:38.494 INFO:tasks.workunit.client.0.smithi121.stdout:1/574: write d5/d10/d14/d2a/d3a/f7a [475966,114961] 0 2024-08-18T22:41:38.495 INFO:tasks.workunit.client.1.smithi195.stdout:5/152: dread d0/d3/d8/f13 [0,4194304] 0 2024-08-18T22:41:38.496 INFO:tasks.workunit.client.1.smithi195.stdout:6/139: truncate da/d15/d1c/f12 2996786 0 2024-08-18T22:41:38.496 INFO:tasks.workunit.client.1.smithi195.stdout:5/153: chown d0/d2 22653 1 2024-08-18T22:41:38.497 INFO:tasks.workunit.client.1.smithi195.stdout:9/261: truncate d1c/f23 258842 0 2024-08-18T22:41:38.499 INFO:tasks.workunit.client.1.smithi195.stdout:5/154: write d0/d3/df/d1a/f24 [368968,13493] 0 2024-08-18T22:41:38.499 INFO:tasks.workunit.client.0.smithi121.stdout:1/575: symlink d5/d10/d14/d2a/d3a/d87/d6c/d6f/d82/d15/d28/d3d/d9a/dac/lc5 0 2024-08-18T22:41:38.500 INFO:tasks.workunit.client.1.smithi195.stdout:9/262: mknod d1c/d32/d37/d4b/c4f 0 2024-08-18T22:41:38.501 INFO:tasks.workunit.client.0.smithi121.stdout:1/576: chown d5/f3c 356761 1 2024-08-18T22:41:38.504 INFO:tasks.workunit.client.0.smithi121.stdout:7/615: symlink de/d1a/d2f/d4b/daf/lc3 0 2024-08-18T22:41:38.505 INFO:tasks.workunit.client.1.smithi195.stdout:9/263: dread f13 [0,4194304] 0 2024-08-18T22:41:38.510 INFO:tasks.workunit.client.1.smithi195.stdout:6/140: truncate da/d15/d1c/f12 2106729 0 2024-08-18T22:41:38.511 INFO:tasks.workunit.client.1.smithi195.stdout:6/141: write da/db/f17 [424504,24438] 0 2024-08-18T22:41:38.512 INFO:tasks.workunit.client.0.smithi121.stdout:1/577: truncate d5/d10/f88 259450 0 2024-08-18T22:41:38.512 INFO:tasks.workunit.client.0.smithi121.stdout:7/616: dwrite de/f15 [0,4194304] 0 2024-08-18T22:41:38.514 INFO:tasks.workunit.client.1.smithi195.stdout:6/142: mknod da/db/d19/c29 0 2024-08-18T22:41:38.514 INFO:tasks.workunit.client.0.smithi121.stdout:7/617: fdatasync de/d13/d18/d23/d24/d25/f55 0 2024-08-18T22:41:38.515 INFO:tasks.workunit.client.1.smithi195.stdout:6/143: readlink da/d15/d1c/l14 0 2024-08-18T22:41:38.516 INFO:tasks.workunit.client.0.smithi121.stdout:7/618: fsync de/d13/d18/d23/f7d 0 2024-08-18T22:41:38.517 INFO:tasks.workunit.client.1.smithi195.stdout:6/144: mkdir da/db/d2a 0 2024-08-18T22:41:38.517 INFO:tasks.workunit.client.1.smithi195.stdout:9/264: dwrite d1c/d32/f49 [0,4194304] 0 2024-08-18T22:41:38.520 INFO:tasks.workunit.client.0.smithi121.stdout:1/578: link d5/d10/d14/f45 d5/d10/d14/d2a/d3a/d87/d6c/d6f/d82/d11/fc6 0 2024-08-18T22:41:38.520 INFO:tasks.workunit.client.1.smithi195.stdout:9/265: creat d1c/d32/f50 x:0 0 0 2024-08-18T22:41:38.522 INFO:tasks.workunit.client.0.smithi121.stdout:7/619: rename de/d1a/d63/fbc to de/d13/da0/fc4 0 2024-08-18T22:41:38.522 INFO:tasks.workunit.client.0.smithi121.stdout:1/579: truncate d5/d10/d14/d2a/d3a/f4d 1025649 0 2024-08-18T22:41:38.523 INFO:tasks.workunit.client.1.smithi195.stdout:9/266: creat d1c/d32/f51 x:0 0 0 2024-08-18T22:41:38.526 INFO:tasks.workunit.client.1.smithi195.stdout:9/267: creat d1c/d32/f52 x:0 0 0 2024-08-18T22:41:38.527 INFO:tasks.workunit.client.0.smithi121.stdout:1/580: write d5/d10/d14/d2a/d3a/d87/d6c/d6f/d79/dab/f75 [29332,115776] 0 2024-08-18T22:41:38.527 INFO:tasks.workunit.client.1.smithi195.stdout:9/268: dread - d1c/d32/d37/f42 zero size 2024-08-18T22:41:38.532 INFO:tasks.workunit.client.0.smithi121.stdout:7/620: dwrite de/d1a/d63/f6b [8388608,4194304] 0 2024-08-18T22:41:38.535 INFO:tasks.workunit.client.0.smithi121.stdout:1/581: creat d5/d10/d14/d34/fc7 x:0 0 0 2024-08-18T22:41:38.537 INFO:tasks.workunit.client.0.smithi121.stdout:1/582: stat d5/d10/d14/d2a/d3a/d87/d6c/d6f/d82/d15/d28/d3d/l99 0 2024-08-18T22:41:38.538 INFO:tasks.workunit.client.0.smithi121.stdout:7/621: symlink de/d1a/d20/lc5 0 2024-08-18T22:41:38.539 INFO:tasks.workunit.client.1.smithi195.stdout:6/145: truncate da/d15/d1c/f28 3015330 0 2024-08-18T22:41:38.539 INFO:tasks.workunit.client.1.smithi195.stdout:9/269: dread d1c/f23 [0,4194304] 0 2024-08-18T22:41:38.540 INFO:tasks.workunit.client.1.smithi195.stdout:9/270: fdatasync d1c/f21 0 2024-08-18T22:41:38.540 INFO:tasks.workunit.client.0.smithi121.stdout:1/583: write d5/d10/d14/d2a/d3a/d87/d6c/d6f/d82/d15/f9e [50800,6417] 0 2024-08-18T22:41:38.541 INFO:tasks.workunit.client.1.smithi195.stdout:9/271: fdatasync f16 0 2024-08-18T22:41:38.542 INFO:tasks.workunit.client.0.smithi121.stdout:7/622: mknod de/d1a/d2f/dbf/cc6 0 2024-08-18T22:41:38.544 INFO:tasks.workunit.client.1.smithi195.stdout:9/272: mknod d1c/d32/d37/d4b/c53 0 2024-08-18T22:41:38.546 INFO:tasks.workunit.client.0.smithi121.stdout:1/584: symlink d5/d10/d14/d2a/d3a/d87/d6c/d6f/d82/d15/d28/lc8 0 2024-08-18T22:41:38.547 INFO:tasks.workunit.client.1.smithi195.stdout:6/146: dwrite da/db/f17 [0,4194304] 0 2024-08-18T22:41:38.548 INFO:tasks.workunit.client.0.smithi121.stdout:1/585: write d5/d10/d14/d34/fa2 [22867,129867] 0 2024-08-18T22:41:38.549 INFO:tasks.workunit.client.0.smithi121.stdout:7/623: rename de/f7c to de/d1a/d2f/fc7 0 2024-08-18T22:41:38.549 INFO:tasks.workunit.client.1.smithi195.stdout:6/147: chown f5 44 1 2024-08-18T22:41:38.552 INFO:tasks.workunit.client.0.smithi121.stdout:1/586: write d5/d10/d14/d2a/d3a/d87/d6c/d6f/d82/d15/f5b [1275465,25343] 0 2024-08-18T22:41:38.554 INFO:tasks.workunit.client.1.smithi195.stdout:6/148: write da/db/d19/f1d [1054950,39668] 0 2024-08-18T22:41:38.555 INFO:tasks.workunit.client.1.smithi195.stdout:6/149: dread - da/f13 zero size 2024-08-18T22:41:38.556 INFO:tasks.workunit.client.1.smithi195.stdout:9/273: dwrite d1c/d32/f51 [0,4194304] 0 2024-08-18T22:41:38.559 INFO:tasks.workunit.client.0.smithi121.stdout:7/624: link de/d1a/c99 de/d1a/d2f/dbf/cc8 0 2024-08-18T22:41:38.561 INFO:tasks.workunit.client.1.smithi195.stdout:6/150: rename da/db/cf to da/db/d2a/c2b 0 2024-08-18T22:41:38.562 INFO:tasks.workunit.client.1.smithi195.stdout:9/274: dread d1c/f3c [0,4194304] 0 2024-08-18T22:41:38.565 INFO:tasks.workunit.client.0.smithi121.stdout:7/625: dread de/d1a/f61 [0,4194304] 0 2024-08-18T22:41:38.567 INFO:tasks.workunit.client.0.smithi121.stdout:7/626: write de/d2d/fa3 [788118,5965] 0 2024-08-18T22:41:38.567 INFO:tasks.workunit.client.1.smithi195.stdout:9/275: dread d1c/f39 [0,4194304] 0 2024-08-18T22:41:38.568 INFO:tasks.workunit.client.1.smithi195.stdout:6/151: dread da/db/f17 [0,4194304] 0 2024-08-18T22:41:38.569 INFO:tasks.workunit.client.0.smithi121.stdout:7/627: getdents de/d1a 0 2024-08-18T22:41:38.570 INFO:tasks.workunit.client.1.smithi195.stdout:6/152: creat da/d15/f2c x:0 0 0 2024-08-18T22:41:38.570 INFO:tasks.workunit.client.1.smithi195.stdout:9/276: write d1c/f1f [560731,97094] 0 2024-08-18T22:41:38.572 INFO:tasks.workunit.client.1.smithi195.stdout:9/277: creat d1c/d32/d37/f54 x:0 0 0 2024-08-18T22:41:38.575 INFO:tasks.workunit.client.1.smithi195.stdout:9/278: rename d1c/l2e to d1c/d32/d37/d4b/l55 0 2024-08-18T22:41:38.590 INFO:tasks.workunit.client.0.smithi121.stdout:8/624: sync 2024-08-18T22:41:38.591 INFO:tasks.workunit.client.0.smithi121.stdout:8/625: read - d6/d20/d69/f9b zero size 2024-08-18T22:41:38.593 INFO:tasks.workunit.client.0.smithi121.stdout:8/626: write d6/dd/d3b/da3/dca/f40 [745362,19301] 0 2024-08-18T22:41:38.593 INFO:tasks.workunit.client.0.smithi121.stdout:8/627: chown d6/dd/d3b/da3/dca/d18 4154 1 2024-08-18T22:41:38.596 INFO:tasks.workunit.client.0.smithi121.stdout:8/628: symlink d6/d1e/d2d/d78/d85/ldb 0 2024-08-18T22:41:38.601 INFO:tasks.workunit.client.0.smithi121.stdout:7/628: dread de/d2d/fa3 [0,4194304] 0 2024-08-18T22:41:38.608 INFO:tasks.workunit.client.1.smithi195.stdout:6/153: write da/d15/d1c/f12 [1053094,18438] 0 2024-08-18T22:41:38.610 INFO:tasks.workunit.client.0.smithi121.stdout:8/629: dread d6/f8 [0,4194304] 0 2024-08-18T22:41:38.611 INFO:tasks.workunit.client.1.smithi195.stdout:6/154: mkdir da/db/d26/d2d 0 2024-08-18T22:41:38.611 INFO:tasks.workunit.client.1.smithi195.stdout:6/155: stat da/f13 0 2024-08-18T22:41:38.617 INFO:tasks.workunit.client.0.smithi121.stdout:8/630: dwrite d6/d1e/d2d/f81 [0,4194304] 0 2024-08-18T22:41:38.618 INFO:tasks.workunit.client.0.smithi121.stdout:8/631: chown d6/d20/d69/l96 1418 1 2024-08-18T22:41:38.621 INFO:tasks.workunit.client.0.smithi121.stdout:8/632: creat d6/dd/d25/d56/fdc x:0 0 0 2024-08-18T22:41:38.631 INFO:tasks.workunit.client.0.smithi121.stdout:8/633: dwrite d6/d1e/d2d/f97 [0,4194304] 0 2024-08-18T22:41:38.635 INFO:tasks.workunit.client.0.smithi121.stdout:8/634: read d6/d1e/d2d/d78/fb9 [4193208,55061] 0 2024-08-18T22:41:38.637 INFO:tasks.workunit.client.0.smithi121.stdout:8/635: symlink d6/dd/d3b/ldd 0 2024-08-18T22:41:38.641 INFO:tasks.workunit.client.1.smithi195.stdout:2/156: sync 2024-08-18T22:41:38.645 INFO:tasks.workunit.client.1.smithi195.stdout:2/157: creat d1/d22/f30 x:0 0 0 2024-08-18T22:41:38.647 INFO:tasks.workunit.client.1.smithi195.stdout:2/158: creat d1/d22/f31 x:0 0 0 2024-08-18T22:41:38.649 INFO:tasks.workunit.client.1.smithi195.stdout:2/159: symlink d1/d22/l32 0 2024-08-18T22:41:38.653 INFO:tasks.workunit.client.1.smithi195.stdout:2/160: rename d1/d8/l16 to d1/d24/l33 0 2024-08-18T22:41:38.655 INFO:tasks.workunit.client.1.smithi195.stdout:2/161: creat d1/d24/f34 x:0 0 0 2024-08-18T22:41:38.657 INFO:tasks.workunit.client.0.smithi121.stdout:8/636: dread d6/d20/d69/d77/f88 [0,4194304] 0 2024-08-18T22:41:38.659 INFO:tasks.workunit.client.0.smithi121.stdout:8/637: truncate d6/dd/d25/fd1 553692 0 2024-08-18T22:41:38.659 INFO:tasks.workunit.client.1.smithi195.stdout:2/162: rename d1/l3 to d1/d8/d27/l35 0 2024-08-18T22:41:38.660 INFO:tasks.workunit.client.0.smithi121.stdout:8/638: truncate d6/dd/d25/fd1 977895 0 2024-08-18T22:41:38.663 INFO:tasks.workunit.client.1.smithi195.stdout:2/163: rename d1/f21 to d1/d24/d26/f36 0 2024-08-18T22:41:38.665 INFO:tasks.workunit.client.1.smithi195.stdout:2/164: creat d1/d24/d26/f37 x:0 0 0 2024-08-18T22:41:38.666 INFO:tasks.workunit.client.0.smithi121.stdout:8/639: dwrite d6/dd/f16 [0,4194304] 0 2024-08-18T22:41:38.666 INFO:tasks.workunit.client.1.smithi195.stdout:2/165: chown d1/d24/d26/f37 508834 1 2024-08-18T22:41:38.670 INFO:tasks.workunit.client.1.smithi195.stdout:2/166: creat d1/f38 x:0 0 0 2024-08-18T22:41:38.670 INFO:tasks.workunit.client.1.smithi195.stdout:2/167: stat d1/d22/d29/fa 0 2024-08-18T22:41:38.671 INFO:tasks.workunit.client.0.smithi121.stdout:8/640: dread d6/d1e/d2d/f97 [0,4194304] 0 2024-08-18T22:41:38.673 INFO:tasks.workunit.client.0.smithi121.stdout:8/641: write d6/d1e/d2d/d78/f6c [2258930,60667] 0 2024-08-18T22:41:38.680 INFO:tasks.workunit.client.0.smithi121.stdout:8/642: fsync d6/d1e/d2d/d78/f6c 0 2024-08-18T22:41:38.681 INFO:tasks.workunit.client.0.smithi121.stdout:8/643: write d6/dd/d25/fd1 [1973879,12983] 0 2024-08-18T22:41:38.682 INFO:tasks.workunit.client.0.smithi121.stdout:8/644: write d6/d1e/f4e [2049323,65265] 0 2024-08-18T22:41:38.684 INFO:tasks.workunit.client.0.smithi121.stdout:8/645: rmdir d6/dd 39 2024-08-18T22:41:38.686 INFO:tasks.workunit.client.0.smithi121.stdout:8/646: creat d6/fde x:0 0 0 2024-08-18T22:41:38.686 INFO:tasks.workunit.client.1.smithi195.stdout:2/168: dread d1/f2 [0,4194304] 0 2024-08-18T22:41:38.689 INFO:tasks.workunit.client.0.smithi121.stdout:8/647: rename d6/dd/d3b/da3/dca/d18/d83/lc5 to d6/dd/d3b/da3/dca/d18/d83/ldf 0 2024-08-18T22:41:38.690 INFO:tasks.workunit.client.0.smithi121.stdout:8/648: read - d6/d1e/d2d/d78/d45/d86/fb6 zero size 2024-08-18T22:41:38.691 INFO:tasks.workunit.client.1.smithi195.stdout:2/169: dwrite d1/d22/f30 [0,4194304] 0 2024-08-18T22:41:38.693 INFO:tasks.workunit.client.0.smithi121.stdout:8/649: rename d6/d1e/d2d/d78/laa to d6/dd/d3b/da3/le0 0 2024-08-18T22:41:38.694 INFO:tasks.workunit.client.0.smithi121.stdout:8/650: readlink d6/dd/l89 0 2024-08-18T22:41:38.695 INFO:tasks.workunit.client.1.smithi195.stdout:2/170: mknod d1/d22/c39 0 2024-08-18T22:41:38.695 INFO:tasks.workunit.client.0.smithi121.stdout:8/651: chown d6/dd/c11 1782672 1 2024-08-18T22:41:38.697 INFO:tasks.workunit.client.1.smithi195.stdout:2/171: read d1/f1b [309054,79596] 0 2024-08-18T22:41:38.698 INFO:tasks.workunit.client.0.smithi121.stdout:8/652: symlink d6/d1e/d2d/le1 0 2024-08-18T22:41:38.699 INFO:tasks.workunit.client.1.smithi195.stdout:2/172: creat d1/d8/d27/f3a x:0 0 0 2024-08-18T22:41:38.704 INFO:tasks.workunit.client.1.smithi195.stdout:2/173: dread d1/d22/d29/f18 [0,4194304] 0 2024-08-18T22:41:38.705 INFO:tasks.workunit.client.0.smithi121.stdout:8/653: getdents d6 0 2024-08-18T22:41:38.706 INFO:tasks.workunit.client.0.smithi121.stdout:8/654: write d6/dd/d25/d56/fdc [32627,52219] 0 2024-08-18T22:41:38.707 INFO:tasks.workunit.client.1.smithi195.stdout:2/174: mkdir d1/d22/d29/d3b 0 2024-08-18T22:41:38.710 INFO:tasks.workunit.client.1.smithi195.stdout:2/175: creat d1/f3c x:0 0 0 2024-08-18T22:41:38.718 INFO:tasks.workunit.client.1.smithi195.stdout:2/176: rename d1/d22/d29 to d1/d8/d3d 0 2024-08-18T22:41:38.718 INFO:tasks.workunit.client.1.smithi195.stdout:2/177: read - d1/d8/f2f zero size 2024-08-18T22:41:38.719 INFO:tasks.workunit.client.1.smithi195.stdout:2/178: fdatasync d1/f2 0 2024-08-18T22:41:38.720 INFO:tasks.workunit.client.0.smithi121.stdout:8/655: dread d6/d1e/d2d/d78/f58 [0,4194304] 0 2024-08-18T22:41:38.723 INFO:tasks.workunit.client.1.smithi195.stdout:2/179: dread d1/d24/d26/f2b [0,4194304] 0 2024-08-18T22:41:38.723 INFO:tasks.workunit.client.0.smithi121.stdout:8/656: truncate d6/fc9 1400425 0 2024-08-18T22:41:38.730 INFO:tasks.workunit.client.0.smithi121.stdout:8/657: dwrite d6/dd/d3b/da3/dca/d60/d5b/f95 [0,4194304] 0 2024-08-18T22:41:38.730 INFO:tasks.workunit.client.1.smithi195.stdout:2/180: dwrite d1/d8/d3d/f1c [0,4194304] 0 2024-08-18T22:41:38.732 INFO:tasks.workunit.client.0.smithi121.stdout:8/658: rmdir d6/dd/d3b/da3/dca/d60/d5b/d6e 39 2024-08-18T22:41:38.738 INFO:tasks.workunit.client.1.smithi195.stdout:2/181: link d1/d8/f11 d1/d8/d3d/f3e 0 2024-08-18T22:41:38.743 INFO:tasks.workunit.client.0.smithi121.stdout:8/659: dread d6/dd/d25/d56/fc6 [0,4194304] 0 2024-08-18T22:41:38.744 INFO:tasks.workunit.client.0.smithi121.stdout:8/660: dread - d6/dd/d3b/da3/dca/d60/d5b/fa2 zero size 2024-08-18T22:41:38.746 INFO:tasks.workunit.client.1.smithi195.stdout:2/182: dwrite d1/d24/d26/f2c [0,4194304] 0 2024-08-18T22:41:38.748 INFO:tasks.workunit.client.1.smithi195.stdout:2/183: truncate d1/d24/d26/f37 68118 0 2024-08-18T22:41:38.758 INFO:tasks.workunit.client.1.smithi195.stdout:2/184: dwrite d1/d8/f11 [0,4194304] 0 2024-08-18T22:41:38.763 INFO:tasks.workunit.client.0.smithi121.stdout:8/661: dread d6/d1e/d2d/d78/d45/f53 [0,4194304] 0 2024-08-18T22:41:38.765 INFO:tasks.workunit.client.0.smithi121.stdout:8/662: write d6/dd/d3b/da3/dca/d18/d99/da0/fd2 [52824,49440] 0 2024-08-18T22:41:38.766 INFO:tasks.workunit.client.0.smithi121.stdout:5/438: sync 2024-08-18T22:41:38.766 INFO:tasks.workunit.client.0.smithi121.stdout:9/659: sync 2024-08-18T22:41:38.766 INFO:tasks.workunit.client.0.smithi121.stdout:0/500: sync 2024-08-18T22:41:38.766 INFO:tasks.workunit.client.0.smithi121.stdout:4/543: sync 2024-08-18T22:41:38.766 INFO:tasks.workunit.client.0.smithi121.stdout:3/605: sync 2024-08-18T22:41:38.766 INFO:tasks.workunit.client.0.smithi121.stdout:2/415: sync 2024-08-18T22:41:38.768 INFO:tasks.workunit.client.0.smithi121.stdout:4/544: readlink d2/dc/d1c/d62/l65 0 2024-08-18T22:41:38.770 INFO:tasks.workunit.client.0.smithi121.stdout:4/545: write d2/dc/d16/d59/f8e [3906453,56834] 0 2024-08-18T22:41:38.772 INFO:tasks.workunit.client.0.smithi121.stdout:3/606: creat d1e/d1f/d25/d74/fdf x:0 0 0 2024-08-18T22:41:38.773 INFO:tasks.workunit.client.0.smithi121.stdout:5/439: creat d3/f8c x:0 0 0 2024-08-18T22:41:38.775 INFO:tasks.workunit.client.0.smithi121.stdout:9/660: dread d0/d5/dd/d1a/f37 [0,4194304] 0 2024-08-18T22:41:38.780 INFO:tasks.workunit.client.0.smithi121.stdout:4/546: creat d2/dc/d8d/fc3 x:0 0 0 2024-08-18T22:41:38.780 INFO:tasks.workunit.client.0.smithi121.stdout:0/501: creat d1/d4/db/d24/df/d8/d71/d79/fab x:0 0 0 2024-08-18T22:41:38.786 INFO:tasks.workunit.client.0.smithi121.stdout:2/416: creat d2/d3/f8a x:0 0 0 2024-08-18T22:41:38.787 INFO:tasks.workunit.client.0.smithi121.stdout:0/502: write d1/d4/db/d24/d30/d6c/f51 [699968,30086] 0 2024-08-18T22:41:38.788 INFO:tasks.workunit.client.0.smithi121.stdout:4/547: write d2/dc/d1c/f7d [2111416,25398] 0 2024-08-18T22:41:38.790 INFO:tasks.workunit.client.0.smithi121.stdout:0/503: stat d1/d4/db/d24/df/d8/d78 0 2024-08-18T22:41:38.791 INFO:tasks.workunit.client.0.smithi121.stdout:5/440: dread d3/d5/d27/f54 [0,4194304] 0 2024-08-18T22:41:38.793 INFO:tasks.workunit.client.0.smithi121.stdout:5/441: write d3/d5/d13/f6f [813163,46983] 0 2024-08-18T22:41:38.796 INFO:tasks.workunit.client.0.smithi121.stdout:3/607: dread d1e/d1f/d25/d2e/f91 [0,4194304] 0 2024-08-18T22:41:38.796 INFO:tasks.workunit.client.0.smithi121.stdout:8/663: getdents d6/dd/d3b/da3/dca 0 2024-08-18T22:41:38.798 INFO:tasks.workunit.client.0.smithi121.stdout:4/548: mkdir d2/dc/d8d/dc4 0 2024-08-18T22:41:38.799 INFO:tasks.workunit.client.0.smithi121.stdout:5/442: truncate d3/d5/d13/d23/d66/f88 200694 0 2024-08-18T22:41:38.801 INFO:tasks.workunit.client.0.smithi121.stdout:4/549: stat d2/dc/d16/d22/d29/c31 0 2024-08-18T22:41:38.802 INFO:tasks.workunit.client.0.smithi121.stdout:9/661: rename d0/d38/d9e/df/d3d/d89/d92/dc6/dd5/l8d to d0/d38/d44/lda 0 2024-08-18T22:41:38.806 INFO:tasks.workunit.client.0.smithi121.stdout:0/504: mknod d1/d4/db/d18/d40/d83/cac 0 2024-08-18T22:41:38.806 INFO:tasks.workunit.client.0.smithi121.stdout:5/443: fsync d3/d5/d13/d23/f34 0 2024-08-18T22:41:38.806 INFO:tasks.workunit.client.0.smithi121.stdout:4/550: readlink d2/dc/d1c/d62/l65 0 2024-08-18T22:41:38.806 INFO:tasks.workunit.client.0.smithi121.stdout:8/664: creat d6/dd/d25/fe2 x:0 0 0 2024-08-18T22:41:38.807 INFO:tasks.workunit.client.0.smithi121.stdout:3/608: mkdir d1e/d1f/d25/d58/de0 0 2024-08-18T22:41:38.807 INFO:tasks.workunit.client.0.smithi121.stdout:2/417: dwrite d2/d8/d19/f52 [0,4194304] 0 2024-08-18T22:41:38.807 INFO:tasks.workunit.client.0.smithi121.stdout:9/662: creat d0/d38/d9e/df/fdb x:0 0 0 2024-08-18T22:41:38.809 INFO:tasks.workunit.client.0.smithi121.stdout:5/444: stat d3/d5/d13/d19/d75 0 2024-08-18T22:41:38.810 INFO:tasks.workunit.client.1.smithi195.stdout:8/275: sync 2024-08-18T22:41:38.810 INFO:tasks.workunit.client.1.smithi195.stdout:5/155: sync 2024-08-18T22:41:38.810 INFO:tasks.workunit.client.1.smithi195.stdout:3/252: sync 2024-08-18T22:41:38.810 INFO:tasks.workunit.client.1.smithi195.stdout:7/115: sync 2024-08-18T22:41:38.810 INFO:tasks.workunit.client.1.smithi195.stdout:0/213: sync 2024-08-18T22:41:38.810 INFO:tasks.workunit.client.1.smithi195.stdout:1/321: sync 2024-08-18T22:41:38.810 INFO:tasks.workunit.client.1.smithi195.stdout:4/212: sync 2024-08-18T22:41:38.812 INFO:tasks.workunit.client.1.smithi195.stdout:7/116: chown dc/d14/d15/d17/f1a 27575843 1 2024-08-18T22:41:38.813 INFO:tasks.workunit.client.0.smithi121.stdout:3/609: write d1e/d1f/d25/d58/f99 [976581,102587] 0 2024-08-18T22:41:38.813 INFO:tasks.workunit.client.1.smithi195.stdout:0/214: mknod d0/c3f 0 2024-08-18T22:41:38.816 INFO:tasks.workunit.client.0.smithi121.stdout:3/610: stat d1e/d1f/d25/d6b/d81 0 2024-08-18T22:41:38.817 INFO:tasks.workunit.client.0.smithi121.stdout:8/665: chown d6/dd/d3b/da3/dca/d18/f32 27 1 2024-08-18T22:41:38.818 INFO:tasks.workunit.client.0.smithi121.stdout:2/418: creat d2/d8/d19/d4a/d64/f8b x:0 0 0 2024-08-18T22:41:38.818 INFO:tasks.workunit.client.1.smithi195.stdout:7/117: unlink dc/l1b 0 2024-08-18T22:41:38.820 INFO:tasks.workunit.client.1.smithi195.stdout:4/213: getdents d0/d9/d41 0 2024-08-18T22:41:38.820 INFO:tasks.workunit.client.0.smithi121.stdout:3/611: symlink d1e/d1f/d5e/le1 0 2024-08-18T22:41:38.821 INFO:tasks.workunit.client.1.smithi195.stdout:7/118: write dc/d14/d15/f16 [188583,12409] 0 2024-08-18T22:41:38.822 INFO:tasks.workunit.client.0.smithi121.stdout:2/419: chown d2/d3/d53/l6e 0 1 2024-08-18T22:41:38.823 INFO:tasks.workunit.client.1.smithi195.stdout:0/215: creat d0/dc/d11/d30/f40 x:0 0 0 2024-08-18T22:41:38.823 INFO:tasks.workunit.client.1.smithi195.stdout:8/276: dread d1/d3/f2b [0,4194304] 0 2024-08-18T22:41:38.824 INFO:tasks.workunit.client.1.smithi195.stdout:1/322: truncate da/d18/d28/d31/d3b/d4e/f67 537951 0 2024-08-18T22:41:38.825 INFO:tasks.workunit.client.0.smithi121.stdout:5/445: dwrite d3/d5/d27/d35/d67/f5b [0,4194304] 0 2024-08-18T22:41:38.826 INFO:tasks.workunit.client.1.smithi195.stdout:0/216: read - d0/dc/d11/d30/f35 zero size 2024-08-18T22:41:38.830 INFO:tasks.workunit.client.1.smithi195.stdout:1/323: rmdir da/d4c 39 2024-08-18T22:41:38.830 INFO:tasks.workunit.client.1.smithi195.stdout:4/214: creat d0/d9/d3b/f4b x:0 0 0 2024-08-18T22:41:38.831 INFO:tasks.workunit.client.1.smithi195.stdout:0/217: dread d0/f3 [0,4194304] 0 2024-08-18T22:41:38.832 INFO:tasks.workunit.client.0.smithi121.stdout:2/420: dwrite d2/d3/f8a [0,4194304] 0 2024-08-18T22:41:38.835 INFO:tasks.workunit.client.1.smithi195.stdout:8/277: symlink d1/d64/l6d 0 2024-08-18T22:41:38.839 INFO:tasks.workunit.client.1.smithi195.stdout:8/278: write d1/d3/db/d35/f42 [518936,25589] 0 2024-08-18T22:41:38.841 INFO:tasks.workunit.client.0.smithi121.stdout:9/663: dread d0/d5/f25 [0,4194304] 0 2024-08-18T22:41:38.842 INFO:tasks.workunit.client.0.smithi121.stdout:4/551: dread d2/dc/d16/d22/f50 [0,4194304] 0 2024-08-18T22:41:38.842 INFO:tasks.workunit.client.1.smithi195.stdout:7/119: link dc/d22/l28 dc/d2a/l2e 0 2024-08-18T22:41:38.844 INFO:tasks.workunit.client.1.smithi195.stdout:0/218: dwrite d0/dc/dd/f3c [0,4194304] 0 2024-08-18T22:41:38.844 INFO:tasks.workunit.client.0.smithi121.stdout:4/552: stat d2/dc/c28 0 2024-08-18T22:41:38.844 INFO:tasks.workunit.client.0.smithi121.stdout:9/664: fdatasync d0/d38/d9e/df/d61/db2/f8a 0 2024-08-18T22:41:38.845 INFO:tasks.workunit.client.1.smithi195.stdout:5/156: truncate d0/d3/df/d1a/f24 298661 0 2024-08-18T22:41:38.846 INFO:tasks.workunit.client.1.smithi195.stdout:1/324: dread da/f29 [0,4194304] 0 2024-08-18T22:41:38.850 INFO:tasks.workunit.client.0.smithi121.stdout:5/446: write d3/d5/d27/d35/f36 [3881993,126084] 0 2024-08-18T22:41:38.850 INFO:tasks.workunit.client.0.smithi121.stdout:5/447: truncate d3/d5/f62 224648 0 2024-08-18T22:41:38.850 INFO:tasks.workunit.client.0.smithi121.stdout:8/666: dread d6/dd/d3b/da3/dca/d18/f2c [0,4194304] 0 2024-08-18T22:41:38.851 INFO:tasks.workunit.client.1.smithi195.stdout:0/219: mkdir d0/dc/df/d41 0 2024-08-18T22:41:38.852 INFO:tasks.workunit.client.0.smithi121.stdout:2/421: rename d2/d8/f39 to d2/d3/d48/d77/f8c 0 2024-08-18T22:41:38.854 INFO:tasks.workunit.client.0.smithi121.stdout:2/422: chown d2/d3/d53/c5a 3 1 2024-08-18T22:41:38.854 INFO:tasks.workunit.client.0.smithi121.stdout:4/553: symlink d2/dc/d16/d22/d2c/d44/d8c/lc5 0 2024-08-18T22:41:38.855 INFO:tasks.workunit.client.0.smithi121.stdout:3/612: mkdir d1e/de2 0 2024-08-18T22:41:38.855 INFO:tasks.workunit.client.1.smithi195.stdout:7/120: creat dc/d14/d15/d17/f2f x:0 0 0 2024-08-18T22:41:38.856 INFO:tasks.workunit.client.1.smithi195.stdout:0/220: write d0/dc/d25/f1e [359364,104617] 0 2024-08-18T22:41:38.857 INFO:tasks.workunit.client.1.smithi195.stdout:5/157: mknod d0/d2/d29/c2c 0 2024-08-18T22:41:38.857 INFO:tasks.workunit.client.0.smithi121.stdout:8/667: creat d6/fe3 x:0 0 0 2024-08-18T22:41:38.860 INFO:tasks.workunit.client.0.smithi121.stdout:5/448: unlink d3/d5/d27/d35/d67/f29 0 2024-08-18T22:41:38.861 INFO:tasks.workunit.client.1.smithi195.stdout:4/215: mkdir d0/d9/d11/d16/d37/d48/d4c 0 2024-08-18T22:41:38.861 INFO:tasks.workunit.client.0.smithi121.stdout:5/449: read d3/d5/d27/f54 [91397,72385] 0 2024-08-18T22:41:38.861 INFO:tasks.workunit.client.1.smithi195.stdout:8/279: dwrite d1/d3/d1c/f52 [0,4194304] 0 2024-08-18T22:41:38.865 INFO:tasks.workunit.client.1.smithi195.stdout:4/216: truncate d0/d9/d11/d16/f38 481146 0 2024-08-18T22:41:38.868 INFO:tasks.workunit.client.1.smithi195.stdout:4/217: stat d0/d7/d1d/f2f 0 2024-08-18T22:41:38.869 INFO:tasks.workunit.client.1.smithi195.stdout:0/221: dread d0/dc/d25/f1e [0,4194304] 0 2024-08-18T22:41:38.874 INFO:tasks.workunit.client.1.smithi195.stdout:4/218: rmdir d0/d7 39 2024-08-18T22:41:38.874 INFO:tasks.workunit.client.0.smithi121.stdout:4/554: dwrite d2/dc/d16/d22/f50 [0,4194304] 0 2024-08-18T22:41:38.875 INFO:tasks.workunit.client.1.smithi195.stdout:0/222: mkdir d0/dc/d25/d42 0 2024-08-18T22:41:38.877 INFO:tasks.workunit.client.1.smithi195.stdout:8/280: link d1/d3/db/fd d1/de/df/d1d/f6e 0 2024-08-18T22:41:38.878 INFO:tasks.workunit.client.0.smithi121.stdout:3/613: mkdir d1e/d1f/d5e/dbc/dcb/de3 0 2024-08-18T22:41:38.879 INFO:tasks.workunit.client.1.smithi195.stdout:7/121: link c0 dc/c30 0 2024-08-18T22:41:38.879 INFO:tasks.workunit.client.0.smithi121.stdout:9/665: dwrite d0/d38/d44/dbf/f77 [0,4194304] 0 2024-08-18T22:41:38.880 INFO:tasks.workunit.client.1.smithi195.stdout:4/219: readlink d0/d9/d11/l1e 0 2024-08-18T22:41:38.880 INFO:tasks.workunit.client.1.smithi195.stdout:1/325: link da/d4c/l71 da/d18/d28/d31/l72 0 2024-08-18T22:41:38.880 INFO:tasks.workunit.client.0.smithi121.stdout:2/423: link d2/d8/d19/c14 d2/d3/d48/c8d 0 2024-08-18T22:41:38.882 INFO:tasks.workunit.client.0.smithi121.stdout:8/668: creat d6/d20/d69/d77/fe4 x:0 0 0 2024-08-18T22:41:38.882 INFO:tasks.workunit.client.0.smithi121.stdout:5/450: truncate d3/d5/d13/d19/d24/f47 688666 0 2024-08-18T22:41:38.882 INFO:tasks.workunit.client.0.smithi121.stdout:3/614: chown d1e/d1f/d25/d6b/d81/ca2 15 1 2024-08-18T22:41:38.883 INFO:tasks.workunit.client.1.smithi195.stdout:4/220: dread - d0/d9/d11/d16/d49/f40 zero size 2024-08-18T22:41:38.883 INFO:tasks.workunit.client.0.smithi121.stdout:9/666: rmdir d0/d38/d9e/d45 39 2024-08-18T22:41:38.884 INFO:tasks.workunit.client.0.smithi121.stdout:4/555: mknod d2/dc/cc6 0 2024-08-18T22:41:38.884 INFO:tasks.workunit.client.1.smithi195.stdout:4/221: truncate d0/ff 108523 0 2024-08-18T22:41:38.885 INFO:tasks.workunit.client.0.smithi121.stdout:4/556: stat d2/f2e 0 2024-08-18T22:41:38.887 INFO:tasks.workunit.client.1.smithi195.stdout:1/326: rename da/c21 to da/d4c/d5d/c73 0 2024-08-18T22:41:38.888 INFO:tasks.workunit.client.0.smithi121.stdout:3/615: write d1e/d1f/d25/f54 [4385434,102704] 0 2024-08-18T22:41:38.889 INFO:tasks.workunit.client.1.smithi195.stdout:0/223: getdents d0/dc/d25/d42 0 2024-08-18T22:41:38.889 INFO:tasks.workunit.client.1.smithi195.stdout:7/122: chown c0 1866902 1 2024-08-18T22:41:38.890 INFO:tasks.workunit.client.1.smithi195.stdout:8/281: dwrite d1/de/d31/d5a/f57 [0,4194304] 0 2024-08-18T22:41:38.891 INFO:tasks.workunit.client.1.smithi195.stdout:1/327: creat da/d18/d43/f74 x:0 0 0 2024-08-18T22:41:38.892 INFO:tasks.workunit.client.1.smithi195.stdout:8/282: write d1/d3/db/d35/f42 [1336290,81115] 0 2024-08-18T22:41:38.897 INFO:tasks.workunit.client.1.smithi195.stdout:0/224: rmdir d0/dc/d25/d42 0 2024-08-18T22:41:38.902 INFO:tasks.workunit.client.1.smithi195.stdout:0/225: write d0/f1c [8851027,129332] 0 2024-08-18T22:41:38.905 INFO:tasks.workunit.client.1.smithi195.stdout:7/123: dwrite f5 [0,4194304] 0 2024-08-18T22:41:38.906 INFO:tasks.workunit.client.1.smithi195.stdout:1/328: write da/d18/d28/f34 [4701045,18411] 0 2024-08-18T22:41:38.907 INFO:tasks.workunit.client.1.smithi195.stdout:8/283: dwrite d1/d3/d1c/d21/f62 [0,4194304] 0 2024-08-18T22:41:38.916 INFO:tasks.workunit.client.1.smithi195.stdout:4/222: write d0/d9/d11/d16/f1b [1567848,117680] 0 2024-08-18T22:41:38.916 INFO:tasks.workunit.client.1.smithi195.stdout:8/284: mknod d1/d3/db/d39/d44/c6f 0 2024-08-18T22:41:38.924 INFO:tasks.workunit.client.1.smithi195.stdout:0/226: dwrite d0/dc/d11/f15 [0,4194304] 0 2024-08-18T22:41:38.926 INFO:tasks.workunit.client.1.smithi195.stdout:8/285: chown d1/d3/db/f5d 39910638 1 2024-08-18T22:41:38.928 INFO:tasks.workunit.client.1.smithi195.stdout:4/223: symlink d0/d9/l4d 0 2024-08-18T22:41:38.928 INFO:tasks.workunit.client.1.smithi195.stdout:0/227: dread - d0/dc/d11/d30/f35 zero size 2024-08-18T22:41:38.934 INFO:tasks.workunit.client.1.smithi195.stdout:7/124: unlink dc/c30 0 2024-08-18T22:41:38.940 INFO:tasks.workunit.client.1.smithi195.stdout:4/224: rmdir d0/d36 0 2024-08-18T22:41:38.941 INFO:tasks.workunit.client.1.smithi195.stdout:7/125: symlink dc/d14/d2b/l31 0 2024-08-18T22:41:38.942 INFO:tasks.workunit.client.1.smithi195.stdout:5/158: dwrite d0/d3/df/d1a/f24 [0,4194304] 0 2024-08-18T22:41:38.945 INFO:tasks.workunit.client.1.smithi195.stdout:7/126: creat dc/f32 x:0 0 0 2024-08-18T22:41:38.946 INFO:tasks.workunit.client.1.smithi195.stdout:4/225: creat d0/d9/d11/d16/d37/f4e x:0 0 0 2024-08-18T22:41:38.946 INFO:tasks.workunit.client.1.smithi195.stdout:1/329: dwrite da/d3d/f41 [0,4194304] 0 2024-08-18T22:41:38.949 INFO:tasks.workunit.client.1.smithi195.stdout:4/226: chown d0/c1f 3 1 2024-08-18T22:41:38.949 INFO:tasks.workunit.client.1.smithi195.stdout:5/159: mknod d0/d2/c2d 0 2024-08-18T22:41:38.950 INFO:tasks.workunit.client.0.smithi121.stdout:4/557: creat d2/dc/d16/d22/d2c/d44/d8c/fc7 x:0 0 0 2024-08-18T22:41:38.950 INFO:tasks.workunit.client.0.smithi121.stdout:1/587: sync 2024-08-18T22:41:38.950 INFO:tasks.workunit.client.0.smithi121.stdout:7/629: sync 2024-08-18T22:41:38.951 INFO:tasks.workunit.client.1.smithi195.stdout:7/127: fsync dc/d14/d15/f16 0 2024-08-18T22:41:38.953 INFO:tasks.workunit.client.1.smithi195.stdout:7/128: write dc/d14/d15/d17/f2f [851606,88182] 0 2024-08-18T22:41:38.955 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:38.952+0000 7fa3bb7fe640 1 -- 172.21.15.121:0/633220465 <== mon.1 v2:172.21.15.195:3300/0 7 ==== mgrmap(e 22) v1 ==== 45945+0+0 (secure 0 0 0) 0x7fa3c801dd70 con 0x7fa3d40ff7d0 2024-08-18T22:41:38.955 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:38.952+0000 7fa3bb7fe640 1 --2- 172.21.15.121:0/633220465 >> [v2:172.21.15.195:6828/1174410756,v1:172.21.15.195:6829/1174410756] conn(0x7fa3bc03dbd0 0x7fa3bc03ffb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:41:38.955 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:38.952+0000 7fa3bb7fe640 1 -- 172.21.15.121:0/633220465 --> [v2:172.21.15.195:6828/1174410756,v1:172.21.15.195:6829/1174410756] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fa3bc0404f0 con 0x7fa3bc03dbd0 2024-08-18T22:41:38.956 INFO:tasks.workunit.client.0.smithi121.stdout:5/451: mkdir d3/d8d 0 2024-08-18T22:41:38.956 INFO:tasks.workunit.client.1.smithi195.stdout:7/129: creat dc/d14/d15/f33 x:0 0 0 2024-08-18T22:41:38.959 INFO:tasks.workunit.client.1.smithi195.stdout:5/160: write d0/d3/df/f16 [2369895,102149] 0 2024-08-18T22:41:38.961 INFO:tasks.workunit.client.1.smithi195.stdout:5/161: fdatasync d0/d3/d8/f14 0 2024-08-18T22:41:38.961 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:38.960+0000 7fa3d2ffd640 1 --2- 172.21.15.121:0/633220465 >> [v2:172.21.15.195:6828/1174410756,v1:172.21.15.195:6829/1174410756] conn(0x7fa3bc03dbd0 0x7fa3bc03ffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:41:38.964 INFO:tasks.workunit.client.1.smithi195.stdout:1/330: rename da/d18/d28/d31/d3b/l3e to da/d3d/l75 0 2024-08-18T22:41:38.966 INFO:tasks.workunit.client.1.smithi195.stdout:1/331: rmdir da/d18/d43 39 2024-08-18T22:41:38.967 INFO:tasks.workunit.client.1.smithi195.stdout:9/279: sync 2024-08-18T22:41:38.967 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:38.966+0000 7fa3d2ffd640 1 --2- 172.21.15.121:0/633220465 >> [v2:172.21.15.195:6828/1174410756,v1:172.21.15.195:6829/1174410756] conn(0x7fa3bc03dbd0 0x7fa3bc03ffb0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fa3c4000c00 tx=0x7fa3c4035040 comp rx=0 tx=0).ready entity=mgr.24377 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:41:38.970 INFO:tasks.workunit.client.0.smithi121.stdout:9/667: creat d0/d38/d9e/df/d61/db2/dce/fdc x:0 0 0 2024-08-18T22:41:38.971 INFO:tasks.workunit.client.0.smithi121.stdout:5/452: write d3/d5/f11 [230699,36266] 0 2024-08-18T22:41:38.972 INFO:tasks.workunit.client.1.smithi195.stdout:5/162: dread d0/d3/d8/f13 [0,4194304] 0 2024-08-18T22:41:38.973 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:38.972+0000 7fa3bb7fe640 1 -- 172.21.15.121:0/633220465 <== mgr.24377 v2:172.21.15.195:6828/1174410756 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+318 (secure 0 0 0) 0x7fa3bc0404f0 con 0x7fa3bc03dbd0 2024-08-18T22:41:38.974 INFO:tasks.workunit.client.1.smithi195.stdout:1/332: mknod da/d18/d28/d31/d3b/c76 0 2024-08-18T22:41:38.974 INFO:tasks.workunit.client.1.smithi195.stdout:7/130: rename dc/d14/d15/d17/f1a to dc/d1d/d29/f34 0 2024-08-18T22:41:38.975 INFO:tasks.workunit.client.0.smithi121.stdout:9/668: read d0/d38/d9e/f1f [659931,27583] 0 2024-08-18T22:41:38.976 INFO:tasks.workunit.client.1.smithi195.stdout:9/280: dread d1c/f2c [0,4194304] 0 2024-08-18T22:41:38.976 INFO:tasks.workunit.client.1.smithi195.stdout:1/333: stat da/f60 0 2024-08-18T22:41:38.977 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:38.975+0000 7fa3d9944640 1 -- 172.21.15.121:0/633220465 >> [v2:172.21.15.195:6828/1174410756,v1:172.21.15.195:6829/1174410756] conn(0x7fa3bc03dbd0 msgr2=0x7fa3bc03ffb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:41:38.977 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:38.975+0000 7fa3d9944640 1 --2- 172.21.15.121:0/633220465 >> [v2:172.21.15.195:6828/1174410756,v1:172.21.15.195:6829/1174410756] conn(0x7fa3bc03dbd0 0x7fa3bc03ffb0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fa3c4000c00 tx=0x7fa3c4035040 comp rx=0 tx=0).stop 2024-08-18T22:41:38.977 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:38.975+0000 7fa3d9944640 1 -- 172.21.15.121:0/633220465 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa3d40ff7d0 msgr2=0x7fa3d410f550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:41:38.977 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:38.975+0000 7fa3d9944640 1 --2- 172.21.15.121:0/633220465 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa3d40ff7d0 0x7fa3d410f550 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fa3c800eb70 tx=0x7fa3c800b040 comp rx=0 tx=0).stop 2024-08-18T22:41:38.977 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:38.976+0000 7fa3d9944640 1 -- 172.21.15.121:0/633220465 shutdown_connections 2024-08-18T22:41:38.977 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:38.976+0000 7fa3d9944640 1 --2- 172.21.15.121:0/633220465 >> [v2:172.21.15.195:6828/1174410756,v1:172.21.15.195:6829/1174410756] conn(0x7fa3bc03dbd0 0x7fa3bc03ffb0 secure :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fa3c4000c00 tx=0x7fa3c4035040 comp rx=0 tx=0).stop 2024-08-18T22:41:38.977 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:38.976+0000 7fa3d9944640 1 --2- 172.21.15.121:0/633220465 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa3d40ff7d0 0x7fa3d410f550 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:41:38.977 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:38.976+0000 7fa3d9944640 1 --2- 172.21.15.121:0/633220465 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa3d40fe500 0x7fa3d410f010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:41:38.977 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:38.976+0000 7fa3d9944640 1 -- 172.21.15.121:0/633220465 >> 172.21.15.121:0/633220465 conn(0x7fa3d40f9e00 msgr2=0x7fa3d40fc520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:41:38.978 INFO:tasks.workunit.client.1.smithi195.stdout:1/334: chown da/d4c/c5f 12902231 1 2024-08-18T22:41:38.978 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:38.976+0000 7fa3d9944640 1 -- 172.21.15.121:0/633220465 shutdown_connections 2024-08-18T22:41:38.978 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:38.976+0000 7fa3d9944640 1 -- 172.21.15.121:0/633220465 wait complete. 2024-08-18T22:41:38.979 INFO:tasks.workunit.client.0.smithi121.stdout:1/588: symlink d5/d10/d67/lc9 0 2024-08-18T22:41:38.979 INFO:tasks.workunit.client.0.smithi121.stdout:4/558: symlink d2/dc/lc8 0 2024-08-18T22:41:38.981 INFO:tasks.workunit.client.0.smithi121.stdout:7/630: truncate de/d1a/d2f/d36/f54 4790840 0 2024-08-18T22:41:38.982 INFO:tasks.workunit.client.0.smithi121.stdout:3/616: link d1e/c8d d1e/d1f/d5e/dbc/dcb/de3/ce4 0 2024-08-18T22:41:38.985 INFO:tasks.workunit.client.1.smithi195.stdout:5/163: getdents d0/d3/d8 0 2024-08-18T22:41:38.986 INFO:tasks.workunit.client.0.smithi121.stdout:7/631: truncate de/d1a/d34/d6c/f6f 1575120 0 2024-08-18T22:41:38.987 INFO:tasks.workunit.client.0.smithi121.stdout:7/632: fsync de/f87 0 2024-08-18T22:41:38.989 INFO:tasks.workunit.client.1.smithi195.stdout:1/335: dwrite da/d4c/d5d/d63/f64 [0,4194304] 0 2024-08-18T22:41:38.990 INFO:tasks.workunit.client.0.smithi121.stdout:8/669: rename d6/dd/d3b/da3/dca/d18/d99/da0 to d6/d1e/d2d/de5 0 2024-08-18T22:41:38.993 INFO:tasks.workunit.client.0.smithi121.stdout:5/453: creat d3/d5/d13/d19/d24/f8e x:0 0 0 2024-08-18T22:41:38.993 INFO:tasks.workunit.client.1.smithi195.stdout:7/131: truncate f2 573221 0 2024-08-18T22:41:38.995 INFO:tasks.workunit.client.0.smithi121.stdout:5/454: write d3/d5/d13/f6f [1375567,113068] 0 2024-08-18T22:41:38.996 INFO:tasks.workunit.client.1.smithi195.stdout:1/336: unlink c2 0 2024-08-18T22:41:38.998 INFO:teuthology.orchestra.run.smithi121.stdout:true 2024-08-18T22:41:38.999 INFO:tasks.workunit.client.1.smithi195.stdout:7/132: mknod dc/d2a/c35 0 2024-08-18T22:41:38.999 INFO:tasks.workunit.client.1.smithi195.stdout:1/337: dread - da/d4c/d5d/d63/f65 zero size 2024-08-18T22:41:38.999 INFO:tasks.workunit.client.1.smithi195.stdout:4/227: dwrite d0/d9/f44 [0,4194304] 0 2024-08-18T22:41:39.000 INFO:tasks.workunit.client.0.smithi121.stdout:1/589: dread d5/d10/d14/d2a/f60 [0,4194304] 0 2024-08-18T22:41:39.003 INFO:tasks.workunit.client.1.smithi195.stdout:9/281: dwrite d1c/d32/d37/f4d [0,4194304] 0 2024-08-18T22:41:39.004 INFO:tasks.workunit.client.1.smithi195.stdout:7/133: symlink dc/d2a/l36 0 2024-08-18T22:41:39.005 INFO:tasks.workunit.client.1.smithi195.stdout:4/228: chown d0/d7/d1d/f3d 13 1 2024-08-18T22:41:39.007 INFO:tasks.workunit.client.0.smithi121.stdout:9/669: dread d0/d5/f9b [0,4194304] 0 2024-08-18T22:41:39.008 INFO:tasks.workunit.client.1.smithi195.stdout:9/282: rename d1c to d1c/d32/d56 22 2024-08-18T22:41:39.008 INFO:tasks.workunit.client.1.smithi195.stdout:7/134: symlink dc/d1d/d29/l37 0 2024-08-18T22:41:39.009 INFO:tasks.workunit.client.1.smithi195.stdout:7/135: readlink l4 0 2024-08-18T22:41:39.010 INFO:tasks.workunit.client.1.smithi195.stdout:7/136: dread - dc/d14/f21 zero size 2024-08-18T22:41:39.010 INFO:tasks.workunit.client.1.smithi195.stdout:4/229: creat d0/d9/d11/d16/f4f x:0 0 0 2024-08-18T22:41:39.011 INFO:tasks.workunit.client.0.smithi121.stdout:4/559: creat d2/dc/d16/d22/d2c/fc9 x:0 0 0 2024-08-18T22:41:39.012 INFO:tasks.workunit.client.0.smithi121.stdout:3/617: rename d1e/d1f/d25/ca1 to d1e/d1f/d25/d67/d92/da0/ce5 0 2024-08-18T22:41:39.013 INFO:tasks.workunit.client.1.smithi195.stdout:1/338: rmdir da/d18/d28/d31/d3b/d70 0 2024-08-18T22:41:39.013 INFO:tasks.workunit.client.1.smithi195.stdout:7/137: chown dc/d14/d15/c23 61 1 2024-08-18T22:41:39.013 INFO:tasks.workunit.client.1.smithi195.stdout:4/230: dread - d0/d9/d3b/f4b zero size 2024-08-18T22:41:39.014 INFO:tasks.workunit.client.0.smithi121.stdout:7/633: dread de/d13/f49 [0,4194304] 0 2024-08-18T22:41:39.016 INFO:tasks.workunit.client.1.smithi195.stdout:7/138: symlink dc/d2a/l38 0 2024-08-18T22:41:39.017 INFO:tasks.workunit.client.0.smithi121.stdout:1/590: creat d5/d10/d14/d2a/d3a/d87/d6c/d6f/d79/dab/fca x:0 0 0 2024-08-18T22:41:39.017 INFO:tasks.workunit.client.0.smithi121.stdout:3/618: truncate d1e/d1f/d25/d6b/fdc 301172 0 2024-08-18T22:41:39.017 INFO:tasks.workunit.client.1.smithi195.stdout:9/283: dwrite d1c/f27 [0,4194304] 0 2024-08-18T22:41:39.017 INFO:tasks.workunit.client.1.smithi195.stdout:4/231: fdatasync d0/d9/d11/d16/d49/f40 0 2024-08-18T22:41:39.018 INFO:tasks.workunit.client.1.smithi195.stdout:7/139: fsync dc/f25 0 2024-08-18T22:41:39.020 INFO:tasks.workunit.client.1.smithi195.stdout:4/232: write d0/f4a [580711,68286] 0 2024-08-18T22:41:39.022 INFO:tasks.workunit.client.1.smithi195.stdout:4/233: chown d0/d9/d11/d16/f42 9180438 1 2024-08-18T22:41:39.022 INFO:tasks.workunit.client.0.smithi121.stdout:4/560: chown d2/dc/d16/d22/d2c/d44/l54 114 1 2024-08-18T22:41:39.024 INFO:tasks.workunit.client.1.smithi195.stdout:7/140: creat dc/d22/f39 x:0 0 0 2024-08-18T22:41:39.024 INFO:tasks.workunit.client.0.smithi121.stdout:8/670: rename d6/dd/d3b/da3/dca/d60/d5b/f9a to d6/dd/d25/dda/fe6 0 2024-08-18T22:41:39.024 INFO:tasks.workunit.client.1.smithi195.stdout:9/284: truncate f13 4091250 0 2024-08-18T22:41:39.027 INFO:tasks.workunit.client.0.smithi121.stdout:8/671: write d6/d1e/d2d/d78/d45/d86/fd6 [980640,1740] 0 2024-08-18T22:41:39.027 INFO:tasks.workunit.client.0.smithi121.stdout:1/591: mkdir d5/d10/d14/d2a/d3a/d87/dcb 0 2024-08-18T22:41:39.027 INFO:tasks.workunit.client.0.smithi121.stdout:9/670: read d0/d38/d44/dbf/f84 [2559,94799] 0 2024-08-18T22:41:39.030 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:41:38 smithi121 ceph-mon[16788]: Manager daemon smithi195.acttsj is now available 2024-08-18T22:41:39.031 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:41:38 smithi121 ceph-mon[16788]: from='mgr.24377 ' entity='mgr.smithi195.acttsj' 2024-08-18T22:41:39.031 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:41:38 smithi121 ceph-mon[16788]: from='mgr.24377 ' entity='mgr.smithi195.acttsj' 2024-08-18T22:41:39.031 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:41:38 smithi121 ceph-mon[16788]: from='mgr.24377 ' entity='mgr.smithi195.acttsj' 2024-08-18T22:41:39.031 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:41:38 smithi121 ceph-mon[16788]: from='mgr.24377 172.21.15.195:0/2331273060' entity='mgr.smithi195.acttsj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-18T22:41:39.031 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:41:38 smithi121 ceph-mon[16788]: from='mgr.24377 172.21.15.195:0/2331273060' entity='mgr.smithi195.acttsj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-18T22:41:39.031 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:41:38 smithi121 ceph-mon[16788]: from='mgr.24377 172.21.15.195:0/2331273060' entity='mgr.smithi195.acttsj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi195.acttsj/mirror_snapshot_schedule"}]: dispatch 2024-08-18T22:41:39.031 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:41:38 smithi121 ceph-mon[16788]: from='mgr.24377 ' entity='mgr.smithi195.acttsj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi195.acttsj/mirror_snapshot_schedule"}]: dispatch 2024-08-18T22:41:39.031 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:41:38 smithi121 ceph-mon[16788]: from='mgr.24377 172.21.15.195:0/2331273060' entity='mgr.smithi195.acttsj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi195.acttsj/trash_purge_schedule"}]: dispatch 2024-08-18T22:41:39.031 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:41:38 smithi121 ceph-mon[16788]: from='mgr.24377 ' entity='mgr.smithi195.acttsj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi195.acttsj/trash_purge_schedule"}]: dispatch 2024-08-18T22:41:39.037 INFO:tasks.workunit.client.0.smithi121.stdout:7/634: unlink de/d13/d18/c86 0 2024-08-18T22:41:39.038 INFO:tasks.workunit.client.0.smithi121.stdout:9/671: fsync d0/d5/f98 0 2024-08-18T22:41:39.038 INFO:tasks.workunit.client.0.smithi121.stdout:5/455: dread d3/d5/d13/f16 [4194304,4194304] 0 2024-08-18T22:41:39.040 INFO:tasks.workunit.client.0.smithi121.stdout:1/592: creat d5/d10/d14/d2a/d3a/d87/d6c/fcc x:0 0 0 2024-08-18T22:41:39.041 INFO:tasks.workunit.client.1.smithi195.stdout:4/234: dwrite d0/d7/d1d/f27 [4194304,4194304] 0 2024-08-18T22:41:39.042 INFO:tasks.workunit.client.1.smithi195.stdout:9/285: dwrite f0 [4194304,4194304] 0 2024-08-18T22:41:39.043 INFO:tasks.workunit.client.1.smithi195.stdout:1/339: dread da/d3d/f48 [0,4194304] 0 2024-08-18T22:41:39.044 INFO:tasks.workunit.client.0.smithi121.stdout:8/672: truncate d6/dd/d3b/da3/dca/d37/f50 1482785 0 2024-08-18T22:41:39.046 INFO:tasks.workunit.client.0.smithi121.stdout:5/456: unlink d3/d5/d13/f6f 0 2024-08-18T22:41:39.048 INFO:tasks.workunit.client.0.smithi121.stdout:9/672: read d0/d38/d9e/df/d3d/d89/d92/dc6/fd4 [1242541,98503] 0 2024-08-18T22:41:39.050 INFO:tasks.workunit.client.1.smithi195.stdout:1/340: mkdir da/d18/d28/d31/d77 0 2024-08-18T22:41:39.052 INFO:tasks.workunit.client.1.smithi195.stdout:7/141: dread dc/d1d/d29/f34 [0,4194304] 0 2024-08-18T22:41:39.053 INFO:tasks.workunit.client.1.smithi195.stdout:4/235: getdents d0/d9/d11/d16/d49 0 2024-08-18T22:41:39.055 INFO:tasks.workunit.client.1.smithi195.stdout:9/286: dwrite d1c/d32/f36 [0,4194304] 0 2024-08-18T22:41:39.055 INFO:tasks.workunit.client.1.smithi195.stdout:1/341: read - da/d3d/f40 zero size 2024-08-18T22:41:39.055 INFO:tasks.workunit.client.1.smithi195.stdout:7/142: chown dc/d1d/c20 27 1 2024-08-18T22:41:39.056 INFO:tasks.workunit.client.0.smithi121.stdout:4/561: dwrite d2/dc/d16/d22/d29/f20 [0,4194304] 0 2024-08-18T22:41:39.057 INFO:tasks.workunit.client.0.smithi121.stdout:7/635: truncate de/f28 2577463 0 2024-08-18T22:41:39.058 INFO:tasks.workunit.client.0.smithi121.stdout:7/636: chown de/d13/d18/d23 3504 1 2024-08-18T22:41:39.060 INFO:tasks.workunit.client.1.smithi195.stdout:7/143: creat dc/d14/d2b/f3a x:0 0 0 2024-08-18T22:41:39.060 INFO:tasks.workunit.client.0.smithi121.stdout:8/673: mkdir d6/dd/dcc/de7 0 2024-08-18T22:41:39.062 INFO:tasks.workunit.client.0.smithi121.stdout:8/674: chown d6/dd/d25/d56/fdc 4954 1 2024-08-18T22:41:39.064 INFO:tasks.workunit.client.1.smithi195.stdout:1/342: creat da/f78 x:0 0 0 2024-08-18T22:41:39.066 INFO:tasks.workunit.client.0.smithi121.stdout:5/457: rename d3/d5/d27/d35/d67 to d3/d5/d3c/d3f/d8f 0 2024-08-18T22:41:39.066 INFO:tasks.workunit.client.0.smithi121.stdout:9/673: truncate d0/d38/d9e/f1f 5134959 0 2024-08-18T22:41:39.067 INFO:tasks.workunit.client.0.smithi121.stdout:4/562: mknod d2/dc/d16/cca 0 2024-08-18T22:41:39.068 INFO:tasks.workunit.client.1.smithi195.stdout:4/236: dwrite d0/d9/f1c [0,4194304] 0 2024-08-18T22:41:39.069 INFO:tasks.workunit.client.0.smithi121.stdout:7/637: symlink de/d1a/d34/d38/d73/dbb/lc9 0 2024-08-18T22:41:39.070 INFO:tasks.workunit.client.1.smithi195.stdout:7/144: write dc/d14/d15/d17/f2f [308088,62479] 0 2024-08-18T22:41:39.074 INFO:tasks.workunit.client.1.smithi195.stdout:4/237: chown d0/d9/d11/d16/d49/f46 0 1 2024-08-18T22:41:39.077 INFO:tasks.workunit.client.1.smithi195.stdout:4/238: write d0/d7/d1d/f3d [2430166,26903] 0 2024-08-18T22:41:39.078 INFO:tasks.workunit.client.0.smithi121.stdout:8/675: dwrite d6/dd/d3b/da3/dca/d60/d5b/f95 [0,4194304] 0 2024-08-18T22:41:39.081 INFO:tasks.workunit.client.0.smithi121.stdout:7/638: dread de/f15 [0,4194304] 0 2024-08-18T22:41:39.081 INFO:tasks.workunit.client.1.smithi195.stdout:4/239: truncate d0/d9/d3b/f4b 273471 0 2024-08-18T22:41:39.081 INFO:tasks.workunit.client.1.smithi195.stdout:7/145: unlink dc/d14/d15/f16 0 2024-08-18T22:41:39.082 INFO:tasks.workunit.client.1.smithi195.stdout:4/240: symlink d0/d9/l50 0 2024-08-18T22:41:39.084 INFO:tasks.workunit.client.0.smithi121.stdout:8/676: truncate d6/dd/d3b/da3/dca/d18/d83/f8a 376444 0 2024-08-18T22:41:39.085 INFO:tasks.workunit.client.0.smithi121.stdout:4/563: rename d2/dc/d16/d22/d2c/fb4 to d2/dc/d1c/d62/d90/fcb 0 2024-08-18T22:41:39.086 INFO:tasks.workunit.client.1.smithi195.stdout:7/146: creat dc/d14/f3b x:0 0 0 2024-08-18T22:41:39.086 INFO:tasks.workunit.client.0.smithi121.stdout:5/458: mknod d3/d5/d13/d19/d24/c90 0 2024-08-18T22:41:39.088 INFO:tasks.workunit.client.1.smithi195.stdout:7/147: symlink dc/l3c 0 2024-08-18T22:41:39.089 INFO:tasks.workunit.client.0.smithi121.stdout:5/459: fdatasync d3/d5/d3c/d3f/f6e 0 2024-08-18T22:41:39.090 INFO:tasks.workunit.client.1.smithi195.stdout:7/148: write dc/f10 [1603143,107279] 0 2024-08-18T22:41:39.090 INFO:tasks.workunit.client.1.smithi195.stdout:1/343: dread da/d18/d28/d31/d3b/d4e/f67 [0,4194304] 0 2024-08-18T22:41:39.090 INFO:tasks.workunit.client.0.smithi121.stdout:7/639: mkdir de/d1a/d2f/d4b/d6d/dca 0 2024-08-18T22:41:39.091 INFO:tasks.workunit.client.0.smithi121.stdout:5/460: rename d3/d5/d13/d19 to d3/d5/d13/d19/d75/d91 22 2024-08-18T22:41:39.093 INFO:tasks.workunit.client.1.smithi195.stdout:1/344: truncate f7 1128251 0 2024-08-18T22:41:39.093 INFO:tasks.workunit.client.0.smithi121.stdout:4/564: dwrite d2/f9 [0,4194304] 0 2024-08-18T22:41:39.094 INFO:tasks.workunit.client.0.smithi121.stdout:5/461: write d3/d5/d3c/d3f/d8f/f5e [51040,62387] 0 2024-08-18T22:41:39.099 INFO:tasks.workunit.client.1.smithi195.stdout:1/345: read da/d18/d28/d31/d3b/f3c [487735,57847] 0 2024-08-18T22:41:39.100 INFO:tasks.workunit.client.0.smithi121.stdout:7/640: read de/d13/d18/d23/d24/d29/f4d [23207,72797] 0 2024-08-18T22:41:39.102 INFO:tasks.workunit.client.0.smithi121.stdout:5/462: creat d3/d5/d3c/d3f/d8f/f92 x:0 0 0 2024-08-18T22:41:39.103 INFO:tasks.workunit.client.1.smithi195.stdout:4/241: truncate d0/f33 4190501 0 2024-08-18T22:41:39.104 INFO:tasks.workunit.client.0.smithi121.stdout:5/463: write d3/f46 [158809,50024] 0 2024-08-18T22:41:39.105 INFO:tasks.workunit.client.1.smithi195.stdout:4/242: write d0/d9/d11/d16/d37/f43 [11612,105296] 0 2024-08-18T22:41:39.105 INFO:tasks.workunit.client.1.smithi195.stdout:1/346: mknod da/d18/d28/d31/d3b/d4e/c79 0 2024-08-18T22:41:39.105 INFO:tasks.workunit.client.0.smithi121.stdout:4/565: mkdir d2/dc/d16/d22/d2c/d7a/da0/dcc 0 2024-08-18T22:41:39.109 INFO:tasks.workunit.client.1.smithi195.stdout:1/347: mkdir da/d4c/d7a 0 2024-08-18T22:41:39.110 INFO:tasks.workunit.client.1.smithi195.stdout:4/243: mknod d0/d9/d11/d16/d37/d48/c51 0 2024-08-18T22:41:39.111 INFO:tasks.workunit.client.1.smithi195.stdout:1/348: readlink da/d3d/l75 0 2024-08-18T22:41:39.113 INFO:tasks.workunit.client.1.smithi195.stdout:1/349: chown da/d18/f42 6192 1 2024-08-18T22:41:39.116 INFO:tasks.workunit.client.0.smithi121.stdout:1/593: truncate d5/d10/d14/d2a/d3a/d87/d6c/d6f/d82/d15/f5b 238099 0 2024-08-18T22:41:39.118 INFO:tasks.workunit.client.0.smithi121.stdout:7/641: mknod de/d1a/d34/d38/d5f/ccb 0 2024-08-18T22:41:39.118 INFO:tasks.workunit.client.1.smithi195.stdout:4/244: dwrite d0/ff [0,4194304] 0 2024-08-18T22:41:39.122 INFO:tasks.workunit.client.0.smithi121.stdout:1/594: fsync d5/d10/d14/d2a/d3a/f4d 0 2024-08-18T22:41:39.123 INFO:tasks.workunit.client.1.smithi195.stdout:4/245: truncate d0/d9/d11/f3a 4215002 0 2024-08-18T22:41:39.123 INFO:tasks.workunit.client.1.smithi195.stdout:4/246: fsync d0/d7/d1d/f31 0 2024-08-18T22:41:39.124 INFO:tasks.workunit.client.0.smithi121.stdout:4/566: symlink d2/dc/d16/d22/d2c/d7a/da0/lcd 0 2024-08-18T22:41:39.128 INFO:tasks.workunit.client.0.smithi121.stdout:4/567: write d2/dc/d1c/d62/fb2 [774004,122049] 0 2024-08-18T22:41:39.132 INFO:tasks.workunit.client.1.smithi195.stdout:7/149: dread fb [4194304,4194304] 0 2024-08-18T22:41:39.132 INFO:tasks.workunit.client.1.smithi195.stdout:4/247: dwrite d0/d9/d11/d16/f1b [4194304,4194304] 0 2024-08-18T22:41:39.133 INFO:tasks.workunit.client.0.smithi121.stdout:7/642: dwrite f8 [0,4194304] 0 2024-08-18T22:41:39.135 INFO:tasks.workunit.client.0.smithi121.stdout:5/464: dread d3/fc [0,4194304] 0 2024-08-18T22:41:39.136 INFO:tasks.workunit.client.1.smithi195.stdout:7/150: truncate f2 1593217 0 2024-08-18T22:41:39.139 INFO:tasks.workunit.client.1.smithi195.stdout:4/248: link d0/f22 d0/d7/d1d/f52 0 2024-08-18T22:41:39.141 INFO:tasks.workunit.client.0.smithi121.stdout:5/465: truncate d3/d5/d13/d19/d24/d32/d38/d63/f83 92944 0 2024-08-18T22:41:39.141 INFO:tasks.workunit.client.1.smithi195.stdout:7/151: mknod dc/d14/d15/d17/c3d 0 2024-08-18T22:41:39.141 INFO:tasks.workunit.client.1.smithi195.stdout:1/350: dwrite da/d18/d28/d31/d3b/d4e/f51 [0,4194304] 0 2024-08-18T22:41:39.142 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:39.140+0000 7fe8f2bab640 1 -- 172.21.15.121:0/1466867784 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe8ec06f110 msgr2=0x7fe8ec06d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:41:39.142 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:39.140+0000 7fe8f2bab640 1 --2- 172.21.15.121:0/1466867784 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe8ec06f110 0x7fe8ec06d7d0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fe8dc0048d0 tx=0x7fe8dc009da0 comp rx=0 tx=0).stop 2024-08-18T22:41:39.143 INFO:tasks.workunit.client.1.smithi195.stdout:4/249: fsync d0/f25 0 2024-08-18T22:41:39.143 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:39.142+0000 7fe8f2bab640 1 -- 172.21.15.121:0/1466867784 shutdown_connections 2024-08-18T22:41:39.143 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:39.142+0000 7fe8f2bab640 1 --2- 172.21.15.121:0/1466867784 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe8ec06dd10 0x7fe8ec06e180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:41:39.143 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:39.142+0000 7fe8f2bab640 1 --2- 172.21.15.121:0/1466867784 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe8ec06f110 0x7fe8ec06d7d0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:41:39.143 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:39.142+0000 7fe8f2bab640 1 -- 172.21.15.121:0/1466867784 >> 172.21.15.121:0/1466867784 conn(0x7fe8ec069180 msgr2=0x7fe8ec06b5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:41:39.143 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:39.142+0000 7fe8f2bab640 1 -- 172.21.15.121:0/1466867784 shutdown_connections 2024-08-18T22:41:39.144 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:39.142+0000 7fe8f2bab640 1 -- 172.21.15.121:0/1466867784 wait complete. 2024-08-18T22:41:39.144 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:39.143+0000 7fe8f2bab640 1 Processor -- start 2024-08-18T22:41:39.144 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:39.143+0000 7fe8f2bab640 1 -- start start 2024-08-18T22:41:39.144 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:39.143+0000 7fe8f2bab640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe8ec06dd10 0x7fe8ec11bad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:41:39.145 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:39.143+0000 7fe8f2bab640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe8ec06f110 0x7fe8ec11c010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:41:39.145 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:39.143+0000 7fe8f2bab640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8ec11ce80 con 0x7fe8ec06dd10 2024-08-18T22:41:39.145 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:39.143+0000 7fe8f2bab640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8ec11cff0 con 0x7fe8ec06f110 2024-08-18T22:41:39.145 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:39.143+0000 7fe8f1ba9640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe8ec06dd10 0x7fe8ec11bad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:41:39.145 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:39.143+0000 7fe8f13a8640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe8ec06f110 0x7fe8ec11c010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:41:39.145 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:39.143+0000 7fe8f13a8640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe8ec06f110 0x7fe8ec11c010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.121:34978/0 (socket says 172.21.15.121:34978) 2024-08-18T22:41:39.145 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:39.143+0000 7fe8f13a8640 1 -- 172.21.15.121:0/553185674 learned_addr learned my addr 172.21.15.121:0/553185674 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-18T22:41:39.146 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:39.144+0000 7fe8f13a8640 1 -- 172.21.15.121:0/553185674 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe8ec06dd10 msgr2=0x7fe8ec11bad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:41:39.146 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:39.144+0000 7fe8f13a8640 1 --2- 172.21.15.121:0/553185674 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe8ec06dd10 0x7fe8ec11bad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:41:39.146 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:39.144+0000 7fe8f13a8640 1 -- 172.21.15.121:0/553185674 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8dc005040 con 0x7fe8ec06f110 2024-08-18T22:41:39.146 INFO:tasks.workunit.client.1.smithi195.stdout:7/152: truncate dc/d14/f3b 17200 0 2024-08-18T22:41:39.146 INFO:tasks.workunit.client.1.smithi195.stdout:4/250: chown d0/f8 134 1 2024-08-18T22:41:39.146 INFO:tasks.workunit.client.1.smithi195.stdout:1/351: mkdir da/d18/d28/d7b 0 2024-08-18T22:41:39.147 INFO:tasks.workunit.client.1.smithi195.stdout:7/153: creat dc/d22/f3e x:0 0 0 2024-08-18T22:41:39.147 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:39.144+0000 7fe8f13a8640 1 --2- 172.21.15.121:0/553185674 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe8ec06f110 0x7fe8ec11c010 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fe8e800b790 tx=0x7fe8e80091d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:41:39.147 INFO:tasks.workunit.client.0.smithi121.stdout:5/466: truncate d3/d5/d13/d19/d24/d4d/f7c 561533 0 2024-08-18T22:41:39.147 INFO:tasks.workunit.client.0.smithi121.stdout:9/674: dread d0/d38/d9e/df/d3d/d89/faa [0,4194304] 0 2024-08-18T22:41:39.148 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:39.145+0000 7fe8e27fc640 1 -- 172.21.15.121:0/553185674 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe8e800c700 con 0x7fe8ec06f110 2024-08-18T22:41:39.148 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:39.145+0000 7fe8e27fc640 1 -- 172.21.15.121:0/553185674 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fe8e800cd00 con 0x7fe8ec06f110 2024-08-18T22:41:39.148 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:39.145+0000 7fe8e27fc640 1 -- 172.21.15.121:0/553185674 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe8e8015e40 con 0x7fe8ec06f110 2024-08-18T22:41:39.148 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:39.145+0000 7fe8f2bab640 1 -- 172.21.15.121:0/553185674 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8ec11d2d0 con 0x7fe8ec06f110 2024-08-18T22:41:39.148 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:39.145+0000 7fe8f2bab640 1 -- 172.21.15.121:0/553185674 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8ec11d7a0 con 0x7fe8ec06f110 2024-08-18T22:41:39.149 INFO:tasks.workunit.client.1.smithi195.stdout:4/251: rmdir d0/d9/d11/d16 39 2024-08-18T22:41:39.149 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:39.147+0000 7fe8e27fc640 1 -- 172.21.15.121:0/553185674 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 22) v1 ==== 45945+0+0 (secure 0 0 0) 0x7fe8e8012070 con 0x7fe8ec06f110 2024-08-18T22:41:39.150 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:39.147+0000 7fe8f2bab640 1 -- 172.21.15.121:0/553185674 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8d0005240 con 0x7fe8ec06f110 2024-08-18T22:41:39.150 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:39.148+0000 7fe8e27fc640 1 --2- 172.21.15.121:0/553185674 >> [v2:172.21.15.195:6828/1174410756,v1:172.21.15.195:6829/1174410756] conn(0x7fe8d8038b50 0x7fe8d803b000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:41:39.150 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:39.148+0000 7fe8e27fc640 1 -- 172.21.15.121:0/553185674 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5808+0+0 (secure 0 0 0) 0x7fe8e804cd00 con 0x7fe8ec06f110 2024-08-18T22:41:39.150 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:39.149+0000 7fe8f1ba9640 1 --2- 172.21.15.121:0/553185674 >> [v2:172.21.15.195:6828/1174410756,v1:172.21.15.195:6829/1174410756] conn(0x7fe8d8038b50 0x7fe8d803b000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:41:39.151 INFO:tasks.workunit.client.0.smithi121.stdout:9/675: fsync d0/d38/d9e/df/d3d/f95 0 2024-08-18T22:41:39.152 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:39.151+0000 7fe8f1ba9640 1 --2- 172.21.15.121:0/553185674 >> [v2:172.21.15.195:6828/1174410756,v1:172.21.15.195:6829/1174410756] conn(0x7fe8d8038b50 0x7fe8d803b000 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fe8dc0048a0 tx=0x7fe8dc035040 comp rx=0 tx=0).ready entity=mgr.24377 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:41:39.152 INFO:tasks.workunit.client.0.smithi121.stdout:4/568: unlink d2/dc/d1c/c53 0 2024-08-18T22:41:39.154 INFO:tasks.workunit.client.0.smithi121.stdout:0/505: sync 2024-08-18T22:41:39.156 INFO:tasks.workunit.client.1.smithi195.stdout:4/252: mknod d0/d7/c53 0 2024-08-18T22:41:39.157 INFO:tasks.workunit.client.0.smithi121.stdout:1/595: read d5/d10/d14/d2a/d3a/d87/d6c/d6f/f8f [130872,125589] 0 2024-08-18T22:41:39.158 INFO:tasks.workunit.client.1.smithi195.stdout:1/352: dwrite da/d3d/f41 [0,4194304] 0 2024-08-18T22:41:39.159 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:39.157+0000 7fe8e27fc640 1 -- 172.21.15.121:0/553185674 <== mon.1 v2:172.21.15.195:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7fe8e801e3f0 con 0x7fe8ec06f110 2024-08-18T22:41:39.160 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:41:38 smithi195 ceph-mon[23370]: Manager daemon smithi195.acttsj is now available 2024-08-18T22:41:39.160 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:41:38 smithi195 ceph-mon[23370]: from='mgr.24377 ' entity='mgr.smithi195.acttsj' 2024-08-18T22:41:39.160 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:41:38 smithi195 ceph-mon[23370]: from='mgr.24377 ' entity='mgr.smithi195.acttsj' 2024-08-18T22:41:39.161 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:41:38 smithi195 ceph-mon[23370]: from='mgr.24377 ' entity='mgr.smithi195.acttsj' 2024-08-18T22:41:39.161 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:41:38 smithi195 ceph-mon[23370]: from='mgr.24377 172.21.15.195:0/2331273060' entity='mgr.smithi195.acttsj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-18T22:41:39.161 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:41:38 smithi195 ceph-mon[23370]: from='mgr.24377 172.21.15.195:0/2331273060' entity='mgr.smithi195.acttsj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-18T22:41:39.161 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:41:38 smithi195 ceph-mon[23370]: from='mgr.24377 172.21.15.195:0/2331273060' entity='mgr.smithi195.acttsj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi195.acttsj/mirror_snapshot_schedule"}]: dispatch 2024-08-18T22:41:39.161 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:41:38 smithi195 ceph-mon[23370]: from='mgr.24377 ' entity='mgr.smithi195.acttsj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi195.acttsj/mirror_snapshot_schedule"}]: dispatch 2024-08-18T22:41:39.161 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:41:38 smithi195 ceph-mon[23370]: from='mgr.24377 172.21.15.195:0/2331273060' entity='mgr.smithi195.acttsj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi195.acttsj/trash_purge_schedule"}]: dispatch 2024-08-18T22:41:39.161 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:41:38 smithi195 ceph-mon[23370]: from='mgr.24377 ' entity='mgr.smithi195.acttsj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi195.acttsj/trash_purge_schedule"}]: dispatch 2024-08-18T22:41:39.162 INFO:tasks.workunit.client.0.smithi121.stdout:7/643: creat de/d1a/d2f/d4b/fcc x:0 0 0 2024-08-18T22:41:39.162 INFO:tasks.workunit.client.0.smithi121.stdout:4/569: mknod d2/dc/d16/cce 0 2024-08-18T22:41:39.163 INFO:tasks.workunit.client.1.smithi195.stdout:1/353: creat da/d3d/f7c x:0 0 0 2024-08-18T22:41:39.165 INFO:tasks.workunit.client.0.smithi121.stdout:5/467: dwrite d3/d5/d27/d35/f36 [0,4194304] 0 2024-08-18T22:41:39.170 INFO:tasks.workunit.client.1.smithi195.stdout:1/354: creat da/d4c/f7d x:0 0 0 2024-08-18T22:41:39.170 INFO:tasks.workunit.client.1.smithi195.stdout:4/253: dwrite d0/d7/d1d/f27 [0,4194304] 0 2024-08-18T22:41:39.170 INFO:tasks.workunit.client.0.smithi121.stdout:0/506: mknod d1/d4/db/d24/d30/d52/d5b/cad 0 2024-08-18T22:41:39.171 INFO:tasks.workunit.client.0.smithi121.stdout:9/676: symlink d0/d38/d9e/ldd 0 2024-08-18T22:41:39.171 INFO:tasks.workunit.client.0.smithi121.stdout:0/507: dread - d1/d4/db/d24/d30/d52/f87 zero size 2024-08-18T22:41:39.172 INFO:tasks.workunit.client.0.smithi121.stdout:9/677: stat d0/d38/d52/d5f/f8e 0 2024-08-18T22:41:39.173 INFO:tasks.workunit.client.0.smithi121.stdout:7/644: mknod de/d13/d18/d23/d24/d29/d43/ccd 0 2024-08-18T22:41:39.176 INFO:tasks.workunit.client.1.smithi195.stdout:4/254: dread d0/d9/f1c [0,4194304] 0 2024-08-18T22:41:39.179 INFO:tasks.workunit.client.0.smithi121.stdout:1/596: mknod d5/d10/ccd 0 2024-08-18T22:41:39.179 INFO:tasks.workunit.client.1.smithi195.stdout:4/255: dread - d0/d9/d11/d16/d37/f4e zero size 2024-08-18T22:41:39.192 INFO:tasks.workunit.client.0.smithi121.stdout:9/678: dread d0/d38/d44/dbf/f6f [0,4194304] 0 2024-08-18T22:41:39.196 INFO:tasks.workunit.client.0.smithi121.stdout:7/645: rename de/d1a to de/d13/d18/d23/d24/d85/dce 0 2024-08-18T22:41:39.198 INFO:tasks.workunit.client.0.smithi121.stdout:4/570: dwrite d2/dc/d16/d22/d2c/d44/d8c/fb8 [0,4194304] 0 2024-08-18T22:41:39.200 INFO:tasks.workunit.client.0.smithi121.stdout:5/468: getdents d3/d5/d27/d35/d58/d8b 0 2024-08-18T22:41:39.202 INFO:tasks.workunit.client.0.smithi121.stdout:5/469: readlink d3/d5/d13/d19/d24/l2f 0 2024-08-18T22:41:39.203 INFO:tasks.workunit.client.0.smithi121.stdout:5/470: write d3/d5/f11 [273307,83770] 0 2024-08-18T22:41:39.204 INFO:tasks.workunit.client.0.smithi121.stdout:7/646: rmdir de/d13/d18/d23 39 2024-08-18T22:41:39.206 INFO:tasks.workunit.client.0.smithi121.stdout:9/679: dwrite d0/d38/d9e/df/d3d/faf [0,4194304] 0 2024-08-18T22:41:39.210 INFO:tasks.workunit.client.0.smithi121.stdout:1/597: rename d5/d10/c32 to d5/d10/d14/d2a/d3a/d87/d6c/d6f/d79/cce 0 2024-08-18T22:41:39.216 INFO:tasks.workunit.client.0.smithi121.stdout:0/508: truncate d1/d4/f88 278270 0 2024-08-18T22:41:39.216 INFO:tasks.workunit.client.0.smithi121.stdout:5/471: creat d3/d5/d13/d19/d24/d32/d38/f93 x:0 0 0 2024-08-18T22:41:39.220 INFO:tasks.workunit.client.0.smithi121.stdout:5/472: fdatasync d3/d5/d3c/d3f/f6e 0 2024-08-18T22:41:39.220 INFO:tasks.workunit.client.0.smithi121.stdout:1/598: stat d5/d10/d14/d92/d9f/lb7 0 2024-08-18T22:41:39.221 INFO:tasks.workunit.client.1.smithi195.stdout:4/256: truncate d0/f3 5023698 0 2024-08-18T22:41:39.223 INFO:tasks.workunit.client.1.smithi195.stdout:4/257: mkdir d0/d9/d11/d16/d54 0 2024-08-18T22:41:39.226 INFO:tasks.workunit.client.0.smithi121.stdout:4/571: stat d2/dc/d16/d22/d2c/d7a/da0/laf 0 2024-08-18T22:41:39.228 INFO:tasks.workunit.client.1.smithi195.stdout:4/258: rename d0/f33 to d0/d9/d11/d16/f55 0 2024-08-18T22:41:39.229 INFO:tasks.workunit.client.1.smithi195.stdout:4/259: chown d0/d9/d11/d16/d37 747 1 2024-08-18T22:41:39.229 INFO:tasks.workunit.client.1.smithi195.stdout:4/260: stat d0/d7/d1d/f3d 0 2024-08-18T22:41:39.230 INFO:tasks.workunit.client.0.smithi121.stdout:0/509: rename d1/d4/db/d24/d30/d52/d5b/c74 to d1/d4/db/d18/d40/cae 0 2024-08-18T22:41:39.232 INFO:tasks.workunit.client.1.smithi195.stdout:4/261: chown d0/d9/f44 0 1 2024-08-18T22:41:39.233 INFO:tasks.workunit.client.1.smithi195.stdout:4/262: read - d0/d9/d11/d16/f42 zero size 2024-08-18T22:41:39.233 INFO:tasks.workunit.client.0.smithi121.stdout:1/599: chown d5/d10/d14/d2a/d3a/d87/c83 751717997 1 2024-08-18T22:41:39.234 INFO:tasks.workunit.client.0.smithi121.stdout:9/680: creat d0/d5/dd/fde x:0 0 0 2024-08-18T22:41:39.235 INFO:tasks.workunit.client.1.smithi195.stdout:4/263: unlink d0/l21 0 2024-08-18T22:41:39.238 INFO:tasks.workunit.client.0.smithi121.stdout:0/510: mkdir d1/d4/db/d18/d40/d83/daf 0 2024-08-18T22:41:39.239 INFO:tasks.workunit.client.0.smithi121.stdout:9/681: read d0/d5/dd/d2f/f50 [3413617,81411] 0 2024-08-18T22:41:39.240 INFO:tasks.workunit.client.0.smithi121.stdout:4/572: dwrite d2/dc/d16/d22/d2c/fc9 [0,4194304] 0 2024-08-18T22:41:39.240 INFO:tasks.workunit.client.0.smithi121.stdout:9/682: stat d0 0 2024-08-18T22:41:39.242 INFO:tasks.workunit.client.0.smithi121.stdout:0/511: readlink d1/d4/da/d2f/l4b 0 2024-08-18T22:41:39.242 INFO:tasks.workunit.client.0.smithi121.stdout:1/600: write d5/d10/d14/d2a/f8d [936444,59197] 0 2024-08-18T22:41:39.243 INFO:tasks.workunit.client.0.smithi121.stdout:7/647: dread de/d13/d18/d23/d24/d85/dce/f7b [0,4194304] 0 2024-08-18T22:41:39.255 INFO:tasks.workunit.client.0.smithi121.stdout:7/648: dread de/d13/d18/d23/d24/d85/dce/d20/d39/f9a [0,4194304] 0 2024-08-18T22:41:39.255 INFO:tasks.workunit.client.0.smithi121.stdout:4/573: dwrite d2/dc/d16/d59/d83/f98 [0,4194304] 0 2024-08-18T22:41:39.255 INFO:tasks.workunit.client.0.smithi121.stdout:1/601: mkdir d5/dcf 0 2024-08-18T22:41:39.260 INFO:tasks.workunit.client.0.smithi121.stdout:5/473: dread d3/d5/d13/d19/d24/d32/f3b [0,4194304] 0 2024-08-18T22:41:39.268 INFO:tasks.workunit.client.0.smithi121.stdout:9/683: dread d0/d5/f98 [0,4194304] 0 2024-08-18T22:41:39.270 INFO:tasks.workunit.client.0.smithi121.stdout:7/649: rename de/d13/d18/d23/d24/d25/f55 to de/d13/d18/d23/d24/d85/dce/d2f/d4b/d6d/dca/fcf 0 2024-08-18T22:41:39.271 INFO:tasks.workunit.client.0.smithi121.stdout:9/684: write d0/d5/dd/d3b/d48/fc7 [365762,74630] 0 2024-08-18T22:41:39.275 INFO:tasks.workunit.client.0.smithi121.stdout:1/602: truncate d5/d10/d14/d2a/d3a/fbe 417907 0 2024-08-18T22:41:39.278 INFO:tasks.workunit.client.0.smithi121.stdout:4/574: getdents d2/dc/d8d 0 2024-08-18T22:41:39.281 INFO:tasks.workunit.client.0.smithi121.stdout:1/603: dread - d5/d10/d14/f86 zero size 2024-08-18T22:41:39.281 INFO:tasks.workunit.client.0.smithi121.stdout:7/650: creat de/d13/d18/d23/d24/d85/dce/d34/d38/d5f/d9c/fd0 x:0 0 0 2024-08-18T22:41:39.282 INFO:tasks.workunit.client.0.smithi121.stdout:9/685: symlink d0/d5/dd/ldf 0 2024-08-18T22:41:39.282 INFO:tasks.workunit.client.1.smithi195.stdout:4/264: creat d0/d9/d11/d16/f56 x:0 0 0 2024-08-18T22:41:39.283 INFO:tasks.workunit.client.0.smithi121.stdout:5/474: dwrite d3/d5/d27/f54 [0,4194304] 0 2024-08-18T22:41:39.284 INFO:tasks.workunit.client.1.smithi195.stdout:4/265: creat d0/d9/f57 x:0 0 0 2024-08-18T22:41:39.286 INFO:tasks.workunit.client.1.smithi195.stdout:4/266: write d0/d9/d11/d16/d37/f43 [692246,5182] 0 2024-08-18T22:41:39.291 INFO:tasks.workunit.client.0.smithi121.stdout:1/604: creat d5/d10/d14/d92/d9f/fd0 x:0 0 0 2024-08-18T22:41:39.293 INFO:tasks.workunit.client.0.smithi121.stdout:9/686: mkdir d0/d5/dd/d1a/de0 0 2024-08-18T22:41:39.295 INFO:tasks.workunit.client.0.smithi121.stdout:7/651: dwrite de/d13/d18/d23/d24/d85/dce/d34/d38/d73/fbd [0,4194304] 0 2024-08-18T22:41:39.302 INFO:tasks.workunit.client.0.smithi121.stdout:7/652: mknod de/d98/cd1 0 2024-08-18T22:41:39.304 INFO:tasks.workunit.client.0.smithi121.stdout:1/605: creat d5/d10/fd1 x:0 0 0 2024-08-18T22:41:39.306 INFO:tasks.workunit.client.0.smithi121.stdout:1/606: chown d5/d10/d14/d2a/d3a/la0 2 1 2024-08-18T22:41:39.309 INFO:tasks.workunit.client.0.smithi121.stdout:9/687: dwrite d0/d38/d9e/df/d61/f7a [0,4194304] 0 2024-08-18T22:41:39.311 INFO:tasks.workunit.client.0.smithi121.stdout:4/575: dread d2/dc/d16/d22/d29/f26 [4194304,4194304] 0 2024-08-18T22:41:39.318 INFO:tasks.workunit.client.0.smithi121.stdout:4/576: getdents d2/dc/d16/d59 0 2024-08-18T22:41:39.320 INFO:tasks.workunit.client.0.smithi121.stdout:1/607: fsync d5/d10/d14/d2a/d3a/d87/d6c/d6f/d82/d15/d28/d3d/d9a/fbc 0 2024-08-18T22:41:39.320 INFO:tasks.workunit.client.0.smithi121.stdout:4/577: write d2/dc/d1c/d62/fb2 [1676275,92970] 0 2024-08-18T22:41:39.320 INFO:tasks.workunit.client.0.smithi121.stdout:9/688: write d0/d5/dd/d3f/fa7 [2072945,76205] 0 2024-08-18T22:41:39.324 INFO:tasks.workunit.client.0.smithi121.stdout:4/578: readlink d2/dc/l18 0 2024-08-18T22:41:39.326 INFO:tasks.workunit.client.0.smithi121.stdout:9/689: mkdir d0/d38/d52/d5f/de1 0 2024-08-18T22:41:39.330 INFO:tasks.workunit.client.0.smithi121.stdout:9/690: mknod d0/d38/d9e/df/dcb/ce2 0 2024-08-18T22:41:39.331 INFO:tasks.workunit.client.0.smithi121.stdout:1/608: dwrite d5/d10/d14/d2a/d3a/d87/d6c/d6f/d82/d15/d28/d3d/f55 [0,4194304] 0 2024-08-18T22:41:39.335 INFO:tasks.workunit.client.0.smithi121.stdout:4/579: truncate d2/dc/d16/d22/d2c/d44/d8c/f99 1272298 0 2024-08-18T22:41:39.336 INFO:tasks.workunit.client.0.smithi121.stdout:4/580: chown d2/dc/d1c/d62/fb2 6125529 1 2024-08-18T22:41:39.338 INFO:tasks.workunit.client.0.smithi121.stdout:4/581: truncate d2/dc/d1c/f6a 4211832 0 2024-08-18T22:41:39.343 INFO:tasks.workunit.client.0.smithi121.stdout:4/582: creat d2/dc/d1c/d62/d90/fcf x:0 0 0 2024-08-18T22:41:39.344 INFO:tasks.workunit.client.0.smithi121.stdout:1/609: mknod d5/d10/d67/da7/dc1/cd2 0 2024-08-18T22:41:39.347 INFO:tasks.workunit.client.0.smithi121.stdout:1/610: mknod d5/d10/d67/cd3 0 2024-08-18T22:41:39.348 INFO:tasks.workunit.client.0.smithi121.stdout:9/691: getdents d0/d38/d9e/df/d3d/d89/d92/dc6/dd5/db3 0 2024-08-18T22:41:39.348 INFO:tasks.workunit.client.0.smithi121.stdout:1/611: readlink d5/d10/d14/d2a/d3a/d87/d6c/l94 0 2024-08-18T22:41:39.349 INFO:tasks.workunit.client.0.smithi121.stdout:1/612: write d5/f1d [3520946,53163] 0 2024-08-18T22:41:39.349 INFO:tasks.workunit.client.0.smithi121.stdout:4/583: rename d2/dc/d1c/c46 to d2/dc/d16/d22/d29/cd0 0 2024-08-18T22:41:39.352 INFO:tasks.workunit.client.0.smithi121.stdout:9/692: symlink d0/d5/dd/d3b/le3 0 2024-08-18T22:41:39.354 INFO:tasks.workunit.client.0.smithi121.stdout:9/693: write d0/d38/d9e/fbe [813147,113630] 0 2024-08-18T22:41:39.355 INFO:tasks.workunit.client.0.smithi121.stdout:1/613: mknod d5/d10/d14/d2a/d3a/d87/d6c/d6f/d82/d15/d28/d3d/d9a/cd4 0 2024-08-18T22:41:39.359 INFO:tasks.workunit.client.0.smithi121.stdout:9/694: creat d0/d38/d52/d5f/fe4 x:0 0 0 2024-08-18T22:41:39.362 INFO:tasks.workunit.client.0.smithi121.stdout:1/614: rename d5/d10/d14/d2a/d3a/d87/dcb to d5/d10/d14/d2a/d3a/d87/d6c/d6f/d82/d15/d28/d3d/d9a/dac/dd5 0 2024-08-18T22:41:39.364 INFO:tasks.workunit.client.0.smithi121.stdout:4/584: truncate d2/fb 2803817 0 2024-08-18T22:41:39.366 INFO:tasks.workunit.client.1.smithi195.stdout:6/156: sync 2024-08-18T22:41:39.367 INFO:tasks.workunit.client.0.smithi121.stdout:1/615: mknod d5/d10/d14/d2a/d3a/d87/d6c/d6f/d82/d15/d28/d3d/d9a/cd6 0 2024-08-18T22:41:39.368 INFO:tasks.workunit.client.0.smithi121.stdout:4/585: mkdir d2/dc/d16/d22/d2c/d44/d66/dd1 0 2024-08-18T22:41:39.369 INFO:tasks.workunit.client.0.smithi121.stdout:9/695: getdents d0/d38/d9e/df/d3d/d89 0 2024-08-18T22:41:39.370 INFO:tasks.workunit.client.0.smithi121.stdout:4/586: fsync d2/dc/d16/d47/f86 0 2024-08-18T22:41:39.374 INFO:tasks.workunit.client.0.smithi121.stdout:4/587: unlink d2/dc/d16/d22/d2c/d44/d66/l73 0 2024-08-18T22:41:39.376 INFO:tasks.workunit.client.0.smithi121.stdout:1/616: mknod d5/d10/d14/d2a/d91/cd7 0 2024-08-18T22:41:39.378 INFO:tasks.workunit.client.0.smithi121.stdout:4/588: symlink d2/dc/d16/d22/d29/ld2 0 2024-08-18T22:41:39.379 INFO:tasks.workunit.client.0.smithi121.stdout:1/617: chown d5/d10/c2e 125923 1 2024-08-18T22:41:39.380 INFO:tasks.workunit.client.0.smithi121.stdout:4/589: fdatasync d2/dc/d16/d22/d2c/d44/f78 0 2024-08-18T22:41:39.380 INFO:tasks.workunit.client.1.smithi195.stdout:6/157: dwrite f6 [0,4194304] 0 2024-08-18T22:41:39.381 INFO:tasks.workunit.client.1.smithi195.stdout:6/158: unlink da/db/f17 0 2024-08-18T22:41:39.382 INFO:tasks.workunit.client.0.smithi121.stdout:4/590: symlink d2/dc/d16/d22/d2c/d7a/ld3 0 2024-08-18T22:41:39.383 INFO:tasks.workunit.client.0.smithi121.stdout:1/618: dread d5/d10/d14/f50 [0,4194304] 0 2024-08-18T22:41:39.383 INFO:tasks.workunit.client.1.smithi195.stdout:6/159: write da/db/d19/f1d [3951117,47111] 0 2024-08-18T22:41:39.386 INFO:tasks.workunit.client.0.smithi121.stdout:1/619: write d5/d10/d14/d2a/d3a/d87/d6c/d6f/d82/d15/d38/f72 [2674529,2693] 0 2024-08-18T22:41:39.387 INFO:tasks.workunit.client.1.smithi195.stdout:6/160: mkdir da/d15/d1c/d2e 0 2024-08-18T22:41:39.387 INFO:tasks.workunit.client.0.smithi121.stdout:4/591: symlink d2/dc/d1c/d62/d90/ld4 0 2024-08-18T22:41:39.390 INFO:tasks.workunit.client.1.smithi195.stdout:6/161: rename da/d15/d1c/l14 to da/db/d26/d2d/l2f 0 2024-08-18T22:41:39.390 INFO:tasks.workunit.client.0.smithi121.stdout:1/620: creat d5/d10/d14/d2a/d3a/d87/d6c/d6f/d82/d15/d28/d3d/fd8 x:0 0 0 2024-08-18T22:41:39.391 INFO:tasks.workunit.client.1.smithi195.stdout:6/162: truncate da/db/d19/f1d 4726203 0 2024-08-18T22:41:39.392 INFO:tasks.workunit.client.0.smithi121.stdout:1/621: fsync d5/d10/d14/d2a/d3a/d87/d6c/fcc 0 2024-08-18T22:41:39.393 INFO:tasks.workunit.client.1.smithi195.stdout:6/163: symlink da/db/d26/l30 0 2024-08-18T22:41:39.393 INFO:tasks.workunit.client.0.smithi121.stdout:4/592: getdents d2/dc/d1c 0 2024-08-18T22:41:39.394 INFO:tasks.workunit.client.1.smithi195.stdout:6/164: write da/db/d19/f27 [828882,58467] 0 2024-08-18T22:41:39.394 INFO:tasks.workunit.client.0.smithi121.stdout:4/593: dread - d2/dc/d16/f70 zero size 2024-08-18T22:41:39.396 INFO:tasks.workunit.client.1.smithi195.stdout:6/165: unlink da/db/c1b 0 2024-08-18T22:41:39.397 INFO:tasks.workunit.client.0.smithi121.stdout:4/594: symlink d2/dc/d1c/dc1/ld5 0 2024-08-18T22:41:39.398 INFO:tasks.workunit.client.1.smithi195.stdout:6/166: creat da/d15/f31 x:0 0 0 2024-08-18T22:41:39.400 INFO:tasks.workunit.client.1.smithi195.stdout:6/167: mknod da/d15/d1c/c32 0 2024-08-18T22:41:39.402 INFO:tasks.workunit.client.1.smithi195.stdout:6/168: creat da/d15/d1c/d2e/f33 x:0 0 0 2024-08-18T22:41:39.402 INFO:tasks.workunit.client.0.smithi121.stdout:1/622: rename d5/d10/d14/d92/lc3 to d5/d10/d14/d2a/d3a/d87/d6c/d6f/d82/d15/d28/d3d/d9a/ld9 0 2024-08-18T22:41:39.404 INFO:tasks.workunit.client.0.smithi121.stdout:1/623: read d5/d10/d14/d2a/d3a/d87/d6c/d6f/f8f [149395,57546] 0 2024-08-18T22:41:39.404 INFO:tasks.workunit.client.1.smithi195.stdout:6/169: link da/d15/f2c da/d15/f34 0 2024-08-18T22:41:39.405 INFO:tasks.workunit.client.0.smithi121.stdout:4/595: getdents d2/dc/d16/d22/d2c/d7a/da0 0 2024-08-18T22:41:39.405 INFO:tasks.workunit.client.0.smithi121.stdout:1/624: readlink d5/d10/d14/d92/lbf 0 2024-08-18T22:41:39.406 INFO:tasks.workunit.client.1.smithi195.stdout:6/170: rmdir da/db/d19 39 2024-08-18T22:41:39.408 INFO:tasks.workunit.client.1.smithi195.stdout:6/171: symlink da/db/l35 0 2024-08-18T22:41:39.409 INFO:tasks.workunit.client.0.smithi121.stdout:1/625: creat d5/d10/d14/d2a/d3a/d87/d6c/d6f/d82/d15/d28/d3d/fda x:0 0 0 2024-08-18T22:41:39.411 INFO:tasks.workunit.client.0.smithi121.stdout:1/626: write d5/d10/d14/d2a/d3a/f7a [1611894,91804] 0 2024-08-18T22:41:39.413 INFO:tasks.workunit.client.1.smithi195.stdout:6/172: getdents da/db/d26/d2d 0 2024-08-18T22:41:39.413 INFO:tasks.workunit.client.1.smithi195.stdout:6/173: chown f6 115 1 2024-08-18T22:41:39.415 INFO:tasks.workunit.client.1.smithi195.stdout:6/174: mkdir da/d15/d1c/d2e/d36 0 2024-08-18T22:41:39.416 INFO:tasks.workunit.client.0.smithi121.stdout:1/627: mkdir d5/d10/d14/d2a/d3a/d87/d6c/d6f/d82/ddb 0 2024-08-18T22:41:39.416 INFO:tasks.workunit.client.0.smithi121.stdout:1/628: stat d5/d10/d14/d92 0 2024-08-18T22:41:39.417 INFO:tasks.workunit.client.0.smithi121.stdout:1/629: dread - d5/d10/d14/f86 zero size 2024-08-18T22:41:39.418 INFO:tasks.workunit.client.1.smithi195.stdout:6/175: link da/d15/f2c da/db/f37 0 2024-08-18T22:41:39.419 INFO:tasks.workunit.client.1.smithi195.stdout:6/176: chown da/db/d26/d2d 1403 1 2024-08-18T22:41:39.419 INFO:tasks.workunit.client.0.smithi121.stdout:1/630: fdatasync d5/d10/d14/d2a/d3a/d87/d6c/d6f/d79/dab/fca 0 2024-08-18T22:41:39.420 INFO:tasks.workunit.client.0.smithi121.stdout:4/596: dread d2/dc/d16/f36 [0,4194304] 0 2024-08-18T22:41:39.420 INFO:tasks.workunit.client.1.smithi195.stdout:6/177: creat da/d15/d1c/d2e/f38 x:0 0 0 2024-08-18T22:41:39.421 INFO:tasks.workunit.client.1.smithi195.stdout:6/178: chown da/db/d19/f1d 14731870 1 2024-08-18T22:41:39.422 INFO:tasks.workunit.client.1.smithi195.stdout:6/179: write f6 [2004231,61576] 0 2024-08-18T22:41:39.424 INFO:tasks.workunit.client.1.smithi195.stdout:6/180: write da/d15/d1c/d2e/f38 [493295,6317] 0 2024-08-18T22:41:39.424 INFO:tasks.workunit.client.0.smithi121.stdout:1/631: creat d5/d10/d14/d2a/d3a/d87/d6c/d6f/d82/d15/d28/d3d/d9a/fdc x:0 0 0 2024-08-18T22:41:39.430 INFO:tasks.workunit.client.1.smithi195.stdout:6/181: dwrite da/db/d19/f23 [0,4194304] 0 2024-08-18T22:41:39.433 INFO:tasks.workunit.client.1.smithi195.stdout:6/182: symlink da/d15/d1c/d2e/l39 0 2024-08-18T22:41:39.436 INFO:tasks.workunit.client.0.smithi121.stdout:4/597: dread d2/dc/d16/d22/d29/f38 [0,4194304] 0 2024-08-18T22:41:39.444 INFO:tasks.workunit.client.1.smithi195.stdout:6/183: write da/d15/d1c/f28 [3727319,21314] 0 2024-08-18T22:41:39.445 INFO:tasks.workunit.client.1.smithi195.stdout:6/184: write da/d15/d1c/d2e/f38 [1471130,46592] 0 2024-08-18T22:41:39.452 INFO:tasks.workunit.client.1.smithi195.stdout:6/185: dread f5 [0,4194304] 0 2024-08-18T22:41:39.455 INFO:tasks.workunit.client.1.smithi195.stdout:8/286: sync 2024-08-18T22:41:39.455 INFO:tasks.workunit.client.1.smithi195.stdout:3/253: sync 2024-08-18T22:41:39.455 INFO:tasks.workunit.client.1.smithi195.stdout:0/228: sync 2024-08-18T22:41:39.455 INFO:tasks.workunit.client.1.smithi195.stdout:2/185: sync 2024-08-18T22:41:39.455 INFO:tasks.workunit.client.1.smithi195.stdout:5/164: sync 2024-08-18T22:41:39.455 INFO:tasks.workunit.client.1.smithi195.stdout:0/229: dread - d0/dc/d11/d30/f35 zero size 2024-08-18T22:41:39.457 INFO:tasks.workunit.client.1.smithi195.stdout:0/230: chown d0/c16 190270 1 2024-08-18T22:41:39.458 INFO:tasks.workunit.client.1.smithi195.stdout:6/186: write da/d15/f2c [891604,31499] 0 2024-08-18T22:41:39.459 INFO:tasks.workunit.client.1.smithi195.stdout:5/165: symlink d0/d3/df/l2e 0 2024-08-18T22:41:39.460 INFO:tasks.workunit.client.0.smithi121.stdout:4/598: dread d2/d7c/f7f [0,4194304] 0 2024-08-18T22:41:39.461 INFO:tasks.workunit.client.0.smithi121.stdout:4/599: fsync d2/dc/d1c/f6a 0 2024-08-18T22:41:39.461 INFO:tasks.workunit.client.1.smithi195.stdout:8/287: creat d1/d3/db/d39/f70 x:0 0 0 2024-08-18T22:41:39.463 INFO:tasks.workunit.client.1.smithi195.stdout:0/231: mkdir d0/dc/df/d43 0 2024-08-18T22:41:39.463 INFO:tasks.workunit.client.0.smithi121.stdout:4/600: creat d2/dc/d16/d47/fd6 x:0 0 0 2024-08-18T22:41:39.464 INFO:tasks.workunit.client.1.smithi195.stdout:3/254: dwrite d7/f18 [0,4194304] 0 2024-08-18T22:41:39.467 INFO:tasks.workunit.client.1.smithi195.stdout:5/166: rmdir d0/db/d26 0 2024-08-18T22:41:39.467 INFO:tasks.workunit.client.0.smithi121.stdout:4/601: dread d2/dc/d16/d22/d29/f26 [4194304,4194304] 0 2024-08-18T22:41:39.470 INFO:tasks.workunit.client.1.smithi195.stdout:3/255: rmdir d7/d1f/d49 39 2024-08-18T22:41:39.470 INFO:tasks.workunit.client.1.smithi195.stdout:8/288: fsync d1/de/df/d1d/f3e 0 2024-08-18T22:41:39.471 INFO:tasks.workunit.client.1.smithi195.stdout:6/187: dwrite da/d15/f2c [0,4194304] 0 2024-08-18T22:41:39.475 INFO:tasks.workunit.client.1.smithi195.stdout:8/289: stat d1/de/d27/l51 0 2024-08-18T22:41:39.477 INFO:tasks.workunit.client.1.smithi195.stdout:8/290: mknod d1/d3/d1c/c71 0 2024-08-18T22:41:39.479 INFO:tasks.workunit.client.1.smithi195.stdout:6/188: getdents da/d15 0 2024-08-18T22:41:39.481 INFO:tasks.workunit.client.1.smithi195.stdout:3/256: dwrite d7/da/df/f20 [0,4194304] 0 2024-08-18T22:41:39.482 INFO:tasks.workunit.client.0.smithi121.stdout:4/602: truncate d2/f8 380482 0 2024-08-18T22:41:39.482 INFO:tasks.workunit.client.1.smithi195.stdout:8/291: write d1/de/df/d1d/f3e [2569076,123370] 0 2024-08-18T22:41:39.484 INFO:tasks.workunit.client.1.smithi195.stdout:8/292: dread - d1/d3/d1c/d21/f3f zero size 2024-08-18T22:41:39.484 INFO:tasks.workunit.client.1.smithi195.stdout:6/189: dread da/db/f21 [0,4194304] 0 2024-08-18T22:41:39.487 INFO:tasks.workunit.client.1.smithi195.stdout:0/232: rename d0/dc/df to d0/dc/d11/d30/d44 0 2024-08-18T22:41:39.489 INFO:tasks.workunit.client.1.smithi195.stdout:3/257: creat d7/da/df/d1c/f58 x:0 0 0 2024-08-18T22:41:39.493 INFO:tasks.workunit.client.1.smithi195.stdout:6/190: unlink da/d15/d1c/c32 0 2024-08-18T22:41:39.494 INFO:tasks.workunit.client.1.smithi195.stdout:0/233: write d0/dc/dd/f29 [1060017,23432] 0 2024-08-18T22:41:39.497 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:39.496+0000 7fe8f2bab640 1 -- 172.21.15.121:0/553185674 --> [v2:172.21.15.195:6828/1174410756,v1:172.21.15.195:6829/1174410756] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fe8d0000bf0 con 0x7fe8d8038b50 2024-08-18T22:41:39.498 INFO:tasks.workunit.client.0.smithi121.stdout:4/603: dwrite d2/dc/f89 [0,4194304] 0 2024-08-18T22:41:39.499 INFO:tasks.workunit.client.1.smithi195.stdout:3/258: symlink d7/da/l59 0 2024-08-18T22:41:39.502 INFO:tasks.workunit.client.1.smithi195.stdout:3/259: read - d7/da/df/f3b zero size 2024-08-18T22:41:39.503 INFO:tasks.workunit.client.0.smithi121.stdout:4/604: dread d2/dc/d16/d22/d29/f3b [0,4194304] 0 2024-08-18T22:41:39.504 INFO:tasks.workunit.client.1.smithi195.stdout:8/293: dread d1/de/d27/f29 [0,4194304] 0 2024-08-18T22:41:39.506 INFO:tasks.workunit.client.1.smithi195.stdout:0/234: dwrite d0/dc/d11/f20 [0,4194304] 0 2024-08-18T22:41:39.507 INFO:tasks.workunit.client.0.smithi121.stdout:4/605: rename d2/dc/d1c/d62 to d2/dc/d16/d59/d83/dd7 0 2024-08-18T22:41:39.509 INFO:tasks.workunit.client.1.smithi195.stdout:3/260: symlink d7/d1f/l5a 0 2024-08-18T22:41:39.510 INFO:tasks.workunit.client.1.smithi195.stdout:0/235: creat d0/dc/d11/d23/f45 x:0 0 0 2024-08-18T22:41:39.511 INFO:tasks.workunit.client.0.smithi121.stdout:4/606: truncate d2/dc/f94 380164 0 2024-08-18T22:41:39.512 INFO:tasks.workunit.client.1.smithi195.stdout:8/294: link d1/de/df/l12 d1/d3/d1c/d6a/l72 0 2024-08-18T22:41:39.513 INFO:tasks.workunit.client.1.smithi195.stdout:8/295: chown d1/c5b 30 1 2024-08-18T22:41:39.513 INFO:tasks.workunit.client.0.smithi121.stdout:4/607: mknod d2/dc/d16/d22/d2c/d7a/cd8 0 2024-08-18T22:41:39.514 INFO:tasks.workunit.client.1.smithi195.stdout:0/236: mkdir d0/dc/dd/d46 0 2024-08-18T22:41:39.514 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:39.514+0000 7fe8e27fc640 1 -- 172.21.15.121:0/553185674 <== mgr.24377 v2:172.21.15.195:6828/1174410756 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+318 (secure 0 0 0) 0x7fe8d0000bf0 con 0x7fe8d8038b50 2024-08-18T22:41:39.519 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:39.517+0000 7fe8f2bab640 1 -- 172.21.15.121:0/553185674 >> [v2:172.21.15.195:6828/1174410756,v1:172.21.15.195:6829/1174410756] conn(0x7fe8d8038b50 msgr2=0x7fe8d803b000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:41:39.519 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:39.517+0000 7fe8f2bab640 1 --2- 172.21.15.121:0/553185674 >> [v2:172.21.15.195:6828/1174410756,v1:172.21.15.195:6829/1174410756] conn(0x7fe8d8038b50 0x7fe8d803b000 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fe8dc0048a0 tx=0x7fe8dc035040 comp rx=0 tx=0).stop 2024-08-18T22:41:39.519 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:39.517+0000 7fe8f2bab640 1 -- 172.21.15.121:0/553185674 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe8ec06f110 msgr2=0x7fe8ec11c010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:41:39.519 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:39.517+0000 7fe8f2bab640 1 --2- 172.21.15.121:0/553185674 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe8ec06f110 0x7fe8ec11c010 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fe8e800b790 tx=0x7fe8e80091d0 comp rx=0 tx=0).stop 2024-08-18T22:41:39.519 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:39.518+0000 7fe8f2bab640 1 -- 172.21.15.121:0/553185674 shutdown_connections 2024-08-18T22:41:39.519 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:39.518+0000 7fe8f2bab640 1 --2- 172.21.15.121:0/553185674 >> [v2:172.21.15.195:6828/1174410756,v1:172.21.15.195:6829/1174410756] conn(0x7fe8d8038b50 0x7fe8d803b000 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:41:39.519 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:39.518+0000 7fe8f2bab640 1 --2- 172.21.15.121:0/553185674 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe8ec06f110 0x7fe8ec11c010 secure :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fe8e800b790 tx=0x7fe8e80091d0 comp rx=0 tx=0).stop 2024-08-18T22:41:39.519 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:39.518+0000 7fe8f2bab640 1 --2- 172.21.15.121:0/553185674 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe8ec06dd10 0x7fe8ec11bad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:41:39.519 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:39.518+0000 7fe8f2bab640 1 -- 172.21.15.121:0/553185674 >> 172.21.15.121:0/553185674 conn(0x7fe8ec069180 msgr2=0x7fe8ec06a940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:41:39.520 INFO:tasks.workunit.client.1.smithi195.stdout:8/296: dwrite d1/de/f54 [0,4194304] 0 2024-08-18T22:41:39.520 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:39.518+0000 7fe8f2bab640 1 -- 172.21.15.121:0/553185674 shutdown_connections 2024-08-18T22:41:39.520 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:39.519+0000 7fe8f2bab640 1 -- 172.21.15.121:0/553185674 wait complete. 2024-08-18T22:41:39.522 INFO:tasks.workunit.client.0.smithi121.stdout:4/608: dwrite d2/dc/d16/d22/d2c/d7a/fa3 [0,4194304] 0 2024-08-18T22:41:39.523 INFO:tasks.workunit.client.0.smithi121.stdout:4/609: write d2/dc/d16/d59/fa8 [731281,95693] 0 2024-08-18T22:41:39.525 INFO:tasks.workunit.client.0.smithi121.stdout:4/610: write d2/d7c/fab [3330034,126185] 0 2024-08-18T22:41:39.525 INFO:tasks.workunit.client.1.smithi195.stdout:8/297: write d1/d3/f6 [800047,127323] 0 2024-08-18T22:41:39.529 INFO:tasks.workunit.client.0.smithi121.stdout:4/611: creat d2/dc/d16/d22/d29/fd9 x:0 0 0 2024-08-18T22:41:39.531 INFO:tasks.workunit.client.0.smithi121.stdout:2/424: sync 2024-08-18T22:41:39.531 INFO:tasks.workunit.client.0.smithi121.stdout:3/619: sync 2024-08-18T22:41:39.531 INFO:tasks.workunit.client.1.smithi195.stdout:3/261: getdents d7/da/df/d1c 0 2024-08-18T22:41:39.532 INFO:tasks.workunit.client.1.smithi195.stdout:8/298: creat d1/d64/f73 x:0 0 0 2024-08-18T22:41:39.532 INFO:tasks.workunit.client.0.smithi121.stdout:2/425: fsync d2/d8/d19/f52 0 2024-08-18T22:41:39.532 INFO:tasks.workunit.client.0.smithi121.stdout:2/426: stat d2/d3/l44 0 2024-08-18T22:41:39.533 INFO:tasks.workunit.client.0.smithi121.stdout:3/620: chown d1e/d1f/d25/d2e/d36/ddb 74682 1 2024-08-18T22:41:39.533 INFO:tasks.workunit.client.1.smithi195.stdout:3/262: write d7/f18 [1990295,125659] 0 2024-08-18T22:41:39.533 INFO:tasks.workunit.client.0.smithi121.stdout:4/612: write d2/dc/d16/d22/d2c/f84 [3002456,45888] 0 2024-08-18T22:41:39.538 INFO:tasks.workunit.client.1.smithi195.stdout:3/263: rename d7/da/df/d38/c55 to d7/da/df/d38/c5b 0 2024-08-18T22:41:39.538 INFO:tasks.workunit.client.0.smithi121.stdout:2/427: creat d2/d3/d48/f8e x:0 0 0 2024-08-18T22:41:39.538 INFO:tasks.workunit.client.1.smithi195.stdout:3/264: readlink d7/da/l59 0 2024-08-18T22:41:39.539 INFO:tasks.workunit.client.0.smithi121.stdout:2/428: write d2/d3/d48/f8e [795733,129503] 0 2024-08-18T22:41:39.541 INFO:tasks.workunit.client.1.smithi195.stdout:8/299: dwrite d1/d3/d1c/f65 [0,4194304] 0 2024-08-18T22:41:39.541 INFO:tasks.workunit.client.1.smithi195.stdout:3/265: write d7/da/df/d38/f45 [803764,103052] 0 2024-08-18T22:41:39.545 INFO:tasks.workunit.client.0.smithi121.stdout:4/613: creat d2/dc/d16/d22/d2c/d7a/da0/dcc/fda x:0 0 0 2024-08-18T22:41:39.547 INFO:tasks.workunit.client.1.smithi195.stdout:3/266: getdents d7/d1f 0 2024-08-18T22:41:39.548 INFO:tasks.workunit.client.1.smithi195.stdout:3/267: dread - d7/f51 zero size 2024-08-18T22:41:39.549 INFO:tasks.workunit.client.1.smithi195.stdout:8/300: dwrite d1/de/f54 [0,4194304] 0 2024-08-18T22:41:39.551 INFO:tasks.workunit.client.0.smithi121.stdout:3/621: truncate d1e/d1f/da6/dc7/dae/fc2 591225 0 2024-08-18T22:41:39.551 INFO:tasks.workunit.client.1.smithi195.stdout:3/268: getdents d7/da/df/d47 0 2024-08-18T22:41:39.553 INFO:tasks.workunit.client.0.smithi121.stdout:4/614: mkdir d2/dc/d1c/dc1/ddb 0 2024-08-18T22:41:39.556 INFO:tasks.workunit.client.1.smithi195.stdout:3/269: creat d7/f5c x:0 0 0 2024-08-18T22:41:39.557 INFO:tasks.workunit.client.0.smithi121.stdout:4/615: write d2/dc/d16/d22/d2c/d44/d66/f6d [380290,113430] 0 2024-08-18T22:41:39.560 INFO:tasks.workunit.client.0.smithi121.stdout:3/622: dwrite d1e/d1f/d25/d2e/d36/f37 [0,4194304] 0 2024-08-18T22:41:39.561 INFO:tasks.workunit.client.1.smithi195.stdout:8/301: dwrite d1/d3/db/d39/f59 [0,4194304] 0 2024-08-18T22:41:39.565 INFO:tasks.workunit.client.0.smithi121.stdout:3/623: mkdir d1e/d1f/d25/d6b/db4/d94/de6 0 2024-08-18T22:41:39.568 INFO:tasks.workunit.client.1.smithi195.stdout:3/270: dwrite d7/da/df/d38/f45 [0,4194304] 0 2024-08-18T22:41:39.568 INFO:tasks.workunit.client.1.smithi195.stdout:3/271: stat f6 0 2024-08-18T22:41:39.570 INFO:tasks.workunit.client.1.smithi195.stdout:8/302: truncate d1/de/df/d1d/f6e 7900412 0 2024-08-18T22:41:39.576 INFO:tasks.workunit.client.1.smithi195.stdout:8/303: getdents d1/d3/d1c/d49 0 2024-08-18T22:41:39.581 INFO:tasks.workunit.client.1.smithi195.stdout:3/272: dwrite d7/d1f/f26 [0,4194304] 0 2024-08-18T22:41:39.582 INFO:tasks.workunit.client.0.smithi121.stdout:2/429: dread d2/d3/d48/d77/f3b [4194304,4194304] 0 2024-08-18T22:41:39.584 INFO:tasks.workunit.client.0.smithi121.stdout:2/430: symlink d2/d73/l8f 0 2024-08-18T22:41:39.585 INFO:tasks.workunit.client.1.smithi195.stdout:3/273: rmdir d7/da/df 39 2024-08-18T22:41:39.585 INFO:tasks.workunit.client.0.smithi121.stdout:2/431: fsync d2/d8/d1f/f35 0 2024-08-18T22:41:39.586 INFO:tasks.workunit.client.0.smithi121.stdout:4/616: dread d2/dc/d16/d22/f3d [0,4194304] 0 2024-08-18T22:41:39.588 INFO:tasks.workunit.client.0.smithi121.stdout:4/617: chown d2/dc/d16/d22/l27 98 1 2024-08-18T22:41:39.588 INFO:tasks.workunit.client.1.smithi195.stdout:3/274: fsync d7/da/df/d1c/f41 0 2024-08-18T22:41:39.589 INFO:tasks.workunit.client.0.smithi121.stdout:2/432: creat d2/d8/d19/d4a/d64/f90 x:0 0 0 2024-08-18T22:41:39.590 INFO:tasks.workunit.client.1.smithi195.stdout:8/304: link d1/d3/l2d d1/d3/db/d35/d4d/d5c/l74 0 2024-08-18T22:41:39.590 INFO:tasks.workunit.client.1.smithi195.stdout:3/275: mknod d7/da/d4d/c5d 0 2024-08-18T22:41:39.593 INFO:tasks.workunit.client.0.smithi121.stdout:2/433: mkdir d2/d3/d51/d91 0 2024-08-18T22:41:39.594 INFO:tasks.workunit.client.0.smithi121.stdout:2/434: readlink d2/d8/d19/d55/l82 0 2024-08-18T22:41:39.596 INFO:tasks.workunit.client.0.smithi121.stdout:2/435: dread d2/d3/f49 [0,4194304] 0 2024-08-18T22:41:39.598 INFO:tasks.workunit.client.1.smithi195.stdout:8/305: dwrite d1/de/df/d1d/f3e [0,4194304] 0 2024-08-18T22:41:39.599 INFO:tasks.workunit.client.0.smithi121.stdout:2/436: fdatasync d2/d3/d48/d77/f3b 0 2024-08-18T22:41:39.600 INFO:tasks.workunit.client.0.smithi121.stdout:2/437: chown d2/d3/d48 25 1 2024-08-18T22:41:39.601 INFO:tasks.workunit.client.0.smithi121.stdout:3/624: truncate d1e/d1f/d25/d6b/f59 284638 0 2024-08-18T22:41:39.604 INFO:tasks.workunit.client.1.smithi195.stdout:8/306: mknod d1/d3/db/d35/c75 0 2024-08-18T22:41:39.606 INFO:tasks.workunit.client.0.smithi121.stdout:3/625: creat d1e/d1f/d2a/fe7 x:0 0 0 2024-08-18T22:41:39.607 INFO:tasks.workunit.client.0.smithi121.stdout:2/438: dread d2/d3/d48/f8e [0,4194304] 0 2024-08-18T22:41:39.608 INFO:tasks.workunit.client.1.smithi195.stdout:8/307: creat d1/d3/db/d35/d56/f76 x:0 0 0 2024-08-18T22:41:39.609 INFO:tasks.workunit.client.1.smithi195.stdout:3/276: dread d7/f9 [0,4194304] 0 2024-08-18T22:41:39.609 INFO:tasks.workunit.client.1.smithi195.stdout:8/308: fdatasync d1/f2a 0 2024-08-18T22:41:39.612 INFO:tasks.workunit.client.1.smithi195.stdout:3/277: creat d7/d1f/d49/f5e x:0 0 0 2024-08-18T22:41:39.612 INFO:tasks.workunit.client.1.smithi195.stdout:8/309: truncate d1/d3/db/d35/f47 556188 0 2024-08-18T22:41:39.613 INFO:tasks.workunit.client.0.smithi121.stdout:2/439: creat d2/f92 x:0 0 0 2024-08-18T22:41:39.614 INFO:tasks.workunit.client.0.smithi121.stdout:3/626: dwrite d1e/d1f/d25/d74/fdf [0,4194304] 0 2024-08-18T22:41:39.614 INFO:tasks.workunit.client.1.smithi195.stdout:8/310: write d1/d3/d1c/d21/f28 [3839754,95933] 0 2024-08-18T22:41:39.616 INFO:tasks.workunit.client.1.smithi195.stdout:3/278: truncate d7/da/df/f1a 1008754 0 2024-08-18T22:41:39.617 INFO:tasks.workunit.client.0.smithi121.stdout:3/627: chown d1e/d1f/d5e/d9a/c9d 547779361 1 2024-08-18T22:41:39.617 INFO:tasks.workunit.client.1.smithi195.stdout:3/279: rmdir d7/d1f 39 2024-08-18T22:41:39.619 INFO:tasks.workunit.client.1.smithi195.stdout:3/280: read d7/f17 [2670788,126355] 0 2024-08-18T22:41:39.620 INFO:tasks.workunit.client.0.smithi121.stdout:3/628: mknod d1e/d1f/d25/d67/d92/da0/ce8 0 2024-08-18T22:41:39.621 INFO:tasks.workunit.client.1.smithi195.stdout:3/281: chown d7/da/df 155984 1 2024-08-18T22:41:39.626 INFO:tasks.workunit.client.0.smithi121.stdout:3/629: symlink d1e/d1f/d25/d58/le9 0 2024-08-18T22:41:39.626 INFO:tasks.workunit.client.0.smithi121.stdout:3/630: mknod d1e/d1f/d25/d58/d75/cea 0 2024-08-18T22:41:39.626 INFO:tasks.workunit.client.1.smithi195.stdout:8/311: rename d1/de/df/d1d/d1f/f66 to d1/d3/db/d39/d2e/f77 0 2024-08-18T22:41:39.627 INFO:tasks.workunit.client.1.smithi195.stdout:8/312: chown d1/d3/db/fd 47 1 2024-08-18T22:41:39.629 INFO:tasks.workunit.client.1.smithi195.stdout:3/282: creat d7/da/df/f5f x:0 0 0 2024-08-18T22:41:39.631 INFO:tasks.workunit.client.0.smithi121.stdout:3/631: dwrite d1e/d1f/d5e/d9a/fcf [0,4194304] 0 2024-08-18T22:41:39.632 INFO:tasks.workunit.client.1.smithi195.stdout:3/283: creat d7/d1f/f60 x:0 0 0 2024-08-18T22:41:39.635 INFO:tasks.workunit.client.0.smithi121.stdout:3/632: creat d1e/d1f/d25/d2e/d36/ddb/feb x:0 0 0 2024-08-18T22:41:39.640 INFO:tasks.workunit.client.1.smithi195.stdout:3/284: fsync d7/da/df/f5f 0 2024-08-18T22:41:39.644 INFO:tasks.workunit.client.0.smithi121.stdout:3/633: write d1e/d1f/d25/d58/f87 [1088986,120483] 0 2024-08-18T22:41:39.647 INFO:tasks.workunit.client.0.smithi121.stdout:3/634: creat d1e/d1f/d3e/fec x:0 0 0 2024-08-18T22:41:39.649 INFO:tasks.workunit.client.0.smithi121.stdout:3/635: creat d1e/d1f/d5e/d9a/dda/fed x:0 0 0 2024-08-18T22:41:39.652 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:39.651+0000 7f008b744640 1 -- 172.21.15.121:0/2923182620 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f00840ff410 msgr2=0x7f00841017f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:41:39.652 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:39.651+0000 7f008b744640 1 --2- 172.21.15.121:0/2923182620 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f00840ff410 0x7f00841017f0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f00780048d0 tx=0x7f0078009da0 comp rx=0 tx=0).stop 2024-08-18T22:41:39.652 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:39.651+0000 7f008b744640 1 -- 172.21.15.121:0/2923182620 shutdown_connections 2024-08-18T22:41:39.652 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:39.651+0000 7f008b744640 1 --2- 172.21.15.121:0/2923182620 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f00840ff410 0x7f00841017f0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:41:39.652 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:39.651+0000 7f008b744640 1 --2- 172.21.15.121:0/2923182620 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0084066270 0x7f00840feed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:41:39.652 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:39.651+0000 7f008b744640 1 -- 172.21.15.121:0/2923182620 >> 172.21.15.121:0/2923182620 conn(0x7f00840f69a0 msgr2=0x7f00840f8db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:41:39.652 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:39.651+0000 7f008b744640 1 -- 172.21.15.121:0/2923182620 shutdown_connections 2024-08-18T22:41:39.652 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:39.651+0000 7f008b744640 1 -- 172.21.15.121:0/2923182620 wait complete. 2024-08-18T22:41:39.653 INFO:tasks.workunit.client.0.smithi121.stdout:3/636: rename d1e/f9c to d1e/d1f/d25/d74/d97/fee 0 2024-08-18T22:41:39.654 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:39.651+0000 7f008b744640 1 Processor -- start 2024-08-18T22:41:39.654 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:39.652+0000 7f008b744640 1 -- start start 2024-08-18T22:41:39.655 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:39.652+0000 7f008b744640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0084066270 0x7f0084113470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:41:39.655 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:39.652+0000 7f008b744640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f00840ff410 0x7f00841139b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:41:39.655 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:39.652+0000 7f008b744640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0084114000 con 0x7f0084066270 2024-08-18T22:41:39.655 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:39.652+0000 7f008b744640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00841147d0 con 0x7f00840ff410 2024-08-18T22:41:39.655 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:39.652+0000 7f00894e0640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0084066270 0x7f0084113470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:41:39.655 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:39.652+0000 7f0088cdf640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f00840ff410 0x7f00841139b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:41:39.655 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:39.652+0000 7f0088cdf640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f00840ff410 0x7f00841139b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.121:35000/0 (socket says 172.21.15.121:35000) 2024-08-18T22:41:39.655 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:39.652+0000 7f0088cdf640 1 -- 172.21.15.121:0/4002841145 learned_addr learned my addr 172.21.15.121:0/4002841145 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-18T22:41:39.655 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:39.652+0000 7f00894e0640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0084066270 0x7f0084113470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:58936/0 (socket says 172.21.15.121:58936) 2024-08-18T22:41:39.655 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:39.653+0000 7f0088cdf640 1 -- 172.21.15.121:0/4002841145 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0084066270 msgr2=0x7f0084113470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:41:39.655 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:39.653+0000 7f0088cdf640 1 --2- 172.21.15.121:0/4002841145 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0084066270 0x7f0084113470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:41:39.655 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:39.653+0000 7f0088cdf640 1 -- 172.21.15.121:0/4002841145 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0078005040 con 0x7f00840ff410 2024-08-18T22:41:39.656 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:39.653+0000 7f00894e0640 1 --2- 172.21.15.121:0/4002841145 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0084066270 0x7f0084113470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:41:39.656 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:39.653+0000 7f0088cdf640 1 --2- 172.21.15.121:0/4002841145 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f00840ff410 0x7f00841139b0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f00780048a0 tx=0x7f0078009da0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:41:39.656 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:39.653+0000 7f0075ffb640 1 -- 172.21.15.121:0/4002841145 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0078038070 con 0x7f00840ff410 2024-08-18T22:41:39.656 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:39.653+0000 7f0075ffb640 1 -- 172.21.15.121:0/4002841145 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f0078004290 con 0x7f00840ff410 2024-08-18T22:41:39.656 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:39.653+0000 7f0075ffb640 1 -- 172.21.15.121:0/4002841145 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0078033660 con 0x7f00840ff410 2024-08-18T22:41:39.656 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:39.653+0000 7f008b744640 1 -- 172.21.15.121:0/4002841145 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0084114a00 con 0x7f00840ff410 2024-08-18T22:41:39.656 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:39.654+0000 7f008b744640 1 -- 172.21.15.121:0/4002841145 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0084114fa0 con 0x7f00840ff410 2024-08-18T22:41:39.656 INFO:tasks.workunit.client.0.smithi121.stdout:3/637: symlink d1e/d1f/d25/d6b/d83/lef 0 2024-08-18T22:41:39.657 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:39.655+0000 7f0075ffb640 1 -- 172.21.15.121:0/4002841145 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 22) v1 ==== 45945+0+0 (secure 0 0 0) 0x7f0078030020 con 0x7f00840ff410 2024-08-18T22:41:39.657 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:39.655+0000 7f008b744640 1 -- 172.21.15.121:0/4002841145 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00840fa620 con 0x7f00840ff410 2024-08-18T22:41:39.657 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:39.655+0000 7f0075ffb640 1 --2- 172.21.15.121:0/4002841145 >> [v2:172.21.15.195:6828/1174410756,v1:172.21.15.195:6829/1174410756] conn(0x7f0070038ab0 0x7f007003af60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:41:39.657 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:39.655+0000 7f0075ffb640 1 -- 172.21.15.121:0/4002841145 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f007806c600 con 0x7f00840ff410 2024-08-18T22:41:39.658 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:39.655+0000 7f00894e0640 1 --2- 172.21.15.121:0/4002841145 >> [v2:172.21.15.195:6828/1174410756,v1:172.21.15.195:6829/1174410756] conn(0x7f0070038ab0 0x7f007003af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:41:39.658 INFO:tasks.workunit.client.0.smithi121.stdout:3/638: symlink d1e/d1f/d3e/lf0 0 2024-08-18T22:41:39.658 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:39.656+0000 7f00894e0640 1 --2- 172.21.15.121:0/4002841145 >> [v2:172.21.15.195:6828/1174410756,v1:172.21.15.195:6829/1174410756] conn(0x7f0070038ab0 0x7f007003af60 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f0080004fd0 tx=0x7f008000b040 comp rx=0 tx=0).ready entity=mgr.24377 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:41:39.659 INFO:tasks.workunit.client.0.smithi121.stdout:3/639: symlink d1e/d1f/d25/d6b/d66/dd9/lf1 0 2024-08-18T22:41:39.661 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:39.660+0000 7f0075ffb640 1 -- 172.21.15.121:0/4002841145 <== mon.1 v2:172.21.15.195:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7f007802c870 con 0x7f00840ff410 2024-08-18T22:41:39.665 INFO:tasks.workunit.client.0.smithi121.stdout:3/640: dwrite d1e/d1f/d25/d2e/f91 [4194304,4194304] 0 2024-08-18T22:41:39.681 INFO:tasks.workunit.client.0.smithi121.stdout:3/641: dread d1e/d1f/d3e/f79 [0,4194304] 0 2024-08-18T22:41:39.682 INFO:tasks.workunit.client.0.smithi121.stdout:3/642: write d1e/d1f/d25/d2e/f91 [3142766,68732] 0 2024-08-18T22:41:39.683 INFO:tasks.workunit.client.1.smithi195.stdout:9/287: sync 2024-08-18T22:41:39.683 INFO:tasks.workunit.client.1.smithi195.stdout:9/288: fdatasync d1c/f44 0 2024-08-18T22:41:39.684 INFO:tasks.workunit.client.0.smithi121.stdout:3/643: truncate d1e/d1f/d25/d2e/d36/ddb/feb 352916 0 2024-08-18T22:41:39.685 INFO:tasks.workunit.client.0.smithi121.stdout:3/644: stat d1e/d1f/d25/d58/d75/fa9 0 2024-08-18T22:41:39.685 INFO:tasks.workunit.client.0.smithi121.stdout:3/645: stat d1e/d1f/d25/d2e/c35 0 2024-08-18T22:41:39.688 INFO:tasks.workunit.client.1.smithi195.stdout:9/289: dread f17 [0,4194304] 0 2024-08-18T22:41:39.688 INFO:tasks.workunit.client.1.smithi195.stdout:9/290: fdatasync f3 0 2024-08-18T22:41:39.689 INFO:tasks.workunit.client.0.smithi121.stdout:3/646: rename d1e/d1f/d25/d6b/d66/fd1 to d1e/d1f/d25/d2e/d36/d5f/dd2/ff2 0 2024-08-18T22:41:39.690 INFO:tasks.workunit.client.1.smithi195.stdout:9/291: dread d1c/d32/f43 [0,4194304] 0 2024-08-18T22:41:39.692 INFO:tasks.workunit.client.0.smithi121.stdout:3/647: getdents d1e/d1f/d25/d2e/d36/d5f 0 2024-08-18T22:41:39.693 INFO:tasks.workunit.client.1.smithi195.stdout:9/292: dread d1c/f3c [0,4194304] 0 2024-08-18T22:41:39.694 INFO:tasks.workunit.client.1.smithi195.stdout:9/293: chown f13 15516 1 2024-08-18T22:41:39.696 INFO:tasks.workunit.client.0.smithi121.stdout:3/648: rmdir d1e/d1f/d25/d6b 39 2024-08-18T22:41:39.702 INFO:tasks.workunit.client.0.smithi121.stdout:3/649: dwrite d1e/d1f/d25/f54 [0,4194304] 0 2024-08-18T22:41:39.705 INFO:tasks.workunit.client.0.smithi121.stdout:3/650: creat d1e/d1f/da6/dc7/dae/ff3 x:0 0 0 2024-08-18T22:41:39.707 INFO:tasks.workunit.client.0.smithi121.stdout:3/651: creat d1e/d1f/d25/d58/d75/ff4 x:0 0 0 2024-08-18T22:41:39.711 INFO:tasks.workunit.client.1.smithi195.stdout:9/294: dread fd [0,4194304] 0 2024-08-18T22:41:39.714 INFO:tasks.workunit.client.1.smithi195.stdout:9/295: symlink d1c/d32/l57 0 2024-08-18T22:41:39.715 INFO:tasks.workunit.client.0.smithi121.stdout:3/652: dwrite d1e/d1f/d25/d2e/d36/ddb/feb [0,4194304] 0 2024-08-18T22:41:39.717 INFO:tasks.workunit.client.1.smithi195.stdout:9/296: creat d1c/f58 x:0 0 0 2024-08-18T22:41:39.717 INFO:tasks.workunit.client.1.smithi195.stdout:9/297: rename d1c/d32 to d1c/d32/d37/d59 22 2024-08-18T22:41:39.718 INFO:tasks.workunit.client.1.smithi195.stdout:9/298: fsync f15 0 2024-08-18T22:41:39.719 INFO:tasks.workunit.client.0.smithi121.stdout:3/653: creat d1e/ff5 x:0 0 0 2024-08-18T22:41:39.721 INFO:tasks.workunit.client.1.smithi195.stdout:9/299: mknod d1c/d32/c5a 0 2024-08-18T22:41:39.722 INFO:tasks.workunit.client.0.smithi121.stdout:3/654: rename d1e/d1f/d25/d67/d92/da0 to d1e/d1f/dba/df6 0 2024-08-18T22:41:39.723 INFO:tasks.workunit.client.1.smithi195.stdout:9/300: creat d1c/d32/d37/f5b x:0 0 0 2024-08-18T22:41:39.724 INFO:tasks.workunit.client.0.smithi121.stdout:3/655: fdatasync d1e/d1f/d25/d2e/d36/d5f/dd2/ff2 0 2024-08-18T22:41:39.730 INFO:tasks.workunit.client.0.smithi121.stdout:3/656: write d1e/d1f/f3a [3017550,122363] 0 2024-08-18T22:41:39.731 INFO:tasks.workunit.client.0.smithi121.stdout:3/657: chown d1e/d1f/d25/d58/d75/lb9 24533 1 2024-08-18T22:41:39.733 INFO:tasks.workunit.client.1.smithi195.stdout:9/301: getdents d1c/d32/d37 0 2024-08-18T22:41:39.734 INFO:tasks.workunit.client.0.smithi121.stdout:3/658: dread d1e/d1f/d25/f54 [0,4194304] 0 2024-08-18T22:41:39.734 INFO:tasks.workunit.client.1.smithi195.stdout:9/302: mknod d1c/d32/c5c 0 2024-08-18T22:41:39.737 INFO:tasks.workunit.client.1.smithi195.stdout:9/303: rename d1c/d32/f43 to d1c/d32/d37/d4b/f5d 0 2024-08-18T22:41:39.738 INFO:tasks.workunit.client.1.smithi195.stdout:9/304: mknod d1c/c5e 0 2024-08-18T22:41:39.807 INFO:tasks.workunit.client.0.smithi121.stdout:8/677: sync 2024-08-18T22:41:39.812 INFO:tasks.workunit.client.0.smithi121.stdout:8/678: link d6/d1e/d2d/f7f d6/dd/d3b/fe8 0 2024-08-18T22:41:39.814 INFO:tasks.workunit.client.0.smithi121.stdout:8/679: write d6/d1e/d2d/d78/d85/fad [840600,112901] 0 2024-08-18T22:41:39.817 INFO:tasks.workunit.client.0.smithi121.stdout:8/680: write d6/dd/d3b/da3/dca/d60/d5b/d6e/fab [466524,107086] 0 2024-08-18T22:41:39.819 INFO:tasks.workunit.client.0.smithi121.stdout:8/681: mkdir d6/dd/d25/dc8/de9 0 2024-08-18T22:41:39.820 INFO:tasks.workunit.client.0.smithi121.stdout:8/682: stat d6/d1e/d2d/d78/d45/dd9 0 2024-08-18T22:41:39.827 INFO:tasks.workunit.client.0.smithi121.stdout:8/683: dwrite d6/dd/d3b/da3/dca/d60/f66 [0,4194304] 0 2024-08-18T22:41:39.829 INFO:tasks.workunit.client.0.smithi121.stdout:8/684: write d6/fde [410192,728] 0 2024-08-18T22:41:39.833 INFO:tasks.workunit.client.0.smithi121.stdout:8/685: creat d6/d1e/d2d/d78/d85/fea x:0 0 0 2024-08-18T22:41:39.835 INFO:tasks.workunit.client.0.smithi121.stdout:8/686: creat d6/dd/dcc/de7/feb x:0 0 0 2024-08-18T22:41:39.843 INFO:tasks.workunit.client.0.smithi121.stdout:8/687: read d6/dd/d25/dda/fe6 [4117,79831] 0 2024-08-18T22:41:39.844 INFO:tasks.workunit.client.0.smithi121.stdout:8/688: dread - d6/dd/d25/fe2 zero size 2024-08-18T22:41:39.845 INFO:tasks.workunit.client.0.smithi121.stdout:8/689: dread - d6/dd/dcc/de7/feb zero size 2024-08-18T22:41:39.847 INFO:tasks.workunit.client.0.smithi121.stdout:8/690: creat d6/dd/d3b/da3/dca/fec x:0 0 0 2024-08-18T22:41:39.849 INFO:tasks.workunit.client.0.smithi121.stdout:8/691: mkdir d6/d1e/d2d/d78/d45/d86/ded 0 2024-08-18T22:41:39.850 INFO:tasks.workunit.client.0.smithi121.stdout:8/692: dread - d6/d1e/fc1 zero size 2024-08-18T22:41:39.851 INFO:tasks.workunit.client.0.smithi121.stdout:8/693: chown d6/dd/d3b/f64 272506 1 2024-08-18T22:41:39.857 INFO:tasks.workunit.client.0.smithi121.stdout:8/694: dread - d6/dd/d3b/da3/dca/d60/fd5 zero size 2024-08-18T22:41:39.859 INFO:tasks.workunit.client.0.smithi121.stdout:8/695: symlink d6/dd/d3b/da3/lee 0 2024-08-18T22:41:39.860 INFO:tasks.workunit.client.0.smithi121.stdout:8/696: write d6/dd/d3b/da3/dca/d60/f66 [2953541,47566] 0 2024-08-18T22:41:39.866 INFO:tasks.workunit.client.1.smithi195.stdout:2/186: sync 2024-08-18T22:41:39.866 INFO:tasks.workunit.client.1.smithi195.stdout:1/355: sync 2024-08-18T22:41:39.866 INFO:tasks.workunit.client.1.smithi195.stdout:7/154: sync 2024-08-18T22:41:39.866 INFO:tasks.workunit.client.1.smithi195.stdout:4/267: sync 2024-08-18T22:41:39.867 INFO:tasks.workunit.client.0.smithi121.stdout:8/697: dwrite d6/dd/d25/d56/fdc [0,4194304] 0 2024-08-18T22:41:39.868 INFO:tasks.workunit.client.1.smithi195.stdout:4/268: unlink d0/l13 0 2024-08-18T22:41:39.869 INFO:tasks.workunit.client.0.smithi121.stdout:8/698: stat d6/d1e/d2d 0 2024-08-18T22:41:39.869 INFO:tasks.workunit.client.1.smithi195.stdout:4/269: chown d0/d9/d11/d16/f4f 325664115 1 2024-08-18T22:41:39.872 INFO:tasks.workunit.client.0.smithi121.stdout:8/699: symlink d6/dd/d25/d56/lef 0 2024-08-18T22:41:39.876 INFO:tasks.workunit.client.0.smithi121.stdout:8/700: rmdir d6/dd/d3b/da3/dca/d18/d83 39 2024-08-18T22:41:39.876 INFO:tasks.workunit.client.1.smithi195.stdout:7/155: dwrite dc/d1d/d29/f34 [0,4194304] 0 2024-08-18T22:41:39.877 INFO:tasks.workunit.client.0.smithi121.stdout:0/512: sync 2024-08-18T22:41:39.878 INFO:tasks.workunit.client.1.smithi195.stdout:1/356: dread da/d18/f42 [0,4194304] 0 2024-08-18T22:41:39.878 INFO:tasks.workunit.client.0.smithi121.stdout:8/701: write d6/d20/d69/f9b [1043892,23212] 0 2024-08-18T22:41:39.879 INFO:tasks.workunit.client.0.smithi121.stdout:8/702: dread - d6/dd/d25/dc8/fd3 zero size 2024-08-18T22:41:39.879 INFO:tasks.workunit.client.0.smithi121.stdout:8/703: chown d6/d20/d69/cb1 8089114 1 2024-08-18T22:41:39.881 INFO:tasks.workunit.client.1.smithi195.stdout:4/270: dwrite d0/f4a [0,4194304] 0 2024-08-18T22:41:39.883 INFO:tasks.workunit.client.0.smithi121.stdout:0/513: getdents d1/d4/d53/da7 0 2024-08-18T22:41:39.884 INFO:tasks.workunit.client.1.smithi195.stdout:7/156: creat dc/d14/d15/d17/d18/f3f x:0 0 0 2024-08-18T22:41:39.884 INFO:tasks.workunit.client.0.smithi121.stdout:8/704: readlink d6/dd/d3b/da3/dca/d18/d83/ldf 0 2024-08-18T22:41:39.885 INFO:tasks.workunit.client.0.smithi121.stdout:0/514: write d1/d8a/fa9 [1180327,21279] 0 2024-08-18T22:41:39.886 INFO:tasks.workunit.client.1.smithi195.stdout:1/357: write da/d18/d28/d31/f45 [4964709,62961] 0 2024-08-18T22:41:39.888 INFO:tasks.workunit.client.1.smithi195.stdout:2/187: dwrite d1/d24/d26/f2b [0,4194304] 0 2024-08-18T22:41:39.889 INFO:tasks.workunit.client.1.smithi195.stdout:4/271: symlink d0/d7/l58 0 2024-08-18T22:41:39.891 INFO:tasks.workunit.client.0.smithi121.stdout:8/705: symlink d6/dd/d25/lf0 0 2024-08-18T22:41:39.891 INFO:tasks.workunit.client.1.smithi195.stdout:7/157: stat c6 0 2024-08-18T22:41:39.892 INFO:tasks.workunit.client.0.smithi121.stdout:0/515: truncate d1/d4/db/f7d 4930020 0 2024-08-18T22:41:39.895 INFO:tasks.workunit.client.0.smithi121.stdout:8/706: creat d6/dd/dcc/de7/ff1 x:0 0 0 2024-08-18T22:41:39.897 INFO:tasks.workunit.client.0.smithi121.stdout:0/516: symlink d1/d4/db/d24/d30/d52/d90/lb0 0 2024-08-18T22:41:39.899 INFO:tasks.workunit.client.1.smithi195.stdout:4/272: dwrite d0/d9/f57 [0,4194304] 0 2024-08-18T22:41:39.902 INFO:tasks.workunit.client.1.smithi195.stdout:7/158: rename dc/d22/l28 to dc/d22/l40 0 2024-08-18T22:41:39.905 INFO:tasks.workunit.client.1.smithi195.stdout:7/159: read - dc/d22/f39 zero size 2024-08-18T22:41:39.907 INFO:tasks.workunit.client.0.smithi121.stdout:0/517: dwrite d1/d4/db/d24/d30/d52/d90/f98 [0,4194304] 0 2024-08-18T22:41:39.909 INFO:tasks.workunit.client.1.smithi195.stdout:7/160: creat dc/d1d/d29/f41 x:0 0 0 2024-08-18T22:41:39.910 INFO:tasks.workunit.client.1.smithi195.stdout:1/358: truncate da/d18/d28/d31/f45 547530 0 2024-08-18T22:41:39.912 INFO:tasks.workunit.client.1.smithi195.stdout:4/273: dwrite d0/d7/d1d/f28 [0,4194304] 0 2024-08-18T22:41:39.912 INFO:tasks.workunit.client.1.smithi195.stdout:1/359: stat da/f15 0 2024-08-18T22:41:39.912 INFO:tasks.workunit.client.0.smithi121.stdout:0/518: fsync d1/d4/db/d18/d40/f96 0 2024-08-18T22:41:39.914 INFO:tasks.workunit.client.0.smithi121.stdout:0/519: rename d1/d4/db/d24/d30/d52 to d1/d4/db/d24/d30/d52/d5b/da5/db1 22 2024-08-18T22:41:39.915 INFO:tasks.workunit.client.1.smithi195.stdout:4/274: stat d0/d7/l19 0 2024-08-18T22:41:39.917 INFO:tasks.workunit.client.1.smithi195.stdout:1/360: truncate da/d18/d28/d31/d3b/d4e/f6b 568422 0 2024-08-18T22:41:39.918 INFO:tasks.workunit.client.0.smithi121.stdout:0/520: creat d1/d4/db/d24/df/d8/fb2 x:0 0 0 2024-08-18T22:41:39.921 INFO:tasks.workunit.client.0.smithi121.stdout:0/521: creat d1/d4/db/d24/fb3 x:0 0 0 2024-08-18T22:41:39.921 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:39.920+0000 7f008b744640 1 -- 172.21.15.121:0/4002841145 --> [v2:172.21.15.195:6828/1174410756,v1:172.21.15.195:6829/1174410756] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f0084104e40 con 0x7f0070038ab0 2024-08-18T22:41:39.921 INFO:tasks.workunit.client.1.smithi195.stdout:4/275: unlink d0/d9/d11/d16/f56 0 2024-08-18T22:41:39.923 INFO:tasks.workunit.client.1.smithi195.stdout:4/276: stat d0/d9/l32 0 2024-08-18T22:41:39.924 INFO:tasks.workunit.client.1.smithi195.stdout:4/277: chown d0/d9/l32 15 1 2024-08-18T22:41:39.927 INFO:tasks.workunit.client.1.smithi195.stdout:1/361: creat da/d18/d28/d7b/f7e x:0 0 0 2024-08-18T22:41:39.929 INFO:tasks.workunit.client.1.smithi195.stdout:7/161: rmdir dc 39 2024-08-18T22:41:39.932 INFO:tasks.workunit.client.0.smithi121.stdout:8/707: dread d6/d1e/f3f [0,4194304] 0 2024-08-18T22:41:39.933 INFO:tasks.workunit.client.1.smithi195.stdout:4/278: mknod d0/d7/c59 0 2024-08-18T22:41:39.933 INFO:tasks.workunit.client.1.smithi195.stdout:2/188: dread d1/d8/f25 [0,4194304] 0 2024-08-18T22:41:39.933 INFO:tasks.workunit.client.0.smithi121.stdout:8/708: chown d6/d1e/d2d 6558215 1 2024-08-18T22:41:39.935 INFO:tasks.workunit.client.0.smithi121.stdout:8/709: write d6/f8 [4571204,14670] 0 2024-08-18T22:41:39.936 INFO:tasks.workunit.client.1.smithi195.stdout:7/162: dread - dc/d14/d2b/f3a zero size 2024-08-18T22:41:39.937 INFO:tasks.workunit.client.1.smithi195.stdout:4/279: creat d0/d9/d3b/f5a x:0 0 0 2024-08-18T22:41:39.938 INFO:tasks.workunit.client.1.smithi195.stdout:1/362: symlink da/d18/d43/l7f 0 2024-08-18T22:41:39.940 INFO:tasks.workunit.client.1.smithi195.stdout:2/189: creat d1/d8/d3d/d3b/f3f x:0 0 0 2024-08-18T22:41:39.940 INFO:tasks.workunit.client.1.smithi195.stdout:1/363: read da/f53 [611592,79039] 0 2024-08-18T22:41:39.941 INFO:tasks.workunit.client.1.smithi195.stdout:4/280: creat d0/d9/d3b/f5b x:0 0 0 2024-08-18T22:41:39.942 INFO:tasks.workunit.client.0.smithi121.stdout:0/522: write d1/d4/db/d24/df/d8/fb2 [152824,24039] 0 2024-08-18T22:41:39.945 INFO:tasks.workunit.client.0.smithi121.stdout:8/710: dwrite d6/dd/d3b/da3/dca/d60/d5b/d6e/fbe [8388608,4194304] 0 2024-08-18T22:41:39.947 INFO:tasks.workunit.client.0.smithi121.stdout:0/523: read d1/d4/db/d24/df/d8/d78/f7a [388434,19702] 0 2024-08-18T22:41:39.949 INFO:tasks.workunit.client.0.smithi121.stdout:0/524: dread - d1/d4/db/d24/d30/f86 zero size 2024-08-18T22:41:39.949 INFO:tasks.workunit.client.1.smithi195.stdout:2/190: dread d1/f1b [0,4194304] 0 2024-08-18T22:41:39.950 INFO:tasks.workunit.client.1.smithi195.stdout:4/281: dread d0/d9/d11/d16/f55 [0,4194304] 0 2024-08-18T22:41:39.952 INFO:tasks.workunit.client.0.smithi121.stdout:8/711: unlink d6/dd/d3b/da3/dca/f40 0 2024-08-18T22:41:39.954 INFO:tasks.workunit.client.0.smithi121.stdout:8/712: truncate d6/d1e/d2d/d78/d45/f53 4733047 0 2024-08-18T22:41:39.954 INFO:tasks.workunit.client.1.smithi195.stdout:7/163: dread dc/f10 [0,4194304] 0 2024-08-18T22:41:39.955 INFO:tasks.workunit.client.0.smithi121.stdout:0/525: symlink d1/d4/db/d24/d30/lb4 0 2024-08-18T22:41:39.957 INFO:tasks.workunit.client.1.smithi195.stdout:1/364: truncate da/d18/d28/d31/d3b/f3c 168974 0 2024-08-18T22:41:39.959 INFO:tasks.workunit.client.1.smithi195.stdout:4/282: rename d0/d9/f1c to d0/d9/d11/d16/d54/f5c 0 2024-08-18T22:41:39.960 INFO:tasks.workunit.client.1.smithi195.stdout:7/164: creat dc/d14/d15/f42 x:0 0 0 2024-08-18T22:41:39.962 INFO:tasks.workunit.client.1.smithi195.stdout:2/191: dwrite d1/d22/f31 [0,4194304] 0 2024-08-18T22:41:39.965 INFO:tasks.workunit.client.1.smithi195.stdout:5/167: sync 2024-08-18T22:41:39.966 INFO:tasks.workunit.client.0.smithi121.stdout:0/526: dwrite d1/f67 [0,4194304] 0 2024-08-18T22:41:39.968 INFO:tasks.workunit.client.1.smithi195.stdout:1/365: getdents da/d3d 0 2024-08-18T22:41:39.970 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:39.969+0000 7f0075ffb640 1 -- 172.21.15.121:0/4002841145 <== mgr.24377 v2:172.21.15.195:6828/1174410756 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f0084104e40 con 0x7f0070038ab0 2024-08-18T22:41:39.971 INFO:teuthology.orchestra.run.smithi121.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-08-18T22:41:39.971 INFO:teuthology.orchestra.run.smithi121.stdout:alertmanager.smithi121 smithi121 *:9093,9094 running (6m) 2m ago 7m 24.7M - 0.25.0 c8568f914cd2 0e56a9950e47 2024-08-18T22:41:39.971 INFO:teuthology.orchestra.run.smithi121.stdout:crash.smithi121 smithi121 running (7m) 2m ago 7m 6899k - 17.2.7-1406-gdf62bdcc 774894bef55f cf3deea293c3 2024-08-18T22:41:39.971 INFO:teuthology.orchestra.run.smithi121.stdout:crash.smithi195 smithi195 running (6m) 21s ago 6m 6899k - 17.2.7-1406-gdf62bdcc 774894bef55f 98aa377daf77 2024-08-18T22:41:39.971 INFO:teuthology.orchestra.run.smithi121.stdout:grafana.smithi121 smithi121 *:3000 running (6m) 2m ago 7m 87.2M - 9.4.7 954c08fa6188 07c3d993780f 2024-08-18T22:41:39.971 INFO:teuthology.orchestra.run.smithi121.stdout:mds.cephfs.smithi121.gbickb smithi121 running (2m) 2m ago 2m 16.2M - 17.2.7-1406-gdf62bdcc 774894bef55f 484da0bc2c95 2024-08-18T22:41:39.971 INFO:teuthology.orchestra.run.smithi121.stdout:mds.cephfs.smithi121.xuzsdg smithi121 running (2m) 2m ago 2m 10.7M - 17.2.7-1406-gdf62bdcc 774894bef55f 6976b708cdcd 2024-08-18T22:41:39.971 INFO:teuthology.orchestra.run.smithi121.stdout:mds.cephfs.smithi195.buqvbr smithi195 running (2m) 21s ago 2m 77.3M - 17.2.7-1406-gdf62bdcc 774894bef55f 11a3703b4276 2024-08-18T22:41:39.971 INFO:teuthology.orchestra.run.smithi121.stdout:mds.cephfs.smithi195.nptgyc smithi195 running (2m) 21s ago 2m 15.6M - 17.2.7-1406-gdf62bdcc 774894bef55f b9f8043ea83e 2024-08-18T22:41:39.971 INFO:teuthology.orchestra.run.smithi121.stdout:mgr.smithi121.lopxqc smithi121 *:9283,8765,8443 running (8m) 2m ago 8m 447M - 17.2.7-1406-gdf62bdcc 774894bef55f 3ac16dcb26e3 2024-08-18T22:41:39.972 INFO:teuthology.orchestra.run.smithi121.stdout:mgr.smithi195.acttsj smithi195 *:8443,9283 running (33s) 21s ago 6m 51.5M - 19.1.0-1382-gde09dd01 ea7a5189f30b eaf531f5f439 2024-08-18T22:41:39.972 INFO:teuthology.orchestra.run.smithi121.stdout:mon.smithi121 smithi121 running (8m) 2m ago 8m 51.2M 2048M 17.2.7-1406-gdf62bdcc 774894bef55f 4a7bead235ac 2024-08-18T22:41:39.972 INFO:teuthology.orchestra.run.smithi121.stdout:mon.smithi195 smithi195 running (6m) 21s ago 6m 38.0M 2048M 17.2.7-1406-gdf62bdcc 774894bef55f ced63ecfbfae 2024-08-18T22:41:39.972 INFO:teuthology.orchestra.run.smithi121.stdout:node-exporter.smithi121 smithi121 *:9100 running (7m) 2m ago 7m 16.9M - 1.5.0 0da6a335fe13 81d394827425 2024-08-18T22:41:39.972 INFO:teuthology.orchestra.run.smithi121.stdout:node-exporter.smithi195 smithi195 *:9100 running (6m) 21s ago 6m 15.3M - 1.5.0 0da6a335fe13 e09a01163b83 2024-08-18T22:41:39.972 INFO:teuthology.orchestra.run.smithi121.stdout:osd.0 smithi121 running (5m) 2m ago 5m 47.2M 4287M 17.2.7-1406-gdf62bdcc 774894bef55f 30859216633d 2024-08-18T22:41:39.972 INFO:teuthology.orchestra.run.smithi121.stdout:osd.1 smithi121 running (5m) 2m ago 5m 49.1M 4287M 17.2.7-1406-gdf62bdcc 774894bef55f ef5fadfd753f 2024-08-18T22:41:39.972 INFO:teuthology.orchestra.run.smithi121.stdout:osd.2 smithi121 running (5m) 2m ago 5m 43.6M 4287M 17.2.7-1406-gdf62bdcc 774894bef55f 3fa061e41f99 2024-08-18T22:41:39.972 INFO:teuthology.orchestra.run.smithi121.stdout:osd.3 smithi195 running (4m) 21s ago 4m 98.5M 5312M 17.2.7-1406-gdf62bdcc 774894bef55f 15d30b1b459e 2024-08-18T22:41:39.972 INFO:teuthology.orchestra.run.smithi121.stdout:osd.4 smithi195 running (4m) 21s ago 4m 91.3M 5312M 17.2.7-1406-gdf62bdcc 774894bef55f 99ed156dfd36 2024-08-18T22:41:39.972 INFO:teuthology.orchestra.run.smithi121.stdout:osd.5 smithi195 running (3m) 21s ago 3m 91.7M 5312M 17.2.7-1406-gdf62bdcc 774894bef55f e7eff7bdb752 2024-08-18T22:41:39.972 INFO:teuthology.orchestra.run.smithi121.stdout:prometheus.smithi121 smithi121 *:9095 running (6m) 2m ago 7m 56.2M - 2.43.0 a07b618ecd1d d6016f1b45a3 2024-08-18T22:41:39.974 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:39.973+0000 7f008b744640 1 -- 172.21.15.121:0/4002841145 >> [v2:172.21.15.195:6828/1174410756,v1:172.21.15.195:6829/1174410756] conn(0x7f0070038ab0 msgr2=0x7f007003af60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:41:39.975 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:39.973+0000 7f008b744640 1 --2- 172.21.15.121:0/4002841145 >> [v2:172.21.15.195:6828/1174410756,v1:172.21.15.195:6829/1174410756] conn(0x7f0070038ab0 0x7f007003af60 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f0080004fd0 tx=0x7f008000b040 comp rx=0 tx=0).stop 2024-08-18T22:41:39.975 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:39.973+0000 7f008b744640 1 -- 172.21.15.121:0/4002841145 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f00840ff410 msgr2=0x7f00841139b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:41:39.975 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:39.973+0000 7f008b744640 1 --2- 172.21.15.121:0/4002841145 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f00840ff410 0x7f00841139b0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f00780048a0 tx=0x7f0078009da0 comp rx=0 tx=0).stop 2024-08-18T22:41:39.975 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:39.973+0000 7f008b744640 1 -- 172.21.15.121:0/4002841145 shutdown_connections 2024-08-18T22:41:39.975 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:39.973+0000 7f008b744640 1 --2- 172.21.15.121:0/4002841145 >> [v2:172.21.15.195:6828/1174410756,v1:172.21.15.195:6829/1174410756] conn(0x7f0070038ab0 0x7f007003af60 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:41:39.975 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:39.973+0000 7f008b744640 1 --2- 172.21.15.121:0/4002841145 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f00840ff410 0x7f00841139b0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:41:39.975 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:39.973+0000 7f008b744640 1 --2- 172.21.15.121:0/4002841145 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0084066270 0x7f0084113470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:41:39.975 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:39.973+0000 7f008b744640 1 -- 172.21.15.121:0/4002841145 >> 172.21.15.121:0/4002841145 conn(0x7f00840f69a0 msgr2=0x7f00840fb0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:41:39.975 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:39.973+0000 7f008b744640 1 -- 172.21.15.121:0/4002841145 shutdown_connections 2024-08-18T22:41:39.976 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:39.974+0000 7f008b744640 1 -- 172.21.15.121:0/4002841145 wait complete. 2024-08-18T22:41:39.982 INFO:tasks.workunit.client.0.smithi121.stdout:0/527: creat d1/d4/db/d24/d30/d52/fb5 x:0 0 0 2024-08-18T22:41:39.983 INFO:tasks.workunit.client.0.smithi121.stdout:8/713: getdents d6/dd/dcc/de7 0 2024-08-18T22:41:39.984 INFO:tasks.workunit.client.1.smithi195.stdout:7/165: dwrite dc/d14/d15/d17/d18/f3f [0,4194304] 0 2024-08-18T22:41:39.985 INFO:tasks.workunit.client.1.smithi195.stdout:4/283: dwrite d0/d9/d11/d16/d54/f5c [0,4194304] 0 2024-08-18T22:41:39.985 INFO:tasks.workunit.client.0.smithi121.stdout:8/714: stat d6/d1e/d2d/d78/lb3 0 2024-08-18T22:41:39.988 INFO:tasks.workunit.client.1.smithi195.stdout:2/192: dwrite d1/d24/d26/f37 [0,4194304] 0 2024-08-18T22:41:39.990 INFO:tasks.workunit.client.0.smithi121.stdout:8/715: write d6/dd/d3b/da3/dca/d60/f66 [4469754,73599] 0 2024-08-18T22:41:39.992 INFO:tasks.workunit.client.1.smithi195.stdout:5/168: dwrite d0/d3/f15 [0,4194304] 0 2024-08-18T22:41:39.993 INFO:tasks.workunit.client.0.smithi121.stdout:0/528: dwrite d1/d4/db/d24/df/f7 [0,4194304] 0 2024-08-18T22:41:39.996 INFO:tasks.workunit.client.1.smithi195.stdout:5/169: dread - d0/d3/f27 zero size 2024-08-18T22:41:39.996 INFO:tasks.workunit.client.1.smithi195.stdout:7/166: creat dc/d14/d15/d17/d18/f43 x:0 0 0 2024-08-18T22:41:39.996 INFO:tasks.workunit.client.1.smithi195.stdout:4/284: truncate d0/d9/d3b/f5a 59308 0 2024-08-18T22:41:40.000 INFO:tasks.workunit.client.1.smithi195.stdout:7/167: write dc/f25 [402195,28502] 0 2024-08-18T22:41:40.000 INFO:tasks.workunit.client.1.smithi195.stdout:2/193: link d1/d24/d26/f37 d1/d24/d26/f40 0 2024-08-18T22:41:40.003 INFO:tasks.workunit.client.0.smithi121.stdout:0/529: dwrite d1/d4/d53/da7/f5c [0,4194304] 0 2024-08-18T22:41:40.004 INFO:tasks.workunit.client.1.smithi195.stdout:4/285: rename d0/c1f to d0/d9/d11/d16/d37/c5d 0 2024-08-18T22:41:40.004 INFO:tasks.workunit.client.0.smithi121.stdout:0/530: readlink d1/d4/da/l16 0 2024-08-18T22:41:40.007 INFO:tasks.workunit.client.1.smithi195.stdout:2/194: stat d1/d8/d3d/f20 0 2024-08-18T22:41:40.009 INFO:tasks.workunit.client.0.smithi121.stdout:0/531: mknod d1/d4/db/d18/cb6 0 2024-08-18T22:41:40.009 INFO:tasks.workunit.client.0.smithi121.stdout:5/475: sync 2024-08-18T22:41:40.010 INFO:tasks.workunit.client.1.smithi195.stdout:6/191: sync 2024-08-18T22:41:40.010 INFO:tasks.workunit.client.1.smithi195.stdout:9/305: sync 2024-08-18T22:41:40.010 INFO:tasks.workunit.client.1.smithi195.stdout:0/237: sync 2024-08-18T22:41:40.010 INFO:tasks.workunit.client.1.smithi195.stdout:8/313: sync 2024-08-18T22:41:40.010 INFO:tasks.workunit.client.1.smithi195.stdout:3/285: sync 2024-08-18T22:41:40.010 INFO:tasks.workunit.client.1.smithi195.stdout:4/286: chown d0/d9/d3b/f4b 414689 1 2024-08-18T22:41:40.011 INFO:tasks.workunit.client.1.smithi195.stdout:3/286: dread - d7/da/df/f3b zero size 2024-08-18T22:41:40.012 INFO:tasks.workunit.client.1.smithi195.stdout:6/192: write da/d15/d1c/f12 [2546924,17252] 0 2024-08-18T22:41:40.015 INFO:tasks.workunit.client.1.smithi195.stdout:2/195: mknod d1/d24/d26/c41 0 2024-08-18T22:41:40.016 INFO:tasks.workunit.client.0.smithi121.stdout:0/532: creat d1/d4/db/d18/d40/d83/daf/fb7 x:0 0 0 2024-08-18T22:41:40.018 INFO:tasks.workunit.client.0.smithi121.stdout:5/476: link d3/d5/d27/d35/f5d d3/d5c/f94 0 2024-08-18T22:41:40.019 INFO:tasks.workunit.client.1.smithi195.stdout:5/170: getdents d0/d2 0 2024-08-18T22:41:40.019 INFO:tasks.workunit.client.1.smithi195.stdout:8/314: chown d1/d3/d1c/d49/l5e 1473725403 1 2024-08-18T22:41:40.020 INFO:tasks.workunit.client.0.smithi121.stdout:0/533: chown d1/d4/db/d24/d30/d52/f70 4442 1 2024-08-18T22:41:40.021 INFO:tasks.workunit.client.0.smithi121.stdout:5/477: chown d3/d5/d3c/d3f/l55 18 1 2024-08-18T22:41:40.022 INFO:tasks.workunit.client.0.smithi121.stdout:5/478: dread - d3/d5/d13/d19/d24/d32/d38/f93 zero size 2024-08-18T22:41:40.023 INFO:tasks.workunit.client.1.smithi195.stdout:9/306: mknod d1c/d32/d37/d4b/c5f 0 2024-08-18T22:41:40.023 INFO:tasks.workunit.client.1.smithi195.stdout:0/238: creat d0/dc/d25/f47 x:0 0 0 2024-08-18T22:41:40.024 INFO:tasks.workunit.client.1.smithi195.stdout:6/193: mknod da/db/d2a/c3a 0 2024-08-18T22:41:40.024 INFO:tasks.workunit.client.1.smithi195.stdout:4/287: creat d0/d9/d11/d16/f5e x:0 0 0 2024-08-18T22:41:40.024 INFO:tasks.workunit.client.0.smithi121.stdout:0/534: creat d1/d4/fb8 x:0 0 0 2024-08-18T22:41:40.025 INFO:tasks.workunit.client.1.smithi195.stdout:2/196: readlink d1/d8/d27/l35 0 2024-08-18T22:41:40.025 INFO:tasks.workunit.client.1.smithi195.stdout:5/171: unlink d0/d2/c1b 0 2024-08-18T22:41:40.029 INFO:tasks.workunit.client.0.smithi121.stdout:5/479: rmdir d3/d5/d13/d19/d24 39 2024-08-18T22:41:40.031 INFO:tasks.workunit.client.0.smithi121.stdout:5/480: write d3/d5/d27/f6d [113413,51729] 0 2024-08-18T22:41:40.031 INFO:tasks.workunit.client.1.smithi195.stdout:5/172: write d0/db/f19 [4351465,99902] 0 2024-08-18T22:41:40.031 INFO:tasks.workunit.client.1.smithi195.stdout:9/307: creat d1c/d32/d37/f60 x:0 0 0 2024-08-18T22:41:40.031 INFO:tasks.workunit.client.1.smithi195.stdout:8/315: mkdir d1/d3/db/d39/d2e/d78 0 2024-08-18T22:41:40.032 INFO:tasks.workunit.client.1.smithi195.stdout:1/366: dread da/d18/d28/d31/d3b/f3a [0,4194304] 0 2024-08-18T22:41:40.032 INFO:tasks.workunit.client.1.smithi195.stdout:5/173: unlink d0/d3/f15 0 2024-08-18T22:41:40.032 INFO:tasks.workunit.client.1.smithi195.stdout:4/288: mkdir d0/d9/d11/d16/d37/d5f 0 2024-08-18T22:41:40.032 INFO:tasks.workunit.client.0.smithi121.stdout:5/481: fdatasync d3/d5/d27/d35/f36 0 2024-08-18T22:41:40.033 INFO:tasks.workunit.client.1.smithi195.stdout:6/194: mkdir da/d3b 0 2024-08-18T22:41:40.033 INFO:tasks.workunit.client.0.smithi121.stdout:8/716: dread d6/f7c [0,4194304] 0 2024-08-18T22:41:40.034 INFO:tasks.workunit.client.1.smithi195.stdout:4/289: chown d0/d9/d11/d16/d37/d48 76 1 2024-08-18T22:41:40.035 INFO:tasks.workunit.client.0.smithi121.stdout:4/618: sync 2024-08-18T22:41:40.036 INFO:tasks.workunit.client.0.smithi121.stdout:5/482: write d3/d5/d27/d35/f72 [4030636,111581] 0 2024-08-18T22:41:40.036 INFO:tasks.workunit.client.1.smithi195.stdout:9/308: unlink d1c/d32/f51 0 2024-08-18T22:41:40.037 INFO:tasks.workunit.client.0.smithi121.stdout:4/619: chown d2/dc/d16/d22/d2c/d44/l5a 7 1 2024-08-18T22:41:40.037 INFO:tasks.workunit.client.1.smithi195.stdout:0/239: symlink d0/dc/d11/d30/d44/d43/l48 0 2024-08-18T22:41:40.037 INFO:tasks.workunit.client.0.smithi121.stdout:5/483: fsync d3/d5/d27/d35/f74 0 2024-08-18T22:41:40.038 INFO:tasks.workunit.client.0.smithi121.stdout:0/535: fdatasync d1/d4/db/d24/df/d8/f85 0 2024-08-18T22:41:40.041 INFO:tasks.workunit.client.0.smithi121.stdout:0/536: chown d1/d4/db/d18/d40/ca3 180 1 2024-08-18T22:41:40.041 INFO:tasks.workunit.client.1.smithi195.stdout:9/309: dread - d1c/f4e zero size 2024-08-18T22:41:40.041 INFO:tasks.workunit.client.1.smithi195.stdout:9/310: stat d1c/f20 0 2024-08-18T22:41:40.041 INFO:tasks.workunit.client.1.smithi195.stdout:8/316: mkdir d1/d3/db/d39/d44/d79 0 2024-08-18T22:41:40.043 INFO:tasks.workunit.client.0.smithi121.stdout:8/717: symlink d6/d1e/d2d/d78/d45/dd9/lf2 0 2024-08-18T22:41:40.044 INFO:tasks.workunit.client.1.smithi195.stdout:5/174: mknod d0/d3/d8/c2f 0 2024-08-18T22:41:40.045 INFO:tasks.workunit.client.0.smithi121.stdout:8/718: write d6/dd/d3b/da3/dca/fec [388099,98623] 0 2024-08-18T22:41:40.045 INFO:tasks.workunit.client.1.smithi195.stdout:3/287: write d7/f19 [2194401,90605] 0 2024-08-18T22:41:40.046 INFO:tasks.workunit.client.1.smithi195.stdout:4/290: creat d0/d9/d11/d16/d37/d48/f60 x:0 0 0 2024-08-18T22:41:40.047 INFO:tasks.workunit.client.1.smithi195.stdout:4/291: dread - d0/d9/d11/d16/f4f zero size 2024-08-18T22:41:40.049 INFO:tasks.workunit.client.1.smithi195.stdout:9/311: mkdir d1c/d32/d37/d4b/d61 0 2024-08-18T22:41:40.052 INFO:tasks.workunit.client.1.smithi195.stdout:8/317: mkdir d1/d3/db/d7a 0 2024-08-18T22:41:40.053 INFO:tasks.workunit.client.0.smithi121.stdout:8/719: truncate d6/dd/d3b/da3/dca/d37/f94 4849372 0 2024-08-18T22:41:40.054 INFO:tasks.workunit.client.1.smithi195.stdout:5/175: mknod d0/d3/df/d1a/c30 0 2024-08-18T22:41:40.055 INFO:tasks.workunit.client.0.smithi121.stdout:8/720: chown d6/dd/d3b/da3/lee 14921881 1 2024-08-18T22:41:40.055 INFO:tasks.workunit.client.0.smithi121.stdout:4/620: link d2/dc/d16/d22/d2c/d7a/cd8 d2/dc/d16/d22/d2c/d44/cdc 0 2024-08-18T22:41:40.055 INFO:tasks.workunit.client.1.smithi195.stdout:5/176: stat d0/d3/d8/c23 0 2024-08-18T22:41:40.056 INFO:tasks.workunit.client.0.smithi121.stdout:8/721: fdatasync d6/d1e/d2d/d78/d85/fad 0 2024-08-18T22:41:40.057 INFO:tasks.workunit.client.1.smithi195.stdout:2/197: dread d1/f10 [0,4194304] 0 2024-08-18T22:41:40.058 INFO:tasks.workunit.client.1.smithi195.stdout:4/292: creat d0/d9/d11/d16/f61 x:0 0 0 2024-08-18T22:41:40.059 INFO:tasks.workunit.client.1.smithi195.stdout:7/168: dread dc/f25 [0,4194304] 0 2024-08-18T22:41:40.059 INFO:tasks.workunit.client.0.smithi121.stdout:0/537: link d1/d4/db/d18/d40/f41 d1/d4/db/d24/df/d8/fb9 0 2024-08-18T22:41:40.059 INFO:tasks.workunit.client.1.smithi195.stdout:4/293: stat d0/d9/f2e 0 2024-08-18T22:41:40.060 INFO:tasks.workunit.client.1.smithi195.stdout:1/367: link da/d18/l4a da/d18/d43/l80 0 2024-08-18T22:41:40.060 INFO:tasks.workunit.client.1.smithi195.stdout:2/198: chown d1/d24/d26/c41 69869879 1 2024-08-18T22:41:40.061 INFO:tasks.workunit.client.0.smithi121.stdout:4/621: creat d2/dc/d16/d59/d83/fdd x:0 0 0 2024-08-18T22:41:40.062 INFO:tasks.workunit.client.1.smithi195.stdout:6/195: creat da/db/f3c x:0 0 0 2024-08-18T22:41:40.062 INFO:tasks.workunit.client.1.smithi195.stdout:4/294: stat d0/d9/d11/d16/d37/f4e 0 2024-08-18T22:41:40.063 INFO:tasks.workunit.client.1.smithi195.stdout:8/318: rmdir d1/de/d31/d5a 39 2024-08-18T22:41:40.063 INFO:tasks.workunit.client.0.smithi121.stdout:8/722: chown d6/dd/d3b/da3/dca/d18/d99/cb4 889 1 2024-08-18T22:41:40.065 INFO:tasks.workunit.client.1.smithi195.stdout:8/319: write d1/de/f4e [338819,316] 0 2024-08-18T22:41:40.065 INFO:tasks.workunit.client.1.smithi195.stdout:9/312: unlink d1c/d32/d37/f60 0 2024-08-18T22:41:40.066 INFO:tasks.workunit.client.0.smithi121.stdout:4/622: rename d2/dc/d16/d22/d2c/c6f to d2/dc/d1c/dc1/cde 0 2024-08-18T22:41:40.067 INFO:tasks.workunit.client.1.smithi195.stdout:7/169: symlink dc/d14/d2b/l44 0 2024-08-18T22:41:40.068 INFO:tasks.workunit.client.1.smithi195.stdout:2/199: mkdir d1/d24/d26/d42 0 2024-08-18T22:41:40.068 INFO:tasks.workunit.client.1.smithi195.stdout:0/240: write d0/dc/d25/f1f [362481,105319] 0 2024-08-18T22:41:40.070 INFO:tasks.workunit.client.0.smithi121.stdout:4/623: creat d2/dc/d16/d59/d83/fdf x:0 0 0 2024-08-18T22:41:40.070 INFO:tasks.workunit.client.0.smithi121.stdout:5/484: truncate d3/d5/d27/d35/f72 3804585 0 2024-08-18T22:41:40.072 INFO:tasks.workunit.client.1.smithi195.stdout:0/241: write d0/dc/d25/f1f [853723,110458] 0 2024-08-18T22:41:40.073 INFO:tasks.workunit.client.0.smithi121.stdout:0/538: mkdir d1/d4/db/d24/df/d8/d78/d7c/dba 0 2024-08-18T22:41:40.074 INFO:tasks.workunit.client.1.smithi195.stdout:5/177: mknod d0/d2/c31 0 2024-08-18T22:41:40.075 INFO:tasks.workunit.client.0.smithi121.stdout:4/624: mknod d2/dc/d16/d22/d2c/d7a/dbf/ce0 0 2024-08-18T22:41:40.079 INFO:tasks.workunit.client.1.smithi195.stdout:6/196: creat da/d15/d1c/d2e/f3d x:0 0 0 2024-08-18T22:41:40.079 INFO:tasks.workunit.client.1.smithi195.stdout:1/368: rename da/d3d/f6a to da/d18/d28/d31/d77/f81 0 2024-08-18T22:41:40.079 INFO:tasks.workunit.client.0.smithi121.stdout:5/485: mknod d3/d5/d13/d19/d24/d4d/c95 0 2024-08-18T22:41:40.079 INFO:tasks.workunit.client.0.smithi121.stdout:4/625: symlink d2/dc/d16/d59/d83/le1 0 2024-08-18T22:41:40.080 INFO:tasks.workunit.client.1.smithi195.stdout:0/242: write d0/dc/d25/f1f [956409,4693] 0 2024-08-18T22:41:40.081 INFO:tasks.workunit.client.1.smithi195.stdout:2/200: creat d1/d24/d26/d42/f43 x:0 0 0 2024-08-18T22:41:40.082 INFO:tasks.workunit.client.0.smithi121.stdout:0/539: symlink d1/d4/da/lbb 0 2024-08-18T22:41:40.082 INFO:tasks.workunit.client.1.smithi195.stdout:1/369: dread - da/d4c/f7d zero size 2024-08-18T22:41:40.082 INFO:tasks.workunit.client.1.smithi195.stdout:7/170: dread fb [4194304,4194304] 0 2024-08-18T22:41:40.083 INFO:tasks.workunit.client.1.smithi195.stdout:3/288: dwrite d7/d1f/f37 [0,4194304] 0 2024-08-18T22:41:40.085 INFO:tasks.workunit.client.1.smithi195.stdout:5/178: creat d0/d2/d29/f32 x:0 0 0 2024-08-18T22:41:40.086 INFO:tasks.workunit.client.1.smithi195.stdout:4/295: rename d0/d9/d3b/f5b to d0/d9/d11/d16/d37/d5f/f62 0 2024-08-18T22:41:40.087 INFO:tasks.workunit.client.0.smithi121.stdout:0/540: creat d1/d47/fbc x:0 0 0 2024-08-18T22:41:40.087 INFO:tasks.workunit.client.1.smithi195.stdout:6/197: write da/d15/f34 [2891649,17168] 0 2024-08-18T22:41:40.088 INFO:tasks.workunit.client.0.smithi121.stdout:5/486: dwrite d3/d5/d13/d23/d66/f88 [0,4194304] 0 2024-08-18T22:41:40.090 INFO:tasks.workunit.client.1.smithi195.stdout:4/296: fsync d0/d9/d11/d16/d49/f45 0 2024-08-18T22:41:40.091 INFO:tasks.workunit.client.1.smithi195.stdout:0/243: write d0/f1c [3263385,29645] 0 2024-08-18T22:41:40.093 INFO:tasks.workunit.client.1.smithi195.stdout:0/244: stat d0/l2 0 2024-08-18T22:41:40.094 INFO:tasks.workunit.client.0.smithi121.stdout:4/626: rmdir d2/dc/d16/d22/d2c/d44/d66/dd1 0 2024-08-18T22:41:40.095 INFO:tasks.workunit.client.1.smithi195.stdout:9/313: dread f16 [0,4194304] 0 2024-08-18T22:41:40.096 INFO:tasks.workunit.client.0.smithi121.stdout:0/541: write d1/d4/d53/da7/f34 [74349,79905] 0 2024-08-18T22:41:40.097 INFO:tasks.workunit.client.1.smithi195.stdout:9/314: write f14 [7099344,110741] 0 2024-08-18T22:41:40.097 INFO:tasks.workunit.client.0.smithi121.stdout:8/723: dwrite d6/d1e/f47 [0,4194304] 0 2024-08-18T22:41:40.097 INFO:tasks.workunit.client.0.smithi121.stdout:4/627: read d2/dc/d16/d22/d2c/fa1 [114652,118173] 0 2024-08-18T22:41:40.100 INFO:tasks.workunit.client.0.smithi121.stdout:5/487: mknod d3/d5/d13/d19/d24/d32/c96 0 2024-08-18T22:41:40.102 INFO:tasks.workunit.client.0.smithi121.stdout:5/488: write d3/d5/d13/d19/f4a [913377,7951] 0 2024-08-18T22:41:40.102 INFO:tasks.workunit.client.1.smithi195.stdout:5/179: dwrite d0/d2/d29/f32 [0,4194304] 0 2024-08-18T22:41:40.103 INFO:tasks.workunit.client.0.smithi121.stdout:8/724: chown d6/dd/l61 0 1 2024-08-18T22:41:40.105 INFO:tasks.workunit.client.0.smithi121.stdout:8/725: truncate d6/d1e/d2d/f7f 308568 0 2024-08-18T22:41:40.105 INFO:tasks.workunit.client.1.smithi195.stdout:2/201: dwrite d1/d8/d3d/f3e [0,4194304] 0 2024-08-18T22:41:40.110 INFO:tasks.workunit.client.0.smithi121.stdout:4/628: write d2/f4 [2256315,112433] 0 2024-08-18T22:41:40.111 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:40.110+0000 7f9c73457640 1 -- 172.21.15.121:0/2179041703 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9c6c06fde0 msgr2=0x7f9c6c070250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:41:40.111 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:40.110+0000 7f9c73457640 1 --2- 172.21.15.121:0/2179041703 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9c6c06fde0 0x7f9c6c070250 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f9c5c004950 tx=0x7f9c5c009da0 comp rx=0 tx=0).stop 2024-08-18T22:41:40.111 INFO:tasks.workunit.client.1.smithi195.stdout:0/245: write d0/dc/dd/f3c [680210,116033] 0 2024-08-18T22:41:40.111 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:40.110+0000 7f9c73457640 1 -- 172.21.15.121:0/2179041703 shutdown_connections 2024-08-18T22:41:40.111 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:40.110+0000 7f9c73457640 1 --2- 172.21.15.121:0/2179041703 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9c6c06fde0 0x7f9c6c070250 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:41:40.112 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:40.110+0000 7f9c73457640 1 --2- 172.21.15.121:0/2179041703 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9c6c071370 0x7f9c6c06f8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:41:40.112 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:40.110+0000 7f9c73457640 1 -- 172.21.15.121:0/2179041703 >> 172.21.15.121:0/2179041703 conn(0x7f9c6c0f7a80 msgr2=0x7f9c6c0f9eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:41:40.112 INFO:tasks.workunit.client.0.smithi121.stdout:4/629: dread - d2/dc/d16/d22/d2c/d44/f78 zero size 2024-08-18T22:41:40.112 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:40.111+0000 7f9c73457640 1 -- 172.21.15.121:0/2179041703 shutdown_connections 2024-08-18T22:41:40.112 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:40.111+0000 7f9c73457640 1 -- 172.21.15.121:0/2179041703 wait complete. 2024-08-18T22:41:40.113 INFO:tasks.workunit.client.1.smithi195.stdout:9/315: write d1c/d32/d37/f4d [3521503,6310] 0 2024-08-18T22:41:40.113 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:40.112+0000 7f9c73457640 1 Processor -- start 2024-08-18T22:41:40.114 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:40.112+0000 7f9c73457640 1 -- start start 2024-08-18T22:41:40.114 INFO:tasks.workunit.client.0.smithi121.stdout:8/726: rename d6/dd/d3b/da3/dca/d60/d5b/d6e/fbe to d6/dd/dcc/de7/ff3 0 2024-08-18T22:41:40.114 INFO:tasks.workunit.client.1.smithi195.stdout:0/246: truncate d0/dc/d25/f1e 542239 0 2024-08-18T22:41:40.115 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:40.113+0000 7f9c73457640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9c6c06fde0 0x7f9c6c10ad20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:41:40.115 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:40.113+0000 7f9c73457640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9c6c071370 0x7f9c6c10b260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:41:40.115 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:40.113+0000 7f9c73457640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c6c10bf90 con 0x7f9c6c071370 2024-08-18T22:41:40.115 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:40.113+0000 7f9c73457640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c6c10c100 con 0x7f9c6c06fde0 2024-08-18T22:41:40.115 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:40.113+0000 7f9c709f2640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9c6c071370 0x7f9c6c10b260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:41:40.115 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:40.113+0000 7f9c709f2640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9c6c071370 0x7f9c6c10b260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:58948/0 (socket says 172.21.15.121:58948) 2024-08-18T22:41:40.115 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:40.113+0000 7f9c709f2640 1 -- 172.21.15.121:0/1728537375 learned_addr learned my addr 172.21.15.121:0/1728537375 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-18T22:41:40.116 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:40.114+0000 7f9c711f3640 1 --2- 172.21.15.121:0/1728537375 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9c6c06fde0 0x7f9c6c10ad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:41:40.116 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:40.114+0000 7f9c709f2640 1 -- 172.21.15.121:0/1728537375 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9c6c06fde0 msgr2=0x7f9c6c10ad20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:41:40.116 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:40.114+0000 7f9c709f2640 1 --2- 172.21.15.121:0/1728537375 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9c6c06fde0 0x7f9c6c10ad20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:41:40.116 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:40.114+0000 7f9c709f2640 1 -- 172.21.15.121:0/1728537375 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c5c005040 con 0x7f9c6c071370 2024-08-18T22:41:40.117 INFO:tasks.workunit.client.0.smithi121.stdout:0/542: read d1/d4/db/d18/d40/f96 [497367,120254] 0 2024-08-18T22:41:40.117 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:40.116+0000 7f9c709f2640 1 --2- 172.21.15.121:0/1728537375 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9c6c071370 0x7f9c6c10b260 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f9c5c009ac0 tx=0x7f9c5c009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:41:40.118 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:40.117+0000 7f9c61ffb640 1 -- 172.21.15.121:0/1728537375 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9c5c049070 con 0x7f9c6c071370 2024-08-18T22:41:40.118 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:40.117+0000 7f9c61ffb640 1 -- 172.21.15.121:0/1728537375 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f9c5c044cb0 con 0x7f9c6c071370 2024-08-18T22:41:40.118 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:40.117+0000 7f9c73457640 1 -- 172.21.15.121:0/1728537375 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c6c10c380 con 0x7f9c6c071370 2024-08-18T22:41:40.118 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:40.117+0000 7f9c61ffb640 1 -- 172.21.15.121:0/1728537375 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9c5c04eb90 con 0x7f9c6c071370 2024-08-18T22:41:40.119 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:40.117+0000 7f9c73457640 1 -- 172.21.15.121:0/1728537375 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c6c10c8c0 con 0x7f9c6c071370 2024-08-18T22:41:40.122 INFO:tasks.workunit.client.1.smithi195.stdout:8/320: link d1/de/df/c13 d1/de/d31/c7b 0 2024-08-18T22:41:40.122 INFO:tasks.workunit.client.1.smithi195.stdout:2/202: write d1/d22/f30 [983971,82640] 0 2024-08-18T22:41:40.122 INFO:tasks.workunit.client.1.smithi195.stdout:4/297: creat d0/d9/d11/d16/d37/d48/d4c/f63 x:0 0 0 2024-08-18T22:41:40.122 INFO:tasks.workunit.client.1.smithi195.stdout:3/289: creat d7/f61 x:0 0 0 2024-08-18T22:41:40.123 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:40.121+0000 7f9c577fe640 1 -- 172.21.15.121:0/1728537375 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c4c005210 con 0x7f9c6c071370 2024-08-18T22:41:40.123 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:40.122+0000 7f9c61ffb640 1 -- 172.21.15.121:0/1728537375 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 22) v1 ==== 45945+0+0 (secure 0 0 0) 0x7f9c5c041020 con 0x7f9c6c071370 2024-08-18T22:41:40.124 INFO:tasks.workunit.client.1.smithi195.stdout:9/316: chown d1c/d32/c40 76635 1 2024-08-18T22:41:40.124 INFO:tasks.workunit.client.1.smithi195.stdout:0/247: dwrite d0/dc/d25/f1f [0,4194304] 0 2024-08-18T22:41:40.124 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:40.123+0000 7f9c61ffb640 1 --2- 172.21.15.121:0/1728537375 >> [v2:172.21.15.195:6828/1174410756,v1:172.21.15.195:6829/1174410756] conn(0x7f9c58038b50 0x7f9c5803b000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:41:40.124 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:40.123+0000 7f9c61ffb640 1 -- 172.21.15.121:0/1728537375 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f9c5c07de30 con 0x7f9c6c071370 2024-08-18T22:41:40.125 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:40.123+0000 7f9c711f3640 1 --2- 172.21.15.121:0/1728537375 >> [v2:172.21.15.195:6828/1174410756,v1:172.21.15.195:6829/1174410756] conn(0x7f9c58038b50 0x7f9c5803b000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:41:40.125 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:40.125+0000 7f9c711f3640 1 --2- 172.21.15.121:0/1728537375 >> [v2:172.21.15.195:6828/1174410756,v1:172.21.15.195:6829/1174410756] conn(0x7f9c58038b50 0x7f9c5803b000 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f9c6c0710d0 tx=0x7f9c68008040 comp rx=0 tx=0).ready entity=mgr.24377 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:41:40.126 INFO:tasks.workunit.client.1.smithi195.stdout:5/180: symlink d0/d3/df/l33 0 2024-08-18T22:41:40.127 INFO:tasks.workunit.client.1.smithi195.stdout:1/370: getdents da/d18 0 2024-08-18T22:41:40.129 INFO:tasks.workunit.client.1.smithi195.stdout:3/290: chown d7/da/df/d1c/c2c 179 1 2024-08-18T22:41:40.131 INFO:tasks.workunit.client.1.smithi195.stdout:6/198: getdents da/d15 0 2024-08-18T22:41:40.131 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:40.130+0000 7f9c61ffb640 1 -- 172.21.15.121:0/1728537375 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7f9c5c056570 con 0x7f9c6c071370 2024-08-18T22:41:40.136 INFO:tasks.workunit.client.1.smithi195.stdout:8/321: symlink d1/de/df/d1d/d1f/l7c 0 2024-08-18T22:41:40.136 INFO:tasks.workunit.client.1.smithi195.stdout:9/317: symlink d1c/l62 0 2024-08-18T22:41:40.137 INFO:tasks.workunit.client.1.smithi195.stdout:6/199: write da/d15/d1c/d2e/f3d [813852,35311] 0 2024-08-18T22:41:40.138 INFO:tasks.workunit.client.1.smithi195.stdout:3/291: unlink d7/da/df/d1c/f41 0 2024-08-18T22:41:40.139 INFO:tasks.workunit.client.1.smithi195.stdout:5/181: rename d0/d2/c2d to d0/db/c34 0 2024-08-18T22:41:40.142 INFO:tasks.workunit.client.0.smithi121.stdout:4/630: symlink d2/dc/d16/le2 0 2024-08-18T22:41:40.144 INFO:tasks.workunit.client.0.smithi121.stdout:8/727: creat d6/d1e/d2d/d78/d45/dd9/ff4 x:0 0 0 2024-08-18T22:41:40.145 INFO:tasks.workunit.client.1.smithi195.stdout:4/298: write d0/f22 [1859568,84203] 0 2024-08-18T22:41:40.145 INFO:tasks.workunit.client.1.smithi195.stdout:3/292: read d7/f19 [1377631,126064] 0 2024-08-18T22:41:40.148 INFO:tasks.workunit.client.1.smithi195.stdout:0/248: dwrite d0/dc/d11/d30/f40 [0,4194304] 0 2024-08-18T22:41:40.149 INFO:tasks.workunit.client.1.smithi195.stdout:5/182: mknod d0/d3/d8/c35 0 2024-08-18T22:41:40.151 INFO:tasks.workunit.client.0.smithi121.stdout:8/728: dwrite f5 [0,4194304] 0 2024-08-18T22:41:40.151 INFO:tasks.workunit.client.0.smithi121.stdout:4/631: creat d2/dc/d1c/dc1/fe3 x:0 0 0 2024-08-18T22:41:40.156 INFO:tasks.workunit.client.1.smithi195.stdout:3/293: symlink d7/da/df/d1c/l62 0 2024-08-18T22:41:40.160 INFO:tasks.workunit.client.1.smithi195.stdout:3/294: dread - d7/f5c zero size 2024-08-18T22:41:40.161 INFO:tasks.workunit.client.1.smithi195.stdout:9/318: creat d1c/f63 x:0 0 0 2024-08-18T22:41:40.162 INFO:tasks.workunit.client.1.smithi195.stdout:8/322: creat d1/f7d x:0 0 0 2024-08-18T22:41:40.162 INFO:tasks.workunit.client.1.smithi195.stdout:5/183: unlink d0/d3/df/d1a/f24 0 2024-08-18T22:41:40.165 INFO:tasks.workunit.client.0.smithi121.stdout:8/729: mknod d6/d1e/cf5 0 2024-08-18T22:41:40.165 INFO:tasks.workunit.client.1.smithi195.stdout:6/200: dwrite da/d15/d1c/d2e/f33 [0,4194304] 0 2024-08-18T22:41:40.172 INFO:tasks.workunit.client.1.smithi195.stdout:4/299: dwrite d0/d9/d11/d16/d37/f4e [0,4194304] 0 2024-08-18T22:41:40.173 INFO:tasks.workunit.client.0.smithi121.stdout:8/730: dwrite d6/d1e/d2d/d78/d85/fad [0,4194304] 0 2024-08-18T22:41:40.174 INFO:tasks.workunit.client.1.smithi195.stdout:0/249: dread d0/dc/d11/d30/f40 [0,4194304] 0 2024-08-18T22:41:40.174 INFO:tasks.workunit.client.1.smithi195.stdout:2/203: dread d1/f1f [0,4194304] 0 2024-08-18T22:41:40.175 INFO:tasks.workunit.client.1.smithi195.stdout:8/323: creat d1/d3/db/d35/f7e x:0 0 0 2024-08-18T22:41:40.177 INFO:tasks.workunit.client.1.smithi195.stdout:2/204: read d1/d22/f31 [3719241,112263] 0 2024-08-18T22:41:40.177 INFO:tasks.workunit.client.1.smithi195.stdout:5/184: mknod d0/d3/df/d1a/c36 0 2024-08-18T22:41:40.179 INFO:tasks.workunit.client.1.smithi195.stdout:2/205: chown d1/d8/f1a 125651 1 2024-08-18T22:41:40.179 INFO:tasks.workunit.client.0.smithi121.stdout:4/632: creat d2/dc/d16/d22/fe4 x:0 0 0 2024-08-18T22:41:40.179 INFO:tasks.workunit.client.1.smithi195.stdout:5/185: chown d0/f1d 45 1 2024-08-18T22:41:40.180 INFO:tasks.workunit.client.1.smithi195.stdout:3/295: unlink d7/d1f/d49/l4e 0 2024-08-18T22:41:40.180 INFO:tasks.workunit.client.1.smithi195.stdout:2/206: chown d1/d22/c2a 107576719 1 2024-08-18T22:41:40.181 INFO:tasks.workunit.client.0.smithi121.stdout:0/543: dwrite d1/d4/da/d2f/f5e [0,4194304] 0 2024-08-18T22:41:40.184 INFO:tasks.workunit.client.1.smithi195.stdout:4/300: fsync d0/d9/d11/d16/f55 0 2024-08-18T22:41:40.185 INFO:tasks.workunit.client.1.smithi195.stdout:8/324: rename d1/d3/d1c/f69 to d1/d3/d1c/d21/f7f 0 2024-08-18T22:41:40.187 INFO:tasks.workunit.client.0.smithi121.stdout:8/731: unlink d6/d1e/d2d/d78/d85/fad 0 2024-08-18T22:41:40.190 INFO:tasks.workunit.client.1.smithi195.stdout:6/201: creat da/d3b/f3e x:0 0 0 2024-08-18T22:41:40.190 INFO:tasks.workunit.client.1.smithi195.stdout:3/296: creat d7/da/df/d1c/f63 x:0 0 0 2024-08-18T22:41:40.191 INFO:tasks.workunit.client.1.smithi195.stdout:4/301: chown d0/d9/d11/d16/d37/c5d 32700507 1 2024-08-18T22:41:40.193 INFO:tasks.workunit.client.1.smithi195.stdout:5/186: mkdir d0/d37 0 2024-08-18T22:41:40.194 INFO:tasks.workunit.client.1.smithi195.stdout:5/187: fdatasync d0/d3/d8/f14 0 2024-08-18T22:41:40.195 INFO:tasks.workunit.client.1.smithi195.stdout:4/302: dread d0/d9/d3b/f5a [0,4194304] 0 2024-08-18T22:41:40.197 INFO:tasks.workunit.client.0.smithi121.stdout:8/732: link d6/dd/dcc/de7/feb d6/d1e/ff6 0 2024-08-18T22:41:40.200 INFO:tasks.workunit.client.0.smithi121.stdout:8/733: mknod d6/d20/cf7 0 2024-08-18T22:41:40.202 INFO:tasks.workunit.client.1.smithi195.stdout:5/188: dwrite d0/d3/df/f16 [0,4194304] 0 2024-08-18T22:41:40.203 INFO:tasks.workunit.client.0.smithi121.stdout:8/734: mkdir d6/dd/d3b/da3/dca/d60/df8 0 2024-08-18T22:41:40.203 INFO:tasks.workunit.client.1.smithi195.stdout:8/325: creat d1/d64/f80 x:0 0 0 2024-08-18T22:41:40.204 INFO:tasks.workunit.client.1.smithi195.stdout:3/297: unlink d7/da/df/f12 0 2024-08-18T22:41:40.204 INFO:tasks.workunit.client.0.smithi121.stdout:8/735: readlink d6/dd/d3b/da3/dca/d18/d83/ldf 0 2024-08-18T22:41:40.205 INFO:tasks.workunit.client.1.smithi195.stdout:9/319: dread d1c/f20 [0,4194304] 0 2024-08-18T22:41:40.207 INFO:tasks.workunit.client.0.smithi121.stdout:4/633: dread d2/dc/f94 [0,4194304] 0 2024-08-18T22:41:40.208 INFO:tasks.workunit.client.1.smithi195.stdout:6/202: mknod da/db/d26/d2d/c3f 0 2024-08-18T22:41:40.208 INFO:tasks.workunit.client.0.smithi121.stdout:4/634: chown d2/dc/d16/fad 611812 1 2024-08-18T22:41:40.208 INFO:tasks.workunit.client.1.smithi195.stdout:0/250: dread d0/dc/dd/f3c [0,4194304] 0 2024-08-18T22:41:40.209 INFO:tasks.workunit.client.1.smithi195.stdout:4/303: creat d0/d9/d3b/f64 x:0 0 0 2024-08-18T22:41:40.209 INFO:tasks.workunit.client.1.smithi195.stdout:3/298: fsync d7/da/df/d38/f3f 0 2024-08-18T22:41:40.211 INFO:tasks.workunit.client.0.smithi121.stdout:3/659: sync 2024-08-18T22:41:40.211 INFO:tasks.workunit.client.0.smithi121.stdout:2/440: sync 2024-08-18T22:41:40.211 INFO:tasks.workunit.client.0.smithi121.stdout:1/632: sync 2024-08-18T22:41:40.211 INFO:tasks.workunit.client.0.smithi121.stdout:9/696: sync 2024-08-18T22:41:40.211 INFO:tasks.workunit.client.0.smithi121.stdout:7/653: sync 2024-08-18T22:41:40.213 INFO:tasks.workunit.client.1.smithi195.stdout:8/326: mknod d1/d3/db/d35/d56/c81 0 2024-08-18T22:41:40.217 INFO:tasks.workunit.client.0.smithi121.stdout:8/736: link d6/d1e/d2d/lbb d6/dd/d3b/lf9 0 2024-08-18T22:41:40.219 INFO:tasks.workunit.client.1.smithi195.stdout:8/327: mknod d1/d3/db/c82 0 2024-08-18T22:41:40.221 INFO:tasks.workunit.client.0.smithi121.stdout:4/635: creat d2/fe5 x:0 0 0 2024-08-18T22:41:40.221 INFO:tasks.workunit.client.1.smithi195.stdout:5/189: mknod d0/d2/c38 0 2024-08-18T22:41:40.222 INFO:tasks.workunit.client.0.smithi121.stdout:1/633: link d5/d10/d14/f4f d5/d10/d14/d2a/d3a/d87/fdd 0 2024-08-18T22:41:40.223 INFO:tasks.workunit.client.0.smithi121.stdout:3/660: dwrite d1e/d1f/d5e/d9a/dda/fed [0,4194304] 0 2024-08-18T22:41:40.224 INFO:tasks.workunit.client.0.smithi121.stdout:8/737: creat d6/dd/ffa x:0 0 0 2024-08-18T22:41:40.227 INFO:tasks.workunit.client.0.smithi121.stdout:4/636: write d2/dc/f48 [1646806,116164] 0 2024-08-18T22:41:40.228 INFO:tasks.workunit.client.1.smithi195.stdout:9/320: dwrite d1c/d32/f52 [0,4194304] 0 2024-08-18T22:41:40.229 INFO:tasks.workunit.client.1.smithi195.stdout:8/328: write d1/d3/db/d39/d2e/f4c [785940,90243] 0 2024-08-18T22:41:40.230 INFO:tasks.workunit.client.0.smithi121.stdout:4/637: fsync d2/dc/d16/d47/f86 0 2024-08-18T22:41:40.234 INFO:tasks.workunit.client.1.smithi195.stdout:3/299: dwrite d7/da/f3d [0,4194304] 0 2024-08-18T22:41:40.235 INFO:tasks.workunit.client.1.smithi195.stdout:5/190: creat d0/d3/df/f39 x:0 0 0 2024-08-18T22:41:40.239 INFO:tasks.workunit.client.1.smithi195.stdout:4/304: dwrite d0/d9/d11/d16/f42 [0,4194304] 0 2024-08-18T22:41:40.240 INFO:tasks.workunit.client.0.smithi121.stdout:7/654: dwrite de/f15 [0,4194304] 0 2024-08-18T22:41:40.240 INFO:tasks.workunit.client.1.smithi195.stdout:3/300: write f6 [4637243,24561] 0 2024-08-18T22:41:40.241 INFO:tasks.workunit.client.0.smithi121.stdout:8/738: write d6/dd/d3b/da3/dca/d18/f2c [409224,63176] 0 2024-08-18T22:41:40.243 INFO:tasks.workunit.client.1.smithi195.stdout:0/251: dwrite d0/dc/dd/f29 [0,4194304] 0 2024-08-18T22:41:40.244 INFO:tasks.workunit.client.1.smithi195.stdout:9/321: write d1c/f63 [673286,35147] 0 2024-08-18T22:41:40.246 INFO:tasks.workunit.client.0.smithi121.stdout:4/638: creat d2/dc/d16/d22/d29/fe6 x:0 0 0 2024-08-18T22:41:40.246 INFO:tasks.workunit.client.0.smithi121.stdout:1/634: dwrite d5/d10/d14/d2a/d3a/d87/d6c/d6f/d82/d15/d38/f72 [0,4194304] 0 2024-08-18T22:41:40.247 INFO:tasks.workunit.client.1.smithi195.stdout:6/203: truncate da/d15/d1c/d2e/f33 136630 0 2024-08-18T22:41:40.248 INFO:tasks.workunit.client.0.smithi121.stdout:1/635: fsync d5/d10/d14/d92/faa 0 2024-08-18T22:41:40.251 INFO:tasks.workunit.client.1.smithi195.stdout:0/252: truncate d0/dc/d11/d30/f35 338840 0 2024-08-18T22:41:40.251 INFO:tasks.workunit.client.1.smithi195.stdout:4/305: chown d0/d7/d1d/f31 55 1 2024-08-18T22:41:40.253 INFO:tasks.workunit.client.0.smithi121.stdout:9/697: dread d0/d38/d9e/df/d73/fa5 [0,4194304] 0 2024-08-18T22:41:40.253 INFO:tasks.workunit.client.1.smithi195.stdout:6/204: write da/db/d19/f23 [87683,111711] 0 2024-08-18T22:41:40.253 INFO:tasks.workunit.client.1.smithi195.stdout:0/253: write d0/dc/d11/f32 [469757,109143] 0 2024-08-18T22:41:40.256 INFO:tasks.workunit.client.0.smithi121.stdout:4/639: dread - d2/dc/d1c/f96 zero size 2024-08-18T22:41:40.258 INFO:tasks.workunit.client.0.smithi121.stdout:7/655: creat de/d13/fd2 x:0 0 0 2024-08-18T22:41:40.258 INFO:tasks.workunit.client.1.smithi195.stdout:0/254: write d0/dc/d11/f20 [616463,86877] 0 2024-08-18T22:41:40.262 INFO:tasks.workunit.client.1.smithi195.stdout:5/191: rename d0/d3/c1f to d0/d3/df/c3a 0 2024-08-18T22:41:40.262 INFO:tasks.workunit.client.0.smithi121.stdout:8/739: rename d6/d1e/d2d/c4b to d6/dd/d3b/da3/dca/d60/cfb 0 2024-08-18T22:41:40.265 INFO:tasks.workunit.client.1.smithi195.stdout:9/322: creat d1c/f64 x:0 0 0 2024-08-18T22:41:40.266 INFO:tasks.workunit.client.1.smithi195.stdout:4/306: mkdir d0/d9/d11/d16/d37/d5f/d65 0 2024-08-18T22:41:40.266 INFO:tasks.workunit.client.0.smithi121.stdout:9/698: symlink d0/d5/dd/d1a/d93/le5 0 2024-08-18T22:41:40.272 INFO:tasks.workunit.client.1.smithi195.stdout:8/329: dwrite d1/de/df/d1d/f32 [0,4194304] 0 2024-08-18T22:41:40.273 INFO:tasks.workunit.client.1.smithi195.stdout:4/307: truncate d0/d9/d11/d16/f4f 918149 0 2024-08-18T22:41:40.274 INFO:tasks.workunit.client.1.smithi195.stdout:9/323: creat d1c/d32/d37/d4b/f65 x:0 0 0 2024-08-18T22:41:40.277 INFO:tasks.workunit.client.0.smithi121.stdout:4/640: rename d2/dc/d16/le2 to d2/dc/d16/d22/d2c/d7a/le7 0 2024-08-18T22:41:40.278 INFO:tasks.workunit.client.0.smithi121.stdout:4/641: readlink d2/l5b 0 2024-08-18T22:41:40.278 INFO:tasks.workunit.client.0.smithi121.stdout:3/661: dwrite d1e/d1f/d25/f27 [0,4194304] 0 2024-08-18T22:41:40.278 INFO:tasks.workunit.client.0.smithi121.stdout:8/740: write d6/d1e/d2d/d78/fb9 [2640497,88849] 0 2024-08-18T22:41:40.279 INFO:tasks.workunit.client.1.smithi195.stdout:5/192: dwrite d0/d3/f27 [0,4194304] 0 2024-08-18T22:41:40.279 INFO:tasks.workunit.client.1.smithi195.stdout:6/205: creat da/f40 x:0 0 0 2024-08-18T22:41:40.279 INFO:tasks.workunit.client.1.smithi195.stdout:4/308: fsync d0/d9/d11/d16/f1b 0 2024-08-18T22:41:40.282 INFO:tasks.workunit.client.1.smithi195.stdout:8/330: dread - d1/d3/d1c/f45 zero size 2024-08-18T22:41:40.287 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:41:39 smithi121 ceph-mon[16788]: Checking for cert/key for grafana.smithi121 2024-08-18T22:41:40.287 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:41:39 smithi121 ceph-mon[16788]: Migrating grafana.smithi121 cert to cert store 2024-08-18T22:41:40.287 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:41:39 smithi121 ceph-mon[16788]: Migrating grafana.smithi121 key to cert store 2024-08-18T22:41:40.287 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:41:39 smithi121 ceph-mon[16788]: mgrmap e22: smithi195.acttsj(active, since 1.28036s) 2024-08-18T22:41:40.287 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:41:39 smithi121 ceph-mon[16788]: Deploying cephadm binary to smithi121 2024-08-18T22:41:40.287 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:41:39 smithi121 ceph-mon[16788]: from='client.24393 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-18T22:41:40.287 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:41:39 smithi121 ceph-mon[16788]: pgmap v3: 65 pgs: 65 active+clean; 1.8 GiB data, 6.9 GiB used, 530 GiB / 536 GiB avail 2024-08-18T22:41:40.287 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:41:39 smithi121 ceph-mon[16788]: Deploying cephadm binary to smithi195 2024-08-18T22:41:40.287 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:41:39 smithi121 ceph-mon[16788]: from='client.24415 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-18T22:41:40.287 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:41:39 smithi121 ceph-mon[16788]: pgmap v4: 65 pgs: 65 active+clean; 1.8 GiB data, 6.9 GiB used, 530 GiB / 536 GiB avail 2024-08-18T22:41:40.287 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:41:39 smithi121 ceph-mon[16788]: from='mgr.24377 ' entity='mgr.smithi195.acttsj' 2024-08-18T22:41:40.288 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:41:39 smithi121 ceph-mon[16788]: from='mgr.24377 ' entity='mgr.smithi195.acttsj' 2024-08-18T22:41:40.288 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:41:39 smithi121 ceph-mon[16788]: from='client.24419 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-18T22:41:40.288 INFO:tasks.workunit.client.1.smithi195.stdout:9/324: rmdir d1c/d32/d37/d4b/d61 0 2024-08-18T22:41:40.289 INFO:tasks.workunit.client.1.smithi195.stdout:6/206: read da/db/f37 [1025734,104759] 0 2024-08-18T22:41:40.296 INFO:tasks.workunit.client.1.smithi195.stdout:8/331: unlink d1/d3/db/d39/d44/c6f 0 2024-08-18T22:41:40.297 INFO:tasks.workunit.client.1.smithi195.stdout:4/309: truncate d0/d9/d11/d16/d37/f43 724223 0 2024-08-18T22:41:40.298 INFO:tasks.workunit.client.1.smithi195.stdout:5/193: dwrite d0/f11 [0,4194304] 0 2024-08-18T22:41:40.298 INFO:tasks.workunit.client.1.smithi195.stdout:3/301: chown d7/da/df/d1c 837861 1 2024-08-18T22:41:40.303 INFO:tasks.workunit.client.1.smithi195.stdout:6/207: write da/d15/d1c/f12 [792442,84338] 0 2024-08-18T22:41:40.304 INFO:tasks.workunit.client.1.smithi195.stdout:3/302: chown d7/l3c 25080 1 2024-08-18T22:41:40.305 INFO:tasks.workunit.client.1.smithi195.stdout:6/208: fsync da/db/d19/f27 0 2024-08-18T22:41:40.308 INFO:tasks.workunit.client.1.smithi195.stdout:5/194: chown d0/d2/d29/c2c 11218923 1 2024-08-18T22:41:40.308 INFO:tasks.workunit.client.1.smithi195.stdout:6/209: chown da/d15/d1c 44633939 1 2024-08-18T22:41:40.308 INFO:tasks.workunit.client.1.smithi195.stdout:3/303: chown d7/da/df/f5f 1 1 2024-08-18T22:41:40.313 INFO:tasks.workunit.client.1.smithi195.stdout:0/255: write d0/dc/d25/f1f [4443564,6881] 0 2024-08-18T22:41:40.315 INFO:tasks.workunit.client.1.smithi195.stdout:5/195: mkdir d0/d3/d8/d3b 0 2024-08-18T22:41:40.316 INFO:tasks.workunit.client.1.smithi195.stdout:4/310: read d0/d9/d11/f3a [3958877,66954] 0 2024-08-18T22:41:40.316 INFO:tasks.workunit.client.1.smithi195.stdout:6/210: creat da/db/d26/f41 x:0 0 0 2024-08-18T22:41:40.320 INFO:tasks.workunit.client.1.smithi195.stdout:9/325: link d1c/f44 d1c/d32/f66 0 2024-08-18T22:41:40.320 INFO:tasks.workunit.client.1.smithi195.stdout:3/304: stat d7/d1f/c35 0 2024-08-18T22:41:40.326 INFO:tasks.workunit.client.1.smithi195.stdout:5/196: write d0/d3/df/f39 [11585,5453] 0 2024-08-18T22:41:40.330 INFO:tasks.workunit.client.1.smithi195.stdout:0/256: dwrite d0/dc/d25/f47 [0,4194304] 0 2024-08-18T22:41:40.332 INFO:tasks.workunit.client.1.smithi195.stdout:3/305: dread - d7/da/df/f3b zero size 2024-08-18T22:41:40.333 INFO:tasks.workunit.client.1.smithi195.stdout:3/306: stat d7/da/df/d47 0 2024-08-18T22:41:40.335 INFO:tasks.workunit.client.1.smithi195.stdout:4/311: mkdir d0/d9/d41/d66 0 2024-08-18T22:41:40.338 INFO:tasks.workunit.client.0.smithi121.stdout:1/636: truncate d5/d10/d14/d2a/d3a/f7a 528989 0 2024-08-18T22:41:40.338 INFO:tasks.workunit.client.1.smithi195.stdout:0/257: fdatasync d0/f3 0 2024-08-18T22:41:40.339 INFO:tasks.workunit.client.0.smithi121.stdout:3/662: write d1e/d1f/d25/d6b/db4/d94/fab [2871379,127682] 0 2024-08-18T22:41:40.340 INFO:tasks.workunit.client.1.smithi195.stdout:5/197: rename d0/d3/d8/c23 to d0/db/c3c 0 2024-08-18T22:41:40.340 INFO:tasks.workunit.client.1.smithi195.stdout:3/307: write f6 [1464570,38983] 0 2024-08-18T22:41:40.342 INFO:tasks.workunit.client.1.smithi195.stdout:4/312: symlink d0/d9/l67 0 2024-08-18T22:41:40.343 INFO:tasks.workunit.client.0.smithi121.stdout:7/656: write de/d13/d18/d23/d24/d85/dce/d34/d38/d5f/f66 [1095848,20920] 0 2024-08-18T22:41:40.344 INFO:tasks.workunit.client.0.smithi121.stdout:1/637: unlink d5/d10/d14/d92/d9f/lb7 0 2024-08-18T22:41:40.345 INFO:tasks.workunit.client.1.smithi195.stdout:5/198: write d0/db/f19 [1269043,23173] 0 2024-08-18T22:41:40.345 INFO:tasks.workunit.client.1.smithi195.stdout:8/332: dread d1/de/f3b [4194304,4194304] 0 2024-08-18T22:41:40.346 INFO:tasks.workunit.client.1.smithi195.stdout:8/333: chown d1/de/df/c15 28577 1 2024-08-18T22:41:40.346 INFO:tasks.workunit.client.0.smithi121.stdout:4/642: rmdir d2/dc/d16 39 2024-08-18T22:41:40.347 INFO:tasks.workunit.client.1.smithi195.stdout:5/199: write d0/f11 [4142543,78048] 0 2024-08-18T22:41:40.348 INFO:tasks.workunit.client.0.smithi121.stdout:8/741: link d6/d20/d69/cb1 d6/dd/d3b/cfc 0 2024-08-18T22:41:40.348 INFO:tasks.workunit.client.0.smithi121.stdout:8/742: read - d6/d1e/d2d/d78/d45/fa5 zero size 2024-08-18T22:41:40.351 INFO:tasks.workunit.client.0.smithi121.stdout:7/657: mkdir de/d13/d18/d23/d24/d85/dce/d34/d38/d5f/dd3 0 2024-08-18T22:41:40.352 INFO:tasks.workunit.client.1.smithi195.stdout:8/334: write d1/d3/db/d39/d44/f6b [983968,119702] 0 2024-08-18T22:41:40.354 INFO:tasks.workunit.client.1.smithi195.stdout:5/200: write d0/d3/df/f16 [123362,114275] 0 2024-08-18T22:41:40.355 INFO:tasks.workunit.client.0.smithi121.stdout:8/743: creat d6/dd/dcc/ffd x:0 0 0 2024-08-18T22:41:40.358 INFO:tasks.workunit.client.1.smithi195.stdout:0/258: link d0/dc/d11/d30/d44/f2d d0/dc/d11/d23/f49 0 2024-08-18T22:41:40.359 INFO:tasks.workunit.client.0.smithi121.stdout:1/638: symlink d5/d10/d14/d2a/d3a/d87/d6c/d6f/d82/d15/d28/d3d/dbd/lde 0 2024-08-18T22:41:40.360 INFO:tasks.workunit.client.0.smithi121.stdout:4/643: truncate d2/dc/d16/d22/d2c/d44/d8c/fb8 3084028 0 2024-08-18T22:41:40.362 INFO:tasks.workunit.client.0.smithi121.stdout:8/744: creat d6/dd/d3b/da3/dca/d18/d99/ffe x:0 0 0 2024-08-18T22:41:40.362 INFO:tasks.workunit.client.0.smithi121.stdout:4/644: chown d2/dc/d16/d22/d2c/d7a/da0/laf 17870 1 2024-08-18T22:41:40.362 INFO:tasks.workunit.client.0.smithi121.stdout:7/658: truncate de/d2d/f42 217286 0 2024-08-18T22:41:40.363 INFO:tasks.workunit.client.1.smithi195.stdout:0/259: chown d0/f1c 4 1 2024-08-18T22:41:40.364 INFO:tasks.workunit.client.0.smithi121.stdout:8/745: write d6/d1e/d2d/de5/fbd [522282,17977] 0 2024-08-18T22:41:40.366 INFO:tasks.workunit.client.0.smithi121.stdout:8/746: write d6/d1e/fc1 [698512,92927] 0 2024-08-18T22:41:40.366 INFO:tasks.workunit.client.1.smithi195.stdout:9/326: dread d1c/f3a [0,4194304] 0 2024-08-18T22:41:40.367 INFO:tasks.workunit.client.0.smithi121.stdout:4/645: mkdir d2/dc/d16/d22/d2c/d7a/da0/de8 0 2024-08-18T22:41:40.367 INFO:tasks.workunit.client.1.smithi195.stdout:0/260: fdatasync d0/dc/d11/f15 0 2024-08-18T22:41:40.370 INFO:tasks.workunit.client.0.smithi121.stdout:8/747: unlink d6/dd/d25/l9d 0 2024-08-18T22:41:40.371 INFO:tasks.workunit.client.1.smithi195.stdout:0/261: fdatasync d0/dc/d11/f32 0 2024-08-18T22:41:40.373 INFO:tasks.workunit.client.0.smithi121.stdout:4/646: dwrite d2/dc/d16/d47/f86 [0,4194304] 0 2024-08-18T22:41:40.376 INFO:tasks.workunit.client.1.smithi195.stdout:3/308: dwrite d7/d1f/f26 [0,4194304] 0 2024-08-18T22:41:40.376 INFO:tasks.workunit.client.1.smithi195.stdout:9/327: truncate d1c/f47 373888 0 2024-08-18T22:41:40.377 INFO:tasks.workunit.client.1.smithi195.stdout:8/335: dwrite d1/de/f4e [0,4194304] 0 2024-08-18T22:41:40.378 INFO:tasks.workunit.client.1.smithi195.stdout:9/328: stat d1c/f63 0 2024-08-18T22:41:40.380 INFO:tasks.workunit.client.0.smithi121.stdout:4/647: creat d2/dc/d16/d22/d2c/d44/da7/fe9 x:0 0 0 2024-08-18T22:41:40.381 INFO:tasks.workunit.client.0.smithi121.stdout:4/648: dread - d2/dc/d16/d47/fd6 zero size 2024-08-18T22:41:40.384 INFO:tasks.workunit.client.1.smithi195.stdout:0/262: write d0/dc/d11/d23/f49 [1864424,108737] 0 2024-08-18T22:41:40.387 INFO:tasks.workunit.client.1.smithi195.stdout:5/201: dwrite d0/d3/f27 [0,4194304] 0 2024-08-18T22:41:40.391 INFO:tasks.workunit.client.0.smithi121.stdout:4/649: dwrite d2/dc/d16/d22/f25 [0,4194304] 0 2024-08-18T22:41:40.392 INFO:tasks.workunit.client.1.smithi195.stdout:9/329: dread d1c/f3c [0,4194304] 0 2024-08-18T22:41:40.394 INFO:tasks.workunit.client.1.smithi195.stdout:3/309: dwrite d7/d1f/f37 [0,4194304] 0 2024-08-18T22:41:40.398 INFO:tasks.workunit.client.1.smithi195.stdout:9/330: dread - d1c/f4e zero size 2024-08-18T22:41:40.399 INFO:tasks.workunit.client.1.smithi195.stdout:0/263: symlink d0/dc/d25/l4a 0 2024-08-18T22:41:40.401 INFO:tasks.workunit.client.0.smithi121.stdout:4/650: dwrite d2/fe5 [0,4194304] 0 2024-08-18T22:41:40.402 INFO:tasks.workunit.client.1.smithi195.stdout:8/336: fsync d1/d3/db/d35/f47 0 2024-08-18T22:41:40.409 INFO:tasks.workunit.client.1.smithi195.stdout:5/202: dread d0/f11 [0,4194304] 0 2024-08-18T22:41:40.409 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:41:39 smithi195 ceph-mon[23370]: Checking for cert/key for grafana.smithi121 2024-08-18T22:41:40.409 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:41:39 smithi195 ceph-mon[23370]: Migrating grafana.smithi121 cert to cert store 2024-08-18T22:41:40.409 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:41:39 smithi195 ceph-mon[23370]: Migrating grafana.smithi121 key to cert store 2024-08-18T22:41:40.409 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:41:39 smithi195 ceph-mon[23370]: mgrmap e22: smithi195.acttsj(active, since 1.28036s) 2024-08-18T22:41:40.409 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:41:39 smithi195 ceph-mon[23370]: Deploying cephadm binary to smithi121 2024-08-18T22:41:40.409 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:41:39 smithi195 ceph-mon[23370]: from='client.24393 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-18T22:41:40.409 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:41:39 smithi195 ceph-mon[23370]: pgmap v3: 65 pgs: 65 active+clean; 1.8 GiB data, 6.9 GiB used, 530 GiB / 536 GiB avail 2024-08-18T22:41:40.410 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:41:39 smithi195 ceph-mon[23370]: Deploying cephadm binary to smithi195 2024-08-18T22:41:40.410 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:41:39 smithi195 ceph-mon[23370]: from='client.24415 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-18T22:41:40.410 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:41:39 smithi195 ceph-mon[23370]: pgmap v4: 65 pgs: 65 active+clean; 1.8 GiB data, 6.9 GiB used, 530 GiB / 536 GiB avail 2024-08-18T22:41:40.410 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:41:39 smithi195 ceph-mon[23370]: from='mgr.24377 ' entity='mgr.smithi195.acttsj' 2024-08-18T22:41:40.410 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:41:39 smithi195 ceph-mon[23370]: from='mgr.24377 ' entity='mgr.smithi195.acttsj' 2024-08-18T22:41:40.410 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:41:39 smithi195 ceph-mon[23370]: from='client.24419 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-18T22:41:40.410 INFO:tasks.workunit.client.0.smithi121.stdout:4/651: getdents d2/dc 0 2024-08-18T22:41:40.411 INFO:tasks.workunit.client.1.smithi195.stdout:0/264: rename d0/dc/d11/d23/c34 to d0/dc/dd/d46/c4b 0 2024-08-18T22:41:40.413 INFO:tasks.workunit.client.1.smithi195.stdout:8/337: symlink d1/d3/d1c/d49/l83 0 2024-08-18T22:41:40.413 INFO:tasks.workunit.client.1.smithi195.stdout:5/203: stat d0/db 0 2024-08-18T22:41:40.418 INFO:tasks.workunit.client.1.smithi195.stdout:0/265: dread d0/dc/d25/f47 [0,4194304] 0 2024-08-18T22:41:40.419 INFO:tasks.workunit.client.1.smithi195.stdout:5/204: dread d0/d3/df/f16 [0,4194304] 0 2024-08-18T22:41:40.421 INFO:tasks.workunit.client.1.smithi195.stdout:3/310: rename d7/d1f/d49/c52 to d7/da/df/d38/c64 0 2024-08-18T22:41:40.428 INFO:tasks.workunit.client.1.smithi195.stdout:8/338: creat d1/d3/db/d7a/f84 x:0 0 0 2024-08-18T22:41:40.429 INFO:tasks.workunit.client.1.smithi195.stdout:0/266: mkdir d0/dc/d11/d30/d44/d41/d4c 0 2024-08-18T22:41:40.429 INFO:tasks.workunit.client.1.smithi195.stdout:5/205: dread d0/d3/f27 [0,4194304] 0 2024-08-18T22:41:40.431 INFO:tasks.workunit.client.1.smithi195.stdout:0/267: write d0/dc/f21 [264171,53283] 0 2024-08-18T22:41:40.437 INFO:tasks.workunit.client.1.smithi195.stdout:5/206: write d0/f11 [1410402,3778] 0 2024-08-18T22:41:40.439 INFO:tasks.workunit.client.1.smithi195.stdout:5/207: read d0/d3/f27 [168959,124886] 0 2024-08-18T22:41:40.441 INFO:tasks.workunit.client.1.smithi195.stdout:0/268: dwrite d0/dc/d11/d30/d44/f2d [0,4194304] 0 2024-08-18T22:41:40.442 INFO:tasks.workunit.client.0.smithi121.stdout:1/639: write d5/d10/d14/f4f [1029924,35715] 0 2024-08-18T22:41:40.443 INFO:tasks.workunit.client.0.smithi121.stdout:1/640: chown d5/d10/d14/d34/f63 194254 1 2024-08-18T22:41:40.448 INFO:tasks.workunit.client.0.smithi121.stdout:1/641: rmdir d5/d10/d14/d2a/d3a/d87/d6c/d6f/d82/d15/d38/d8e 39 2024-08-18T22:41:40.451 INFO:tasks.workunit.client.1.smithi195.stdout:3/311: rename d7/da/ld to d7/l65 0 2024-08-18T22:41:40.451 INFO:tasks.workunit.client.1.smithi195.stdout:8/339: link d1/d64/l6d d1/de/l85 0 2024-08-18T22:41:40.452 INFO:tasks.workunit.client.1.smithi195.stdout:3/312: fdatasync d7/da/f14 0 2024-08-18T22:41:40.452 INFO:tasks.workunit.client.1.smithi195.stdout:8/340: chown d1/d3/db/d7a/f84 13466615 1 2024-08-18T22:41:40.455 INFO:tasks.workunit.client.1.smithi195.stdout:8/341: fdatasync d1/d3/d1c/f45 0 2024-08-18T22:41:40.455 INFO:tasks.workunit.client.1.smithi195.stdout:0/269: link d0/dc/d25/l4a d0/dc/d25/l4d 0 2024-08-18T22:41:40.455 INFO:tasks.workunit.client.0.smithi121.stdout:9/699: mkdir d0/d38/d9e/df/de6 0 2024-08-18T22:41:40.456 INFO:tasks.workunit.client.1.smithi195.stdout:0/270: fdatasync d0/dc/d11/f15 0 2024-08-18T22:41:40.457 INFO:tasks.workunit.client.1.smithi195.stdout:8/342: read d1/d3/db/d35/f47 [373535,128477] 0 2024-08-18T22:41:40.457 INFO:tasks.workunit.client.0.smithi121.stdout:9/700: creat d0/d38/d44/d7f/fe7 x:0 0 0 2024-08-18T22:41:40.458 INFO:tasks.workunit.client.1.smithi195.stdout:3/313: readlink d7/da/df/d1c/l62 0 2024-08-18T22:41:40.458 INFO:tasks.workunit.client.0.smithi121.stdout:3/663: rename d1e/d1f/d5e/dbc/dcb to d1e/d1f/d25/d58/df7 0 2024-08-18T22:41:40.459 INFO:tasks.workunit.client.1.smithi195.stdout:3/314: chown d7/da/df/d47 8025739 1 2024-08-18T22:41:40.461 INFO:tasks.workunit.client.0.smithi121.stdout:3/664: write d1e/d1f/d25/d74/d97/fee [352386,100050] 0 2024-08-18T22:41:40.463 INFO:tasks.workunit.client.1.smithi195.stdout:7/171: sync 2024-08-18T22:41:40.463 INFO:tasks.workunit.client.0.smithi121.stdout:8/748: rename d6/d1e/d2d/f7f to d6/dd/d25/dc8/dce/fff 0 2024-08-18T22:41:40.465 INFO:tasks.workunit.client.1.smithi195.stdout:0/271: symlink d0/dc/d11/l4e 0 2024-08-18T22:41:40.465 INFO:tasks.workunit.client.0.smithi121.stdout:3/665: unlink d1e/d1f/d2a/f65 0 2024-08-18T22:41:40.469 INFO:tasks.workunit.client.1.smithi195.stdout:7/172: symlink dc/d22/l45 0 2024-08-18T22:41:40.471 INFO:tasks.workunit.client.0.smithi121.stdout:3/666: write d1e/d1f/d25/d2e/d36/d5f/dd2/ff2 [648020,55770] 0 2024-08-18T22:41:40.474 INFO:tasks.workunit.client.0.smithi121.stdout:8/749: dwrite d6/dd/d25/fe2 [0,4194304] 0 2024-08-18T22:41:40.474 INFO:tasks.workunit.client.1.smithi195.stdout:0/272: mkdir d0/dc/d11/d30/d44/d41/d4c/d4f 0 2024-08-18T22:41:40.476 INFO:tasks.workunit.client.0.smithi121.stdout:4/652: dwrite d2/dc/d16/d22/d2c/d44/da7/fb1 [0,4194304] 0 2024-08-18T22:41:40.476 INFO:tasks.workunit.client.0.smithi121.stdout:3/667: chown d1e/d1f/da6/dc7/dae 20674 1 2024-08-18T22:41:40.476 INFO:tasks.workunit.client.0.smithi121.stdout:4/653: stat d2/dc/f93 0 2024-08-18T22:41:40.479 INFO:tasks.workunit.client.1.smithi195.stdout:7/173: symlink dc/d14/d15/d17/d18/l46 0 2024-08-18T22:41:40.479 INFO:tasks.workunit.client.1.smithi195.stdout:5/208: dread d0/db/f19 [0,4194304] 0 2024-08-18T22:41:40.480 INFO:tasks.workunit.client.1.smithi195.stdout:5/209: read d0/f11 [916193,77492] 0 2024-08-18T22:41:40.482 INFO:tasks.workunit.client.1.smithi195.stdout:0/273: dread d0/dc/d11/d30/d44/f2d [0,4194304] 0 2024-08-18T22:41:40.483 INFO:tasks.workunit.client.1.smithi195.stdout:5/210: chown d0/d3/df 118842 1 2024-08-18T22:41:40.484 INFO:tasks.workunit.client.1.smithi195.stdout:8/343: getdents d1/de 0 2024-08-18T22:41:40.484 INFO:tasks.workunit.client.1.smithi195.stdout:7/174: read dc/f1e [2972573,30094] 0 2024-08-18T22:41:40.485 INFO:tasks.workunit.client.0.smithi121.stdout:4/654: dwrite d2/dc/f13 [0,4194304] 0 2024-08-18T22:41:40.485 INFO:tasks.workunit.client.1.smithi195.stdout:3/315: dread d7/da/df/d38/f3f [0,4194304] 0 2024-08-18T22:41:40.488 INFO:tasks.workunit.client.1.smithi195.stdout:5/211: read d0/d3/df/f16 [1043479,33344] 0 2024-08-18T22:41:40.489 INFO:tasks.workunit.client.0.smithi121.stdout:9/701: write d0/d38/d9e/df/d3d/d89/faa [568098,32977] 0 2024-08-18T22:41:40.490 INFO:tasks.workunit.client.0.smithi121.stdout:1/642: dread d5/d10/d14/d2a/d3a/d87/d6c/d6f/d82/d11/fc6 [0,4194304] 0 2024-08-18T22:41:40.491 INFO:tasks.workunit.client.1.smithi195.stdout:3/316: rmdir d7 39 2024-08-18T22:41:40.493 INFO:tasks.workunit.client.0.smithi121.stdout:4/655: write d2/dc/d16/d22/d2c/f84 [4794269,76713] 0 2024-08-18T22:41:40.494 INFO:tasks.workunit.client.0.smithi121.stdout:9/702: stat d0/d38/d44/lda 0 2024-08-18T22:41:40.497 INFO:tasks.workunit.client.0.smithi121.stdout:4/656: mkdir d2/dc/d16/d47/dea 0 2024-08-18T22:41:40.497 INFO:tasks.workunit.client.0.smithi121.stdout:9/703: fdatasync d0/d38/d9e/df/d3d/fd3 0 2024-08-18T22:41:40.498 INFO:tasks.workunit.client.1.smithi195.stdout:5/212: unlink d0/d3/d8/c2f 0 2024-08-18T22:41:40.498 INFO:tasks.workunit.client.0.smithi121.stdout:1/643: creat d5/d10/d14/d2a/d3a/d87/fdf x:0 0 0 2024-08-18T22:41:40.499 INFO:tasks.workunit.client.0.smithi121.stdout:8/750: dwrite d6/d1e/d2d/d78/d45/f53 [0,4194304] 0 2024-08-18T22:41:40.501 INFO:tasks.workunit.client.0.smithi121.stdout:1/644: read - d5/d10/d14/d92/d9f/fd0 zero size 2024-08-18T22:41:40.501 INFO:tasks.workunit.client.1.smithi195.stdout:8/344: dread d1/de/d27/f29 [0,4194304] 0 2024-08-18T22:41:40.502 INFO:tasks.workunit.client.0.smithi121.stdout:8/751: dread - d6/dd/d3b/da3/dca/d18/d83/fae zero size 2024-08-18T22:41:40.502 INFO:tasks.workunit.client.0.smithi121.stdout:4/657: creat d2/dc/d16/d22/d2c/d44/d8c/feb x:0 0 0 2024-08-18T22:41:40.505 INFO:tasks.workunit.client.1.smithi195.stdout:7/175: dwrite dc/f10 [0,4194304] 0 2024-08-18T22:41:40.506 INFO:tasks.workunit.client.0.smithi121.stdout:4/658: write d2/dc/d16/d59/d83/dd7/d90/fcb [950813,102929] 0 2024-08-18T22:41:40.506 INFO:tasks.workunit.client.0.smithi121.stdout:8/752: write d6/d20/d69/d77/f88 [1245863,31649] 0 2024-08-18T22:41:40.507 INFO:tasks.workunit.client.1.smithi195.stdout:0/274: truncate d0/dc/d11/f15 2305946 0 2024-08-18T22:41:40.507 INFO:tasks.workunit.client.1.smithi195.stdout:7/176: truncate dc/d22/f3e 293969 0 2024-08-18T22:41:40.511 INFO:tasks.workunit.client.1.smithi195.stdout:0/275: write d0/dc/d25/f1f [4084141,57757] 0 2024-08-18T22:41:40.511 INFO:tasks.workunit.client.0.smithi121.stdout:8/753: fdatasync d6/d20/d69/d77/fe4 0 2024-08-18T22:41:40.513 INFO:tasks.workunit.client.1.smithi195.stdout:5/213: creat d0/d2/d29/f3d x:0 0 0 2024-08-18T22:41:40.513 INFO:tasks.workunit.client.1.smithi195.stdout:8/345: creat d1/de/d27/d4f/f86 x:0 0 0 2024-08-18T22:41:40.514 INFO:tasks.workunit.client.0.smithi121.stdout:8/754: stat d6/d20/d69/d77 0 2024-08-18T22:41:40.514 INFO:tasks.workunit.client.0.smithi121.stdout:4/659: creat d2/dc/d16/d59/fec x:0 0 0 2024-08-18T22:41:40.515 INFO:tasks.workunit.client.1.smithi195.stdout:8/346: write d1/d3/db/f34 [3281140,98920] 0 2024-08-18T22:41:40.515 INFO:tasks.workunit.client.1.smithi195.stdout:5/214: write d0/d2/d29/f32 [317861,39838] 0 2024-08-18T22:41:40.515 INFO:tasks.workunit.client.0.smithi121.stdout:1/645: dwrite d5/d10/d14/f5c [0,4194304] 0 2024-08-18T22:41:40.517 INFO:tasks.workunit.client.0.smithi121.stdout:8/755: dread - d6/dd/dcc/ffd zero size 2024-08-18T22:41:40.518 INFO:tasks.workunit.client.1.smithi195.stdout:7/177: creat dc/d14/f47 x:0 0 0 2024-08-18T22:41:40.518 INFO:tasks.workunit.client.1.smithi195.stdout:8/347: rename d1/de/df/c15 to d1/d3/d1c/d21/c87 0 2024-08-18T22:41:40.523 INFO:tasks.workunit.client.0.smithi121.stdout:3/668: dread d1e/d1f/d3e/f6f [0,4194304] 0 2024-08-18T22:41:40.523 INFO:tasks.workunit.client.1.smithi195.stdout:0/276: symlink d0/l50 0 2024-08-18T22:41:40.523 INFO:tasks.workunit.client.1.smithi195.stdout:8/348: truncate d1/d3/db/d39/d44/f6b 2145531 0 2024-08-18T22:41:40.524 INFO:tasks.workunit.client.1.smithi195.stdout:7/178: symlink dc/d14/d15/l48 0 2024-08-18T22:41:40.524 INFO:tasks.workunit.client.1.smithi195.stdout:3/317: link d7/da/df/d1c/l32 d7/d1f/d49/l66 0 2024-08-18T22:41:40.524 INFO:tasks.workunit.client.1.smithi195.stdout:7/179: truncate dc/d14/d2b/f3a 543471 0 2024-08-18T22:41:40.524 INFO:tasks.workunit.client.0.smithi121.stdout:5/489: sync 2024-08-18T22:41:40.524 INFO:tasks.workunit.client.0.smithi121.stdout:4/660: mkdir d2/dc/d16/d22/d29/ded 0 2024-08-18T22:41:40.528 INFO:tasks.workunit.client.0.smithi121.stdout:8/756: creat d6/d1e/d2d/f100 x:0 0 0 2024-08-18T22:41:40.528 INFO:tasks.workunit.client.1.smithi195.stdout:5/215: getdents d0 0 2024-08-18T22:41:40.528 INFO:tasks.workunit.client.0.smithi121.stdout:5/490: read d3/d5/f7 [1525931,70728] 0 2024-08-18T22:41:40.530 INFO:tasks.workunit.client.0.smithi121.stdout:3/669: creat d1e/d1f/d25/d67/d92/ff8 x:0 0 0 2024-08-18T22:41:40.530 INFO:tasks.workunit.client.1.smithi195.stdout:8/349: mkdir d1/de/d31/d88 0 2024-08-18T22:41:40.531 INFO:tasks.workunit.client.1.smithi195.stdout:7/180: rename dc/d14/d15/d17/d18/f3f to dc/d14/f49 0 2024-08-18T22:41:40.531 INFO:tasks.workunit.client.0.smithi121.stdout:9/704: write d0/d38/d9e/df/d61/f85 [974185,92066] 0 2024-08-18T22:41:40.532 INFO:tasks.workunit.client.1.smithi195.stdout:7/181: fdatasync dc/d14/d2b/f3a 0 2024-08-18T22:41:40.535 INFO:tasks.workunit.client.0.smithi121.stdout:4/661: symlink d2/dc/d16/d22/d2c/d7a/dbf/lee 0 2024-08-18T22:41:40.535 INFO:tasks.workunit.client.0.smithi121.stdout:1/646: link d5/d10/d67/cd3 d5/d10/d14/d2a/d3a/d87/d6c/d6f/ce0 0 2024-08-18T22:41:40.537 INFO:tasks.workunit.client.1.smithi195.stdout:8/350: symlink d1/d3/db/l89 0 2024-08-18T22:41:40.539 INFO:tasks.workunit.client.1.smithi195.stdout:8/351: chown d1/de/d31/c41 1694 1 2024-08-18T22:41:40.539 INFO:tasks.workunit.client.0.smithi121.stdout:3/670: mknod d1e/d1f/d25/d58/df7/de3/cf9 0 2024-08-18T22:41:40.540 INFO:tasks.workunit.client.1.smithi195.stdout:8/352: fdatasync d1/d3/d1c/f45 0 2024-08-18T22:41:40.540 INFO:tasks.workunit.client.0.smithi121.stdout:8/757: dread d6/dd/d25/dda/fe6 [0,4194304] 0 2024-08-18T22:41:40.541 INFO:tasks.workunit.client.1.smithi195.stdout:7/182: creat dc/d14/f4a x:0 0 0 2024-08-18T22:41:40.542 INFO:tasks.workunit.client.0.smithi121.stdout:8/758: dread - d6/dd/dcc/ffd zero size 2024-08-18T22:41:40.542 INFO:tasks.workunit.client.1.smithi195.stdout:5/216: mknod d0/d37/c3e 0 2024-08-18T22:41:40.544 INFO:tasks.workunit.client.0.smithi121.stdout:1/647: dread d5/d10/d14/d34/f98 [0,4194304] 0 2024-08-18T22:41:40.545 INFO:tasks.workunit.client.0.smithi121.stdout:4/662: creat d2/dc/d8d/da4/fef x:0 0 0 2024-08-18T22:41:40.545 INFO:tasks.workunit.client.1.smithi195.stdout:7/183: mkdir dc/d14/d4b 0 2024-08-18T22:41:40.546 INFO:tasks.workunit.client.1.smithi195.stdout:7/184: chown dc/d2a/c35 74 1 2024-08-18T22:41:40.546 INFO:tasks.workunit.client.0.smithi121.stdout:3/671: mkdir d1e/d1f/d25/d6b/d81/dfa 0 2024-08-18T22:41:40.547 INFO:tasks.workunit.client.0.smithi121.stdout:9/705: link d0/d5/dd/d2f/cb0 d0/d38/d9e/df/d3d/d89/d92/dc6/ce8 0 2024-08-18T22:41:40.547 INFO:tasks.workunit.client.1.smithi195.stdout:8/353: rmdir d1/de/d27/d4f 39 2024-08-18T22:41:40.549 INFO:tasks.workunit.client.0.smithi121.stdout:5/491: getdents d3/d5/d13/d23/d66 0 2024-08-18T22:41:40.550 INFO:tasks.workunit.client.1.smithi195.stdout:8/354: fsync d1/de/df/d1d/f6e 0 2024-08-18T22:41:40.552 INFO:tasks.workunit.client.0.smithi121.stdout:9/706: chown d0/d38/d44/la2 15180 1 2024-08-18T22:41:40.552 INFO:tasks.workunit.client.1.smithi195.stdout:7/185: dread dc/d14/f49 [0,4194304] 0 2024-08-18T22:41:40.552 INFO:tasks.workunit.client.0.smithi121.stdout:5/492: chown d3/d5/d27/d35/f36 46512 1 2024-08-18T22:41:40.553 INFO:tasks.workunit.client.0.smithi121.stdout:3/672: creat d1e/d1f/d25/d6b/d83/ffb x:0 0 0 2024-08-18T22:41:40.555 INFO:tasks.workunit.client.0.smithi121.stdout:8/759: dwrite d6/dd/d3b/da3/dca/d60/fb0 [0,4194304] 0 2024-08-18T22:41:40.557 INFO:tasks.workunit.client.1.smithi195.stdout:8/355: symlink d1/d3/db/d35/d4d/d5c/l8a 0 2024-08-18T22:41:40.557 INFO:tasks.workunit.client.0.smithi121.stdout:1/648: rename d5/d10/d67/da7 to d5/dcf/de1 0 2024-08-18T22:41:40.558 INFO:tasks.workunit.client.1.smithi195.stdout:7/186: write dc/d1d/d29/f41 [469321,44693] 0 2024-08-18T22:41:40.560 INFO:tasks.workunit.client.1.smithi195.stdout:8/356: dread - d1/d64/f80 zero size 2024-08-18T22:41:40.561 INFO:tasks.workunit.client.0.smithi121.stdout:5/493: rmdir d3 39 2024-08-18T22:41:40.561 INFO:tasks.workunit.client.1.smithi195.stdout:0/277: dwrite d0/f1c [0,4194304] 0 2024-08-18T22:41:40.562 INFO:tasks.workunit.client.1.smithi195.stdout:7/187: mkdir dc/d2a/d4c 0 2024-08-18T22:41:40.563 INFO:tasks.workunit.client.0.smithi121.stdout:4/663: dread d2/dc/d16/d22/d2c/d44/d66/f6d [0,4194304] 0 2024-08-18T22:41:40.563 INFO:tasks.workunit.client.0.smithi121.stdout:7/659: sync 2024-08-18T22:41:40.563 INFO:tasks.workunit.client.0.smithi121.stdout:2/441: sync 2024-08-18T22:41:40.563 INFO:tasks.workunit.client.0.smithi121.stdout:0/544: sync 2024-08-18T22:41:40.564 INFO:tasks.workunit.client.1.smithi195.stdout:7/188: fdatasync dc/d22/f2c 0 2024-08-18T22:41:40.565 INFO:tasks.workunit.client.1.smithi195.stdout:0/278: chown d0/dc/d11/d30/d44 3653221 1 2024-08-18T22:41:40.567 INFO:tasks.workunit.client.1.smithi195.stdout:7/189: mkdir dc/d14/d15/d4d 0 2024-08-18T22:41:40.569 INFO:tasks.workunit.client.0.smithi121.stdout:3/673: symlink d1e/d1f/d2a/lfc 0 2024-08-18T22:41:40.571 INFO:tasks.workunit.client.0.smithi121.stdout:8/760: rename d6/dd/cf to d6/dd/d3b/da3/dca/d18/d99/c101 0 2024-08-18T22:41:40.571 INFO:tasks.workunit.client.1.smithi195.stdout:7/190: write dc/d14/f3b [315177,57769] 0 2024-08-18T22:41:40.571 INFO:tasks.workunit.client.1.smithi195.stdout:3/318: dread d7/f19 [4194304,4194304] 0 2024-08-18T22:41:40.571 INFO:tasks.workunit.client.0.smithi121.stdout:3/674: readlink d1e/d1f/d2a/lfc 0 2024-08-18T22:41:40.574 INFO:tasks.workunit.client.0.smithi121.stdout:9/707: dwrite d0/d38/d9e/df/d61/db2/fa3 [0,4194304] 0 2024-08-18T22:41:40.576 INFO:tasks.workunit.client.1.smithi195.stdout:5/217: dread d0/d3/d8/f14 [0,4194304] 0 2024-08-18T22:41:40.578 INFO:tasks.workunit.client.0.smithi121.stdout:1/649: rename d5/f3c to d5/d10/d14/d2a/d3a/fe2 0 2024-08-18T22:41:40.580 INFO:tasks.workunit.client.1.smithi195.stdout:5/218: write d0/d3/df/f39 [10244,119487] 0 2024-08-18T22:41:40.582 INFO:tasks.workunit.client.0.smithi121.stdout:8/761: mknod d6/d1e/d2d/de5/c102 0 2024-08-18T22:41:40.582 INFO:tasks.workunit.client.1.smithi195.stdout:7/191: rename c0 to dc/c4e 0 2024-08-18T22:41:40.582 INFO:tasks.workunit.client.1.smithi195.stdout:3/319: symlink d7/d54/l67 0 2024-08-18T22:41:40.583 INFO:tasks.workunit.client.1.smithi195.stdout:3/320: dread - d7/f56 zero size 2024-08-18T22:41:40.583 INFO:tasks.workunit.client.1.smithi195.stdout:7/192: truncate dc/d14/f47 695947 0 2024-08-18T22:41:40.584 INFO:tasks.workunit.client.1.smithi195.stdout:8/357: dread d1/d3/f6 [4194304,4194304] 0 2024-08-18T22:41:40.586 INFO:tasks.workunit.client.0.smithi121.stdout:9/708: creat d0/d38/d44/d7f/fe9 x:0 0 0 2024-08-18T22:41:40.586 INFO:tasks.workunit.client.1.smithi195.stdout:5/219: fdatasync d0/d3/df/f16 0 2024-08-18T22:41:40.587 INFO:tasks.workunit.client.1.smithi195.stdout:3/321: write d7/da/df/f27 [357099,741] 0 2024-08-18T22:41:40.589 INFO:tasks.workunit.client.0.smithi121.stdout:9/709: unlink d0/d38/d52/d5f/fe4 0 2024-08-18T22:41:40.590 INFO:tasks.workunit.client.0.smithi121.stdout:9/710: fdatasync d0/d38/d9e/df/d61/f85 0 2024-08-18T22:41:40.591 INFO:tasks.workunit.client.1.smithi195.stdout:7/193: rename dc/d14/d15/f33 to dc/d14/f4f 0 2024-08-18T22:41:40.593 INFO:tasks.workunit.client.0.smithi121.stdout:8/762: mkdir d6/dd/d3b/da3/dca/d103 0 2024-08-18T22:41:40.594 INFO:tasks.workunit.client.1.smithi195.stdout:5/220: creat d0/d3/df/d1a/f3f x:0 0 0 2024-08-18T22:41:40.595 INFO:tasks.workunit.client.0.smithi121.stdout:3/675: dread d1e/d1f/d3e/f64 [0,4194304] 0 2024-08-18T22:41:40.597 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:40.596+0000 7f9c577fe640 1 -- 172.21.15.121:0/1728537375 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f9c4c005cd0 con 0x7f9c6c071370 2024-08-18T22:41:40.597 INFO:tasks.workunit.client.1.smithi195.stdout:0/279: truncate d0/dc/dd/f29 2597530 0 2024-08-18T22:41:40.598 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:40.597+0000 7f9c61ffb640 1 -- 172.21.15.121:0/1728537375 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+741 (secure 0 0 0) 0x7f9c5c056390 con 0x7f9c6c071370 2024-08-18T22:41:40.598 INFO:teuthology.orchestra.run.smithi121.stdout:{ 2024-08-18T22:41:40.598 INFO:teuthology.orchestra.run.smithi121.stdout: "mon": { 2024-08-18T22:41:40.598 INFO:teuthology.orchestra.run.smithi121.stdout: "ceph version 17.2.7-1406-gdf62bdcc (df62bdccd9a13bf566b27a250eddfdd89be3072d) quincy (stable)": 2 2024-08-18T22:41:40.599 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-18T22:41:40.599 INFO:teuthology.orchestra.run.smithi121.stdout: "mgr": { 2024-08-18T22:41:40.599 INFO:teuthology.orchestra.run.smithi121.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 1 2024-08-18T22:41:40.599 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-18T22:41:40.599 INFO:teuthology.orchestra.run.smithi121.stdout: "osd": { 2024-08-18T22:41:40.599 INFO:teuthology.orchestra.run.smithi121.stdout: "ceph version 17.2.7-1406-gdf62bdcc (df62bdccd9a13bf566b27a250eddfdd89be3072d) quincy (stable)": 6 2024-08-18T22:41:40.599 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-18T22:41:40.599 INFO:teuthology.orchestra.run.smithi121.stdout: "mds": { 2024-08-18T22:41:40.599 INFO:teuthology.orchestra.run.smithi121.stdout: "ceph version 17.2.7-1406-gdf62bdcc (df62bdccd9a13bf566b27a250eddfdd89be3072d) quincy (stable)": 4 2024-08-18T22:41:40.599 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-18T22:41:40.599 INFO:teuthology.orchestra.run.smithi121.stdout: "overall": { 2024-08-18T22:41:40.599 INFO:teuthology.orchestra.run.smithi121.stdout: "ceph version 17.2.7-1406-gdf62bdcc (df62bdccd9a13bf566b27a250eddfdd89be3072d) quincy (stable)": 12, 2024-08-18T22:41:40.599 INFO:teuthology.orchestra.run.smithi121.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 1 2024-08-18T22:41:40.600 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-08-18T22:41:40.600 INFO:teuthology.orchestra.run.smithi121.stdout:} 2024-08-18T22:41:40.600 INFO:tasks.workunit.client.0.smithi121.stdout:5/494: write d3/d5/f7 [1085832,73944] 0 2024-08-18T22:41:40.600 INFO:tasks.workunit.client.1.smithi195.stdout:7/194: mknod dc/d14/d4b/c50 0 2024-08-18T22:41:40.600 INFO:tasks.workunit.client.1.smithi195.stdout:5/221: write d0/d3/df/d1a/f3f [3884,41807] 0 2024-08-18T22:41:40.601 INFO:tasks.workunit.client.1.smithi195.stdout:8/358: dwrite d1/de/df/d1d/f32 [0,4194304] 0 2024-08-18T22:41:40.601 INFO:tasks.workunit.client.0.smithi121.stdout:3/676: truncate d1e/d1f/f4f 858499 0 2024-08-18T22:41:40.602 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:40.601+0000 7f9c577fe640 1 -- 172.21.15.121:0/1728537375 >> [v2:172.21.15.195:6828/1174410756,v1:172.21.15.195:6829/1174410756] conn(0x7f9c58038b50 msgr2=0x7f9c5803b000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:41:40.602 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:40.601+0000 7f9c577fe640 1 --2- 172.21.15.121:0/1728537375 >> [v2:172.21.15.195:6828/1174410756,v1:172.21.15.195:6829/1174410756] conn(0x7f9c58038b50 0x7f9c5803b000 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f9c6c0710d0 tx=0x7f9c68008040 comp rx=0 tx=0).stop 2024-08-18T22:41:40.602 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:40.601+0000 7f9c577fe640 1 -- 172.21.15.121:0/1728537375 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9c6c071370 msgr2=0x7f9c6c10b260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:41:40.602 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:40.601+0000 7f9c577fe640 1 --2- 172.21.15.121:0/1728537375 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9c6c071370 0x7f9c6c10b260 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f9c5c009ac0 tx=0x7f9c5c009da0 comp rx=0 tx=0).stop 2024-08-18T22:41:40.603 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:40.602+0000 7f9c577fe640 1 -- 172.21.15.121:0/1728537375 shutdown_connections 2024-08-18T22:41:40.604 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:40.602+0000 7f9c577fe640 1 --2- 172.21.15.121:0/1728537375 >> [v2:172.21.15.195:6828/1174410756,v1:172.21.15.195:6829/1174410756] conn(0x7f9c58038b50 0x7f9c5803b000 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:41:40.604 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:40.602+0000 7f9c577fe640 1 --2- 172.21.15.121:0/1728537375 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9c6c071370 0x7f9c6c10b260 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:41:40.604 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:40.602+0000 7f9c577fe640 1 --2- 172.21.15.121:0/1728537375 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9c6c06fde0 0x7f9c6c10ad20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:41:40.604 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:40.602+0000 7f9c577fe640 1 -- 172.21.15.121:0/1728537375 >> 172.21.15.121:0/1728537375 conn(0x7f9c6c0f7a80 msgr2=0x7f9c6c0f91a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:41:40.604 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:40.603+0000 7f9c577fe640 1 -- 172.21.15.121:0/1728537375 shutdown_connections 2024-08-18T22:41:40.604 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:40.603+0000 7f9c577fe640 1 -- 172.21.15.121:0/1728537375 wait complete. 2024-08-18T22:41:40.604 INFO:tasks.workunit.client.0.smithi121.stdout:4/664: truncate d2/dc/d16/d59/d83/f98 147681 0 2024-08-18T22:41:40.605 INFO:tasks.workunit.client.1.smithi195.stdout:3/322: dwrite d7/da/df/f27 [0,4194304] 0 2024-08-18T22:41:40.606 INFO:tasks.workunit.client.1.smithi195.stdout:8/359: fsync d1/d3/db/fd 0 2024-08-18T22:41:40.607 INFO:tasks.workunit.client.0.smithi121.stdout:7/660: dwrite de/f16 [0,4194304] 0 2024-08-18T22:41:40.607 INFO:tasks.workunit.client.0.smithi121.stdout:9/711: getdents d0/d5/dd/d3b/d48 0 2024-08-18T22:41:40.609 INFO:tasks.workunit.client.0.smithi121.stdout:3/677: creat d1e/d1f/d5e/dbc/ffd x:0 0 0 2024-08-18T22:41:40.609 INFO:tasks.workunit.client.1.smithi195.stdout:8/360: readlink d1/d3/db/d39/l53 0 2024-08-18T22:41:40.610 INFO:tasks.workunit.client.0.smithi121.stdout:4/665: creat d2/dc/ff0 x:0 0 0 2024-08-18T22:41:40.611 INFO:tasks.workunit.client.1.smithi195.stdout:3/323: rmdir d7/da/df/d38 39 2024-08-18T22:41:40.611 INFO:tasks.workunit.client.1.smithi195.stdout:0/280: dwrite d0/f3 [0,4194304] 0 2024-08-18T22:41:40.611 INFO:tasks.workunit.client.1.smithi195.stdout:3/324: readlink d7/l15 0 2024-08-18T22:41:40.612 INFO:tasks.workunit.client.0.smithi121.stdout:0/545: dwrite d1/d4/da/d2f/da0/f8c [0,4194304] 0 2024-08-18T22:41:40.614 INFO:tasks.workunit.client.1.smithi195.stdout:0/281: stat d0/dc/d11/d23/c2f 0 2024-08-18T22:41:40.615 INFO:tasks.workunit.client.0.smithi121.stdout:2/442: dread d2/d3/d48/d77/f6d [0,4194304] 0 2024-08-18T22:41:40.615 INFO:tasks.workunit.client.0.smithi121.stdout:9/712: chown d0/d38/d9e/df/d3d/f95 1265940 1 2024-08-18T22:41:40.620 INFO:tasks.workunit.client.1.smithi195.stdout:8/361: mkdir d1/d3/db/d35/d4d/d8b 0 2024-08-18T22:41:40.621 INFO:tasks.workunit.client.1.smithi195.stdout:8/362: dread - d1/d3/d1c/f45 zero size 2024-08-18T22:41:40.621 INFO:tasks.workunit.client.1.smithi195.stdout:3/325: readlink d7/d1f/d49/l66 0 2024-08-18T22:41:40.622 INFO:tasks.workunit.client.0.smithi121.stdout:8/763: getdents d6/d1e/d2d/d78/d45/dd9 0 2024-08-18T22:41:40.622 INFO:tasks.workunit.client.0.smithi121.stdout:5/495: creat d3/d5/d13/d19/f97 x:0 0 0 2024-08-18T22:41:40.623 INFO:tasks.workunit.client.1.smithi195.stdout:0/282: mkdir d0/dc/d11/d23/d51 0 2024-08-18T22:41:40.624 INFO:tasks.workunit.client.1.smithi195.stdout:5/222: getdents d0/d3/df 0 2024-08-18T22:41:40.624 INFO:tasks.workunit.client.1.smithi195.stdout:2/207: sync 2024-08-18T22:41:40.624 INFO:tasks.workunit.client.1.smithi195.stdout:1/371: sync 2024-08-18T22:41:40.624 INFO:tasks.workunit.client.1.smithi195.stdout:0/283: write d0/dc/d11/f32 [428107,115091] 0 2024-08-18T22:41:40.627 INFO:tasks.workunit.client.0.smithi121.stdout:7/661: mkdir de/d13/d18/d23/d24/d85/dce/d2f/d4b/daf/dd4 0 2024-08-18T22:41:40.629 INFO:tasks.workunit.client.1.smithi195.stdout:1/372: write da/d4c/f66 [413020,128443] 0 2024-08-18T22:41:40.630 INFO:tasks.workunit.client.1.smithi195.stdout:8/363: mkdir d1/d3/db/d39/d44/d8c 0 2024-08-18T22:41:40.631 INFO:tasks.workunit.client.0.smithi121.stdout:7/662: truncate de/d13/d18/d23/d24/d85/dce/d2f/fc7 747501 0 2024-08-18T22:41:40.631 INFO:tasks.workunit.client.1.smithi195.stdout:5/223: readlink d0/d2/l10 0 2024-08-18T22:41:40.633 INFO:tasks.workunit.client.0.smithi121.stdout:2/443: creat d2/d8/d19/f93 x:0 0 0 2024-08-18T22:41:40.634 INFO:tasks.workunit.client.1.smithi195.stdout:3/326: read d7/da/fb [578586,31012] 0 2024-08-18T22:41:40.635 INFO:tasks.workunit.client.0.smithi121.stdout:8/764: symlink d6/d20/d69/d77/l104 0 2024-08-18T22:41:40.636 INFO:tasks.workunit.client.0.smithi121.stdout:2/444: fsync d2/d8/d19/f24 0 2024-08-18T22:41:40.637 INFO:tasks.workunit.client.1.smithi195.stdout:0/284: fsync d0/dc/dd/f3c 0 2024-08-18T22:41:40.638 INFO:tasks.workunit.client.0.smithi121.stdout:0/546: dwrite d1/d4/db/d24/df/d8/d78/f7a [0,4194304] 0 2024-08-18T22:41:40.639 INFO:tasks.workunit.client.0.smithi121.stdout:5/496: chown d3/d5/d27/d35/c3a 1439053 1 2024-08-18T22:41:40.645 INFO:tasks.workunit.client.1.smithi195.stdout:3/327: creat d7/da/d4d/f68 x:0 0 0 2024-08-18T22:41:40.645 INFO:tasks.workunit.client.1.smithi195.stdout:7/195: dread f1 [0,4194304] 0 2024-08-18T22:41:40.645 INFO:tasks.workunit.client.1.smithi195.stdout:5/224: dwrite d0/d3/d8/f13 [0,4194304] 0 2024-08-18T22:41:40.645 INFO:tasks.workunit.client.0.smithi121.stdout:7/663: dwrite de/d13/d18/d23/d24/d85/dce/d2f/d36/f54 [0,4194304] 0 2024-08-18T22:41:40.646 INFO:tasks.workunit.client.1.smithi195.stdout:0/285: read d0/dc/d11/f20 [4063917,4993] 0 2024-08-18T22:41:40.648 INFO:tasks.workunit.client.1.smithi195.stdout:8/364: rename d1/d3/db/c82 to d1/d3/db/c8d 0 2024-08-18T22:41:40.649 INFO:tasks.workunit.client.0.smithi121.stdout:3/678: write d1e/f31 [4052085,119926] 0 2024-08-18T22:41:40.651 INFO:tasks.workunit.client.0.smithi121.stdout:8/765: creat d6/dd/d3b/da3/dca/d37/f105 x:0 0 0 2024-08-18T22:41:40.652 INFO:tasks.workunit.client.0.smithi121.stdout:0/547: fsync d1/d4/db/d24/d30/f31 0 2024-08-18T22:41:40.654 INFO:tasks.workunit.client.0.smithi121.stdout:2/445: truncate d2/d8/d1f/f35 2810174 0 2024-08-18T22:41:40.656 INFO:tasks.workunit.client.1.smithi195.stdout:0/286: rmdir d0/dc/d11/d30/d44/d41 39 2024-08-18T22:41:40.658 INFO:tasks.workunit.client.1.smithi195.stdout:7/196: dwrite dc/d14/d15/d17/d18/f43 [0,4194304] 0 2024-08-18T22:41:40.658 INFO:tasks.workunit.client.1.smithi195.stdout:1/373: link da/lf da/d4c/l82 0 2024-08-18T22:41:40.659 INFO:tasks.workunit.client.0.smithi121.stdout:4/666: dread d2/dc/d16/d22/d2c/d44/da7/fb1 [0,4194304] 0 2024-08-18T22:41:40.659 INFO:tasks.workunit.client.1.smithi195.stdout:8/365: write d1/de/d31/d5a/f57 [4176059,71848] 0 2024-08-18T22:41:40.660 INFO:tasks.workunit.client.0.smithi121.stdout:0/548: mknod d1/d4/da/d2f/da0/cbd 0 2024-08-18T22:41:40.663 INFO:tasks.workunit.client.1.smithi195.stdout:7/197: chown dc/d14/d15/d17/f2f 31278366 1 2024-08-18T22:41:40.663 INFO:tasks.workunit.client.1.smithi195.stdout:5/225: rename d0/d3/d8/c1c to d0/c40 0 2024-08-18T22:41:40.663 INFO:tasks.workunit.client.1.smithi195.stdout:1/374: chown da/d4c/d5d/d63/f64 7007 1 2024-08-18T22:41:40.664 INFO:tasks.workunit.client.1.smithi195.stdout:1/375: dread - da/d3d/f40 zero size 2024-08-18T22:41:40.664 INFO:tasks.workunit.client.1.smithi195.stdout:3/328: creat d7/da/df/f69 x:0 0 0 2024-08-18T22:41:40.664 INFO:tasks.workunit.client.0.smithi121.stdout:2/446: creat d2/d73/f94 x:0 0 0 2024-08-18T22:41:40.666 INFO:tasks.workunit.client.0.smithi121.stdout:5/497: truncate d3/d5/d13/d23/f34 4020114 0 2024-08-18T22:41:40.668 INFO:tasks.workunit.client.0.smithi121.stdout:7/664: creat de/d13/fd5 x:0 0 0 2024-08-18T22:41:40.669 INFO:tasks.workunit.client.0.smithi121.stdout:5/498: write d3/d5/d13/d23/d66/f79 [235953,31087] 0 2024-08-18T22:41:40.673 INFO:tasks.workunit.client.1.smithi195.stdout:1/376: dwrite da/d18/d28/d7b/f7e [0,4194304] 0 2024-08-18T22:41:40.674 INFO:tasks.workunit.client.0.smithi121.stdout:4/667: mkdir d2/dc/d1c/dc1/ddb/df1 0 2024-08-18T22:41:40.675 INFO:tasks.workunit.client.0.smithi121.stdout:0/549: creat d1/d4/db/d18/fbe x:0 0 0 2024-08-18T22:41:40.676 INFO:tasks.workunit.client.0.smithi121.stdout:4/668: chown d2/dc/d16/d22/d2c/d44/cc0 3210 1 2024-08-18T22:41:40.679 INFO:tasks.workunit.client.0.smithi121.stdout:7/665: rename de/d13/d18/d23/d24/d85/dce/d4f to de/d13/d18/d23/d24/d85/dce/d34/d38/dd6 0 2024-08-18T22:41:40.679 INFO:tasks.workunit.client.0.smithi121.stdout:0/550: rmdir d1/d4/db/d18/d40/d83/daf 39 2024-08-18T22:41:40.680 INFO:tasks.workunit.client.1.smithi195.stdout:0/287: getdents d0/dc/d11/d30/d44/d43 0 2024-08-18T22:41:40.681 INFO:tasks.workunit.client.1.smithi195.stdout:7/198: dwrite dc/f1e [0,4194304] 0 2024-08-18T22:41:40.682 INFO:tasks.workunit.client.0.smithi121.stdout:0/551: chown d1/d4/db/d24/d30/d52/f87 293 1 2024-08-18T22:41:40.683 INFO:tasks.workunit.client.0.smithi121.stdout:4/669: rename d2/fe5 to d2/dc/d16/d22/d2c/d44/da7/ff2 0 2024-08-18T22:41:40.683 INFO:tasks.workunit.client.1.smithi195.stdout:7/199: write dc/f1e [2487357,51033] 0 2024-08-18T22:41:40.684 INFO:tasks.workunit.client.0.smithi121.stdout:7/666: mkdir de/d13/d18/d2e/dd7 0 2024-08-18T22:41:40.685 INFO:tasks.workunit.client.0.smithi121.stdout:4/670: readlink d2/dc/d16/d22/l27 0 2024-08-18T22:41:40.687 INFO:tasks.workunit.client.1.smithi195.stdout:0/288: write d0/dc/f33 [110789,24357] 0 2024-08-18T22:41:40.687 INFO:tasks.workunit.client.1.smithi195.stdout:0/289: write d0/dc/d11/f27 [5062481,51003] 0 2024-08-18T22:41:40.687 INFO:tasks.workunit.client.0.smithi121.stdout:0/552: symlink d1/d4/db/d24/df/lbf 0 2024-08-18T22:41:40.688 INFO:tasks.workunit.client.1.smithi195.stdout:2/208: write d1/d8/d3d/f20 [2046214,40501] 0 2024-08-18T22:41:40.688 INFO:tasks.workunit.client.0.smithi121.stdout:0/553: stat d1/d4/db/d18/d1c/d5f/l9c 0 2024-08-18T22:41:40.689 INFO:tasks.workunit.client.1.smithi195.stdout:0/290: write d0/f3 [4171212,49613] 0 2024-08-18T22:41:40.689 INFO:tasks.workunit.client.0.smithi121.stdout:7/667: mknod de/d13/d18/d23/d24/cd8 0 2024-08-18T22:41:40.690 INFO:tasks.workunit.client.0.smithi121.stdout:0/554: chown d1/d4/db/d24/d30/d52/f46 0 1 2024-08-18T22:41:40.691 INFO:tasks.workunit.client.1.smithi195.stdout:1/377: dread da/d18/f39 [0,4194304] 0 2024-08-18T22:41:40.692 INFO:tasks.workunit.client.1.smithi195.stdout:1/378: write da/d4c/d5d/d63/f65 [861915,64854] 0 2024-08-18T22:41:40.693 INFO:tasks.workunit.client.1.smithi195.stdout:7/200: mknod dc/d14/c51 0 2024-08-18T22:41:40.694 INFO:tasks.workunit.client.0.smithi121.stdout:4/671: creat d2/dc/d16/d22/d29/ded/ff3 x:0 0 0 2024-08-18T22:41:40.695 INFO:tasks.workunit.client.0.smithi121.stdout:2/447: dread d2/d3/d51/f81 [0,4194304] 0 2024-08-18T22:41:40.696 INFO:tasks.workunit.client.1.smithi195.stdout:1/379: symlink da/d18/l83 0 2024-08-18T22:41:40.696 INFO:tasks.workunit.client.1.smithi195.stdout:7/201: truncate dc/d22/f2c 194401 0 2024-08-18T22:41:40.698 INFO:tasks.workunit.client.0.smithi121.stdout:5/499: fsync d3/d5/d13/d23/d66/f79 0 2024-08-18T22:41:40.700 INFO:tasks.workunit.client.0.smithi121.stdout:9/713: write d0/d38/d9e/df/d3d/d89/d92/dc6/fd4 [2731297,99484] 0 2024-08-18T22:41:40.704 INFO:tasks.workunit.client.0.smithi121.stdout:0/555: link d1/d4/db/d24/d30/d52/d5b/f7b d1/d4/db/d24/d30/fc0 0 2024-08-18T22:41:40.704 INFO:tasks.workunit.client.0.smithi121.stdout:2/448: truncate d2/d3/d48/f71 878900 0 2024-08-18T22:41:40.706 INFO:tasks.workunit.client.1.smithi195.stdout:3/329: rename d7/da/d4d to d7/da/df/d1c/d6a 0 2024-08-18T22:41:40.709 INFO:tasks.workunit.client.0.smithi121.stdout:9/714: fdatasync d0/d38/d9e/df/f40 0 2024-08-18T22:41:40.709 INFO:tasks.workunit.client.1.smithi195.stdout:7/202: dread dc/d14/d15/d17/f2f [0,4194304] 0 2024-08-18T22:41:40.710 INFO:tasks.workunit.client.0.smithi121.stdout:4/672: rename d2/dc/d16/d22/d2c/c4c to d2/dc/d8d/dc4/cf4 0 2024-08-18T22:41:40.710 INFO:tasks.workunit.client.1.smithi195.stdout:3/330: write d7/da/df/d38/f45 [1292554,80142] 0 2024-08-18T22:41:40.714 INFO:tasks.workunit.client.0.smithi121.stdout:3/679: dwrite d1e/d1f/d25/d6b/d81/fcc [4194304,4194304] 0 2024-08-18T22:41:40.715 INFO:tasks.workunit.client.0.smithi121.stdout:7/668: getdents de/d13/d18/d23/d24/d29/d43/d7f 0 2024-08-18T22:41:40.717 INFO:tasks.workunit.client.0.smithi121.stdout:7/669: chown de/d13/d18/d23/d24/d29/ca7 1244570 1 2024-08-18T22:41:40.717 INFO:tasks.workunit.client.0.smithi121.stdout:8/766: truncate d6/dd/f16 2706818 0 2024-08-18T22:41:40.719 INFO:tasks.workunit.client.1.smithi195.stdout:7/203: dwrite dc/d14/f3b [0,4194304] 0 2024-08-18T22:41:40.721 INFO:tasks.workunit.client.0.smithi121.stdout:9/715: mkdir d0/d38/d9e/df/d3d/d89/dea 0 2024-08-18T22:41:40.722 INFO:tasks.workunit.client.1.smithi195.stdout:2/209: dread d1/d8/d3d/f1c [0,4194304] 0 2024-08-18T22:41:40.722 INFO:tasks.workunit.client.0.smithi121.stdout:0/556: mknod d1/cc1 0 2024-08-18T22:41:40.723 INFO:tasks.workunit.client.1.smithi195.stdout:3/331: creat d7/da/f6b x:0 0 0 2024-08-18T22:41:40.725 INFO:tasks.workunit.client.1.smithi195.stdout:3/332: write f6 [923466,42782] 0 2024-08-18T22:41:40.727 INFO:tasks.workunit.client.1.smithi195.stdout:5/226: truncate d0/d2/d29/f3d 131295 0 2024-08-18T22:41:40.727 INFO:tasks.workunit.client.1.smithi195.stdout:7/204: symlink dc/d1d/l52 0 2024-08-18T22:41:40.729 INFO:tasks.workunit.client.0.smithi121.stdout:3/680: creat d1e/d1f/d25/d58/df7/de3/ffe x:0 0 0 2024-08-18T22:41:40.729 INFO:tasks.workunit.client.0.smithi121.stdout:9/716: dwrite d0/d38/d9e/df/d3d/d89/faa [0,4194304] 0 2024-08-18T22:41:40.732 INFO:tasks.workunit.client.1.smithi195.stdout:8/366: dwrite d1/de/df/d1d/f6e [4194304,4194304] 0 2024-08-18T22:41:40.732 INFO:tasks.workunit.client.1.smithi195.stdout:3/333: write d7/da/f14 [1736526,95046] 0 2024-08-18T22:41:40.732 INFO:tasks.workunit.client.1.smithi195.stdout:7/205: fsync dc/d14/d2b/f3a 0 2024-08-18T22:41:40.734 INFO:tasks.workunit.client.0.smithi121.stdout:5/500: creat d3/d5/d13/d19/d24/d32/f98 x:0 0 0 2024-08-18T22:41:40.736 INFO:tasks.workunit.client.0.smithi121.stdout:8/767: creat d6/dd/d3b/da3/dca/d60/d5b/d6e/f106 x:0 0 0 2024-08-18T22:41:40.738 INFO:tasks.workunit.client.1.smithi195.stdout:1/380: creat da/d18/d28/d31/f84 x:0 0 0 2024-08-18T22:41:40.741 INFO:tasks.workunit.client.0.smithi121.stdout:7/670: rename de/l2a to de/d13/d18/d23/d24/d85/ld9 0 2024-08-18T22:41:40.745 INFO:tasks.workunit.client.0.smithi121.stdout:2/449: dread d2/d8/d1f/f76 [0,4194304] 0 2024-08-18T22:41:40.745 INFO:tasks.workunit.client.1.smithi195.stdout:2/210: dwrite d1/d8/d27/f3a [0,4194304] 0 2024-08-18T22:41:40.749 INFO:tasks.workunit.client.0.smithi121.stdout:9/717: creat d0/d5/dd/d3b/d48/feb x:0 0 0 2024-08-18T22:41:40.755 INFO:tasks.workunit.client.1.smithi195.stdout:1/381: mknod da/d18/d28/d31/c85 0 2024-08-18T22:41:40.755 INFO:tasks.workunit.client.1.smithi195.stdout:6/211: sync 2024-08-18T22:41:40.756 INFO:tasks.workunit.client.0.smithi121.stdout:5/501: getdents d3/d5c/d78 0 2024-08-18T22:41:40.757 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:40.755+0000 7f0ed7db2640 1 -- 172.21.15.121:0/1400842172 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0ed0103bd0 msgr2=0x7f0ed0104040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:41:40.757 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:40.755+0000 7f0ed7db2640 1 --2- 172.21.15.121:0/1400842172 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0ed0103bd0 0x7f0ed0104040 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f0ec00048d0 tx=0x7f0ec0009da0 comp rx=0 tx=0).stop 2024-08-18T22:41:40.757 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:40.755+0000 7f0ed7db2640 1 -- 172.21.15.121:0/1400842172 shutdown_connections 2024-08-18T22:41:40.757 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:40.755+0000 7f0ed7db2640 1 --2- 172.21.15.121:0/1400842172 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0ed0103bd0 0x7f0ed0104040 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:41:40.757 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:40.755+0000 7f0ed7db2640 1 --2- 172.21.15.121:0/1400842172 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0ed0102900 0x7f0ed0102d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:41:40.757 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:40.755+0000 7f0ed7db2640 1 -- 172.21.15.121:0/1400842172 >> 172.21.15.121:0/1400842172 conn(0x7f0ed00661f0 msgr2=0x7f0ed0066610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:41:40.757 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:40.756+0000 7f0ed7db2640 1 -- 172.21.15.121:0/1400842172 shutdown_connections 2024-08-18T22:41:40.757 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:40.756+0000 7f0ed7db2640 1 -- 172.21.15.121:0/1400842172 wait complete. 2024-08-18T22:41:40.758 INFO:tasks.workunit.client.0.smithi121.stdout:8/768: dwrite d6/dd/d3b/da3/dca/f1d [0,4194304] 0 2024-08-18T22:41:40.758 INFO:tasks.workunit.client.0.smithi121.stdout:9/718: mknod d0/cec 0 2024-08-18T22:41:40.759 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:40.756+0000 7f0ed7db2640 1 Processor -- start 2024-08-18T22:41:40.759 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:40.756+0000 7f0ed7db2640 1 -- start start 2024-08-18T22:41:40.759 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:40.757+0000 7f0ed7db2640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0ed0102900 0x7f0ed0067260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:41:40.759 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:40.757+0000 7f0ed7db2640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0ed0103bd0 0x7f0ed00677a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:41:40.759 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:40.757+0000 7f0ed7db2640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ed0067da0 con 0x7f0ed0103bd0 2024-08-18T22:41:40.760 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:40.757+0000 7f0ed7db2640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ed0068610 con 0x7f0ed0102900 2024-08-18T22:41:40.760 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:40.757+0000 7f0ed534d640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0ed0103bd0 0x7f0ed00677a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:41:40.760 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:40.757+0000 7f0ed534d640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0ed0103bd0 0x7f0ed00677a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:58966/0 (socket says 172.21.15.121:58966) 2024-08-18T22:41:40.760 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:40.757+0000 7f0ed534d640 1 -- 172.21.15.121:0/2448079062 learned_addr learned my addr 172.21.15.121:0/2448079062 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-18T22:41:40.760 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:40.757+0000 7f0ed534d640 1 -- 172.21.15.121:0/2448079062 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0ed0102900 msgr2=0x7f0ed0067260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:41:40.760 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:40.757+0000 7f0ed534d640 1 --2- 172.21.15.121:0/2448079062 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0ed0102900 0x7f0ed0067260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:41:40.760 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:40.757+0000 7f0ed534d640 1 -- 172.21.15.121:0/2448079062 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ec0005040 con 0x7f0ed0103bd0 2024-08-18T22:41:40.760 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:40.758+0000 7f0ed534d640 1 --2- 172.21.15.121:0/2448079062 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0ed0103bd0 0x7f0ed00677a0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f0ec00048a0 tx=0x7f0ec0009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:41:40.760 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:40.758+0000 7f0ec67fc640 1 -- 172.21.15.121:0/2448079062 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0ec0038070 con 0x7f0ed0103bd0 2024-08-18T22:41:40.760 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:40.758+0000 7f0ed7db2640 1 -- 172.21.15.121:0/2448079062 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ed0068890 con 0x7f0ed0103bd0 2024-08-18T22:41:40.760 INFO:tasks.workunit.client.0.smithi121.stdout:4/673: getdents d2/dc/d8d/da4 0 2024-08-18T22:41:40.761 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:40.758+0000 7f0ed7db2640 1 -- 172.21.15.121:0/2448079062 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ed0068e30 con 0x7f0ed0103bd0 2024-08-18T22:41:40.761 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:40.758+0000 7f0ec67fc640 1 -- 172.21.15.121:0/2448079062 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f0ec002ae90 con 0x7f0ed0103bd0 2024-08-18T22:41:40.761 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:40.758+0000 7f0ec67fc640 1 -- 172.21.15.121:0/2448079062 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0ec003e430 con 0x7f0ed0103bd0 2024-08-18T22:41:40.761 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:40.760+0000 7f0ec67fc640 1 -- 172.21.15.121:0/2448079062 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 22) v1 ==== 45945+0+0 (secure 0 0 0) 0x7f0ec0030020 con 0x7f0ed0103bd0 2024-08-18T22:41:40.761 INFO:tasks.workunit.client.0.smithi121.stdout:3/681: link d1e/d1f/c20 d1e/d1f/d25/d6b/cff 0 2024-08-18T22:41:40.762 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:40.760+0000 7f0ed7db2640 1 -- 172.21.15.121:0/2448079062 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0eb4005240 con 0x7f0ed0103bd0 2024-08-18T22:41:40.762 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:40.760+0000 7f0ec67fc640 1 --2- 172.21.15.121:0/2448079062 >> [v2:172.21.15.195:6828/1174410756,v1:172.21.15.195:6829/1174410756] conn(0x7f0ebc038ab0 0x7f0ebc03af60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:41:40.762 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:40.760+0000 7f0ec67fc640 1 -- 172.21.15.121:0/2448079062 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f0ec006c540 con 0x7f0ed0103bd0 2024-08-18T22:41:40.762 INFO:tasks.workunit.client.0.smithi121.stdout:3/682: dread - d1e/ff5 zero size 2024-08-18T22:41:40.763 INFO:tasks.workunit.client.1.smithi195.stdout:0/291: dread d0/dc/d11/f20 [0,4194304] 0 2024-08-18T22:41:40.763 INFO:tasks.workunit.client.1.smithi195.stdout:2/211: mkdir d1/d24/d26/d42/d44 0 2024-08-18T22:41:40.763 INFO:tasks.workunit.client.1.smithi195.stdout:7/206: dwrite dc/f10 [0,4194304] 0 2024-08-18T22:41:40.764 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:40.763+0000 7f0ed5b4e640 1 --2- 172.21.15.121:0/2448079062 >> [v2:172.21.15.195:6828/1174410756,v1:172.21.15.195:6829/1174410756] conn(0x7f0ebc038ab0 0x7f0ebc03af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:41:40.764 INFO:tasks.workunit.client.0.smithi121.stdout:8/769: write d6/d1e/f3f [2716142,107717] 0 2024-08-18T22:41:40.765 INFO:tasks.workunit.client.0.smithi121.stdout:7/671: write de/d13/d18/d23/d24/d85/dce/f61 [1558863,86127] 0 2024-08-18T22:41:40.767 INFO:tasks.workunit.client.0.smithi121.stdout:7/672: write de/d13/d18/d23/fbe [464389,72827] 0 2024-08-18T22:41:40.767 INFO:tasks.workunit.client.1.smithi195.stdout:5/227: dread d0/db/f19 [0,4194304] 0 2024-08-18T22:41:40.769 INFO:tasks.workunit.client.0.smithi121.stdout:5/502: rmdir d3/d5/d13/d19 39 2024-08-18T22:41:40.770 INFO:tasks.workunit.client.1.smithi195.stdout:3/334: dwrite d7/da/df/f3b [0,4194304] 0 2024-08-18T22:41:40.770 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:40.769+0000 7f0ed5b4e640 1 --2- 172.21.15.121:0/2448079062 >> [v2:172.21.15.195:6828/1174410756,v1:172.21.15.195:6829/1174410756] conn(0x7f0ebc038ab0 0x7f0ebc03af60 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f0ed0067010 tx=0x7f0ecc00b040 comp rx=0 tx=0).ready entity=mgr.24377 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:41:40.770 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:40.769+0000 7f0ec67fc640 1 -- 172.21.15.121:0/2448079062 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7f0ec0046a40 con 0x7f0ed0103bd0 2024-08-18T22:41:40.770 INFO:tasks.workunit.client.1.smithi195.stdout:0/292: write d0/dc/dd/f3c [2099195,82759] 0 2024-08-18T22:41:40.773 INFO:tasks.workunit.client.0.smithi121.stdout:0/557: write d1/d4/db/d24/d30/f31 [958926,12969] 0 2024-08-18T22:41:40.776 INFO:tasks.workunit.client.0.smithi121.stdout:5/503: write d3/d5/d27/d35/d58/f77 [385128,122164] 0 2024-08-18T22:41:40.776 INFO:tasks.workunit.client.0.smithi121.stdout:5/504: stat d3/d5/f11 0 2024-08-18T22:41:40.778 INFO:tasks.workunit.client.1.smithi195.stdout:1/382: creat da/d4c/d5d/d63/f86 x:0 0 0 2024-08-18T22:41:40.779 INFO:tasks.workunit.client.1.smithi195.stdout:6/212: truncate da/d15/f34 1671594 0 2024-08-18T22:41:40.779 INFO:tasks.workunit.client.1.smithi195.stdout:2/212: dwrite d1/f5 [0,4194304] 0 2024-08-18T22:41:40.780 INFO:tasks.workunit.client.0.smithi121.stdout:8/770: creat d6/f107 x:0 0 0 2024-08-18T22:41:40.780 INFO:tasks.workunit.client.0.smithi121.stdout:3/683: link d1e/d1f/d25/d67/d92/dbd/cc0 d1e/d1f/d25/d6b/db4/d94/c100 0 2024-08-18T22:41:40.780 INFO:tasks.workunit.client.0.smithi121.stdout:5/505: write d3/d5/d27/d35/f36 [3498190,90294] 0 2024-08-18T22:41:40.781 INFO:tasks.workunit.client.1.smithi195.stdout:7/207: symlink dc/d14/d4b/l53 0 2024-08-18T22:41:40.782 INFO:tasks.workunit.client.1.smithi195.stdout:6/213: write da/db/d19/f27 [343465,25724] 0 2024-08-18T22:41:40.783 INFO:tasks.workunit.client.1.smithi195.stdout:3/335: mkdir d7/da/df/d1c/d6a/d6c 0 2024-08-18T22:41:40.784 INFO:tasks.workunit.client.1.smithi195.stdout:6/214: dread - da/d15/f31 zero size 2024-08-18T22:41:40.784 INFO:tasks.workunit.client.1.smithi195.stdout:5/228: write d0/f1d [379653,118428] 0 2024-08-18T22:41:40.786 INFO:tasks.workunit.client.0.smithi121.stdout:1/650: sync 2024-08-18T22:41:40.787 INFO:tasks.workunit.client.0.smithi121.stdout:0/558: dwrite d1/d8a/fa9 [0,4194304] 0 2024-08-18T22:41:40.788 INFO:tasks.workunit.client.1.smithi195.stdout:7/208: mknod dc/d1d/c54 0 2024-08-18T22:41:40.789 INFO:tasks.workunit.client.0.smithi121.stdout:0/559: chown d1/f69 8107220 1 2024-08-18T22:41:40.789 INFO:tasks.workunit.client.1.smithi195.stdout:8/367: dread d1/d3/db/d35/f42 [0,4194304] 0 2024-08-18T22:41:40.790 INFO:tasks.workunit.client.0.smithi121.stdout:3/684: symlink d1e/d1f/da6/dc7/db8/l101 0 2024-08-18T22:41:40.791 INFO:tasks.workunit.client.0.smithi121.stdout:0/560: fdatasync d1/d4/da/d2f/da0/f6d 0 2024-08-18T22:41:40.791 INFO:tasks.workunit.client.1.smithi195.stdout:7/209: dread - dc/d14/f4f zero size 2024-08-18T22:41:40.791 INFO:tasks.workunit.client.1.smithi195.stdout:0/293: creat d0/dc/d11/d23/d51/f52 x:0 0 0 2024-08-18T22:41:40.791 INFO:tasks.workunit.client.0.smithi121.stdout:3/685: chown d1e/d1f/fc3 0 1 2024-08-18T22:41:40.793 INFO:tasks.workunit.client.1.smithi195.stdout:8/368: readlink d1/d3/d1c/d49/l5e 0 2024-08-18T22:41:40.794 INFO:tasks.workunit.client.0.smithi121.stdout:3/686: dread - d1e/d1f/d25/d58/fc1 zero size 2024-08-18T22:41:40.797 INFO:tasks.workunit.client.1.smithi195.stdout:3/336: symlink d7/d1f/d49/l6d 0 2024-08-18T22:41:40.799 INFO:tasks.workunit.client.1.smithi195.stdout:9/331: sync 2024-08-18T22:41:40.799 INFO:tasks.workunit.client.1.smithi195.stdout:4/313: sync 2024-08-18T22:41:40.804 INFO:tasks.workunit.client.1.smithi195.stdout:9/332: dread - d1c/f58 zero size 2024-08-18T22:41:40.804 INFO:tasks.workunit.client.0.smithi121.stdout:4/674: truncate d2/dc/d16/d22/d2c/d44/da7/ff2 1195645 0 2024-08-18T22:41:40.807 INFO:tasks.workunit.client.1.smithi195.stdout:1/383: getdents da/d3d 0 2024-08-18T22:41:40.807 INFO:tasks.workunit.client.0.smithi121.stdout:1/651: creat d5/d10/d14/d2a/d3a/fe3 x:0 0 0 2024-08-18T22:41:40.808 INFO:tasks.workunit.client.0.smithi121.stdout:3/687: dwrite d1e/d1f/d25/d6b/db4/d94/fab [4194304,4194304] 0 2024-08-18T22:41:40.808 INFO:tasks.workunit.client.0.smithi121.stdout:7/673: truncate de/d13/f49 249170 0 2024-08-18T22:41:40.810 INFO:tasks.workunit.client.0.smithi121.stdout:5/506: symlink d3/l99 0 2024-08-18T22:41:40.810 INFO:tasks.workunit.client.1.smithi195.stdout:6/215: rename da/d15/d1c/d2e/f33 to da/db/d26/d2d/f42 0 2024-08-18T22:41:40.812 INFO:tasks.workunit.client.0.smithi121.stdout:3/688: chown d1e/d1f/da6/dc7/c88 12180597 1 2024-08-18T22:41:40.814 INFO:tasks.workunit.client.1.smithi195.stdout:8/369: unlink d1/de/df/d1d/f32 0 2024-08-18T22:41:40.815 INFO:tasks.workunit.client.0.smithi121.stdout:0/561: creat d1/d47/fc2 x:0 0 0 2024-08-18T22:41:40.815 INFO:tasks.workunit.client.1.smithi195.stdout:7/210: dwrite dc/f10 [0,4194304] 0 2024-08-18T22:41:40.816 INFO:tasks.workunit.client.1.smithi195.stdout:0/294: dwrite d0/dc/f33 [0,4194304] 0 2024-08-18T22:41:40.816 INFO:tasks.workunit.client.0.smithi121.stdout:0/562: stat d1/cc1 0 2024-08-18T22:41:40.818 INFO:tasks.workunit.client.0.smithi121.stdout:1/652: mkdir d5/d10/d14/d34/de4 0 2024-08-18T22:41:40.819 INFO:tasks.workunit.client.1.smithi195.stdout:4/314: symlink d0/d7/l68 0 2024-08-18T22:41:40.820 INFO:tasks.workunit.client.0.smithi121.stdout:2/450: dwrite d2/d3/f49 [0,4194304] 0 2024-08-18T22:41:40.822 INFO:tasks.workunit.client.0.smithi121.stdout:1/653: read - d5/d10/d14/d2a/d3a/d87/d6c/fcc zero size 2024-08-18T22:41:40.822 INFO:tasks.workunit.client.1.smithi195.stdout:2/213: dwrite d1/d8/d3d/fa [4194304,4194304] 0 2024-08-18T22:41:40.827 INFO:tasks.workunit.client.1.smithi195.stdout:2/214: stat d1/d8/f1a 0 2024-08-18T22:41:40.828 INFO:tasks.workunit.client.0.smithi121.stdout:9/719: fdatasync d0/d38/d44/dbf/f77 0 2024-08-18T22:41:40.829 INFO:tasks.workunit.client.0.smithi121.stdout:8/771: truncate d6/d1e/d2d/d78/f58 6486665 0 2024-08-18T22:41:40.831 INFO:tasks.workunit.client.1.smithi195.stdout:1/384: stat da/d18/d28/f34 0 2024-08-18T22:41:40.834 INFO:tasks.workunit.client.0.smithi121.stdout:4/675: mknod d2/dc/d1c/cf5 0 2024-08-18T22:41:40.835 INFO:tasks.workunit.client.1.smithi195.stdout:2/215: chown d1/d8/d27/l35 39789156 1 2024-08-18T22:41:40.837 INFO:tasks.workunit.client.1.smithi195.stdout:9/333: dwrite d1c/f21 [0,4194304] 0 2024-08-18T22:41:40.839 INFO:tasks.workunit.client.1.smithi195.stdout:5/229: dwrite d0/f11 [0,4194304] 0 2024-08-18T22:41:40.841 INFO:tasks.workunit.client.0.smithi121.stdout:3/689: link d1e/d1f/d25/d58/fbe d1e/d1f/da6/dc7/f102 0 2024-08-18T22:41:40.842 INFO:tasks.workunit.client.1.smithi195.stdout:4/315: mkdir d0/d7/d1d/d69 0 2024-08-18T22:41:40.845 INFO:tasks.workunit.client.0.smithi121.stdout:9/720: rename d0/d38/d9e/df/dcb to d0/d38/d44/dbf/ded 0 2024-08-18T22:41:40.847 INFO:tasks.workunit.client.0.smithi121.stdout:0/563: read d1/d4/db/d18/d1c/f59 [2810769,120023] 0 2024-08-18T22:41:40.847 INFO:tasks.workunit.client.0.smithi121.stdout:8/772: write d6/f8c [160450,41328] 0 2024-08-18T22:41:40.849 INFO:tasks.workunit.client.0.smithi121.stdout:7/674: mkdir de/d13/d18/d23/d24/d85/dce/d34/dda 0 2024-08-18T22:41:40.849 INFO:tasks.workunit.client.1.smithi195.stdout:8/370: mkdir d1/de/df/d1d/d8e 0 2024-08-18T22:41:40.849 INFO:tasks.workunit.client.1.smithi195.stdout:3/337: creat d7/da/df/d1c/d6a/d6c/f6e x:0 0 0 2024-08-18T22:41:40.850 INFO:tasks.workunit.client.1.smithi195.stdout:4/316: readlink d0/d9/l50 0 2024-08-18T22:41:40.850 INFO:tasks.workunit.client.1.smithi195.stdout:3/338: dread - d7/f51 zero size 2024-08-18T22:41:40.851 INFO:tasks.workunit.client.1.smithi195.stdout:2/216: fdatasync d1/d22/f31 0 2024-08-18T22:41:40.851 INFO:tasks.workunit.client.0.smithi121.stdout:1/654: link d5/d10/d14/d2a/d3a/d87/d6c/d6f/d82/d15/d28/d3d/d9a/fdc d5/d10/d14/d2a/d3a/d87/d6c/d6f/d82/d15/d28/d3d/dbd/fe5 0 2024-08-18T22:41:40.852 INFO:tasks.workunit.client.0.smithi121.stdout:3/690: mknod d1e/d1f/d25/d58/d75/c103 0 2024-08-18T22:41:40.853 INFO:tasks.workunit.client.1.smithi195.stdout:8/371: write d1/d3/db/f34 [407229,65900] 0 2024-08-18T22:41:40.854 INFO:tasks.workunit.client.0.smithi121.stdout:9/721: symlink d0/d38/d9e/df/d73/lee 0 2024-08-18T22:41:40.854 INFO:tasks.workunit.client.0.smithi121.stdout:4/676: mknod d2/dc/d16/d47/dea/cf6 0 2024-08-18T22:41:40.854 INFO:tasks.workunit.client.1.smithi195.stdout:1/385: creat da/d18/d43/f87 x:0 0 0 2024-08-18T22:41:40.855 INFO:tasks.workunit.client.0.smithi121.stdout:8/773: mknod d6/dd/dcc/de7/c108 0 2024-08-18T22:41:40.856 INFO:tasks.workunit.client.0.smithi121.stdout:0/564: mkdir d1/d4/db/d24/d30/d52/d90/dc3 0 2024-08-18T22:41:40.857 INFO:tasks.workunit.client.0.smithi121.stdout:7/675: stat de/d13/d18/d23/d24/d85/dce/d34/d38/c4a 0 2024-08-18T22:41:40.858 INFO:tasks.workunit.client.0.smithi121.stdout:4/677: write d2/dc/d16/d59/fa8 [209998,117967] 0 2024-08-18T22:41:40.859 INFO:tasks.workunit.client.0.smithi121.stdout:0/565: write d1/d4/db/d24/f6f [3408025,120234] 0 2024-08-18T22:41:40.859 INFO:tasks.workunit.client.0.smithi121.stdout:8/774: fdatasync d6/d1e/d2d/d78/d45/f53 0 2024-08-18T22:41:40.860 INFO:tasks.workunit.client.1.smithi195.stdout:8/372: write d1/de/df/d1d/f3e [2372597,8994] 0 2024-08-18T22:41:40.860 INFO:tasks.workunit.client.1.smithi195.stdout:6/216: link da/d22/c24 da/d22/c43 0 2024-08-18T22:41:40.861 INFO:tasks.workunit.client.0.smithi121.stdout:3/691: rename d1e/d1f/d5e to d1e/d1f/da6/dc7/db8/d104 0 2024-08-18T22:41:40.861 INFO:tasks.workunit.client.1.smithi195.stdout:5/230: creat d0/d3/d8/f41 x:0 0 0 2024-08-18T22:41:40.862 INFO:tasks.workunit.client.0.smithi121.stdout:1/655: read d5/d10/d14/d34/fae [383908,61714] 0 2024-08-18T22:41:40.862 INFO:tasks.workunit.client.0.smithi121.stdout:7/676: write de/d2d/d50/f71 [1363457,98294] 0 2024-08-18T22:41:40.862 INFO:tasks.workunit.client.1.smithi195.stdout:5/231: read d0/d3/df/f16 [3070180,112082] 0 2024-08-18T22:41:40.863 INFO:tasks.workunit.client.1.smithi195.stdout:7/211: dread f3 [0,4194304] 0 2024-08-18T22:41:40.865 INFO:tasks.workunit.client.1.smithi195.stdout:2/217: readlink d1/l23 0 2024-08-18T22:41:40.865 INFO:tasks.workunit.client.1.smithi195.stdout:7/212: dread - dc/d14/f4f zero size 2024-08-18T22:41:40.866 INFO:tasks.workunit.client.0.smithi121.stdout:3/692: read d1e/d1f/d3e/f6f [2602562,51392] 0 2024-08-18T22:41:40.866 INFO:tasks.workunit.client.0.smithi121.stdout:4/678: creat d2/dc/d16/d22/d2c/d44/da9/ff7 x:0 0 0 2024-08-18T22:41:40.867 INFO:tasks.workunit.client.1.smithi195.stdout:9/334: link d1c/d32/f66 d1c/d32/d37/f67 0 2024-08-18T22:41:40.867 INFO:tasks.workunit.client.1.smithi195.stdout:0/295: link d0/l50 d0/dc/d11/d30/d44/d41/d4c/l53 0 2024-08-18T22:41:40.867 INFO:tasks.workunit.client.0.smithi121.stdout:0/566: creat d1/d4/db/fc4 x:0 0 0 2024-08-18T22:41:40.868 INFO:tasks.workunit.client.0.smithi121.stdout:8/775: dread d6/f7c [0,4194304] 0 2024-08-18T22:41:40.870 INFO:tasks.workunit.client.1.smithi195.stdout:0/296: chown d0/dc/d11/l4e 480173716 1 2024-08-18T22:41:40.870 INFO:tasks.workunit.client.0.smithi121.stdout:0/567: read - d1/d4/f72 zero size 2024-08-18T22:41:40.871 INFO:tasks.workunit.client.1.smithi195.stdout:2/218: chown d1/d24/d26/c41 11894281 1 2024-08-18T22:41:40.871 INFO:tasks.workunit.client.1.smithi195.stdout:3/339: dwrite d7/fc [0,4194304] 0 2024-08-18T22:41:40.874 INFO:tasks.workunit.client.0.smithi121.stdout:2/451: dread d2/f2c [0,4194304] 0 2024-08-18T22:41:40.875 INFO:tasks.workunit.client.0.smithi121.stdout:9/722: getdents d0/d5/dd/d3b 0 2024-08-18T22:41:40.876 INFO:tasks.workunit.client.1.smithi195.stdout:9/335: symlink d1c/d32/d37/d4b/l68 0 2024-08-18T22:41:40.876 INFO:tasks.workunit.client.1.smithi195.stdout:3/340: write d7/da/df/d1c/d6a/d6c/f6e [950650,120047] 0 2024-08-18T22:41:40.878 INFO:tasks.workunit.client.1.smithi195.stdout:0/297: fsync d0/dc/d11/d23/f49 0 2024-08-18T22:41:40.879 INFO:tasks.workunit.client.0.smithi121.stdout:0/568: write d1/d4/db/d24/d30/d52/f7e [3495949,130388] 0 2024-08-18T22:41:40.879 INFO:tasks.workunit.client.0.smithi121.stdout:3/693: symlink d1e/d1f/d25/d58/d75/d8c/l105 0 2024-08-18T22:41:40.881 INFO:tasks.workunit.client.1.smithi195.stdout:6/217: dread f5 [0,4194304] 0 2024-08-18T22:41:40.881 INFO:tasks.workunit.client.0.smithi121.stdout:7/677: dwrite de/d13/d18/d23/d24/d85/dce/d34/d38/d5f/f94 [0,4194304] 0 2024-08-18T22:41:40.882 INFO:tasks.workunit.client.1.smithi195.stdout:4/317: getdents d0/d9/d3b 0 2024-08-18T22:41:40.883 INFO:tasks.workunit.client.1.smithi195.stdout:7/213: creat dc/d2a/d4c/f55 x:0 0 0 2024-08-18T22:41:40.883 INFO:tasks.workunit.client.1.smithi195.stdout:8/373: dwrite d1/de/f36 [0,4194304] 0 2024-08-18T22:41:40.885 INFO:tasks.workunit.client.0.smithi121.stdout:0/569: stat d1/d4/db/d18/d1c/d5f 0 2024-08-18T22:41:40.888 INFO:tasks.workunit.client.1.smithi195.stdout:0/298: creat d0/dc/d25/f54 x:0 0 0 2024-08-18T22:41:40.890 INFO:tasks.workunit.client.0.smithi121.stdout:2/452: write d2/d8/f3f [1151662,33536] 0 2024-08-18T22:41:40.890 INFO:tasks.workunit.client.0.smithi121.stdout:8/776: creat d6/dd/d3b/da3/dca/d37/f109 x:0 0 0 2024-08-18T22:41:40.891 INFO:tasks.workunit.client.1.smithi195.stdout:5/232: getdents d0/d3/df 0 2024-08-18T22:41:40.893 INFO:tasks.workunit.client.0.smithi121.stdout:9/723: symlink d0/d38/d9e/df/d73/lef 0 2024-08-18T22:41:40.894 INFO:tasks.workunit.client.0.smithi121.stdout:4/679: creat d2/dc/d16/d22/d2c/d44/da9/dae/ff8 x:0 0 0 2024-08-18T22:41:40.895 INFO:tasks.workunit.client.1.smithi195.stdout:1/386: getdents da/d18/d43 0 2024-08-18T22:41:40.897 INFO:tasks.workunit.client.1.smithi195.stdout:7/214: mkdir dc/d2a/d56 0 2024-08-18T22:41:40.897 INFO:tasks.workunit.client.0.smithi121.stdout:7/678: creat de/d13/da0/fdb x:0 0 0 2024-08-18T22:41:40.898 INFO:tasks.workunit.client.1.smithi195.stdout:6/218: dwrite da/d15/d1c/d2e/f3d [0,4194304] 0 2024-08-18T22:41:40.899 INFO:tasks.workunit.client.1.smithi195.stdout:6/219: dread - da/f40 zero size 2024-08-18T22:41:40.900 INFO:tasks.workunit.client.1.smithi195.stdout:1/387: readlink da/d18/d43/l7f 0 2024-08-18T22:41:40.903 INFO:tasks.workunit.client.0.smithi121.stdout:9/724: stat d0/d5/dd/d2f/cb0 0 2024-08-18T22:41:40.904 INFO:tasks.workunit.client.1.smithi195.stdout:4/318: symlink d0/d9/d11/d16/d54/l6a 0 2024-08-18T22:41:40.904 INFO:tasks.workunit.client.1.smithi195.stdout:1/388: write da/d18/d28/d31/d3b/d4e/f51 [2215368,88818] 0 2024-08-18T22:41:40.904 INFO:tasks.workunit.client.0.smithi121.stdout:4/680: mknod d2/d7c/cf9 0 2024-08-18T22:41:40.906 INFO:tasks.workunit.client.0.smithi121.stdout:4/681: chown d2/dc/d16/d22/d2c/d44/d8c/lc5 85408 1 2024-08-18T22:41:40.906 INFO:tasks.workunit.client.0.smithi121.stdout:7/679: rmdir de/d13/d18/d23/d24/d29 39 2024-08-18T22:41:40.907 INFO:tasks.workunit.client.0.smithi121.stdout:4/682: write d2/f14 [1836117,12638] 0 2024-08-18T22:41:40.908 INFO:tasks.workunit.client.0.smithi121.stdout:4/683: chown d2/dc/d16/d22/d2c/d44 15549 1 2024-08-18T22:41:40.909 INFO:tasks.workunit.client.1.smithi195.stdout:3/341: mknod d7/da/df/c6f 0 2024-08-18T22:41:40.909 INFO:tasks.workunit.client.0.smithi121.stdout:4/684: read - d2/dc/d16/d22/fe4 zero size 2024-08-18T22:41:40.910 INFO:tasks.workunit.client.0.smithi121.stdout:1/656: truncate d5/d10/d14/f45 2056719 0 2024-08-18T22:41:40.912 INFO:tasks.workunit.client.1.smithi195.stdout:5/233: symlink d0/d2/d29/l42 0 2024-08-18T22:41:40.914 INFO:tasks.workunit.client.1.smithi195.stdout:2/219: truncate d1/d24/d26/f36 2130090 0 2024-08-18T22:41:40.915 INFO:tasks.workunit.client.0.smithi121.stdout:4/685: write d2/dc/d16/d22/d2c/d44/d66/f6d [2232994,42652] 0 2024-08-18T22:41:40.915 INFO:tasks.workunit.client.0.smithi121.stdout:1/657: fdatasync d5/d10/d14/d2a/d3a/d87/d6c/d6f/fc4 0 2024-08-18T22:41:40.917 INFO:tasks.workunit.client.0.smithi121.stdout:4/686: fdatasync d2/dc/d16/d59/f8e 0 2024-08-18T22:41:40.918 INFO:tasks.workunit.client.1.smithi195.stdout:6/220: creat da/db/d2a/f44 x:0 0 0 2024-08-18T22:41:40.918 INFO:tasks.workunit.client.1.smithi195.stdout:0/299: dread d0/dc/d11/f15 [0,4194304] 0 2024-08-18T22:41:40.919 INFO:tasks.workunit.client.1.smithi195.stdout:7/215: dwrite fb [0,4194304] 0 2024-08-18T22:41:40.919 INFO:tasks.workunit.client.1.smithi195.stdout:1/389: rename da/d18/d28/d31/f45 to da/d3d/f88 0 2024-08-18T22:41:40.920 INFO:tasks.workunit.client.0.smithi121.stdout:2/453: rename d2/d8/d19/dc/d67/l87 to d2/d8/l95 0 2024-08-18T22:41:40.923 INFO:tasks.workunit.client.0.smithi121.stdout:8/777: getdents d6/dd/d3b 0 2024-08-18T22:41:40.924 INFO:tasks.workunit.client.0.smithi121.stdout:9/725: dread d0/d5/dd/f9c [0,4194304] 0 2024-08-18T22:41:40.924 INFO:tasks.workunit.client.1.smithi195.stdout:8/374: dwrite d1/de/d27/f29 [4194304,4194304] 0 2024-08-18T22:41:40.926 INFO:tasks.workunit.client.1.smithi195.stdout:9/336: link c1 d1c/c69 0 2024-08-18T22:41:40.927 INFO:tasks.workunit.client.0.smithi121.stdout:7/680: symlink de/d13/d18/d23/d24/d29/d43/d7f/ldc 0 2024-08-18T22:41:40.930 INFO:tasks.workunit.client.0.smithi121.stdout:0/570: dwrite d1/d4/db/d24/d30/d52/d5b/f7b [0,4194304] 0 2024-08-18T22:41:40.931 INFO:tasks.workunit.client.1.smithi195.stdout:1/390: creat da/d18/d43/f89 x:0 0 0 2024-08-18T22:41:40.933 INFO:tasks.workunit.client.0.smithi121.stdout:7/681: chown de/d13/d18/d23/d24/d85/dce/d34/d38/d73/dbb/lc9 30 1 2024-08-18T22:41:40.934 INFO:tasks.workunit.client.1.smithi195.stdout:2/220: symlink d1/d24/d26/d42/d44/l45 0 2024-08-18T22:41:40.934 INFO:tasks.workunit.client.1.smithi195.stdout:9/337: chown d1c/d32/d37/f42 14355460 1 2024-08-18T22:41:40.934 INFO:tasks.workunit.client.1.smithi195.stdout:7/216: creat dc/d14/d15/d17/d18/f57 x:0 0 0 2024-08-18T22:41:40.935 INFO:tasks.workunit.client.1.smithi195.stdout:4/319: dwrite d0/d9/d11/d16/d37/f3f [0,4194304] 0 2024-08-18T22:41:40.941 INFO:tasks.workunit.client.1.smithi195.stdout:8/375: mknod d1/d3/db/d35/d56/c8f 0 2024-08-18T22:41:40.941 INFO:tasks.workunit.client.0.smithi121.stdout:0/571: write d1/d4/db/d24/d30/d6c/f51 [3578363,67112] 0 2024-08-18T22:41:40.942 INFO:tasks.workunit.client.0.smithi121.stdout:8/778: symlink d6/dd/d25/d56/l10a 0 2024-08-18T22:41:40.943 INFO:tasks.workunit.client.0.smithi121.stdout:8/779: readlink d6/dd/l6d 0 2024-08-18T22:41:40.944 INFO:tasks.workunit.client.1.smithi195.stdout:7/217: dread - dc/d14/d15/d17/d18/f57 zero size 2024-08-18T22:41:40.944 INFO:tasks.workunit.client.1.smithi195.stdout:4/320: chown d0/d9/f57 0 1 2024-08-18T22:41:40.945 INFO:tasks.workunit.client.1.smithi195.stdout:5/234: dwrite d0/db/f19 [0,4194304] 0 2024-08-18T22:41:40.946 INFO:tasks.workunit.client.0.smithi121.stdout:4/687: symlink d2/dc/d1c/lfa 0 2024-08-18T22:41:40.946 INFO:tasks.workunit.client.0.smithi121.stdout:9/726: write d0/d5/f9b [1216973,15699] 0 2024-08-18T22:41:40.947 INFO:tasks.workunit.client.0.smithi121.stdout:7/682: readlink de/d13/d18/d23/d24/d85/ld9 0 2024-08-18T22:41:40.948 INFO:tasks.workunit.client.0.smithi121.stdout:7/683: fdatasync de/f1c 0 2024-08-18T22:41:40.949 INFO:tasks.workunit.client.0.smithi121.stdout:0/572: rmdir d1/d4/db/d24/d30/d6c 39 2024-08-18T22:41:40.949 INFO:tasks.workunit.client.1.smithi195.stdout:3/342: creat d7/da/f70 x:0 0 0 2024-08-18T22:41:40.950 INFO:tasks.workunit.client.0.smithi121.stdout:4/688: mknod d2/dc/d16/d47/cfb 0 2024-08-18T22:41:40.950 INFO:tasks.workunit.client.0.smithi121.stdout:1/658: creat d5/d10/d14/d2a/d3a/d87/d6c/d6f/d82/d15/fe6 x:0 0 0 2024-08-18T22:41:40.951 INFO:tasks.workunit.client.1.smithi195.stdout:1/391: symlink da/d4c/d7a/l8a 0 2024-08-18T22:41:40.952 INFO:tasks.workunit.client.1.smithi195.stdout:0/300: link d0/dc/d11/f15 d0/dc/d11/d30/d44/f55 0 2024-08-18T22:41:40.953 INFO:tasks.workunit.client.1.smithi195.stdout:6/221: dwrite da/db/d19/f23 [0,4194304] 0 2024-08-18T22:41:40.954 INFO:tasks.workunit.client.0.smithi121.stdout:8/780: dread d6/d1e/fc1 [0,4194304] 0 2024-08-18T22:41:40.954 INFO:tasks.workunit.client.0.smithi121.stdout:7/684: chown de/d13/d18/d23/d24/d85 117083282 1 2024-08-18T22:41:40.958 INFO:tasks.workunit.client.1.smithi195.stdout:0/301: fsync d0/dc/d11/d23/f49 0 2024-08-18T22:41:40.960 INFO:tasks.workunit.client.1.smithi195.stdout:8/376: dread - d1/de/d27/d4f/f60 zero size 2024-08-18T22:41:40.963 INFO:tasks.workunit.client.1.smithi195.stdout:8/377: chown d1/d3/d1c/d49/d55 434576377 1 2024-08-18T22:41:40.964 INFO:tasks.workunit.client.1.smithi195.stdout:0/302: write d0/dc/f33 [2759924,10704] 0 2024-08-18T22:41:40.964 INFO:tasks.workunit.client.1.smithi195.stdout:7/218: mkdir dc/d14/d15/d17/d58 0 2024-08-18T22:41:40.966 INFO:tasks.workunit.client.0.smithi121.stdout:8/781: mknod d6/d1e/c10b 0 2024-08-18T22:41:40.967 INFO:tasks.workunit.client.0.smithi121.stdout:1/659: rmdir d5/d10/d14/d2a/d3a/d87/d6c/d6f/d82 39 2024-08-18T22:41:40.967 INFO:tasks.workunit.client.1.smithi195.stdout:6/222: unlink da/db/d26/l30 0 2024-08-18T22:41:40.971 INFO:tasks.workunit.client.1.smithi195.stdout:5/235: dread d0/f11 [0,4194304] 0 2024-08-18T22:41:40.971 INFO:tasks.workunit.client.1.smithi195.stdout:3/343: dread d7/f10 [0,4194304] 0 2024-08-18T22:41:40.972 INFO:tasks.workunit.client.1.smithi195.stdout:3/344: chown d7/da/df/d1c/d6a/d6c 816 1 2024-08-18T22:41:40.972 INFO:tasks.workunit.client.1.smithi195.stdout:3/345: chown l5 59404 1 2024-08-18T22:41:40.974 INFO:tasks.workunit.client.1.smithi195.stdout:1/392: rename da/d18/d28/f27 to da/d18/d28/d31/d3b/d4e/f8b 0 2024-08-18T22:41:40.974 INFO:tasks.workunit.client.0.smithi121.stdout:0/573: dwrite d1/d4/db/d18/d1c/d5f/fa2 [0,4194304] 0 2024-08-18T22:41:40.974 INFO:tasks.workunit.client.0.smithi121.stdout:9/727: write d0/d38/d9e/df/f20 [3048436,100160] 0 2024-08-18T22:41:40.974 INFO:tasks.workunit.client.1.smithi195.stdout:6/223: fdatasync da/db/f37 0 2024-08-18T22:41:40.975 INFO:tasks.workunit.client.1.smithi195.stdout:5/236: fdatasync d0/db/f19 0 2024-08-18T22:41:40.976 INFO:tasks.workunit.client.0.smithi121.stdout:0/574: chown d1/f69 782481 1 2024-08-18T22:41:40.976 INFO:tasks.workunit.client.0.smithi121.stdout:2/454: dwrite d2/d3/d48/f71 [0,4194304] 0 2024-08-18T22:41:40.977 INFO:tasks.workunit.client.1.smithi195.stdout:7/219: link dc/d14/d15/d17/c3d dc/d2a/c59 0 2024-08-18T22:41:40.979 INFO:tasks.workunit.client.0.smithi121.stdout:4/689: rename d2/dc/d16/d22/d29/f38 to d2/dc/d1c/dc1/ddb/ffc 0 2024-08-18T22:41:40.980 INFO:tasks.workunit.client.0.smithi121.stdout:0/575: readlink d1/d4/db/d18/d40/d83/l8f 0 2024-08-18T22:41:40.983 INFO:tasks.workunit.client.0.smithi121.stdout:8/782: symlink d6/dd/d3b/da3/dca/d18/d83/l10c 0 2024-08-18T22:41:40.985 INFO:tasks.workunit.client.0.smithi121.stdout:0/576: creat d1/d4/da/d2f/da0/fc5 x:0 0 0 2024-08-18T22:41:40.986 INFO:tasks.workunit.client.1.smithi195.stdout:6/224: unlink da/d22/l25 0 2024-08-18T22:41:40.986 INFO:tasks.workunit.client.1.smithi195.stdout:5/237: dwrite d0/d3/df/d1a/f3f [0,4194304] 0 2024-08-18T22:41:40.989 INFO:tasks.workunit.client.1.smithi195.stdout:0/303: symlink d0/dc/d11/d30/d44/d41/d4c/d4f/l56 0 2024-08-18T22:41:40.989 INFO:tasks.workunit.client.0.smithi121.stdout:7/685: symlink de/d13/d18/d23/d24/d85/dce/d34/d38/d5f/dd3/ldd 0 2024-08-18T22:41:40.990 INFO:tasks.workunit.client.0.smithi121.stdout:0/577: write d1/d4/db/d18/d1c/d5f/fa2 [4872856,113328] 0 2024-08-18T22:41:40.991 INFO:tasks.workunit.client.1.smithi195.stdout:9/338: write d1c/f44 [767706,2235] 0 2024-08-18T22:41:40.992 INFO:tasks.workunit.client.0.smithi121.stdout:7/686: chown de/d13/d18/d23/d24/d85/dce/d34/d38/d73/d8a 167 1 2024-08-18T22:41:40.995 INFO:tasks.workunit.client.0.smithi121.stdout:2/455: symlink d2/d3/d84/l96 0 2024-08-18T22:41:41.001 INFO:tasks.workunit.client.1.smithi195.stdout:8/378: truncate d1/d3/db/d39/f59 708085 0 2024-08-18T22:41:41.001 INFO:tasks.workunit.client.1.smithi195.stdout:0/304: write d0/dc/d11/d30/f40 [3249399,4425] 0 2024-08-18T22:41:41.003 INFO:tasks.workunit.client.0.smithi121.stdout:2/456: chown d2/d8/l95 8018 1 2024-08-18T22:41:41.004 INFO:tasks.workunit.client.1.smithi195.stdout:4/321: dwrite d0/d9/d11/d16/f55 [4194304,4194304] 0 2024-08-18T22:41:41.005 INFO:tasks.workunit.client.1.smithi195.stdout:8/379: fsync d1/de/f54 0 2024-08-18T22:41:41.006 INFO:tasks.workunit.client.0.smithi121.stdout:1/660: creat d5/d10/d14/d2a/d3a/d87/d6c/d6f/d82/fe7 x:0 0 0 2024-08-18T22:41:41.009 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:41.008+0000 7f0ec67fc640 1 -- 172.21.15.121:0/2448079062 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mgrmap(e 23) v1 ==== 46241+0+0 (secure 0 0 0) 0x7f0ec0039dc0 con 0x7f0ed0103bd0 2024-08-18T22:41:41.009 INFO:tasks.workunit.client.1.smithi195.stdout:3/346: rename d7/da/c46 to d7/c71 0 2024-08-18T22:41:41.010 INFO:tasks.workunit.client.1.smithi195.stdout:8/380: fdatasync d1/d3/db/f5d 0 2024-08-18T22:41:41.011 INFO:tasks.workunit.client.0.smithi121.stdout:0/578: dwrite d1/d4/db/d24/df/d8/f85 [0,4194304] 0 2024-08-18T22:41:41.011 INFO:tasks.workunit.client.1.smithi195.stdout:6/225: dwrite f5 [0,4194304] 0 2024-08-18T22:41:41.012 INFO:tasks.workunit.client.1.smithi195.stdout:7/220: creat dc/d14/d15/d17/d58/f5a x:0 0 0 2024-08-18T22:41:41.012 INFO:tasks.workunit.client.1.smithi195.stdout:5/238: truncate d0/db/f19 1101470 0 2024-08-18T22:41:41.015 INFO:tasks.workunit.client.0.smithi121.stdout:2/457: truncate d2/f6 3743479 0 2024-08-18T22:41:41.015 INFO:tasks.workunit.client.0.smithi121.stdout:4/690: dwrite d2/f21 [0,4194304] 0 2024-08-18T22:41:41.018 INFO:tasks.workunit.client.1.smithi195.stdout:3/347: chown d7/da/df/l1e 8618 1 2024-08-18T22:41:41.018 INFO:tasks.workunit.client.1.smithi195.stdout:4/322: truncate d0/d9/d11/d16/d54/f5c 4379676 0 2024-08-18T22:41:41.019 INFO:tasks.workunit.client.1.smithi195.stdout:4/323: fsync d0/f22 0 2024-08-18T22:41:41.019 INFO:tasks.workunit.client.1.smithi195.stdout:8/381: write d1/de/d31/d5a/f57 [4501867,125159] 0 2024-08-18T22:41:41.020 INFO:tasks.workunit.client.1.smithi195.stdout:7/221: chown dc/d14/d15/d17/d18/f43 2010337617 1 2024-08-18T22:41:41.021 INFO:tasks.workunit.client.0.smithi121.stdout:0/579: creat d1/d4/d53/da7/fc6 x:0 0 0 2024-08-18T22:41:41.021 INFO:tasks.workunit.client.0.smithi121.stdout:7/687: getdents de/d98 0 2024-08-18T22:41:41.021 INFO:tasks.workunit.client.0.smithi121.stdout:9/728: dread d0/d38/d44/dbf/f77 [0,4194304] 0 2024-08-18T22:41:41.024 INFO:tasks.workunit.client.1.smithi195.stdout:9/339: creat d1c/f6a x:0 0 0 2024-08-18T22:41:41.024 INFO:tasks.workunit.client.1.smithi195.stdout:5/239: dread d0/d3/df/d1a/f3f [0,4194304] 0 2024-08-18T22:41:41.024 INFO:tasks.workunit.client.1.smithi195.stdout:6/226: creat da/db/d19/f45 x:0 0 0 2024-08-18T22:41:41.027 INFO:tasks.workunit.client.1.smithi195.stdout:7/222: truncate dc/d14/d15/d17/f2f 1443967 0 2024-08-18T22:41:41.027 INFO:tasks.workunit.client.1.smithi195.stdout:3/348: write d7/d1f/f34 [1619277,28255] 0 2024-08-18T22:41:41.028 INFO:tasks.workunit.client.1.smithi195.stdout:8/382: creat d1/d3/db/d35/d56/f90 x:0 0 0 2024-08-18T22:41:41.028 INFO:tasks.workunit.client.0.smithi121.stdout:1/661: dread d5/d10/d14/d2a/d3a/f47 [0,4194304] 0 2024-08-18T22:41:41.029 INFO:tasks.workunit.client.1.smithi195.stdout:3/349: stat d7/da/l59 0 2024-08-18T22:41:41.032 INFO:tasks.workunit.client.0.smithi121.stdout:4/691: dwrite d2/dc/d16/d22/fbd [0,4194304] 0 2024-08-18T22:41:41.032 INFO:tasks.workunit.client.0.smithi121.stdout:9/729: chown d0/d5/dd/f9c 441428 1 2024-08-18T22:41:41.035 INFO:tasks.workunit.client.0.smithi121.stdout:2/458: rename d2/d3/d51/l85 to d2/d8/d19/d4a/d64/l97 0 2024-08-18T22:41:41.036 INFO:tasks.workunit.client.1.smithi195.stdout:1/393: dwrite da/d18/f2a [0,4194304] 0 2024-08-18T22:41:41.038 INFO:tasks.workunit.client.0.smithi121.stdout:1/662: creat d5/d10/d14/d34/de4/fe8 x:0 0 0 2024-08-18T22:41:41.039 INFO:tasks.workunit.client.1.smithi195.stdout:1/394: fsync da/d4c/f66 0 2024-08-18T22:41:41.040 INFO:tasks.workunit.client.1.smithi195.stdout:6/227: mknod da/db/d26/c46 0 2024-08-18T22:41:41.041 INFO:tasks.workunit.client.1.smithi195.stdout:8/383: chown d1/de/df/d1d/l3c 426450506 1 2024-08-18T22:41:41.043 INFO:tasks.workunit.client.0.smithi121.stdout:0/580: creat d1/d4/db/d24/d30/d52/d90/dc3/fc7 x:0 0 0 2024-08-18T22:41:41.044 INFO:tasks.workunit.client.0.smithi121.stdout:1/663: dread d5/d10/d14/d34/f98 [0,4194304] 0 2024-08-18T22:41:41.044 INFO:tasks.workunit.client.0.smithi121.stdout:9/730: mkdir d0/d38/d9e/df/d3d/d89/d92/df0 0 2024-08-18T22:41:41.045 INFO:tasks.workunit.client.0.smithi121.stdout:8/783: dread d6/dd/d3b/da3/dca/d18/f98 [0,4194304] 0 2024-08-18T22:41:41.045 INFO:tasks.workunit.client.0.smithi121.stdout:2/459: symlink d2/d8/d19/d4a/l98 0 2024-08-18T22:41:41.046 INFO:tasks.workunit.client.1.smithi195.stdout:7/223: fsync f2 0 2024-08-18T22:41:41.046 INFO:tasks.workunit.client.0.smithi121.stdout:8/784: chown d6/d1e/d2d/d78 167726641 1 2024-08-18T22:41:41.047 INFO:tasks.workunit.client.0.smithi121.stdout:2/460: chown d2/d3/d53/l6e 4 1 2024-08-18T22:41:41.049 INFO:tasks.workunit.client.1.smithi195.stdout:4/324: getdents d0/d9/d11/d16/d37/d48 0 2024-08-18T22:41:41.050 INFO:tasks.workunit.client.0.smithi121.stdout:8/785: creat d6/d20/f10d x:0 0 0 2024-08-18T22:41:41.051 INFO:tasks.workunit.client.1.smithi195.stdout:7/224: chown dc/d14/d15/d17/f2f 30054 1 2024-08-18T22:41:41.051 INFO:tasks.workunit.client.1.smithi195.stdout:6/228: dwrite da/d15/d1c/d2e/f3d [0,4194304] 0 2024-08-18T22:41:41.051 INFO:tasks.workunit.client.1.smithi195.stdout:4/325: stat d0/d7/l19 0 2024-08-18T22:41:41.051 INFO:tasks.workunit.client.0.smithi121.stdout:0/581: creat d1/d4/db/d18/d40/fc8 x:0 0 0 2024-08-18T22:41:41.052 INFO:tasks.workunit.client.1.smithi195.stdout:6/229: dread - da/f13 zero size 2024-08-18T22:41:41.054 INFO:tasks.workunit.client.0.smithi121.stdout:1/664: rename d5/dcf/de1/dc1/cd2 to d5/d10/d67/dc2/ce9 0 2024-08-18T22:41:41.054 INFO:tasks.workunit.client.1.smithi195.stdout:3/350: link d7/d1f/d49/l66 d7/da/df/d38/l72 0 2024-08-18T22:41:41.055 INFO:tasks.workunit.client.1.smithi195.stdout:1/395: mkdir da/d18/d28/d8c 0 2024-08-18T22:41:41.057 INFO:tasks.workunit.client.1.smithi195.stdout:8/384: creat d1/d3/db/d35/d4d/d8b/f91 x:0 0 0 2024-08-18T22:41:41.057 INFO:tasks.workunit.client.0.smithi121.stdout:9/731: rename d0/d5/dd/d2f/cc3 to d0/d5/dd/d2f/cf1 0 2024-08-18T22:41:41.058 INFO:tasks.workunit.client.1.smithi195.stdout:8/385: fdatasync d1/d3/db/d7a/f84 0 2024-08-18T22:41:41.058 INFO:tasks.workunit.client.0.smithi121.stdout:0/582: fdatasync d1/d4/db/f60 0 2024-08-18T22:41:41.059 INFO:tasks.workunit.client.0.smithi121.stdout:8/786: creat d6/dd/d3b/da3/dca/d60/d5b/d6e/f10e x:0 0 0 2024-08-18T22:41:41.059 INFO:tasks.workunit.client.1.smithi195.stdout:1/396: creat da/d4c/d7a/f8d x:0 0 0 2024-08-18T22:41:41.060 INFO:tasks.workunit.client.1.smithi195.stdout:8/386: chown d1/d3/d1c/d21/f7f 441430041 1 2024-08-18T22:41:41.061 INFO:tasks.workunit.client.1.smithi195.stdout:3/351: mkdir d7/d1f/d73 0 2024-08-18T22:41:41.061 INFO:tasks.workunit.client.0.smithi121.stdout:0/583: truncate d1/f8e 378648 0 2024-08-18T22:41:41.062 INFO:tasks.workunit.client.1.smithi195.stdout:4/326: rmdir d0/d9/d11/d16/d37/d5f/d65 0 2024-08-18T22:41:41.064 INFO:tasks.workunit.client.0.smithi121.stdout:8/787: dread - d6/dd/d25/dc8/fd3 zero size 2024-08-18T22:41:41.065 INFO:tasks.workunit.client.1.smithi195.stdout:8/387: mknod d1/d3/db/d35/c92 0 2024-08-18T22:41:41.066 INFO:tasks.workunit.client.0.smithi121.stdout:9/732: creat d0/d38/d9e/df/d61/ff2 x:0 0 0 2024-08-18T22:41:41.067 INFO:tasks.workunit.client.1.smithi195.stdout:3/352: write d7/d1f/d49/f5e [210543,49997] 0 2024-08-18T22:41:41.068 INFO:tasks.workunit.client.0.smithi121.stdout:1/665: dwrite d5/d10/d14/d2a/daf/fb1 [0,4194304] 0 2024-08-18T22:41:41.068 INFO:tasks.workunit.client.1.smithi195.stdout:4/327: mknod d0/d9/d11/d16/d37/d48/d4c/c6b 0 2024-08-18T22:41:41.071 INFO:tasks.workunit.client.0.smithi121.stdout:0/584: mknod d1/d4/db/d18/d40/cc9 0 2024-08-18T22:41:41.071 INFO:tasks.workunit.client.0.smithi121.stdout:9/733: dread d0/d5/dd/f9c [0,4194304] 0 2024-08-18T22:41:41.073 INFO:tasks.workunit.client.1.smithi195.stdout:5/240: write d0/d3/df/f16 [4215300,4489] 0 2024-08-18T22:41:41.073 INFO:tasks.workunit.client.1.smithi195.stdout:8/388: symlink d1/d64/l93 0 2024-08-18T22:41:41.076 INFO:tasks.workunit.client.0.smithi121.stdout:8/788: truncate d6/dd/d3b/da3/dca/d18/d83/fa9 687800 0 2024-08-18T22:41:41.077 INFO:tasks.workunit.client.0.smithi121.stdout:8/789: chown d6/fde 0 1 2024-08-18T22:41:41.079 INFO:tasks.workunit.client.0.smithi121.stdout:0/585: mknod d1/d4/db/d18/d40/d83/daf/cca 0 2024-08-18T22:41:41.079 INFO:tasks.workunit.client.1.smithi195.stdout:4/328: dwrite d0/d9/d11/d16/f4f [0,4194304] 0 2024-08-18T22:41:41.080 INFO:tasks.workunit.client.0.smithi121.stdout:9/734: creat d0/ff3 x:0 0 0 2024-08-18T22:41:41.082 INFO:tasks.workunit.client.1.smithi195.stdout:3/353: getdents d7/da/df/d1c 0 2024-08-18T22:41:41.082 INFO:tasks.workunit.client.0.smithi121.stdout:0/586: read - d1/d4/db/d24/d30/d52/f87 zero size 2024-08-18T22:41:41.083 INFO:tasks.workunit.client.1.smithi195.stdout:5/241: symlink d0/l43 0 2024-08-18T22:41:41.084 INFO:tasks.workunit.client.1.smithi195.stdout:1/397: dread da/d3d/f41 [0,4194304] 0 2024-08-18T22:41:41.084 INFO:tasks.workunit.client.1.smithi195.stdout:1/398: chown da/f24 1895 1 2024-08-18T22:41:41.085 INFO:tasks.workunit.client.1.smithi195.stdout:4/329: mkdir d0/d9/d6c 0 2024-08-18T22:41:41.086 INFO:tasks.workunit.client.0.smithi121.stdout:1/666: dwrite d5/f49 [0,4194304] 0 2024-08-18T22:41:41.091 INFO:tasks.workunit.client.1.smithi195.stdout:8/389: link d1/d3/db/d35/f47 d1/d3/db/d7a/f94 0 2024-08-18T22:41:41.093 INFO:tasks.workunit.client.0.smithi121.stdout:7/688: dread de/d13/f17 [0,4194304] 0 2024-08-18T22:41:41.093 INFO:tasks.workunit.client.0.smithi121.stdout:1/667: stat d5/d10/d14/d2a/f60 0 2024-08-18T22:41:41.094 INFO:tasks.workunit.client.1.smithi195.stdout:3/354: mkdir d7/d1f/d74 0 2024-08-18T22:41:41.094 INFO:tasks.workunit.client.0.smithi121.stdout:8/790: dwrite d6/dd/d3b/da3/dca/d18/f3a [4194304,4194304] 0 2024-08-18T22:41:41.096 INFO:tasks.workunit.client.1.smithi195.stdout:4/330: rename d0/d9/d11/d16/d37/d48/d4c/c6b to d0/d7/d1d/d69/c6d 0 2024-08-18T22:41:41.097 INFO:tasks.workunit.client.1.smithi195.stdout:4/331: read d0/d9/d11/d16/f4f [1840525,1390] 0 2024-08-18T22:41:41.098 INFO:tasks.workunit.client.0.smithi121.stdout:0/587: mkdir d1/d4/db/d18/d40/d83/daf/dcb 0 2024-08-18T22:41:41.098 INFO:tasks.workunit.client.0.smithi121.stdout:1/668: chown d5/d10/d14 247448 1 2024-08-18T22:41:41.098 INFO:tasks.workunit.client.0.smithi121.stdout:9/735: creat d0/d38/d9e/df/d73/ff4 x:0 0 0 2024-08-18T22:41:41.098 INFO:tasks.workunit.client.0.smithi121.stdout:8/791: stat d6/d20/d69/d77/f88 0 2024-08-18T22:41:41.099 INFO:tasks.workunit.client.0.smithi121.stdout:9/736: dread - d0/d38/d52/d5f/fc5 zero size 2024-08-18T22:41:41.100 INFO:tasks.workunit.client.1.smithi195.stdout:1/399: mkdir da/d18/d28/d8e 0 2024-08-18T22:41:41.102 INFO:tasks.workunit.client.0.smithi121.stdout:8/792: truncate d6/d1e/d2d/f100 537673 0 2024-08-18T22:41:41.103 INFO:tasks.workunit.client.0.smithi121.stdout:0/588: creat d1/d4/db/d18/d40/d83/daf/fcc x:0 0 0 2024-08-18T22:41:41.107 INFO:tasks.workunit.client.1.smithi195.stdout:5/242: symlink d0/d3/d8/d3b/l44 0 2024-08-18T22:41:41.108 INFO:tasks.workunit.client.1.smithi195.stdout:4/332: mknod d0/d7/d1d/d69/c6e 0 2024-08-18T22:41:41.109 INFO:tasks.workunit.client.0.smithi121.stdout:7/689: truncate de/d13/d18/d23/d24/d29/f4d 224716 0 2024-08-18T22:41:41.110 INFO:tasks.workunit.client.1.smithi195.stdout:8/390: unlink d1/de/df/l48 0 2024-08-18T22:41:41.112 INFO:tasks.workunit.client.0.smithi121.stdout:0/589: rename d1/d4/db/d18/d40/d83/daf/cca to d1/d4/db/d18/d1c/ccd 0 2024-08-18T22:41:41.113 INFO:tasks.workunit.client.0.smithi121.stdout:1/669: getdents d5/d10/d14/d92/d9f 0 2024-08-18T22:41:41.113 INFO:tasks.workunit.client.0.smithi121.stdout:8/793: dwrite d6/dd/d3b/da3/dca/f1d [0,4194304] 0 2024-08-18T22:41:41.117 INFO:tasks.workunit.client.1.smithi195.stdout:5/243: rename d0/d3/d8/c35 to d0/d3/df/d1a/c45 0 2024-08-18T22:41:41.119 INFO:tasks.workunit.client.1.smithi195.stdout:4/333: dwrite d0/d9/d11/d16/d49/f35 [0,4194304] 0 2024-08-18T22:41:41.120 INFO:tasks.workunit.client.0.smithi121.stdout:0/590: write d1/d4/d53/da7/f34 [925904,17596] 0 2024-08-18T22:41:41.122 INFO:tasks.workunit.client.0.smithi121.stdout:1/670: unlink d5/d10/d14/d92/lbf 0 2024-08-18T22:41:41.123 INFO:tasks.workunit.client.1.smithi195.stdout:5/244: truncate d0/d2/d29/f3d 553509 0 2024-08-18T22:41:41.124 INFO:tasks.workunit.client.0.smithi121.stdout:7/690: rename de/d13/d18/d23/d24/d85/dce/d34/d38/d5f/d9c/fd0 to de/d13/d18/d23/d24/d85/dce/d34/d6c/fde 0 2024-08-18T22:41:41.125 INFO:tasks.workunit.client.0.smithi121.stdout:8/794: truncate d6/dd/d3b/da3/dca/d60/d5b/f6f 3217112 0 2024-08-18T22:41:41.128 INFO:tasks.workunit.client.1.smithi195.stdout:3/355: getdents d7/da/df 0 2024-08-18T22:41:41.129 INFO:tasks.workunit.client.0.smithi121.stdout:1/671: chown d5/d10/d14/d2a/d3a/d87/d6c/d6f/d82/c97 9930993 1 2024-08-18T22:41:41.130 INFO:tasks.workunit.client.1.smithi195.stdout:8/391: rename d1/d3/d1c/d49 to d1/d3/db/d35/d4d/d95 0 2024-08-18T22:41:41.131 INFO:tasks.workunit.client.0.smithi121.stdout:8/795: mknod d6/dd/d3b/da3/dca/d60/d5b/d6e/c10f 0 2024-08-18T22:41:41.131 INFO:tasks.workunit.client.0.smithi121.stdout:1/672: chown d5/f1f 4689 1 2024-08-18T22:41:41.132 INFO:tasks.workunit.client.1.smithi195.stdout:1/400: getdents da/d18/d28/d31/d3b/d4e 0 2024-08-18T22:41:41.132 INFO:tasks.workunit.client.1.smithi195.stdout:1/401: chown da/d18/d43/f5b 6 1 2024-08-18T22:41:41.133 INFO:tasks.workunit.client.0.smithi121.stdout:7/691: creat de/d13/d18/d23/d24/d85/dce/d34/d38/d73/d8a/fdf x:0 0 0 2024-08-18T22:41:41.134 INFO:tasks.workunit.client.1.smithi195.stdout:4/334: unlink d0/d9/d11/l1e 0 2024-08-18T22:41:41.134 INFO:tasks.workunit.client.0.smithi121.stdout:8/796: write d6/dd/d3b/da3/dca/d18/f3a [9066945,77371] 0 2024-08-18T22:41:41.135 INFO:tasks.workunit.client.1.smithi195.stdout:4/335: read d0/d7/d1d/f2f [26920,105427] 0 2024-08-18T22:41:41.136 INFO:tasks.workunit.client.0.smithi121.stdout:9/737: dread d0/d38/d9e/df/f20 [0,4194304] 0 2024-08-18T22:41:41.136 INFO:tasks.workunit.client.0.smithi121.stdout:0/591: rename d1/d4/db/d24/df/d8/c21 to d1/d4/db/d18/d1c/d5f/cce 0 2024-08-18T22:41:41.138 INFO:tasks.workunit.client.1.smithi195.stdout:3/356: read d7/d1f/f34 [1060521,120834] 0 2024-08-18T22:41:41.138 INFO:tasks.workunit.client.1.smithi195.stdout:1/402: readlink da/d18/l6e 0 2024-08-18T22:41:41.139 INFO:tasks.workunit.client.1.smithi195.stdout:3/357: dread - d7/da/f70 zero size 2024-08-18T22:41:41.140 INFO:tasks.workunit.client.0.smithi121.stdout:8/797: write d6/dd/d3b/da3/dca/fc0 [1027291,59202] 0 2024-08-18T22:41:41.140 INFO:tasks.workunit.client.1.smithi195.stdout:4/336: mkdir d0/d9/d3b/d6f 0 2024-08-18T22:41:41.141 INFO:tasks.workunit.client.0.smithi121.stdout:1/673: dread d5/f49 [0,4194304] 0 2024-08-18T22:41:41.141 INFO:tasks.workunit.client.0.smithi121.stdout:9/738: unlink d0/d38/d9e/df/d3d/d89/l9f 0 2024-08-18T22:41:41.143 INFO:tasks.workunit.client.1.smithi195.stdout:8/392: creat d1/d3/db/d39/d44/d8c/f96 x:0 0 0 2024-08-18T22:41:41.146 INFO:tasks.workunit.client.1.smithi195.stdout:5/245: getdents d0/d3/df/d1a 0 2024-08-18T22:41:41.148 INFO:tasks.workunit.client.0.smithi121.stdout:9/739: rename d0/d38/d9e/df/d61/db2/f8a to d0/d38/d9e/d45/ff5 0 2024-08-18T22:41:41.150 INFO:tasks.workunit.client.1.smithi195.stdout:4/337: dwrite d0/d9/d11/d16/d37/d48/d4c/f63 [0,4194304] 0 2024-08-18T22:41:41.151 INFO:tasks.workunit.client.0.smithi121.stdout:7/692: write de/d13/f49 [344046,70315] 0 2024-08-18T22:41:41.152 INFO:tasks.workunit.client.1.smithi195.stdout:4/338: fdatasync d0/d7/d1d/f28 0 2024-08-18T22:41:41.155 INFO:tasks.workunit.client.0.smithi121.stdout:9/740: symlink d0/d5/dd/lf6 0 2024-08-18T22:41:41.158 INFO:tasks.workunit.client.1.smithi195.stdout:4/339: creat d0/d7/d1d/d69/f70 x:0 0 0 2024-08-18T22:41:41.158 INFO:tasks.workunit.client.1.smithi195.stdout:1/403: creat da/d18/f8f x:0 0 0 2024-08-18T22:41:41.160 INFO:tasks.workunit.client.1.smithi195.stdout:5/246: mkdir d0/d46 0 2024-08-18T22:41:41.161 INFO:tasks.workunit.client.0.smithi121.stdout:7/693: dwrite de/d2d/fa3 [0,4194304] 0 2024-08-18T22:41:41.162 INFO:tasks.workunit.client.1.smithi195.stdout:3/358: getdents d7/d1f/d49 0 2024-08-18T22:41:41.165 INFO:tasks.workunit.client.0.smithi121.stdout:9/741: dwrite d0/d38/d9e/d45/dba/fbb [0,4194304] 0 2024-08-18T22:41:41.165 INFO:tasks.workunit.client.0.smithi121.stdout:7/694: mknod de/d13/d18/d23/d24/d85/dce/d34/ce0 0 2024-08-18T22:41:41.167 INFO:tasks.workunit.client.1.smithi195.stdout:1/404: write da/f78 [207447,11387] 0 2024-08-18T22:41:41.167 INFO:tasks.workunit.client.0.smithi121.stdout:9/742: fsync d0/d38/d44/dbf/fa0 0 2024-08-18T22:41:41.170 INFO:tasks.workunit.client.0.smithi121.stdout:8/798: truncate d6/f9 2378481 0 2024-08-18T22:41:41.173 INFO:tasks.workunit.client.1.smithi195.stdout:8/393: dwrite d1/d3/db/d39/d2e/f77 [0,4194304] 0 2024-08-18T22:41:41.175 INFO:tasks.workunit.client.0.smithi121.stdout:1/674: truncate d5/d10/d14/d2a/d3a/d87/d6c/d6f/d82/d15/d38/fb6 864865 0 2024-08-18T22:41:41.177 INFO:tasks.workunit.client.0.smithi121.stdout:8/799: dwrite d6/d1e/d2d/d78/d45/f53 [0,4194304] 0 2024-08-18T22:41:41.178 INFO:tasks.workunit.client.0.smithi121.stdout:9/743: mkdir d0/d38/d44/dbf/d7c/df7 0 2024-08-18T22:41:41.179 INFO:tasks.workunit.client.0.smithi121.stdout:8/800: fsync d6/dd/d3b/da3/dca/d60/d5b/f95 0 2024-08-18T22:41:41.179 INFO:tasks.workunit.client.0.smithi121.stdout:7/695: mknod de/d13/d18/d23/d24/d85/dce/d20/d39/ce1 0 2024-08-18T22:41:41.181 INFO:tasks.workunit.client.0.smithi121.stdout:9/744: write d0/d5/dd/d3b/d48/feb [174338,80263] 0 2024-08-18T22:41:41.182 INFO:tasks.workunit.client.0.smithi121.stdout:8/801: stat d6/dd/d3b/da3/dca/d18/d99/ffe 0 2024-08-18T22:41:41.182 INFO:tasks.workunit.client.0.smithi121.stdout:9/745: chown d0/d5/dd/lf6 30920 1 2024-08-18T22:41:41.184 INFO:tasks.workunit.client.1.smithi195.stdout:1/405: chown da/d18/d28/d31/l72 36720692 1 2024-08-18T22:41:41.186 INFO:tasks.workunit.client.0.smithi121.stdout:1/675: dread d5/d10/d14/d2a/d3a/d87/d6c/d6f/d82/d15/d38/f72 [0,4194304] 0 2024-08-18T22:41:41.186 INFO:tasks.workunit.client.0.smithi121.stdout:1/676: fsync d5/d10/fd1 0 2024-08-18T22:41:41.190 INFO:tasks.workunit.client.0.smithi121.stdout:8/802: mkdir d6/d1e/d2d/de5/dd7/d110 0 2024-08-18T22:41:41.190 INFO:tasks.workunit.client.0.smithi121.stdout:7/696: dwrite de/d13/d18/f3c [0,4194304] 0 2024-08-18T22:41:41.190 INFO:tasks.workunit.client.1.smithi195.stdout:3/359: dwrite d7/fc [0,4194304] 0 2024-08-18T22:41:41.191 INFO:tasks.workunit.client.0.smithi121.stdout:9/746: creat d0/d5/dd/d2f/dcd/ff8 x:0 0 0 2024-08-18T22:41:41.193 INFO:tasks.workunit.client.1.smithi195.stdout:4/340: dwrite d0/d9/d11/d16/d37/d5f/f62 [0,4194304] 0 2024-08-18T22:41:41.194 INFO:tasks.workunit.client.0.smithi121.stdout:7/697: mknod de/d13/d18/d2e/ce2 0 2024-08-18T22:41:41.197 INFO:tasks.workunit.client.0.smithi121.stdout:8/803: mknod d6/dd/d3b/da3/dca/d60/df8/c111 0 2024-08-18T22:41:41.199 INFO:tasks.workunit.client.1.smithi195.stdout:5/247: dread d0/f11 [0,4194304] 0 2024-08-18T22:41:41.200 INFO:tasks.workunit.client.0.smithi121.stdout:9/747: mknod d0/d38/d9e/df/d3d/d89/d92/dc6/dd5/db3/cf9 0 2024-08-18T22:41:41.201 INFO:tasks.workunit.client.0.smithi121.stdout:1/677: dwrite d5/d10/d14/d2a/d3a/d87/d6c/d6f/d79/dab/f84 [0,4194304] 0 2024-08-18T22:41:41.201 INFO:tasks.workunit.client.1.smithi195.stdout:8/394: dwrite d1/de/df/d1d/f6e [4194304,4194304] 0 2024-08-18T22:41:41.202 INFO:tasks.workunit.client.1.smithi195.stdout:1/406: unlink da/d4c/d5d/d63/f86 0 2024-08-18T22:41:41.205 INFO:tasks.workunit.client.1.smithi195.stdout:8/395: write d1/de/df/f19 [2765596,24523] 0 2024-08-18T22:41:41.209 INFO:tasks.workunit.client.1.smithi195.stdout:8/396: fdatasync d1/d3/d1c/f65 0 2024-08-18T22:41:41.212 INFO:tasks.workunit.client.0.smithi121.stdout:1/678: creat d5/d10/d14/fea x:0 0 0 2024-08-18T22:41:41.213 INFO:tasks.workunit.client.1.smithi195.stdout:5/248: rename d0/d3/d8/f41 to d0/d2/d29/f47 0 2024-08-18T22:41:41.215 INFO:tasks.workunit.client.1.smithi195.stdout:5/249: readlink d0/d2/l10 0 2024-08-18T22:41:41.216 INFO:tasks.workunit.client.1.smithi195.stdout:8/397: fsync d1/d3/f2b 0 2024-08-18T22:41:41.216 INFO:tasks.workunit.client.0.smithi121.stdout:1/679: chown d5/d10/d14/d2a/d3a/d87/d6c/d6f/d82/l19 263043713 1 2024-08-18T22:41:41.218 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:41.216+0000 7f0ed7db2640 1 -- 172.21.15.121:0/2448079062 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f0eb4005d00 con 0x7f0ed0103bd0 2024-08-18T22:41:41.218 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:41:40 smithi121 ceph-mon[16788]: from='client.? 172.21.15.121:0/1728537375' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-08-18T22:41:41.218 INFO:tasks.workunit.client.0.smithi121.stdout:1/680: mknod d5/d10/d14/d34/de4/ceb 0 2024-08-18T22:41:41.219 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:41.217+0000 7f0ec67fc640 1 -- 172.21.15.121:0/2448079062 <== mon.0 v2:172.21.15.121:3300/0 8 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 18 v18) v1 ==== 76+0+1835 (secure 0 0 0) 0x7f0ec003daa0 con 0x7f0ed0103bd0 2024-08-18T22:41:41.219 INFO:teuthology.orchestra.run.smithi121.stdout:e18 2024-08-18T22:41:41.219 INFO:teuthology.orchestra.run.smithi121.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-08-18T22:41:41.219 INFO:teuthology.orchestra.run.smithi121.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-08-18T22:41:41.219 INFO:teuthology.orchestra.run.smithi121.stdout:legacy client fscid: 1 2024-08-18T22:41:41.219 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-08-18T22:41:41.219 INFO:teuthology.orchestra.run.smithi121.stdout:Filesystem 'cephfs' (1) 2024-08-18T22:41:41.219 INFO:teuthology.orchestra.run.smithi121.stdout:fs_name cephfs 2024-08-18T22:41:41.220 INFO:teuthology.orchestra.run.smithi121.stdout:epoch 18 2024-08-18T22:41:41.220 INFO:teuthology.orchestra.run.smithi121.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-08-18T22:41:41.220 INFO:teuthology.orchestra.run.smithi121.stdout:created 2024-08-18T22:39:04.054074+0000 2024-08-18T22:41:41.220 INFO:teuthology.orchestra.run.smithi121.stdout:modified 2024-08-18T22:41:01.169096+0000 2024-08-18T22:41:41.220 INFO:teuthology.orchestra.run.smithi121.stdout:tableserver 0 2024-08-18T22:41:41.220 INFO:teuthology.orchestra.run.smithi121.stdout:root 0 2024-08-18T22:41:41.220 INFO:teuthology.orchestra.run.smithi121.stdout:session_timeout 60 2024-08-18T22:41:41.220 INFO:teuthology.orchestra.run.smithi121.stdout:session_autoclose 300 2024-08-18T22:41:41.220 INFO:teuthology.orchestra.run.smithi121.stdout:max_file_size 1099511627776 2024-08-18T22:41:41.220 INFO:teuthology.orchestra.run.smithi121.stdout:required_client_features {} 2024-08-18T22:41:41.220 INFO:teuthology.orchestra.run.smithi121.stdout:last_failure 0 2024-08-18T22:41:41.220 INFO:teuthology.orchestra.run.smithi121.stdout:last_failure_osd_epoch 47 2024-08-18T22:41:41.220 INFO:teuthology.orchestra.run.smithi121.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-08-18T22:41:41.220 INFO:teuthology.orchestra.run.smithi121.stdout:max_mds 2 2024-08-18T22:41:41.221 INFO:teuthology.orchestra.run.smithi121.stdout:in 0,1 2024-08-18T22:41:41.221 INFO:teuthology.orchestra.run.smithi121.stdout:up {0=14474,1=24249} 2024-08-18T22:41:41.221 INFO:teuthology.orchestra.run.smithi121.stdout:failed 2024-08-18T22:41:41.221 INFO:teuthology.orchestra.run.smithi121.stdout:damaged 2024-08-18T22:41:41.221 INFO:teuthology.orchestra.run.smithi121.stdout:stopped 2024-08-18T22:41:41.221 INFO:teuthology.orchestra.run.smithi121.stdout:data_pools [3] 2024-08-18T22:41:41.221 INFO:teuthology.orchestra.run.smithi121.stdout:metadata_pool 2 2024-08-18T22:41:41.221 INFO:teuthology.orchestra.run.smithi121.stdout:inline_data disabled 2024-08-18T22:41:41.221 INFO:teuthology.orchestra.run.smithi121.stdout:balancer 2024-08-18T22:41:41.221 INFO:teuthology.orchestra.run.smithi121.stdout:standby_count_wanted 1 2024-08-18T22:41:41.221 INFO:teuthology.orchestra.run.smithi121.stdout:[mds.cephfs.smithi121.gbickb{0:14474} state up:active seq 6 export targets 1 join_fscid=1 addr [v2:172.21.15.121:6828/2277706406,v1:172.21.15.121:6829/2277706406] compat {c=[1],r=[1],i=[7ff]}] 2024-08-18T22:41:41.221 INFO:teuthology.orchestra.run.smithi121.stdout:[mds.cephfs.smithi195.buqvbr{1:24249} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.195:6824/2414511859,v1:172.21.15.195:6825/2414511859] compat {c=[1],r=[1],i=[7ff]}] 2024-08-18T22:41:41.221 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-08-18T22:41:41.222 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-08-18T22:41:41.222 INFO:teuthology.orchestra.run.smithi121.stdout:Standby daemons: 2024-08-18T22:41:41.222 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-08-18T22:41:41.222 INFO:teuthology.orchestra.run.smithi121.stdout:[mds.cephfs.smithi121.xuzsdg{-1:14490} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.121:6826/91588128,v1:172.21.15.121:6827/91588128] compat {c=[1],r=[1],i=[7ff]}] 2024-08-18T22:41:41.222 INFO:teuthology.orchestra.run.smithi121.stdout:[mds.cephfs.smithi195.nptgyc{-1:24259} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.195:6826/238549847,v1:172.21.15.195:6827/238549847] compat {c=[1],r=[1],i=[7ff]}] 2024-08-18T22:41:41.222 INFO:teuthology.orchestra.run.smithi121.stderr:dumped fsmap epoch 18 2024-08-18T22:41:41.222 INFO:tasks.workunit.client.0.smithi121.stdout:1/681: chown d5/d10/d14/d2a/d3a/d87/c54 25144 1 2024-08-18T22:41:41.223 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:41.220+0000 7f0ed7db2640 1 -- 172.21.15.121:0/2448079062 >> [v2:172.21.15.195:6828/1174410756,v1:172.21.15.195:6829/1174410756] conn(0x7f0ebc038ab0 msgr2=0x7f0ebc03af60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:41:41.223 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:41.220+0000 7f0ed7db2640 1 --2- 172.21.15.121:0/2448079062 >> [v2:172.21.15.195:6828/1174410756,v1:172.21.15.195:6829/1174410756] conn(0x7f0ebc038ab0 0x7f0ebc03af60 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f0ed0067010 tx=0x7f0ecc00b040 comp rx=0 tx=0).stop 2024-08-18T22:41:41.223 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:41.220+0000 7f0ed7db2640 1 -- 172.21.15.121:0/2448079062 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0ed0103bd0 msgr2=0x7f0ed00677a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:41:41.223 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:41.220+0000 7f0ed7db2640 1 --2- 172.21.15.121:0/2448079062 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0ed0103bd0 0x7f0ed00677a0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f0ec00048a0 tx=0x7f0ec0009da0 comp rx=0 tx=0).stop 2024-08-18T22:41:41.223 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:41.221+0000 7f0ed7db2640 1 -- 172.21.15.121:0/2448079062 shutdown_connections 2024-08-18T22:41:41.224 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:41.221+0000 7f0ed7db2640 1 --2- 172.21.15.121:0/2448079062 >> [v2:172.21.15.195:6828/1174410756,v1:172.21.15.195:6829/1174410756] conn(0x7f0ebc038ab0 0x7f0ebc03af60 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:41:41.224 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:41.221+0000 7f0ed7db2640 1 --2- 172.21.15.121:0/2448079062 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0ed0103bd0 0x7f0ed00677a0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:41:41.224 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:41.221+0000 7f0ed7db2640 1 --2- 172.21.15.121:0/2448079062 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0ed0102900 0x7f0ed0067260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:41:41.224 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:41.221+0000 7f0ed7db2640 1 -- 172.21.15.121:0/2448079062 >> 172.21.15.121:0/2448079062 conn(0x7f0ed00661f0 msgr2=0x7f0ed0074730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:41:41.224 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:41.221+0000 7f0ed7db2640 1 -- 172.21.15.121:0/2448079062 shutdown_connections 2024-08-18T22:41:41.224 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:41.221+0000 7f0ed7db2640 1 -- 172.21.15.121:0/2448079062 wait complete. 2024-08-18T22:41:41.224 INFO:tasks.workunit.client.0.smithi121.stdout:1/682: truncate d5/d10/d14/d2a/f60 1200470 0 2024-08-18T22:41:41.225 INFO:tasks.workunit.client.1.smithi195.stdout:3/360: dread d7/f9 [0,4194304] 0 2024-08-18T22:41:41.225 INFO:tasks.workunit.client.1.smithi195.stdout:8/398: write d1/d3/db/d35/d4d/d8b/f91 [654436,86802] 0 2024-08-18T22:41:41.225 INFO:tasks.workunit.client.1.smithi195.stdout:5/250: rename d0/d2/d29/l42 to d0/d3/df/l48 0 2024-08-18T22:41:41.225 INFO:tasks.workunit.client.1.smithi195.stdout:5/251: chown d0/d3/df/d1a/c45 118 1 2024-08-18T22:41:41.225 INFO:tasks.workunit.client.1.smithi195.stdout:3/361: mkdir d7/da/d75 0 2024-08-18T22:41:41.226 INFO:tasks.workunit.client.1.smithi195.stdout:3/362: write d7/da/df/d38/f4a [4075171,32339] 0 2024-08-18T22:41:41.226 INFO:tasks.workunit.client.0.smithi121.stdout:1/683: mknod d5/d10/cec 0 2024-08-18T22:41:41.226 INFO:tasks.workunit.client.1.smithi195.stdout:5/252: chown d0/f1d 52 1 2024-08-18T22:41:41.229 INFO:tasks.workunit.client.0.smithi121.stdout:1/684: mknod d5/d10/d14/d2a/d3a/d87/d6c/d6f/d82/d15/ced 0 2024-08-18T22:41:41.231 INFO:tasks.workunit.client.1.smithi195.stdout:5/253: mknod d0/d3/d8/c49 0 2024-08-18T22:41:41.232 INFO:tasks.workunit.client.0.smithi121.stdout:8/804: dread d6/dd/d3b/da3/dca/d37/f50 [0,4194304] 0 2024-08-18T22:41:41.235 INFO:tasks.workunit.client.0.smithi121.stdout:8/805: fdatasync d6/f7c 0 2024-08-18T22:41:41.235 INFO:tasks.workunit.client.1.smithi195.stdout:5/254: mkdir d0/d3/d8/d4a 0 2024-08-18T22:41:41.238 INFO:tasks.workunit.client.0.smithi121.stdout:1/685: rename d5/d10/d14/d2a/d3a/d87/d6c/d6f/d82/d15/d28/d3d/fda to d5/d10/d14/d2a/d3a/d87/d6c/d6f/d82/d15/d28/d3d/dbd/fee 0 2024-08-18T22:41:41.241 INFO:tasks.workunit.client.0.smithi121.stdout:8/806: symlink d6/d1e/d2d/de5/dd7/l112 0 2024-08-18T22:41:41.241 INFO:tasks.workunit.client.0.smithi121.stdout:7/698: write de/d2d/f42 [650150,343] 0 2024-08-18T22:41:41.243 INFO:tasks.workunit.client.1.smithi195.stdout:4/341: dread d0/d9/d11/f18 [0,4194304] 0 2024-08-18T22:41:41.244 INFO:tasks.workunit.client.0.smithi121.stdout:1/686: rmdir d5/dcf/de1 39 2024-08-18T22:41:41.247 INFO:tasks.workunit.client.0.smithi121.stdout:7/699: mknod de/d13/d18/d23/d24/d29/d43/d7f/ce3 0 2024-08-18T22:41:41.250 INFO:tasks.workunit.client.0.smithi121.stdout:1/687: write d5/d10/d14/d2a/d3a/d87/d6c/d6f/d82/d15/d38/f72 [4959976,91249] 0 2024-08-18T22:41:41.255 INFO:tasks.workunit.client.0.smithi121.stdout:7/700: readlink de/d13/d18/d23/d24/d85/dce/d2f/d4b/d6d/l9f 0 2024-08-18T22:41:41.259 INFO:tasks.workunit.client.1.smithi195.stdout:4/342: dread d0/d9/d11/d16/f1b [0,4194304] 0 2024-08-18T22:41:41.260 INFO:tasks.workunit.client.0.smithi121.stdout:1/688: dwrite d5/d10/d14/d92/d9f/fd0 [0,4194304] 0 2024-08-18T22:41:41.261 INFO:tasks.workunit.client.1.smithi195.stdout:1/407: dread da/f60 [0,4194304] 0 2024-08-18T22:41:41.263 INFO:tasks.workunit.client.1.smithi195.stdout:8/399: write d1/d3/db/d39/f59 [294099,67806] 0 2024-08-18T22:41:41.264 INFO:tasks.workunit.client.1.smithi195.stdout:8/400: write d1/d3/f2b [2249331,15606] 0 2024-08-18T22:41:41.267 INFO:tasks.workunit.client.1.smithi195.stdout:8/401: write d1/d3/db/d39/f70 [949840,83267] 0 2024-08-18T22:41:41.269 INFO:tasks.workunit.client.0.smithi121.stdout:1/689: mknod d5/d10/d14/d2a/d3a/d87/d6c/d6f/d82/d15/d28/d3d/dbd/cef 0 2024-08-18T22:41:41.269 INFO:tasks.workunit.client.0.smithi121.stdout:8/807: write f5 [998623,43525] 0 2024-08-18T22:41:41.271 INFO:tasks.workunit.client.0.smithi121.stdout:7/701: dread de/d2d/f5d [0,4194304] 0 2024-08-18T22:41:41.272 INFO:tasks.workunit.client.1.smithi195.stdout:3/363: dwrite d7/f17 [4194304,4194304] 0 2024-08-18T22:41:41.273 INFO:tasks.workunit.client.1.smithi195.stdout:3/364: chown d7/d1f 2 1 2024-08-18T22:41:41.275 INFO:tasks.workunit.client.1.smithi195.stdout:8/402: mknod d1/d3/db/d35/d4d/d5c/c97 0 2024-08-18T22:41:41.275 INFO:tasks.workunit.client.1.smithi195.stdout:3/365: write d7/da/df/f20 [4792725,80553] 0 2024-08-18T22:41:41.276 INFO:tasks.workunit.client.1.smithi195.stdout:8/403: fdatasync d1/f2a 0 2024-08-18T22:41:41.276 INFO:tasks.workunit.client.0.smithi121.stdout:8/808: rename d6/d1e/d2d/de5/dd7/d110 to d6/dd/d3b/da3/dca/d103/d113 0 2024-08-18T22:41:41.277 INFO:tasks.workunit.client.1.smithi195.stdout:1/408: mknod da/d18/d28/c90 0 2024-08-18T22:41:41.278 INFO:tasks.workunit.client.1.smithi195.stdout:3/366: write d7/da/f48 [1114947,112952] 0 2024-08-18T22:41:41.278 INFO:tasks.workunit.client.1.smithi195.stdout:8/404: write d1/d64/f73 [395190,113092] 0 2024-08-18T22:41:41.279 INFO:tasks.workunit.client.1.smithi195.stdout:8/405: dread - d1/f7d zero size 2024-08-18T22:41:41.280 INFO:tasks.workunit.client.0.smithi121.stdout:8/809: write d6/dd/d3b/da3/dca/d60/d5b/d6e/f10e [381894,83342] 0 2024-08-18T22:41:41.283 INFO:tasks.workunit.client.0.smithi121.stdout:8/810: read d6/d1e/f4e [2859251,18810] 0 2024-08-18T22:41:41.284 INFO:tasks.workunit.client.1.smithi195.stdout:1/409: write da/d18/f1f [1254592,111075] 0 2024-08-18T22:41:41.287 INFO:tasks.workunit.client.0.smithi121.stdout:1/690: rename d5/d10/d14/d2a/d3a/d87/d6c/d6f/d79/dab/l8c to d5/dcf/de1/dc1/lf0 0 2024-08-18T22:41:41.287 INFO:tasks.workunit.client.1.smithi195.stdout:8/406: creat d1/de/df/d1d/d1f/f98 x:0 0 0 2024-08-18T22:41:41.288 INFO:tasks.workunit.client.0.smithi121.stdout:8/811: chown d6/dd/d3b/da3/dca/c1a 3 1 2024-08-18T22:41:41.289 INFO:tasks.workunit.client.0.smithi121.stdout:7/702: dread de/d13/d18/d23/d24/d85/dce/d20/f3f [0,4194304] 0 2024-08-18T22:41:41.290 INFO:tasks.workunit.client.1.smithi195.stdout:1/410: dread da/f60 [0,4194304] 0 2024-08-18T22:41:41.291 INFO:tasks.workunit.client.0.smithi121.stdout:7/703: chown de/d13/d18/d23/d24/d85/dce/d34/d38/d73/d8a/fdf 150875 1 2024-08-18T22:41:41.294 INFO:tasks.workunit.client.1.smithi195.stdout:1/411: stat da/d18/l25 0 2024-08-18T22:41:41.294 INFO:tasks.workunit.client.1.smithi195.stdout:5/255: write d0/db/f19 [1030110,16086] 0 2024-08-18T22:41:41.295 INFO:tasks.workunit.client.0.smithi121.stdout:7/704: write de/d13/d18/d23/d24/d85/dce/d20/d39/f9a [1273318,60654] 0 2024-08-18T22:41:41.295 INFO:tasks.workunit.client.0.smithi121.stdout:1/691: dwrite d5/d10/d14/d34/f63 [0,4194304] 0 2024-08-18T22:41:41.298 INFO:tasks.workunit.client.1.smithi195.stdout:8/407: dwrite d1/de/f3b [8388608,4194304] 0 2024-08-18T22:41:41.300 INFO:tasks.workunit.client.0.smithi121.stdout:7/705: creat de/d2d/fe4 x:0 0 0 2024-08-18T22:41:41.301 INFO:tasks.workunit.client.1.smithi195.stdout:5/256: rmdir d0/d3/d8 39 2024-08-18T22:41:41.301 INFO:tasks.workunit.client.0.smithi121.stdout:1/692: fsync d5/d10/f18 0 2024-08-18T22:41:41.303 INFO:tasks.workunit.client.0.smithi121.stdout:7/706: creat de/d13/fe5 x:0 0 0 2024-08-18T22:41:41.305 INFO:tasks.workunit.client.0.smithi121.stdout:7/707: rmdir de/d13/d18/d23/d24/d29 39 2024-08-18T22:41:41.308 INFO:tasks.workunit.client.1.smithi195.stdout:8/408: dwrite d1/d3/db/d39/f59 [0,4194304] 0 2024-08-18T22:41:41.310 INFO:tasks.workunit.client.0.smithi121.stdout:7/708: mkdir de/d13/d18/d23/d24/d29/de6 0 2024-08-18T22:41:41.313 INFO:tasks.workunit.client.1.smithi195.stdout:8/409: mknod d1/d3/db/d35/d4d/c99 0 2024-08-18T22:41:41.314 INFO:tasks.workunit.client.0.smithi121.stdout:1/693: dread d5/d10/f18 [0,4194304] 0 2024-08-18T22:41:41.314 INFO:tasks.workunit.client.1.smithi195.stdout:5/257: rmdir d0/d3/d8/d3b 39 2024-08-18T22:41:41.316 INFO:tasks.workunit.client.0.smithi121.stdout:1/694: chown d5/d10/d14/d2a/d3a/fe3 0 1 2024-08-18T22:41:41.316 INFO:tasks.workunit.client.1.smithi195.stdout:5/258: chown d0/d3/d8/c49 135275 1 2024-08-18T22:41:41.316 INFO:tasks.workunit.client.1.smithi195.stdout:5/259: stat d0/d3/d8/c2b 0 2024-08-18T22:41:41.318 INFO:tasks.workunit.client.0.smithi121.stdout:7/709: dwrite de/d13/d18/d23/d24/d85/dce/d34/d38/d73/dbb/fb0 [0,4194304] 0 2024-08-18T22:41:41.318 INFO:tasks.workunit.client.0.smithi121.stdout:5/507: sync 2024-08-18T22:41:41.318 INFO:tasks.workunit.client.1.smithi195.stdout:5/260: fdatasync d0/f11 0 2024-08-18T22:41:41.319 INFO:tasks.workunit.client.1.smithi195.stdout:8/410: creat d1/de/df/d1d/d8e/f9a x:0 0 0 2024-08-18T22:41:41.319 INFO:tasks.workunit.client.1.smithi195.stdout:5/261: stat d0/db 0 2024-08-18T22:41:41.321 INFO:tasks.workunit.client.1.smithi195.stdout:3/367: rmdir d7/da/df/d47 0 2024-08-18T22:41:41.322 INFO:tasks.workunit.client.1.smithi195.stdout:8/411: stat d1/d3/db/d35/f47 0 2024-08-18T22:41:41.324 INFO:tasks.workunit.client.0.smithi121.stdout:7/710: rename de/ff to de/d13/d18/d23/d24/d85/dce/d2f/d4b/d6d/fe7 0 2024-08-18T22:41:41.327 INFO:tasks.workunit.client.0.smithi121.stdout:5/508: rename d3/d5/d13/d19/d24/c90 to d3/d5/d3c/d3f/d8f/c9a 0 2024-08-18T22:41:41.329 INFO:tasks.workunit.client.0.smithi121.stdout:5/509: chown d3/d5c/f69 5343943 1 2024-08-18T22:41:41.330 INFO:tasks.workunit.client.1.smithi195.stdout:5/262: dread d0/f1d [0,4194304] 0 2024-08-18T22:41:41.331 INFO:tasks.workunit.client.1.smithi195.stdout:1/412: dwrite da/d18/d28/d31/d77/f81 [0,4194304] 0 2024-08-18T22:41:41.332 INFO:tasks.workunit.client.1.smithi195.stdout:3/368: fdatasync d7/d1f/f34 0 2024-08-18T22:41:41.334 INFO:tasks.workunit.client.1.smithi195.stdout:3/369: write d7/f17 [7424131,23933] 0 2024-08-18T22:41:41.335 INFO:tasks.workunit.client.1.smithi195.stdout:5/263: readlink d0/d3/df/l48 0 2024-08-18T22:41:41.336 INFO:tasks.workunit.client.0.smithi121.stdout:7/711: dwrite de/d13/d18/d23/d24/f56 [0,4194304] 0 2024-08-18T22:41:41.336 INFO:tasks.workunit.client.0.smithi121.stdout:5/510: creat d3/d5/d13/d19/d24/d4d/f9b x:0 0 0 2024-08-18T22:41:41.337 INFO:tasks.workunit.client.1.smithi195.stdout:1/413: chown da/d18/d28/c49 53832 1 2024-08-18T22:41:41.338 INFO:tasks.workunit.client.0.smithi121.stdout:1/695: dwrite d5/d10/d14/d34/fae [0,4194304] 0 2024-08-18T22:41:41.339 INFO:tasks.workunit.client.1.smithi195.stdout:1/414: chown da/d18/d28 1253 1 2024-08-18T22:41:41.339 INFO:tasks.workunit.client.1.smithi195.stdout:3/370: readlink d7/l65 0 2024-08-18T22:41:41.339 INFO:tasks.workunit.client.0.smithi121.stdout:5/511: chown d3/d5/d27/d35/c3a 420035366 1 2024-08-18T22:41:41.340 INFO:tasks.workunit.client.1.smithi195.stdout:8/412: dwrite d1/de/f36 [0,4194304] 0 2024-08-18T22:41:41.340 INFO:tasks.workunit.client.1.smithi195.stdout:5/264: write d0/d3/f27 [4882663,27160] 0 2024-08-18T22:41:41.341 INFO:tasks.workunit.client.1.smithi195.stdout:8/413: fdatasync d1/d3/f2b 0 2024-08-18T22:41:41.341 INFO:tasks.workunit.client.1.smithi195.stdout:1/415: unlink c8 0 2024-08-18T22:41:41.343 INFO:tasks.workunit.client.0.smithi121.stdout:7/712: chown de/d13/d18/d23/d24/d85/dce/d2f/d36/f54 28 1 2024-08-18T22:41:41.343 INFO:tasks.workunit.client.0.smithi121.stdout:1/696: dread d5/d10/d14/d2a/d3a/f47 [0,4194304] 0 2024-08-18T22:41:41.348 INFO:tasks.workunit.client.0.smithi121.stdout:1/697: truncate d5/d10/d14/d34/fa2 673238 0 2024-08-18T22:41:41.349 INFO:tasks.workunit.client.1.smithi195.stdout:1/416: chown da/d18/d28/f2d 797516 1 2024-08-18T22:41:41.349 INFO:tasks.workunit.client.1.smithi195.stdout:1/417: chown da/d18/d28/f2d 510 1 2024-08-18T22:41:41.351 INFO:tasks.workunit.client.1.smithi195.stdout:8/414: creat d1/de/d31/d88/f9b x:0 0 0 2024-08-18T22:41:41.354 INFO:tasks.workunit.client.1.smithi195.stdout:8/415: dread - d1/d3/db/d35/d56/f76 zero size 2024-08-18T22:41:41.356 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:41.354+0000 7ff42ab0d640 1 -- 172.21.15.121:0/2816355354 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff4240fc490 msgr2=0x7ff4240fc900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:41:41.356 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:41.354+0000 7ff42ab0d640 1 --2- 172.21.15.121:0/2816355354 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff4240fc490 0x7ff4240fc900 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7ff4100048d0 tx=0x7ff410009da0 comp rx=0 tx=0).stop 2024-08-18T22:41:41.356 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:41.355+0000 7ff42ab0d640 1 -- 172.21.15.121:0/2816355354 shutdown_connections 2024-08-18T22:41:41.356 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:41.355+0000 7ff42ab0d640 1 --2- 172.21.15.121:0/2816355354 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff4240fc490 0x7ff4240fc900 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:41:41.356 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:41.355+0000 7ff42ab0d640 1 --2- 172.21.15.121:0/2816355354 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff4240fb1c0 0x7ff4240fb5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:41:41.356 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:41.355+0000 7ff42ab0d640 1 -- 172.21.15.121:0/2816355354 >> 172.21.15.121:0/2816355354 conn(0x7ff4240f69a0 msgr2=0x7ff4240f8db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:41:41.356 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:41.355+0000 7ff42ab0d640 1 -- 172.21.15.121:0/2816355354 shutdown_connections 2024-08-18T22:41:41.356 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:41.355+0000 7ff42ab0d640 1 -- 172.21.15.121:0/2816355354 wait complete. 2024-08-18T22:41:41.357 INFO:tasks.workunit.client.1.smithi195.stdout:5/265: getdents d0/d3/d8/d3b 0 2024-08-18T22:41:41.358 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:41.356+0000 7ff42ab0d640 1 Processor -- start 2024-08-18T22:41:41.358 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:41.356+0000 7ff42ab0d640 1 -- start start 2024-08-18T22:41:41.358 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:41.356+0000 7ff42ab0d640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff4240fb1c0 0x7ff42410be00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:41:41.358 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:41.356+0000 7ff42ab0d640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff4240fc490 0x7ff42410c340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:41:41.358 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:41.357+0000 7ff42ab0d640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff42410c9c0 con 0x7ff4240fb1c0 2024-08-18T22:41:41.358 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:41.357+0000 7ff42ab0d640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff42410d0e0 con 0x7ff4240fc490 2024-08-18T22:41:41.358 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:41.357+0000 7ff4288a9640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff4240fb1c0 0x7ff42410be00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:41:41.358 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:41.357+0000 7ff4288a9640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff4240fb1c0 0x7ff42410be00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:58990/0 (socket says 172.21.15.121:58990) 2024-08-18T22:41:41.359 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:41.357+0000 7ff4288a9640 1 -- 172.21.15.121:0/303321188 learned_addr learned my addr 172.21.15.121:0/303321188 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-18T22:41:41.359 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:41.357+0000 7ff423fff640 1 --2- 172.21.15.121:0/303321188 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff4240fc490 0x7ff42410c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:41:41.359 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:41.357+0000 7ff4288a9640 1 -- 172.21.15.121:0/303321188 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff4240fc490 msgr2=0x7ff42410c340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:41:41.359 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:41.357+0000 7ff4288a9640 1 --2- 172.21.15.121:0/303321188 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff4240fc490 0x7ff42410c340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:41:41.359 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:41.357+0000 7ff4288a9640 1 -- 172.21.15.121:0/303321188 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff410005040 con 0x7ff4240fb1c0 2024-08-18T22:41:41.360 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:41.358+0000 7ff4288a9640 1 --2- 172.21.15.121:0/303321188 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff4240fb1c0 0x7ff42410be00 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7ff41800b790 tx=0x7ff4180091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:41:41.360 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:41.358+0000 7ff4217fa640 1 -- 172.21.15.121:0/303321188 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff41800c700 con 0x7ff4240fb1c0 2024-08-18T22:41:41.360 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:41.358+0000 7ff4217fa640 1 -- 172.21.15.121:0/303321188 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7ff41800cd00 con 0x7ff4240fb1c0 2024-08-18T22:41:41.360 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:41.358+0000 7ff42ab0d640 1 -- 172.21.15.121:0/303321188 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff42410d3c0 con 0x7ff4240fb1c0 2024-08-18T22:41:41.360 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:41.358+0000 7ff42ab0d640 1 -- 172.21.15.121:0/303321188 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff42410d8e0 con 0x7ff4240fb1c0 2024-08-18T22:41:41.360 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:41.358+0000 7ff4217fa640 1 -- 172.21.15.121:0/303321188 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff418015e30 con 0x7ff4240fb1c0 2024-08-18T22:41:41.360 INFO:tasks.workunit.client.1.smithi195.stdout:3/371: dwrite d7/da/df/d1c/d6a/f68 [0,4194304] 0 2024-08-18T22:41:41.361 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:41.360+0000 7ff42ab0d640 1 -- 172.21.15.121:0/303321188 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4241055d0 con 0x7ff4240fb1c0 2024-08-18T22:41:41.361 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:41.360+0000 7ff4217fa640 1 -- 172.21.15.121:0/303321188 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 23) v1 ==== 46241+0+0 (secure 0 0 0) 0x7ff418012070 con 0x7ff4240fb1c0 2024-08-18T22:41:41.361 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:41.360+0000 7ff4217fa640 1 --2- 172.21.15.121:0/303321188 >> [v2:172.21.15.195:6828/1174410756,v1:172.21.15.195:6829/1174410756] conn(0x7ff414038df0 0x7ff41403b2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:41:41.361 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:41.360+0000 7ff4217fa640 1 -- 172.21.15.121:0/303321188 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5808+0+0 (secure 0 0 0) 0x7ff41804c3f0 con 0x7ff4240fb1c0 2024-08-18T22:41:41.362 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:41.361+0000 7ff423fff640 1 --2- 172.21.15.121:0/303321188 >> [v2:172.21.15.195:6828/1174410756,v1:172.21.15.195:6829/1174410756] conn(0x7ff414038df0 0x7ff41403b2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:41:41.364 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:41.363+0000 7ff423fff640 1 --2- 172.21.15.121:0/303321188 >> [v2:172.21.15.195:6828/1174410756,v1:172.21.15.195:6829/1174410756] conn(0x7ff414038df0 0x7ff41403b2a0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7ff410007ac0 tx=0x7ff410035040 comp rx=0 tx=0).ready entity=mgr.24377 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:41:41.364 INFO:tasks.workunit.client.1.smithi195.stdout:8/416: getdents d1/de/d27 0 2024-08-18T22:41:41.366 INFO:tasks.workunit.client.1.smithi195.stdout:1/418: dread da/d3d/f88 [0,4194304] 0 2024-08-18T22:41:41.366 INFO:tasks.workunit.client.1.smithi195.stdout:3/372: dread f6 [4194304,4194304] 0 2024-08-18T22:41:41.368 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:41.367+0000 7ff4217fa640 1 -- 172.21.15.121:0/303321188 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7ff41801c6b0 con 0x7ff4240fb1c0 2024-08-18T22:41:41.371 INFO:tasks.workunit.client.1.smithi195.stdout:8/417: dwrite d1/de/f4e [0,4194304] 0 2024-08-18T22:41:41.371 INFO:tasks.workunit.client.1.smithi195.stdout:3/373: creat d7/da/df/d1c/d6a/f76 x:0 0 0 2024-08-18T22:41:41.372 INFO:tasks.workunit.client.1.smithi195.stdout:1/419: creat da/f91 x:0 0 0 2024-08-18T22:41:41.376 INFO:tasks.workunit.client.1.smithi195.stdout:3/374: mknod d7/d54/c77 0 2024-08-18T22:41:41.379 INFO:tasks.workunit.client.1.smithi195.stdout:3/375: write d7/f56 [15301,35484] 0 2024-08-18T22:41:41.381 INFO:tasks.workunit.client.1.smithi195.stdout:8/418: creat d1/d3/db/d39/f9c x:0 0 0 2024-08-18T22:41:41.384 INFO:tasks.workunit.client.1.smithi195.stdout:3/376: rename d7/da/df/f20 to d7/da/d75/f78 0 2024-08-18T22:41:41.387 INFO:tasks.workunit.client.1.smithi195.stdout:3/377: symlink d7/d1f/d74/l79 0 2024-08-18T22:41:41.395 INFO:tasks.workunit.client.1.smithi195.stdout:5/266: dread d0/d3/f27 [0,4194304] 0 2024-08-18T22:41:41.396 INFO:tasks.workunit.client.1.smithi195.stdout:1/420: dwrite da/d18/d28/d31/f46 [4194304,4194304] 0 2024-08-18T22:41:41.399 INFO:tasks.workunit.client.1.smithi195.stdout:3/378: dwrite d7/da/df/d38/f45 [0,4194304] 0 2024-08-18T22:41:41.401 INFO:tasks.workunit.client.1.smithi195.stdout:1/421: creat da/d3d/f92 x:0 0 0 2024-08-18T22:41:41.406 INFO:tasks.workunit.client.1.smithi195.stdout:3/379: mkdir d7/da/d75/d7a 0 2024-08-18T22:41:41.408 INFO:tasks.workunit.client.1.smithi195.stdout:1/422: fdatasync da/d4c/f69 0 2024-08-18T22:41:41.408 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:41:40 smithi195 ceph-mon[23370]: from='client.? 172.21.15.121:0/1728537375' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-08-18T22:41:41.410 INFO:tasks.workunit.client.1.smithi195.stdout:5/267: truncate d0/d3/d8/f13 2662117 0 2024-08-18T22:41:41.412 INFO:tasks.workunit.client.1.smithi195.stdout:3/380: dread d7/fc [0,4194304] 0 2024-08-18T22:41:41.413 INFO:tasks.workunit.client.1.smithi195.stdout:1/423: truncate da/d18/d28/d31/d3b/f3a 1649641 0 2024-08-18T22:41:41.414 INFO:tasks.workunit.client.1.smithi195.stdout:1/424: chown da/d18/d28/c2c 314 1 2024-08-18T22:41:41.415 INFO:tasks.workunit.client.0.smithi121.stdout:7/713: creat de/d2d/d50/db7/fe8 x:0 0 0 2024-08-18T22:41:41.418 INFO:tasks.workunit.client.0.smithi121.stdout:7/714: write de/d13/d18/d23/d24/d85/dce/f61 [1653874,7684] 0 2024-08-18T22:41:41.418 INFO:tasks.workunit.client.0.smithi121.stdout:1/698: mkdir d5/d10/d14/d2a/d3a/d87/df1 0 2024-08-18T22:41:41.420 INFO:tasks.workunit.client.0.smithi121.stdout:3/694: sync 2024-08-18T22:41:41.421 INFO:tasks.workunit.client.1.smithi195.stdout:1/425: dread da/d18/f2a [0,4194304] 0 2024-08-18T22:41:41.423 INFO:tasks.workunit.client.0.smithi121.stdout:1/699: mkdir d5/d10/d14/d2a/d3a/d87/d6c/d6f/d82/d15/d28/d3d/d9a/dac/df2 0 2024-08-18T22:41:41.424 INFO:tasks.workunit.client.0.smithi121.stdout:7/715: truncate de/d13/d18/d23/d24/d29/d43/d7f/f80 977424 0 2024-08-18T22:41:41.425 INFO:tasks.workunit.client.0.smithi121.stdout:3/695: write d1e/d1f/da6/dc7/db8/d104/f8a [1530989,21827] 0 2024-08-18T22:41:41.425 INFO:tasks.workunit.client.1.smithi195.stdout:1/426: creat da/d18/d28/d31/d77/f93 x:0 0 0 2024-08-18T22:41:41.427 INFO:tasks.workunit.client.0.smithi121.stdout:7/716: rmdir de/d13/da0 39 2024-08-18T22:41:41.428 INFO:tasks.workunit.client.1.smithi195.stdout:5/268: dread d0/d3/d8/f13 [0,4194304] 0 2024-08-18T22:41:41.428 INFO:tasks.workunit.client.0.smithi121.stdout:5/512: dwrite d3/d5/d3c/d3f/d8f/f4b [0,4194304] 0 2024-08-18T22:41:41.429 INFO:tasks.workunit.client.0.smithi121.stdout:1/700: write d5/d10/d14/d2a/d3a/d87/d6c/d6f/d82/d15/fe6 [648010,78871] 0 2024-08-18T22:41:41.430 INFO:tasks.workunit.client.1.smithi195.stdout:5/269: creat d0/f4b x:0 0 0 2024-08-18T22:41:41.430 INFO:tasks.workunit.client.1.smithi195.stdout:1/427: dread da/f13 [0,4194304] 0 2024-08-18T22:41:41.432 INFO:tasks.workunit.client.1.smithi195.stdout:5/270: dread - d0/d2/d29/f47 zero size 2024-08-18T22:41:41.434 INFO:tasks.workunit.client.1.smithi195.stdout:5/271: creat d0/db/f4c x:0 0 0 2024-08-18T22:41:41.437 INFO:tasks.workunit.client.1.smithi195.stdout:5/272: fdatasync d0/d3/df/d1a/f3f 0 2024-08-18T22:41:41.439 INFO:tasks.workunit.client.0.smithi121.stdout:7/717: dwrite de/d13/d18/d23/d24/d29/f8e [0,4194304] 0 2024-08-18T22:41:41.440 INFO:tasks.workunit.client.1.smithi195.stdout:1/428: dwrite da/d18/d43/f74 [0,4194304] 0 2024-08-18T22:41:41.440 INFO:tasks.workunit.client.0.smithi121.stdout:5/513: mknod d3/d5/d7e/c9c 0 2024-08-18T22:41:41.440 INFO:tasks.workunit.client.0.smithi121.stdout:7/718: write de/f1c [3450575,8143] 0 2024-08-18T22:41:41.441 INFO:tasks.workunit.client.1.smithi195.stdout:1/429: chown da/d3d/f88 8173 1 2024-08-18T22:41:41.442 INFO:tasks.workunit.client.0.smithi121.stdout:5/514: dread - d3/d5/d3c/f7f zero size 2024-08-18T22:41:41.443 INFO:tasks.workunit.client.1.smithi195.stdout:5/273: getdents d0/d3/d8/d3b 0 2024-08-18T22:41:41.443 INFO:tasks.workunit.client.0.smithi121.stdout:7/719: write de/d13/d18/d23/d24/d85/dce/f61 [1213008,82868] 0 2024-08-18T22:41:41.443 INFO:tasks.workunit.client.0.smithi121.stdout:1/701: write d5/f7 [4695104,27071] 0 2024-08-18T22:41:41.444 INFO:tasks.workunit.client.1.smithi195.stdout:5/274: chown d0/d3/df/c3a 14209314 1 2024-08-18T22:41:41.445 INFO:tasks.workunit.client.1.smithi195.stdout:1/430: creat da/d68/f94 x:0 0 0 2024-08-18T22:41:41.450 INFO:tasks.workunit.client.1.smithi195.stdout:1/431: rmdir da/d18/d28/d8c 0 2024-08-18T22:41:41.451 INFO:tasks.workunit.client.0.smithi121.stdout:1/702: mkdir d5/d10/d67/dc2/df3 0 2024-08-18T22:41:41.452 INFO:tasks.workunit.client.0.smithi121.stdout:3/696: dwrite d1e/d1f/d25/d2e/d36/f57 [0,4194304] 0 2024-08-18T22:41:41.453 INFO:tasks.workunit.client.1.smithi195.stdout:1/432: fdatasync da/d18/d28/f2d 0 2024-08-18T22:41:41.454 INFO:tasks.workunit.client.1.smithi195.stdout:5/275: dwrite d0/d2/d29/f47 [0,4194304] 0 2024-08-18T22:41:41.455 INFO:tasks.workunit.client.1.smithi195.stdout:1/433: chown da/d18/d28/d31/d3b/c76 391188 1 2024-08-18T22:41:41.455 INFO:tasks.workunit.client.0.smithi121.stdout:5/515: creat d3/d5/f9d x:0 0 0 2024-08-18T22:41:41.457 INFO:tasks.workunit.client.0.smithi121.stdout:5/516: write d3/d5/d13/d19/d75/f87 [792540,120429] 0 2024-08-18T22:41:41.457 INFO:tasks.workunit.client.0.smithi121.stdout:7/720: symlink de/d13/d18/d23/d24/d85/dce/d34/d38/d5f/d9c/le9 0 2024-08-18T22:41:41.458 INFO:tasks.workunit.client.1.smithi195.stdout:5/276: mknod d0/d3/d8/d3b/c4d 0 2024-08-18T22:41:41.458 INFO:tasks.workunit.client.0.smithi121.stdout:1/703: creat d5/d10/d14/d2a/d3a/d87/d6c/ff4 x:0 0 0 2024-08-18T22:41:41.461 INFO:tasks.workunit.client.1.smithi195.stdout:1/434: fsync da/d18/d28/d31/d3b/d4e/f67 0 2024-08-18T22:41:41.462 INFO:tasks.workunit.client.1.smithi195.stdout:5/277: mknod d0/d3/d8/d3b/c4e 0 2024-08-18T22:41:41.464 INFO:tasks.workunit.client.0.smithi121.stdout:3/697: rename d1e/ff5 to d1e/d1f/d25/f106 0 2024-08-18T22:41:41.466 INFO:tasks.workunit.client.0.smithi121.stdout:3/698: truncate d1e/d1f/d25/d58/d75/fa9 3199368 0 2024-08-18T22:41:41.467 INFO:tasks.workunit.client.1.smithi195.stdout:5/278: mknod d0/d3/c4f 0 2024-08-18T22:41:41.468 INFO:tasks.workunit.client.0.smithi121.stdout:1/704: rename d5/d10/d14/d2a/d3a/d87/d6c/d6f/d82/d11/fc6 to d5/d10/d67/dc2/df3/ff5 0 2024-08-18T22:41:41.470 INFO:tasks.workunit.client.0.smithi121.stdout:3/699: mknod d1e/d1f/c107 0 2024-08-18T22:41:41.472 INFO:tasks.workunit.client.1.smithi195.stdout:5/279: write d0/d3/f27 [5527610,123542] 0 2024-08-18T22:41:41.473 INFO:tasks.workunit.client.0.smithi121.stdout:3/700: truncate d1e/d1f/d25/d2e/d36/fac 4914984 0 2024-08-18T22:41:41.473 INFO:tasks.workunit.client.1.smithi195.stdout:1/435: getdents da/d4c/d5d 0 2024-08-18T22:41:41.473 INFO:tasks.workunit.client.0.smithi121.stdout:1/705: getdents d5/d10/d14/d92 0 2024-08-18T22:41:41.474 INFO:tasks.workunit.client.1.smithi195.stdout:1/436: write da/d4c/f7d [838063,114379] 0 2024-08-18T22:41:41.475 INFO:tasks.workunit.client.0.smithi121.stdout:1/706: chown d5/d10/d14/d2a/d3a/d87/d6c/d6f/d79/dab/f75 3992698 1 2024-08-18T22:41:41.477 INFO:tasks.workunit.client.1.smithi195.stdout:1/437: mkdir da/d18/d28/d31/d3b/d4e/d95 0 2024-08-18T22:41:41.478 INFO:tasks.workunit.client.0.smithi121.stdout:1/707: mknod d5/dcf/de1/dc1/cf6 0 2024-08-18T22:41:41.479 INFO:tasks.workunit.client.1.smithi195.stdout:5/280: creat d0/d2/f50 x:0 0 0 2024-08-18T22:41:41.481 INFO:tasks.workunit.client.0.smithi121.stdout:3/701: dwrite d1e/d1f/d25/d67/d92/ff8 [0,4194304] 0 2024-08-18T22:41:41.483 INFO:tasks.workunit.client.1.smithi195.stdout:5/281: rmdir d0/d3/d8/d4a 0 2024-08-18T22:41:41.487 INFO:tasks.workunit.client.0.smithi121.stdout:1/708: rename d5/f1f to d5/d10/d14/d2a/d3a/ff7 0 2024-08-18T22:41:41.489 INFO:tasks.workunit.client.1.smithi195.stdout:5/282: dwrite d0/f1d [0,4194304] 0 2024-08-18T22:41:41.490 INFO:tasks.workunit.client.0.smithi121.stdout:7/721: write de/f1d [1643918,42725] 0 2024-08-18T22:41:41.490 INFO:tasks.workunit.client.0.smithi121.stdout:5/517: write d3/d5/d13/d19/d24/f47 [1235258,27998] 0 2024-08-18T22:41:41.491 INFO:tasks.workunit.client.1.smithi195.stdout:5/283: read d0/d3/d8/f13 [1088503,73677] 0 2024-08-18T22:41:41.493 INFO:tasks.workunit.client.0.smithi121.stdout:1/709: symlink d5/d10/d14/lf8 0 2024-08-18T22:41:41.494 INFO:tasks.workunit.client.1.smithi195.stdout:5/284: write d0/d2/d29/f32 [2874031,63062] 0 2024-08-18T22:41:41.495 INFO:tasks.workunit.client.0.smithi121.stdout:3/702: dwrite d1e/d1f/d25/d74/d97/fee [0,4194304] 0 2024-08-18T22:41:41.498 INFO:tasks.workunit.client.1.smithi195.stdout:5/285: unlink d0/d3/df/f39 0 2024-08-18T22:41:41.498 INFO:tasks.workunit.client.0.smithi121.stdout:7/722: chown de/d13/d18/d23/d24/d85/dce/d63/ca6 438102488 1 2024-08-18T22:41:41.500 INFO:tasks.workunit.client.1.smithi195.stdout:1/438: dread f6 [0,4194304] 0 2024-08-18T22:41:41.502 INFO:tasks.workunit.client.1.smithi195.stdout:5/286: mknod d0/d3/df/d1a/c51 0 2024-08-18T22:41:41.502 INFO:tasks.workunit.client.0.smithi121.stdout:7/723: creat de/d13/d18/d23/d24/d85/dce/d2f/d36/fea x:0 0 0 2024-08-18T22:41:41.502 INFO:tasks.workunit.client.0.smithi121.stdout:1/710: getdents d5/d10/d14/d2a/d91 0 2024-08-18T22:41:41.505 INFO:tasks.workunit.client.0.smithi121.stdout:7/724: creat de/d13/d18/d23/feb x:0 0 0 2024-08-18T22:41:41.505 INFO:tasks.workunit.client.1.smithi195.stdout:1/439: mknod da/d18/d28/d31/d3b/c96 0 2024-08-18T22:41:41.506 INFO:tasks.workunit.client.0.smithi121.stdout:1/711: unlink d5/d10/d14/l35 0 2024-08-18T22:41:41.508 INFO:tasks.workunit.client.1.smithi195.stdout:1/440: creat da/d4c/d5d/d63/f97 x:0 0 0 2024-08-18T22:41:41.509 INFO:tasks.workunit.client.0.smithi121.stdout:7/725: mkdir de/d13/d18/d23/d24/d85/dce/d34/d38/d5f/dec 0 2024-08-18T22:41:41.509 INFO:tasks.workunit.client.0.smithi121.stdout:3/703: truncate d1e/d1f/d3e/f79 2219129 0 2024-08-18T22:41:41.510 INFO:tasks.workunit.client.1.smithi195.stdout:5/287: dwrite d0/d3/d8/f14 [0,4194304] 0 2024-08-18T22:41:41.511 INFO:tasks.workunit.client.1.smithi195.stdout:5/288: dread - d0/f4b zero size 2024-08-18T22:41:41.512 INFO:tasks.workunit.client.0.smithi121.stdout:7/726: chown de/d13/d18/d23/d24/d29/d43/d7f/ldc 215 1 2024-08-18T22:41:41.512 INFO:tasks.workunit.client.1.smithi195.stdout:5/289: rmdir d0/d3/d8/d3b 39 2024-08-18T22:41:41.513 INFO:tasks.workunit.client.1.smithi195.stdout:5/290: read d0/d3/df/d1a/f3f [643442,107448] 0 2024-08-18T22:41:41.514 INFO:tasks.workunit.client.0.smithi121.stdout:5/518: dread d3/d5c/f94 [0,4194304] 0 2024-08-18T22:41:41.520 INFO:tasks.workunit.client.1.smithi195.stdout:5/291: dwrite d0/d2/d29/f3d [0,4194304] 0 2024-08-18T22:41:41.521 INFO:tasks.workunit.client.1.smithi195.stdout:5/292: fdatasync d0/d2/d29/f47 0 2024-08-18T22:41:41.524 INFO:tasks.workunit.client.0.smithi121.stdout:5/519: rename d3/d5/d3c/d3f/d8f/f25 to d3/d5/d3c/f9e 0 2024-08-18T22:41:41.525 INFO:tasks.workunit.client.0.smithi121.stdout:1/712: write d5/d10/d67/f85 [907772,67904] 0 2024-08-18T22:41:41.527 INFO:tasks.workunit.client.1.smithi195.stdout:5/293: symlink d0/d37/l52 0 2024-08-18T22:41:41.528 INFO:tasks.workunit.client.0.smithi121.stdout:5/520: write d3/d5/d13/d23/d66/f88 [2058471,80366] 0 2024-08-18T22:41:41.529 INFO:tasks.workunit.client.1.smithi195.stdout:5/294: rmdir d0/d37 39 2024-08-18T22:41:41.529 INFO:tasks.workunit.client.0.smithi121.stdout:1/713: chown d5/d10/d14/d2a/d3a/d87/d6c/d6f/d79/dab/l81 9 1 2024-08-18T22:41:41.530 INFO:tasks.workunit.client.0.smithi121.stdout:3/704: write d1e/d1f/da6/dc7/dae/fc2 [816010,107812] 0 2024-08-18T22:41:41.531 INFO:tasks.workunit.client.1.smithi195.stdout:5/295: mkdir d0/d2/d53 0 2024-08-18T22:41:41.533 INFO:tasks.workunit.client.1.smithi195.stdout:5/296: dread d0/db/f19 [0,4194304] 0 2024-08-18T22:41:41.534 INFO:tasks.workunit.client.0.smithi121.stdout:1/714: truncate d5/d10/d14/f86 979690 0 2024-08-18T22:41:41.535 INFO:tasks.workunit.client.1.smithi195.stdout:5/297: mkdir d0/d2/d29/d54 0 2024-08-18T22:41:41.538 INFO:tasks.workunit.client.0.smithi121.stdout:7/727: dwrite de/d13/d18/d23/d24/d85/dce/d34/d38/dd6/f75 [0,4194304] 0 2024-08-18T22:41:41.538 INFO:tasks.workunit.client.1.smithi195.stdout:5/298: truncate d0/f11 2924822 0 2024-08-18T22:41:41.539 INFO:tasks.workunit.client.0.smithi121.stdout:1/715: dread - d5/d10/d14/d2a/d3a/d87/d6c/d6f/d79/fb9 zero size 2024-08-18T22:41:41.540 INFO:tasks.workunit.client.0.smithi121.stdout:7/728: write fc [1157392,27422] 0 2024-08-18T22:41:41.540 INFO:tasks.workunit.client.0.smithi121.stdout:3/705: symlink d1e/d1f/d25/d6b/db4/d94/de6/l108 0 2024-08-18T22:41:41.543 INFO:tasks.workunit.client.1.smithi195.stdout:5/299: truncate d0/d2/d29/f47 2736241 0 2024-08-18T22:41:41.544 INFO:tasks.workunit.client.0.smithi121.stdout:5/521: link d3/d5/d13/d19/f97 d3/d5/d13/d23/d66/f9f 0 2024-08-18T22:41:41.544 INFO:tasks.workunit.client.0.smithi121.stdout:5/522: chown d3/l99 22 1 2024-08-18T22:41:41.546 INFO:tasks.workunit.client.0.smithi121.stdout:1/716: creat d5/d10/d14/d34/de4/ff9 x:0 0 0 2024-08-18T22:41:41.547 INFO:tasks.workunit.client.1.smithi195.stdout:5/300: creat d0/d2/f55 x:0 0 0 2024-08-18T22:41:41.548 INFO:tasks.workunit.client.0.smithi121.stdout:3/706: creat d1e/d1f/d25/d74/f109 x:0 0 0 2024-08-18T22:41:41.549 INFO:tasks.workunit.client.0.smithi121.stdout:7/729: mkdir de/d13/d18/d23/d24/d85/dce/d63/ded 0 2024-08-18T22:41:41.550 INFO:tasks.workunit.client.0.smithi121.stdout:5/523: symlink d3/d5/d13/d19/d24/d32/d38/la0 0 2024-08-18T22:41:41.551 INFO:tasks.workunit.client.1.smithi195.stdout:5/301: rename d0/db/f4c to d0/d3/d8/f56 0 2024-08-18T22:41:41.552 INFO:tasks.workunit.client.0.smithi121.stdout:5/524: write d3/f8c [669933,76367] 0 2024-08-18T22:41:41.552 INFO:tasks.workunit.client.0.smithi121.stdout:7/730: chown de/d13/d18/d23/d24/d85/dce/d2f/dbf 171318683 1 2024-08-18T22:41:41.552 INFO:tasks.workunit.client.1.smithi195.stdout:5/302: write d0/db/f19 [1048583,3162] 0 2024-08-18T22:41:41.553 INFO:tasks.workunit.client.0.smithi121.stdout:5/525: write d3/d5/d13/d19/d24/d4d/f4f [836284,42640] 0 2024-08-18T22:41:41.554 INFO:tasks.workunit.client.1.smithi195.stdout:5/303: creat d0/d2/d29/f57 x:0 0 0 2024-08-18T22:41:41.555 INFO:tasks.workunit.client.0.smithi121.stdout:5/526: chown d3/d5/d27/d35/d58 19336 1 2024-08-18T22:41:41.555 INFO:tasks.workunit.client.1.smithi195.stdout:2/221: sync 2024-08-18T22:41:41.555 INFO:tasks.workunit.client.1.smithi195.stdout:2/222: readlink d1/d22/l32 0 2024-08-18T22:41:41.556 INFO:tasks.workunit.client.1.smithi195.stdout:5/304: creat d0/d3/df/f58 x:0 0 0 2024-08-18T22:41:41.558 INFO:tasks.workunit.client.0.smithi121.stdout:7/731: dread de/d13/f17 [0,4194304] 0 2024-08-18T22:41:41.558 INFO:tasks.workunit.client.1.smithi195.stdout:2/223: mkdir d1/d8/d3d/d3b/d46 0 2024-08-18T22:41:41.559 INFO:tasks.workunit.client.1.smithi195.stdout:5/305: symlink d0/d2/l59 0 2024-08-18T22:41:41.561 INFO:tasks.workunit.client.1.smithi195.stdout:5/306: mkdir d0/d3/df/d5a 0 2024-08-18T22:41:41.562 INFO:tasks.workunit.client.0.smithi121.stdout:7/732: write de/d13/d18/d23/d24/d85/dce/d34/d6c/fde [663992,47984] 0 2024-08-18T22:41:41.564 INFO:tasks.workunit.client.0.smithi121.stdout:7/733: fsync de/d13/da0/fdb 0 2024-08-18T22:41:41.566 INFO:tasks.workunit.client.0.smithi121.stdout:1/717: dread d5/d10/d14/d2a/d3a/f66 [0,4194304] 0 2024-08-18T22:41:41.566 INFO:tasks.workunit.client.0.smithi121.stdout:7/734: dread - de/d13/d18/d23/d24/d85/fc2 zero size 2024-08-18T22:41:41.568 INFO:tasks.workunit.client.1.smithi195.stdout:5/307: dwrite d0/d2/d29/f3d [0,4194304] 0 2024-08-18T22:41:41.570 INFO:tasks.workunit.client.1.smithi195.stdout:5/308: mknod d0/d3/df/d1a/c5b 0 2024-08-18T22:41:41.571 INFO:tasks.workunit.client.0.smithi121.stdout:7/735: symlink de/d13/d18/d23/d24/d85/dce/d34/d38/d73/da2/lee 0 2024-08-18T22:41:41.572 INFO:tasks.workunit.client.0.smithi121.stdout:5/527: dread d3/d5/d13/d23/d66/f88 [0,4194304] 0 2024-08-18T22:41:41.573 INFO:tasks.workunit.client.0.smithi121.stdout:1/718: dread d5/d10/d14/d2a/d3a/d87/d6c/d6f/d82/d15/f2b [0,4194304] 0 2024-08-18T22:41:41.574 INFO:tasks.workunit.client.0.smithi121.stdout:5/528: write d3/d5/f9d [179086,104436] 0 2024-08-18T22:41:41.577 INFO:tasks.workunit.client.0.smithi121.stdout:1/719: dread - d5/d10/d14/d2a/d3a/d87/f95 zero size 2024-08-18T22:41:41.579 INFO:tasks.workunit.client.1.smithi195.stdout:5/309: dwrite d0/d2/f50 [0,4194304] 0 2024-08-18T22:41:41.580 INFO:tasks.workunit.client.0.smithi121.stdout:1/720: dread d5/d10/d14/d2a/d3a/d87/d6c/d6f/d82/d15/f9e [0,4194304] 0 2024-08-18T22:41:41.588 INFO:tasks.workunit.client.0.smithi121.stdout:1/721: rename d5/d10/d14/d2a/d3a/d87/d6c/d6f/ce0 to d5/dcf/de1/dc1/cfa 0 2024-08-18T22:41:41.590 INFO:tasks.workunit.client.1.smithi195.stdout:5/310: dwrite d0/d3/df/f16 [0,4194304] 0 2024-08-18T22:41:41.593 INFO:tasks.workunit.client.0.smithi121.stdout:1/722: rmdir d5/d10/d14/d2a/d3a/d87/d6c/d6f/d82/d15 39 2024-08-18T22:41:41.595 INFO:tasks.workunit.client.0.smithi121.stdout:7/736: write de/d13/d18/d23/d24/d29/f4d [385655,32477] 0 2024-08-18T22:41:41.598 INFO:tasks.workunit.client.0.smithi121.stdout:5/529: truncate d3/d5/d3c/d3f/d8f/f5b 881847 0 2024-08-18T22:41:41.599 INFO:tasks.workunit.client.0.smithi121.stdout:5/530: chown d3/d5c/l82 50646954 1 2024-08-18T22:41:41.601 INFO:tasks.workunit.client.0.smithi121.stdout:7/737: symlink de/d2d/d50/lef 0 2024-08-18T22:41:41.602 INFO:tasks.workunit.client.0.smithi121.stdout:7/738: chown de/d13/d18/d2e/l3e 271393565 1 2024-08-18T22:41:41.602 INFO:tasks.workunit.client.1.smithi195.stdout:5/311: fsync d0/d2/f50 0 2024-08-18T22:41:41.603 INFO:tasks.workunit.client.0.smithi121.stdout:5/531: creat d3/d5c/d78/fa1 x:0 0 0 2024-08-18T22:41:41.603 INFO:tasks.workunit.client.1.smithi195.stdout:5/312: fdatasync d0/d3/d8/f56 0 2024-08-18T22:41:41.604 INFO:tasks.workunit.client.0.smithi121.stdout:5/532: fdatasync d3/d5/f62 0 2024-08-18T22:41:41.604 INFO:tasks.workunit.client.0.smithi121.stdout:7/739: write de/d13/d18/d23/d24/d85/dce/d2f/d36/f54 [5441559,121267] 0 2024-08-18T22:41:41.605 INFO:tasks.workunit.client.1.smithi195.stdout:5/313: mknod d0/d2/d29/d54/c5c 0 2024-08-18T22:41:41.606 INFO:tasks.workunit.client.1.smithi195.stdout:5/314: read - d0/d2/f55 zero size 2024-08-18T22:41:41.606 INFO:tasks.workunit.client.0.smithi121.stdout:7/740: write fc [926113,130033] 0 2024-08-18T22:41:41.609 INFO:tasks.workunit.client.1.smithi195.stdout:5/315: getdents d0/d3/d8/d3b 0 2024-08-18T22:41:41.610 INFO:tasks.workunit.client.0.smithi121.stdout:5/533: mkdir d3/d5/d13/d19/d24/d32/da2 0 2024-08-18T22:41:41.610 INFO:tasks.workunit.client.1.smithi195.stdout:5/316: chown d0/d2/d29/f32 1 1 2024-08-18T22:41:41.611 INFO:tasks.workunit.client.0.smithi121.stdout:7/741: symlink de/d13/d18/d23/d24/d85/dce/d2f/d4b/d6d/lf0 0 2024-08-18T22:41:41.613 INFO:tasks.workunit.client.0.smithi121.stdout:5/534: mkdir d3/d5/d13/d19/da3 0 2024-08-18T22:41:41.614 INFO:tasks.workunit.client.0.smithi121.stdout:1/723: dread d5/d10/d14/d2a/d3a/d87/d6c/d6f/d82/d15/d28/f71 [4194304,4194304] 0 2024-08-18T22:41:41.615 INFO:tasks.workunit.client.1.smithi195.stdout:5/317: write d0/d3/df/d1a/f3f [4577892,61108] 0 2024-08-18T22:41:41.616 INFO:tasks.workunit.client.1.smithi195.stdout:5/318: creat d0/db/f5d x:0 0 0 2024-08-18T22:41:41.616 INFO:tasks.workunit.client.0.smithi121.stdout:1/724: mknod d5/dcf/de1/cfb 0 2024-08-18T22:41:41.617 INFO:tasks.workunit.client.1.smithi195.stdout:5/319: chown d0/d2/l59 1738 1 2024-08-18T22:41:41.618 INFO:tasks.workunit.client.0.smithi121.stdout:1/725: fdatasync d5/d10/d14/d2a/d3a/d87/d6c/d6f/d82/d15/d28/d3d/d9a/fbc 0 2024-08-18T22:41:41.618 INFO:tasks.workunit.client.1.smithi195.stdout:5/320: symlink d0/d3/df/d5a/l5e 0 2024-08-18T22:41:41.618 INFO:tasks.workunit.client.1.smithi195.stdout:5/321: dread - d0/d3/d8/f56 zero size 2024-08-18T22:41:41.620 INFO:tasks.workunit.client.0.smithi121.stdout:1/726: fsync d5/f7d 0 2024-08-18T22:41:41.620 INFO:tasks.workunit.client.1.smithi195.stdout:5/322: mkdir d0/d3/d5f 0 2024-08-18T22:41:41.620 INFO:tasks.workunit.client.1.smithi195.stdout:5/323: chown d0/f1d 236189 1 2024-08-18T22:41:41.621 INFO:tasks.workunit.client.0.smithi121.stdout:5/535: dread d3/fc [0,4194304] 0 2024-08-18T22:41:41.622 INFO:tasks.workunit.client.1.smithi195.stdout:5/324: unlink d0/d3/df/l33 0 2024-08-18T22:41:41.622 INFO:tasks.workunit.client.1.smithi195.stdout:5/325: stat d0/d2 0 2024-08-18T22:41:41.623 INFO:tasks.workunit.client.0.smithi121.stdout:1/727: mkdir d5/d10/d14/dfc 0 2024-08-18T22:41:41.629 INFO:tasks.workunit.client.1.smithi195.stdout:5/326: dwrite d0/f4b [0,4194304] 0 2024-08-18T22:41:41.629 INFO:tasks.workunit.client.0.smithi121.stdout:5/536: dwrite d3/d5/d13/d19/d24/f7a [0,4194304] 0 2024-08-18T22:41:41.632 INFO:tasks.workunit.client.1.smithi195.stdout:5/327: unlink d0/d3/df/d1a/c5b 0 2024-08-18T22:41:41.634 INFO:tasks.workunit.client.0.smithi121.stdout:5/537: rename d3/d5/d7e to d3/d5/d13/d23/da4 0 2024-08-18T22:41:41.635 INFO:tasks.workunit.client.0.smithi121.stdout:1/728: write d5/d10/d14/f86 [255522,33443] 0 2024-08-18T22:41:41.637 INFO:tasks.workunit.client.0.smithi121.stdout:5/538: creat d3/d5/d3c/d3f/d8f/fa5 x:0 0 0 2024-08-18T22:41:41.637 INFO:tasks.workunit.client.0.smithi121.stdout:5/539: chown d3/f46 3 1 2024-08-18T22:41:41.640 INFO:tasks.workunit.client.1.smithi195.stdout:5/328: dwrite d0/d2/d29/f57 [0,4194304] 0 2024-08-18T22:41:41.641 INFO:tasks.workunit.client.0.smithi121.stdout:1/729: creat d5/d10/d14/d2a/d3a/d87/d6c/d6f/d82/d15/d38/d8e/ffd x:0 0 0 2024-08-18T22:41:41.642 INFO:tasks.workunit.client.0.smithi121.stdout:5/540: mkdir d3/d5/d13/d23/da4/da6 0 2024-08-18T22:41:41.644 INFO:tasks.workunit.client.1.smithi195.stdout:5/329: symlink d0/d3/df/d5a/l60 0 2024-08-18T22:41:41.645 INFO:tasks.workunit.client.0.smithi121.stdout:5/541: chown d3/d5/l9 6689157 1 2024-08-18T22:41:41.646 INFO:tasks.workunit.client.0.smithi121.stdout:1/730: getdents d5/d10/d14/d2a 0 2024-08-18T22:41:41.650 INFO:tasks.workunit.client.0.smithi121.stdout:5/542: rename d3/d5/d27/d35/d53/c8a to d3/d5/d3c/d3f/d8f/ca7 0 2024-08-18T22:41:41.650 INFO:tasks.workunit.client.1.smithi195.stdout:5/330: dread d0/f11 [0,4194304] 0 2024-08-18T22:41:41.650 INFO:tasks.workunit.client.1.smithi195.stdout:5/331: read d0/f1d [183636,127358] 0 2024-08-18T22:41:41.651 INFO:tasks.workunit.client.0.smithi121.stdout:5/543: truncate d3/d5/d3c/f9e 4471903 0 2024-08-18T22:41:41.653 INFO:tasks.workunit.client.1.smithi195.stdout:5/332: mknod d0/d2/d53/c61 0 2024-08-18T22:41:41.654 INFO:tasks.workunit.client.0.smithi121.stdout:1/731: creat d5/d10/d14/d2a/d3a/d87/d6c/d6f/d82/ffe x:0 0 0 2024-08-18T22:41:41.654 INFO:tasks.workunit.client.0.smithi121.stdout:5/544: mkdir d3/d5/d13/d19/d24/d32/da8 0 2024-08-18T22:41:41.656 INFO:tasks.workunit.client.1.smithi195.stdout:5/333: dread d0/f1d [0,4194304] 0 2024-08-18T22:41:41.657 INFO:tasks.workunit.client.0.smithi121.stdout:5/545: creat d3/d5/d3c/d3f/d8f/fa9 x:0 0 0 2024-08-18T22:41:41.657 INFO:tasks.workunit.client.0.smithi121.stdout:5/546: stat d3/d5/d13/d23/d66 0 2024-08-18T22:41:41.663 INFO:tasks.workunit.client.1.smithi195.stdout:5/334: dwrite d0/d2/f55 [0,4194304] 0 2024-08-18T22:41:41.663 INFO:tasks.workunit.client.0.smithi121.stdout:1/732: getdents d5/d10/d14/d2a/d3a/d87/d6c/d6f/d82 0 2024-08-18T22:41:41.664 INFO:tasks.workunit.client.0.smithi121.stdout:5/547: truncate d3/d5c/f94 2460743 0 2024-08-18T22:41:41.666 INFO:tasks.workunit.client.1.smithi195.stdout:5/335: mkdir d0/d3/df/d5a/d62 0 2024-08-18T22:41:41.667 INFO:tasks.workunit.client.0.smithi121.stdout:1/733: getdents d5/d10/d14/d92 0 2024-08-18T22:41:41.667 INFO:tasks.workunit.client.0.smithi121.stdout:5/548: dread d3/d5/d13/d19/f30 [0,4194304] 0 2024-08-18T22:41:41.669 INFO:tasks.workunit.client.1.smithi195.stdout:5/336: creat d0/d46/f63 x:0 0 0 2024-08-18T22:41:41.670 INFO:tasks.workunit.client.0.smithi121.stdout:5/549: creat d3/d5/d13/d23/d66/faa x:0 0 0 2024-08-18T22:41:41.673 INFO:tasks.workunit.client.0.smithi121.stdout:5/550: unlink d3/d5/d13/d19/d24/l2f 0 2024-08-18T22:41:41.673 INFO:tasks.workunit.client.0.smithi121.stdout:5/551: chown d3/d5/d27/c49 864 1 2024-08-18T22:41:41.675 INFO:tasks.workunit.client.1.smithi195.stdout:5/337: dwrite d0/d3/df/f16 [0,4194304] 0 2024-08-18T22:41:41.676 INFO:tasks.workunit.client.1.smithi195.stdout:5/338: write d0/f4b [2519427,120973] 0 2024-08-18T22:41:41.678 INFO:tasks.workunit.client.1.smithi195.stdout:5/339: chown d0/d3/df/d1a/c51 26569164 1 2024-08-18T22:41:41.682 INFO:tasks.workunit.client.0.smithi121.stdout:5/552: dwrite d3/d5/d13/d19/d24/d32/d38/f3e [4194304,4194304] 0 2024-08-18T22:41:41.686 INFO:tasks.workunit.client.0.smithi121.stdout:5/553: write d3/d5/d27/d35/f36 [2399249,115675] 0 2024-08-18T22:41:41.687 INFO:tasks.workunit.client.0.smithi121.stdout:5/554: fdatasync d3/f2a 0 2024-08-18T22:41:41.688 INFO:tasks.workunit.client.1.smithi195.stdout:5/340: truncate d0/d3/df/d1a/f3f 691788 0 2024-08-18T22:41:41.690 INFO:tasks.workunit.client.0.smithi121.stdout:1/734: dread d5/d10/d14/d2a/f8d [0,4194304] 0 2024-08-18T22:41:41.692 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:41.692+0000 7ff42ab0d640 1 -- 172.21.15.121:0/303321188 --> [v2:172.21.15.195:6828/1174410756,v1:172.21.15.195:6829/1174410756] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ff42410de20 con 0x7ff414038df0 2024-08-18T22:41:41.696 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:41.695+0000 7ff4217fa640 1 -- 172.21.15.121:0/303321188 <== mgr.24377 v2:172.21.15.195:6828/1174410756 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+318 (secure 0 0 0) 0x7ff42410de20 con 0x7ff414038df0 2024-08-18T22:41:41.696 INFO:teuthology.orchestra.run.smithi121.stdout:{ 2024-08-18T22:41:41.696 INFO:teuthology.orchestra.run.smithi121.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9", 2024-08-18T22:41:41.696 INFO:teuthology.orchestra.run.smithi121.stdout: "in_progress": true, 2024-08-18T22:41:41.696 INFO:teuthology.orchestra.run.smithi121.stdout: "which": "Upgrading all daemon types on all hosts", 2024-08-18T22:41:41.696 INFO:teuthology.orchestra.run.smithi121.stdout: "services_complete": [], 2024-08-18T22:41:41.696 INFO:teuthology.orchestra.run.smithi121.stdout: "progress": "1/21 daemons upgraded", 2024-08-18T22:41:41.697 INFO:teuthology.orchestra.run.smithi121.stdout: "message": "", 2024-08-18T22:41:41.697 INFO:teuthology.orchestra.run.smithi121.stdout: "is_paused": false 2024-08-18T22:41:41.697 INFO:teuthology.orchestra.run.smithi121.stdout:} 2024-08-18T22:41:41.697 INFO:tasks.workunit.client.0.smithi121.stdout:1/735: fsync d5/d10/d14/d2a/d3a/fbe 0 2024-08-18T22:41:41.697 INFO:tasks.workunit.client.0.smithi121.stdout:5/555: dwrite d3/d5/d13/d23/d66/f88 [0,4194304] 0 2024-08-18T22:41:41.699 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:41.698+0000 7ff42ab0d640 1 -- 172.21.15.121:0/303321188 >> [v2:172.21.15.195:6828/1174410756,v1:172.21.15.195:6829/1174410756] conn(0x7ff414038df0 msgr2=0x7ff41403b2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:41:41.699 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:41.698+0000 7ff42ab0d640 1 --2- 172.21.15.121:0/303321188 >> [v2:172.21.15.195:6828/1174410756,v1:172.21.15.195:6829/1174410756] conn(0x7ff414038df0 0x7ff41403b2a0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7ff410007ac0 tx=0x7ff410035040 comp rx=0 tx=0).stop 2024-08-18T22:41:41.699 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:41.698+0000 7ff42ab0d640 1 -- 172.21.15.121:0/303321188 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff4240fb1c0 msgr2=0x7ff42410be00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:41:41.699 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:41.698+0000 7ff42ab0d640 1 --2- 172.21.15.121:0/303321188 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff4240fb1c0 0x7ff42410be00 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7ff41800b790 tx=0x7ff4180091d0 comp rx=0 tx=0).stop 2024-08-18T22:41:41.699 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:41.698+0000 7ff42ab0d640 1 -- 172.21.15.121:0/303321188 shutdown_connections 2024-08-18T22:41:41.700 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:41.698+0000 7ff42ab0d640 1 --2- 172.21.15.121:0/303321188 >> [v2:172.21.15.195:6828/1174410756,v1:172.21.15.195:6829/1174410756] conn(0x7ff414038df0 0x7ff41403b2a0 secure :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7ff410007ac0 tx=0x7ff410035040 comp rx=0 tx=0).stop 2024-08-18T22:41:41.700 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:41.698+0000 7ff42ab0d640 1 --2- 172.21.15.121:0/303321188 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff4240fc490 0x7ff42410c340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:41:41.700 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:41.698+0000 7ff42ab0d640 1 --2- 172.21.15.121:0/303321188 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff4240fb1c0 0x7ff42410be00 secure :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7ff41800b790 tx=0x7ff4180091d0 comp rx=0 tx=0).stop 2024-08-18T22:41:41.700 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:41.698+0000 7ff42ab0d640 1 -- 172.21.15.121:0/303321188 >> 172.21.15.121:0/303321188 conn(0x7ff4240f69a0 msgr2=0x7ff4240ff7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:41:41.700 INFO:tasks.workunit.client.0.smithi121.stdout:5/556: readlink d3/d5/d13/d19/d24/d32/l33 0 2024-08-18T22:41:41.700 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:41.699+0000 7ff42ab0d640 1 -- 172.21.15.121:0/303321188 shutdown_connections 2024-08-18T22:41:41.701 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:41.700+0000 7ff42ab0d640 1 -- 172.21.15.121:0/303321188 wait complete. 2024-08-18T22:41:41.701 INFO:tasks.workunit.client.0.smithi121.stdout:5/557: read d3/d5/f62 [204602,14224] 0 2024-08-18T22:41:41.703 INFO:tasks.workunit.client.0.smithi121.stdout:5/558: fdatasync d3/d5/d13/d19/d24/f47 0 2024-08-18T22:41:41.703 INFO:tasks.workunit.client.0.smithi121.stdout:1/736: creat d5/d10/d14/d2a/d3a/d87/d6c/d6f/fff x:0 0 0 2024-08-18T22:41:41.705 INFO:tasks.workunit.client.1.smithi195.stdout:5/341: dwrite d0/f1d [0,4194304] 0 2024-08-18T22:41:41.706 INFO:tasks.workunit.client.0.smithi121.stdout:1/737: mknod d5/d10/d67/dc2/df3/c100 0 2024-08-18T22:41:41.707 INFO:tasks.workunit.client.0.smithi121.stdout:5/559: symlink d3/d5/d13/d23/da4/da6/lab 0 2024-08-18T22:41:41.708 INFO:tasks.workunit.client.0.smithi121.stdout:5/560: fsync d3/d5/d13/d19/d75/f87 0 2024-08-18T22:41:41.710 INFO:tasks.workunit.client.0.smithi121.stdout:1/738: write d5/d10/d14/d2a/d3a/d87/d6c/d6f/d82/d15/d38/d8e/f96 [73333,72596] 0 2024-08-18T22:41:41.711 INFO:tasks.workunit.client.1.smithi195.stdout:5/342: rename d0/d2/d29/d54 to d0/d3/d8/d64 0 2024-08-18T22:41:41.711 INFO:tasks.workunit.client.1.smithi195.stdout:5/343: write d0/f1d [85937,32666] 0 2024-08-18T22:41:41.712 INFO:tasks.workunit.client.0.smithi121.stdout:5/561: mknod d3/d5/d3c/d3f/cac 0 2024-08-18T22:41:41.714 INFO:tasks.workunit.client.1.smithi195.stdout:5/344: creat d0/db/f65 x:0 0 0 2024-08-18T22:41:41.716 INFO:tasks.workunit.client.0.smithi121.stdout:5/562: rename d3/d5/d27/d35/d58 to d3/d5/d13/d19/d24/d4d/dad 0 2024-08-18T22:41:41.718 INFO:tasks.workunit.client.0.smithi121.stdout:5/563: read d3/f46 [79611,18821] 0 2024-08-18T22:41:41.719 INFO:tasks.workunit.client.1.smithi195.stdout:7/225: sync 2024-08-18T22:41:41.719 INFO:tasks.workunit.client.1.smithi195.stdout:0/305: sync 2024-08-18T22:41:41.719 INFO:tasks.workunit.client.1.smithi195.stdout:9/340: sync 2024-08-18T22:41:41.720 INFO:tasks.workunit.client.1.smithi195.stdout:7/226: write fb [6288260,43525] 0 2024-08-18T22:41:41.720 INFO:tasks.workunit.client.1.smithi195.stdout:9/341: dread - d1c/d32/d37/f54 zero size 2024-08-18T22:41:41.721 INFO:tasks.workunit.client.1.smithi195.stdout:7/227: write dc/d14/f4a [920098,56382] 0 2024-08-18T22:41:41.723 INFO:tasks.workunit.client.1.smithi195.stdout:7/228: fsync dc/d2a/d4c/f55 0 2024-08-18T22:41:41.723 INFO:tasks.workunit.client.0.smithi121.stdout:1/739: write d5/d10/f88 [284859,68434] 0 2024-08-18T22:41:41.724 INFO:tasks.workunit.client.1.smithi195.stdout:9/342: rmdir d1c/d32/d37/d4b 39 2024-08-18T22:41:41.731 INFO:tasks.workunit.client.1.smithi195.stdout:7/229: link dc/d14/f47 dc/d14/d15/d17/f5b 0 2024-08-18T22:41:41.732 INFO:tasks.workunit.client.1.smithi195.stdout:9/343: write f13 [832399,112785] 0 2024-08-18T22:41:41.732 INFO:tasks.workunit.client.1.smithi195.stdout:0/306: link d0/dc/d11/l4e d0/dc/d11/l57 0 2024-08-18T22:41:41.732 INFO:tasks.workunit.client.0.smithi121.stdout:5/564: dwrite d3/d5/d13/d19/d24/d32/d38/f4e [0,4194304] 0 2024-08-18T22:41:41.733 INFO:tasks.workunit.client.1.smithi195.stdout:7/230: dread - dc/d2a/d4c/f55 zero size 2024-08-18T22:41:41.735 INFO:tasks.workunit.client.1.smithi195.stdout:5/345: dwrite d0/d2/d29/f47 [0,4194304] 0 2024-08-18T22:41:41.736 INFO:tasks.workunit.client.0.smithi121.stdout:5/565: mkdir d3/d5/d13/d19/d24/d32/d38/d63/dae 0 2024-08-18T22:41:41.737 INFO:tasks.workunit.client.0.smithi121.stdout:1/740: dread d5/d10/f20 [0,4194304] 0 2024-08-18T22:41:41.738 INFO:tasks.workunit.client.0.smithi121.stdout:5/566: mkdir d3/d5/d3c/daf 0 2024-08-18T22:41:41.739 INFO:tasks.workunit.client.1.smithi195.stdout:7/231: write dc/d14/d15/d17/f2f [1136500,71929] 0 2024-08-18T22:41:41.744 INFO:tasks.workunit.client.0.smithi121.stdout:1/741: rename d5/d10/ca8 to d5/d10/d14/d2a/d3a/d87/d6c/d6f/c101 0 2024-08-18T22:41:41.746 INFO:tasks.workunit.client.1.smithi195.stdout:7/232: creat dc/d14/d15/d17/d58/f5c x:0 0 0 2024-08-18T22:41:41.746 INFO:tasks.workunit.client.0.smithi121.stdout:1/742: creat d5/d10/d14/d34/f102 x:0 0 0 2024-08-18T22:41:41.747 INFO:tasks.workunit.client.1.smithi195.stdout:9/344: getdents d1c/d32/d37/d4b 0 2024-08-18T22:41:41.750 INFO:tasks.workunit.client.0.smithi121.stdout:1/743: readlink d5/d10/d14/d2a/d3a/d87/d6c/d6f/d82/d15/d38/d8e/lb0 0 2024-08-18T22:41:41.750 INFO:tasks.workunit.client.1.smithi195.stdout:7/233: rename dc/d14/d4b to dc/d1d/d29/d5d 0 2024-08-18T22:41:41.751 INFO:tasks.workunit.client.1.smithi195.stdout:9/345: creat d1c/d32/d37/d4b/f6b x:0 0 0 2024-08-18T22:41:41.752 INFO:tasks.workunit.client.1.smithi195.stdout:9/346: chown d1c/f3a 11 1 2024-08-18T22:41:41.752 INFO:tasks.workunit.client.1.smithi195.stdout:7/234: creat dc/d14/d2b/f5e x:0 0 0 2024-08-18T22:41:41.752 INFO:tasks.workunit.client.0.smithi121.stdout:5/567: truncate d3/d5/d27/d35/f72 317375 0 2024-08-18T22:41:41.753 INFO:tasks.workunit.client.0.smithi121.stdout:5/568: readlink d3/d5/d13/d19/d24/l31 0 2024-08-18T22:41:41.754 INFO:tasks.workunit.client.1.smithi195.stdout:7/235: creat dc/d14/d15/d17/d18/f5f x:0 0 0 2024-08-18T22:41:41.755 INFO:tasks.workunit.client.0.smithi121.stdout:5/569: chown d3/d5/d13/d23/c6b 1215854 1 2024-08-18T22:41:41.757 INFO:tasks.workunit.client.0.smithi121.stdout:5/570: dread d3/d5/d13/d19/f30 [0,4194304] 0 2024-08-18T22:41:41.758 INFO:tasks.workunit.client.1.smithi195.stdout:7/236: creat dc/d14/d15/f60 x:0 0 0 2024-08-18T22:41:41.759 INFO:tasks.workunit.client.1.smithi195.stdout:0/307: dread d0/dc/d11/d30/d44/f12 [0,4194304] 0 2024-08-18T22:41:41.761 INFO:tasks.workunit.client.1.smithi195.stdout:9/347: dwrite d1c/d32/d37/f3d [0,4194304] 0 2024-08-18T22:41:41.762 INFO:tasks.workunit.client.0.smithi121.stdout:5/571: dwrite d3/d5/d13/d23/d66/faa [0,4194304] 0 2024-08-18T22:41:41.763 INFO:tasks.workunit.client.0.smithi121.stdout:5/572: chown d3/d5c 18348974 1 2024-08-18T22:41:41.766 INFO:tasks.workunit.client.1.smithi195.stdout:0/308: creat d0/dc/dd/f58 x:0 0 0 2024-08-18T22:41:41.768 INFO:tasks.workunit.client.1.smithi195.stdout:0/309: write d0/dc/d25/f54 [474066,27223] 0 2024-08-18T22:41:41.772 INFO:tasks.workunit.client.0.smithi121.stdout:5/573: link d3/d5/d13/d19/d24/d32/c96 d3/d5/d27/d35/d53/cb0 0 2024-08-18T22:41:41.777 INFO:tasks.workunit.client.0.smithi121.stdout:5/574: rename d3/d5/d13/d23/d66/faa to d3/d5/d13/d23/d81/fb1 0 2024-08-18T22:41:41.779 INFO:tasks.workunit.client.1.smithi195.stdout:9/348: link d1c/d32/c40 d1c/d32/d37/c6c 0 2024-08-18T22:41:41.779 INFO:tasks.workunit.client.1.smithi195.stdout:6/230: sync 2024-08-18T22:41:41.780 INFO:tasks.workunit.client.1.smithi195.stdout:7/237: dread dc/d14/d15/d17/d18/f1c [0,4194304] 0 2024-08-18T22:41:41.781 INFO:tasks.workunit.client.0.smithi121.stdout:5/575: symlink d3/d5/d13/d23/da4/lb2 0 2024-08-18T22:41:41.782 INFO:tasks.workunit.client.1.smithi195.stdout:6/231: symlink da/db/d26/l47 0 2024-08-18T22:41:41.783 INFO:tasks.workunit.client.1.smithi195.stdout:9/349: creat d1c/d32/d37/f6d x:0 0 0 2024-08-18T22:41:41.784 INFO:tasks.workunit.client.1.smithi195.stdout:6/232: mknod da/d15/d1c/d2e/c48 0 2024-08-18T22:41:41.786 INFO:tasks.workunit.client.1.smithi195.stdout:9/350: creat d1c/d32/d37/d4b/f6e x:0 0 0 2024-08-18T22:41:41.787 INFO:tasks.workunit.client.1.smithi195.stdout:0/310: write d0/dc/dd/f29 [237718,112745] 0 2024-08-18T22:41:41.787 INFO:tasks.workunit.client.1.smithi195.stdout:9/351: write f3 [529993,59209] 0 2024-08-18T22:41:41.788 INFO:tasks.workunit.client.0.smithi121.stdout:5/576: dwrite d3/f8c [0,4194304] 0 2024-08-18T22:41:41.791 INFO:tasks.workunit.client.1.smithi195.stdout:9/352: write d1c/f31 [360872,130902] 0 2024-08-18T22:41:41.791 INFO:tasks.workunit.client.1.smithi195.stdout:0/311: read d0/dc/d25/f1f [43078,14168] 0 2024-08-18T22:41:41.793 INFO:tasks.workunit.client.0.smithi121.stdout:5/577: getdents d3/d5/d27/d68 0 2024-08-18T22:41:41.793 INFO:tasks.workunit.client.1.smithi195.stdout:9/353: chown d1c/l41 1856736 1 2024-08-18T22:41:41.796 INFO:tasks.workunit.client.0.smithi121.stdout:5/578: truncate d3/d5/d13/d19/d24/d4d/f4f 2800043 0 2024-08-18T22:41:41.796 INFO:tasks.workunit.client.1.smithi195.stdout:6/233: getdents da/db/d2a 0 2024-08-18T22:41:41.798 INFO:tasks.workunit.client.0.smithi121.stdout:5/579: symlink d3/d5/d3c/d3f/d8f/lb3 0 2024-08-18T22:41:41.798 INFO:tasks.workunit.client.1.smithi195.stdout:7/238: dwrite f3 [0,4194304] 0 2024-08-18T22:41:41.799 INFO:tasks.workunit.client.1.smithi195.stdout:7/239: chown dc/d14 809 1 2024-08-18T22:41:41.801 INFO:tasks.workunit.client.1.smithi195.stdout:0/312: unlink d0/dc/d11/f27 0 2024-08-18T22:41:41.802 INFO:tasks.workunit.client.1.smithi195.stdout:7/240: chown dc/d1d/d29/f41 1 1 2024-08-18T22:41:41.803 INFO:tasks.workunit.client.1.smithi195.stdout:9/354: write fd [907337,86129] 0 2024-08-18T22:41:41.804 INFO:tasks.workunit.client.0.smithi121.stdout:5/580: creat d3/d5/d27/d35/fb4 x:0 0 0 2024-08-18T22:41:41.805 INFO:tasks.workunit.client.0.smithi121.stdout:5/581: write d3/d5/f11 [224363,61345] 0 2024-08-18T22:41:41.806 INFO:tasks.workunit.client.1.smithi195.stdout:0/313: creat d0/dc/dd/f59 x:0 0 0 2024-08-18T22:41:41.807 INFO:tasks.workunit.client.1.smithi195.stdout:7/241: symlink dc/d14/d15/d17/d58/l61 0 2024-08-18T22:41:41.813 INFO:tasks.workunit.client.1.smithi195.stdout:7/242: unlink dc/d2a/d4c/f55 0 2024-08-18T22:41:41.814 INFO:tasks.workunit.client.0.smithi121.stdout:5/582: rename d3/d8d to d3/d5/d13/d23/d81/db5 0 2024-08-18T22:41:41.814 INFO:tasks.workunit.client.1.smithi195.stdout:9/355: dwrite d1c/d32/d37/f67 [0,4194304] 0 2024-08-18T22:41:41.816 INFO:tasks.workunit.client.0.smithi121.stdout:5/583: readlink d3/d5/d3c/d3f/l55 0 2024-08-18T22:41:41.818 INFO:tasks.workunit.client.1.smithi195.stdout:7/243: creat dc/d14/d2b/f62 x:0 0 0 2024-08-18T22:41:41.819 INFO:tasks.workunit.client.0.smithi121.stdout:5/584: creat d3/d5/d3c/daf/fb6 x:0 0 0 2024-08-18T22:41:41.819 INFO:tasks.workunit.client.1.smithi195.stdout:0/314: symlink d0/dc/d11/l5a 0 2024-08-18T22:41:41.822 INFO:tasks.workunit.client.1.smithi195.stdout:7/244: chown dc/d14/c51 387 1 2024-08-18T22:41:41.822 INFO:tasks.workunit.client.1.smithi195.stdout:0/315: stat d0/dc/dd/d46 0 2024-08-18T22:41:41.824 INFO:tasks.workunit.client.0.smithi121.stdout:5/585: creat d3/d5/d13/d19/d24/d32/da8/fb7 x:0 0 0 2024-08-18T22:41:41.829 INFO:tasks.workunit.client.1.smithi195.stdout:9/356: dwrite d1c/d32/d37/d4b/f65 [0,4194304] 0 2024-08-18T22:41:41.830 INFO:tasks.workunit.client.1.smithi195.stdout:6/234: dwrite da/d15/f34 [0,4194304] 0 2024-08-18T22:41:41.831 INFO:tasks.workunit.client.0.smithi121.stdout:5/586: dwrite d3/d5/f11 [0,4194304] 0 2024-08-18T22:41:41.833 INFO:tasks.workunit.client.1.smithi195.stdout:6/235: write da/d15/d1c/f28 [3080007,94348] 0 2024-08-18T22:41:41.834 INFO:tasks.workunit.client.1.smithi195.stdout:6/236: write da/db/d2a/f44 [622559,7711] 0 2024-08-18T22:41:41.835 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:41.833+0000 7fabdffff640 1 -- 172.21.15.121:0/3377316608 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fabe00fc300 msgr2=0x7fabe00fc770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:41:41.835 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:41.833+0000 7fabdffff640 1 --2- 172.21.15.121:0/3377316608 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fabe00fc300 0x7fabe00fc770 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fabd40048d0 tx=0x7fabd4009da0 comp rx=0 tx=0).stop 2024-08-18T22:41:41.835 INFO:tasks.workunit.client.0.smithi121.stdout:5/587: mknod d3/d5/d27/cb8 0 2024-08-18T22:41:41.836 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:41.834+0000 7fabdffff640 1 -- 172.21.15.121:0/3377316608 shutdown_connections 2024-08-18T22:41:41.836 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:41.834+0000 7fabdffff640 1 --2- 172.21.15.121:0/3377316608 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fabe00fc300 0x7fabe00fc770 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:41:41.836 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:41.834+0000 7fabdffff640 1 --2- 172.21.15.121:0/3377316608 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fabe00fb030 0x7fabe00fb440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:41:41.836 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:41.834+0000 7fabdffff640 1 -- 172.21.15.121:0/3377316608 >> 172.21.15.121:0/3377316608 conn(0x7fabe00f6810 msgr2=0x7fabe00f8c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:41:41.836 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:41.834+0000 7fabdffff640 1 -- 172.21.15.121:0/3377316608 shutdown_connections 2024-08-18T22:41:41.836 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:41.835+0000 7fabdffff640 1 -- 172.21.15.121:0/3377316608 wait complete. 2024-08-18T22:41:41.837 INFO:tasks.workunit.client.1.smithi195.stdout:6/237: write da/db/f3c [1004147,4582] 0 2024-08-18T22:41:41.837 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:41.836+0000 7fabdffff640 1 Processor -- start 2024-08-18T22:41:41.838 INFO:tasks.workunit.client.0.smithi121.stdout:5/588: mknod d3/d5/d13/d23/d81/cb9 0 2024-08-18T22:41:41.838 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:41.837+0000 7fabdffff640 1 -- start start 2024-08-18T22:41:41.838 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:41.837+0000 7fabdffff640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fabe00fb030 0x7fabe010ed90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:41:41.839 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:41.837+0000 7fabdffff640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fabe00fc300 0x7fabe010f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:41:41.839 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:41.837+0000 7fabdffff640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabe010ff90 con 0x7fabe00fb030 2024-08-18T22:41:41.839 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:41.837+0000 7fabdffff640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabe0110100 con 0x7fabe00fc300 2024-08-18T22:41:41.839 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:41.839+0000 7fabdeffd640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fabe00fb030 0x7fabe010ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:41:41.839 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:41.839+0000 7fabdeffd640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fabe00fb030 0x7fabe010ed90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:59008/0 (socket says 172.21.15.121:59008) 2024-08-18T22:41:41.840 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:41.839+0000 7fabdeffd640 1 -- 172.21.15.121:0/2547825099 learned_addr learned my addr 172.21.15.121:0/2547825099 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-18T22:41:41.840 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:41.839+0000 7fabdeffd640 1 -- 172.21.15.121:0/2547825099 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fabe00fc300 msgr2=0x7fabe010f2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:41:41.840 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:41.839+0000 7fabdeffd640 1 --2- 172.21.15.121:0/2547825099 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fabe00fc300 0x7fabe010f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:41:41.840 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:41.839+0000 7fabdeffd640 1 -- 172.21.15.121:0/2547825099 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabd4005040 con 0x7fabe00fb030 2024-08-18T22:41:41.841 INFO:tasks.workunit.client.1.smithi195.stdout:7/245: getdents dc/d14/d2b 0 2024-08-18T22:41:41.842 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:41.840+0000 7fabdeffd640 1 --2- 172.21.15.121:0/2547825099 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fabe00fb030 0x7fabe010ed90 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fabd000eb70 tx=0x7fabd000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:41:41.842 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:41.841+0000 7fabc77fe640 1 -- 172.21.15.121:0/2547825099 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fabd0007c30 con 0x7fabe00fb030 2024-08-18T22:41:41.842 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:41.841+0000 7fabc77fe640 1 -- 172.21.15.121:0/2547825099 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fabd000f040 con 0x7fabe00fb030 2024-08-18T22:41:41.842 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:41.841+0000 7fabc77fe640 1 -- 172.21.15.121:0/2547825099 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fabd0009550 con 0x7fabe00fb030 2024-08-18T22:41:41.842 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:41.841+0000 7fabdffff640 1 -- 172.21.15.121:0/2547825099 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fabe0110380 con 0x7fabe00fb030 2024-08-18T22:41:41.843 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:41.841+0000 7fabdffff640 1 -- 172.21.15.121:0/2547825099 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fabe01107e0 con 0x7fabe00fb030 2024-08-18T22:41:41.844 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:41.843+0000 7fabc77fe640 1 -- 172.21.15.121:0/2547825099 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 23) v1 ==== 46241+0+0 (secure 0 0 0) 0x7fabd000cca0 con 0x7fabe00fb030 2024-08-18T22:41:41.844 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:41.843+0000 7fabdffff640 1 -- 172.21.15.121:0/2547825099 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fabe005eb10 con 0x7fabe00fb030 2024-08-18T22:41:41.845 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:41.844+0000 7fabc77fe640 1 --2- 172.21.15.121:0/2547825099 >> [v2:172.21.15.195:6828/1174410756,v1:172.21.15.195:6829/1174410756] conn(0x7fabc8038e50 0x7fabc803b300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:41:41.845 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:41.844+0000 7fabc77fe640 1 -- 172.21.15.121:0/2547825099 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5808+0+0 (secure 0 0 0) 0x7fabd004c820 con 0x7fabe00fb030 2024-08-18T22:41:41.845 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:41.844+0000 7fabde7fc640 1 --2- 172.21.15.121:0/2547825099 >> [v2:172.21.15.195:6828/1174410756,v1:172.21.15.195:6829/1174410756] conn(0x7fabc8038e50 0x7fabc803b300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:41:41.846 INFO:tasks.workunit.client.0.smithi121.stdout:5/589: dread d3/d5/d27/f6d [0,4194304] 0 2024-08-18T22:41:41.847 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:41.846+0000 7fabde7fc640 1 --2- 172.21.15.121:0/2547825099 >> [v2:172.21.15.195:6828/1174410756,v1:172.21.15.195:6829/1174410756] conn(0x7fabc8038e50 0x7fabc803b300 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fabd402a530 tx=0x7fabd4009da0 comp rx=0 tx=0).ready entity=mgr.24377 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:41:41.847 INFO:tasks.workunit.client.0.smithi121.stdout:5/590: chown c0 233 1 2024-08-18T22:41:41.848 INFO:tasks.workunit.client.1.smithi195.stdout:6/238: dread da/db/d19/f23 [0,4194304] 0 2024-08-18T22:41:41.849 INFO:tasks.workunit.client.1.smithi195.stdout:7/246: rename dc/d14/d2b/f62 to dc/d1d/d29/f63 0 2024-08-18T22:41:41.851 INFO:tasks.workunit.client.1.smithi195.stdout:0/316: dwrite d0/dc/d11/f15 [4194304,4194304] 0 2024-08-18T22:41:41.852 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:41.851+0000 7fabc77fe640 1 -- 172.21.15.121:0/2547825099 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7fabd0012db0 con 0x7fabe00fb030 2024-08-18T22:41:41.855 INFO:tasks.workunit.client.1.smithi195.stdout:7/247: mknod dc/d14/d15/d17/d18/c64 0 2024-08-18T22:41:41.860 INFO:tasks.workunit.client.1.smithi195.stdout:6/239: dwrite da/d15/d1c/f28 [0,4194304] 0 2024-08-18T22:41:41.863 INFO:tasks.workunit.client.1.smithi195.stdout:6/240: write f6 [1558160,7494] 0 2024-08-18T22:41:41.864 INFO:tasks.workunit.client.1.smithi195.stdout:0/317: getdents d0/dc/d25 0 2024-08-18T22:41:41.866 INFO:tasks.workunit.client.1.smithi195.stdout:6/241: read da/d15/f2c [1203038,24080] 0 2024-08-18T22:41:41.868 INFO:tasks.workunit.client.1.smithi195.stdout:7/248: dwrite f3 [4194304,4194304] 0 2024-08-18T22:41:41.871 INFO:tasks.workunit.client.1.smithi195.stdout:6/242: creat da/d3b/f49 x:0 0 0 2024-08-18T22:41:41.875 INFO:tasks.workunit.client.1.smithi195.stdout:7/249: creat dc/d2a/f65 x:0 0 0 2024-08-18T22:41:41.876 INFO:tasks.workunit.client.1.smithi195.stdout:6/243: chown l8 885674 1 2024-08-18T22:41:41.876 INFO:tasks.workunit.client.1.smithi195.stdout:0/318: link d0/dc/l1a d0/dc/d11/d30/d44/d41/l5b 0 2024-08-18T22:41:41.877 INFO:tasks.workunit.client.0.smithi121.stdout:5/591: dread d3/d5/d13/d19/d24/d32/f3b [0,4194304] 0 2024-08-18T22:41:41.878 INFO:tasks.workunit.client.1.smithi195.stdout:7/250: symlink dc/d14/d2b/l66 0 2024-08-18T22:41:41.879 INFO:tasks.workunit.client.0.smithi121.stdout:5/592: truncate d3/d5/d13/d19/d24/d4d/f9b 782154 0 2024-08-18T22:41:41.880 INFO:tasks.workunit.client.1.smithi195.stdout:0/319: symlink d0/dc/l5c 0 2024-08-18T22:41:41.882 INFO:tasks.workunit.client.1.smithi195.stdout:6/244: getdents da/d22 0 2024-08-18T22:41:41.882 INFO:tasks.workunit.client.0.smithi121.stdout:5/593: symlink d3/d5/d13/d19/d24/d4d/dad/d8b/lba 0 2024-08-18T22:41:41.883 INFO:tasks.workunit.client.1.smithi195.stdout:7/251: dread f1 [0,4194304] 0 2024-08-18T22:41:41.884 INFO:tasks.workunit.client.1.smithi195.stdout:6/245: chown da/d15/d1c/d2e 106 1 2024-08-18T22:41:41.884 INFO:tasks.workunit.client.0.smithi121.stdout:5/594: write d3/d5/d13/d23/d81/fb1 [2353395,70820] 0 2024-08-18T22:41:41.884 INFO:tasks.workunit.client.1.smithi195.stdout:7/252: stat dc/d2a/l36 0 2024-08-18T22:41:41.885 INFO:tasks.workunit.client.1.smithi195.stdout:9/357: dread d1c/f3a [0,4194304] 0 2024-08-18T22:41:41.885 INFO:tasks.workunit.client.0.smithi121.stdout:5/595: fsync d3/d5c/f69 0 2024-08-18T22:41:41.886 INFO:tasks.workunit.client.1.smithi195.stdout:9/358: chown l5 0 1 2024-08-18T22:41:41.891 INFO:tasks.workunit.client.1.smithi195.stdout:0/320: rename d0/dc/d11/d30/d44/f55 to d0/dc/d11/d30/d44/d41/f5d 0 2024-08-18T22:41:41.891 INFO:tasks.workunit.client.1.smithi195.stdout:0/321: chown d0/l2 1 1 2024-08-18T22:41:41.892 INFO:tasks.workunit.client.1.smithi195.stdout:6/246: rmdir da/d15/d1c/d2e/d36 0 2024-08-18T22:41:41.895 INFO:tasks.workunit.client.1.smithi195.stdout:7/253: dwrite dc/f1e [4194304,4194304] 0 2024-08-18T22:41:41.897 INFO:tasks.workunit.client.1.smithi195.stdout:0/322: getdents d0/dc/d25 0 2024-08-18T22:41:41.898 INFO:tasks.workunit.client.1.smithi195.stdout:9/359: dwrite d1c/d32/f46 [0,4194304] 0 2024-08-18T22:41:41.902 INFO:tasks.workunit.client.1.smithi195.stdout:9/360: creat d1c/d32/d37/d4b/f6f x:0 0 0 2024-08-18T22:41:41.903 INFO:tasks.workunit.client.0.smithi121.stdout:5/596: dwrite d3/d5/d13/d23/f71 [0,4194304] 0 2024-08-18T22:41:41.905 INFO:tasks.workunit.client.1.smithi195.stdout:9/361: write f13 [3961694,5843] 0 2024-08-18T22:41:41.905 INFO:tasks.workunit.client.0.smithi121.stdout:0/592: sync 2024-08-18T22:41:41.905 INFO:tasks.workunit.client.0.smithi121.stdout:9/748: sync 2024-08-18T22:41:41.905 INFO:tasks.workunit.client.0.smithi121.stdout:8/812: sync 2024-08-18T22:41:41.905 INFO:tasks.workunit.client.0.smithi121.stdout:4/692: sync 2024-08-18T22:41:41.905 INFO:tasks.workunit.client.0.smithi121.stdout:2/461: sync 2024-08-18T22:41:41.907 INFO:tasks.workunit.client.1.smithi195.stdout:9/362: truncate f15 5006400 0 2024-08-18T22:41:41.910 INFO:tasks.workunit.client.1.smithi195.stdout:7/254: dwrite dc/d22/f39 [0,4194304] 0 2024-08-18T22:41:41.913 INFO:tasks.workunit.client.0.smithi121.stdout:0/593: mknod d1/d4/db/d24/d30/d52/d5b/ccf 0 2024-08-18T22:41:41.914 INFO:tasks.workunit.client.1.smithi195.stdout:9/363: mkdir d1c/d70 0 2024-08-18T22:41:41.914 INFO:tasks.workunit.client.1.smithi195.stdout:0/323: dwrite d0/dc/d25/f1e [0,4194304] 0 2024-08-18T22:41:41.916 INFO:tasks.workunit.client.1.smithi195.stdout:7/255: mknod dc/d1d/d29/d5d/c67 0 2024-08-18T22:41:41.917 INFO:tasks.workunit.client.0.smithi121.stdout:8/813: symlink d6/dd/d25/dda/l114 0 2024-08-18T22:41:41.918 INFO:tasks.workunit.client.0.smithi121.stdout:5/597: dwrite d3/d5/d13/d23/f71 [0,4194304] 0 2024-08-18T22:41:41.919 INFO:tasks.workunit.client.1.smithi195.stdout:9/364: mkdir d1c/d32/d71 0 2024-08-18T22:41:41.921 INFO:tasks.workunit.client.1.smithi195.stdout:0/324: rename d0/c16 to d0/dc/d11/d30/c5e 0 2024-08-18T22:41:41.921 INFO:tasks.workunit.client.1.smithi195.stdout:7/256: getdents dc/d14/d15/d4d 0 2024-08-18T22:41:41.923 INFO:tasks.workunit.client.0.smithi121.stdout:2/462: dread d2/d3/d48/f8e [0,4194304] 0 2024-08-18T22:41:41.924 INFO:tasks.workunit.client.0.smithi121.stdout:2/463: fdatasync d2/d8/d19/d4a/f4d 0 2024-08-18T22:41:41.924 INFO:tasks.workunit.client.1.smithi195.stdout:7/257: creat dc/d14/f68 x:0 0 0 2024-08-18T22:41:41.926 INFO:tasks.workunit.client.1.smithi195.stdout:0/325: link d0/dc/f21 d0/dc/d25/f5f 0 2024-08-18T22:41:41.928 INFO:tasks.workunit.client.1.smithi195.stdout:7/258: rename dc/c11 to dc/d14/d15/c69 0 2024-08-18T22:41:41.928 INFO:tasks.workunit.client.0.smithi121.stdout:9/749: rename d0/d38/d44 to d0/d5/dd/d1a/dc8/dfa 0 2024-08-18T22:41:41.929 INFO:tasks.workunit.client.1.smithi195.stdout:0/326: mkdir d0/dc/d11/d23/d51/d60 0 2024-08-18T22:41:41.930 INFO:tasks.workunit.client.0.smithi121.stdout:0/594: chown d1/d4/db/d24/df/d8/l4e 66 1 2024-08-18T22:41:41.931 INFO:tasks.workunit.client.0.smithi121.stdout:8/814: dread d6/d1e/d2d/d78/d45/f53 [0,4194304] 0 2024-08-18T22:41:41.932 INFO:tasks.workunit.client.1.smithi195.stdout:7/259: link dc/f25 dc/d14/d15/d4d/f6a 0 2024-08-18T22:41:41.933 INFO:tasks.workunit.client.0.smithi121.stdout:4/693: creat d2/dc/d1c/ffd x:0 0 0 2024-08-18T22:41:41.933 INFO:tasks.workunit.client.0.smithi121.stdout:8/815: chown d6/dd/c31 186696741 1 2024-08-18T22:41:41.933 INFO:tasks.workunit.client.1.smithi195.stdout:7/260: dread - dc/d2a/f65 zero size 2024-08-18T22:41:41.933 INFO:tasks.workunit.client.0.smithi121.stdout:0/595: chown d1/d4/db/d24/d30/f86 3121 1 2024-08-18T22:41:41.934 INFO:tasks.workunit.client.1.smithi195.stdout:7/261: readlink dc/d14/d2b/l44 0 2024-08-18T22:41:41.934 INFO:tasks.workunit.client.0.smithi121.stdout:4/694: readlink d2/dc/d1c/dc1/ld5 0 2024-08-18T22:41:41.935 INFO:tasks.workunit.client.1.smithi195.stdout:0/327: rename d0/dc/d11/f32 to d0/dc/d11/d30/d44/d41/d4c/f61 0 2024-08-18T22:41:41.936 INFO:tasks.workunit.client.0.smithi121.stdout:4/695: chown d2/dc/d16/d22/d2c/d44/d8c/fc7 58 1 2024-08-18T22:41:41.936 INFO:tasks.workunit.client.1.smithi195.stdout:7/262: creat dc/d14/d15/d17/d58/f6b x:0 0 0 2024-08-18T22:41:41.937 INFO:tasks.workunit.client.1.smithi195.stdout:0/328: truncate d0/dc/dd/f58 413696 0 2024-08-18T22:41:41.937 INFO:tasks.workunit.client.0.smithi121.stdout:2/464: read d2/d3/d48/d77/f6d [1377805,58769] 0 2024-08-18T22:41:41.937 INFO:tasks.workunit.client.0.smithi121.stdout:5/598: rename d3/d5/c6 to d3/d5/d13/d19/d24/d4d/dad/d8b/cbb 0 2024-08-18T22:41:41.938 INFO:tasks.workunit.client.1.smithi195.stdout:6/247: dread da/db/f21 [0,4194304] 0 2024-08-18T22:41:41.938 INFO:tasks.workunit.client.0.smithi121.stdout:9/750: fsync d0/d5/dd/d1a/dc8/dfa/dbf/f84 0 2024-08-18T22:41:41.940 INFO:tasks.workunit.client.0.smithi121.stdout:0/596: write d1/d4/da/d2f/da0/f8c [547519,99308] 0 2024-08-18T22:41:41.941 INFO:tasks.workunit.client.1.smithi195.stdout:7/263: symlink dc/l6c 0 2024-08-18T22:41:41.941 INFO:tasks.workunit.client.1.smithi195.stdout:6/248: mknod da/d22/c4a 0 2024-08-18T22:41:41.945 INFO:tasks.workunit.client.1.smithi195.stdout:6/249: chown da/db/d19/f27 639862 1 2024-08-18T22:41:41.946 INFO:tasks.workunit.client.1.smithi195.stdout:7/264: symlink dc/d2a/d4c/l6d 0 2024-08-18T22:41:41.947 INFO:tasks.workunit.client.0.smithi121.stdout:8/816: dread d6/dd/d25/dda/fe6 [0,4194304] 0 2024-08-18T22:41:41.947 INFO:tasks.workunit.client.1.smithi195.stdout:6/250: fdatasync da/db/f3c 0 2024-08-18T22:41:41.948 INFO:tasks.workunit.client.1.smithi195.stdout:0/329: dwrite d0/f3 [4194304,4194304] 0 2024-08-18T22:41:41.948 INFO:tasks.workunit.client.1.smithi195.stdout:9/365: dread f13 [0,4194304] 0 2024-08-18T22:41:41.949 INFO:tasks.workunit.client.1.smithi195.stdout:9/366: stat d1c/f26 0 2024-08-18T22:41:41.951 INFO:tasks.workunit.client.1.smithi195.stdout:7/265: creat dc/d1d/d29/d5d/f6e x:0 0 0 2024-08-18T22:41:41.951 INFO:tasks.workunit.client.0.smithi121.stdout:0/597: mkdir d1/d4/db/dd0 0 2024-08-18T22:41:41.953 INFO:tasks.workunit.client.0.smithi121.stdout:0/598: fsync d1/d4/f72 0 2024-08-18T22:41:41.953 INFO:tasks.workunit.client.1.smithi195.stdout:0/330: symlink d0/dc/d11/d30/d44/d41/d4c/l62 0 2024-08-18T22:41:41.954 INFO:tasks.workunit.client.1.smithi195.stdout:9/367: mkdir d1c/d32/d72 0 2024-08-18T22:41:41.955 INFO:tasks.workunit.client.0.smithi121.stdout:9/751: unlink d0/d38/d9e/df/d73/ff4 0 2024-08-18T22:41:41.957 INFO:tasks.workunit.client.1.smithi195.stdout:0/331: creat d0/dc/dd/f63 x:0 0 0 2024-08-18T22:41:41.958 INFO:tasks.workunit.client.0.smithi121.stdout:4/696: rmdir d2 39 2024-08-18T22:41:41.958 INFO:tasks.workunit.client.1.smithi195.stdout:7/266: link dc/d1d/d29/d5d/c67 dc/d1d/d29/d5d/c6f 0 2024-08-18T22:41:41.959 INFO:tasks.workunit.client.0.smithi121.stdout:8/817: dwrite d6/dd/d3b/f64 [0,4194304] 0 2024-08-18T22:41:41.959 INFO:tasks.workunit.client.0.smithi121.stdout:0/599: truncate d1/d4/db/d18/d40/fc8 29798 0 2024-08-18T22:41:41.961 INFO:tasks.workunit.client.1.smithi195.stdout:9/368: link d1c/d32/d37/d4b/c4f d1c/c73 0 2024-08-18T22:41:41.962 INFO:tasks.workunit.client.0.smithi121.stdout:9/752: write d0/d38/d9e/d18/f56 [1277075,91609] 0 2024-08-18T22:41:41.969 INFO:tasks.workunit.client.1.smithi195.stdout:7/267: dwrite dc/d14/d15/d17/d18/f57 [0,4194304] 0 2024-08-18T22:41:41.970 INFO:tasks.workunit.client.0.smithi121.stdout:3/707: sync 2024-08-18T22:41:41.972 INFO:tasks.workunit.client.0.smithi121.stdout:0/600: mknod d1/d4/d53/d61/cd1 0 2024-08-18T22:41:41.974 INFO:tasks.workunit.client.0.smithi121.stdout:4/697: rename d2/dc/d1c/lfa to d2/dc/d16/d59/d83/da5/lfe 0 2024-08-18T22:41:41.974 INFO:tasks.workunit.client.1.smithi195.stdout:9/369: dwrite d1c/d32/f36 [0,4194304] 0 2024-08-18T22:41:41.975 INFO:tasks.workunit.client.1.smithi195.stdout:7/268: mknod dc/d14/d15/d17/d18/c70 0 2024-08-18T22:41:41.975 INFO:tasks.workunit.client.0.smithi121.stdout:8/818: read d6/dd/d3b/da3/dca/f55 [107250,25842] 0 2024-08-18T22:41:41.976 INFO:tasks.workunit.client.0.smithi121.stdout:3/708: fsync d1e/d1f/d25/d6b/fdc 0 2024-08-18T22:41:41.976 INFO:tasks.workunit.client.0.smithi121.stdout:4/698: fsync d2/dc/d1c/f96 0 2024-08-18T22:41:41.976 INFO:tasks.workunit.client.1.smithi195.stdout:7/269: write dc/d14/f21 [765401,11628] 0 2024-08-18T22:41:41.977 INFO:tasks.workunit.client.1.smithi195.stdout:4/343: sync 2024-08-18T22:41:41.980 INFO:tasks.workunit.client.1.smithi195.stdout:7/270: creat dc/d14/d15/f71 x:0 0 0 2024-08-18T22:41:41.980 INFO:tasks.workunit.client.1.smithi195.stdout:9/370: mkdir d1c/d74 0 2024-08-18T22:41:41.982 INFO:tasks.workunit.client.1.smithi195.stdout:0/332: dread d0/dc/d11/d30/f40 [0,4194304] 0 2024-08-18T22:41:41.984 INFO:tasks.workunit.client.1.smithi195.stdout:4/344: mknod d0/d7/d1d/c71 0 2024-08-18T22:41:41.984 INFO:tasks.workunit.client.1.smithi195.stdout:9/371: chown d1c/d32/d37/d4b/c5f 26533744 1 2024-08-18T22:41:41.988 INFO:tasks.workunit.client.1.smithi195.stdout:6/251: write da/d15/f2c [3790109,82245] 0 2024-08-18T22:41:41.991 INFO:tasks.workunit.client.1.smithi195.stdout:0/333: mkdir d0/dc/d64 0 2024-08-18T22:41:41.993 INFO:tasks.workunit.client.1.smithi195.stdout:6/252: fsync da/db/f21 0 2024-08-18T22:41:41.994 INFO:tasks.workunit.client.0.smithi121.stdout:2/465: dread d2/d3/d48/d77/f6d [0,4194304] 0 2024-08-18T22:41:41.995 INFO:tasks.workunit.client.1.smithi195.stdout:0/334: rmdir d0/dc/d11/d30 39 2024-08-18T22:41:41.995 INFO:tasks.workunit.client.1.smithi195.stdout:7/271: dwrite dc/d1d/d29/f34 [4194304,4194304] 0 2024-08-18T22:41:41.999 INFO:tasks.workunit.client.1.smithi195.stdout:4/345: dwrite d0/d9/d11/d16/d54/f5c [0,4194304] 0 2024-08-18T22:41:42.002 INFO:tasks.workunit.client.1.smithi195.stdout:7/272: write dc/d22/f2c [1093173,115265] 0 2024-08-18T22:41:42.010 INFO:tasks.workunit.client.1.smithi195.stdout:9/372: dwrite d1c/d32/f49 [0,4194304] 0 2024-08-18T22:41:42.010 INFO:tasks.workunit.client.1.smithi195.stdout:7/273: fdatasync dc/d14/f21 0 2024-08-18T22:41:42.012 INFO:tasks.workunit.client.1.smithi195.stdout:4/346: stat d0/d9/d11/d16 0 2024-08-18T22:41:42.012 INFO:tasks.workunit.client.1.smithi195.stdout:0/335: write d0/dc/f21 [560383,94735] 0 2024-08-18T22:41:42.015 INFO:tasks.workunit.client.1.smithi195.stdout:7/274: creat dc/f72 x:0 0 0 2024-08-18T22:41:42.015 INFO:tasks.workunit.client.1.smithi195.stdout:6/253: dwrite da/d15/d1c/d2e/f3d [0,4194304] 0 2024-08-18T22:41:42.018 INFO:tasks.workunit.client.1.smithi195.stdout:6/254: fdatasync da/db/d19/f45 0 2024-08-18T22:41:42.019 INFO:tasks.workunit.client.1.smithi195.stdout:9/373: rmdir d1c/d32/d72 0 2024-08-18T22:41:42.021 INFO:tasks.workunit.client.1.smithi195.stdout:7/275: unlink c6 0 2024-08-18T22:41:42.023 INFO:tasks.workunit.client.1.smithi195.stdout:6/255: dread da/db/d2a/f44 [0,4194304] 0 2024-08-18T22:41:42.027 INFO:tasks.workunit.client.1.smithi195.stdout:0/336: truncate d0/dc/d11/d30/d44/d41/d4c/f61 1181637 0 2024-08-18T22:41:42.027 INFO:tasks.workunit.client.1.smithi195.stdout:6/256: symlink da/db/d2a/l4b 0 2024-08-18T22:41:42.028 INFO:tasks.workunit.client.1.smithi195.stdout:0/337: chown d0/l4 87267913 1 2024-08-18T22:41:42.030 INFO:tasks.workunit.client.1.smithi195.stdout:6/257: mknod da/db/d26/c4c 0 2024-08-18T22:41:42.038 INFO:tasks.workunit.client.1.smithi195.stdout:0/338: rmdir d0/dc/d11/d23/d51/d60 0 2024-08-18T22:41:42.038 INFO:tasks.workunit.client.1.smithi195.stdout:8/419: sync 2024-08-18T22:41:42.038 INFO:tasks.workunit.client.1.smithi195.stdout:4/347: dread d0/d9/d11/d16/d37/d48/d4c/f63 [0,4194304] 0 2024-08-18T22:41:42.039 INFO:tasks.workunit.client.1.smithi195.stdout:6/258: dwrite da/db/d19/f27 [0,4194304] 0 2024-08-18T22:41:42.043 INFO:tasks.workunit.client.0.smithi121.stdout:7/742: sync 2024-08-18T22:41:42.043 INFO:tasks.workunit.client.0.smithi121.stdout:1/744: sync 2024-08-18T22:41:42.045 INFO:tasks.workunit.client.1.smithi195.stdout:9/374: dread d1c/f21 [0,4194304] 0 2024-08-18T22:41:42.045 INFO:tasks.workunit.client.1.smithi195.stdout:6/259: symlink da/d3b/l4d 0 2024-08-18T22:41:42.046 INFO:tasks.workunit.client.1.smithi195.stdout:9/375: readlink d1c/l1e 0 2024-08-18T22:41:42.048 INFO:tasks.workunit.client.1.smithi195.stdout:8/420: symlink d1/de/d31/d5a/l9d 0 2024-08-18T22:41:42.051 INFO:tasks.workunit.client.0.smithi121.stdout:7/743: dwrite de/d13/d18/f3c [0,4194304] 0 2024-08-18T22:41:42.051 INFO:tasks.workunit.client.1.smithi195.stdout:4/348: mknod d0/d9/d11/d16/c72 0 2024-08-18T22:41:42.051 INFO:tasks.workunit.client.0.smithi121.stdout:7/744: stat de/d13/d18/d23/d24/f56 0 2024-08-18T22:41:42.052 INFO:tasks.workunit.client.1.smithi195.stdout:7/276: dwrite dc/d14/d15/d4d/f6a [0,4194304] 0 2024-08-18T22:41:42.052 INFO:tasks.workunit.client.1.smithi195.stdout:4/349: write d0/d9/d11/d16/d49/f35 [3827404,119907] 0 2024-08-18T22:41:42.053 INFO:tasks.workunit.client.1.smithi195.stdout:6/260: creat da/db/d26/d2d/f4e x:0 0 0 2024-08-18T22:41:42.056 INFO:tasks.workunit.client.1.smithi195.stdout:6/261: write da/d15/d1c/f12 [1187673,109868] 0 2024-08-18T22:41:42.061 INFO:tasks.workunit.client.1.smithi195.stdout:8/421: chown d1/d64/l6d 3 1 2024-08-18T22:41:42.062 INFO:tasks.workunit.client.1.smithi195.stdout:8/422: read - d1/de/df/d1d/d1f/f98 zero size 2024-08-18T22:41:42.063 INFO:tasks.workunit.client.1.smithi195.stdout:9/376: mkdir d1c/d32/d71/d75 0 2024-08-18T22:41:42.064 INFO:tasks.workunit.client.1.smithi195.stdout:4/350: symlink d0/d9/d41/l73 0 2024-08-18T22:41:42.066 INFO:tasks.workunit.client.1.smithi195.stdout:6/262: rename da/db/d26/d2d/f4e to da/db/d26/f4f 0 2024-08-18T22:41:42.070 INFO:tasks.workunit.client.1.smithi195.stdout:0/339: getdents d0/dc/d11 0 2024-08-18T22:41:42.071 INFO:tasks.workunit.client.1.smithi195.stdout:9/377: creat d1c/d70/f76 x:0 0 0 2024-08-18T22:41:42.072 INFO:tasks.workunit.client.0.smithi121.stdout:5/599: link d3/d5/d27/d35/f5d d3/d5/d13/d23/fbc 0 2024-08-18T22:41:42.072 INFO:tasks.workunit.client.1.smithi195.stdout:6/263: creat da/d15/d1c/f50 x:0 0 0 2024-08-18T22:41:42.074 INFO:tasks.workunit.client.1.smithi195.stdout:8/423: dwrite d1/d3/db/d39/f70 [0,4194304] 0 2024-08-18T22:41:42.075 INFO:tasks.workunit.client.1.smithi195.stdout:7/277: symlink dc/d14/d15/d17/l73 0 2024-08-18T22:41:42.075 INFO:tasks.workunit.client.1.smithi195.stdout:6/264: dread - da/d3b/f3e zero size 2024-08-18T22:41:42.076 INFO:tasks.workunit.client.1.smithi195.stdout:9/378: rmdir d1c/d32/d37/d4b 39 2024-08-18T22:41:42.077 INFO:tasks.workunit.client.1.smithi195.stdout:6/265: fsync da/db/f37 0 2024-08-18T22:41:42.079 INFO:tasks.workunit.client.1.smithi195.stdout:8/424: mknod d1/de/d27/d4f/c9e 0 2024-08-18T22:41:42.079 INFO:tasks.workunit.client.1.smithi195.stdout:6/266: dread - da/d15/f31 zero size 2024-08-18T22:41:42.079 INFO:tasks.workunit.client.1.smithi195.stdout:7/278: stat dc/d14/d15/d17/f2f 0 2024-08-18T22:41:42.080 INFO:tasks.workunit.client.1.smithi195.stdout:8/425: write d1/f7d [823364,21749] 0 2024-08-18T22:41:42.081 INFO:tasks.workunit.client.1.smithi195.stdout:9/379: symlink d1c/d32/d71/l77 0 2024-08-18T22:41:42.082 INFO:tasks.workunit.client.0.smithi121.stdout:7/745: symlink de/d13/d18/d23/d24/d85/dce/d34/lf1 0 2024-08-18T22:41:42.085 INFO:tasks.workunit.client.1.smithi195.stdout:8/426: unlink d1/de/df/d1d/d1f/f24 0 2024-08-18T22:41:42.087 INFO:tasks.workunit.client.1.smithi195.stdout:0/340: link d0/dc/d11/d30/d44/c28 d0/dc/d11/d30/d44/d41/c65 0 2024-08-18T22:41:42.088 INFO:tasks.workunit.client.0.smithi121.stdout:8/819: mkdir d6/d115 0 2024-08-18T22:41:42.088 INFO:tasks.workunit.client.1.smithi195.stdout:9/380: symlink d1c/d32/d37/d4b/l78 0 2024-08-18T22:41:42.088 INFO:tasks.workunit.client.1.smithi195.stdout:4/351: write d0/f8 [963765,29446] 0 2024-08-18T22:41:42.091 INFO:tasks.workunit.client.0.smithi121.stdout:8/820: truncate d6/d1e/d2d/de5/fbd 663482 0 2024-08-18T22:41:42.093 INFO:tasks.workunit.client.1.smithi195.stdout:6/267: dwrite da/db/f3c [0,4194304] 0 2024-08-18T22:41:42.094 INFO:tasks.workunit.client.1.smithi195.stdout:8/427: write d1/d3/db/d35/f42 [615108,58732] 0 2024-08-18T22:41:42.095 INFO:tasks.workunit.client.1.smithi195.stdout:4/352: mknod d0/d7/d1d/c74 0 2024-08-18T22:41:42.096 INFO:tasks.workunit.client.0.smithi121.stdout:3/709: link d1e/d1f/da6/dc7/dae/fc2 d1e/d1f/da6/dc7/db8/d104/d9a/f10a 0 2024-08-18T22:41:42.096 INFO:tasks.workunit.client.1.smithi195.stdout:4/353: fsync d0/d9/d11/d16/f5e 0 2024-08-18T22:41:42.097 INFO:tasks.workunit.client.1.smithi195.stdout:9/381: rename d1c/d32/d37/f54 to d1c/d32/d71/f79 0 2024-08-18T22:41:42.100 INFO:tasks.workunit.client.0.smithi121.stdout:4/699: dwrite d2/dc/d1c/f7d [4194304,4194304] 0 2024-08-18T22:41:42.101 INFO:tasks.workunit.client.1.smithi195.stdout:6/268: dread da/db/f21 [0,4194304] 0 2024-08-18T22:41:42.101 INFO:tasks.workunit.client.1.smithi195.stdout:7/279: truncate dc/d14/d15/d17/d18/f1c 3047481 0 2024-08-18T22:41:42.102 INFO:tasks.workunit.client.1.smithi195.stdout:4/354: write d0/d9/f2e [3482618,6298] 0 2024-08-18T22:41:42.104 INFO:tasks.workunit.client.1.smithi195.stdout:4/355: stat d0/c12 0 2024-08-18T22:41:42.111 INFO:tasks.workunit.client.1.smithi195.stdout:9/382: dwrite d1c/f58 [0,4194304] 0 2024-08-18T22:41:42.113 INFO:tasks.workunit.client.1.smithi195.stdout:0/341: dwrite d0/dc/dd/f59 [0,4194304] 0 2024-08-18T22:41:42.113 INFO:tasks.workunit.client.1.smithi195.stdout:6/269: chown da/db/f3c 705308 1 2024-08-18T22:41:42.114 INFO:tasks.workunit.client.1.smithi195.stdout:6/270: dread - da/f40 zero size 2024-08-18T22:41:42.115 INFO:tasks.workunit.client.1.smithi195.stdout:9/383: chown d1c/d32/d37/d4b/f65 7724300 1 2024-08-18T22:41:42.117 INFO:tasks.workunit.client.0.smithi121.stdout:2/466: rmdir d2/d3/d51/d91 0 2024-08-18T22:41:42.121 INFO:tasks.workunit.client.1.smithi195.stdout:6/271: dread - da/f13 zero size 2024-08-18T22:41:42.122 INFO:tasks.workunit.client.1.smithi195.stdout:0/342: mkdir d0/dc/d11/d30/d44/d41/d4c/d4f/d66 0 2024-08-18T22:41:42.123 INFO:tasks.workunit.client.0.smithi121.stdout:3/710: truncate d1e/d1f/d3e/f78 2972698 0 2024-08-18T22:41:42.124 INFO:tasks.workunit.client.1.smithi195.stdout:7/280: dwrite dc/d14/d2b/f5e [0,4194304] 0 2024-08-18T22:41:42.125 INFO:tasks.workunit.client.0.smithi121.stdout:0/601: write d1/d4/db/d24/f2b [2008715,51690] 0 2024-08-18T22:41:42.127 INFO:tasks.workunit.client.0.smithi121.stdout:8/821: creat d6/dd/d25/dc8/de9/f116 x:0 0 0 2024-08-18T22:41:42.130 INFO:tasks.workunit.client.1.smithi195.stdout:9/384: dread d1c/f44 [0,4194304] 0 2024-08-18T22:41:42.133 INFO:tasks.workunit.client.1.smithi195.stdout:9/385: chown d1c/d32/d37/c3f 23754 1 2024-08-18T22:41:42.137 INFO:tasks.workunit.client.0.smithi121.stdout:4/700: rename d2/dc/d16/d59/d83/da5/lfe to d2/dc/d16/d47/dea/lff 0 2024-08-18T22:41:42.137 INFO:tasks.workunit.client.1.smithi195.stdout:9/386: write d1c/d32/f50 [347863,75708] 0 2024-08-18T22:41:42.137 INFO:tasks.workunit.client.1.smithi195.stdout:0/343: dwrite d0/dc/d11/d30/d44/d41/d4c/f61 [0,4194304] 0 2024-08-18T22:41:42.140 INFO:tasks.workunit.client.0.smithi121.stdout:7/746: creat de/d13/d18/d23/d24/d85/dce/d2f/d4b/ff2 x:0 0 0 2024-08-18T22:41:42.140 INFO:tasks.workunit.client.1.smithi195.stdout:7/281: dwrite dc/d14/d15/d4d/f6a [4194304,4194304] 0 2024-08-18T22:41:42.140 INFO:tasks.workunit.client.0.smithi121.stdout:0/602: dwrite d1/d4/db/d24/df/d8/d78/f7a [0,4194304] 0 2024-08-18T22:41:42.141 INFO:tasks.workunit.client.1.smithi195.stdout:7/282: stat dc/d14/d2b/l31 0 2024-08-18T22:41:42.142 INFO:tasks.workunit.client.1.smithi195.stdout:9/387: creat d1c/d32/d37/d4b/f7a x:0 0 0 2024-08-18T22:41:42.147 INFO:tasks.workunit.client.0.smithi121.stdout:2/467: dwrite d2/f2c [0,4194304] 0 2024-08-18T22:41:42.148 INFO:tasks.workunit.client.1.smithi195.stdout:7/283: write dc/d14/d15/d17/d58/f5a [607957,97868] 0 2024-08-18T22:41:42.148 INFO:tasks.workunit.client.1.smithi195.stdout:0/344: dwrite d0/dc/d25/f54 [0,4194304] 0 2024-08-18T22:41:42.150 INFO:tasks.workunit.client.1.smithi195.stdout:9/388: mkdir d1c/d74/d7b 0 2024-08-18T22:41:42.152 INFO:tasks.workunit.client.0.smithi121.stdout:8/822: chown d6/d1e/d2d/d78/l4f 11791 1 2024-08-18T22:41:42.152 INFO:tasks.workunit.client.1.smithi195.stdout:0/345: mkdir d0/dc/d25/d67 0 2024-08-18T22:41:42.153 INFO:tasks.workunit.client.0.smithi121.stdout:3/711: creat d1e/d1f/d25/d58/df7/f10b x:0 0 0 2024-08-18T22:41:42.154 INFO:tasks.workunit.client.1.smithi195.stdout:7/284: mknod dc/d2a/d4c/c74 0 2024-08-18T22:41:42.155 INFO:tasks.workunit.client.0.smithi121.stdout:4/701: chown d2/dc/lc8 1 1 2024-08-18T22:41:42.159 INFO:tasks.workunit.client.1.smithi195.stdout:0/346: read d0/dc/d25/f1e [685310,98551] 0 2024-08-18T22:41:42.161 INFO:tasks.workunit.client.1.smithi195.stdout:9/389: creat d1c/f7c x:0 0 0 2024-08-18T22:41:42.164 INFO:tasks.workunit.client.1.smithi195.stdout:7/285: creat dc/d14/d15/d17/d18/f75 x:0 0 0 2024-08-18T22:41:42.164 INFO:tasks.workunit.client.1.smithi195.stdout:0/347: creat d0/dc/d11/d30/d44/d41/d4c/d4f/f68 x:0 0 0 2024-08-18T22:41:42.165 INFO:tasks.workunit.client.1.smithi195.stdout:9/390: read d1c/d32/f46 [3542644,107290] 0 2024-08-18T22:41:42.167 INFO:tasks.workunit.client.0.smithi121.stdout:5/600: dwrite d3/d5/d27/d35/f5d [0,4194304] 0 2024-08-18T22:41:42.167 INFO:tasks.workunit.client.1.smithi195.stdout:7/286: write dc/d14/f21 [457018,24272] 0 2024-08-18T22:41:42.170 INFO:tasks.workunit.client.0.smithi121.stdout:8/823: unlink d6/dd/d25/dc8/de9/f116 0 2024-08-18T22:41:42.172 INFO:tasks.workunit.client.1.smithi195.stdout:0/348: fdatasync d0/f1c 0 2024-08-18T22:41:42.175 INFO:tasks.workunit.client.1.smithi195.stdout:7/287: truncate f2 1425094 0 2024-08-18T22:41:42.175 INFO:tasks.workunit.client.0.smithi121.stdout:5/601: creat d3/d5/d3c/fbd x:0 0 0 2024-08-18T22:41:42.175 INFO:tasks.workunit.client.0.smithi121.stdout:3/712: dwrite d1e/d1f/d25/d2e/d36/f57 [4194304,4194304] 0 2024-08-18T22:41:42.178 INFO:tasks.workunit.client.0.smithi121.stdout:0/603: mknod d1/d4/db/d18/d40/d83/daf/dcb/cd2 0 2024-08-18T22:41:42.181 INFO:tasks.workunit.client.0.smithi121.stdout:8/824: creat d6/d115/f117 x:0 0 0 2024-08-18T22:41:42.181 INFO:tasks.workunit.client.0.smithi121.stdout:0/604: chown d1/d4/db/d18/d1c/d5f/f9a 1 1 2024-08-18T22:41:42.181 INFO:tasks.workunit.client.1.smithi195.stdout:0/349: mknod d0/dc/dd/d46/c69 0 2024-08-18T22:41:42.182 INFO:tasks.workunit.client.1.smithi195.stdout:7/288: chown dc/d14/d15/d17/d18/c24 264023 1 2024-08-18T22:41:42.182 INFO:tasks.workunit.client.1.smithi195.stdout:9/391: dwrite d1c/d32/d37/d4b/f6b [0,4194304] 0 2024-08-18T22:41:42.184 INFO:tasks.workunit.client.0.smithi121.stdout:4/702: dwrite d2/dc/d16/d47/fd6 [0,4194304] 0 2024-08-18T22:41:42.187 INFO:tasks.workunit.client.0.smithi121.stdout:4/703: write d2/dc/d16/d59/d83/dd7/f88 [3652029,58883] 0 2024-08-18T22:41:42.189 INFO:tasks.workunit.client.0.smithi121.stdout:0/605: read d1/d4/da/d2f/da0/f8c [2942121,31320] 0 2024-08-18T22:41:42.191 INFO:tasks.workunit.client.1.smithi195.stdout:9/392: creat d1c/d32/d71/f7d x:0 0 0 2024-08-18T22:41:42.191 INFO:tasks.workunit.client.1.smithi195.stdout:7/289: creat dc/d14/d15/d17/d58/f76 x:0 0 0 2024-08-18T22:41:42.192 INFO:tasks.workunit.client.1.smithi195.stdout:0/350: dread d0/dc/dd/f58 [0,4194304] 0 2024-08-18T22:41:42.193 INFO:tasks.workunit.client.0.smithi121.stdout:5/602: truncate d3/d5/d27/d35/f72 960417 0 2024-08-18T22:41:42.193 INFO:tasks.workunit.client.0.smithi121.stdout:5/603: chown d3/d5/d13/d23 49 1 2024-08-18T22:41:42.193 INFO:tasks.workunit.client.0.smithi121.stdout:5/604: readlink d3/d5/d13/d19/d24/l2b 0 2024-08-18T22:41:42.193 INFO:tasks.workunit.client.0.smithi121.stdout:8/825: mkdir d6/d20/d118 0 2024-08-18T22:41:42.195 INFO:tasks.workunit.client.0.smithi121.stdout:8/826: chown d6/dd/d3b/da3/dca 1267598 1 2024-08-18T22:41:42.195 INFO:tasks.workunit.client.1.smithi195.stdout:7/290: chown dc/d14/d15/d17/f2f 171119838 1 2024-08-18T22:41:42.196 INFO:tasks.workunit.client.0.smithi121.stdout:8/827: write d6/dd/d25/fe2 [2337620,73734] 0 2024-08-18T22:41:42.197 INFO:tasks.workunit.client.0.smithi121.stdout:4/704: creat d2/dc/d16/d22/d2c/d44/f100 x:0 0 0 2024-08-18T22:41:42.202 INFO:tasks.workunit.client.1.smithi195.stdout:9/393: dwrite d1c/d32/f50 [0,4194304] 0 2024-08-18T22:41:42.203 INFO:tasks.workunit.client.1.smithi195.stdout:9/394: dread - d1c/f6a zero size 2024-08-18T22:41:42.204 INFO:tasks.workunit.client.0.smithi121.stdout:4/705: write d2/dc/d16/d22/d29/fe6 [47521,42107] 0 2024-08-18T22:41:42.209 INFO:tasks.workunit.client.0.smithi121.stdout:8/828: mkdir d6/dd/d25/dc8/d119 0 2024-08-18T22:41:42.210 INFO:tasks.workunit.client.0.smithi121.stdout:5/605: mknod d3/d5/d13/d19/da3/cbe 0 2024-08-18T22:41:42.211 INFO:tasks.workunit.client.1.smithi195.stdout:9/395: creat d1c/d32/d71/d75/f7e x:0 0 0 2024-08-18T22:41:42.212 INFO:tasks.workunit.client.1.smithi195.stdout:9/396: chown f13 691 1 2024-08-18T22:41:42.212 INFO:tasks.workunit.client.0.smithi121.stdout:4/706: chown d2/dc/d1c/daa 23 1 2024-08-18T22:41:42.213 INFO:tasks.workunit.client.0.smithi121.stdout:2/468: dwrite d2/d3/d48/d77/f42 [0,4194304] 0 2024-08-18T22:41:42.215 INFO:tasks.workunit.client.1.smithi195.stdout:9/397: getdents d1c/d70 0 2024-08-18T22:41:42.218 INFO:tasks.workunit.client.1.smithi195.stdout:9/398: symlink d1c/l7f 0 2024-08-18T22:41:42.219 INFO:tasks.workunit.client.0.smithi121.stdout:3/713: dwrite f11 [4194304,4194304] 0 2024-08-18T22:41:42.219 INFO:tasks.workunit.client.0.smithi121.stdout:7/747: dread de/d13/d18/d23/d24/d85/dce/d63/f6b [8388608,4194304] 0 2024-08-18T22:41:42.221 INFO:tasks.workunit.client.1.smithi195.stdout:9/399: rename d1c/f2a to d1c/d74/f80 0 2024-08-18T22:41:42.222 INFO:tasks.workunit.client.0.smithi121.stdout:5/606: fsync d3/d5/d13/d19/d24/d32/d38/d63/f83 0 2024-08-18T22:41:42.222 INFO:tasks.workunit.client.1.smithi195.stdout:9/400: write d1c/f3a [1036373,67419] 0 2024-08-18T22:41:42.223 INFO:tasks.workunit.client.1.smithi195.stdout:9/401: dread - d1c/d32/d37/f5b zero size 2024-08-18T22:41:42.223 INFO:tasks.workunit.client.0.smithi121.stdout:0/606: link d1/d4/db/d18/d40/cae d1/d4/da/cd3 0 2024-08-18T22:41:42.224 INFO:tasks.workunit.client.1.smithi195.stdout:9/402: chown d1c/l62 5 1 2024-08-18T22:41:42.224 INFO:tasks.workunit.client.0.smithi121.stdout:8/829: fdatasync d6/d1e/d2d/d78/d85/f9c 0 2024-08-18T22:41:42.227 INFO:tasks.workunit.client.0.smithi121.stdout:4/707: dread - d2/dc/f32 zero size 2024-08-18T22:41:42.228 INFO:tasks.workunit.client.0.smithi121.stdout:2/469: mknod d2/d8/d1f/c99 0 2024-08-18T22:41:42.228 INFO:tasks.workunit.client.1.smithi195.stdout:9/403: mknod d1c/c81 0 2024-08-18T22:41:42.228 INFO:tasks.workunit.client.0.smithi121.stdout:7/748: symlink de/d13/d18/d23/d24/d85/dce/d20/d39/lf3 0 2024-08-18T22:41:42.233 INFO:tasks.workunit.client.1.smithi195.stdout:9/404: mkdir d1c/d74/d7b/d82 0 2024-08-18T22:41:42.234 INFO:tasks.workunit.client.0.smithi121.stdout:5/607: rename d3/d5/d3c/d3f/d8f/f5e to d3/d5/d3c/fbf 0 2024-08-18T22:41:42.235 INFO:tasks.workunit.client.1.smithi195.stdout:9/405: creat d1c/d70/f83 x:0 0 0 2024-08-18T22:41:42.238 INFO:tasks.workunit.client.1.smithi195.stdout:0/351: truncate d0/dc/d25/f54 1599860 0 2024-08-18T22:41:42.239 INFO:tasks.workunit.client.0.smithi121.stdout:2/470: write d2/d8/d19/f47 [188904,57630] 0 2024-08-18T22:41:42.239 INFO:tasks.workunit.client.1.smithi195.stdout:9/406: write d1c/f2c [3383840,106755] 0 2024-08-18T22:41:42.243 INFO:tasks.workunit.client.1.smithi195.stdout:0/352: unlink d0/dc/d11/d30/d44/f2d 0 2024-08-18T22:41:42.244 INFO:tasks.workunit.client.0.smithi121.stdout:7/749: readlink de/d13/d18/d23/d24/d85/dce/d20/la8 0 2024-08-18T22:41:42.246 INFO:tasks.workunit.client.1.smithi195.stdout:0/353: symlink d0/dc/d11/d30/d44/d41/d4c/d4f/l6a 0 2024-08-18T22:41:42.248 INFO:tasks.workunit.client.1.smithi195.stdout:9/407: link f13 d1c/d32/f84 0 2024-08-18T22:41:42.250 INFO:tasks.workunit.client.1.smithi195.stdout:7/291: write f2 [31927,69729] 0 2024-08-18T22:41:42.252 INFO:tasks.workunit.client.0.smithi121.stdout:0/607: dwrite d1/d4/fb8 [0,4194304] 0 2024-08-18T22:41:42.252 INFO:tasks.workunit.client.0.smithi121.stdout:5/608: creat d3/d5/d13/d19/d24/d32/d38/d63/dae/fc0 x:0 0 0 2024-08-18T22:41:42.254 INFO:tasks.workunit.client.1.smithi195.stdout:0/354: creat d0/f6b x:0 0 0 2024-08-18T22:41:42.254 INFO:tasks.workunit.client.0.smithi121.stdout:8/830: dwrite d6/dd/d3b/f64 [0,4194304] 0 2024-08-18T22:41:42.255 INFO:tasks.workunit.client.0.smithi121.stdout:2/471: truncate d2/d8/d1f/f32 206010 0 2024-08-18T22:41:42.255 INFO:tasks.workunit.client.1.smithi195.stdout:7/292: dread - dc/f32 zero size 2024-08-18T22:41:42.255 INFO:tasks.workunit.client.1.smithi195.stdout:9/408: dread d1c/d32/d37/d4b/f65 [0,4194304] 0 2024-08-18T22:41:42.259 INFO:tasks.workunit.client.1.smithi195.stdout:7/293: symlink dc/d14/l77 0 2024-08-18T22:41:42.260 INFO:tasks.workunit.client.1.smithi195.stdout:9/409: symlink d1c/d32/d71/d75/l85 0 2024-08-18T22:41:42.261 INFO:tasks.workunit.client.0.smithi121.stdout:4/708: dwrite d2/dc/d16/d22/d2c/d44/d8c/feb [0,4194304] 0 2024-08-18T22:41:42.261 INFO:tasks.workunit.client.1.smithi195.stdout:0/355: creat d0/f6c x:0 0 0 2024-08-18T22:41:42.264 INFO:tasks.workunit.client.0.smithi121.stdout:0/608: mknod d1/d4/db/d18/d40/d83/cd4 0 2024-08-18T22:41:42.265 INFO:tasks.workunit.client.0.smithi121.stdout:3/714: dwrite d1e/d1f/f23 [4194304,4194304] 0 2024-08-18T22:41:42.266 INFO:tasks.workunit.client.1.smithi195.stdout:9/410: truncate d1c/d32/d37/d4b/f7a 697821 0 2024-08-18T22:41:42.270 INFO:tasks.workunit.client.0.smithi121.stdout:0/609: readlink d1/d4/da/l16 0 2024-08-18T22:41:42.270 INFO:tasks.workunit.client.0.smithi121.stdout:8/831: mknod d6/dd/d25/dc8/dce/c11a 0 2024-08-18T22:41:42.273 INFO:tasks.workunit.client.1.smithi195.stdout:0/356: mkdir d0/dc/d11/d30/d44/d41/d6d 0 2024-08-18T22:41:42.274 INFO:tasks.workunit.client.0.smithi121.stdout:0/610: write d1/d8a/fa9 [1400774,35710] 0 2024-08-18T22:41:42.275 INFO:tasks.workunit.client.0.smithi121.stdout:9/753: sync 2024-08-18T22:41:42.275 INFO:tasks.workunit.client.1.smithi195.stdout:9/411: dread d1c/f31 [0,4194304] 0 2024-08-18T22:41:42.276 INFO:tasks.workunit.client.0.smithi121.stdout:7/750: mkdir de/d13/d18/d23/d24/d85/dce/d2f/d4b/d6d/dca/df4 0 2024-08-18T22:41:42.280 INFO:tasks.workunit.client.1.smithi195.stdout:0/357: dwrite d0/f3 [4194304,4194304] 0 2024-08-18T22:41:42.281 INFO:tasks.workunit.client.1.smithi195.stdout:0/358: fsync d0/dc/d11/f15 0 2024-08-18T22:41:42.282 INFO:tasks.workunit.client.0.smithi121.stdout:5/609: dwrite d3/d5/d13/d19/d24/d32/d38/f93 [0,4194304] 0 2024-08-18T22:41:42.283 INFO:tasks.workunit.client.0.smithi121.stdout:0/611: write d1/d4/db/d24/d30/d52/fb5 [793267,79678] 0 2024-08-18T22:41:42.285 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:41:42 smithi121 ceph-mon[16788]: mgrmap e23: smithi195.acttsj(active, since 3s) 2024-08-18T22:41:42.285 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:41:42 smithi121 ceph-mon[16788]: from='client.? 172.21.15.121:0/2448079062' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-08-18T22:41:42.285 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:41:42 smithi121 ceph-mon[16788]: [18/Aug/2024:22:41:41] ENGINE Bus STARTING 2024-08-18T22:41:42.285 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:41:42 smithi121 ceph-mon[16788]: [18/Aug/2024:22:41:41] ENGINE Serving on http://172.21.15.195:8765 2024-08-18T22:41:42.285 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:41:42 smithi121 ceph-mon[16788]: [18/Aug/2024:22:41:41] ENGINE Serving on https://172.21.15.195:7150 2024-08-18T22:41:42.285 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:41:42 smithi121 ceph-mon[16788]: [18/Aug/2024:22:41:41] ENGINE Bus STARTED 2024-08-18T22:41:42.285 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:41:42 smithi121 ceph-mon[16788]: [18/Aug/2024:22:41:41] ENGINE Error in HTTPServer.serve 2024-08-18T22:41:42.285 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout: Traceback (most recent call last): 2024-08-18T22:41:42.285 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-08-18T22:41:42.285 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout: self._connections.run(self.expiration_interval) 2024-08-18T22:41:42.285 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-08-18T22:41:42.285 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout: self._run(expiration_interval) 2024-08-18T22:41:42.285 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-08-18T22:41:42.285 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-08-18T22:41:42.286 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-08-18T22:41:42.286 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-08-18T22:41:42.286 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-08-18T22:41:42.286 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout: s = self.context.wrap_socket( 2024-08-18T22:41:42.286 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-08-18T22:41:42.286 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout: return self.sslsocket_class._create( 2024-08-18T22:41:42.286 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-08-18T22:41:42.286 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout: self.do_handshake() 2024-08-18T22:41:42.286 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-08-18T22:41:42.286 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout: self._sslobj.do_handshake() 2024-08-18T22:41:42.286 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-08-18T22:41:42.286 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:41:42 smithi121 ceph-mon[16788]: from='client.14668 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-18T22:41:42.286 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:41:42 smithi121 ceph-mon[16788]: pgmap v5: 65 pgs: 65 active+clean; 1.8 GiB data, 6.9 GiB used, 530 GiB / 536 GiB avail 2024-08-18T22:41:42.287 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:42.285+0000 7fabdffff640 1 -- 172.21.15.121:0/2547825099 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fabe0100c00 con 0x7fabe00fb030 2024-08-18T22:41:42.288 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:42.286+0000 7fabc77fe640 1 -- 172.21.15.121:0/2547825099 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7fabd0019090 con 0x7fabe00fb030 2024-08-18T22:41:42.288 INFO:tasks.workunit.client.0.smithi121.stdout:0/612: write d1/d47/fbc [210263,103782] 0 2024-08-18T22:41:42.288 INFO:teuthology.orchestra.run.smithi121.stdout:HEALTH_OK 2024-08-18T22:41:42.288 INFO:tasks.workunit.client.0.smithi121.stdout:4/709: rename d2/dc/d8d/dc4/cf4 to d2/dc/d16/d22/d2c/d7a/c101 0 2024-08-18T22:41:42.289 INFO:tasks.workunit.client.0.smithi121.stdout:0/613: readlink d1/d4/db/d18/l84 0 2024-08-18T22:41:42.292 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:42.290+0000 7fabc57fa640 1 -- 172.21.15.121:0/2547825099 >> [v2:172.21.15.195:6828/1174410756,v1:172.21.15.195:6829/1174410756] conn(0x7fabc8038e50 msgr2=0x7fabc803b300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:41:42.292 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:42.290+0000 7fabc57fa640 1 --2- 172.21.15.121:0/2547825099 >> [v2:172.21.15.195:6828/1174410756,v1:172.21.15.195:6829/1174410756] conn(0x7fabc8038e50 0x7fabc803b300 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fabd402a530 tx=0x7fabd4009da0 comp rx=0 tx=0).stop 2024-08-18T22:41:42.292 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:42.290+0000 7fabc57fa640 1 -- 172.21.15.121:0/2547825099 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fabe00fb030 msgr2=0x7fabe010ed90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:41:42.293 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:42.290+0000 7fabc57fa640 1 --2- 172.21.15.121:0/2547825099 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fabe00fb030 0x7fabe010ed90 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fabd000eb70 tx=0x7fabd000b040 comp rx=0 tx=0).stop 2024-08-18T22:41:42.293 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:42.291+0000 7fabc57fa640 1 -- 172.21.15.121:0/2547825099 shutdown_connections 2024-08-18T22:41:42.293 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:42.291+0000 7fabc57fa640 1 --2- 172.21.15.121:0/2547825099 >> [v2:172.21.15.195:6828/1174410756,v1:172.21.15.195:6829/1174410756] conn(0x7fabc8038e50 0x7fabc803b300 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:41:42.293 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:42.291+0000 7fabc57fa640 1 --2- 172.21.15.121:0/2547825099 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fabe00fc300 0x7fabe010f2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:41:42.293 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:42.291+0000 7fabc57fa640 1 --2- 172.21.15.121:0/2547825099 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fabe00fb030 0x7fabe010ed90 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:41:42.293 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:42.291+0000 7fabc57fa640 1 -- 172.21.15.121:0/2547825099 >> 172.21.15.121:0/2547825099 conn(0x7fabe00f6810 msgr2=0x7fabe00f7e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:41:42.293 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:42.291+0000 7fabc57fa640 1 -- 172.21.15.121:0/2547825099 shutdown_connections 2024-08-18T22:41:42.293 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:41:42.291+0000 7fabc57fa640 1 -- 172.21.15.121:0/2547825099 wait complete. 2024-08-18T22:41:42.293 INFO:tasks.workunit.client.0.smithi121.stdout:8/832: symlink d6/d1e/d2d/d78/d45/l11b 0 2024-08-18T22:41:42.294 INFO:tasks.workunit.client.1.smithi195.stdout:9/412: dwrite d1c/d74/f80 [0,4194304] 0 2024-08-18T22:41:42.294 INFO:tasks.workunit.client.0.smithi121.stdout:9/754: creat d0/d5/dd/d3b/ffb x:0 0 0 2024-08-18T22:41:42.295 INFO:tasks.workunit.client.0.smithi121.stdout:2/472: write d2/d8/d19/d55/f58 [115891,89873] 0 2024-08-18T22:41:42.296 INFO:tasks.workunit.client.0.smithi121.stdout:5/610: fdatasync d3/f2c 0 2024-08-18T22:41:42.299 INFO:tasks.workunit.client.0.smithi121.stdout:7/751: creat de/d13/d18/d23/d24/d85/dce/d2f/d4b/d6d/dca/df4/ff5 x:0 0 0 2024-08-18T22:41:42.299 INFO:tasks.workunit.client.0.smithi121.stdout:4/710: rmdir d2/dc/d16/d22/d2c/d7a/dbf 39 2024-08-18T22:41:42.300 INFO:tasks.workunit.client.1.smithi195.stdout:7/294: truncate dc/d14/d15/d17/d18/f57 1963921 0 2024-08-18T22:41:42.303 INFO:tasks.workunit.client.0.smithi121.stdout:5/611: write d3/d5/d27/f6d [424281,126859] 0 2024-08-18T22:41:42.303 INFO:tasks.workunit.client.1.smithi195.stdout:9/413: getdents d1c/d74 0 2024-08-18T22:41:42.305 INFO:tasks.workunit.client.1.smithi195.stdout:0/359: truncate d0/dc/d11/d30/d44/d41/d4c/f61 3150791 0 2024-08-18T22:41:42.305 INFO:tasks.workunit.client.1.smithi195.stdout:7/295: write dc/d1d/d29/f41 [448085,64344] 0 2024-08-18T22:41:42.307 INFO:tasks.workunit.client.1.smithi195.stdout:7/296: dread - dc/d2a/f65 zero size 2024-08-18T22:41:42.308 INFO:tasks.workunit.client.0.smithi121.stdout:8/833: rename d6/dd/d3b/da3/dca/d18/f32 to d6/d20/d118/f11c 0 2024-08-18T22:41:42.308 INFO:tasks.workunit.client.0.smithi121.stdout:3/715: dwrite d1e/d1f/d25/d58/df7/f10b [0,4194304] 0 2024-08-18T22:41:42.309 INFO:tasks.workunit.client.1.smithi195.stdout:9/414: rename fb to d1c/d70/f86 0 2024-08-18T22:41:42.309 INFO:tasks.workunit.client.0.smithi121.stdout:2/473: creat d2/d8/d19/f9a x:0 0 0 2024-08-18T22:41:42.309 INFO:tasks.workunit.client.1.smithi195.stdout:7/297: rmdir dc/d14/d2b 39 2024-08-18T22:41:42.310 INFO:tasks.workunit.client.0.smithi121.stdout:9/755: dread d0/d5/dd/d1a/dc8/dfa/dbf/f6f [0,4194304] 0 2024-08-18T22:41:42.311 INFO:tasks.workunit.client.1.smithi195.stdout:3/381: sync 2024-08-18T22:41:42.311 INFO:tasks.workunit.client.1.smithi195.stdout:1/441: sync 2024-08-18T22:41:42.311 INFO:tasks.workunit.client.1.smithi195.stdout:2/224: sync 2024-08-18T22:41:42.311 INFO:tasks.workunit.client.1.smithi195.stdout:5/346: sync 2024-08-18T22:41:42.312 INFO:tasks.workunit.client.1.smithi195.stdout:0/360: getdents d0/dc 0 2024-08-18T22:41:42.313 INFO:tasks.workunit.client.0.smithi121.stdout:2/474: write d2/d8/d19/d55/f58 [2002253,101988] 0 2024-08-18T22:41:42.313 INFO:tasks.workunit.client.1.smithi195.stdout:7/298: rmdir dc/d14/d2b 39 2024-08-18T22:41:42.316 INFO:tasks.workunit.client.1.smithi195.stdout:5/347: write d0/d3/df/f16 [1672711,18297] 0 2024-08-18T22:41:42.316 INFO:tasks.workunit.client.0.smithi121.stdout:4/711: creat d2/dc/d16/d22/d2c/d44/d66/f102 x:0 0 0 2024-08-18T22:41:42.317 INFO:tasks.workunit.client.0.smithi121.stdout:7/752: mknod de/d13/d18/d23/d24/d85/dce/d34/d38/d73/da2/cf6 0 2024-08-18T22:41:42.318 INFO:tasks.workunit.client.0.smithi121.stdout:0/614: rename d1/d4/db/d24/d30/d52 to d1/d4/db/d18/d40/d83/daf/dd5 0 2024-08-18T22:41:42.321 INFO:tasks.workunit.client.0.smithi121.stdout:7/753: read - de/d65/fb1 zero size 2024-08-18T22:41:42.322 INFO:tasks.workunit.client.0.smithi121.stdout:2/475: rename d2/d3/d51/l6c to d2/d3/d51/l9b 0 2024-08-18T22:41:42.322 INFO:tasks.workunit.client.0.smithi121.stdout:0/615: dread - d1/d4/f72 zero size 2024-08-18T22:41:42.327 INFO:tasks.workunit.client.0.smithi121.stdout:9/756: rename d0/d5/dd/d1a/dc8/dfa/dbf/d7c/df7 to d0/d5/dd/d1a/dc8/dfa/dbf/dfc 0 2024-08-18T22:41:42.329 INFO:tasks.workunit.client.0.smithi121.stdout:2/476: stat d2/c5e 0 2024-08-18T22:41:42.331 INFO:tasks.workunit.client.0.smithi121.stdout:4/712: dwrite d2/dc/d16/d47/fd6 [0,4194304] 0 2024-08-18T22:41:42.331 INFO:tasks.workunit.client.0.smithi121.stdout:9/757: fsync d0/d5/dd/d1a/dc8/dfa/dbf/d60/fd8 0 2024-08-18T22:41:42.334 INFO:tasks.workunit.client.0.smithi121.stdout:3/716: link d1e/f31 d1e/d1f/d25/f10c 0 2024-08-18T22:41:42.334 INFO:tasks.workunit.client.0.smithi121.stdout:3/717: readlink d1e/d1f/d25/d6b/d83/lef 0 2024-08-18T22:41:42.341 INFO:tasks.workunit.client.0.smithi121.stdout:5/612: truncate d3/d5/f11 375529 0 2024-08-18T22:41:42.342 INFO:tasks.workunit.client.0.smithi121.stdout:7/754: creat de/d13/d18/d23/ff7 x:0 0 0 2024-08-18T22:41:42.344 INFO:tasks.workunit.client.0.smithi121.stdout:9/758: mkdir d0/d38/d9e/d18/dfd 0 2024-08-18T22:41:42.344 INFO:tasks.workunit.client.0.smithi121.stdout:8/834: dread d6/dd/d25/d56/fdc [0,4194304] 0 2024-08-18T22:41:42.345 INFO:tasks.workunit.client.0.smithi121.stdout:4/713: dwrite d2/dc/d16/d59/d83/fdf [0,4194304] 0 2024-08-18T22:41:42.350 INFO:tasks.workunit.client.0.smithi121.stdout:0/616: dread d1/d4/db/d18/d40/f96 [0,4194304] 0 2024-08-18T22:41:42.352 INFO:tasks.workunit.client.0.smithi121.stdout:9/759: write d0/d38/d9e/df/d73/fd1 [97699,2855] 0 2024-08-18T22:41:42.353 INFO:tasks.workunit.client.0.smithi121.stdout:7/755: readlink de/d13/d18/d23/d24/d85/dce/d2f/d4b/daf/lb9 0 2024-08-18T22:41:42.353 INFO:tasks.workunit.client.1.smithi195.stdout:2/225: mkdir d1/d24/d47 0 2024-08-18T22:41:42.353 INFO:tasks.workunit.client.1.smithi195.stdout:0/361: fdatasync d0/dc/d11/f20 0 2024-08-18T22:41:42.356 INFO:tasks.workunit.client.0.smithi121.stdout:8/835: unlink d6/d20/f10d 0 2024-08-18T22:41:42.357 INFO:tasks.workunit.client.0.smithi121.stdout:4/714: rename d2/dc/d16/d22/d29/f41 to d2/dc/d16/d59/d83/dd7/f103 0 2024-08-18T22:41:42.357 INFO:tasks.workunit.client.0.smithi121.stdout:5/613: dread d3/d5/d3c/d3f/f6e [0,4194304] 0 2024-08-18T22:41:42.358 INFO:tasks.workunit.client.0.smithi121.stdout:2/477: write d2/d8/d1f/f35 [3663360,19903] 0 2024-08-18T22:41:42.363 INFO:tasks.workunit.client.0.smithi121.stdout:0/617: symlink d1/d4/d53/ld6 0 2024-08-18T22:41:42.365 INFO:tasks.workunit.client.0.smithi121.stdout:8/836: dread - d6/dd/dcc/de7/feb zero size 2024-08-18T22:41:42.366 INFO:tasks.workunit.client.0.smithi121.stdout:4/715: getdents d2/d7c 0 2024-08-18T22:41:42.366 INFO:tasks.workunit.client.0.smithi121.stdout:2/478: write d2/d8/d1f/f35 [4640494,34111] 0 2024-08-18T22:41:42.368 INFO:tasks.workunit.client.0.smithi121.stdout:3/718: dwrite f16 [0,4194304] 0 2024-08-18T22:41:42.368 INFO:tasks.workunit.client.0.smithi121.stdout:0/618: dread - d1/d4/db/d24/d30/f86 zero size 2024-08-18T22:41:42.370 INFO:tasks.workunit.client.0.smithi121.stdout:9/760: rename d0/d38/d9e/df/d61/db2/fa3 to d0/d38/d9e/df/de6/ffe 0 2024-08-18T22:41:42.372 INFO:tasks.workunit.client.0.smithi121.stdout:8/837: chown d6/dd/d25/dc8/dce/fff 923472387 1 2024-08-18T22:41:42.374 INFO:tasks.workunit.client.0.smithi121.stdout:4/716: write d2/dc/d16/d22/f25 [2832364,106755] 0 2024-08-18T22:41:42.374 INFO:tasks.workunit.client.0.smithi121.stdout:9/761: dread - d0/d38/d9e/df/d61/db2/dce/fdc zero size 2024-08-18T22:41:42.378 INFO:tasks.workunit.client.0.smithi121.stdout:1/745: sync 2024-08-18T22:41:42.382 INFO:tasks.workunit.client.0.smithi121.stdout:7/756: link de/d13/fd5 de/d13/d18/d23/d24/d85/dce/d2f/d4b/d6d/dca/ff8 0 2024-08-18T22:41:42.383 INFO:tasks.workunit.client.0.smithi121.stdout:7/757: write de/d13/d18/f3c [4009335,94148] 0 2024-08-18T22:41:42.384 INFO:tasks.workunit.client.0.smithi121.stdout:4/717: mkdir d2/dc/d16/d59/d83/dd7/d104 0 2024-08-18T22:41:42.388 INFO:tasks.workunit.client.0.smithi121.stdout:9/762: truncate d0/d5/f98 2734846 0 2024-08-18T22:41:42.388 INFO:tasks.workunit.client.0.smithi121.stdout:7/758: truncate de/d13/d18/d23/d24/d85/dce/d2f/d4b/d6d/dca/ff8 610721 0 2024-08-18T22:41:42.390 INFO:tasks.workunit.client.0.smithi121.stdout:3/719: write d1e/d1f/d25/d2e/d36/f68 [2937325,122916] 0 2024-08-18T22:41:42.392 INFO:tasks.workunit.client.0.smithi121.stdout:0/619: symlink d1/d4/db/d24/df/ld7 0 2024-08-18T22:41:42.393 INFO:tasks.workunit.client.0.smithi121.stdout:1/746: truncate d5/d10/d14/f90 2274020 0 2024-08-18T22:41:42.393 INFO:tasks.workunit.client.0.smithi121.stdout:5/614: link d3/d5/d13/d19/f97 d3/d5/d13/d19/d24/d32/d38/d63/dae/fc1 0 2024-08-18T22:41:42.395 INFO:tasks.workunit.client.0.smithi121.stdout:2/479: rename d2/d8/d19/dc/l10 to d2/d3/l9c 0 2024-08-18T22:41:42.396 INFO:tasks.workunit.client.1.smithi195.stdout:3/382: creat d7/da/df/d38/f7b x:0 0 0 2024-08-18T22:41:42.397 INFO:tasks.workunit.client.1.smithi195.stdout:3/383: stat d7/ce 0 2024-08-18T22:41:42.399 INFO:tasks.workunit.client.0.smithi121.stdout:9/763: creat d0/d38/d9e/df/d3d/d89/d92/dc6/dd5/db3/fff x:0 0 0 2024-08-18T22:41:42.400 INFO:tasks.workunit.client.0.smithi121.stdout:7/759: dwrite de/d2d/f42 [0,4194304] 0 2024-08-18T22:41:42.401 INFO:tasks.workunit.client.0.smithi121.stdout:5/615: unlink d3/d5c/f94 0 2024-08-18T22:41:42.403 INFO:tasks.workunit.client.1.smithi195.stdout:3/384: dwrite d7/f18 [0,4194304] 0 2024-08-18T22:41:42.404 INFO:tasks.workunit.client.0.smithi121.stdout:8/838: rename d6/dd/d3b/da3/dca/d60/f66 to d6/d20/d69/d77/f11d 0 2024-08-18T22:41:42.405 INFO:tasks.workunit.client.1.smithi195.stdout:9/415: getdents d1c/d74/d7b 0 2024-08-18T22:41:42.406 INFO:tasks.workunit.client.0.smithi121.stdout:8/839: chown d6/dd/d3b/da3/lb5 454265193 1 2024-08-18T22:41:42.408 INFO:tasks.workunit.client.0.smithi121.stdout:2/480: creat d2/d3/d51/f9d x:0 0 0 2024-08-18T22:41:42.409 INFO:tasks.workunit.client.1.smithi195.stdout:9/416: dread - d1c/f35 zero size 2024-08-18T22:41:42.409 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:41:42 smithi195 ceph-mon[23370]: mgrmap e23: smithi195.acttsj(active, since 3s) 2024-08-18T22:41:42.409 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:41:42 smithi195 ceph-mon[23370]: from='client.? 172.21.15.121:0/2448079062' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-08-18T22:41:42.409 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:41:42 smithi195 ceph-mon[23370]: [18/Aug/2024:22:41:41] ENGINE Bus STARTING 2024-08-18T22:41:42.409 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:41:42 smithi195 ceph-mon[23370]: [18/Aug/2024:22:41:41] ENGINE Serving on http://172.21.15.195:8765 2024-08-18T22:41:42.409 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:41:42 smithi195 ceph-mon[23370]: [18/Aug/2024:22:41:41] ENGINE Serving on https://172.21.15.195:7150 2024-08-18T22:41:42.409 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:41:42 smithi195 ceph-mon[23370]: [18/Aug/2024:22:41:41] ENGINE Bus STARTED 2024-08-18T22:41:42.409 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:41:42 smithi195 ceph-mon[23370]: [18/Aug/2024:22:41:41] ENGINE Error in HTTPServer.serve 2024-08-18T22:41:42.409 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: Traceback (most recent call last): 2024-08-18T22:41:42.410 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-08-18T22:41:42.410 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: self._connections.run(self.expiration_interval) 2024-08-18T22:41:42.410 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-08-18T22:41:42.410 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: self._run(expiration_interval) 2024-08-18T22:41:42.410 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-08-18T22:41:42.410 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-08-18T22:41:42.410 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-08-18T22:41:42.410 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-08-18T22:41:42.410 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-08-18T22:41:42.410 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: s = self.context.wrap_socket( 2024-08-18T22:41:42.410 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-08-18T22:41:42.410 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: return self.sslsocket_class._create( 2024-08-18T22:41:42.410 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-08-18T22:41:42.410 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: self.do_handshake() 2024-08-18T22:41:42.411 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-08-18T22:41:42.411 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: self._sslobj.do_handshake() 2024-08-18T22:41:42.411 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-08-18T22:41:42.411 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:41:42 smithi195 ceph-mon[23370]: from='client.14668 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-18T22:41:42.411 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:41:42 smithi195 ceph-mon[23370]: pgmap v5: 65 pgs: 65 active+clean; 1.8 GiB data, 6.9 GiB used, 530 GiB / 536 GiB avail 2024-08-18T22:41:42.414 INFO:tasks.workunit.client.1.smithi195.stdout:7/299: rename dc/d14/c26 to dc/d14/d2b/c78 0 2024-08-18T22:41:42.414 INFO:tasks.workunit.client.1.smithi195.stdout:5/348: mkdir d0/d3/d66 0 2024-08-18T22:41:42.415 INFO:tasks.workunit.client.1.smithi195.stdout:3/385: mknod d7/da/df/d1c/c7c 0 2024-08-18T22:41:42.416 INFO:tasks.workunit.client.0.smithi121.stdout:2/481: dwrite d2/d8/d19/f52 [0,4194304] 0 2024-08-18T22:41:42.417 INFO:tasks.workunit.client.1.smithi195.stdout:3/386: stat d7/da/df/d1c/d6a/c5d 0 2024-08-18T22:41:42.417 INFO:tasks.workunit.client.1.smithi195.stdout:3/387: stat d7/d54/l67 0 2024-08-18T22:41:42.418 INFO:tasks.workunit.client.0.smithi121.stdout:9/764: rename d0/d5/dd/d1a/dc8/dfa/dbf/d60/fd8 to d0/d38/d52/d5f/de1/f100 0 2024-08-18T22:41:42.421 INFO:tasks.workunit.client.1.smithi195.stdout:5/349: creat d0/d2/d29/f67 x:0 0 0 2024-08-18T22:41:42.421 INFO:tasks.workunit.client.0.smithi121.stdout:4/718: truncate d2/dc/d16/d22/f25 4074325 0 2024-08-18T22:41:42.422 INFO:tasks.workunit.client.1.smithi195.stdout:5/350: read d0/d2/d29/f57 [3541538,20246] 0 2024-08-18T22:41:42.422 INFO:tasks.workunit.client.0.smithi121.stdout:5/616: truncate d3/f2c 3164669 0 2024-08-18T22:41:42.422 INFO:tasks.workunit.client.0.smithi121.stdout:1/747: dread d5/d10/d14/d2a/d3a/d87/d6c/d6f/d82/d15/d38/fb6 [0,4194304] 0 2024-08-18T22:41:42.423 INFO:tasks.workunit.client.1.smithi195.stdout:7/300: creat dc/d14/d15/d4d/f79 x:0 0 0 2024-08-18T22:41:42.424 INFO:tasks.workunit.client.1.smithi195.stdout:1/442: truncate da/f12 1650751 0 2024-08-18T22:41:42.424 INFO:tasks.workunit.client.0.smithi121.stdout:8/840: mkdir d6/dd/d3b/da3/dca/d11e 0 2024-08-18T22:41:42.426 INFO:tasks.workunit.client.0.smithi121.stdout:7/760: rename de/d13/d18/d23/d24/d85/dce/d20/lc5 to de/d13/d18/d23/d24/d85/dce/d34/d38/d73/lf9 0 2024-08-18T22:41:42.427 INFO:tasks.workunit.client.0.smithi121.stdout:2/482: write d2/d8/d19/f9a [300605,25192] 0 2024-08-18T22:41:42.428 INFO:tasks.workunit.client.1.smithi195.stdout:2/226: getdents d1/d24/d26 0 2024-08-18T22:41:42.428 INFO:tasks.workunit.client.0.smithi121.stdout:8/841: write d6/d1e/d2d/d78/d85/fea [1011740,96151] 0 2024-08-18T22:41:42.430 INFO:tasks.workunit.client.1.smithi195.stdout:0/362: dwrite d0/dc/dd/f58 [0,4194304] 0 2024-08-18T22:41:42.433 INFO:tasks.workunit.client.1.smithi195.stdout:9/417: creat d1c/d32/f87 x:0 0 0 2024-08-18T22:41:42.433 INFO:tasks.workunit.client.0.smithi121.stdout:9/765: write d0/d5/dd/d3f/f75 [242583,14911] 0 2024-08-18T22:41:42.434 INFO:tasks.workunit.client.1.smithi195.stdout:7/301: creat dc/d1d/f7a x:0 0 0 2024-08-18T22:41:42.435 INFO:tasks.workunit.client.0.smithi121.stdout:5/617: rename c0 to d3/d5/d3c/cc2 0 2024-08-18T22:41:42.436 INFO:tasks.workunit.client.1.smithi195.stdout:1/443: mknod da/d18/d43/c98 0 2024-08-18T22:41:42.436 INFO:tasks.workunit.client.1.smithi195.stdout:3/388: dread d7/da/f3d [0,4194304] 0 2024-08-18T22:41:42.437 INFO:tasks.workunit.client.0.smithi121.stdout:1/748: dwrite d5/d10/d67/f85 [0,4194304] 0 2024-08-18T22:41:42.441 INFO:tasks.workunit.client.1.smithi195.stdout:5/351: creat d0/d37/f68 x:0 0 0 2024-08-18T22:41:42.443 INFO:tasks.workunit.client.1.smithi195.stdout:9/418: rmdir d1c/d70 39 2024-08-18T22:41:42.444 INFO:tasks.workunit.client.1.smithi195.stdout:9/419: fsync f0 0 2024-08-18T22:41:42.444 INFO:tasks.workunit.client.1.smithi195.stdout:7/302: creat dc/d14/d15/d17/d18/f7b x:0 0 0 2024-08-18T22:41:42.444 INFO:tasks.workunit.client.1.smithi195.stdout:3/389: symlink d7/d54/l7d 0 2024-08-18T22:41:42.446 INFO:tasks.workunit.client.1.smithi195.stdout:9/420: write d1c/f27 [4219086,15595] 0 2024-08-18T22:41:42.447 INFO:tasks.workunit.client.1.smithi195.stdout:9/421: stat d1c/l30 0 2024-08-18T22:41:42.448 INFO:tasks.workunit.client.0.smithi121.stdout:2/483: dwrite d2/f2c [0,4194304] 0 2024-08-18T22:41:42.448 INFO:tasks.workunit.client.0.smithi121.stdout:5/618: fdatasync d3/d5/d13/d19/d24/f8e 0 2024-08-18T22:41:42.449 INFO:tasks.workunit.client.1.smithi195.stdout:1/444: mkdir da/d18/d28/d8e/d99 0 2024-08-18T22:41:42.449 INFO:tasks.workunit.client.0.smithi121.stdout:4/719: rename d2/dc/d16/d22/f55 to d2/dc/d16/d22/d2c/d44/da7/f105 0 2024-08-18T22:41:42.449 INFO:tasks.workunit.client.1.smithi195.stdout:5/352: write d0/d2/d29/f57 [535888,53001] 0 2024-08-18T22:41:42.453 INFO:tasks.workunit.client.1.smithi195.stdout:3/390: read d7/f9 [2244534,91038] 0 2024-08-18T22:41:42.454 INFO:tasks.workunit.client.1.smithi195.stdout:1/445: dread - da/d18/d43/f89 zero size 2024-08-18T22:41:42.457 INFO:tasks.workunit.client.0.smithi121.stdout:5/619: dread d3/d5/d13/d19/d24/d32/d38/f85 [0,4194304] 0 2024-08-18T22:41:42.458 INFO:tasks.workunit.client.1.smithi195.stdout:2/227: creat d1/d8/d3d/f48 x:0 0 0 2024-08-18T22:41:42.459 INFO:tasks.workunit.client.0.smithi121.stdout:2/484: mkdir d2/d8/d9e 0 2024-08-18T22:41:42.461 INFO:tasks.workunit.client.0.smithi121.stdout:5/620: chown d3/d5c/d78 49562958 1 2024-08-18T22:41:42.461 INFO:tasks.workunit.client.1.smithi195.stdout:7/303: rename dc/d14/f4a to dc/d2a/f7c 0 2024-08-18T22:41:42.462 INFO:tasks.workunit.client.0.smithi121.stdout:4/720: symlink d2/dc/d16/d59/d83/dd7/d104/l106 0 2024-08-18T22:41:42.463 INFO:tasks.workunit.client.0.smithi121.stdout:9/766: link d0/d5/dd/d1a/dc8/dfa/dbf/cb4 d0/c101 0 2024-08-18T22:41:42.465 INFO:tasks.workunit.client.0.smithi121.stdout:5/621: creat d3/d5/d3c/daf/fc3 x:0 0 0 2024-08-18T22:41:42.466 INFO:tasks.workunit.client.0.smithi121.stdout:8/842: dwrite d6/d1e/f5d [0,4194304] 0 2024-08-18T22:41:42.466 INFO:tasks.workunit.client.1.smithi195.stdout:7/304: unlink ca 0 2024-08-18T22:41:42.467 INFO:tasks.workunit.client.1.smithi195.stdout:3/391: dwrite d7/da/df/d1c/f58 [0,4194304] 0 2024-08-18T22:41:42.468 INFO:tasks.workunit.client.1.smithi195.stdout:1/446: fdatasync da/d18/f38 0 2024-08-18T22:41:42.469 INFO:tasks.workunit.client.1.smithi195.stdout:9/422: creat d1c/d32/f88 x:0 0 0 2024-08-18T22:41:42.472 INFO:tasks.workunit.client.1.smithi195.stdout:7/305: unlink dc/d14/d15/d17/l73 0 2024-08-18T22:41:42.472 INFO:tasks.workunit.client.0.smithi121.stdout:4/721: mknod d2/dc/d1c/c107 0 2024-08-18T22:41:42.472 INFO:tasks.workunit.client.0.smithi121.stdout:5/622: chown d3/d5/d27/d35/f36 221773139 1 2024-08-18T22:41:42.474 INFO:tasks.workunit.client.1.smithi195.stdout:7/306: write dc/d14/d15/f71 [137772,10491] 0 2024-08-18T22:41:42.474 INFO:tasks.workunit.client.0.smithi121.stdout:9/767: unlink d0/d38/d9e/fc 0 2024-08-18T22:41:42.474 INFO:tasks.workunit.client.1.smithi195.stdout:3/392: mknod d7/d1f/c7e 0 2024-08-18T22:41:42.475 INFO:tasks.workunit.client.1.smithi195.stdout:9/423: rmdir d1c/d74/d7b 39 2024-08-18T22:41:42.475 INFO:tasks.workunit.client.1.smithi195.stdout:7/307: read - dc/d1d/d29/d5d/f6e zero size 2024-08-18T22:41:42.477 INFO:tasks.workunit.client.1.smithi195.stdout:5/353: rename d0/l43 to d0/d2/l69 0 2024-08-18T22:41:42.477 INFO:tasks.workunit.client.1.smithi195.stdout:2/228: link d1/c13 d1/d8/d27/c49 0 2024-08-18T22:41:42.478 INFO:tasks.workunit.client.0.smithi121.stdout:4/722: symlink d2/dc/d16/d22/d29/l108 0 2024-08-18T22:41:42.478 INFO:tasks.workunit.client.1.smithi195.stdout:5/354: chown d0/d3/d8/f13 1 1 2024-08-18T22:41:42.478 INFO:tasks.workunit.client.0.smithi121.stdout:5/623: mkdir d3/d5/d13/d23/da4/da6/dc4 0 2024-08-18T22:41:42.479 INFO:tasks.workunit.client.0.smithi121.stdout:9/768: write d0/d5/dd/d1a/dc8/dfa/dbf/f77 [1287968,8787] 0 2024-08-18T22:41:42.480 INFO:tasks.workunit.client.1.smithi195.stdout:3/393: creat d7/d1f/d49/f7f x:0 0 0 2024-08-18T22:41:42.481 INFO:tasks.workunit.client.0.smithi121.stdout:7/761: dread de/d2d/d50/f71 [0,4194304] 0 2024-08-18T22:41:42.481 INFO:tasks.workunit.client.0.smithi121.stdout:5/624: stat d3/d5/d27/d35/d53 0 2024-08-18T22:41:42.482 INFO:tasks.workunit.client.0.smithi121.stdout:2/485: rename d2/d3/d84/l89 to d2/l9f 0 2024-08-18T22:41:42.482 INFO:tasks.workunit.client.1.smithi195.stdout:7/308: creat dc/d2a/f7d x:0 0 0 2024-08-18T22:41:42.482 INFO:tasks.workunit.client.1.smithi195.stdout:2/229: rmdir d1/d24/d26/d42/d44 39 2024-08-18T22:41:42.483 INFO:tasks.workunit.client.0.smithi121.stdout:8/843: creat d6/d1e/d2d/d78/d45/d86/ded/f11f x:0 0 0 2024-08-18T22:41:42.484 INFO:tasks.workunit.client.1.smithi195.stdout:2/230: dread - d1/f3c zero size 2024-08-18T22:41:42.486 INFO:tasks.workunit.client.0.smithi121.stdout:9/769: write d0/d38/d9e/d45/ff5 [2879991,110672] 0 2024-08-18T22:41:42.487 INFO:tasks.workunit.client.0.smithi121.stdout:8/844: write d6/d1e/d2d/de5/fd2 [124015,42826] 0 2024-08-18T22:41:42.487 INFO:tasks.workunit.client.1.smithi195.stdout:1/447: dread da/d18/d28/f2e [0,4194304] 0 2024-08-18T22:41:42.487 INFO:tasks.workunit.client.1.smithi195.stdout:9/424: mknod d1c/d74/d7b/d82/c89 0 2024-08-18T22:41:42.489 INFO:tasks.workunit.client.1.smithi195.stdout:5/355: dwrite d0/d3/d8/f56 [0,4194304] 0 2024-08-18T22:41:42.491 INFO:tasks.workunit.client.0.smithi121.stdout:7/762: readlink de/d13/d18/d23/d24/d85/dce/d34/d38/d73/dbb/lc9 0 2024-08-18T22:41:42.492 INFO:tasks.workunit.client.0.smithi121.stdout:5/625: dread - d3/d5/d13/d23/f52 zero size 2024-08-18T22:41:42.492 INFO:tasks.workunit.client.0.smithi121.stdout:2/486: creat d2/d8/fa0 x:0 0 0 2024-08-18T22:41:42.494 INFO:tasks.workunit.client.1.smithi195.stdout:2/231: unlink d1/f5 0 2024-08-18T22:41:42.496 INFO:tasks.workunit.client.1.smithi195.stdout:0/363: dread d0/dc/d11/f20 [0,4194304] 0 2024-08-18T22:41:42.498 INFO:tasks.workunit.client.1.smithi195.stdout:7/309: unlink dc/d22/f39 0 2024-08-18T22:41:42.498 INFO:tasks.workunit.client.1.smithi195.stdout:0/364: readlink d0/dc/d11/d30/d44/d41/d4c/d4f/l6a 0 2024-08-18T22:41:42.498 INFO:tasks.workunit.client.1.smithi195.stdout:7/310: readlink dc/d14/l77 0 2024-08-18T22:41:42.502 INFO:tasks.workunit.client.0.smithi121.stdout:4/723: dwrite d2/dc/d16/d22/d2c/d44/d8c/feb [4194304,4194304] 0 2024-08-18T22:41:42.502 INFO:tasks.workunit.client.0.smithi121.stdout:5/626: write d3/f46 [12559,5664] 0 2024-08-18T22:41:42.503 INFO:tasks.workunit.client.1.smithi195.stdout:9/425: write d1c/d32/d37/f67 [2215631,121338] 0 2024-08-18T22:41:42.507 INFO:tasks.workunit.client.1.smithi195.stdout:0/365: rename d0/f1c to d0/dc/dd/f6e 0 2024-08-18T22:41:42.507 INFO:tasks.workunit.client.1.smithi195.stdout:5/356: mkdir d0/d3/df/d5a/d62/d6a 0 2024-08-18T22:41:42.509 INFO:tasks.workunit.client.1.smithi195.stdout:2/232: symlink d1/d24/d26/d42/d44/l4a 0 2024-08-18T22:41:42.509 INFO:tasks.workunit.client.1.smithi195.stdout:3/394: dwrite d7/f2b [0,4194304] 0 2024-08-18T22:41:42.510 INFO:tasks.workunit.client.0.smithi121.stdout:4/724: truncate d2/f3f 1382694 0 2024-08-18T22:41:42.512 INFO:tasks.workunit.client.1.smithi195.stdout:2/233: truncate d1/d22/f30 4473406 0 2024-08-18T22:41:42.512 INFO:tasks.workunit.client.1.smithi195.stdout:3/395: chown d7/da/df/d38/c39 437922812 1 2024-08-18T22:41:42.513 INFO:tasks.workunit.client.0.smithi121.stdout:7/763: creat de/d13/d18/d23/d24/d85/dce/d2f/d4b/d6d/ffa x:0 0 0 2024-08-18T22:41:42.514 INFO:tasks.workunit.client.0.smithi121.stdout:9/770: dwrite d0/d5/dd/d1a/dc8/dfa/d7f/fe7 [0,4194304] 0 2024-08-18T22:41:42.514 INFO:tasks.workunit.client.0.smithi121.stdout:1/749: dread d5/d10/d14/d2a/d3a/d87/d6c/d6f/d82/f51 [0,4194304] 0 2024-08-18T22:41:42.516 INFO:tasks.workunit.client.1.smithi195.stdout:7/311: rename dc/d14/d15/d4d/f6a to dc/d22/f7e 0 2024-08-18T22:41:42.516 INFO:tasks.workunit.client.1.smithi195.stdout:9/426: mknod d1c/d32/d37/c8a 0 2024-08-18T22:41:42.517 INFO:tasks.workunit.client.1.smithi195.stdout:0/366: mkdir d0/dc/d11/d6f 0 2024-08-18T22:41:42.520 INFO:tasks.workunit.client.1.smithi195.stdout:2/234: symlink d1/d24/l4b 0 2024-08-18T22:41:42.521 INFO:tasks.workunit.client.1.smithi195.stdout:5/357: creat d0/d3/d5f/f6b x:0 0 0 2024-08-18T22:41:42.521 INFO:tasks.workunit.client.1.smithi195.stdout:1/448: dwrite da/fe [0,4194304] 0 2024-08-18T22:41:42.522 INFO:tasks.workunit.client.0.smithi121.stdout:7/764: truncate de/d13/d18/d23/d24/d29/d43/d7f/f92 755782 0 2024-08-18T22:41:42.522 INFO:tasks.workunit.client.1.smithi195.stdout:7/312: symlink dc/d2a/d4c/l7f 0 2024-08-18T22:41:42.528 INFO:tasks.workunit.client.0.smithi121.stdout:2/487: dwrite d2/d3/d51/f81 [4194304,4194304] 0 2024-08-18T22:41:42.529 INFO:tasks.workunit.client.1.smithi195.stdout:3/396: dwrite d7/da/df/d1c/f23 [4194304,4194304] 0 2024-08-18T22:41:42.530 INFO:tasks.workunit.client.1.smithi195.stdout:5/358: rename d0/d2/f50 to d0/d46/f6c 0 2024-08-18T22:41:42.531 INFO:tasks.workunit.client.1.smithi195.stdout:0/367: dread d0/dc/f21 [0,4194304] 0 2024-08-18T22:41:42.531 INFO:tasks.workunit.client.1.smithi195.stdout:1/449: unlink da/d18/l56 0 2024-08-18T22:41:42.534 INFO:tasks.workunit.client.1.smithi195.stdout:2/235: creat d1/d24/d26/d42/f4c x:0 0 0 2024-08-18T22:41:42.536 INFO:tasks.workunit.client.1.smithi195.stdout:9/427: dwrite d1c/f1f [0,4194304] 0 2024-08-18T22:41:42.536 INFO:tasks.workunit.client.0.smithi121.stdout:8/845: dwrite d6/dd/d3b/da3/dca/d60/d5b/f92 [4194304,4194304] 0 2024-08-18T22:41:42.538 INFO:tasks.workunit.client.1.smithi195.stdout:1/450: chown da/d18/c23 12268 1 2024-08-18T22:41:42.539 INFO:tasks.workunit.client.0.smithi121.stdout:5/627: link d3/d5/d13/d19/d24/f7a d3/d5/d13/d23/da4/fc5 0 2024-08-18T22:41:42.539 INFO:tasks.workunit.client.0.smithi121.stdout:1/750: mknod d5/d10/d14/d92/c103 0 2024-08-18T22:41:42.542 INFO:tasks.workunit.client.0.smithi121.stdout:2/488: symlink d2/d8/d19/d4a/la1 0 2024-08-18T22:41:42.544 INFO:tasks.workunit.client.0.smithi121.stdout:4/725: rename d2/dc/f89 to d2/dc/d1c/dc1/f109 0 2024-08-18T22:41:42.545 INFO:tasks.workunit.client.1.smithi195.stdout:5/359: dread d0/db/f19 [0,4194304] 0 2024-08-18T22:41:42.546 INFO:tasks.workunit.client.0.smithi121.stdout:5/628: unlink d3/d5/d13/d23/f52 0 2024-08-18T22:41:42.548 INFO:tasks.workunit.client.1.smithi195.stdout:3/397: dwrite d7/da/f3d [0,4194304] 0 2024-08-18T22:41:42.548 INFO:tasks.workunit.client.1.smithi195.stdout:5/360: fdatasync d0/db/f5d 0 2024-08-18T22:41:42.552 INFO:tasks.workunit.client.1.smithi195.stdout:0/368: creat d0/dc/d11/d23/f70 x:0 0 0 2024-08-18T22:41:42.552 INFO:tasks.workunit.client.0.smithi121.stdout:8/846: dwrite d6/d1e/f4d [0,4194304] 0 2024-08-18T22:41:42.554 INFO:tasks.workunit.client.0.smithi121.stdout:1/751: dwrite d5/d10/d14/f5c [0,4194304] 0 2024-08-18T22:41:42.556 INFO:tasks.workunit.client.0.smithi121.stdout:5/629: readlink d3/d5/d13/d19/d24/l2b 0 2024-08-18T22:41:42.556 INFO:tasks.workunit.client.1.smithi195.stdout:8/428: sync 2024-08-18T22:41:42.558 INFO:tasks.workunit.client.1.smithi195.stdout:1/451: creat da/d18/d28/d31/f9a x:0 0 0 2024-08-18T22:41:42.558 INFO:tasks.workunit.client.1.smithi195.stdout:9/428: dwrite d1c/f20 [0,4194304] 0 2024-08-18T22:41:42.560 INFO:tasks.workunit.client.0.smithi121.stdout:7/765: rename de/d13/d18/d23/d24/d85 to de/d98/dfb 0 2024-08-18T22:41:42.560 INFO:tasks.workunit.client.0.smithi121.stdout:1/752: chown d5/d10/d14/d2a/d3a/d87/f4c 6676673 1 2024-08-18T22:41:42.560 INFO:tasks.workunit.client.1.smithi195.stdout:3/398: chown d7/da/df/f69 1144 1 2024-08-18T22:41:42.563 INFO:tasks.workunit.client.0.smithi121.stdout:7/766: mknod de/d98/dfb/dce/d2f/d4b/d6d/dca/cfc 0 2024-08-18T22:41:42.564 INFO:tasks.workunit.client.0.smithi121.stdout:7/767: chown de/d13/fd2 218 1 2024-08-18T22:41:42.564 INFO:tasks.workunit.client.0.smithi121.stdout:8/847: mkdir d6/dd/d3b/da3/dca/d60/df8/d120 0 2024-08-18T22:41:42.565 INFO:tasks.workunit.client.1.smithi195.stdout:7/313: write dc/d14/f47 [1050106,71525] 0 2024-08-18T22:41:42.565 INFO:tasks.workunit.client.1.smithi195.stdout:5/361: mkdir d0/d46/d6d 0 2024-08-18T22:41:42.567 INFO:tasks.workunit.client.0.smithi121.stdout:8/848: write d6/dd/d3b/da3/dca/d60/fb0 [3453598,86048] 0 2024-08-18T22:41:42.569 INFO:tasks.workunit.client.0.smithi121.stdout:8/849: readlink d6/d1e/d2d/d78/l4f 0 2024-08-18T22:41:42.570 INFO:tasks.workunit.client.1.smithi195.stdout:7/314: write f5 [2610398,63155] 0 2024-08-18T22:41:42.570 INFO:tasks.workunit.client.1.smithi195.stdout:5/362: read d0/f11 [3645089,130748] 0 2024-08-18T22:41:42.572 INFO:tasks.workunit.client.1.smithi195.stdout:8/429: symlink d1/d3/d1c/l9f 0 2024-08-18T22:41:42.573 INFO:tasks.workunit.client.1.smithi195.stdout:9/429: mknod d1c/d32/d71/c8b 0 2024-08-18T22:41:42.576 INFO:tasks.workunit.client.1.smithi195.stdout:8/430: write d1/f5 [5399983,51902] 0 2024-08-18T22:41:42.578 INFO:tasks.workunit.client.0.smithi121.stdout:1/753: symlink d5/d10/d14/d2a/d3a/d87/d6c/d6f/l104 0 2024-08-18T22:41:42.578 INFO:tasks.workunit.client.0.smithi121.stdout:1/754: fdatasync d5/d10/d14/d2a/d3a/d87/d6c/d6f/d82/d15/d38/d8e/ffd 0 2024-08-18T22:41:42.579 INFO:tasks.workunit.client.1.smithi195.stdout:2/236: mkdir d1/d8/d3d/d4d 0 2024-08-18T22:41:42.582 INFO:tasks.workunit.client.0.smithi121.stdout:8/850: fdatasync d6/dd/d3b/da3/dca/d37/f50 0 2024-08-18T22:41:42.583 INFO:tasks.workunit.client.1.smithi195.stdout:0/369: truncate d0/dc/d11/d30/d44/f12 3460327 0 2024-08-18T22:41:42.583 INFO:tasks.workunit.client.0.smithi121.stdout:8/851: write d6/f8c [145914,50534] 0 2024-08-18T22:41:42.584 INFO:tasks.workunit.client.1.smithi195.stdout:5/363: dwrite d0/d2/d29/f47 [0,4194304] 0 2024-08-18T22:41:42.584 INFO:tasks.workunit.client.1.smithi195.stdout:0/370: stat d0/dc/l17 0 2024-08-18T22:41:42.585 INFO:tasks.workunit.client.0.smithi121.stdout:5/630: rename d3/d5/d3c/d3f/d8f/fa9 to d3/d5/d13/d19/fc6 0 2024-08-18T22:41:42.586 INFO:tasks.workunit.client.0.smithi121.stdout:5/631: stat d3/d5/d3c/d3f/d8f 0 2024-08-18T22:41:42.588 INFO:tasks.workunit.client.1.smithi195.stdout:7/315: dread f1 [0,4194304] 0 2024-08-18T22:41:42.589 INFO:tasks.workunit.client.0.smithi121.stdout:5/632: stat d3/d5/d13/d19/d24/d32/d38/f85 0 2024-08-18T22:41:42.589 INFO:tasks.workunit.client.1.smithi195.stdout:1/452: dread da/d18/f39 [0,4194304] 0 2024-08-18T22:41:42.592 INFO:tasks.workunit.client.1.smithi195.stdout:8/431: rename d1/d3/db/d35/f47 to d1/d3/db/d35/d4d/d95/fa0 0 2024-08-18T22:41:42.592 INFO:tasks.workunit.client.1.smithi195.stdout:5/364: rename d0/d2 to d0/d2/d29/d6e 22 2024-08-18T22:41:42.593 INFO:tasks.workunit.client.1.smithi195.stdout:3/399: dread d7/d1f/f34 [0,4194304] 0 2024-08-18T22:41:42.593 INFO:tasks.workunit.client.0.smithi121.stdout:7/768: rename de/d98/dfb/dce/d63 to de/d13/d18/d2e/dd7/dfd 0 2024-08-18T22:41:42.593 INFO:tasks.workunit.client.1.smithi195.stdout:0/371: symlink d0/dc/d11/l71 0 2024-08-18T22:41:42.594 INFO:tasks.workunit.client.1.smithi195.stdout:5/365: read - d0/d37/f68 zero size 2024-08-18T22:41:42.594 INFO:tasks.workunit.client.0.smithi121.stdout:8/852: rmdir d6/dd/d3b/da3/dca/d60/df8 39 2024-08-18T22:41:42.595 INFO:tasks.workunit.client.1.smithi195.stdout:1/453: creat da/d4c/f9b x:0 0 0 2024-08-18T22:41:42.595 INFO:tasks.workunit.client.0.smithi121.stdout:4/726: truncate d2/dc/f5d 2915282 0 2024-08-18T22:41:42.596 INFO:tasks.workunit.client.1.smithi195.stdout:7/316: dread dc/d22/f2c [0,4194304] 0 2024-08-18T22:41:42.596 INFO:tasks.workunit.client.0.smithi121.stdout:5/633: write d3/d5/d13/d23/f71 [1447603,45090] 0 2024-08-18T22:41:42.597 INFO:tasks.workunit.client.1.smithi195.stdout:5/366: creat d0/db/f6f x:0 0 0 2024-08-18T22:41:42.598 INFO:tasks.workunit.client.1.smithi195.stdout:3/400: fsync d7/da/df/f1a 0 2024-08-18T22:41:42.598 INFO:tasks.workunit.client.0.smithi121.stdout:1/755: rename d5/d10/d14/d2a/d3a/d87/d6c/d6f/d82/d15/d28/d3d/d9a/dac/lc5 to d5/d10/d14/d2a/d3a/d87/l105 0 2024-08-18T22:41:42.599 INFO:tasks.workunit.client.1.smithi195.stdout:7/317: read dc/d22/f3e [231448,88123] 0 2024-08-18T22:41:42.599 INFO:tasks.workunit.client.0.smithi121.stdout:8/853: creat d6/dd/f121 x:0 0 0 2024-08-18T22:41:42.601 INFO:tasks.workunit.client.0.smithi121.stdout:8/854: stat d6/d20/d69/f9b 0 2024-08-18T22:41:42.601 INFO:tasks.workunit.client.1.smithi195.stdout:1/454: mkdir da/d18/d28/d31/d3b/d4e/d95/d9c 0 2024-08-18T22:41:42.602 INFO:tasks.workunit.client.0.smithi121.stdout:7/769: rename de/d13/d18/d2e/l3e to de/d98/dfb/dce/d34/d38/d5f/lfe 0 2024-08-18T22:41:42.602 INFO:tasks.workunit.client.0.smithi121.stdout:1/756: truncate d5/d10/d14/d92/d9f/fd0 5088655 0 2024-08-18T22:41:42.603 INFO:tasks.workunit.client.1.smithi195.stdout:3/401: unlink d7/da/df/d1c/d6a/f68 0 2024-08-18T22:41:42.604 INFO:tasks.workunit.client.0.smithi121.stdout:7/770: chown de/d98/dfb/dce/d34/d38/d73 115506941 1 2024-08-18T22:41:42.604 INFO:tasks.workunit.client.1.smithi195.stdout:3/402: write d7/f2b [4500587,124521] 0 2024-08-18T22:41:42.605 INFO:tasks.workunit.client.1.smithi195.stdout:0/372: dwrite d0/dc/d11/d30/d44/d41/f5d [0,4194304] 0 2024-08-18T22:41:42.605 INFO:tasks.workunit.client.1.smithi195.stdout:5/367: rename d0/d2/d29/f57 to d0/d3/d8/d64/f70 0 2024-08-18T22:41:42.606 INFO:tasks.workunit.client.0.smithi121.stdout:5/634: rename d3/d5/d13/d19/d24/d32/d38/d63 to d3/d5/d13/d23/da4/dc7 0 2024-08-18T22:41:42.608 INFO:tasks.workunit.client.0.smithi121.stdout:4/727: dread d2/dc/d16/f36 [4194304,4194304] 0 2024-08-18T22:41:42.608 INFO:tasks.workunit.client.1.smithi195.stdout:7/318: mknod dc/c80 0 2024-08-18T22:41:42.611 INFO:tasks.workunit.client.0.smithi121.stdout:9/771: dread d0/d38/d9e/df/d3d/faf [0,4194304] 0 2024-08-18T22:41:42.613 INFO:tasks.workunit.client.1.smithi195.stdout:3/403: dread - d7/da/df/f5f zero size 2024-08-18T22:41:42.614 INFO:tasks.workunit.client.1.smithi195.stdout:7/319: mkdir dc/d14/d2b/d81 0 2024-08-18T22:41:42.617 INFO:tasks.workunit.client.0.smithi121.stdout:9/772: fsync d0/d5/dd/d1a/dc8/dfa/d7f/fe7 0 2024-08-18T22:41:42.618 INFO:tasks.workunit.client.0.smithi121.stdout:5/635: dwrite d3/d5/d3c/f9e [0,4194304] 0 2024-08-18T22:41:42.619 INFO:tasks.workunit.client.0.smithi121.stdout:1/757: rename d5/d10/d14/d2a/d3a/d87/d6c/d6f/d82/d15/la3 to d5/d10/d14/d2a/d3a/l106 0 2024-08-18T22:41:42.619 INFO:tasks.workunit.client.1.smithi195.stdout:2/237: rmdir d1/d8/d3d 39 2024-08-18T22:41:42.620 INFO:tasks.workunit.client.1.smithi195.stdout:7/320: truncate dc/d14/d15/d17/d58/f76 812658 0 2024-08-18T22:41:42.620 INFO:tasks.workunit.client.1.smithi195.stdout:5/368: dwrite d0/d3/d8/f56 [0,4194304] 0 2024-08-18T22:41:42.622 INFO:tasks.workunit.client.1.smithi195.stdout:4/356: sync 2024-08-18T22:41:42.622 INFO:tasks.workunit.client.1.smithi195.stdout:6/272: sync 2024-08-18T22:41:42.622 INFO:tasks.workunit.client.1.smithi195.stdout:5/369: write d0/d46/f63 [270416,77087] 0 2024-08-18T22:41:42.626 INFO:tasks.workunit.client.1.smithi195.stdout:9/430: truncate d1c/f2c 3146370 0 2024-08-18T22:41:42.627 INFO:tasks.workunit.client.0.smithi121.stdout:4/728: dwrite d2/dc/d16/d22/fbd [4194304,4194304] 0 2024-08-18T22:41:42.627 INFO:tasks.workunit.client.0.smithi121.stdout:7/771: getdents de/d98/dfb/dce/d2f/dbf 0 2024-08-18T22:41:42.628 INFO:tasks.workunit.client.1.smithi195.stdout:9/431: chown c1b 134311 1 2024-08-18T22:41:42.628 INFO:tasks.workunit.client.0.smithi121.stdout:5/636: read d3/d5/d13/d19/d24/d4d/f7c [278028,10991] 0 2024-08-18T22:41:42.629 INFO:tasks.workunit.client.1.smithi195.stdout:6/273: truncate da/db/d2a/f44 1486996 0 2024-08-18T22:41:42.629 INFO:tasks.workunit.client.1.smithi195.stdout:8/432: getdents d1/d3/db/d35/d4d/d95 0 2024-08-18T22:41:42.631 INFO:tasks.workunit.client.0.smithi121.stdout:5/637: chown d3/d5/f62 2 1 2024-08-18T22:41:42.631 INFO:tasks.workunit.client.0.smithi121.stdout:8/855: link d6/d1e/d2d/le1 d6/d20/d69/l122 0 2024-08-18T22:41:42.635 INFO:tasks.workunit.client.1.smithi195.stdout:0/373: link d0/f6b d0/dc/d11/d23/d51/f72 0 2024-08-18T22:41:42.636 INFO:tasks.workunit.client.0.smithi121.stdout:9/773: dwrite d0/d5/dd/d1a/dc8/dfa/d7f/fe9 [0,4194304] 0 2024-08-18T22:41:42.637 INFO:tasks.workunit.client.1.smithi195.stdout:4/357: mknod d0/d9/d11/d16/d54/c75 0 2024-08-18T22:41:42.637 INFO:tasks.workunit.client.1.smithi195.stdout:7/321: dwrite dc/d14/d15/d17/d58/f5c [0,4194304] 0 2024-08-18T22:41:42.638 INFO:tasks.workunit.client.0.smithi121.stdout:7/772: rename de/d98/dfb/dce/d2f/d4b/daf/lb9 to de/d13/d18/d23/d24/d29/lff 0 2024-08-18T22:41:42.640 INFO:tasks.workunit.client.1.smithi195.stdout:6/274: rmdir da/d15 39 2024-08-18T22:41:42.641 INFO:tasks.workunit.client.1.smithi195.stdout:3/404: truncate d7/da/df/d38/f3f 2033022 0 2024-08-18T22:41:42.641 INFO:tasks.workunit.client.1.smithi195.stdout:1/455: write da/f10 [2008176,15682] 0 2024-08-18T22:41:42.641 INFO:tasks.workunit.client.0.smithi121.stdout:7/773: dread - de/d98/dfb/dce/d2f/d4b/ff2 zero size 2024-08-18T22:41:42.643 INFO:tasks.workunit.client.1.smithi195.stdout:8/433: mknod d1/d3/db/d35/d4d/d8b/ca1 0 2024-08-18T22:41:42.645 INFO:tasks.workunit.client.0.smithi121.stdout:9/774: creat d0/d38/d9e/df/f102 x:0 0 0 2024-08-18T22:41:42.645 INFO:tasks.workunit.client.0.smithi121.stdout:4/729: mkdir d2/dc/d1c/dc1/ddb/df1/d10a 0 2024-08-18T22:41:42.646 INFO:tasks.workunit.client.0.smithi121.stdout:1/758: write d5/d10/d14/d2a/f68 [4873125,22734] 0 2024-08-18T22:41:42.646 INFO:tasks.workunit.client.1.smithi195.stdout:2/238: chown d1/d8/d3d/f3e 14583674 1 2024-08-18T22:41:42.647 INFO:tasks.workunit.client.0.smithi121.stdout:9/775: chown d0/d5/dd/d1a/dc8/dfa/lda 1734 1 2024-08-18T22:41:42.647 INFO:tasks.workunit.client.1.smithi195.stdout:0/374: creat d0/dc/d11/d30/d44/d41/f73 x:0 0 0 2024-08-18T22:41:42.648 INFO:tasks.workunit.client.1.smithi195.stdout:0/375: chown d0/dc/d11/d6f 15471 1 2024-08-18T22:41:42.650 INFO:tasks.workunit.client.1.smithi195.stdout:7/322: mkdir dc/d14/d2b/d82 0 2024-08-18T22:41:42.651 INFO:tasks.workunit.client.1.smithi195.stdout:6/275: stat da/d15/d1c/f28 0 2024-08-18T22:41:42.652 INFO:tasks.workunit.client.0.smithi121.stdout:8/856: write d6/dd/d25/d56/fc6 [1397409,72470] 0 2024-08-18T22:41:42.652 INFO:tasks.workunit.client.0.smithi121.stdout:7/774: fdatasync de/d13/d18/f7e 0 2024-08-18T22:41:42.653 INFO:tasks.workunit.client.1.smithi195.stdout:3/405: readlink d7/da/df/l16 0 2024-08-18T22:41:42.658 INFO:tasks.workunit.client.0.smithi121.stdout:1/759: truncate d5/d10/d14/d2a/d3a/d87/d6c/d6f/d82/d11/f26 4322847 0 2024-08-18T22:41:42.658 INFO:tasks.workunit.client.1.smithi195.stdout:9/432: rename d1c/c73 to d1c/d74/d7b/d82/c8c 0 2024-08-18T22:41:42.659 INFO:tasks.workunit.client.0.smithi121.stdout:4/730: dwrite d2/dc/d16/d22/fb0 [4194304,4194304] 0 2024-08-18T22:41:42.659 INFO:tasks.workunit.client.0.smithi121.stdout:8/857: getdents d6/dd/d3b/da3/dca/d60 0 2024-08-18T22:41:42.660 INFO:tasks.workunit.client.1.smithi195.stdout:2/239: read d1/d8/d3d/fc [3369021,105393] 0 2024-08-18T22:41:42.660 INFO:tasks.workunit.client.1.smithi195.stdout:0/376: symlink d0/dc/l74 0 2024-08-18T22:41:42.661 INFO:tasks.workunit.client.1.smithi195.stdout:6/276: mknod da/d22/c51 0 2024-08-18T22:41:42.662 INFO:tasks.workunit.client.1.smithi195.stdout:7/323: dread dc/d14/d15/d17/f2f [0,4194304] 0 2024-08-18T22:41:42.662 INFO:tasks.workunit.client.0.smithi121.stdout:1/760: symlink d5/dcf/de1/dc1/l107 0 2024-08-18T22:41:42.662 INFO:tasks.workunit.client.1.smithi195.stdout:3/406: fsync d7/fc 0 2024-08-18T22:41:42.664 INFO:tasks.workunit.client.1.smithi195.stdout:1/456: dread da/d18/f1f [0,4194304] 0 2024-08-18T22:41:42.664 INFO:tasks.workunit.client.1.smithi195.stdout:9/433: write d1c/f64 [493200,41619] 0 2024-08-18T22:41:42.665 INFO:tasks.workunit.client.0.smithi121.stdout:1/761: mkdir d5/d10/d14/d2a/d108 0 2024-08-18T22:41:42.666 INFO:tasks.workunit.client.1.smithi195.stdout:6/277: write da/d15/f2c [3469521,28207] 0 2024-08-18T22:41:42.668 INFO:tasks.workunit.client.0.smithi121.stdout:8/858: dwrite d6/dd/d3b/da3/dca/d60/d5b/f95 [0,4194304] 0 2024-08-18T22:41:42.668 INFO:tasks.workunit.client.1.smithi195.stdout:8/434: rename d1/l7 to d1/de/d67/la2 0 2024-08-18T22:41:42.668 INFO:tasks.workunit.client.1.smithi195.stdout:6/278: chown da/d15/d1c/f50 29769 1 2024-08-18T22:41:42.669 INFO:tasks.workunit.client.1.smithi195.stdout:2/240: mknod d1/d24/c4e 0 2024-08-18T22:41:42.671 INFO:tasks.workunit.client.0.smithi121.stdout:4/731: symlink d2/dc/d16/d22/d2c/l10b 0 2024-08-18T22:41:42.671 INFO:tasks.workunit.client.0.smithi121.stdout:7/775: write de/d13/d18/f19 [2155546,87017] 0 2024-08-18T22:41:42.671 INFO:tasks.workunit.client.1.smithi195.stdout:7/324: creat dc/d2a/d4c/f83 x:0 0 0 2024-08-18T22:41:42.672 INFO:tasks.workunit.client.1.smithi195.stdout:7/325: dread - dc/d14/d15/d17/d58/f6b zero size 2024-08-18T22:41:42.673 INFO:tasks.workunit.client.1.smithi195.stdout:9/434: rmdir d1c/d74/d7b/d82 39 2024-08-18T22:41:42.674 INFO:tasks.workunit.client.1.smithi195.stdout:9/435: fsync f14 0 2024-08-18T22:41:42.675 INFO:tasks.workunit.client.1.smithi195.stdout:9/436: readlink d1c/l7f 0 2024-08-18T22:41:42.675 INFO:tasks.workunit.client.1.smithi195.stdout:1/457: symlink da/d4c/l9d 0 2024-08-18T22:41:42.675 INFO:tasks.workunit.client.0.smithi121.stdout:7/776: write de/d98/dfb/dce/d20/f3f [1636066,2847] 0 2024-08-18T22:41:42.675 INFO:tasks.workunit.client.0.smithi121.stdout:4/732: mknod d2/dc/d16/d59/d83/dd7/d90/db3/c10c 0 2024-08-18T22:41:42.676 INFO:tasks.workunit.client.1.smithi195.stdout:8/435: creat d1/d3/d1c/d21/fa3 x:0 0 0 2024-08-18T22:41:42.677 INFO:tasks.workunit.client.1.smithi195.stdout:9/437: write d1c/d32/d37/f3d [4532281,89821] 0 2024-08-18T22:41:42.677 INFO:tasks.workunit.client.1.smithi195.stdout:5/370: truncate d0/d46/f6c 3362834 0 2024-08-18T22:41:42.678 INFO:tasks.workunit.client.0.smithi121.stdout:8/859: dwrite d6/dd/d3b/da3/dca/f1d [0,4194304] 0 2024-08-18T22:41:42.678 INFO:tasks.workunit.client.1.smithi195.stdout:8/436: chown d1/de/d67 27494107 1 2024-08-18T22:41:42.680 INFO:tasks.workunit.client.0.smithi121.stdout:7/777: truncate de/d65/fb1 565459 0 2024-08-18T22:41:42.684 INFO:tasks.workunit.client.0.smithi121.stdout:7/778: rmdir de/d13/d18/d23/d24/d29 39 2024-08-18T22:41:42.685 INFO:tasks.workunit.client.1.smithi195.stdout:7/326: unlink dc/d2a/d4c/f83 0 2024-08-18T22:41:42.687 INFO:tasks.workunit.client.1.smithi195.stdout:8/437: rmdir d1/de 39 2024-08-18T22:41:42.689 INFO:tasks.workunit.client.0.smithi121.stdout:4/733: dwrite d2/dc/d16/d59/d83/dd7/d90/fcb [0,4194304] 0 2024-08-18T22:41:42.689 INFO:tasks.workunit.client.1.smithi195.stdout:9/438: rename d1c/d32/d71/c8b to d1c/d32/d71/c8d 0 2024-08-18T22:41:42.690 INFO:tasks.workunit.client.1.smithi195.stdout:9/439: chown d1c/d32/d37/d4b/f5d 161 1 2024-08-18T22:41:42.691 INFO:tasks.workunit.client.1.smithi195.stdout:9/440: fdatasync d1c/f45 0 2024-08-18T22:41:42.692 INFO:tasks.workunit.client.1.smithi195.stdout:3/407: creat d7/d1f/f80 x:0 0 0 2024-08-18T22:41:42.693 INFO:tasks.workunit.client.1.smithi195.stdout:2/241: creat d1/d8/f4f x:0 0 0 2024-08-18T22:41:42.696 INFO:tasks.workunit.client.0.smithi121.stdout:1/762: dwrite d5/d10/d14/d2a/d3a/d87/d6c/d6f/d82/d15/f37 [0,4194304] 0 2024-08-18T22:41:42.696 INFO:tasks.workunit.client.1.smithi195.stdout:3/408: dread d7/f4c [0,4194304] 0 2024-08-18T22:41:42.699 INFO:tasks.workunit.client.0.smithi121.stdout:7/779: dwrite de/d13/d18/d23/d24/f56 [0,4194304] 0 2024-08-18T22:41:42.700 INFO:tasks.workunit.client.1.smithi195.stdout:9/441: mkdir d1c/d74/d8e 0 2024-08-18T22:41:42.701 INFO:tasks.workunit.client.0.smithi121.stdout:8/860: dwrite d6/d1e/d2d/f97 [0,4194304] 0 2024-08-18T22:41:42.701 INFO:tasks.workunit.client.1.smithi195.stdout:3/409: mkdir d7/d1f/d74/d81 0 2024-08-18T22:41:42.702 INFO:tasks.workunit.client.0.smithi121.stdout:7/780: chown de/d2d/fe4 0 1 2024-08-18T22:41:42.707 INFO:tasks.workunit.client.0.smithi121.stdout:8/861: fsync d6/dd/d3b/da3/dca/d18/f2c 0 2024-08-18T22:41:42.707 INFO:tasks.workunit.client.1.smithi195.stdout:0/377: creat d0/dc/d11/d30/d44/d41/d6d/f75 x:0 0 0 2024-08-18T22:41:42.709 INFO:tasks.workunit.client.1.smithi195.stdout:2/242: dwrite d1/d8/f11 [4194304,4194304] 0 2024-08-18T22:41:42.710 INFO:tasks.workunit.client.1.smithi195.stdout:9/442: rmdir d1c/d32/d71/d75 39 2024-08-18T22:41:42.712 INFO:tasks.workunit.client.1.smithi195.stdout:3/410: rename d7/d1f/d49/f5e to d7/d1f/d74/d81/f82 0 2024-08-18T22:41:42.714 INFO:tasks.workunit.client.0.smithi121.stdout:1/763: dwrite d5/d10/d14/f86 [0,4194304] 0 2024-08-18T22:41:42.717 INFO:tasks.workunit.client.1.smithi195.stdout:0/378: creat d0/dc/d11/d30/d44/d41/d6d/f76 x:0 0 0 2024-08-18T22:41:42.721 INFO:tasks.workunit.client.1.smithi195.stdout:6/279: truncate da/d15/d1c/d2e/f38 662440 0 2024-08-18T22:41:42.722 INFO:tasks.workunit.client.1.smithi195.stdout:3/411: creat d7/d1f/d74/d81/f83 x:0 0 0 2024-08-18T22:41:42.722 INFO:tasks.workunit.client.0.smithi121.stdout:7/781: dwrite de/d13/d18/d23/d24/d29/f4d [0,4194304] 0 2024-08-18T22:41:42.722 INFO:tasks.workunit.client.0.smithi121.stdout:4/734: dread d2/dc/f13 [0,4194304] 0 2024-08-18T22:41:42.724 INFO:tasks.workunit.client.0.smithi121.stdout:1/764: mknod d5/d10/d14/d2a/d3a/d87/d6c/d6f/d82/ddb/c109 0 2024-08-18T22:41:42.725 INFO:tasks.workunit.client.1.smithi195.stdout:6/280: read da/d15/f34 [955067,81302] 0 2024-08-18T22:41:42.726 INFO:tasks.workunit.client.1.smithi195.stdout:7/327: truncate dc/d2a/f7c 348066 0 2024-08-18T22:41:42.728 INFO:tasks.workunit.client.0.smithi121.stdout:4/735: creat d2/dc/d1c/daa/f10d x:0 0 0 2024-08-18T22:41:42.729 INFO:tasks.workunit.client.1.smithi195.stdout:6/281: chown da/d15/f31 10 1 2024-08-18T22:41:42.730 INFO:tasks.workunit.client.0.smithi121.stdout:7/782: rename de/d13 to de/d98/dfb/dce/d34/d38/d73/da2/d100 0 2024-08-18T22:41:42.731 INFO:tasks.workunit.client.1.smithi195.stdout:9/443: link d1c/d32/f49 d1c/d32/f8f 0 2024-08-18T22:41:42.735 INFO:tasks.workunit.client.1.smithi195.stdout:3/412: dwrite d7/da/df/f5f [0,4194304] 0 2024-08-18T22:41:42.735 INFO:tasks.workunit.client.0.smithi121.stdout:4/736: creat d2/f10e x:0 0 0 2024-08-18T22:41:42.738 INFO:tasks.workunit.client.0.smithi121.stdout:1/765: truncate d5/d10/d14/d2a/d3a/d87/d6c/d6f/d82/d11/f6a 1703407 0 2024-08-18T22:41:42.740 INFO:tasks.workunit.client.0.smithi121.stdout:7/783: unlink de/d98/dfb/dce/d34/d38/d73/da2/d100/d18/d23/d24/d25/cab 0 2024-08-18T22:41:42.742 INFO:tasks.workunit.client.0.smithi121.stdout:8/862: dwrite d6/fc9 [0,4194304] 0 2024-08-18T22:41:42.744 INFO:tasks.workunit.client.0.smithi121.stdout:4/737: mkdir d2/dc/d16/d22/d2c/d44/d8c/d10f 0 2024-08-18T22:41:42.745 INFO:tasks.workunit.client.0.smithi121.stdout:1/766: fdatasync d5/d10/d14/d2a/d3a/d87/f95 0 2024-08-18T22:41:42.746 INFO:tasks.workunit.client.1.smithi195.stdout:8/438: dwrite d1/de/df/f58 [0,4194304] 0 2024-08-18T22:41:42.746 INFO:tasks.workunit.client.1.smithi195.stdout:9/444: read fd [1441875,85171] 0 2024-08-18T22:41:42.746 INFO:tasks.workunit.client.0.smithi121.stdout:8/863: fdatasync d6/d1e/f35 0 2024-08-18T22:41:42.746 INFO:tasks.workunit.client.0.smithi121.stdout:1/767: stat d5/cb8 0 2024-08-18T22:41:42.750 INFO:tasks.workunit.client.1.smithi195.stdout:8/439: symlink d1/de/d27/la4 0 2024-08-18T22:41:42.756 INFO:tasks.workunit.client.1.smithi195.stdout:9/445: dread d1c/d32/f46 [0,4194304] 0 2024-08-18T22:41:42.758 INFO:tasks.workunit.client.0.smithi121.stdout:4/738: mknod d2/dc/d8d/da4/c110 0 2024-08-18T22:41:42.761 INFO:tasks.workunit.client.0.smithi121.stdout:4/739: write d2/dc/d16/f36 [5786505,12639] 0 2024-08-18T22:41:42.761 INFO:tasks.workunit.client.0.smithi121.stdout:8/864: link d6/dd/d3b/da3/dca/d60/l5a d6/d1e/d2d/d78/d45/d86/ded/l123 0 2024-08-18T22:41:42.762 INFO:tasks.workunit.client.0.smithi121.stdout:7/784: write de/d98/dfb/dce/d34/d38/d73/da2/d100/fd5 [838632,20379] 0 2024-08-18T22:41:42.763 INFO:tasks.workunit.client.1.smithi195.stdout:9/446: getdents d1c/d74/d7b/d82 0 2024-08-18T22:41:42.764 INFO:tasks.workunit.client.0.smithi121.stdout:4/740: stat d2/dc/d16/d22/d2c/d7a/da0/laf 0 2024-08-18T22:41:42.765 INFO:tasks.workunit.client.1.smithi195.stdout:1/458: dread da/f1d [0,4194304] 0 2024-08-18T22:41:42.766 INFO:tasks.workunit.client.0.smithi121.stdout:8/865: rename d6/dd/d3b/da3/dca/fc0 to d6/d20/d118/f124 0 2024-08-18T22:41:42.767 INFO:tasks.workunit.client.0.smithi121.stdout:7/785: truncate de/f28 618779 0 2024-08-18T22:41:42.769 INFO:tasks.workunit.client.1.smithi195.stdout:1/459: write da/d18/f42 [598365,16547] 0 2024-08-18T22:41:42.769 INFO:tasks.workunit.client.1.smithi195.stdout:9/447: truncate d1c/f23 1217536 0 2024-08-18T22:41:42.769 INFO:tasks.workunit.client.0.smithi121.stdout:4/741: mkdir d2/dc/d16/d22/d2c/d44/d111 0 2024-08-18T22:41:42.771 INFO:tasks.workunit.client.1.smithi195.stdout:7/328: truncate dc/d14/d15/d17/d58/f5c 2377863 0 2024-08-18T22:41:42.771 INFO:tasks.workunit.client.0.smithi121.stdout:7/786: dread - de/d98/dfb/dce/d34/d38/d73/da2/d100/d18/d23/ff7 zero size 2024-08-18T22:41:42.771 INFO:tasks.workunit.client.1.smithi195.stdout:2/243: dwrite d1/d8/d3d/fc [0,4194304] 0 2024-08-18T22:41:42.773 INFO:tasks.workunit.client.1.smithi195.stdout:8/440: fdatasync d1/de/df/f58 0 2024-08-18T22:41:42.773 INFO:tasks.workunit.client.0.smithi121.stdout:4/742: symlink d2/dc/d1c/daa/l112 0 2024-08-18T22:41:42.774 INFO:tasks.workunit.client.0.smithi121.stdout:8/866: dwrite d6/d1e/f3f [0,4194304] 0 2024-08-18T22:41:42.775 INFO:tasks.workunit.client.1.smithi195.stdout:9/448: mkdir d1c/d74/d7b/d82/d90 0 2024-08-18T22:41:42.776 INFO:tasks.workunit.client.1.smithi195.stdout:7/329: stat dc/d14/d2b/d82 0 2024-08-18T22:41:42.777 INFO:tasks.workunit.client.0.smithi121.stdout:7/787: rmdir de/d98/dfb/dce/d34/d38/d73/da2/d100/d18/d23/d24 39 2024-08-18T22:41:42.778 INFO:tasks.workunit.client.1.smithi195.stdout:0/379: dwrite d0/dc/d11/d23/f49 [0,4194304] 0 2024-08-18T22:41:42.779 INFO:tasks.workunit.client.0.smithi121.stdout:8/867: creat d6/dd/d3b/da3/dca/d18/d99/f125 x:0 0 0 2024-08-18T22:41:42.779 INFO:tasks.workunit.client.0.smithi121.stdout:7/788: symlink de/d98/dfb/dce/d34/d38/d73/dbb/l101 0 2024-08-18T22:41:42.781 INFO:tasks.workunit.client.0.smithi121.stdout:4/743: link d2/dc/d1c/f96 d2/dc/d8d/dc4/f113 0 2024-08-18T22:41:42.784 INFO:tasks.workunit.client.1.smithi195.stdout:8/441: readlink d1/de/d67/la2 0 2024-08-18T22:41:42.785 INFO:tasks.workunit.client.0.smithi121.stdout:4/744: creat d2/dc/d16/d22/d2c/d7a/da0/dcc/f114 x:0 0 0 2024-08-18T22:41:42.785 INFO:tasks.workunit.client.0.smithi121.stdout:8/868: creat d6/dd/d3b/da3/dca/d60/d5b/f126 x:0 0 0 2024-08-18T22:41:42.788 INFO:tasks.workunit.client.0.smithi121.stdout:8/869: write d6/dd/d3b/da3/dca/d60/fd5 [112753,48886] 0 2024-08-18T22:41:42.789 INFO:tasks.workunit.client.0.smithi121.stdout:4/745: rename d2/dc/d16/d59/d83/le1 to d2/dc/d16/d59/d83/da5/l115 0 2024-08-18T22:41:42.791 INFO:tasks.workunit.client.1.smithi195.stdout:7/330: creat dc/d2a/d56/f84 x:0 0 0 2024-08-18T22:41:42.793 INFO:tasks.workunit.client.1.smithi195.stdout:1/460: dwrite da/d18/d28/d31/d3b/d4e/f6b [0,4194304] 0 2024-08-18T22:41:42.794 INFO:tasks.workunit.client.0.smithi121.stdout:4/746: creat d2/dc/d16/d59/d83/dd7/d104/f116 x:0 0 0 2024-08-18T22:41:42.794 INFO:tasks.workunit.client.0.smithi121.stdout:8/870: truncate d6/d1e/d2d/d78/d45/d86/fc4 935266 0 2024-08-18T22:41:42.795 INFO:tasks.workunit.client.0.smithi121.stdout:4/747: stat d2/ca 0 2024-08-18T22:41:42.795 INFO:tasks.workunit.client.1.smithi195.stdout:1/461: truncate da/d18/f8f 415104 0 2024-08-18T22:41:42.797 INFO:tasks.workunit.client.1.smithi195.stdout:0/380: getdents d0 0 2024-08-18T22:41:42.798 INFO:tasks.workunit.client.1.smithi195.stdout:9/449: dwrite d1c/d32/d37/f5b [0,4194304] 0 2024-08-18T22:41:42.799 INFO:tasks.workunit.client.0.smithi121.stdout:8/871: rename d6/dd/d3b/c65 to d6/d1e/d2d/d78/d45/c127 0 2024-08-18T22:41:42.800 INFO:tasks.workunit.client.1.smithi195.stdout:8/442: write d1/de/d27/d4f/f86 [270402,90131] 0 2024-08-18T22:41:42.801 INFO:tasks.workunit.client.1.smithi195.stdout:1/462: chown da/d18/d43/f74 63984 1 2024-08-18T22:41:42.801 INFO:tasks.workunit.client.0.smithi121.stdout:4/748: link d2/dc/d16/cce d2/dc/d1c/dc1/c117 0 2024-08-18T22:41:42.804 INFO:tasks.workunit.client.1.smithi195.stdout:1/463: stat da/d18/f38 0 2024-08-18T22:41:42.805 INFO:tasks.workunit.client.1.smithi195.stdout:3/413: dread d7/d1f/f26 [0,4194304] 0 2024-08-18T22:41:42.805 INFO:tasks.workunit.client.1.smithi195.stdout:3/414: stat d7/l65 0 2024-08-18T22:41:42.806 INFO:tasks.workunit.client.1.smithi195.stdout:7/331: symlink dc/d14/d2b/l85 0 2024-08-18T22:41:42.807 INFO:tasks.workunit.client.1.smithi195.stdout:7/332: read - dc/d14/d15/d17/d18/f75 zero size 2024-08-18T22:41:42.815 INFO:tasks.workunit.client.1.smithi195.stdout:0/381: creat d0/dc/d11/d23/d51/f77 x:0 0 0 2024-08-18T22:41:42.815 INFO:tasks.workunit.client.1.smithi195.stdout:1/464: dwrite da/d4c/d5d/d63/f65 [0,4194304] 0 2024-08-18T22:41:42.816 INFO:tasks.workunit.client.1.smithi195.stdout:2/244: dread d1/d24/d26/f40 [0,4194304] 0 2024-08-18T22:41:42.821 INFO:tasks.workunit.client.1.smithi195.stdout:3/415: chown d7/da/df/d38/c64 3 1 2024-08-18T22:41:42.823 INFO:tasks.workunit.client.1.smithi195.stdout:3/416: fsync d7/da/f70 0 2024-08-18T22:41:42.824 INFO:tasks.workunit.client.1.smithi195.stdout:1/465: mknod da/d4c/d5d/c9e 0 2024-08-18T22:41:42.825 INFO:tasks.workunit.client.1.smithi195.stdout:8/443: symlink d1/d3/d1c/d6a/la5 0 2024-08-18T22:41:42.826 INFO:tasks.workunit.client.1.smithi195.stdout:0/382: dread - d0/dc/d11/d23/f45 zero size 2024-08-18T22:41:42.826 INFO:tasks.workunit.client.1.smithi195.stdout:7/333: dwrite dc/d14/f68 [0,4194304] 0 2024-08-18T22:41:42.828 INFO:tasks.workunit.client.1.smithi195.stdout:2/245: mkdir d1/d24/d26/d42/d50 0 2024-08-18T22:41:42.830 INFO:tasks.workunit.client.1.smithi195.stdout:3/417: mkdir d7/d84 0 2024-08-18T22:41:42.832 INFO:tasks.workunit.client.1.smithi195.stdout:1/466: write da/f29 [784967,125249] 0 2024-08-18T22:41:42.832 INFO:tasks.workunit.client.1.smithi195.stdout:8/444: creat d1/d3/db/d35/d4d/d95/fa6 x:0 0 0 2024-08-18T22:41:42.833 INFO:tasks.workunit.client.0.smithi121.stdout:8/872: write d6/d1e/d2d/d78/f58 [481519,81731] 0 2024-08-18T22:41:42.833 INFO:tasks.workunit.client.0.smithi121.stdout:4/749: write d2/dc/d1c/f60 [1397106,78010] 0 2024-08-18T22:41:42.834 INFO:tasks.workunit.client.1.smithi195.stdout:0/383: truncate d0/dc/d11/d23/f70 913173 0 2024-08-18T22:41:42.836 INFO:tasks.workunit.client.0.smithi121.stdout:8/873: symlink d6/dd/d25/d56/l128 0 2024-08-18T22:41:42.837 INFO:tasks.workunit.client.0.smithi121.stdout:4/750: symlink d2/l118 0 2024-08-18T22:41:42.837 INFO:tasks.workunit.client.1.smithi195.stdout:7/334: creat dc/d1d/d29/f86 x:0 0 0 2024-08-18T22:41:42.838 INFO:tasks.workunit.client.1.smithi195.stdout:3/418: rename l5 to d7/da/df/d1c/d6a/l85 0 2024-08-18T22:41:42.838 INFO:tasks.workunit.client.0.smithi121.stdout:4/751: chown d2/dc/d1c/dc1/fe3 61567698 1 2024-08-18T22:41:42.839 INFO:tasks.workunit.client.1.smithi195.stdout:8/445: mknod d1/de/d31/d88/ca7 0 2024-08-18T22:41:42.841 INFO:tasks.workunit.client.1.smithi195.stdout:2/246: dwrite d1/d24/d26/f2b [0,4194304] 0 2024-08-18T22:41:42.841 INFO:tasks.workunit.client.1.smithi195.stdout:3/419: read f6 [3246459,20505] 0 2024-08-18T22:41:42.841 INFO:tasks.workunit.client.0.smithi121.stdout:8/874: link d6/d1e/d2d/d78/d45/fa5 d6/dd/d3b/f129 0 2024-08-18T22:41:42.841 INFO:tasks.workunit.client.0.smithi121.stdout:4/752: truncate d2/dc/d16/d59/d83/dd7/fb2 1774690 0 2024-08-18T22:41:42.841 INFO:tasks.workunit.client.1.smithi195.stdout:1/467: creat da/d18/d28/d31/d77/f9f x:0 0 0 2024-08-18T22:41:42.842 INFO:tasks.workunit.client.0.smithi121.stdout:8/875: dread - d6/dd/d3b/da3/dca/d60/d5b/d6e/f106 zero size 2024-08-18T22:41:42.842 INFO:tasks.workunit.client.0.smithi121.stdout:4/753: creat d2/dc/d1c/daa/f119 x:0 0 0 2024-08-18T22:41:42.843 INFO:tasks.workunit.client.1.smithi195.stdout:8/446: creat d1/de/fa8 x:0 0 0 2024-08-18T22:41:42.844 INFO:tasks.workunit.client.0.smithi121.stdout:4/754: dread - d2/dc/d16/d22/d2c/d44/d66/f102 zero size 2024-08-18T22:41:42.844 INFO:tasks.workunit.client.0.smithi121.stdout:8/876: rmdir d6/dd/d3b/da3 39 2024-08-18T22:41:42.845 INFO:tasks.workunit.client.0.smithi121.stdout:8/877: fdatasync d6/d1e/d2d/de5/fd2 0 2024-08-18T22:41:42.845 INFO:tasks.workunit.client.1.smithi195.stdout:2/247: readlink d1/d24/d26/d42/d44/l45 0 2024-08-18T22:41:42.846 INFO:tasks.workunit.client.0.smithi121.stdout:4/755: symlink d2/dc/d16/d22/d2c/d44/d8c/l11a 0 2024-08-18T22:41:42.847 INFO:tasks.workunit.client.1.smithi195.stdout:7/335: rename dc/d14/d2b/l85 to dc/d14/d2b/l87 0 2024-08-18T22:41:42.847 INFO:tasks.workunit.client.0.smithi121.stdout:8/878: write d6/dd/dcc/de7/ff3 [6316255,39505] 0 2024-08-18T22:41:42.849 INFO:tasks.workunit.client.0.smithi121.stdout:4/756: chown d2/dc/d16/d22/l7b 0 1 2024-08-18T22:41:42.849 INFO:tasks.workunit.client.1.smithi195.stdout:8/447: mkdir d1/d3/db/d35/da9 0 2024-08-18T22:41:42.851 INFO:tasks.workunit.client.1.smithi195.stdout:3/420: creat d7/da/df/d38/f86 x:0 0 0 2024-08-18T22:41:42.852 INFO:tasks.workunit.client.1.smithi195.stdout:7/336: write dc/d14/d15/d17/d18/f43 [3659238,108468] 0 2024-08-18T22:41:42.852 INFO:tasks.workunit.client.1.smithi195.stdout:2/248: chown d1/f1f 0 1 2024-08-18T22:41:42.855 INFO:tasks.workunit.client.1.smithi195.stdout:1/468: link da/d18/c26 da/d18/d28/d7b/ca0 0 2024-08-18T22:41:42.856 INFO:tasks.workunit.client.1.smithi195.stdout:7/337: fdatasync dc/d14/d15/d17/d58/f76 0 2024-08-18T22:41:42.856 INFO:tasks.workunit.client.1.smithi195.stdout:0/384: dwrite d0/dc/d11/d30/d44/d41/d6d/f76 [0,4194304] 0 2024-08-18T22:41:42.856 INFO:tasks.workunit.client.1.smithi195.stdout:2/249: mkdir d1/d22/d51 0 2024-08-18T22:41:42.857 INFO:tasks.workunit.client.0.smithi121.stdout:4/757: dwrite d2/dc/d16/d59/d83/dd7/fb2 [0,4194304] 0 2024-08-18T22:41:42.857 INFO:tasks.workunit.client.1.smithi195.stdout:1/469: chown da/d18/f2a 9749 1 2024-08-18T22:41:42.859 INFO:tasks.workunit.client.1.smithi195.stdout:0/385: dread - d0/f6b zero size 2024-08-18T22:41:42.862 INFO:tasks.workunit.client.1.smithi195.stdout:7/338: creat dc/d1d/f88 x:0 0 0 2024-08-18T22:41:42.864 INFO:tasks.workunit.client.0.smithi121.stdout:4/758: rename d2/dc/d16/d22/d2c/d7a/dbf/ce0 to d2/dc/d16/d22/d29/c11b 0 2024-08-18T22:41:42.866 INFO:tasks.workunit.client.0.smithi121.stdout:4/759: write d2/f14 [904051,108656] 0 2024-08-18T22:41:42.867 INFO:tasks.workunit.client.0.smithi121.stdout:8/879: dwrite d6/d1e/d2d/d78/d45/d86/fc4 [0,4194304] 0 2024-08-18T22:41:42.868 INFO:tasks.workunit.client.1.smithi195.stdout:7/339: mkdir dc/d14/d15/d17/d18/d89 0 2024-08-18T22:41:42.869 INFO:tasks.workunit.client.0.smithi121.stdout:4/760: dread - d2/dc/d16/f79 zero size 2024-08-18T22:41:42.870 INFO:tasks.workunit.client.1.smithi195.stdout:2/250: creat d1/d24/d26/d42/d50/f52 x:0 0 0 2024-08-18T22:41:42.872 INFO:tasks.workunit.client.1.smithi195.stdout:0/386: fsync d0/dc/d11/d30/d44/d41/d4c/f61 0 2024-08-18T22:41:42.874 INFO:tasks.workunit.client.1.smithi195.stdout:0/387: chown d0/dc/d11/d30/l3e 506 1 2024-08-18T22:41:42.876 INFO:tasks.workunit.client.0.smithi121.stdout:8/880: creat d6/dd/d3b/da3/dca/d18/f12a x:0 0 0 2024-08-18T22:41:42.878 INFO:tasks.workunit.client.1.smithi195.stdout:3/421: rmdir d7/da/df/d38 39 2024-08-18T22:41:42.880 INFO:tasks.workunit.client.1.smithi195.stdout:3/422: write d7/da/df/d1c/f58 [1881020,113727] 0 2024-08-18T22:41:42.881 INFO:tasks.workunit.client.0.smithi121.stdout:4/761: dwrite d2/dc/d16/d59/d83/dd7/d90/fcf [0,4194304] 0 2024-08-18T22:41:42.881 INFO:tasks.workunit.client.1.smithi195.stdout:3/423: stat d7/l15 0 2024-08-18T22:41:42.884 INFO:tasks.workunit.client.1.smithi195.stdout:2/251: getdents d1/d22 0 2024-08-18T22:41:42.885 INFO:tasks.workunit.client.1.smithi195.stdout:0/388: getdents d0/dc 0 2024-08-18T22:41:42.886 INFO:tasks.workunit.client.1.smithi195.stdout:3/424: getdents d7/d84 0 2024-08-18T22:41:42.890 INFO:tasks.workunit.client.0.smithi121.stdout:4/762: dwrite d2/dc/d16/d59/fec [0,4194304] 0 2024-08-18T22:41:42.891 INFO:tasks.workunit.client.1.smithi195.stdout:0/389: creat d0/dc/d11/d30/d44/d41/f78 x:0 0 0 2024-08-18T22:41:42.893 INFO:tasks.workunit.client.1.smithi195.stdout:1/470: dread da/d18/d28/f2d [0,4194304] 0 2024-08-18T22:41:42.893 INFO:tasks.workunit.client.0.smithi121.stdout:8/881: dwrite d6/dd/d3b/da3/dca/d18/d83/fa9 [0,4194304] 0 2024-08-18T22:41:42.894 INFO:tasks.workunit.client.1.smithi195.stdout:3/425: mknod d7/da/c87 0 2024-08-18T22:41:42.894 INFO:tasks.workunit.client.1.smithi195.stdout:1/471: write da/f29 [1870903,102189] 0 2024-08-18T22:41:42.895 INFO:tasks.workunit.client.1.smithi195.stdout:0/390: creat d0/dc/d11/f79 x:0 0 0 2024-08-18T22:41:42.897 INFO:tasks.workunit.client.0.smithi121.stdout:4/763: getdents d2/dc/d16/d22/d2c/d44/da9 0 2024-08-18T22:41:42.899 INFO:tasks.workunit.client.1.smithi195.stdout:1/472: mknod da/d18/d28/d31/d3b/d4e/ca1 0 2024-08-18T22:41:42.900 INFO:tasks.workunit.client.0.smithi121.stdout:8/882: write d6/dd/d3b/f43 [1251370,103848] 0 2024-08-18T22:41:42.901 INFO:tasks.workunit.client.1.smithi195.stdout:0/391: creat d0/dc/d11/d23/d51/f7a x:0 0 0 2024-08-18T22:41:42.901 INFO:tasks.workunit.client.0.smithi121.stdout:8/883: stat d6/d1e/d2d/d78/f58 0 2024-08-18T22:41:42.905 INFO:tasks.workunit.client.0.smithi121.stdout:8/884: symlink d6/d1e/d2d/d78/l12b 0 2024-08-18T22:41:42.906 INFO:tasks.workunit.client.1.smithi195.stdout:3/426: link d7/d1f/c28 d7/d1f/c88 0 2024-08-18T22:41:42.910 INFO:tasks.workunit.client.1.smithi195.stdout:0/392: rename d0/dc/d11/l3d to d0/dc/d25/d67/l7b 0 2024-08-18T22:41:42.911 INFO:tasks.workunit.client.1.smithi195.stdout:3/427: write d7/fc [3295085,93891] 0 2024-08-18T22:41:42.911 INFO:tasks.workunit.client.1.smithi195.stdout:7/340: dread dc/d14/f3b [0,4194304] 0 2024-08-18T22:41:42.911 INFO:tasks.workunit.client.1.smithi195.stdout:0/393: read - d0/f6c zero size 2024-08-18T22:41:42.911 INFO:tasks.workunit.client.1.smithi195.stdout:2/252: dwrite d1/d24/d26/f36 [0,4194304] 0 2024-08-18T22:41:42.911 INFO:tasks.workunit.client.0.smithi121.stdout:8/885: dread d6/f7c [0,4194304] 0 2024-08-18T22:41:42.914 INFO:tasks.workunit.client.1.smithi195.stdout:2/253: write d1/d24/d26/d42/f43 [566420,36299] 0 2024-08-18T22:41:42.915 INFO:tasks.workunit.client.1.smithi195.stdout:7/341: mknod dc/d22/c8a 0 2024-08-18T22:41:42.915 INFO:tasks.workunit.client.1.smithi195.stdout:2/254: chown d1/d24 5543 1 2024-08-18T22:41:42.916 INFO:tasks.workunit.client.1.smithi195.stdout:0/394: getdents d0/dc/d11/d30/d44/d41/d4c/d4f/d66 0 2024-08-18T22:41:42.917 INFO:tasks.workunit.client.1.smithi195.stdout:7/342: chown dc/d14/d15/l48 1065148 1 2024-08-18T22:41:42.918 INFO:tasks.workunit.client.1.smithi195.stdout:1/473: dread da/f12 [0,4194304] 0 2024-08-18T22:41:42.921 INFO:tasks.workunit.client.1.smithi195.stdout:3/428: dwrite d7/d1f/d74/d81/f83 [0,4194304] 0 2024-08-18T22:41:42.921 INFO:tasks.workunit.client.0.smithi121.stdout:4/764: dread d2/fb [0,4194304] 0 2024-08-18T22:41:42.922 INFO:tasks.workunit.client.1.smithi195.stdout:2/255: mkdir d1/d8/d3d/d3b/d53 0 2024-08-18T22:41:42.922 INFO:tasks.workunit.client.1.smithi195.stdout:7/343: write dc/d14/d15/d4d/f79 [708436,121008] 0 2024-08-18T22:41:42.923 INFO:tasks.workunit.client.0.smithi121.stdout:4/765: creat d2/dc/d16/d22/d29/ded/f11c x:0 0 0 2024-08-18T22:41:42.924 INFO:tasks.workunit.client.1.smithi195.stdout:3/429: stat d7/da/df/d1c/f63 0 2024-08-18T22:41:42.925 INFO:tasks.workunit.client.0.smithi121.stdout:4/766: rmdir d2/dc/d16/d22/d2c/d44/da9 39 2024-08-18T22:41:42.926 INFO:tasks.workunit.client.1.smithi195.stdout:7/344: read dc/d14/d15/d17/f5b [1091824,11822] 0 2024-08-18T22:41:42.928 INFO:tasks.workunit.client.1.smithi195.stdout:1/474: symlink da/la2 0 2024-08-18T22:41:42.929 INFO:tasks.workunit.client.0.smithi121.stdout:8/886: dread d6/dd/d3b/da3/dca/fec [0,4194304] 0 2024-08-18T22:41:42.930 INFO:tasks.workunit.client.0.smithi121.stdout:8/887: chown d6/dd/l61 27899 1 2024-08-18T22:41:42.931 INFO:tasks.workunit.client.0.smithi121.stdout:8/888: chown d6/d1e/d2d/d78/d45/d86/c9f 0 1 2024-08-18T22:41:42.933 INFO:tasks.workunit.client.1.smithi195.stdout:2/256: dwrite d1/d22/f30 [0,4194304] 0 2024-08-18T22:41:42.934 INFO:tasks.workunit.client.0.smithi121.stdout:8/889: creat d6/d1e/d2d/d78/d45/dd9/f12c x:0 0 0 2024-08-18T22:41:42.934 INFO:tasks.workunit.client.0.smithi121.stdout:8/890: readlink d6/dd/d25/d56/l128 0 2024-08-18T22:41:42.935 INFO:tasks.workunit.client.1.smithi195.stdout:1/475: creat da/d18/fa3 x:0 0 0 2024-08-18T22:41:42.936 INFO:tasks.workunit.client.0.smithi121.stdout:8/891: mkdir d6/dd/dcc/de7/d12d 0 2024-08-18T22:41:42.937 INFO:tasks.workunit.client.0.smithi121.stdout:8/892: symlink d6/l12e 0 2024-08-18T22:41:42.939 INFO:tasks.workunit.client.0.smithi121.stdout:8/893: symlink d6/d1e/d2d/d78/d85/l12f 0 2024-08-18T22:41:42.940 INFO:tasks.workunit.client.1.smithi195.stdout:2/257: fdatasync d1/d8/d3d/f18 0 2024-08-18T22:41:42.941 INFO:tasks.workunit.client.1.smithi195.stdout:1/476: symlink da/d18/d28/d31/la4 0 2024-08-18T22:41:42.942 INFO:tasks.workunit.client.1.smithi195.stdout:1/477: chown da/d18/d28/d31/d3b/c96 146519015 1 2024-08-18T22:41:42.944 INFO:tasks.workunit.client.1.smithi195.stdout:0/395: write d0/dc/d11/d23/d51/f72 [399196,47126] 0 2024-08-18T22:41:42.944 INFO:tasks.workunit.client.0.smithi121.stdout:2/489: sync 2024-08-18T22:41:42.944 INFO:tasks.workunit.client.0.smithi121.stdout:0/620: sync 2024-08-18T22:41:42.944 INFO:tasks.workunit.client.0.smithi121.stdout:5/638: sync 2024-08-18T22:41:42.944 INFO:tasks.workunit.client.0.smithi121.stdout:3/720: sync 2024-08-18T22:41:42.944 INFO:tasks.workunit.client.1.smithi195.stdout:2/258: creat d1/d24/d26/d42/f54 x:0 0 0 2024-08-18T22:41:42.945 INFO:tasks.workunit.client.1.smithi195.stdout:1/478: dread - da/d18/f4d zero size 2024-08-18T22:41:42.946 INFO:tasks.workunit.client.0.smithi121.stdout:2/490: write d2/d8/d19/f47 [7543980,56858] 0 2024-08-18T22:41:42.946 INFO:tasks.workunit.client.1.smithi195.stdout:0/396: write d0/dc/d11/d30/d44/d41/f78 [670292,34188] 0 2024-08-18T22:41:42.947 INFO:tasks.workunit.client.1.smithi195.stdout:0/397: stat d0/f6b 0 2024-08-18T22:41:42.947 INFO:tasks.workunit.client.0.smithi121.stdout:3/721: write d1e/d1f/da6/dc7/db8/d104/d9a/fcf [804341,122305] 0 2024-08-18T22:41:42.947 INFO:tasks.workunit.client.0.smithi121.stdout:0/621: fsync d1/d4/da/d2f/da0/f3d 0 2024-08-18T22:41:42.948 INFO:tasks.workunit.client.1.smithi195.stdout:2/259: unlink d1/d22/c2a 0 2024-08-18T22:41:42.949 INFO:tasks.workunit.client.1.smithi195.stdout:3/430: truncate d7/f17 1713205 0 2024-08-18T22:41:42.951 INFO:tasks.workunit.client.1.smithi195.stdout:0/398: creat d0/dc/d25/f7c x:0 0 0 2024-08-18T22:41:42.953 INFO:tasks.workunit.client.1.smithi195.stdout:1/479: dread f6 [0,4194304] 0 2024-08-18T22:41:42.954 INFO:tasks.workunit.client.1.smithi195.stdout:0/399: write d0/dc/dd/f63 [787687,78177] 0 2024-08-18T22:41:42.954 INFO:tasks.workunit.client.1.smithi195.stdout:3/431: write d7/d1f/f37 [5234366,93284] 0 2024-08-18T22:41:42.955 INFO:tasks.workunit.client.1.smithi195.stdout:2/260: mknod d1/d22/d51/c55 0 2024-08-18T22:41:42.955 INFO:tasks.workunit.client.0.smithi121.stdout:5/639: dwrite d3/d5/d13/d19/d24/d4d/f9b [0,4194304] 0 2024-08-18T22:41:42.956 INFO:tasks.workunit.client.1.smithi195.stdout:3/432: chown d7/da 23684 1 2024-08-18T22:41:42.957 INFO:tasks.workunit.client.0.smithi121.stdout:0/622: dread d1/d4/db/d18/d40/d83/daf/dd5/f46 [0,4194304] 0 2024-08-18T22:41:42.958 INFO:tasks.workunit.client.1.smithi195.stdout:1/480: creat da/d68/fa5 x:0 0 0 2024-08-18T22:41:42.959 INFO:tasks.workunit.client.0.smithi121.stdout:0/623: dread - d1/d4/db/d18/d40/d83/daf/dd5/fa8 zero size 2024-08-18T22:41:42.960 INFO:tasks.workunit.client.1.smithi195.stdout:3/433: creat d7/f89 x:0 0 0 2024-08-18T22:41:42.961 INFO:tasks.workunit.client.1.smithi195.stdout:7/345: dwrite dc/d14/d15/d17/d58/f5c [0,4194304] 0 2024-08-18T22:41:42.962 INFO:tasks.workunit.client.0.smithi121.stdout:5/640: rename d3/d5/d27/d35/c5a to d3/d5c/cc8 0 2024-08-18T22:41:42.964 INFO:tasks.workunit.client.1.smithi195.stdout:3/434: chown d7/l3c 272416212 1 2024-08-18T22:41:42.965 INFO:tasks.workunit.client.1.smithi195.stdout:1/481: read da/d18/f47 [2489418,32643] 0 2024-08-18T22:41:42.966 INFO:tasks.workunit.client.0.smithi121.stdout:5/641: dread - d3/d5/d3c/daf/fc3 zero size 2024-08-18T22:41:42.967 INFO:tasks.workunit.client.0.smithi121.stdout:0/624: rename d1/d4/db/dd0 to d1/d4/db/d18/d40/d83/daf/dd5/d90/dd8 0 2024-08-18T22:41:42.967 INFO:tasks.workunit.client.0.smithi121.stdout:3/722: dwrite d1e/d1f/dba/df6/fa8 [0,4194304] 0 2024-08-18T22:41:42.968 INFO:tasks.workunit.client.1.smithi195.stdout:0/400: dwrite d0/dc/d11/d30/f35 [0,4194304] 0 2024-08-18T22:41:42.972 INFO:tasks.workunit.client.1.smithi195.stdout:0/401: symlink d0/dc/dd/d46/l7d 0 2024-08-18T22:41:42.976 INFO:tasks.workunit.client.1.smithi195.stdout:1/482: link da/d18/f39 da/d4c/d5d/d63/fa6 0 2024-08-18T22:41:42.977 INFO:tasks.workunit.client.0.smithi121.stdout:5/642: truncate d3/d5/d3c/f7f 740936 0 2024-08-18T22:41:42.980 INFO:tasks.workunit.client.1.smithi195.stdout:0/402: creat d0/dc/dd/d46/f7e x:0 0 0 2024-08-18T22:41:42.981 INFO:tasks.workunit.client.0.smithi121.stdout:2/491: dread d2/d8/d19/d4a/f4d [4194304,4194304] 0 2024-08-18T22:41:42.981 INFO:tasks.workunit.client.1.smithi195.stdout:0/403: chown d0/dc/d11/d30/d44/d41/f73 2455 1 2024-08-18T22:41:42.984 INFO:tasks.workunit.client.1.smithi195.stdout:7/346: write f1 [1050943,127893] 0 2024-08-18T22:41:42.985 INFO:tasks.workunit.client.1.smithi195.stdout:7/347: stat dc/d14/d15/d17/d18/c24 0 2024-08-18T22:41:42.986 INFO:tasks.workunit.client.0.smithi121.stdout:3/723: dwrite d1e/d1f/da6/dc7/db8/d104/f8a [0,4194304] 0 2024-08-18T22:41:42.986 INFO:tasks.workunit.client.1.smithi195.stdout:7/348: fsync dc/d14/d15/f60 0 2024-08-18T22:41:42.987 INFO:tasks.workunit.client.1.smithi195.stdout:0/404: symlink d0/dc/d11/d30/d44/l7f 0 2024-08-18T22:41:42.988 INFO:tasks.workunit.client.1.smithi195.stdout:7/349: rmdir dc/d14/d15 39 2024-08-18T22:41:42.990 INFO:tasks.workunit.client.1.smithi195.stdout:7/350: fdatasync dc/d14/d2b/f5e 0 2024-08-18T22:41:42.993 INFO:tasks.workunit.client.1.smithi195.stdout:7/351: truncate dc/d14/d15/d4d/f79 1610150 0 2024-08-18T22:41:42.999 INFO:tasks.workunit.client.1.smithi195.stdout:7/352: dwrite dc/d14/f3b [0,4194304] 0 2024-08-18T22:41:43.000 INFO:tasks.workunit.client.1.smithi195.stdout:7/353: chown dc/d14/d2b/d82 14851919 1 2024-08-18T22:41:43.002 INFO:tasks.workunit.client.1.smithi195.stdout:7/354: creat dc/d1d/d29/d5d/f8b x:0 0 0 2024-08-18T22:41:43.003 INFO:tasks.workunit.client.1.smithi195.stdout:7/355: mknod dc/d14/d15/c8c 0 2024-08-18T22:41:43.013 INFO:tasks.workunit.client.1.smithi195.stdout:3/435: dread d7/fc [0,4194304] 0 2024-08-18T22:41:43.013 INFO:tasks.workunit.client.0.smithi121.stdout:0/625: rmdir d1/d4/db/d24/d30/d6c 39 2024-08-18T22:41:43.014 INFO:tasks.workunit.client.0.smithi121.stdout:5/643: read - d3/d5/d13/d23/da4/dc7/dae/fc1 zero size 2024-08-18T22:41:43.014 INFO:tasks.workunit.client.0.smithi121.stdout:3/724: creat d1e/d1f/da6/dc7/dae/f10d x:0 0 0 2024-08-18T22:41:43.015 INFO:tasks.workunit.client.1.smithi195.stdout:3/436: creat d7/d54/f8a x:0 0 0 2024-08-18T22:41:43.015 INFO:tasks.workunit.client.0.smithi121.stdout:5/644: dread - d3/d5/d27/d35/fb4 zero size 2024-08-18T22:41:43.016 INFO:tasks.workunit.client.1.smithi195.stdout:3/437: fdatasync d7/f89 0 2024-08-18T22:41:43.016 INFO:tasks.workunit.client.0.smithi121.stdout:0/626: mknod d1/d4/d53/cd9 0 2024-08-18T22:41:43.017 INFO:tasks.workunit.client.0.smithi121.stdout:3/725: creat d1e/d1f/d3e/f10e x:0 0 0 2024-08-18T22:41:43.018 INFO:tasks.workunit.client.1.smithi195.stdout:1/483: write da/d4c/f69 [1245884,37508] 0 2024-08-18T22:41:43.018 INFO:tasks.workunit.client.1.smithi195.stdout:0/405: getdents d0/dc/d11/d30/d44 0 2024-08-18T22:41:43.020 INFO:tasks.workunit.client.0.smithi121.stdout:3/726: symlink d1e/d1f/d25/d6b/db4/d94/de6/l10f 0 2024-08-18T22:41:43.021 INFO:tasks.workunit.client.1.smithi195.stdout:1/484: mknod da/d4c/d5d/ca7 0 2024-08-18T22:41:43.021 INFO:tasks.workunit.client.0.smithi121.stdout:5/645: creat d3/d5/d13/d19/d24/fc9 x:0 0 0 2024-08-18T22:41:43.022 INFO:tasks.workunit.client.1.smithi195.stdout:7/356: truncate dc/d14/d15/d17/f2f 127495 0 2024-08-18T22:41:43.022 INFO:tasks.workunit.client.1.smithi195.stdout:1/485: dread - da/d68/fa5 zero size 2024-08-18T22:41:43.023 INFO:tasks.workunit.client.1.smithi195.stdout:1/486: write da/f91 [48202,125629] 0 2024-08-18T22:41:43.024 INFO:tasks.workunit.client.0.smithi121.stdout:3/727: symlink d1e/d1f/dba/df6/dd3/l110 0 2024-08-18T22:41:43.025 INFO:tasks.workunit.client.0.smithi121.stdout:5/646: symlink d3/d5/d13/d23/da4/da6/lca 0 2024-08-18T22:41:43.026 INFO:tasks.workunit.client.1.smithi195.stdout:7/357: mknod dc/d14/d15/d17/c8d 0 2024-08-18T22:41:43.028 INFO:tasks.workunit.client.0.smithi121.stdout:3/728: rmdir d1e/d1f/d25/d2e/d36/d5f 39 2024-08-18T22:41:43.028 INFO:tasks.workunit.client.0.smithi121.stdout:5/647: mknod d3/d5/d27/d35/d53/ccb 0 2024-08-18T22:41:43.029 INFO:tasks.workunit.client.1.smithi195.stdout:7/358: symlink dc/d14/d15/d17/d18/l8e 0 2024-08-18T22:41:43.030 INFO:tasks.workunit.client.0.smithi121.stdout:3/729: unlink d1e/f31 0 2024-08-18T22:41:43.031 INFO:tasks.workunit.client.0.smithi121.stdout:5/648: dread d3/d5/d13/d23/da4/dc7/f83 [0,4194304] 0 2024-08-18T22:41:43.032 INFO:tasks.workunit.client.1.smithi195.stdout:7/359: read dc/d14/d15/f71 [115582,81825] 0 2024-08-18T22:41:43.034 INFO:tasks.workunit.client.1.smithi195.stdout:7/360: write dc/d14/d15/d17/d58/f5a [880873,91640] 0 2024-08-18T22:41:43.039 INFO:tasks.workunit.client.1.smithi195.stdout:1/487: truncate da/d18/f1f 2601321 0 2024-08-18T22:41:43.039 INFO:tasks.workunit.client.1.smithi195.stdout:0/406: dwrite d0/dc/d25/f1f [4194304,4194304] 0 2024-08-18T22:41:43.039 INFO:tasks.workunit.client.1.smithi195.stdout:7/361: mkdir dc/d8f 0 2024-08-18T22:41:43.040 INFO:tasks.workunit.client.1.smithi195.stdout:1/488: dread - da/d18/d43/f89 zero size 2024-08-18T22:41:43.042 INFO:tasks.workunit.client.0.smithi121.stdout:0/627: dwrite d1/d4/db/d18/d40/d83/daf/dd5/f46 [0,4194304] 0 2024-08-18T22:41:43.043 INFO:tasks.workunit.client.1.smithi195.stdout:0/407: rmdir d0/dc/d11 39 2024-08-18T22:41:43.044 INFO:tasks.workunit.client.1.smithi195.stdout:1/489: rename da/d18/f8f to da/d18/d28/d8e/d99/fa8 0 2024-08-18T22:41:43.045 INFO:tasks.workunit.client.0.smithi121.stdout:0/628: mknod d1/d4/da/d2f/cda 0 2024-08-18T22:41:43.046 INFO:tasks.workunit.client.1.smithi195.stdout:1/490: dread da/f91 [0,4194304] 0 2024-08-18T22:41:43.053 INFO:tasks.workunit.client.0.smithi121.stdout:0/629: getdents d1/d4/db/d18/d40/d83/daf/dd5/d90/dc3 0 2024-08-18T22:41:43.054 INFO:tasks.workunit.client.1.smithi195.stdout:1/491: mknod da/d18/d43/ca9 0 2024-08-18T22:41:43.054 INFO:tasks.workunit.client.1.smithi195.stdout:1/492: fdatasync da/d18/d28/d31/f84 0 2024-08-18T22:41:43.055 INFO:tasks.workunit.client.0.smithi121.stdout:0/630: rmdir d1/d4/d53/d61 39 2024-08-18T22:41:43.056 INFO:tasks.workunit.client.1.smithi195.stdout:7/362: getdents dc/d2a/d56 0 2024-08-18T22:41:43.057 INFO:tasks.workunit.client.0.smithi121.stdout:0/631: symlink d1/d4/d53/d61/ldb 0 2024-08-18T22:41:43.058 INFO:tasks.workunit.client.1.smithi195.stdout:7/363: stat dc/d14/d15/d17/d58/f5a 0 2024-08-18T22:41:43.059 INFO:tasks.workunit.client.1.smithi195.stdout:1/493: symlink da/d18/d28/d31/laa 0 2024-08-18T22:41:43.059 INFO:tasks.workunit.client.1.smithi195.stdout:7/364: read f1 [1705738,103258] 0 2024-08-18T22:41:43.061 INFO:tasks.workunit.client.0.smithi121.stdout:0/632: rename d1/d4/db/d24/d30/d6c/l4a to d1/d4/db/d24/df/d8/d78/d7c/ldc 0 2024-08-18T22:41:43.062 INFO:tasks.workunit.client.1.smithi195.stdout:1/494: chown da/d18/d28/c2c 387 1 2024-08-18T22:41:43.063 INFO:tasks.workunit.client.0.smithi121.stdout:0/633: unlink d1/f69 0 2024-08-18T22:41:43.064 INFO:tasks.workunit.client.1.smithi195.stdout:0/408: dwrite d0/dc/d11/d30/f40 [0,4194304] 0 2024-08-18T22:41:43.065 INFO:tasks.workunit.client.0.smithi121.stdout:0/634: dread d1/d4/db/d18/d40/fc8 [0,4194304] 0 2024-08-18T22:41:43.066 INFO:tasks.workunit.client.0.smithi121.stdout:0/635: mkdir d1/d4/db/d18/d40/d83/daf/ddd 0 2024-08-18T22:41:43.067 INFO:tasks.workunit.client.1.smithi195.stdout:7/365: dread f1 [0,4194304] 0 2024-08-18T22:41:43.067 INFO:tasks.workunit.client.1.smithi195.stdout:0/409: stat d0/dc/d25/f1f 0 2024-08-18T22:41:43.070 INFO:tasks.workunit.client.1.smithi195.stdout:7/366: symlink dc/d1d/d29/l90 0 2024-08-18T22:41:43.076 INFO:tasks.workunit.client.1.smithi195.stdout:0/410: dwrite d0/f6b [0,4194304] 0 2024-08-18T22:41:43.079 INFO:tasks.workunit.client.0.smithi121.stdout:0/636: dwrite d1/d4/db/d18/d40/d83/daf/dd5/f70 [4194304,4194304] 0 2024-08-18T22:41:43.079 INFO:tasks.workunit.client.1.smithi195.stdout:7/367: dwrite dc/d22/f7e [4194304,4194304] 0 2024-08-18T22:41:43.082 INFO:tasks.workunit.client.1.smithi195.stdout:7/368: write dc/d22/f7e [2255644,124361] 0 2024-08-18T22:41:43.082 INFO:tasks.workunit.client.1.smithi195.stdout:1/495: dread da/d18/d28/d31/d3b/d4e/f8b [0,4194304] 0 2024-08-18T22:41:43.082 INFO:tasks.workunit.client.0.smithi121.stdout:0/637: mkdir d1/d4/db/d24/d30/d6c/dde 0 2024-08-18T22:41:43.083 INFO:tasks.workunit.client.1.smithi195.stdout:7/369: readlink dc/d1d/l52 0 2024-08-18T22:41:43.085 INFO:tasks.workunit.client.0.smithi121.stdout:0/638: chown d1/d4/db/d18/d40/d83/daf/dd5/d5b/c9b 156540262 1 2024-08-18T22:41:43.087 INFO:tasks.workunit.client.1.smithi195.stdout:0/411: rename d0/dc/d11/d30/d44/d41/f78 to d0/dc/d11/d23/f80 0 2024-08-18T22:41:43.087 INFO:tasks.workunit.client.1.smithi195.stdout:1/496: mknod da/d18/d28/d31/d77/cab 0 2024-08-18T22:41:43.088 INFO:tasks.workunit.client.1.smithi195.stdout:7/370: symlink dc/d2a/l91 0 2024-08-18T22:41:43.090 INFO:tasks.workunit.client.1.smithi195.stdout:1/497: mkdir da/d4c/d5d/dac 0 2024-08-18T22:41:43.091 INFO:tasks.workunit.client.1.smithi195.stdout:7/371: write dc/d14/d15/d17/f19 [3098731,26993] 0 2024-08-18T22:41:43.092 INFO:tasks.workunit.client.1.smithi195.stdout:1/498: chown da/d18/d28/d31/c85 116 1 2024-08-18T22:41:43.093 INFO:tasks.workunit.client.1.smithi195.stdout:7/372: mknod dc/d2a/d4c/c92 0 2024-08-18T22:41:43.093 INFO:tasks.workunit.client.1.smithi195.stdout:1/499: truncate da/d18/d28/d31/f46 9148520 0 2024-08-18T22:41:43.094 INFO:tasks.workunit.client.1.smithi195.stdout:1/500: chown da/f29 458820350 1 2024-08-18T22:41:43.095 INFO:tasks.workunit.client.1.smithi195.stdout:7/373: dread - dc/d14/d15/d17/d18/f7b zero size 2024-08-18T22:41:43.095 INFO:tasks.workunit.client.1.smithi195.stdout:1/501: stat da/d18/l83 0 2024-08-18T22:41:43.096 INFO:tasks.workunit.client.1.smithi195.stdout:1/502: symlink da/d4c/d5d/d63/lad 0 2024-08-18T22:41:43.096 INFO:tasks.workunit.client.1.smithi195.stdout:1/503: stat da/c16 0 2024-08-18T22:41:43.097 INFO:tasks.workunit.client.1.smithi195.stdout:7/374: mknod dc/d14/d2b/d82/c93 0 2024-08-18T22:41:43.097 INFO:tasks.workunit.client.1.smithi195.stdout:7/375: chown dc/d14/d2b/l31 768 1 2024-08-18T22:41:43.098 INFO:tasks.workunit.client.1.smithi195.stdout:7/376: symlink dc/d14/d15/d17/d18/d89/l94 0 2024-08-18T22:41:43.105 INFO:tasks.workunit.client.0.smithi121.stdout:0/639: write d1/d4/db/d24/df/d8/f20 [4710822,54484] 0 2024-08-18T22:41:43.114 INFO:tasks.workunit.client.0.smithi121.stdout:0/640: dwrite d1/d4/db/d24/d30/f86 [0,4194304] 0 2024-08-18T22:41:43.115 INFO:tasks.workunit.client.0.smithi121.stdout:0/641: creat d1/d4/db/d24/d30/d6c/fdf x:0 0 0 2024-08-18T22:41:43.116 INFO:tasks.workunit.client.1.smithi195.stdout:7/377: chown dc/d14/d15/d17/d18/c64 3265 1 2024-08-18T22:41:43.116 INFO:tasks.workunit.client.1.smithi195.stdout:7/378: chown fb 74490059 1 2024-08-18T22:41:43.117 INFO:tasks.workunit.client.1.smithi195.stdout:0/412: rename d0/dc/d11/d30 to d0/dc/d64/d81 0 2024-08-18T22:41:43.117 INFO:tasks.workunit.client.0.smithi121.stdout:0/642: chown d1/d4/db/d24/df/d8/d71/c75 8204162 1 2024-08-18T22:41:43.118 INFO:tasks.workunit.client.1.smithi195.stdout:0/413: chown d0/dc/d11 44 1 2024-08-18T22:41:43.118 INFO:tasks.workunit.client.1.smithi195.stdout:7/379: chown dc/d14/d15/d17/d18/f1c 300337 1 2024-08-18T22:41:43.118 INFO:tasks.workunit.client.0.smithi121.stdout:0/643: dread - d1/d4/db/fc4 zero size 2024-08-18T22:41:43.120 INFO:tasks.workunit.client.1.smithi195.stdout:7/380: unlink dc/d14/f4f 0 2024-08-18T22:41:43.121 INFO:tasks.workunit.client.0.smithi121.stdout:0/644: creat d1/d4/d53/fe0 x:0 0 0 2024-08-18T22:41:43.121 INFO:tasks.workunit.client.1.smithi195.stdout:1/504: rename da/d4c/l9d to da/d18/d28/d31/lae 0 2024-08-18T22:41:43.123 INFO:tasks.workunit.client.1.smithi195.stdout:0/414: creat d0/dc/d64/d81/d44/d41/d4c/f82 x:0 0 0 2024-08-18T22:41:43.124 INFO:tasks.workunit.client.1.smithi195.stdout:7/381: symlink dc/d14/d2b/d81/l95 0 2024-08-18T22:41:43.125 INFO:tasks.workunit.client.1.smithi195.stdout:0/415: dread - d0/dc/d11/d23/f45 zero size 2024-08-18T22:41:43.126 INFO:tasks.workunit.client.1.smithi195.stdout:7/382: write dc/d14/d15/d4d/f79 [1326323,89465] 0 2024-08-18T22:41:43.126 INFO:tasks.workunit.client.1.smithi195.stdout:1/505: rename da/d18/d28/d31/d77/cab to da/d18/d28/caf 0 2024-08-18T22:41:43.132 INFO:tasks.workunit.client.0.smithi121.stdout:0/645: dwrite d1/d4/f1f [4194304,4194304] 0 2024-08-18T22:41:43.133 INFO:tasks.workunit.client.1.smithi195.stdout:0/416: rename d0/dc/d64/d81/d44/c28 to d0/dc/dd/d46/c83 0 2024-08-18T22:41:43.136 INFO:tasks.workunit.client.1.smithi195.stdout:7/383: dwrite dc/d14/d15/f71 [0,4194304] 0 2024-08-18T22:41:43.138 INFO:tasks.workunit.client.1.smithi195.stdout:7/384: truncate dc/d14/d2b/f3a 799048 0 2024-08-18T22:41:43.139 INFO:tasks.workunit.client.0.smithi121.stdout:0/646: dwrite d1/d8a/fa9 [0,4194304] 0 2024-08-18T22:41:43.140 INFO:tasks.workunit.client.1.smithi195.stdout:7/385: truncate dc/d2a/f7d 926038 0 2024-08-18T22:41:43.144 INFO:tasks.workunit.client.1.smithi195.stdout:1/506: dread da/f53 [0,4194304] 0 2024-08-18T22:41:43.144 INFO:tasks.workunit.client.1.smithi195.stdout:7/386: mkdir dc/d8f/d96 0 2024-08-18T22:41:43.144 INFO:tasks.workunit.client.0.smithi121.stdout:0/647: creat d1/d4/db/d18/d40/d83/daf/dd5/d90/dc3/fe1 x:0 0 0 2024-08-18T22:41:43.146 INFO:tasks.workunit.client.1.smithi195.stdout:7/387: fsync f1 0 2024-08-18T22:41:43.147 INFO:tasks.workunit.client.1.smithi195.stdout:7/388: read - dc/d1d/f7a zero size 2024-08-18T22:41:43.151 INFO:tasks.workunit.client.1.smithi195.stdout:7/389: mkdir dc/d14/d15/d4d/d97 0 2024-08-18T22:41:43.152 INFO:tasks.workunit.client.0.smithi121.stdout:0/648: dread d1/d4/f88 [0,4194304] 0 2024-08-18T22:41:43.155 INFO:tasks.workunit.client.1.smithi195.stdout:7/390: write dc/d1d/d29/f41 [653092,65280] 0 2024-08-18T22:41:43.157 INFO:tasks.workunit.client.0.smithi121.stdout:0/649: dwrite d1/d4/f72 [0,4194304] 0 2024-08-18T22:41:43.158 INFO:tasks.workunit.client.1.smithi195.stdout:7/391: stat dc/d2a/d4c/l7f 0 2024-08-18T22:41:43.158 INFO:tasks.workunit.client.1.smithi195.stdout:1/507: dwrite da/d18/d28/d31/d3b/d4e/f51 [0,4194304] 0 2024-08-18T22:41:43.159 INFO:tasks.workunit.client.1.smithi195.stdout:0/417: dwrite d0/dc/d64/d81/d44/d41/d6d/f76 [4194304,4194304] 0 2024-08-18T22:41:43.167 INFO:tasks.workunit.client.1.smithi195.stdout:0/418: creat d0/dc/f84 x:0 0 0 2024-08-18T22:41:43.170 INFO:tasks.workunit.client.1.smithi195.stdout:0/419: write d0/dc/d25/f1f [1421836,25397] 0 2024-08-18T22:41:43.171 INFO:tasks.workunit.client.1.smithi195.stdout:1/508: dwrite da/d18/f2a [4194304,4194304] 0 2024-08-18T22:41:43.178 INFO:tasks.workunit.client.1.smithi195.stdout:7/392: dread dc/d14/d15/d4d/f79 [0,4194304] 0 2024-08-18T22:41:43.179 INFO:tasks.workunit.client.1.smithi195.stdout:1/509: link da/f24 da/d4c/d5d/dac/fb0 0 2024-08-18T22:41:43.181 INFO:tasks.workunit.client.1.smithi195.stdout:1/510: write da/d18/d28/d31/f9a [402171,85619] 0 2024-08-18T22:41:43.183 INFO:tasks.workunit.client.1.smithi195.stdout:0/420: link d0/dc/d25/l4a d0/dc/d64/d81/d44/d41/d4c/d4f/l85 0 2024-08-18T22:41:43.184 INFO:tasks.workunit.client.1.smithi195.stdout:1/511: mkdir da/d4c/d5d/dac/db1 0 2024-08-18T22:41:43.186 INFO:tasks.workunit.client.1.smithi195.stdout:1/512: chown da/d4c/d5d/ca7 7 1 2024-08-18T22:41:43.187 INFO:tasks.workunit.client.1.smithi195.stdout:7/393: dwrite dc/d1d/d29/d5d/f8b [0,4194304] 0 2024-08-18T22:41:43.187 INFO:tasks.workunit.client.1.smithi195.stdout:1/513: fsync da/d4c/f69 0 2024-08-18T22:41:43.188 INFO:tasks.workunit.client.1.smithi195.stdout:0/421: creat d0/dc/d64/d81/d44/d41/d4c/d4f/d66/f86 x:0 0 0 2024-08-18T22:41:43.189 INFO:tasks.workunit.client.1.smithi195.stdout:1/514: write da/d4c/f69 [662240,32453] 0 2024-08-18T22:41:43.190 INFO:tasks.workunit.client.1.smithi195.stdout:1/515: read da/d18/d28/f2e [1271744,119374] 0 2024-08-18T22:41:43.190 INFO:tasks.workunit.client.1.smithi195.stdout:7/394: rmdir dc/d1d/d29/d5d 39 2024-08-18T22:41:43.193 INFO:tasks.workunit.client.1.smithi195.stdout:7/395: rmdir dc/d22 39 2024-08-18T22:41:43.196 INFO:tasks.workunit.client.1.smithi195.stdout:1/516: symlink da/d18/d28/lb2 0 2024-08-18T22:41:43.199 INFO:tasks.workunit.client.1.smithi195.stdout:7/396: dread dc/d14/d15/d4d/f79 [0,4194304] 0 2024-08-18T22:41:43.199 INFO:tasks.workunit.client.1.smithi195.stdout:0/422: dwrite d0/dc/d11/d23/d51/f72 [0,4194304] 0 2024-08-18T22:41:43.199 INFO:tasks.workunit.client.1.smithi195.stdout:1/517: rmdir da/d18/d28/d8e 39 2024-08-18T22:41:43.200 INFO:tasks.workunit.client.0.smithi121.stdout:0/650: dread d1/d4/db/d18/d40/d83/daf/dd5/d90/f98 [0,4194304] 0 2024-08-18T22:41:43.204 INFO:tasks.workunit.client.1.smithi195.stdout:0/423: rmdir d0/dc/d64/d81 39 2024-08-18T22:41:43.205 INFO:tasks.workunit.client.1.smithi195.stdout:7/397: creat dc/d14/d15/d17/d18/d89/f98 x:0 0 0 2024-08-18T22:41:43.206 INFO:tasks.workunit.client.0.smithi121.stdout:0/651: dwrite d1/d8a/fa9 [0,4194304] 0 2024-08-18T22:41:43.207 INFO:tasks.workunit.client.1.smithi195.stdout:1/518: creat da/d18/d28/d8e/d99/fb3 x:0 0 0 2024-08-18T22:41:43.207 INFO:tasks.workunit.client.0.smithi121.stdout:9/776: sync 2024-08-18T22:41:43.208 INFO:tasks.workunit.client.1.smithi195.stdout:0/424: symlink d0/dc/dd/l87 0 2024-08-18T22:41:43.209 INFO:tasks.workunit.client.1.smithi195.stdout:1/519: symlink da/d68/lb4 0 2024-08-18T22:41:43.212 INFO:tasks.workunit.client.1.smithi195.stdout:0/425: unlink d0/dc/d25/l4d 0 2024-08-18T22:41:43.213 INFO:tasks.workunit.client.1.smithi195.stdout:7/398: getdents dc/d1d 0 2024-08-18T22:41:43.214 INFO:tasks.workunit.client.0.smithi121.stdout:9/777: rename d0/d5/f9 to d0/d38/d9e/df/d3d/f103 0 2024-08-18T22:41:43.214 INFO:tasks.workunit.client.0.smithi121.stdout:0/652: link d1/d4/db/d24/df/d8/l4e d1/d4/db/d24/d30/le2 0 2024-08-18T22:41:43.215 INFO:tasks.workunit.client.1.smithi195.stdout:0/426: creat d0/dc/d25/d67/f88 x:0 0 0 2024-08-18T22:41:43.215 INFO:tasks.workunit.client.0.smithi121.stdout:9/778: stat d0/d38/d9e/df/d73/lef 0 2024-08-18T22:41:43.216 INFO:tasks.workunit.client.1.smithi195.stdout:7/399: rmdir dc/d2a 39 2024-08-18T22:41:43.216 INFO:tasks.workunit.client.0.smithi121.stdout:0/653: mkdir d1/d4/db/d24/df/d8/d71/de3 0 2024-08-18T22:41:43.218 INFO:tasks.workunit.client.1.smithi195.stdout:0/427: readlink d0/dc/d25/d67/l7b 0 2024-08-18T22:41:43.218 INFO:tasks.workunit.client.0.smithi121.stdout:0/654: rmdir d1/d4/db/d18/d40/d83/daf/dcb 39 2024-08-18T22:41:43.219 INFO:tasks.workunit.client.0.smithi121.stdout:0/655: rmdir d1/d47 39 2024-08-18T22:41:43.220 INFO:tasks.workunit.client.1.smithi195.stdout:0/428: chown d0/dc/d25/f1f 106204 1 2024-08-18T22:41:43.223 INFO:tasks.workunit.client.1.smithi195.stdout:7/400: dwrite dc/d1d/f88 [0,4194304] 0 2024-08-18T22:41:43.223 INFO:tasks.workunit.client.0.smithi121.stdout:0/656: link d1/d4/fb8 d1/d4/db/d24/df/d8/d78/d7c/dba/fe4 0 2024-08-18T22:41:43.224 INFO:tasks.workunit.client.1.smithi195.stdout:0/429: rename d0/dc/d25/f1e to d0/dc/d64/d81/f89 0 2024-08-18T22:41:43.225 INFO:tasks.workunit.client.1.smithi195.stdout:1/520: dread da/d18/d28/d31/d3b/f3c [0,4194304] 0 2024-08-18T22:41:43.226 INFO:tasks.workunit.client.0.smithi121.stdout:0/657: unlink d1/d4/db/d18/d1c/d5f/l9c 0 2024-08-18T22:41:43.227 INFO:tasks.workunit.client.1.smithi195.stdout:7/401: write dc/d2a/d56/f84 [15405,14468] 0 2024-08-18T22:41:43.228 INFO:tasks.workunit.client.0.smithi121.stdout:0/658: mknod d1/d4/db/d18/d1c/d5f/ce5 0 2024-08-18T22:41:43.228 INFO:tasks.workunit.client.1.smithi195.stdout:0/430: mknod d0/dc/d25/d67/c8a 0 2024-08-18T22:41:43.229 INFO:tasks.workunit.client.1.smithi195.stdout:1/521: rmdir da/d68 39 2024-08-18T22:41:43.233 INFO:tasks.workunit.client.1.smithi195.stdout:0/431: rmdir d0/dc/d64/d81/d44/d41/d6d 39 2024-08-18T22:41:43.233 INFO:tasks.workunit.client.0.smithi121.stdout:9/779: dwrite d0/d5/dd/d1a/dc8/dfa/dbf/f6f [0,4194304] 0 2024-08-18T22:41:43.233 INFO:tasks.workunit.client.0.smithi121.stdout:0/659: fdatasync d1/d4/db/d18/d40/d83/daf/dd5/d90/f98 0 2024-08-18T22:41:43.234 INFO:tasks.workunit.client.1.smithi195.stdout:1/522: creat da/d68/fb5 x:0 0 0 2024-08-18T22:41:43.234 INFO:tasks.workunit.client.0.smithi121.stdout:9/780: write d0/d38/d9e/df/f40 [2534160,125607] 0 2024-08-18T22:41:43.235 INFO:tasks.workunit.client.1.smithi195.stdout:0/432: creat d0/dc/d64/d81/d44/d41/d4c/d4f/d66/f8b x:0 0 0 2024-08-18T22:41:43.236 INFO:tasks.workunit.client.1.smithi195.stdout:1/523: chown da/d18/d28/f2e 4078884 1 2024-08-18T22:41:43.237 INFO:tasks.workunit.client.1.smithi195.stdout:0/433: write d0/dc/d11/d23/f70 [1194467,64022] 0 2024-08-18T22:41:43.238 INFO:tasks.workunit.client.0.smithi121.stdout:0/660: mknod d1/d4/db/d18/d40/d83/daf/dcb/ce6 0 2024-08-18T22:41:43.241 INFO:tasks.workunit.client.1.smithi195.stdout:1/524: mknod da/d18/cb6 0 2024-08-18T22:41:43.241 INFO:tasks.workunit.client.0.smithi121.stdout:9/781: mknod d0/d38/d9e/df/d61/db2/c104 0 2024-08-18T22:41:43.243 INFO:tasks.workunit.client.1.smithi195.stdout:0/434: creat d0/dc/d64/d81/d44/d41/d4c/d4f/f8c x:0 0 0 2024-08-18T22:41:43.244 INFO:tasks.workunit.client.0.smithi121.stdout:9/782: rename d0/d5/dd/d1a/dc8/dfa/dbf/f6c to d0/d38/d52/f105 0 2024-08-18T22:41:43.246 INFO:tasks.workunit.client.1.smithi195.stdout:7/402: dread dc/d1d/d29/f34 [0,4194304] 0 2024-08-18T22:41:43.246 INFO:tasks.workunit.client.1.smithi195.stdout:1/525: rename da/d18/l83 to da/d18/d28/lb7 0 2024-08-18T22:41:43.246 INFO:tasks.workunit.client.0.smithi121.stdout:9/783: mknod d0/d5/dd/d1a/d93/c106 0 2024-08-18T22:41:43.249 INFO:tasks.workunit.client.1.smithi195.stdout:7/403: unlink dc/d14/d15/d17/d18/f2d 0 2024-08-18T22:41:43.249 INFO:tasks.workunit.client.0.smithi121.stdout:9/784: fdatasync d0/d5/dd/d3b/d48/fc7 0 2024-08-18T22:41:43.250 INFO:tasks.workunit.client.1.smithi195.stdout:1/526: symlink da/d18/d28/d31/d77/lb8 0 2024-08-18T22:41:43.251 INFO:tasks.workunit.client.0.smithi121.stdout:0/661: dread d1/d4/da/d2f/da0/f3d [0,4194304] 0 2024-08-18T22:41:43.253 INFO:tasks.workunit.client.0.smithi121.stdout:9/785: creat d0/d5/dd/d1a/de0/f107 x:0 0 0 2024-08-18T22:41:43.255 INFO:tasks.workunit.client.1.smithi195.stdout:1/527: dread da/d4c/f69 [0,4194304] 0 2024-08-18T22:41:43.257 INFO:tasks.workunit.client.1.smithi195.stdout:7/404: dwrite dc/d14/d2b/f5e [0,4194304] 0 2024-08-18T22:41:43.258 INFO:tasks.workunit.client.1.smithi195.stdout:1/528: write da/d18/d28/d31/d3b/d4e/f6f [280092,44050] 0 2024-08-18T22:41:43.258 INFO:tasks.workunit.client.0.smithi121.stdout:9/786: write d0/d5/dd/d1a/d93/f94 [821001,95129] 0 2024-08-18T22:41:43.260 INFO:tasks.workunit.client.1.smithi195.stdout:0/435: dread d0/dc/dd/f3c [0,4194304] 0 2024-08-18T22:41:43.260 INFO:tasks.workunit.client.1.smithi195.stdout:1/529: dread - da/d18/d43/f87 zero size 2024-08-18T22:41:43.262 INFO:tasks.workunit.client.0.smithi121.stdout:1/768: sync 2024-08-18T22:41:43.263 INFO:tasks.workunit.client.1.smithi195.stdout:0/436: rmdir d0/dc/dd/d46 39 2024-08-18T22:41:43.263 INFO:tasks.workunit.client.0.smithi121.stdout:9/787: creat d0/d38/d9e/df/d3d/d89/dea/f108 x:0 0 0 2024-08-18T22:41:43.265 INFO:tasks.workunit.client.0.smithi121.stdout:9/788: stat d0/d38/d9e/df/d3d/d89/d92/la6 0 2024-08-18T22:41:43.265 INFO:tasks.workunit.client.1.smithi195.stdout:0/437: write d0/dc/d64/d81/d44/d41/d4c/d4f/d66/f86 [548599,58467] 0 2024-08-18T22:41:43.267 INFO:tasks.workunit.client.1.smithi195.stdout:0/438: mkdir d0/dc/d64/d81/d44/d41/d4c/d4f/d66/d8d 0 2024-08-18T22:41:43.268 INFO:tasks.workunit.client.0.smithi121.stdout:0/662: dread d1/d4/db/d24/df/f7 [0,4194304] 0 2024-08-18T22:41:43.268 INFO:tasks.workunit.client.1.smithi195.stdout:0/439: write d0/dc/d64/d81/d44/d41/d4c/f82 [722032,52123] 0 2024-08-18T22:41:43.269 INFO:tasks.workunit.client.0.smithi121.stdout:0/663: dread - d1/d4/db/fc4 zero size 2024-08-18T22:41:43.270 INFO:tasks.workunit.client.1.smithi195.stdout:0/440: mkdir d0/dc/d11/d23/d8e 0 2024-08-18T22:41:43.270 INFO:tasks.workunit.client.0.smithi121.stdout:0/664: truncate d1/d4/d53/fe0 366912 0 2024-08-18T22:41:43.271 INFO:tasks.workunit.client.0.smithi121.stdout:0/665: readlink d1/d4/db/d18/l89 0 2024-08-18T22:41:43.272 INFO:tasks.workunit.client.0.smithi121.stdout:9/789: truncate d0/d5/f30 4342342 0 2024-08-18T22:41:43.273 INFO:tasks.workunit.client.1.smithi195.stdout:0/441: dread d0/dc/d11/f15 [0,4194304] 0 2024-08-18T22:41:43.276 INFO:tasks.workunit.client.0.smithi121.stdout:9/790: creat d0/d38/d9e/d18/dfd/f109 x:0 0 0 2024-08-18T22:41:43.278 INFO:tasks.workunit.client.0.smithi121.stdout:0/666: getdents d1/d4/db/d18/d40/d83/daf/dcb 0 2024-08-18T22:41:43.278 INFO:tasks.workunit.client.0.smithi121.stdout:1/769: dwrite d5/d10/d14/d2a/d3a/d87/d6c/d6f/d82/d15/d28/d3d/dbd/fee [0,4194304] 0 2024-08-18T22:41:43.280 INFO:tasks.workunit.client.0.smithi121.stdout:1/770: chown d5/d10/d14/d2a/f5d 1332697 1 2024-08-18T22:41:43.282 INFO:tasks.workunit.client.0.smithi121.stdout:0/667: mkdir d1/d4/db/d24/d30/d6c/de7 0 2024-08-18T22:41:43.283 INFO:tasks.workunit.client.0.smithi121.stdout:9/791: truncate d0/d5/dd/d1a/dc8/dfa/d7f/f91 2749667 0 2024-08-18T22:41:43.283 INFO:tasks.workunit.client.0.smithi121.stdout:1/771: read - d5/d10/d14/d2a/d3a/d87/d6c/d6f/d82/ffe zero size 2024-08-18T22:41:43.285 INFO:tasks.workunit.client.0.smithi121.stdout:1/772: dread - d5/d10/d14/d34/f102 zero size 2024-08-18T22:41:43.287 INFO:tasks.workunit.client.0.smithi121.stdout:1/773: dread - d5/d10/d14/d2a/d3a/d87/d6c/d6f/d82/d15/d28/d3d/fd8 zero size 2024-08-18T22:41:43.289 INFO:tasks.workunit.client.1.smithi195.stdout:4/358: sync 2024-08-18T22:41:43.291 INFO:tasks.workunit.client.1.smithi195.stdout:4/359: write d0/d7/d1d/f47 [335708,3710] 0 2024-08-18T22:41:43.292 INFO:tasks.workunit.client.0.smithi121.stdout:1/774: unlink d5/d10/d14/d2a/d3a/d87/d6c/d6f/d82/d11/f6a 0 2024-08-18T22:41:43.294 INFO:tasks.workunit.client.0.smithi121.stdout:1/775: symlink d5/d10/l10a 0 2024-08-18T22:41:43.295 INFO:tasks.workunit.client.1.smithi195.stdout:0/442: unlink d0/dc/d25/f47 0 2024-08-18T22:41:43.295 INFO:tasks.workunit.client.0.smithi121.stdout:1/776: mkdir d5/d10b 0 2024-08-18T22:41:43.298 INFO:tasks.workunit.client.1.smithi195.stdout:4/360: dwrite d0/d7/d1d/f28 [0,4194304] 0 2024-08-18T22:41:43.299 INFO:tasks.workunit.client.1.smithi195.stdout:0/443: read d0/dc/d25/f54 [360321,18285] 0 2024-08-18T22:41:43.299 INFO:tasks.workunit.client.0.smithi121.stdout:1/777: rename d5/d10/d14/d34/f63 to d5/dcf/f10c 0 2024-08-18T22:41:43.300 INFO:tasks.workunit.client.1.smithi195.stdout:1/530: write da/d4c/d5d/d63/fa6 [932378,88752] 0 2024-08-18T22:41:43.300 INFO:tasks.workunit.client.1.smithi195.stdout:7/405: truncate dc/d14/d2b/f3a 61038 0 2024-08-18T22:41:43.300 INFO:tasks.workunit.client.0.smithi121.stdout:1/778: chown d5/d10/d67/dc2 898 1 2024-08-18T22:41:43.301 INFO:tasks.workunit.client.0.smithi121.stdout:9/792: dread d0/d5/f7d [0,4194304] 0 2024-08-18T22:41:43.301 INFO:tasks.workunit.client.0.smithi121.stdout:9/793: chown d0/d38/d9e/df/d73 71 1 2024-08-18T22:41:43.302 INFO:tasks.workunit.client.1.smithi195.stdout:4/361: rmdir d0/d7/d1d 39 2024-08-18T22:41:43.303 INFO:tasks.workunit.client.1.smithi195.stdout:4/362: readlink d0/d9/lc 0 2024-08-18T22:41:43.303 INFO:tasks.workunit.client.0.smithi121.stdout:1/779: creat d5/d10/d14/d92/d9f/f10d x:0 0 0 2024-08-18T22:41:43.304 INFO:tasks.workunit.client.1.smithi195.stdout:7/406: creat dc/d1d/f99 x:0 0 0 2024-08-18T22:41:43.306 INFO:tasks.workunit.client.0.smithi121.stdout:0/668: dread d1/d4/db/d18/d1c/f36 [4194304,4194304] 0 2024-08-18T22:41:43.306 INFO:tasks.workunit.client.1.smithi195.stdout:4/363: mkdir d0/d9/d41/d76 0 2024-08-18T22:41:43.307 INFO:tasks.workunit.client.1.smithi195.stdout:0/444: getdents d0/dc/d11/d23/d8e 0 2024-08-18T22:41:43.307 INFO:tasks.workunit.client.1.smithi195.stdout:4/364: stat d0/d9/l67 0 2024-08-18T22:41:43.308 INFO:tasks.workunit.client.0.smithi121.stdout:1/780: symlink d5/d10/d14/d2a/d3a/d87/d6c/d6f/d82/d15/d28/d3d/l10e 0 2024-08-18T22:41:43.309 INFO:tasks.workunit.client.1.smithi195.stdout:7/407: chown dc/d1d/d29/d5d/f6e 43091 1 2024-08-18T22:41:43.309 INFO:tasks.workunit.client.1.smithi195.stdout:7/408: chown dc/d14 0 1 2024-08-18T22:41:43.310 INFO:tasks.workunit.client.0.smithi121.stdout:0/669: truncate d1/d4/db/f1a 791844 0 2024-08-18T22:41:43.311 INFO:tasks.workunit.client.0.smithi121.stdout:1/781: read d5/d10/d14/d2a/d3a/fbe [173609,55982] 0 2024-08-18T22:41:43.312 INFO:tasks.workunit.client.0.smithi121.stdout:1/782: stat d5/d10/d14/d2a/d3a/d87/d6c/d6f/d82/d11 0 2024-08-18T22:41:43.313 INFO:tasks.workunit.client.1.smithi195.stdout:7/409: symlink dc/d14/d2b/d82/l9a 0 2024-08-18T22:41:43.313 INFO:tasks.workunit.client.0.smithi121.stdout:0/670: creat d1/d4/da/d2f/da0/fe8 x:0 0 0 2024-08-18T22:41:43.314 INFO:tasks.workunit.client.1.smithi195.stdout:0/445: mknod d0/dc/d64/d81/d44/d41/d6d/c8f 0 2024-08-18T22:41:43.314 INFO:tasks.workunit.client.1.smithi195.stdout:1/531: dread da/f29 [0,4194304] 0 2024-08-18T22:41:43.318 INFO:tasks.workunit.client.0.smithi121.stdout:9/794: truncate d0/d38/d9e/df/d3d/d89/faa 2774877 0 2024-08-18T22:41:43.318 INFO:tasks.workunit.client.0.smithi121.stdout:9/795: chown d0/d5/dd/fde 238450438 1 2024-08-18T22:41:43.318 INFO:tasks.workunit.client.1.smithi195.stdout:1/532: creat da/d3d/fb9 x:0 0 0 2024-08-18T22:41:43.318 INFO:tasks.workunit.client.0.smithi121.stdout:0/671: mknod d1/d4/db/d18/d40/d83/daf/ce9 0 2024-08-18T22:41:43.319 INFO:tasks.workunit.client.1.smithi195.stdout:7/410: mknod dc/d14/c9b 0 2024-08-18T22:41:43.320 INFO:tasks.workunit.client.0.smithi121.stdout:1/783: getdents d5 0 2024-08-18T22:41:43.321 INFO:tasks.workunit.client.1.smithi195.stdout:0/446: dwrite d0/f3 [0,4194304] 0 2024-08-18T22:41:43.323 INFO:tasks.workunit.client.0.smithi121.stdout:1/784: truncate d5/d10/d14/d2a/d3a/fe2 2609782 0 2024-08-18T22:41:43.324 INFO:tasks.workunit.client.1.smithi195.stdout:1/533: mkdir da/d18/d28/dba 0 2024-08-18T22:41:43.324 INFO:tasks.workunit.client.1.smithi195.stdout:7/411: mkdir dc/d14/d2b/d81/d9c 0 2024-08-18T22:41:43.327 INFO:tasks.workunit.client.1.smithi195.stdout:1/534: write da/d4c/f66 [135481,130961] 0 2024-08-18T22:41:43.328 INFO:tasks.workunit.client.1.smithi195.stdout:7/412: symlink dc/d14/d2b/d82/l9d 0 2024-08-18T22:41:43.333 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:41:43 smithi121 ceph-mon[16788]: from='client.? 172.21.15.121:0/2547825099' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-08-18T22:41:43.337 INFO:tasks.workunit.client.1.smithi195.stdout:7/413: rename dc/d1d/f99 to dc/d14/d2b/d81/d9c/f9e 0 2024-08-18T22:41:43.338 INFO:tasks.workunit.client.1.smithi195.stdout:1/535: link da/d4c/f66 da/d18/d28/d31/d3b/d4e/d95/d9c/fbb 0 2024-08-18T22:41:43.338 INFO:tasks.workunit.client.1.smithi195.stdout:7/414: write dc/d2a/f65 [632004,60137] 0 2024-08-18T22:41:43.339 INFO:tasks.workunit.client.1.smithi195.stdout:4/365: dread d0/f3 [0,4194304] 0 2024-08-18T22:41:43.340 INFO:tasks.workunit.client.1.smithi195.stdout:7/415: chown dc/d14/d15/f42 10943 1 2024-08-18T22:41:43.340 INFO:tasks.workunit.client.1.smithi195.stdout:1/536: creat da/d4c/d5d/fbc x:0 0 0 2024-08-18T22:41:43.342 INFO:tasks.workunit.client.0.smithi121.stdout:9/796: truncate d0/d5/dd/d2f/f5e 1269404 0 2024-08-18T22:41:43.342 INFO:tasks.workunit.client.1.smithi195.stdout:4/366: symlink d0/d9/d41/d66/l77 0 2024-08-18T22:41:43.343 INFO:tasks.workunit.client.1.smithi195.stdout:4/367: chown d0/d9/d11 0 1 2024-08-18T22:41:43.343 INFO:tasks.workunit.client.1.smithi195.stdout:1/537: mkdir da/d4c/d7a/dbd 0 2024-08-18T22:41:43.344 INFO:tasks.workunit.client.0.smithi121.stdout:1/785: dwrite d5/d10/d14/d2a/d3a/d87/fdf [0,4194304] 0 2024-08-18T22:41:43.345 INFO:tasks.workunit.client.0.smithi121.stdout:1/786: chown d5/d10/d14/d2a/d3a/d87/d6c/fcc 212264088 1 2024-08-18T22:41:43.345 INFO:tasks.workunit.client.0.smithi121.stdout:9/797: symlink d0/d5/dd/d1a/dc8/dfa/d7f/l10a 0 2024-08-18T22:41:43.349 INFO:tasks.workunit.client.0.smithi121.stdout:1/787: creat d5/d10/d14/d2a/d3a/d87/df1/f10f x:0 0 0 2024-08-18T22:41:43.352 INFO:tasks.workunit.client.1.smithi195.stdout:4/368: dwrite d0/d9/d11/d16/d37/f4e [0,4194304] 0 2024-08-18T22:41:43.352 INFO:tasks.workunit.client.1.smithi195.stdout:1/538: dread da/d4c/d5d/dac/fb0 [0,4194304] 0 2024-08-18T22:41:43.354 INFO:tasks.workunit.client.1.smithi195.stdout:1/539: dread da/d18/d28/d31/d3b/f3c [0,4194304] 0 2024-08-18T22:41:43.356 INFO:tasks.workunit.client.0.smithi121.stdout:9/798: write d0/d38/d9e/df/d61/db2/f51 [1411147,66595] 0 2024-08-18T22:41:43.357 INFO:tasks.workunit.client.1.smithi195.stdout:7/416: dread dc/d22/f7e [0,4194304] 0 2024-08-18T22:41:43.362 INFO:tasks.workunit.client.1.smithi195.stdout:4/369: link d0/d7/d1d/c29 d0/d9/d6c/c78 0 2024-08-18T22:41:43.363 INFO:tasks.workunit.client.1.smithi195.stdout:7/417: link dc/d1d/d29/d5d/c50 dc/c9f 0 2024-08-18T22:41:43.363 INFO:tasks.workunit.client.0.smithi121.stdout:1/788: dread d5/d10/d14/f90 [0,4194304] 0 2024-08-18T22:41:43.363 INFO:tasks.workunit.client.0.smithi121.stdout:9/799: write d0/d38/d52/f6d [732435,102227] 0 2024-08-18T22:41:43.364 INFO:tasks.workunit.client.0.smithi121.stdout:1/789: write d5/d10/d14/d34/fa2 [1120010,33919] 0 2024-08-18T22:41:43.364 INFO:tasks.workunit.client.1.smithi195.stdout:4/370: creat d0/d9/f79 x:0 0 0 2024-08-18T22:41:43.366 INFO:tasks.workunit.client.0.smithi121.stdout:9/800: mkdir d0/d38/d52/d5f/de1/d10b 0 2024-08-18T22:41:43.367 INFO:tasks.workunit.client.1.smithi195.stdout:4/371: symlink d0/d7/d1d/d69/l7a 0 2024-08-18T22:41:43.367 INFO:tasks.workunit.client.1.smithi195.stdout:7/418: dread dc/d1d/f88 [0,4194304] 0 2024-08-18T22:41:43.368 INFO:tasks.workunit.client.1.smithi195.stdout:7/419: stat dc/d14/d2b/d82/l9d 0 2024-08-18T22:41:43.369 INFO:tasks.workunit.client.1.smithi195.stdout:4/372: creat d0/f7b x:0 0 0 2024-08-18T22:41:43.370 INFO:tasks.workunit.client.0.smithi121.stdout:9/801: getdents d0/d38/d9e 0 2024-08-18T22:41:43.371 INFO:tasks.workunit.client.1.smithi195.stdout:7/420: creat dc/d14/d15/d4d/d97/fa0 x:0 0 0 2024-08-18T22:41:43.372 INFO:tasks.workunit.client.0.smithi121.stdout:9/802: symlink d0/d38/d9e/df/d3d/l10c 0 2024-08-18T22:41:43.372 INFO:tasks.workunit.client.0.smithi121.stdout:9/803: readlink d0/d38/d9e/d45/dba/lca 0 2024-08-18T22:41:43.373 INFO:tasks.workunit.client.1.smithi195.stdout:4/373: rename d0/d9/d11/d16/d54/c75 to d0/d9/d11/d16/d54/c7c 0 2024-08-18T22:41:43.374 INFO:tasks.workunit.client.1.smithi195.stdout:7/421: creat dc/d22/fa1 x:0 0 0 2024-08-18T22:41:43.374 INFO:tasks.workunit.client.1.smithi195.stdout:4/374: chown d0/d9/d11/d16/d37/d48/c51 91 1 2024-08-18T22:41:43.376 INFO:tasks.workunit.client.1.smithi195.stdout:4/375: mkdir d0/d7/d1d/d69/d7d 0 2024-08-18T22:41:43.377 INFO:tasks.workunit.client.0.smithi121.stdout:1/790: dwrite d5/d10/d14/d2a/d3a/f47 [0,4194304] 0 2024-08-18T22:41:43.381 INFO:tasks.workunit.client.1.smithi195.stdout:7/422: truncate dc/d14/d15/d17/d58/f5c 1317290 0 2024-08-18T22:41:43.381 INFO:tasks.workunit.client.0.smithi121.stdout:9/804: rename d0/d38/d9e/df/d73/fa5 to d0/d38/d9e/df/d61/db2/f10d 0 2024-08-18T22:41:43.383 INFO:tasks.workunit.client.0.smithi121.stdout:1/791: chown d5/d10/d14/d2a/d3a/d87/d6c/d6f/d82/c16 3 1 2024-08-18T22:41:43.385 INFO:tasks.workunit.client.0.smithi121.stdout:1/792: chown d5/d10/l24 7 1 2024-08-18T22:41:43.388 INFO:tasks.workunit.client.1.smithi195.stdout:7/423: dwrite dc/d14/d15/f42 [0,4194304] 0 2024-08-18T22:41:43.389 INFO:tasks.workunit.client.0.smithi121.stdout:9/805: dwrite d0/d38/d9e/df/d3d/fbd [0,4194304] 0 2024-08-18T22:41:43.391 INFO:tasks.workunit.client.1.smithi195.stdout:7/424: truncate dc/d14/d15/d17/d18/d89/f98 835588 0 2024-08-18T22:41:43.393 INFO:tasks.workunit.client.1.smithi195.stdout:7/425: write dc/d1d/d29/d5d/f6e [623700,44219] 0 2024-08-18T22:41:43.393 INFO:tasks.workunit.client.0.smithi121.stdout:1/793: rename d5/d10/d14/d2a/d3a/d87/d6c/d6f/d82/d15/d28/d3d/d9a/cd6 to d5/d10/d14/d92/c110 0 2024-08-18T22:41:43.394 INFO:tasks.workunit.client.0.smithi121.stdout:9/806: mknod d0/d38/d9e/df/d61/db2/dce/c10e 0 2024-08-18T22:41:43.396 INFO:tasks.workunit.client.0.smithi121.stdout:1/794: symlink d5/d10/d14/dfc/l111 0 2024-08-18T22:41:43.396 INFO:tasks.workunit.client.0.smithi121.stdout:9/807: write d0/d5/dd/fde [930856,18071] 0 2024-08-18T22:41:43.399 INFO:tasks.workunit.client.0.smithi121.stdout:1/795: readlink d5/d10/d14/dfc/l111 0 2024-08-18T22:41:43.399 INFO:tasks.workunit.client.1.smithi195.stdout:7/426: dwrite dc/d14/d15/d17/d58/f76 [0,4194304] 0 2024-08-18T22:41:43.400 INFO:tasks.workunit.client.0.smithi121.stdout:9/808: creat d0/d38/d9e/df/d73/f10f x:0 0 0 2024-08-18T22:41:43.402 INFO:tasks.workunit.client.1.smithi195.stdout:7/427: unlink dc/d2a/d4c/c92 0 2024-08-18T22:41:43.402 INFO:tasks.workunit.client.0.smithi121.stdout:9/809: fdatasync d0/d38/d9e/d18/fb9 0 2024-08-18T22:41:43.404 INFO:tasks.workunit.client.1.smithi195.stdout:7/428: symlink dc/d14/d15/d17/d18/la2 0 2024-08-18T22:41:43.405 INFO:tasks.workunit.client.1.smithi195.stdout:7/429: dread - dc/d14/d15/d17/d18/f75 zero size 2024-08-18T22:41:43.406 INFO:tasks.workunit.client.0.smithi121.stdout:9/810: creat d0/d5/dd/d3b/f110 x:0 0 0 2024-08-18T22:41:43.408 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:41:43 smithi195 ceph-mon[23370]: from='client.? 172.21.15.121:0/2547825099' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-08-18T22:41:43.421 INFO:tasks.workunit.client.0.smithi121.stdout:7/789: sync 2024-08-18T22:41:43.427 INFO:tasks.workunit.client.0.smithi121.stdout:9/811: truncate d0/d38/d9e/df/d3d/fbd 2652978 0 2024-08-18T22:41:43.429 INFO:tasks.workunit.client.0.smithi121.stdout:7/790: dwrite de/d98/dfb/dce/d34/d6c/fde [0,4194304] 0 2024-08-18T22:41:43.433 INFO:tasks.workunit.client.0.smithi121.stdout:9/812: dread d0/d5/f25 [0,4194304] 0 2024-08-18T22:41:43.434 INFO:tasks.workunit.client.0.smithi121.stdout:7/791: read de/d98/dfb/dce/d34/d38/d73/da2/d100/d18/d2e/dd7/dfd/f6b [4248384,93331] 0 2024-08-18T22:41:43.434 INFO:tasks.workunit.client.0.smithi121.stdout:1/796: dread d5/d10/d14/d2a/d3a/d87/d6c/d6f/f77 [0,4194304] 0 2024-08-18T22:41:43.438 INFO:tasks.workunit.client.0.smithi121.stdout:1/797: creat d5/d10/d14/dfc/f112 x:0 0 0 2024-08-18T22:41:43.439 INFO:tasks.workunit.client.0.smithi121.stdout:7/792: creat de/d98/dfb/dce/d34/d38/d73/da2/d100/d18/d2e/f102 x:0 0 0 2024-08-18T22:41:43.441 INFO:tasks.workunit.client.0.smithi121.stdout:7/793: rmdir de/d98/dfb/dce/d2f/d4b/d6d 39 2024-08-18T22:41:43.441 INFO:tasks.workunit.client.0.smithi121.stdout:1/798: truncate d5/d10/d14/d2a/d3a/d87/d6c/d6f/d82/d15/f5b 302395 0 2024-08-18T22:41:43.443 INFO:tasks.workunit.client.0.smithi121.stdout:7/794: rmdir de/d98/dfb/dce/d2f/d4b/daf 39 2024-08-18T22:41:43.445 INFO:tasks.workunit.client.0.smithi121.stdout:1/799: creat d5/d10/d14/d2a/d3a/d87/d6c/d6f/d79/dab/f113 x:0 0 0 2024-08-18T22:41:43.446 INFO:tasks.workunit.client.0.smithi121.stdout:7/795: mknod de/d98/dfb/dce/d2f/d36/c103 0 2024-08-18T22:41:43.447 INFO:tasks.workunit.client.0.smithi121.stdout:7/796: stat de/d98/dfb/dce/d20 0 2024-08-18T22:41:43.448 INFO:tasks.workunit.client.0.smithi121.stdout:1/800: write d5/d10/d14/d2a/d3a/d87/d6c/d6f/d82/d15/d28/d3d/dbd/fee [4042036,20514] 0 2024-08-18T22:41:43.449 INFO:tasks.workunit.client.0.smithi121.stdout:4/767: sync 2024-08-18T22:41:43.449 INFO:tasks.workunit.client.0.smithi121.stdout:5/649: sync 2024-08-18T22:41:43.449 INFO:tasks.workunit.client.0.smithi121.stdout:0/672: sync 2024-08-18T22:41:43.449 INFO:tasks.workunit.client.0.smithi121.stdout:2/492: sync 2024-08-18T22:41:43.449 INFO:tasks.workunit.client.0.smithi121.stdout:8/894: sync 2024-08-18T22:41:43.450 INFO:tasks.workunit.client.0.smithi121.stdout:3/730: sync 2024-08-18T22:41:43.452 INFO:tasks.workunit.client.0.smithi121.stdout:1/801: mkdir d5/d10/d67/dc2/df3/d114 0 2024-08-18T22:41:43.456 INFO:tasks.workunit.client.0.smithi121.stdout:4/768: chown d2/dc/f13 119 1 2024-08-18T22:41:43.456 INFO:tasks.workunit.client.0.smithi121.stdout:3/731: readlink d1e/d1f/d25/l7c 0 2024-08-18T22:41:43.458 INFO:tasks.workunit.client.0.smithi121.stdout:8/895: fdatasync d6/dd/d3b/da3/dca/d18/f12a 0 2024-08-18T22:41:43.460 INFO:tasks.workunit.client.0.smithi121.stdout:1/802: mkdir d5/d10/d14/d92/d9f/d115 0 2024-08-18T22:41:43.462 INFO:tasks.workunit.client.0.smithi121.stdout:0/673: symlink d1/d4/db/d18/d1c/d5f/lea 0 2024-08-18T22:41:43.464 INFO:tasks.workunit.client.0.smithi121.stdout:7/797: dwrite f8 [4194304,4194304] 0 2024-08-18T22:41:43.466 INFO:tasks.workunit.client.0.smithi121.stdout:5/650: dwrite d3/d5/f62 [0,4194304] 0 2024-08-18T22:41:43.467 INFO:tasks.workunit.client.0.smithi121.stdout:9/813: dread d0/d38/d9e/df/d61/f6e [0,4194304] 0 2024-08-18T22:41:43.467 INFO:tasks.workunit.client.0.smithi121.stdout:2/493: rename d2/d3/d48/d77/f26 to d2/d3/d51/fa2 0 2024-08-18T22:41:43.474 INFO:tasks.workunit.client.0.smithi121.stdout:3/732: unlink d1e/d1f/d25/d2e/d36/f37 0 2024-08-18T22:41:43.474 INFO:tasks.workunit.client.0.smithi121.stdout:2/494: write d2/d8/f3f [513851,91271] 0 2024-08-18T22:41:43.475 INFO:tasks.workunit.client.0.smithi121.stdout:0/674: symlink d1/d4/d53/leb 0 2024-08-18T22:41:43.477 INFO:tasks.workunit.client.0.smithi121.stdout:4/769: link d2/dc/d16/d22/fe4 d2/dc/d16/d47/dea/f11d 0 2024-08-18T22:41:43.480 INFO:tasks.workunit.client.0.smithi121.stdout:9/814: mknod d0/d5/dd/d1a/dc8/c111 0 2024-08-18T22:41:43.481 INFO:tasks.workunit.client.0.smithi121.stdout:8/896: dwrite d6/d1e/d2d/de5/fd2 [0,4194304] 0 2024-08-18T22:41:43.482 INFO:tasks.workunit.client.0.smithi121.stdout:2/495: chown d2/d8/d19/dc/l74 6321346 1 2024-08-18T22:41:43.486 INFO:tasks.workunit.client.0.smithi121.stdout:0/675: readlink d1/d4/db/d18/d40/d83/l8f 0 2024-08-18T22:41:43.487 INFO:tasks.workunit.client.0.smithi121.stdout:5/651: symlink d3/d5/d13/d19/d24/lcc 0 2024-08-18T22:41:43.487 INFO:tasks.workunit.client.0.smithi121.stdout:4/770: chown d2/dc/d1c/daa/fac 0 1 2024-08-18T22:41:43.488 INFO:tasks.workunit.client.0.smithi121.stdout:1/803: creat d5/d10/d14/d2a/d3a/d87/d6c/d6f/d82/d15/d28/d3d/d9a/dac/dd5/f116 x:0 0 0 2024-08-18T22:41:43.490 INFO:tasks.workunit.client.0.smithi121.stdout:9/815: symlink d0/d5/dd/d1a/dc8/dfa/dbf/d60/l112 0 2024-08-18T22:41:43.492 INFO:tasks.workunit.client.0.smithi121.stdout:3/733: mkdir d1e/d1f/d25/d67/d92/d111 0 2024-08-18T22:41:43.494 INFO:tasks.workunit.client.0.smithi121.stdout:4/771: write d2/dc/f13 [924019,32563] 0 2024-08-18T22:41:43.495 INFO:tasks.workunit.client.0.smithi121.stdout:7/798: mkdir de/d98/dfb/dce/d34/d38/d73/da2/d100/d18/d23/d24/d29/d104 0 2024-08-18T22:41:43.496 INFO:tasks.workunit.client.0.smithi121.stdout:1/804: creat d5/d10/d14/d34/f117 x:0 0 0 2024-08-18T22:41:43.497 INFO:tasks.workunit.client.0.smithi121.stdout:5/652: rmdir d3/d5/d13/d19/d24/d32/d38 39 2024-08-18T22:41:43.498 INFO:tasks.workunit.client.0.smithi121.stdout:2/496: creat d2/d8/fa3 x:0 0 0 2024-08-18T22:41:43.500 INFO:tasks.workunit.client.0.smithi121.stdout:1/805: read d5/d10/d14/d2a/f2f [787610,51810] 0 2024-08-18T22:41:43.501 INFO:tasks.workunit.client.0.smithi121.stdout:7/799: mknod de/d98/dfb/dce/d34/d38/d73/da2/d100/d18/d2e/dd7/c105 0 2024-08-18T22:41:43.503 INFO:tasks.workunit.client.0.smithi121.stdout:5/653: creat d3/d5/d13/d23/d81/fcd x:0 0 0 2024-08-18T22:41:43.506 INFO:tasks.workunit.client.0.smithi121.stdout:7/800: chown de/d98/dfb/dce/d34/d38/d73/da2/d100/d18/d2e/dd7/c105 0 1 2024-08-18T22:41:43.507 INFO:tasks.workunit.client.0.smithi121.stdout:2/497: dread d2/d3/d48/f71 [0,4194304] 0 2024-08-18T22:41:43.508 INFO:tasks.workunit.client.0.smithi121.stdout:2/498: stat d2/d8/d19/d55/f78 0 2024-08-18T22:41:43.509 INFO:tasks.workunit.client.0.smithi121.stdout:9/816: getdents d0/d5/dd/d1a/dc8/dfa/dbf/d60 0 2024-08-18T22:41:43.511 INFO:tasks.workunit.client.0.smithi121.stdout:5/654: fdatasync d3/d5/d13/d19/f30 0 2024-08-18T22:41:43.514 INFO:tasks.workunit.client.0.smithi121.stdout:2/499: fsync d2/d3/d48/d77/f8c 0 2024-08-18T22:41:43.519 INFO:tasks.workunit.client.0.smithi121.stdout:0/676: truncate d1/d4/db/d18/f58 2348385 0 2024-08-18T22:41:43.521 INFO:tasks.workunit.client.0.smithi121.stdout:1/806: truncate d5/d10/d14/d2a/d3a/d87/d6c/d6f/d82/d15/f37 2051473 0 2024-08-18T22:41:43.523 INFO:tasks.workunit.client.0.smithi121.stdout:8/897: dwrite d6/d20/d118/f11c [0,4194304] 0 2024-08-18T22:41:43.525 INFO:tasks.workunit.client.0.smithi121.stdout:2/500: mknod d2/d8/d1f/ca4 0 2024-08-18T22:41:43.526 INFO:tasks.workunit.client.0.smithi121.stdout:9/817: dwrite d0/d38/d9e/d18/dfd/f109 [0,4194304] 0 2024-08-18T22:41:43.534 INFO:tasks.workunit.client.0.smithi121.stdout:0/677: mknod d1/d4/db/d24/d30/d6c/cec 0 2024-08-18T22:41:43.536 INFO:tasks.workunit.client.0.smithi121.stdout:5/655: dwrite d3/d5/d13/d19/f30 [0,4194304] 0 2024-08-18T22:41:43.538 INFO:tasks.workunit.client.0.smithi121.stdout:4/772: dwrite d2/dc/d16/f79 [0,4194304] 0 2024-08-18T22:41:43.545 INFO:tasks.workunit.client.0.smithi121.stdout:9/818: fsync d0/d5/dd/d2f/f50 0 2024-08-18T22:41:43.546 INFO:tasks.workunit.client.0.smithi121.stdout:0/678: fdatasync d1/d4/db/d18/d40/d83/daf/dd5/d90/f98 0 2024-08-18T22:41:43.552 INFO:tasks.workunit.client.0.smithi121.stdout:4/773: rename d2/l10 to d2/dc/d8d/l11e 0 2024-08-18T22:41:43.555 INFO:tasks.workunit.client.0.smithi121.stdout:5/656: dread d3/d5/d3c/f7f [0,4194304] 0 2024-08-18T22:41:43.556 INFO:tasks.workunit.client.0.smithi121.stdout:8/898: dwrite d6/d20/d69/d77/fe4 [0,4194304] 0 2024-08-18T22:41:43.559 INFO:tasks.workunit.client.0.smithi121.stdout:9/819: fsync d0/d38/d52/d5f/fc5 0 2024-08-18T22:41:43.560 INFO:tasks.workunit.client.0.smithi121.stdout:1/807: dwrite d5/d10/d14/d2a/d3a/d87/f95 [0,4194304] 0 2024-08-18T22:41:43.562 INFO:tasks.workunit.client.0.smithi121.stdout:8/899: dread - d6/d1e/d2d/d78/d45/dd9/ff4 zero size 2024-08-18T22:41:43.562 INFO:tasks.workunit.client.0.smithi121.stdout:4/774: read d2/dc/d16/d22/d2c/d44/da7/ff2 [700486,118896] 0 2024-08-18T22:41:43.566 INFO:tasks.workunit.client.0.smithi121.stdout:1/808: symlink d5/l118 0 2024-08-18T22:41:43.567 INFO:tasks.workunit.client.0.smithi121.stdout:9/820: chown d0/d5/dd/d3b/lc4 60260 1 2024-08-18T22:41:43.569 INFO:tasks.workunit.client.0.smithi121.stdout:8/900: fdatasync d6/dd/d3b/fe8 0 2024-08-18T22:41:43.574 INFO:tasks.workunit.client.0.smithi121.stdout:4/775: mknod d2/dc/d16/d22/d2c/d7a/dbf/c11f 0 2024-08-18T22:41:43.577 INFO:tasks.workunit.client.0.smithi121.stdout:5/657: dwrite d3/d5/d3c/daf/fc3 [0,4194304] 0 2024-08-18T22:41:43.579 INFO:tasks.workunit.client.0.smithi121.stdout:8/901: creat d6/d1e/d2d/de5/f130 x:0 0 0 2024-08-18T22:41:43.579 INFO:tasks.workunit.client.0.smithi121.stdout:0/679: link d1/d4/db/d18/d40/d83/daf/dd5/c55 d1/d4/da/d2f/da0/ced 0 2024-08-18T22:41:43.581 INFO:tasks.workunit.client.0.smithi121.stdout:2/501: dwrite d2/d3/d51/fa2 [0,4194304] 0 2024-08-18T22:41:43.583 INFO:tasks.workunit.client.1.smithi195.stdout:5/371: sync 2024-08-18T22:41:43.583 INFO:tasks.workunit.client.1.smithi195.stdout:5/372: readlink d0/d2/l59 0 2024-08-18T22:41:43.586 INFO:tasks.workunit.client.1.smithi195.stdout:5/373: rmdir d0/d37 39 2024-08-18T22:41:43.588 INFO:tasks.workunit.client.1.smithi195.stdout:5/374: mknod d0/d2/d29/c71 0 2024-08-18T22:41:43.589 INFO:tasks.workunit.client.0.smithi121.stdout:9/821: rename d0/d5/dd/d1a/l71 to d0/d38/d9e/df/d3d/d89/d92/df0/l113 0 2024-08-18T22:41:43.589 INFO:tasks.workunit.client.1.smithi195.stdout:5/375: symlink d0/l72 0 2024-08-18T22:41:43.590 INFO:tasks.workunit.client.0.smithi121.stdout:5/658: stat d3/d5/d13/d19/d24/d32/d38/c40 0 2024-08-18T22:41:43.592 INFO:tasks.workunit.client.0.smithi121.stdout:9/822: write d0/d38/d9e/df/d3d/fd3 [1012166,100782] 0 2024-08-18T22:41:43.592 INFO:tasks.workunit.client.0.smithi121.stdout:8/902: mkdir d6/dd/d25/dc8/dce/d131 0 2024-08-18T22:41:43.594 INFO:tasks.workunit.client.0.smithi121.stdout:5/659: truncate d3/d5c/f69 967785 0 2024-08-18T22:41:43.596 INFO:tasks.workunit.client.0.smithi121.stdout:5/660: chown d3/d5/cf 2 1 2024-08-18T22:41:43.607 INFO:tasks.workunit.client.1.smithi195.stdout:5/376: dread d0/d3/df/f16 [0,4194304] 0 2024-08-18T22:41:43.607 INFO:tasks.workunit.client.1.smithi195.stdout:5/377: chown d0/d3/df 102 1 2024-08-18T22:41:43.610 INFO:tasks.workunit.client.1.smithi195.stdout:5/378: dread d0/d3/df/f16 [0,4194304] 0 2024-08-18T22:41:43.612 INFO:tasks.workunit.client.1.smithi195.stdout:5/379: unlink d0/db/f19 0 2024-08-18T22:41:43.613 INFO:tasks.workunit.client.1.smithi195.stdout:5/380: symlink d0/d2/d29/l73 0 2024-08-18T22:41:43.614 INFO:tasks.workunit.client.1.smithi195.stdout:5/381: creat d0/d3/df/f74 x:0 0 0 2024-08-18T22:41:43.622 INFO:tasks.workunit.client.1.smithi195.stdout:5/382: dwrite d0/f11 [4194304,4194304] 0 2024-08-18T22:41:43.624 INFO:tasks.workunit.client.1.smithi195.stdout:5/383: truncate d0/d2/d29/f67 900407 0 2024-08-18T22:41:43.624 INFO:tasks.workunit.client.1.smithi195.stdout:5/384: stat d0/d3 0 2024-08-18T22:41:43.625 INFO:tasks.workunit.client.1.smithi195.stdout:5/385: dread - d0/db/f6f zero size 2024-08-18T22:41:43.630 INFO:tasks.workunit.client.1.smithi195.stdout:5/386: dwrite d0/d3/f27 [0,4194304] 0 2024-08-18T22:41:43.631 INFO:tasks.workunit.client.1.smithi195.stdout:5/387: readlink d0/d2/l69 0 2024-08-18T22:41:43.634 INFO:tasks.workunit.client.1.smithi195.stdout:5/388: symlink d0/d46/d6d/l75 0 2024-08-18T22:41:43.639 INFO:tasks.workunit.client.1.smithi195.stdout:5/389: fdatasync d0/f11 0 2024-08-18T22:41:43.641 INFO:tasks.workunit.client.1.smithi195.stdout:5/390: creat d0/d3/df/f76 x:0 0 0 2024-08-18T22:41:43.652 INFO:tasks.workunit.client.1.smithi195.stdout:5/391: dread d0/d2/d29/f47 [0,4194304] 0 2024-08-18T22:41:43.654 INFO:tasks.workunit.client.1.smithi195.stdout:5/392: creat d0/f77 x:0 0 0 2024-08-18T22:41:43.655 INFO:tasks.workunit.client.1.smithi195.stdout:5/393: creat d0/db/f78 x:0 0 0 2024-08-18T22:41:43.660 INFO:tasks.workunit.client.1.smithi195.stdout:5/394: dwrite d0/d3/df/f76 [0,4194304] 0 2024-08-18T22:41:43.661 INFO:tasks.workunit.client.1.smithi195.stdout:5/395: truncate d0/db/f65 831130 0 2024-08-18T22:41:43.665 INFO:tasks.workunit.client.1.smithi195.stdout:6/282: sync 2024-08-18T22:41:43.665 INFO:tasks.workunit.client.1.smithi195.stdout:6/283: dread - da/db/d19/f45 zero size 2024-08-18T22:41:43.667 INFO:tasks.workunit.client.1.smithi195.stdout:6/284: readlink da/d15/d1c/d2e/l39 0 2024-08-18T22:41:43.667 INFO:tasks.workunit.client.1.smithi195.stdout:5/396: dwrite d0/d3/d8/d64/f70 [0,4194304] 0 2024-08-18T22:41:43.668 INFO:tasks.workunit.client.1.smithi195.stdout:5/397: chown d0/f1d 9 1 2024-08-18T22:41:43.669 INFO:tasks.workunit.client.0.smithi121.stdout:8/903: dwrite d6/dd/d3b/da3/dca/d18/f12a [0,4194304] 0 2024-08-18T22:41:43.670 INFO:tasks.workunit.client.0.smithi121.stdout:4/776: write d2/dc/d1c/f4b [874812,54829] 0 2024-08-18T22:41:43.673 INFO:tasks.workunit.client.1.smithi195.stdout:5/398: write d0/d2/d29/f47 [120655,119985] 0 2024-08-18T22:41:43.674 INFO:tasks.workunit.client.0.smithi121.stdout:4/777: symlink d2/d7c/l120 0 2024-08-18T22:41:43.676 INFO:tasks.workunit.client.0.smithi121.stdout:5/661: dwrite d3/d5/d27/f54 [4194304,4194304] 0 2024-08-18T22:41:43.676 INFO:tasks.workunit.client.1.smithi195.stdout:6/285: dwrite da/db/d19/f1d [4194304,4194304] 0 2024-08-18T22:41:43.678 INFO:tasks.workunit.client.0.smithi121.stdout:8/904: truncate d6/dd/ffa 411040 0 2024-08-18T22:41:43.681 INFO:tasks.workunit.client.0.smithi121.stdout:1/809: dwrite d5/d10/d14/d2a/d3a/d87/d6c/d6f/d82/d15/d28/d3d/dbd/fe5 [0,4194304] 0 2024-08-18T22:41:43.682 INFO:tasks.workunit.client.1.smithi195.stdout:6/286: read da/d15/f34 [2556489,96146] 0 2024-08-18T22:41:43.685 INFO:tasks.workunit.client.1.smithi195.stdout:5/399: dwrite d0/d3/d8/d64/f70 [0,4194304] 0 2024-08-18T22:41:43.686 INFO:tasks.workunit.client.0.smithi121.stdout:0/680: dread d1/d4/db/d24/d30/f3b [0,4194304] 0 2024-08-18T22:41:43.687 INFO:tasks.workunit.client.0.smithi121.stdout:4/778: mknod d2/dc/d16/d22/d2c/d44/da7/c121 0 2024-08-18T22:41:43.691 INFO:tasks.workunit.client.0.smithi121.stdout:8/905: link d6/d1e/fc1 d6/dd/dcc/de7/f132 0 2024-08-18T22:41:43.691 INFO:tasks.workunit.client.0.smithi121.stdout:2/502: dread d2/d8/d19/f7b [0,4194304] 0 2024-08-18T22:41:43.694 INFO:tasks.workunit.client.0.smithi121.stdout:5/662: dwrite d3/f2a [0,4194304] 0 2024-08-18T22:41:43.695 INFO:tasks.workunit.client.1.smithi195.stdout:5/400: mkdir d0/d2/d79 0 2024-08-18T22:41:43.696 INFO:tasks.workunit.client.1.smithi195.stdout:5/401: write d0/d3/df/f74 [31590,12634] 0 2024-08-18T22:41:43.697 INFO:tasks.workunit.client.0.smithi121.stdout:5/663: readlink d3/l86 0 2024-08-18T22:41:43.697 INFO:tasks.workunit.client.0.smithi121.stdout:2/503: stat d2/d3/d53/f66 0 2024-08-18T22:41:43.697 INFO:tasks.workunit.client.1.smithi195.stdout:6/287: link da/d22/c43 da/db/c52 0 2024-08-18T22:41:43.698 INFO:tasks.workunit.client.0.smithi121.stdout:4/779: mkdir d2/dc/d16/d22/d2c/d7a/da0/dcc/d122 0 2024-08-18T22:41:43.699 INFO:tasks.workunit.client.1.smithi195.stdout:6/288: rmdir da 39 2024-08-18T22:41:43.700 INFO:tasks.workunit.client.0.smithi121.stdout:1/810: rename d5/d10/d14/d2a/d3a/d87/d6c/d6f/d79/dab/f75 to d5/d10/d14/d2a/d3a/d87/d6c/f119 0 2024-08-18T22:41:43.703 INFO:tasks.workunit.client.1.smithi195.stdout:6/289: symlink da/d15/l53 0 2024-08-18T22:41:43.705 INFO:tasks.workunit.client.1.smithi195.stdout:6/290: readlink da/l1a 0 2024-08-18T22:41:43.706 INFO:tasks.workunit.client.1.smithi195.stdout:5/402: dwrite d0/db/f6f [0,4194304] 0 2024-08-18T22:41:43.708 INFO:tasks.workunit.client.1.smithi195.stdout:5/403: write d0/db/f5d [3193,79752] 0 2024-08-18T22:41:43.711 INFO:tasks.workunit.client.1.smithi195.stdout:5/404: chown d0/d37/c3e 1286635520 1 2024-08-18T22:41:43.712 INFO:tasks.workunit.client.1.smithi195.stdout:5/405: chown d0/d3/d5f 45242 1 2024-08-18T22:41:43.713 INFO:tasks.workunit.client.0.smithi121.stdout:1/811: unlink d5/d10/d14/d2a/d3a/d87/d6c/d6f/d82/d15/d28/d3d/l7b 0 2024-08-18T22:41:43.714 INFO:tasks.workunit.client.0.smithi121.stdout:1/812: read - d5/d10/f8b zero size 2024-08-18T22:41:43.715 INFO:tasks.workunit.client.1.smithi195.stdout:5/406: creat d0/d3/df/d5a/d62/d6a/f7a x:0 0 0 2024-08-18T22:41:43.719 INFO:tasks.workunit.client.0.smithi121.stdout:2/504: truncate d2/d8/d19/d4a/f4d 1750753 0 2024-08-18T22:41:43.720 INFO:tasks.workunit.client.0.smithi121.stdout:4/780: write d2/dc/d16/d22/f3d [3818808,99406] 0 2024-08-18T22:41:43.726 INFO:tasks.workunit.client.0.smithi121.stdout:8/906: dread d6/dd/d3b/da3/dca/f1d [0,4194304] 0 2024-08-18T22:41:43.726 INFO:tasks.workunit.client.0.smithi121.stdout:1/813: rename d5/d10/d14/d2a/d3a/d87/f95 to d5/d10/d14/d2a/d3a/d87/d6c/d6f/d82/d15/d38/f11a 0 2024-08-18T22:41:43.726 INFO:tasks.workunit.client.0.smithi121.stdout:4/781: dread - d2/dc/d16/d47/dea/f11d zero size 2024-08-18T22:41:43.726 INFO:tasks.workunit.client.0.smithi121.stdout:2/505: rename d2 to d2/d8/d19/dc/d67/da5 22 2024-08-18T22:41:43.726 INFO:tasks.workunit.client.0.smithi121.stdout:5/664: dwrite d3/d5/d13/d19/d24/d32/f3b [4194304,4194304] 0 2024-08-18T22:41:43.729 INFO:tasks.workunit.client.0.smithi121.stdout:4/782: chown d2/dc/d16/d22/d2c/d7a/fa3 2768692 1 2024-08-18T22:41:43.730 INFO:tasks.workunit.client.0.smithi121.stdout:8/907: dread d6/f7c [0,4194304] 0 2024-08-18T22:41:43.731 INFO:tasks.workunit.client.0.smithi121.stdout:8/908: stat d6/dd/d25/fd1 0 2024-08-18T22:41:43.735 INFO:tasks.workunit.client.0.smithi121.stdout:2/506: mknod d2/d8/d19/dc/ca6 0 2024-08-18T22:41:43.736 INFO:tasks.workunit.client.0.smithi121.stdout:2/507: chown d2/d8/d1f/l3d 85 1 2024-08-18T22:41:43.737 INFO:tasks.workunit.client.0.smithi121.stdout:5/665: rename d3/d5/d13/d23/d81 to d3/d5/d27/dce 0 2024-08-18T22:41:43.740 INFO:tasks.workunit.client.0.smithi121.stdout:4/783: write d2/f19 [2283071,44442] 0 2024-08-18T22:41:43.743 INFO:tasks.workunit.client.0.smithi121.stdout:2/508: chown d2/f1d 203 1 2024-08-18T22:41:43.747 INFO:tasks.workunit.client.0.smithi121.stdout:8/909: write d6/dd/d3b/da3/dca/d37/f50 [512331,116702] 0 2024-08-18T22:41:43.748 INFO:tasks.workunit.client.0.smithi121.stdout:2/509: mknod d2/d8/d19/ca7 0 2024-08-18T22:41:43.753 INFO:tasks.workunit.client.0.smithi121.stdout:1/814: getdents d5/d10/d14/d2a/d3a/d87/d6c/d6f/d82/d15/d28/d3d/d9a/dac 0 2024-08-18T22:41:43.754 INFO:tasks.workunit.client.0.smithi121.stdout:4/784: link d2/dc/d16/d59/d83/f9c d2/dc/d8d/da4/f123 0 2024-08-18T22:41:43.757 INFO:tasks.workunit.client.0.smithi121.stdout:2/510: getdents d2/d8/d9e 0 2024-08-18T22:41:43.760 INFO:tasks.workunit.client.0.smithi121.stdout:2/511: rmdir d2/d8/d19/d4a 39 2024-08-18T22:41:43.764 INFO:tasks.workunit.client.0.smithi121.stdout:2/512: rmdir d2/d8/d19/d55 39 2024-08-18T22:41:43.765 INFO:tasks.workunit.client.0.smithi121.stdout:5/666: dread d3/d5/d3c/f9e [0,4194304] 0 2024-08-18T22:41:43.766 INFO:tasks.workunit.client.0.smithi121.stdout:4/785: dwrite d2/dc/d16/d22/d2c/d44/f100 [0,4194304] 0 2024-08-18T22:41:43.768 INFO:tasks.workunit.client.0.smithi121.stdout:5/667: write d3/d5/d13/d23/f71 [1146130,55475] 0 2024-08-18T22:41:43.768 INFO:tasks.workunit.client.0.smithi121.stdout:8/910: dread d6/d1e/d2d/f97 [0,4194304] 0 2024-08-18T22:41:43.770 INFO:tasks.workunit.client.0.smithi121.stdout:2/513: mknod d2/ca8 0 2024-08-18T22:41:43.771 INFO:tasks.workunit.client.0.smithi121.stdout:5/668: mkdir d3/d5/d13/d19/d24/d4d/dad/d8b/dcf 0 2024-08-18T22:41:43.772 INFO:tasks.workunit.client.0.smithi121.stdout:1/815: dread d5/d10/d67/f85 [0,4194304] 0 2024-08-18T22:41:43.772 INFO:tasks.workunit.client.0.smithi121.stdout:8/911: fdatasync d6/dd/f16 0 2024-08-18T22:41:43.773 INFO:tasks.workunit.client.0.smithi121.stdout:8/912: readlink d6/dd/l6d 0 2024-08-18T22:41:43.774 INFO:tasks.workunit.client.0.smithi121.stdout:5/669: unlink d3/d5/d13/f16 0 2024-08-18T22:41:43.775 INFO:tasks.workunit.client.0.smithi121.stdout:8/913: chown d6/d1e/d2d/d78/d45 3 1 2024-08-18T22:41:43.776 INFO:tasks.workunit.client.0.smithi121.stdout:1/816: symlink d5/l11b 0 2024-08-18T22:41:43.777 INFO:tasks.workunit.client.0.smithi121.stdout:8/914: read d6/dd/d3b/da3/dca/d60/fb0 [1639365,1549] 0 2024-08-18T22:41:43.780 INFO:tasks.workunit.client.0.smithi121.stdout:1/817: write d5/d10/d14/d2a/d3a/d87/d6c/d6f/d82/d15/d28/d3d/dbd/fe5 [3772470,108440] 0 2024-08-18T22:41:43.781 INFO:tasks.workunit.client.0.smithi121.stdout:2/514: link d2/d73/f94 d2/d8/fa9 0 2024-08-18T22:41:43.783 INFO:tasks.workunit.client.0.smithi121.stdout:1/818: chown d5/d10/d14/d2a/d3a/d87/d6c/d6f/d79/dab/fa5 142481686 1 2024-08-18T22:41:43.785 INFO:tasks.workunit.client.0.smithi121.stdout:8/915: creat d6/dd/dcc/f133 x:0 0 0 2024-08-18T22:41:43.786 INFO:tasks.workunit.client.0.smithi121.stdout:2/515: creat d2/d3/d84/faa x:0 0 0 2024-08-18T22:41:43.789 INFO:tasks.workunit.client.0.smithi121.stdout:1/819: read d5/d10/d14/d2a/d3a/f66 [872328,105365] 0 2024-08-18T22:41:43.791 INFO:tasks.workunit.client.0.smithi121.stdout:2/516: creat d2/d3/d53/fab x:0 0 0 2024-08-18T22:41:43.792 INFO:tasks.workunit.client.0.smithi121.stdout:8/916: truncate d6/f7c 715727 0 2024-08-18T22:41:43.793 INFO:tasks.workunit.client.0.smithi121.stdout:1/820: write d5/d10/d14/d2a/d3a/d87/d6c/d6f/d82/d15/d38/f72 [1688883,72131] 0 2024-08-18T22:41:43.801 INFO:tasks.workunit.client.0.smithi121.stdout:2/517: write d2/f4b [3155575,70277] 0 2024-08-18T22:41:43.802 INFO:tasks.workunit.client.0.smithi121.stdout:8/917: truncate d6/f9 2095276 0 2024-08-18T22:41:43.804 INFO:tasks.workunit.client.0.smithi121.stdout:8/918: read - d6/dd/f121 zero size 2024-08-18T22:41:43.804 INFO:tasks.workunit.client.0.smithi121.stdout:5/670: dwrite d3/f2c [0,4194304] 0 2024-08-18T22:41:43.805 INFO:tasks.workunit.client.1.smithi195.stdout:2/261: sync 2024-08-18T22:41:43.805 INFO:tasks.workunit.client.1.smithi195.stdout:4/376: sync 2024-08-18T22:41:43.805 INFO:tasks.workunit.client.1.smithi195.stdout:3/438: sync 2024-08-18T22:41:43.805 INFO:tasks.workunit.client.1.smithi195.stdout:8/448: sync 2024-08-18T22:41:43.805 INFO:tasks.workunit.client.1.smithi195.stdout:1/540: sync 2024-08-18T22:41:43.805 INFO:tasks.workunit.client.1.smithi195.stdout:7/430: sync 2024-08-18T22:41:43.805 INFO:tasks.workunit.client.1.smithi195.stdout:9/450: sync 2024-08-18T22:41:43.805 INFO:tasks.workunit.client.1.smithi195.stdout:0/447: sync 2024-08-18T22:41:43.806 INFO:tasks.workunit.client.0.smithi121.stdout:2/518: rename d2/d8/d19/dc/l40 to d2/d8/d19/dc/lac 0 2024-08-18T22:41:43.807 INFO:tasks.workunit.client.1.smithi195.stdout:3/439: stat d7/d1f/l53 0 2024-08-18T22:41:43.808 INFO:tasks.workunit.client.1.smithi195.stdout:9/451: write d1c/f33 [4457068,113939] 0 2024-08-18T22:41:43.809 INFO:tasks.workunit.client.1.smithi195.stdout:8/449: rmdir d1/de/df/d1d 39 2024-08-18T22:41:43.810 INFO:tasks.workunit.client.0.smithi121.stdout:5/671: truncate d3/d5/d13/d23/d66/f9f 821132 0 2024-08-18T22:41:43.810 INFO:tasks.workunit.client.1.smithi195.stdout:7/431: rmdir dc/d1d/d29/d5d 39 2024-08-18T22:41:43.811 INFO:tasks.workunit.client.1.smithi195.stdout:1/541: truncate da/f1d 5487128 0 2024-08-18T22:41:43.814 INFO:tasks.workunit.client.1.smithi195.stdout:8/450: chown d1/d3/db/d35/f42 139 1 2024-08-18T22:41:43.818 INFO:tasks.workunit.client.1.smithi195.stdout:4/377: mknod d0/d7/d1d/d69/d7d/c7e 0 2024-08-18T22:41:43.821 INFO:tasks.workunit.client.1.smithi195.stdout:0/448: dwrite d0/dc/dd/f63 [0,4194304] 0 2024-08-18T22:41:43.821 INFO:tasks.workunit.client.0.smithi121.stdout:3/734: sync 2024-08-18T22:41:43.821 INFO:tasks.workunit.client.0.smithi121.stdout:8/919: dread d6/d1e/f3f [0,4194304] 0 2024-08-18T22:41:43.823 INFO:tasks.workunit.client.0.smithi121.stdout:3/735: dread - d1e/d1f/d3e/fec zero size 2024-08-18T22:41:43.823 INFO:tasks.workunit.client.0.smithi121.stdout:3/736: readlink d1e/d1f/da6/dc7/db8/l101 0 2024-08-18T22:41:43.824 INFO:tasks.workunit.client.0.smithi121.stdout:8/920: rmdir d6/dd/d25/dc8/dce 39 2024-08-18T22:41:43.824 INFO:tasks.workunit.client.0.smithi121.stdout:3/737: dread - d1e/d1f/d2a/fe7 zero size 2024-08-18T22:41:43.824 INFO:tasks.workunit.client.0.smithi121.stdout:8/921: dread - d6/d115/f117 zero size 2024-08-18T22:41:43.826 INFO:tasks.workunit.client.1.smithi195.stdout:3/440: rmdir d7/da/d75/d7a 0 2024-08-18T22:41:43.827 INFO:tasks.workunit.client.1.smithi195.stdout:9/452: creat d1c/d32/f91 x:0 0 0 2024-08-18T22:41:43.828 INFO:tasks.workunit.client.1.smithi195.stdout:7/432: dwrite dc/d14/d15/d17/d58/f76 [0,4194304] 0 2024-08-18T22:41:43.829 INFO:tasks.workunit.client.1.smithi195.stdout:4/378: creat d0/d7/d1d/d69/f7f x:0 0 0 2024-08-18T22:41:43.829 INFO:tasks.workunit.client.0.smithi121.stdout:3/738: mkdir d1e/de2/d112 0 2024-08-18T22:41:43.829 INFO:tasks.workunit.client.1.smithi195.stdout:9/453: chown d1c/d32/f52 128 1 2024-08-18T22:41:43.831 INFO:tasks.workunit.client.1.smithi195.stdout:2/262: truncate d1/d8/d27/f3a 209599 0 2024-08-18T22:41:43.831 INFO:tasks.workunit.client.0.smithi121.stdout:5/672: dread d3/d5/d13/d19/d24/d32/d38/f4e [0,4194304] 0 2024-08-18T22:41:43.832 INFO:tasks.workunit.client.0.smithi121.stdout:8/922: write d6/dd/d3b/f129 [471062,67951] 0 2024-08-18T22:41:43.832 INFO:tasks.workunit.client.0.smithi121.stdout:3/739: fdatasync d1e/d1f/d25/d2e/d36/f68 0 2024-08-18T22:41:43.836 INFO:tasks.workunit.client.1.smithi195.stdout:8/451: dread d1/d3/db/d39/d44/f6b [0,4194304] 0 2024-08-18T22:41:43.836 INFO:tasks.workunit.client.1.smithi195.stdout:2/263: creat d1/d24/f56 x:0 0 0 2024-08-18T22:41:43.836 INFO:tasks.workunit.client.1.smithi195.stdout:7/433: chown dc/d14/d15/d17/d18/la2 3543307 1 2024-08-18T22:41:43.836 INFO:tasks.workunit.client.0.smithi121.stdout:5/673: symlink d3/d5/d13/d23/da4/da6/ld0 0 2024-08-18T22:41:43.836 INFO:tasks.workunit.client.1.smithi195.stdout:9/454: mkdir d1c/d92 0 2024-08-18T22:41:43.837 INFO:tasks.workunit.client.1.smithi195.stdout:0/449: getdents d0/dc/d64/d81/d44 0 2024-08-18T22:41:43.838 INFO:tasks.workunit.client.1.smithi195.stdout:4/379: creat d0/d7/f80 x:0 0 0 2024-08-18T22:41:43.838 INFO:tasks.workunit.client.1.smithi195.stdout:8/452: dread - d1/de/fa8 zero size 2024-08-18T22:41:43.839 INFO:tasks.workunit.client.0.smithi121.stdout:5/674: rmdir d3/d5/d27/d35/d53 39 2024-08-18T22:41:43.840 INFO:tasks.workunit.client.1.smithi195.stdout:6/291: sync 2024-08-18T22:41:43.840 INFO:tasks.workunit.client.0.smithi121.stdout:3/740: rename d1e/d1f/d25/d2e/d36/ddb to d1e/d1f/dba/d113 0 2024-08-18T22:41:43.842 INFO:tasks.workunit.client.1.smithi195.stdout:9/455: read d1c/f2c [2577369,74574] 0 2024-08-18T22:41:43.843 INFO:tasks.workunit.client.0.smithi121.stdout:3/741: fdatasync d1e/d1f/d25/d58/df7/de3/ffe 0 2024-08-18T22:41:43.845 INFO:tasks.workunit.client.0.smithi121.stdout:3/742: rmdir d1e/d1f/dba 39 2024-08-18T22:41:43.846 INFO:tasks.workunit.client.1.smithi195.stdout:3/441: dwrite d7/da/f14 [0,4194304] 0 2024-08-18T22:41:43.846 INFO:tasks.workunit.client.0.smithi121.stdout:5/675: dwrite d3/f46 [0,4194304] 0 2024-08-18T22:41:43.846 INFO:tasks.workunit.client.1.smithi195.stdout:1/542: dwrite da/f60 [0,4194304] 0 2024-08-18T22:41:43.847 INFO:tasks.workunit.client.0.smithi121.stdout:3/743: chown d1e/d1f/da6/dc7 20496 1 2024-08-18T22:41:43.848 INFO:tasks.workunit.client.0.smithi121.stdout:5/676: stat d3/d5/d13/d23/da4/da6/ld0 0 2024-08-18T22:41:43.850 INFO:tasks.workunit.client.1.smithi195.stdout:0/450: fsync d0/dc/d64/d81/d44/d41/f5d 0 2024-08-18T22:41:43.851 INFO:tasks.workunit.client.1.smithi195.stdout:9/456: dread - d1c/f4e zero size 2024-08-18T22:41:43.851 INFO:tasks.workunit.client.0.smithi121.stdout:8/923: truncate d6/d20/d69/d77/f88 2100511 0 2024-08-18T22:41:43.851 INFO:tasks.workunit.client.1.smithi195.stdout:8/453: mkdir d1/d3/d1c/d21/daa 0 2024-08-18T22:41:43.852 INFO:tasks.workunit.client.0.smithi121.stdout:3/744: mkdir d1e/d1f/dba/d113/d114 0 2024-08-18T22:41:43.853 INFO:tasks.workunit.client.0.smithi121.stdout:5/677: link d3/d5/d13/l17 d3/d5/d27/dce/db5/ld1 0 2024-08-18T22:41:43.854 INFO:tasks.workunit.client.1.smithi195.stdout:2/264: rename d1/d24/d26/f37 to d1/d24/d26/d42/d44/f57 0 2024-08-18T22:41:43.856 INFO:tasks.workunit.client.0.smithi121.stdout:8/924: symlink d6/dd/d25/dc8/dce/l134 0 2024-08-18T22:41:43.859 INFO:tasks.workunit.client.1.smithi195.stdout:0/451: write d0/dc/d25/d67/f88 [28080,87402] 0 2024-08-18T22:41:43.863 INFO:tasks.workunit.client.1.smithi195.stdout:7/434: dwrite dc/d1d/f88 [0,4194304] 0 2024-08-18T22:41:43.863 INFO:tasks.workunit.client.1.smithi195.stdout:3/442: chown d7/d1f/c88 22471944 1 2024-08-18T22:41:43.865 INFO:tasks.workunit.client.0.smithi121.stdout:5/678: dwrite d3/d5/d3c/f9e [0,4194304] 0 2024-08-18T22:41:43.871 INFO:tasks.workunit.client.1.smithi195.stdout:1/543: rename da/d18/d28/c49 to da/d18/d28/dba/cbe 0 2024-08-18T22:41:43.874 INFO:tasks.workunit.client.0.smithi121.stdout:3/745: dwrite d1e/d1f/fc3 [0,4194304] 0 2024-08-18T22:41:43.876 INFO:tasks.workunit.client.0.smithi121.stdout:8/925: dwrite d6/dd/d3b/da3/dca/d37/f109 [0,4194304] 0 2024-08-18T22:41:43.879 INFO:tasks.workunit.client.1.smithi195.stdout:6/292: dwrite da/db/d19/f23 [0,4194304] 0 2024-08-18T22:41:43.880 INFO:tasks.workunit.client.0.smithi121.stdout:5/679: truncate d3/d5/d13/d19/d75/f87 547557 0 2024-08-18T22:41:43.880 INFO:tasks.workunit.client.0.smithi121.stdout:8/926: dread - d6/dd/dcc/de7/feb zero size 2024-08-18T22:41:43.880 INFO:tasks.workunit.client.1.smithi195.stdout:8/454: dwrite d1/d3/db/d7a/f94 [0,4194304] 0 2024-08-18T22:41:43.882 INFO:tasks.workunit.client.1.smithi195.stdout:5/407: sync 2024-08-18T22:41:43.884 INFO:tasks.workunit.client.0.smithi121.stdout:3/746: symlink d1e/d1f/d25/d58/de0/l115 0 2024-08-18T22:41:43.885 INFO:tasks.workunit.client.1.smithi195.stdout:1/544: truncate da/d68/fb5 577612 0 2024-08-18T22:41:43.886 INFO:tasks.workunit.client.1.smithi195.stdout:6/293: dread - da/f40 zero size 2024-08-18T22:41:43.886 INFO:tasks.workunit.client.1.smithi195.stdout:9/457: dwrite d1c/f58 [0,4194304] 0 2024-08-18T22:41:43.887 INFO:tasks.workunit.client.1.smithi195.stdout:2/265: dwrite d1/d24/f56 [0,4194304] 0 2024-08-18T22:41:43.891 INFO:tasks.workunit.client.1.smithi195.stdout:5/408: readlink d0/db/l20 0 2024-08-18T22:41:43.891 INFO:tasks.workunit.client.0.smithi121.stdout:8/927: read d6/dd/dcc/de7/ff3 [12246650,15645] 0 2024-08-18T22:41:43.892 INFO:tasks.workunit.client.1.smithi195.stdout:5/409: readlink d0/d37/l52 0 2024-08-18T22:41:43.893 INFO:tasks.workunit.client.0.smithi121.stdout:5/680: symlink d3/d5/d13/d23/da4/da6/dc4/ld2 0 2024-08-18T22:41:43.893 INFO:tasks.workunit.client.1.smithi195.stdout:2/266: fsync d1/d24/d26/f2b 0 2024-08-18T22:41:43.893 INFO:tasks.workunit.client.0.smithi121.stdout:8/928: write d6/dd/d3b/da3/dca/d60/fd5 [1193316,12669] 0 2024-08-18T22:41:43.894 INFO:tasks.workunit.client.1.smithi195.stdout:6/294: chown da/d15/f31 0 1 2024-08-18T22:41:43.894 INFO:tasks.workunit.client.1.smithi195.stdout:7/435: creat dc/d1d/d29/d5d/fa3 x:0 0 0 2024-08-18T22:41:43.895 INFO:tasks.workunit.client.0.smithi121.stdout:3/747: rename d1e/d1f/da6/dc7/db8/d104/dbc to d1e/d1f/dba/d113/d116 0 2024-08-18T22:41:43.898 INFO:tasks.workunit.client.1.smithi195.stdout:8/455: creat d1/de/fab x:0 0 0 2024-08-18T22:41:43.899 INFO:tasks.workunit.client.1.smithi195.stdout:4/380: dwrite d0/d9/d11/d16/d49/f46 [0,4194304] 0 2024-08-18T22:41:43.899 INFO:tasks.workunit.client.0.smithi121.stdout:5/681: write d3/d5/d13/d19/d24/d32/da8/fb7 [835184,44859] 0 2024-08-18T22:41:43.900 INFO:tasks.workunit.client.1.smithi195.stdout:9/458: creat d1c/d74/d8e/f93 x:0 0 0 2024-08-18T22:41:43.902 INFO:tasks.workunit.client.1.smithi195.stdout:2/267: mknod d1/d24/d26/d42/d50/c58 0 2024-08-18T22:41:43.902 INFO:tasks.workunit.client.1.smithi195.stdout:4/381: dread - d0/d9/d11/d16/f61 zero size 2024-08-18T22:41:43.905 INFO:tasks.workunit.client.1.smithi195.stdout:8/456: mkdir d1/de/dac 0 2024-08-18T22:41:43.905 INFO:tasks.workunit.client.1.smithi195.stdout:2/268: write d1/d24/d26/d42/f43 [1615967,7987] 0 2024-08-18T22:41:43.905 INFO:tasks.workunit.client.1.smithi195.stdout:5/410: mknod d0/d2/d79/c7b 0 2024-08-18T22:41:43.906 INFO:tasks.workunit.client.0.smithi121.stdout:3/748: rename d1e/d1f/d25/d6b/c7f to d1e/d1f/d25/d58/d75/d8c/c117 0 2024-08-18T22:41:43.907 INFO:tasks.workunit.client.0.smithi121.stdout:5/682: fdatasync d3/d5/d3c/f7f 0 2024-08-18T22:41:43.909 INFO:tasks.workunit.client.0.smithi121.stdout:8/929: dwrite d6/dd/d3b/da3/dca/d37/f50 [0,4194304] 0 2024-08-18T22:41:43.909 INFO:tasks.workunit.client.1.smithi195.stdout:1/545: rename da/d3d/f48 to da/d18/d28/d31/fbf 0 2024-08-18T22:41:43.909 INFO:tasks.workunit.client.1.smithi195.stdout:5/411: write d0/db/f65 [488368,119195] 0 2024-08-18T22:41:43.912 INFO:tasks.workunit.client.0.smithi121.stdout:5/683: mkdir d3/d5/d3c/dd3 0 2024-08-18T22:41:43.913 INFO:tasks.workunit.client.1.smithi195.stdout:0/452: link d0/dc/dd/d46/c4b d0/dc/d64/d81/d44/d41/d4c/d4f/d66/d8d/c90 0 2024-08-18T22:41:43.914 INFO:tasks.workunit.client.1.smithi195.stdout:6/295: dwrite da/d15/f34 [0,4194304] 0 2024-08-18T22:41:43.915 INFO:tasks.workunit.client.1.smithi195.stdout:8/457: truncate d1/d3/d1c/d21/f62 4428815 0 2024-08-18T22:41:43.915 INFO:tasks.workunit.client.0.smithi121.stdout:5/684: symlink d3/d5c/ld4 0 2024-08-18T22:41:43.917 INFO:tasks.workunit.client.0.smithi121.stdout:8/930: link d6/d1e/d2d/d78/d45/d86/cc3 d6/d1e/d2d/d78/d45/d86/ded/c135 0 2024-08-18T22:41:43.918 INFO:tasks.workunit.client.1.smithi195.stdout:1/546: mknod da/d4c/d5d/cc0 0 2024-08-18T22:41:43.919 INFO:tasks.workunit.client.1.smithi195.stdout:4/382: truncate d0/d7/d1d/f27 1178890 0 2024-08-18T22:41:43.920 INFO:tasks.workunit.client.0.smithi121.stdout:5/685: mkdir d3/dd5 0 2024-08-18T22:41:43.920 INFO:tasks.workunit.client.1.smithi195.stdout:6/296: write da/d3b/f49 [766335,122851] 0 2024-08-18T22:41:43.923 INFO:tasks.workunit.client.0.smithi121.stdout:5/686: creat d3/d5/d13/d19/da3/fd6 x:0 0 0 2024-08-18T22:41:43.924 INFO:tasks.workunit.client.0.smithi121.stdout:8/931: getdents d6/d20 0 2024-08-18T22:41:43.924 INFO:tasks.workunit.client.1.smithi195.stdout:2/269: creat d1/f59 x:0 0 0 2024-08-18T22:41:43.927 INFO:tasks.workunit.client.1.smithi195.stdout:5/412: mkdir d0/d7c 0 2024-08-18T22:41:43.927 INFO:tasks.workunit.client.1.smithi195.stdout:4/383: chown d0/d7/d1d/f2f 32495 1 2024-08-18T22:41:43.927 INFO:tasks.workunit.client.1.smithi195.stdout:6/297: write da/d15/d1c/f28 [2349037,89761] 0 2024-08-18T22:41:43.928 INFO:tasks.workunit.client.0.smithi121.stdout:8/932: fsync d6/d20/f26 0 2024-08-18T22:41:43.929 INFO:tasks.workunit.client.0.smithi121.stdout:5/687: symlink d3/d5/d13/d19/d24/d32/da8/ld7 0 2024-08-18T22:41:43.929 INFO:tasks.workunit.client.1.smithi195.stdout:6/298: readlink da/d15/d1c/d2e/l39 0 2024-08-18T22:41:43.929 INFO:tasks.workunit.client.1.smithi195.stdout:0/453: creat d0/dc/d64/d81/d44/d41/d4c/d4f/f91 x:0 0 0 2024-08-18T22:41:43.929 INFO:tasks.workunit.client.1.smithi195.stdout:6/299: chown da/d3b 34 1 2024-08-18T22:41:43.929 INFO:tasks.workunit.client.1.smithi195.stdout:6/300: write da/d15/f31 [636523,117040] 0 2024-08-18T22:41:43.930 INFO:tasks.workunit.client.0.smithi121.stdout:8/933: chown d6/dd/d3b/da3/dca/d60/df8 5 1 2024-08-18T22:41:43.931 INFO:tasks.workunit.client.0.smithi121.stdout:5/688: truncate d3/d5/d13/d23/da4/fc5 5215297 0 2024-08-18T22:41:43.931 INFO:tasks.workunit.client.1.smithi195.stdout:2/270: write d1/d24/d26/f40 [4532855,92495] 0 2024-08-18T22:41:43.933 INFO:tasks.workunit.client.0.smithi121.stdout:5/689: write d3/d5/d3c/d3f/d8f/fa5 [440489,59127] 0 2024-08-18T22:41:43.935 INFO:tasks.workunit.client.1.smithi195.stdout:5/413: rename d0/d3/df/d1a/c51 to d0/d3/d8/c7d 0 2024-08-18T22:41:43.937 INFO:tasks.workunit.client.1.smithi195.stdout:0/454: unlink d0/dc/d64/d81/d44/d41/d4c/d4f/f8c 0 2024-08-18T22:41:43.938 INFO:tasks.workunit.client.1.smithi195.stdout:5/414: write d0/d46/f63 [66911,27674] 0 2024-08-18T22:41:43.939 INFO:tasks.workunit.client.1.smithi195.stdout:0/455: dread - d0/dc/d64/d81/d44/d41/f73 zero size 2024-08-18T22:41:43.940 INFO:tasks.workunit.client.1.smithi195.stdout:6/301: getdents da/db/d19 0 2024-08-18T22:41:43.941 INFO:tasks.workunit.client.1.smithi195.stdout:6/302: write da/d15/f2c [1461346,72287] 0 2024-08-18T22:41:43.942 INFO:tasks.workunit.client.1.smithi195.stdout:0/456: fsync d0/dc/d11/f20 0 2024-08-18T22:41:43.945 INFO:tasks.workunit.client.1.smithi195.stdout:5/415: creat d0/d3/f7e x:0 0 0 2024-08-18T22:41:43.945 INFO:tasks.workunit.client.0.smithi121.stdout:3/749: dread d1e/d1f/dba/d113/feb [0,4194304] 0 2024-08-18T22:41:43.945 INFO:tasks.workunit.client.0.smithi121.stdout:3/750: dread - d1e/d1f/d3e/f10e zero size 2024-08-18T22:41:43.946 INFO:tasks.workunit.client.1.smithi195.stdout:5/416: dread - d0/d3/d5f/f6b zero size 2024-08-18T22:41:43.950 INFO:tasks.workunit.client.1.smithi195.stdout:6/303: dwrite da/db/f21 [0,4194304] 0 2024-08-18T22:41:43.957 INFO:tasks.workunit.client.1.smithi195.stdout:9/459: write d1c/d70/f86 [1263004,12263] 0 2024-08-18T22:41:43.960 INFO:tasks.workunit.client.1.smithi195.stdout:8/458: write d1/d3/db/d39/d2e/f61 [664628,56685] 0 2024-08-18T22:41:43.963 INFO:tasks.workunit.client.0.smithi121.stdout:3/751: dread d1e/d1f/dba/df6/fa8 [0,4194304] 0 2024-08-18T22:41:43.963 INFO:tasks.workunit.client.1.smithi195.stdout:1/547: write da/d18/d28/f2f [708417,65224] 0 2024-08-18T22:41:43.965 INFO:tasks.workunit.client.0.smithi121.stdout:3/752: rmdir d1e/d1f/d25/d58/d75 39 2024-08-18T22:41:43.966 INFO:tasks.workunit.client.1.smithi195.stdout:0/457: rename d0/dc/d64/d81/d44/d41/d4c/d4f to d0/dc/d64/d81/d44/d41/d6d/d92 0 2024-08-18T22:41:43.966 INFO:tasks.workunit.client.1.smithi195.stdout:8/459: write d1/d3/db/f5d [622614,60107] 0 2024-08-18T22:41:43.967 INFO:tasks.workunit.client.1.smithi195.stdout:2/271: write d1/d22/f31 [573804,119046] 0 2024-08-18T22:41:43.968 INFO:tasks.workunit.client.0.smithi121.stdout:5/690: getdents d3 0 2024-08-18T22:41:43.971 INFO:tasks.workunit.client.1.smithi195.stdout:6/304: rename da/db/d2a/l4b to da/db/d19/l54 0 2024-08-18T22:41:43.971 INFO:tasks.workunit.client.1.smithi195.stdout:5/417: write d0/d46/f6c [2575051,82199] 0 2024-08-18T22:41:43.972 INFO:tasks.workunit.client.0.smithi121.stdout:5/691: truncate d3/d5/d27/f2e 2796150 0 2024-08-18T22:41:43.973 INFO:tasks.workunit.client.0.smithi121.stdout:5/692: unlink d3/d5/d27/c49 0 2024-08-18T22:41:43.976 INFO:tasks.workunit.client.0.smithi121.stdout:5/693: chown d3/d5/d27/d35/f5d 25918 1 2024-08-18T22:41:43.985 INFO:tasks.workunit.client.0.smithi121.stdout:3/753: dwrite d1e/d1f/f4f [0,4194304] 0 2024-08-18T22:41:43.993 INFO:tasks.workunit.client.0.smithi121.stdout:3/754: write d1e/d1f/d25/d74/d97/fee [4564712,74561] 0 2024-08-18T22:41:44.004 INFO:tasks.workunit.client.0.smithi121.stdout:7/801: sync 2024-08-18T22:41:44.004 INFO:tasks.workunit.client.0.smithi121.stdout:3/755: mknod d1e/d1f/d25/d6b/d81/dfa/c118 0 2024-08-18T22:41:44.010 INFO:tasks.workunit.client.0.smithi121.stdout:3/756: truncate d1e/d1f/d25/d2e/d36/d5f/dd2/ff2 1263989 0 2024-08-18T22:41:44.011 INFO:tasks.workunit.client.0.smithi121.stdout:3/757: chown d1e/d1f/d3e/f10e 114 1 2024-08-18T22:41:44.013 INFO:tasks.workunit.client.0.smithi121.stdout:3/758: dread - d1e/d1f/d25/d58/d75/ff4 zero size 2024-08-18T22:41:44.021 INFO:tasks.workunit.client.0.smithi121.stdout:7/802: dread de/d98/dfb/dce/d34/d38/d73/da2/d100/d18/d2e/dd7/dfd/f6b [0,4194304] 0 2024-08-18T22:41:44.022 INFO:tasks.workunit.client.0.smithi121.stdout:3/759: dwrite d1e/d1f/d25/d2e/d36/f86 [0,4194304] 0 2024-08-18T22:41:44.024 INFO:tasks.workunit.client.0.smithi121.stdout:7/803: truncate de/d65/fb1 1140993 0 2024-08-18T22:41:44.024 INFO:tasks.workunit.client.0.smithi121.stdout:7/804: dread - de/d2d/d50/db7/fe8 zero size 2024-08-18T22:41:44.030 INFO:tasks.workunit.client.0.smithi121.stdout:7/805: creat de/d98/dfb/dce/f106 x:0 0 0 2024-08-18T22:41:44.030 INFO:tasks.workunit.client.1.smithi195.stdout:4/384: dwrite d0/d9/d11/f3a [4194304,4194304] 0 2024-08-18T22:41:44.032 INFO:tasks.workunit.client.1.smithi195.stdout:0/458: truncate d0/dc/d11/f15 3526643 0 2024-08-18T22:41:44.035 INFO:tasks.workunit.client.1.smithi195.stdout:9/460: dwrite fd [0,4194304] 0 2024-08-18T22:41:44.035 INFO:tasks.workunit.client.1.smithi195.stdout:1/548: rename da/d18/d28/d31/d3b/c5e to da/d18/d28/d31/d3b/d4e/d95/d9c/cc1 0 2024-08-18T22:41:44.038 INFO:tasks.workunit.client.1.smithi195.stdout:3/443: dread f1 [4194304,4194304] 0 2024-08-18T22:41:44.038 INFO:tasks.workunit.client.1.smithi195.stdout:4/385: mkdir d0/d9/d41/d76/d81 0 2024-08-18T22:41:44.040 INFO:tasks.workunit.client.0.smithi121.stdout:3/760: dread d1e/d1f/d25/d6b/d81/fcc [4194304,4194304] 0 2024-08-18T22:41:44.040 INFO:tasks.workunit.client.1.smithi195.stdout:4/386: fsync d0/f4a 0 2024-08-18T22:41:44.043 INFO:tasks.workunit.client.1.smithi195.stdout:0/459: rmdir d0/dc/d64/d81/d44/d41 39 2024-08-18T22:41:44.045 INFO:tasks.workunit.client.1.smithi195.stdout:5/418: rename d0/d3/df/c2a to d0/d46/d6d/c7f 0 2024-08-18T22:41:44.045 INFO:tasks.workunit.client.1.smithi195.stdout:3/444: fsync d7/d1f/d74/d81/f82 0 2024-08-18T22:41:44.045 INFO:tasks.workunit.client.0.smithi121.stdout:3/761: unlink d1e/d1f/d25/d2e/d36/d5f/dd2/ff2 0 2024-08-18T22:41:44.047 INFO:tasks.workunit.client.1.smithi195.stdout:9/461: read d1c/d32/f52 [2552577,46015] 0 2024-08-18T22:41:44.047 INFO:tasks.workunit.client.0.smithi121.stdout:7/806: dwrite de/d98/dfb/dce/d2f/d4b/f96 [0,4194304] 0 2024-08-18T22:41:44.050 INFO:tasks.workunit.client.0.smithi121.stdout:7/807: write de/d98/dfb/dce/d2f/d36/fea [997,71805] 0 2024-08-18T22:41:44.050 INFO:tasks.workunit.client.0.smithi121.stdout:3/762: truncate d1e/d1f/d25/d67/d92/fc8 577629 0 2024-08-18T22:41:44.051 INFO:tasks.workunit.client.1.smithi195.stdout:1/549: link da/d3d/fb9 da/d4c/d7a/fc2 0 2024-08-18T22:41:44.056 INFO:tasks.workunit.client.1.smithi195.stdout:6/305: dwrite da/d3b/f3e [0,4194304] 0 2024-08-18T22:41:44.064 INFO:tasks.workunit.client.1.smithi195.stdout:1/550: symlink da/d4c/d5d/d63/lc3 0 2024-08-18T22:41:44.066 INFO:tasks.workunit.client.1.smithi195.stdout:0/460: dwrite d0/f6b [0,4194304] 0 2024-08-18T22:41:44.072 INFO:tasks.workunit.client.0.smithi121.stdout:3/763: dread d1e/d1f/d3e/f64 [0,4194304] 0 2024-08-18T22:41:44.073 INFO:tasks.workunit.client.1.smithi195.stdout:9/462: creat d1c/f94 x:0 0 0 2024-08-18T22:41:44.074 INFO:tasks.workunit.client.1.smithi195.stdout:5/419: dread d0/d3/d8/d64/f70 [0,4194304] 0 2024-08-18T22:41:44.082 INFO:tasks.workunit.client.1.smithi195.stdout:6/306: dwrite f5 [4194304,4194304] 0 2024-08-18T22:41:44.086 INFO:tasks.workunit.client.0.smithi121.stdout:7/808: dread de/d98/dfb/dce/d34/d38/d73/da2/d100/d18/f19 [0,4194304] 0 2024-08-18T22:41:44.087 INFO:tasks.workunit.client.1.smithi195.stdout:8/460: dread d1/de/d27/f29 [4194304,4194304] 0 2024-08-18T22:41:44.088 INFO:tasks.workunit.client.0.smithi121.stdout:3/764: truncate d1e/d1f/d25/d6b/db4/d94/fab 374492 0 2024-08-18T22:41:44.088 INFO:tasks.workunit.client.1.smithi195.stdout:5/420: creat d0/d3/df/d5a/d62/d6a/f80 x:0 0 0 2024-08-18T22:41:44.090 INFO:tasks.workunit.client.1.smithi195.stdout:6/307: mknod da/d15/d1c/c55 0 2024-08-18T22:41:44.090 INFO:tasks.workunit.client.0.smithi121.stdout:7/809: creat de/d98/dfb/dce/d34/d38/d5f/d9c/f107 x:0 0 0 2024-08-18T22:41:44.091 INFO:tasks.workunit.client.1.smithi195.stdout:0/461: truncate d0/dc/d11/f20 2043511 0 2024-08-18T22:41:44.092 INFO:tasks.workunit.client.0.smithi121.stdout:3/765: getdents d1e 0 2024-08-18T22:41:44.093 INFO:tasks.workunit.client.1.smithi195.stdout:1/551: truncate da/d18/f39 207282 0 2024-08-18T22:41:44.093 INFO:tasks.workunit.client.0.smithi121.stdout:7/810: fdatasync de/d98/dfb/dce/d34/d38/d73/da2/d100/d18/d23/ff7 0 2024-08-18T22:41:44.094 INFO:tasks.workunit.client.1.smithi195.stdout:8/461: symlink d1/d3/db/d35/d4d/d5c/lad 0 2024-08-18T22:41:44.095 INFO:tasks.workunit.client.1.smithi195.stdout:6/308: read f6 [1041976,90781] 0 2024-08-18T22:41:44.097 INFO:tasks.workunit.client.0.smithi121.stdout:7/811: fsync de/f28 0 2024-08-18T22:41:44.098 INFO:tasks.workunit.client.1.smithi195.stdout:6/309: read - da/db/d19/f45 zero size 2024-08-18T22:41:44.098 INFO:tasks.workunit.client.1.smithi195.stdout:3/445: dread d7/da/df/d1c/f25 [4194304,4194304] 0 2024-08-18T22:41:44.101 INFO:tasks.workunit.client.1.smithi195.stdout:9/463: getdents d1c/d74/d7b 0 2024-08-18T22:41:44.101 INFO:tasks.workunit.client.1.smithi195.stdout:6/310: write da/d15/d1c/f12 [2248286,3062] 0 2024-08-18T22:41:44.101 INFO:tasks.workunit.client.0.smithi121.stdout:7/812: mknod de/d98/dfb/dce/d20/c108 0 2024-08-18T22:41:44.102 INFO:tasks.workunit.client.1.smithi195.stdout:8/462: symlink d1/d3/db/d39/d44/lae 0 2024-08-18T22:41:44.102 INFO:tasks.workunit.client.1.smithi195.stdout:5/421: rmdir d0/d7c 0 2024-08-18T22:41:44.105 INFO:tasks.workunit.client.1.smithi195.stdout:0/462: mknod d0/dc/d64/d81/d44/d41/d6d/d92/d66/d8d/c93 0 2024-08-18T22:41:44.107 INFO:tasks.workunit.client.1.smithi195.stdout:5/422: dread - d0/d3/df/d5a/d62/d6a/f7a zero size 2024-08-18T22:41:44.107 INFO:tasks.workunit.client.1.smithi195.stdout:9/464: symlink d1c/d32/d71/d75/l95 0 2024-08-18T22:41:44.108 INFO:tasks.workunit.client.1.smithi195.stdout:8/463: mkdir d1/d3/db/d35/d4d/d95/daf 0 2024-08-18T22:41:44.108 INFO:tasks.workunit.client.1.smithi195.stdout:6/311: symlink da/db/l56 0 2024-08-18T22:41:44.109 INFO:tasks.workunit.client.1.smithi195.stdout:0/463: chown d0/dc/d25/d67/f88 3765291 1 2024-08-18T22:41:44.110 INFO:tasks.workunit.client.1.smithi195.stdout:9/465: write d1c/f45 [1546646,20941] 0 2024-08-18T22:41:44.110 INFO:tasks.workunit.client.1.smithi195.stdout:3/446: dwrite d7/f61 [0,4194304] 0 2024-08-18T22:41:44.111 INFO:tasks.workunit.client.1.smithi195.stdout:5/423: chown d0/d3/d8/f56 124 1 2024-08-18T22:41:44.112 INFO:tasks.workunit.client.1.smithi195.stdout:5/424: readlink d0/d2/l59 0 2024-08-18T22:41:44.116 INFO:tasks.workunit.client.1.smithi195.stdout:3/447: rename d7/l22 to d7/d84/l8b 0 2024-08-18T22:41:44.121 INFO:tasks.workunit.client.1.smithi195.stdout:6/312: dwrite da/f40 [0,4194304] 0 2024-08-18T22:41:44.123 INFO:tasks.workunit.client.1.smithi195.stdout:5/425: link d0/d3/d8/c7d d0/d3/df/d5a/c81 0 2024-08-18T22:41:44.123 INFO:tasks.workunit.client.1.smithi195.stdout:1/552: dread da/f13 [0,4194304] 0 2024-08-18T22:41:44.125 INFO:tasks.workunit.client.1.smithi195.stdout:5/426: rmdir d0/d46/d6d 39 2024-08-18T22:41:44.130 INFO:tasks.workunit.client.1.smithi195.stdout:1/553: creat da/d18/d28/d31/fc4 x:0 0 0 2024-08-18T22:41:44.130 INFO:tasks.workunit.client.1.smithi195.stdout:8/464: dread d1/d3/f6 [0,4194304] 0 2024-08-18T22:41:44.132 INFO:tasks.workunit.client.1.smithi195.stdout:3/448: dwrite d7/da/df/f27 [0,4194304] 0 2024-08-18T22:41:44.133 INFO:tasks.workunit.client.1.smithi195.stdout:5/427: truncate d0/d3/df/d1a/f3f 789158 0 2024-08-18T22:41:44.133 INFO:tasks.workunit.client.1.smithi195.stdout:3/449: stat d7/l3c 0 2024-08-18T22:41:44.134 INFO:tasks.workunit.client.1.smithi195.stdout:5/428: stat d0/d3/df/d5a 0 2024-08-18T22:41:44.135 INFO:tasks.workunit.client.1.smithi195.stdout:8/465: creat d1/d3/d1c/d21/fb0 x:0 0 0 2024-08-18T22:41:44.136 INFO:tasks.workunit.client.1.smithi195.stdout:5/429: chown d0/d2/c31 2049380 1 2024-08-18T22:41:44.137 INFO:tasks.workunit.client.1.smithi195.stdout:1/554: rename da/f12 to da/d18/d28/fc5 0 2024-08-18T22:41:44.138 INFO:tasks.workunit.client.1.smithi195.stdout:5/430: dread d0/d3/df/f74 [0,4194304] 0 2024-08-18T22:41:44.138 INFO:tasks.workunit.client.1.smithi195.stdout:8/466: stat d1/de/df/l12 0 2024-08-18T22:41:44.140 INFO:tasks.workunit.client.1.smithi195.stdout:8/467: write d1/d3/db/fd [5270173,24208] 0 2024-08-18T22:41:44.142 INFO:tasks.workunit.client.1.smithi195.stdout:8/468: chown d1/d3/f2b 2 1 2024-08-18T22:41:44.142 INFO:tasks.workunit.client.1.smithi195.stdout:5/431: mknod d0/d3/df/d5a/d62/d6a/c82 0 2024-08-18T22:41:44.144 INFO:tasks.workunit.client.1.smithi195.stdout:5/432: chown d0/db/f5d 0 1 2024-08-18T22:41:44.144 INFO:tasks.workunit.client.1.smithi195.stdout:8/469: chown d1/d3/db/d35/c75 213669 1 2024-08-18T22:41:44.146 INFO:tasks.workunit.client.1.smithi195.stdout:1/555: dwrite da/f13 [0,4194304] 0 2024-08-18T22:41:44.148 INFO:tasks.workunit.client.1.smithi195.stdout:5/433: write d0/d2/d29/f47 [5077873,83091] 0 2024-08-18T22:41:44.148 INFO:tasks.workunit.client.1.smithi195.stdout:8/470: creat d1/d3/db/d7a/fb1 x:0 0 0 2024-08-18T22:41:44.149 INFO:tasks.workunit.client.1.smithi195.stdout:5/434: write d0/db/f6f [4653516,120388] 0 2024-08-18T22:41:44.150 INFO:tasks.workunit.client.1.smithi195.stdout:1/556: mkdir da/d18/dc6 0 2024-08-18T22:41:44.153 INFO:tasks.workunit.client.1.smithi195.stdout:1/557: rename da/d18/d43/f87 to da/d4c/fc7 0 2024-08-18T22:41:44.155 INFO:tasks.workunit.client.1.smithi195.stdout:1/558: read da/d68/fb5 [143803,125764] 0 2024-08-18T22:41:44.158 INFO:tasks.workunit.client.1.smithi195.stdout:5/435: dwrite d0/d3/df/f58 [0,4194304] 0 2024-08-18T22:41:44.159 INFO:tasks.workunit.client.1.smithi195.stdout:5/436: chown d0/d37/c3e 348427807 1 2024-08-18T22:41:44.162 INFO:tasks.workunit.client.1.smithi195.stdout:5/437: rename d0/d3/df/f16 to d0/d3/df/d5a/d62/d6a/f83 0 2024-08-18T22:41:44.164 INFO:tasks.workunit.client.1.smithi195.stdout:5/438: creat d0/d3/d8/d64/f84 x:0 0 0 2024-08-18T22:41:44.165 INFO:tasks.workunit.client.1.smithi195.stdout:5/439: write d0/d3/df/f76 [598972,80410] 0 2024-08-18T22:41:44.166 INFO:tasks.workunit.client.1.smithi195.stdout:5/440: symlink d0/d3/d8/d3b/l85 0 2024-08-18T22:41:44.167 INFO:tasks.workunit.client.1.smithi195.stdout:5/441: dread - d0/d3/d8/d64/f84 zero size 2024-08-18T22:41:44.169 INFO:tasks.workunit.client.1.smithi195.stdout:5/442: unlink d0/d3/d8/d64/c5c 0 2024-08-18T22:41:44.170 INFO:tasks.workunit.client.1.smithi195.stdout:7/436: sync 2024-08-18T22:41:44.171 INFO:tasks.workunit.client.1.smithi195.stdout:5/443: write d0/d3/d8/f14 [4519089,126665] 0 2024-08-18T22:41:44.176 INFO:tasks.workunit.client.0.smithi121.stdout:3/766: dread d1e/d1f/d3e/f78 [0,4194304] 0 2024-08-18T22:41:44.178 INFO:tasks.workunit.client.1.smithi195.stdout:5/444: unlink d0/d2/d29/c71 0 2024-08-18T22:41:44.182 INFO:tasks.workunit.client.1.smithi195.stdout:5/445: symlink d0/d3/l86 0 2024-08-18T22:41:44.184 INFO:tasks.workunit.client.0.smithi121.stdout:9/823: sync 2024-08-18T22:41:44.184 INFO:tasks.workunit.client.0.smithi121.stdout:0/681: sync 2024-08-18T22:41:44.184 INFO:tasks.workunit.client.0.smithi121.stdout:3/767: dwrite d1e/d1f/dba/d113/d116/ffd [0,4194304] 0 2024-08-18T22:41:44.186 INFO:tasks.workunit.client.1.smithi195.stdout:6/313: read f6 [765806,55925] 0 2024-08-18T22:41:44.187 INFO:tasks.workunit.client.0.smithi121.stdout:7/813: dwrite de/d98/dfb/dce/d2f/d4b/f64 [0,4194304] 0 2024-08-18T22:41:44.188 INFO:tasks.workunit.client.1.smithi195.stdout:5/446: mkdir d0/d3/d8/d64/d87 0 2024-08-18T22:41:44.189 INFO:tasks.workunit.client.0.smithi121.stdout:0/682: chown d1/d4/db/d18/d40/d83/cd4 1 1 2024-08-18T22:41:44.189 INFO:tasks.workunit.client.1.smithi195.stdout:5/447: readlink d0/d2/l10 0 2024-08-18T22:41:44.190 INFO:tasks.workunit.client.1.smithi195.stdout:6/314: creat da/db/d2a/f57 x:0 0 0 2024-08-18T22:41:44.191 INFO:tasks.workunit.client.0.smithi121.stdout:3/768: symlink d1e/d1f/d25/d58/df7/l119 0 2024-08-18T22:41:44.193 INFO:tasks.workunit.client.1.smithi195.stdout:6/315: truncate da/db/d26/f4f 18359 0 2024-08-18T22:41:44.195 INFO:tasks.workunit.client.1.smithi195.stdout:6/316: write da/db/d2a/f57 [138589,62444] 0 2024-08-18T22:41:44.195 INFO:tasks.workunit.client.0.smithi121.stdout:0/683: truncate d1/d4/db/d18/d40/d83/daf/dd5/f87 469714 0 2024-08-18T22:41:44.196 INFO:tasks.workunit.client.0.smithi121.stdout:9/824: creat d0/f114 x:0 0 0 2024-08-18T22:41:44.197 INFO:tasks.workunit.client.0.smithi121.stdout:3/769: dread d1e/d1f/fc3 [0,4194304] 0 2024-08-18T22:41:44.201 INFO:tasks.workunit.client.0.smithi121.stdout:9/825: creat d0/d5/dd/d1a/dc8/f115 x:0 0 0 2024-08-18T22:41:44.201 INFO:tasks.workunit.client.1.smithi195.stdout:6/317: symlink da/d15/l58 0 2024-08-18T22:41:44.203 INFO:tasks.workunit.client.0.smithi121.stdout:9/826: truncate d0/d38/d9e/df/d3d/faf 5163589 0 2024-08-18T22:41:44.203 INFO:tasks.workunit.client.0.smithi121.stdout:3/770: unlink d1e/d1f/d25/d6b/d66/fb3 0 2024-08-18T22:41:44.204 INFO:tasks.workunit.client.0.smithi121.stdout:3/771: dread - d1e/d1f/d3e/fec zero size 2024-08-18T22:41:44.208 INFO:tasks.workunit.client.1.smithi195.stdout:7/437: dread dc/f1e [4194304,4194304] 0 2024-08-18T22:41:44.208 INFO:tasks.workunit.client.1.smithi195.stdout:7/438: write dc/d2a/f65 [968007,56447] 0 2024-08-18T22:41:44.209 INFO:tasks.workunit.client.0.smithi121.stdout:9/827: dread d0/d38/d9e/df/d3d/fd3 [0,4194304] 0 2024-08-18T22:41:44.209 INFO:tasks.workunit.client.0.smithi121.stdout:0/684: dread d1/d47/f66 [0,4194304] 0 2024-08-18T22:41:44.210 INFO:tasks.workunit.client.0.smithi121.stdout:3/772: truncate d1e/d1f/d25/f106 1023847 0 2024-08-18T22:41:44.211 INFO:tasks.workunit.client.1.smithi195.stdout:9/466: rmdir d1c/d32/d71 39 2024-08-18T22:41:44.212 INFO:tasks.workunit.client.1.smithi195.stdout:3/450: readlink d7/d84/l8b 0 2024-08-18T22:41:44.215 INFO:tasks.workunit.client.1.smithi195.stdout:3/451: write d7/d1f/d49/f7f [179215,114238] 0 2024-08-18T22:41:44.216 INFO:tasks.workunit.client.0.smithi121.stdout:3/773: creat d1e/d1f/d25/d6b/db4/d94/de6/f11a x:0 0 0 2024-08-18T22:41:44.217 INFO:tasks.workunit.client.0.smithi121.stdout:3/774: stat d1e/d1f/d25/d2e/d36/f68 0 2024-08-18T22:41:44.219 INFO:tasks.workunit.client.0.smithi121.stdout:3/775: write d1e/d1f/d25/d58/df7/f10b [1999007,25004] 0 2024-08-18T22:41:44.219 INFO:tasks.workunit.client.0.smithi121.stdout:7/814: dread de/d98/dfb/dce/d34/d38/dd6/f75 [0,4194304] 0 2024-08-18T22:41:44.219 INFO:tasks.workunit.client.1.smithi195.stdout:7/439: creat dc/d14/d15/d17/d58/fa4 x:0 0 0 2024-08-18T22:41:44.220 INFO:tasks.workunit.client.1.smithi195.stdout:9/467: unlink l5 0 2024-08-18T22:41:44.220 INFO:tasks.workunit.client.0.smithi121.stdout:3/776: chown d1e/d1f/d25/d74/fdf 2 1 2024-08-18T22:41:44.220 INFO:tasks.workunit.client.1.smithi195.stdout:0/464: dwrite d0/dc/d25/f54 [0,4194304] 0 2024-08-18T22:41:44.223 INFO:tasks.workunit.client.1.smithi195.stdout:8/471: dread d1/de/f54 [0,4194304] 0 2024-08-18T22:41:44.223 INFO:tasks.workunit.client.0.smithi121.stdout:7/815: mknod de/d98/dfb/dce/d34/d38/c109 0 2024-08-18T22:41:44.225 INFO:tasks.workunit.client.0.smithi121.stdout:7/816: mknod de/d98/dfb/dce/d34/d6c/c10a 0 2024-08-18T22:41:44.228 INFO:tasks.workunit.client.0.smithi121.stdout:7/817: unlink de/d98/dfb/dce/d34/d38/c3a 0 2024-08-18T22:41:44.229 INFO:tasks.workunit.client.1.smithi195.stdout:5/448: rename d0/d3/df/d5a/d62 to d0/d2/d29/d88 0 2024-08-18T22:41:44.231 INFO:tasks.workunit.client.0.smithi121.stdout:9/828: write d0/d5/dd/d3b/d48/f74 [4753776,3501] 0 2024-08-18T22:41:44.232 INFO:tasks.workunit.client.0.smithi121.stdout:3/777: write d1e/d1f/d25/d58/f98 [877637,106928] 0 2024-08-18T22:41:44.232 INFO:tasks.workunit.client.1.smithi195.stdout:0/465: dwrite d0/dc/d25/d67/f88 [0,4194304] 0 2024-08-18T22:41:44.234 INFO:tasks.workunit.client.1.smithi195.stdout:7/440: mknod dc/d14/d15/d17/d18/ca5 0 2024-08-18T22:41:44.234 INFO:tasks.workunit.client.0.smithi121.stdout:7/818: dread fc [0,4194304] 0 2024-08-18T22:41:44.236 INFO:tasks.workunit.client.0.smithi121.stdout:9/829: mknod d0/d5/dd/d3b/d48/c116 0 2024-08-18T22:41:44.236 INFO:tasks.workunit.client.1.smithi195.stdout:9/468: mkdir d1c/d92/d96 0 2024-08-18T22:41:44.237 INFO:tasks.workunit.client.0.smithi121.stdout:3/778: symlink d1e/d1f/d25/d74/d97/l11b 0 2024-08-18T22:41:44.237 INFO:tasks.workunit.client.0.smithi121.stdout:0/685: dwrite d1/d4/db/d18/f23 [0,4194304] 0 2024-08-18T22:41:44.238 INFO:tasks.workunit.client.1.smithi195.stdout:9/469: fsync d1c/d32/f50 0 2024-08-18T22:41:44.238 INFO:tasks.workunit.client.1.smithi195.stdout:6/318: rename da/db/d2a/c2b to da/db/d26/c59 0 2024-08-18T22:41:44.239 INFO:tasks.workunit.client.1.smithi195.stdout:8/472: dwrite d1/d3/db/f5d [0,4194304] 0 2024-08-18T22:41:44.239 INFO:tasks.workunit.client.1.smithi195.stdout:7/441: mknod dc/d14/d2b/d82/ca6 0 2024-08-18T22:41:44.241 INFO:tasks.workunit.client.1.smithi195.stdout:0/466: stat d0/dc/d64/d81/d44/d41/d6d/d92/d66/f8b 0 2024-08-18T22:41:44.241 INFO:tasks.workunit.client.0.smithi121.stdout:7/819: chown de/d98/dfb/dce/d34/d38/d73/da2/d100/d18/d23/c52 223058036 1 2024-08-18T22:41:44.241 INFO:tasks.workunit.client.0.smithi121.stdout:9/830: mkdir d0/d38/d117 0 2024-08-18T22:41:44.241 INFO:tasks.workunit.client.0.smithi121.stdout:0/686: readlink d1/d4/db/d18/d40/d83/daf/dd5/d90/lb0 0 2024-08-18T22:41:44.242 INFO:tasks.workunit.client.0.smithi121.stdout:7/820: dread - de/d98/dfb/dce/d34/d38/d73/da2/d100/fd2 zero size 2024-08-18T22:41:44.242 INFO:tasks.workunit.client.0.smithi121.stdout:9/831: readlink d0/d5/dd/d3f/l83 0 2024-08-18T22:41:44.243 INFO:tasks.workunit.client.0.smithi121.stdout:3/779: mknod d1e/d1f/d25/c11c 0 2024-08-18T22:41:44.243 INFO:tasks.workunit.client.1.smithi195.stdout:6/319: mknod da/db/d26/d2d/c5a 0 2024-08-18T22:41:44.245 INFO:tasks.workunit.client.0.smithi121.stdout:7/821: symlink de/d98/dfb/dce/d2f/l10b 0 2024-08-18T22:41:44.245 INFO:tasks.workunit.client.1.smithi195.stdout:7/442: unlink dc/d14/d2b/l31 0 2024-08-18T22:41:44.247 INFO:tasks.workunit.client.0.smithi121.stdout:0/687: mkdir d1/d4/db/d24/df/d8/dee 0 2024-08-18T22:41:44.250 INFO:tasks.workunit.client.0.smithi121.stdout:3/780: dread d1e/d1f/da6/dc7/db8/d104/d9a/f10a [0,4194304] 0 2024-08-18T22:41:44.255 INFO:tasks.workunit.client.0.smithi121.stdout:3/781: mkdir d1e/d1f/d25/d58/df7/d11d 0 2024-08-18T22:41:44.256 INFO:tasks.workunit.client.0.smithi121.stdout:0/688: dwrite d1/d4/da/d2f/f5e [0,4194304] 0 2024-08-18T22:41:44.259 INFO:tasks.workunit.client.1.smithi195.stdout:3/452: dread d7/f9 [0,4194304] 0 2024-08-18T22:41:44.260 INFO:tasks.workunit.client.0.smithi121.stdout:3/782: rename d1e/d1f/d25/d74/d97/ca4 to d1e/c11e 0 2024-08-18T22:41:44.260 INFO:tasks.workunit.client.1.smithi195.stdout:0/467: creat d0/dc/d64/d81/d44/d41/f94 x:0 0 0 2024-08-18T22:41:44.260 INFO:tasks.workunit.client.0.smithi121.stdout:0/689: truncate d1/d4/db/f37 2904780 0 2024-08-18T22:41:44.262 INFO:tasks.workunit.client.0.smithi121.stdout:0/690: unlink d1/d47/c94 0 2024-08-18T22:41:44.264 INFO:tasks.workunit.client.1.smithi195.stdout:9/470: dwrite d1c/f47 [0,4194304] 0 2024-08-18T22:41:44.268 INFO:tasks.workunit.client.1.smithi195.stdout:1/559: dwrite da/d4c/d5d/d63/fa6 [0,4194304] 0 2024-08-18T22:41:44.268 INFO:tasks.workunit.client.1.smithi195.stdout:0/468: chown d0/dc/d11/d23/d51 17 1 2024-08-18T22:41:44.268 INFO:tasks.workunit.client.0.smithi121.stdout:0/691: creat d1/d4/db/d18/d40/d83/fef x:0 0 0 2024-08-18T22:41:44.269 INFO:tasks.workunit.client.0.smithi121.stdout:9/832: write d0/d38/d9e/df/d3d/d89/d92/f9a [58353,96] 0 2024-08-18T22:41:44.272 INFO:tasks.workunit.client.1.smithi195.stdout:8/473: dwrite d1/d3/f6 [4194304,4194304] 0 2024-08-18T22:41:44.272 INFO:tasks.workunit.client.1.smithi195.stdout:6/320: rename da/d15/d1c/d2e/f38 to da/db/f5b 0 2024-08-18T22:41:44.274 INFO:tasks.workunit.client.1.smithi195.stdout:3/453: rename d7/da to d7/da/df/d1c/d6a/d6c/d8c 22 2024-08-18T22:41:44.277 INFO:tasks.workunit.client.1.smithi195.stdout:1/560: unlink da/d3d/f41 0 2024-08-18T22:41:44.280 INFO:tasks.workunit.client.0.smithi121.stdout:7/822: dwrite de/d2d/d50/f84 [0,4194304] 0 2024-08-18T22:41:44.281 INFO:tasks.workunit.client.0.smithi121.stdout:0/692: rename d1/d47/l63 to d1/d4/db/d18/d40/d83/lf0 0 2024-08-18T22:41:44.284 INFO:tasks.workunit.client.0.smithi121.stdout:9/833: rmdir d0/d5/dd/d1a/dc8/dfa/dbf/dfc 0 2024-08-18T22:41:44.287 INFO:tasks.workunit.client.0.smithi121.stdout:7/823: chown de/d98/dfb/dce/d34/d38/d73/da2/d100/d18/d23/d24/d29/d43/d7f 0 1 2024-08-18T22:41:44.287 INFO:tasks.workunit.client.0.smithi121.stdout:0/693: mknod d1/d4/db/d24/d30/cf1 0 2024-08-18T22:41:44.287 INFO:tasks.workunit.client.1.smithi195.stdout:6/321: rename da/db/d26/f4f to da/d22/f5c 0 2024-08-18T22:41:44.287 INFO:tasks.workunit.client.0.smithi121.stdout:9/834: fdatasync d0/d38/d9e/df/d61/ff2 0 2024-08-18T22:41:44.288 INFO:tasks.workunit.client.0.smithi121.stdout:3/783: fdatasync d1e/d1f/da6/dc7/db8/d104/f8a 0 2024-08-18T22:41:44.290 INFO:tasks.workunit.client.1.smithi195.stdout:1/561: mkdir da/d18/d28/d31/d3b/d4e/d95/d9c/dc8 0 2024-08-18T22:41:44.292 INFO:tasks.workunit.client.1.smithi195.stdout:6/322: fsync da/db/d2a/f57 0 2024-08-18T22:41:44.293 INFO:tasks.workunit.client.1.smithi195.stdout:0/469: fdatasync d0/dc/d64/d81/d44/d41/f5d 0 2024-08-18T22:41:44.298 INFO:tasks.workunit.client.0.smithi121.stdout:7/824: dwrite de/f1d [0,4194304] 0 2024-08-18T22:41:44.299 INFO:tasks.workunit.client.0.smithi121.stdout:3/784: dwrite f16 [0,4194304] 0 2024-08-18T22:41:44.299 INFO:tasks.workunit.client.1.smithi195.stdout:7/443: dwrite dc/d22/f3e [0,4194304] 0 2024-08-18T22:41:44.301 INFO:tasks.workunit.client.1.smithi195.stdout:0/470: mknod d0/dc/d11/c95 0 2024-08-18T22:41:44.302 INFO:tasks.workunit.client.1.smithi195.stdout:8/474: dwrite d1/de/df/d1d/f6e [4194304,4194304] 0 2024-08-18T22:41:44.302 INFO:tasks.workunit.client.1.smithi195.stdout:1/562: creat da/d18/d28/d31/fc9 x:0 0 0 2024-08-18T22:41:44.303 INFO:tasks.workunit.client.1.smithi195.stdout:6/323: symlink da/d15/d1c/d2e/l5d 0 2024-08-18T22:41:44.303 INFO:tasks.workunit.client.1.smithi195.stdout:3/454: dwrite d7/da/df/f3b [0,4194304] 0 2024-08-18T22:41:44.303 INFO:tasks.workunit.client.0.smithi121.stdout:3/785: mknod d1e/d1f/da6/c11f 0 2024-08-18T22:41:44.305 INFO:tasks.workunit.client.1.smithi195.stdout:1/563: fdatasync da/d18/f39 0 2024-08-18T22:41:44.307 INFO:tasks.workunit.client.1.smithi195.stdout:0/471: write d0/dc/dd/f58 [1430342,125170] 0 2024-08-18T22:41:44.308 INFO:tasks.workunit.client.0.smithi121.stdout:4/786: sync 2024-08-18T22:41:44.308 INFO:tasks.workunit.client.0.smithi121.stdout:1/821: sync 2024-08-18T22:41:44.309 INFO:tasks.workunit.client.1.smithi195.stdout:6/324: creat da/db/d2a/f5e x:0 0 0 2024-08-18T22:41:44.310 INFO:tasks.workunit.client.0.smithi121.stdout:1/822: readlink l2 0 2024-08-18T22:41:44.313 INFO:tasks.workunit.client.0.smithi121.stdout:9/835: dread d0/d5/f9b [0,4194304] 0 2024-08-18T22:41:44.313 INFO:tasks.workunit.client.0.smithi121.stdout:7/825: dwrite de/d98/dfb/dce/d34/d38/d73/da2/d100/d18/f3c [0,4194304] 0 2024-08-18T22:41:44.315 INFO:tasks.workunit.client.0.smithi121.stdout:7/826: chown de/d98/dfb/dce/d34/d38/d5f/c82 5482 1 2024-08-18T22:41:44.319 INFO:tasks.workunit.client.0.smithi121.stdout:3/786: creat d1e/d1f/d25/d6b/d66/f120 x:0 0 0 2024-08-18T22:41:44.321 INFO:tasks.workunit.client.0.smithi121.stdout:3/787: stat d1e/d1f/d3e/f6f 0 2024-08-18T22:41:44.322 INFO:tasks.workunit.client.1.smithi195.stdout:6/325: mkdir da/d3b/d5f 0 2024-08-18T22:41:44.322 INFO:tasks.workunit.client.0.smithi121.stdout:1/823: write d5/d10/d14/d2a/d3a/d87/d6c/d6f/d82/f51 [2404158,25017] 0 2024-08-18T22:41:44.322 INFO:tasks.workunit.client.0.smithi121.stdout:9/836: creat d0/d5/dd/d2f/dcd/f118 x:0 0 0 2024-08-18T22:41:44.323 INFO:tasks.workunit.client.0.smithi121.stdout:1/824: chown d5/d10/d14/d2a/f8d 11 1 2024-08-18T22:41:44.325 INFO:tasks.workunit.client.1.smithi195.stdout:3/455: creat d7/da/df/d38/f8d x:0 0 0 2024-08-18T22:41:44.327 INFO:tasks.workunit.client.0.smithi121.stdout:4/787: truncate d2/dc/d16/d47/f9a 1665534 0 2024-08-18T22:41:44.329 INFO:tasks.workunit.client.1.smithi195.stdout:8/475: dwrite d1/d64/f73 [0,4194304] 0 2024-08-18T22:41:44.331 INFO:tasks.workunit.client.0.smithi121.stdout:9/837: creat d0/d38/d9e/df/d3d/d89/f119 x:0 0 0 2024-08-18T22:41:44.331 INFO:tasks.workunit.client.0.smithi121.stdout:3/788: write d1e/d1f/d25/f27 [822094,79535] 0 2024-08-18T22:41:44.332 INFO:tasks.workunit.client.0.smithi121.stdout:4/788: read - d2/dc/d16/d59/d83/f9c zero size 2024-08-18T22:41:44.333 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:41:44 smithi121 ceph-mon[16788]: mgrmap e24: smithi195.acttsj(active, since 5s) 2024-08-18T22:41:44.333 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:41:44 smithi121 ceph-mon[16788]: pgmap v6: 65 pgs: 65 active+clean; 1.8 GiB data, 6.9 GiB used, 530 GiB / 536 GiB avail 2024-08-18T22:41:44.335 INFO:tasks.workunit.client.1.smithi195.stdout:7/444: dread dc/d1d/d29/f34 [4194304,4194304] 0 2024-08-18T22:41:44.335 INFO:tasks.workunit.client.1.smithi195.stdout:0/472: dwrite d0/dc/d11/d23/f45 [0,4194304] 0 2024-08-18T22:41:44.337 INFO:tasks.workunit.client.1.smithi195.stdout:8/476: creat d1/d3/db/d35/d56/fb2 x:0 0 0 2024-08-18T22:41:44.338 INFO:tasks.workunit.client.0.smithi121.stdout:3/789: creat d1e/d1f/d25/d67/d92/d111/f121 x:0 0 0 2024-08-18T22:41:44.338 INFO:tasks.workunit.client.0.smithi121.stdout:4/789: mknod d2/dc/d16/d47/dea/c124 0 2024-08-18T22:41:44.342 INFO:tasks.workunit.client.1.smithi195.stdout:3/456: unlink d7/d1f/l53 0 2024-08-18T22:41:44.342 INFO:tasks.workunit.client.1.smithi195.stdout:7/445: chown dc/d14/d15/d17/d18/c64 77198 1 2024-08-18T22:41:44.343 INFO:tasks.workunit.client.1.smithi195.stdout:8/477: stat d1/de/d31 0 2024-08-18T22:41:44.344 INFO:tasks.workunit.client.0.smithi121.stdout:5/694: sync 2024-08-18T22:41:44.344 INFO:tasks.workunit.client.0.smithi121.stdout:1/825: dwrite d5/d10/d14/d2a/d3a/d87/d6c/d6f/f8f [0,4194304] 0 2024-08-18T22:41:44.345 INFO:tasks.workunit.client.1.smithi195.stdout:6/326: dread f5 [4194304,4194304] 0 2024-08-18T22:41:44.345 INFO:tasks.workunit.client.0.smithi121.stdout:2/519: sync 2024-08-18T22:41:44.345 INFO:tasks.workunit.client.0.smithi121.stdout:8/934: sync 2024-08-18T22:41:44.347 INFO:tasks.workunit.client.1.smithi195.stdout:6/327: chown da/db/d26/f41 25 1 2024-08-18T22:41:44.347 INFO:tasks.workunit.client.1.smithi195.stdout:6/328: truncate da/db/d2a/f5e 201289 0 2024-08-18T22:41:44.348 INFO:tasks.workunit.client.0.smithi121.stdout:0/694: dread d1/d4/db/d18/d1c/f36 [0,4194304] 0 2024-08-18T22:41:44.348 INFO:tasks.workunit.client.0.smithi121.stdout:3/790: unlink d1e/d1f/d25/d6b/c4a 0 2024-08-18T22:41:44.349 INFO:tasks.workunit.client.1.smithi195.stdout:6/329: chown da/db/d19/f23 1253 1 2024-08-18T22:41:44.351 INFO:tasks.workunit.client.1.smithi195.stdout:8/478: creat d1/d64/fb3 x:0 0 0 2024-08-18T22:41:44.352 INFO:tasks.workunit.client.1.smithi195.stdout:6/330: unlink da/db/d2a/f44 0 2024-08-18T22:41:44.352 INFO:tasks.workunit.client.1.smithi195.stdout:6/331: chown da/db/f37 1987807370 1 2024-08-18T22:41:44.354 INFO:tasks.workunit.client.1.smithi195.stdout:3/457: unlink d7/f19 0 2024-08-18T22:41:44.354 INFO:tasks.workunit.client.0.smithi121.stdout:4/790: creat d2/dc/d16/d22/d2c/d44/d8c/f125 x:0 0 0 2024-08-18T22:41:44.354 INFO:tasks.workunit.client.1.smithi195.stdout:0/473: creat d0/dc/dd/f96 x:0 0 0 2024-08-18T22:41:44.356 INFO:tasks.workunit.client.1.smithi195.stdout:9/471: dread d1c/f33 [0,4194304] 0 2024-08-18T22:41:44.356 INFO:tasks.workunit.client.1.smithi195.stdout:8/479: unlink d1/d3/l2d 0 2024-08-18T22:41:44.359 INFO:tasks.workunit.client.1.smithi195.stdout:8/480: write d1/d3/db/d7a/fb1 [698243,35981] 0 2024-08-18T22:41:44.361 INFO:tasks.workunit.client.1.smithi195.stdout:3/458: rename d7/d84 to d7/da/df/d8e 0 2024-08-18T22:41:44.362 INFO:tasks.workunit.client.1.smithi195.stdout:9/472: symlink d1c/d74/d7b/d82/d90/l97 0 2024-08-18T22:41:44.365 INFO:tasks.workunit.client.1.smithi195.stdout:1/564: write da/f1d [3618995,43203] 0 2024-08-18T22:41:44.366 INFO:tasks.workunit.client.0.smithi121.stdout:5/695: mknod d3/d5/d13/d23/da4/cd8 0 2024-08-18T22:41:44.366 INFO:tasks.workunit.client.0.smithi121.stdout:0/695: rename d1/d4/db/d18/d40/d83/fef to d1/d4/db/d18/d40/d83/daf/dd5/d5b/ff2 0 2024-08-18T22:41:44.366 INFO:tasks.workunit.client.0.smithi121.stdout:3/791: creat d1e/d1f/d3e/f122 x:0 0 0 2024-08-18T22:41:44.367 INFO:tasks.workunit.client.0.smithi121.stdout:4/791: dwrite d2/dc/d16/d22/d2c/d44/d66/f102 [0,4194304] 0 2024-08-18T22:41:44.368 INFO:tasks.workunit.client.1.smithi195.stdout:1/565: mknod da/d4c/d5d/d63/cca 0 2024-08-18T22:41:44.368 INFO:tasks.workunit.client.0.smithi121.stdout:5/696: stat d3/d5/d13/d19/c43 0 2024-08-18T22:41:44.369 INFO:tasks.workunit.client.1.smithi195.stdout:3/459: creat d7/da/df/f8f x:0 0 0 2024-08-18T22:41:44.370 INFO:tasks.workunit.client.1.smithi195.stdout:3/460: truncate d7/f89 77143 0 2024-08-18T22:41:44.371 INFO:tasks.workunit.client.1.smithi195.stdout:3/461: mknod d7/da/d75/c90 0 2024-08-18T22:41:44.373 INFO:tasks.workunit.client.0.smithi121.stdout:4/792: chown d2/dc/d1c/c9d 4 1 2024-08-18T22:41:44.374 INFO:tasks.workunit.client.1.smithi195.stdout:3/462: rename d7/da/d75/c90 to d7/d1f/d73/c91 0 2024-08-18T22:41:44.375 INFO:tasks.workunit.client.0.smithi121.stdout:3/792: mkdir d1e/d1f/dba/d113/d116/d123 0 2024-08-18T22:41:44.377 INFO:tasks.workunit.client.1.smithi195.stdout:3/463: rename d7/da/df/d1c/c44 to d7/da/df/d1c/d6a/c92 0 2024-08-18T22:41:44.378 INFO:tasks.workunit.client.0.smithi121.stdout:3/793: mknod d1e/d1f/dba/c124 0 2024-08-18T22:41:44.379 INFO:tasks.workunit.client.0.smithi121.stdout:5/697: getdents d3/d5/d13/d19/d75 0 2024-08-18T22:41:44.383 INFO:tasks.workunit.client.0.smithi121.stdout:5/698: mkdir d3/d5/d13/d19/d24/d32/d38/dd9 0 2024-08-18T22:41:44.383 INFO:tasks.workunit.client.1.smithi195.stdout:3/464: dwrite d7/d1f/f80 [0,4194304] 0 2024-08-18T22:41:44.387 INFO:tasks.workunit.client.0.smithi121.stdout:5/699: creat d3/d5/d3c/d3f/fda x:0 0 0 2024-08-18T22:41:44.390 INFO:tasks.workunit.client.1.smithi195.stdout:3/465: dwrite d7/da/df/f5f [0,4194304] 0 2024-08-18T22:41:44.391 INFO:tasks.workunit.client.1.smithi195.stdout:3/466: chown d7/da/l59 208 1 2024-08-18T22:41:44.392 INFO:tasks.workunit.client.0.smithi121.stdout:2/520: write d2/d3/f8a [1159551,103788] 0 2024-08-18T22:41:44.393 INFO:tasks.workunit.client.1.smithi195.stdout:3/467: creat d7/d1f/d49/f93 x:0 0 0 2024-08-18T22:41:44.395 INFO:tasks.workunit.client.0.smithi121.stdout:7/827: dread de/d98/dfb/dce/d34/d38/d73/da2/d100/d18/d23/d24/d29/f4d [0,4194304] 0 2024-08-18T22:41:44.399 INFO:tasks.workunit.client.1.smithi195.stdout:3/468: creat d7/d54/f94 x:0 0 0 2024-08-18T22:41:44.401 INFO:tasks.workunit.client.0.smithi121.stdout:5/700: truncate d3/d5/f11 1411198 0 2024-08-18T22:41:44.401 INFO:tasks.workunit.client.0.smithi121.stdout:1/826: truncate d5/d10/d14/d34/fa2 327769 0 2024-08-18T22:41:44.403 INFO:tasks.workunit.client.1.smithi195.stdout:9/473: write d1c/f2c [1355861,20677] 0 2024-08-18T22:41:44.403 INFO:tasks.workunit.client.1.smithi195.stdout:8/481: write d1/d3/db/f17 [519087,121255] 0 2024-08-18T22:41:44.403 INFO:tasks.workunit.client.0.smithi121.stdout:2/521: unlink d2/d8/d1f/f32 0 2024-08-18T22:41:44.403 INFO:tasks.workunit.client.0.smithi121.stdout:0/696: write d1/d4/db/d24/df/d8/d71/d79/fab [191287,106166] 0 2024-08-18T22:41:44.404 INFO:tasks.workunit.client.0.smithi121.stdout:4/793: write d2/dc/f93 [56698,58124] 0 2024-08-18T22:41:44.404 INFO:tasks.workunit.client.0.smithi121.stdout:8/935: dwrite d6/d1e/d2d/d78/fa8 [0,4194304] 0 2024-08-18T22:41:44.405 INFO:tasks.workunit.client.1.smithi195.stdout:1/566: dread f6 [0,4194304] 0 2024-08-18T22:41:44.405 INFO:tasks.workunit.client.1.smithi195.stdout:0/474: dwrite d0/dc/dd/f6e [0,4194304] 0 2024-08-18T22:41:44.408 INFO:tasks.workunit.client.1.smithi195.stdout:3/469: dread - d7/da/df/d38/f7b zero size 2024-08-18T22:41:44.409 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:41:44 smithi195 ceph-mon[23370]: mgrmap e24: smithi195.acttsj(active, since 5s) 2024-08-18T22:41:44.409 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:41:44 smithi195 ceph-mon[23370]: pgmap v6: 65 pgs: 65 active+clean; 1.8 GiB data, 6.9 GiB used, 530 GiB / 536 GiB avail 2024-08-18T22:41:44.409 INFO:tasks.workunit.client.0.smithi121.stdout:5/701: creat d3/d5/d13/d23/d66/fdb x:0 0 0 2024-08-18T22:41:44.412 INFO:tasks.workunit.client.1.smithi195.stdout:6/332: dwrite da/db/f5b [0,4194304] 0 2024-08-18T22:41:44.414 INFO:tasks.workunit.client.0.smithi121.stdout:5/702: chown d3/d5/d13/d23 2293 1 2024-08-18T22:41:44.414 INFO:tasks.workunit.client.1.smithi195.stdout:6/333: readlink da/db/l35 0 2024-08-18T22:41:44.414 INFO:tasks.workunit.client.1.smithi195.stdout:1/567: write da/d18/d28/d31/f84 [628383,43625] 0 2024-08-18T22:41:44.415 INFO:tasks.workunit.client.1.smithi195.stdout:0/475: read d0/dc/d11/f15 [3025437,58464] 0 2024-08-18T22:41:44.415 INFO:tasks.workunit.client.0.smithi121.stdout:0/697: creat d1/d4/db/d24/df/ff3 x:0 0 0 2024-08-18T22:41:44.419 INFO:tasks.workunit.client.0.smithi121.stdout:9/838: dread d0/d5/dd/f41 [0,4194304] 0 2024-08-18T22:41:44.420 INFO:tasks.workunit.client.0.smithi121.stdout:7/828: dwrite de/d98/dfb/fc2 [0,4194304] 0 2024-08-18T22:41:44.421 INFO:tasks.workunit.client.1.smithi195.stdout:8/482: read d1/d3/db/d35/d4d/d8b/f91 [123185,49656] 0 2024-08-18T22:41:44.423 INFO:tasks.workunit.client.1.smithi195.stdout:3/470: mkdir d7/da/df/d95 0 2024-08-18T22:41:44.426 INFO:tasks.workunit.client.1.smithi195.stdout:0/476: mkdir d0/dc/d64/d81/d44/d41/d6d/d97 0 2024-08-18T22:41:44.427 INFO:tasks.workunit.client.1.smithi195.stdout:3/471: mkdir d7/da/d75/d96 0 2024-08-18T22:41:44.427 INFO:tasks.workunit.client.1.smithi195.stdout:6/334: dwrite da/db/d2a/f5e [0,4194304] 0 2024-08-18T22:41:44.429 INFO:tasks.workunit.client.1.smithi195.stdout:9/474: read d1c/d32/d37/d4b/f6b [420899,89986] 0 2024-08-18T22:41:44.430 INFO:tasks.workunit.client.0.smithi121.stdout:8/936: fdatasync d6/dd/d25/dc8/dce/fff 0 2024-08-18T22:41:44.431 INFO:tasks.workunit.client.1.smithi195.stdout:9/475: truncate d1c/f64 1095657 0 2024-08-18T22:41:44.432 INFO:tasks.workunit.client.0.smithi121.stdout:2/522: unlink d2/d8/d19/dc/c65 0 2024-08-18T22:41:44.433 INFO:tasks.workunit.client.1.smithi195.stdout:3/472: rmdir d7/da/df/d8e 39 2024-08-18T22:41:44.434 INFO:tasks.workunit.client.0.smithi121.stdout:0/698: creat d1/d4/db/d18/d40/ff4 x:0 0 0 2024-08-18T22:41:44.435 INFO:tasks.workunit.client.0.smithi121.stdout:8/937: readlink d6/d1e/d2d/d78/d45/l74 0 2024-08-18T22:41:44.437 INFO:tasks.workunit.client.0.smithi121.stdout:4/794: truncate d2/dc/fd 37893 0 2024-08-18T22:41:44.437 INFO:tasks.workunit.client.0.smithi121.stdout:5/703: dwrite d3/d5/d13/d19/da3/fd6 [0,4194304] 0 2024-08-18T22:41:44.437 INFO:tasks.workunit.client.1.smithi195.stdout:6/335: write da/d15/f31 [43531,40831] 0 2024-08-18T22:41:44.441 INFO:tasks.workunit.client.0.smithi121.stdout:8/938: stat d6/dd/f121 0 2024-08-18T22:41:44.442 INFO:tasks.workunit.client.1.smithi195.stdout:3/473: mkdir d7/da/d97 0 2024-08-18T22:41:44.442 INFO:tasks.workunit.client.1.smithi195.stdout:8/483: dwrite d1/d3/db/d39/d2e/f4c [0,4194304] 0 2024-08-18T22:41:44.442 INFO:tasks.workunit.client.1.smithi195.stdout:6/336: write f5 [2151160,9330] 0 2024-08-18T22:41:44.445 INFO:tasks.workunit.client.1.smithi195.stdout:3/474: truncate d7/d54/f8a 164571 0 2024-08-18T22:41:44.446 INFO:tasks.workunit.client.0.smithi121.stdout:9/839: creat d0/d38/d52/d5f/de1/d10b/f11a x:0 0 0 2024-08-18T22:41:44.446 INFO:tasks.workunit.client.1.smithi195.stdout:6/337: creat da/d15/d1c/d2e/f60 x:0 0 0 2024-08-18T22:41:44.446 INFO:tasks.workunit.client.1.smithi195.stdout:9/476: getdents d1c/d32/d71 0 2024-08-18T22:41:44.448 INFO:tasks.workunit.client.0.smithi121.stdout:4/795: write d2/dc/d16/d59/d83/dd7/f88 [4521439,72852] 0 2024-08-18T22:41:44.448 INFO:tasks.workunit.client.0.smithi121.stdout:5/704: chown d3/d5/d27/d35 1026 1 2024-08-18T22:41:44.449 INFO:tasks.workunit.client.1.smithi195.stdout:6/338: fsync da/f13 0 2024-08-18T22:41:44.450 INFO:tasks.workunit.client.0.smithi121.stdout:9/840: chown d0/d5/dd/d3b/d48/c5b 32298503 1 2024-08-18T22:41:44.451 INFO:tasks.workunit.client.0.smithi121.stdout:7/829: dwrite de/d2d/d50/db7/fe8 [0,4194304] 0 2024-08-18T22:41:44.453 INFO:tasks.workunit.client.1.smithi195.stdout:6/339: symlink da/l61 0 2024-08-18T22:41:44.455 INFO:tasks.workunit.client.1.smithi195.stdout:0/477: dread d0/dc/dd/f59 [0,4194304] 0 2024-08-18T22:41:44.457 INFO:tasks.workunit.client.0.smithi121.stdout:7/830: stat de/d98/dfb/dce/d34/d38/d73/da2/d100/da0/fc4 0 2024-08-18T22:41:44.458 INFO:tasks.workunit.client.1.smithi195.stdout:6/340: dread - da/d15/d1c/d2e/f60 zero size 2024-08-18T22:41:44.458 INFO:tasks.workunit.client.1.smithi195.stdout:0/478: read - d0/dc/d11/f79 zero size 2024-08-18T22:41:44.459 INFO:tasks.workunit.client.1.smithi195.stdout:8/484: dwrite d1/d3/db/d35/d56/f76 [0,4194304] 0 2024-08-18T22:41:44.460 INFO:tasks.workunit.client.1.smithi195.stdout:3/475: dwrite d7/d1f/d49/f7f [0,4194304] 0 2024-08-18T22:41:44.462 INFO:tasks.workunit.client.0.smithi121.stdout:1/827: dwrite d5/d10/d14/d2a/d3a/d87/f4c [4194304,4194304] 0 2024-08-18T22:41:44.462 INFO:tasks.workunit.client.1.smithi195.stdout:0/479: dread - d0/dc/d64/d81/d44/d41/f73 zero size 2024-08-18T22:41:44.462 INFO:tasks.workunit.client.0.smithi121.stdout:9/841: mknod d0/d5/dd/d2f/c11b 0 2024-08-18T22:41:44.463 INFO:tasks.workunit.client.1.smithi195.stdout:8/485: write d1/de/df/f58 [3492512,44937] 0 2024-08-18T22:41:44.464 INFO:tasks.workunit.client.1.smithi195.stdout:8/486: readlink d1/d3/d1c/l9f 0 2024-08-18T22:41:44.466 INFO:tasks.workunit.client.1.smithi195.stdout:8/487: write d1/d3/f2b [1951754,60677] 0 2024-08-18T22:41:44.466 INFO:tasks.workunit.client.0.smithi121.stdout:8/939: rename d6/dd/d3b/f64 to d6/d1e/d2d/d78/d45/f136 0 2024-08-18T22:41:44.468 INFO:tasks.workunit.client.0.smithi121.stdout:4/796: mkdir d2/dc/d126 0 2024-08-18T22:41:44.468 INFO:tasks.workunit.client.1.smithi195.stdout:8/488: chown d1/d3/db/d35/d4d/d95/daf 51340757 1 2024-08-18T22:41:44.470 INFO:tasks.workunit.client.1.smithi195.stdout:8/489: write d1/d3/db/fd [6008256,130713] 0 2024-08-18T22:41:44.471 INFO:tasks.workunit.client.1.smithi195.stdout:0/480: truncate d0/dc/d64/d81/f89 3745172 0 2024-08-18T22:41:44.474 INFO:tasks.workunit.client.1.smithi195.stdout:0/481: unlink d0/dc/d25/c3a 0 2024-08-18T22:41:44.475 INFO:tasks.workunit.client.0.smithi121.stdout:9/842: write d0/d38/d9e/df/d3d/d89/dea/f108 [632246,15113] 0 2024-08-18T22:41:44.476 INFO:tasks.workunit.client.1.smithi195.stdout:0/482: creat d0/dc/d25/d67/f98 x:0 0 0 2024-08-18T22:41:44.477 INFO:tasks.workunit.client.0.smithi121.stdout:1/828: mknod d5/d10/d14/d2a/d3a/d87/df1/c11c 0 2024-08-18T22:41:44.478 INFO:tasks.workunit.client.0.smithi121.stdout:5/705: rename d3/d5/d13/d23/d66/fdb to d3/d5/d13/d23/da4/dc7/dae/fdc 0 2024-08-18T22:41:44.479 INFO:tasks.workunit.client.1.smithi195.stdout:0/483: symlink d0/dc/d64/d81/l99 0 2024-08-18T22:41:44.483 INFO:tasks.workunit.client.1.smithi195.stdout:0/484: creat d0/dc/d64/d81/d44/d41/d6d/d92/d66/d8d/f9a x:0 0 0 2024-08-18T22:41:44.484 INFO:tasks.workunit.client.0.smithi121.stdout:2/523: dwrite d2/d8/fa9 [0,4194304] 0 2024-08-18T22:41:44.485 INFO:tasks.workunit.client.0.smithi121.stdout:7/831: dwrite de/d98/dfb/dce/d34/d38/d73/da2/d100/d18/d23/d24/f56 [0,4194304] 0 2024-08-18T22:41:44.486 INFO:tasks.workunit.client.1.smithi195.stdout:9/477: dwrite f17 [0,4194304] 0 2024-08-18T22:41:44.486 INFO:tasks.workunit.client.0.smithi121.stdout:9/843: mkdir d0/d5/dd/d2f/dcd/d11c 0 2024-08-18T22:41:44.487 INFO:tasks.workunit.client.1.smithi195.stdout:0/485: truncate d0/dc/d11/d23/f49 4566336 0 2024-08-18T22:41:44.490 INFO:tasks.workunit.client.0.smithi121.stdout:8/940: chown d6/d115/f117 147 1 2024-08-18T22:41:44.491 INFO:tasks.workunit.client.0.smithi121.stdout:5/706: rmdir d3/d5/d13/d23/da4/dc7/dae 39 2024-08-18T22:41:44.492 INFO:tasks.workunit.client.1.smithi195.stdout:0/486: creat d0/dc/d11/d23/f9b x:0 0 0 2024-08-18T22:41:44.493 INFO:tasks.workunit.client.0.smithi121.stdout:5/707: readlink d3/d5c/ld4 0 2024-08-18T22:41:44.495 INFO:tasks.workunit.client.1.smithi195.stdout:0/487: symlink d0/dc/d11/d23/d51/l9c 0 2024-08-18T22:41:44.496 INFO:tasks.workunit.client.1.smithi195.stdout:3/476: truncate d7/da/df/d38/f4a 2113702 0 2024-08-18T22:41:44.497 INFO:tasks.workunit.client.1.smithi195.stdout:6/341: dwrite f6 [0,4194304] 0 2024-08-18T22:41:44.498 INFO:tasks.workunit.client.1.smithi195.stdout:0/488: rmdir d0/dc/dd 39 2024-08-18T22:41:44.500 INFO:tasks.workunit.client.0.smithi121.stdout:1/829: dwrite d5/d10/d14/d2a/d3a/d87/d6c/d6f/d82/d15/d28/d3d/d9a/fbc [4194304,4194304] 0 2024-08-18T22:41:44.500 INFO:tasks.workunit.client.0.smithi121.stdout:9/844: rmdir d0/d5/dd/d1a 39 2024-08-18T22:41:44.503 INFO:tasks.workunit.client.1.smithi195.stdout:3/477: symlink d7/d1f/l98 0 2024-08-18T22:41:44.505 INFO:tasks.workunit.client.1.smithi195.stdout:6/342: rename da/db/d26/d2d/f42 to da/d22/f62 0 2024-08-18T22:41:44.508 INFO:tasks.workunit.client.1.smithi195.stdout:0/489: mkdir d0/dc/d11/d6f/d9d 0 2024-08-18T22:41:44.509 INFO:tasks.workunit.client.0.smithi121.stdout:0/699: truncate d1/d4/db/d24/df/d8/f20 37764 0 2024-08-18T22:41:44.511 INFO:tasks.workunit.client.1.smithi195.stdout:3/478: rmdir d7/da/d97 0 2024-08-18T22:41:44.512 INFO:tasks.workunit.client.1.smithi195.stdout:0/490: mknod d0/dc/d25/c9e 0 2024-08-18T22:41:44.512 INFO:tasks.workunit.client.0.smithi121.stdout:1/830: unlink d5/d10/f20 0 2024-08-18T22:41:44.513 INFO:tasks.workunit.client.0.smithi121.stdout:1/831: fsync d5/d10/fd1 0 2024-08-18T22:41:44.516 INFO:tasks.workunit.client.1.smithi195.stdout:3/479: link d7/d1f/c7e d7/da/df/d38/c99 0 2024-08-18T22:41:44.518 INFO:tasks.workunit.client.1.smithi195.stdout:3/480: fsync d7/da/df/d38/f45 0 2024-08-18T22:41:44.520 INFO:tasks.workunit.client.1.smithi195.stdout:0/491: dwrite d0/dc/d11/d23/f49 [0,4194304] 0 2024-08-18T22:41:44.520 INFO:tasks.workunit.client.0.smithi121.stdout:4/797: write d2/dc/d16/f68 [1359161,108675] 0 2024-08-18T22:41:44.521 INFO:tasks.workunit.client.0.smithi121.stdout:0/700: fdatasync d1/fd 0 2024-08-18T22:41:44.522 INFO:tasks.workunit.client.0.smithi121.stdout:0/701: chown d1/d47/f81 29278 1 2024-08-18T22:41:44.523 INFO:tasks.workunit.client.0.smithi121.stdout:1/832: readlink d5/d10/d14/d2a/d3a/d87/l105 0 2024-08-18T22:41:44.524 INFO:tasks.workunit.client.1.smithi195.stdout:0/492: rename d0/dc/d25/f5f to d0/dc/d11/d23/d51/f9f 0 2024-08-18T22:41:44.525 INFO:tasks.workunit.client.0.smithi121.stdout:0/702: fsync d1/d4/da/d2f/da0/fc5 0 2024-08-18T22:41:44.528 INFO:tasks.workunit.client.0.smithi121.stdout:4/798: write d2/dc/d16/d22/d2c/d44/da7/f105 [527145,7959] 0 2024-08-18T22:41:44.531 INFO:tasks.workunit.client.0.smithi121.stdout:0/703: write d1/d4/db/d18/d40/d83/daf/dd5/f46 [1914421,127417] 0 2024-08-18T22:41:44.531 INFO:tasks.workunit.client.0.smithi121.stdout:5/708: truncate d3/d5/d13/d23/da4/dc7/dae/fc1 682288 0 2024-08-18T22:41:44.532 INFO:tasks.workunit.client.1.smithi195.stdout:0/493: dwrite d0/dc/d11/f79 [0,4194304] 0 2024-08-18T22:41:44.533 INFO:tasks.workunit.client.0.smithi121.stdout:7/832: write de/d98/dfb/dce/d34/d38/d73/da2/d100/d18/d2e/f32 [3880511,112754] 0 2024-08-18T22:41:44.536 INFO:tasks.workunit.client.0.smithi121.stdout:4/799: chown d2/f3f 301 1 2024-08-18T22:41:44.538 INFO:tasks.workunit.client.1.smithi195.stdout:0/494: creat d0/dc/d11/d23/fa0 x:0 0 0 2024-08-18T22:41:44.542 INFO:tasks.workunit.client.0.smithi121.stdout:2/524: dwrite d2/d3/d48/f4e [0,4194304] 0 2024-08-18T22:41:44.542 INFO:tasks.workunit.client.0.smithi121.stdout:1/833: creat d5/d10/d14/d2a/d3a/d87/d6c/d6f/d82/d15/d38/d8e/f11d x:0 0 0 2024-08-18T22:41:44.546 INFO:tasks.workunit.client.0.smithi121.stdout:9/845: write d0/d5/dd/f41 [46041,96308] 0 2024-08-18T22:41:44.546 INFO:tasks.workunit.client.0.smithi121.stdout:7/833: write de/d98/dfb/dce/d20/f3f [1869757,120917] 0 2024-08-18T22:41:44.546 INFO:tasks.workunit.client.0.smithi121.stdout:2/525: chown d2/d3/d84 63 1 2024-08-18T22:41:44.547 INFO:tasks.workunit.client.0.smithi121.stdout:8/941: write d6/d1e/d2d/d78/d45/d86/fb6 [791644,95143] 0 2024-08-18T22:41:44.551 INFO:tasks.workunit.client.0.smithi121.stdout:9/846: stat d0/d38/d9e/df/d3d/d89/d92/dc6/dd5/db3/fff 0 2024-08-18T22:41:44.551 INFO:tasks.workunit.client.0.smithi121.stdout:5/709: mknod d3/d5/d3c/dd3/cdd 0 2024-08-18T22:41:44.554 INFO:tasks.workunit.client.0.smithi121.stdout:5/710: chown d3/d5/d13/d23/da4/dc7/l89 18353 1 2024-08-18T22:41:44.554 INFO:tasks.workunit.client.0.smithi121.stdout:1/834: unlink d5/d10/d14/d2a/d3a/d87/d6c/d6f/l104 0 2024-08-18T22:41:44.556 INFO:tasks.workunit.client.0.smithi121.stdout:0/704: fdatasync d1/d4/db/f37 0 2024-08-18T22:41:44.557 INFO:tasks.workunit.client.1.smithi195.stdout:3/481: dread d7/da/df/d1c/d6a/d6c/f6e [0,4194304] 0 2024-08-18T22:41:44.559 INFO:tasks.workunit.client.0.smithi121.stdout:2/526: rename d2/d8/d1f/f25 to d2/d3/d48/fad 0 2024-08-18T22:41:44.562 INFO:tasks.workunit.client.0.smithi121.stdout:4/800: unlink d2/dc/d8d/fc3 0 2024-08-18T22:41:44.564 INFO:tasks.workunit.client.0.smithi121.stdout:8/942: mknod d6/dd/d3b/c137 0 2024-08-18T22:41:44.564 INFO:tasks.workunit.client.1.smithi195.stdout:6/343: dread da/db/d19/f1d [0,4194304] 0 2024-08-18T22:41:44.566 INFO:tasks.workunit.client.0.smithi121.stdout:1/835: mknod d5/d10/d67/c11e 0 2024-08-18T22:41:44.567 INFO:tasks.workunit.client.0.smithi121.stdout:7/834: symlink de/d98/dfb/dce/d2f/d4b/d6d/dca/df4/l10c 0 2024-08-18T22:41:44.569 INFO:tasks.workunit.client.0.smithi121.stdout:7/835: fsync de/d98/dfb/fc2 0 2024-08-18T22:41:44.569 INFO:tasks.workunit.client.0.smithi121.stdout:0/705: chown d1/d4/da/d2f/da0/ced 443 1 2024-08-18T22:41:44.571 INFO:tasks.workunit.client.1.smithi195.stdout:8/490: dread d1/de/d31/d5a/f50 [0,4194304] 0 2024-08-18T22:41:44.572 INFO:tasks.workunit.client.0.smithi121.stdout:7/836: chown de/d98/dfb/dce/d34/d38/dd6/c8d 76804 1 2024-08-18T22:41:44.573 INFO:tasks.workunit.client.0.smithi121.stdout:8/943: dread d6/d1e/f4d [0,4194304] 0 2024-08-18T22:41:44.573 INFO:tasks.workunit.client.0.smithi121.stdout:9/847: link d0/d38/d9e/df/d61/f7a d0/d5/dd/d3f/f11d 0 2024-08-18T22:41:44.575 INFO:tasks.workunit.client.0.smithi121.stdout:1/836: truncate d5/d10/d14/d2a/d3a/d87/d6c/d6f/d82/d15/d38/d8e/f96 1114799 0 2024-08-18T22:41:44.577 INFO:tasks.workunit.client.0.smithi121.stdout:7/837: chown de/d98/dfb/dce/d34/d38/d73/da2/d100/d18/l90 1 1 2024-08-18T22:41:44.578 INFO:tasks.workunit.client.0.smithi121.stdout:9/848: chown d0/d5/dd/d2f/dcd/f118 80725 1 2024-08-18T22:41:44.581 INFO:tasks.workunit.client.0.smithi121.stdout:0/706: rename d1/d4/db/d18/d40/d83 to d1/d4/db/d24/df/d8/d78/d7c/df5 0 2024-08-18T22:41:44.589 INFO:tasks.workunit.client.0.smithi121.stdout:7/838: truncate de/d98/dfb/dce/d34/d38/d73/da2/d100/d18/d23/d24/d29/d43/d8b/fae 1395277 0 2024-08-18T22:41:44.591 INFO:tasks.workunit.client.0.smithi121.stdout:8/944: link d6/d1e/d2d/d78/d45/l11b d6/d1e/d2d/d78/d45/d86/ded/l138 0 2024-08-18T22:41:44.591 INFO:tasks.workunit.client.0.smithi121.stdout:7/839: fdatasync de/d98/dfb/dce/d2f/d4b/f96 0 2024-08-18T22:41:44.593 INFO:tasks.workunit.client.0.smithi121.stdout:0/707: symlink d1/d4/db/d24/d30/d6c/de7/lf6 0 2024-08-18T22:41:44.597 INFO:tasks.workunit.client.0.smithi121.stdout:7/840: dread - de/d98/dfb/dce/d34/d38/d73/da2/d100/d18/d23/ff7 zero size 2024-08-18T22:41:44.600 INFO:tasks.workunit.client.0.smithi121.stdout:8/945: mkdir d6/d1e/d2d/d78/d139 0 2024-08-18T22:41:44.601 INFO:tasks.workunit.client.0.smithi121.stdout:9/849: dread d0/d5/f30 [0,4194304] 0 2024-08-18T22:41:44.601 INFO:tasks.workunit.client.0.smithi121.stdout:4/801: dwrite d2/dc/d16/d22/d2c/d44/da7/fb1 [0,4194304] 0 2024-08-18T22:41:44.606 INFO:tasks.workunit.client.0.smithi121.stdout:2/527: dwrite d2/d8/d19/d4a/d64/f79 [0,4194304] 0 2024-08-18T22:41:44.610 INFO:tasks.workunit.client.0.smithi121.stdout:0/708: write d1/d4/db/d24/df/d8/d78/d7c/df5/daf/fcc [477965,117892] 0 2024-08-18T22:41:44.618 INFO:tasks.workunit.client.0.smithi121.stdout:1/837: dwrite d5/d10/f8b [0,4194304] 0 2024-08-18T22:41:44.618 INFO:tasks.workunit.client.0.smithi121.stdout:7/841: creat de/d98/dfb/dce/d2f/f10d x:0 0 0 2024-08-18T22:41:44.624 INFO:tasks.workunit.client.0.smithi121.stdout:7/842: readlink de/d98/dfb/dce/d2f/d4b/d6d/l77 0 2024-08-18T22:41:44.624 INFO:tasks.workunit.client.0.smithi121.stdout:8/946: dwrite d6/dd/d3b/da3/dca/d60/d5b/f92 [4194304,4194304] 0 2024-08-18T22:41:44.624 INFO:tasks.workunit.client.0.smithi121.stdout:4/802: rename d2/dc/d16/d22/d2c/d44/d66/f6d to d2/dc/d16/d59/d83/dd7/d104/f127 0 2024-08-18T22:41:44.624 INFO:tasks.workunit.client.0.smithi121.stdout:0/709: symlink d1/d4/db/d24/df/d8/d78/d7c/df5/daf/dcb/lf7 0 2024-08-18T22:41:44.624 INFO:tasks.workunit.client.0.smithi121.stdout:8/947: read d6/d1e/f4d [4469022,76781] 0 2024-08-18T22:41:44.625 INFO:tasks.workunit.client.0.smithi121.stdout:9/850: dread d0/d5/dd/d3b/fae [0,4194304] 0 2024-08-18T22:41:44.625 INFO:tasks.workunit.client.0.smithi121.stdout:7/843: chown de/d98/dfb/dce/d34/l40 1323185 1 2024-08-18T22:41:44.627 INFO:tasks.workunit.client.0.smithi121.stdout:4/803: readlink d2/dc/d16/d22/l7b 0 2024-08-18T22:41:44.629 INFO:tasks.workunit.client.0.smithi121.stdout:1/838: rename d5/d10/c5a to d5/d10/d14/d92/c11f 0 2024-08-18T22:41:44.630 INFO:tasks.workunit.client.0.smithi121.stdout:9/851: readlink d0/d38/d9e/d45/dba/lc1 0 2024-08-18T22:41:44.631 INFO:tasks.workunit.client.0.smithi121.stdout:7/844: write de/d98/dfb/dce/d34/d38/d5f/f94 [3377904,52876] 0 2024-08-18T22:41:44.634 INFO:tasks.workunit.client.1.smithi195.stdout:2/272: sync 2024-08-18T22:41:44.634 INFO:tasks.workunit.client.1.smithi195.stdout:4/387: sync 2024-08-18T22:41:44.635 INFO:tasks.workunit.client.0.smithi121.stdout:1/839: write d5/d10/d14/d2a/d3a/d87/d6c/d6f/f8f [2996562,55099] 0 2024-08-18T22:41:44.635 INFO:tasks.workunit.client.0.smithi121.stdout:0/710: mkdir d1/d4/db/d24/df/d8/d78/d7c/df5/daf/df8 0 2024-08-18T22:41:44.636 INFO:tasks.workunit.client.1.smithi195.stdout:3/482: chown d7/da/df/l4f 0 1 2024-08-18T22:41:44.636 INFO:tasks.workunit.client.1.smithi195.stdout:6/344: creat da/db/d26/f63 x:0 0 0 2024-08-18T22:41:44.637 INFO:tasks.workunit.client.1.smithi195.stdout:6/345: write da/db/f21 [1888438,57738] 0 2024-08-18T22:41:44.639 INFO:tasks.workunit.client.1.smithi195.stdout:2/273: rmdir d1/d24/d26/d42/d44 39 2024-08-18T22:41:44.639 INFO:tasks.workunit.client.0.smithi121.stdout:1/840: fsync d5/dcf/f10c 0 2024-08-18T22:41:44.640 INFO:tasks.workunit.client.1.smithi195.stdout:4/388: mknod d0/d7/d1d/c82 0 2024-08-18T22:41:44.641 INFO:tasks.workunit.client.0.smithi121.stdout:9/852: dwrite d0/d38/d9e/df/d73/f10f [0,4194304] 0 2024-08-18T22:41:44.641 INFO:tasks.workunit.client.0.smithi121.stdout:7/845: write de/d98/dfb/dce/d34/d38/fba [2226903,107455] 0 2024-08-18T22:41:44.642 INFO:tasks.workunit.client.1.smithi195.stdout:3/483: mkdir d7/d54/d9a 0 2024-08-18T22:41:44.642 INFO:tasks.workunit.client.0.smithi121.stdout:4/804: link d2/dc/d16/d22/d2c/fc9 d2/dc/d1c/dc1/ddb/df1/f128 0 2024-08-18T22:41:44.643 INFO:tasks.workunit.client.0.smithi121.stdout:1/841: truncate d5/d10/d14/f5c 4574743 0 2024-08-18T22:41:44.645 INFO:tasks.workunit.client.1.smithi195.stdout:6/346: mkdir da/d15/d1c/d64 0 2024-08-18T22:41:44.648 INFO:tasks.workunit.client.0.smithi121.stdout:7/846: rename de/d2d/f42 to de/d98/dfb/dce/d2f/d4b/d6d/dca/f10e 0 2024-08-18T22:41:44.648 INFO:tasks.workunit.client.1.smithi195.stdout:4/389: creat d0/d9/d11/d16/d37/d48/f83 x:0 0 0 2024-08-18T22:41:44.651 INFO:tasks.workunit.client.1.smithi195.stdout:8/491: creat d1/de/df/fb4 x:0 0 0 2024-08-18T22:41:44.653 INFO:tasks.workunit.client.1.smithi195.stdout:2/274: dread d1/d22/f30 [0,4194304] 0 2024-08-18T22:41:44.654 INFO:tasks.workunit.client.1.smithi195.stdout:6/347: stat da/db/d19/l54 0 2024-08-18T22:41:44.654 INFO:tasks.workunit.client.0.smithi121.stdout:7/847: creat de/d98/dfb/dce/d34/d6c/f10f x:0 0 0 2024-08-18T22:41:44.657 INFO:tasks.workunit.client.0.smithi121.stdout:1/842: mkdir d5/d10/d14/d2a/d3a/d87/d6c/d6f/d82/d15/d120 0 2024-08-18T22:41:44.658 INFO:tasks.workunit.client.1.smithi195.stdout:6/348: mknod da/d15/c65 0 2024-08-18T22:41:44.659 INFO:tasks.workunit.client.1.smithi195.stdout:3/484: link d7/d1f/l98 d7/da/df/d38/l9b 0 2024-08-18T22:41:44.659 INFO:tasks.workunit.client.0.smithi121.stdout:4/805: rename d2/dc/d16/d47/f9a to d2/dc/d16/d22/d2c/d44/d8c/f129 0 2024-08-18T22:41:44.660 INFO:tasks.workunit.client.1.smithi195.stdout:2/275: dwrite d1/f59 [0,4194304] 0 2024-08-18T22:41:44.660 INFO:tasks.workunit.client.1.smithi195.stdout:0/495: write d0/dc/d64/d81/f89 [2197856,64560] 0 2024-08-18T22:41:44.660 INFO:tasks.workunit.client.1.smithi195.stdout:8/492: creat d1/d3/db/d39/d2e/d78/fb5 x:0 0 0 2024-08-18T22:41:44.661 INFO:tasks.workunit.client.0.smithi121.stdout:9/853: link d0/d5/f7d d0/d38/d9e/df/d3d/d89/f11e 0 2024-08-18T22:41:44.662 INFO:tasks.workunit.client.0.smithi121.stdout:1/843: creat d5/d10/d14/d2a/d3a/d87/d6c/f121 x:0 0 0 2024-08-18T22:41:44.662 INFO:tasks.workunit.client.1.smithi195.stdout:4/390: creat d0/d9/d11/f84 x:0 0 0 2024-08-18T22:41:44.664 INFO:tasks.workunit.client.1.smithi195.stdout:8/493: write d1/de/f4e [4880467,130786] 0 2024-08-18T22:41:44.667 INFO:tasks.workunit.client.0.smithi121.stdout:7/848: getdents de/d98/dfb/dce/d2f/d36 0 2024-08-18T22:41:44.667 INFO:tasks.workunit.client.1.smithi195.stdout:2/276: mknod d1/d24/c5a 0 2024-08-18T22:41:44.667 INFO:tasks.workunit.client.1.smithi195.stdout:6/349: dread da/d22/f5c [0,4194304] 0 2024-08-18T22:41:44.668 INFO:tasks.workunit.client.1.smithi195.stdout:3/485: symlink d7/da/df/d8e/l9c 0 2024-08-18T22:41:44.669 INFO:tasks.workunit.client.1.smithi195.stdout:4/391: unlink d0/d9/d11/d16/d37/f43 0 2024-08-18T22:41:44.671 INFO:tasks.workunit.client.1.smithi195.stdout:8/494: creat d1/d3/db/d35/d4d/d8b/fb6 x:0 0 0 2024-08-18T22:41:44.672 INFO:tasks.workunit.client.0.smithi121.stdout:7/849: write de/d98/dfb/dce/d34/d38/d73/fbd [34244,38385] 0 2024-08-18T22:41:44.673 INFO:tasks.workunit.client.1.smithi195.stdout:8/495: fsync d1/d64/f80 0 2024-08-18T22:41:44.674 INFO:tasks.workunit.client.1.smithi195.stdout:0/496: dwrite d0/dc/f84 [0,4194304] 0 2024-08-18T22:41:44.676 INFO:tasks.workunit.client.1.smithi195.stdout:4/392: unlink d0/d9/d11/d16/f55 0 2024-08-18T22:41:44.676 INFO:tasks.workunit.client.0.smithi121.stdout:1/844: dwrite d5/d10/d14/d2a/d3a/d87/d6c/ff4 [0,4194304] 0 2024-08-18T22:41:44.678 INFO:tasks.workunit.client.0.smithi121.stdout:9/854: dwrite d0/d38/d9e/df/f40 [0,4194304] 0 2024-08-18T22:41:44.680 INFO:tasks.workunit.client.1.smithi195.stdout:2/277: mkdir d1/d8/d3d/d3b/d53/d5b 0 2024-08-18T22:41:44.682 INFO:tasks.workunit.client.0.smithi121.stdout:7/850: creat de/d98/dfb/dce/d34/d38/d73/da2/d100/da0/f110 x:0 0 0 2024-08-18T22:41:44.683 INFO:tasks.workunit.client.1.smithi195.stdout:8/496: dwrite d1/d3/d1c/d21/f28 [0,4194304] 0 2024-08-18T22:41:44.684 INFO:tasks.workunit.client.1.smithi195.stdout:0/497: rename d0/l4 to d0/dc/d11/d6f/la1 0 2024-08-18T22:41:44.686 INFO:tasks.workunit.client.0.smithi121.stdout:1/845: write d5/d10/d14/d2a/d3a/d87/d6c/d6f/d79/fb9 [529141,70574] 0 2024-08-18T22:41:44.689 INFO:tasks.workunit.client.1.smithi195.stdout:8/497: symlink d1/d3/db/d35/lb7 0 2024-08-18T22:41:44.690 INFO:tasks.workunit.client.0.smithi121.stdout:3/794: sync 2024-08-18T22:41:44.690 INFO:tasks.workunit.client.0.smithi121.stdout:9/855: rename d0/d38/d9e/df/d3d/d89/d92/dc6/dd5/db3 to d0/d5/d11f 0 2024-08-18T22:41:44.690 INFO:tasks.workunit.client.0.smithi121.stdout:4/806: dwrite d2/dc/d16/d22/d2c/d44/d66/f91 [0,4194304] 0 2024-08-18T22:41:44.691 INFO:tasks.workunit.client.0.smithi121.stdout:7/851: mkdir de/d98/dfb/dce/d34/d38/d73/dbb/d111 0 2024-08-18T22:41:44.692 INFO:tasks.workunit.client.0.smithi121.stdout:1/846: chown d5/d10/d14/d2a/d3a/d87/c62 122 1 2024-08-18T22:41:44.694 INFO:tasks.workunit.client.1.smithi195.stdout:4/393: rename d0/d9/d11/d16/d37 to d0/d9/d41/d76/d85 0 2024-08-18T22:41:44.695 INFO:tasks.workunit.client.0.smithi121.stdout:4/807: write d2/dc/d1c/daa/f119 [951719,124415] 0 2024-08-18T22:41:44.696 INFO:tasks.workunit.client.1.smithi195.stdout:0/498: fdatasync d0/dc/d64/d81/d44/d41/d4c/f61 0 2024-08-18T22:41:44.697 INFO:tasks.workunit.client.1.smithi195.stdout:6/350: getdents da 0 2024-08-18T22:41:44.697 INFO:tasks.workunit.client.1.smithi195.stdout:2/278: mkdir d1/d24/d26/d42/d5c 0 2024-08-18T22:41:44.698 INFO:tasks.workunit.client.0.smithi121.stdout:3/795: chown d1e/d1f/c20 101973187 1 2024-08-18T22:41:44.698 INFO:tasks.workunit.client.0.smithi121.stdout:9/856: symlink d0/d38/d9e/df/d73/l120 0 2024-08-18T22:41:44.698 INFO:tasks.workunit.client.1.smithi195.stdout:4/394: mkdir d0/d9/d41/d76/d86 0 2024-08-18T22:41:44.700 INFO:tasks.workunit.client.0.smithi121.stdout:7/852: rename de/d98/dfb/dce/d2f/d4b/d6d/ffa to de/da4/f112 0 2024-08-18T22:41:44.701 INFO:tasks.workunit.client.0.smithi121.stdout:7/853: fsync de/d98/dfb/fc2 0 2024-08-18T22:41:44.702 INFO:tasks.workunit.client.1.smithi195.stdout:3/486: dwrite d7/f17 [0,4194304] 0 2024-08-18T22:41:44.703 INFO:tasks.workunit.client.0.smithi121.stdout:1/847: creat d5/dcf/de1/f122 x:0 0 0 2024-08-18T22:41:44.704 INFO:tasks.workunit.client.1.smithi195.stdout:8/498: symlink d1/de/dac/lb8 0 2024-08-18T22:41:44.704 INFO:tasks.workunit.client.1.smithi195.stdout:6/351: mkdir da/d3b/d66 0 2024-08-18T22:41:44.704 INFO:tasks.workunit.client.0.smithi121.stdout:4/808: rmdir d2/dc/d8d 39 2024-08-18T22:41:44.705 INFO:tasks.workunit.client.1.smithi195.stdout:2/279: chown d1/d24/f34 20 1 2024-08-18T22:41:44.706 INFO:tasks.workunit.client.0.smithi121.stdout:9/857: rmdir d0/d38/d52/d5f/de1 39 2024-08-18T22:41:44.706 INFO:tasks.workunit.client.0.smithi121.stdout:3/796: rename d1e/d1f/dba/d113/feb to d1e/d1f/dba/df6/dd3/f125 0 2024-08-18T22:41:44.708 INFO:tasks.workunit.client.0.smithi121.stdout:3/797: readlink d1e/d1f/d25/d67/d92/dbd/l84 0 2024-08-18T22:41:44.708 INFO:tasks.workunit.client.0.smithi121.stdout:7/854: fsync de/d98/dfb/dce/d2f/f72 0 2024-08-18T22:41:44.709 INFO:tasks.workunit.client.0.smithi121.stdout:4/809: fsync d2/dc/d16/d59/d83/f9c 0 2024-08-18T22:41:44.710 INFO:tasks.workunit.client.0.smithi121.stdout:3/798: readlink d1e/d1f/d25/d6b/db4/d94/de6/l108 0 2024-08-18T22:41:44.713 INFO:tasks.workunit.client.1.smithi195.stdout:8/499: creat d1/d64/fb9 x:0 0 0 2024-08-18T22:41:44.713 INFO:tasks.workunit.client.1.smithi195.stdout:0/499: dwrite d0/dc/d64/d81/d44/d41/f73 [0,4194304] 0 2024-08-18T22:41:44.714 INFO:tasks.workunit.client.1.smithi195.stdout:6/352: rename da/d3b/d66 to da/db/d19/d67 0 2024-08-18T22:41:44.715 INFO:tasks.workunit.client.0.smithi121.stdout:1/848: rename d5/d10/d67/dc2/df3/ff5 to d5/d10/d14/d2a/d3a/d87/d6c/d6f/d82/d15/d28/d3d/d9a/dac/f123 0 2024-08-18T22:41:44.716 INFO:tasks.workunit.client.0.smithi121.stdout:4/810: dread d2/f3f [0,4194304] 0 2024-08-18T22:41:44.716 INFO:tasks.workunit.client.1.smithi195.stdout:8/500: write d1/de/fab [285226,110238] 0 2024-08-18T22:41:44.717 INFO:tasks.workunit.client.0.smithi121.stdout:9/858: link d0/d5/dd/d3f/fa7 d0/d5/f121 0 2024-08-18T22:41:44.720 INFO:tasks.workunit.client.0.smithi121.stdout:4/811: read d2/f9 [3116117,41912] 0 2024-08-18T22:41:44.720 INFO:tasks.workunit.client.1.smithi195.stdout:6/353: write da/d15/d1c/f12 [1111551,113551] 0 2024-08-18T22:41:44.721 INFO:tasks.workunit.client.0.smithi121.stdout:4/812: write d2/dc/d16/f36 [8101036,87263] 0 2024-08-18T22:41:44.730 INFO:tasks.workunit.client.1.smithi195.stdout:0/500: getdents d0/dc/d64/d81/d44/d41/d6d/d92 0 2024-08-18T22:41:44.732 INFO:tasks.workunit.client.1.smithi195.stdout:8/501: dwrite d1/d3/db/d7a/fb1 [0,4194304] 0 2024-08-18T22:41:44.734 INFO:tasks.workunit.client.1.smithi195.stdout:6/354: dwrite da/d15/d1c/f50 [0,4194304] 0 2024-08-18T22:41:44.737 INFO:tasks.workunit.client.1.smithi195.stdout:2/280: dread d1/d8/d3d/f1c [0,4194304] 0 2024-08-18T22:41:44.738 INFO:tasks.workunit.client.1.smithi195.stdout:0/501: write d0/dc/d64/d81/f40 [2848634,113809] 0 2024-08-18T22:41:44.739 INFO:tasks.workunit.client.1.smithi195.stdout:4/395: dread d0/d7/d1d/f3d [0,4194304] 0 2024-08-18T22:41:44.740 INFO:tasks.workunit.client.1.smithi195.stdout:2/281: readlink d1/d24/l33 0 2024-08-18T22:41:44.745 INFO:tasks.workunit.client.1.smithi195.stdout:3/487: dwrite d7/d1f/f34 [0,4194304] 0 2024-08-18T22:41:44.745 INFO:tasks.workunit.client.1.smithi195.stdout:8/502: creat d1/d3/db/d35/d4d/d95/daf/fba x:0 0 0 2024-08-18T22:41:44.746 INFO:tasks.workunit.client.1.smithi195.stdout:5/449: sync 2024-08-18T22:41:44.746 INFO:tasks.workunit.client.1.smithi195.stdout:7/446: sync 2024-08-18T22:41:44.747 INFO:tasks.workunit.client.1.smithi195.stdout:6/355: rename c4 to da/d15/d1c/c68 0 2024-08-18T22:41:44.750 INFO:tasks.workunit.client.1.smithi195.stdout:8/503: chown d1/d3/db/d39/d2e/f4c 20170677 1 2024-08-18T22:41:44.753 INFO:tasks.workunit.client.1.smithi195.stdout:3/488: write d7/da/df/d1c/f23 [8866175,69127] 0 2024-08-18T22:41:44.754 INFO:tasks.workunit.client.1.smithi195.stdout:4/396: dread - d0/d9/d11/d16/f5e zero size 2024-08-18T22:41:44.762 INFO:tasks.workunit.client.1.smithi195.stdout:0/502: dwrite d0/dc/d64/d81/d44/d41/d6d/d92/d66/f8b [0,4194304] 0 2024-08-18T22:41:44.764 INFO:tasks.workunit.client.1.smithi195.stdout:2/282: dwrite d1/d24/d26/f36 [0,4194304] 0 2024-08-18T22:41:44.764 INFO:tasks.workunit.client.1.smithi195.stdout:7/447: dread dc/d2a/f7c [0,4194304] 0 2024-08-18T22:41:44.766 INFO:tasks.workunit.client.1.smithi195.stdout:4/397: creat d0/d7/d1d/d69/d7d/f87 x:0 0 0 2024-08-18T22:41:44.766 INFO:tasks.workunit.client.1.smithi195.stdout:8/504: write d1/d3/d1c/f52 [1917773,75993] 0 2024-08-18T22:41:44.767 INFO:tasks.workunit.client.1.smithi195.stdout:5/450: dwrite d0/d3/df/f58 [0,4194304] 0 2024-08-18T22:41:44.767 INFO:tasks.workunit.client.1.smithi195.stdout:3/489: creat d7/da/df/d95/f9d x:0 0 0 2024-08-18T22:41:44.767 INFO:tasks.workunit.client.1.smithi195.stdout:6/356: dread f6 [0,4194304] 0 2024-08-18T22:41:44.767 INFO:tasks.workunit.client.1.smithi195.stdout:0/503: readlink d0/dc/d11/l57 0 2024-08-18T22:41:44.772 INFO:tasks.workunit.client.1.smithi195.stdout:2/283: truncate d1/f1b 1118281 0 2024-08-18T22:41:44.773 INFO:tasks.workunit.client.1.smithi195.stdout:0/504: chown d0/dc/d11/d23/f9b 87725625 1 2024-08-18T22:41:44.776 INFO:tasks.workunit.client.1.smithi195.stdout:6/357: chown da/db/c52 127877 1 2024-08-18T22:41:44.776 INFO:tasks.workunit.client.1.smithi195.stdout:3/490: chown d7/da/df/c6f 3372495 1 2024-08-18T22:41:44.777 INFO:tasks.workunit.client.1.smithi195.stdout:7/448: rename dc/d2a/d4c/l6d to dc/d8f/d96/la7 0 2024-08-18T22:41:44.777 INFO:tasks.workunit.client.1.smithi195.stdout:5/451: truncate d0/d3/df/f74 949435 0 2024-08-18T22:41:44.778 INFO:tasks.workunit.client.1.smithi195.stdout:4/398: creat d0/d9/d3b/f88 x:0 0 0 2024-08-18T22:41:44.778 INFO:tasks.workunit.client.1.smithi195.stdout:7/449: stat dc/d14/d15/d4d 0 2024-08-18T22:41:44.781 INFO:tasks.workunit.client.1.smithi195.stdout:2/284: symlink d1/d24/l5d 0 2024-08-18T22:41:44.783 INFO:tasks.workunit.client.1.smithi195.stdout:3/491: symlink d7/da/df/d38/l9e 0 2024-08-18T22:41:44.785 INFO:tasks.workunit.client.1.smithi195.stdout:3/492: chown d7/da/d75/d96 759288 1 2024-08-18T22:41:44.786 INFO:tasks.workunit.client.1.smithi195.stdout:0/505: symlink d0/dc/d11/d23/d8e/la2 0 2024-08-18T22:41:44.788 INFO:tasks.workunit.client.1.smithi195.stdout:6/358: dwrite da/d15/f31 [0,4194304] 0 2024-08-18T22:41:44.789 INFO:tasks.workunit.client.1.smithi195.stdout:5/452: getdents d0/d3/d66 0 2024-08-18T22:41:44.790 INFO:tasks.workunit.client.1.smithi195.stdout:3/493: chown d7/d1f/d74/l79 128338992 1 2024-08-18T22:41:44.791 INFO:tasks.workunit.client.1.smithi195.stdout:7/450: link dc/d14/f68 dc/d14/d15/fa8 0 2024-08-18T22:41:44.792 INFO:tasks.workunit.client.1.smithi195.stdout:8/505: getdents d1/d3/db/d35/d56 0 2024-08-18T22:41:44.792 INFO:tasks.workunit.client.1.smithi195.stdout:9/478: sync 2024-08-18T22:41:44.792 INFO:tasks.workunit.client.1.smithi195.stdout:1/568: sync 2024-08-18T22:41:44.795 INFO:tasks.workunit.client.1.smithi195.stdout:1/569: chown da/d68 360680403 1 2024-08-18T22:41:44.797 INFO:tasks.workunit.client.1.smithi195.stdout:6/359: unlink da/db/f21 0 2024-08-18T22:41:44.798 INFO:tasks.workunit.client.1.smithi195.stdout:2/285: dwrite d1/d8/d3d/f3e [0,4194304] 0 2024-08-18T22:41:44.799 INFO:tasks.workunit.client.1.smithi195.stdout:9/479: mkdir d1c/d74/d7b/d82/d98 0 2024-08-18T22:41:44.801 INFO:tasks.workunit.client.1.smithi195.stdout:9/480: chown f14 3471366 1 2024-08-18T22:41:44.802 INFO:tasks.workunit.client.1.smithi195.stdout:6/360: truncate da/f13 621377 0 2024-08-18T22:41:44.803 INFO:tasks.workunit.client.1.smithi195.stdout:8/506: unlink d1/de/d31/d88/f9b 0 2024-08-18T22:41:44.805 INFO:tasks.workunit.client.1.smithi195.stdout:4/399: write d0/d9/d3b/f5a [747644,77518] 0 2024-08-18T22:41:44.807 INFO:tasks.workunit.client.1.smithi195.stdout:7/451: dwrite dc/d22/f7e [0,4194304] 0 2024-08-18T22:41:44.811 INFO:tasks.workunit.client.1.smithi195.stdout:6/361: fdatasync da/d15/d1c/d2e/f3d 0 2024-08-18T22:41:44.811 INFO:tasks.workunit.client.1.smithi195.stdout:3/494: creat d7/da/df/d1c/d6a/d6c/f9f x:0 0 0 2024-08-18T22:41:44.812 INFO:tasks.workunit.client.1.smithi195.stdout:5/453: creat d0/d46/d6d/f89 x:0 0 0 2024-08-18T22:41:44.813 INFO:tasks.workunit.client.1.smithi195.stdout:4/400: write d0/d7/d1d/f28 [2792821,75725] 0 2024-08-18T22:41:44.813 INFO:tasks.workunit.client.1.smithi195.stdout:1/570: fdatasync da/d18/f47 0 2024-08-18T22:41:44.814 INFO:tasks.workunit.client.1.smithi195.stdout:3/495: chown l3 3 1 2024-08-18T22:41:44.819 INFO:tasks.workunit.client.1.smithi195.stdout:0/506: creat d0/dc/d64/fa3 x:0 0 0 2024-08-18T22:41:44.819 INFO:tasks.workunit.client.1.smithi195.stdout:7/452: symlink dc/d1d/d29/d5d/la9 0 2024-08-18T22:41:44.820 INFO:tasks.workunit.client.1.smithi195.stdout:5/454: creat d0/d2/d79/f8a x:0 0 0 2024-08-18T22:41:44.820 INFO:tasks.workunit.client.1.smithi195.stdout:3/496: dread - d7/da/df/d38/f86 zero size 2024-08-18T22:41:44.820 INFO:tasks.workunit.client.0.smithi121.stdout:3/799: rename d1e/d1f/d25/d74 to d1e/d1f/d25/d67/d92/dbd/d126 0 2024-08-18T22:41:44.822 INFO:tasks.workunit.client.1.smithi195.stdout:9/481: rename d1c/d32/d71/d75/f7e to d1c/d32/f99 0 2024-08-18T22:41:44.823 INFO:tasks.workunit.client.1.smithi195.stdout:2/286: dwrite d1/d22/f31 [0,4194304] 0 2024-08-18T22:41:44.823 INFO:tasks.workunit.client.0.smithi121.stdout:1/849: creat d5/d10/d14/d2a/daf/f124 x:0 0 0 2024-08-18T22:41:44.825 INFO:tasks.workunit.client.1.smithi195.stdout:7/453: fdatasync dc/d1d/d29/f34 0 2024-08-18T22:41:44.827 INFO:tasks.workunit.client.1.smithi195.stdout:5/455: fsync d0/d3/f7e 0 2024-08-18T22:41:44.829 INFO:tasks.workunit.client.1.smithi195.stdout:6/362: rename da/db/d26/d2d/c5a to da/db/d26/c69 0 2024-08-18T22:41:44.830 INFO:tasks.workunit.client.1.smithi195.stdout:9/482: dread - d1c/d32/d37/d4b/f6e zero size 2024-08-18T22:41:44.830 INFO:tasks.workunit.client.1.smithi195.stdout:2/287: chown d1/d8/d3d/d4d 7296 1 2024-08-18T22:41:44.832 INFO:tasks.workunit.client.1.smithi195.stdout:0/507: mknod d0/dc/d64/d81/d44/ca4 0 2024-08-18T22:41:44.832 INFO:tasks.workunit.client.1.smithi195.stdout:6/363: fsync da/d3b/f49 0 2024-08-18T22:41:44.832 INFO:tasks.workunit.client.0.smithi121.stdout:9/859: dwrite d0/d5/f121 [0,4194304] 0 2024-08-18T22:41:44.834 INFO:tasks.workunit.client.1.smithi195.stdout:5/456: mkdir d0/d37/d8b 0 2024-08-18T22:41:44.834 INFO:tasks.workunit.client.1.smithi195.stdout:9/483: mkdir d1c/d92/d9a 0 2024-08-18T22:41:44.836 INFO:tasks.workunit.client.1.smithi195.stdout:7/454: mkdir dc/d14/daa 0 2024-08-18T22:41:44.836 INFO:tasks.workunit.client.0.smithi121.stdout:4/813: creat d2/dc/d1c/f12a x:0 0 0 2024-08-18T22:41:44.836 INFO:tasks.workunit.client.1.smithi195.stdout:9/484: fdatasync f3 0 2024-08-18T22:41:44.837 INFO:tasks.workunit.client.1.smithi195.stdout:2/288: write d1/d8/d3d/fc [4384483,52733] 0 2024-08-18T22:41:44.837 INFO:tasks.workunit.client.1.smithi195.stdout:6/364: chown da/d15/f2c 15666 1 2024-08-18T22:41:44.837 INFO:tasks.workunit.client.0.smithi121.stdout:4/814: readlink d2/dc/d16/d59/d83/l85 0 2024-08-18T22:41:44.838 INFO:tasks.workunit.client.1.smithi195.stdout:3/497: dwrite d7/f17 [0,4194304] 0 2024-08-18T22:41:44.841 INFO:tasks.workunit.client.1.smithi195.stdout:8/507: dread d1/d3/d1c/d21/f62 [0,4194304] 0 2024-08-18T22:41:44.842 INFO:tasks.workunit.client.1.smithi195.stdout:2/289: write d1/d8/d3d/f3e [8918404,610] 0 2024-08-18T22:41:44.842 INFO:tasks.workunit.client.0.smithi121.stdout:4/815: read d2/dc/d1c/f7d [7932159,86132] 0 2024-08-18T22:41:44.842 INFO:tasks.workunit.client.1.smithi195.stdout:0/508: read d0/dc/d11/d23/d51/f72 [1671399,43432] 0 2024-08-18T22:41:44.843 INFO:tasks.workunit.client.1.smithi195.stdout:7/455: symlink dc/d8f/d96/lab 0 2024-08-18T22:41:44.845 INFO:tasks.workunit.client.1.smithi195.stdout:3/498: dread d7/f89 [0,4194304] 0 2024-08-18T22:41:44.846 INFO:tasks.workunit.client.0.smithi121.stdout:1/850: rename d5/d10/d14/c23 to d5/d10/d14/c125 0 2024-08-18T22:41:44.847 INFO:tasks.workunit.client.1.smithi195.stdout:3/499: chown d7/da/d75/f78 0 1 2024-08-18T22:41:44.847 INFO:tasks.workunit.client.1.smithi195.stdout:6/365: rmdir da/db/d2a 39 2024-08-18T22:41:44.848 INFO:tasks.workunit.client.1.smithi195.stdout:1/571: truncate da/f24 1505382 0 2024-08-18T22:41:44.849 INFO:tasks.workunit.client.1.smithi195.stdout:7/456: write dc/d22/f3e [880414,86670] 0 2024-08-18T22:41:44.850 INFO:tasks.workunit.client.1.smithi195.stdout:3/500: stat d7/da/df/d1c 0 2024-08-18T22:41:44.851 INFO:tasks.workunit.client.1.smithi195.stdout:5/457: rename d0/d3/df/f76 to d0/d3/d66/f8c 0 2024-08-18T22:41:44.851 INFO:tasks.workunit.client.0.smithi121.stdout:1/851: mknod d5/d10/d14/d2a/d91/c126 0 2024-08-18T22:41:44.852 INFO:tasks.workunit.client.0.smithi121.stdout:3/800: dwrite d1e/d1f/da6/dc7/dae/fc2 [0,4194304] 0 2024-08-18T22:41:44.852 INFO:tasks.workunit.client.1.smithi195.stdout:1/572: chown da/d4c/d5d/l6c 14356661 1 2024-08-18T22:41:44.854 INFO:tasks.workunit.client.0.smithi121.stdout:3/801: chown d1e/d1f/dba/d113 105198 1 2024-08-18T22:41:44.854 INFO:tasks.workunit.client.1.smithi195.stdout:3/501: dread - d7/da/df/d38/f86 zero size 2024-08-18T22:41:44.854 INFO:tasks.workunit.client.1.smithi195.stdout:0/509: mkdir d0/dc/d64/d81/d44/d41/d6d/da5 0 2024-08-18T22:41:44.855 INFO:tasks.workunit.client.0.smithi121.stdout:4/816: dwrite d2/dc/d1c/f12a [0,4194304] 0 2024-08-18T22:41:44.856 INFO:tasks.workunit.client.1.smithi195.stdout:8/508: write d1/d3/db/d39/f59 [2192966,69811] 0 2024-08-18T22:41:44.860 INFO:tasks.workunit.client.0.smithi121.stdout:3/802: symlink d1e/d1f/d3e/l127 0 2024-08-18T22:41:44.860 INFO:tasks.workunit.client.1.smithi195.stdout:6/366: dread da/d3b/f49 [0,4194304] 0 2024-08-18T22:41:44.863 INFO:tasks.workunit.client.0.smithi121.stdout:4/817: rename d2/dc/d16/d22/d2c/d44/da7/c121 to d2/dc/d16/d22/d2c/d44/d8c/c12b 0 2024-08-18T22:41:44.865 INFO:tasks.workunit.client.0.smithi121.stdout:1/852: getdents d5 0 2024-08-18T22:41:44.865 INFO:tasks.workunit.client.0.smithi121.stdout:1/853: stat d5/d10/d14/lf8 0 2024-08-18T22:41:44.866 INFO:tasks.workunit.client.0.smithi121.stdout:3/803: unlink d1e/d1f/d25/d67/caa 0 2024-08-18T22:41:44.866 INFO:tasks.workunit.client.1.smithi195.stdout:4/401: dwrite d0/d9/f44 [4194304,4194304] 0 2024-08-18T22:41:44.867 INFO:tasks.workunit.client.0.smithi121.stdout:4/818: creat d2/d7c/f12c x:0 0 0 2024-08-18T22:41:44.867 INFO:tasks.workunit.client.1.smithi195.stdout:3/502: truncate d7/da/df/d1c/d6a/d6c/f6e 1181080 0 2024-08-18T22:41:44.868 INFO:tasks.workunit.client.1.smithi195.stdout:5/458: creat d0/d3/f8d x:0 0 0 2024-08-18T22:41:44.868 INFO:tasks.workunit.client.1.smithi195.stdout:4/402: chown d0/d7/d1d/d69 57161 1 2024-08-18T22:41:44.869 INFO:tasks.workunit.client.0.smithi121.stdout:3/804: unlink d1e/d1f/c55 0 2024-08-18T22:41:44.869 INFO:tasks.workunit.client.0.smithi121.stdout:1/854: write d5/d10/d14/d2a/d3a/d87/d6c/d6f/fc4 [65029,130467] 0 2024-08-18T22:41:44.871 INFO:tasks.workunit.client.0.smithi121.stdout:9/860: write d0/fad [2798778,84529] 0 2024-08-18T22:41:44.871 INFO:tasks.workunit.client.0.smithi121.stdout:1/855: truncate d5/d10/d14/d2a/d3a/fe3 750535 0 2024-08-18T22:41:44.872 INFO:tasks.workunit.client.1.smithi195.stdout:4/403: chown d0/d9/d11/d16/d54/f5c 7711 1 2024-08-18T22:41:44.874 INFO:tasks.workunit.client.0.smithi121.stdout:1/856: write d5/d10/d14/d2a/d3a/ff7 [532023,85417] 0 2024-08-18T22:41:44.876 INFO:tasks.workunit.client.1.smithi195.stdout:1/573: getdents da/d4c 0 2024-08-18T22:41:44.877 INFO:tasks.workunit.client.0.smithi121.stdout:3/805: read d1e/d1f/d25/f27 [1321000,6341] 0 2024-08-18T22:41:44.877 INFO:tasks.workunit.client.1.smithi195.stdout:8/509: creat d1/de/df/d1d/d8e/fbb x:0 0 0 2024-08-18T22:41:44.878 INFO:tasks.workunit.client.0.smithi121.stdout:9/861: rename d0/d38/d9e/df/d3d/d89/d92/df0 to d0/d38/d52/d5f/de1/d122 0 2024-08-18T22:41:44.880 INFO:tasks.workunit.client.0.smithi121.stdout:1/857: creat d5/d10/d14/d2a/d3a/d87/d6c/f127 x:0 0 0 2024-08-18T22:41:44.882 INFO:tasks.workunit.client.0.smithi121.stdout:9/862: truncate d0/d38/d9e/df/d3d/fbd 3345330 0 2024-08-18T22:41:44.882 INFO:tasks.workunit.client.1.smithi195.stdout:5/459: creat d0/d46/d6d/f8e x:0 0 0 2024-08-18T22:41:44.883 INFO:tasks.workunit.client.0.smithi121.stdout:3/806: rename d1e/d1f/d25/d2e/d36 to d1e/d1f/dba/d113/d116/d128 0 2024-08-18T22:41:44.885 INFO:tasks.workunit.client.0.smithi121.stdout:3/807: chown d1e/d1f/d2a/c34 670843 1 2024-08-18T22:41:44.885 INFO:tasks.workunit.client.0.smithi121.stdout:1/858: symlink d5/d10/d14/d2a/d3a/d87/d6c/d6f/d82/d15/l128 0 2024-08-18T22:41:44.886 INFO:tasks.workunit.client.1.smithi195.stdout:3/503: dwrite d7/f5c [0,4194304] 0 2024-08-18T22:41:44.887 INFO:tasks.workunit.client.0.smithi121.stdout:9/863: rename d0/d5/dd/f9c to d0/d38/d52/d5f/de1/f123 0 2024-08-18T22:41:44.887 INFO:tasks.workunit.client.1.smithi195.stdout:5/460: stat d0/d3/d8/c2b 0 2024-08-18T22:41:44.888 INFO:tasks.workunit.client.0.smithi121.stdout:1/859: chown d5/d10/d14/d2a/d3a/d87/d6c/d6f/d82/ddb/c109 29381 1 2024-08-18T22:41:44.889 INFO:tasks.workunit.client.1.smithi195.stdout:8/510: write d1/d3/db/d39/f70 [1972271,65220] 0 2024-08-18T22:41:44.889 INFO:tasks.workunit.client.1.smithi195.stdout:4/404: write d0/d9/f57 [1642642,31036] 0 2024-08-18T22:41:44.891 INFO:tasks.workunit.client.0.smithi121.stdout:1/860: creat d5/dcf/de1/f129 x:0 0 0 2024-08-18T22:41:44.891 INFO:tasks.workunit.client.1.smithi195.stdout:5/461: dread - d0/f77 zero size 2024-08-18T22:41:44.894 INFO:tasks.workunit.client.1.smithi195.stdout:1/574: dwrite da/f13 [4194304,4194304] 0 2024-08-18T22:41:44.896 INFO:tasks.workunit.client.1.smithi195.stdout:2/290: dwrite d1/f1b [0,4194304] 0 2024-08-18T22:41:44.897 INFO:tasks.workunit.client.0.smithi121.stdout:1/861: rename d5/d10/d14/d34/fae to d5/d10/d14/d2a/d3a/d87/d6c/d6f/d82/d15/d28/d3d/f12a 0 2024-08-18T22:41:44.897 INFO:tasks.workunit.client.1.smithi195.stdout:7/457: truncate dc/f25 8246495 0 2024-08-18T22:41:44.898 INFO:tasks.workunit.client.1.smithi195.stdout:3/504: read d7/da/df/d38/f45 [2513192,12137] 0 2024-08-18T22:41:44.902 INFO:tasks.workunit.client.1.smithi195.stdout:4/405: unlink d0/d9/d11/d16/f4f 0 2024-08-18T22:41:44.903 INFO:tasks.workunit.client.0.smithi121.stdout:4/819: dread d2/d7c/f7f [0,4194304] 0 2024-08-18T22:41:44.904 INFO:tasks.workunit.client.1.smithi195.stdout:8/511: symlink d1/d3/d1c/d21/lbc 0 2024-08-18T22:41:44.904 INFO:tasks.workunit.client.1.smithi195.stdout:9/485: dread d1c/f1f [0,4194304] 0 2024-08-18T22:41:44.904 INFO:tasks.workunit.client.0.smithi121.stdout:1/862: getdents d5/d10/d14/d92/d9f 0 2024-08-18T22:41:44.906 INFO:tasks.workunit.client.1.smithi195.stdout:8/512: stat d1/d3/db/d35/d4d/d95/daf/fba 0 2024-08-18T22:41:44.906 INFO:tasks.workunit.client.1.smithi195.stdout:7/458: creat dc/d8f/fac x:0 0 0 2024-08-18T22:41:44.910 INFO:tasks.workunit.client.1.smithi195.stdout:4/406: truncate d0/d9/f79 675827 0 2024-08-18T22:41:44.911 INFO:tasks.workunit.client.1.smithi195.stdout:5/462: link d0/d2/l59 d0/d3/df/l8f 0 2024-08-18T22:41:44.911 INFO:tasks.workunit.client.0.smithi121.stdout:4/820: rename d2/dc/d16/d22/d2c/d44/d66/l82 to d2/dc/d16/d22/d2c/d7a/da0/de8/l12d 0 2024-08-18T22:41:44.912 INFO:tasks.workunit.client.0.smithi121.stdout:3/808: truncate d1e/d1f/dba/df6/fa8 2896680 0 2024-08-18T22:41:44.913 INFO:tasks.workunit.client.1.smithi195.stdout:3/505: creat d7/da/fa0 x:0 0 0 2024-08-18T22:41:44.913 INFO:tasks.workunit.client.1.smithi195.stdout:0/510: dread d0/dc/d64/d81/d44/d41/d6d/f76 [4194304,4194304] 0 2024-08-18T22:41:44.915 INFO:tasks.workunit.client.0.smithi121.stdout:1/863: rename d5/d10/d14/d2a/d3a/d87/d6c/d6f/d82/d15/c61 to d5/d10/d14/d92/c12b 0 2024-08-18T22:41:44.915 INFO:tasks.workunit.client.1.smithi195.stdout:7/459: rename dc/d22/c8a to dc/cad 0 2024-08-18T22:41:44.916 INFO:tasks.workunit.client.1.smithi195.stdout:5/463: mkdir d0/d2/d29/d88/d90 0 2024-08-18T22:41:44.917 INFO:tasks.workunit.client.1.smithi195.stdout:7/460: write dc/d14/d15/f42 [4803989,10749] 0 2024-08-18T22:41:44.919 INFO:tasks.workunit.client.0.smithi121.stdout:3/809: unlink d1e/d1f/d25/d6b/d83/fd6 0 2024-08-18T22:41:44.919 INFO:tasks.workunit.client.0.smithi121.stdout:9/864: dwrite d0/d38/d9e/f63 [0,4194304] 0 2024-08-18T22:41:44.919 INFO:tasks.workunit.client.1.smithi195.stdout:7/461: chown dc/d2a 89 1 2024-08-18T22:41:44.920 INFO:tasks.workunit.client.1.smithi195.stdout:3/506: creat d7/da/df/d38/fa1 x:0 0 0 2024-08-18T22:41:44.921 INFO:tasks.workunit.client.1.smithi195.stdout:4/407: dread d0/d7/d1d/f47 [0,4194304] 0 2024-08-18T22:41:44.922 INFO:tasks.workunit.client.1.smithi195.stdout:7/462: readlink dc/d1d/d29/d5d/la9 0 2024-08-18T22:41:44.923 INFO:tasks.workunit.client.1.smithi195.stdout:8/513: getdents d1/d3/db/d39/d44 0 2024-08-18T22:41:44.924 INFO:tasks.workunit.client.0.smithi121.stdout:1/864: symlink d5/d10/d14/d2a/d3a/d87/d6c/d6f/d79/dab/l12c 0 2024-08-18T22:41:44.925 INFO:tasks.workunit.client.0.smithi121.stdout:3/810: creat d1e/d1f/d25/d58/de0/f129 x:0 0 0 2024-08-18T22:41:44.927 INFO:tasks.workunit.client.1.smithi195.stdout:0/511: rmdir d0/dc/dd 39 2024-08-18T22:41:44.928 INFO:tasks.workunit.client.1.smithi195.stdout:4/408: fdatasync d0/d7/d1d/d69/d7d/f87 0 2024-08-18T22:41:44.930 INFO:tasks.workunit.client.0.smithi121.stdout:3/811: write d1e/d1f/d25/d6b/db4/d94/de6/f11a [135277,91228] 0 2024-08-18T22:41:44.931 INFO:tasks.workunit.client.1.smithi195.stdout:5/464: dwrite d0/db/f78 [0,4194304] 0 2024-08-18T22:41:44.932 INFO:tasks.workunit.client.1.smithi195.stdout:8/514: rmdir d1/d3/db/d35/d56 39 2024-08-18T22:41:44.934 INFO:tasks.workunit.client.1.smithi195.stdout:7/463: symlink dc/d14/d15/d17/d18/lae 0 2024-08-18T22:41:44.934 INFO:tasks.workunit.client.0.smithi121.stdout:1/865: dwrite d5/d10/d14/d2a/d3a/d87/d6c/d6f/d79/dab/fca [0,4194304] 0 2024-08-18T22:41:44.935 INFO:tasks.workunit.client.1.smithi195.stdout:2/291: write d1/f38 [706666,99421] 0 2024-08-18T22:41:44.936 INFO:tasks.workunit.client.1.smithi195.stdout:7/464: dread - dc/d14/d15/f60 zero size 2024-08-18T22:41:44.937 INFO:tasks.workunit.client.0.smithi121.stdout:3/812: symlink d1e/l12a 0 2024-08-18T22:41:44.938 INFO:tasks.workunit.client.1.smithi195.stdout:3/507: rename d7/da/df/d38/c99 to d7/da/df/d1c/d6a/ca2 0 2024-08-18T22:41:44.940 INFO:tasks.workunit.client.0.smithi121.stdout:4/821: dread d2/dc/d16/d22/d2c/fc9 [0,4194304] 0 2024-08-18T22:41:44.943 INFO:tasks.workunit.client.0.smithi121.stdout:1/866: creat d5/d10/d14/d2a/d3a/d87/d6c/d6f/d82/d15/d38/f12d x:0 0 0 2024-08-18T22:41:44.943 INFO:tasks.workunit.client.0.smithi121.stdout:4/822: fdatasync d2/dc/d1c/daa/f10d 0 2024-08-18T22:41:44.943 INFO:tasks.workunit.client.1.smithi195.stdout:8/515: mknod d1/d3/d1c/d6a/cbd 0 2024-08-18T22:41:44.943 INFO:tasks.workunit.client.1.smithi195.stdout:1/575: dwrite da/d18/f1a [0,4194304] 0 2024-08-18T22:41:44.944 INFO:tasks.workunit.client.0.smithi121.stdout:3/813: symlink d1e/d1f/d3e/l12b 0 2024-08-18T22:41:44.944 INFO:tasks.workunit.client.1.smithi195.stdout:7/465: chown dc/d14/d15/d17/d18/f7b 3051267 1 2024-08-18T22:41:44.947 INFO:tasks.workunit.client.0.smithi121.stdout:4/823: fsync d2/dc/d16/d22/d2c/d44/d8c/fc7 0 2024-08-18T22:41:44.949 INFO:tasks.workunit.client.0.smithi121.stdout:4/824: chown d2/dc/d16/d59/d83/dd7/d90/ld4 12234 1 2024-08-18T22:41:44.949 INFO:tasks.workunit.client.0.smithi121.stdout:1/867: creat d5/d10/d67/dc2/df3/d114/f12e x:0 0 0 2024-08-18T22:41:44.950 INFO:tasks.workunit.client.1.smithi195.stdout:4/409: symlink d0/d9/l89 0 2024-08-18T22:41:44.950 INFO:tasks.workunit.client.1.smithi195.stdout:3/508: rename d7/c31 to d7/da/d75/ca3 0 2024-08-18T22:41:44.951 INFO:tasks.workunit.client.0.smithi121.stdout:4/825: chown d2/dc/d16/d59/d83/dd7/f103 32 1 2024-08-18T22:41:44.954 INFO:tasks.workunit.client.0.smithi121.stdout:1/868: write d5/d10/d14/d2a/d3a/d87/d6c/d6f/d82/d15/d28/f71 [2634406,55212] 0 2024-08-18T22:41:44.954 INFO:tasks.workunit.client.1.smithi195.stdout:8/516: rmdir d1/d3/db 39 2024-08-18T22:41:44.954 INFO:tasks.workunit.client.1.smithi195.stdout:7/466: creat dc/d14/d2b/faf x:0 0 0 2024-08-18T22:41:44.954 INFO:tasks.workunit.client.0.smithi121.stdout:4/826: symlink d2/dc/d16/d59/d83/dd7/d104/l12e 0 2024-08-18T22:41:44.955 INFO:tasks.workunit.client.1.smithi195.stdout:1/576: mkdir da/d4c/d5d/dcb 0 2024-08-18T22:41:44.956 INFO:tasks.workunit.client.0.smithi121.stdout:1/869: truncate d5/d10/d14/d34/f102 540810 0 2024-08-18T22:41:44.956 INFO:tasks.workunit.client.1.smithi195.stdout:3/509: readlink d7/d1f/l4b 0 2024-08-18T22:41:44.958 INFO:tasks.workunit.client.0.smithi121.stdout:1/870: write d5/d10/d14/d92/d9f/fd0 [5602185,123318] 0 2024-08-18T22:41:44.958 INFO:tasks.workunit.client.0.smithi121.stdout:4/827: mkdir d2/dc/d16/d22/d12f 0 2024-08-18T22:41:44.958 INFO:tasks.workunit.client.1.smithi195.stdout:8/517: write d1/d3/db/f17 [1356781,110470] 0 2024-08-18T22:41:44.959 INFO:tasks.workunit.client.1.smithi195.stdout:0/512: link d0/dc/dd/f58 d0/dc/d64/d81/d44/d41/d6d/d92/d66/d8d/fa6 0 2024-08-18T22:41:44.960 INFO:tasks.workunit.client.0.smithi121.stdout:9/865: dread d0/d5/dd/d1a/dc8/dfa/d7f/f91 [0,4194304] 0 2024-08-18T22:41:44.962 INFO:tasks.workunit.client.1.smithi195.stdout:7/467: write dc/d14/f49 [3904001,81620] 0 2024-08-18T22:41:44.963 INFO:tasks.workunit.client.0.smithi121.stdout:9/866: fdatasync d0/d5/dd/d1a/d93/f94 0 2024-08-18T22:41:44.963 INFO:tasks.workunit.client.0.smithi121.stdout:4/828: creat d2/dc/d16/d59/d83/da5/f130 x:0 0 0 2024-08-18T22:41:44.963 INFO:tasks.workunit.client.1.smithi195.stdout:4/410: rename d0/d9/d11/d16/d49/f40 to d0/d9/d41/d76/d81/f8a 0 2024-08-18T22:41:44.965 INFO:tasks.workunit.client.1.smithi195.stdout:2/292: getdents d1/d24/d26/d42/d50 0 2024-08-18T22:41:44.965 INFO:tasks.workunit.client.0.smithi121.stdout:1/871: creat d5/d10/d14/d2a/d3a/d87/d6c/d6f/d82/d15/d28/d3d/d9a/dac/f12f x:0 0 0 2024-08-18T22:41:44.966 INFO:tasks.workunit.client.1.smithi195.stdout:2/293: write d1/f59 [1225596,120332] 0 2024-08-18T22:41:44.966 INFO:tasks.workunit.client.1.smithi195.stdout:1/577: symlink da/d4c/d5d/dcb/lcc 0 2024-08-18T22:41:44.968 INFO:tasks.workunit.client.0.smithi121.stdout:4/829: symlink d2/dc/d16/d22/d2c/d44/da9/l131 0 2024-08-18T22:41:44.970 INFO:tasks.workunit.client.1.smithi195.stdout:2/294: chown d1/d8/d3d/f3e 4747 1 2024-08-18T22:41:44.972 INFO:tasks.workunit.client.0.smithi121.stdout:1/872: getdents d5/d10/d14/d2a/d3a/d87/d6c/d6f/d82/d15/d120 0 2024-08-18T22:41:44.972 INFO:tasks.workunit.client.1.smithi195.stdout:3/510: dread f6 [0,4194304] 0 2024-08-18T22:41:44.973 INFO:tasks.workunit.client.1.smithi195.stdout:0/513: symlink d0/dc/d64/d81/d44/d41/d6d/da5/la7 0 2024-08-18T22:41:44.974 INFO:tasks.workunit.client.1.smithi195.stdout:1/578: symlink da/d4c/lcd 0 2024-08-18T22:41:44.974 INFO:tasks.workunit.client.1.smithi195.stdout:4/411: rmdir d0/d9/d6c 39 2024-08-18T22:41:44.974 INFO:tasks.workunit.client.0.smithi121.stdout:3/814: dwrite d1e/d1f/d3e/f78 [0,4194304] 0 2024-08-18T22:41:44.975 INFO:tasks.workunit.client.0.smithi121.stdout:3/815: dread - d1e/d1f/d2a/fe7 zero size 2024-08-18T22:41:44.976 INFO:tasks.workunit.client.0.smithi121.stdout:4/830: rename d2/dc/d16/d22/d2c/d44/d8c/lc5 to d2/dc/d16/d22/d2c/d7a/dbf/l132 0 2024-08-18T22:41:44.976 INFO:tasks.workunit.client.1.smithi195.stdout:4/412: fsync d0/d7/d1d/d69/f7f 0 2024-08-18T22:41:44.977 INFO:tasks.workunit.client.1.smithi195.stdout:5/465: dread d0/d2/d29/f32 [0,4194304] 0 2024-08-18T22:41:44.977 INFO:tasks.workunit.client.0.smithi121.stdout:1/873: symlink d5/d10/d14/d2a/d3a/d87/d6c/d6f/d82/d15/d28/d3d/d9a/l130 0 2024-08-18T22:41:44.979 INFO:tasks.workunit.client.1.smithi195.stdout:3/511: symlink d7/d1f/d73/la4 0 2024-08-18T22:41:44.979 INFO:tasks.workunit.client.0.smithi121.stdout:4/831: mkdir d2/dc/d16/d22/d133 0 2024-08-18T22:41:44.980 INFO:tasks.workunit.client.0.smithi121.stdout:1/874: mknod d5/d10/d14/d2a/d3a/d87/d6c/d6f/d82/c131 0 2024-08-18T22:41:44.981 INFO:tasks.workunit.client.1.smithi195.stdout:3/512: readlink d7/d1f/d74/l79 0 2024-08-18T22:41:44.987 INFO:tasks.workunit.client.0.smithi121.stdout:3/816: rename d1e/d1f/d2a/c2c to d1e/d1f/d25/d58/c12c 0 2024-08-18T22:41:44.988 INFO:tasks.workunit.client.1.smithi195.stdout:1/579: creat da/d18/d28/d31/d3b/d4e/d95/d9c/dc8/fce x:0 0 0 2024-08-18T22:41:44.988 INFO:tasks.workunit.client.1.smithi195.stdout:8/518: link d1/de/d31/d88/ca7 d1/d3/db/d35/cbe 0 2024-08-18T22:41:44.988 INFO:tasks.workunit.client.1.smithi195.stdout:0/514: link d0/dc/d64/fa3 d0/dc/d64/d81/d44/d41/d6d/da5/fa8 0 2024-08-18T22:41:44.991 INFO:tasks.workunit.client.1.smithi195.stdout:3/513: creat d7/da/df/d1c/d6a/d6c/fa5 x:0 0 0 2024-08-18T22:41:44.995 INFO:tasks.workunit.client.1.smithi195.stdout:4/413: dwrite d0/d9/d3b/f88 [0,4194304] 0 2024-08-18T22:41:44.996 INFO:tasks.workunit.client.1.smithi195.stdout:0/515: creat d0/dc/dd/d46/fa9 x:0 0 0 2024-08-18T22:41:44.998 INFO:tasks.workunit.client.1.smithi195.stdout:5/466: dwrite d0/d2/d29/f67 [0,4194304] 0 2024-08-18T22:41:44.999 INFO:tasks.workunit.client.0.smithi121.stdout:4/832: dread d2/dc/d16/d22/d2c/d44/d8c/f129 [0,4194304] 0 2024-08-18T22:41:45.000 INFO:tasks.workunit.client.0.smithi121.stdout:4/833: chown d2/dc/d16/d22/d133 419469 1 2024-08-18T22:41:45.002 INFO:tasks.workunit.client.1.smithi195.stdout:7/468: dwrite dc/d14/f68 [0,4194304] 0 2024-08-18T22:41:45.002 INFO:tasks.workunit.client.1.smithi195.stdout:8/519: creat d1/de/d27/fbf x:0 0 0 2024-08-18T22:41:45.002 INFO:tasks.workunit.client.0.smithi121.stdout:1/875: write d5/d10/d14/d2a/d3a/d87/d6c/d6f/d82/d15/fe6 [109350,93506] 0 2024-08-18T22:41:45.004 INFO:tasks.workunit.client.1.smithi195.stdout:0/516: mkdir d0/dc/d11/daa 0 2024-08-18T22:41:45.006 INFO:tasks.workunit.client.1.smithi195.stdout:7/469: fdatasync dc/d14/d2b/faf 0 2024-08-18T22:41:45.007 INFO:tasks.workunit.client.1.smithi195.stdout:4/414: rename d0/l24 to d0/d9/d41/d76/d85/d48/l8b 0 2024-08-18T22:41:45.007 INFO:tasks.workunit.client.1.smithi195.stdout:8/520: chown d1/de/d31/d5a/l6c 47 1 2024-08-18T22:41:45.008 INFO:tasks.workunit.client.0.smithi121.stdout:1/876: mkdir d5/d10/d14/d2a/d3a/d87/d6c/d6f/d82/d11/d132 0 2024-08-18T22:41:45.010 INFO:tasks.workunit.client.0.smithi121.stdout:1/877: read d5/d10/d14/d2a/f68 [4016379,95470] 0 2024-08-18T22:41:45.010 INFO:tasks.workunit.client.1.smithi195.stdout:1/580: link da/d4c/d5d/dac/fb0 da/d18/d28/d31/d3b/d4e/d95/d9c/dc8/fcf 0 2024-08-18T22:41:45.010 INFO:tasks.workunit.client.1.smithi195.stdout:2/295: dwrite d1/d8/d3d/f20 [0,4194304] 0 2024-08-18T22:41:45.013 INFO:tasks.workunit.client.1.smithi195.stdout:4/415: mknod d0/d9/d41/d76/d85/d5f/c8c 0 2024-08-18T22:41:45.016 INFO:tasks.workunit.client.0.smithi121.stdout:1/878: rename d5/d10/d14/d34 to d5/d10/d14/d2a/d3a/d87/d6c/d6f/d82/d15/d133 0 2024-08-18T22:41:45.016 INFO:tasks.workunit.client.1.smithi195.stdout:3/514: dwrite d7/da/df/d38/fa1 [0,4194304] 0 2024-08-18T22:41:45.018 INFO:tasks.workunit.client.1.smithi195.stdout:2/296: stat d1/d24/d26/d42/d50 0 2024-08-18T22:41:45.018 INFO:tasks.workunit.client.1.smithi195.stdout:8/521: creat d1/de/df/fc0 x:0 0 0 2024-08-18T22:41:45.020 INFO:tasks.workunit.client.1.smithi195.stdout:1/581: read - da/d18/d28/d31/d3b/d4e/d95/d9c/dc8/fce zero size 2024-08-18T22:41:45.024 INFO:tasks.workunit.client.1.smithi195.stdout:4/416: read d0/f4a [257475,7993] 0 2024-08-18T22:41:45.026 INFO:tasks.workunit.client.1.smithi195.stdout:0/517: dwrite d0/dc/d11/d23/d51/f52 [0,4194304] 0 2024-08-18T22:41:45.027 INFO:tasks.workunit.client.1.smithi195.stdout:1/582: rmdir da/d4c/d5d/dcb 39 2024-08-18T22:41:45.029 INFO:tasks.workunit.client.1.smithi195.stdout:1/583: truncate da/d18/d28/d31/fc4 157420 0 2024-08-18T22:41:45.031 INFO:tasks.workunit.client.1.smithi195.stdout:2/297: mkdir d1/d8/d3d/d5e 0 2024-08-18T22:41:45.031 INFO:tasks.workunit.client.1.smithi195.stdout:4/417: rmdir d0/d9/d41/d76/d85 39 2024-08-18T22:41:45.036 INFO:tasks.workunit.client.1.smithi195.stdout:1/584: fdatasync da/f53 0 2024-08-18T22:41:45.036 INFO:tasks.workunit.client.1.smithi195.stdout:4/418: creat d0/d9/d41/d76/d81/f8d x:0 0 0 2024-08-18T22:41:45.038 INFO:tasks.workunit.client.0.smithi121.stdout:3/817: dwrite d1e/d1f/d25/f7b [0,4194304] 0 2024-08-18T22:41:45.038 INFO:tasks.workunit.client.1.smithi195.stdout:2/298: symlink d1/d8/d3d/d3b/d46/l5f 0 2024-08-18T22:41:45.039 INFO:tasks.workunit.client.0.smithi121.stdout:3/818: chown d1e/f46 42 1 2024-08-18T22:41:45.039 INFO:tasks.workunit.client.1.smithi195.stdout:1/585: chown da/d18/c26 1 1 2024-08-18T22:41:45.040 INFO:tasks.workunit.client.0.smithi121.stdout:3/819: dread - d1e/d1f/da6/dc7/dae/f10d zero size 2024-08-18T22:41:45.041 INFO:tasks.workunit.client.1.smithi195.stdout:2/299: creat d1/d24/f60 x:0 0 0 2024-08-18T22:41:45.044 INFO:tasks.workunit.client.0.smithi121.stdout:3/820: dread d1e/d1f/da6/dc7/db8/d104/d9a/f10a [0,4194304] 0 2024-08-18T22:41:45.045 INFO:tasks.workunit.client.1.smithi195.stdout:1/586: write da/d18/d28/f2e [972486,34658] 0 2024-08-18T22:41:45.047 INFO:tasks.workunit.client.0.smithi121.stdout:3/821: write d1e/d1f/f23 [4627582,7890] 0 2024-08-18T22:41:45.048 INFO:tasks.workunit.client.1.smithi195.stdout:4/419: dwrite d0/d9/d41/d76/d85/d48/d4c/f63 [0,4194304] 0 2024-08-18T22:41:45.049 INFO:tasks.workunit.client.1.smithi195.stdout:0/518: dread d0/dc/d11/f20 [0,4194304] 0 2024-08-18T22:41:45.051 INFO:tasks.workunit.client.1.smithi195.stdout:1/587: creat da/d4c/d5d/dcb/fd0 x:0 0 0 2024-08-18T22:41:45.051 INFO:tasks.workunit.client.0.smithi121.stdout:3/822: unlink d1e/d1f/d25/c45 0 2024-08-18T22:41:45.053 INFO:tasks.workunit.client.0.smithi121.stdout:4/834: write d2/dc/d1c/f6a [4722895,21706] 0 2024-08-18T22:41:45.053 INFO:tasks.workunit.client.1.smithi195.stdout:0/519: unlink d0/c7 0 2024-08-18T22:41:45.054 INFO:tasks.workunit.client.0.smithi121.stdout:4/835: chown d2/dc/d1c/ffd 515645623 1 2024-08-18T22:41:45.055 INFO:tasks.workunit.client.0.smithi121.stdout:3/823: creat d1e/d1f/dba/d113/d114/f12d x:0 0 0 2024-08-18T22:41:45.055 INFO:tasks.workunit.client.1.smithi195.stdout:4/420: rename d0/c5 to d0/d9/d41/d66/c8e 0 2024-08-18T22:41:45.056 INFO:tasks.workunit.client.1.smithi195.stdout:1/588: symlink da/d4c/d5d/dac/ld1 0 2024-08-18T22:41:45.057 INFO:tasks.workunit.client.0.smithi121.stdout:3/824: readlink d1e/d1f/d25/d67/l9f 0 2024-08-18T22:41:45.057 INFO:tasks.workunit.client.1.smithi195.stdout:4/421: chown d0/d9/d11/d16/c72 7333562 1 2024-08-18T22:41:45.058 INFO:tasks.workunit.client.0.smithi121.stdout:4/836: mknod d2/dc/d8d/dc4/c134 0 2024-08-18T22:41:45.059 INFO:tasks.workunit.client.0.smithi121.stdout:4/837: chown d2/dc/d16/l74 1444197 1 2024-08-18T22:41:45.060 INFO:tasks.workunit.client.1.smithi195.stdout:0/520: rename d0/dc/d64/d81/d44/d41/d6d/f75 to d0/dc/d64/d81/d44/d41/d6d/d92/fab 0 2024-08-18T22:41:45.061 INFO:tasks.workunit.client.0.smithi121.stdout:3/825: creat d1e/d1f/dba/df6/dd3/f12e x:0 0 0 2024-08-18T22:41:45.061 INFO:tasks.workunit.client.0.smithi121.stdout:4/838: chown d2/dc/d1c/f4b 47 1 2024-08-18T22:41:45.061 INFO:tasks.workunit.client.1.smithi195.stdout:4/422: creat d0/d7/d1d/d69/f8f x:0 0 0 2024-08-18T22:41:45.062 INFO:tasks.workunit.client.1.smithi195.stdout:0/521: mkdir d0/dc/d11/d23/dac 0 2024-08-18T22:41:45.063 INFO:tasks.workunit.client.1.smithi195.stdout:4/423: symlink d0/d7/d1d/l90 0 2024-08-18T22:41:45.065 INFO:tasks.workunit.client.1.smithi195.stdout:0/522: write d0/dc/d64/d81/f35 [4288865,88354] 0 2024-08-18T22:41:45.065 INFO:tasks.workunit.client.0.smithi121.stdout:4/839: creat d2/dc/d16/d22/d2c/d7a/f135 x:0 0 0 2024-08-18T22:41:45.066 INFO:tasks.workunit.client.1.smithi195.stdout:4/424: creat d0/d9/d6c/f91 x:0 0 0 2024-08-18T22:41:45.069 INFO:tasks.workunit.client.0.smithi121.stdout:4/840: creat d2/dc/d16/d59/d83/dd7/d104/f136 x:0 0 0 2024-08-18T22:41:45.069 INFO:tasks.workunit.client.1.smithi195.stdout:3/515: dread d7/da/df/f3b [0,4194304] 0 2024-08-18T22:41:45.069 INFO:tasks.workunit.client.1.smithi195.stdout:4/425: chown d0/d9/d11/f84 59 1 2024-08-18T22:41:45.069 INFO:tasks.workunit.client.1.smithi195.stdout:7/470: dread dc/d14/d15/f71 [0,4194304] 0 2024-08-18T22:41:45.071 INFO:tasks.workunit.client.0.smithi121.stdout:4/841: creat d2/dc/d16/d22/d2c/d44/da7/f137 x:0 0 0 2024-08-18T22:41:45.072 INFO:tasks.workunit.client.1.smithi195.stdout:7/471: dread - dc/d14/d15/d4d/d97/fa0 zero size 2024-08-18T22:41:45.074 INFO:tasks.workunit.client.1.smithi195.stdout:4/426: getdents d0/d9 0 2024-08-18T22:41:45.075 INFO:tasks.workunit.client.0.smithi121.stdout:3/826: dwrite d1e/d1f/d25/d6b/f59 [0,4194304] 0 2024-08-18T22:41:45.076 INFO:tasks.workunit.client.0.smithi121.stdout:4/842: mkdir d2/dc/d16/d22/d2c/d44/d8c/d10f/d138 0 2024-08-18T22:41:45.076 INFO:tasks.workunit.client.1.smithi195.stdout:1/589: dwrite f6 [0,4194304] 0 2024-08-18T22:41:45.078 INFO:tasks.workunit.client.1.smithi195.stdout:7/472: read dc/d14/f47 [472499,84980] 0 2024-08-18T22:41:45.079 INFO:tasks.workunit.client.1.smithi195.stdout:4/427: creat d0/d9/d11/f92 x:0 0 0 2024-08-18T22:41:45.081 INFO:tasks.workunit.client.1.smithi195.stdout:1/590: unlink da/d18/d28/d31/d3b/d4e/ca1 0 2024-08-18T22:41:45.084 INFO:tasks.workunit.client.1.smithi195.stdout:1/591: creat da/d4c/d7a/fd2 x:0 0 0 2024-08-18T22:41:45.085 INFO:tasks.workunit.client.0.smithi121.stdout:3/827: dwrite d1e/d1f/dba/d113/d116/d128/f68 [4194304,4194304] 0 2024-08-18T22:41:45.090 INFO:tasks.workunit.client.1.smithi195.stdout:4/428: dread d0/d7/d1d/f52 [0,4194304] 0 2024-08-18T22:41:45.093 INFO:tasks.workunit.client.0.smithi121.stdout:3/828: dwrite d1e/d1f/d25/f27 [0,4194304] 0 2024-08-18T22:41:45.095 INFO:tasks.workunit.client.1.smithi195.stdout:1/592: dwrite da/d18/d28/f2f [0,4194304] 0 2024-08-18T22:41:45.095 INFO:tasks.workunit.client.0.smithi121.stdout:3/829: read - d1e/d1f/d25/d58/d75/d8c/f8f zero size 2024-08-18T22:41:45.096 INFO:tasks.workunit.client.1.smithi195.stdout:1/593: chown da/d3d/f92 220839496 1 2024-08-18T22:41:45.097 INFO:tasks.workunit.client.1.smithi195.stdout:7/473: dread dc/d14/f49 [0,4194304] 0 2024-08-18T22:41:45.097 INFO:tasks.workunit.client.0.smithi121.stdout:3/830: rmdir d1e/d1f/d25/d67/d92/dbd/d126 39 2024-08-18T22:41:45.098 INFO:tasks.workunit.client.0.smithi121.stdout:3/831: stat d1e/d1f/d2a/l56 0 2024-08-18T22:41:45.098 INFO:tasks.workunit.client.1.smithi195.stdout:7/474: write dc/d1d/f7a [1022926,80410] 0 2024-08-18T22:41:45.102 INFO:tasks.workunit.client.1.smithi195.stdout:1/594: creat da/d4c/d5d/fd3 x:0 0 0 2024-08-18T22:41:45.104 INFO:tasks.workunit.client.0.smithi121.stdout:4/843: dread d2/f14 [0,4194304] 0 2024-08-18T22:41:45.108 INFO:tasks.workunit.client.0.smithi121.stdout:3/832: link d1e/d1f/d25/d67/d92/dbd/d126/fdf d1e/d1f/d25/d6b/db4/f12f 0 2024-08-18T22:41:45.111 INFO:tasks.workunit.client.0.smithi121.stdout:3/833: rename d1e/d1f/dba/d113/d114 to d1e/d1f/dba/d113/d130 0 2024-08-18T22:41:45.112 INFO:tasks.workunit.client.0.smithi121.stdout:3/834: chown d1e/d1f/d25/d6b/d81/fcc 222 1 2024-08-18T22:41:45.116 INFO:tasks.workunit.client.0.smithi121.stdout:3/835: getdents d1e/d1f/d25/d6b/db4/d94/de6 0 2024-08-18T22:41:45.117 INFO:tasks.workunit.client.0.smithi121.stdout:3/836: chown d1e/d1f/d25/d58/d75/d8c/c93 12232970 1 2024-08-18T22:41:45.120 INFO:tasks.workunit.client.0.smithi121.stdout:3/837: fdatasync d1e/d1f/d25/d2e/fbf 0 2024-08-18T22:41:45.122 INFO:tasks.workunit.client.1.smithi195.stdout:7/475: write dc/d14/d15/d17/d58/f5c [923544,105745] 0 2024-08-18T22:41:45.122 INFO:tasks.workunit.client.1.smithi195.stdout:7/476: stat fb 0 2024-08-18T22:41:45.125 INFO:tasks.workunit.client.1.smithi195.stdout:7/477: creat dc/d14/d15/d4d/d97/fb0 x:0 0 0 2024-08-18T22:41:45.125 INFO:tasks.workunit.client.0.smithi121.stdout:4/844: truncate d2/dc/d16/d22/d2c/fc9 2325377 0 2024-08-18T22:41:45.127 INFO:tasks.workunit.client.0.smithi121.stdout:3/838: creat d1e/d1f/dba/d113/d116/d128/f131 x:0 0 0 2024-08-18T22:41:45.128 INFO:tasks.workunit.client.1.smithi195.stdout:7/478: creat dc/d14/d15/d17/fb1 x:0 0 0 2024-08-18T22:41:45.129 INFO:tasks.workunit.client.1.smithi195.stdout:4/429: dread d0/ff [0,4194304] 0 2024-08-18T22:41:45.133 INFO:tasks.workunit.client.1.smithi195.stdout:4/430: mknod d0/d9/d41/d76/d85/d5f/c93 0 2024-08-18T22:41:45.135 INFO:tasks.workunit.client.1.smithi195.stdout:7/479: dwrite dc/d1d/f88 [0,4194304] 0 2024-08-18T22:41:45.136 INFO:tasks.workunit.client.0.smithi121.stdout:3/839: getdents d1e/d1f/d25/d58/df7 0 2024-08-18T22:41:45.136 INFO:tasks.workunit.client.1.smithi195.stdout:7/480: readlink dc/d2a/l91 0 2024-08-18T22:41:45.136 INFO:tasks.workunit.client.0.smithi121.stdout:4/845: write d2/fb [3901500,44036] 0 2024-08-18T22:41:45.137 INFO:tasks.workunit.client.1.smithi195.stdout:4/431: mkdir d0/d9/d11/d16/d94 0 2024-08-18T22:41:45.138 INFO:tasks.workunit.client.0.smithi121.stdout:4/846: write d2/dc/d16/d22/f3d [1010520,94257] 0 2024-08-18T22:41:45.139 INFO:tasks.workunit.client.1.smithi195.stdout:7/481: mknod dc/d22/cb2 0 2024-08-18T22:41:45.139 INFO:tasks.workunit.client.0.smithi121.stdout:3/840: truncate d1e/d1f/da6/dc7/f102 787634 0 2024-08-18T22:41:45.140 INFO:tasks.workunit.client.1.smithi195.stdout:4/432: mkdir d0/d9/d6c/d95 0 2024-08-18T22:41:45.140 INFO:tasks.workunit.client.0.smithi121.stdout:4/847: fdatasync d2/dc/d16/d22/d2c/d44/f78 0 2024-08-18T22:41:45.141 INFO:tasks.workunit.client.1.smithi195.stdout:7/482: write dc/d14/d15/d17/d18/f1c [1975575,50794] 0 2024-08-18T22:41:45.142 INFO:tasks.workunit.client.1.smithi195.stdout:7/483: dread - dc/d14/d2b/d81/d9c/f9e zero size 2024-08-18T22:41:45.142 INFO:tasks.workunit.client.1.smithi195.stdout:4/433: creat d0/d7/d1d/d69/d7d/f96 x:0 0 0 2024-08-18T22:41:45.144 INFO:tasks.workunit.client.1.smithi195.stdout:7/484: chown dc/c4e 382598992 1 2024-08-18T22:41:45.145 INFO:tasks.workunit.client.0.smithi121.stdout:3/841: rename d1e/d1f/dba/d113/d116/d128/d5f/c72 to d1e/d1f/dba/d113/d116/d128/d5f/c132 0 2024-08-18T22:41:45.145 INFO:tasks.workunit.client.1.smithi195.stdout:7/485: read - dc/f72 zero size 2024-08-18T22:41:45.146 INFO:tasks.workunit.client.0.smithi121.stdout:3/842: fsync d1e/d1f/dba/d113/d116/d128/f68 0 2024-08-18T22:41:45.148 INFO:tasks.workunit.client.0.smithi121.stdout:3/843: creat d1e/d1f/da6/f133 x:0 0 0 2024-08-18T22:41:45.148 INFO:tasks.workunit.client.1.smithi195.stdout:7/486: rename dc/d14/d2b/d81/l95 to dc/d1d/d29/d5d/lb3 0 2024-08-18T22:41:45.151 INFO:tasks.workunit.client.0.smithi121.stdout:3/844: rename d1e/d1f/d25/d6b/d83/ldd to d1e/d1f/d2a/l134 0 2024-08-18T22:41:45.152 INFO:tasks.workunit.client.1.smithi195.stdout:4/434: getdents d0/d7/d1d/d69/d7d 0 2024-08-18T22:41:45.153 INFO:tasks.workunit.client.1.smithi195.stdout:4/435: chown d0/d9/d6c/d95 112978 1 2024-08-18T22:41:45.153 INFO:tasks.workunit.client.0.smithi121.stdout:3/845: fsync d1e/d1f/dba/d113/d116/d128/f68 0 2024-08-18T22:41:45.153 INFO:tasks.workunit.client.0.smithi121.stdout:4/848: dwrite d2/dc/d16/d22/f50 [0,4194304] 0 2024-08-18T22:41:45.154 INFO:tasks.workunit.client.1.smithi195.stdout:7/487: dwrite dc/d14/d2b/f5e [4194304,4194304] 0 2024-08-18T22:41:45.156 INFO:tasks.workunit.client.1.smithi195.stdout:4/436: rename d0/f7b to d0/f97 0 2024-08-18T22:41:45.157 INFO:tasks.workunit.client.1.smithi195.stdout:7/488: creat dc/d14/d2b/fb4 x:0 0 0 2024-08-18T22:41:45.158 INFO:tasks.workunit.client.1.smithi195.stdout:4/437: truncate d0/ff 3148404 0 2024-08-18T22:41:45.159 INFO:tasks.workunit.client.1.smithi195.stdout:7/489: mkdir dc/d8f/db5 0 2024-08-18T22:41:45.162 INFO:tasks.workunit.client.1.smithi195.stdout:7/490: truncate dc/d14/d15/d17/d18/f5f 619394 0 2024-08-18T22:41:45.162 INFO:tasks.workunit.client.0.smithi121.stdout:3/846: creat d1e/de2/d112/f135 x:0 0 0 2024-08-18T22:41:45.162 INFO:tasks.workunit.client.0.smithi121.stdout:3/847: write d1e/d1f/f4f [2261944,67687] 0 2024-08-18T22:41:45.162 INFO:tasks.workunit.client.1.smithi195.stdout:4/438: rename d0/d9/d11 to d0/d9/d41/d76/d98 0 2024-08-18T22:41:45.163 INFO:tasks.workunit.client.1.smithi195.stdout:4/439: chown d0/d7/d1d/l3e 0 1 2024-08-18T22:41:45.164 INFO:tasks.workunit.client.0.smithi121.stdout:3/848: readlink d1e/d1f/da6/dc7/db8/d104/lad 0 2024-08-18T22:41:45.164 INFO:tasks.workunit.client.1.smithi195.stdout:7/491: fsync dc/d2a/f7c 0 2024-08-18T22:41:45.166 INFO:tasks.workunit.client.1.smithi195.stdout:7/492: mkdir dc/d14/d15/d17/d58/db6 0 2024-08-18T22:41:45.166 INFO:tasks.workunit.client.0.smithi121.stdout:3/849: mknod d1e/d1f/d25/d6b/d66/dd9/c136 0 2024-08-18T22:41:45.168 INFO:tasks.workunit.client.1.smithi195.stdout:7/493: truncate dc/d22/f7e 4612303 0 2024-08-18T22:41:45.171 INFO:tasks.workunit.client.0.smithi121.stdout:3/850: unlink d1e/d1f/da6/c11f 0 2024-08-18T22:41:45.171 INFO:tasks.workunit.client.0.smithi121.stdout:4/849: dwrite d2/dc/d16/d22/fe4 [0,4194304] 0 2024-08-18T22:41:45.171 INFO:tasks.workunit.client.1.smithi195.stdout:7/494: link dc/d14/l77 dc/d14/d15/d17/d58/lb7 0 2024-08-18T22:41:45.172 INFO:tasks.workunit.client.1.smithi195.stdout:7/495: chown dc/d14/d2b/fb4 257656580 1 2024-08-18T22:41:45.174 INFO:tasks.workunit.client.1.smithi195.stdout:7/496: mkdir dc/d2a/d4c/db8 0 2024-08-18T22:41:45.176 INFO:tasks.workunit.client.0.smithi121.stdout:3/851: write d1e/d1f/d25/f54 [3589511,115904] 0 2024-08-18T22:41:45.178 INFO:tasks.workunit.client.0.smithi121.stdout:3/852: write d1e/d1f/d25/d67/d92/dbd/d126/f109 [774056,81512] 0 2024-08-18T22:41:45.183 INFO:tasks.workunit.client.1.smithi195.stdout:4/440: rename d0/d9/d41/d76 to d0/d99 0 2024-08-18T22:41:45.183 INFO:tasks.workunit.client.1.smithi195.stdout:7/497: dwrite dc/d2a/f7c [0,4194304] 0 2024-08-18T22:41:45.185 INFO:tasks.workunit.client.1.smithi195.stdout:4/441: write d0/d99/d98/f3a [5652240,14903] 0 2024-08-18T22:41:45.187 INFO:tasks.workunit.client.1.smithi195.stdout:7/498: symlink dc/d8f/d96/lb9 0 2024-08-18T22:41:45.188 INFO:tasks.workunit.client.1.smithi195.stdout:4/442: mknod d0/d99/d98/d16/c9a 0 2024-08-18T22:41:45.191 INFO:tasks.workunit.client.1.smithi195.stdout:4/443: creat d0/d9/d6c/f9b x:0 0 0 2024-08-18T22:41:45.191 INFO:tasks.workunit.client.1.smithi195.stdout:7/499: dread dc/d14/f49 [0,4194304] 0 2024-08-18T22:41:45.192 INFO:tasks.workunit.client.1.smithi195.stdout:7/500: dread - dc/d14/d2b/fb4 zero size 2024-08-18T22:41:45.192 INFO:tasks.workunit.client.1.smithi195.stdout:7/501: chown dc/d1d 1049 1 2024-08-18T22:41:45.195 INFO:tasks.workunit.client.1.smithi195.stdout:4/444: dread d0/d7/d1d/f2f [0,4194304] 0 2024-08-18T22:41:45.195 INFO:tasks.workunit.client.1.smithi195.stdout:7/502: mknod dc/d1d/cba 0 2024-08-18T22:41:45.196 INFO:tasks.workunit.client.1.smithi195.stdout:4/445: fsync d0/d99/d98/d16/d54/f5c 0 2024-08-18T22:41:45.199 INFO:tasks.workunit.client.0.smithi121.stdout:4/850: dwrite d2/dc/d1c/f96 [0,4194304] 0 2024-08-18T22:41:45.199 INFO:tasks.workunit.client.0.smithi121.stdout:3/853: dwrite d1e/d1f/d3e/f79 [0,4194304] 0 2024-08-18T22:41:45.200 INFO:tasks.workunit.client.1.smithi195.stdout:4/446: creat d0/d7/d1d/d69/d7d/f9c x:0 0 0 2024-08-18T22:41:45.200 INFO:tasks.workunit.client.0.smithi121.stdout:4/851: write d2/dc/d1c/daa/f119 [81280,8346] 0 2024-08-18T22:41:45.204 INFO:tasks.workunit.client.1.smithi195.stdout:7/503: dwrite dc/d1d/f88 [4194304,4194304] 0 2024-08-18T22:41:45.204 INFO:tasks.workunit.client.1.smithi195.stdout:4/447: unlink d0/f22 0 2024-08-18T22:41:45.205 INFO:tasks.workunit.client.1.smithi195.stdout:7/504: fdatasync dc/d14/d15/d17/fb1 0 2024-08-18T22:41:45.206 INFO:tasks.workunit.client.0.smithi121.stdout:4/852: rmdir d2/dc/d16/d59/d8a 0 2024-08-18T22:41:45.208 INFO:tasks.workunit.client.1.smithi195.stdout:7/505: read dc/d1d/d29/f41 [36196,44570] 0 2024-08-18T22:41:45.210 INFO:tasks.workunit.client.0.smithi121.stdout:4/853: creat d2/dc/d16/d22/d2c/d7a/f139 x:0 0 0 2024-08-18T22:41:45.213 INFO:tasks.workunit.client.1.smithi195.stdout:4/448: dwrite d0/d99/d98/d16/d54/f5c [0,4194304] 0 2024-08-18T22:41:45.219 INFO:tasks.workunit.client.0.smithi121.stdout:4/854: dwrite d2/dc/d16/d22/d29/f3b [0,4194304] 0 2024-08-18T22:41:45.221 INFO:tasks.workunit.client.1.smithi195.stdout:7/506: dread f2 [0,4194304] 0 2024-08-18T22:41:45.222 INFO:tasks.workunit.client.0.smithi121.stdout:4/855: creat d2/dc/d16/d59/d83/da5/f13a x:0 0 0 2024-08-18T22:41:45.224 INFO:tasks.workunit.client.1.smithi195.stdout:4/449: dwrite d0/d99/d85/d48/f83 [0,4194304] 0 2024-08-18T22:41:45.229 INFO:tasks.workunit.client.0.smithi121.stdout:3/854: dread d1e/d1f/f3a [0,4194304] 0 2024-08-18T22:41:45.229 INFO:tasks.workunit.client.1.smithi195.stdout:4/450: mknod d0/d99/d98/d16/d94/c9d 0 2024-08-18T22:41:45.231 INFO:tasks.workunit.client.1.smithi195.stdout:4/451: write d0/d99/d85/d48/d4c/f63 [4234002,118593] 0 2024-08-18T22:41:45.235 INFO:tasks.workunit.client.1.smithi195.stdout:4/452: write d0/d9/d3b/f64 [909787,56703] 0 2024-08-18T22:41:45.236 INFO:tasks.workunit.client.0.smithi121.stdout:4/856: write d2/dc/d1c/dc1/ddb/df1/f128 [3134694,85709] 0 2024-08-18T22:41:45.237 INFO:tasks.workunit.client.0.smithi121.stdout:3/855: dwrite d1e/d1f/d25/d58/df7/de3/ffe [0,4194304] 0 2024-08-18T22:41:45.239 INFO:tasks.workunit.client.1.smithi195.stdout:4/453: mknod d0/d99/d86/c9e 0 2024-08-18T22:41:45.240 INFO:tasks.workunit.client.0.smithi121.stdout:0/711: sync 2024-08-18T22:41:45.240 INFO:tasks.workunit.client.0.smithi121.stdout:2/528: sync 2024-08-18T22:41:45.240 INFO:tasks.workunit.client.0.smithi121.stdout:7/855: sync 2024-08-18T22:41:45.240 INFO:tasks.workunit.client.0.smithi121.stdout:5/711: sync 2024-08-18T22:41:45.241 INFO:tasks.workunit.client.0.smithi121.stdout:8/948: sync 2024-08-18T22:41:45.241 INFO:tasks.workunit.client.1.smithi195.stdout:4/454: mknod d0/d99/d85/d48/c9f 0 2024-08-18T22:41:45.243 INFO:tasks.workunit.client.1.smithi195.stdout:7/507: dread dc/d1d/d29/f34 [0,4194304] 0 2024-08-18T22:41:45.243 INFO:tasks.workunit.client.1.smithi195.stdout:7/508: dread - dc/d14/d2b/faf zero size 2024-08-18T22:41:45.245 INFO:tasks.workunit.client.0.smithi121.stdout:4/857: creat d2/dc/d1c/dc1/ddb/df1/d10a/f13b x:0 0 0 2024-08-18T22:41:45.245 INFO:tasks.workunit.client.0.smithi121.stdout:3/856: chown d1e/d1f/d25/d6b/d66/cc6 8 1 2024-08-18T22:41:45.246 INFO:tasks.workunit.client.0.smithi121.stdout:7/856: dread - de/d98/dfb/dce/d2f/d4b/d6d/dca/df4/ff5 zero size 2024-08-18T22:41:45.246 INFO:tasks.workunit.client.0.smithi121.stdout:2/529: symlink d2/d73/lae 0 2024-08-18T22:41:45.249 INFO:tasks.workunit.client.0.smithi121.stdout:4/858: readlink d2/dc/d16/d22/d2c/d44/d8c/l11a 0 2024-08-18T22:41:45.250 INFO:tasks.workunit.client.0.smithi121.stdout:8/949: chown d6/d1e/d2d/d78/d45/c127 143 1 2024-08-18T22:41:45.250 INFO:tasks.workunit.client.1.smithi195.stdout:7/509: rename dc/l12 to dc/d14/d15/d17/d18/d89/lbb 0 2024-08-18T22:41:45.252 INFO:tasks.workunit.client.1.smithi195.stdout:4/455: fsync d0/d7/d1d/f47 0 2024-08-18T22:41:45.253 INFO:tasks.workunit.client.0.smithi121.stdout:8/950: readlink d6/dd/d25/l3e 0 2024-08-18T22:41:45.253 INFO:tasks.workunit.client.1.smithi195.stdout:4/456: write d0/d9/d3b/f5a [169072,53906] 0 2024-08-18T22:41:45.259 INFO:tasks.workunit.client.1.smithi195.stdout:4/457: dwrite d0/d99/d98/f18 [0,4194304] 0 2024-08-18T22:41:45.259 INFO:tasks.workunit.client.0.smithi121.stdout:5/712: dwrite d3/d5/d13/d19/d24/d32/d38/f85 [0,4194304] 0 2024-08-18T22:41:45.260 INFO:tasks.workunit.client.0.smithi121.stdout:3/857: dwrite d1e/d1f/f4f [0,4194304] 0 2024-08-18T22:41:45.260 INFO:tasks.workunit.client.0.smithi121.stdout:8/951: mknod d6/c13a 0 2024-08-18T22:41:45.261 INFO:tasks.workunit.client.0.smithi121.stdout:7/857: rmdir de/d98/dfb/dce/d34/d38/d73/da2/d100/d18/d23 39 2024-08-18T22:41:45.271 INFO:tasks.workunit.client.0.smithi121.stdout:4/859: getdents d2/dc/d16/d22/d2c/d44/d66 0 2024-08-18T22:41:45.273 INFO:tasks.workunit.client.0.smithi121.stdout:0/712: dwrite d1/d4/db/d18/d40/f96 [0,4194304] 0 2024-08-18T22:41:45.276 INFO:tasks.workunit.client.0.smithi121.stdout:2/530: dwrite d2/d8/d19/f46 [0,4194304] 0 2024-08-18T22:41:45.280 INFO:tasks.workunit.client.0.smithi121.stdout:8/952: creat d6/d1e/d2d/d78/d139/f13b x:0 0 0 2024-08-18T22:41:45.281 INFO:tasks.workunit.client.0.smithi121.stdout:4/860: symlink d2/dc/d16/d59/d83/da5/l13c 0 2024-08-18T22:41:45.285 INFO:tasks.workunit.client.0.smithi121.stdout:5/713: dwrite d3/fd [0,4194304] 0 2024-08-18T22:41:45.312 INFO:tasks.workunit.client.0.smithi121.stdout:9/867: sync 2024-08-18T22:41:45.312 INFO:tasks.workunit.client.0.smithi121.stdout:1/879: sync 2024-08-18T22:41:45.342 INFO:tasks.workunit.client.0.smithi121.stdout:3/858: getdents d1e/d1f/d25/d67/d92 0 2024-08-18T22:41:45.349 INFO:tasks.workunit.client.0.smithi121.stdout:5/714: rename d3/d5/d3c/d3f/d8f/f92 to d3/d5/d13/d19/d24/d32/da8/fde 0 2024-08-18T22:41:45.351 INFO:tasks.workunit.client.0.smithi121.stdout:9/868: write d0/f3 [4795590,17085] 0 2024-08-18T22:41:45.353 INFO:tasks.workunit.client.0.smithi121.stdout:1/880: creat d5/d10/d14/d2a/d3a/d87/df1/f134 x:0 0 0 2024-08-18T22:41:45.356 INFO:tasks.workunit.client.0.smithi121.stdout:7/858: creat de/d98/dfb/dce/d34/d38/d73/da2/d100/d18/d23/d24/d29/de6/f113 x:0 0 0 2024-08-18T22:41:45.360 INFO:tasks.workunit.client.0.smithi121.stdout:3/859: creat d1e/d1f/dba/df6/f137 x:0 0 0 2024-08-18T22:41:45.364 INFO:tasks.workunit.client.0.smithi121.stdout:4/861: creat d2/dc/d16/d22/d133/f13d x:0 0 0 2024-08-18T22:41:45.365 INFO:tasks.workunit.client.0.smithi121.stdout:5/715: mknod d3/d5/d3c/cdf 0 2024-08-18T22:41:45.371 INFO:tasks.workunit.client.0.smithi121.stdout:9/869: dread d0/d38/d9e/fbe [0,4194304] 0 2024-08-18T22:41:45.372 INFO:tasks.workunit.client.0.smithi121.stdout:8/953: rmdir d6/dd/d25/dc8/d119 0 2024-08-18T22:41:45.375 INFO:tasks.workunit.client.0.smithi121.stdout:5/716: symlink d3/d5/d13/d23/da4/da6/le0 0 2024-08-18T22:41:45.376 INFO:tasks.workunit.client.0.smithi121.stdout:5/717: write d3/d5/d13/d19/da3/fd6 [877340,13296] 0 2024-08-18T22:41:45.377 INFO:tasks.workunit.client.0.smithi121.stdout:5/718: chown d3/d5c/d78 45967 1 2024-08-18T22:41:45.378 INFO:tasks.workunit.client.0.smithi121.stdout:4/862: mknod d2/dc/d16/d22/d2c/d7a/da0/dcc/d122/c13e 0 2024-08-18T22:41:45.381 INFO:tasks.workunit.client.0.smithi121.stdout:8/954: symlink d6/d1e/d2d/de5/l13c 0 2024-08-18T22:41:45.384 INFO:tasks.workunit.client.0.smithi121.stdout:5/719: rmdir d3/d5/d13/d19/d24/d32 39 2024-08-18T22:41:45.387 INFO:tasks.workunit.client.0.smithi121.stdout:7/859: link de/d98/dfb/dce/f7b de/d65/f114 0 2024-08-18T22:41:45.389 INFO:tasks.workunit.client.0.smithi121.stdout:8/955: creat d6/d1e/d2d/d78/d45/d86/f13d x:0 0 0 2024-08-18T22:41:45.389 INFO:tasks.workunit.client.0.smithi121.stdout:3/860: getdents d1e/d1f/dba/d113/d116/d128/d5f/dd2 0 2024-08-18T22:41:45.391 INFO:tasks.workunit.client.0.smithi121.stdout:3/861: write d1e/d1f/d25/d58/f98 [31163,3259] 0 2024-08-18T22:41:45.392 INFO:tasks.workunit.client.0.smithi121.stdout:9/870: creat d0/d38/d9e/df/d61/db2/f124 x:0 0 0 2024-08-18T22:41:45.395 INFO:tasks.workunit.client.0.smithi121.stdout:7/860: mknod de/d98/dfb/dce/d34/c115 0 2024-08-18T22:41:45.396 INFO:tasks.workunit.client.0.smithi121.stdout:9/871: write d0/d5/dd/d1a/dc8/f115 [251043,55481] 0 2024-08-18T22:41:45.398 INFO:tasks.workunit.client.0.smithi121.stdout:8/956: mkdir d6/dd/d25/dc8/dce/d13e 0 2024-08-18T22:41:45.401 INFO:tasks.workunit.client.0.smithi121.stdout:0/713: dwrite d1/d47/f81 [0,4194304] 0 2024-08-18T22:41:45.402 INFO:tasks.workunit.client.0.smithi121.stdout:5/720: dread d3/d5/d13/d19/d24/d32/d38/f85 [0,4194304] 0 2024-08-18T22:41:45.407 INFO:tasks.workunit.client.0.smithi121.stdout:7/861: creat de/d2d/d50/f116 x:0 0 0 2024-08-18T22:41:45.409 INFO:tasks.workunit.client.0.smithi121.stdout:9/872: symlink d0/d38/d9e/df/d61/l125 0 2024-08-18T22:41:45.412 INFO:tasks.workunit.client.0.smithi121.stdout:8/957: creat d6/d1e/d2d/d78/d139/f13f x:0 0 0 2024-08-18T22:41:45.417 INFO:tasks.workunit.client.0.smithi121.stdout:5/721: unlink d3/d5/d13/d23/da4/dc7/dae/fdc 0 2024-08-18T22:41:45.420 INFO:tasks.workunit.client.0.smithi121.stdout:8/958: stat d6/la 0 2024-08-18T22:41:45.423 INFO:tasks.workunit.client.0.smithi121.stdout:8/959: dread d6/dd/d25/dda/fe6 [0,4194304] 0 2024-08-18T22:41:45.425 INFO:tasks.workunit.client.0.smithi121.stdout:8/960: chown d6/dd/d3b/da3/dca/d37/f50 832500569 1 2024-08-18T22:41:45.425 INFO:tasks.workunit.client.0.smithi121.stdout:8/961: chown d6/d1e 21479 1 2024-08-18T22:41:45.425 INFO:tasks.workunit.client.0.smithi121.stdout:9/873: mkdir d0/d38/d52/d5f/d126 0 2024-08-18T22:41:45.430 INFO:tasks.workunit.client.0.smithi121.stdout:7/862: getdents de/d98/dfb/dce/d34/d38/d73/da2/d100/d18 0 2024-08-18T22:41:45.431 INFO:tasks.workunit.client.0.smithi121.stdout:9/874: creat d0/d38/d9e/df/d61/db2/dce/f127 x:0 0 0 2024-08-18T22:41:45.432 INFO:tasks.workunit.client.0.smithi121.stdout:9/875: fsync d0/d38/d9e/df/d61/ff2 0 2024-08-18T22:41:45.434 INFO:tasks.workunit.client.0.smithi121.stdout:5/722: link d3/d5/d3c/d3f/d8f/c9a d3/d5/d13/d23/da4/da6/ce1 0 2024-08-18T22:41:45.436 INFO:tasks.workunit.client.0.smithi121.stdout:8/962: creat d6/d20/d69/f140 x:0 0 0 2024-08-18T22:41:45.437 INFO:tasks.workunit.client.0.smithi121.stdout:8/963: chown d6/dd/d3b/da3/dca/d18/c91 168 1 2024-08-18T22:41:45.439 INFO:tasks.workunit.client.0.smithi121.stdout:5/723: symlink d3/d5/d3c/daf/le2 0 2024-08-18T22:41:45.442 INFO:tasks.workunit.client.0.smithi121.stdout:7/863: link de/d98/dfb/dce/d34/d38/d73/da2/d100/d18/d2e/dd7/c105 de/da4/c117 0 2024-08-18T22:41:45.445 INFO:tasks.workunit.client.0.smithi121.stdout:7/864: read de/d98/dfb/dce/d34/d38/d73/da2/d100/fd5 [22651,129166] 0 2024-08-18T22:41:45.446 INFO:tasks.workunit.client.0.smithi121.stdout:9/876: getdents d0/d38/d9e/df/d3d/d89 0 2024-08-18T22:41:45.447 INFO:tasks.workunit.client.0.smithi121.stdout:7/865: stat de/d98/dfb/dce/d34/d38/d5f 0 2024-08-18T22:41:45.449 INFO:tasks.workunit.client.0.smithi121.stdout:9/877: creat d0/d5/d11f/f128 x:0 0 0 2024-08-18T22:41:45.449 INFO:tasks.workunit.client.0.smithi121.stdout:7/866: write de/d98/dfb/dce/d34/d38/d73/da2/d100/d18/d23/ff7 [313904,13698] 0 2024-08-18T22:41:45.451 INFO:tasks.workunit.client.0.smithi121.stdout:7/867: read - de/d98/dfb/dce/d2f/d4b/d6d/dca/df4/ff5 zero size 2024-08-18T22:41:45.452 INFO:tasks.workunit.client.0.smithi121.stdout:9/878: dread d0/d5/dd/d3b/fae [0,4194304] 0 2024-08-18T22:41:45.454 INFO:tasks.workunit.client.0.smithi121.stdout:7/868: write de/d98/dfb/dce/d34/d38/d73/fbd [2592739,103482] 0 2024-08-18T22:41:45.455 INFO:tasks.workunit.client.0.smithi121.stdout:4/863: rename d2/dc/l61 to d2/dc/d16/d59/d83/dd7/d90/db3/l13f 0 2024-08-18T22:41:45.457 INFO:tasks.workunit.client.0.smithi121.stdout:9/879: dread d0/d38/d52/f6d [0,4194304] 0 2024-08-18T22:41:45.460 INFO:tasks.workunit.client.0.smithi121.stdout:5/724: rename d3/d5/d13/d23/da4/dc7/f83 to d3/d5/d3c/dd3/fe3 0 2024-08-18T22:41:45.465 INFO:tasks.workunit.client.0.smithi121.stdout:9/880: dwrite d0/d5/dd/d1a/d93/f94 [0,4194304] 0 2024-08-18T22:41:45.466 INFO:tasks.workunit.client.0.smithi121.stdout:9/881: chown d0/d5/dd/d2f/dcd 2 1 2024-08-18T22:41:45.467 INFO:tasks.workunit.client.0.smithi121.stdout:9/882: readlink d0/d5/dd/d1a/dc8/dfa/d7f/la9 0 2024-08-18T22:41:45.467 INFO:tasks.workunit.client.0.smithi121.stdout:5/725: rmdir d3/d5/d13/d19/d24/d32/da8 39 2024-08-18T22:41:45.468 INFO:tasks.workunit.client.0.smithi121.stdout:9/883: chown d0/d38/d9e/d45/dba 39 1 2024-08-18T22:41:45.472 INFO:tasks.workunit.client.0.smithi121.stdout:5/726: creat d3/d5/fe4 x:0 0 0 2024-08-18T22:41:45.472 INFO:tasks.workunit.client.0.smithi121.stdout:9/884: read d0/d38/d9e/d18/f1d [487907,4792] 0 2024-08-18T22:41:45.476 INFO:tasks.workunit.client.0.smithi121.stdout:5/727: unlink d3/d5/d27/dce/cb9 0 2024-08-18T22:41:45.476 INFO:tasks.workunit.client.0.smithi121.stdout:5/728: readlink d3/d5/d13/d19/l51 0 2024-08-18T22:41:45.486 INFO:tasks.workunit.client.0.smithi121.stdout:0/714: unlink d1/d4/db/d24/df/c9f 0 2024-08-18T22:41:45.486 INFO:tasks.workunit.client.0.smithi121.stdout:3/862: dwrite d1e/d1f/d25/d2e/f91 [0,4194304] 0 2024-08-18T22:41:45.494 INFO:tasks.workunit.client.0.smithi121.stdout:5/729: dread d3/d5/d27/f54 [4194304,4194304] 0 2024-08-18T22:41:45.495 INFO:tasks.workunit.client.0.smithi121.stdout:2/531: symlink d2/d8/d19/laf 0 2024-08-18T22:41:45.496 INFO:tasks.workunit.client.0.smithi121.stdout:0/715: dwrite d1/d4/db/d24/df/d8/d78/d7c/df5/daf/dd5/d90/dc3/fc7 [0,4194304] 0 2024-08-18T22:41:45.499 INFO:tasks.workunit.client.0.smithi121.stdout:0/716: fdatasync d1/d4/db/d24/df/ff3 0 2024-08-18T22:41:45.500 INFO:tasks.workunit.client.0.smithi121.stdout:5/730: mkdir d3/d5/d13/d23/d66/de5 0 2024-08-18T22:41:45.505 INFO:tasks.workunit.client.0.smithi121.stdout:5/731: chown d3/d5/d13/d23/f34 63 1 2024-08-18T22:41:45.505 INFO:tasks.workunit.client.0.smithi121.stdout:0/717: rename d1/d4 to d1/d4/db/d24/d30/df9 22 2024-08-18T22:41:45.506 INFO:tasks.workunit.client.0.smithi121.stdout:7/869: write de/d98/dfb/dce/f7b [2766444,84911] 0 2024-08-18T22:41:45.506 INFO:tasks.workunit.client.1.smithi195.stdout:6/367: sync 2024-08-18T22:41:45.507 INFO:tasks.workunit.client.0.smithi121.stdout:4/864: truncate d2/dc/d16/d22/d2c/d44/d66/f91 3235003 0 2024-08-18T22:41:45.507 INFO:tasks.workunit.client.1.smithi195.stdout:6/368: chown da/db/d2a/f57 17 1 2024-08-18T22:41:45.508 INFO:tasks.workunit.client.0.smithi121.stdout:0/718: dread - d1/d4/db/d24/df/ff3 zero size 2024-08-18T22:41:45.508 INFO:tasks.workunit.client.0.smithi121.stdout:5/732: mknod d3/d5/d13/d19/ce6 0 2024-08-18T22:41:45.509 INFO:tasks.workunit.client.1.smithi195.stdout:6/369: unlink da/d22/c43 0 2024-08-18T22:41:45.510 INFO:tasks.workunit.client.1.smithi195.stdout:6/370: mknod da/c6a 0 2024-08-18T22:41:45.511 INFO:tasks.workunit.client.0.smithi121.stdout:7/870: mkdir de/d98/dfb/dce/d34/d38/d73/da2/d100/da0/d118 0 2024-08-18T22:41:45.512 INFO:tasks.workunit.client.0.smithi121.stdout:4/865: mknod d2/dc/d16/d22/d12f/c140 0 2024-08-18T22:41:45.513 INFO:tasks.workunit.client.0.smithi121.stdout:3/863: write d1e/d1f/d25/d6b/db4/f12f [4776771,6351] 0 2024-08-18T22:41:45.514 INFO:tasks.workunit.client.0.smithi121.stdout:5/733: symlink d3/d5/d13/d23/d66/le7 0 2024-08-18T22:41:45.517 INFO:tasks.workunit.client.0.smithi121.stdout:0/719: creat d1/d4/db/d24/df/d8/d78/d7c/df5/daf/dcb/ffa x:0 0 0 2024-08-18T22:41:45.521 INFO:tasks.workunit.client.0.smithi121.stdout:2/532: truncate d2/d3/f8a 3508608 0 2024-08-18T22:41:45.522 INFO:tasks.workunit.client.0.smithi121.stdout:3/864: truncate d1e/d1f/d25/d67/d92/d111/f121 960931 0 2024-08-18T22:41:45.522 INFO:tasks.workunit.client.1.smithi195.stdout:6/371: chown da/d15/l53 99 1 2024-08-18T22:41:45.523 INFO:tasks.workunit.client.0.smithi121.stdout:7/871: dwrite de/d65/f114 [0,4194304] 0 2024-08-18T22:41:45.524 INFO:tasks.workunit.client.1.smithi195.stdout:6/372: mknod da/d15/d1c/d64/c6b 0 2024-08-18T22:41:45.525 INFO:tasks.workunit.client.1.smithi195.stdout:6/373: read da/f13 [487689,35614] 0 2024-08-18T22:41:45.527 INFO:tasks.workunit.client.0.smithi121.stdout:2/533: symlink d2/d8/d19/d4a/d64/lb0 0 2024-08-18T22:41:45.530 INFO:tasks.workunit.client.0.smithi121.stdout:7/872: creat de/d98/dfb/dce/d34/f119 x:0 0 0 2024-08-18T22:41:45.532 INFO:tasks.workunit.client.1.smithi195.stdout:6/374: dwrite da/d15/d1c/d2e/f60 [0,4194304] 0 2024-08-18T22:41:45.534 INFO:tasks.workunit.client.0.smithi121.stdout:0/720: dwrite d1/d4/db/d24/df/d8/d78/d7c/df5/daf/dd5/d90/f98 [0,4194304] 0 2024-08-18T22:41:45.534 INFO:tasks.workunit.client.0.smithi121.stdout:2/534: creat d2/d8/d19/d4a/fb1 x:0 0 0 2024-08-18T22:41:45.535 INFO:tasks.workunit.client.1.smithi195.stdout:6/375: write da/db/d2a/f5e [3650899,21132] 0 2024-08-18T22:41:45.536 INFO:tasks.workunit.client.0.smithi121.stdout:5/734: write d3/d5/d13/d23/f34 [2003113,87165] 0 2024-08-18T22:41:45.537 INFO:tasks.workunit.client.1.smithi195.stdout:6/376: mknod da/db/d2a/c6c 0 2024-08-18T22:41:45.537 INFO:tasks.workunit.client.0.smithi121.stdout:0/721: write d1/d4/db/d18/d40/f96 [4601389,3253] 0 2024-08-18T22:41:45.538 INFO:tasks.workunit.client.0.smithi121.stdout:4/866: write d2/f72 [1154437,3045] 0 2024-08-18T22:41:45.539 INFO:tasks.workunit.client.1.smithi195.stdout:6/377: creat da/d3b/f6d x:0 0 0 2024-08-18T22:41:45.539 INFO:tasks.workunit.client.1.smithi195.stdout:6/378: stat da/db/d19/f45 0 2024-08-18T22:41:45.540 INFO:tasks.workunit.client.1.smithi195.stdout:6/379: fdatasync da/d15/f34 0 2024-08-18T22:41:45.541 INFO:tasks.workunit.client.1.smithi195.stdout:6/380: truncate da/db/d2a/f57 264852 0 2024-08-18T22:41:45.544 INFO:tasks.workunit.client.1.smithi195.stdout:6/381: read da/f40 [1444612,66128] 0 2024-08-18T22:41:45.546 INFO:tasks.workunit.client.0.smithi121.stdout:7/873: fdatasync de/d98/dfb/dce/d34/d38/d73/da2/d100/d18/d23/d24/d29/d43/d8b/fae 0 2024-08-18T22:41:45.548 INFO:tasks.workunit.client.1.smithi195.stdout:6/382: creat da/f6e x:0 0 0 2024-08-18T22:41:45.550 INFO:tasks.workunit.client.0.smithi121.stdout:4/867: mkdir d2/dc/d1c/dc1/ddb/d141 0 2024-08-18T22:41:45.551 INFO:tasks.workunit.client.1.smithi195.stdout:6/383: mknod da/d3b/d5f/c6f 0 2024-08-18T22:41:45.551 INFO:tasks.workunit.client.0.smithi121.stdout:2/535: rename d2/d8/d19/dc/c1e to d2/d3/d48/d77/cb2 0 2024-08-18T22:41:45.553 INFO:tasks.workunit.client.1.smithi195.stdout:6/384: write da/d15/d1c/f50 [84727,121897] 0 2024-08-18T22:41:45.554 INFO:tasks.workunit.client.0.smithi121.stdout:3/865: dwrite d1e/d1f/d25/f10c [0,4194304] 0 2024-08-18T22:41:45.555 INFO:tasks.workunit.client.1.smithi195.stdout:6/385: stat da/db/d2a/c3a 0 2024-08-18T22:41:45.559 INFO:tasks.workunit.client.1.smithi195.stdout:6/386: creat da/db/f70 x:0 0 0 2024-08-18T22:41:45.559 INFO:tasks.workunit.client.1.smithi195.stdout:6/387: fsync da/db/d19/f23 0 2024-08-18T22:41:45.561 INFO:tasks.workunit.client.1.smithi195.stdout:6/388: symlink da/db/d26/l71 0 2024-08-18T22:41:45.561 INFO:tasks.workunit.client.1.smithi195.stdout:9/486: sync 2024-08-18T22:41:45.563 INFO:tasks.workunit.client.1.smithi195.stdout:6/389: mkdir da/db/d19/d72 0 2024-08-18T22:41:45.564 INFO:tasks.workunit.client.1.smithi195.stdout:9/487: creat d1c/d74/d7b/d82/f9b x:0 0 0 2024-08-18T22:41:45.569 INFO:tasks.workunit.client.1.smithi195.stdout:9/488: rename d1c/d32/f36 to d1c/d92/d96/f9c 0 2024-08-18T22:41:45.569 INFO:tasks.workunit.client.1.smithi195.stdout:6/390: dwrite da/d3b/f3e [0,4194304] 0 2024-08-18T22:41:45.576 INFO:tasks.workunit.client.1.smithi195.stdout:6/391: truncate da/f13 1536681 0 2024-08-18T22:41:45.577 INFO:tasks.workunit.client.1.smithi195.stdout:6/392: dread - da/f6e zero size 2024-08-18T22:41:45.577 INFO:tasks.workunit.client.1.smithi195.stdout:9/489: dwrite d1c/d92/d96/f9c [0,4194304] 0 2024-08-18T22:41:45.580 INFO:tasks.workunit.client.1.smithi195.stdout:6/393: fdatasync da/d22/f5c 0 2024-08-18T22:41:45.584 INFO:tasks.workunit.client.1.smithi195.stdout:9/490: getdents d1c/d32/d37 0 2024-08-18T22:41:45.584 INFO:tasks.workunit.client.1.smithi195.stdout:6/394: mkdir da/d22/d73 0 2024-08-18T22:41:45.586 INFO:tasks.workunit.client.1.smithi195.stdout:9/491: mkdir d1c/d92/d96/d9d 0 2024-08-18T22:41:45.586 INFO:tasks.workunit.client.1.smithi195.stdout:6/395: mkdir da/d15/d1c/d2e/d74 0 2024-08-18T22:41:45.588 INFO:tasks.workunit.client.1.smithi195.stdout:6/396: truncate da/d15/d1c/f50 4782205 0 2024-08-18T22:41:45.588 INFO:tasks.workunit.client.1.smithi195.stdout:6/397: readlink da/d15/l53 0 2024-08-18T22:41:45.588 INFO:tasks.workunit.client.1.smithi195.stdout:9/492: mknod d1c/d74/d7b/d82/d98/c9e 0 2024-08-18T22:41:45.589 INFO:tasks.workunit.client.1.smithi195.stdout:9/493: write d1c/f45 [1108647,79083] 0 2024-08-18T22:41:45.591 INFO:tasks.workunit.client.1.smithi195.stdout:6/398: rename da/db/d2a/f5e to da/db/d19/d67/f75 0 2024-08-18T22:41:45.593 INFO:tasks.workunit.client.1.smithi195.stdout:9/494: creat d1c/d74/d7b/d82/d98/f9f x:0 0 0 2024-08-18T22:41:45.594 INFO:tasks.workunit.client.1.smithi195.stdout:6/399: creat da/db/d19/d72/f76 x:0 0 0 2024-08-18T22:41:45.594 INFO:tasks.workunit.client.1.smithi195.stdout:6/400: chown da/db/d26 3042245 1 2024-08-18T22:41:45.595 INFO:tasks.workunit.client.1.smithi195.stdout:6/401: write da/db/d19/f27 [1929665,122325] 0 2024-08-18T22:41:45.596 INFO:tasks.workunit.client.1.smithi195.stdout:9/495: rename d1c/d32/f87 to d1c/d32/d37/fa0 0 2024-08-18T22:41:45.596 INFO:tasks.workunit.client.1.smithi195.stdout:6/402: chown da/d22/c4a 372141 1 2024-08-18T22:41:45.599 INFO:tasks.workunit.client.1.smithi195.stdout:6/403: getdents da/d15 0 2024-08-18T22:41:45.600 INFO:tasks.workunit.client.1.smithi195.stdout:9/496: read d1c/d32/f46 [424949,112497] 0 2024-08-18T22:41:45.600 INFO:tasks.workunit.client.1.smithi195.stdout:6/404: chown da/db/d26/d2d/l2f 55 1 2024-08-18T22:41:45.601 INFO:tasks.workunit.client.1.smithi195.stdout:6/405: chown da/db/d19/d72 694 1 2024-08-18T22:41:45.604 INFO:tasks.workunit.client.1.smithi195.stdout:6/406: mkdir da/d22/d73/d77 0 2024-08-18T22:41:45.605 INFO:tasks.workunit.client.0.smithi121.stdout:4/868: getdents d2/dc/d16/d22/d2c/d44/da9 0 2024-08-18T22:41:45.605 INFO:tasks.workunit.client.1.smithi195.stdout:6/407: truncate da/db/d19/d67/f75 4542484 0 2024-08-18T22:41:45.606 INFO:tasks.workunit.client.1.smithi195.stdout:6/408: chown da/db/d2a/c6c 1150 1 2024-08-18T22:41:45.607 INFO:tasks.workunit.client.0.smithi121.stdout:2/536: rmdir d2/d8/d19/dc/d67 0 2024-08-18T22:41:45.608 INFO:tasks.workunit.client.0.smithi121.stdout:3/866: creat d1e/d1f/dba/d113/d116/d128/d5f/f138 x:0 0 0 2024-08-18T22:41:45.609 INFO:tasks.workunit.client.0.smithi121.stdout:4/869: truncate d2/dc/d16/d22/d2c/d44/f78 199021 0 2024-08-18T22:41:45.610 INFO:tasks.workunit.client.0.smithi121.stdout:2/537: symlink d2/d73/lb3 0 2024-08-18T22:41:45.611 INFO:tasks.workunit.client.0.smithi121.stdout:3/867: truncate d1e/d1f/d3e/f122 970262 0 2024-08-18T22:41:45.612 INFO:tasks.workunit.client.1.smithi195.stdout:6/409: dwrite da/db/d19/d67/f75 [0,4194304] 0 2024-08-18T22:41:45.616 INFO:tasks.workunit.client.1.smithi195.stdout:6/410: mkdir da/db/d78 0 2024-08-18T22:41:45.616 INFO:tasks.workunit.client.0.smithi121.stdout:0/722: dread d1/d4/db/d24/d30/fc0 [0,4194304] 0 2024-08-18T22:41:45.618 INFO:tasks.workunit.client.0.smithi121.stdout:4/870: dwrite d2/dc/d1c/f96 [0,4194304] 0 2024-08-18T22:41:45.622 INFO:tasks.workunit.client.0.smithi121.stdout:3/868: dwrite d1e/d1f/dba/d113/d116/d128/f68 [8388608,4194304] 0 2024-08-18T22:41:45.623 INFO:tasks.workunit.client.0.smithi121.stdout:3/869: chown d1e/d1f/f4f 1806029 1 2024-08-18T22:41:45.623 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:41:45 smithi121 ceph-mon[16788]: Standby manager daemon smithi121.lopxqc started 2024-08-18T22:41:45.623 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:41:45 smithi121 ceph-mon[16788]: from='mgr.? 172.21.15.121:0/2995984183' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi121.lopxqc/crt"}]: dispatch 2024-08-18T22:41:45.623 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:41:45 smithi121 ceph-mon[16788]: from='mgr.? 172.21.15.121:0/2995984183' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-08-18T22:41:45.623 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:41:45 smithi121 ceph-mon[16788]: from='mgr.? 172.21.15.121:0/2995984183' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi121.lopxqc/key"}]: dispatch 2024-08-18T22:41:45.624 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:41:45 smithi121 ceph-mon[16788]: from='mgr.? 172.21.15.121:0/2995984183' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-08-18T22:41:45.627 INFO:tasks.workunit.client.1.smithi195.stdout:1/595: sync 2024-08-18T22:41:45.627 INFO:tasks.workunit.client.1.smithi195.stdout:7/510: sync 2024-08-18T22:41:45.627 INFO:tasks.workunit.client.1.smithi195.stdout:4/458: sync 2024-08-18T22:41:45.627 INFO:tasks.workunit.client.1.smithi195.stdout:3/516: sync 2024-08-18T22:41:45.627 INFO:tasks.workunit.client.1.smithi195.stdout:2/300: sync 2024-08-18T22:41:45.627 INFO:tasks.workunit.client.1.smithi195.stdout:5/467: sync 2024-08-18T22:41:45.627 INFO:tasks.workunit.client.1.smithi195.stdout:0/523: sync 2024-08-18T22:41:45.627 INFO:tasks.workunit.client.1.smithi195.stdout:8/522: sync 2024-08-18T22:41:45.630 INFO:tasks.workunit.client.0.smithi121.stdout:3/870: dwrite d1e/d1f/d25/d67/d92/ff8 [0,4194304] 0 2024-08-18T22:41:45.630 INFO:tasks.workunit.client.1.smithi195.stdout:7/511: chown dc/d2a/f7c 16767 1 2024-08-18T22:41:45.631 INFO:tasks.workunit.client.1.smithi195.stdout:8/523: creat d1/d3/db/d7a/fc1 x:0 0 0 2024-08-18T22:41:45.632 INFO:tasks.workunit.client.1.smithi195.stdout:2/301: truncate d1/d24/d26/f36 4441067 0 2024-08-18T22:41:45.638 INFO:tasks.workunit.client.1.smithi195.stdout:9/497: dread d1c/f58 [0,4194304] 0 2024-08-18T22:41:45.639 INFO:tasks.workunit.client.1.smithi195.stdout:1/596: creat da/d18/d28/d31/d3b/d4e/d95/fd4 x:0 0 0 2024-08-18T22:41:45.640 INFO:tasks.workunit.client.1.smithi195.stdout:5/468: creat d0/d2/d29/d88/d90/f91 x:0 0 0 2024-08-18T22:41:45.642 INFO:tasks.workunit.client.1.smithi195.stdout:4/459: mknod d0/d7/d1d/d69/ca0 0 2024-08-18T22:41:45.642 INFO:tasks.workunit.client.1.smithi195.stdout:2/302: dread - d1/d8/d3d/f48 zero size 2024-08-18T22:41:45.642 INFO:tasks.workunit.client.1.smithi195.stdout:8/524: write d1/d3/db/d7a/fc1 [1030575,78386] 0 2024-08-18T22:41:45.644 INFO:tasks.workunit.client.1.smithi195.stdout:0/524: unlink d0/dc/d64/d81/d44/d41/d6d/d92/l85 0 2024-08-18T22:41:45.645 INFO:tasks.workunit.client.1.smithi195.stdout:9/498: mkdir d1c/d92/da1 0 2024-08-18T22:41:45.648 INFO:tasks.workunit.client.1.smithi195.stdout:9/499: truncate f13 4544734 0 2024-08-18T22:41:45.649 INFO:tasks.workunit.client.1.smithi195.stdout:2/303: chown d1/d8/d3d/fa 932 1 2024-08-18T22:41:45.649 INFO:tasks.workunit.client.1.smithi195.stdout:4/460: creat d0/d9/d41/d66/fa1 x:0 0 0 2024-08-18T22:41:45.651 INFO:tasks.workunit.client.1.smithi195.stdout:0/525: mkdir d0/dc/d11/d23/d51/dad 0 2024-08-18T22:41:45.652 INFO:tasks.workunit.client.1.smithi195.stdout:3/517: dwrite d7/da/f6b [0,4194304] 0 2024-08-18T22:41:45.652 INFO:tasks.workunit.client.1.smithi195.stdout:4/461: dread - d0/d7/f80 zero size 2024-08-18T22:41:45.653 INFO:tasks.workunit.client.1.smithi195.stdout:5/469: link d0/d2/l69 d0/d3/l92 0 2024-08-18T22:41:45.655 INFO:tasks.workunit.client.1.smithi195.stdout:1/597: dwrite f7 [0,4194304] 0 2024-08-18T22:41:45.656 INFO:tasks.workunit.client.1.smithi195.stdout:3/518: fsync d7/da/df/d1c/d6a/f76 0 2024-08-18T22:41:45.657 INFO:tasks.workunit.client.1.smithi195.stdout:4/462: dread - d0/d9/d6c/f91 zero size 2024-08-18T22:41:45.658 INFO:tasks.workunit.client.1.smithi195.stdout:5/470: write d0/d3/d8/f56 [135559,16139] 0 2024-08-18T22:41:45.660 INFO:tasks.workunit.client.1.smithi195.stdout:9/500: dread - d1c/d32/d37/d4b/f6f zero size 2024-08-18T22:41:45.661 INFO:tasks.workunit.client.1.smithi195.stdout:9/501: chown d1c/d74/d7b 129981 1 2024-08-18T22:41:45.662 INFO:tasks.workunit.client.1.smithi195.stdout:5/471: truncate d0/d3/f7e 445557 0 2024-08-18T22:41:45.662 INFO:tasks.workunit.client.1.smithi195.stdout:3/519: chown d7/da/f70 515930894 1 2024-08-18T22:41:45.662 INFO:tasks.workunit.client.1.smithi195.stdout:5/472: fdatasync d0/d3/d8/d64/f84 0 2024-08-18T22:41:45.664 INFO:tasks.workunit.client.1.smithi195.stdout:2/304: unlink d1/d8/d3d/f1d 0 2024-08-18T22:41:45.666 INFO:tasks.workunit.client.1.smithi195.stdout:8/525: getdents d1/d3/d1c/d21 0 2024-08-18T22:41:45.668 INFO:tasks.workunit.client.1.smithi195.stdout:0/526: symlink d0/dc/d64/d81/d44/d41/d6d/d92/lae 0 2024-08-18T22:41:45.670 INFO:tasks.workunit.client.1.smithi195.stdout:3/520: stat d7/da/df/d38/f3f 0 2024-08-18T22:41:45.671 INFO:tasks.workunit.client.1.smithi195.stdout:9/502: dread - d1c/d32/d37/fa0 zero size 2024-08-18T22:41:45.671 INFO:tasks.workunit.client.1.smithi195.stdout:5/473: dwrite d0/d3/d5f/f6b [0,4194304] 0 2024-08-18T22:41:45.672 INFO:tasks.workunit.client.1.smithi195.stdout:2/305: unlink d1/d8/f11 0 2024-08-18T22:41:45.673 INFO:tasks.workunit.client.1.smithi195.stdout:5/474: stat d0/db/l20 0 2024-08-18T22:41:45.673 INFO:tasks.workunit.client.1.smithi195.stdout:3/521: chown d7/d54/c77 5 1 2024-08-18T22:41:45.674 INFO:tasks.workunit.client.1.smithi195.stdout:5/475: chown d0/db/l21 1446 1 2024-08-18T22:41:45.675 INFO:tasks.workunit.client.1.smithi195.stdout:8/526: unlink d1/de/df/d1d/f6e 0 2024-08-18T22:41:45.678 INFO:tasks.workunit.client.1.smithi195.stdout:9/503: fdatasync d1c/f3a 0 2024-08-18T22:41:45.679 INFO:tasks.workunit.client.1.smithi195.stdout:0/527: creat d0/dc/d64/d81/d44/d41/d6d/d92/faf x:0 0 0 2024-08-18T22:41:45.682 INFO:tasks.workunit.client.1.smithi195.stdout:0/528: dread - d0/dc/d64/d81/d44/d41/d6d/d92/d66/d8d/f9a zero size 2024-08-18T22:41:45.683 INFO:tasks.workunit.client.1.smithi195.stdout:4/463: getdents d0/d99/d86 0 2024-08-18T22:41:45.688 INFO:tasks.workunit.client.1.smithi195.stdout:5/476: fsync d0/d3/df/f74 0 2024-08-18T22:41:45.690 INFO:tasks.workunit.client.1.smithi195.stdout:0/529: creat d0/dc/d25/d67/fb0 x:0 0 0 2024-08-18T22:41:45.691 INFO:tasks.workunit.client.1.smithi195.stdout:4/464: rmdir d0/d7 39 2024-08-18T22:41:45.692 INFO:tasks.workunit.client.1.smithi195.stdout:2/306: write d1/d24/f34 [207969,68117] 0 2024-08-18T22:41:45.694 INFO:tasks.workunit.client.1.smithi195.stdout:2/307: truncate d1/d24/d26/d42/f43 2275716 0 2024-08-18T22:41:45.696 INFO:tasks.workunit.client.1.smithi195.stdout:3/522: rename d7/c13 to d7/da/df/ca6 0 2024-08-18T22:41:45.697 INFO:tasks.workunit.client.1.smithi195.stdout:8/527: truncate d1/d3/db/f34 3423172 0 2024-08-18T22:41:45.702 INFO:tasks.workunit.client.1.smithi195.stdout:2/308: dwrite d1/d24/d26/f36 [4194304,4194304] 0 2024-08-18T22:41:45.703 INFO:tasks.workunit.client.1.smithi195.stdout:2/309: write d1/f1b [3524997,55120] 0 2024-08-18T22:41:45.704 INFO:tasks.workunit.client.1.smithi195.stdout:4/465: write d0/f97 [494526,120432] 0 2024-08-18T22:41:45.705 INFO:tasks.workunit.client.1.smithi195.stdout:5/477: chown d0/d3/df/l8f 139 1 2024-08-18T22:41:45.706 INFO:tasks.workunit.client.1.smithi195.stdout:3/523: symlink d7/da/df/d1c/d6a/la7 0 2024-08-18T22:41:45.710 INFO:tasks.workunit.client.1.smithi195.stdout:9/504: truncate d1c/d32/d37/d4b/f6b 54786 0 2024-08-18T22:41:45.712 INFO:tasks.workunit.client.1.smithi195.stdout:5/478: chown d0/db/c34 4707311 1 2024-08-18T22:41:45.714 INFO:tasks.workunit.client.1.smithi195.stdout:3/524: dwrite d7/da/df/d1c/f58 [0,4194304] 0 2024-08-18T22:41:45.715 INFO:tasks.workunit.client.1.smithi195.stdout:0/530: rename d0/dc/d11/d23/fa0 to d0/dc/d64/d81/d44/d41/fb1 0 2024-08-18T22:41:45.716 INFO:tasks.workunit.client.1.smithi195.stdout:8/528: creat d1/de/d27/fc2 x:0 0 0 2024-08-18T22:41:45.718 INFO:tasks.workunit.client.1.smithi195.stdout:2/310: chown d1/d8/d3d/d5e 52631856 1 2024-08-18T22:41:45.718 INFO:tasks.workunit.client.1.smithi195.stdout:5/479: readlink d0/d3/l92 0 2024-08-18T22:41:45.722 INFO:tasks.workunit.client.1.smithi195.stdout:0/531: creat d0/dc/d64/d81/d44/d41/d6d/da5/fb2 x:0 0 0 2024-08-18T22:41:45.724 INFO:tasks.workunit.client.1.smithi195.stdout:0/532: chown d0/dc/d64/d81/f89 205 1 2024-08-18T22:41:45.726 INFO:tasks.workunit.client.1.smithi195.stdout:8/529: dwrite d1/de/fab [0,4194304] 0 2024-08-18T22:41:45.726 INFO:tasks.workunit.client.1.smithi195.stdout:0/533: chown d0/dc/dd/d46/fa9 278 1 2024-08-18T22:41:45.728 INFO:tasks.workunit.client.1.smithi195.stdout:3/525: rmdir d7/da/d75/d96 0 2024-08-18T22:41:45.731 INFO:tasks.workunit.client.1.smithi195.stdout:2/311: rename d1/d8/f4f to d1/d8/d3d/d3b/d53/d5b/f61 0 2024-08-18T22:41:45.734 INFO:tasks.workunit.client.1.smithi195.stdout:8/530: creat d1/d3/db/d39/d44/d79/fc3 x:0 0 0 2024-08-18T22:41:45.736 INFO:tasks.workunit.client.1.smithi195.stdout:2/312: dread - d1/d8/d3d/d3b/f3f zero size 2024-08-18T22:41:45.739 INFO:tasks.workunit.client.1.smithi195.stdout:0/534: dwrite d0/dc/d64/d81/d44/d41/d6d/da5/fb2 [0,4194304] 0 2024-08-18T22:41:45.740 INFO:tasks.workunit.client.1.smithi195.stdout:0/535: chown d0/la 932429397 1 2024-08-18T22:41:45.743 INFO:tasks.workunit.client.1.smithi195.stdout:8/531: getdents d1/d3/db/d35/d4d/d5c 0 2024-08-18T22:41:45.745 INFO:tasks.workunit.client.1.smithi195.stdout:0/536: unlink d0/dc/d25/d67/c8a 0 2024-08-18T22:41:45.746 INFO:tasks.workunit.client.1.smithi195.stdout:2/313: dwrite d1/d24/f34 [0,4194304] 0 2024-08-18T22:41:45.747 INFO:tasks.workunit.client.0.smithi121.stdout:2/538: rename d2/d73/l8f to d2/d8/d19/d4a/lb4 0 2024-08-18T22:41:45.748 INFO:tasks.workunit.client.0.smithi121.stdout:4/871: mknod d2/dc/d16/d47/c142 0 2024-08-18T22:41:45.748 INFO:tasks.workunit.client.0.smithi121.stdout:2/539: fsync d2/d3/d51/f81 0 2024-08-18T22:41:45.749 INFO:tasks.workunit.client.1.smithi195.stdout:2/314: fdatasync d1/f1b 0 2024-08-18T22:41:45.750 INFO:tasks.workunit.client.0.smithi121.stdout:0/723: symlink d1/d4/db/d24/df/lfb 0 2024-08-18T22:41:45.751 INFO:tasks.workunit.client.0.smithi121.stdout:0/724: stat d1/d4/db/d24/df/d8/d78/d7c/df5/daf/dd5/d5b 0 2024-08-18T22:41:45.751 INFO:tasks.workunit.client.1.smithi195.stdout:2/315: chown d1/d24/l4b 1035652628 1 2024-08-18T22:41:45.753 INFO:tasks.workunit.client.1.smithi195.stdout:8/532: creat d1/d3/db/d39/fc4 x:0 0 0 2024-08-18T22:41:45.754 INFO:tasks.workunit.client.1.smithi195.stdout:0/537: mknod d0/dc/d64/cb3 0 2024-08-18T22:41:45.757 INFO:tasks.workunit.client.1.smithi195.stdout:0/538: chown d0/dc/d11/d6f/d9d 12 1 2024-08-18T22:41:45.757 INFO:tasks.workunit.client.1.smithi195.stdout:3/526: dwrite d7/f89 [0,4194304] 0 2024-08-18T22:41:45.761 INFO:tasks.workunit.client.1.smithi195.stdout:2/316: dwrite d1/d24/d26/f2b [0,4194304] 0 2024-08-18T22:41:45.762 INFO:tasks.workunit.client.1.smithi195.stdout:8/533: truncate d1/d3/db/d35/d56/f90 231763 0 2024-08-18T22:41:45.762 INFO:tasks.workunit.client.1.smithi195.stdout:3/527: mknod d7/ca8 0 2024-08-18T22:41:45.762 INFO:tasks.workunit.client.1.smithi195.stdout:2/317: chown d1/d24/d26/d42 7518 1 2024-08-18T22:41:45.766 INFO:tasks.workunit.client.1.smithi195.stdout:3/528: write d7/da/f14 [589186,103680] 0 2024-08-18T22:41:45.767 INFO:tasks.workunit.client.1.smithi195.stdout:2/318: dread - d1/d8/f2f zero size 2024-08-18T22:41:45.768 INFO:tasks.workunit.client.1.smithi195.stdout:8/534: mknod d1/d3/db/d39/d44/d79/cc5 0 2024-08-18T22:41:45.769 INFO:tasks.workunit.client.1.smithi195.stdout:8/535: dread - d1/d3/db/d39/fc4 zero size 2024-08-18T22:41:45.770 INFO:tasks.workunit.client.0.smithi121.stdout:3/871: symlink d1e/d1f/dba/d113/d116/d123/l139 0 2024-08-18T22:41:45.771 INFO:tasks.workunit.client.0.smithi121.stdout:2/540: readlink d2/d8/d19/dc/ld 0 2024-08-18T22:41:45.773 INFO:tasks.workunit.client.1.smithi195.stdout:8/536: mknod d1/de/d31/d5a/cc6 0 2024-08-18T22:41:45.775 INFO:tasks.workunit.client.1.smithi195.stdout:3/529: getdents d7/da 0 2024-08-18T22:41:45.776 INFO:tasks.workunit.client.0.smithi121.stdout:0/725: rename d1/d4/db/d18/d40/cae to d1/d4/db/d24/df/d8/d78/d7c/dba/cfc 0 2024-08-18T22:41:45.778 INFO:tasks.workunit.client.1.smithi195.stdout:8/537: link d1/de/df/f19 d1/d3/db/d35/d56/fc7 0 2024-08-18T22:41:45.779 INFO:tasks.workunit.client.1.smithi195.stdout:3/530: dread d7/f5c [0,4194304] 0 2024-08-18T22:41:45.781 INFO:tasks.workunit.client.1.smithi195.stdout:8/538: symlink d1/d3/db/d35/d4d/lc8 0 2024-08-18T22:41:45.782 INFO:tasks.workunit.client.0.smithi121.stdout:4/872: getdents d2/dc/d16/d22/d2c/d7a/da0/dcc/d122 0 2024-08-18T22:41:45.782 INFO:tasks.workunit.client.1.smithi195.stdout:8/539: chown d1/d3/db/d35/d4d/d95 397298 1 2024-08-18T22:41:45.784 INFO:tasks.workunit.client.1.smithi195.stdout:3/531: creat d7/d1f/fa9 x:0 0 0 2024-08-18T22:41:45.784 INFO:tasks.workunit.client.1.smithi195.stdout:0/539: truncate d0/dc/d64/d81/d44/d41/d6d/d92/d66/f8b 3917091 0 2024-08-18T22:41:45.785 INFO:tasks.workunit.client.0.smithi121.stdout:4/873: mknod d2/dc/d16/d22/d29/c143 0 2024-08-18T22:41:45.785 INFO:tasks.workunit.client.0.smithi121.stdout:3/872: dread d1e/d1f/d3e/f64 [0,4194304] 0 2024-08-18T22:41:45.786 INFO:tasks.workunit.client.1.smithi195.stdout:3/532: write d7/d1f/f34 [2009945,57621] 0 2024-08-18T22:41:45.787 INFO:tasks.workunit.client.0.smithi121.stdout:0/726: getdents d1/d4/db/d24/df/d8/d71/d79 0 2024-08-18T22:41:45.787 INFO:tasks.workunit.client.0.smithi121.stdout:3/873: truncate d1e/d1f/d25/d6b/fdc 1269527 0 2024-08-18T22:41:45.788 INFO:tasks.workunit.client.0.smithi121.stdout:3/874: write f11 [8061902,44061] 0 2024-08-18T22:41:45.791 INFO:tasks.workunit.client.0.smithi121.stdout:3/875: write d1e/d1f/d3e/f122 [273366,87572] 0 2024-08-18T22:41:45.792 INFO:tasks.workunit.client.0.smithi121.stdout:0/727: creat d1/d4/db/d24/df/d8/d78/d7c/df5/daf/dcb/ffd x:0 0 0 2024-08-18T22:41:45.795 INFO:tasks.workunit.client.1.smithi195.stdout:2/319: dwrite d1/d8/d27/f3a [0,4194304] 0 2024-08-18T22:41:45.796 INFO:tasks.workunit.client.0.smithi121.stdout:2/541: dwrite d2/f6 [0,4194304] 0 2024-08-18T22:41:45.797 INFO:tasks.workunit.client.1.smithi195.stdout:8/540: dwrite d1/de/fa8 [0,4194304] 0 2024-08-18T22:41:45.798 INFO:tasks.workunit.client.0.smithi121.stdout:3/876: rename d1e/d1f/d3e/fec to d1e/d1f/d25/d58/df7/d11d/f13a 0 2024-08-18T22:41:45.798 INFO:tasks.workunit.client.0.smithi121.stdout:0/728: fdatasync d1/d4/db/d24/df/d8/d78/d7c/df5/daf/dd5/d5b/ff2 0 2024-08-18T22:41:45.799 INFO:tasks.workunit.client.0.smithi121.stdout:3/877: stat d1e/d1f/d25/d67/d92/dbd/l84 0 2024-08-18T22:41:45.800 INFO:tasks.workunit.client.0.smithi121.stdout:2/542: rmdir d2/d3/d84 39 2024-08-18T22:41:45.801 INFO:tasks.workunit.client.1.smithi195.stdout:0/540: rename d0/dc/d11/l5a to d0/dc/d11/d23/d51/dad/lb4 0 2024-08-18T22:41:45.803 INFO:tasks.workunit.client.0.smithi121.stdout:3/878: unlink d1e/d1f/d3e/f6f 0 2024-08-18T22:41:45.808 INFO:tasks.workunit.client.0.smithi121.stdout:2/543: truncate d2/d8/d19/dc/f3c 2206949 0 2024-08-18T22:41:45.809 INFO:tasks.workunit.client.0.smithi121.stdout:2/544: chown d2/d3/d48/d77/f8c 643 1 2024-08-18T22:41:45.810 INFO:tasks.workunit.client.1.smithi195.stdout:0/541: mkdir d0/dc/d64/d81/d44/d41/d6d/d97/db5 0 2024-08-18T22:41:45.811 INFO:tasks.workunit.client.1.smithi195.stdout:2/320: getdents d1/d8/d3d/d3b/d53 0 2024-08-18T22:41:45.812 INFO:tasks.workunit.client.0.smithi121.stdout:2/545: rmdir d2/d8/d19/d4a 39 2024-08-18T22:41:45.812 INFO:tasks.workunit.client.1.smithi195.stdout:2/321: fsync d1/d24/d26/f40 0 2024-08-18T22:41:45.818 INFO:tasks.workunit.client.1.smithi195.stdout:0/542: dwrite d0/dc/d25/f54 [0,4194304] 0 2024-08-18T22:41:45.821 INFO:tasks.workunit.client.1.smithi195.stdout:2/322: dwrite d1/d8/d3d/f48 [0,4194304] 0 2024-08-18T22:41:45.823 INFO:tasks.workunit.client.0.smithi121.stdout:0/729: write d1/d4/db/d24/df/d8/f20 [251078,109109] 0 2024-08-18T22:41:45.827 INFO:tasks.workunit.client.0.smithi121.stdout:0/730: mkdir d1/d4/da/dfe 0 2024-08-18T22:41:45.828 INFO:tasks.workunit.client.1.smithi195.stdout:0/543: mkdir d0/dc/d64/d81/d44/d41/d6d/d92/db6 0 2024-08-18T22:41:45.829 INFO:tasks.workunit.client.0.smithi121.stdout:3/879: dwrite d1e/d1f/dba/d113/d116/d128/d5f/f61 [0,4194304] 0 2024-08-18T22:41:45.830 INFO:tasks.workunit.client.0.smithi121.stdout:2/546: dwrite d2/f1d [0,4194304] 0 2024-08-18T22:41:45.831 INFO:tasks.workunit.client.1.smithi195.stdout:8/541: write d1/de/df/f19 [5028613,26591] 0 2024-08-18T22:41:45.833 INFO:tasks.workunit.client.0.smithi121.stdout:3/880: mkdir d1e/d1f/d25/d6b/d13b 0 2024-08-18T22:41:45.834 INFO:tasks.workunit.client.1.smithi195.stdout:8/542: write d1/de/d27/fc2 [590162,14592] 0 2024-08-18T22:41:45.834 INFO:tasks.workunit.client.1.smithi195.stdout:2/323: dwrite d1/f3c [0,4194304] 0 2024-08-18T22:41:45.837 INFO:tasks.workunit.client.0.smithi121.stdout:3/881: symlink d1e/d1f/dba/d113/d116/l13c 0 2024-08-18T22:41:45.837 INFO:tasks.workunit.client.1.smithi195.stdout:3/533: dread d7/da/d75/f78 [0,4194304] 0 2024-08-18T22:41:45.837 INFO:tasks.workunit.client.1.smithi195.stdout:0/544: creat d0/dc/d11/d23/d51/fb7 x:0 0 0 2024-08-18T22:41:45.837 INFO:tasks.workunit.client.1.smithi195.stdout:8/543: chown d1/de/d31/d5a/l6c 6 1 2024-08-18T22:41:45.838 INFO:tasks.workunit.client.1.smithi195.stdout:3/534: readlink d7/da/df/d8e/l8b 0 2024-08-18T22:41:45.840 INFO:tasks.workunit.client.0.smithi121.stdout:2/547: unlink d2/d8/d19/d55/f58 0 2024-08-18T22:41:45.841 INFO:tasks.workunit.client.1.smithi195.stdout:3/535: write d7/da/df/f27 [3160191,114090] 0 2024-08-18T22:41:45.841 INFO:tasks.workunit.client.1.smithi195.stdout:2/324: write d1/d24/d26/d42/d50/f52 [339939,101508] 0 2024-08-18T22:41:45.842 INFO:tasks.workunit.client.0.smithi121.stdout:0/731: write d1/d4/db/d24/d30/f3b [5179552,44456] 0 2024-08-18T22:41:45.844 INFO:tasks.workunit.client.1.smithi195.stdout:0/545: chown d0/dc/l17 4601459 1 2024-08-18T22:41:45.846 INFO:tasks.workunit.client.0.smithi121.stdout:2/548: getdents d2/d3 0 2024-08-18T22:41:45.847 INFO:tasks.workunit.client.0.smithi121.stdout:3/882: dwrite d1e/d1f/dba/d113/d130/f12d [0,4194304] 0 2024-08-18T22:41:45.849 INFO:tasks.workunit.client.1.smithi195.stdout:8/544: creat d1/d3/db/d39/d44/d8c/fc9 x:0 0 0 2024-08-18T22:41:45.851 INFO:tasks.workunit.client.1.smithi195.stdout:0/546: mkdir d0/dc/d25/d67/db8 0 2024-08-18T22:41:45.852 INFO:tasks.workunit.client.1.smithi195.stdout:3/536: dwrite d7/d1f/d49/f93 [0,4194304] 0 2024-08-18T22:41:45.853 INFO:tasks.workunit.client.0.smithi121.stdout:0/732: dwrite d1/d4/f1f [4194304,4194304] 0 2024-08-18T22:41:45.853 INFO:tasks.workunit.client.1.smithi195.stdout:3/537: chown d7/d1f 231 1 2024-08-18T22:41:45.853 INFO:tasks.workunit.client.0.smithi121.stdout:3/883: link d1e/d1f/d2a/l5d d1e/d1f/d3e/l13d 0 2024-08-18T22:41:45.855 INFO:tasks.workunit.client.0.smithi121.stdout:3/884: readlink d1e/d1f/d2a/l5d 0 2024-08-18T22:41:45.856 INFO:tasks.workunit.client.1.smithi195.stdout:8/545: mkdir d1/dca 0 2024-08-18T22:41:45.857 INFO:tasks.workunit.client.0.smithi121.stdout:0/733: symlink d1/d4/db/d24/lff 0 2024-08-18T22:41:45.860 INFO:tasks.workunit.client.1.smithi195.stdout:0/547: rename d0/dc/d11/l71 to d0/dc/d25/d67/db8/lb9 0 2024-08-18T22:41:45.860 INFO:tasks.workunit.client.0.smithi121.stdout:3/885: unlink d1e/d1f/dba/d113/d116/d128/fac 0 2024-08-18T22:41:45.864 INFO:tasks.workunit.client.0.smithi121.stdout:0/734: link d1/d4/db/d24/f6f d1/d4/db/d24/df/d8/d78/d7c/df5/daf/dd5/f100 0 2024-08-18T22:41:45.864 INFO:tasks.workunit.client.1.smithi195.stdout:8/546: mkdir d1/d3/db/d39/d44/dcb 0 2024-08-18T22:41:45.867 INFO:tasks.workunit.client.0.smithi121.stdout:0/735: write d1/d4/db/d24/df/d8/d78/d7c/df5/daf/dcb/ffd [623290,129124] 0 2024-08-18T22:41:45.868 INFO:tasks.workunit.client.1.smithi195.stdout:8/547: getdents d1/d3/db/d35/da9 0 2024-08-18T22:41:45.868 INFO:tasks.workunit.client.1.smithi195.stdout:0/548: rmdir d0/dc/d11/d23/dac 0 2024-08-18T22:41:45.869 INFO:tasks.workunit.client.0.smithi121.stdout:0/736: chown d1/d4/da/d2f/da0/l64 46 1 2024-08-18T22:41:45.870 INFO:tasks.workunit.client.0.smithi121.stdout:2/549: write d2/d3/d48/d77/f3b [1976935,90563] 0 2024-08-18T22:41:45.871 INFO:tasks.workunit.client.1.smithi195.stdout:0/549: write d0/dc/d11/d23/f9b [524307,95282] 0 2024-08-18T22:41:45.871 INFO:tasks.workunit.client.1.smithi195.stdout:8/548: symlink d1/d3/db/d39/d44/d79/lcc 0 2024-08-18T22:41:45.874 INFO:tasks.workunit.client.0.smithi121.stdout:2/550: mknod d2/d3/d48/d77/cb5 0 2024-08-18T22:41:45.875 INFO:tasks.workunit.client.1.smithi195.stdout:8/549: creat d1/d3/db/d35/d4d/fcd x:0 0 0 2024-08-18T22:41:45.876 INFO:tasks.workunit.client.1.smithi195.stdout:2/325: dread d1/f59 [0,4194304] 0 2024-08-18T22:41:45.877 INFO:tasks.workunit.client.1.smithi195.stdout:8/550: rmdir d1/d3/d1c/d21 39 2024-08-18T22:41:45.877 INFO:tasks.workunit.client.0.smithi121.stdout:2/551: dread - d2/d8/d19/d4a/d64/f8b zero size 2024-08-18T22:41:45.878 INFO:tasks.workunit.client.0.smithi121.stdout:0/737: write d1/d4/db/f5a [675857,116678] 0 2024-08-18T22:41:45.879 INFO:tasks.workunit.client.1.smithi195.stdout:2/326: truncate d1/d8/d3d/f18 1740339 0 2024-08-18T22:41:45.880 INFO:tasks.workunit.client.1.smithi195.stdout:0/550: rmdir d0/dc/d25/d67 39 2024-08-18T22:41:45.880 INFO:tasks.workunit.client.0.smithi121.stdout:2/552: creat d2/d8/d9e/fb6 x:0 0 0 2024-08-18T22:41:45.882 INFO:tasks.workunit.client.0.smithi121.stdout:0/738: dread d1/d4/f88 [0,4194304] 0 2024-08-18T22:41:45.882 INFO:tasks.workunit.client.1.smithi195.stdout:2/327: symlink d1/d24/l62 0 2024-08-18T22:41:45.883 INFO:tasks.workunit.client.1.smithi195.stdout:0/551: write d0/dc/d64/d81/d44/d41/f73 [1519312,48182] 0 2024-08-18T22:41:45.884 INFO:tasks.workunit.client.0.smithi121.stdout:2/553: unlink d2/d3/d51/fa2 0 2024-08-18T22:41:45.885 INFO:tasks.workunit.client.0.smithi121.stdout:3/886: dread d1e/d1f/dba/d113/d116/d128/f57 [4194304,4194304] 0 2024-08-18T22:41:45.885 INFO:tasks.workunit.client.1.smithi195.stdout:8/551: dwrite d1/f2a [0,4194304] 0 2024-08-18T22:41:45.886 INFO:tasks.workunit.client.0.smithi121.stdout:0/739: unlink d1/d4/da/d2f/cda 0 2024-08-18T22:41:45.887 INFO:tasks.workunit.client.1.smithi195.stdout:0/552: write d0/dc/d64/d81/d44/d41/d6d/d92/f91 [332993,116331] 0 2024-08-18T22:41:45.888 INFO:tasks.workunit.client.0.smithi121.stdout:0/740: write d1/d4/db/d24/d30/f3b [5782551,73394] 0 2024-08-18T22:41:45.889 INFO:tasks.workunit.client.1.smithi195.stdout:8/552: dread - d1/d3/d1c/d21/f7f zero size 2024-08-18T22:41:45.890 INFO:tasks.workunit.client.0.smithi121.stdout:3/887: rename d1e/d1f/da6/dc7/db8 to d1e/d1f/d25/d67/d92/d111/d13e 0 2024-08-18T22:41:45.892 INFO:tasks.workunit.client.1.smithi195.stdout:2/328: dread d1/f38 [0,4194304] 0 2024-08-18T22:41:45.893 INFO:tasks.workunit.client.1.smithi195.stdout:0/553: unlink d0/dc/l5c 0 2024-08-18T22:41:45.894 INFO:tasks.workunit.client.1.smithi195.stdout:3/538: dread d7/d1f/d49/f7f [0,4194304] 0 2024-08-18T22:41:45.894 INFO:tasks.workunit.client.1.smithi195.stdout:8/553: symlink d1/de/d31/d5a/lce 0 2024-08-18T22:41:45.896 INFO:tasks.workunit.client.1.smithi195.stdout:2/329: mkdir d1/d8/d3d/d4d/d63 0 2024-08-18T22:41:45.898 INFO:tasks.workunit.client.0.smithi121.stdout:3/888: fsync d1e/d1f/d25/d67/fd8 0 2024-08-18T22:41:45.899 INFO:tasks.workunit.client.1.smithi195.stdout:8/554: creat d1/d3/db/d39/d2e/d78/fcf x:0 0 0 2024-08-18T22:41:45.900 INFO:tasks.workunit.client.1.smithi195.stdout:0/554: getdents d0/dc/d64/d81/d44/d41/d4c 0 2024-08-18T22:41:45.901 INFO:tasks.workunit.client.0.smithi121.stdout:3/889: creat d1e/d1f/da6/dc7/f13f x:0 0 0 2024-08-18T22:41:45.903 INFO:tasks.workunit.client.1.smithi195.stdout:3/539: dwrite d7/da/f48 [4194304,4194304] 0 2024-08-18T22:41:45.903 INFO:tasks.workunit.client.0.smithi121.stdout:3/890: write d1e/d1f/d25/f106 [483026,125254] 0 2024-08-18T22:41:45.905 INFO:tasks.workunit.client.0.smithi121.stdout:3/891: chown d1e/d1f/d25/d67/d92/dbd/d126 735388 1 2024-08-18T22:41:45.906 INFO:tasks.workunit.client.1.smithi195.stdout:3/540: dread - d7/da/f70 zero size 2024-08-18T22:41:45.909 INFO:tasks.workunit.client.0.smithi121.stdout:3/892: read d1e/d1f/d25/d58/d75/fa9 [1124662,65099] 0 2024-08-18T22:41:45.909 INFO:tasks.workunit.client.0.smithi121.stdout:0/741: dwrite d1/d47/f66 [0,4194304] 0 2024-08-18T22:41:45.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:41:45 smithi195 ceph-mon[23370]: Standby manager daemon smithi121.lopxqc started 2024-08-18T22:41:45.910 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:41:45 smithi195 ceph-mon[23370]: from='mgr.? 172.21.15.121:0/2995984183' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi121.lopxqc/crt"}]: dispatch 2024-08-18T22:41:45.910 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:41:45 smithi195 ceph-mon[23370]: from='mgr.? 172.21.15.121:0/2995984183' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-08-18T22:41:45.910 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:41:45 smithi195 ceph-mon[23370]: from='mgr.? 172.21.15.121:0/2995984183' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi121.lopxqc/key"}]: dispatch 2024-08-18T22:41:45.910 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:41:45 smithi195 ceph-mon[23370]: from='mgr.? 172.21.15.121:0/2995984183' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-08-18T22:41:45.910 INFO:tasks.workunit.client.0.smithi121.stdout:2/554: dread d2/d3/d51/f81 [4194304,4194304] 0 2024-08-18T22:41:45.911 INFO:tasks.workunit.client.1.smithi195.stdout:3/541: mkdir d7/da/df/d8e/daa 0 2024-08-18T22:41:45.911 INFO:tasks.workunit.client.1.smithi195.stdout:8/555: dwrite d1/d3/d1c/d21/f28 [0,4194304] 0 2024-08-18T22:41:45.912 INFO:tasks.workunit.client.0.smithi121.stdout:3/893: creat d1e/d1f/dba/df6/f140 x:0 0 0 2024-08-18T22:41:45.913 INFO:tasks.workunit.client.0.smithi121.stdout:0/742: symlink d1/d4/db/d24/df/d8/d71/l101 0 2024-08-18T22:41:45.918 INFO:tasks.workunit.client.0.smithi121.stdout:0/743: mknod d1/d4/db/d24/df/d8/d78/d7c/df5/daf/dd5/d5b/c102 0 2024-08-18T22:41:45.920 INFO:tasks.workunit.client.0.smithi121.stdout:3/894: getdents d1e/d1f 0 2024-08-18T22:41:45.921 INFO:tasks.workunit.client.1.smithi195.stdout:2/330: dread d1/d8/d3d/f3e [4194304,4194304] 0 2024-08-18T22:41:45.922 INFO:tasks.workunit.client.1.smithi195.stdout:3/542: dwrite d7/f89 [4194304,4194304] 0 2024-08-18T22:41:45.923 INFO:tasks.workunit.client.0.smithi121.stdout:3/895: rmdir d1e/d1f/d25/d6b/d66/dd9 39 2024-08-18T22:41:45.924 INFO:tasks.workunit.client.1.smithi195.stdout:8/556: dwrite d1/de/df/d1d/f3e [0,4194304] 0 2024-08-18T22:41:45.924 INFO:tasks.workunit.client.0.smithi121.stdout:0/744: rmdir d1/d4/db/d24/df/d8/d78/d7c/df5/daf/dd5/d90/dc3 39 2024-08-18T22:41:45.925 INFO:tasks.workunit.client.1.smithi195.stdout:3/543: readlink d7/d1f/d49/l57 0 2024-08-18T22:41:45.925 INFO:tasks.workunit.client.1.smithi195.stdout:2/331: rmdir d1/d24 39 2024-08-18T22:41:45.927 INFO:tasks.workunit.client.0.smithi121.stdout:3/896: getdents d1e/d1f/d25/d6b/d66 0 2024-08-18T22:41:45.929 INFO:tasks.workunit.client.0.smithi121.stdout:0/745: creat d1/d4/db/d24/df/d8/d78/d7c/df5/daf/dd5/d90/dd8/f103 x:0 0 0 2024-08-18T22:41:45.934 INFO:tasks.workunit.client.0.smithi121.stdout:0/746: creat d1/d4/db/d24/df/d8/d78/d7c/df5/daf/dd5/d5b/f104 x:0 0 0 2024-08-18T22:41:45.935 INFO:tasks.workunit.client.1.smithi195.stdout:3/544: link d7/da/df/d38/f45 d7/d54/d9a/fab 0 2024-08-18T22:41:45.936 INFO:tasks.workunit.client.0.smithi121.stdout:3/897: dwrite d1e/d1f/d25/d58/de0/f129 [0,4194304] 0 2024-08-18T22:41:45.936 INFO:tasks.workunit.client.1.smithi195.stdout:0/555: dread d0/dc/dd/f29 [0,4194304] 0 2024-08-18T22:41:45.936 INFO:tasks.workunit.client.1.smithi195.stdout:3/545: chown d7/da/df/d1c/l62 453825757 1 2024-08-18T22:41:45.937 INFO:tasks.workunit.client.1.smithi195.stdout:3/546: stat d7/da/l59 0 2024-08-18T22:41:45.937 INFO:tasks.workunit.client.1.smithi195.stdout:0/556: mknod d0/dc/d11/cba 0 2024-08-18T22:41:45.938 INFO:tasks.workunit.client.0.smithi121.stdout:0/747: unlink d1/d4/db/d24/d30/l6e 0 2024-08-18T22:41:45.939 INFO:tasks.workunit.client.1.smithi195.stdout:3/547: mknod d7/da/d75/cac 0 2024-08-18T22:41:45.942 INFO:tasks.workunit.client.0.smithi121.stdout:0/748: link d1/d4/d53/da7/c8b d1/d4/d53/c105 0 2024-08-18T22:41:45.944 INFO:tasks.workunit.client.1.smithi195.stdout:0/557: rename d0/dc/f21 to d0/dc/d64/d81/d44/fbb 0 2024-08-18T22:41:45.947 INFO:tasks.workunit.client.1.smithi195.stdout:0/558: mknod d0/dc/d64/d81/d44/d41/d6d/d92/d66/cbc 0 2024-08-18T22:41:45.947 INFO:tasks.workunit.client.1.smithi195.stdout:3/548: dwrite d7/fc [0,4194304] 0 2024-08-18T22:41:45.950 INFO:tasks.workunit.client.1.smithi195.stdout:0/559: creat d0/dc/d64/d81/d44/d41/d6d/fbd x:0 0 0 2024-08-18T22:41:45.951 INFO:tasks.workunit.client.1.smithi195.stdout:3/549: creat d7/fad x:0 0 0 2024-08-18T22:41:45.952 INFO:tasks.workunit.client.1.smithi195.stdout:3/550: write d7/da/df/f27 [1130660,8200] 0 2024-08-18T22:41:45.955 INFO:tasks.workunit.client.1.smithi195.stdout:3/551: mkdir d7/d1f/d73/dae 0 2024-08-18T22:41:45.956 INFO:tasks.workunit.client.0.smithi121.stdout:3/898: fsync d1e/d1f/dba/df6/f140 0 2024-08-18T22:41:45.959 INFO:tasks.workunit.client.1.smithi195.stdout:0/560: dwrite d0/dc/dd/f6e [0,4194304] 0 2024-08-18T22:41:45.962 INFO:tasks.workunit.client.0.smithi121.stdout:3/899: rename d1e/d1f/d25/d67/d92/d111/d13e/d104/lb0 to d1e/d1f/dba/d113/d116/d128/d5f/dd2/l141 0 2024-08-18T22:41:45.962 INFO:tasks.workunit.client.0.smithi121.stdout:0/749: write d1/d4/db/f1a [1577747,33647] 0 2024-08-18T22:41:45.963 INFO:tasks.workunit.client.1.smithi195.stdout:2/332: dwrite d1/d24/d26/f2c [0,4194304] 0 2024-08-18T22:41:45.965 INFO:tasks.workunit.client.1.smithi195.stdout:2/333: truncate d1/d24/d26/d42/f4c 679930 0 2024-08-18T22:41:45.966 INFO:tasks.workunit.client.1.smithi195.stdout:0/561: mkdir d0/dc/d64/d81/d44/d41/d6d/d92/d66/d8d/dbe 0 2024-08-18T22:41:45.968 INFO:tasks.workunit.client.1.smithi195.stdout:0/562: write d0/dc/dd/f29 [3423887,116022] 0 2024-08-18T22:41:45.968 INFO:tasks.workunit.client.0.smithi121.stdout:0/750: creat d1/d4/db/d24/df/d8/d78/d7c/df5/f106 x:0 0 0 2024-08-18T22:41:45.971 INFO:tasks.workunit.client.1.smithi195.stdout:0/563: chown d0/dc/d64/d81/d44/d41/fb1 22863 1 2024-08-18T22:41:45.972 INFO:tasks.workunit.client.0.smithi121.stdout:3/900: dwrite d1e/d1f/d25/d67/d92/dbd/d126/fdf [0,4194304] 0 2024-08-18T22:41:45.973 INFO:tasks.workunit.client.1.smithi195.stdout:0/564: write d0/dc/d25/d67/fb0 [387262,26596] 0 2024-08-18T22:41:45.974 INFO:tasks.workunit.client.1.smithi195.stdout:3/552: truncate d7/d1f/f34 4022619 0 2024-08-18T22:41:45.977 INFO:tasks.workunit.client.1.smithi195.stdout:0/565: chown d0/dc/d25/d67/f98 0 1 2024-08-18T22:41:45.979 INFO:tasks.workunit.client.0.smithi121.stdout:3/901: dwrite d1e/d1f/da6/dc7/dae/f10d [0,4194304] 0 2024-08-18T22:41:45.981 INFO:tasks.workunit.client.0.smithi121.stdout:3/902: mkdir d1e/d1f/d25/d67/d92/dbd/d142 0 2024-08-18T22:41:45.982 INFO:tasks.workunit.client.0.smithi121.stdout:3/903: write d1e/d1f/d25/f10c [1006176,50039] 0 2024-08-18T22:41:45.983 INFO:tasks.workunit.client.1.smithi195.stdout:3/553: dwrite f6 [0,4194304] 0 2024-08-18T22:41:45.987 INFO:tasks.workunit.client.1.smithi195.stdout:0/566: dwrite d0/f3 [4194304,4194304] 0 2024-08-18T22:41:45.989 INFO:tasks.workunit.client.1.smithi195.stdout:2/334: dread d1/d22/f30 [0,4194304] 0 2024-08-18T22:41:45.991 INFO:tasks.workunit.client.1.smithi195.stdout:3/554: creat d7/faf x:0 0 0 2024-08-18T22:41:45.993 INFO:tasks.workunit.client.0.smithi121.stdout:3/904: dread d1e/d1f/d3e/f78 [0,4194304] 0 2024-08-18T22:41:45.994 INFO:tasks.workunit.client.1.smithi195.stdout:3/555: stat d7/da/df/d1c/d6a/d6c/f9f 0 2024-08-18T22:41:46.000 INFO:tasks.workunit.client.1.smithi195.stdout:3/556: mkdir d7/d1f/d73/db0 0 2024-08-18T22:41:46.003 INFO:tasks.workunit.client.1.smithi195.stdout:3/557: fsync d7/da/df/d95/f9d 0 2024-08-18T22:41:46.004 INFO:tasks.workunit.client.1.smithi195.stdout:0/567: rename d0/dc/d64/d81/f40 to d0/dc/d64/d81/d44/fbf 0 2024-08-18T22:41:46.006 INFO:tasks.workunit.client.1.smithi195.stdout:2/335: dwrite d1/f3c [0,4194304] 0 2024-08-18T22:41:46.009 INFO:tasks.workunit.client.1.smithi195.stdout:0/568: mknod d0/dc/d64/d81/d44/d41/d6d/d92/cc0 0 2024-08-18T22:41:46.011 INFO:tasks.workunit.client.1.smithi195.stdout:0/569: stat d0/dc/d64/d81/d44/d41/d4c/f61 0 2024-08-18T22:41:46.019 INFO:tasks.workunit.client.0.smithi121.stdout:3/905: rename d1e/d1f/d25/d6b/d13b to d1e/d1f/d25/d58/de0/d143 0 2024-08-18T22:41:46.022 INFO:tasks.workunit.client.1.smithi195.stdout:0/570: dread d0/dc/d64/d81/d44/f12 [0,4194304] 0 2024-08-18T22:41:46.022 INFO:tasks.workunit.client.1.smithi195.stdout:3/558: dwrite d7/da/df/f1a [0,4194304] 0 2024-08-18T22:41:46.023 INFO:tasks.workunit.client.0.smithi121.stdout:3/906: dread d1e/d1f/d25/f27 [0,4194304] 0 2024-08-18T22:41:46.024 INFO:tasks.workunit.client.0.smithi121.stdout:3/907: write d1e/d1f/fc3 [4199040,92870] 0 2024-08-18T22:41:46.024 INFO:tasks.workunit.client.1.smithi195.stdout:2/336: dread d1/f2 [0,4194304] 0 2024-08-18T22:41:46.025 INFO:tasks.workunit.client.1.smithi195.stdout:2/337: chown d1/d24/f34 3 1 2024-08-18T22:41:46.025 INFO:tasks.workunit.client.0.smithi121.stdout:3/908: dread - d1e/d1f/d2a/fe7 zero size 2024-08-18T22:41:46.028 INFO:tasks.workunit.client.1.smithi195.stdout:0/571: fdatasync d0/dc/d64/d81/d44/d41/d4c/f61 0 2024-08-18T22:41:46.029 INFO:tasks.workunit.client.1.smithi195.stdout:3/559: mknod d7/d54/d9a/cb1 0 2024-08-18T22:41:46.030 INFO:tasks.workunit.client.1.smithi195.stdout:2/338: dread d1/d24/f34 [0,4194304] 0 2024-08-18T22:41:46.031 INFO:tasks.workunit.client.1.smithi195.stdout:0/572: fsync d0/dc/d64/d81/d44/d41/d6d/d92/faf 0 2024-08-18T22:41:46.034 INFO:tasks.workunit.client.1.smithi195.stdout:2/339: rename d1/d24/d26/d42/d50/c58 to d1/d8/d3d/d5e/c64 0 2024-08-18T22:41:46.034 INFO:tasks.workunit.client.1.smithi195.stdout:0/573: dread d0/dc/d11/d23/f9b [0,4194304] 0 2024-08-18T22:41:46.036 INFO:tasks.workunit.client.1.smithi195.stdout:3/560: truncate d7/da/d75/f78 1885154 0 2024-08-18T22:41:46.036 INFO:tasks.workunit.client.1.smithi195.stdout:2/340: mkdir d1/d22/d65 0 2024-08-18T22:41:46.036 INFO:tasks.workunit.client.1.smithi195.stdout:3/561: chown d7/da/df/d38/l9e 9314332 1 2024-08-18T22:41:46.039 INFO:tasks.workunit.client.1.smithi195.stdout:2/341: write d1/d8/d3d/d3b/d53/d5b/f61 [902038,108901] 0 2024-08-18T22:41:46.043 INFO:tasks.workunit.client.1.smithi195.stdout:0/574: dwrite d0/dc/d11/d23/d51/fb7 [0,4194304] 0 2024-08-18T22:41:46.047 INFO:tasks.workunit.client.1.smithi195.stdout:3/562: dwrite d7/da/df/d1c/f58 [0,4194304] 0 2024-08-18T22:41:46.049 INFO:tasks.workunit.client.1.smithi195.stdout:2/342: getdents d1/d22 0 2024-08-18T22:41:46.050 INFO:tasks.workunit.client.1.smithi195.stdout:0/575: creat d0/dc/dd/d46/fc1 x:0 0 0 2024-08-18T22:41:46.052 INFO:tasks.workunit.client.1.smithi195.stdout:2/343: creat d1/d8/d3d/d3b/d46/f66 x:0 0 0 2024-08-18T22:41:46.054 INFO:tasks.workunit.client.1.smithi195.stdout:0/576: unlink d0/dc/d25/d67/f98 0 2024-08-18T22:41:46.056 INFO:tasks.workunit.client.1.smithi195.stdout:3/563: write d7/da/df/d38/f3f [1252323,47078] 0 2024-08-18T22:41:46.058 INFO:tasks.workunit.client.1.smithi195.stdout:2/344: dread d1/d8/d3d/f48 [0,4194304] 0 2024-08-18T22:41:46.059 INFO:tasks.workunit.client.1.smithi195.stdout:3/564: rmdir d7/d1f/d74/d81 39 2024-08-18T22:41:46.060 INFO:tasks.workunit.client.1.smithi195.stdout:2/345: write d1/d24/f56 [2560007,124707] 0 2024-08-18T22:41:46.061 INFO:tasks.workunit.client.1.smithi195.stdout:2/346: chown d1/d8/d3d/f18 57854 1 2024-08-18T22:41:46.061 INFO:tasks.workunit.client.1.smithi195.stdout:0/577: link d0/f3 d0/dc/d64/d81/fc2 0 2024-08-18T22:41:46.063 INFO:tasks.workunit.client.1.smithi195.stdout:0/578: readlink d0/dc/l1a 0 2024-08-18T22:41:46.064 INFO:tasks.workunit.client.1.smithi195.stdout:2/347: mknod d1/d8/c67 0 2024-08-18T22:41:46.065 INFO:tasks.workunit.client.1.smithi195.stdout:0/579: write d0/dc/d11/d23/d51/f7a [691982,94926] 0 2024-08-18T22:41:46.067 INFO:tasks.workunit.client.1.smithi195.stdout:6/411: sync 2024-08-18T22:41:46.067 INFO:tasks.workunit.client.1.smithi195.stdout:7/512: sync 2024-08-18T22:41:46.070 INFO:tasks.workunit.client.1.smithi195.stdout:6/412: read da/d15/d1c/f12 [4668,52372] 0 2024-08-18T22:41:46.072 INFO:tasks.workunit.client.1.smithi195.stdout:7/513: mkdir dc/d14/d2b/dbc 0 2024-08-18T22:41:46.074 INFO:tasks.workunit.client.1.smithi195.stdout:6/413: creat da/d3b/d5f/f79 x:0 0 0 2024-08-18T22:41:46.076 INFO:tasks.workunit.client.1.smithi195.stdout:6/414: creat da/d3b/f7a x:0 0 0 2024-08-18T22:41:46.077 INFO:tasks.workunit.client.1.smithi195.stdout:3/565: dread d7/f18 [0,4194304] 0 2024-08-18T22:41:46.077 INFO:tasks.workunit.client.1.smithi195.stdout:7/514: rename dc/d8f/fac to dc/d14/fbd 0 2024-08-18T22:41:46.078 INFO:tasks.workunit.client.1.smithi195.stdout:0/580: dread d0/dc/d64/d81/f35 [0,4194304] 0 2024-08-18T22:41:46.080 INFO:tasks.workunit.client.1.smithi195.stdout:0/581: write d0/dc/d11/d23/d51/f7a [220899,100008] 0 2024-08-18T22:41:46.081 INFO:tasks.workunit.client.1.smithi195.stdout:3/566: creat d7/da/df/d8e/daa/fb2 x:0 0 0 2024-08-18T22:41:46.082 INFO:tasks.workunit.client.1.smithi195.stdout:7/515: creat dc/d1d/d29/fbe x:0 0 0 2024-08-18T22:41:46.084 INFO:tasks.workunit.client.1.smithi195.stdout:7/516: fdatasync dc/d14/d15/d17/d18/d89/f98 0 2024-08-18T22:41:46.084 INFO:tasks.workunit.client.1.smithi195.stdout:3/567: mknod d7/da/df/d1c/d6a/d6c/cb3 0 2024-08-18T22:41:46.084 INFO:tasks.workunit.client.1.smithi195.stdout:0/582: getdents d0/dc/d11/d6f 0 2024-08-18T22:41:46.087 INFO:tasks.workunit.client.1.smithi195.stdout:7/517: mknod dc/d14/d15/d17/d18/cbf 0 2024-08-18T22:41:46.090 INFO:tasks.workunit.client.1.smithi195.stdout:7/518: creat dc/d14/d2b/dbc/fc0 x:0 0 0 2024-08-18T22:41:46.090 INFO:tasks.workunit.client.1.smithi195.stdout:0/583: getdents d0/dc/dd 0 2024-08-18T22:41:46.091 INFO:tasks.workunit.client.1.smithi195.stdout:7/519: chown dc/f32 361 1 2024-08-18T22:41:46.092 INFO:tasks.workunit.client.1.smithi195.stdout:7/520: write dc/d14/d2b/fb4 [746809,125192] 0 2024-08-18T22:41:46.094 INFO:tasks.workunit.client.1.smithi195.stdout:6/415: dread da/d15/d1c/f28 [0,4194304] 0 2024-08-18T22:41:46.095 INFO:tasks.workunit.client.1.smithi195.stdout:0/584: creat d0/dc/d64/d81/d44/d41/d6d/d92/fc3 x:0 0 0 2024-08-18T22:41:46.095 INFO:tasks.workunit.client.1.smithi195.stdout:0/585: dread - d0/dc/dd/f96 zero size 2024-08-18T22:41:46.096 INFO:tasks.workunit.client.1.smithi195.stdout:6/416: truncate da/d3b/d5f/f79 101404 0 2024-08-18T22:41:46.097 INFO:tasks.workunit.client.1.smithi195.stdout:0/586: creat d0/dc/d25/d67/fc4 x:0 0 0 2024-08-18T22:41:46.098 INFO:tasks.workunit.client.1.smithi195.stdout:6/417: rmdir da/d15 39 2024-08-18T22:41:46.099 INFO:tasks.workunit.client.1.smithi195.stdout:6/418: dread - da/f6e zero size 2024-08-18T22:41:46.099 INFO:tasks.workunit.client.1.smithi195.stdout:3/568: truncate d7/fc 2605141 0 2024-08-18T22:41:46.101 INFO:tasks.workunit.client.1.smithi195.stdout:0/587: rename d0/dc/d11/d23/d8e to d0/dc/d64/d81/dc5 0 2024-08-18T22:41:46.103 INFO:tasks.workunit.client.1.smithi195.stdout:3/569: unlink d7/da/df/f8f 0 2024-08-18T22:41:46.103 INFO:tasks.workunit.client.1.smithi195.stdout:6/419: getdents da/db/d78 0 2024-08-18T22:41:46.105 INFO:tasks.workunit.client.1.smithi195.stdout:3/570: readlink d7/d1f/d49/l66 0 2024-08-18T22:41:46.106 INFO:tasks.workunit.client.1.smithi195.stdout:6/420: write da/d15/f34 [2775306,120429] 0 2024-08-18T22:41:46.108 INFO:tasks.workunit.client.1.smithi195.stdout:3/571: mkdir d7/d1f/d73/dae/db4 0 2024-08-18T22:41:46.109 INFO:tasks.workunit.client.1.smithi195.stdout:6/421: write da/d22/f5c [862182,35373] 0 2024-08-18T22:41:46.109 INFO:tasks.workunit.client.1.smithi195.stdout:0/588: dwrite d0/dc/dd/f96 [0,4194304] 0 2024-08-18T22:41:46.112 INFO:tasks.workunit.client.1.smithi195.stdout:3/572: mknod d7/d1f/d73/dae/db4/cb5 0 2024-08-18T22:41:46.115 INFO:tasks.workunit.client.1.smithi195.stdout:0/589: dread d0/dc/d64/d81/d44/d41/d6d/d92/d66/f86 [0,4194304] 0 2024-08-18T22:41:46.116 INFO:tasks.workunit.client.1.smithi195.stdout:3/573: getdents d7/da/df/d1c/d6a/d6c 0 2024-08-18T22:41:46.117 INFO:tasks.workunit.client.1.smithi195.stdout:3/574: chown d7/f51 1995943557 1 2024-08-18T22:41:46.117 INFO:tasks.workunit.client.1.smithi195.stdout:3/575: dread - d7/da/df/d95/f9d zero size 2024-08-18T22:41:46.117 INFO:tasks.workunit.client.1.smithi195.stdout:0/590: dread d0/dc/d11/d23/f9b [0,4194304] 0 2024-08-18T22:41:46.119 INFO:tasks.workunit.client.1.smithi195.stdout:6/422: dread da/db/d19/f1d [0,4194304] 0 2024-08-18T22:41:46.120 INFO:tasks.workunit.client.1.smithi195.stdout:3/576: rmdir d7/da/df/d8e/daa 39 2024-08-18T22:41:46.121 INFO:tasks.workunit.client.1.smithi195.stdout:0/591: creat d0/dc/d11/daa/fc6 x:0 0 0 2024-08-18T22:41:46.122 INFO:tasks.workunit.client.1.smithi195.stdout:6/423: unlink da/d15/d1c/f50 0 2024-08-18T22:41:46.122 INFO:tasks.workunit.client.1.smithi195.stdout:0/592: write d0/dc/d25/d67/fc4 [519891,21672] 0 2024-08-18T22:41:46.123 INFO:tasks.workunit.client.1.smithi195.stdout:6/424: fdatasync da/f6e 0 2024-08-18T22:41:46.126 INFO:tasks.workunit.client.1.smithi195.stdout:6/425: creat da/d22/f7b x:0 0 0 2024-08-18T22:41:46.128 INFO:tasks.workunit.client.1.smithi195.stdout:6/426: fsync da/d15/d1c/f28 0 2024-08-18T22:41:46.131 INFO:tasks.workunit.client.1.smithi195.stdout:6/427: unlink da/d22/f62 0 2024-08-18T22:41:46.132 INFO:tasks.workunit.client.1.smithi195.stdout:6/428: mknod da/db/d19/d67/c7c 0 2024-08-18T22:41:46.133 INFO:tasks.workunit.client.1.smithi195.stdout:6/429: truncate da/db/d26/f63 103433 0 2024-08-18T22:41:46.134 INFO:tasks.workunit.client.1.smithi195.stdout:6/430: write da/d15/f2c [1573934,5108] 0 2024-08-18T22:41:46.136 INFO:tasks.workunit.client.1.smithi195.stdout:0/593: dread d0/dc/dd/f59 [0,4194304] 0 2024-08-18T22:41:46.141 INFO:tasks.workunit.client.1.smithi195.stdout:0/594: dwrite d0/dc/d64/d81/f89 [0,4194304] 0 2024-08-18T22:41:46.144 INFO:tasks.workunit.client.1.smithi195.stdout:0/595: rename d0/dc/d64/d81/l99 to d0/dc/d11/daa/lc7 0 2024-08-18T22:41:46.145 INFO:tasks.workunit.client.1.smithi195.stdout:0/596: readlink d0/dc/d64/d81/d44/d41/d6d/d92/lae 0 2024-08-18T22:41:46.162 INFO:tasks.workunit.client.0.smithi121.stdout:1/881: sync 2024-08-18T22:41:46.163 INFO:tasks.workunit.client.0.smithi121.stdout:1/882: chown d5/l40 32 1 2024-08-18T22:41:46.163 INFO:tasks.workunit.client.1.smithi195.stdout:7/521: truncate dc/d14/d15/f42 2922414 0 2024-08-18T22:41:46.175 INFO:tasks.workunit.client.1.smithi195.stdout:3/577: truncate d7/da/df/d1c/f58 2391444 0 2024-08-18T22:41:46.179 INFO:tasks.workunit.client.1.smithi195.stdout:0/597: write d0/f3 [1917478,33340] 0 2024-08-18T22:41:46.179 INFO:tasks.workunit.client.1.smithi195.stdout:3/578: dread d7/da/df/d1c/d6a/d6c/f6e [0,4194304] 0 2024-08-18T22:41:46.182 INFO:tasks.workunit.client.1.smithi195.stdout:7/522: truncate dc/d1d/d29/d5d/f8b 472154 0 2024-08-18T22:41:46.186 INFO:tasks.workunit.client.1.smithi195.stdout:6/431: dwrite da/d15/d1c/f12 [0,4194304] 0 2024-08-18T22:41:46.186 INFO:tasks.workunit.client.1.smithi195.stdout:3/579: write d7/da/df/d38/f3f [2749665,11048] 0 2024-08-18T22:41:46.186 INFO:tasks.workunit.client.1.smithi195.stdout:3/580: dread - d7/faf zero size 2024-08-18T22:41:46.188 INFO:tasks.workunit.client.1.smithi195.stdout:3/581: write d7/f51 [772219,12443] 0 2024-08-18T22:41:46.190 INFO:tasks.workunit.client.1.smithi195.stdout:0/598: symlink d0/dc/d11/d23/lc8 0 2024-08-18T22:41:46.192 INFO:tasks.workunit.client.1.smithi195.stdout:6/432: creat da/db/d26/f7d x:0 0 0 2024-08-18T22:41:46.192 INFO:tasks.workunit.client.1.smithi195.stdout:3/582: mknod d7/d1f/d73/dae/cb6 0 2024-08-18T22:41:46.194 INFO:tasks.workunit.client.1.smithi195.stdout:6/433: write da/db/f5b [663652,22931] 0 2024-08-18T22:41:46.198 INFO:tasks.workunit.client.1.smithi195.stdout:3/583: fsync d7/d54/d9a/fab 0 2024-08-18T22:41:46.200 INFO:tasks.workunit.client.1.smithi195.stdout:6/434: creat da/d3b/d5f/f7e x:0 0 0 2024-08-18T22:41:46.202 INFO:tasks.workunit.client.1.smithi195.stdout:0/599: dwrite d0/dc/d11/daa/fc6 [0,4194304] 0 2024-08-18T22:41:46.203 INFO:tasks.workunit.client.1.smithi195.stdout:7/523: dread dc/d14/d15/d17/d18/f43 [0,4194304] 0 2024-08-18T22:41:46.205 INFO:tasks.workunit.client.1.smithi195.stdout:6/435: stat da/l1a 0 2024-08-18T22:41:46.205 INFO:tasks.workunit.client.1.smithi195.stdout:3/584: mknod d7/d1f/d49/cb7 0 2024-08-18T22:41:46.207 INFO:tasks.workunit.client.1.smithi195.stdout:3/585: write d7/f51 [594531,16518] 0 2024-08-18T22:41:46.207 INFO:tasks.workunit.client.1.smithi195.stdout:7/524: symlink dc/d14/d15/d17/d58/lc1 0 2024-08-18T22:41:46.208 INFO:tasks.workunit.client.1.smithi195.stdout:0/600: dread d0/dc/d64/d81/f35 [0,4194304] 0 2024-08-18T22:41:46.209 INFO:tasks.workunit.client.1.smithi195.stdout:3/586: mknod d7/d54/d9a/cb8 0 2024-08-18T22:41:46.212 INFO:tasks.workunit.client.1.smithi195.stdout:7/525: creat dc/d2a/d4c/fc2 x:0 0 0 2024-08-18T22:41:46.213 INFO:tasks.workunit.client.1.smithi195.stdout:0/601: symlink d0/dc/d64/d81/lc9 0 2024-08-18T22:41:46.216 INFO:tasks.workunit.client.1.smithi195.stdout:6/436: creat da/d15/d1c/d2e/d74/f7f x:0 0 0 2024-08-18T22:41:46.216 INFO:tasks.workunit.client.1.smithi195.stdout:7/526: mknod dc/d1d/d29/d5d/cc3 0 2024-08-18T22:41:46.217 INFO:tasks.workunit.client.1.smithi195.stdout:3/587: dwrite d7/fad [0,4194304] 0 2024-08-18T22:41:46.219 INFO:tasks.workunit.client.1.smithi195.stdout:7/527: dread - dc/d14/d15/d17/d58/fa4 zero size 2024-08-18T22:41:46.221 INFO:tasks.workunit.client.1.smithi195.stdout:3/588: creat d7/d54/d9a/fb9 x:0 0 0 2024-08-18T22:41:46.225 INFO:tasks.workunit.client.1.smithi195.stdout:7/528: stat dc/d14/d15/d17/d18/f57 0 2024-08-18T22:41:46.225 INFO:tasks.workunit.client.1.smithi195.stdout:7/529: chown dc/d8f/d96 1035499 1 2024-08-18T22:41:46.232 INFO:tasks.workunit.client.1.smithi195.stdout:6/437: truncate da/db/f37 3043359 0 2024-08-18T22:41:46.233 INFO:tasks.workunit.client.1.smithi195.stdout:0/602: truncate d0/dc/d64/d81/d44/d41/f5d 1216682 0 2024-08-18T22:41:46.233 INFO:tasks.workunit.client.1.smithi195.stdout:3/589: truncate d7/da/df/d38/fa1 33616 0 2024-08-18T22:41:46.234 INFO:tasks.workunit.client.1.smithi195.stdout:7/530: truncate dc/d14/f68 421243 0 2024-08-18T22:41:46.235 INFO:tasks.workunit.client.1.smithi195.stdout:0/603: truncate d0/dc/d25/f7c 777167 0 2024-08-18T22:41:46.236 INFO:tasks.workunit.client.1.smithi195.stdout:3/590: write d7/f5c [4867163,126752] 0 2024-08-18T22:41:46.237 INFO:tasks.workunit.client.1.smithi195.stdout:7/531: write dc/f10 [4709379,62832] 0 2024-08-18T22:41:46.242 INFO:tasks.workunit.client.1.smithi195.stdout:6/438: dwrite da/d15/d1c/f28 [0,4194304] 0 2024-08-18T22:41:46.245 INFO:tasks.workunit.client.1.smithi195.stdout:7/532: dread dc/d14/d15/d17/d58/f5a [0,4194304] 0 2024-08-18T22:41:46.248 INFO:tasks.workunit.client.1.smithi195.stdout:6/439: read da/db/f3c [364855,100346] 0 2024-08-18T22:41:46.249 INFO:tasks.workunit.client.1.smithi195.stdout:1/598: sync 2024-08-18T22:41:46.249 INFO:tasks.workunit.client.1.smithi195.stdout:5/480: sync 2024-08-18T22:41:46.250 INFO:tasks.workunit.client.1.smithi195.stdout:4/466: sync 2024-08-18T22:41:46.250 INFO:tasks.workunit.client.1.smithi195.stdout:8/557: sync 2024-08-18T22:41:46.250 INFO:tasks.workunit.client.1.smithi195.stdout:9/505: sync 2024-08-18T22:41:46.254 INFO:tasks.workunit.client.1.smithi195.stdout:9/506: chown d1c/f64 2 1 2024-08-18T22:41:46.255 INFO:tasks.workunit.client.1.smithi195.stdout:9/507: chown f16 254 1 2024-08-18T22:41:46.260 INFO:tasks.workunit.client.1.smithi195.stdout:1/599: dwrite da/d4c/d5d/dcb/fd0 [0,4194304] 0 2024-08-18T22:41:46.265 INFO:tasks.workunit.client.1.smithi195.stdout:8/558: dwrite d1/d3/db/d39/d44/d79/fc3 [0,4194304] 0 2024-08-18T22:41:46.273 INFO:tasks.workunit.client.1.smithi195.stdout:1/600: dwrite da/d3d/f92 [0,4194304] 0 2024-08-18T22:41:46.293 INFO:tasks.workunit.client.1.smithi195.stdout:7/533: rename dc/d22/fa1 to dc/d14/d15/d17/d58/db6/fc4 0 2024-08-18T22:41:46.295 INFO:tasks.workunit.client.1.smithi195.stdout:6/440: mknod da/d15/d1c/d2e/c80 0 2024-08-18T22:41:46.296 INFO:tasks.workunit.client.1.smithi195.stdout:4/467: readlink d0/d9/l89 0 2024-08-18T22:41:46.297 INFO:tasks.workunit.client.1.smithi195.stdout:5/481: write d0/d3/d8/d64/f70 [125588,51465] 0 2024-08-18T22:41:46.300 INFO:tasks.workunit.client.1.smithi195.stdout:9/508: fdatasync d1c/d32/f84 0 2024-08-18T22:41:46.302 INFO:tasks.workunit.client.1.smithi195.stdout:9/509: truncate d1c/d32/d37/d4b/f6e 542682 0 2024-08-18T22:41:46.303 INFO:tasks.workunit.client.1.smithi195.stdout:8/559: creat d1/de/df/d1d/d8e/fd0 x:0 0 0 2024-08-18T22:41:46.304 INFO:tasks.workunit.client.1.smithi195.stdout:8/560: readlink d1/d3/d1c/d21/lbc 0 2024-08-18T22:41:46.305 INFO:tasks.workunit.client.1.smithi195.stdout:1/601: truncate da/d3d/f7c 802072 0 2024-08-18T22:41:46.306 INFO:tasks.workunit.client.1.smithi195.stdout:1/602: write f6 [4576469,65462] 0 2024-08-18T22:41:46.307 INFO:tasks.workunit.client.1.smithi195.stdout:2/348: sync 2024-08-18T22:41:46.311 INFO:tasks.workunit.client.1.smithi195.stdout:2/349: read - d1/d8/d3d/d3b/d46/f66 zero size 2024-08-18T22:41:46.316 INFO:tasks.workunit.client.1.smithi195.stdout:8/561: dwrite d1/d64/fb3 [0,4194304] 0 2024-08-18T22:41:46.316 INFO:tasks.workunit.client.1.smithi195.stdout:7/534: fsync dc/d1d/d29/f41 0 2024-08-18T22:41:46.318 INFO:tasks.workunit.client.1.smithi195.stdout:1/603: dwrite f7 [0,4194304] 0 2024-08-18T22:41:46.321 INFO:tasks.workunit.client.1.smithi195.stdout:1/604: readlink da/d18/d28/d31/l32 0 2024-08-18T22:41:46.322 INFO:tasks.workunit.client.1.smithi195.stdout:9/510: mknod d1c/d74/d8e/ca2 0 2024-08-18T22:41:46.323 INFO:tasks.workunit.client.1.smithi195.stdout:1/605: write da/d68/fa5 [390296,56796] 0 2024-08-18T22:41:46.323 INFO:tasks.workunit.client.1.smithi195.stdout:3/591: creat d7/da/df/fba x:0 0 0 2024-08-18T22:41:46.324 INFO:tasks.workunit.client.1.smithi195.stdout:3/592: chown d7/da/df/d95 303142 1 2024-08-18T22:41:46.326 INFO:tasks.workunit.client.1.smithi195.stdout:2/350: fsync d1/d8/d3d/fc 0 2024-08-18T22:41:46.328 INFO:tasks.workunit.client.1.smithi195.stdout:2/351: chown d1/d8/f1a 479336893 1 2024-08-18T22:41:46.332 INFO:tasks.workunit.client.1.smithi195.stdout:7/535: fdatasync dc/d22/f2c 0 2024-08-18T22:41:46.333 INFO:tasks.workunit.client.1.smithi195.stdout:6/441: dwrite da/f40 [0,4194304] 0 2024-08-18T22:41:46.337 INFO:tasks.workunit.client.1.smithi195.stdout:9/511: creat d1c/d92/fa3 x:0 0 0 2024-08-18T22:41:46.346 INFO:tasks.workunit.client.0.smithi121.stdout:8/964: sync 2024-08-18T22:41:46.349 INFO:tasks.workunit.client.0.smithi121.stdout:8/965: getdents d6/dd/d3b/da3/dca/d60 0 2024-08-18T22:41:46.351 INFO:tasks.workunit.client.0.smithi121.stdout:8/966: creat d6/dd/d25/dc8/de9/f141 x:0 0 0 2024-08-18T22:41:46.352 INFO:tasks.workunit.client.1.smithi195.stdout:9/512: creat d1c/d70/fa4 x:0 0 0 2024-08-18T22:41:46.353 INFO:tasks.workunit.client.0.smithi121.stdout:8/967: mknod d6/dd/d25/dc8/c142 0 2024-08-18T22:41:46.353 INFO:tasks.workunit.client.1.smithi195.stdout:9/513: chown d1c/f4e 839136883 1 2024-08-18T22:41:46.354 INFO:tasks.workunit.client.0.smithi121.stdout:8/968: fdatasync d6/d1e/d2d/f97 0 2024-08-18T22:41:46.355 INFO:tasks.workunit.client.0.smithi121.stdout:8/969: fsync d6/d1e/f35 0 2024-08-18T22:41:46.359 INFO:tasks.workunit.client.0.smithi121.stdout:8/970: rename d6/dd/d25/dda/l114 to d6/dd/d3b/da3/dca/d60/d5b/l143 0 2024-08-18T22:41:46.360 INFO:tasks.workunit.client.0.smithi121.stdout:8/971: rmdir d6/d1e 39 2024-08-18T22:41:46.362 INFO:tasks.workunit.client.0.smithi121.stdout:8/972: fdatasync d6/dd/d3b/da3/dca/d60/d5b/fa2 0 2024-08-18T22:41:46.365 INFO:tasks.workunit.client.0.smithi121.stdout:8/973: creat d6/dd/d3b/da3/dca/f144 x:0 0 0 2024-08-18T22:41:46.367 INFO:tasks.workunit.client.0.smithi121.stdout:8/974: write d6/dd/ffa [843327,97646] 0 2024-08-18T22:41:46.369 INFO:tasks.workunit.client.0.smithi121.stdout:8/975: creat d6/dd/d25/dc8/dce/d131/f145 x:0 0 0 2024-08-18T22:41:46.371 INFO:tasks.workunit.client.0.smithi121.stdout:8/976: chown d6/d1e/d2d/d78/d45/dd9/lf2 197633 1 2024-08-18T22:41:46.373 INFO:tasks.workunit.client.0.smithi121.stdout:8/977: fdatasync d6/f9 0 2024-08-18T22:41:46.375 INFO:tasks.workunit.client.0.smithi121.stdout:8/978: write d6/dd/d3b/da3/dca/d60/d5b/f92 [699457,49962] 0 2024-08-18T22:41:46.377 INFO:tasks.workunit.client.1.smithi195.stdout:2/352: link d1/d24/d26/d42/d44/f57 d1/d8/d3d/d5e/f68 0 2024-08-18T22:41:46.377 INFO:tasks.workunit.client.1.smithi195.stdout:2/353: readlink d1/d24/l2e 0 2024-08-18T22:41:46.379 INFO:tasks.workunit.client.0.smithi121.stdout:8/979: dread d6/dd/d3b/da3/dca/d60/d5b/d6e/f10e [0,4194304] 0 2024-08-18T22:41:46.379 INFO:tasks.workunit.client.1.smithi195.stdout:2/354: truncate d1/d24/d26/d42/d50/f52 907051 0 2024-08-18T22:41:46.381 INFO:tasks.workunit.client.0.smithi121.stdout:8/980: mkdir d6/d115/d146 0 2024-08-18T22:41:46.382 INFO:tasks.workunit.client.1.smithi195.stdout:7/536: getdents dc/d14/d15/d4d/d97 0 2024-08-18T22:41:46.383 INFO:tasks.workunit.client.0.smithi121.stdout:8/981: symlink d6/dd/d3b/da3/dca/d11e/l147 0 2024-08-18T22:41:46.386 INFO:tasks.workunit.client.1.smithi195.stdout:0/604: truncate d0/dc/d64/d81/fc2 3152828 0 2024-08-18T22:41:46.386 INFO:tasks.workunit.client.1.smithi195.stdout:0/605: chown d0/c3f 503 1 2024-08-18T22:41:46.387 INFO:tasks.workunit.client.1.smithi195.stdout:0/606: chown d0/dc/d25/d67/fc4 1460078222 1 2024-08-18T22:41:46.388 INFO:tasks.workunit.client.1.smithi195.stdout:8/562: mkdir d1/d3/db/d35/dd1 0 2024-08-18T22:41:46.389 INFO:tasks.workunit.client.0.smithi121.stdout:8/982: rmdir d6/dd/d3b/da3/dca 39 2024-08-18T22:41:46.394 INFO:tasks.workunit.client.0.smithi121.stdout:8/983: read d6/dd/d3b/da3/dca/d18/f98 [2157446,38029] 0 2024-08-18T22:41:46.394 INFO:tasks.workunit.client.0.smithi121.stdout:8/984: mkdir d6/dd/d25/dc8/d148 0 2024-08-18T22:41:46.395 INFO:tasks.workunit.client.1.smithi195.stdout:8/563: truncate d1/d3/d1c/d21/f3f 667675 0 2024-08-18T22:41:46.395 INFO:tasks.workunit.client.1.smithi195.stdout:0/607: dread d0/dc/d64/d81/f89 [0,4194304] 0 2024-08-18T22:41:46.395 INFO:tasks.workunit.client.1.smithi195.stdout:8/564: chown d1/d3/l14 881881 1 2024-08-18T22:41:46.396 INFO:tasks.workunit.client.0.smithi121.stdout:8/985: creat d6/dd/d25/dc8/dce/d13e/f149 x:0 0 0 2024-08-18T22:41:46.396 INFO:tasks.workunit.client.1.smithi195.stdout:8/565: creat d1/de/df/d1d/fd2 x:0 0 0 2024-08-18T22:41:46.398 INFO:tasks.workunit.client.1.smithi195.stdout:5/482: creat d0/f93 x:0 0 0 2024-08-18T22:41:46.398 INFO:tasks.workunit.client.0.smithi121.stdout:8/986: dread d6/d1e/f54 [0,4194304] 0 2024-08-18T22:41:46.398 INFO:tasks.workunit.client.0.smithi121.stdout:8/987: chown d6/d1e 168 1 2024-08-18T22:41:46.399 INFO:tasks.workunit.client.0.smithi121.stdout:8/988: symlink d6/l14a 0 2024-08-18T22:41:46.400 INFO:tasks.workunit.client.1.smithi195.stdout:8/566: write d1/d3/d1c/f45 [393447,1532] 0 2024-08-18T22:41:46.401 INFO:tasks.workunit.client.1.smithi195.stdout:4/468: write d0/d7/d1d/f2f [120182,51195] 0 2024-08-18T22:41:46.401 INFO:tasks.workunit.client.1.smithi195.stdout:5/483: mknod d0/d3/df/d5a/c94 0 2024-08-18T22:41:46.402 INFO:tasks.workunit.client.0.smithi121.stdout:8/989: truncate d6/d1e/d2d/d78/d45/d86/ded/f11f 962186 0 2024-08-18T22:41:46.403 INFO:tasks.workunit.client.1.smithi195.stdout:9/514: creat d1c/d32/fa5 x:0 0 0 2024-08-18T22:41:46.403 INFO:tasks.workunit.client.1.smithi195.stdout:3/593: dwrite d7/da/df/d38/f45 [0,4194304] 0 2024-08-18T22:41:46.405 INFO:tasks.workunit.client.1.smithi195.stdout:8/567: mknod d1/d3/db/d35/d56/cd3 0 2024-08-18T22:41:46.407 INFO:tasks.workunit.client.1.smithi195.stdout:4/469: rename d0/d99/d86/c9e to d0/d99/d85/d5f/ca2 0 2024-08-18T22:41:46.408 INFO:tasks.workunit.client.0.smithi121.stdout:9/885: sync 2024-08-18T22:41:46.409 INFO:tasks.workunit.client.0.smithi121.stdout:5/735: sync 2024-08-18T22:41:46.409 INFO:tasks.workunit.client.0.smithi121.stdout:2/555: sync 2024-08-18T22:41:46.409 INFO:tasks.workunit.client.0.smithi121.stdout:0/751: sync 2024-08-18T22:41:46.409 INFO:tasks.workunit.client.0.smithi121.stdout:7/874: sync 2024-08-18T22:41:46.409 INFO:tasks.workunit.client.0.smithi121.stdout:1/883: sync 2024-08-18T22:41:46.409 INFO:tasks.workunit.client.0.smithi121.stdout:4/874: sync 2024-08-18T22:41:46.409 INFO:tasks.workunit.client.0.smithi121.stdout:3/909: sync 2024-08-18T22:41:46.410 INFO:tasks.workunit.client.1.smithi195.stdout:5/484: creat d0/f95 x:0 0 0 2024-08-18T22:41:46.412 INFO:tasks.workunit.client.1.smithi195.stdout:5/485: read - d0/d2/d29/d88/d90/f91 zero size 2024-08-18T22:41:46.413 INFO:tasks.workunit.client.0.smithi121.stdout:2/556: symlink d2/d8/d1f/lb7 0 2024-08-18T22:41:46.413 INFO:tasks.workunit.client.0.smithi121.stdout:0/752: chown d1/d4/db 109 1 2024-08-18T22:41:46.413 INFO:tasks.workunit.client.0.smithi121.stdout:4/875: write d2/f21 [1758716,104768] 0 2024-08-18T22:41:46.414 INFO:tasks.workunit.client.0.smithi121.stdout:1/884: fdatasync d5/d10/d14/d2a/d3a/d87/d6c/d6f/d82/d15/d28/f71 0 2024-08-18T22:41:46.415 INFO:tasks.workunit.client.1.smithi195.stdout:8/568: rmdir d1/d3/db/d39/d44/d8c 39 2024-08-18T22:41:46.415 INFO:tasks.workunit.client.1.smithi195.stdout:5/486: fsync d0/db/f6f 0 2024-08-18T22:41:46.416 INFO:tasks.workunit.client.1.smithi195.stdout:8/569: stat d1/d64/f80 0 2024-08-18T22:41:46.416 INFO:tasks.workunit.client.0.smithi121.stdout:7/875: read de/d98/dfb/dce/d34/d38/d73/fbd [3745845,45361] 0 2024-08-18T22:41:46.417 INFO:tasks.workunit.client.1.smithi195.stdout:9/515: dwrite d1c/d32/d37/d4b/f65 [0,4194304] 0 2024-08-18T22:41:46.418 INFO:tasks.workunit.client.0.smithi121.stdout:3/910: write d1e/d1f/dba/d113/d116/d128/f68 [9052706,26149] 0 2024-08-18T22:41:46.418 INFO:tasks.workunit.client.0.smithi121.stdout:5/736: read d3/d5/d3c/daf/fc3 [150197,72221] 0 2024-08-18T22:41:46.418 INFO:tasks.workunit.client.0.smithi121.stdout:9/886: creat d0/d5/dd/d1a/dc8/f129 x:0 0 0 2024-08-18T22:41:46.419 INFO:tasks.workunit.client.1.smithi195.stdout:5/487: chown d0/d3/c4f 148 1 2024-08-18T22:41:46.419 INFO:tasks.workunit.client.1.smithi195.stdout:8/570: write d1/de/df/fc0 [273553,80663] 0 2024-08-18T22:41:46.420 INFO:tasks.workunit.client.0.smithi121.stdout:4/876: chown d2/dc/d16/d22/d2c/d7a/da0/de8 3 1 2024-08-18T22:41:46.420 INFO:tasks.workunit.client.0.smithi121.stdout:9/887: fdatasync d0/d5/dd/fde 0 2024-08-18T22:41:46.421 INFO:tasks.workunit.client.0.smithi121.stdout:7/876: chown de/d98/dfb/dce/d34/d38/d5f/d9c 46911 1 2024-08-18T22:41:46.422 INFO:tasks.workunit.client.1.smithi195.stdout:3/594: rename d7/da/f3d to d7/d1f/d74/fbb 0 2024-08-18T22:41:46.424 INFO:tasks.workunit.client.0.smithi121.stdout:3/911: mknod d1e/d1f/dba/df6/c144 0 2024-08-18T22:41:46.425 INFO:tasks.workunit.client.0.smithi121.stdout:4/877: creat d2/dc/d8d/f144 x:0 0 0 2024-08-18T22:41:46.426 INFO:tasks.workunit.client.0.smithi121.stdout:9/888: fdatasync d0/d38/d9e/df/d73/f10f 0 2024-08-18T22:41:46.428 INFO:tasks.workunit.client.1.smithi195.stdout:8/571: creat d1/de/d27/d4f/fd4 x:0 0 0 2024-08-18T22:41:46.429 INFO:tasks.workunit.client.0.smithi121.stdout:1/885: fsync d5/d10/d14/d2a/d3a/d87/d6c/d6f/d82/d15/d133/fa2 0 2024-08-18T22:41:46.429 INFO:tasks.workunit.client.0.smithi121.stdout:0/753: dread d1/d4/db/d24/df/d8/fb2 [0,4194304] 0 2024-08-18T22:41:46.430 INFO:tasks.workunit.client.1.smithi195.stdout:5/488: dwrite d0/d46/d6d/f8e [0,4194304] 0 2024-08-18T22:41:46.431 INFO:tasks.workunit.client.0.smithi121.stdout:8/990: dread d6/dd/d3b/da3/dca/d60/d5b/f92 [4194304,4194304] 0 2024-08-18T22:41:46.432 INFO:tasks.workunit.client.0.smithi121.stdout:5/737: dwrite d3/d5/f62 [0,4194304] 0 2024-08-18T22:41:46.432 INFO:tasks.workunit.client.1.smithi195.stdout:4/470: link d0/d9/l50 d0/d99/la3 0 2024-08-18T22:41:46.433 INFO:tasks.workunit.client.0.smithi121.stdout:7/877: creat de/d98/dfb/dce/d34/d38/d73/da2/d100/d18/d23/d24/d29/d43/f11a x:0 0 0 2024-08-18T22:41:46.433 INFO:tasks.workunit.client.1.smithi195.stdout:6/442: write da/f13 [1115072,93866] 0 2024-08-18T22:41:46.438 INFO:tasks.workunit.client.0.smithi121.stdout:4/878: mkdir d2/dc/d1c/dc1/d145 0 2024-08-18T22:41:46.439 INFO:tasks.workunit.client.0.smithi121.stdout:0/754: creat d1/d4/db/d18/d1c/d5f/f107 x:0 0 0 2024-08-18T22:41:46.440 INFO:tasks.workunit.client.1.smithi195.stdout:2/355: truncate d1/d8/d3d/f18 739666 0 2024-08-18T22:41:46.444 INFO:tasks.workunit.client.0.smithi121.stdout:8/991: dwrite d6/d20/d69/d77/fe4 [0,4194304] 0 2024-08-18T22:41:46.445 INFO:tasks.workunit.client.1.smithi195.stdout:7/537: truncate f3 1263561 0 2024-08-18T22:41:46.446 INFO:tasks.workunit.client.1.smithi195.stdout:6/443: fsync da/db/d19/f1d 0 2024-08-18T22:41:46.446 INFO:tasks.workunit.client.1.smithi195.stdout:5/489: dwrite d0/d2/d29/f67 [4194304,4194304] 0 2024-08-18T22:41:46.446 INFO:tasks.workunit.client.1.smithi195.stdout:4/471: mkdir d0/d7/d1d/d69/d7d/da4 0 2024-08-18T22:41:46.449 INFO:tasks.workunit.client.0.smithi121.stdout:5/738: mknod d3/d5/d27/d35/ce8 0 2024-08-18T22:41:46.449 INFO:tasks.workunit.client.1.smithi195.stdout:2/356: mkdir d1/d24/d26/d42/d50/d69 0 2024-08-18T22:41:46.450 INFO:tasks.workunit.client.1.smithi195.stdout:7/538: write dc/d2a/f65 [610672,3957] 0 2024-08-18T22:41:46.451 INFO:tasks.workunit.client.1.smithi195.stdout:8/572: dwrite d1/d3/d1c/d21/f7f [0,4194304] 0 2024-08-18T22:41:46.451 INFO:tasks.workunit.client.0.smithi121.stdout:8/992: readlink d6/dd/d3b/da3/dca/l44 0 2024-08-18T22:41:46.452 INFO:tasks.workunit.client.0.smithi121.stdout:3/912: getdents d1e/d1f/d25/d58 0 2024-08-18T22:41:46.453 INFO:tasks.workunit.client.0.smithi121.stdout:8/993: chown d6/dd/d25/dc8/dce/d13e 0 1 2024-08-18T22:41:46.454 INFO:tasks.workunit.client.1.smithi195.stdout:8/573: chown d1/d3/db/d35/d4d/d8b 7 1 2024-08-18T22:41:46.455 INFO:tasks.workunit.client.0.smithi121.stdout:5/739: mknod d3/d5/d13/d19/da3/ce9 0 2024-08-18T22:41:46.455 INFO:tasks.workunit.client.1.smithi195.stdout:5/490: mkdir d0/d2/d29/d88/d6a/d96 0 2024-08-18T22:41:46.457 INFO:tasks.workunit.client.0.smithi121.stdout:0/755: creat d1/d4/db/d24/df/d8/d78/d7c/df5/daf/dd5/d90/f108 x:0 0 0 2024-08-18T22:41:46.460 INFO:tasks.workunit.client.0.smithi121.stdout:3/913: mknod d1e/d1f/d25/d67/d92/d111/d13e/d104/d9a/c145 0 2024-08-18T22:41:46.460 INFO:tasks.workunit.client.0.smithi121.stdout:8/994: truncate d6/dd/dcc/de7/ff1 525267 0 2024-08-18T22:41:46.460 INFO:tasks.workunit.client.1.smithi195.stdout:4/472: creat d0/d7/d1d/d69/fa5 x:0 0 0 2024-08-18T22:41:46.462 INFO:tasks.workunit.client.1.smithi195.stdout:7/539: mkdir dc/d8f/d96/dc5 0 2024-08-18T22:41:46.464 INFO:tasks.workunit.client.1.smithi195.stdout:6/444: rename da/db/f5b to da/d15/d1c/d2e/d74/f81 0 2024-08-18T22:41:46.464 INFO:tasks.workunit.client.0.smithi121.stdout:5/740: dread d3/fd [0,4194304] 0 2024-08-18T22:41:46.466 INFO:tasks.workunit.client.0.smithi121.stdout:7/878: dread de/f28 [0,4194304] 0 2024-08-18T22:41:46.466 INFO:tasks.workunit.client.0.smithi121.stdout:8/995: unlink d6/dd/d25/dda/fe6 0 2024-08-18T22:41:46.466 INFO:tasks.workunit.client.0.smithi121.stdout:5/741: stat d3/d5/d27/d35 0 2024-08-18T22:41:46.467 INFO:tasks.workunit.client.1.smithi195.stdout:8/574: symlink d1/d64/ld5 0 2024-08-18T22:41:46.467 INFO:tasks.workunit.client.1.smithi195.stdout:5/491: creat d0/d46/d6d/f97 x:0 0 0 2024-08-18T22:41:46.468 INFO:tasks.workunit.client.0.smithi121.stdout:1/886: dread d5/d10/d14/d2a/d3a/d87/fdd [4194304,4194304] 0 2024-08-18T22:41:46.468 INFO:tasks.workunit.client.0.smithi121.stdout:0/756: mknod d1/d4/db/d24/d30/d6c/dde/c109 0 2024-08-18T22:41:46.469 INFO:tasks.workunit.client.1.smithi195.stdout:6/445: dread da/d15/d1c/f28 [0,4194304] 0 2024-08-18T22:41:46.470 INFO:tasks.workunit.client.0.smithi121.stdout:4/879: write d2/dc/d16/d22/d29/fd9 [90293,128664] 0 2024-08-18T22:41:46.471 INFO:tasks.workunit.client.1.smithi195.stdout:7/540: rename dc/f10 to dc/d8f/d96/fc6 0 2024-08-18T22:41:46.473 INFO:tasks.workunit.client.0.smithi121.stdout:1/887: chown d5/d10/ccd 1 1 2024-08-18T22:41:46.474 INFO:tasks.workunit.client.1.smithi195.stdout:0/608: dread d0/dc/f33 [0,4194304] 0 2024-08-18T22:41:46.474 INFO:tasks.workunit.client.1.smithi195.stdout:3/595: write d7/da/f48 [7968305,9756] 0 2024-08-18T22:41:46.475 INFO:tasks.workunit.client.0.smithi121.stdout:3/914: dwrite d1e/d1f/d25/d6b/db4/f12f [4194304,4194304] 0 2024-08-18T22:41:46.475 INFO:tasks.workunit.client.1.smithi195.stdout:4/473: mknod d0/d7/ca6 0 2024-08-18T22:41:46.476 INFO:tasks.workunit.client.1.smithi195.stdout:0/609: write d0/dc/d11/daa/fc6 [2820719,27108] 0 2024-08-18T22:41:46.478 INFO:tasks.workunit.client.1.smithi195.stdout:5/492: unlink d0/d3/d8/f13 0 2024-08-18T22:41:46.478 INFO:tasks.workunit.client.0.smithi121.stdout:4/880: symlink d2/dc/d16/d22/d2c/d7a/dbf/l146 0 2024-08-18T22:41:46.482 INFO:tasks.workunit.client.0.smithi121.stdout:5/742: rmdir d3/d5/d13/d19/d24/d4d/dad/d8b/dcf 0 2024-08-18T22:41:46.484 INFO:tasks.workunit.client.0.smithi121.stdout:4/881: fsync d2/dc/d16/d22/d29/fd9 0 2024-08-18T22:41:46.485 INFO:tasks.workunit.client.0.smithi121.stdout:8/996: dwrite d6/d115/f117 [0,4194304] 0 2024-08-18T22:41:46.485 INFO:tasks.workunit.client.1.smithi195.stdout:0/610: dwrite d0/dc/d11/d23/d51/f52 [0,4194304] 0 2024-08-18T22:41:46.486 INFO:tasks.workunit.client.0.smithi121.stdout:1/888: creat d5/d10/d14/d2a/d108/f135 x:0 0 0 2024-08-18T22:41:46.488 INFO:tasks.workunit.client.1.smithi195.stdout:7/541: read dc/d14/f68 [294221,74434] 0 2024-08-18T22:41:46.490 INFO:tasks.workunit.client.0.smithi121.stdout:1/889: readlink d5/d10/d14/d2a/d3a/d87/d6c/d6f/d82/d15/d28/d3d/l99 0 2024-08-18T22:41:46.490 INFO:tasks.workunit.client.0.smithi121.stdout:8/997: symlink d6/dd/d3b/da3/dca/d18/l14b 0 2024-08-18T22:41:46.491 INFO:tasks.workunit.client.1.smithi195.stdout:3/596: mknod d7/d54/cbc 0 2024-08-18T22:41:46.498 INFO:tasks.workunit.client.0.smithi121.stdout:4/882: dwrite d2/dc/d16/d22/d2c/d44/da7/f105 [0,4194304] 0 2024-08-18T22:41:46.499 INFO:tasks.workunit.client.0.smithi121.stdout:5/743: dwrite d3/fd [0,4194304] 0 2024-08-18T22:41:46.506 INFO:tasks.workunit.client.0.smithi121.stdout:0/757: dwrite d1/d4/da/f28 [0,4194304] 0 2024-08-18T22:41:46.508 INFO:tasks.workunit.client.0.smithi121.stdout:1/890: rmdir d5/d10/d14/d2a/d108 39 2024-08-18T22:41:46.510 INFO:tasks.workunit.client.0.smithi121.stdout:5/744: write d3/d5/d3c/d3f/d8f/f80 [3072006,27327] 0 2024-08-18T22:41:46.513 INFO:tasks.workunit.client.0.smithi121.stdout:1/891: dread - d5/d10/d67/dc2/df3/d114/f12e zero size 2024-08-18T22:41:46.516 INFO:tasks.workunit.client.0.smithi121.stdout:5/745: stat d3/d5/d13/d23/d66/f79 0 2024-08-18T22:41:46.517 INFO:tasks.workunit.client.0.smithi121.stdout:0/758: readlink d1/d4/db/d18/d1c/l27 0 2024-08-18T22:41:46.518 INFO:tasks.workunit.client.0.smithi121.stdout:4/883: dwrite d2/dc/d16/d22/d2c/d44/f78 [0,4194304] 0 2024-08-18T22:41:46.519 INFO:tasks.workunit.client.0.smithi121.stdout:3/915: dwrite d1e/d1f/d3e/f73 [0,4194304] 0 2024-08-18T22:41:46.523 INFO:tasks.workunit.client.0.smithi121.stdout:1/892: write d5/d10/d14/d2a/d3a/d87/d6c/d6f/d82/d15/d133/f102 [1002408,61333] 0 2024-08-18T22:41:46.524 INFO:tasks.workunit.client.0.smithi121.stdout:4/884: truncate d2/dc/d16/d22/d2c/d7a/f139 334746 0 2024-08-18T22:41:46.526 INFO:tasks.workunit.client.0.smithi121.stdout:1/893: write d5/f7 [2668026,117120] 0 2024-08-18T22:41:46.530 INFO:tasks.workunit.client.0.smithi121.stdout:3/916: rename d1e/d1f/d25/d58/d75/d8c to d1e/d1f/d25/d67/d92/d111/d13e/d104/d9a/dda/d146 0 2024-08-18T22:41:46.531 INFO:tasks.workunit.client.0.smithi121.stdout:1/894: write d5/d10/d14/d2a/d3a/d87/d6c/f121 [881679,33018] 0 2024-08-18T22:41:46.531 INFO:tasks.workunit.client.0.smithi121.stdout:7/879: dread de/d98/dfb/dce/d34/d38/d73/da2/d100/d18/d2e/f32 [0,4194304] 0 2024-08-18T22:41:46.531 INFO:tasks.workunit.client.0.smithi121.stdout:5/746: truncate d3/d5/d13/d23/da4/dc7/dae/fc1 1160250 0 2024-08-18T22:41:46.532 INFO:tasks.workunit.client.0.smithi121.stdout:3/917: chown d1e/d1f/d2a/fe7 40098 1 2024-08-18T22:41:46.534 INFO:tasks.workunit.client.0.smithi121.stdout:4/885: creat d2/dc/d16/d59/d83/dd7/d104/f147 x:0 0 0 2024-08-18T22:41:46.536 INFO:tasks.workunit.client.0.smithi121.stdout:1/895: chown d5/d10/d14/d2a/d3a/d87/d6c/d6f/d82/d15/d28/d3d/fd8 333 1 2024-08-18T22:41:46.537 INFO:tasks.workunit.client.0.smithi121.stdout:5/747: write d3/d5/d27/f54 [256607,30829] 0 2024-08-18T22:41:46.538 INFO:tasks.workunit.client.0.smithi121.stdout:7/880: symlink de/d98/dfb/dce/d34/d38/d5f/d9c/l11b 0 2024-08-18T22:41:46.539 INFO:tasks.workunit.client.0.smithi121.stdout:4/886: rmdir d2/dc/d126 0 2024-08-18T22:41:46.541 INFO:tasks.workunit.client.0.smithi121.stdout:5/748: mknod d3/d5/d3c/daf/cea 0 2024-08-18T22:41:46.543 INFO:tasks.workunit.client.0.smithi121.stdout:1/896: unlink d5/d10/d14/d2a/d3a/d87/d6c/d6f/d82/d15/d133/fa2 0 2024-08-18T22:41:46.545 INFO:tasks.workunit.client.0.smithi121.stdout:0/759: truncate d1/d4/db/d24/df/d8/d78/d7c/df5/daf/fcc 374384 0 2024-08-18T22:41:46.546 INFO:tasks.workunit.client.0.smithi121.stdout:5/749: dread d3/d5/f62 [0,4194304] 0 2024-08-18T22:41:46.548 INFO:tasks.workunit.client.0.smithi121.stdout:7/881: rename de/d98/dfb/dce/d34/d6c/fde to de/d98/dfb/dce/d34/d38/d73/da2/f11c 0 2024-08-18T22:41:46.549 INFO:tasks.workunit.client.0.smithi121.stdout:0/760: write d1/d4/db/d18/d1c/d5f/fa2 [2783600,13945] 0 2024-08-18T22:41:46.549 INFO:tasks.workunit.client.0.smithi121.stdout:1/897: read d5/d10/d14/d2a/d3a/d87/d6c/d6f/d82/d15/d28/d3d/d9a/fdc [2272306,114510] 0 2024-08-18T22:41:46.551 INFO:tasks.workunit.client.0.smithi121.stdout:7/882: chown de/d98/dfb/ld9 0 1 2024-08-18T22:41:46.551 INFO:tasks.workunit.client.0.smithi121.stdout:3/918: dread f11 [0,4194304] 0 2024-08-18T22:41:46.552 INFO:tasks.workunit.client.0.smithi121.stdout:4/887: creat d2/dc/d16/d22/f148 x:0 0 0 2024-08-18T22:41:46.555 INFO:tasks.workunit.client.0.smithi121.stdout:7/883: chown de/d98/dfb/dce/d2f/d4b/d6d/dca/df4/ff5 18437 1 2024-08-18T22:41:46.555 INFO:tasks.workunit.client.0.smithi121.stdout:4/888: dread - d2/dc/d16/d59/d83/dd7/d104/f136 zero size 2024-08-18T22:41:46.560 INFO:tasks.workunit.client.0.smithi121.stdout:5/750: rename d3/d5/d13/d19/d24/d32/da2 to d3/d5/d27/d35/d53/deb 0 2024-08-18T22:41:46.561 INFO:tasks.workunit.client.0.smithi121.stdout:3/919: mknod d1e/d1f/d25/d6b/db4/d94/de6/c147 0 2024-08-18T22:41:46.562 INFO:tasks.workunit.client.0.smithi121.stdout:4/889: chown d2/dc/f13 1260820 1 2024-08-18T22:41:46.563 INFO:tasks.workunit.client.0.smithi121.stdout:1/898: symlink d5/d10/d14/d2a/d3a/d87/d6c/d6f/d82/ddb/l136 0 2024-08-18T22:41:46.564 INFO:tasks.workunit.client.0.smithi121.stdout:0/761: symlink d1/d4/db/d24/df/d8/d78/d7c/df5/d9d/l10a 0 2024-08-18T22:41:46.564 INFO:tasks.workunit.client.0.smithi121.stdout:1/899: chown d5/d10/d14/d2a/d3a/d87/d6c/d6f/d82 953122476 1 2024-08-18T22:41:46.565 INFO:tasks.workunit.client.0.smithi121.stdout:7/884: mkdir de/d98/dfb/dce/d34/d38/d73/dbb/d11d 0 2024-08-18T22:41:46.566 INFO:tasks.workunit.client.0.smithi121.stdout:5/751: rmdir d3/d5c 39 2024-08-18T22:41:46.566 INFO:tasks.workunit.client.0.smithi121.stdout:3/920: fsync f11 0 2024-08-18T22:41:46.568 INFO:tasks.workunit.client.0.smithi121.stdout:4/890: creat d2/dc/d16/d22/d29/f149 x:0 0 0 2024-08-18T22:41:46.568 INFO:tasks.workunit.client.0.smithi121.stdout:1/900: mkdir d5/d10/d14/d92/d137 0 2024-08-18T22:41:46.569 INFO:tasks.workunit.client.0.smithi121.stdout:7/885: write de/d2d/f5d [2673892,130892] 0 2024-08-18T22:41:46.571 INFO:tasks.workunit.client.0.smithi121.stdout:3/921: dread d1e/d1f/d3e/f122 [0,4194304] 0 2024-08-18T22:41:46.572 INFO:tasks.workunit.client.0.smithi121.stdout:1/901: readlink d5/d10/d14/d2a/d3a/d87/d6c/d6f/d82/d15/d28/d3d/dbd/lde 0 2024-08-18T22:41:46.573 INFO:tasks.workunit.client.0.smithi121.stdout:0/762: mknod d1/d4/db/d24/df/d8/d78/d7c/df5/daf/dd5/d90/dc3/c10b 0 2024-08-18T22:41:46.574 INFO:tasks.workunit.client.0.smithi121.stdout:5/752: fsync d3/d5/d3c/daf/fb6 0 2024-08-18T22:41:46.575 INFO:tasks.workunit.client.0.smithi121.stdout:7/886: mkdir de/d98/dfb/dce/d11e 0 2024-08-18T22:41:46.575 INFO:tasks.workunit.client.0.smithi121.stdout:3/922: truncate d1e/d1f/dba/df6/f140 1043752 0 2024-08-18T22:41:46.577 INFO:tasks.workunit.client.0.smithi121.stdout:4/891: link d2/dc/d16/d22/d2c/d7a/da0/dcc/d122/c13e d2/dc/d16/d59/c14a 0 2024-08-18T22:41:46.578 INFO:tasks.workunit.client.0.smithi121.stdout:0/763: truncate d1/d4/db/d24/f42 364181 0 2024-08-18T22:41:46.578 INFO:tasks.workunit.client.0.smithi121.stdout:3/923: chown d1e/d1f/dba/df6/c144 610 1 2024-08-18T22:41:46.579 INFO:tasks.workunit.client.0.smithi121.stdout:5/753: dread d3/d5/d3c/fbf [0,4194304] 0 2024-08-18T22:41:46.579 INFO:tasks.workunit.client.0.smithi121.stdout:7/887: dread - de/d98/dfb/dce/d2f/d4b/d6d/dca/df4/ff5 zero size 2024-08-18T22:41:46.580 INFO:tasks.workunit.client.0.smithi121.stdout:7/888: readlink de/l10 0 2024-08-18T22:41:46.583 INFO:tasks.workunit.client.0.smithi121.stdout:0/764: write d1/d4/db/d24/df/d8/d71/d79/fab [859553,106823] 0 2024-08-18T22:41:46.584 INFO:tasks.workunit.client.0.smithi121.stdout:7/889: chown de/d98/dfb/dce/d34/d38/d5f/l88 32166817 1 2024-08-18T22:41:46.585 INFO:tasks.workunit.client.0.smithi121.stdout:5/754: dread - d3/d5/d13/d19/d24/d32/f98 zero size 2024-08-18T22:41:46.587 INFO:tasks.workunit.client.0.smithi121.stdout:0/765: chown d1/d4/da/d2f/da0/l93 3718368 1 2024-08-18T22:41:46.587 INFO:tasks.workunit.client.0.smithi121.stdout:5/755: write d3/d5/f9d [1159572,112980] 0 2024-08-18T22:41:46.590 INFO:tasks.workunit.client.0.smithi121.stdout:7/890: unlink de/d98/dfb/ld9 0 2024-08-18T22:41:46.591 INFO:tasks.workunit.client.0.smithi121.stdout:1/902: dread d5/d10/d14/d2a/d3a/d87/d6c/d6f/d82/d15/d38/f72 [0,4194304] 0 2024-08-18T22:41:46.592 INFO:tasks.workunit.client.0.smithi121.stdout:1/903: fsync d5/d10/d14/d2a/d3a/d87/d6c/f121 0 2024-08-18T22:41:46.592 INFO:tasks.workunit.client.0.smithi121.stdout:4/892: link d2/dc/d16/d22/c95 d2/dc/d16/d22/d2c/d7a/dbf/c14b 0 2024-08-18T22:41:46.593 INFO:tasks.workunit.client.0.smithi121.stdout:1/904: stat d5/d10/d14/d2a/d3a/d87/d6c/d6f/d79/dab/fa5 0 2024-08-18T22:41:46.594 INFO:tasks.workunit.client.0.smithi121.stdout:4/893: fsync d2/dc/d16/d59/d83/f98 0 2024-08-18T22:41:46.596 INFO:tasks.workunit.client.0.smithi121.stdout:5/756: rename d3/d5/d27/d35/d53/ccb to d3/d5/d13/d23/d66/de5/cec 0 2024-08-18T22:41:46.597 INFO:tasks.workunit.client.0.smithi121.stdout:5/757: write d3/d5/d13/d23/d66/f88 [3104291,78183] 0 2024-08-18T22:41:46.598 INFO:tasks.workunit.client.0.smithi121.stdout:5/758: read d3/d5/d3c/fbf [46402,17185] 0 2024-08-18T22:41:46.602 INFO:tasks.workunit.client.0.smithi121.stdout:5/759: chown d3/d5/d13/d23/da4/da6/lca 104446 1 2024-08-18T22:41:46.602 INFO:tasks.workunit.client.0.smithi121.stdout:1/905: mkdir d5/d10/d67/d138 0 2024-08-18T22:41:46.605 INFO:tasks.workunit.client.0.smithi121.stdout:5/760: dwrite d3/d5/d3c/d3f/d8f/fa5 [0,4194304] 0 2024-08-18T22:41:46.607 INFO:tasks.workunit.client.1.smithi195.stdout:8/575: rename d1/d3/db/d39/f9c to d1/d3/db/d35/d56/fd6 0 2024-08-18T22:41:46.607 INFO:tasks.workunit.client.1.smithi195.stdout:0/611: rmdir d0/dc/d64/d81/d44 39 2024-08-18T22:41:46.608 INFO:tasks.workunit.client.0.smithi121.stdout:1/906: mknod d5/d10/d14/d2a/d3a/d87/d6c/d6f/d82/d15/d133/de4/c139 0 2024-08-18T22:41:46.608 INFO:tasks.workunit.client.0.smithi121.stdout:7/891: link de/d98/dfb/dce/d34/ce0 de/d98/dfb/dce/d2f/d4b/d6d/dca/df4/c11f 0 2024-08-18T22:41:46.608 INFO:tasks.workunit.client.0.smithi121.stdout:3/924: truncate d1e/d1f/fc3 1349026 0 2024-08-18T22:41:46.609 INFO:tasks.workunit.client.1.smithi195.stdout:8/576: dread - d1/d3/db/d39/d2e/d78/fb5 zero size 2024-08-18T22:41:46.609 INFO:tasks.workunit.client.0.smithi121.stdout:4/894: creat d2/dc/d16/d22/d2c/d44/f14c x:0 0 0 2024-08-18T22:41:46.611 INFO:tasks.workunit.client.0.smithi121.stdout:4/895: chown d2/dc/d16/d22/d2c/d7a/dbf/c11f 50 1 2024-08-18T22:41:46.611 INFO:tasks.workunit.client.0.smithi121.stdout:3/925: mknod d1e/d1f/d3e/c148 0 2024-08-18T22:41:46.612 INFO:tasks.workunit.client.1.smithi195.stdout:5/493: symlink d0/d3/d8/d64/d87/l98 0 2024-08-18T22:41:46.613 INFO:tasks.workunit.client.1.smithi195.stdout:6/446: creat da/db/f82 x:0 0 0 2024-08-18T22:41:46.614 INFO:tasks.workunit.client.1.smithi195.stdout:6/447: stat da/db/d26/d2d/l2f 0 2024-08-18T22:41:46.615 INFO:tasks.workunit.client.0.smithi121.stdout:7/892: creat de/d98/dfb/dce/d34/d38/dd6/f120 x:0 0 0 2024-08-18T22:41:46.617 INFO:tasks.workunit.client.1.smithi195.stdout:6/448: write da/d3b/f7a [436582,47914] 0 2024-08-18T22:41:46.619 INFO:tasks.workunit.client.0.smithi121.stdout:0/766: dwrite d1/d4/db/d18/d1c/f59 [0,4194304] 0 2024-08-18T22:41:46.621 INFO:tasks.workunit.client.1.smithi195.stdout:5/494: dwrite d0/d3/df/f58 [0,4194304] 0 2024-08-18T22:41:46.628 INFO:tasks.workunit.client.1.smithi195.stdout:7/542: link dc/d14/d15/d17/d18/l8e dc/d1d/d29/lc7 0 2024-08-18T22:41:46.630 INFO:tasks.workunit.client.0.smithi121.stdout:7/893: getdents de/d98/dfb/dce/d34/d38/d73/da2/d100/d18/d23/d24/d29/d43/d8b 0 2024-08-18T22:41:46.631 INFO:tasks.workunit.client.0.smithi121.stdout:5/761: truncate d3/d5/d13/d23/d66/f88 3495358 0 2024-08-18T22:41:46.631 INFO:tasks.workunit.client.1.smithi195.stdout:3/597: write d7/da/fb [570728,76544] 0 2024-08-18T22:41:46.633 INFO:tasks.workunit.client.0.smithi121.stdout:4/896: write d2/dc/d8d/da4/fef [18109,22432] 0 2024-08-18T22:41:46.633 INFO:tasks.workunit.client.1.smithi195.stdout:0/612: rename d0/dc/d64/d81/f35 to d0/dc/d64/d81/d44/d41/fca 0 2024-08-18T22:41:46.633 INFO:tasks.workunit.client.1.smithi195.stdout:4/474: dwrite d0/d99/d98/d16/d49/f45 [0,4194304] 0 2024-08-18T22:41:46.634 INFO:tasks.workunit.client.0.smithi121.stdout:3/926: write d1e/d1f/da6/dc7/f102 [1594304,17436] 0 2024-08-18T22:41:46.634 INFO:tasks.workunit.client.0.smithi121.stdout:0/767: dwrite d1/d4/db/d18/d40/ff4 [0,4194304] 0 2024-08-18T22:41:46.634 INFO:tasks.workunit.client.0.smithi121.stdout:5/762: write d3/d5/d13/d19/da3/fd6 [2723838,81778] 0 2024-08-18T22:41:46.635 INFO:tasks.workunit.client.1.smithi195.stdout:4/475: chown d0 177583749 1 2024-08-18T22:41:46.636 INFO:tasks.workunit.client.1.smithi195.stdout:8/577: getdents d1/de/d27/d4f 0 2024-08-18T22:41:46.637 INFO:tasks.workunit.client.1.smithi195.stdout:7/543: unlink dc/d2a/f7c 0 2024-08-18T22:41:46.638 INFO:tasks.workunit.client.0.smithi121.stdout:3/927: write d1e/d1f/d3e/f10e [667633,62756] 0 2024-08-18T22:41:46.638 INFO:tasks.workunit.client.0.smithi121.stdout:4/897: write d2/dc/d1c/ffd [926866,87075] 0 2024-08-18T22:41:46.639 INFO:tasks.workunit.client.1.smithi195.stdout:5/495: dwrite d0/f4b [0,4194304] 0 2024-08-18T22:41:46.639 INFO:tasks.workunit.client.1.smithi195.stdout:8/578: chown d1/d64/ld5 43614004 1 2024-08-18T22:41:46.640 INFO:tasks.workunit.client.1.smithi195.stdout:3/598: chown d7/da/df/d1c/d6a/la7 61 1 2024-08-18T22:41:46.641 INFO:tasks.workunit.client.1.smithi195.stdout:4/476: fdatasync d0/d99/d85/f3f 0 2024-08-18T22:41:46.642 INFO:tasks.workunit.client.1.smithi195.stdout:0/613: truncate d0/dc/dd/d46/f7e 245434 0 2024-08-18T22:41:46.646 INFO:tasks.workunit.client.1.smithi195.stdout:5/496: creat d0/d2/d29/d88/d90/f99 x:0 0 0 2024-08-18T22:41:46.647 INFO:tasks.workunit.client.0.smithi121.stdout:1/907: dread d5/d10/d14/d2a/d3a/d87/d6c/d6f/d82/d15/d28/d3d/d9a/fdc [0,4194304] 0 2024-08-18T22:41:46.648 INFO:tasks.workunit.client.1.smithi195.stdout:6/449: dread da/db/d19/f27 [0,4194304] 0 2024-08-18T22:41:46.649 INFO:tasks.workunit.client.0.smithi121.stdout:7/894: write de/d98/dfb/dce/d34/d38/d73/da2/d100/d18/d2e/dd7/dfd/f6b [12956518,22151] 0 2024-08-18T22:41:46.651 INFO:tasks.workunit.client.0.smithi121.stdout:1/908: creat d5/d10/d14/d2a/d3a/d87/df1/f13a x:0 0 0 2024-08-18T22:41:46.653 INFO:tasks.workunit.client.0.smithi121.stdout:5/763: rename d3/d5/d13/d19/fc6 to d3/d5/d13/d19/d24/d32/fed 0 2024-08-18T22:41:46.654 INFO:tasks.workunit.client.1.smithi195.stdout:7/544: link dc/d22/f3e dc/d1d/d29/fc8 0 2024-08-18T22:41:46.656 INFO:tasks.workunit.client.1.smithi195.stdout:5/497: creat d0/d2/d29/d88/d90/f9a x:0 0 0 2024-08-18T22:41:46.656 INFO:tasks.workunit.client.1.smithi195.stdout:0/614: creat d0/dc/d11/d23/fcb x:0 0 0 2024-08-18T22:41:46.657 INFO:tasks.workunit.client.1.smithi195.stdout:8/579: dwrite d1/d3/db/d39/f70 [4194304,4194304] 0 2024-08-18T22:41:46.659 INFO:tasks.workunit.client.0.smithi121.stdout:3/928: dwrite d1e/d1f/dba/df6/f140 [0,4194304] 0 2024-08-18T22:41:46.659 INFO:tasks.workunit.client.1.smithi195.stdout:4/477: dwrite d0/d99/d85/d48/f83 [0,4194304] 0 2024-08-18T22:41:46.661 INFO:tasks.workunit.client.0.smithi121.stdout:3/929: chown d1e/d1f/d25/d67/d92/dbd/d126 189746514 1 2024-08-18T22:41:46.664 INFO:tasks.workunit.client.0.smithi121.stdout:5/764: dwrite d3/d5/d3c/daf/fb6 [0,4194304] 0 2024-08-18T22:41:46.665 INFO:tasks.workunit.client.1.smithi195.stdout:7/545: truncate dc/d14/d15/d17/d58/db6/fc4 399526 0 2024-08-18T22:41:46.665 INFO:tasks.workunit.client.1.smithi195.stdout:0/615: chown d0/dc/d64/d81/d44/d41/d6d/d92/lae 123202401 1 2024-08-18T22:41:46.666 INFO:tasks.workunit.client.0.smithi121.stdout:3/930: write d1e/d1f/d25/d67/d92/d111/f121 [307336,15581] 0 2024-08-18T22:41:46.667 INFO:tasks.workunit.client.1.smithi195.stdout:6/450: dwrite da/db/d19/d67/f75 [0,4194304] 0 2024-08-18T22:41:46.667 INFO:tasks.workunit.client.1.smithi195.stdout:7/546: fsync dc/f72 0 2024-08-18T22:41:46.669 INFO:tasks.workunit.client.1.smithi195.stdout:4/478: creat d0/d9/fa7 x:0 0 0 2024-08-18T22:41:46.669 INFO:tasks.workunit.client.0.smithi121.stdout:3/931: read - d1e/d1f/d25/d6b/d66/f120 zero size 2024-08-18T22:41:46.670 INFO:tasks.workunit.client.1.smithi195.stdout:5/498: dwrite d0/d37/f68 [0,4194304] 0 2024-08-18T22:41:46.672 INFO:tasks.workunit.client.1.smithi195.stdout:0/616: chown d0/dc/d64/fa3 4645 1 2024-08-18T22:41:46.677 INFO:tasks.workunit.client.0.smithi121.stdout:0/768: write d1/d4/db/d24/df/d8/d78/d7c/dba/fe4 [3015128,105910] 0 2024-08-18T22:41:46.677 INFO:tasks.workunit.client.0.smithi121.stdout:4/898: write d2/f9 [1815968,83751] 0 2024-08-18T22:41:46.679 INFO:tasks.workunit.client.0.smithi121.stdout:7/895: dread de/d98/dfb/dce/d34/d38/d73/da2/d100/f49 [0,4194304] 0 2024-08-18T22:41:46.680 INFO:tasks.workunit.client.0.smithi121.stdout:1/909: write d5/d10/d14/d2a/d3a/d87/d6c/d6f/d82/d15/d28/d3d/f55 [1445136,72403] 0 2024-08-18T22:41:46.681 INFO:tasks.workunit.client.0.smithi121.stdout:0/769: rename d1/d4/db to d1/d4/db/d24/df/d8/d78/d7c/df5/daf/dcb/d10c 22 2024-08-18T22:41:46.681 INFO:tasks.workunit.client.0.smithi121.stdout:4/899: chown d2/dc/d16/d22/d2c/d7a/da0/dcc/f114 10 1 2024-08-18T22:41:46.681 INFO:tasks.workunit.client.1.smithi195.stdout:0/617: write d0/dc/d64/d81/d44/d41/d6d/d92/f91 [916210,28981] 0 2024-08-18T22:41:46.684 INFO:tasks.workunit.client.1.smithi195.stdout:5/499: dwrite d0/f95 [0,4194304] 0 2024-08-18T22:41:46.684 INFO:tasks.workunit.client.0.smithi121.stdout:1/910: write d5/d10/d14/d2a/d3a/d87/d6c/d6f/fff [912340,87969] 0 2024-08-18T22:41:46.685 INFO:tasks.workunit.client.1.smithi195.stdout:8/580: rename d1/d3/db/d39/f70 to d1/d3/db/d39/fd7 0 2024-08-18T22:41:46.687 INFO:tasks.workunit.client.0.smithi121.stdout:0/770: dread - d1/d4/db/d24/df/d8/d78/d7c/df5/daf/dd5/d90/dd8/f103 zero size 2024-08-18T22:41:46.687 INFO:tasks.workunit.client.0.smithi121.stdout:4/900: unlink d2/dc/d16/d47/dea/c124 0 2024-08-18T22:41:46.688 INFO:tasks.workunit.client.0.smithi121.stdout:1/911: unlink d5/d10/f18 0 2024-08-18T22:41:46.688 INFO:tasks.workunit.client.0.smithi121.stdout:4/901: read - d2/dc/d1c/dc1/ddb/df1/d10a/f13b zero size 2024-08-18T22:41:46.689 INFO:tasks.workunit.client.1.smithi195.stdout:5/500: dread - d0/d2/d29/d88/d90/f91 zero size 2024-08-18T22:41:46.690 INFO:tasks.workunit.client.0.smithi121.stdout:0/771: creat d1/d4/f10d x:0 0 0 2024-08-18T22:41:46.691 INFO:tasks.workunit.client.1.smithi195.stdout:6/451: rename da/d15/c65 to da/d15/d1c/c83 0 2024-08-18T22:41:46.691 INFO:tasks.workunit.client.0.smithi121.stdout:1/912: fdatasync d5/d10/d14/d2a/d3a/d87/d6c/d6f/d82/d15/f9e 0 2024-08-18T22:41:46.692 INFO:tasks.workunit.client.0.smithi121.stdout:4/902: readlink d2/dc/d16/d59/d83/dd7/d90/db3/l13f 0 2024-08-18T22:41:46.693 INFO:tasks.workunit.client.1.smithi195.stdout:0/618: truncate d0/dc/dd/d46/f7e 272288 0 2024-08-18T22:41:46.694 INFO:tasks.workunit.client.0.smithi121.stdout:7/896: read de/d2d/d50/db7/fe8 [676204,71789] 0 2024-08-18T22:41:46.694 INFO:tasks.workunit.client.0.smithi121.stdout:4/903: fsync d2/dc/d16/d22/d2c/d44/da7/f137 0 2024-08-18T22:41:46.695 INFO:tasks.workunit.client.0.smithi121.stdout:0/772: rmdir d1/d4/db/d24/df/d8/d78/d7c/df5/daf/dd5/d90/dc3 39 2024-08-18T22:41:46.695 INFO:tasks.workunit.client.0.smithi121.stdout:1/913: truncate d5/d10/d14/d2a/d3a/d87/d6c/d6f/d79/fb9 1312857 0 2024-08-18T22:41:46.697 INFO:tasks.workunit.client.1.smithi195.stdout:6/452: mknod da/db/d26/d2d/c84 0 2024-08-18T22:41:46.698 INFO:tasks.workunit.client.0.smithi121.stdout:1/914: symlink d5/d10/d14/dfc/l13b 0 2024-08-18T22:41:46.699 INFO:tasks.workunit.client.0.smithi121.stdout:9/889: sync 2024-08-18T22:41:46.699 INFO:tasks.workunit.client.0.smithi121.stdout:2/557: sync 2024-08-18T22:41:46.700 INFO:tasks.workunit.client.0.smithi121.stdout:8/998: sync 2024-08-18T22:41:46.700 INFO:tasks.workunit.client.1.smithi195.stdout:7/547: unlink dc/d14/d15/d17/f2f 0 2024-08-18T22:41:46.700 INFO:tasks.workunit.client.1.smithi195.stdout:8/581: symlink d1/d3/db/d35/dd1/ld8 0 2024-08-18T22:41:46.700 INFO:tasks.workunit.client.1.smithi195.stdout:0/619: truncate d0/dc/d25/d67/fc4 1589442 0 2024-08-18T22:41:46.702 INFO:tasks.workunit.client.1.smithi195.stdout:6/453: fdatasync f6 0 2024-08-18T22:41:46.702 INFO:tasks.workunit.client.0.smithi121.stdout:1/915: chown d5/d10/d14/d2a/d3a/d87/d6c/d6f/d82 93560612 1 2024-08-18T22:41:46.705 INFO:tasks.workunit.client.0.smithi121.stdout:0/773: dread d1/d4/da/f28 [0,4194304] 0 2024-08-18T22:41:46.705 INFO:tasks.workunit.client.0.smithi121.stdout:2/558: creat d2/d3/fb8 x:0 0 0 2024-08-18T22:41:46.705 INFO:tasks.workunit.client.1.smithi195.stdout:7/548: creat dc/d22/fc9 x:0 0 0 2024-08-18T22:41:46.705 INFO:tasks.workunit.client.1.smithi195.stdout:5/501: dwrite d0/d46/d6d/f8e [0,4194304] 0 2024-08-18T22:41:46.708 INFO:tasks.workunit.client.0.smithi121.stdout:8/999: write d6/dd/d3b/da3/dca/fec [1030969,87421] 0 2024-08-18T22:41:46.709 INFO:tasks.workunit.client.1.smithi195.stdout:7/549: dread f2 [0,4194304] 0 2024-08-18T22:41:46.710 INFO:tasks.workunit.client.1.smithi195.stdout:7/550: readlink dc/d2a/l36 0 2024-08-18T22:41:46.710 INFO:tasks.workunit.client.0.smithi121.stdout:4/904: dwrite d2/dc/d16/d22/d29/fd9 [0,4194304] 0 2024-08-18T22:41:46.710 INFO:tasks.workunit.client.1.smithi195.stdout:7/551: fsync dc/d1d/d29/f34 0 2024-08-18T22:41:46.712 INFO:tasks.workunit.client.1.smithi195.stdout:8/582: rename d1/de/d31/d88 to d1/d3/db/d39/d44/d79/dd9 0 2024-08-18T22:41:46.713 INFO:tasks.workunit.client.0.smithi121.stdout:1/916: truncate d5/d10/d14/d2a/d3a/d87/df1/f10f 955931 0 2024-08-18T22:41:46.714 INFO:tasks.workunit.client.0.smithi121.stdout:2/559: unlink d2/d8/d1f/lb7 0 2024-08-18T22:41:46.714 INFO:tasks.workunit.client.1.smithi195.stdout:8/583: symlink d1/d3/db/d35/dd1/lda 0 2024-08-18T22:41:46.715 INFO:tasks.workunit.client.1.smithi195.stdout:7/552: dread dc/d2a/d56/f84 [0,4194304] 0 2024-08-18T22:41:46.716 INFO:tasks.workunit.client.0.smithi121.stdout:9/890: dread d0/d38/d9e/df/d3d/fd3 [0,4194304] 0 2024-08-18T22:41:46.717 INFO:tasks.workunit.client.1.smithi195.stdout:5/502: link d0/d37/c3e d0/c9b 0 2024-08-18T22:41:46.717 INFO:tasks.workunit.client.1.smithi195.stdout:4/479: dread d0/d9/f44 [0,4194304] 0 2024-08-18T22:41:46.719 INFO:tasks.workunit.client.1.smithi195.stdout:7/553: truncate dc/d14/d15/d17/d58/db6/fc4 1156206 0 2024-08-18T22:41:46.720 INFO:tasks.workunit.client.1.smithi195.stdout:8/584: mkdir d1/ddb 0 2024-08-18T22:41:46.720 INFO:tasks.workunit.client.0.smithi121.stdout:7/897: write de/f87 [104909,30987] 0 2024-08-18T22:41:46.720 INFO:tasks.workunit.client.0.smithi121.stdout:0/774: creat d1/d4/db/d24/df/d8/dee/f10e x:0 0 0 2024-08-18T22:41:46.721 INFO:tasks.workunit.client.0.smithi121.stdout:1/917: mkdir d5/d10/d67/d138/d13c 0 2024-08-18T22:41:46.722 INFO:tasks.workunit.client.1.smithi195.stdout:8/585: dread - d1/d3/db/d35/d4d/d95/fa6 zero size 2024-08-18T22:41:46.722 INFO:tasks.workunit.client.0.smithi121.stdout:7/898: truncate de/d2d/fa3 4668936 0 2024-08-18T22:41:46.724 INFO:tasks.workunit.client.0.smithi121.stdout:1/918: write d5/d10/d14/d2a/d3a/d87/fdd [168865,45411] 0 2024-08-18T22:41:46.725 INFO:tasks.workunit.client.0.smithi121.stdout:0/775: creat d1/d4/db/d24/df/d8/d78/d7c/df5/daf/dd5/f10f x:0 0 0 2024-08-18T22:41:46.725 INFO:tasks.workunit.client.0.smithi121.stdout:7/899: write de/d98/dfb/dce/d34/d38/d73/da2/d100/d18/d23/feb [23569,121317] 0 2024-08-18T22:41:46.726 INFO:tasks.workunit.client.1.smithi195.stdout:8/586: dread d1/d3/db/d35/d56/f90 [0,4194304] 0 2024-08-18T22:41:46.726 INFO:tasks.workunit.client.1.smithi195.stdout:7/554: stat dc/d2a/c59 0 2024-08-18T22:41:46.727 INFO:tasks.workunit.client.1.smithi195.stdout:3/599: dread d7/da/df/f5f [0,4194304] 0 2024-08-18T22:41:46.727 INFO:tasks.workunit.client.0.smithi121.stdout:0/776: fdatasync d1/d4/db/d24/df/d8/d78/d7c/df5/daf/dd5/d90/f98 0 2024-08-18T22:41:46.729 INFO:tasks.workunit.client.0.smithi121.stdout:0/777: fdatasync d1/d4/fb8 0 2024-08-18T22:41:46.729 INFO:tasks.workunit.client.1.smithi195.stdout:5/503: creat d0/d46/f9c x:0 0 0 2024-08-18T22:41:46.729 INFO:tasks.workunit.client.1.smithi195.stdout:6/454: read da/d3b/f7a [373411,88236] 0 2024-08-18T22:41:46.731 INFO:tasks.workunit.client.0.smithi121.stdout:5/765: dread d3/d5/d3c/daf/fc3 [0,4194304] 0 2024-08-18T22:41:46.732 INFO:tasks.workunit.client.1.smithi195.stdout:5/504: write d0/d2/d29/d88/d6a/f80 [311147,62519] 0 2024-08-18T22:41:46.732 INFO:tasks.workunit.client.1.smithi195.stdout:3/600: mknod d7/da/df/d8e/daa/cbd 0 2024-08-18T22:41:46.734 INFO:tasks.workunit.client.1.smithi195.stdout:6/455: creat da/d15/d1c/d2e/f85 x:0 0 0 2024-08-18T22:41:46.735 INFO:tasks.workunit.client.1.smithi195.stdout:8/587: dwrite d1/de/fab [0,4194304] 0 2024-08-18T22:41:46.735 INFO:tasks.workunit.client.1.smithi195.stdout:5/505: readlink d0/d3/df/d5a/l5e 0 2024-08-18T22:41:46.735 INFO:tasks.workunit.client.1.smithi195.stdout:7/555: read fb [7301017,109931] 0 2024-08-18T22:41:46.736 INFO:tasks.workunit.client.1.smithi195.stdout:3/601: dread - d7/da/f70 zero size 2024-08-18T22:41:46.739 INFO:tasks.workunit.client.1.smithi195.stdout:7/556: readlink dc/d14/d2b/l66 0 2024-08-18T22:41:46.739 INFO:tasks.workunit.client.1.smithi195.stdout:8/588: chown d1/d3/d1c/c71 36420 1 2024-08-18T22:41:46.741 INFO:tasks.workunit.client.1.smithi195.stdout:7/557: dread - dc/d14/d2b/d81/d9c/f9e zero size 2024-08-18T22:41:46.742 INFO:tasks.workunit.client.1.smithi195.stdout:6/456: dread da/db/d2a/f57 [0,4194304] 0 2024-08-18T22:41:46.742 INFO:tasks.workunit.client.1.smithi195.stdout:5/506: read d0/d46/f6c [1428562,22892] 0 2024-08-18T22:41:46.744 INFO:tasks.workunit.client.1.smithi195.stdout:8/589: creat d1/d3/db/d35/d4d/d95/daf/fdc x:0 0 0 2024-08-18T22:41:46.746 INFO:tasks.workunit.client.1.smithi195.stdout:3/602: creat d7/da/df/d8e/fbe x:0 0 0 2024-08-18T22:41:46.746 INFO:tasks.workunit.client.1.smithi195.stdout:6/457: dread da/d3b/f7a [0,4194304] 0 2024-08-18T22:41:46.747 INFO:tasks.workunit.client.1.smithi195.stdout:7/558: mknod dc/d2a/d4c/cca 0 2024-08-18T22:41:46.747 INFO:tasks.workunit.client.1.smithi195.stdout:8/590: truncate d1/d3/db/d35/d4d/d95/fa6 920143 0 2024-08-18T22:41:46.749 INFO:tasks.workunit.client.1.smithi195.stdout:3/603: fsync d7/da/fa0 0 2024-08-18T22:41:46.751 INFO:tasks.workunit.client.1.smithi195.stdout:7/559: read dc/d14/d15/d17/d18/d89/f98 [624077,51042] 0 2024-08-18T22:41:46.751 INFO:tasks.workunit.client.1.smithi195.stdout:8/591: creat d1/de/dac/fdd x:0 0 0 2024-08-18T22:41:46.754 INFO:tasks.workunit.client.1.smithi195.stdout:4/480: dwrite d0/f25 [0,4194304] 0 2024-08-18T22:41:46.754 INFO:tasks.workunit.client.1.smithi195.stdout:7/560: creat dc/d8f/fcb x:0 0 0 2024-08-18T22:41:46.755 INFO:tasks.workunit.client.1.smithi195.stdout:6/458: getdents da/db/d26/d2d 0 2024-08-18T22:41:46.756 INFO:tasks.workunit.client.1.smithi195.stdout:8/592: mkdir d1/de/d27/d4f/dde 0 2024-08-18T22:41:46.758 INFO:tasks.workunit.client.1.smithi195.stdout:3/604: dread d7/fad [0,4194304] 0 2024-08-18T22:41:46.763 INFO:tasks.workunit.client.1.smithi195.stdout:7/561: link f2 dc/d2a/d4c/fcc 0 2024-08-18T22:41:46.764 INFO:tasks.workunit.client.1.smithi195.stdout:5/507: truncate d0/f95 1482391 0 2024-08-18T22:41:46.764 INFO:tasks.workunit.client.1.smithi195.stdout:6/459: dwrite da/d22/f5c [0,4194304] 0 2024-08-18T22:41:46.764 INFO:tasks.workunit.client.1.smithi195.stdout:8/593: mkdir d1/d3/db/d35/d4d/d5c/ddf 0 2024-08-18T22:41:46.769 INFO:tasks.workunit.client.1.smithi195.stdout:6/460: read da/d3b/d5f/f79 [4988,12800] 0 2024-08-18T22:41:46.769 INFO:tasks.workunit.client.1.smithi195.stdout:7/562: chown dc/d14/d15/d4d/d97/fa0 1594 1 2024-08-18T22:41:46.769 INFO:tasks.workunit.client.1.smithi195.stdout:8/594: write d1/de/d27/d4f/fd4 [377256,75173] 0 2024-08-18T22:41:46.772 INFO:tasks.workunit.client.1.smithi195.stdout:4/481: write d0/ff [3894482,36115] 0 2024-08-18T22:41:46.772 INFO:tasks.workunit.client.1.smithi195.stdout:6/461: write da/d15/d1c/f12 [704933,70671] 0 2024-08-18T22:41:46.773 INFO:tasks.workunit.client.1.smithi195.stdout:3/605: rename d7/d1f/d73/dae/db4/cb5 to d7/d1f/d74/cbf 0 2024-08-18T22:41:46.773 INFO:tasks.workunit.client.1.smithi195.stdout:6/462: fdatasync f5 0 2024-08-18T22:41:46.774 INFO:tasks.workunit.client.1.smithi195.stdout:5/508: truncate d0/d2/d79/f8a 590809 0 2024-08-18T22:41:46.775 INFO:tasks.workunit.client.1.smithi195.stdout:7/563: write dc/d14/d15/d17/d58/db6/fc4 [1646520,26279] 0 2024-08-18T22:41:46.776 INFO:tasks.workunit.client.1.smithi195.stdout:8/595: read d1/d3/d1c/f65 [222508,71245] 0 2024-08-18T22:41:46.778 INFO:tasks.workunit.client.1.smithi195.stdout:4/482: creat d0/d7/d1d/d69/d7d/fa8 x:0 0 0 2024-08-18T22:41:46.778 INFO:tasks.workunit.client.1.smithi195.stdout:7/564: chown dc/d2a/d4c/cca 4193130 1 2024-08-18T22:41:46.778 INFO:tasks.workunit.client.1.smithi195.stdout:3/606: write d7/da/df/d1c/d6a/d6c/fa5 [650467,116390] 0 2024-08-18T22:41:46.779 INFO:tasks.workunit.client.0.smithi121.stdout:5/766: symlink d3/d5/d3c/daf/lee 0 2024-08-18T22:41:46.780 INFO:tasks.workunit.client.1.smithi195.stdout:6/463: rename da/d3b/d5f to da/d22/d86 0 2024-08-18T22:41:46.780 INFO:tasks.workunit.client.1.smithi195.stdout:3/607: dread - d7/da/df/d38/f8d zero size 2024-08-18T22:41:46.781 INFO:tasks.workunit.client.0.smithi121.stdout:9/891: write d0/d38/d9e/df/d61/f85 [2027061,77994] 0 2024-08-18T22:41:46.781 INFO:tasks.workunit.client.0.smithi121.stdout:1/919: truncate d5/d10/d14/d92/d9f/fd0 2668075 0 2024-08-18T22:41:46.783 INFO:tasks.workunit.client.0.smithi121.stdout:4/905: dread d2/dc/d1c/f87 [0,4194304] 0 2024-08-18T22:41:46.783 INFO:tasks.workunit.client.0.smithi121.stdout:2/560: chown d2/d3/d84 7 1 2024-08-18T22:41:46.783 INFO:tasks.workunit.client.0.smithi121.stdout:3/932: dread d1e/d1f/d25/d6b/f59 [0,4194304] 0 2024-08-18T22:41:46.784 INFO:tasks.workunit.client.0.smithi121.stdout:9/892: dread - d0/d5/d11f/fff zero size 2024-08-18T22:41:46.784 INFO:tasks.workunit.client.0.smithi121.stdout:5/767: chown d3/d5/d13/d19/d24/lcc 315384272 1 2024-08-18T22:41:46.784 INFO:tasks.workunit.client.0.smithi121.stdout:0/778: link d1/d4/db/d24/df/d8/d78/d7c/df5/daf/dcb/ce6 d1/d4/db/d24/df/d8/d78/d7c/df5/daf/dd5/d90/dd8/c110 0 2024-08-18T22:41:46.785 INFO:tasks.workunit.client.1.smithi195.stdout:5/509: creat d0/d3/d8/d64/f9d x:0 0 0 2024-08-18T22:41:46.786 INFO:tasks.workunit.client.1.smithi195.stdout:7/565: mknod dc/d14/d15/d17/d18/ccd 0 2024-08-18T22:41:46.787 INFO:tasks.workunit.client.1.smithi195.stdout:5/510: read d0/d3/d8/d64/f70 [1025514,72624] 0 2024-08-18T22:41:46.788 INFO:tasks.workunit.client.1.smithi195.stdout:3/608: rename d7/da/df/d8e/daa/fb2 to d7/d1f/d73/fc0 0 2024-08-18T22:41:46.791 INFO:tasks.workunit.client.1.smithi195.stdout:6/464: mkdir da/d22/d87 0 2024-08-18T22:41:46.792 INFO:tasks.workunit.client.1.smithi195.stdout:8/596: mknod d1/de/df/ce0 0 2024-08-18T22:41:46.793 INFO:tasks.workunit.client.1.smithi195.stdout:6/465: write da/d15/d1c/d2e/f3d [4933385,52295] 0 2024-08-18T22:41:46.794 INFO:tasks.workunit.client.1.smithi195.stdout:4/483: dread d0/d9/d3b/f88 [0,4194304] 0 2024-08-18T22:41:46.796 INFO:tasks.workunit.client.1.smithi195.stdout:7/566: mknod dc/d2a/d4c/cce 0 2024-08-18T22:41:46.797 INFO:tasks.workunit.client.1.smithi195.stdout:7/567: chown dc/d14/d15/d17/d58/f5c 42040 1 2024-08-18T22:41:46.802 INFO:tasks.workunit.client.1.smithi195.stdout:3/609: mknod d7/da/df/d1c/d6a/d6c/cc1 0 2024-08-18T22:41:46.802 INFO:tasks.workunit.client.1.smithi195.stdout:3/610: readlink d7/d54/l67 0 2024-08-18T22:41:46.802 INFO:tasks.workunit.client.1.smithi195.stdout:8/597: creat d1/de/d67/fe1 x:0 0 0 2024-08-18T22:41:46.802 INFO:tasks.workunit.client.1.smithi195.stdout:8/598: chown d1/de/d27/fc2 4017 1 2024-08-18T22:41:46.804 INFO:tasks.workunit.client.1.smithi195.stdout:8/599: readlink d1/de/df/d1d/d1f/l7c 0 2024-08-18T22:41:46.806 INFO:tasks.workunit.client.1.smithi195.stdout:5/511: creat d0/d3/f9e x:0 0 0 2024-08-18T22:41:46.806 INFO:tasks.workunit.client.1.smithi195.stdout:7/568: dread dc/d14/d15/fa8 [0,4194304] 0 2024-08-18T22:41:46.808 INFO:tasks.workunit.client.1.smithi195.stdout:7/569: readlink dc/d22/l45 0 2024-08-18T22:41:46.809 INFO:tasks.workunit.client.1.smithi195.stdout:6/466: getdents da/d22 0 2024-08-18T22:41:46.809 INFO:tasks.workunit.client.1.smithi195.stdout:3/611: dwrite f1 [8388608,4194304] 0 2024-08-18T22:41:46.812 INFO:tasks.workunit.client.1.smithi195.stdout:5/512: unlink d0/d2/c31 0 2024-08-18T22:41:46.812 INFO:tasks.workunit.client.1.smithi195.stdout:4/484: dread d0/d7/d1d/f27 [0,4194304] 0 2024-08-18T22:41:46.812 INFO:tasks.workunit.client.1.smithi195.stdout:7/570: truncate dc/d22/fc9 267564 0 2024-08-18T22:41:46.812 INFO:tasks.workunit.client.1.smithi195.stdout:8/600: creat d1/d3/db/d39/d44/d79/fe2 x:0 0 0 2024-08-18T22:41:46.814 INFO:tasks.workunit.client.1.smithi195.stdout:5/513: write d0/f1d [194109,17] 0 2024-08-18T22:41:46.814 INFO:tasks.workunit.client.1.smithi195.stdout:8/601: chown d1/de/f54 95391 1 2024-08-18T22:41:46.815 INFO:tasks.workunit.client.1.smithi195.stdout:3/612: creat d7/d1f/d74/d81/fc2 x:0 0 0 2024-08-18T22:41:46.816 INFO:tasks.workunit.client.1.smithi195.stdout:8/602: dread - d1/d64/f80 zero size 2024-08-18T22:41:46.818 INFO:tasks.workunit.client.1.smithi195.stdout:5/514: mkdir d0/d3/df/d1a/d9f 0 2024-08-18T22:41:46.821 INFO:tasks.workunit.client.1.smithi195.stdout:7/571: link dc/d14/d15/f71 dc/d2a/d4c/db8/fcf 0 2024-08-18T22:41:46.824 INFO:tasks.workunit.client.1.smithi195.stdout:4/485: dwrite d0/d99/d98/f84 [0,4194304] 0 2024-08-18T22:41:46.825 INFO:tasks.workunit.client.1.smithi195.stdout:6/467: getdents da/db/d19 0 2024-08-18T22:41:46.828 INFO:tasks.workunit.client.1.smithi195.stdout:8/603: dread d1/d3/db/d39/d44/d79/fc3 [0,4194304] 0 2024-08-18T22:41:46.829 INFO:tasks.workunit.client.1.smithi195.stdout:6/468: symlink da/d15/d1c/l88 0 2024-08-18T22:41:46.832 INFO:tasks.workunit.client.1.smithi195.stdout:6/469: fdatasync da/db/f70 0 2024-08-18T22:41:46.833 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:41:46 smithi121 ceph-mon[16788]: from='mgr.24377 172.21.15.195:0/2331273060' entity='mgr.smithi195.acttsj' cmd=[{"prefix": "mgr metadata", "who": "smithi121.lopxqc", "id": "smithi121.lopxqc"}]: dispatch 2024-08-18T22:41:46.833 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:41:46 smithi121 ceph-mon[16788]: mgrmap e25: smithi195.acttsj(active, since 7s), standbys: smithi121.lopxqc 2024-08-18T22:41:46.833 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:41:46 smithi121 ceph-mon[16788]: pgmap v7: 65 pgs: 65 active+clean; 2.6 GiB data, 8.9 GiB used, 528 GiB / 536 GiB avail; 81 MiB/s rd, 244 MiB/s wr, 461 op/s 2024-08-18T22:41:46.834 INFO:tasks.workunit.client.1.smithi195.stdout:8/604: mknod d1/de/d31/ce3 0 2024-08-18T22:41:46.834 INFO:tasks.workunit.client.1.smithi195.stdout:7/572: dwrite dc/d14/d15/d17/d18/f1c [0,4194304] 0 2024-08-18T22:41:46.834 INFO:tasks.workunit.client.1.smithi195.stdout:6/470: fsync da/d15/f31 0 2024-08-18T22:41:46.835 INFO:tasks.workunit.client.1.smithi195.stdout:8/605: readlink d1/d3/l14 0 2024-08-18T22:41:46.836 INFO:tasks.workunit.client.1.smithi195.stdout:6/471: write da/db/d26/f7d [103310,127026] 0 2024-08-18T22:41:46.837 INFO:tasks.workunit.client.1.smithi195.stdout:4/486: rename d0/d9/l32 to d0/d9/d41/la9 0 2024-08-18T22:41:46.837 INFO:tasks.workunit.client.1.smithi195.stdout:3/613: write d7/fc [2421561,97228] 0 2024-08-18T22:41:46.842 INFO:tasks.workunit.client.1.smithi195.stdout:8/606: mkdir d1/d3/db/d35/d4d/d5c/de4 0 2024-08-18T22:41:46.842 INFO:tasks.workunit.client.1.smithi195.stdout:7/573: mkdir dc/d14/d15/d17/d58/db6/dd0 0 2024-08-18T22:41:46.844 INFO:tasks.workunit.client.1.smithi195.stdout:6/472: mknod da/db/d78/c89 0 2024-08-18T22:41:46.846 INFO:tasks.workunit.client.1.smithi195.stdout:4/487: rename d0/d99/d81/f8a to d0/d99/d85/faa 0 2024-08-18T22:41:46.846 INFO:tasks.workunit.client.1.smithi195.stdout:7/574: write dc/f32 [127127,29481] 0 2024-08-18T22:41:46.847 INFO:tasks.workunit.client.1.smithi195.stdout:6/473: readlink da/db/d26/d2d/l2f 0 2024-08-18T22:41:46.850 INFO:tasks.workunit.client.1.smithi195.stdout:3/614: dwrite f6 [0,4194304] 0 2024-08-18T22:41:46.852 INFO:tasks.workunit.client.1.smithi195.stdout:4/488: unlink d0/d9/d41/l73 0 2024-08-18T22:41:46.852 INFO:tasks.workunit.client.1.smithi195.stdout:5/515: dread d0/d3/f27 [0,4194304] 0 2024-08-18T22:41:46.852 INFO:tasks.workunit.client.1.smithi195.stdout:6/474: write da/d3b/f49 [1010863,37093] 0 2024-08-18T22:41:46.853 INFO:tasks.workunit.client.1.smithi195.stdout:7/575: fdatasync dc/d14/d15/f71 0 2024-08-18T22:41:46.853 INFO:tasks.workunit.client.1.smithi195.stdout:4/489: chown d0/d9/d3b/f64 205786 1 2024-08-18T22:41:46.856 INFO:tasks.workunit.client.1.smithi195.stdout:7/576: write dc/d14/f21 [1183370,50904] 0 2024-08-18T22:41:46.857 INFO:tasks.workunit.client.1.smithi195.stdout:7/577: write dc/d14/d2b/fb4 [770142,95391] 0 2024-08-18T22:41:46.858 INFO:tasks.workunit.client.1.smithi195.stdout:3/615: mkdir d7/dc3 0 2024-08-18T22:41:46.858 INFO:tasks.workunit.client.1.smithi195.stdout:4/490: mkdir d0/d99/d85/d48/d4c/dab 0 2024-08-18T22:41:46.861 INFO:tasks.workunit.client.1.smithi195.stdout:5/516: symlink d0/d2/la0 0 2024-08-18T22:41:46.862 INFO:tasks.workunit.client.1.smithi195.stdout:3/616: symlink d7/d1f/d73/dae/lc4 0 2024-08-18T22:41:46.863 INFO:tasks.workunit.client.1.smithi195.stdout:5/517: dread - d0/d46/d6d/f97 zero size 2024-08-18T22:41:46.864 INFO:tasks.workunit.client.1.smithi195.stdout:3/617: stat d7/da/df/d38/l9b 0 2024-08-18T22:41:46.866 INFO:tasks.workunit.client.1.smithi195.stdout:5/518: creat d0/d46/d6d/fa1 x:0 0 0 2024-08-18T22:41:46.867 INFO:tasks.workunit.client.1.smithi195.stdout:4/491: dwrite d0/d7/d1d/d69/f7f [0,4194304] 0 2024-08-18T22:41:46.868 INFO:tasks.workunit.client.1.smithi195.stdout:5/519: mkdir d0/d46/d6d/da2 0 2024-08-18T22:41:46.869 INFO:tasks.workunit.client.1.smithi195.stdout:4/492: chown d0/d99/d98/d16/d54/f5c 118196 1 2024-08-18T22:41:46.872 INFO:tasks.workunit.client.1.smithi195.stdout:4/493: creat d0/d99/d85/d48/fac x:0 0 0 2024-08-18T22:41:46.880 INFO:tasks.workunit.client.1.smithi195.stdout:8/607: dread d1/d3/db/d39/d2e/f4c [0,4194304] 0 2024-08-18T22:41:46.882 INFO:tasks.workunit.client.1.smithi195.stdout:6/475: write da/d15/f34 [710243,76174] 0 2024-08-18T22:41:46.882 INFO:tasks.workunit.client.1.smithi195.stdout:8/608: write d1/d3/db/d39/fd7 [8999685,96545] 0 2024-08-18T22:41:46.886 INFO:tasks.workunit.client.1.smithi195.stdout:8/609: mkdir d1/de/df/d1d/de5 0 2024-08-18T22:41:46.886 INFO:tasks.workunit.client.1.smithi195.stdout:8/610: chown d1/de/d27/d4f 71 1 2024-08-18T22:41:46.887 INFO:tasks.workunit.client.1.smithi195.stdout:8/611: readlink d1/de/df/l1b 0 2024-08-18T22:41:46.891 INFO:tasks.workunit.client.1.smithi195.stdout:4/494: dwrite d0/d99/d85/f3f [4194304,4194304] 0 2024-08-18T22:41:46.894 INFO:tasks.workunit.client.1.smithi195.stdout:4/495: rmdir d0/d99/d98/d16/d94 39 2024-08-18T22:41:46.897 INFO:tasks.workunit.client.1.smithi195.stdout:7/578: dread dc/f1e [4194304,4194304] 0 2024-08-18T22:41:46.898 INFO:tasks.workunit.client.1.smithi195.stdout:4/496: mkdir d0/d7/d1d/d69/d7d/da4/dad 0 2024-08-18T22:41:46.898 INFO:tasks.workunit.client.1.smithi195.stdout:3/618: dread d7/d1f/f26 [0,4194304] 0 2024-08-18T22:41:46.899 INFO:tasks.workunit.client.1.smithi195.stdout:7/579: write dc/d1d/d29/f86 [697471,30992] 0 2024-08-18T22:41:46.900 INFO:tasks.workunit.client.1.smithi195.stdout:4/497: write d0/d7/d1d/d69/d7d/f9c [878091,112845] 0 2024-08-18T22:41:46.902 INFO:tasks.workunit.client.0.smithi121.stdout:5/768: chown d3/d5 40 1 2024-08-18T22:41:46.902 INFO:tasks.workunit.client.1.smithi195.stdout:4/498: fsync d0/d7/d1d/d69/fa5 0 2024-08-18T22:41:46.903 INFO:tasks.workunit.client.1.smithi195.stdout:8/612: dread d1/de/f54 [0,4194304] 0 2024-08-18T22:41:46.904 INFO:tasks.workunit.client.0.smithi121.stdout:2/561: creat d2/d73/fb9 x:0 0 0 2024-08-18T22:41:46.904 INFO:tasks.workunit.client.0.smithi121.stdout:9/893: mkdir d0/d38/d9e/df/d61/db2/dce/d12a 0 2024-08-18T22:41:46.905 INFO:tasks.workunit.client.0.smithi121.stdout:3/933: mkdir d1e/d1f/d25/d6b/d81/dfa/d149 0 2024-08-18T22:41:46.907 INFO:tasks.workunit.client.0.smithi121.stdout:4/906: creat d2/dc/d16/d59/d83/dd7/f14d x:0 0 0 2024-08-18T22:41:46.908 INFO:tasks.workunit.client.1.smithi195.stdout:7/580: link dc/d22/f3e dc/d14/d2b/d81/d9c/fd1 0 2024-08-18T22:41:46.908 INFO:tasks.workunit.client.1.smithi195.stdout:3/619: dread d7/f18 [0,4194304] 0 2024-08-18T22:41:46.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:41:46 smithi195 ceph-mon[23370]: from='mgr.24377 172.21.15.195:0/2331273060' entity='mgr.smithi195.acttsj' cmd=[{"prefix": "mgr metadata", "who": "smithi121.lopxqc", "id": "smithi121.lopxqc"}]: dispatch 2024-08-18T22:41:46.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:41:46 smithi195 ceph-mon[23370]: mgrmap e25: smithi195.acttsj(active, since 7s), standbys: smithi121.lopxqc 2024-08-18T22:41:46.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:41:46 smithi195 ceph-mon[23370]: pgmap v7: 65 pgs: 65 active+clean; 2.6 GiB data, 8.9 GiB used, 528 GiB / 536 GiB avail; 81 MiB/s rd, 244 MiB/s wr, 461 op/s 2024-08-18T22:41:46.909 INFO:tasks.workunit.client.0.smithi121.stdout:1/920: unlink d5/d10/d14/d2a/d3a/d87/d6c/d6f/d82/d15/d133/de4/fe8 0 2024-08-18T22:41:46.909 INFO:tasks.workunit.client.0.smithi121.stdout:1/921: chown d5/dcf 1735 1 2024-08-18T22:41:46.910 INFO:tasks.workunit.client.0.smithi121.stdout:2/562: rmdir d2/d8/d19/dc 39 2024-08-18T22:41:46.910 INFO:tasks.workunit.client.0.smithi121.stdout:1/922: chown d5/d10/d14/d2a/d3a/la0 933566 1 2024-08-18T22:41:46.910 INFO:tasks.workunit.client.0.smithi121.stdout:0/779: truncate d1/d4/db/d18/d1c/d5f/f9a 220271 0 2024-08-18T22:41:46.911 INFO:tasks.workunit.client.1.smithi195.stdout:3/620: creat d7/da/df/d1c/d6a/d6c/fc5 x:0 0 0 2024-08-18T22:41:46.911 INFO:tasks.workunit.client.1.smithi195.stdout:7/581: dread dc/d14/d2b/fb4 [0,4194304] 0 2024-08-18T22:41:46.911 INFO:tasks.workunit.client.0.smithi121.stdout:4/907: mknod d2/dc/d16/d22/d2c/d7a/da0/dcc/c14e 0 2024-08-18T22:41:46.913 INFO:tasks.workunit.client.1.smithi195.stdout:3/621: mkdir d7/da/df/d1c/dc6 0 2024-08-18T22:41:46.913 INFO:tasks.workunit.client.0.smithi121.stdout:1/923: chown d5/d10/d14/d2a/d108/f135 27672750 1 2024-08-18T22:41:46.914 INFO:tasks.workunit.client.1.smithi195.stdout:7/582: creat dc/d14/d15/d17/d18/d89/fd2 x:0 0 0 2024-08-18T22:41:46.914 INFO:tasks.workunit.client.1.smithi195.stdout:8/613: write d1/de/df/d1d/d8e/f9a [555522,33845] 0 2024-08-18T22:41:46.914 INFO:tasks.workunit.client.0.smithi121.stdout:0/780: unlink d1/d4/db/d24/df/d8/f20 0 2024-08-18T22:41:46.915 INFO:tasks.workunit.client.1.smithi195.stdout:7/583: stat dc/d14/d2b/d82/l9d 0 2024-08-18T22:41:46.917 INFO:tasks.workunit.client.1.smithi195.stdout:3/622: rename d7/da/f14 to d7/d54/fc7 0 2024-08-18T22:41:46.917 INFO:tasks.workunit.client.0.smithi121.stdout:4/908: rmdir d2/dc/d16/d22/d2c/d44/da7 39 2024-08-18T22:41:46.917 INFO:tasks.workunit.client.1.smithi195.stdout:8/614: creat d1/de/d67/fe6 x:0 0 0 2024-08-18T22:41:46.918 INFO:tasks.workunit.client.1.smithi195.stdout:8/615: chown d1/d3/d1c/f45 8849 1 2024-08-18T22:41:46.919 INFO:tasks.workunit.client.0.smithi121.stdout:2/563: symlink d2/d3/d53/lba 0 2024-08-18T22:41:46.919 INFO:tasks.workunit.client.1.smithi195.stdout:8/616: stat d1/d3/db/d35/d56/c8f 0 2024-08-18T22:41:46.921 INFO:tasks.workunit.client.1.smithi195.stdout:7/584: getdents dc/d8f 0 2024-08-18T22:41:46.922 INFO:tasks.workunit.client.1.smithi195.stdout:7/585: stat dc/d1d/d29/l37 0 2024-08-18T22:41:46.922 INFO:tasks.workunit.client.1.smithi195.stdout:8/617: symlink d1/d3/db/d7a/le7 0 2024-08-18T22:41:46.925 INFO:tasks.workunit.client.1.smithi195.stdout:7/586: symlink dc/d14/d15/d4d/ld3 0 2024-08-18T22:41:46.926 INFO:tasks.workunit.client.0.smithi121.stdout:2/564: unlink d2/d8/c3e 0 2024-08-18T22:41:46.926 INFO:tasks.workunit.client.1.smithi195.stdout:7/587: chown dc/d14/f47 81221 1 2024-08-18T22:41:46.927 INFO:tasks.workunit.client.0.smithi121.stdout:1/924: symlink d5/d10/l13d 0 2024-08-18T22:41:46.927 INFO:tasks.workunit.client.1.smithi195.stdout:8/618: creat d1/d3/d1c/fe8 x:0 0 0 2024-08-18T22:41:46.928 INFO:tasks.workunit.client.0.smithi121.stdout:0/781: symlink d1/d4/l111 0 2024-08-18T22:41:46.928 INFO:tasks.workunit.client.1.smithi195.stdout:3/623: mknod d7/da/df/d1c/d6a/cc8 0 2024-08-18T22:41:46.929 INFO:tasks.workunit.client.1.smithi195.stdout:8/619: stat d1/d3/db/d39/d44/d79/dd9 0 2024-08-18T22:41:46.931 INFO:tasks.workunit.client.0.smithi121.stdout:9/894: dread d0/d5/dd/d1a/dc8/dfa/dbf/d60/f99 [0,4194304] 0 2024-08-18T22:41:46.933 INFO:tasks.workunit.client.1.smithi195.stdout:8/620: write d1/d3/db/d39/d44/d8c/fc9 [191536,62673] 0 2024-08-18T22:41:46.934 INFO:tasks.workunit.client.0.smithi121.stdout:1/925: creat d5/d10b/f13e x:0 0 0 2024-08-18T22:41:46.934 INFO:tasks.workunit.client.1.smithi195.stdout:7/588: dwrite dc/d8f/fcb [0,4194304] 0 2024-08-18T22:41:46.936 INFO:tasks.workunit.client.1.smithi195.stdout:4/499: dread d0/d99/d98/f18 [4194304,4194304] 0 2024-08-18T22:41:46.937 INFO:tasks.workunit.client.0.smithi121.stdout:9/895: dread d0/d5/dd/d3b/fae [0,4194304] 0 2024-08-18T22:41:46.937 INFO:tasks.workunit.client.0.smithi121.stdout:0/782: rename d1/l76 to d1/d4/db/d24/df/d8/d78/d7c/df5/l112 0 2024-08-18T22:41:46.938 INFO:tasks.workunit.client.0.smithi121.stdout:1/926: write d5/d10/d14/d2a/d3a/d87/d6c/f121 [1184833,73154] 0 2024-08-18T22:41:46.938 INFO:tasks.workunit.client.0.smithi121.stdout:4/909: write d2/dc/d16/d22/d29/ded/ff3 [203934,20573] 0 2024-08-18T22:41:46.939 INFO:tasks.workunit.client.1.smithi195.stdout:4/500: write d0/d99/d98/f92 [768015,83140] 0 2024-08-18T22:41:46.940 INFO:tasks.workunit.client.0.smithi121.stdout:5/769: dwrite d3/d5/d13/d19/d24/d32/da8/fde [0,4194304] 0 2024-08-18T22:41:46.942 INFO:tasks.workunit.client.1.smithi195.stdout:3/624: truncate f6 3925304 0 2024-08-18T22:41:46.942 INFO:tasks.workunit.client.1.smithi195.stdout:8/621: mkdir d1/d3/db/d35/d4d/d5c/de9 0 2024-08-18T22:41:46.943 INFO:tasks.workunit.client.1.smithi195.stdout:7/589: symlink dc/ld4 0 2024-08-18T22:41:46.943 INFO:tasks.workunit.client.0.smithi121.stdout:2/565: rename d2/d8/d19/dc/l16 to d2/d8/d9e/lbb 0 2024-08-18T22:41:46.945 INFO:tasks.workunit.client.1.smithi195.stdout:8/622: write d1/d3/db/d39/fc4 [669358,37441] 0 2024-08-18T22:41:46.945 INFO:tasks.workunit.client.1.smithi195.stdout:3/625: mkdir d7/d1f/d74/dc9 0 2024-08-18T22:41:46.946 INFO:tasks.workunit.client.0.smithi121.stdout:0/783: creat d1/d4/db/d24/df/d8/d78/d7c/f113 x:0 0 0 2024-08-18T22:41:46.946 INFO:tasks.workunit.client.1.smithi195.stdout:4/501: getdents d0/d99/d98/d16 0 2024-08-18T22:41:46.947 INFO:tasks.workunit.client.1.smithi195.stdout:8/623: stat d1/l4a 0 2024-08-18T22:41:46.948 INFO:tasks.workunit.client.1.smithi195.stdout:4/502: chown d0/c12 417951 1 2024-08-18T22:41:46.949 INFO:tasks.workunit.client.0.smithi121.stdout:0/784: write d1/d4/db/d24/df/d8/d78/d7c/df5/daf/dcb/ffa [239534,103176] 0 2024-08-18T22:41:46.949 INFO:tasks.workunit.client.0.smithi121.stdout:9/896: rename d0/d38/d9e/df/d3d/d89 to d0/d38/d9e/df/d73/d12b 0 2024-08-18T22:41:46.949 INFO:tasks.workunit.client.1.smithi195.stdout:4/503: stat d0/d9/f2e 0 2024-08-18T22:41:46.950 INFO:tasks.workunit.client.1.smithi195.stdout:8/624: stat d1/d3/db/d39/d44/d79/cc5 0 2024-08-18T22:41:46.950 INFO:tasks.workunit.client.1.smithi195.stdout:4/504: chown d0/d9/d41 13531 1 2024-08-18T22:41:46.950 INFO:tasks.workunit.client.1.smithi195.stdout:7/590: dread dc/f1e [4194304,4194304] 0 2024-08-18T22:41:46.951 INFO:tasks.workunit.client.1.smithi195.stdout:7/591: fdatasync dc/f72 0 2024-08-18T22:41:46.951 INFO:tasks.workunit.client.1.smithi195.stdout:4/505: readlink d0/d9/l4d 0 2024-08-18T22:41:46.952 INFO:tasks.workunit.client.0.smithi121.stdout:1/927: mkdir d5/d10/d14/d2a/d3a/d87/d6c/d6f/d82/d15/d28/d3d/d9a/dac/d13f 0 2024-08-18T22:41:46.953 INFO:tasks.workunit.client.1.smithi195.stdout:8/625: creat d1/de/d27/d4f/dde/fea x:0 0 0 2024-08-18T22:41:46.953 INFO:tasks.workunit.client.0.smithi121.stdout:4/910: creat d2/dc/d16/d22/f14f x:0 0 0 2024-08-18T22:41:46.954 INFO:tasks.workunit.client.0.smithi121.stdout:2/566: symlink d2/lbc 0 2024-08-18T22:41:46.954 INFO:tasks.workunit.client.0.smithi121.stdout:4/911: write d2/d7c/f12c [646724,108336] 0 2024-08-18T22:41:46.955 INFO:tasks.workunit.client.1.smithi195.stdout:8/626: fdatasync d1/d3/db/d35/f7e 0 2024-08-18T22:41:46.958 INFO:tasks.workunit.client.1.smithi195.stdout:7/592: getdents dc/d14/d15/d17/d58 0 2024-08-18T22:41:46.961 INFO:tasks.workunit.client.0.smithi121.stdout:2/567: truncate d2/f92 288978 0 2024-08-18T22:41:46.962 INFO:tasks.workunit.client.1.smithi195.stdout:8/627: truncate d1/d3/d1c/d21/f3f 211850 0 2024-08-18T22:41:46.963 INFO:tasks.workunit.client.1.smithi195.stdout:7/593: symlink dc/ld5 0 2024-08-18T22:41:46.963 INFO:tasks.workunit.client.0.smithi121.stdout:9/897: symlink d0/d38/d9e/df/d61/db2/l12c 0 2024-08-18T22:41:46.965 INFO:tasks.workunit.client.0.smithi121.stdout:0/785: symlink d1/d4/db/d24/df/d8/d71/de3/l114 0 2024-08-18T22:41:46.967 INFO:tasks.workunit.client.0.smithi121.stdout:4/912: mkdir d2/dc/d16/d22/d2c/d44/d111/d150 0 2024-08-18T22:41:46.968 INFO:tasks.workunit.client.1.smithi195.stdout:7/594: write dc/d14/d15/d17/d18/f1c [2798915,95479] 0 2024-08-18T22:41:46.969 INFO:tasks.workunit.client.0.smithi121.stdout:0/786: unlink d1/d4/fb8 0 2024-08-18T22:41:46.976 INFO:tasks.workunit.client.1.smithi195.stdout:4/506: dwrite d0/d7/d1d/f27 [0,4194304] 0 2024-08-18T22:41:46.978 INFO:tasks.workunit.client.1.smithi195.stdout:8/628: dwrite d1/d3/db/d35/d4d/fcd [0,4194304] 0 2024-08-18T22:41:46.978 INFO:tasks.workunit.client.1.smithi195.stdout:7/595: creat dc/d14/d15/d17/fd6 x:0 0 0 2024-08-18T22:41:46.978 INFO:tasks.workunit.client.1.smithi195.stdout:3/626: dwrite d7/f9 [4194304,4194304] 0 2024-08-18T22:41:46.984 INFO:tasks.workunit.client.1.smithi195.stdout:8/629: mknod d1/d3/db/d39/d44/d79/dd9/ceb 0 2024-08-18T22:41:46.988 INFO:tasks.workunit.client.1.smithi195.stdout:3/627: write d7/da/df/f3b [4590361,101230] 0 2024-08-18T22:41:46.991 INFO:tasks.workunit.client.1.smithi195.stdout:8/630: write d1/d64/fb3 [734783,99732] 0 2024-08-18T22:41:46.995 INFO:tasks.workunit.client.1.smithi195.stdout:4/507: dwrite d0/d9/d3b/f5a [0,4194304] 0 2024-08-18T22:41:46.998 INFO:tasks.workunit.client.1.smithi195.stdout:7/596: dwrite dc/d14/d2b/d81/d9c/f9e [0,4194304] 0 2024-08-18T22:41:47.004 INFO:tasks.workunit.client.1.smithi195.stdout:3/628: dwrite d7/f89 [4194304,4194304] 0 2024-08-18T22:41:47.012 INFO:tasks.workunit.client.1.smithi195.stdout:4/508: dwrite d0/d99/d98/d16/f61 [0,4194304] 0 2024-08-18T22:41:47.013 INFO:tasks.workunit.client.1.smithi195.stdout:8/631: truncate d1/d3/db/d39/f59 2434506 0 2024-08-18T22:41:47.019 INFO:tasks.workunit.client.1.smithi195.stdout:7/597: dwrite dc/d2a/f65 [0,4194304] 0 2024-08-18T22:41:47.027 INFO:tasks.workunit.client.1.smithi195.stdout:7/598: creat dc/d1d/d29/fd7 x:0 0 0 2024-08-18T22:41:47.027 INFO:tasks.workunit.client.1.smithi195.stdout:7/599: write dc/d14/d15/d17/d18/f1c [3127505,51633] 0 2024-08-18T22:41:47.030 INFO:tasks.workunit.client.1.smithi195.stdout:7/600: getdents dc/d14/d15/d17/d58/db6/dd0 0 2024-08-18T22:41:47.034 INFO:tasks.workunit.client.1.smithi195.stdout:7/601: symlink dc/d1d/d29/ld8 0 2024-08-18T22:41:47.035 INFO:tasks.workunit.client.1.smithi195.stdout:7/602: fdatasync dc/d14/d15/d17/d58/fa4 0 2024-08-18T22:41:47.037 INFO:tasks.workunit.client.1.smithi195.stdout:7/603: dread - dc/d14/d15/d17/d58/f6b zero size 2024-08-18T22:41:47.037 INFO:tasks.workunit.client.1.smithi195.stdout:4/509: dwrite d0/d7/d1d/f52 [0,4194304] 0 2024-08-18T22:41:47.038 INFO:tasks.workunit.client.1.smithi195.stdout:7/604: chown dc/d2a/d4c/db8 8 1 2024-08-18T22:41:47.040 INFO:tasks.workunit.client.1.smithi195.stdout:4/510: mkdir d0/d99/d98/d16/dae 0 2024-08-18T22:41:47.042 INFO:tasks.workunit.client.1.smithi195.stdout:7/605: creat dc/d14/d15/d17/d18/fd9 x:0 0 0 2024-08-18T22:41:47.044 INFO:tasks.workunit.client.1.smithi195.stdout:7/606: symlink dc/d1d/lda 0 2024-08-18T22:41:47.049 INFO:tasks.workunit.client.1.smithi195.stdout:7/607: rename dc/d14 to dc/d1d/d29/ddb 0 2024-08-18T22:41:47.054 INFO:tasks.workunit.client.1.smithi195.stdout:4/511: dwrite d0/d99/d85/d48/f60 [0,4194304] 0 2024-08-18T22:41:47.056 INFO:tasks.workunit.client.1.smithi195.stdout:4/512: creat d0/d7/faf x:0 0 0 2024-08-18T22:41:47.059 INFO:tasks.workunit.client.1.smithi195.stdout:4/513: rename d0/d99/d85/d5f to d0/d9/d3b/d6f/db0 0 2024-08-18T22:41:47.060 INFO:tasks.workunit.client.1.smithi195.stdout:4/514: write d0/d7/f80 [183792,52391] 0 2024-08-18T22:41:47.062 INFO:tasks.workunit.client.1.smithi195.stdout:4/515: truncate d0/d9/fa7 913524 0 2024-08-18T22:41:47.064 INFO:tasks.workunit.client.1.smithi195.stdout:7/608: dwrite dc/f25 [0,4194304] 0 2024-08-18T22:41:47.064 INFO:tasks.workunit.client.1.smithi195.stdout:4/516: write d0/d99/d98/f18 [8099431,108193] 0 2024-08-18T22:41:47.066 INFO:tasks.workunit.client.1.smithi195.stdout:7/609: dread dc/d2a/d56/f84 [0,4194304] 0 2024-08-18T22:41:47.071 INFO:tasks.workunit.client.1.smithi195.stdout:7/610: fsync dc/d1d/d29/fc8 0 2024-08-18T22:41:47.072 INFO:tasks.workunit.client.1.smithi195.stdout:4/517: mknod d0/d99/d98/d16/dae/cb1 0 2024-08-18T22:41:47.072 INFO:tasks.workunit.client.1.smithi195.stdout:7/611: readlink dc/d1d/d29/ddb/d2b/l44 0 2024-08-18T22:41:47.073 INFO:tasks.workunit.client.1.smithi195.stdout:4/518: fdatasync d0/f8 0 2024-08-18T22:41:47.074 INFO:tasks.workunit.client.1.smithi195.stdout:7/612: dread dc/d1d/d29/ddb/f68 [0,4194304] 0 2024-08-18T22:41:47.075 INFO:tasks.workunit.client.1.smithi195.stdout:4/519: dread - d0/d9/d6c/f91 zero size 2024-08-18T22:41:47.075 INFO:tasks.workunit.client.1.smithi195.stdout:7/613: fdatasync fb 0 2024-08-18T22:41:47.076 INFO:tasks.workunit.client.1.smithi195.stdout:7/614: chown dc/d1d/d29/d5d/l53 714676 1 2024-08-18T22:41:47.077 INFO:tasks.workunit.client.1.smithi195.stdout:7/615: chown dc/d1d/d29/ddb/d2b/d82 5 1 2024-08-18T22:41:47.079 INFO:tasks.workunit.client.1.smithi195.stdout:4/520: rename d0/d7/d1d/d69/d7d to d0/d99/d98/d16/d94/db2 0 2024-08-18T22:41:47.080 INFO:tasks.workunit.client.1.smithi195.stdout:4/521: readlink d0/d9/d41/d66/l77 0 2024-08-18T22:41:47.080 INFO:tasks.workunit.client.1.smithi195.stdout:7/616: symlink dc/d1d/d29/ddb/d15/d4d/ldc 0 2024-08-18T22:41:47.081 INFO:tasks.workunit.client.1.smithi195.stdout:7/617: chown dc/d1d/d29/f63 5346685 1 2024-08-18T22:41:47.086 INFO:tasks.workunit.client.1.smithi195.stdout:7/618: write dc/d1d/d29/ddb/d15/d17/d18/f57 [840556,2093] 0 2024-08-18T22:41:47.086 INFO:tasks.workunit.client.1.smithi195.stdout:4/522: dwrite d0/d9/f44 [4194304,4194304] 0 2024-08-18T22:41:47.089 INFO:tasks.workunit.client.1.smithi195.stdout:4/523: mknod d0/d99/d85/cb3 0 2024-08-18T22:41:47.090 INFO:tasks.workunit.client.1.smithi195.stdout:4/524: dread - d0/d9/d6c/f9b zero size 2024-08-18T22:41:47.096 INFO:tasks.workunit.client.1.smithi195.stdout:4/525: dwrite d0/d99/d98/f3a [4194304,4194304] 0 2024-08-18T22:41:47.099 INFO:tasks.workunit.client.1.smithi195.stdout:4/526: mkdir d0/d7/d1d/d69/db4 0 2024-08-18T22:41:47.100 INFO:tasks.workunit.client.1.smithi195.stdout:4/527: dread - d0/d9/d6c/f91 zero size 2024-08-18T22:41:47.102 INFO:tasks.workunit.client.1.smithi195.stdout:4/528: creat d0/fb5 x:0 0 0 2024-08-18T22:41:47.107 INFO:tasks.workunit.client.1.smithi195.stdout:4/529: dwrite d0/d7/faf [0,4194304] 0 2024-08-18T22:41:47.110 INFO:tasks.workunit.client.0.smithi121.stdout:1/928: dwrite d5/d10/d14/d2a/d3a/d87/d6c/d6f/d82/d15/d133/fc7 [0,4194304] 0 2024-08-18T22:41:47.111 INFO:tasks.workunit.client.0.smithi121.stdout:5/770: dwrite d3/d5c/f69 [0,4194304] 0 2024-08-18T22:41:47.121 INFO:tasks.workunit.client.0.smithi121.stdout:9/898: dread d0/d5/f25 [0,4194304] 0 2024-08-18T22:41:47.129 INFO:tasks.workunit.client.0.smithi121.stdout:4/913: dread d2/dc/d16/d22/d2c/d44/d8c/fb8 [0,4194304] 0 2024-08-18T22:41:47.130 INFO:tasks.workunit.client.0.smithi121.stdout:4/914: fsync d2/dc/d16/d59/d83/fdf 0 2024-08-18T22:41:47.131 INFO:tasks.workunit.client.0.smithi121.stdout:4/915: chown d2/dc/d8d/da4/c110 6 1 2024-08-18T22:41:47.132 INFO:tasks.workunit.client.0.smithi121.stdout:4/916: stat d2/dc/d16/d22/d2c/d44/d111 0 2024-08-18T22:41:47.135 INFO:tasks.workunit.client.1.smithi195.stdout:4/530: truncate d0/d99/d98/d16/f1b 4058177 0 2024-08-18T22:41:47.136 INFO:tasks.workunit.client.0.smithi121.stdout:5/771: creat d3/d5/d13/d23/da4/da6/dc4/fef x:0 0 0 2024-08-18T22:41:47.138 INFO:tasks.workunit.client.0.smithi121.stdout:5/772: write d3/d5/f9d [1576588,75756] 0 2024-08-18T22:41:47.139 INFO:tasks.workunit.client.1.smithi195.stdout:4/531: dread d0/d99/d85/f3f [4194304,4194304] 0 2024-08-18T22:41:47.139 INFO:tasks.workunit.client.0.smithi121.stdout:5/773: readlink d3/d5/d13/d19/d24/d32/d38/la0 0 2024-08-18T22:41:47.140 INFO:tasks.workunit.client.1.smithi195.stdout:4/532: chown d0/d7/d1d/d69 20020 1 2024-08-18T22:41:47.140 INFO:tasks.workunit.client.0.smithi121.stdout:0/787: unlink d1/d4/db/d24/df/d8/d78/d7c/df5/daf/fcc 0 2024-08-18T22:41:47.141 INFO:tasks.workunit.client.1.smithi195.stdout:4/533: readlink d0/d99/d85/d48/l8b 0 2024-08-18T22:41:47.142 INFO:tasks.workunit.client.1.smithi195.stdout:4/534: rmdir d0/d7/d1d 39 2024-08-18T22:41:47.143 INFO:tasks.workunit.client.0.smithi121.stdout:0/788: write d1/d4/da/d2f/da0/fe8 [274109,8678] 0 2024-08-18T22:41:47.143 INFO:tasks.workunit.client.0.smithi121.stdout:1/929: rename d5/d10/d14/d2a/d3a/d87/d6c/d6f/d82/c17 to d5/d10/d14/d2a/d3a/d87/d6c/d6f/d82/ddb/c140 0 2024-08-18T22:41:47.144 INFO:tasks.workunit.client.1.smithi195.stdout:4/535: mkdir d0/d99/d98/db6 0 2024-08-18T22:41:47.145 INFO:tasks.workunit.client.0.smithi121.stdout:0/789: dread - d1/d4/db/d24/df/d8/d71/d79/f92 zero size 2024-08-18T22:41:47.146 INFO:tasks.workunit.client.0.smithi121.stdout:9/899: creat d0/d5/dd/d3b/f12d x:0 0 0 2024-08-18T22:41:47.148 INFO:tasks.workunit.client.0.smithi121.stdout:4/917: dread d2/dc/d16/d59/d83/dd7/d90/fcf [0,4194304] 0 2024-08-18T22:41:47.148 INFO:tasks.workunit.client.1.smithi195.stdout:4/536: rename d0/d9 to d0/d7/d1d/d69/db7 0 2024-08-18T22:41:47.149 INFO:tasks.workunit.client.0.smithi121.stdout:0/790: rmdir d1/d4/db/d24/d30/d6c/dde 39 2024-08-18T22:41:47.149 INFO:tasks.workunit.client.0.smithi121.stdout:4/918: chown d2/d7c/l120 7613441 1 2024-08-18T22:41:47.150 INFO:tasks.workunit.client.0.smithi121.stdout:5/774: dread d3/d5/d13/d19/d75/f87 [0,4194304] 0 2024-08-18T22:41:47.151 INFO:tasks.workunit.client.0.smithi121.stdout:9/900: unlink d0/d38/d9e/f63 0 2024-08-18T22:41:47.152 INFO:tasks.workunit.client.1.smithi195.stdout:4/537: rename d0/d7/d1d/d69/db7/d41/d66/c8e to d0/d7/d1d/d69/db7/d3b/d6f/cb8 0 2024-08-18T22:41:47.154 INFO:tasks.workunit.client.0.smithi121.stdout:4/919: read d2/dc/f5e [407184,12019] 0 2024-08-18T22:41:47.156 INFO:tasks.workunit.client.0.smithi121.stdout:0/791: mknod d1/d4/db/d24/df/d8/d78/d7c/df5/daf/df8/c115 0 2024-08-18T22:41:47.158 INFO:tasks.workunit.client.0.smithi121.stdout:5/775: rename d3/d5/d3c/f7f to d3/dd5/ff0 0 2024-08-18T22:41:47.160 INFO:tasks.workunit.client.0.smithi121.stdout:0/792: unlink d1/d4/da/d2f/da0/l93 0 2024-08-18T22:41:47.161 INFO:tasks.workunit.client.0.smithi121.stdout:0/793: readlink d1/d4/d53/d61/ldb 0 2024-08-18T22:41:47.162 INFO:tasks.workunit.client.0.smithi121.stdout:0/794: dread - d1/d4/db/d24/df/d8/d78/d7c/df5/f106 zero size 2024-08-18T22:41:47.163 INFO:tasks.workunit.client.0.smithi121.stdout:5/776: fsync d3/d5/d27/d35/f72 0 2024-08-18T22:41:47.164 INFO:tasks.workunit.client.0.smithi121.stdout:0/795: chown d1/d4/db/d24/c8d 10012137 1 2024-08-18T22:41:47.165 INFO:tasks.workunit.client.0.smithi121.stdout:5/777: fdatasync d3/d5/d3c/d3f/fda 0 2024-08-18T22:41:47.168 INFO:tasks.workunit.client.0.smithi121.stdout:5/778: read d3/f12 [2533403,35053] 0 2024-08-18T22:41:47.168 INFO:tasks.workunit.client.0.smithi121.stdout:0/796: chown d1/d4/db/d24/df/d8/d78/d7c/ldc 79169121 1 2024-08-18T22:41:47.168 INFO:tasks.workunit.client.0.smithi121.stdout:4/920: dwrite d2/dc/d16/d22/d2c/d44/da7/fb1 [0,4194304] 0 2024-08-18T22:41:47.171 INFO:tasks.workunit.client.0.smithi121.stdout:0/797: chown d1/d4/db/d24/d30/d6c/fdf 8580 1 2024-08-18T22:41:47.174 INFO:tasks.workunit.client.0.smithi121.stdout:4/921: creat d2/dc/d1c/dc1/ddb/d141/f151 x:0 0 0 2024-08-18T22:41:47.178 INFO:tasks.workunit.client.0.smithi121.stdout:5/779: dwrite d3/d5/d13/d19/d24/f8e [0,4194304] 0 2024-08-18T22:41:47.179 INFO:tasks.workunit.client.0.smithi121.stdout:0/798: fsync d1/d4/db/d24/df/d8/d78/d7c/df5/daf/dd5/fa8 0 2024-08-18T22:41:47.182 INFO:tasks.workunit.client.0.smithi121.stdout:4/922: rename d2/dc/d1c/f7d to d2/dc/d1c/dc1/ddb/df1/f152 0 2024-08-18T22:41:47.183 INFO:tasks.workunit.client.0.smithi121.stdout:5/780: creat d3/d5/d3c/d3f/ff1 x:0 0 0 2024-08-18T22:41:47.184 INFO:tasks.workunit.client.0.smithi121.stdout:0/799: mknod d1/d4/db/d24/df/d8/d71/c116 0 2024-08-18T22:41:47.187 INFO:tasks.workunit.client.0.smithi121.stdout:4/923: symlink d2/dc/d16/d22/d2c/l153 0 2024-08-18T22:41:47.190 INFO:tasks.workunit.client.0.smithi121.stdout:0/800: link d1/d4/da/d2f/f5e d1/d4/d53/d61/f117 0 2024-08-18T22:41:47.192 INFO:tasks.workunit.client.0.smithi121.stdout:5/781: creat d3/d5/ff2 x:0 0 0 2024-08-18T22:41:47.194 INFO:tasks.workunit.client.0.smithi121.stdout:1/930: dwrite d5/d10/d14/d2a/d3a/f66 [0,4194304] 0 2024-08-18T22:41:47.195 INFO:tasks.workunit.client.0.smithi121.stdout:9/901: write d0/d38/d9e/d18/dfd/f109 [2682256,21788] 0 2024-08-18T22:41:47.198 INFO:tasks.workunit.client.0.smithi121.stdout:5/782: creat d3/d5/d13/d19/d24/d4d/dad/ff3 x:0 0 0 2024-08-18T22:41:47.199 INFO:tasks.workunit.client.0.smithi121.stdout:1/931: rmdir d5/d10/d14/d2a/d3a/d87/d6c/d6f/d82/d15/d28/d3d 39 2024-08-18T22:41:47.201 INFO:tasks.workunit.client.0.smithi121.stdout:9/902: dread d0/d5/dd/d3b/d48/fc7 [0,4194304] 0 2024-08-18T22:41:47.202 INFO:tasks.workunit.client.0.smithi121.stdout:1/932: write d5/d10/d14/d2a/d3a/d87/d6c/d6f/fc4 [186309,38072] 0 2024-08-18T22:41:47.203 INFO:tasks.workunit.client.0.smithi121.stdout:5/783: mkdir d3/d5/d27/d35/d53/df4 0 2024-08-18T22:41:47.205 INFO:tasks.workunit.client.0.smithi121.stdout:0/801: getdents d1/d4/db/d24/df/d8/d78/d7c/df5/daf/dd5/d5b 0 2024-08-18T22:41:47.212 INFO:tasks.workunit.client.0.smithi121.stdout:4/924: dread d2/dc/d16/d22/d2c/d44/d66/f9b [0,4194304] 0 2024-08-18T22:41:47.213 INFO:tasks.workunit.client.0.smithi121.stdout:0/802: rename d1/d4/db/d24/df/d8/d78/d7c/df5/daf/dd5/d90/dd8 to d1/d4/db/d24/d118 0 2024-08-18T22:41:47.222 INFO:tasks.workunit.client.0.smithi121.stdout:1/933: dwrite d5/d10/d14/fea [0,4194304] 0 2024-08-18T22:41:47.222 INFO:tasks.workunit.client.0.smithi121.stdout:9/903: link d0/d5/dd/d3b/ca8 d0/d38/d9e/df/d73/d12b/d92/c12e 0 2024-08-18T22:41:47.223 INFO:tasks.workunit.client.0.smithi121.stdout:0/803: write d1/d4/db/f60 [60265,24103] 0 2024-08-18T22:41:47.225 INFO:tasks.workunit.client.1.smithi195.stdout:1/606: sync 2024-08-18T22:41:47.226 INFO:tasks.workunit.client.1.smithi195.stdout:1/607: mkdir da/d4c/dd5 0 2024-08-18T22:41:47.227 INFO:tasks.workunit.client.0.smithi121.stdout:9/904: chown d0/d5/dd/c14 5660227 1 2024-08-18T22:41:47.228 INFO:tasks.workunit.client.0.smithi121.stdout:1/934: chown d5/d10/d14/d2a/d3a/d87/c62 23743 1 2024-08-18T22:41:47.229 INFO:tasks.workunit.client.1.smithi195.stdout:1/608: mkdir da/d4c/d5d/dac/db1/dd6 0 2024-08-18T22:41:47.229 INFO:tasks.workunit.client.0.smithi121.stdout:5/784: dwrite d3/dd5/ff0 [0,4194304] 0 2024-08-18T22:41:47.230 INFO:tasks.workunit.client.1.smithi195.stdout:1/609: truncate da/d3d/f92 4450594 0 2024-08-18T22:41:47.230 INFO:tasks.workunit.client.1.smithi195.stdout:1/610: fdatasync da/d18/d28/f2d 0 2024-08-18T22:41:47.231 INFO:tasks.workunit.client.1.smithi195.stdout:1/611: rmdir da/d18 39 2024-08-18T22:41:47.231 INFO:tasks.workunit.client.0.smithi121.stdout:4/925: dwrite d2/dc/d16/d22/d2c/fa1 [0,4194304] 0 2024-08-18T22:41:47.234 INFO:tasks.workunit.client.0.smithi121.stdout:4/926: write d2/f19 [1304987,95950] 0 2024-08-18T22:41:47.234 INFO:tasks.workunit.client.0.smithi121.stdout:3/934: sync 2024-08-18T22:41:47.235 INFO:tasks.workunit.client.0.smithi121.stdout:2/568: sync 2024-08-18T22:41:47.235 INFO:tasks.workunit.client.0.smithi121.stdout:7/900: sync 2024-08-18T22:41:47.235 INFO:tasks.workunit.client.0.smithi121.stdout:9/905: mknod d0/d5/dd/d1a/dc8/dfa/d7f/c12f 0 2024-08-18T22:41:47.236 INFO:tasks.workunit.client.0.smithi121.stdout:5/785: creat d3/d5/d27/ff5 x:0 0 0 2024-08-18T22:41:47.239 INFO:tasks.workunit.client.0.smithi121.stdout:9/906: dread - d0/d38/d9e/df/d3d/f95 zero size 2024-08-18T22:41:47.240 INFO:tasks.workunit.client.0.smithi121.stdout:5/786: read d3/d5/d3c/daf/fc3 [784029,55588] 0 2024-08-18T22:41:47.240 INFO:tasks.workunit.client.0.smithi121.stdout:0/804: dwrite d1/d4/db/d24/df/d8/d78/d7c/f113 [0,4194304] 0 2024-08-18T22:41:47.241 INFO:tasks.workunit.client.0.smithi121.stdout:2/569: creat d2/d3/d48/d77/fbd x:0 0 0 2024-08-18T22:41:47.241 INFO:tasks.workunit.client.1.smithi195.stdout:1/612: dwrite da/d4c/f69 [0,4194304] 0 2024-08-18T22:41:47.246 INFO:tasks.workunit.client.0.smithi121.stdout:9/907: fsync d0/d5/dd/d3b/d48/f74 0 2024-08-18T22:41:47.250 INFO:tasks.workunit.client.0.smithi121.stdout:4/927: link d2/d7c/fab d2/dc/d16/d22/d2c/d7a/da0/f154 0 2024-08-18T22:41:47.274 INFO:tasks.workunit.client.1.smithi195.stdout:1/613: rmdir da/d18/d43 39 2024-08-18T22:41:47.275 INFO:tasks.workunit.client.1.smithi195.stdout:1/614: truncate da/d18/d28/d31/d77/f9f 920759 0 2024-08-18T22:41:47.279 INFO:tasks.workunit.client.1.smithi195.stdout:1/615: truncate da/d18/d28/f2f 1458531 0 2024-08-18T22:41:47.334 INFO:tasks.workunit.client.1.smithi195.stdout:1/616: write da/d4c/d5d/dac/fb0 [1772959,17404] 0 2024-08-18T22:41:47.336 INFO:tasks.workunit.client.0.smithi121.stdout:3/935: dwrite d1e/d1f/d25/d58/d75/ff4 [0,4194304] 0 2024-08-18T22:41:47.336 INFO:tasks.workunit.client.0.smithi121.stdout:2/570: fdatasync d2/d3/f56 0 2024-08-18T22:41:47.336 INFO:tasks.workunit.client.1.smithi195.stdout:1/617: write da/d18/d28/d8e/d99/fb3 [835636,85100] 0 2024-08-18T22:41:47.338 INFO:tasks.workunit.client.1.smithi195.stdout:1/618: truncate da/d4c/d7a/f8d 69393 0 2024-08-18T22:41:47.338 INFO:tasks.workunit.client.0.smithi121.stdout:1/935: write d5/f49 [4689608,44459] 0 2024-08-18T22:41:47.340 INFO:tasks.workunit.client.0.smithi121.stdout:9/908: rename d0/d38/d9e/df/de6/ffe to d0/d38/d9e/df/d73/d12b/d92/dc6/dd5/f130 0 2024-08-18T22:41:47.342 INFO:tasks.workunit.client.0.smithi121.stdout:0/805: mknod d1/d4/db/d24/df/d8/d78/d7c/df5/c119 0 2024-08-18T22:41:47.343 INFO:tasks.workunit.client.1.smithi195.stdout:1/619: link da/d3d/l75 da/d18/d28/d8e/ld7 0 2024-08-18T22:41:47.343 INFO:tasks.workunit.client.0.smithi121.stdout:4/928: mkdir d2/dc/d16/d22/d2c/d44/d66/d155 0 2024-08-18T22:41:47.343 INFO:tasks.workunit.client.0.smithi121.stdout:1/936: stat d5/d10/d14/d2a/d3a/d87/d6c/d6f/d82/d15/d133/de4 0 2024-08-18T22:41:47.344 INFO:tasks.workunit.client.0.smithi121.stdout:2/571: creat d2/d8/d19/d4a/d64/fbe x:0 0 0 2024-08-18T22:41:47.347 INFO:tasks.workunit.client.0.smithi121.stdout:7/901: write de/d98/dfb/dce/d34/d38/d73/da2/d100/d18/d23/d24/d29/d43/d7f/f92 [1368676,69414] 0 2024-08-18T22:41:47.350 INFO:tasks.workunit.client.0.smithi121.stdout:3/936: rename d1e/d1f/d25/d67/d92/dbd/d126/f49 to d1e/d1f/dba/d113/d116/d123/f14a 0 2024-08-18T22:41:47.354 INFO:tasks.workunit.client.0.smithi121.stdout:7/902: rmdir de/d98/dfb/dce/d34/d38/dd6 39 2024-08-18T22:41:47.355 INFO:tasks.workunit.client.0.smithi121.stdout:2/572: symlink d2/d3/lbf 0 2024-08-18T22:41:47.355 INFO:tasks.workunit.client.0.smithi121.stdout:3/937: dread - d1e/d1f/dba/d113/d116/d128/f131 zero size 2024-08-18T22:41:47.356 INFO:tasks.workunit.client.0.smithi121.stdout:1/937: dwrite d5/d10/d14/d2a/d3a/d87/d6c/f121 [0,4194304] 0 2024-08-18T22:41:47.357 INFO:tasks.workunit.client.0.smithi121.stdout:0/806: dwrite d1/d4/db/d24/df/d8/d78/d7c/df5/daf/dd5/d90/f98 [0,4194304] 0 2024-08-18T22:41:47.357 INFO:tasks.workunit.client.1.smithi195.stdout:1/620: dread da/d18/d28/d31/f46 [4194304,4194304] 0 2024-08-18T22:41:47.361 INFO:tasks.workunit.client.0.smithi121.stdout:2/573: fdatasync d2/d3/d48/f4e 0 2024-08-18T22:41:47.361 INFO:tasks.workunit.client.0.smithi121.stdout:7/903: readlink de/d98/dfb/dce/d34/d38/d73/lf9 0 2024-08-18T22:41:47.365 INFO:tasks.workunit.client.0.smithi121.stdout:0/807: mknod d1/d4/db/d24/df/d8/d78/c11a 0 2024-08-18T22:41:47.367 INFO:tasks.workunit.client.0.smithi121.stdout:7/904: creat de/d98/dfb/dce/d34/d38/d73/f121 x:0 0 0 2024-08-18T22:41:47.369 INFO:tasks.workunit.client.0.smithi121.stdout:0/808: mknod d1/d4/db/d18/d40/c11b 0 2024-08-18T22:41:47.369 INFO:tasks.workunit.client.0.smithi121.stdout:7/905: truncate de/f1c 7351700 0 2024-08-18T22:41:47.371 INFO:tasks.workunit.client.0.smithi121.stdout:1/938: write d5/d10/d14/d2a/f60 [1806191,90830] 0 2024-08-18T22:41:47.371 INFO:tasks.workunit.client.0.smithi121.stdout:4/929: dread d2/dc/d1c/f3c [0,4194304] 0 2024-08-18T22:41:47.373 INFO:tasks.workunit.client.0.smithi121.stdout:0/809: mkdir d1/d4/db/d24/df/d8/d78/d7c/df5/daf/dd5/d5b/da5/d11c 0 2024-08-18T22:41:47.374 INFO:tasks.workunit.client.0.smithi121.stdout:4/930: readlink d2/dc/l18 0 2024-08-18T22:41:47.375 INFO:tasks.workunit.client.0.smithi121.stdout:7/906: mknod de/d98/dfb/dce/d34/d38/d73/da2/d100/d18/d23/d24/d29/d43/c122 0 2024-08-18T22:41:47.375 INFO:tasks.workunit.client.1.smithi195.stdout:1/621: dread da/d18/f1a [0,4194304] 0 2024-08-18T22:41:47.376 INFO:tasks.workunit.client.0.smithi121.stdout:0/810: creat d1/d4/d53/d61/f11d x:0 0 0 2024-08-18T22:41:47.381 INFO:tasks.workunit.client.0.smithi121.stdout:1/939: dwrite d5/d10/d14/d2a/d3a/d87/d6c/d6f/d82/d15/f2b [0,4194304] 0 2024-08-18T22:41:47.382 INFO:tasks.workunit.client.1.smithi195.stdout:1/622: dwrite da/d18/d28/d31/d77/f9f [0,4194304] 0 2024-08-18T22:41:47.382 INFO:tasks.workunit.client.1.smithi195.stdout:1/623: stat da/d4c/dd5 0 2024-08-18T22:41:47.385 INFO:tasks.workunit.client.1.smithi195.stdout:1/624: fsync da/d18/d28/d31/d3b/d4e/d95/d9c/fbb 0 2024-08-18T22:41:47.386 INFO:tasks.workunit.client.1.smithi195.stdout:1/625: chown da/d4c/d5d/fbc 8178 1 2024-08-18T22:41:47.387 INFO:tasks.workunit.client.0.smithi121.stdout:4/931: dwrite d2/dc/f52 [4194304,4194304] 0 2024-08-18T22:41:47.388 INFO:tasks.workunit.client.1.smithi195.stdout:1/626: symlink da/d4c/d7a/ld8 0 2024-08-18T22:41:47.389 INFO:tasks.workunit.client.0.smithi121.stdout:1/940: mkdir d5/d10/d67/dc2/df3/d114/d141 0 2024-08-18T22:41:47.389 INFO:tasks.workunit.client.1.smithi195.stdout:1/627: write da/d18/d28/f2d [1145628,57054] 0 2024-08-18T22:41:47.391 INFO:tasks.workunit.client.1.smithi195.stdout:1/628: chown da/d4c/d5d/cc0 567 1 2024-08-18T22:41:47.392 INFO:tasks.workunit.client.1.smithi195.stdout:1/629: chown da/d18/d28/c2c 226341 1 2024-08-18T22:41:47.393 INFO:tasks.workunit.client.0.smithi121.stdout:1/941: creat d5/d10/d67/f142 x:0 0 0 2024-08-18T22:41:47.394 INFO:tasks.workunit.client.1.smithi195.stdout:1/630: read da/d4c/d5d/d63/f64 [130427,19697] 0 2024-08-18T22:41:47.394 INFO:tasks.workunit.client.0.smithi121.stdout:0/811: rename d1/d4/db/d24/df/d8/d78/d7c/df5/cac to d1/d4/db/d24/df/d8/d78/d7c/df5/daf/dd5/c11e 0 2024-08-18T22:41:47.397 INFO:tasks.workunit.client.0.smithi121.stdout:2/574: dread d2/d3/d48/f4e [0,4194304] 0 2024-08-18T22:41:47.398 INFO:tasks.workunit.client.1.smithi195.stdout:9/516: sync 2024-08-18T22:41:47.399 INFO:tasks.workunit.client.1.smithi195.stdout:1/631: link da/d18/d28/f2f da/d18/dc6/fd9 0 2024-08-18T22:41:47.400 INFO:tasks.workunit.client.1.smithi195.stdout:9/517: dread - d1c/f6a zero size 2024-08-18T22:41:47.400 INFO:tasks.workunit.client.1.smithi195.stdout:9/518: stat d1c/d74/d8e/f93 0 2024-08-18T22:41:47.401 INFO:tasks.workunit.client.1.smithi195.stdout:1/632: unlink da/d18/c26 0 2024-08-18T22:41:47.401 INFO:tasks.workunit.client.1.smithi195.stdout:1/633: dread - da/d68/f94 zero size 2024-08-18T22:41:47.402 INFO:tasks.workunit.client.0.smithi121.stdout:0/812: chown d1/d4/db/d24/df/d8/d78/d7c/df5/daf/dcb/cd2 48 1 2024-08-18T22:41:47.402 INFO:tasks.workunit.client.0.smithi121.stdout:4/932: dwrite d2/dc/d16/d22/d2c/d44/f78 [4194304,4194304] 0 2024-08-18T22:41:47.404 INFO:tasks.workunit.client.1.smithi195.stdout:1/634: mkdir da/d4c/d5d/dac/db1/dda 0 2024-08-18T22:41:47.405 INFO:tasks.workunit.client.0.smithi121.stdout:7/907: dwrite de/d98/dfb/dce/d34/d38/d73/da2/d100/d18/d23/d24/d29/d43/d7f/f80 [0,4194304] 0 2024-08-18T22:41:47.407 INFO:tasks.workunit.client.0.smithi121.stdout:1/942: link d5/d10/d14/c7e d5/d10/d14/d92/d9f/c143 0 2024-08-18T22:41:47.414 INFO:tasks.workunit.client.1.smithi195.stdout:1/635: dread da/d18/d28/d31/f84 [0,4194304] 0 2024-08-18T22:41:47.414 INFO:tasks.workunit.client.0.smithi121.stdout:2/575: read d2/d3/d48/fad [3639938,109551] 0 2024-08-18T22:41:47.414 INFO:tasks.workunit.client.0.smithi121.stdout:0/813: write d1/d4/db/d24/df/d8/d78/d7c/df5/daf/dd5/d90/dc3/fe1 [295865,35087] 0 2024-08-18T22:41:47.414 INFO:tasks.workunit.client.0.smithi121.stdout:7/908: mkdir de/d98/dfb/dce/d2f/d4b/d6d/d123 0 2024-08-18T22:41:47.415 INFO:tasks.workunit.client.0.smithi121.stdout:3/938: read d1e/d1f/d25/f54 [1059746,63652] 0 2024-08-18T22:41:47.418 INFO:tasks.workunit.client.0.smithi121.stdout:7/909: fdatasync de/d98/dfb/dce/d2f/d4b/ff2 0 2024-08-18T22:41:47.420 INFO:tasks.workunit.client.1.smithi195.stdout:1/636: rename da/d18/d28/d31/d3b to da/d4c/d7a/dbd/ddb 0 2024-08-18T22:41:47.423 INFO:tasks.workunit.client.0.smithi121.stdout:7/910: mknod de/d98/dfb/dce/d34/d38/d73/da2/d100/d18/c124 0 2024-08-18T22:41:47.423 INFO:tasks.workunit.client.1.smithi195.stdout:1/637: mkdir da/d4c/d7a/dbd/ddb/d4e/ddc 0 2024-08-18T22:41:47.424 INFO:tasks.workunit.client.0.smithi121.stdout:0/814: getdents d1/d4/da/d2f/da0 0 2024-08-18T22:41:47.424 INFO:tasks.workunit.client.0.smithi121.stdout:7/911: chown de/da4/f112 0 1 2024-08-18T22:41:47.425 INFO:tasks.workunit.client.1.smithi195.stdout:9/519: dread d1c/f44 [0,4194304] 0 2024-08-18T22:41:47.426 INFO:tasks.workunit.client.0.smithi121.stdout:3/939: getdents d1e/d1f/dba/d113/d116/d128/d5f/dd2 0 2024-08-18T22:41:47.427 INFO:tasks.workunit.client.1.smithi195.stdout:1/638: unlink da/d4c/d7a/dbd/ddb/f3c 0 2024-08-18T22:41:47.427 INFO:tasks.workunit.client.0.smithi121.stdout:9/909: dread d0/d5/f30 [0,4194304] 0 2024-08-18T22:41:47.428 INFO:tasks.workunit.client.1.smithi195.stdout:9/520: symlink d1c/d74/d7b/d82/la6 0 2024-08-18T22:41:47.428 INFO:tasks.workunit.client.0.smithi121.stdout:3/940: write d1e/d1f/d3e/f73 [1718173,50709] 0 2024-08-18T22:41:47.428 INFO:tasks.workunit.client.1.smithi195.stdout:9/521: chown d1c/f26 333 1 2024-08-18T22:41:47.430 INFO:tasks.workunit.client.0.smithi121.stdout:0/815: rename d1/d4/db/d24/df/d8/d78/d7c/df5/c119 to d1/d4/db/d24/df/d8/d78/d7c/df5/daf/ddd/c11f 0 2024-08-18T22:41:47.430 INFO:tasks.workunit.client.1.smithi195.stdout:9/522: chown d1c/d32/d37/f42 13206 1 2024-08-18T22:41:47.431 INFO:tasks.workunit.client.0.smithi121.stdout:3/941: write d1e/d1f/d25/d58/de0/f129 [4449048,55726] 0 2024-08-18T22:41:47.432 INFO:tasks.workunit.client.0.smithi121.stdout:4/933: truncate d2/dc/d16/d47/dea/f11d 4148442 0 2024-08-18T22:41:47.433 INFO:tasks.workunit.client.0.smithi121.stdout:2/576: write d2/f54 [867553,46657] 0 2024-08-18T22:41:47.434 INFO:tasks.workunit.client.0.smithi121.stdout:9/910: chown d0/d38/d9e/d45/dba/lc1 11509 1 2024-08-18T22:41:47.434 INFO:tasks.workunit.client.1.smithi195.stdout:9/523: dread d1c/f64 [0,4194304] 0 2024-08-18T22:41:47.435 INFO:tasks.workunit.client.0.smithi121.stdout:1/943: write d5/d10/d14/d2a/d3a/d87/d6c/d6f/d82/d15/f6b [658233,50818] 0 2024-08-18T22:41:47.436 INFO:tasks.workunit.client.0.smithi121.stdout:4/934: write d2/dc/d1c/f12a [3399506,50464] 0 2024-08-18T22:41:47.438 INFO:tasks.workunit.client.0.smithi121.stdout:0/816: mkdir d1/d8a/d120 0 2024-08-18T22:41:47.440 INFO:tasks.workunit.client.0.smithi121.stdout:0/817: fsync d1/d4/db/fc4 0 2024-08-18T22:41:47.445 INFO:tasks.workunit.client.0.smithi121.stdout:4/935: symlink d2/dc/d16/d22/d2c/d44/da9/dae/l156 0 2024-08-18T22:41:47.445 INFO:tasks.workunit.client.1.smithi195.stdout:1/639: dread f6 [0,4194304] 0 2024-08-18T22:41:47.446 INFO:tasks.workunit.client.1.smithi195.stdout:1/640: chown da/d3d 7222228 1 2024-08-18T22:41:47.446 INFO:tasks.workunit.client.0.smithi121.stdout:2/577: mknod d2/d8/d19/cc0 0 2024-08-18T22:41:47.448 INFO:tasks.workunit.client.0.smithi121.stdout:0/818: mkdir d1/d4/db/d24/df/d8/d71/d79/d121 0 2024-08-18T22:41:47.449 INFO:tasks.workunit.client.0.smithi121.stdout:1/944: dread d5/d10/d14/d2a/d3a/d87/d6c/d6f/d82/d15/d38/fb6 [0,4194304] 0 2024-08-18T22:41:47.451 INFO:tasks.workunit.client.0.smithi121.stdout:2/578: readlink d2/d3/l2b 0 2024-08-18T22:41:47.451 INFO:tasks.workunit.client.1.smithi195.stdout:9/524: dwrite d1c/f3c [0,4194304] 0 2024-08-18T22:41:47.452 INFO:tasks.workunit.client.0.smithi121.stdout:3/942: truncate d1e/d1f/dba/d113/d116/ffd 2956548 0 2024-08-18T22:41:47.452 INFO:tasks.workunit.client.1.smithi195.stdout:1/641: link da/d18/d28/c90 da/d4c/d5d/d63/cdd 0 2024-08-18T22:41:47.454 INFO:tasks.workunit.client.1.smithi195.stdout:9/525: rename d1c/d32/f52 to d1c/d74/d7b/d82/d98/fa7 0 2024-08-18T22:41:47.457 INFO:tasks.workunit.client.1.smithi195.stdout:9/526: creat d1c/fa8 x:0 0 0 2024-08-18T22:41:47.460 INFO:tasks.workunit.client.1.smithi195.stdout:9/527: rename d1c/d70/fa4 to d1c/fa9 0 2024-08-18T22:41:47.460 INFO:tasks.workunit.client.0.smithi121.stdout:9/911: dwrite d0/d5/fa [0,4194304] 0 2024-08-18T22:41:47.461 INFO:tasks.workunit.client.1.smithi195.stdout:9/528: symlink d1c/d32/d71/d75/laa 0 2024-08-18T22:41:47.463 INFO:tasks.workunit.client.0.smithi121.stdout:4/936: dwrite d2/dc/d16/d22/fb0 [4194304,4194304] 0 2024-08-18T22:41:47.463 INFO:tasks.workunit.client.0.smithi121.stdout:9/912: chown d0/d38/d9e/d45/dba/lca 14851749 1 2024-08-18T22:41:47.463 INFO:tasks.workunit.client.0.smithi121.stdout:3/943: fdatasync d1e/d1f/dba/d113/d116/ffd 0 2024-08-18T22:41:47.465 INFO:tasks.workunit.client.1.smithi195.stdout:9/529: link d1c/d32/l57 d1c/d32/d71/lab 0 2024-08-18T22:41:47.468 INFO:tasks.workunit.client.1.smithi195.stdout:9/530: getdents d1c/d32/d37 0 2024-08-18T22:41:47.469 INFO:tasks.workunit.client.1.smithi195.stdout:9/531: read d1c/d32/f84 [3284454,74604] 0 2024-08-18T22:41:47.471 INFO:tasks.workunit.client.1.smithi195.stdout:9/532: mknod d1c/d92/d9a/cac 0 2024-08-18T22:41:47.472 INFO:tasks.workunit.client.0.smithi121.stdout:9/913: mknod d0/d5/dd/c131 0 2024-08-18T22:41:47.474 INFO:tasks.workunit.client.0.smithi121.stdout:4/937: rename d2/dc/d16/d59/d83/dd7/d90/db3 to d2/dc/d16/d22/d2c/d44/d66/d157 0 2024-08-18T22:41:47.475 INFO:tasks.workunit.client.0.smithi121.stdout:1/945: fsync d5/d10/d14/d2a/d3a/d87/d6c/d6f/d82/d15/d28/d3d/d9a/dac/f123 0 2024-08-18T22:41:47.477 INFO:tasks.workunit.client.0.smithi121.stdout:9/914: mknod d0/d38/d9e/d18/dfd/c132 0 2024-08-18T22:41:47.478 INFO:tasks.workunit.client.0.smithi121.stdout:9/915: stat d0/d5/dd/d3b/d48/feb 0 2024-08-18T22:41:47.482 INFO:tasks.workunit.client.0.smithi121.stdout:4/938: read d2/dc/d16/d47/dea/f11d [2755773,21985] 0 2024-08-18T22:41:47.484 INFO:tasks.workunit.client.0.smithi121.stdout:9/916: mknod d0/d38/d52/c133 0 2024-08-18T22:41:47.486 INFO:tasks.workunit.client.1.smithi195.stdout:9/533: rmdir d1c/d32/d71/d75 39 2024-08-18T22:41:47.486 INFO:tasks.workunit.client.0.smithi121.stdout:1/946: truncate d5/f49 3653665 0 2024-08-18T22:41:47.489 INFO:tasks.workunit.client.0.smithi121.stdout:9/917: chown d0/d38/d9e/df/d73/d12b/d92/c12e 172 1 2024-08-18T22:41:47.491 INFO:tasks.workunit.client.1.smithi195.stdout:9/534: write d1c/f6a [285287,57769] 0 2024-08-18T22:41:47.493 INFO:tasks.workunit.client.1.smithi195.stdout:9/535: creat d1c/d32/d37/fad x:0 0 0 2024-08-18T22:41:47.494 INFO:tasks.workunit.client.0.smithi121.stdout:9/918: write d0/d38/d9e/df/d3d/fd3 [778279,103504] 0 2024-08-18T22:41:47.494 INFO:tasks.workunit.client.1.smithi195.stdout:9/536: fsync f13 0 2024-08-18T22:41:47.495 INFO:tasks.workunit.client.1.smithi195.stdout:9/537: fdatasync d1c/f47 0 2024-08-18T22:41:47.496 INFO:tasks.workunit.client.0.smithi121.stdout:0/819: dread d1/d4/d53/da7/f5c [0,4194304] 0 2024-08-18T22:41:47.496 INFO:tasks.workunit.client.0.smithi121.stdout:3/944: dread d1e/d1f/dba/d113/d116/d128/f68 [4194304,4194304] 0 2024-08-18T22:41:47.496 INFO:tasks.workunit.client.1.smithi195.stdout:9/538: write d1c/d32/f91 [198171,76448] 0 2024-08-18T22:41:47.499 INFO:tasks.workunit.client.0.smithi121.stdout:2/579: dread d2/d3/f56 [0,4194304] 0 2024-08-18T22:41:47.499 INFO:tasks.workunit.client.0.smithi121.stdout:4/939: truncate d2/dc/d16/d59/d83/dd7/fb2 2360627 0 2024-08-18T22:41:47.500 INFO:tasks.workunit.client.1.smithi195.stdout:9/539: creat d1c/d32/d71/d75/fae x:0 0 0 2024-08-18T22:41:47.501 INFO:tasks.workunit.client.1.smithi195.stdout:9/540: write d1c/d32/f66 [1836087,85722] 0 2024-08-18T22:41:47.502 INFO:tasks.workunit.client.1.smithi195.stdout:9/541: chown d1c/d74/d7b/d82/d98/c9e 6933 1 2024-08-18T22:41:47.502 INFO:tasks.workunit.client.1.smithi195.stdout:9/542: chown d1c/f26 4 1 2024-08-18T22:41:47.504 INFO:tasks.workunit.client.1.smithi195.stdout:9/543: getdents d1c/d74/d7b 0 2024-08-18T22:41:47.505 INFO:tasks.workunit.client.1.smithi195.stdout:9/544: write d1c/d74/d7b/d82/f9b [1018446,5315] 0 2024-08-18T22:41:47.505 INFO:tasks.workunit.client.0.smithi121.stdout:0/820: read d1/d4/db/d24/f42 [237472,48106] 0 2024-08-18T22:41:47.506 INFO:tasks.workunit.client.0.smithi121.stdout:9/919: chown d0/d38/d52/d5f/de1/d122/l113 103186 1 2024-08-18T22:41:47.506 INFO:tasks.workunit.client.1.smithi195.stdout:9/545: getdents d1c/d92/d96/d9d 0 2024-08-18T22:41:47.508 INFO:tasks.workunit.client.0.smithi121.stdout:3/945: mkdir d1e/d1f/dba/d113/d116/d123/d14b 0 2024-08-18T22:41:47.509 INFO:tasks.workunit.client.0.smithi121.stdout:4/940: read d2/dc/d16/d22/d29/f26 [7951840,26881] 0 2024-08-18T22:41:47.509 INFO:tasks.workunit.client.1.smithi195.stdout:9/546: link d1c/d32/d71/f79 d1c/d74/d8e/faf 0 2024-08-18T22:41:47.510 INFO:tasks.workunit.client.0.smithi121.stdout:1/947: dwrite d5/d10/d14/d2a/d3a/d87/d6c/d6f/f77 [0,4194304] 0 2024-08-18T22:41:47.510 INFO:tasks.workunit.client.1.smithi195.stdout:9/547: fdatasync f0 0 2024-08-18T22:41:47.514 INFO:tasks.workunit.client.0.smithi121.stdout:2/580: rename d2/d8/d19/dc/f3c to d2/d73/fc1 0 2024-08-18T22:41:47.521 INFO:tasks.workunit.client.0.smithi121.stdout:9/920: dwrite d0/fad [0,4194304] 0 2024-08-18T22:41:47.522 INFO:tasks.workunit.client.0.smithi121.stdout:2/581: chown d2/d8/d19/d4a/l98 55061 1 2024-08-18T22:41:47.525 INFO:tasks.workunit.client.1.smithi195.stdout:9/548: dread d1c/f58 [0,4194304] 0 2024-08-18T22:41:47.525 INFO:tasks.workunit.client.0.smithi121.stdout:9/921: rmdir d0/d5 39 2024-08-18T22:41:47.527 INFO:tasks.workunit.client.1.smithi195.stdout:9/549: mknod d1c/d74/d7b/d82/d90/cb0 0 2024-08-18T22:41:47.527 INFO:tasks.workunit.client.1.smithi195.stdout:9/550: chown d1c/f45 199213700 1 2024-08-18T22:41:47.528 INFO:tasks.workunit.client.0.smithi121.stdout:3/946: dwrite d1e/d1f/dba/df6/f137 [0,4194304] 0 2024-08-18T22:41:47.528 INFO:tasks.workunit.client.1.smithi195.stdout:9/551: stat d1c/f23 0 2024-08-18T22:41:47.532 INFO:tasks.workunit.client.1.smithi195.stdout:5/520: sync 2024-08-18T22:41:47.532 INFO:tasks.workunit.client.1.smithi195.stdout:0/620: sync 2024-08-18T22:41:47.533 INFO:tasks.workunit.client.1.smithi195.stdout:2/357: sync 2024-08-18T22:41:47.533 INFO:tasks.workunit.client.1.smithi195.stdout:6/476: sync 2024-08-18T22:41:47.533 INFO:tasks.workunit.client.1.smithi195.stdout:3/629: sync 2024-08-18T22:41:47.533 INFO:tasks.workunit.client.1.smithi195.stdout:8/632: sync 2024-08-18T22:41:47.533 INFO:tasks.workunit.client.1.smithi195.stdout:9/552: getdents d1c/d74/d7b/d82 0 2024-08-18T22:41:47.533 INFO:tasks.workunit.client.0.smithi121.stdout:3/947: dread - d1e/d1f/d2a/fe7 zero size 2024-08-18T22:41:47.534 INFO:tasks.workunit.client.1.smithi195.stdout:5/521: dread - d0/f77 zero size 2024-08-18T22:41:47.534 INFO:tasks.workunit.client.0.smithi121.stdout:4/941: truncate d2/dc/d16/d22/d2c/d44/d8c/f99 1218443 0 2024-08-18T22:41:47.535 INFO:tasks.workunit.client.0.smithi121.stdout:9/922: mkdir d0/d5/dd/d134 0 2024-08-18T22:41:47.536 INFO:tasks.workunit.client.0.smithi121.stdout:0/821: dwrite d1/d4/da/d2f/da0/f8c [0,4194304] 0 2024-08-18T22:41:47.536 INFO:tasks.workunit.client.1.smithi195.stdout:3/630: fsync d7/da/df/d1c/d6a/f76 0 2024-08-18T22:41:47.539 INFO:tasks.workunit.client.1.smithi195.stdout:8/633: unlink d1/de/d27/c63 0 2024-08-18T22:41:47.540 INFO:tasks.workunit.client.0.smithi121.stdout:2/582: read d2/d3/d48/d77/f3b [2896822,80218] 0 2024-08-18T22:41:47.540 INFO:tasks.workunit.client.0.smithi121.stdout:3/948: mkdir d1e/d1f/d25/d58/df7/d11d/d14c 0 2024-08-18T22:41:47.541 INFO:tasks.workunit.client.1.smithi195.stdout:6/477: rename da/d22/f7b to da/db/d19/d72/f8a 0 2024-08-18T22:41:47.541 INFO:tasks.workunit.client.0.smithi121.stdout:1/948: link d5/d10/d14/d2a/d3a/d87/d6c/d6f/d82/ddb/c140 d5/d10/d14/d2a/d3a/d87/d6c/d6f/d82/d11/d132/c144 0 2024-08-18T22:41:47.543 INFO:tasks.workunit.client.0.smithi121.stdout:0/822: fsync d1/d4/db/d24/df/d8/d71/d79/f92 0 2024-08-18T22:41:47.545 INFO:tasks.workunit.client.1.smithi195.stdout:5/522: dread d0/d3/f27 [0,4194304] 0 2024-08-18T22:41:47.546 INFO:tasks.workunit.client.1.smithi195.stdout:9/553: getdents d1c/d74/d7b/d82/d98 0 2024-08-18T22:41:47.546 INFO:tasks.workunit.client.1.smithi195.stdout:6/478: creat da/d15/d1c/d64/f8b x:0 0 0 2024-08-18T22:41:47.547 INFO:tasks.workunit.client.1.smithi195.stdout:6/479: truncate da/db/f70 890200 0 2024-08-18T22:41:47.548 INFO:tasks.workunit.client.1.smithi195.stdout:6/480: read - da/d15/d1c/d2e/d74/f7f zero size 2024-08-18T22:41:47.549 INFO:tasks.workunit.client.1.smithi195.stdout:0/621: rename d0/dc/d64/d81/d44/d41/d4c/f82 to d0/dc/d64/d81/d44/d41/d6d/da5/fcc 0 2024-08-18T22:41:47.549 INFO:tasks.workunit.client.0.smithi121.stdout:4/942: dwrite d2/d7c/f7f [0,4194304] 0 2024-08-18T22:41:47.550 INFO:tasks.workunit.client.1.smithi195.stdout:8/634: link d1/d3/db/d39/d44/d79/dd9/ceb d1/d3/db/d39/d2e/cec 0 2024-08-18T22:41:47.551 INFO:tasks.workunit.client.1.smithi195.stdout:0/622: write d0/dc/d64/d81/d44/d41/d6d/da5/fb2 [176745,96715] 0 2024-08-18T22:41:47.553 INFO:tasks.workunit.client.0.smithi121.stdout:1/949: write d5/d10/d14/d2a/d3a/d87/d6c/d6f/d82/d15/d38/f72 [4038690,118471] 0 2024-08-18T22:41:47.553 INFO:tasks.workunit.client.0.smithi121.stdout:4/943: dread - d2/dc/d1c/daa/fac zero size 2024-08-18T22:41:47.553 INFO:tasks.workunit.client.1.smithi195.stdout:6/481: mkdir da/db/d78/d8c 0 2024-08-18T22:41:47.559 INFO:tasks.workunit.client.0.smithi121.stdout:1/950: truncate d5/d10/d14/d2a/d3a/d87/d6c/d6f/d82/d15/d38/f12d 636544 0 2024-08-18T22:41:47.559 INFO:tasks.workunit.client.1.smithi195.stdout:5/523: link d0/d46/d6d/l75 d0/d3/d66/la3 0 2024-08-18T22:41:47.560 INFO:tasks.workunit.client.0.smithi121.stdout:4/944: creat d2/dc/d16/d22/d2c/d44/d111/d150/f158 x:0 0 0 2024-08-18T22:41:47.560 INFO:tasks.workunit.client.0.smithi121.stdout:5/787: sync 2024-08-18T22:41:47.561 INFO:tasks.workunit.client.1.smithi195.stdout:5/524: readlink d0/d2/l59 0 2024-08-18T22:41:47.561 INFO:tasks.workunit.client.0.smithi121.stdout:1/951: creat d5/d10/d14/d2a/d3a/f145 x:0 0 0 2024-08-18T22:41:47.562 INFO:tasks.workunit.client.1.smithi195.stdout:3/631: rename d7/d1f/d74 to d7/da/df/dca 0 2024-08-18T22:41:47.563 INFO:tasks.workunit.client.1.smithi195.stdout:2/358: dwrite d1/d8/d3d/d5e/f68 [0,4194304] 0 2024-08-18T22:41:47.563 INFO:tasks.workunit.client.0.smithi121.stdout:5/788: rmdir d3/d5/d13/d23/d66 39 2024-08-18T22:41:47.565 INFO:tasks.workunit.client.0.smithi121.stdout:0/823: write d1/d4/da/d2f/f5e [383082,86164] 0 2024-08-18T22:41:47.565 INFO:tasks.workunit.client.1.smithi195.stdout:5/525: symlink d0/d3/df/la4 0 2024-08-18T22:41:47.567 INFO:tasks.workunit.client.1.smithi195.stdout:5/526: stat d0/d3/c4f 0 2024-08-18T22:41:47.568 INFO:tasks.workunit.client.0.smithi121.stdout:1/952: fdatasync d5/d10/d14/d2a/f8d 0 2024-08-18T22:41:47.568 INFO:tasks.workunit.client.1.smithi195.stdout:0/623: dread d0/dc/dd/f59 [0,4194304] 0 2024-08-18T22:41:47.569 INFO:tasks.workunit.client.1.smithi195.stdout:6/482: creat da/f8d x:0 0 0 2024-08-18T22:41:47.570 INFO:tasks.workunit.client.1.smithi195.stdout:6/483: chown da/d15/c1f 119778983 1 2024-08-18T22:41:47.571 INFO:tasks.workunit.client.0.smithi121.stdout:9/923: dread d0/d38/d9e/df/d73/f10f [0,4194304] 0 2024-08-18T22:41:47.572 INFO:tasks.workunit.client.1.smithi195.stdout:0/624: unlink d0/l2 0 2024-08-18T22:41:47.574 INFO:tasks.workunit.client.1.smithi195.stdout:1/642: sync 2024-08-18T22:41:47.575 INFO:tasks.workunit.client.1.smithi195.stdout:7/619: sync 2024-08-18T22:41:47.575 INFO:tasks.workunit.client.1.smithi195.stdout:4/538: sync 2024-08-18T22:41:47.576 INFO:tasks.workunit.client.1.smithi195.stdout:5/527: dwrite d0/d2/d29/d88/d6a/f80 [0,4194304] 0 2024-08-18T22:41:47.578 INFO:tasks.workunit.client.1.smithi195.stdout:9/554: rename d1c/d32/d71/d75 to d1c/d32/db1 0 2024-08-18T22:41:47.578 INFO:tasks.workunit.client.1.smithi195.stdout:3/632: creat d7/d1f/d73/db0/fcb x:0 0 0 2024-08-18T22:41:47.578 INFO:tasks.workunit.client.0.smithi121.stdout:2/583: dwrite d2/d8/d19/d55/f70 [0,4194304] 0 2024-08-18T22:41:47.579 INFO:tasks.workunit.client.1.smithi195.stdout:2/359: link d1/d24/f56 d1/d24/d26/d42/d5c/f6a 0 2024-08-18T22:41:47.583 INFO:tasks.workunit.client.1.smithi195.stdout:6/484: mkdir da/db/d26/d2d/d8e 0 2024-08-18T22:41:47.583 INFO:tasks.workunit.client.1.smithi195.stdout:4/539: dread - d0/d7/d1d/d69/f8f zero size 2024-08-18T22:41:47.584 INFO:tasks.workunit.client.0.smithi121.stdout:1/953: truncate d5/d10/d14/f90 464051 0 2024-08-18T22:41:47.584 INFO:tasks.workunit.client.1.smithi195.stdout:1/643: chown da/d18/d28/d31/fbf 8445 1 2024-08-18T22:41:47.585 INFO:tasks.workunit.client.1.smithi195.stdout:9/555: symlink d1c/d74/d7b/lb2 0 2024-08-18T22:41:47.585 INFO:tasks.workunit.client.0.smithi121.stdout:3/949: dwrite d1e/d1f/da6/dc7/dae/ff3 [0,4194304] 0 2024-08-18T22:41:47.588 INFO:tasks.workunit.client.0.smithi121.stdout:0/824: getdents d1/d4/db/d24/df/d8/d78/d7c 0 2024-08-18T22:41:47.589 INFO:tasks.workunit.client.0.smithi121.stdout:2/584: stat d2/d8/d19/d4a/la1 0 2024-08-18T22:41:47.589 INFO:tasks.workunit.client.0.smithi121.stdout:5/789: dwrite d3/d5/d13/d19/d24/d32/d38/f85 [0,4194304] 0 2024-08-18T22:41:47.590 INFO:tasks.workunit.client.1.smithi195.stdout:1/644: read - da/d3d/fb9 zero size 2024-08-18T22:41:47.591 INFO:tasks.workunit.client.1.smithi195.stdout:2/360: read d1/d8/d3d/d5e/f68 [4454740,118129] 0 2024-08-18T22:41:47.591 INFO:tasks.workunit.client.1.smithi195.stdout:7/620: truncate dc/d1d/d29/ddb/d15/d17/d18/d89/fd2 911511 0 2024-08-18T22:41:47.592 INFO:tasks.workunit.client.1.smithi195.stdout:9/556: truncate f15 2405570 0 2024-08-18T22:41:47.594 INFO:tasks.workunit.client.0.smithi121.stdout:3/950: truncate f12 2514817 0 2024-08-18T22:41:47.594 INFO:tasks.workunit.client.0.smithi121.stdout:4/945: dwrite d2/dc/d16/d22/d2c/d7a/da0/dcc/fda [0,4194304] 0 2024-08-18T22:41:47.594 INFO:tasks.workunit.client.1.smithi195.stdout:6/485: creat da/d15/d1c/f8f x:0 0 0 2024-08-18T22:41:47.594 INFO:tasks.workunit.client.1.smithi195.stdout:7/621: chown dc/d1d/d29/ddb/d2b 5 1 2024-08-18T22:41:47.594 INFO:tasks.workunit.client.1.smithi195.stdout:4/540: symlink d0/d7/d1d/d69/db7/d41/d66/lb9 0 2024-08-18T22:41:47.595 INFO:tasks.workunit.client.1.smithi195.stdout:5/528: dread d0/db/f65 [0,4194304] 0 2024-08-18T22:41:47.595 INFO:tasks.workunit.client.0.smithi121.stdout:9/924: rename d0/d5/dd/d1a/dc8/dfa/dbf/d60/fd6 to d0/d5/dd/d3b/d48/f135 0 2024-08-18T22:41:47.595 INFO:tasks.workunit.client.1.smithi195.stdout:9/557: read d1c/d70/f86 [716634,123402] 0 2024-08-18T22:41:47.597 INFO:tasks.workunit.client.0.smithi121.stdout:1/954: fsync d5/d10/d14/d2a/daf/fb1 0 2024-08-18T22:41:47.599 INFO:tasks.workunit.client.1.smithi195.stdout:9/558: chown d1c/d32/d71 4642 1 2024-08-18T22:41:47.600 INFO:tasks.workunit.client.1.smithi195.stdout:8/635: rename d1/de/df/f58 to d1/de/df/d1d/fed 0 2024-08-18T22:41:47.601 INFO:tasks.workunit.client.1.smithi195.stdout:0/625: getdents d0/dc/d64/d81/d44/d41/d4c 0 2024-08-18T22:41:47.601 INFO:tasks.workunit.client.0.smithi121.stdout:3/951: chown d1e/d1f/d25/d67/d92/d111/d13e/d104/d9a/fcf 6080 1 2024-08-18T22:41:47.601 INFO:tasks.workunit.client.0.smithi121.stdout:0/825: mknod d1/d4/db/d18/d1c/c122 0 2024-08-18T22:41:47.602 INFO:tasks.workunit.client.1.smithi195.stdout:0/626: stat d0/dc/d25/d67/fb0 0 2024-08-18T22:41:47.602 INFO:tasks.workunit.client.0.smithi121.stdout:4/946: unlink d2/dc/d16/d22/fbd 0 2024-08-18T22:41:47.606 INFO:tasks.workunit.client.0.smithi121.stdout:3/952: write d1e/d1f/d25/d67/d92/d111/f121 [1263933,78382] 0 2024-08-18T22:41:47.606 INFO:tasks.workunit.client.1.smithi195.stdout:7/622: fsync dc/d1d/d29/ddb/d15/d4d/f79 0 2024-08-18T22:41:47.607 INFO:tasks.workunit.client.0.smithi121.stdout:5/790: creat d3/d5/d13/d23/d66/ff6 x:0 0 0 2024-08-18T22:41:47.608 INFO:tasks.workunit.client.1.smithi195.stdout:6/486: dread da/d22/d86/f79 [0,4194304] 0 2024-08-18T22:41:47.608 INFO:tasks.workunit.client.0.smithi121.stdout:2/585: creat d2/d8/fc2 x:0 0 0 2024-08-18T22:41:47.610 INFO:tasks.workunit.client.1.smithi195.stdout:5/529: read d0/d3/d66/f8c [546991,34878] 0 2024-08-18T22:41:47.610 INFO:tasks.workunit.client.1.smithi195.stdout:3/633: mknod d7/da/df/d1c/dc6/ccc 0 2024-08-18T22:41:47.610 INFO:tasks.workunit.client.1.smithi195.stdout:4/541: rmdir d0/d7/d1d/d69/db7/d6c 39 2024-08-18T22:41:47.612 INFO:tasks.workunit.client.1.smithi195.stdout:6/487: truncate da/db/f70 1580734 0 2024-08-18T22:41:47.612 INFO:tasks.workunit.client.0.smithi121.stdout:0/826: dwrite d1/d4/db/d24/df/d8/d78/f7a [0,4194304] 0 2024-08-18T22:41:47.612 INFO:tasks.workunit.client.1.smithi195.stdout:3/634: write d7/f5c [2726446,70670] 0 2024-08-18T22:41:47.613 INFO:tasks.workunit.client.0.smithi121.stdout:3/953: fsync d1e/d1f/d25/d67/d92/dbd/d126/f109 0 2024-08-18T22:41:47.618 INFO:tasks.workunit.client.1.smithi195.stdout:1/645: mknod da/d4c/d5d/cde 0 2024-08-18T22:41:47.618 INFO:tasks.workunit.client.1.smithi195.stdout:1/646: truncate da/d3d/f92 4853034 0 2024-08-18T22:41:47.618 INFO:tasks.workunit.client.1.smithi195.stdout:0/627: write d0/dc/d11/d23/d51/f9f [735692,112947] 0 2024-08-18T22:41:47.619 INFO:tasks.workunit.client.0.smithi121.stdout:1/955: creat d5/d10/d14/f146 x:0 0 0 2024-08-18T22:41:47.619 INFO:tasks.workunit.client.0.smithi121.stdout:9/925: creat d0/d38/f136 x:0 0 0 2024-08-18T22:41:47.619 INFO:tasks.workunit.client.0.smithi121.stdout:5/791: creat d3/d5/d13/d23/ff7 x:0 0 0 2024-08-18T22:41:47.619 INFO:tasks.workunit.client.1.smithi195.stdout:2/361: rmdir d1/d24/d26/d42/d50/d69 0 2024-08-18T22:41:47.621 INFO:tasks.workunit.client.0.smithi121.stdout:0/827: truncate d1/d4/db/d24/f48 1371194 0 2024-08-18T22:41:47.622 INFO:tasks.workunit.client.0.smithi121.stdout:3/954: write d1e/d1f/da6/dc7/dae/ff3 [4927217,97687] 0 2024-08-18T22:41:47.625 INFO:tasks.workunit.client.1.smithi195.stdout:8/636: write d1/de/df/d1d/d1f/f98 [341249,127893] 0 2024-08-18T22:41:47.626 INFO:tasks.workunit.client.0.smithi121.stdout:4/947: dwrite d2/dc/d16/d22/d2c/d44/da7/f137 [0,4194304] 0 2024-08-18T22:41:47.628 INFO:tasks.workunit.client.1.smithi195.stdout:1/647: creat da/d4c/d5d/dac/db1/fdf x:0 0 0 2024-08-18T22:41:47.629 INFO:tasks.workunit.client.1.smithi195.stdout:1/648: readlink da/d18/d28/d31/l4b 0 2024-08-18T22:41:47.631 INFO:tasks.workunit.client.1.smithi195.stdout:7/623: link f5 dc/d22/fdd 0 2024-08-18T22:41:47.631 INFO:tasks.workunit.client.0.smithi121.stdout:1/956: mknod d5/d10/c147 0 2024-08-18T22:41:47.632 INFO:tasks.workunit.client.1.smithi195.stdout:8/637: truncate d1/f7d 1180159 0 2024-08-18T22:41:47.633 INFO:tasks.workunit.client.1.smithi195.stdout:9/559: getdents d1c/d92/d96 0 2024-08-18T22:41:47.634 INFO:tasks.workunit.client.1.smithi195.stdout:8/638: write d1/f5 [5546685,43688] 0 2024-08-18T22:41:47.635 INFO:tasks.workunit.client.1.smithi195.stdout:8/639: chown d1/de 1847355 1 2024-08-18T22:41:47.636 INFO:tasks.workunit.client.1.smithi195.stdout:2/362: symlink d1/d22/d65/l6b 0 2024-08-18T22:41:47.637 INFO:tasks.workunit.client.1.smithi195.stdout:5/530: rmdir d0/d3/df/d1a/d9f 0 2024-08-18T22:41:47.637 INFO:tasks.workunit.client.0.smithi121.stdout:4/948: creat d2/dc/d16/d22/d2c/d7a/da0/dcc/d122/f159 x:0 0 0 2024-08-18T22:41:47.639 INFO:tasks.workunit.client.0.smithi121.stdout:9/926: dwrite d0/d5/dd/f41 [0,4194304] 0 2024-08-18T22:41:47.642 INFO:tasks.workunit.client.1.smithi195.stdout:6/488: getdents da/d3b 0 2024-08-18T22:41:47.644 INFO:tasks.workunit.client.0.smithi121.stdout:9/927: rename d0/d38/d9e/df/d73/fcc to d0/d38/d9e/df/d61/f137 0 2024-08-18T22:41:47.646 INFO:tasks.workunit.client.0.smithi121.stdout:4/949: mkdir d2/dc/d16/d22/d2c/d44/d66/d157/d15a 0 2024-08-18T22:41:47.647 INFO:tasks.workunit.client.0.smithi121.stdout:4/950: stat d2/dc/d16/d22/d2c/d44/d8c/c9f 0 2024-08-18T22:41:47.648 INFO:tasks.workunit.client.1.smithi195.stdout:5/531: symlink d0/d2/d53/la5 0 2024-08-18T22:41:47.648 INFO:tasks.workunit.client.0.smithi121.stdout:1/957: rename d5/d10/d14/f5c to d5/d10/d14/d2a/d3a/d87/d6c/d6f/d79/f148 0 2024-08-18T22:41:47.649 INFO:tasks.workunit.client.1.smithi195.stdout:4/542: link d0/d7/d1d/d69/db7/d3b/d6f/db0/c93 d0/d7/cba 0 2024-08-18T22:41:47.649 INFO:tasks.workunit.client.0.smithi121.stdout:1/958: chown d5/d10/d14/f4f 15 1 2024-08-18T22:41:47.649 INFO:tasks.workunit.client.0.smithi121.stdout:9/928: rmdir d0/d5/dd/d2f 39 2024-08-18T22:41:47.650 INFO:tasks.workunit.client.1.smithi195.stdout:7/624: mkdir dc/d1d/d29/ddb/d15/d17/d58/db6/dd0/dde 0 2024-08-18T22:41:47.651 INFO:tasks.workunit.client.1.smithi195.stdout:6/489: dwrite da/db/d19/f45 [0,4194304] 0 2024-08-18T22:41:47.652 INFO:tasks.workunit.client.0.smithi121.stdout:9/929: chown d0/cec 246238825 1 2024-08-18T22:41:47.653 INFO:tasks.workunit.client.0.smithi121.stdout:3/955: dread d1e/d1f/d25/d6b/db4/d94/de6/f11a [0,4194304] 0 2024-08-18T22:41:47.655 INFO:tasks.workunit.client.1.smithi195.stdout:2/363: mkdir d1/d8/d3d/d6c 0 2024-08-18T22:41:47.657 INFO:tasks.workunit.client.1.smithi195.stdout:5/532: dread d0/d3/f27 [0,4194304] 0 2024-08-18T22:41:47.657 INFO:tasks.workunit.client.0.smithi121.stdout:1/959: link d5/d10/d14/dfc/l13b d5/d10/d67/d138/d13c/l149 0 2024-08-18T22:41:47.659 INFO:tasks.workunit.client.0.smithi121.stdout:4/951: dwrite d2/dc/d16/d22/d2c/d44/d111/d150/f158 [0,4194304] 0 2024-08-18T22:41:47.660 INFO:tasks.workunit.client.1.smithi195.stdout:6/490: rmdir da/db/d19/d67 39 2024-08-18T22:41:47.661 INFO:tasks.workunit.client.1.smithi195.stdout:8/640: creat d1/de/d27/fee x:0 0 0 2024-08-18T22:41:47.662 INFO:tasks.workunit.client.1.smithi195.stdout:3/635: dread d7/da/df/d1c/f58 [0,4194304] 0 2024-08-18T22:41:47.663 INFO:tasks.workunit.client.1.smithi195.stdout:4/543: mknod d0/d7/d1d/d69/db4/cbb 0 2024-08-18T22:41:47.664 INFO:tasks.workunit.client.1.smithi195.stdout:5/533: fsync d0/d46/f6c 0 2024-08-18T22:41:47.665 INFO:tasks.workunit.client.0.smithi121.stdout:4/952: rmdir d2/dc/d1c 39 2024-08-18T22:41:47.666 INFO:tasks.workunit.client.1.smithi195.stdout:9/560: getdents d1c/d32 0 2024-08-18T22:41:47.670 INFO:tasks.workunit.client.1.smithi195.stdout:5/534: fdatasync d0/d3/d8/d64/f9d 0 2024-08-18T22:41:47.671 INFO:tasks.workunit.client.1.smithi195.stdout:7/625: rename dc/d1d/d29/ddb/l77 to dc/d1d/d29/ddb/d15/d17/d18/ldf 0 2024-08-18T22:41:47.673 INFO:tasks.workunit.client.0.smithi121.stdout:4/953: symlink d2/dc/d16/d59/d83/dd7/d90/l15b 0 2024-08-18T22:41:47.673 INFO:tasks.workunit.client.1.smithi195.stdout:6/491: mkdir da/db/d26/d90 0 2024-08-18T22:41:47.674 INFO:tasks.workunit.client.1.smithi195.stdout:3/636: creat d7/da/df/d1c/dc6/fcd x:0 0 0 2024-08-18T22:41:47.674 INFO:tasks.workunit.client.0.smithi121.stdout:5/792: dread d3/d5/d13/d23/d66/f88 [0,4194304] 0 2024-08-18T22:41:47.675 INFO:tasks.workunit.client.1.smithi195.stdout:7/626: truncate dc/f72 199423 0 2024-08-18T22:41:47.678 INFO:tasks.workunit.client.1.smithi195.stdout:8/641: mknod d1/de/dac/cef 0 2024-08-18T22:41:47.679 INFO:tasks.workunit.client.0.smithi121.stdout:9/930: dwrite d0/d5/dd/d3b/fae [0,4194304] 0 2024-08-18T22:41:47.679 INFO:tasks.workunit.client.0.smithi121.stdout:4/954: readlink d2/dc/d16/d22/d2c/d44/da9/l131 0 2024-08-18T22:41:47.679 INFO:tasks.workunit.client.1.smithi195.stdout:9/561: creat d1c/d32/db1/fb3 x:0 0 0 2024-08-18T22:41:47.679 INFO:tasks.workunit.client.1.smithi195.stdout:6/492: fsync da/d3b/f49 0 2024-08-18T22:41:47.680 INFO:tasks.workunit.client.1.smithi195.stdout:3/637: mknod d7/d1f/d73/cce 0 2024-08-18T22:41:47.680 INFO:tasks.workunit.client.0.smithi121.stdout:5/793: chown d3/d5/d13/d19/d24/l31 431475 1 2024-08-18T22:41:47.680 INFO:tasks.workunit.client.0.smithi121.stdout:1/960: dread d5/d10/d14/d2a/d3a/d87/d6c/d6f/d82/d15/d38/f72 [0,4194304] 0 2024-08-18T22:41:47.681 INFO:tasks.workunit.client.1.smithi195.stdout:5/535: mkdir d0/da6 0 2024-08-18T22:41:47.683 INFO:tasks.workunit.client.1.smithi195.stdout:1/649: dwrite da/d18/d43/f5b [0,4194304] 0 2024-08-18T22:41:47.684 INFO:tasks.workunit.client.1.smithi195.stdout:2/364: dread d1/f2 [0,4194304] 0 2024-08-18T22:41:47.684 INFO:tasks.workunit.client.0.smithi121.stdout:5/794: chown d3/d5/d13/d19/d24/d32/d38/dd9 482892355 1 2024-08-18T22:41:47.685 INFO:tasks.workunit.client.0.smithi121.stdout:4/955: truncate d2/dc/d16/d22/d2c/d44/d8c/f125 569278 0 2024-08-18T22:41:47.685 INFO:tasks.workunit.client.1.smithi195.stdout:7/627: dread - dc/d1d/d29/ddb/d15/d17/d18/f75 zero size 2024-08-18T22:41:47.686 INFO:tasks.workunit.client.0.smithi121.stdout:9/931: unlink d0/d5/dd/d3b/d48/feb 0 2024-08-18T22:41:47.687 INFO:tasks.workunit.client.0.smithi121.stdout:3/956: truncate d1e/d1f/d25/d58/df7/f10b 2237157 0 2024-08-18T22:41:47.689 INFO:tasks.workunit.client.0.smithi121.stdout:5/795: symlink d3/d5/d3c/d3f/d8f/lf8 0 2024-08-18T22:41:47.689 INFO:tasks.workunit.client.0.smithi121.stdout:4/956: creat d2/dc/d16/d22/d12f/f15c x:0 0 0 2024-08-18T22:41:47.690 INFO:tasks.workunit.client.1.smithi195.stdout:2/365: chown d1/d24/l5d 173586 1 2024-08-18T22:41:47.691 INFO:tasks.workunit.client.1.smithi195.stdout:6/493: truncate da/d22/d86/f79 358852 0 2024-08-18T22:41:47.691 INFO:tasks.workunit.client.0.smithi121.stdout:9/932: rmdir d0/d38/d52/d5f/de1/d10b 39 2024-08-18T22:41:47.693 INFO:tasks.workunit.client.1.smithi195.stdout:1/650: fsync da/d4c/f66 0 2024-08-18T22:41:47.693 INFO:tasks.workunit.client.1.smithi195.stdout:9/562: mknod d1c/d92/d96/d9d/cb4 0 2024-08-18T22:41:47.695 INFO:tasks.workunit.client.1.smithi195.stdout:5/536: truncate d0/f95 2322439 0 2024-08-18T22:41:47.696 INFO:tasks.workunit.client.1.smithi195.stdout:0/628: dread d0/dc/d64/d81/d44/d41/d6d/f76 [4194304,4194304] 0 2024-08-18T22:41:47.696 INFO:tasks.workunit.client.1.smithi195.stdout:7/628: mknod dc/d1d/d29/ddb/d2b/d81/ce0 0 2024-08-18T22:41:47.697 INFO:tasks.workunit.client.1.smithi195.stdout:1/651: stat da/f29 0 2024-08-18T22:41:47.697 INFO:tasks.workunit.client.1.smithi195.stdout:2/366: creat d1/d22/f6d x:0 0 0 2024-08-18T22:41:47.698 INFO:tasks.workunit.client.0.smithi121.stdout:5/796: mknod d3/cf9 0 2024-08-18T22:41:47.704 INFO:tasks.workunit.client.0.smithi121.stdout:9/933: getdents d0/d38/d9e/d45 0 2024-08-18T22:41:47.705 INFO:tasks.workunit.client.1.smithi195.stdout:8/642: dwrite d1/d3/db/d39/fd7 [4194304,4194304] 0 2024-08-18T22:41:47.706 INFO:tasks.workunit.client.0.smithi121.stdout:1/961: dwrite d5/d10/d14/d2a/d3a/d87/d6c/f121 [4194304,4194304] 0 2024-08-18T22:41:47.706 INFO:tasks.workunit.client.1.smithi195.stdout:4/544: dwrite d0/d7/d1d/f3d [4194304,4194304] 0 2024-08-18T22:41:47.709 INFO:tasks.workunit.client.1.smithi195.stdout:7/629: creat dc/d2a/d4c/db8/fe1 x:0 0 0 2024-08-18T22:41:47.709 INFO:tasks.workunit.client.0.smithi121.stdout:9/934: mkdir d0/d38/d9e/df/d73/d12b/d92/d138 0 2024-08-18T22:41:47.712 INFO:tasks.workunit.client.0.smithi121.stdout:3/957: write d1e/d1f/d25/d58/d75/fa9 [117656,96728] 0 2024-08-18T22:41:47.715 INFO:tasks.workunit.client.0.smithi121.stdout:9/935: mknod d0/d38/d9e/df/d3d/c139 0 2024-08-18T22:41:47.715 INFO:tasks.workunit.client.1.smithi195.stdout:8/643: symlink d1/d3/db/d35/d4d/d5c/ddf/lf0 0 2024-08-18T22:41:47.717 INFO:tasks.workunit.client.0.smithi121.stdout:1/962: creat d5/d10/d14/d2a/d3a/d87/d6c/d6f/d82/d15/d28/d3d/d9a/dac/d13f/f14a x:0 0 0 2024-08-18T22:41:47.718 INFO:tasks.workunit.client.1.smithi195.stdout:8/644: chown d1/d3/db/f5d 251511 1 2024-08-18T22:41:47.718 INFO:tasks.workunit.client.0.smithi121.stdout:3/958: mknod d1e/d1f/d25/d67/d92/dbd/d126/c14d 0 2024-08-18T22:41:47.718 INFO:tasks.workunit.client.1.smithi195.stdout:1/652: dread da/d18/d28/f2d [4194304,4194304] 0 2024-08-18T22:41:47.719 INFO:tasks.workunit.client.0.smithi121.stdout:9/936: dread - d0/d38/d9e/df/d73/d12b/f119 zero size 2024-08-18T22:41:47.719 INFO:tasks.workunit.client.1.smithi195.stdout:3/638: truncate d7/da/f6b 3333517 0 2024-08-18T22:41:47.719 INFO:tasks.workunit.client.1.smithi195.stdout:6/494: dwrite da/d15/d1c/f12 [0,4194304] 0 2024-08-18T22:41:47.720 INFO:tasks.workunit.client.1.smithi195.stdout:7/630: truncate dc/d1d/d29/ddb/d15/d17/d58/f6b 682982 0 2024-08-18T22:41:47.720 INFO:tasks.workunit.client.0.smithi121.stdout:4/957: dwrite d2/dc/d16/d22/d2c/d44/d8c/fb8 [0,4194304] 0 2024-08-18T22:41:47.721 INFO:tasks.workunit.client.1.smithi195.stdout:6/495: stat da/db/l56 0 2024-08-18T22:41:47.722 INFO:tasks.workunit.client.1.smithi195.stdout:1/653: chown da/d4c/d5d/c73 1706233532 1 2024-08-18T22:41:47.723 INFO:tasks.workunit.client.0.smithi121.stdout:1/963: fdatasync d5/f1d 0 2024-08-18T22:41:47.723 INFO:tasks.workunit.client.1.smithi195.stdout:5/537: rmdir d0 39 2024-08-18T22:41:47.723 INFO:tasks.workunit.client.0.smithi121.stdout:1/964: readlink d5/l40 0 2024-08-18T22:41:47.724 INFO:tasks.workunit.client.1.smithi195.stdout:3/639: stat d7/da/df/d1c/d6a/d6c 0 2024-08-18T22:41:47.726 INFO:tasks.workunit.client.0.smithi121.stdout:4/958: unlink d2/dc/d16/d22/d2c/d7a/da0/dcc/c14e 0 2024-08-18T22:41:47.727 INFO:tasks.workunit.client.0.smithi121.stdout:5/797: write d3/d5/d13/d19/d24/d32/f44 [2618533,36672] 0 2024-08-18T22:41:47.728 INFO:tasks.workunit.client.1.smithi195.stdout:4/545: creat d0/d99/d86/fbc x:0 0 0 2024-08-18T22:41:47.728 INFO:tasks.workunit.client.1.smithi195.stdout:8/645: fsync d1/de/d27/d4f/f60 0 2024-08-18T22:41:47.729 INFO:tasks.workunit.client.0.smithi121.stdout:9/937: mknod d0/d5/dd/d3b/c13a 0 2024-08-18T22:41:47.730 INFO:tasks.workunit.client.0.smithi121.stdout:5/798: write d3/d5/d3c/d3f/d8f/fa5 [1818246,107998] 0 2024-08-18T22:41:47.735 INFO:tasks.workunit.client.0.smithi121.stdout:4/959: rename d2/dc/d16/d59/d83/dd7/f103 to d2/dc/d16/d22/d2c/d7a/dbf/f15d 0 2024-08-18T22:41:47.735 INFO:tasks.workunit.client.1.smithi195.stdout:1/654: mkdir da/d3d/de0 0 2024-08-18T22:41:47.735 INFO:tasks.workunit.client.1.smithi195.stdout:7/631: dwrite dc/d1d/f88 [4194304,4194304] 0 2024-08-18T22:41:47.736 INFO:tasks.workunit.client.0.smithi121.stdout:9/938: mkdir d0/d5/dd/d3b/d13b 0 2024-08-18T22:41:47.739 INFO:tasks.workunit.client.0.smithi121.stdout:4/960: creat d2/dc/d16/d47/f15e x:0 0 0 2024-08-18T22:41:47.741 INFO:tasks.workunit.client.1.smithi195.stdout:6/496: mkdir da/d22/d87/d91 0 2024-08-18T22:41:47.741 INFO:tasks.workunit.client.1.smithi195.stdout:6/497: dread - da/f6e zero size 2024-08-18T22:41:47.743 INFO:tasks.workunit.client.0.smithi121.stdout:4/961: mknod d2/dc/d16/d22/d12f/c15f 0 2024-08-18T22:41:47.745 INFO:tasks.workunit.client.0.smithi121.stdout:4/962: fdatasync d2/dc/d16/d22/d29/ded/ff3 0 2024-08-18T22:41:47.748 INFO:tasks.workunit.client.1.smithi195.stdout:1/655: stat da/d18/d28/d7b/f7e 0 2024-08-18T22:41:47.748 INFO:tasks.workunit.client.0.smithi121.stdout:5/799: rename d3/d5/d27/d35/d53/df4 to d3/d5/dfa 0 2024-08-18T22:41:47.749 INFO:tasks.workunit.client.1.smithi195.stdout:9/563: dwrite d1c/d32/f8f [4194304,4194304] 0 2024-08-18T22:41:47.752 INFO:tasks.workunit.client.0.smithi121.stdout:3/959: write d1e/d1f/da6/dc7/dae/fc5 [484702,49999] 0 2024-08-18T22:41:47.752 INFO:tasks.workunit.client.1.smithi195.stdout:7/632: symlink dc/d8f/le2 0 2024-08-18T22:41:47.754 INFO:tasks.workunit.client.0.smithi121.stdout:3/960: write d1e/d1f/d3e/f73 [74995,69391] 0 2024-08-18T22:41:47.755 INFO:tasks.workunit.client.0.smithi121.stdout:7/912: sync 2024-08-18T22:41:47.756 INFO:tasks.workunit.client.0.smithi121.stdout:1/965: write d5/d10/d14/d92/d9f/fd0 [3316897,114952] 0 2024-08-18T22:41:47.756 INFO:tasks.workunit.client.1.smithi195.stdout:7/633: stat fb 0 2024-08-18T22:41:47.757 INFO:tasks.workunit.client.1.smithi195.stdout:1/656: unlink da/fe 0 2024-08-18T22:41:47.757 INFO:tasks.workunit.client.0.smithi121.stdout:7/913: stat de/d98/dfb/dce/d2f 0 2024-08-18T22:41:47.757 INFO:tasks.workunit.client.1.smithi195.stdout:0/629: dwrite d0/dc/d64/d81/d44/d41/d6d/da5/fa8 [0,4194304] 0 2024-08-18T22:41:47.759 INFO:tasks.workunit.client.0.smithi121.stdout:5/800: mknod d3/d5/cfb 0 2024-08-18T22:41:47.759 INFO:tasks.workunit.client.1.smithi195.stdout:8/646: link d1/d3/db/d39/d2e/d78/fcf d1/d3/d1c/d21/daa/ff1 0 2024-08-18T22:41:47.760 INFO:tasks.workunit.client.0.smithi121.stdout:3/961: unlink d1e/d1f/dba/d113/d116/d123/l139 0 2024-08-18T22:41:47.760 INFO:tasks.workunit.client.1.smithi195.stdout:6/498: write da/d15/d1c/d64/f8b [697935,81396] 0 2024-08-18T22:41:47.762 INFO:tasks.workunit.client.1.smithi195.stdout:5/538: dwrite d0/d2/d29/d88/d90/f9a [0,4194304] 0 2024-08-18T22:41:47.762 INFO:tasks.workunit.client.0.smithi121.stdout:1/966: dread - d5/d10/d14/d2a/d3a/d87/d6c/d6f/d82/d15/d133/de4/ff9 zero size 2024-08-18T22:41:47.763 INFO:tasks.workunit.client.0.smithi121.stdout:5/801: rmdir d3/d5/d13/d23/d66 39 2024-08-18T22:41:47.766 INFO:tasks.workunit.client.1.smithi195.stdout:8/647: mkdir d1/d3/db/d39/d44/d79/df2 0 2024-08-18T22:41:47.768 INFO:tasks.workunit.client.1.smithi195.stdout:7/634: read - dc/d1d/d29/ddb/d15/d17/fd6 zero size 2024-08-18T22:41:47.768 INFO:tasks.workunit.client.1.smithi195.stdout:9/564: rename d1c/f7c to d1c/fb5 0 2024-08-18T22:41:47.768 INFO:tasks.workunit.client.0.smithi121.stdout:7/914: rmdir de/d98/dfb/dce/d34/d38/d73/da2/d100/d18/d23/d24/d25 39 2024-08-18T22:41:47.770 INFO:tasks.workunit.client.0.smithi121.stdout:5/802: symlink d3/d5c/d78/lfc 0 2024-08-18T22:41:47.770 INFO:tasks.workunit.client.1.smithi195.stdout:9/565: chown d1c/d32/d71 101228 1 2024-08-18T22:41:47.770 INFO:tasks.workunit.client.1.smithi195.stdout:5/539: write d0/f1d [1916364,77185] 0 2024-08-18T22:41:47.772 INFO:tasks.workunit.client.0.smithi121.stdout:9/939: dwrite d0/d5/dd/d1a/f37 [0,4194304] 0 2024-08-18T22:41:47.774 INFO:tasks.workunit.client.0.smithi121.stdout:5/803: dread - d3/d5/d3c/d3f/ff1 zero size 2024-08-18T22:41:47.777 INFO:tasks.workunit.client.0.smithi121.stdout:3/962: dwrite d1e/d1f/dba/df6/f140 [0,4194304] 0 2024-08-18T22:41:47.778 INFO:tasks.workunit.client.1.smithi195.stdout:1/657: dwrite da/d18/d43/f89 [0,4194304] 0 2024-08-18T22:41:47.778 INFO:tasks.workunit.client.0.smithi121.stdout:1/967: rename d5/d10/d14/d2a/d3a/d87/fdd to d5/d10/d14/d2a/d3a/d87/d6c/d6f/d79/f14b 0 2024-08-18T22:41:47.780 INFO:tasks.workunit.client.0.smithi121.stdout:9/940: mknod d0/d5/d11f/c13c 0 2024-08-18T22:41:47.782 INFO:tasks.workunit.client.1.smithi195.stdout:7/635: write dc/d1d/d29/ddb/f49 [254944,88988] 0 2024-08-18T22:41:47.784 INFO:tasks.workunit.client.0.smithi121.stdout:5/804: mkdir d3/dfd 0 2024-08-18T22:41:47.786 INFO:tasks.workunit.client.1.smithi195.stdout:5/540: symlink d0/d2/d53/la7 0 2024-08-18T22:41:47.788 INFO:tasks.workunit.client.1.smithi195.stdout:8/648: dwrite d1/d3/db/d39/d2e/f61 [0,4194304] 0 2024-08-18T22:41:47.788 INFO:tasks.workunit.client.0.smithi121.stdout:9/941: stat d0/d38/d9e/df/f20 0 2024-08-18T22:41:47.789 INFO:tasks.workunit.client.1.smithi195.stdout:1/658: mkdir da/d18/d28/dba/de1 0 2024-08-18T22:41:47.789 INFO:tasks.workunit.client.1.smithi195.stdout:6/499: rmdir da/db/d78/d8c 0 2024-08-18T22:41:47.792 INFO:tasks.workunit.client.0.smithi121.stdout:1/968: unlink d5/d10/d14/d2a/d3a/d87/d6c/d6f/d79/dab/f113 0 2024-08-18T22:41:47.792 INFO:tasks.workunit.client.0.smithi121.stdout:1/969: dread - d5/d10/d67/f142 zero size 2024-08-18T22:41:47.794 INFO:tasks.workunit.client.1.smithi195.stdout:0/630: dread d0/dc/d64/d81/d44/d41/d6d/d92/f91 [0,4194304] 0 2024-08-18T22:41:47.794 INFO:tasks.workunit.client.1.smithi195.stdout:4/546: rename d0/d99/d98/d16/d54/c7c to d0/d7/d1d/d69/db7/cbd 0 2024-08-18T22:41:47.795 INFO:tasks.workunit.client.0.smithi121.stdout:4/963: write d2/dc/d1c/f87 [1054817,57260] 0 2024-08-18T22:41:47.796 INFO:tasks.workunit.client.1.smithi195.stdout:7/636: creat dc/d1d/d29/ddb/d15/d17/d58/db6/fe3 x:0 0 0 2024-08-18T22:41:47.796 INFO:tasks.workunit.client.1.smithi195.stdout:0/631: write d0/dc/d11/d23/f45 [1468479,4378] 0 2024-08-18T22:41:47.797 INFO:tasks.workunit.client.0.smithi121.stdout:1/970: readlink d5/d10/d14/d2a/d3a/d87/d6c/d6f/d82/d11/l69 0 2024-08-18T22:41:47.799 INFO:tasks.workunit.client.0.smithi121.stdout:5/805: mkdir d3/d5/dfe 0 2024-08-18T22:41:47.800 INFO:tasks.workunit.client.1.smithi195.stdout:5/541: rename d0/d3/df/d5a/c94 to d0/d2/d29/ca8 0 2024-08-18T22:41:47.802 INFO:tasks.workunit.client.0.smithi121.stdout:9/942: creat d0/d38/f13d x:0 0 0 2024-08-18T22:41:47.802 INFO:tasks.workunit.client.1.smithi195.stdout:7/637: creat dc/d1d/d29/ddb/d15/d17/d58/fe4 x:0 0 0 2024-08-18T22:41:47.803 INFO:tasks.workunit.client.0.smithi121.stdout:5/806: creat d3/d5/d27/dce/db5/fff x:0 0 0 2024-08-18T22:41:47.804 INFO:tasks.workunit.client.0.smithi121.stdout:1/971: getdents d5/dcf/de1 0 2024-08-18T22:41:47.805 INFO:tasks.workunit.client.0.smithi121.stdout:9/943: creat d0/d38/d9e/df/d73/d12b/d92/dc6/f13e x:0 0 0 2024-08-18T22:41:47.806 INFO:tasks.workunit.client.1.smithi195.stdout:0/632: fdatasync d0/dc/d64/d81/d44/d41/fb1 0 2024-08-18T22:41:47.806 INFO:tasks.workunit.client.0.smithi121.stdout:5/807: unlink d3/d5/d27/d35/d53/c76 0 2024-08-18T22:41:47.807 INFO:tasks.workunit.client.0.smithi121.stdout:1/972: creat d5/d10/d14/d2a/d3a/f14c x:0 0 0 2024-08-18T22:41:47.808 INFO:tasks.workunit.client.0.smithi121.stdout:5/808: creat d3/d5c/f100 x:0 0 0 2024-08-18T22:41:47.808 INFO:tasks.workunit.client.1.smithi195.stdout:4/547: rename d0/d7/c53 to d0/d7/d1d/d69/db7/d3b/d6f/cbe 0 2024-08-18T22:41:47.809 INFO:tasks.workunit.client.0.smithi121.stdout:1/973: mknod d5/d10/d14/d2a/d3a/c14d 0 2024-08-18T22:41:47.811 INFO:tasks.workunit.client.0.smithi121.stdout:5/809: creat d3/d5/d13/d23/da4/dc7/dae/f101 x:0 0 0 2024-08-18T22:41:47.812 INFO:tasks.workunit.client.1.smithi195.stdout:7/638: symlink dc/d1d/d29/ddb/d15/d4d/le5 0 2024-08-18T22:41:47.812 INFO:tasks.workunit.client.1.smithi195.stdout:6/500: link da/d15/d1c/d2e/c48 da/d3b/c92 0 2024-08-18T22:41:47.813 INFO:tasks.workunit.client.1.smithi195.stdout:8/649: dread d1/de/f4e [0,4194304] 0 2024-08-18T22:41:47.813 INFO:tasks.workunit.client.0.smithi121.stdout:1/974: link d5/d10/d14/d2a/f60 d5/d10/d14/d2a/d91/f14e 0 2024-08-18T22:41:47.815 INFO:tasks.workunit.client.1.smithi195.stdout:1/659: creat da/d18/d28/fe2 x:0 0 0 2024-08-18T22:41:47.816 INFO:tasks.workunit.client.1.smithi195.stdout:0/633: creat d0/dc/d64/d81/d44/d41/d6d/d92/d66/fcd x:0 0 0 2024-08-18T22:41:47.818 INFO:tasks.workunit.client.1.smithi195.stdout:4/548: mkdir d0/d7/d1d/d69/db7/d41/dbf 0 2024-08-18T22:41:47.818 INFO:tasks.workunit.client.1.smithi195.stdout:6/501: dread da/db/d19/f45 [0,4194304] 0 2024-08-18T22:41:47.819 INFO:tasks.workunit.client.0.smithi121.stdout:9/944: dread d0/d38/d9e/df/d3d/fbd [0,4194304] 0 2024-08-18T22:41:47.822 INFO:tasks.workunit.client.1.smithi195.stdout:4/549: write d0/d99/d98/f92 [149942,92206] 0 2024-08-18T22:41:47.822 INFO:tasks.workunit.client.1.smithi195.stdout:5/542: link d0/d2/d29/f67 d0/db/fa9 0 2024-08-18T22:41:47.822 INFO:tasks.workunit.client.0.smithi121.stdout:7/915: write de/d98/dfb/dce/d34/d38/d73/da2/d100/d18/f60 [418440,76763] 0 2024-08-18T22:41:47.823 INFO:tasks.workunit.client.0.smithi121.stdout:9/945: chown d0/d5/dd/d1a/dc8/dfa/dbf/cc2 9928627 1 2024-08-18T22:41:47.823 INFO:tasks.workunit.client.0.smithi121.stdout:7/916: readlink de/d98/dfb/dce/d34/d38/d5f/l88 0 2024-08-18T22:41:47.823 INFO:tasks.workunit.client.0.smithi121.stdout:4/964: write d2/dc/d16/d22/d2c/f6e [1052115,70622] 0 2024-08-18T22:41:47.823 INFO:tasks.workunit.client.0.smithi121.stdout:9/946: chown d0/d38/d9e/df/d61/db2/dce/c10e 6502 1 2024-08-18T22:41:47.824 INFO:tasks.workunit.client.1.smithi195.stdout:8/650: symlink d1/d3/db/d35/d4d/lf3 0 2024-08-18T22:41:47.824 INFO:tasks.workunit.client.0.smithi121.stdout:4/965: fsync d2/dc/d16/d22/d29/ded/f11c 0 2024-08-18T22:41:47.825 INFO:tasks.workunit.client.1.smithi195.stdout:8/651: write d1/d3/f2b [173185,42554] 0 2024-08-18T22:41:47.826 INFO:tasks.workunit.client.1.smithi195.stdout:1/660: fdatasync da/d3d/fb9 0 2024-08-18T22:41:47.826 INFO:tasks.workunit.client.0.smithi121.stdout:5/810: write d3/d5/d27/dce/fb1 [5169566,44811] 0 2024-08-18T22:41:47.828 INFO:tasks.workunit.client.1.smithi195.stdout:6/502: dread da/db/d19/f45 [0,4194304] 0 2024-08-18T22:41:47.828 INFO:tasks.workunit.client.1.smithi195.stdout:8/652: read d1/de/df/fc0 [291698,32592] 0 2024-08-18T22:41:47.828 INFO:tasks.workunit.client.0.smithi121.stdout:4/966: symlink d2/dc/d16/d22/d2c/d44/d8c/d10f/l160 0 2024-08-18T22:41:47.831 INFO:tasks.workunit.client.0.smithi121.stdout:9/947: getdents d0/d38/d9e/df/d73/d12b 0 2024-08-18T22:41:47.832 INFO:tasks.workunit.client.1.smithi195.stdout:9/566: write d1c/d32/d37/d4b/f6b [708412,32265] 0 2024-08-18T22:41:47.833 INFO:tasks.workunit.client.0.smithi121.stdout:7/917: dread de/d98/dfb/dce/d34/d38/d5f/f66 [0,4194304] 0 2024-08-18T22:41:47.834 INFO:tasks.workunit.client.0.smithi121.stdout:5/811: fsync d3/d5/d3c/d3f/d8f/f4b 0 2024-08-18T22:41:47.834 INFO:tasks.workunit.client.0.smithi121.stdout:1/975: dwrite d5/d10/d14/f90 [0,4194304] 0 2024-08-18T22:41:47.836 INFO:tasks.workunit.client.0.smithi121.stdout:4/967: creat d2/dc/d16/d59/d83/dd7/f161 x:0 0 0 2024-08-18T22:41:47.839 INFO:tasks.workunit.client.1.smithi195.stdout:0/634: unlink d0/dc/d64/d81/d44/d41/f5d 0 2024-08-18T22:41:47.839 INFO:tasks.workunit.client.0.smithi121.stdout:4/968: readlink d2/dc/d16/d22/d2c/d7a/dbf/l146 0 2024-08-18T22:41:47.840 INFO:tasks.workunit.client.0.smithi121.stdout:7/918: rename de/d98/dfb/dce/d2f/d36/fea to de/d98/dfb/dce/d20/f125 0 2024-08-18T22:41:47.841 INFO:tasks.workunit.client.0.smithi121.stdout:5/812: stat d3/d5/d3c/d3f/d8f/ca7 0 2024-08-18T22:41:47.842 INFO:tasks.workunit.client.1.smithi195.stdout:4/550: dwrite d0/d7/d1d/d69/db7/d6c/f91 [0,4194304] 0 2024-08-18T22:41:47.845 INFO:tasks.workunit.client.0.smithi121.stdout:5/813: stat d3/l6a 0 2024-08-18T22:41:47.845 INFO:tasks.workunit.client.1.smithi195.stdout:5/543: unlink d0/db/c3c 0 2024-08-18T22:41:47.845 INFO:tasks.workunit.client.1.smithi195.stdout:9/567: creat d1c/d70/fb6 x:0 0 0 2024-08-18T22:41:47.846 INFO:tasks.workunit.client.1.smithi195.stdout:9/568: fdatasync f17 0 2024-08-18T22:41:47.847 INFO:tasks.workunit.client.0.smithi121.stdout:5/814: dread - d3/d5/d13/d19/d24/d4d/dad/ff3 zero size 2024-08-18T22:41:47.848 INFO:tasks.workunit.client.0.smithi121.stdout:4/969: creat d2/dc/d16/d22/d2c/d7a/f162 x:0 0 0 2024-08-18T22:41:47.849 INFO:tasks.workunit.client.0.smithi121.stdout:5/815: stat d3/d5/d3c/d3f/d8f/l57 0 2024-08-18T22:41:47.849 INFO:tasks.workunit.client.0.smithi121.stdout:7/919: dread de/d98/dfb/dce/d34/d38/d73/da2/d100/d18/d23/d24/d29/d43/d7f/f80 [0,4194304] 0 2024-08-18T22:41:47.849 INFO:tasks.workunit.client.1.smithi195.stdout:9/569: write d1c/d32/d37/d4b/f6f [652153,11753] 0 2024-08-18T22:41:47.849 INFO:tasks.workunit.client.1.smithi195.stdout:6/503: unlink da/d22/c24 0 2024-08-18T22:41:47.850 INFO:tasks.workunit.client.1.smithi195.stdout:8/653: mknod d1/d3/db/d35/cf4 0 2024-08-18T22:41:47.851 INFO:tasks.workunit.client.0.smithi121.stdout:4/970: mkdir d2/d163 0 2024-08-18T22:41:47.856 INFO:tasks.workunit.client.1.smithi195.stdout:5/544: mkdir d0/d3/d66/daa 0 2024-08-18T22:41:47.856 INFO:tasks.workunit.client.1.smithi195.stdout:1/661: dread da/f15 [0,4194304] 0 2024-08-18T22:41:47.856 INFO:tasks.workunit.client.0.smithi121.stdout:1/976: write d5/d10/d14/d2a/d3a/d87/d6c/d6f/d82/d15/d28/d3d/dbd/fe5 [781642,106063] 0 2024-08-18T22:41:47.858 INFO:tasks.workunit.client.0.smithi121.stdout:7/920: mknod de/d98/dfb/dce/d34/d38/d73/da2/d100/d18/d23/d24/d29/d104/c126 0 2024-08-18T22:41:47.858 INFO:tasks.workunit.client.0.smithi121.stdout:1/977: fdatasync d5/d10b/f13e 0 2024-08-18T22:41:47.861 INFO:tasks.workunit.client.1.smithi195.stdout:7/639: dwrite dc/d1d/d29/f41 [0,4194304] 0 2024-08-18T22:41:47.861 INFO:tasks.workunit.client.0.smithi121.stdout:7/921: symlink de/d98/dfb/dce/d34/d38/d5f/d9c/l127 0 2024-08-18T22:41:47.864 INFO:tasks.workunit.client.1.smithi195.stdout:5/545: write d0/db/f5d [495188,57425] 0 2024-08-18T22:41:47.867 INFO:tasks.workunit.client.1.smithi195.stdout:7/640: fsync dc/d1d/d29/ddb/d15/d4d/d97/fb0 0 2024-08-18T22:41:47.870 INFO:tasks.workunit.client.1.smithi195.stdout:7/641: stat dc/d8f/d96/lb9 0 2024-08-18T22:41:47.872 INFO:tasks.workunit.client.1.smithi195.stdout:6/504: dwrite da/d15/d1c/d2e/f85 [0,4194304] 0 2024-08-18T22:41:47.873 INFO:tasks.workunit.client.0.smithi121.stdout:7/922: dwrite de/d98/dfb/dce/d34/d38/dd6/f75 [4194304,4194304] 0 2024-08-18T22:41:47.874 INFO:tasks.workunit.client.0.smithi121.stdout:5/816: dwrite d3/d5/d13/d19/f97 [0,4194304] 0 2024-08-18T22:41:47.877 INFO:tasks.workunit.client.0.smithi121.stdout:4/971: dwrite d2/dc/d16/fad [0,4194304] 0 2024-08-18T22:41:47.878 INFO:tasks.workunit.client.1.smithi195.stdout:6/505: chown da/d22/d87/d91 1252 1 2024-08-18T22:41:47.879 INFO:tasks.workunit.client.1.smithi195.stdout:8/654: creat d1/de/d27/ff5 x:0 0 0 2024-08-18T22:41:47.882 INFO:tasks.workunit.client.0.smithi121.stdout:7/923: chown de/d98/dfb/dce/d2f/d4b/daf/lc3 194088018 1 2024-08-18T22:41:47.884 INFO:tasks.workunit.client.1.smithi195.stdout:1/662: dwrite da/d4c/d7a/dbd/ddb/d4e/f51 [0,4194304] 0 2024-08-18T22:41:47.885 INFO:tasks.workunit.client.0.smithi121.stdout:1/978: dread d5/d10/d14/f4b [0,4194304] 0 2024-08-18T22:41:47.885 INFO:tasks.workunit.client.0.smithi121.stdout:7/924: dread - de/d98/dfb/dce/f106 zero size 2024-08-18T22:41:47.890 INFO:tasks.workunit.client.0.smithi121.stdout:7/925: read de/d98/dfb/fc2 [986171,108444] 0 2024-08-18T22:41:47.891 INFO:tasks.workunit.client.0.smithi121.stdout:4/972: creat d2/dc/d16/d22/d2c/f164 x:0 0 0 2024-08-18T22:41:47.892 INFO:tasks.workunit.client.0.smithi121.stdout:4/973: readlink d2/dc/d16/d22/d29/ld2 0 2024-08-18T22:41:47.892 INFO:tasks.workunit.client.0.smithi121.stdout:5/817: read d3/d5/d13/d19/d24/f47 [969737,51655] 0 2024-08-18T22:41:47.893 INFO:tasks.workunit.client.1.smithi195.stdout:4/551: dwrite d0/d7/d1d/d69/db7/d3b/f4b [0,4194304] 0 2024-08-18T22:41:47.894 INFO:tasks.workunit.client.0.smithi121.stdout:1/979: creat d5/d10/d14/d2a/d3a/d87/d6c/d6f/d82/ddb/f14f x:0 0 0 2024-08-18T22:41:47.894 INFO:tasks.workunit.client.1.smithi195.stdout:0/635: dwrite d0/dc/d64/d81/d44/d41/d6d/d92/d66/d8d/fa6 [0,4194304] 0 2024-08-18T22:41:47.895 INFO:tasks.workunit.client.0.smithi121.stdout:5/818: chown d3/d5/d27/d35/d53 48720 1 2024-08-18T22:41:47.896 INFO:tasks.workunit.client.1.smithi195.stdout:9/570: dwrite d1c/d74/f80 [0,4194304] 0 2024-08-18T22:41:47.898 INFO:tasks.workunit.client.0.smithi121.stdout:4/974: mkdir d2/dc/d16/d22/d2c/d7a/da0/dcc/d165 0 2024-08-18T22:41:47.898 INFO:tasks.workunit.client.0.smithi121.stdout:7/926: write de/d98/dfb/dce/d2f/d4b/d6d/dca/f10e [734476,117253] 0 2024-08-18T22:41:47.899 INFO:tasks.workunit.client.1.smithi195.stdout:5/546: dwrite d0/d2/d29/d88/d90/f99 [0,4194304] 0 2024-08-18T22:41:47.901 INFO:tasks.workunit.client.0.smithi121.stdout:1/980: creat d5/d10/f150 x:0 0 0 2024-08-18T22:41:47.902 INFO:tasks.workunit.client.0.smithi121.stdout:7/927: readlink de/d98/dfb/dce/d34/d38/d5f/d9c/l11b 0 2024-08-18T22:41:47.905 INFO:tasks.workunit.client.0.smithi121.stdout:1/981: write d5/d10/d14/d2a/d3a/f66 [45647,625] 0 2024-08-18T22:41:47.907 INFO:tasks.workunit.client.1.smithi195.stdout:9/571: rename c1b to d1c/d32/db1/cb7 0 2024-08-18T22:41:47.908 INFO:tasks.workunit.client.0.smithi121.stdout:1/982: write d5/d10/d67/dc2/df3/d114/f12e [691260,110302] 0 2024-08-18T22:41:47.908 INFO:tasks.workunit.client.0.smithi121.stdout:4/975: truncate d2/dc/f5d 1537364 0 2024-08-18T22:41:47.908 INFO:tasks.workunit.client.0.smithi121.stdout:7/928: creat de/d98/dfb/dce/d34/d38/d73/f128 x:0 0 0 2024-08-18T22:41:47.908 INFO:tasks.workunit.client.1.smithi195.stdout:5/547: creat d0/d3/df/d1a/fab x:0 0 0 2024-08-18T22:41:47.909 INFO:tasks.workunit.client.1.smithi195.stdout:0/636: rmdir d0/dc/d11/d23/d51/dad 39 2024-08-18T22:41:47.909 INFO:tasks.workunit.client.1.smithi195.stdout:7/642: write dc/d2a/d4c/db8/fcf [2278673,64937] 0 2024-08-18T22:41:47.912 INFO:tasks.workunit.client.0.smithi121.stdout:4/976: chown d2/dc/d16/d22/f25 40337 1 2024-08-18T22:41:47.912 INFO:tasks.workunit.client.0.smithi121.stdout:7/929: write de/d98/dfb/dce/d34/d6c/f6f [1251898,94975] 0 2024-08-18T22:41:47.914 INFO:tasks.workunit.client.0.smithi121.stdout:7/930: chown de/f16 104 1 2024-08-18T22:41:47.916 INFO:tasks.workunit.client.1.smithi195.stdout:5/548: fdatasync d0/f93 0 2024-08-18T22:41:47.917 INFO:tasks.workunit.client.1.smithi195.stdout:0/637: chown d0/dc/d64/d81/d44/d41/d6d 7969873 1 2024-08-18T22:41:47.918 INFO:tasks.workunit.client.1.smithi195.stdout:6/506: creat da/db/d26/d2d/f93 x:0 0 0 2024-08-18T22:41:47.921 INFO:tasks.workunit.client.0.smithi121.stdout:4/977: dwrite d2/dc/d8d/da4/fef [0,4194304] 0 2024-08-18T22:41:47.921 INFO:tasks.workunit.client.0.smithi121.stdout:7/931: creat de/d98/dfb/dce/d34/d38/d73/da2/d100/d18/d2e/dd7/f129 x:0 0 0 2024-08-18T22:41:47.921 INFO:tasks.workunit.client.1.smithi195.stdout:7/643: stat dc/d2a/c59 0 2024-08-18T22:41:47.922 INFO:tasks.workunit.client.1.smithi195.stdout:1/663: dwrite da/f10 [0,4194304] 0 2024-08-18T22:41:47.922 INFO:tasks.workunit.client.0.smithi121.stdout:4/978: chown d2/dc/d1c/dc1/lc2 238150638 1 2024-08-18T22:41:47.924 INFO:tasks.workunit.client.1.smithi195.stdout:6/507: fdatasync da/f40 0 2024-08-18T22:41:47.925 INFO:tasks.workunit.client.0.smithi121.stdout:4/979: mknod d2/dc/d16/d22/c166 0 2024-08-18T22:41:47.927 INFO:tasks.workunit.client.0.smithi121.stdout:4/980: rmdir d2/dc/d16/d59/d83/dd7/d104 39 2024-08-18T22:41:47.927 INFO:tasks.workunit.client.0.smithi121.stdout:4/981: fdatasync d2/fb 0 2024-08-18T22:41:47.928 INFO:tasks.workunit.client.1.smithi195.stdout:4/552: rename d0/f25 to d0/d99/d98/fc0 0 2024-08-18T22:41:47.929 INFO:tasks.workunit.client.1.smithi195.stdout:8/655: dwrite d1/d3/d1c/d21/f62 [0,4194304] 0 2024-08-18T22:41:47.931 INFO:tasks.workunit.client.0.smithi121.stdout:5/819: dread d3/d5/d13/d23/fbc [0,4194304] 0 2024-08-18T22:41:47.932 INFO:tasks.workunit.client.0.smithi121.stdout:4/982: rename d2/dc/d16/d22/d12f/f15c to d2/dc/d16/d22/d2c/d7a/dbf/f167 0 2024-08-18T22:41:47.932 INFO:tasks.workunit.client.1.smithi195.stdout:4/553: fdatasync d0/f97 0 2024-08-18T22:41:47.935 INFO:tasks.workunit.client.0.smithi121.stdout:4/983: unlink d2/dc/d16/d22/d2c/fc9 0 2024-08-18T22:41:47.936 INFO:tasks.workunit.client.1.smithi195.stdout:1/664: truncate da/d3d/fb9 137147 0 2024-08-18T22:41:47.938 INFO:tasks.workunit.client.0.smithi121.stdout:5/820: creat d3/d5/d13/d23/da4/dc7/f102 x:0 0 0 2024-08-18T22:41:47.938 INFO:tasks.workunit.client.1.smithi195.stdout:5/549: link d0/d46/d6d/f8e d0/d3/d8/d64/fac 0 2024-08-18T22:41:47.939 INFO:tasks.workunit.client.1.smithi195.stdout:0/638: rmdir d0/dc/d64/d81/d44/d43 39 2024-08-18T22:41:47.939 INFO:tasks.workunit.client.0.smithi121.stdout:4/984: write d2/dc/d1c/dc1/f109 [2043088,72889] 0 2024-08-18T22:41:47.941 INFO:tasks.workunit.client.1.smithi195.stdout:8/656: read d1/f7d [366245,122865] 0 2024-08-18T22:41:47.942 INFO:tasks.workunit.client.0.smithi121.stdout:5/821: symlink d3/d5/d13/d19/d24/d32/da8/l103 0 2024-08-18T22:41:47.943 INFO:tasks.workunit.client.0.smithi121.stdout:5/822: chown d3/d5c/d78/fa1 105 1 2024-08-18T22:41:47.945 INFO:tasks.workunit.client.0.smithi121.stdout:4/985: rename d2/dc/d1c/dc1/ddb/d141/f151 to d2/dc/d1c/dc1/d145/f168 0 2024-08-18T22:41:47.946 INFO:tasks.workunit.client.1.smithi195.stdout:0/639: chown d0/dc/d64/d81/d44/d41/d6d/d92/fc3 0 1 2024-08-18T22:41:47.947 INFO:tasks.workunit.client.1.smithi195.stdout:8/657: write d1/d64/fb9 [945125,21161] 0 2024-08-18T22:41:47.948 INFO:tasks.workunit.client.0.smithi121.stdout:4/986: mknod d2/dc/d1c/dc1/ddb/df1/d10a/c169 0 2024-08-18T22:41:47.949 INFO:tasks.workunit.client.0.smithi121.stdout:2/586: sync 2024-08-18T22:41:47.950 INFO:tasks.workunit.client.1.smithi195.stdout:7/644: getdents dc/d1d/d29 0 2024-08-18T22:41:47.951 INFO:tasks.workunit.client.0.smithi121.stdout:5/823: rmdir d3/d5/d13/d19/d24/d32/d38/dd9 0 2024-08-18T22:41:47.951 INFO:tasks.workunit.client.1.smithi195.stdout:6/508: link da/d15/d1c/c55 da/d22/d86/c94 0 2024-08-18T22:41:47.952 INFO:tasks.workunit.client.1.smithi195.stdout:5/550: dread d0/d3/f27 [0,4194304] 0 2024-08-18T22:41:47.952 INFO:tasks.workunit.client.1.smithi195.stdout:0/640: creat d0/dc/d64/d81/d44/d41/d4c/fce x:0 0 0 2024-08-18T22:41:47.953 INFO:tasks.workunit.client.0.smithi121.stdout:4/987: fdatasync d2/dc/d16/d47/f86 0 2024-08-18T22:41:47.953 INFO:tasks.workunit.client.1.smithi195.stdout:4/554: rmdir d0/d99/d85/d48/d4c/dab 0 2024-08-18T22:41:47.954 INFO:tasks.workunit.client.0.smithi121.stdout:2/587: truncate d2/d8/d19/d55/f78 1983843 0 2024-08-18T22:41:47.955 INFO:tasks.workunit.client.0.smithi121.stdout:5/824: chown d3/d5/d13/d23/da4/dc7/dae/f101 14860 1 2024-08-18T22:41:47.956 INFO:tasks.workunit.client.0.smithi121.stdout:7/932: dwrite de/d98/dfb/dce/d34/d38/d73/da2/d100/d18/d23/fbe [0,4194304] 0 2024-08-18T22:41:47.956 INFO:tasks.workunit.client.1.smithi195.stdout:5/551: truncate d0/f1d 5080870 0 2024-08-18T22:41:47.957 INFO:tasks.workunit.client.1.smithi195.stdout:0/641: rmdir d0/dc/d11/daa 39 2024-08-18T22:41:47.962 INFO:tasks.workunit.client.1.smithi195.stdout:7/645: symlink dc/d1d/d29/ddb/d15/d17/d58/le6 0 2024-08-18T22:41:47.963 INFO:tasks.workunit.client.0.smithi121.stdout:2/588: unlink d2/d8/d19/dc/c68 0 2024-08-18T22:41:47.963 INFO:tasks.workunit.client.0.smithi121.stdout:1/983: dread d5/d10/d14/d92/d9f/fd0 [0,4194304] 0 2024-08-18T22:41:47.964 INFO:tasks.workunit.client.1.smithi195.stdout:4/555: creat d0/d99/d81/fc1 x:0 0 0 2024-08-18T22:41:47.965 INFO:tasks.workunit.client.1.smithi195.stdout:1/665: dread da/f11 [4194304,4194304] 0 2024-08-18T22:41:47.965 INFO:tasks.workunit.client.1.smithi195.stdout:7/646: chown dc/d1d/d29/f86 1702603 1 2024-08-18T22:41:47.965 INFO:tasks.workunit.client.1.smithi195.stdout:0/642: read d0/dc/d64/d81/d44/d41/d4c/f61 [2587580,104838] 0 2024-08-18T22:41:47.966 INFO:tasks.workunit.client.1.smithi195.stdout:6/509: rename da/d15/d1c/d2e/d74/f7f to da/db/d26/f95 0 2024-08-18T22:41:47.966 INFO:tasks.workunit.client.0.smithi121.stdout:5/825: creat d3/d5/d13/d23/d66/f104 x:0 0 0 2024-08-18T22:41:47.968 INFO:tasks.workunit.client.1.smithi195.stdout:9/572: dwrite d1c/d32/d37/d4b/f7a [0,4194304] 0 2024-08-18T22:41:47.968 INFO:tasks.workunit.client.0.smithi121.stdout:2/589: creat d2/d8/d19/d4a/fc3 x:0 0 0 2024-08-18T22:41:47.970 INFO:tasks.workunit.client.1.smithi195.stdout:9/573: chown d1c/f45 69963 1 2024-08-18T22:41:47.973 INFO:tasks.workunit.client.0.smithi121.stdout:5/826: mknod d3/d5/d13/d19/d75/c105 0 2024-08-18T22:41:47.973 INFO:tasks.workunit.client.1.smithi195.stdout:1/666: mknod da/d4c/d5d/dac/db1/ce3 0 2024-08-18T22:41:47.974 INFO:tasks.workunit.client.1.smithi195.stdout:9/574: write d1c/d32/d37/d4b/f65 [3906213,116995] 0 2024-08-18T22:41:47.974 INFO:tasks.workunit.client.1.smithi195.stdout:6/510: mknod da/d22/d86/c96 0 2024-08-18T22:41:47.976 INFO:tasks.workunit.client.1.smithi195.stdout:6/511: fdatasync f6 0 2024-08-18T22:41:47.977 INFO:tasks.workunit.client.1.smithi195.stdout:5/552: creat d0/d2/d29/d88/d6a/d96/fad x:0 0 0 2024-08-18T22:41:47.977 INFO:tasks.workunit.client.0.smithi121.stdout:4/988: write d2/dc/d16/d59/d83/fdd [569189,108774] 0 2024-08-18T22:41:47.978 INFO:tasks.workunit.client.0.smithi121.stdout:1/984: rename d5/d10/d14/dfc/l13b to d5/d10/d14/d2a/d3a/d87/d6c/d6f/d82/d11/d132/l151 0 2024-08-18T22:41:47.979 INFO:tasks.workunit.client.1.smithi195.stdout:1/667: write da/d4c/d5d/dac/db1/fdf [415872,80218] 0 2024-08-18T22:41:47.981 INFO:tasks.workunit.client.1.smithi195.stdout:8/658: dwrite d1/d3/db/d35/d4d/d8b/f91 [0,4194304] 0 2024-08-18T22:41:47.982 INFO:tasks.workunit.client.0.smithi121.stdout:7/933: getdents de/d98/dfb/dce/d2f/d4b/d6d 0 2024-08-18T22:41:47.983 INFO:tasks.workunit.client.1.smithi195.stdout:0/643: rename d0/dc/d64/d81/d44/d41/d6d/d92/f91 to d0/dc/d64/d81/d44/d41/d6d/da5/fcf 0 2024-08-18T22:41:47.983 INFO:tasks.workunit.client.1.smithi195.stdout:5/553: write d0/d46/f9c [362646,81514] 0 2024-08-18T22:41:47.983 INFO:tasks.workunit.client.1.smithi195.stdout:1/668: stat da/d4c/d5d/d63/cca 0 2024-08-18T22:41:47.983 INFO:tasks.workunit.client.1.smithi195.stdout:7/647: mkdir dc/d8f/d96/dc5/de7 0 2024-08-18T22:41:47.986 INFO:tasks.workunit.client.1.smithi195.stdout:8/659: readlink d1/d3/db/d35/d4d/d5c/lad 0 2024-08-18T22:41:47.986 INFO:tasks.workunit.client.0.smithi121.stdout:5/827: mknod d3/c106 0 2024-08-18T22:41:47.987 INFO:tasks.workunit.client.1.smithi195.stdout:8/660: readlink d1/d3/l43 0 2024-08-18T22:41:47.988 INFO:tasks.workunit.client.0.smithi121.stdout:2/590: creat d2/d8/fc4 x:0 0 0 2024-08-18T22:41:47.989 INFO:tasks.workunit.client.0.smithi121.stdout:1/985: creat d5/d10/d14/d92/f152 x:0 0 0 2024-08-18T22:41:47.989 INFO:tasks.workunit.client.1.smithi195.stdout:0/644: mknod d0/dc/d25/cd0 0 2024-08-18T22:41:47.990 INFO:tasks.workunit.client.0.smithi121.stdout:4/989: write d2/d7c/fab [1002676,33625] 0 2024-08-18T22:41:47.990 INFO:tasks.workunit.client.0.smithi121.stdout:1/986: chown d5/d10/d14/d92/faa 767 1 2024-08-18T22:41:47.991 INFO:tasks.workunit.client.0.smithi121.stdout:4/990: stat d2/dc/d1c/cf5 0 2024-08-18T22:41:47.991 INFO:tasks.workunit.client.1.smithi195.stdout:9/575: creat d1c/d32/d71/fb8 x:0 0 0 2024-08-18T22:41:47.992 INFO:tasks.workunit.client.0.smithi121.stdout:5/828: unlink d3/d5c/f100 0 2024-08-18T22:41:47.992 INFO:tasks.workunit.client.1.smithi195.stdout:0/645: write d0/dc/d11/d23/d51/fb7 [2068230,76355] 0 2024-08-18T22:41:47.993 INFO:tasks.workunit.client.0.smithi121.stdout:4/991: write d2/dc/d16/d22/d2c/d7a/f162 [673093,20057] 0 2024-08-18T22:41:47.993 INFO:tasks.workunit.client.0.smithi121.stdout:7/934: mkdir de/d98/dfb/dce/d34/d38/d73/da2/d100/da0/d118/d12a 0 2024-08-18T22:41:47.994 INFO:tasks.workunit.client.0.smithi121.stdout:1/987: rmdir d5/dcf/de1/dc1 39 2024-08-18T22:41:47.995 INFO:tasks.workunit.client.1.smithi195.stdout:3/640: sync 2024-08-18T22:41:47.995 INFO:tasks.workunit.client.1.smithi195.stdout:2/367: sync 2024-08-18T22:41:47.995 INFO:tasks.workunit.client.1.smithi195.stdout:6/512: creat da/db/d19/d67/f97 x:0 0 0 2024-08-18T22:41:47.996 INFO:tasks.workunit.client.0.smithi121.stdout:2/591: symlink d2/d8/lc5 0 2024-08-18T22:41:47.996 INFO:tasks.workunit.client.1.smithi195.stdout:9/576: read f0 [744900,84547] 0 2024-08-18T22:41:47.997 INFO:tasks.workunit.client.0.smithi121.stdout:5/829: creat d3/d5/d13/d23/d66/f107 x:0 0 0 2024-08-18T22:41:47.997 INFO:tasks.workunit.client.1.smithi195.stdout:8/661: mknod d1/de/d67/cf6 0 2024-08-18T22:41:47.998 INFO:tasks.workunit.client.0.smithi121.stdout:7/935: symlink de/d98/dfb/dce/d34/d38/d73/da2/d100/d18/d23/d24/d29/d43/l12b 0 2024-08-18T22:41:48.000 INFO:tasks.workunit.client.0.smithi121.stdout:7/936: chown de/d98/dfb/dce/d2f/d4b/d6d/dca/cfc 27 1 2024-08-18T22:41:48.001 INFO:tasks.workunit.client.0.smithi121.stdout:5/830: mknod d3/d5/c108 0 2024-08-18T22:41:48.003 INFO:tasks.workunit.client.0.smithi121.stdout:7/937: read de/f1c [1951600,119651] 0 2024-08-18T22:41:48.004 INFO:tasks.workunit.client.1.smithi195.stdout:4/556: truncate d0/d99/d98/d16/f61 595658 0 2024-08-18T22:41:48.005 INFO:tasks.workunit.client.0.smithi121.stdout:7/938: write de/d98/dfb/dce/d2f/d4b/ff2 [596959,28896] 0 2024-08-18T22:41:48.006 INFO:tasks.workunit.client.0.smithi121.stdout:7/939: chown de/d98/dfb/dce/d20/c62 15079 1 2024-08-18T22:41:48.008 INFO:tasks.workunit.client.1.smithi195.stdout:9/577: mkdir d1c/d92/d96/d9d/db9 0 2024-08-18T22:41:48.009 INFO:tasks.workunit.client.1.smithi195.stdout:8/662: dwrite d1/de/df/d1d/fd2 [0,4194304] 0 2024-08-18T22:41:48.009 INFO:tasks.workunit.client.1.smithi195.stdout:4/557: chown d0/d7/d1d/d69/db7/d3b/d6f 18003875 1 2024-08-18T22:41:48.010 INFO:tasks.workunit.client.0.smithi121.stdout:7/940: mkdir de/d98/dfb/dce/d34/d38/d73/da2/d100/da0/d118/d12a/d12c 0 2024-08-18T22:41:48.011 INFO:tasks.workunit.client.0.smithi121.stdout:4/992: dread d2/f2e [0,4194304] 0 2024-08-18T22:41:48.012 INFO:tasks.workunit.client.0.smithi121.stdout:7/941: dread - de/d98/dfb/dce/d34/d38/d5f/d9c/f107 zero size 2024-08-18T22:41:48.012 INFO:tasks.workunit.client.1.smithi195.stdout:3/641: symlink d7/da/df/dca/lcf 0 2024-08-18T22:41:48.012 INFO:tasks.workunit.client.0.smithi121.stdout:4/993: rmdir d2/dc/d8d/dc4 39 2024-08-18T22:41:48.013 INFO:tasks.workunit.client.1.smithi195.stdout:6/513: rename da/d22/d86/c94 to da/db/d19/d67/c98 0 2024-08-18T22:41:48.013 INFO:tasks.workunit.client.0.smithi121.stdout:1/988: dread d5/d10/d14/d2a/d3a/d87/d6c/d6f/d82/f51 [0,4194304] 0 2024-08-18T22:41:48.015 INFO:tasks.workunit.client.1.smithi195.stdout:5/554: dread d0/db/f78 [0,4194304] 0 2024-08-18T22:41:48.015 INFO:tasks.workunit.client.1.smithi195.stdout:8/663: chown d1/d3/db/d35/d4d/d5c/lad 19447880 1 2024-08-18T22:41:48.016 INFO:tasks.workunit.client.0.smithi121.stdout:7/942: rmdir de/d98/dfb/dce/d20 39 2024-08-18T22:41:48.016 INFO:tasks.workunit.client.0.smithi121.stdout:4/994: symlink d2/dc/d8d/l16a 0 2024-08-18T22:41:48.017 INFO:tasks.workunit.client.1.smithi195.stdout:8/664: dread - d1/de/d67/fe6 zero size 2024-08-18T22:41:48.017 INFO:tasks.workunit.client.0.smithi121.stdout:1/989: dread d5/d10/d14/d2a/d3a/d87/d6c/d6f/d82/d15/d38/fb6 [0,4194304] 0 2024-08-18T22:41:48.018 INFO:tasks.workunit.client.1.smithi195.stdout:0/646: creat d0/dc/d11/fd1 x:0 0 0 2024-08-18T22:41:48.018 INFO:tasks.workunit.client.0.smithi121.stdout:7/943: read de/d2d/f5d [1542228,44220] 0 2024-08-18T22:41:48.019 INFO:tasks.workunit.client.1.smithi195.stdout:6/514: dread da/db/d26/f63 [0,4194304] 0 2024-08-18T22:41:48.020 INFO:tasks.workunit.client.1.smithi195.stdout:1/669: dwrite da/d4c/d7a/fc2 [0,4194304] 0 2024-08-18T22:41:48.020 INFO:tasks.workunit.client.1.smithi195.stdout:8/665: fdatasync d1/d3/f6 0 2024-08-18T22:41:48.020 INFO:tasks.workunit.client.1.smithi195.stdout:2/368: rmdir d1/d8/d3d/d4d/d63 0 2024-08-18T22:41:48.022 INFO:tasks.workunit.client.1.smithi195.stdout:6/515: write da/f8d [801597,96643] 0 2024-08-18T22:41:48.022 INFO:tasks.workunit.client.0.smithi121.stdout:7/944: mknod de/d98/dfb/dce/d2f/c12d 0 2024-08-18T22:41:48.023 INFO:tasks.workunit.client.1.smithi195.stdout:9/578: creat d1c/d92/d96/fba x:0 0 0 2024-08-18T22:41:48.023 INFO:tasks.workunit.client.1.smithi195.stdout:1/670: chown da/d4c/d5d/fd3 21 1 2024-08-18T22:41:48.024 INFO:tasks.workunit.client.1.smithi195.stdout:2/369: chown d1/d8/d3d/d3b/d46/f66 5474 1 2024-08-18T22:41:48.024 INFO:tasks.workunit.client.1.smithi195.stdout:9/579: fsync d1c/d32/f8f 0 2024-08-18T22:41:48.025 INFO:tasks.workunit.client.0.smithi121.stdout:4/995: dwrite d2/f19 [4194304,4194304] 0 2024-08-18T22:41:48.026 INFO:tasks.workunit.client.1.smithi195.stdout:4/558: rename d0/d99/d85/d48/c51 to d0/d99/d85/d48/cc2 0 2024-08-18T22:41:48.026 INFO:tasks.workunit.client.1.smithi195.stdout:2/370: dread - d1/d24/d26/d42/f54 zero size 2024-08-18T22:41:48.027 INFO:tasks.workunit.client.0.smithi121.stdout:7/945: mknod de/d98/dfb/dce/d2f/d4b/d6d/c12e 0 2024-08-18T22:41:48.028 INFO:tasks.workunit.client.1.smithi195.stdout:6/516: truncate da/d15/d1c/d2e/f85 4234645 0 2024-08-18T22:41:48.028 INFO:tasks.workunit.client.1.smithi195.stdout:5/555: rmdir d0/d37 39 2024-08-18T22:41:48.029 INFO:tasks.workunit.client.1.smithi195.stdout:7/648: getdents dc/d1d/d29/ddb/d15 0 2024-08-18T22:41:48.031 INFO:tasks.workunit.client.0.smithi121.stdout:4/996: getdents d2/dc/d1c 0 2024-08-18T22:41:48.032 INFO:tasks.workunit.client.0.smithi121.stdout:4/997: write d2/dc/d16/d22/d2c/d44/d66/f80 [2248225,4552] 0 2024-08-18T22:41:48.034 INFO:tasks.workunit.client.0.smithi121.stdout:4/998: mknod d2/dc/d1c/dc1/ddb/c16b 0 2024-08-18T22:41:48.034 INFO:tasks.workunit.client.1.smithi195.stdout:3/642: mknod d7/da/cd0 0 2024-08-18T22:41:48.034 INFO:tasks.workunit.client.1.smithi195.stdout:1/671: creat da/d4c/d5d/dac/db1/fe4 x:0 0 0 2024-08-18T22:41:48.036 INFO:tasks.workunit.client.0.smithi121.stdout:4/999: mknod d2/dc/d16/d22/d2c/d7a/da0/c16c 0 2024-08-18T22:41:48.038 INFO:tasks.workunit.client.1.smithi195.stdout:8/666: mknod d1/d3/db/d39/cf7 0 2024-08-18T22:41:48.040 INFO:tasks.workunit.client.1.smithi195.stdout:0/647: rename d0/dc/d64/d81/d44/d41/c65 to d0/dc/d25/d67/cd2 0 2024-08-18T22:41:48.040 INFO:tasks.workunit.client.0.smithi121.stdout:1/990: write d5/d10/d14/d2a/d3a/d87/d6c/d6f/d82/d15/d38/fb6 [1561692,17318] 0 2024-08-18T22:41:48.041 INFO:tasks.workunit.client.1.smithi195.stdout:5/556: chown d0/f95 20 1 2024-08-18T22:41:48.041 INFO:tasks.workunit.client.0.smithi121.stdout:7/946: write de/d98/dfb/dce/d34/d38/d5f/f66 [828062,46648] 0 2024-08-18T22:41:48.042 INFO:tasks.workunit.client.1.smithi195.stdout:8/667: chown d1/d3/db/d39 403506063 1 2024-08-18T22:41:48.042 INFO:tasks.workunit.client.1.smithi195.stdout:9/580: dwrite d1c/d32/f88 [0,4194304] 0 2024-08-18T22:41:48.043 INFO:tasks.workunit.client.0.smithi121.stdout:7/947: fdatasync de/d98/dfb/fc2 0 2024-08-18T22:41:48.046 INFO:tasks.workunit.client.0.smithi121.stdout:7/948: symlink de/d98/dfb/dce/d2f/d4b/l12f 0 2024-08-18T22:41:48.046 INFO:tasks.workunit.client.1.smithi195.stdout:4/559: symlink d0/d7/d1d/lc3 0 2024-08-18T22:41:48.048 INFO:tasks.workunit.client.0.smithi121.stdout:7/949: creat de/d98/dfb/dce/d34/d38/d73/da2/d100/da0/f130 x:0 0 0 2024-08-18T22:41:48.048 INFO:tasks.workunit.client.1.smithi195.stdout:6/517: dwrite da/db/d26/d2d/f93 [0,4194304] 0 2024-08-18T22:41:48.049 INFO:tasks.workunit.client.1.smithi195.stdout:3/643: readlink d7/da/df/l2f 0 2024-08-18T22:41:48.049 INFO:tasks.workunit.client.1.smithi195.stdout:5/557: dread - d0/d46/d6d/fa1 zero size 2024-08-18T22:41:48.050 INFO:tasks.workunit.client.1.smithi195.stdout:3/644: readlink d7/da/df/d8e/l9c 0 2024-08-18T22:41:48.051 INFO:tasks.workunit.client.1.smithi195.stdout:2/371: rename d1/d24/d26/d42/f43 to d1/d22/d51/f6e 0 2024-08-18T22:41:48.051 INFO:tasks.workunit.client.0.smithi121.stdout:7/950: mkdir de/d98/dfb/dce/d34/d38/d73/da2/d100/d18/d23/d24/d29/d43/d131 0 2024-08-18T22:41:48.051 INFO:tasks.workunit.client.0.smithi121.stdout:7/951: chown de/d2d/fe4 120652944 1 2024-08-18T22:41:48.053 INFO:tasks.workunit.client.0.smithi121.stdout:7/952: mknod de/d98/dfb/dce/d34/d38/d5f/dd3/c132 0 2024-08-18T22:41:48.055 INFO:tasks.workunit.client.1.smithi195.stdout:3/645: read d7/da/df/d1c/d6a/d6c/f6e [334939,114416] 0 2024-08-18T22:41:48.055 INFO:tasks.workunit.client.0.smithi121.stdout:1/991: truncate d5/d10/d14/d2a/d3a/d87/fdf 1706084 0 2024-08-18T22:41:48.056 INFO:tasks.workunit.client.1.smithi195.stdout:8/668: mkdir d1/de/df/d1d/de5/df8 0 2024-08-18T22:41:48.056 INFO:tasks.workunit.client.1.smithi195.stdout:1/672: read da/f78 [168982,129561] 0 2024-08-18T22:41:48.057 INFO:tasks.workunit.client.0.smithi121.stdout:7/953: fsync de/d98/dfb/dce/d34/d38/d73/da2/d100/d18/f3c 0 2024-08-18T22:41:48.058 INFO:tasks.workunit.client.1.smithi195.stdout:6/518: creat da/d22/d86/f99 x:0 0 0 2024-08-18T22:41:48.060 INFO:tasks.workunit.client.1.smithi195.stdout:0/648: creat d0/dc/d11/fd3 x:0 0 0 2024-08-18T22:41:48.060 INFO:tasks.workunit.client.0.smithi121.stdout:7/954: creat de/d98/dfb/dce/d34/d6c/f133 x:0 0 0 2024-08-18T22:41:48.061 INFO:tasks.workunit.client.0.smithi121.stdout:1/992: mkdir d5/d10/d14/d2a/d3a/d87/d6c/d6f/d82/d15/d120/d153 0 2024-08-18T22:41:48.061 INFO:tasks.workunit.client.1.smithi195.stdout:2/372: creat d1/d24/d26/d42/d50/f6f x:0 0 0 2024-08-18T22:41:48.063 INFO:tasks.workunit.client.0.smithi121.stdout:1/993: mkdir d5/d10/d14/d2a/d91/d154 0 2024-08-18T22:41:48.064 INFO:tasks.workunit.client.1.smithi195.stdout:1/673: dread da/d18/d28/d8e/d99/fb3 [0,4194304] 0 2024-08-18T22:41:48.065 INFO:tasks.workunit.client.1.smithi195.stdout:0/649: symlink d0/dc/d25/d67/db8/ld4 0 2024-08-18T22:41:48.066 INFO:tasks.workunit.client.0.smithi121.stdout:1/994: mknod d5/d10/d14/d2a/d3a/d87/d6c/d6f/d79/dab/c155 0 2024-08-18T22:41:48.067 INFO:tasks.workunit.client.1.smithi195.stdout:1/674: fsync da/d18/d28/f34 0 2024-08-18T22:41:48.067 INFO:tasks.workunit.client.0.smithi121.stdout:1/995: creat d5/d10/d14/d2a/d3a/f156 x:0 0 0 2024-08-18T22:41:48.070 INFO:tasks.workunit.client.1.smithi195.stdout:8/669: creat d1/d3/db/d39/ff9 x:0 0 0 2024-08-18T22:41:48.071 INFO:tasks.workunit.client.1.smithi195.stdout:9/581: dread d1c/d32/f50 [0,4194304] 0 2024-08-18T22:41:48.071 INFO:tasks.workunit.client.1.smithi195.stdout:0/650: rename d0/dc/d25 to d0/dc/d25/d67/db8/dd5 22 2024-08-18T22:41:48.072 INFO:tasks.workunit.client.1.smithi195.stdout:3/646: getdents d7/d1f/d73 0 2024-08-18T22:41:48.075 INFO:tasks.workunit.client.1.smithi195.stdout:6/519: dwrite da/db/d26/f95 [0,4194304] 0 2024-08-18T22:41:48.076 INFO:tasks.workunit.client.0.smithi121.stdout:1/996: write d5/f1d [2844330,99164] 0 2024-08-18T22:41:48.077 INFO:tasks.workunit.client.1.smithi195.stdout:8/670: chown d1/d3/db/d35/d4d/d5c/lad 97 1 2024-08-18T22:41:48.080 INFO:tasks.workunit.client.0.smithi121.stdout:7/955: dwrite de/d98/dfb/dce/d2f/d4b/d6d/f83 [0,4194304] 0 2024-08-18T22:41:48.081 INFO:tasks.workunit.client.1.smithi195.stdout:2/373: write d1/d8/f2f [327955,61485] 0 2024-08-18T22:41:48.081 INFO:tasks.workunit.client.1.smithi195.stdout:3/647: truncate d7/da/df/d38/f7b 589289 0 2024-08-18T22:41:48.082 INFO:tasks.workunit.client.1.smithi195.stdout:8/671: dread - d1/de/d27/d4f/f60 zero size 2024-08-18T22:41:48.082 INFO:tasks.workunit.client.0.smithi121.stdout:1/997: truncate d5/d10/d14/d2a/d3a/d87/d6c/d6f/d82/d15/d28/d3d/f12a 4975930 0 2024-08-18T22:41:48.083 INFO:tasks.workunit.client.1.smithi195.stdout:3/648: stat f1 0 2024-08-18T22:41:48.084 INFO:tasks.workunit.client.0.smithi121.stdout:1/998: chown d5/d10/d14/d2a/d3a/f14c 80346230 1 2024-08-18T22:41:48.086 INFO:tasks.workunit.client.1.smithi195.stdout:6/520: rmdir da/d22/d73 39 2024-08-18T22:41:48.086 INFO:tasks.workunit.client.1.smithi195.stdout:1/675: mknod da/d4c/d5d/dac/db1/dda/ce5 0 2024-08-18T22:41:48.088 INFO:tasks.workunit.client.1.smithi195.stdout:0/651: dwrite d0/dc/d11/fd3 [0,4194304] 0 2024-08-18T22:41:48.088 INFO:tasks.workunit.client.1.smithi195.stdout:9/582: mknod d1c/cbb 0 2024-08-18T22:41:48.089 INFO:tasks.workunit.client.0.smithi121.stdout:7/956: dread de/d98/dfb/dce/d34/d38/d73/da2/d100/d18/d23/d24/d29/d43/d7f/f80 [0,4194304] 0 2024-08-18T22:41:48.091 INFO:tasks.workunit.client.0.smithi121.stdout:7/957: creat de/d98/dfb/dce/d34/d38/dd6/f134 x:0 0 0 2024-08-18T22:41:48.092 INFO:tasks.workunit.client.1.smithi195.stdout:2/374: creat d1/d8/f70 x:0 0 0 2024-08-18T22:41:48.094 INFO:tasks.workunit.client.1.smithi195.stdout:6/521: stat da/d22/d86/f79 0 2024-08-18T22:41:48.095 INFO:tasks.workunit.client.1.smithi195.stdout:5/558: dwrite d0/d2/d29/d88/d6a/f80 [4194304,4194304] 0 2024-08-18T22:41:48.096 INFO:tasks.workunit.client.1.smithi195.stdout:4/560: dread d0/d99/d98/d16/d49/f46 [0,4194304] 0 2024-08-18T22:41:48.096 INFO:tasks.workunit.client.1.smithi195.stdout:3/649: symlink d7/da/df/d1c/dc6/ld1 0 2024-08-18T22:41:48.097 INFO:tasks.workunit.client.1.smithi195.stdout:2/375: mknod d1/d22/d51/c71 0 2024-08-18T22:41:48.098 INFO:tasks.workunit.client.1.smithi195.stdout:9/583: fsync d1c/d32/d37/f6d 0 2024-08-18T22:41:48.101 INFO:tasks.workunit.client.0.smithi121.stdout:7/958: dwrite de/d98/dfb/dce/d20/f3f [0,4194304] 0 2024-08-18T22:41:48.101 INFO:tasks.workunit.client.1.smithi195.stdout:0/652: mknod d0/dc/dd/d46/cd6 0 2024-08-18T22:41:48.104 INFO:tasks.workunit.client.1.smithi195.stdout:8/672: dread d1/de/df/f19 [4194304,4194304] 0 2024-08-18T22:41:48.104 INFO:tasks.workunit.client.1.smithi195.stdout:9/584: fdatasync d1c/fa8 0 2024-08-18T22:41:48.105 INFO:tasks.workunit.client.1.smithi195.stdout:1/676: rename da/d4c/d5d/fbc to da/d3d/fe6 0 2024-08-18T22:41:48.107 INFO:tasks.workunit.client.1.smithi195.stdout:3/650: fdatasync d7/da/df/d1c/f25 0 2024-08-18T22:41:48.107 INFO:tasks.workunit.client.1.smithi195.stdout:6/522: mknod da/db/d2a/c9a 0 2024-08-18T22:41:48.107 INFO:tasks.workunit.client.1.smithi195.stdout:9/585: stat d1c/d70/f83 0 2024-08-18T22:41:48.110 INFO:tasks.workunit.client.1.smithi195.stdout:1/677: write da/f1d [3808973,41123] 0 2024-08-18T22:41:48.112 INFO:tasks.workunit.client.1.smithi195.stdout:3/651: write d7/d1f/d73/db0/fcb [882630,84229] 0 2024-08-18T22:41:48.113 INFO:tasks.workunit.client.1.smithi195.stdout:2/376: mkdir d1/d24/d26/d42/d72 0 2024-08-18T22:41:48.113 INFO:tasks.workunit.client.1.smithi195.stdout:9/586: chown d1c/d32/d37/d4b/l55 1601935070 1 2024-08-18T22:41:48.114 INFO:tasks.workunit.client.1.smithi195.stdout:6/523: write da/d3b/f7a [517063,112708] 0 2024-08-18T22:41:48.116 INFO:tasks.workunit.client.1.smithi195.stdout:0/653: creat d0/dc/d64/d81/d44/d41/d6d/da5/fd7 x:0 0 0 2024-08-18T22:41:48.120 INFO:tasks.workunit.client.1.smithi195.stdout:2/377: creat d1/d24/f73 x:0 0 0 2024-08-18T22:41:48.120 INFO:tasks.workunit.client.1.smithi195.stdout:6/524: rmdir da/db/d26/d2d 39 2024-08-18T22:41:48.122 INFO:tasks.workunit.client.1.smithi195.stdout:1/678: rename da/d4c/d5d/cde to da/d4c/d5d/dac/db1/ce7 0 2024-08-18T22:41:48.123 INFO:tasks.workunit.client.1.smithi195.stdout:5/559: dwrite d0/d2/d29/f32 [0,4194304] 0 2024-08-18T22:41:48.123 INFO:tasks.workunit.client.1.smithi195.stdout:4/561: dwrite d0/d99/d98/d16/d94/db2/fa8 [0,4194304] 0 2024-08-18T22:41:48.123 INFO:tasks.workunit.client.1.smithi195.stdout:9/587: mknod d1c/d74/d7b/d82/d90/cbc 0 2024-08-18T22:41:48.126 INFO:tasks.workunit.client.1.smithi195.stdout:3/652: unlink d7/d1f/c28 0 2024-08-18T22:41:48.127 INFO:tasks.workunit.client.1.smithi195.stdout:0/654: chown d0/dc/d64/d81/fc2 27545 1 2024-08-18T22:41:48.127 INFO:tasks.workunit.client.1.smithi195.stdout:3/653: stat d7/da/df/l4f 0 2024-08-18T22:41:48.127 INFO:tasks.workunit.client.1.smithi195.stdout:6/525: symlink da/db/d2a/l9b 0 2024-08-18T22:41:48.128 INFO:tasks.workunit.client.1.smithi195.stdout:2/378: symlink d1/d22/l74 0 2024-08-18T22:41:48.129 INFO:tasks.workunit.client.1.smithi195.stdout:4/562: mknod d0/d99/d98/d16/dae/cc4 0 2024-08-18T22:41:48.130 INFO:tasks.workunit.client.1.smithi195.stdout:5/560: mknod d0/d3/d8/d3b/cae 0 2024-08-18T22:41:48.131 INFO:tasks.workunit.client.1.smithi195.stdout:8/673: write d1/de/df/fc0 [105233,100241] 0 2024-08-18T22:41:48.132 INFO:tasks.workunit.client.1.smithi195.stdout:3/654: dread - d7/da/f70 zero size 2024-08-18T22:41:48.132 INFO:tasks.workunit.client.1.smithi195.stdout:5/561: chown d0/d46/d6d/fa1 0 1 2024-08-18T22:41:48.133 INFO:tasks.workunit.client.1.smithi195.stdout:2/379: mknod d1/d22/d65/c75 0 2024-08-18T22:41:48.137 INFO:tasks.workunit.client.1.smithi195.stdout:5/562: creat d0/d3/df/faf x:0 0 0 2024-08-18T22:41:48.139 INFO:tasks.workunit.client.1.smithi195.stdout:2/380: dread d1/d24/d26/d42/f4c [0,4194304] 0 2024-08-18T22:41:48.141 INFO:tasks.workunit.client.1.smithi195.stdout:1/679: rename da/d18/d28/d8e to da/d4c/d5d/de8 0 2024-08-18T22:41:48.143 INFO:tasks.workunit.client.0.smithi121.stdout:7/959: link de/d98/dfb/dce/d34/d38/d5f/lfe de/d98/dfb/dce/d2f/d4b/d6d/dca/l135 0 2024-08-18T22:41:48.145 INFO:tasks.workunit.client.1.smithi195.stdout:3/655: dwrite d7/da/df/d1c/d6a/d6c/fc5 [0,4194304] 0 2024-08-18T22:41:48.145 INFO:tasks.workunit.client.1.smithi195.stdout:4/563: rename d0 to d0/d7/d1d/d69/db7/d6c/d95/dc5 22 2024-08-18T22:41:48.145 INFO:tasks.workunit.client.0.smithi121.stdout:7/960: symlink de/d98/dfb/dce/d34/d38/d73/da2/d100/d18/d23/l136 0 2024-08-18T22:41:48.146 INFO:tasks.workunit.client.1.smithi195.stdout:5/563: mknod d0/d3/df/d1a/cb0 0 2024-08-18T22:41:48.147 INFO:tasks.workunit.client.1.smithi195.stdout:6/526: getdents da/db/d26/d2d/d8e 0 2024-08-18T22:41:48.147 INFO:tasks.workunit.client.0.smithi121.stdout:7/961: truncate de/d98/dfb/dce/d2f/d4b/d6d/dca/f10e 4513135 0 2024-08-18T22:41:48.150 INFO:tasks.workunit.client.1.smithi195.stdout:8/674: creat d1/d3/ffa x:0 0 0 2024-08-18T22:41:48.151 INFO:tasks.workunit.client.1.smithi195.stdout:1/680: symlink da/d4c/d5d/dac/db1/dda/le9 0 2024-08-18T22:41:48.152 INFO:tasks.workunit.client.1.smithi195.stdout:2/381: creat d1/d8/d3d/d3b/d53/f76 x:0 0 0 2024-08-18T22:41:48.158 INFO:tasks.workunit.client.1.smithi195.stdout:5/564: unlink d0/d3/d8/d64/f84 0 2024-08-18T22:41:48.158 INFO:tasks.workunit.client.1.smithi195.stdout:3/656: rmdir d7/d1f 39 2024-08-18T22:41:48.158 INFO:tasks.workunit.client.1.smithi195.stdout:5/565: readlink d0/d2/l69 0 2024-08-18T22:41:48.159 INFO:tasks.workunit.client.1.smithi195.stdout:3/657: write d7/d54/f8a [1055510,127864] 0 2024-08-18T22:41:48.161 INFO:tasks.workunit.client.1.smithi195.stdout:4/564: symlink d0/d99/d98/d16/d94/db2/da4/lc6 0 2024-08-18T22:41:48.163 INFO:tasks.workunit.client.1.smithi195.stdout:8/675: fsync d1/de/d31/d5a/f50 0 2024-08-18T22:41:48.165 INFO:tasks.workunit.client.1.smithi195.stdout:8/676: chown d1/de/f54 1487 1 2024-08-18T22:41:48.168 INFO:tasks.workunit.client.1.smithi195.stdout:3/658: dwrite d7/da/df/d1c/d6a/d6c/f9f [0,4194304] 0 2024-08-18T22:41:48.168 INFO:tasks.workunit.client.1.smithi195.stdout:6/527: creat da/db/d26/d90/f9c x:0 0 0 2024-08-18T22:41:48.169 INFO:tasks.workunit.client.1.smithi195.stdout:5/566: mkdir d0/d3/d8/d3b/db1 0 2024-08-18T22:41:48.170 INFO:tasks.workunit.client.1.smithi195.stdout:8/677: readlink d1/d3/db/d35/d4d/d95/l83 0 2024-08-18T22:41:48.171 INFO:tasks.workunit.client.1.smithi195.stdout:6/528: write da/d22/d86/f7e [96271,2758] 0 2024-08-18T22:41:48.173 INFO:tasks.workunit.client.1.smithi195.stdout:4/565: creat d0/d7/d1d/d69/fc7 x:0 0 0 2024-08-18T22:41:48.174 INFO:tasks.workunit.client.1.smithi195.stdout:1/681: dwrite da/f13 [0,4194304] 0 2024-08-18T22:41:48.175 INFO:tasks.workunit.client.1.smithi195.stdout:4/566: chown d0/d7/d1d/d69/c6e 22 1 2024-08-18T22:41:48.177 INFO:tasks.workunit.client.0.smithi121.stdout:7/962: dwrite de/d98/dfb/dce/d20/d39/f9a [0,4194304] 0 2024-08-18T22:41:48.178 INFO:tasks.workunit.client.1.smithi195.stdout:1/682: read da/f24 [458196,95461] 0 2024-08-18T22:41:48.179 INFO:tasks.workunit.client.1.smithi195.stdout:2/382: getdents d1/d24/d26/d42/d72 0 2024-08-18T22:41:48.180 INFO:tasks.workunit.client.0.smithi121.stdout:7/963: fdatasync de/d98/dfb/dce/d34/d38/d73/da2/d100/d18/d23/f7d 0 2024-08-18T22:41:48.181 INFO:tasks.workunit.client.1.smithi195.stdout:8/678: dwrite d1/d3/db/d35/d4d/d95/fa6 [0,4194304] 0 2024-08-18T22:41:48.182 INFO:tasks.workunit.client.0.smithi121.stdout:7/964: stat de/d98/dfb/dce/d34/d38/d73/da2/f11c 0 2024-08-18T22:41:48.183 INFO:tasks.workunit.client.1.smithi195.stdout:2/383: dread - d1/d8/d3d/d3b/d53/f76 zero size 2024-08-18T22:41:48.184 INFO:tasks.workunit.client.0.smithi121.stdout:7/965: readlink de/d98/dfb/dce/d34/d38/d5f/lfe 0 2024-08-18T22:41:48.185 INFO:tasks.workunit.client.0.smithi121.stdout:7/966: creat de/d98/dfb/dce/d20/f137 x:0 0 0 2024-08-18T22:41:48.186 INFO:tasks.workunit.client.1.smithi195.stdout:2/384: write d1/d8/d3d/d3b/d53/d5b/f61 [1267480,23455] 0 2024-08-18T22:41:48.187 INFO:tasks.workunit.client.0.smithi121.stdout:7/967: symlink de/da4/l138 0 2024-08-18T22:41:48.191 INFO:tasks.workunit.client.1.smithi195.stdout:1/683: fdatasync da/d18/d43/f44 0 2024-08-18T22:41:48.192 INFO:tasks.workunit.client.1.smithi195.stdout:3/659: dread d7/f56 [0,4194304] 0 2024-08-18T22:41:48.195 INFO:tasks.workunit.client.1.smithi195.stdout:6/529: creat da/d22/d73/f9d x:0 0 0 2024-08-18T22:41:48.196 INFO:tasks.workunit.client.1.smithi195.stdout:6/530: chown da/f13 123990149 1 2024-08-18T22:41:48.197 INFO:tasks.workunit.client.1.smithi195.stdout:1/684: mknod da/d4c/d7a/dbd/ddb/d4e/cea 0 2024-08-18T22:41:48.198 INFO:tasks.workunit.client.1.smithi195.stdout:6/531: creat da/d15/d1c/f9e x:0 0 0 2024-08-18T22:41:48.200 INFO:tasks.workunit.client.1.smithi195.stdout:1/685: write da/d18/d28/d31/d77/f81 [8582413,51864] 0 2024-08-18T22:41:48.201 INFO:tasks.workunit.client.1.smithi195.stdout:8/679: rename d1/f5 to d1/de/d31/ffb 0 2024-08-18T22:41:48.204 INFO:tasks.workunit.client.1.smithi195.stdout:6/532: mknod da/d15/d1c/c9f 0 2024-08-18T22:41:48.206 INFO:tasks.workunit.client.1.smithi195.stdout:2/385: rename d1/d24/d26/d42/f54 to d1/d24/d26/d42/d50/f77 0 2024-08-18T22:41:48.213 INFO:tasks.workunit.client.1.smithi195.stdout:6/533: dwrite da/d22/d73/f9d [0,4194304] 0 2024-08-18T22:41:48.214 INFO:tasks.workunit.client.1.smithi195.stdout:6/534: fdatasync da/d3b/f3e 0 2024-08-18T22:41:48.215 INFO:tasks.workunit.client.1.smithi195.stdout:3/660: write d7/da/df/d38/fa1 [932827,40656] 0 2024-08-18T22:41:48.219 INFO:tasks.workunit.client.1.smithi195.stdout:3/661: mknod d7/da/df/dca/d81/cd2 0 2024-08-18T22:41:48.220 INFO:tasks.workunit.client.1.smithi195.stdout:6/535: mknod da/db/d78/ca0 0 2024-08-18T22:41:48.222 INFO:tasks.workunit.client.1.smithi195.stdout:3/662: mkdir d7/da/df/dd3 0 2024-08-18T22:41:48.225 INFO:tasks.workunit.client.1.smithi195.stdout:8/680: dwrite d1/d3/db/fd [0,4194304] 0 2024-08-18T22:41:48.229 INFO:tasks.workunit.client.1.smithi195.stdout:2/386: dread d1/d24/d26/f2c [0,4194304] 0 2024-08-18T22:41:48.230 INFO:tasks.workunit.client.1.smithi195.stdout:1/686: dread da/d18/d28/d7b/f7e [0,4194304] 0 2024-08-18T22:41:48.233 INFO:tasks.workunit.client.1.smithi195.stdout:8/681: truncate d1/d3/f6 5794947 0 2024-08-18T22:41:48.235 INFO:tasks.workunit.client.1.smithi195.stdout:3/663: link d7/da/df/d1c/d6a/f76 d7/d1f/d49/fd4 0 2024-08-18T22:41:48.238 INFO:tasks.workunit.client.1.smithi195.stdout:2/387: fdatasync d1/d8/d3d/fa 0 2024-08-18T22:41:48.239 INFO:tasks.workunit.client.1.smithi195.stdout:1/687: creat da/d3d/de0/feb x:0 0 0 2024-08-18T22:41:48.240 INFO:tasks.workunit.client.1.smithi195.stdout:8/682: symlink d1/d3/lfc 0 2024-08-18T22:41:48.241 INFO:tasks.workunit.client.1.smithi195.stdout:2/388: chown d1/d22/d51 56 1 2024-08-18T22:41:48.243 INFO:tasks.workunit.client.1.smithi195.stdout:6/536: dwrite da/db/d2a/f57 [0,4194304] 0 2024-08-18T22:41:48.243 INFO:tasks.workunit.client.1.smithi195.stdout:1/688: unlink da/d3d/f92 0 2024-08-18T22:41:48.246 INFO:tasks.workunit.client.0.smithi121.stdout:0/828: sync 2024-08-18T22:41:48.248 INFO:tasks.workunit.client.1.smithi195.stdout:2/389: symlink d1/d22/d65/l78 0 2024-08-18T22:41:48.249 INFO:tasks.workunit.client.0.smithi121.stdout:0/829: chown d1/d4/db/d24/df/d8/d78/d7c/df5/daf/ddd/c11f 2 1 2024-08-18T22:41:48.250 INFO:tasks.workunit.client.1.smithi195.stdout:6/537: mkdir da/db/d26/d2d/da1 0 2024-08-18T22:41:48.250 INFO:tasks.workunit.client.1.smithi195.stdout:2/390: write d1/d24/d26/f36 [1233390,17862] 0 2024-08-18T22:41:48.254 INFO:tasks.workunit.client.1.smithi195.stdout:8/683: mknod d1/ddb/cfd 0 2024-08-18T22:41:48.257 INFO:tasks.workunit.client.1.smithi195.stdout:6/538: mknod da/d15/d1c/d64/ca2 0 2024-08-18T22:41:48.259 INFO:tasks.workunit.client.1.smithi195.stdout:2/391: symlink d1/d24/d47/l79 0 2024-08-18T22:41:48.260 INFO:tasks.workunit.client.1.smithi195.stdout:6/539: stat da/d15/d1c/d2e/c48 0 2024-08-18T22:41:48.267 INFO:tasks.workunit.client.1.smithi195.stdout:3/664: dread d7/da/df/f5f [0,4194304] 0 2024-08-18T22:41:48.269 INFO:tasks.workunit.client.1.smithi195.stdout:6/540: link da/db/l56 da/d3b/la3 0 2024-08-18T22:41:48.273 INFO:tasks.workunit.client.1.smithi195.stdout:1/689: dwrite da/d18/d28/d31/d77/f93 [0,4194304] 0 2024-08-18T22:41:48.273 INFO:tasks.workunit.client.1.smithi195.stdout:2/392: dwrite d1/d8/d3d/f48 [4194304,4194304] 0 2024-08-18T22:41:48.274 INFO:tasks.workunit.client.1.smithi195.stdout:3/665: unlink d7/d1f/c7e 0 2024-08-18T22:41:48.277 INFO:tasks.workunit.client.1.smithi195.stdout:3/666: chown d7/d1f/d49/f7f 7143 1 2024-08-18T22:41:48.277 INFO:tasks.workunit.client.1.smithi195.stdout:8/684: dread d1/de/d31/d5a/f57 [0,4194304] 0 2024-08-18T22:41:48.278 INFO:tasks.workunit.client.1.smithi195.stdout:2/393: chown d1/d22/l32 59525 1 2024-08-18T22:41:48.278 INFO:tasks.workunit.client.1.smithi195.stdout:3/667: dread - d7/da/df/d38/f86 zero size 2024-08-18T22:41:48.280 INFO:tasks.workunit.client.1.smithi195.stdout:8/685: write d1/de/df/fb4 [523012,25078] 0 2024-08-18T22:41:48.281 INFO:tasks.workunit.client.1.smithi195.stdout:6/541: dread da/d15/d1c/d64/f8b [0,4194304] 0 2024-08-18T22:41:48.283 INFO:tasks.workunit.client.1.smithi195.stdout:6/542: unlink da/d3b/c92 0 2024-08-18T22:41:48.284 INFO:tasks.workunit.client.1.smithi195.stdout:1/690: dread da/d18/dc6/fd9 [0,4194304] 0 2024-08-18T22:41:48.285 INFO:tasks.workunit.client.1.smithi195.stdout:1/691: fdatasync da/f29 0 2024-08-18T22:41:48.286 INFO:tasks.workunit.client.1.smithi195.stdout:8/686: unlink d1/de/d27/fc2 0 2024-08-18T22:41:48.286 INFO:tasks.workunit.client.1.smithi195.stdout:6/543: truncate da/d3b/f7a 1003098 0 2024-08-18T22:41:48.288 INFO:tasks.workunit.client.1.smithi195.stdout:6/544: chown da/db/d26/f63 724 1 2024-08-18T22:41:48.289 INFO:tasks.workunit.client.1.smithi195.stdout:6/545: fsync da/db/d19/f23 0 2024-08-18T22:41:48.289 INFO:tasks.workunit.client.1.smithi195.stdout:3/668: rename d7/d54/d9a/fb9 to d7/d1f/d73/db0/fd5 0 2024-08-18T22:41:48.291 INFO:tasks.workunit.client.1.smithi195.stdout:6/546: write da/db/d26/f95 [4807251,35176] 0 2024-08-18T22:41:48.293 INFO:tasks.workunit.client.1.smithi195.stdout:1/692: symlink da/d4c/d5d/dac/db1/lec 0 2024-08-18T22:41:48.294 INFO:tasks.workunit.client.1.smithi195.stdout:8/687: dread d1/d3/db/d39/d44/f6b [0,4194304] 0 2024-08-18T22:41:48.294 INFO:tasks.workunit.client.1.smithi195.stdout:1/693: chown da/d18/f42 127610 1 2024-08-18T22:41:48.296 INFO:tasks.workunit.client.1.smithi195.stdout:8/688: fsync d1/d3/db/f5d 0 2024-08-18T22:41:48.296 INFO:tasks.workunit.client.1.smithi195.stdout:3/669: mknod d7/da/df/d8e/cd6 0 2024-08-18T22:41:48.298 INFO:tasks.workunit.client.1.smithi195.stdout:1/694: unlink da/d18/d28/f2d 0 2024-08-18T22:41:48.300 INFO:tasks.workunit.client.1.smithi195.stdout:2/394: dread d1/d8/d3d/f1c [0,4194304] 0 2024-08-18T22:41:48.302 INFO:tasks.workunit.client.1.smithi195.stdout:3/670: mknod d7/da/df/dca/d81/cd7 0 2024-08-18T22:41:48.302 INFO:tasks.workunit.client.1.smithi195.stdout:6/547: dwrite da/d15/d1c/f12 [0,4194304] 0 2024-08-18T22:41:48.305 INFO:tasks.workunit.client.1.smithi195.stdout:6/548: truncate da/db/d26/f7d 452973 0 2024-08-18T22:41:48.308 INFO:tasks.workunit.client.1.smithi195.stdout:8/689: creat d1/de/df/d1d/de5/df8/ffe x:0 0 0 2024-08-18T22:41:48.310 INFO:tasks.workunit.client.1.smithi195.stdout:3/671: creat d7/d54/d9a/fd8 x:0 0 0 2024-08-18T22:41:48.312 INFO:tasks.workunit.client.1.smithi195.stdout:1/695: creat da/d4c/d5d/dac/db1/dd6/fed x:0 0 0 2024-08-18T22:41:48.314 INFO:tasks.workunit.client.1.smithi195.stdout:6/549: mknod da/d15/d1c/d2e/d74/ca4 0 2024-08-18T22:41:48.316 INFO:tasks.workunit.client.1.smithi195.stdout:2/395: dwrite d1/d22/f30 [0,4194304] 0 2024-08-18T22:41:48.318 INFO:tasks.workunit.client.1.smithi195.stdout:3/672: symlink d7/da/df/d1c/dc6/ld9 0 2024-08-18T22:41:48.322 INFO:tasks.workunit.client.1.smithi195.stdout:6/550: creat da/db/d19/d67/fa5 x:0 0 0 2024-08-18T22:41:48.323 INFO:tasks.workunit.client.1.smithi195.stdout:8/690: dwrite d1/de/d27/fee [0,4194304] 0 2024-08-18T22:41:48.330 INFO:tasks.workunit.client.1.smithi195.stdout:8/691: mkdir d1/de/df/d1d/de5/dff 0 2024-08-18T22:41:48.331 INFO:tasks.workunit.client.1.smithi195.stdout:3/673: write d7/d1f/f34 [1196070,75585] 0 2024-08-18T22:41:48.334 INFO:tasks.workunit.client.1.smithi195.stdout:2/396: getdents d1/d8/d27 0 2024-08-18T22:41:48.334 INFO:tasks.workunit.client.1.smithi195.stdout:8/692: dread - d1/d3/db/d39/ff9 zero size 2024-08-18T22:41:48.335 INFO:tasks.workunit.client.1.smithi195.stdout:1/696: creat da/d18/d28/d31/fee x:0 0 0 2024-08-18T22:41:48.337 INFO:tasks.workunit.client.1.smithi195.stdout:2/397: fdatasync d1/f59 0 2024-08-18T22:41:48.337 INFO:tasks.workunit.client.1.smithi195.stdout:1/697: chown da/d4c/lcd 1296 1 2024-08-18T22:41:48.340 INFO:tasks.workunit.client.1.smithi195.stdout:6/551: dwrite da/db/d26/f63 [0,4194304] 0 2024-08-18T22:41:48.340 INFO:tasks.workunit.client.1.smithi195.stdout:1/698: creat da/d4c/fef x:0 0 0 2024-08-18T22:41:48.341 INFO:tasks.workunit.client.1.smithi195.stdout:3/674: link d7/d1f/l98 d7/d54/d9a/lda 0 2024-08-18T22:41:48.342 INFO:tasks.workunit.client.1.smithi195.stdout:2/398: truncate d1/f2 1674526 0 2024-08-18T22:41:48.344 INFO:tasks.workunit.client.1.smithi195.stdout:6/552: write da/db/d19/d67/f75 [2974994,12920] 0 2024-08-18T22:41:48.348 INFO:tasks.workunit.client.1.smithi195.stdout:8/693: dwrite d1/d3/db/d35/d4d/fcd [0,4194304] 0 2024-08-18T22:41:48.349 INFO:tasks.workunit.client.1.smithi195.stdout:3/675: creat d7/d1f/d49/fdb x:0 0 0 2024-08-18T22:41:48.350 INFO:tasks.workunit.client.1.smithi195.stdout:1/699: getdents da/d4c/d7a/dbd 0 2024-08-18T22:41:48.353 INFO:tasks.workunit.client.1.smithi195.stdout:6/553: symlink da/d15/d1c/la6 0 2024-08-18T22:41:48.354 INFO:tasks.workunit.client.1.smithi195.stdout:6/554: fsync da/d3b/f49 0 2024-08-18T22:41:48.354 INFO:tasks.workunit.client.1.smithi195.stdout:2/399: mknod d1/d24/d26/d42/d5c/c7a 0 2024-08-18T22:41:48.356 INFO:tasks.workunit.client.1.smithi195.stdout:2/400: read d1/d22/f31 [992811,46223] 0 2024-08-18T22:41:48.362 INFO:tasks.workunit.client.1.smithi195.stdout:3/676: link d7/ca8 d7/da/df/d8e/daa/cdc 0 2024-08-18T22:41:48.362 INFO:tasks.workunit.client.1.smithi195.stdout:1/700: creat da/d18/ff0 x:0 0 0 2024-08-18T22:41:48.362 INFO:tasks.workunit.client.1.smithi195.stdout:2/401: readlink d1/d24/d47/l79 0 2024-08-18T22:41:48.372 INFO:tasks.workunit.client.1.smithi195.stdout:3/677: link d7/c42 d7/dc3/cdd 0 2024-08-18T22:41:48.373 INFO:tasks.workunit.client.1.smithi195.stdout:1/701: creat da/d4c/d5d/ff1 x:0 0 0 2024-08-18T22:41:48.377 INFO:tasks.workunit.client.1.smithi195.stdout:3/678: creat d7/da/df/fde x:0 0 0 2024-08-18T22:41:48.379 INFO:tasks.workunit.client.1.smithi195.stdout:3/679: read d7/d1f/f80 [2798415,35206] 0 2024-08-18T22:41:48.382 INFO:tasks.workunit.client.1.smithi195.stdout:1/702: rename da/d4c/d5d/dac to da/d18/d28/d7b/df2 0 2024-08-18T22:41:48.384 INFO:tasks.workunit.client.1.smithi195.stdout:3/680: symlink d7/da/df/ldf 0 2024-08-18T22:41:48.385 INFO:tasks.workunit.client.1.smithi195.stdout:1/703: creat da/d4c/d5d/de8/d99/ff3 x:0 0 0 2024-08-18T22:41:48.385 INFO:tasks.workunit.client.1.smithi195.stdout:3/681: write d7/da/df/d1c/dc6/fcd [59897,109137] 0 2024-08-18T22:41:48.386 INFO:tasks.workunit.client.1.smithi195.stdout:3/682: stat d7/da/df/dca 0 2024-08-18T22:41:48.389 INFO:tasks.workunit.client.1.smithi195.stdout:3/683: symlink d7/d1f/d49/le0 0 2024-08-18T22:41:48.390 INFO:tasks.workunit.client.1.smithi195.stdout:1/704: creat da/d18/d28/dba/de1/ff4 x:0 0 0 2024-08-18T22:41:48.391 INFO:tasks.workunit.client.1.smithi195.stdout:3/684: dread - d7/da/df/d1c/f63 zero size 2024-08-18T22:41:48.391 INFO:tasks.workunit.client.1.smithi195.stdout:1/705: fsync da/d18/d43/f89 0 2024-08-18T22:41:48.394 INFO:tasks.workunit.client.1.smithi195.stdout:3/685: dread d7/da/df/dca/d81/f82 [0,4194304] 0 2024-08-18T22:41:48.397 INFO:tasks.workunit.client.1.smithi195.stdout:2/402: write d1/d8/f1a [824742,106559] 0 2024-08-18T22:41:48.400 INFO:tasks.workunit.client.1.smithi195.stdout:2/403: creat d1/d8/d3d/d5e/f7b x:0 0 0 2024-08-18T22:41:48.403 INFO:tasks.workunit.client.1.smithi195.stdout:2/404: mkdir d1/d8/d3d/d6c/d7c 0 2024-08-18T22:41:48.405 INFO:tasks.workunit.client.1.smithi195.stdout:2/405: mkdir d1/d8/d3d/d3b/d7d 0 2024-08-18T22:41:48.405 INFO:tasks.workunit.client.1.smithi195.stdout:1/706: rmdir da/d18 39 2024-08-18T22:41:48.406 INFO:tasks.workunit.client.1.smithi195.stdout:2/406: write d1/d8/d3d/d5e/f7b [174190,76370] 0 2024-08-18T22:41:48.409 INFO:tasks.workunit.client.1.smithi195.stdout:1/707: dread da/f10 [0,4194304] 0 2024-08-18T22:41:48.410 INFO:tasks.workunit.client.1.smithi195.stdout:2/407: rename d1/d8/d3d/d3b/d53/d5b/f61 to d1/d24/d26/d42/d5c/f7e 0 2024-08-18T22:41:48.412 INFO:tasks.workunit.client.1.smithi195.stdout:2/408: creat d1/d8/d27/f7f x:0 0 0 2024-08-18T22:41:48.413 INFO:tasks.workunit.client.1.smithi195.stdout:1/708: mkdir da/d18/d28/d7b/df2/db1/dd6/df5 0 2024-08-18T22:41:48.414 INFO:tasks.workunit.client.1.smithi195.stdout:1/709: chown da/d4c/d7a/dbd/ddb/c96 454 1 2024-08-18T22:41:48.420 INFO:tasks.workunit.client.1.smithi195.stdout:1/710: dwrite da/d18/d43/f5b [0,4194304] 0 2024-08-18T22:41:48.424 INFO:tasks.workunit.client.1.smithi195.stdout:1/711: creat da/d18/d28/d31/d77/ff6 x:0 0 0 2024-08-18T22:41:48.426 INFO:tasks.workunit.client.1.smithi195.stdout:2/409: dread d1/d24/d26/d42/d44/f57 [0,4194304] 0 2024-08-18T22:41:48.427 INFO:tasks.workunit.client.1.smithi195.stdout:2/410: read d1/d8/d3d/f48 [6765100,89962] 0 2024-08-18T22:41:48.429 INFO:tasks.workunit.client.1.smithi195.stdout:1/712: rename da/d18/d28/l22 to da/d18/d28/d31/d77/lf7 0 2024-08-18T22:41:48.430 INFO:tasks.workunit.client.0.smithi121.stdout:3/963: sync 2024-08-18T22:41:48.430 INFO:tasks.workunit.client.1.smithi195.stdout:2/411: symlink d1/d8/d3d/d3b/d53/l80 0 2024-08-18T22:41:48.431 INFO:tasks.workunit.client.1.smithi195.stdout:1/713: creat da/d18/d28/dba/ff8 x:0 0 0 2024-08-18T22:41:48.433 INFO:tasks.workunit.client.1.smithi195.stdout:1/714: write da/d18/d28/d31/fc4 [970149,39254] 0 2024-08-18T22:41:48.433 INFO:tasks.workunit.client.1.smithi195.stdout:2/412: creat d1/d8/d3d/d3b/f81 x:0 0 0 2024-08-18T22:41:48.433 INFO:tasks.workunit.client.0.smithi121.stdout:3/964: mkdir d1e/d1f/d25/d58/de0/d14e 0 2024-08-18T22:41:48.434 INFO:tasks.workunit.client.1.smithi195.stdout:3/686: dread d7/da/d75/f78 [0,4194304] 0 2024-08-18T22:41:48.435 INFO:tasks.workunit.client.1.smithi195.stdout:2/413: dread - d1/d24/d26/d42/d50/f77 zero size 2024-08-18T22:41:48.438 INFO:tasks.workunit.client.1.smithi195.stdout:1/715: creat da/d4c/d7a/dbd/ddb/d4e/ddc/ff9 x:0 0 0 2024-08-18T22:41:48.441 INFO:tasks.workunit.client.1.smithi195.stdout:3/687: getdents d7/da/df/d38 0 2024-08-18T22:41:48.444 INFO:tasks.workunit.client.0.smithi121.stdout:3/965: dread d1e/d1f/d25/f106 [0,4194304] 0 2024-08-18T22:41:48.444 INFO:tasks.workunit.client.1.smithi195.stdout:2/414: dwrite d1/d8/d3d/d3b/d46/f66 [0,4194304] 0 2024-08-18T22:41:48.447 INFO:tasks.workunit.client.1.smithi195.stdout:1/716: rename da/d18/d28/dba/de1/ff4 to da/ffa 0 2024-08-18T22:41:48.448 INFO:tasks.workunit.client.0.smithi121.stdout:3/966: rename d1e/d1f/d25/d67/d92/dbd/d126/fdf to d1e/d1f/dba/d113/d116/d123/d14b/f14f 0 2024-08-18T22:41:48.449 INFO:tasks.workunit.client.1.smithi195.stdout:1/717: chown da/d4c/d5d/d63/f65 6 1 2024-08-18T22:41:48.451 INFO:tasks.workunit.client.0.smithi121.stdout:3/967: write d1e/d1f/d25/d6b/fcd [1525404,27773] 0 2024-08-18T22:41:48.453 INFO:tasks.workunit.client.1.smithi195.stdout:2/415: dwrite d1/d24/f73 [0,4194304] 0 2024-08-18T22:41:48.454 INFO:tasks.workunit.client.0.smithi121.stdout:3/968: mknod d1e/d1f/da6/dc7/c150 0 2024-08-18T22:41:48.454 INFO:tasks.workunit.client.0.smithi121.stdout:3/969: read - d1e/d1f/d25/d67/fd8 zero size 2024-08-18T22:41:48.456 INFO:tasks.workunit.client.1.smithi195.stdout:1/718: symlink da/d4c/d7a/dbd/ddb/d4e/lfb 0 2024-08-18T22:41:48.457 INFO:tasks.workunit.client.0.smithi121.stdout:3/970: mkdir d1e/d1f/d3e/d151 0 2024-08-18T22:41:48.458 INFO:tasks.workunit.client.1.smithi195.stdout:2/416: dread d1/d8/f2f [0,4194304] 0 2024-08-18T22:41:48.458 INFO:tasks.workunit.client.1.smithi195.stdout:1/719: creat da/d68/ffc x:0 0 0 2024-08-18T22:41:48.461 INFO:tasks.workunit.client.0.smithi121.stdout:3/971: rename d1e/d1f/d25/d67/d92/d111/d13e/d104/d9a/f10a to d1e/d1f/d25/d6b/f152 0 2024-08-18T22:41:48.464 INFO:tasks.workunit.client.0.smithi121.stdout:3/972: rename d1e/d1f/d25/d58/de0/l115 to d1e/d1f/d25/d6b/db4/d94/l153 0 2024-08-18T22:41:48.466 INFO:tasks.workunit.client.0.smithi121.stdout:3/973: unlink d1e/d1f/d2a/c48 0 2024-08-18T22:41:48.469 INFO:tasks.workunit.client.0.smithi121.stdout:3/974: rename d1e/de2 to d1e/d1f/dba/d113/d154 0 2024-08-18T22:41:48.469 INFO:tasks.workunit.client.0.smithi121.stdout:3/975: chown d1e/d1f/d25/f106 1207524908 1 2024-08-18T22:41:48.474 INFO:tasks.workunit.client.0.smithi121.stdout:3/976: dwrite d1e/d1f/da6/f133 [0,4194304] 0 2024-08-18T22:41:48.476 INFO:tasks.workunit.client.0.smithi121.stdout:3/977: fsync d1e/d1f/d25/d67/fd8 0 2024-08-18T22:41:48.477 INFO:tasks.workunit.client.0.smithi121.stdout:3/978: chown d1e/d1f/d25/d6b/d81/dfa 1810742096 1 2024-08-18T22:41:48.480 INFO:tasks.workunit.client.0.smithi121.stdout:3/979: symlink d1e/d1f/d25/d67/d92/l155 0 2024-08-18T22:41:48.482 INFO:tasks.workunit.client.0.smithi121.stdout:3/980: write d1e/d1f/d25/d67/d92/dbd/d126/d97/fee [5081483,120991] 0 2024-08-18T22:41:48.482 INFO:tasks.workunit.client.1.smithi195.stdout:1/720: read - da/d3d/de0/feb zero size 2024-08-18T22:41:48.482 INFO:tasks.workunit.client.1.smithi195.stdout:2/417: truncate d1/f10 4565757 0 2024-08-18T22:41:48.483 INFO:tasks.workunit.client.0.smithi121.stdout:3/981: write d1e/d1f/f23 [2277164,87463] 0 2024-08-18T22:41:48.485 INFO:tasks.workunit.client.1.smithi195.stdout:2/418: chown d1/f2 171787239 1 2024-08-18T22:41:48.486 INFO:tasks.workunit.client.0.smithi121.stdout:9/948: sync 2024-08-18T22:41:48.486 INFO:tasks.workunit.client.0.smithi121.stdout:2/592: sync 2024-08-18T22:41:48.486 INFO:tasks.workunit.client.0.smithi121.stdout:5/831: sync 2024-08-18T22:41:48.487 INFO:tasks.workunit.client.0.smithi121.stdout:9/949: read - d0/f114 zero size 2024-08-18T22:41:48.488 INFO:tasks.workunit.client.0.smithi121.stdout:3/982: link d1e/d1f/dba/d113/d116/d128/d5f/f61 d1e/d1f/d25/d67/d92/d111/d13e/f156 0 2024-08-18T22:41:48.489 INFO:tasks.workunit.client.0.smithi121.stdout:2/593: creat d2/d3/d48/d77/fc6 x:0 0 0 2024-08-18T22:41:48.490 INFO:tasks.workunit.client.0.smithi121.stdout:2/594: read - d2/d8/fc4 zero size 2024-08-18T22:41:48.491 INFO:tasks.workunit.client.0.smithi121.stdout:9/950: unlink d0/d38/d9e/df/d73/d12b/faa 0 2024-08-18T22:41:48.491 INFO:tasks.workunit.client.0.smithi121.stdout:2/595: chown d2/d8/d19/f13 104 1 2024-08-18T22:41:48.493 INFO:tasks.workunit.client.0.smithi121.stdout:5/832: symlink d3/d5/d13/d19/d24/l109 0 2024-08-18T22:41:48.493 INFO:tasks.workunit.client.0.smithi121.stdout:9/951: dread - d0/d38/d52/d5f/de1/f100 zero size 2024-08-18T22:41:48.493 INFO:tasks.workunit.client.0.smithi121.stdout:2/596: write d2/d3/fb8 [787521,111199] 0 2024-08-18T22:41:48.493 INFO:tasks.workunit.client.1.smithi195.stdout:2/419: write d1/d24/f56 [4781095,89164] 0 2024-08-18T22:41:48.494 INFO:tasks.workunit.client.0.smithi121.stdout:2/597: fsync d2/d8/fc2 0 2024-08-18T22:41:48.494 INFO:tasks.workunit.client.1.smithi195.stdout:3/688: dread d7/d1f/f34 [0,4194304] 0 2024-08-18T22:41:48.495 INFO:tasks.workunit.client.1.smithi195.stdout:2/420: write d1/d8/d27/f3a [879877,55355] 0 2024-08-18T22:41:48.496 INFO:tasks.workunit.client.0.smithi121.stdout:9/952: rmdir d0/d5/d11f 39 2024-08-18T22:41:48.497 INFO:tasks.workunit.client.0.smithi121.stdout:3/983: link ca d1e/d1f/d25/d6b/c157 0 2024-08-18T22:41:48.498 INFO:tasks.workunit.client.1.smithi195.stdout:2/421: readlink d1/d8/d3d/d3b/d46/l5f 0 2024-08-18T22:41:48.499 INFO:tasks.workunit.client.1.smithi195.stdout:2/422: write d1/d24/d26/d42/d50/f6f [434697,7545] 0 2024-08-18T22:41:48.500 INFO:tasks.workunit.client.1.smithi195.stdout:3/689: rename d7/da/df/dca/d81/f82 to d7/da/df/dca/d81/fe1 0 2024-08-18T22:41:48.501 INFO:tasks.workunit.client.1.smithi195.stdout:2/423: chown d1/d24/f60 6882109 1 2024-08-18T22:41:48.502 INFO:tasks.workunit.client.1.smithi195.stdout:2/424: write d1/d8/d3d/d3b/d53/f76 [282444,84234] 0 2024-08-18T22:41:48.502 INFO:tasks.workunit.client.0.smithi121.stdout:2/598: mknod d2/d8/d19/dc/cc7 0 2024-08-18T22:41:48.503 INFO:tasks.workunit.client.1.smithi195.stdout:1/721: dread da/d4c/d7a/dbd/ddb/d4e/d95/d9c/dc8/fcf [0,4194304] 0 2024-08-18T22:41:48.505 INFO:tasks.workunit.client.0.smithi121.stdout:3/984: mknod d1e/d1f/d3e/d151/c158 0 2024-08-18T22:41:48.505 INFO:tasks.workunit.client.1.smithi195.stdout:3/690: mkdir d7/da/df/d8e/de2 0 2024-08-18T22:41:48.507 INFO:tasks.workunit.client.1.smithi195.stdout:1/722: rename da/l14 to da/d4c/d5d/de8/d99/lfd 0 2024-08-18T22:41:48.508 INFO:tasks.workunit.client.1.smithi195.stdout:2/425: creat d1/d8/d3d/d3b/d7d/f82 x:0 0 0 2024-08-18T22:41:48.509 INFO:tasks.workunit.client.0.smithi121.stdout:2/599: fsync d2/d3/d53/f66 0 2024-08-18T22:41:48.511 INFO:tasks.workunit.client.1.smithi195.stdout:2/426: truncate d1/d22/f31 5110170 0 2024-08-18T22:41:48.511 INFO:tasks.workunit.client.0.smithi121.stdout:9/953: write d0/d38/d9e/df/d3d/f95 [964506,108957] 0 2024-08-18T22:41:48.512 INFO:tasks.workunit.client.0.smithi121.stdout:5/833: truncate d3/d5/d13/d23/d66/f9f 1833340 0 2024-08-18T22:41:48.512 INFO:tasks.workunit.client.0.smithi121.stdout:3/985: dwrite d1e/d1f/da6/f133 [0,4194304] 0 2024-08-18T22:41:48.513 INFO:tasks.workunit.client.1.smithi195.stdout:2/427: write d1/d24/d26/d42/d5c/f7e [572128,96116] 0 2024-08-18T22:41:48.514 INFO:tasks.workunit.client.1.smithi195.stdout:2/428: chown d1/d24/d26/d42 5694584 1 2024-08-18T22:41:48.515 INFO:tasks.workunit.client.1.smithi195.stdout:2/429: write d1/f59 [3134372,30029] 0 2024-08-18T22:41:48.517 INFO:tasks.workunit.client.0.smithi121.stdout:3/986: dread - d1e/d1f/dba/d113/d116/d128/d5f/f138 zero size 2024-08-18T22:41:48.517 INFO:tasks.workunit.client.0.smithi121.stdout:5/834: rmdir d3/d5/d3c 39 2024-08-18T22:41:48.519 INFO:tasks.workunit.client.0.smithi121.stdout:9/954: mknod d0/d38/d9e/df/d61/db2/dce/c13f 0 2024-08-18T22:41:48.522 INFO:tasks.workunit.client.0.smithi121.stdout:2/600: dwrite d2/d8/d19/d4a/d64/f79 [4194304,4194304] 0 2024-08-18T22:41:48.522 INFO:tasks.workunit.client.0.smithi121.stdout:5/835: fsync d3/f1c 0 2024-08-18T22:41:48.525 INFO:tasks.workunit.client.1.smithi195.stdout:3/691: dread d7/da/df/d38/f3f [0,4194304] 0 2024-08-18T22:41:48.528 INFO:tasks.workunit.client.0.smithi121.stdout:2/601: symlink d2/d8/d1f/lc8 0 2024-08-18T22:41:48.529 INFO:tasks.workunit.client.0.smithi121.stdout:3/987: dwrite d1e/d1f/dba/d113/d116/ffd [0,4194304] 0 2024-08-18T22:41:48.529 INFO:tasks.workunit.client.1.smithi195.stdout:3/692: creat d7/da/df/d1c/d6a/d6c/fe3 x:0 0 0 2024-08-18T22:41:48.529 INFO:tasks.workunit.client.0.smithi121.stdout:9/955: fsync d0/d38/d9e/df/d61/f137 0 2024-08-18T22:41:48.531 INFO:tasks.workunit.client.1.smithi195.stdout:3/693: write d7/da/df/d1c/d6a/d6c/fc5 [5128953,125368] 0 2024-08-18T22:41:48.532 INFO:tasks.workunit.client.0.smithi121.stdout:9/956: chown d0/d5/dd/d134 1238 1 2024-08-18T22:41:48.534 INFO:tasks.workunit.client.0.smithi121.stdout:2/602: truncate d2/d3/d48/d77/f6d 4939974 0 2024-08-18T22:41:48.534 INFO:tasks.workunit.client.1.smithi195.stdout:3/694: creat d7/da/df/d1c/fe4 x:0 0 0 2024-08-18T22:41:48.535 INFO:tasks.workunit.client.0.smithi121.stdout:3/988: symlink d1e/d1f/d25/d6b/d83/l159 0 2024-08-18T22:41:48.535 INFO:tasks.workunit.client.0.smithi121.stdout:9/957: mknod d0/d38/d9e/df/d73/d12b/d92/c140 0 2024-08-18T22:41:48.535 INFO:tasks.workunit.client.0.smithi121.stdout:3/989: chown d1e/d1f/d25/d6b/cd5 771312025 1 2024-08-18T22:41:48.537 INFO:tasks.workunit.client.0.smithi121.stdout:3/990: fsync d1e/d1f/d25/f5c 0 2024-08-18T22:41:48.538 INFO:tasks.workunit.client.0.smithi121.stdout:9/958: rename d0/d5/dd/l11 to d0/d5/dd/d1a/l141 0 2024-08-18T22:41:48.539 INFO:tasks.workunit.client.1.smithi195.stdout:3/695: rename d7/da/f70 to d7/da/df/d95/fe5 0 2024-08-18T22:41:48.539 INFO:tasks.workunit.client.0.smithi121.stdout:3/991: getdents d1e/d1f/d25/d58/de0/d14e 0 2024-08-18T22:41:48.539 INFO:tasks.workunit.client.0.smithi121.stdout:9/959: readlink d0/d5/dd/d1a/dc8/dfa/la2 0 2024-08-18T22:41:48.540 INFO:tasks.workunit.client.0.smithi121.stdout:3/992: chown d1e/d1f/d25/d6b/cd5 322989235 1 2024-08-18T22:41:48.542 INFO:tasks.workunit.client.0.smithi121.stdout:3/993: mknod d1e/d1f/d25/d58/de0/c15a 0 2024-08-18T22:41:48.542 INFO:tasks.workunit.client.0.smithi121.stdout:7/968: sync 2024-08-18T22:41:48.543 INFO:tasks.workunit.client.0.smithi121.stdout:0/830: sync 2024-08-18T22:41:48.543 INFO:tasks.workunit.client.0.smithi121.stdout:1/999: sync 2024-08-18T22:41:48.543 INFO:tasks.workunit.client.1.smithi195.stdout:3/696: link d7/da/df/d1c/f25 d7/d1f/d73/db0/fe6 0 2024-08-18T22:41:48.546 INFO:tasks.workunit.client.0.smithi121.stdout:3/994: symlink d1e/d1f/d25/d6b/d83/l15b 0 2024-08-18T22:41:48.546 INFO:tasks.workunit.client.0.smithi121.stdout:0/831: fsync d1/d4/db/d24/df/d8/d78/d7c/f113 0 2024-08-18T22:41:48.546 INFO:tasks.workunit.client.1.smithi195.stdout:3/697: mknod d7/da/df/dca/ce7 0 2024-08-18T22:41:48.548 INFO:tasks.workunit.client.0.smithi121.stdout:9/960: dwrite d0/d5/dd/d1a/d93/f94 [4194304,4194304] 0 2024-08-18T22:41:48.548 INFO:tasks.workunit.client.0.smithi121.stdout:5/836: write d3/d5/d3c/fbd [252431,36589] 0 2024-08-18T22:41:48.550 INFO:tasks.workunit.client.1.smithi195.stdout:3/698: rmdir d7/d1f/d73/dae/db4 0 2024-08-18T22:41:48.551 INFO:tasks.workunit.client.0.smithi121.stdout:0/832: chown d1/d4/db/d24/d30/d6c/fdf 5840 1 2024-08-18T22:41:48.553 INFO:tasks.workunit.client.0.smithi121.stdout:7/969: dread de/d98/dfb/dce/d20/f3f [0,4194304] 0 2024-08-18T22:41:48.553 INFO:tasks.workunit.client.0.smithi121.stdout:0/833: chown d1/d47/fc2 24 1 2024-08-18T22:41:48.554 INFO:tasks.workunit.client.0.smithi121.stdout:3/995: mkdir d1e/d1f/d25/d67/d92/dbd/d126/d97/d15c 0 2024-08-18T22:41:48.555 INFO:tasks.workunit.client.0.smithi121.stdout:9/961: mknod d0/d38/d9e/df/d73/d12b/d92/dc6/dd5/c142 0 2024-08-18T22:41:48.558 INFO:tasks.workunit.client.0.smithi121.stdout:5/837: rename d3/d5/d27/f6d to d3/d5/d13/d23/da4/da6/dc4/f10a 0 2024-08-18T22:41:48.559 INFO:tasks.workunit.client.0.smithi121.stdout:7/970: creat de/d98/dfb/dce/d2f/d4b/d6d/dca/f139 x:0 0 0 2024-08-18T22:41:48.560 INFO:tasks.workunit.client.0.smithi121.stdout:3/996: creat d1e/d1f/d25/d6b/db4/f15d x:0 0 0 2024-08-18T22:41:48.561 INFO:tasks.workunit.client.0.smithi121.stdout:7/971: chown de/d98/dfb/dce/d2f/dbf/cc6 802 1 2024-08-18T22:41:48.561 INFO:tasks.workunit.client.0.smithi121.stdout:9/962: mkdir d0/d38/d9e/df/d61/db2/dce/d143 0 2024-08-18T22:41:48.562 INFO:tasks.workunit.client.0.smithi121.stdout:0/834: creat d1/d4/d53/da7/f123 x:0 0 0 2024-08-18T22:41:48.563 INFO:tasks.workunit.client.1.smithi195.stdout:3/699: dwrite d7/d1f/d49/fd4 [0,4194304] 0 2024-08-18T22:41:48.563 INFO:tasks.workunit.client.0.smithi121.stdout:7/972: write de/d98/dfb/dce/f106 [290250,75119] 0 2024-08-18T22:41:48.565 INFO:tasks.workunit.client.0.smithi121.stdout:3/997: link d1e/d1f/da6/dc7/f13f d1e/d1f/d3e/f15e 0 2024-08-18T22:41:48.566 INFO:tasks.workunit.client.1.smithi195.stdout:3/700: chown d7/da/df/d1c/d6a/c92 1059 1 2024-08-18T22:41:48.566 INFO:tasks.workunit.client.0.smithi121.stdout:0/835: fdatasync d1/d4/db/d24/d30/fc0 0 2024-08-18T22:41:48.568 INFO:tasks.workunit.client.0.smithi121.stdout:3/998: write d1e/d1f/d25/d6b/d81/fcc [1113080,103197] 0 2024-08-18T22:41:48.569 INFO:tasks.workunit.client.1.smithi195.stdout:3/701: symlink d7/da/le8 0 2024-08-18T22:41:48.570 INFO:tasks.workunit.client.0.smithi121.stdout:9/963: link d0/f114 d0/d5/dd/d1a/dc8/dfa/f144 0 2024-08-18T22:41:48.570 INFO:tasks.workunit.client.0.smithi121.stdout:5/838: dread d3/d5/d13/d19/d24/f47 [0,4194304] 0 2024-08-18T22:41:48.571 INFO:tasks.workunit.client.1.smithi195.stdout:7/649: sync 2024-08-18T22:41:48.571 INFO:tasks.workunit.client.1.smithi195.stdout:3/702: read d7/d1f/f80 [3779542,65656] 0 2024-08-18T22:41:48.572 INFO:tasks.workunit.client.0.smithi121.stdout:7/973: rename de/d98/dfb/dce/d2f/d4b/d6d/d123 to de/d98/dfb/dce/d34/d38/d73/da2/d100/da0/d118/d13a 0 2024-08-18T22:41:48.572 INFO:tasks.workunit.client.0.smithi121.stdout:5/839: chown d3/d5/d13/d23/c84 1531 1 2024-08-18T22:41:48.572 INFO:tasks.workunit.client.0.smithi121.stdout:3/999: fsync d1e/d1f/d25/d58/f87 0 2024-08-18T22:41:48.574 INFO:tasks.workunit.client.0.smithi121.stdout:5/840: truncate d3/d5/d13/d19/d24/d4d/dad/ff3 848294 0 2024-08-18T22:41:48.575 INFO:tasks.workunit.client.0.smithi121.stdout:0/836: getdents d1/d4/db/d24/df/d8/d71/d79 0 2024-08-18T22:41:48.576 INFO:tasks.workunit.client.0.smithi121.stdout:5/841: write d3/f2c [2101826,90131] 0 2024-08-18T22:41:48.577 INFO:tasks.workunit.client.0.smithi121.stdout:9/964: link d0/d38/d9e/df/d3d/fbd d0/d5/dd/d2f/dcd/f145 0 2024-08-18T22:41:48.578 INFO:tasks.workunit.client.1.smithi195.stdout:7/650: dwrite dc/f32 [0,4194304] 0 2024-08-18T22:41:48.578 INFO:tasks.workunit.client.0.smithi121.stdout:0/837: creat d1/d8a/f124 x:0 0 0 2024-08-18T22:41:48.580 INFO:tasks.workunit.client.1.smithi195.stdout:3/703: dread d7/da/df/d1c/d6a/d6c/f6e [0,4194304] 0 2024-08-18T22:41:48.583 INFO:tasks.workunit.client.1.smithi195.stdout:3/704: mknod d7/da/df/d1c/d6a/d6c/ce9 0 2024-08-18T22:41:48.585 INFO:tasks.workunit.client.1.smithi195.stdout:3/705: fsync d7/d1f/fa9 0 2024-08-18T22:41:48.585 INFO:tasks.workunit.client.1.smithi195.stdout:7/651: link dc/d1d/d29/ddb/d15/d17/d58/lc1 dc/d8f/d96/le8 0 2024-08-18T22:41:48.590 INFO:tasks.workunit.client.1.smithi195.stdout:7/652: rmdir dc/d1d/d29/ddb/daa 0 2024-08-18T22:41:48.591 INFO:tasks.workunit.client.1.smithi195.stdout:3/706: rename d7/d1f/d49/fd4 to d7/da/df/d1c/d6a/fea 0 2024-08-18T22:41:48.594 INFO:tasks.workunit.client.1.smithi195.stdout:7/653: rename dc/d1d/f7a to dc/d1d/d29/ddb/d15/d17/d58/fe9 0 2024-08-18T22:41:48.595 INFO:tasks.workunit.client.1.smithi195.stdout:7/654: fsync dc/f72 0 2024-08-18T22:41:48.599 INFO:tasks.workunit.client.1.smithi195.stdout:3/707: dwrite d7/da/df/d1c/dc6/fcd [0,4194304] 0 2024-08-18T22:41:48.602 INFO:tasks.workunit.client.1.smithi195.stdout:3/708: write d7/da/df/d95/fe5 [1045669,123460] 0 2024-08-18T22:41:48.605 INFO:tasks.workunit.client.1.smithi195.stdout:7/655: dwrite dc/d1d/d29/ddb/d2b/f5e [0,4194304] 0 2024-08-18T22:41:48.606 INFO:tasks.workunit.client.1.smithi195.stdout:3/709: dread d7/f4c [0,4194304] 0 2024-08-18T22:41:48.608 INFO:tasks.workunit.client.1.smithi195.stdout:3/710: chown d7/da/df/d95 1672 1 2024-08-18T22:41:48.608 INFO:tasks.workunit.client.1.smithi195.stdout:7/656: mknod dc/d1d/d29/ddb/d15/cea 0 2024-08-18T22:41:48.610 INFO:tasks.workunit.client.1.smithi195.stdout:3/711: mknod d7/da/df/d8e/daa/ceb 0 2024-08-18T22:41:48.611 INFO:tasks.workunit.client.1.smithi195.stdout:7/657: fsync dc/d1d/d29/ddb/f47 0 2024-08-18T22:41:48.616 INFO:tasks.workunit.client.1.smithi195.stdout:3/712: symlink d7/da/df/d8e/lec 0 2024-08-18T22:41:48.617 INFO:tasks.workunit.client.1.smithi195.stdout:3/713: chown d7/d1f/d73/c91 41567 1 2024-08-18T22:41:48.619 INFO:tasks.workunit.client.1.smithi195.stdout:3/714: creat d7/da/df/dd3/fed x:0 0 0 2024-08-18T22:41:48.622 INFO:tasks.workunit.client.1.smithi195.stdout:3/715: mknod d7/da/df/d1c/d6a/cee 0 2024-08-18T22:41:48.624 INFO:tasks.workunit.client.1.smithi195.stdout:7/658: truncate dc/d1d/f88 6994423 0 2024-08-18T22:41:48.626 INFO:tasks.workunit.client.1.smithi195.stdout:3/716: dread d7/d1f/f34 [0,4194304] 0 2024-08-18T22:41:48.628 INFO:tasks.workunit.client.1.smithi195.stdout:3/717: truncate d7/da/df/d1c/d6a/d6c/fa5 929677 0 2024-08-18T22:41:48.631 INFO:tasks.workunit.client.1.smithi195.stdout:3/718: creat d7/da/df/d1c/fef x:0 0 0 2024-08-18T22:41:48.632 INFO:tasks.workunit.client.1.smithi195.stdout:7/659: dwrite dc/d1d/d29/ddb/d15/d17/d58/db6/fe3 [0,4194304] 0 2024-08-18T22:41:48.640 INFO:tasks.workunit.client.1.smithi195.stdout:7/660: getdents dc/d1d/d29/ddb/d15/d17/d58 0 2024-08-18T22:41:48.647 INFO:tasks.workunit.client.1.smithi195.stdout:3/719: dwrite d7/da/df/f69 [0,4194304] 0 2024-08-18T22:41:48.648 INFO:tasks.workunit.client.1.smithi195.stdout:7/661: truncate dc/f32 191687 0 2024-08-18T22:41:48.649 INFO:tasks.workunit.client.1.smithi195.stdout:7/662: chown dc/d1d 57052 1 2024-08-18T22:41:48.650 INFO:tasks.workunit.client.1.smithi195.stdout:3/720: rmdir d7/d1f/d73/dae 39 2024-08-18T22:41:48.655 INFO:tasks.workunit.client.1.smithi195.stdout:7/663: creat dc/feb x:0 0 0 2024-08-18T22:41:48.657 INFO:tasks.workunit.client.1.smithi195.stdout:7/664: fsync f2 0 2024-08-18T22:41:48.660 INFO:tasks.workunit.client.1.smithi195.stdout:3/721: link d7/da/df/d8e/daa/cdc d7/d1f/d49/cf0 0 2024-08-18T22:41:48.662 INFO:tasks.workunit.client.1.smithi195.stdout:3/722: mkdir d7/da/df/d1c/d6a/df1 0 2024-08-18T22:41:48.667 INFO:tasks.workunit.client.0.smithi121.stdout:5/842: mkdir d3/d5/d13/d10b 0 2024-08-18T22:41:48.671 INFO:tasks.workunit.client.0.smithi121.stdout:9/965: dwrite d0/d5/dd/d2f/f50 [0,4194304] 0 2024-08-18T22:41:48.671 INFO:tasks.workunit.client.0.smithi121.stdout:0/838: dwrite d1/d4/f1f [4194304,4194304] 0 2024-08-18T22:41:48.673 INFO:tasks.workunit.client.0.smithi121.stdout:0/839: write d1/d4/db/d18/d1c/f59 [3615993,45385] 0 2024-08-18T22:41:48.677 INFO:tasks.workunit.client.0.smithi121.stdout:5/843: link d3/d5/d13/d19/d24/lcc d3/d5/d13/d19/d24/d32/da8/l10c 0 2024-08-18T22:41:48.679 INFO:tasks.workunit.client.0.smithi121.stdout:5/844: creat d3/d5/d13/d23/d66/f10d x:0 0 0 2024-08-18T22:41:48.682 INFO:tasks.workunit.client.0.smithi121.stdout:5/845: link d3/d5/d3c/cc2 d3/d5c/c10e 0 2024-08-18T22:41:48.684 INFO:tasks.workunit.client.0.smithi121.stdout:5/846: unlink d3/d5/d13/d23/da4/da6/dc4/ld2 0 2024-08-18T22:41:48.690 INFO:tasks.workunit.client.0.smithi121.stdout:9/966: dread d0/d38/d9e/df/d3d/f103 [0,4194304] 0 2024-08-18T22:41:48.691 INFO:tasks.workunit.client.0.smithi121.stdout:5/847: dwrite d3/d5/d13/d19/d24/d32/fed [0,4194304] 0 2024-08-18T22:41:48.691 INFO:tasks.workunit.client.0.smithi121.stdout:9/967: chown d0/d38/d9e/d18 47834086 1 2024-08-18T22:41:48.693 INFO:tasks.workunit.client.0.smithi121.stdout:9/968: truncate d0/d38/d9e/d18/fb9 834536 0 2024-08-18T22:41:48.693 INFO:tasks.workunit.client.0.smithi121.stdout:5/848: mkdir d3/d5/d27/d10f 0 2024-08-18T22:41:48.695 INFO:tasks.workunit.client.0.smithi121.stdout:9/969: truncate d0/d38/d9e/d18/fb9 1210559 0 2024-08-18T22:41:48.697 INFO:tasks.workunit.client.0.smithi121.stdout:5/849: read d3/d5/d13/d23/d66/f79 [96551,58489] 0 2024-08-18T22:41:48.701 INFO:tasks.workunit.client.0.smithi121.stdout:5/850: creat d3/d5/d13/d23/da4/f110 x:0 0 0 2024-08-18T22:41:48.703 INFO:tasks.workunit.client.0.smithi121.stdout:5/851: mknod d3/d5/d13/d23/da4/da6/c111 0 2024-08-18T22:41:48.708 INFO:tasks.workunit.client.0.smithi121.stdout:5/852: dwrite d3/d5/f9d [0,4194304] 0 2024-08-18T22:41:48.715 INFO:tasks.workunit.client.0.smithi121.stdout:5/853: rename d3/d5/d13/d19/d24/d4d/dad/d8b/cbb to d3/d5/d13/d23/c112 0 2024-08-18T22:41:48.716 INFO:tasks.workunit.client.0.smithi121.stdout:9/970: dwrite d0/d38/d52/d5f/f8e [0,4194304] 0 2024-08-18T22:41:48.724 INFO:tasks.workunit.client.1.smithi195.stdout:7/665: dwrite dc/d8f/d96/fc6 [0,4194304] 0 2024-08-18T22:41:48.725 INFO:tasks.workunit.client.1.smithi195.stdout:3/723: symlink d7/da/df/dca/d81/lf2 0 2024-08-18T22:41:48.727 INFO:tasks.workunit.client.0.smithi121.stdout:5/854: truncate d3/d5/f62 234421 0 2024-08-18T22:41:48.727 INFO:tasks.workunit.client.1.smithi195.stdout:7/666: write dc/d1d/d29/ddb/d15/d17/d58/fe4 [607217,17958] 0 2024-08-18T22:41:48.730 INFO:tasks.workunit.client.1.smithi195.stdout:7/667: creat dc/d1d/d29/ddb/d15/d4d/d97/fec x:0 0 0 2024-08-18T22:41:48.730 INFO:tasks.workunit.client.0.smithi121.stdout:5/855: creat d3/d5c/f113 x:0 0 0 2024-08-18T22:41:48.733 INFO:tasks.workunit.client.1.smithi195.stdout:7/668: unlink dc/d1d/d29/ddb/d2b/faf 0 2024-08-18T22:41:48.733 INFO:tasks.workunit.client.0.smithi121.stdout:9/971: dwrite d0/d38/d52/d5f/de1/f123 [0,4194304] 0 2024-08-18T22:41:48.736 INFO:tasks.workunit.client.1.smithi195.stdout:3/724: truncate d7/f5c 2087658 0 2024-08-18T22:41:48.736 INFO:tasks.workunit.client.1.smithi195.stdout:3/725: stat d7/da/df/d1c 0 2024-08-18T22:41:48.737 INFO:tasks.workunit.client.0.smithi121.stdout:5/856: rename d3/d5/d13/d19/da3/ce9 to d3/d5/d3c/daf/c114 0 2024-08-18T22:41:48.741 INFO:tasks.workunit.client.0.smithi121.stdout:9/972: rename d0/d5/dd/d3b/d48/fc7 to d0/d38/d9e/d45/f146 0 2024-08-18T22:41:48.742 INFO:tasks.workunit.client.0.smithi121.stdout:9/973: dread - d0/d38/d9e/df/d73/d12b/d92/dc6/f13e zero size 2024-08-18T22:41:48.743 INFO:tasks.workunit.client.1.smithi195.stdout:3/726: write d7/d1f/f26 [973605,128649] 0 2024-08-18T22:41:48.744 INFO:tasks.workunit.client.0.smithi121.stdout:9/974: mknod d0/d5/dd/d1a/dc8/dfa/dbf/c147 0 2024-08-18T22:41:48.744 INFO:tasks.workunit.client.0.smithi121.stdout:5/857: link d3/d5/d13/d19/d24/d32/d38/f93 d3/d5/d3c/dd3/f115 0 2024-08-18T22:41:48.747 INFO:tasks.workunit.client.0.smithi121.stdout:9/975: rmdir d0/d38/d9e/df/d73/d12b 39 2024-08-18T22:41:48.748 INFO:tasks.workunit.client.1.smithi195.stdout:7/669: dread f1 [0,4194304] 0 2024-08-18T22:41:48.748 INFO:tasks.workunit.client.0.smithi121.stdout:5/858: rmdir d3/d5/d13/d19 39 2024-08-18T22:41:48.749 INFO:tasks.workunit.client.1.smithi195.stdout:7/670: creat dc/d2a/d56/fed x:0 0 0 2024-08-18T22:41:48.750 INFO:tasks.workunit.client.0.smithi121.stdout:9/976: fsync d0/d38/d9e/df/d73/d12b/d92/dc6/dd5/f130 0 2024-08-18T22:41:48.751 INFO:tasks.workunit.client.0.smithi121.stdout:5/859: rmdir d3/d5/d13/d19/d24/d4d 39 2024-08-18T22:41:48.752 INFO:tasks.workunit.client.0.smithi121.stdout:9/977: read - d0/d5/dd/d3b/ffb zero size 2024-08-18T22:41:48.753 INFO:tasks.workunit.client.0.smithi121.stdout:5/860: write d3/d5/d13/d19/d24/d32/d38/f85 [3786913,114583] 0 2024-08-18T22:41:48.757 INFO:tasks.workunit.client.1.smithi195.stdout:7/671: write dc/d1d/d29/ddb/d15/d17/d58/f5a [848707,63609] 0 2024-08-18T22:41:48.760 INFO:tasks.workunit.client.1.smithi195.stdout:7/672: creat dc/d1d/d29/ddb/d15/d17/fee x:0 0 0 2024-08-18T22:41:48.761 INFO:tasks.workunit.client.0.smithi121.stdout:2/603: sync 2024-08-18T22:41:48.761 INFO:tasks.workunit.client.1.smithi195.stdout:7/673: read - dc/d1d/d29/ddb/d2b/dbc/fc0 zero size 2024-08-18T22:41:48.762 INFO:tasks.workunit.client.1.smithi195.stdout:7/674: creat dc/d1d/d29/ddb/d2b/d82/fef x:0 0 0 2024-08-18T22:41:48.763 INFO:tasks.workunit.client.0.smithi121.stdout:5/861: dwrite d3/d5/d13/d19/d24/d4d/f9b [0,4194304] 0 2024-08-18T22:41:48.764 INFO:tasks.workunit.client.1.smithi195.stdout:7/675: mkdir dc/d1d/d29/df0 0 2024-08-18T22:41:48.764 INFO:tasks.workunit.client.1.smithi195.stdout:7/676: stat dc 0 2024-08-18T22:41:48.766 INFO:tasks.workunit.client.0.smithi121.stdout:5/862: truncate d3/d5/d13/d19/d24/f47 1204179 0 2024-08-18T22:41:48.766 INFO:tasks.workunit.client.0.smithi121.stdout:2/604: link d2/d3/d48/d77/l43 d2/d3/d48/d77/lc9 0 2024-08-18T22:41:48.768 INFO:tasks.workunit.client.0.smithi121.stdout:2/605: creat d2/d3/d48/d77/fca x:0 0 0 2024-08-18T22:41:48.769 INFO:tasks.workunit.client.0.smithi121.stdout:2/606: chown d2/d8/d19/d4a/fb1 17843 1 2024-08-18T22:41:48.773 INFO:tasks.workunit.client.1.smithi195.stdout:7/677: write dc/d1d/d29/ddb/d2b/fb4 [537829,45183] 0 2024-08-18T22:41:48.775 INFO:tasks.workunit.client.1.smithi195.stdout:7/678: write dc/d22/f2c [1641281,12401] 0 2024-08-18T22:41:48.775 INFO:tasks.workunit.client.0.smithi121.stdout:5/863: write d3/d5/d13/d19/d75/f87 [891825,41786] 0 2024-08-18T22:41:48.778 INFO:tasks.workunit.client.0.smithi121.stdout:5/864: mknod d3/d5c/c116 0 2024-08-18T22:41:48.779 INFO:tasks.workunit.client.1.smithi195.stdout:7/679: getdents dc 0 2024-08-18T22:41:48.780 INFO:tasks.workunit.client.1.smithi195.stdout:7/680: readlink dc/d1d/d29/ddb/d15/d17/d58/l61 0 2024-08-18T22:41:48.781 INFO:tasks.workunit.client.0.smithi121.stdout:2/607: dwrite d2/f2c [0,4194304] 0 2024-08-18T22:41:48.781 INFO:tasks.workunit.client.1.smithi195.stdout:7/681: write dc/d1d/d29/ddb/d15/d4d/d97/fb0 [190907,52636] 0 2024-08-18T22:41:48.783 INFO:tasks.workunit.client.0.smithi121.stdout:5/865: getdents d3/d5/d13/d19/d24/d32/da8 0 2024-08-18T22:41:48.783 INFO:tasks.workunit.client.0.smithi121.stdout:2/608: dread - d2/d8/d19/d4a/d64/f90 zero size 2024-08-18T22:41:48.785 INFO:tasks.workunit.client.0.smithi121.stdout:5/866: creat d3/d5/d13/d19/da3/f117 x:0 0 0 2024-08-18T22:41:48.788 INFO:tasks.workunit.client.0.smithi121.stdout:5/867: creat d3/d5/d13/d23/da4/da6/f118 x:0 0 0 2024-08-18T22:41:48.793 INFO:tasks.workunit.client.1.smithi195.stdout:7/682: dwrite dc/d1d/d29/ddb/f3b [4194304,4194304] 0 2024-08-18T22:41:48.800 INFO:tasks.workunit.client.0.smithi121.stdout:2/609: dwrite d2/d8/d19/f52 [4194304,4194304] 0 2024-08-18T22:41:48.801 INFO:tasks.workunit.client.0.smithi121.stdout:5/868: dwrite d3/d5/d13/d23/da4/dc7/dae/fc0 [0,4194304] 0 2024-08-18T22:41:48.806 INFO:tasks.workunit.client.0.smithi121.stdout:2/610: rename d2/d8/d19/d55/l82 to d2/d8/d9e/lcb 0 2024-08-18T22:41:48.810 INFO:tasks.workunit.client.1.smithi195.stdout:7/683: dread f5 [0,4194304] 0 2024-08-18T22:41:48.811 INFO:tasks.workunit.client.0.smithi121.stdout:2/611: rename d2/d3/d48/f4e to d2/d8/d1f/fcc 0 2024-08-18T22:41:48.814 INFO:tasks.workunit.client.0.smithi121.stdout:2/612: fsync d2/d73/fc1 0 2024-08-18T22:41:48.814 INFO:tasks.workunit.client.1.smithi195.stdout:7/684: dread dc/d1d/d29/ddb/d15/fa8 [0,4194304] 0 2024-08-18T22:41:48.816 INFO:tasks.workunit.client.0.smithi121.stdout:2/613: rmdir d2/d3/d84 39 2024-08-18T22:41:48.817 INFO:tasks.workunit.client.0.smithi121.stdout:2/614: creat d2/d73/fcd x:0 0 0 2024-08-18T22:41:48.817 INFO:tasks.workunit.client.0.smithi121.stdout:2/615: chown d2/d3 1 1 2024-08-18T22:41:48.819 INFO:tasks.workunit.client.0.smithi121.stdout:2/616: unlink d2/d8/d19/laf 0 2024-08-18T22:41:48.828 INFO:tasks.workunit.client.0.smithi121.stdout:5/869: truncate d3/d5/d13/d19/d24/d32/d38/f4e 220321 0 2024-08-18T22:41:48.831 INFO:tasks.workunit.client.1.smithi195.stdout:7/685: truncate dc/d1d/d29/ddb/d15/d17/d18/f43 2330014 0 2024-08-18T22:41:48.832 INFO:tasks.workunit.client.0.smithi121.stdout:5/870: rename d3/f46 to d3/d5/d13/d23/da4/da6/dc4/f119 0 2024-08-18T22:41:48.832 INFO:tasks.workunit.client.1.smithi195.stdout:7/686: rmdir dc/d1d/d29/ddb/d15/d17/d58 39 2024-08-18T22:41:48.833 INFO:tasks.workunit.client.0.smithi121.stdout:5/871: write d3/d5/d13/d19/d24/d32/d38/f85 [1514335,100159] 0 2024-08-18T22:41:48.834 INFO:tasks.workunit.client.1.smithi195.stdout:7/687: chown dc/d1d/d29/ddb/d2b/c78 1 1 2024-08-18T22:41:48.839 INFO:tasks.workunit.client.1.smithi195.stdout:7/688: write dc/d2a/d4c/fcc [1920109,17982] 0 2024-08-18T22:41:48.840 INFO:tasks.workunit.client.0.smithi121.stdout:2/617: dwrite d2/d8/d19/f93 [0,4194304] 0 2024-08-18T22:41:48.840 INFO:tasks.workunit.client.0.smithi121.stdout:5/872: rename d3/d5/d13/d23/da4/da6/dc4/f119 to d3/d5/d13/d23/da4/da6/dc4/f11a 0 2024-08-18T22:41:48.842 INFO:tasks.workunit.client.1.smithi195.stdout:7/689: read dc/d2a/d56/f84 [276,131055] 0 2024-08-18T22:41:48.843 INFO:tasks.workunit.client.0.smithi121.stdout:5/873: creat d3/d5/d3c/d3f/d8f/f11b x:0 0 0 2024-08-18T22:41:48.844 INFO:tasks.workunit.client.0.smithi121.stdout:2/618: rename d2/d73/fcd to d2/d3/d53/fce 0 2024-08-18T22:41:48.845 INFO:tasks.workunit.client.0.smithi121.stdout:5/874: mkdir d3/d5/d13/d23/da4/dc7/dae/d11c 0 2024-08-18T22:41:48.846 INFO:tasks.workunit.client.0.smithi121.stdout:2/619: symlink d2/d3/lcf 0 2024-08-18T22:41:48.851 INFO:tasks.workunit.client.1.smithi195.stdout:7/690: rename dc/d1d/d29/ddb/d15/d17/d18/f75 to dc/d1d/d29/ddb/d15/d17/d58/ff1 0 2024-08-18T22:41:48.851 INFO:tasks.workunit.client.0.smithi121.stdout:2/620: mknod d2/d3/d53/cd0 0 2024-08-18T22:41:48.851 INFO:tasks.workunit.client.0.smithi121.stdout:2/621: stat d2/d8/d1f/f41 0 2024-08-18T22:41:48.852 INFO:tasks.workunit.client.0.smithi121.stdout:2/622: chown d2/d8/d19/dc/c6f 486 1 2024-08-18T22:41:48.852 INFO:tasks.workunit.client.1.smithi195.stdout:7/691: getdents dc/d2a/d4c 0 2024-08-18T22:41:48.853 INFO:tasks.workunit.client.0.smithi121.stdout:5/875: dwrite d3/d5/d27/dce/db5/fff [0,4194304] 0 2024-08-18T22:41:48.854 INFO:tasks.workunit.client.1.smithi195.stdout:7/692: chown dc/d1d/d29/ddb/d15/d17/d58/db6/fe3 1191512 1 2024-08-18T22:41:48.855 INFO:tasks.workunit.client.0.smithi121.stdout:2/623: symlink d2/d3/d48/d77/ld1 0 2024-08-18T22:41:48.862 INFO:tasks.workunit.client.0.smithi121.stdout:5/876: mknod d3/d5/d13/d23/d66/c11d 0 2024-08-18T22:41:48.863 INFO:tasks.workunit.client.0.smithi121.stdout:5/877: read d3/d5/d27/dce/db5/fff [101196,61984] 0 2024-08-18T22:41:48.863 INFO:tasks.workunit.client.0.smithi121.stdout:0/840: sync 2024-08-18T22:41:48.863 INFO:tasks.workunit.client.0.smithi121.stdout:7/974: sync 2024-08-18T22:41:48.864 INFO:tasks.workunit.client.1.smithi195.stdout:7/693: dwrite dc/d1d/d29/fbe [0,4194304] 0 2024-08-18T22:41:48.864 INFO:tasks.workunit.client.0.smithi121.stdout:2/624: rename d2/d3/l18 to d2/d8/d19/dc/ld2 0 2024-08-18T22:41:48.866 INFO:tasks.workunit.client.1.smithi195.stdout:7/694: truncate dc/d1d/d29/ddb/d15/d17/fd6 782964 0 2024-08-18T22:41:48.867 INFO:tasks.workunit.client.1.smithi195.stdout:7/695: chown dc/d1d/d29/ddb/d15/d17/d58/fe9 5604982 1 2024-08-18T22:41:48.869 INFO:tasks.workunit.client.1.smithi195.stdout:7/696: mkdir dc/d1d/d29/df0/df2 0 2024-08-18T22:41:48.869 INFO:tasks.workunit.client.0.smithi121.stdout:5/878: dwrite d3/fd [0,4194304] 0 2024-08-18T22:41:48.870 INFO:tasks.workunit.client.0.smithi121.stdout:0/841: mkdir d1/d4/db/d24/d30/d6c/dde/d125 0 2024-08-18T22:41:48.870 INFO:tasks.workunit.client.0.smithi121.stdout:2/625: fsync d2/d8/d19/d4a/d64/f79 0 2024-08-18T22:41:48.870 INFO:tasks.workunit.client.1.smithi195.stdout:7/697: chown dc/d1d/d29/ddb/d15/d17/d18/ldf 1417 1 2024-08-18T22:41:48.872 INFO:tasks.workunit.client.1.smithi195.stdout:7/698: write dc/d1d/d29/ddb/d2b/dbc/fc0 [723349,4423] 0 2024-08-18T22:41:48.873 INFO:tasks.workunit.client.1.smithi195.stdout:7/699: rmdir dc/d1d 39 2024-08-18T22:41:48.875 INFO:tasks.workunit.client.0.smithi121.stdout:5/879: chown d3/d5/d13/d23/da4/dc7/l89 13 1 2024-08-18T22:41:48.875 INFO:tasks.workunit.client.0.smithi121.stdout:7/975: dwrite de/d98/dfb/dce/f106 [0,4194304] 0 2024-08-18T22:41:48.878 INFO:tasks.workunit.client.0.smithi121.stdout:0/842: write d1/d4/db/d24/df/d8/d78/d7c/df5/daf/dd5/d90/f108 [500107,73633] 0 2024-08-18T22:41:48.882 INFO:tasks.workunit.client.0.smithi121.stdout:5/880: rename d3/d5/d13/d23/da4/dc7/dae to d3/d5/d13/d10b/d11e 0 2024-08-18T22:41:48.883 INFO:tasks.workunit.client.0.smithi121.stdout:7/976: mkdir de/d98/dfb/dce/d34/d38/d73/da2/d100/d18/d2e/dd7/dfd/d13b 0 2024-08-18T22:41:48.883 INFO:tasks.workunit.client.0.smithi121.stdout:2/626: dwrite d2/d8/d19/d55/f70 [0,4194304] 0 2024-08-18T22:41:48.884 INFO:tasks.workunit.client.0.smithi121.stdout:0/843: mknod d1/d4/db/d24/d30/d6c/dde/c126 0 2024-08-18T22:41:48.885 INFO:tasks.workunit.client.0.smithi121.stdout:2/627: chown d2/d3/d53 22664 1 2024-08-18T22:41:48.889 INFO:tasks.workunit.client.0.smithi121.stdout:0/844: creat d1/d4/d53/d61/f127 x:0 0 0 2024-08-18T22:41:48.890 INFO:tasks.workunit.client.0.smithi121.stdout:7/977: creat de/d98/dfb/dce/d34/d38/d73/da2/d100/d18/d2e/dd7/dfd/f13c x:0 0 0 2024-08-18T22:41:48.891 INFO:tasks.workunit.client.1.smithi195.stdout:7/700: dwrite dc/d1d/d29/ddb/f68 [0,4194304] 0 2024-08-18T22:41:48.893 INFO:tasks.workunit.client.0.smithi121.stdout:5/881: dwrite d3/d5/d13/d23/ff7 [0,4194304] 0 2024-08-18T22:41:48.896 INFO:tasks.workunit.client.0.smithi121.stdout:5/882: write d3/d5/d3c/fbd [616506,101289] 0 2024-08-18T22:41:48.899 INFO:tasks.workunit.client.0.smithi121.stdout:0/845: mknod d1/d4/db/d24/df/d8/d78/d7c/df5/daf/dd5/d5b/da5/d11c/c128 0 2024-08-18T22:41:48.902 INFO:tasks.workunit.client.0.smithi121.stdout:5/883: rename d3/d5/d27/dce to d3/d5/d3c/daf/d11f 0 2024-08-18T22:41:48.905 INFO:tasks.workunit.client.1.smithi195.stdout:7/701: dread dc/d1d/d29/ddb/d15/d17/d18/f57 [0,4194304] 0 2024-08-18T22:41:48.907 INFO:tasks.workunit.client.0.smithi121.stdout:0/846: mkdir d1/d4/db/d18/d129 0 2024-08-18T22:41:48.907 INFO:tasks.workunit.client.1.smithi195.stdout:7/702: chown dc/d8f/d96/fc6 277 1 2024-08-18T22:41:48.909 INFO:tasks.workunit.client.0.smithi121.stdout:5/884: dread d3/d5/d13/d23/ff7 [0,4194304] 0 2024-08-18T22:41:48.909 INFO:tasks.workunit.client.0.smithi121.stdout:0/847: write d1/d4/da/d2f/da0/fe8 [276085,128816] 0 2024-08-18T22:41:48.911 INFO:tasks.workunit.client.0.smithi121.stdout:0/848: readlink d1/d4/db/d24/df/d8/d78/d7c/df5/d9d/l10a 0 2024-08-18T22:41:48.915 INFO:tasks.workunit.client.1.smithi195.stdout:7/703: dwrite dc/d1d/d29/ddb/d15/d17/d58/db6/fc4 [0,4194304] 0 2024-08-18T22:41:48.916 INFO:tasks.workunit.client.0.smithi121.stdout:9/978: sync 2024-08-18T22:41:48.923 INFO:tasks.workunit.client.0.smithi121.stdout:9/979: getdents d0/d38/d9e/df/d73/d12b/d92/dc6/dd5 0 2024-08-18T22:41:48.923 INFO:tasks.workunit.client.0.smithi121.stdout:2/628: dread d2/d8/d19/f52 [0,4194304] 0 2024-08-18T22:41:48.924 INFO:tasks.workunit.client.1.smithi195.stdout:7/704: dwrite dc/d1d/d29/f63 [0,4194304] 0 2024-08-18T22:41:48.924 INFO:tasks.workunit.client.0.smithi121.stdout:7/978: truncate de/d98/dfb/dce/d34/d38/d73/da2/f11c 780007 0 2024-08-18T22:41:48.926 INFO:tasks.workunit.client.0.smithi121.stdout:2/629: dread - d2/d8/d1f/f41 zero size 2024-08-18T22:41:48.931 INFO:tasks.workunit.client.0.smithi121.stdout:7/979: creat de/d98/dfb/dce/d34/d38/d73/da2/d100/d18/d23/d24/d29/d43/d131/f13d x:0 0 0 2024-08-18T22:41:48.932 INFO:tasks.workunit.client.0.smithi121.stdout:5/885: dwrite d3/d5/d13/d23/d66/f9f [0,4194304] 0 2024-08-18T22:41:48.934 INFO:tasks.workunit.client.1.smithi195.stdout:7/705: write dc/d1d/d29/ddb/d15/d17/d18/f43 [3230215,129231] 0 2024-08-18T22:41:48.936 INFO:tasks.workunit.client.0.smithi121.stdout:7/980: creat de/d98/dfb/dce/d34/d38/d73/f13e x:0 0 0 2024-08-18T22:41:48.937 INFO:tasks.workunit.client.1.smithi195.stdout:7/706: creat dc/ff3 x:0 0 0 2024-08-18T22:41:48.938 INFO:tasks.workunit.client.0.smithi121.stdout:2/630: dwrite d2/d8/d19/f52 [0,4194304] 0 2024-08-18T22:41:48.941 INFO:tasks.workunit.client.1.smithi195.stdout:7/707: dread dc/d1d/d29/ddb/d15/d17/d18/d89/f98 [0,4194304] 0 2024-08-18T22:41:48.944 INFO:tasks.workunit.client.0.smithi121.stdout:2/631: read d2/d8/d19/f52 [6319121,3650] 0 2024-08-18T22:41:48.944 INFO:tasks.workunit.client.0.smithi121.stdout:5/886: link d3/d5/d13/l73 d3/d5/d13/d23/da4/da6/dc4/l120 0 2024-08-18T22:41:48.945 INFO:tasks.workunit.client.1.smithi195.stdout:7/708: creat dc/d1d/d29/ddb/d15/d17/d58/db6/dd0/ff4 x:0 0 0 2024-08-18T22:41:48.946 INFO:tasks.workunit.client.0.smithi121.stdout:5/887: write d3/d5/d13/d23/da4/dc7/f102 [461938,122278] 0 2024-08-18T22:41:48.946 INFO:tasks.workunit.client.0.smithi121.stdout:2/632: fsync d2/d8/d19/d4a/d64/f8b 0 2024-08-18T22:41:48.948 INFO:tasks.workunit.client.1.smithi195.stdout:7/709: write dc/d1d/d29/ddb/d15/d17/d18/f1c [4867828,129893] 0 2024-08-18T22:41:48.951 INFO:tasks.workunit.client.1.smithi195.stdout:7/710: truncate dc/d1d/d29/ddb/d15/d4d/d97/fec 791330 0 2024-08-18T22:41:48.951 INFO:tasks.workunit.client.0.smithi121.stdout:2/633: getdents d2 0 2024-08-18T22:41:48.952 INFO:tasks.workunit.client.0.smithi121.stdout:0/849: dread d1/d4/db/f7d [4194304,4194304] 0 2024-08-18T22:41:48.952 INFO:tasks.workunit.client.1.smithi195.stdout:7/711: write dc/d1d/d29/ddb/d15/d17/d18/fd9 [192525,84764] 0 2024-08-18T22:41:48.954 INFO:tasks.workunit.client.1.smithi195.stdout:7/712: chown dc/d1d/d29/ddb/d15/d17/d18/l8e 41 1 2024-08-18T22:41:48.955 INFO:tasks.workunit.client.0.smithi121.stdout:0/850: rmdir d1/d4/db/d24/d30 39 2024-08-18T22:41:48.956 INFO:tasks.workunit.client.0.smithi121.stdout:0/851: chown d1/d4/db/d24/df/d8/fb2 5906 1 2024-08-18T22:41:48.956 INFO:tasks.workunit.client.0.smithi121.stdout:2/634: truncate d2/d8/d19/d55/f78 2108399 0 2024-08-18T22:41:48.957 INFO:tasks.workunit.client.1.smithi195.stdout:7/713: mknod dc/d1d/d29/ddb/d15/d17/d18/d89/cf5 0 2024-08-18T22:41:48.961 INFO:tasks.workunit.client.0.smithi121.stdout:7/981: truncate de/d98/dfb/dce/d20/f3f 809810 0 2024-08-18T22:41:48.962 INFO:tasks.workunit.client.0.smithi121.stdout:2/635: dread d2/d8/d19/d55/f70 [0,4194304] 0 2024-08-18T22:41:48.964 INFO:tasks.workunit.client.1.smithi195.stdout:9/588: sync 2024-08-18T22:41:48.964 INFO:tasks.workunit.client.1.smithi195.stdout:7/714: dwrite dc/d1d/d29/ddb/d15/d17/d18/f5f [0,4194304] 0 2024-08-18T22:41:48.964 INFO:tasks.workunit.client.0.smithi121.stdout:2/636: write d2/f2c [4535876,11922] 0 2024-08-18T22:41:48.966 INFO:tasks.workunit.client.0.smithi121.stdout:7/982: mkdir de/d98/dfb/dce/d34/d38/d73/dbb/d11d/d13f 0 2024-08-18T22:41:48.967 INFO:tasks.workunit.client.0.smithi121.stdout:2/637: chown d2/d8/d19/c37 41 1 2024-08-18T22:41:48.968 INFO:tasks.workunit.client.0.smithi121.stdout:9/980: dread d0/d5/dd/d1a/dc8/dfa/dbf/f77 [0,4194304] 0 2024-08-18T22:41:48.969 INFO:tasks.workunit.client.1.smithi195.stdout:9/589: creat d1c/d92/d96/d9d/db9/fbd x:0 0 0 2024-08-18T22:41:48.970 INFO:tasks.workunit.client.0.smithi121.stdout:5/888: dread d3/d5/d27/f54 [4194304,4194304] 0 2024-08-18T22:41:48.970 INFO:tasks.workunit.client.1.smithi195.stdout:9/590: stat d1c/d32/d37/d4b/f5d 0 2024-08-18T22:41:48.971 INFO:tasks.workunit.client.1.smithi195.stdout:7/715: rename dc/d1d/f88 to dc/d1d/d29/ddb/d2b/ff6 0 2024-08-18T22:41:48.973 INFO:tasks.workunit.client.0.smithi121.stdout:2/638: mknod d2/d8/d1f/cd3 0 2024-08-18T22:41:48.973 INFO:tasks.workunit.client.0.smithi121.stdout:7/983: rmdir de/d98/dfb/dce/d2f/d4b/d6d/dca/df4 39 2024-08-18T22:41:48.973 INFO:tasks.workunit.client.0.smithi121.stdout:0/852: dwrite d1/d4/da/d2f/da0/f6d [4194304,4194304] 0 2024-08-18T22:41:48.973 INFO:tasks.workunit.client.1.smithi195.stdout:7/716: fdatasync dc/f25 0 2024-08-18T22:41:48.976 INFO:tasks.workunit.client.0.smithi121.stdout:7/984: stat de/d98/dfb/dce/d34/d38/dd6/f75 0 2024-08-18T22:41:48.977 INFO:tasks.workunit.client.0.smithi121.stdout:0/853: chown d1/d4/db/d24/df/d8/d71/l101 1478238 1 2024-08-18T22:41:48.977 INFO:tasks.workunit.client.1.smithi195.stdout:9/591: rename d1c/d74/d7b/d82 to d1c/d32/d71/dbe 0 2024-08-18T22:41:48.978 INFO:tasks.workunit.client.1.smithi195.stdout:7/717: mkdir dc/d1d/d29/ddb/d15/d17/d58/db6/df7 0 2024-08-18T22:41:48.979 INFO:tasks.workunit.client.0.smithi121.stdout:5/889: creat d3/d5/d13/d23/f121 x:0 0 0 2024-08-18T22:41:48.979 INFO:tasks.workunit.client.0.smithi121.stdout:2/639: mknod d2/d8/d19/d4a/d64/cd4 0 2024-08-18T22:41:48.980 INFO:tasks.workunit.client.0.smithi121.stdout:5/890: stat d3/d5/d27/d35 0 2024-08-18T22:41:48.981 INFO:tasks.workunit.client.1.smithi195.stdout:7/718: creat dc/d1d/d29/df0/ff8 x:0 0 0 2024-08-18T22:41:48.983 INFO:tasks.workunit.client.0.smithi121.stdout:0/854: creat d1/d4/da/d2f/f12a x:0 0 0 2024-08-18T22:41:48.984 INFO:tasks.workunit.client.1.smithi195.stdout:9/592: getdents d1c/d32/db1 0 2024-08-18T22:41:48.985 INFO:tasks.workunit.client.0.smithi121.stdout:2/640: stat d2/d3/c30 0 2024-08-18T22:41:48.985 INFO:tasks.workunit.client.0.smithi121.stdout:0/855: readlink d1/d4/db/d18/d1c/l27 0 2024-08-18T22:41:48.985 INFO:tasks.workunit.client.0.smithi121.stdout:7/985: symlink de/d98/dfb/dce/d34/d38/d73/da2/d100/d18/d2e/dd7/dfd/ded/l140 0 2024-08-18T22:41:48.985 INFO:tasks.workunit.client.1.smithi195.stdout:9/593: stat d1c/d32/d37/f42 0 2024-08-18T22:41:48.986 INFO:tasks.workunit.client.0.smithi121.stdout:0/856: read - d1/d4/db/d24/df/ff3 zero size 2024-08-18T22:41:48.987 INFO:tasks.workunit.client.1.smithi195.stdout:7/719: link dc/d1d/d29/ddb/d15/d4d/ldc dc/d1d/d29/ddb/d2b/dbc/lf9 0 2024-08-18T22:41:48.987 INFO:tasks.workunit.client.0.smithi121.stdout:2/641: readlink d2/d8/d19/dc/lac 0 2024-08-18T22:41:48.987 INFO:tasks.workunit.client.0.smithi121.stdout:7/986: write de/d98/dfb/dce/d2f/d4b/ff2 [1323245,113074] 0 2024-08-18T22:41:48.988 INFO:tasks.workunit.client.1.smithi195.stdout:9/594: creat d1c/d92/d96/d9d/fbf x:0 0 0 2024-08-18T22:41:48.989 INFO:tasks.workunit.client.0.smithi121.stdout:2/642: unlink d2/c29 0 2024-08-18T22:41:48.994 INFO:tasks.workunit.client.1.smithi195.stdout:7/720: dwrite dc/d1d/d29/ddb/d15/d17/d18/f1c [0,4194304] 0 2024-08-18T22:41:48.998 INFO:tasks.workunit.client.1.smithi195.stdout:7/721: dread dc/d2a/d56/f84 [0,4194304] 0 2024-08-18T22:41:49.000 INFO:tasks.workunit.client.1.smithi195.stdout:7/722: dread dc/f32 [0,4194304] 0 2024-08-18T22:41:49.001 INFO:tasks.workunit.client.0.smithi121.stdout:0/857: truncate d1/d4/db/d24/df/d8/d71/d79/fab 778352 0 2024-08-18T22:41:49.002 INFO:tasks.workunit.client.0.smithi121.stdout:5/891: dwrite d3/f1c [0,4194304] 0 2024-08-18T22:41:49.007 INFO:tasks.workunit.client.0.smithi121.stdout:0/858: fsync d1/d4/db/d24/df/d8/d78/d7c/f113 0 2024-08-18T22:41:49.008 INFO:tasks.workunit.client.0.smithi121.stdout:2/643: rmdir d2/d3/d51 39 2024-08-18T22:41:49.012 INFO:tasks.workunit.client.0.smithi121.stdout:9/981: dread d0/d5/dd/d3b/d48/f74 [0,4194304] 0 2024-08-18T22:41:49.013 INFO:tasks.workunit.client.0.smithi121.stdout:0/859: mknod d1/d4/db/d24/d30/d6c/dde/d125/c12b 0 2024-08-18T22:41:49.014 INFO:tasks.workunit.client.0.smithi121.stdout:9/982: write d0/d5/dd/d3f/fa7 [6945405,77550] 0 2024-08-18T22:41:49.014 INFO:tasks.workunit.client.1.smithi195.stdout:9/595: dread d1c/f3c [0,4194304] 0 2024-08-18T22:41:49.017 INFO:tasks.workunit.client.1.smithi195.stdout:9/596: link d1c/d70/f76 d1c/d70/fc0 0 2024-08-18T22:41:49.018 INFO:tasks.workunit.client.0.smithi121.stdout:9/983: getdents d0/d38/d9e/d45/dba 0 2024-08-18T22:41:49.019 INFO:tasks.workunit.client.0.smithi121.stdout:2/644: read d2/d3/f49 [146541,56016] 0 2024-08-18T22:41:49.021 INFO:tasks.workunit.client.0.smithi121.stdout:9/984: creat d0/d5/d11f/f148 x:0 0 0 2024-08-18T22:41:49.021 INFO:tasks.workunit.client.0.smithi121.stdout:0/860: write d1/d4/db/d18/f2d [4481564,30468] 0 2024-08-18T22:41:49.024 INFO:tasks.workunit.client.0.smithi121.stdout:0/861: symlink d1/d4/da/l12c 0 2024-08-18T22:41:49.026 INFO:tasks.workunit.client.0.smithi121.stdout:9/985: mkdir d0/d5/dd/d134/d149 0 2024-08-18T22:41:49.027 INFO:tasks.workunit.client.0.smithi121.stdout:2/645: symlink d2/d8/d19/dc/ld5 0 2024-08-18T22:41:49.027 INFO:tasks.workunit.client.0.smithi121.stdout:0/862: creat d1/d4/da/d2f/f12d x:0 0 0 2024-08-18T22:41:49.029 INFO:tasks.workunit.client.0.smithi121.stdout:0/863: stat d1/f8e 0 2024-08-18T22:41:49.030 INFO:tasks.workunit.client.0.smithi121.stdout:0/864: stat d1/d4/d53/leb 0 2024-08-18T22:41:49.030 INFO:tasks.workunit.client.0.smithi121.stdout:2/646: mkdir d2/d3/dd6 0 2024-08-18T22:41:49.034 INFO:tasks.workunit.client.0.smithi121.stdout:0/865: mkdir d1/d4/da/dfe/d12e 0 2024-08-18T22:41:49.035 INFO:tasks.workunit.client.0.smithi121.stdout:2/647: stat d2/d3/d51/l9b 0 2024-08-18T22:41:49.037 INFO:tasks.workunit.client.0.smithi121.stdout:7/987: dread de/d98/dfb/dce/d34/d38/d73/dbb/fb0 [0,4194304] 0 2024-08-18T22:41:49.037 INFO:tasks.workunit.client.0.smithi121.stdout:0/866: readlink d1/d4/db/d18/d1c/d5f/lea 0 2024-08-18T22:41:49.037 INFO:tasks.workunit.client.0.smithi121.stdout:9/986: getdents d0/d5/dd/d1a/dc8/dfa/dbf 0 2024-08-18T22:41:49.040 INFO:tasks.workunit.client.0.smithi121.stdout:2/648: truncate d2/d8/d19/d4a/d64/fbe 207644 0 2024-08-18T22:41:49.040 INFO:tasks.workunit.client.0.smithi121.stdout:7/988: rmdir de/d98/dfb/dce/d34/d38/d73/dbb/d11d 39 2024-08-18T22:41:49.041 INFO:tasks.workunit.client.0.smithi121.stdout:7/989: chown de/d2d/d50/db7 2 1 2024-08-18T22:41:49.041 INFO:tasks.workunit.client.0.smithi121.stdout:5/892: dread d3/d5/d3c/daf/fc3 [0,4194304] 0 2024-08-18T22:41:49.042 INFO:tasks.workunit.client.1.smithi195.stdout:9/597: dread d1c/d32/d37/f67 [0,4194304] 0 2024-08-18T22:41:49.042 INFO:tasks.workunit.client.0.smithi121.stdout:0/867: rename d1/d4/d53/da7/l82 to d1/d47/l12f 0 2024-08-18T22:41:49.043 INFO:tasks.workunit.client.0.smithi121.stdout:2/649: creat d2/d3/d48/fd7 x:0 0 0 2024-08-18T22:41:49.045 INFO:tasks.workunit.client.0.smithi121.stdout:5/893: fdatasync d3/d5/d3c/daf/fc3 0 2024-08-18T22:41:49.047 INFO:tasks.workunit.client.0.smithi121.stdout:9/987: rename d0/d5/dd/d3b/ffb to d0/d38/d9e/df/d73/d12b/d92/dc6/dd5/f14a 0 2024-08-18T22:41:49.048 INFO:tasks.workunit.client.1.smithi195.stdout:7/723: dread dc/d1d/d29/ddb/d2b/d81/d9c/f9e [0,4194304] 0 2024-08-18T22:41:49.048 INFO:tasks.workunit.client.1.smithi195.stdout:9/598: write d1c/fb5 [631292,102203] 0 2024-08-18T22:41:49.051 INFO:tasks.workunit.client.0.smithi121.stdout:2/650: chown d2/f4b 11 1 2024-08-18T22:41:49.051 INFO:tasks.workunit.client.1.smithi195.stdout:7/724: creat dc/d1d/d29/ddb/ffa x:0 0 0 2024-08-18T22:41:49.052 INFO:tasks.workunit.client.0.smithi121.stdout:5/894: rmdir d3 39 2024-08-18T22:41:49.053 INFO:tasks.workunit.client.1.smithi195.stdout:7/725: write dc/d1d/d29/ddb/d15/f71 [2037422,40985] 0 2024-08-18T22:41:49.056 INFO:tasks.workunit.client.0.smithi121.stdout:7/990: creat de/d98/dfb/dce/d34/d38/f141 x:0 0 0 2024-08-18T22:41:49.061 INFO:tasks.workunit.client.0.smithi121.stdout:2/651: mkdir d2/dd8 0 2024-08-18T22:41:49.063 INFO:tasks.workunit.client.0.smithi121.stdout:5/895: fsync d3/d5/d27/d35/f72 0 2024-08-18T22:41:49.065 INFO:tasks.workunit.client.0.smithi121.stdout:9/988: creat d0/d5/dd/d1a/dc8/dfa/f14b x:0 0 0 2024-08-18T22:41:49.067 INFO:tasks.workunit.client.0.smithi121.stdout:7/991: write de/d98/dfb/dce/d34/d38/d73/d8a/fdf [960829,59291] 0 2024-08-18T22:41:49.067 INFO:tasks.workunit.client.0.smithi121.stdout:5/896: chown d3/d5/d13/d19/d24/d4d/f4f 18398372 1 2024-08-18T22:41:49.068 INFO:tasks.workunit.client.0.smithi121.stdout:0/868: dwrite d1/d4/db/d24/d30/d6c/f51 [0,4194304] 0 2024-08-18T22:41:49.070 INFO:tasks.workunit.client.0.smithi121.stdout:2/652: rmdir d2/d8 39 2024-08-18T22:41:49.070 INFO:tasks.workunit.client.0.smithi121.stdout:0/869: write d1/d4/db/d24/d30/d6c/f51 [2364639,44498] 0 2024-08-18T22:41:49.071 INFO:tasks.workunit.client.0.smithi121.stdout:9/989: dread - d0/d5/dd/d2f/dcd/ff8 zero size 2024-08-18T22:41:49.072 INFO:tasks.workunit.client.0.smithi121.stdout:9/990: fdatasync d0/d38/d9e/d18/fb9 0 2024-08-18T22:41:49.073 INFO:tasks.workunit.client.0.smithi121.stdout:9/991: readlink d0/d38/d9e/df/d73/l120 0 2024-08-18T22:41:49.074 INFO:tasks.workunit.client.0.smithi121.stdout:7/992: creat de/d65/f142 x:0 0 0 2024-08-18T22:41:49.078 INFO:tasks.workunit.client.0.smithi121.stdout:0/870: symlink d1/d4/db/d24/df/d8/d78/d7c/df5/daf/dd5/d90/dc3/l130 0 2024-08-18T22:41:49.079 INFO:tasks.workunit.client.0.smithi121.stdout:7/993: rename de/f16 to de/d98/dfb/f143 0 2024-08-18T22:41:49.080 INFO:tasks.workunit.client.0.smithi121.stdout:2/653: fsync d2/d3/d48/d77/f3b 0 2024-08-18T22:41:49.082 INFO:tasks.workunit.client.0.smithi121.stdout:5/897: dwrite d3/d5/d3c/daf/d11f/db5/fff [0,4194304] 0 2024-08-18T22:41:49.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:41:48 smithi121 ceph-mon[16788]: pgmap v8: 65 pgs: 65 active+clean; 2.6 GiB data, 8.9 GiB used, 528 GiB / 536 GiB avail; 63 MiB/s rd, 188 MiB/s wr, 355 op/s 2024-08-18T22:41:49.086 INFO:tasks.workunit.client.0.smithi121.stdout:2/654: unlink d2/d3/d53/c5a 0 2024-08-18T22:41:49.086 INFO:tasks.workunit.client.0.smithi121.stdout:5/898: write d3/d5/d13/d19/d24/d32/d38/f85 [3044766,56925] 0 2024-08-18T22:41:49.086 INFO:tasks.workunit.client.0.smithi121.stdout:0/871: rmdir d1/d4/db/d24/df/d8 39 2024-08-18T22:41:49.088 INFO:tasks.workunit.client.0.smithi121.stdout:2/655: readlink d2/l86 0 2024-08-18T22:41:49.090 INFO:tasks.workunit.client.0.smithi121.stdout:5/899: truncate d3/d5/d13/d19/d24/d32/f44 4827331 0 2024-08-18T22:41:49.092 INFO:tasks.workunit.client.0.smithi121.stdout:7/994: creat de/d98/dfb/dce/d34/d38/d73/da2/d100/f144 x:0 0 0 2024-08-18T22:41:49.093 INFO:tasks.workunit.client.0.smithi121.stdout:9/992: dread d0/d38/d9e/d18/dfd/f109 [0,4194304] 0 2024-08-18T22:41:49.093 INFO:tasks.workunit.client.0.smithi121.stdout:5/900: write d3/d5/d13/d23/f34 [2197447,25188] 0 2024-08-18T22:41:49.094 INFO:tasks.workunit.client.0.smithi121.stdout:2/656: rename d2/d3/l2b to d2/d3/d84/ld9 0 2024-08-18T22:41:49.095 INFO:tasks.workunit.client.0.smithi121.stdout:9/993: stat d0/d38/d9e/df/d73/d12b/d92/dc6 0 2024-08-18T22:41:49.095 INFO:tasks.workunit.client.0.smithi121.stdout:0/872: mkdir d1/d4/db/d24/df/d8/d78/d7c/df5/d131 0 2024-08-18T22:41:49.098 INFO:tasks.workunit.client.0.smithi121.stdout:5/901: write d3/d5/d13/d19/d24/d32/d38/f85 [2066895,8573] 0 2024-08-18T22:41:49.099 INFO:tasks.workunit.client.0.smithi121.stdout:2/657: truncate d2/d8/d9e/fb6 736699 0 2024-08-18T22:41:49.100 INFO:tasks.workunit.client.0.smithi121.stdout:0/873: fdatasync d1/d4/db/f7d 0 2024-08-18T22:41:49.103 INFO:tasks.workunit.client.0.smithi121.stdout:7/995: creat de/d98/dfb/dce/d34/d38/d73/da2/d100/d18/d23/d24/d29/f145 x:0 0 0 2024-08-18T22:41:49.105 INFO:tasks.workunit.client.0.smithi121.stdout:7/996: stat de/d98/dfb/dce/d34/d38/d5f/l88 0 2024-08-18T22:41:49.106 INFO:tasks.workunit.client.0.smithi121.stdout:5/902: mkdir d3/d5/d13/d10b/d11e/d11c/d122 0 2024-08-18T22:41:49.107 INFO:tasks.workunit.client.0.smithi121.stdout:2/658: dwrite d2/d3/d51/f81 [0,4194304] 0 2024-08-18T22:41:49.108 INFO:tasks.workunit.client.0.smithi121.stdout:0/874: getdents d1/d4/db/d24/df/d8/d71 0 2024-08-18T22:41:49.114 INFO:tasks.workunit.client.0.smithi121.stdout:7/997: creat de/d98/dfb/dce/d34/d38/d73/da2/d100/d18/d23/d24/d29/d43/d7f/f146 x:0 0 0 2024-08-18T22:41:49.124 INFO:tasks.workunit.client.0.smithi121.stdout:9/994: dwrite d0/d38/d9e/df/d3d/f64 [0,4194304] 0 2024-08-18T22:41:49.125 INFO:tasks.workunit.client.0.smithi121.stdout:5/903: truncate d3/d5/d13/d19/d24/d32/fed 37698 0 2024-08-18T22:41:49.126 INFO:tasks.workunit.client.0.smithi121.stdout:9/995: dread - d0/d38/d9e/df/d61/f137 zero size 2024-08-18T22:41:49.128 INFO:tasks.workunit.client.1.smithi195.stdout:7/726: unlink dc/d1d/d29/ddb/f47 0 2024-08-18T22:41:49.133 INFO:tasks.workunit.client.1.smithi195.stdout:9/599: dwrite d1c/f63 [0,4194304] 0 2024-08-18T22:41:49.134 INFO:tasks.workunit.client.1.smithi195.stdout:7/727: mknod dc/d1d/d29/ddb/d15/d17/d18/cfb 0 2024-08-18T22:41:49.136 INFO:tasks.workunit.client.0.smithi121.stdout:2/659: dread d2/d8/d19/d4a/f4d [0,4194304] 0 2024-08-18T22:41:49.136 INFO:tasks.workunit.client.1.smithi195.stdout:9/600: unlink d1c/d92/fa3 0 2024-08-18T22:41:49.142 INFO:tasks.workunit.client.1.smithi195.stdout:7/728: unlink dc/d1d/d29/ddb/f21 0 2024-08-18T22:41:49.144 INFO:tasks.workunit.client.1.smithi195.stdout:9/601: dwrite d1c/d32/f88 [0,4194304] 0 2024-08-18T22:41:49.154 INFO:tasks.workunit.client.1.smithi195.stdout:7/729: creat dc/d1d/d29/ddb/d15/d17/d58/db6/dd0/dde/ffc x:0 0 0 2024-08-18T22:41:49.155 INFO:tasks.workunit.client.1.smithi195.stdout:9/602: fsync d1c/d70/fc0 0 2024-08-18T22:41:49.156 INFO:tasks.workunit.client.0.smithi121.stdout:0/875: dread d1/d4/db/d24/df/d8/fb9 [0,4194304] 0 2024-08-18T22:41:49.157 INFO:tasks.workunit.client.0.smithi121.stdout:5/904: creat d3/d5/d3c/dd3/f123 x:0 0 0 2024-08-18T22:41:49.157 INFO:tasks.workunit.client.1.smithi195.stdout:9/603: chown d1c/d74/d8e/f93 10438 1 2024-08-18T22:41:49.158 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:41:48 smithi195 ceph-mon[23370]: pgmap v8: 65 pgs: 65 active+clean; 2.6 GiB data, 8.9 GiB used, 528 GiB / 536 GiB avail; 63 MiB/s rd, 188 MiB/s wr, 355 op/s 2024-08-18T22:41:49.159 INFO:tasks.workunit.client.0.smithi121.stdout:7/998: link de/d98/dfb/dce/d34/d38/d73/da2/d100/da0/fc4 de/d98/dfb/dce/d34/d38/d73/f147 0 2024-08-18T22:41:49.160 INFO:tasks.workunit.client.0.smithi121.stdout:5/905: symlink d3/dd5/l124 0 2024-08-18T22:41:49.161 INFO:tasks.workunit.client.0.smithi121.stdout:0/876: write d1/d4/db/d24/d30/f86 [1007930,56007] 0 2024-08-18T22:41:49.161 INFO:tasks.workunit.client.1.smithi195.stdout:9/604: creat d1c/d92/d96/d9d/db9/fc1 x:0 0 0 2024-08-18T22:41:49.162 INFO:tasks.workunit.client.1.smithi195.stdout:7/730: dwrite dc/d8f/fcb [0,4194304] 0 2024-08-18T22:41:49.162 INFO:tasks.workunit.client.0.smithi121.stdout:7/999: mknod de/d98/dfb/dce/d11e/c148 0 2024-08-18T22:41:49.163 INFO:tasks.workunit.client.1.smithi195.stdout:7/731: fdatasync dc/d1d/d29/f63 0 2024-08-18T22:41:49.164 INFO:tasks.workunit.client.0.smithi121.stdout:0/877: mkdir d1/d4/db/d24/d30/d132 0 2024-08-18T22:41:49.165 INFO:tasks.workunit.client.0.smithi121.stdout:0/878: stat d1/d4/db/d24/lff 0 2024-08-18T22:41:49.169 INFO:tasks.workunit.client.1.smithi195.stdout:9/605: unlink d1c/l3e 0 2024-08-18T22:41:49.172 INFO:tasks.workunit.client.0.smithi121.stdout:0/879: dwrite d1/d4/da/d2f/f5e [0,4194304] 0 2024-08-18T22:41:49.174 INFO:tasks.workunit.client.1.smithi195.stdout:9/606: mknod d1c/d92/da1/cc2 0 2024-08-18T22:41:49.178 INFO:tasks.workunit.client.0.smithi121.stdout:0/880: truncate d1/d4/db/d24/df/d8/f85 762919 0 2024-08-18T22:41:49.180 INFO:tasks.workunit.client.0.smithi121.stdout:0/881: mknod d1/d4/d53/da7/c133 0 2024-08-18T22:41:49.180 INFO:tasks.workunit.client.1.smithi195.stdout:9/607: dread d1c/d70/f86 [0,4194304] 0 2024-08-18T22:41:49.182 INFO:tasks.workunit.client.0.smithi121.stdout:9/996: write d0/d38/d9e/d45/dba/fbb [169623,53541] 0 2024-08-18T22:41:49.183 INFO:tasks.workunit.client.1.smithi195.stdout:9/608: truncate d1c/d32/d37/d4b/f6b 1171532 0 2024-08-18T22:41:49.184 INFO:tasks.workunit.client.0.smithi121.stdout:9/997: mknod d0/d5/dd/d3f/c14c 0 2024-08-18T22:41:49.185 INFO:tasks.workunit.client.0.smithi121.stdout:5/906: write d3/d5/d13/d23/da4/fc5 [1742557,53261] 0 2024-08-18T22:41:49.187 INFO:tasks.workunit.client.1.smithi195.stdout:7/732: dwrite dc/f32 [0,4194304] 0 2024-08-18T22:41:49.188 INFO:tasks.workunit.client.0.smithi121.stdout:9/998: mkdir d0/d38/d9e/df/d73/d12b/d92/dc6/d14d 0 2024-08-18T22:41:49.189 INFO:tasks.workunit.client.0.smithi121.stdout:9/999: write d0/d38/d9e/df/d61/ff2 [28871,107938] 0 2024-08-18T22:41:49.191 INFO:tasks.workunit.client.1.smithi195.stdout:7/733: readlink dc/d1d/d29/ddb/d15/d17/d18/l46 0 2024-08-18T22:41:49.192 INFO:tasks.workunit.client.1.smithi195.stdout:9/609: dwrite d1c/d32/f66 [0,4194304] 0 2024-08-18T22:41:49.192 INFO:tasks.workunit.client.1.smithi195.stdout:9/610: dread - d1c/d32/db1/fb3 zero size 2024-08-18T22:41:49.194 INFO:tasks.workunit.client.1.smithi195.stdout:5/567: sync 2024-08-18T22:41:49.194 INFO:tasks.workunit.client.1.smithi195.stdout:0/655: sync 2024-08-18T22:41:49.196 INFO:tasks.workunit.client.0.smithi121.stdout:5/907: truncate d3/d5/d3c/daf/fb6 3639753 0 2024-08-18T22:41:49.197 INFO:tasks.workunit.client.1.smithi195.stdout:5/568: symlink d0/d3/df/lb2 0 2024-08-18T22:41:49.200 INFO:tasks.workunit.client.1.smithi195.stdout:5/569: symlink d0/d2/d79/lb3 0 2024-08-18T22:41:49.201 INFO:tasks.workunit.client.1.smithi195.stdout:7/734: link dc/d1d/d29/ddb/d15/d17/d18/ccd dc/d2a/d56/cfd 0 2024-08-18T22:41:49.202 INFO:tasks.workunit.client.1.smithi195.stdout:9/611: write d1c/f20 [5224345,80490] 0 2024-08-18T22:41:49.207 INFO:tasks.workunit.client.1.smithi195.stdout:0/656: dwrite d0/dc/dd/f59 [0,4194304] 0 2024-08-18T22:41:49.207 INFO:tasks.workunit.client.0.smithi121.stdout:5/908: truncate d3/d5/d13/d23/da4/dc7/f102 456742 0 2024-08-18T22:41:49.211 INFO:tasks.workunit.client.1.smithi195.stdout:5/570: symlink d0/d2/d29/d88/d6a/d96/lb4 0 2024-08-18T22:41:49.213 INFO:tasks.workunit.client.1.smithi195.stdout:9/612: mknod d1c/cc3 0 2024-08-18T22:41:49.215 INFO:tasks.workunit.client.1.smithi195.stdout:5/571: truncate d0/d2/f55 4027615 0 2024-08-18T22:41:49.216 INFO:tasks.workunit.client.1.smithi195.stdout:5/572: read - d0/d3/df/d1a/fab zero size 2024-08-18T22:41:49.217 INFO:tasks.workunit.client.1.smithi195.stdout:7/735: rename dc/d1d/d29/ddb/d15/d17 to dc/d1d/d29/ddb/d15/d4d/d97/dfe 0 2024-08-18T22:41:49.218 INFO:tasks.workunit.client.1.smithi195.stdout:7/736: chown dc/d1d/d29/ddb/c9b 16482947 1 2024-08-18T22:41:49.219 INFO:tasks.workunit.client.1.smithi195.stdout:0/657: creat d0/dc/d64/d81/fd8 x:0 0 0 2024-08-18T22:41:49.219 INFO:tasks.workunit.client.0.smithi121.stdout:5/909: dwrite d3/d5/d13/d19/d24/d32/d38/f4e [0,4194304] 0 2024-08-18T22:41:49.222 INFO:tasks.workunit.client.1.smithi195.stdout:5/573: mkdir d0/d2/d29/db5 0 2024-08-18T22:41:49.222 INFO:tasks.workunit.client.1.smithi195.stdout:5/574: readlink d0/l72 0 2024-08-18T22:41:49.223 INFO:tasks.workunit.client.1.smithi195.stdout:7/737: symlink dc/d2a/d56/lff 0 2024-08-18T22:41:49.224 INFO:tasks.workunit.client.0.smithi121.stdout:5/910: rename d3/d5/d13/d10b/d11e/d11c/d122 to d3/d5/d13/d19/d24/d125 0 2024-08-18T22:41:49.224 INFO:tasks.workunit.client.0.smithi121.stdout:5/911: chown d3/d5/d13/d19/f97 1935 1 2024-08-18T22:41:49.229 INFO:tasks.workunit.client.1.smithi195.stdout:5/575: write d0/d2/d29/f47 [5255439,37058] 0 2024-08-18T22:41:49.229 INFO:tasks.workunit.client.1.smithi195.stdout:7/738: readlink dc/d8f/d96/lab 0 2024-08-18T22:41:49.230 INFO:tasks.workunit.client.1.smithi195.stdout:9/613: write d1c/f39 [2218813,42544] 0 2024-08-18T22:41:49.230 INFO:tasks.workunit.client.1.smithi195.stdout:0/658: dwrite d0/dc/d11/d23/d51/f7a [0,4194304] 0 2024-08-18T22:41:49.231 INFO:tasks.workunit.client.1.smithi195.stdout:5/576: write d0/d3/f27 [970660,58342] 0 2024-08-18T22:41:49.234 INFO:tasks.workunit.client.1.smithi195.stdout:5/577: truncate d0/d46/f9c 486901 0 2024-08-18T22:41:49.234 INFO:tasks.workunit.client.1.smithi195.stdout:7/739: creat dc/d2a/d56/f100 x:0 0 0 2024-08-18T22:41:49.240 INFO:tasks.workunit.client.1.smithi195.stdout:9/614: dread d1c/d32/f88 [0,4194304] 0 2024-08-18T22:41:49.241 INFO:tasks.workunit.client.1.smithi195.stdout:5/578: rename d0/d46/f63 to d0/d3/d8/d64/fb6 0 2024-08-18T22:41:49.243 INFO:tasks.workunit.client.1.smithi195.stdout:9/615: chown d1c/d32/f46 5 1 2024-08-18T22:41:49.244 INFO:tasks.workunit.client.1.smithi195.stdout:5/579: chown d0/d3/d8/d3b/c4e 1034118604 1 2024-08-18T22:41:49.245 INFO:tasks.workunit.client.1.smithi195.stdout:0/659: dwrite d0/dc/d11/fd3 [0,4194304] 0 2024-08-18T22:41:49.249 INFO:tasks.workunit.client.1.smithi195.stdout:0/660: stat d0/dc/d64/d81/d44/d41/d6d/d92/f68 0 2024-08-18T22:41:49.249 INFO:tasks.workunit.client.1.smithi195.stdout:9/616: unlink d1c/d32/db1/l85 0 2024-08-18T22:41:49.250 INFO:tasks.workunit.client.1.smithi195.stdout:5/580: chown d0/d46/d6d/c7f 482 1 2024-08-18T22:41:49.250 INFO:tasks.workunit.client.1.smithi195.stdout:0/661: chown d0/dc/dd/d46/c69 0 1 2024-08-18T22:41:49.250 INFO:tasks.workunit.client.1.smithi195.stdout:9/617: unlink d1c/l30 0 2024-08-18T22:41:49.251 INFO:tasks.workunit.client.1.smithi195.stdout:9/618: write f0 [2647283,96305] 0 2024-08-18T22:41:49.251 INFO:tasks.workunit.client.1.smithi195.stdout:5/581: write d0/d3/d8/d64/fb6 [801676,41855] 0 2024-08-18T22:41:49.253 INFO:tasks.workunit.client.1.smithi195.stdout:5/582: dread - d0/f77 zero size 2024-08-18T22:41:49.254 INFO:tasks.workunit.client.1.smithi195.stdout:9/619: mkdir d1c/d32/d71/dc4 0 2024-08-18T22:41:49.255 INFO:tasks.workunit.client.1.smithi195.stdout:5/583: dread - d0/f77 zero size 2024-08-18T22:41:49.257 INFO:tasks.workunit.client.1.smithi195.stdout:7/740: dread dc/d2a/f65 [0,4194304] 0 2024-08-18T22:41:49.259 INFO:tasks.workunit.client.1.smithi195.stdout:0/662: dwrite d0/dc/d64/d81/d44/d41/d6d/d92/faf [0,4194304] 0 2024-08-18T22:41:49.260 INFO:tasks.workunit.client.1.smithi195.stdout:9/620: getdents d1c/d92 0 2024-08-18T22:41:49.262 INFO:tasks.workunit.client.1.smithi195.stdout:7/741: fsync dc/d1d/d29/ddb/d15/fa8 0 2024-08-18T22:41:49.262 INFO:tasks.workunit.client.1.smithi195.stdout:0/663: read d0/dc/d11/fd3 [821368,40128] 0 2024-08-18T22:41:49.266 INFO:tasks.workunit.client.1.smithi195.stdout:9/621: symlink d1c/d32/d37/d4b/lc5 0 2024-08-18T22:41:49.267 INFO:tasks.workunit.client.1.smithi195.stdout:7/742: symlink dc/d8f/d96/dc5/l101 0 2024-08-18T22:41:49.268 INFO:tasks.workunit.client.1.smithi195.stdout:5/584: dwrite d0/d2/d29/f47 [4194304,4194304] 0 2024-08-18T22:41:49.270 INFO:tasks.workunit.client.1.smithi195.stdout:0/664: mkdir d0/dc/d64/d81/d44/d41/d4c/dd9 0 2024-08-18T22:41:49.272 INFO:tasks.workunit.client.1.smithi195.stdout:9/622: mkdir d1c/d32/d37/d4b/dc6 0 2024-08-18T22:41:49.272 INFO:tasks.workunit.client.1.smithi195.stdout:7/743: fsync dc/d2a/f65 0 2024-08-18T22:41:49.274 INFO:tasks.workunit.client.1.smithi195.stdout:5/585: symlink d0/d2/d29/lb7 0 2024-08-18T22:41:49.274 INFO:tasks.workunit.client.1.smithi195.stdout:9/623: write d1c/f4e [291483,109117] 0 2024-08-18T22:41:49.275 INFO:tasks.workunit.client.1.smithi195.stdout:0/665: mknod d0/dc/d64/d81/d44/d41/d6d/d92/d66/d8d/cda 0 2024-08-18T22:41:49.276 INFO:tasks.workunit.client.1.smithi195.stdout:5/586: mknod d0/db/cb8 0 2024-08-18T22:41:49.277 INFO:tasks.workunit.client.1.smithi195.stdout:9/624: symlink d1c/d92/lc7 0 2024-08-18T22:41:49.278 INFO:tasks.workunit.client.1.smithi195.stdout:9/625: chown d1c/d32/db1/laa 106 1 2024-08-18T22:41:49.278 INFO:tasks.workunit.client.1.smithi195.stdout:0/666: symlink d0/dc/d64/d81/d44/d41/d6d/d92/d66/d8d/dbe/ldb 0 2024-08-18T22:41:49.279 INFO:tasks.workunit.client.1.smithi195.stdout:5/587: creat d0/d3/d8/fb9 x:0 0 0 2024-08-18T22:41:49.282 INFO:tasks.workunit.client.1.smithi195.stdout:5/588: write d0/d46/d6d/f89 [698785,54788] 0 2024-08-18T22:41:49.287 INFO:tasks.workunit.client.1.smithi195.stdout:9/626: dwrite d1c/d32/d37/d4b/f6f [0,4194304] 0 2024-08-18T22:41:49.288 INFO:tasks.workunit.client.0.smithi121.stdout:5/912: truncate d3/d5/d3c/f9e 4665223 0 2024-08-18T22:41:49.290 INFO:tasks.workunit.client.1.smithi195.stdout:9/627: mkdir d1c/d32/d37/d4b/dc8 0 2024-08-18T22:41:49.291 INFO:tasks.workunit.client.0.smithi121.stdout:5/913: rmdir d3/d5/d13/d23/da4 39 2024-08-18T22:41:49.294 INFO:tasks.workunit.client.1.smithi195.stdout:9/628: creat d1c/d74/fc9 x:0 0 0 2024-08-18T22:41:49.294 INFO:tasks.workunit.client.0.smithi121.stdout:5/914: mknod d3/d5/d13/d19/d75/c126 0 2024-08-18T22:41:49.295 INFO:tasks.workunit.client.0.smithi121.stdout:5/915: chown d3/d5/d3c/d3f/d8f/lf8 4 1 2024-08-18T22:41:49.297 INFO:tasks.workunit.client.0.smithi121.stdout:5/916: mknod d3/d5c/d78/c127 0 2024-08-18T22:41:49.298 INFO:tasks.workunit.client.0.smithi121.stdout:5/917: fsync d3/d5/d3c/d3f/d8f/fa5 0 2024-08-18T22:41:49.322 INFO:tasks.workunit.client.1.smithi195.stdout:9/629: dread d1c/d32/d37/d4b/f6b [0,4194304] 0 2024-08-18T22:41:49.324 INFO:tasks.workunit.client.0.smithi121.stdout:5/918: write d3/d5/f62 [990687,89481] 0 2024-08-18T22:41:49.328 INFO:tasks.workunit.client.1.smithi195.stdout:9/630: dwrite d1c/d32/d37/d4b/f65 [0,4194304] 0 2024-08-18T22:41:49.329 INFO:tasks.workunit.client.1.smithi195.stdout:9/631: chown d1c/d32/f46 9118 1 2024-08-18T22:41:49.332 INFO:tasks.workunit.client.1.smithi195.stdout:9/632: creat d1c/d92/da1/fca x:0 0 0 2024-08-18T22:41:49.335 INFO:tasks.workunit.client.1.smithi195.stdout:9/633: mknod d1c/d32/d37/d4b/dc6/ccb 0 2024-08-18T22:41:49.338 INFO:tasks.workunit.client.1.smithi195.stdout:0/667: write d0/dc/dd/f3c [5014073,93884] 0 2024-08-18T22:41:49.341 INFO:tasks.workunit.client.0.smithi121.stdout:5/919: write d3/d5/d13/d23/d66/f88 [4209339,26158] 0 2024-08-18T22:41:49.341 INFO:tasks.workunit.client.1.smithi195.stdout:0/668: fdatasync d0/dc/d64/d81/d44/d41/d6d/d92/fab 0 2024-08-18T22:41:49.343 INFO:tasks.workunit.client.1.smithi195.stdout:5/589: dwrite d0/d3/d8/d64/f70 [0,4194304] 0 2024-08-18T22:41:49.343 INFO:tasks.workunit.client.0.smithi121.stdout:5/920: symlink d3/d5/d13/d23/d66/l128 0 2024-08-18T22:41:49.343 INFO:tasks.workunit.client.0.smithi121.stdout:5/921: readlink d3/d5/l9 0 2024-08-18T22:41:49.344 INFO:tasks.workunit.client.0.smithi121.stdout:5/922: chown d3/d5/d3c/d3f/f6e 32207 1 2024-08-18T22:41:49.344 INFO:tasks.workunit.client.1.smithi195.stdout:5/590: dread - d0/d3/df/d1a/fab zero size 2024-08-18T22:41:49.345 INFO:tasks.workunit.client.1.smithi195.stdout:0/669: mknod d0/dc/d64/cdc 0 2024-08-18T22:41:49.345 INFO:tasks.workunit.client.1.smithi195.stdout:9/634: dread d1c/f31 [0,4194304] 0 2024-08-18T22:41:49.345 INFO:tasks.workunit.client.0.smithi121.stdout:5/923: creat d3/d5/d13/d19/d24/d125/f129 x:0 0 0 2024-08-18T22:41:49.347 INFO:tasks.workunit.client.0.smithi121.stdout:5/924: rename d3/d5/d3c/d3f/cac to d3/d5/d3c/daf/d11f/c12a 0 2024-08-18T22:41:49.348 INFO:tasks.workunit.client.1.smithi195.stdout:5/591: mkdir d0/d37/dba 0 2024-08-18T22:41:49.349 INFO:tasks.workunit.client.1.smithi195.stdout:9/635: mkdir d1c/d74/d8e/dcc 0 2024-08-18T22:41:49.350 INFO:tasks.workunit.client.1.smithi195.stdout:9/636: stat d1c/d32/d71/dbe/d90 0 2024-08-18T22:41:49.350 INFO:tasks.workunit.client.1.smithi195.stdout:0/670: mkdir d0/dc/d64/d81/d44/d41/d6d/d92/d66/d8d/dbe/ddd 0 2024-08-18T22:41:49.351 INFO:tasks.workunit.client.1.smithi195.stdout:9/637: chown d1c/d92/d96 317 1 2024-08-18T22:41:49.352 INFO:tasks.workunit.client.1.smithi195.stdout:0/671: chown d0/dc/d64/cb3 1746977 1 2024-08-18T22:41:49.352 INFO:tasks.workunit.client.1.smithi195.stdout:5/592: unlink d0/d3/d8/c49 0 2024-08-18T22:41:49.354 INFO:tasks.workunit.client.1.smithi195.stdout:0/672: write d0/dc/d11/fd3 [286319,74025] 0 2024-08-18T22:41:49.354 INFO:tasks.workunit.client.1.smithi195.stdout:9/638: getdents d1c/d32/d37 0 2024-08-18T22:41:49.355 INFO:tasks.workunit.client.1.smithi195.stdout:5/593: mkdir d0/d3/df/dbb 0 2024-08-18T22:41:49.357 INFO:tasks.workunit.client.1.smithi195.stdout:0/673: readlink d0/dc/d64/d81/d44/d41/d4c/l53 0 2024-08-18T22:41:49.358 INFO:tasks.workunit.client.1.smithi195.stdout:0/674: chown d0/dc/dd/l37 686 1 2024-08-18T22:41:49.360 INFO:tasks.workunit.client.0.smithi121.stdout:5/925: dwrite d3/d5/d3c/dd3/f115 [0,4194304] 0 2024-08-18T22:41:49.365 INFO:tasks.workunit.client.0.smithi121.stdout:5/926: write d3/d5/d13/d19/d24/d32/da8/fb7 [822678,104002] 0 2024-08-18T22:41:49.365 INFO:tasks.workunit.client.0.smithi121.stdout:5/927: chown d3/d5/d13/d19/d24/d4d/f9b 260862 1 2024-08-18T22:41:49.366 INFO:tasks.workunit.client.0.smithi121.stdout:5/928: read - d3/d5/d13/d10b/d11e/f101 zero size 2024-08-18T22:41:49.368 INFO:tasks.workunit.client.0.smithi121.stdout:5/929: getdents d3/d5/d13/d19/d24/d32/da8 0 2024-08-18T22:41:49.374 INFO:tasks.workunit.client.1.smithi195.stdout:9/639: dwrite d1c/d70/fc0 [0,4194304] 0 2024-08-18T22:41:49.374 INFO:tasks.workunit.client.0.smithi121.stdout:5/930: dwrite d3/d5/d13/d10b/d11e/f101 [0,4194304] 0 2024-08-18T22:41:49.381 INFO:tasks.workunit.client.1.smithi195.stdout:0/675: dread d0/f6b [0,4194304] 0 2024-08-18T22:41:49.383 INFO:tasks.workunit.client.1.smithi195.stdout:0/676: write d0/dc/d11/d23/d51/fb7 [4994040,50175] 0 2024-08-18T22:41:49.384 INFO:tasks.workunit.client.1.smithi195.stdout:9/640: rmdir d1c 39 2024-08-18T22:41:49.386 INFO:tasks.workunit.client.0.smithi121.stdout:5/931: dwrite d3/d5/d27/d35/fb4 [0,4194304] 0 2024-08-18T22:41:49.391 INFO:tasks.workunit.client.0.smithi121.stdout:5/932: link d3/d5/d3c/d3f/ff1 d3/d5/d13/d23/da4/dc7/f12b 0 2024-08-18T22:41:49.391 INFO:tasks.workunit.client.1.smithi195.stdout:9/641: rmdir d1c/d74 39 2024-08-18T22:41:49.391 INFO:tasks.workunit.client.1.smithi195.stdout:0/677: read d0/dc/dd/f58 [2782705,110944] 0 2024-08-18T22:41:49.393 INFO:tasks.workunit.client.0.smithi121.stdout:5/933: mkdir d3/d5/d3c/daf/d11f/db5/d12c 0 2024-08-18T22:41:49.394 INFO:tasks.workunit.client.1.smithi195.stdout:9/642: mknod d1c/d32/d37/d4b/ccd 0 2024-08-18T22:41:49.396 INFO:tasks.workunit.client.0.smithi121.stdout:5/934: creat d3/d5/d13/d23/da4/da6/f12d x:0 0 0 2024-08-18T22:41:49.398 INFO:tasks.workunit.client.0.smithi121.stdout:5/935: creat d3/d5/d27/d10f/f12e x:0 0 0 2024-08-18T22:41:49.398 INFO:tasks.workunit.client.1.smithi195.stdout:0/678: unlink d0/dc/d64/d81/d44/d43/l48 0 2024-08-18T22:41:49.398 INFO:tasks.workunit.client.0.smithi121.stdout:5/936: stat d3/d5/d27/d10f 0 2024-08-18T22:41:49.399 INFO:tasks.workunit.client.1.smithi195.stdout:9/643: dread d1c/d32/d37/d4b/f6f [0,4194304] 0 2024-08-18T22:41:49.401 INFO:tasks.workunit.client.1.smithi195.stdout:0/679: write d0/dc/dd/f58 [1538381,50994] 0 2024-08-18T22:41:49.401 INFO:tasks.workunit.client.0.smithi121.stdout:5/937: rmdir d3/d5/dfe 0 2024-08-18T22:41:49.401 INFO:tasks.workunit.client.0.smithi121.stdout:5/938: chown d3/d5/d27/d35 927561516 1 2024-08-18T22:41:49.403 INFO:tasks.workunit.client.0.smithi121.stdout:5/939: mkdir d3/d5/d3c/daf/d12f 0 2024-08-18T22:41:49.405 INFO:tasks.workunit.client.0.smithi121.stdout:5/940: creat d3/d5/d27/d35/f130 x:0 0 0 2024-08-18T22:41:49.405 INFO:tasks.workunit.client.1.smithi195.stdout:9/644: write d1c/d32/d37/d4b/f5d [1697540,71899] 0 2024-08-18T22:41:49.406 INFO:tasks.workunit.client.0.smithi121.stdout:5/941: write d3/d5/d3c/d3f/d8f/f80 [4745945,36318] 0 2024-08-18T22:41:49.406 INFO:tasks.workunit.client.1.smithi195.stdout:4/567: sync 2024-08-18T22:41:49.407 INFO:tasks.workunit.client.1.smithi195.stdout:8/694: sync 2024-08-18T22:41:49.407 INFO:tasks.workunit.client.0.smithi121.stdout:5/942: truncate d3/d5/ff2 108773 0 2024-08-18T22:41:49.408 INFO:tasks.workunit.client.1.smithi195.stdout:0/680: dwrite d0/dc/d25/f7c [0,4194304] 0 2024-08-18T22:41:49.409 INFO:tasks.workunit.client.1.smithi195.stdout:8/695: stat d1/d3/db/d39/d2e/f61 0 2024-08-18T22:41:49.410 INFO:tasks.workunit.client.0.smithi121.stdout:5/943: fsync d3/d5/d3c/f9e 0 2024-08-18T22:41:49.410 INFO:tasks.workunit.client.1.smithi195.stdout:9/645: symlink d1c/d32/d71/dc4/lce 0 2024-08-18T22:41:49.412 INFO:tasks.workunit.client.1.smithi195.stdout:4/568: mkdir d0/d99/d85/dc8 0 2024-08-18T22:41:49.412 INFO:tasks.workunit.client.1.smithi195.stdout:9/646: chown d1c/d32/d71/dbe/d90/l97 72 1 2024-08-18T22:41:49.414 INFO:tasks.workunit.client.1.smithi195.stdout:8/696: symlink d1/l100 0 2024-08-18T22:41:49.416 INFO:tasks.workunit.client.1.smithi195.stdout:4/569: readlink d0/d7/d1d/d69/db7/l89 0 2024-08-18T22:41:49.417 INFO:tasks.workunit.client.1.smithi195.stdout:9/647: creat d1c/d32/d71/dbe/d98/fcf x:0 0 0 2024-08-18T22:41:49.417 INFO:tasks.workunit.client.1.smithi195.stdout:8/697: mknod d1/dca/c101 0 2024-08-18T22:41:49.419 INFO:tasks.workunit.client.1.smithi195.stdout:4/570: mknod d0/cc9 0 2024-08-18T22:41:49.422 INFO:tasks.workunit.client.1.smithi195.stdout:0/681: dwrite d0/dc/d64/d81/d44/d41/d6d/da5/fcc [0,4194304] 0 2024-08-18T22:41:49.424 INFO:tasks.workunit.client.0.smithi121.stdout:5/944: dread d3/d5/d27/f2e [0,4194304] 0 2024-08-18T22:41:49.427 INFO:tasks.workunit.client.1.smithi195.stdout:4/571: rename d0/d99/d86 to d0/d99/d98/db6/dca 0 2024-08-18T22:41:49.427 INFO:tasks.workunit.client.0.smithi121.stdout:5/945: truncate d3/d5/d3c/d3f/d8f/f4b 2439770 0 2024-08-18T22:41:49.428 INFO:tasks.workunit.client.0.smithi121.stdout:5/946: chown d3/d5/l61 9 1 2024-08-18T22:41:49.429 INFO:tasks.workunit.client.1.smithi195.stdout:0/682: write d0/dc/d25/d67/fc4 [2118050,123960] 0 2024-08-18T22:41:49.431 INFO:tasks.workunit.client.0.smithi121.stdout:5/947: unlink d3/d5/d13/d19/d24/d32/d38/f85 0 2024-08-18T22:41:49.432 INFO:tasks.workunit.client.1.smithi195.stdout:9/648: dwrite d1c/fa9 [0,4194304] 0 2024-08-18T22:41:49.434 INFO:tasks.workunit.client.0.smithi121.stdout:5/948: symlink d3/d5/d27/d35/d53/deb/l131 0 2024-08-18T22:41:49.435 INFO:tasks.workunit.client.1.smithi195.stdout:8/698: dwrite d1/de/df/fb4 [0,4194304] 0 2024-08-18T22:41:49.435 INFO:tasks.workunit.client.0.smithi121.stdout:5/949: mknod d3/d5c/d78/c132 0 2024-08-18T22:41:49.436 INFO:tasks.workunit.client.1.smithi195.stdout:0/683: chown d0/dc/d64/d81/d44/d41/d4c/fce 0 1 2024-08-18T22:41:49.437 INFO:tasks.workunit.client.1.smithi195.stdout:4/572: symlink d0/d7/d1d/d69/db7/d41/dbf/lcb 0 2024-08-18T22:41:49.437 INFO:tasks.workunit.client.1.smithi195.stdout:9/649: mknod d1c/d92/d96/d9d/db9/cd0 0 2024-08-18T22:41:49.438 INFO:tasks.workunit.client.0.smithi121.stdout:5/950: unlink d3/fc 0 2024-08-18T22:41:49.439 INFO:tasks.workunit.client.0.smithi121.stdout:5/951: fsync d3/d5/d3c/daf/d11f/fb1 0 2024-08-18T22:41:49.439 INFO:tasks.workunit.client.1.smithi195.stdout:8/699: creat d1/de/d27/d4f/dde/f102 x:0 0 0 2024-08-18T22:41:49.440 INFO:tasks.workunit.client.0.smithi121.stdout:5/952: read - d3/d5/d27/d35/f130 zero size 2024-08-18T22:41:49.441 INFO:tasks.workunit.client.1.smithi195.stdout:8/700: stat d1/de/d67/cf6 0 2024-08-18T22:41:49.444 INFO:tasks.workunit.client.1.smithi195.stdout:0/684: link d0/c3f d0/dc/d64/d81/cde 0 2024-08-18T22:41:49.446 INFO:tasks.workunit.client.1.smithi195.stdout:9/650: mknod d1c/d74/cd1 0 2024-08-18T22:41:49.448 INFO:tasks.workunit.client.1.smithi195.stdout:4/573: dwrite d0/d99/d85/d48/f83 [0,4194304] 0 2024-08-18T22:41:49.448 INFO:tasks.workunit.client.1.smithi195.stdout:8/701: mkdir d1/de/df/d1d/d8e/d103 0 2024-08-18T22:41:49.448 INFO:tasks.workunit.client.0.smithi121.stdout:5/953: dwrite d3/d5/d3c/d3f/d8f/fa5 [0,4194304] 0 2024-08-18T22:41:49.451 INFO:tasks.workunit.client.1.smithi195.stdout:8/702: readlink d1/d3/db/d35/d4d/lc8 0 2024-08-18T22:41:49.452 INFO:tasks.workunit.client.0.smithi121.stdout:5/954: creat d3/d5/d3c/daf/d11f/db5/f133 x:0 0 0 2024-08-18T22:41:49.455 INFO:tasks.workunit.client.1.smithi195.stdout:9/651: truncate d1c/f31 76216 0 2024-08-18T22:41:49.455 INFO:tasks.workunit.client.1.smithi195.stdout:4/574: rmdir d0/d7/d1d/d69/db7/d6c 39 2024-08-18T22:41:49.462 INFO:tasks.workunit.client.0.smithi121.stdout:5/955: dwrite d3/d5/d13/d23/d66/f9f [0,4194304] 0 2024-08-18T22:41:49.462 INFO:tasks.workunit.client.1.smithi195.stdout:8/703: dwrite d1/d3/db/fd [4194304,4194304] 0 2024-08-18T22:41:49.465 INFO:tasks.workunit.client.1.smithi195.stdout:0/685: rename d0/dc/d11/daa/fc6 to d0/dc/d11/fdf 0 2024-08-18T22:41:49.466 INFO:tasks.workunit.client.1.smithi195.stdout:0/686: read d0/dc/d11/d23/d51/f7a [3114886,123413] 0 2024-08-18T22:41:49.468 INFO:tasks.workunit.client.1.smithi195.stdout:4/575: creat d0/d7/d1d/d69/db7/d6c/fcc x:0 0 0 2024-08-18T22:41:49.468 INFO:tasks.workunit.client.0.smithi121.stdout:5/956: link d3/d5/d13/d23/d66/l128 d3/d5/d3c/daf/d12f/l134 0 2024-08-18T22:41:49.472 INFO:tasks.workunit.client.1.smithi195.stdout:4/576: fdatasync d0/d7/d1d/f3d 0 2024-08-18T22:41:49.475 INFO:tasks.workunit.client.1.smithi195.stdout:8/704: creat d1/d3/db/d39/f104 x:0 0 0 2024-08-18T22:41:49.476 INFO:tasks.workunit.client.1.smithi195.stdout:0/687: unlink d0/dc/d64/d81/d44/d41/f94 0 2024-08-18T22:41:49.476 INFO:tasks.workunit.client.1.smithi195.stdout:9/652: getdents d1c/d92/d96 0 2024-08-18T22:41:49.482 INFO:tasks.workunit.client.1.smithi195.stdout:8/705: creat d1/d3/db/d39/d44/dcb/f105 x:0 0 0 2024-08-18T22:41:49.483 INFO:tasks.workunit.client.1.smithi195.stdout:8/706: stat d1/d3/db/f17 0 2024-08-18T22:41:49.483 INFO:tasks.workunit.client.1.smithi195.stdout:0/688: getdents d0/dc/dd 0 2024-08-18T22:41:49.485 INFO:tasks.workunit.client.0.smithi121.stdout:5/957: getdents d3/d5/d13/d23/da4 0 2024-08-18T22:41:49.485 INFO:tasks.workunit.client.1.smithi195.stdout:8/707: chown d1/d3/db/d35/cbe 26020 1 2024-08-18T22:41:49.486 INFO:tasks.workunit.client.0.smithi121.stdout:5/958: symlink d3/d5/dfa/l135 0 2024-08-18T22:41:49.488 INFO:tasks.workunit.client.1.smithi195.stdout:8/708: creat d1/d3/db/d7a/f106 x:0 0 0 2024-08-18T22:41:49.490 INFO:tasks.workunit.client.1.smithi195.stdout:8/709: dread - d1/d3/d1c/d21/daa/ff1 zero size 2024-08-18T22:41:49.490 INFO:tasks.workunit.client.0.smithi121.stdout:5/959: dread d3/f1c [0,4194304] 0 2024-08-18T22:41:49.490 INFO:tasks.workunit.client.1.smithi195.stdout:8/710: readlink d1/d3/lfc 0 2024-08-18T22:41:49.492 INFO:tasks.workunit.client.0.smithi121.stdout:5/960: fdatasync d3/d5/d13/d19/d24/d32/f98 0 2024-08-18T22:41:49.494 INFO:tasks.workunit.client.1.smithi195.stdout:8/711: mkdir d1/d3/db/d35/d4d/d5c/ddf/d107 0 2024-08-18T22:41:49.495 INFO:tasks.workunit.client.1.smithi195.stdout:0/689: dread d0/f3 [0,4194304] 0 2024-08-18T22:41:49.496 INFO:tasks.workunit.client.0.smithi121.stdout:5/961: dread d3/d5/d13/d10b/d11e/f101 [0,4194304] 0 2024-08-18T22:41:49.497 INFO:tasks.workunit.client.1.smithi195.stdout:0/690: write d0/dc/d64/d81/fd8 [704472,102989] 0 2024-08-18T22:41:49.497 INFO:tasks.workunit.client.1.smithi195.stdout:8/712: creat d1/d3/db/d35/d4d/d5c/f108 x:0 0 0 2024-08-18T22:41:49.498 INFO:tasks.workunit.client.0.smithi121.stdout:5/962: mkdir d3/d5/d13/d23/da4/dc7/d136 0 2024-08-18T22:41:49.500 INFO:tasks.workunit.client.0.smithi121.stdout:5/963: symlink d3/d5/d13/d19/l137 0 2024-08-18T22:41:49.502 INFO:tasks.workunit.client.0.smithi121.stdout:5/964: unlink d3/d5/d13/d23/da4/lb2 0 2024-08-18T22:41:49.503 INFO:tasks.workunit.client.0.smithi121.stdout:5/965: symlink d3/d5/d13/d10b/d11e/d11c/l138 0 2024-08-18T22:41:49.504 INFO:tasks.workunit.client.1.smithi195.stdout:4/577: dwrite d0/d7/d1d/d69/f70 [0,4194304] 0 2024-08-18T22:41:49.506 INFO:tasks.workunit.client.1.smithi195.stdout:0/691: mkdir d0/dc/d64/d81/d44/d41/d6d/d92/d66/de0 0 2024-08-18T22:41:49.507 INFO:tasks.workunit.client.1.smithi195.stdout:9/653: dwrite d1c/d74/d8e/faf [0,4194304] 0 2024-08-18T22:41:49.509 INFO:tasks.workunit.client.1.smithi195.stdout:4/578: creat d0/d99/d98/d16/dae/fcd x:0 0 0 2024-08-18T22:41:49.513 INFO:tasks.workunit.client.1.smithi195.stdout:8/713: link d1/d3/db/d7a/f84 d1/d3/db/d39/d44/d79/dd9/f109 0 2024-08-18T22:41:49.515 INFO:tasks.workunit.client.0.smithi121.stdout:5/966: dwrite d3/d5/d13/d19/d24/fc9 [0,4194304] 0 2024-08-18T22:41:49.516 INFO:tasks.workunit.client.1.smithi195.stdout:0/692: rename d0/l50 to d0/dc/le1 0 2024-08-18T22:41:49.516 INFO:tasks.workunit.client.0.smithi121.stdout:5/967: write d3/d5/f7 [3129994,50118] 0 2024-08-18T22:41:49.520 INFO:tasks.workunit.client.1.smithi195.stdout:2/430: sync 2024-08-18T22:41:49.520 INFO:tasks.workunit.client.1.smithi195.stdout:3/727: sync 2024-08-18T22:41:49.520 INFO:tasks.workunit.client.1.smithi195.stdout:6/555: sync 2024-08-18T22:41:49.520 INFO:tasks.workunit.client.1.smithi195.stdout:1/723: sync 2024-08-18T22:41:49.520 INFO:tasks.workunit.client.1.smithi195.stdout:7/744: sync 2024-08-18T22:41:49.521 INFO:tasks.workunit.client.1.smithi195.stdout:9/654: rename d1c/d32/d71/f79 to d1c/d32/fd2 0 2024-08-18T22:41:49.524 INFO:tasks.workunit.client.0.smithi121.stdout:5/968: dwrite d3/f2c [0,4194304] 0 2024-08-18T22:41:49.525 INFO:tasks.workunit.client.0.smithi121.stdout:5/969: readlink d3/d5/d13/d23/da4/dc7/l64 0 2024-08-18T22:41:49.526 INFO:tasks.workunit.client.1.smithi195.stdout:6/556: rmdir da/db/d19/d67 39 2024-08-18T22:41:49.527 INFO:tasks.workunit.client.0.smithi121.stdout:5/970: mkdir d3/d5/d13/d23/d139 0 2024-08-18T22:41:49.528 INFO:tasks.workunit.client.1.smithi195.stdout:6/557: readlink da/db/d19/l54 0 2024-08-18T22:41:49.528 INFO:tasks.workunit.client.1.smithi195.stdout:4/579: rename d0/d7/d1d/d69/db7/f2e to d0/d99/d98/d16/d94/db2/da4/fce 0 2024-08-18T22:41:49.529 INFO:tasks.workunit.client.0.smithi121.stdout:5/971: creat d3/dd5/f13a x:0 0 0 2024-08-18T22:41:49.531 INFO:tasks.workunit.client.0.smithi121.stdout:5/972: readlink d3/l59 0 2024-08-18T22:41:49.532 INFO:tasks.workunit.client.1.smithi195.stdout:1/724: write da/d4c/d7a/dbd/ddb/d4e/d95/d9c/dc8/fce [327822,30953] 0 2024-08-18T22:41:49.533 INFO:tasks.workunit.client.1.smithi195.stdout:6/558: chown da/d15/d1c/d2e/l39 2732 1 2024-08-18T22:41:49.537 INFO:tasks.workunit.client.1.smithi195.stdout:4/580: dread d0/f97 [0,4194304] 0 2024-08-18T22:41:49.538 INFO:tasks.workunit.client.1.smithi195.stdout:0/693: getdents d0/dc/d11/daa 0 2024-08-18T22:41:49.539 INFO:tasks.workunit.client.1.smithi195.stdout:8/714: write d1/de/f3b [2606840,68681] 0 2024-08-18T22:41:49.540 INFO:tasks.workunit.client.1.smithi195.stdout:7/745: dread - dc/d1d/d29/ddb/d15/d4d/d97/dfe/d18/f7b zero size 2024-08-18T22:41:49.543 INFO:tasks.workunit.client.1.smithi195.stdout:3/728: getdents d7/d54 0 2024-08-18T22:41:49.543 INFO:tasks.workunit.client.1.smithi195.stdout:9/655: dwrite d1c/d74/f80 [0,4194304] 0 2024-08-18T22:41:49.545 INFO:tasks.workunit.client.1.smithi195.stdout:0/694: stat d0/dc/d64/d81 0 2024-08-18T22:41:49.547 INFO:tasks.workunit.client.1.smithi195.stdout:3/729: chown d7/f18 906 1 2024-08-18T22:41:49.548 INFO:tasks.workunit.client.0.smithi121.stdout:5/973: dread d3/d5/d13/d19/f30 [0,4194304] 0 2024-08-18T22:41:49.548 INFO:tasks.workunit.client.1.smithi195.stdout:6/559: dread da/f13 [0,4194304] 0 2024-08-18T22:41:49.549 INFO:tasks.workunit.client.1.smithi195.stdout:6/560: chown da/d22/d86 0 1 2024-08-18T22:41:49.550 INFO:tasks.workunit.client.1.smithi195.stdout:4/581: getdents d0/d7/d1d/d69/db7/d6c/d95 0 2024-08-18T22:41:49.550 INFO:tasks.workunit.client.1.smithi195.stdout:2/431: dread d1/d8/f25 [4194304,4194304] 0 2024-08-18T22:41:49.551 INFO:tasks.workunit.client.1.smithi195.stdout:1/725: rename da/d18/f1f to da/d3d/de0/ffe 0 2024-08-18T22:41:49.552 INFO:tasks.workunit.client.1.smithi195.stdout:8/715: truncate d1/d3/f6 4752778 0 2024-08-18T22:41:49.553 INFO:tasks.workunit.client.1.smithi195.stdout:1/726: stat da/d4c/d7a/dbd/ddb/c96 0 2024-08-18T22:41:49.553 INFO:tasks.workunit.client.1.smithi195.stdout:1/727: readlink da/la2 0 2024-08-18T22:41:49.554 INFO:tasks.workunit.client.1.smithi195.stdout:9/656: symlink d1c/d32/d37/d4b/dc6/ld3 0 2024-08-18T22:41:49.554 INFO:tasks.workunit.client.1.smithi195.stdout:8/716: chown d1/d3/db/d39/d44/d79 1643749 1 2024-08-18T22:41:49.555 INFO:tasks.workunit.client.1.smithi195.stdout:3/730: unlink d7/da/df/f1a 0 2024-08-18T22:41:49.558 INFO:tasks.workunit.client.1.smithi195.stdout:2/432: mkdir d1/d24/d26/d83 0 2024-08-18T22:41:49.559 INFO:tasks.workunit.client.1.smithi195.stdout:0/695: mkdir d0/dc/d64/de2 0 2024-08-18T22:41:49.560 INFO:tasks.workunit.client.1.smithi195.stdout:7/746: creat dc/d1d/d29/ddb/f102 x:0 0 0 2024-08-18T22:41:49.561 INFO:tasks.workunit.client.1.smithi195.stdout:1/728: creat da/d18/d43/fff x:0 0 0 2024-08-18T22:41:49.563 INFO:tasks.workunit.client.1.smithi195.stdout:8/717: fsync d1/d64/f73 0 2024-08-18T22:41:49.564 INFO:tasks.workunit.client.0.smithi121.stdout:5/974: dwrite d3/d5/d13/d23/f71 [0,4194304] 0 2024-08-18T22:41:49.564 INFO:tasks.workunit.client.1.smithi195.stdout:4/582: rename d0/d7/d1d/d69/db7/fa7 to d0/d7/d1d/d69/db7/d3b/fcf 0 2024-08-18T22:41:49.566 INFO:tasks.workunit.client.1.smithi195.stdout:9/657: truncate d1c/f27 1150498 0 2024-08-18T22:41:49.568 INFO:tasks.workunit.client.1.smithi195.stdout:1/729: dwrite da/d4c/d5d/dcb/fd0 [0,4194304] 0 2024-08-18T22:41:49.569 INFO:tasks.workunit.client.0.smithi121.stdout:5/975: write d3/d5/d3c/d3f/d8f/f4b [1297777,100631] 0 2024-08-18T22:41:49.571 INFO:tasks.workunit.client.1.smithi195.stdout:4/583: write d0/d99/d98/d16/d94/db2/f87 [653551,111148] 0 2024-08-18T22:41:49.572 INFO:tasks.workunit.client.1.smithi195.stdout:1/730: write da/d4c/d5d/de8/d99/ff3 [509665,23301] 0 2024-08-18T22:41:49.576 INFO:tasks.workunit.client.1.smithi195.stdout:1/731: write da/d18/d28/d31/d77/f81 [5919956,55841] 0 2024-08-18T22:41:49.577 INFO:tasks.workunit.client.1.smithi195.stdout:5/594: sync 2024-08-18T22:41:49.579 INFO:tasks.workunit.client.1.smithi195.stdout:9/658: dwrite d1c/d32/f50 [0,4194304] 0 2024-08-18T22:41:49.583 INFO:tasks.workunit.client.0.smithi121.stdout:5/976: dwrite d3/d5/d3c/d3f/ff1 [0,4194304] 0 2024-08-18T22:41:49.584 INFO:tasks.workunit.client.0.smithi121.stdout:5/977: chown d3/d5c/l82 8420 1 2024-08-18T22:41:49.587 INFO:tasks.workunit.client.0.smithi121.stdout:5/978: getdents d3/d5/d13/d19/d24/d125 0 2024-08-18T22:41:49.588 INFO:tasks.workunit.client.1.smithi195.stdout:3/731: symlink d7/dc3/lf3 0 2024-08-18T22:41:49.588 INFO:tasks.workunit.client.1.smithi195.stdout:2/433: symlink d1/d8/l84 0 2024-08-18T22:41:49.590 INFO:tasks.workunit.client.0.smithi121.stdout:5/979: symlink d3/d5/l13b 0 2024-08-18T22:41:49.591 INFO:tasks.workunit.client.1.smithi195.stdout:7/747: creat dc/d22/f103 x:0 0 0 2024-08-18T22:41:49.591 INFO:tasks.workunit.client.1.smithi195.stdout:4/584: chown d0/d99/d98/d16/d94/db2/da4/fce 3844610 1 2024-08-18T22:41:49.591 INFO:tasks.workunit.client.1.smithi195.stdout:6/561: getdents da 0 2024-08-18T22:41:49.593 INFO:tasks.workunit.client.0.smithi121.stdout:5/980: creat d3/d5/d13/f13c x:0 0 0 2024-08-18T22:41:49.593 INFO:tasks.workunit.client.1.smithi195.stdout:4/585: chown d0/d99/d98/d16/d54 31447 1 2024-08-18T22:41:49.594 INFO:tasks.workunit.client.0.smithi121.stdout:5/981: chown d3/d5/d3c/d3f/d8f/fa5 0 1 2024-08-18T22:41:49.594 INFO:tasks.workunit.client.1.smithi195.stdout:8/718: link d1/d3/d1c/f52 d1/d3/d1c/d6a/f10a 0 2024-08-18T22:41:49.595 INFO:tasks.workunit.client.1.smithi195.stdout:7/748: fsync dc/d1d/d29/ddb/d15/f71 0 2024-08-18T22:41:49.595 INFO:tasks.workunit.client.1.smithi195.stdout:5/595: mkdir d0/d3/d8/d64/d87/dbc 0 2024-08-18T22:41:49.596 INFO:tasks.workunit.client.0.smithi121.stdout:5/982: rename d3/l6a to d3/d5/d13/d10b/l13d 0 2024-08-18T22:41:49.599 INFO:tasks.workunit.client.1.smithi195.stdout:9/659: creat d1c/d32/d37/d4b/dc6/fd4 x:0 0 0 2024-08-18T22:41:49.600 INFO:tasks.workunit.client.1.smithi195.stdout:1/732: truncate da/d4c/d5d/d63/f65 1019387 0 2024-08-18T22:41:49.600 INFO:tasks.workunit.client.1.smithi195.stdout:8/719: readlink d1/d3/db/d35/dd1/lda 0 2024-08-18T22:41:49.600 INFO:tasks.workunit.client.0.smithi121.stdout:5/983: unlink d3/d5/d3c/daf/fb6 0 2024-08-18T22:41:49.601 INFO:tasks.workunit.client.1.smithi195.stdout:2/434: unlink d1/f3c 0 2024-08-18T22:41:49.601 INFO:tasks.workunit.client.1.smithi195.stdout:1/733: write da/d4c/d7a/fd2 [375713,297] 0 2024-08-18T22:41:49.604 INFO:tasks.workunit.client.1.smithi195.stdout:3/732: creat d7/da/df/d1c/dc6/ff4 x:0 0 0 2024-08-18T22:41:49.604 INFO:tasks.workunit.client.1.smithi195.stdout:6/562: fdatasync da/db/d19/f45 0 2024-08-18T22:41:49.605 INFO:tasks.workunit.client.1.smithi195.stdout:5/596: rmdir d0/d3/d5f 39 2024-08-18T22:41:49.607 INFO:tasks.workunit.client.1.smithi195.stdout:3/733: chown d7/d54/d9a/cb8 31 1 2024-08-18T22:41:49.608 INFO:tasks.workunit.client.1.smithi195.stdout:7/749: chown dc/d1d/d29/ddb/d15/d4d/d97/dfe/d58/db6/dd0/ff4 34162705 1 2024-08-18T22:41:49.610 INFO:tasks.workunit.client.1.smithi195.stdout:8/720: creat d1/d3/db/d35/d56/f10b x:0 0 0 2024-08-18T22:41:49.612 INFO:tasks.workunit.client.1.smithi195.stdout:5/597: readlink d0/d3/d66/la3 0 2024-08-18T22:41:49.612 INFO:tasks.workunit.client.1.smithi195.stdout:9/660: dwrite d1c/d32/f66 [0,4194304] 0 2024-08-18T22:41:49.612 INFO:tasks.workunit.client.1.smithi195.stdout:3/734: fsync d7/da/df/d38/f86 0 2024-08-18T22:41:49.613 INFO:tasks.workunit.client.1.smithi195.stdout:4/586: creat d0/d99/d98/d16/d94/db2/da4/dad/fd0 x:0 0 0 2024-08-18T22:41:49.614 INFO:tasks.workunit.client.1.smithi195.stdout:1/734: mknod da/d18/d28/d7b/df2/db1/dd6/c100 0 2024-08-18T22:41:49.618 INFO:tasks.workunit.client.1.smithi195.stdout:2/435: rename d1/d8/d3d/d5e to d1/d24/d26/d42/d72/d85 0 2024-08-18T22:41:49.620 INFO:tasks.workunit.client.1.smithi195.stdout:7/750: creat dc/d1d/d29/ddb/d15/d4d/d97/dfe/d58/db6/dd0/f104 x:0 0 0 2024-08-18T22:41:49.622 INFO:tasks.workunit.client.1.smithi195.stdout:5/598: symlink d0/d3/df/d5a/lbd 0 2024-08-18T22:41:49.628 INFO:tasks.workunit.client.1.smithi195.stdout:5/599: read d0/d2/d29/f47 [6308686,110841] 0 2024-08-18T22:41:49.628 INFO:tasks.workunit.client.1.smithi195.stdout:5/600: chown d0/d46/d6d/f97 352 1 2024-08-18T22:41:49.629 INFO:tasks.workunit.client.1.smithi195.stdout:2/436: dwrite d1/d24/d26/f36 [0,4194304] 0 2024-08-18T22:41:49.631 INFO:tasks.workunit.client.1.smithi195.stdout:6/563: dread da/d15/d1c/d2e/f3d [0,4194304] 0 2024-08-18T22:41:49.631 INFO:tasks.workunit.client.1.smithi195.stdout:2/437: fdatasync d1/d8/f70 0 2024-08-18T22:41:49.631 INFO:tasks.workunit.client.1.smithi195.stdout:5/601: readlink d0/d3/df/l48 0 2024-08-18T22:41:49.640 INFO:tasks.workunit.client.1.smithi195.stdout:8/721: mknod d1/d3/db/d35/d4d/d5c/de9/c10c 0 2024-08-18T22:41:49.642 INFO:tasks.workunit.client.1.smithi195.stdout:6/564: mkdir da/db/d19/d72/da7 0 2024-08-18T22:41:49.643 INFO:tasks.workunit.client.1.smithi195.stdout:2/438: dwrite d1/d8/d3d/d3b/d46/f66 [4194304,4194304] 0 2024-08-18T22:41:49.648 INFO:tasks.workunit.client.1.smithi195.stdout:6/565: readlink da/d15/d1c/d2e/l5d 0 2024-08-18T22:41:49.649 INFO:tasks.workunit.client.1.smithi195.stdout:4/587: link d0/d7/d1d/d69/db7/d3b/f5a d0/d7/d1d/d69/db7/d3b/fd1 0 2024-08-18T22:41:49.651 INFO:tasks.workunit.client.1.smithi195.stdout:7/751: creat dc/d1d/d29/d5d/f105 x:0 0 0 2024-08-18T22:41:49.654 INFO:tasks.workunit.client.1.smithi195.stdout:1/735: dwrite da/d4c/f9b [0,4194304] 0 2024-08-18T22:41:49.656 INFO:tasks.workunit.client.1.smithi195.stdout:5/602: symlink d0/d2/lbe 0 2024-08-18T22:41:49.657 INFO:tasks.workunit.client.1.smithi195.stdout:6/566: readlink da/d3b/la3 0 2024-08-18T22:41:49.659 INFO:tasks.workunit.client.1.smithi195.stdout:3/735: dread f6 [0,4194304] 0 2024-08-18T22:41:49.662 INFO:tasks.workunit.client.1.smithi195.stdout:9/661: dread d1c/f58 [0,4194304] 0 2024-08-18T22:41:49.665 INFO:tasks.workunit.client.1.smithi195.stdout:5/603: write d0/d3/f8d [545312,85395] 0 2024-08-18T22:41:49.666 INFO:tasks.workunit.client.1.smithi195.stdout:2/439: dwrite d1/f1b [0,4194304] 0 2024-08-18T22:41:49.669 INFO:tasks.workunit.client.1.smithi195.stdout:4/588: truncate d0/d99/d98/d16/f1b 3248968 0 2024-08-18T22:41:49.671 INFO:tasks.workunit.client.1.smithi195.stdout:3/736: chown d7/da/df/d1c/d6a/d6c 271869 1 2024-08-18T22:41:49.672 INFO:tasks.workunit.client.1.smithi195.stdout:6/567: write da/db/d19/d67/fa5 [561058,118929] 0 2024-08-18T22:41:49.674 INFO:tasks.workunit.client.1.smithi195.stdout:8/722: dwrite d1/de/d27/d4f/dde/f102 [0,4194304] 0 2024-08-18T22:41:49.675 INFO:tasks.workunit.client.1.smithi195.stdout:2/440: truncate d1/d24/d26/f40 4826833 0 2024-08-18T22:41:49.676 INFO:tasks.workunit.client.1.smithi195.stdout:1/736: link da/f15 da/d18/d28/d7b/df2/f101 0 2024-08-18T22:41:49.678 INFO:tasks.workunit.client.1.smithi195.stdout:5/604: dread d0/d3/d8/d64/fb6 [0,4194304] 0 2024-08-18T22:41:49.686 INFO:tasks.workunit.client.1.smithi195.stdout:4/589: rename d0/d7/l19 to d0/d7/d1d/d69/db7/d41/ld2 0 2024-08-18T22:41:49.688 INFO:tasks.workunit.client.1.smithi195.stdout:7/752: truncate dc/d1d/d29/ddb/d2b/dbc/fc0 619504 0 2024-08-18T22:41:49.688 INFO:tasks.workunit.client.1.smithi195.stdout:6/568: fsync da/d15/d1c/d64/f8b 0 2024-08-18T22:41:49.688 INFO:tasks.workunit.client.1.smithi195.stdout:1/737: rmdir da/d3d/de0 39 2024-08-18T22:41:49.691 INFO:tasks.workunit.client.1.smithi195.stdout:5/605: fdatasync d0/d3/df/f74 0 2024-08-18T22:41:49.692 INFO:tasks.workunit.client.1.smithi195.stdout:5/606: fsync d0/d2/d29/f32 0 2024-08-18T22:41:49.693 INFO:tasks.workunit.client.1.smithi195.stdout:9/662: dread d1c/f47 [0,4194304] 0 2024-08-18T22:41:49.693 INFO:tasks.workunit.client.1.smithi195.stdout:5/607: fdatasync d0/d3/f27 0 2024-08-18T22:41:49.695 INFO:tasks.workunit.client.1.smithi195.stdout:2/441: unlink d1/c13 0 2024-08-18T22:41:49.700 INFO:tasks.workunit.client.1.smithi195.stdout:9/663: dwrite d1c/d70/fc0 [4194304,4194304] 0 2024-08-18T22:41:49.701 INFO:tasks.workunit.client.1.smithi195.stdout:9/664: chown d1c/f1d 2696066 1 2024-08-18T22:41:49.779 INFO:tasks.workunit.client.1.smithi195.stdout:1/738: rmdir da/d4c/d5d/d63 39 2024-08-18T22:41:49.779 INFO:tasks.workunit.client.1.smithi195.stdout:6/569: write da/d22/d86/f79 [749990,42709] 0 2024-08-18T22:41:49.780 INFO:tasks.workunit.client.1.smithi195.stdout:8/723: creat d1/de/df/d1d/de5/dff/f10d x:0 0 0 2024-08-18T22:41:49.780 INFO:tasks.workunit.client.1.smithi195.stdout:4/590: mknod d0/d7/d1d/cd3 0 2024-08-18T22:41:49.780 INFO:tasks.workunit.client.1.smithi195.stdout:3/737: creat d7/da/df/d8e/ff5 x:0 0 0 2024-08-18T22:41:49.781 INFO:tasks.workunit.client.1.smithi195.stdout:7/753: link dc/d1d/d29/ddb/f102 dc/d1d/d29/ddb/d2b/d82/f106 0 2024-08-18T22:41:49.781 INFO:tasks.workunit.client.1.smithi195.stdout:2/442: rename d1/d24/d26/d42/d72/d85/f7b to d1/d24/d26/d42/d72/f86 0 2024-08-18T22:41:49.823 INFO:tasks.workunit.client.0.smithi121.stdout:2/660: sync 2024-08-18T22:41:49.824 INFO:tasks.workunit.client.0.smithi121.stdout:2/661: rmdir d2/d8/d9e 39 2024-08-18T22:41:49.825 INFO:tasks.workunit.client.0.smithi121.stdout:2/662: write d2/f6 [2579887,28085] 0 2024-08-18T22:41:49.828 INFO:tasks.workunit.client.0.smithi121.stdout:2/663: truncate d2/d8/d9e/fb6 1533605 0 2024-08-18T22:41:49.829 INFO:tasks.workunit.client.0.smithi121.stdout:2/664: dread - d2/d3/d53/fab zero size 2024-08-18T22:41:49.830 INFO:tasks.workunit.client.0.smithi121.stdout:2/665: chown d2/l5 1888 1 2024-08-18T22:41:49.831 INFO:tasks.workunit.client.0.smithi121.stdout:2/666: chown d2/d8/d19/d4a/f4d 5786808 1 2024-08-18T22:41:49.833 INFO:tasks.workunit.client.0.smithi121.stdout:2/667: rename d2/c5e to d2/dd8/cda 0 2024-08-18T22:41:49.834 INFO:tasks.workunit.client.0.smithi121.stdout:2/668: mknod d2/d3/d53/cdb 0 2024-08-18T22:41:49.835 INFO:tasks.workunit.client.0.smithi121.stdout:2/669: mkdir d2/dd8/ddc 0 2024-08-18T22:41:49.838 INFO:tasks.workunit.client.0.smithi121.stdout:2/670: getdents d2/d8/d19 0 2024-08-18T22:41:49.842 INFO:tasks.workunit.client.0.smithi121.stdout:2/671: write d2/d8/d1f/f76 [3786471,70178] 0 2024-08-18T22:41:49.844 INFO:tasks.workunit.client.0.smithi121.stdout:2/672: fdatasync d2/d8/d19/d4a/d64/f90 0 2024-08-18T22:41:49.849 INFO:tasks.workunit.client.1.smithi195.stdout:8/724: write d1/d3/db/d39/d44/d79/fe2 [444105,89111] 0 2024-08-18T22:41:49.851 INFO:tasks.workunit.client.1.smithi195.stdout:3/738: mkdir d7/df6 0 2024-08-18T22:41:49.853 INFO:tasks.workunit.client.1.smithi195.stdout:1/739: chown da/d4c/d7a/dbd/ddb/d4e/d95/d9c/cc1 10783 1 2024-08-18T22:41:49.853 INFO:tasks.workunit.client.1.smithi195.stdout:7/754: creat dc/d1d/d29/ddb/d15/d4d/d97/dfe/d18/f107 x:0 0 0 2024-08-18T22:41:49.855 INFO:tasks.workunit.client.1.smithi195.stdout:3/739: write f1 [2655275,53498] 0 2024-08-18T22:41:49.855 INFO:tasks.workunit.client.1.smithi195.stdout:4/591: creat d0/d7/fd4 x:0 0 0 2024-08-18T22:41:49.855 INFO:tasks.workunit.client.1.smithi195.stdout:8/725: stat d1/d3/db/d39/d2e/d78/fb5 0 2024-08-18T22:41:49.856 INFO:tasks.workunit.client.1.smithi195.stdout:2/443: dread d1/d8/d3d/f18 [0,4194304] 0 2024-08-18T22:41:49.857 INFO:tasks.workunit.client.1.smithi195.stdout:6/570: getdents da/d15/d1c 0 2024-08-18T22:41:49.859 INFO:tasks.workunit.client.0.smithi121.stdout:2/673: dread d2/f1d [0,4194304] 0 2024-08-18T22:41:49.861 INFO:tasks.workunit.client.0.smithi121.stdout:2/674: mknod d2/d3/d48/d77/cdd 0 2024-08-18T22:41:49.861 INFO:tasks.workunit.client.1.smithi195.stdout:6/571: chown da/d3b/f6d 46436 1 2024-08-18T22:41:49.867 INFO:tasks.workunit.client.1.smithi195.stdout:6/572: write da/d15/d1c/d2e/f60 [4758688,52181] 0 2024-08-18T22:41:49.868 INFO:tasks.workunit.client.1.smithi195.stdout:4/592: dread d0/d99/d98/d16/d94/db2/f87 [0,4194304] 0 2024-08-18T22:41:49.868 INFO:tasks.workunit.client.0.smithi121.stdout:2/675: truncate d2/f6 185810 0 2024-08-18T22:41:49.869 INFO:tasks.workunit.client.1.smithi195.stdout:7/755: unlink dc/d1d/d29/ddb/d15/d4d/d97/dfe/f5b 0 2024-08-18T22:41:49.870 INFO:tasks.workunit.client.0.smithi121.stdout:2/676: truncate d2/d8/d19/d4a/d64/f79 4001136 0 2024-08-18T22:41:49.873 INFO:tasks.workunit.client.0.smithi121.stdout:2/677: fdatasync d2/d8/d19/f52 0 2024-08-18T22:41:49.874 INFO:tasks.workunit.client.1.smithi195.stdout:6/573: unlink da/db/d26/f41 0 2024-08-18T22:41:49.875 INFO:tasks.workunit.client.1.smithi195.stdout:8/726: rename d1/de/d31/d5a/f50 to d1/d3/db/d35/d4d/d5c/ddf/d107/f10e 0 2024-08-18T22:41:49.876 INFO:tasks.workunit.client.1.smithi195.stdout:1/740: dwrite da/d18/d28/d7b/df2/db1/fdf [0,4194304] 0 2024-08-18T22:41:49.878 INFO:tasks.workunit.client.0.smithi121.stdout:2/678: write d2/d8/d19/f7b [1734218,31364] 0 2024-08-18T22:41:49.879 INFO:tasks.workunit.client.1.smithi195.stdout:1/741: chown da/d3d/f88 5577 1 2024-08-18T22:41:49.880 INFO:tasks.workunit.client.1.smithi195.stdout:2/444: dread d1/f59 [0,4194304] 0 2024-08-18T22:41:49.882 INFO:tasks.workunit.client.1.smithi195.stdout:4/593: mkdir d0/d7/d1d/d69/db7/d3b/dd5 0 2024-08-18T22:41:49.884 INFO:tasks.workunit.client.0.smithi121.stdout:2/679: read d2/d8/d19/d4a/d64/f79 [3687020,61744] 0 2024-08-18T22:41:49.885 INFO:tasks.workunit.client.0.smithi121.stdout:2/680: dread - d2/d8/fa3 zero size 2024-08-18T22:41:49.885 INFO:tasks.workunit.client.0.smithi121.stdout:2/681: stat d2/d3/d48/d77/cb5 0 2024-08-18T22:41:49.887 INFO:tasks.workunit.client.0.smithi121.stdout:2/682: symlink d2/d8/d9e/lde 0 2024-08-18T22:41:49.887 INFO:tasks.workunit.client.0.smithi121.stdout:2/683: stat d2 0 2024-08-18T22:41:49.888 INFO:tasks.workunit.client.1.smithi195.stdout:3/740: getdents d7/da/df/d1c/d6a 0 2024-08-18T22:41:49.889 INFO:tasks.workunit.client.0.smithi121.stdout:2/684: creat d2/d3/d51/fdf x:0 0 0 2024-08-18T22:41:49.889 INFO:tasks.workunit.client.1.smithi195.stdout:6/574: dwrite da/d3b/f7a [0,4194304] 0 2024-08-18T22:41:49.894 INFO:tasks.workunit.client.1.smithi195.stdout:4/594: read d0/d7/d1d/f2f [34390,122115] 0 2024-08-18T22:41:49.896 INFO:tasks.workunit.client.1.smithi195.stdout:1/742: creat da/f102 x:0 0 0 2024-08-18T22:41:49.897 INFO:tasks.workunit.client.1.smithi195.stdout:6/575: unlink da/d15/d1c/d2e/d74/ca4 0 2024-08-18T22:41:49.897 INFO:tasks.workunit.client.1.smithi195.stdout:7/756: dread dc/d1d/d29/ddb/f49 [0,4194304] 0 2024-08-18T22:41:49.898 INFO:tasks.workunit.client.0.smithi121.stdout:5/984: sync 2024-08-18T22:41:49.898 INFO:tasks.workunit.client.0.smithi121.stdout:0/882: sync 2024-08-18T22:41:49.899 INFO:tasks.workunit.client.0.smithi121.stdout:0/883: chown d1/d4/f72 1021 1 2024-08-18T22:41:49.900 INFO:tasks.workunit.client.0.smithi121.stdout:5/985: write d3/d5/d3c/d3f/ff1 [4947179,43814] 0 2024-08-18T22:41:49.902 INFO:tasks.workunit.client.0.smithi121.stdout:0/884: chown d1/d4/db/d24/df/d8/d78/f7a 43 1 2024-08-18T22:41:49.903 INFO:tasks.workunit.client.0.smithi121.stdout:2/685: dwrite d2/d3/d48/d77/f6d [4194304,4194304] 0 2024-08-18T22:41:49.907 INFO:tasks.workunit.client.0.smithi121.stdout:5/986: dread d3/d5/d3c/d3f/ff1 [0,4194304] 0 2024-08-18T22:41:49.908 INFO:tasks.workunit.client.1.smithi195.stdout:3/741: dwrite d7/d1f/fa9 [0,4194304] 0 2024-08-18T22:41:49.908 INFO:tasks.workunit.client.1.smithi195.stdout:8/727: getdents d1/d64 0 2024-08-18T22:41:49.912 INFO:tasks.workunit.client.0.smithi121.stdout:5/987: mkdir d3/d5/d3c/d3f/d13e 0 2024-08-18T22:41:49.914 INFO:tasks.workunit.client.0.smithi121.stdout:0/885: dwrite d1/d4/db/d24/df/d8/d78/d7c/df5/daf/dd5/f46 [0,4194304] 0 2024-08-18T22:41:49.914 INFO:tasks.workunit.client.1.smithi195.stdout:8/728: mkdir d1/d3/db/d10f 0 2024-08-18T22:41:49.914 INFO:tasks.workunit.client.0.smithi121.stdout:2/686: dwrite d2/d8/d1f/fcc [0,4194304] 0 2024-08-18T22:41:49.918 INFO:tasks.workunit.client.1.smithi195.stdout:8/729: write d1/de/f4e [3725049,127730] 0 2024-08-18T22:41:49.924 INFO:tasks.workunit.client.0.smithi121.stdout:2/687: dwrite d2/d3/d51/f81 [0,4194304] 0 2024-08-18T22:41:49.925 INFO:tasks.workunit.client.1.smithi195.stdout:2/445: dread d1/d8/d3d/f48 [0,4194304] 0 2024-08-18T22:41:49.926 INFO:tasks.workunit.client.1.smithi195.stdout:8/730: creat d1/d3/db/d39/d44/d79/df2/f110 x:0 0 0 2024-08-18T22:41:49.928 INFO:tasks.workunit.client.0.smithi121.stdout:2/688: rename d2/d8/lc5 to d2/d8/d19/d4a/d64/le0 0 2024-08-18T22:41:49.931 INFO:tasks.workunit.client.0.smithi121.stdout:2/689: creat d2/d3/d48/d77/fe1 x:0 0 0 2024-08-18T22:41:49.931 INFO:tasks.workunit.client.0.smithi121.stdout:5/988: dwrite d3/d5/d13/d19/d24/f47 [0,4194304] 0 2024-08-18T22:41:49.932 INFO:tasks.workunit.client.1.smithi195.stdout:2/446: mkdir d1/d24/d26/d42/d44/d87 0 2024-08-18T22:41:49.933 INFO:tasks.workunit.client.0.smithi121.stdout:5/989: fsync d3/d5/d13/d19/d24/d4d/f9b 0 2024-08-18T22:41:49.938 INFO:tasks.workunit.client.1.smithi195.stdout:8/731: dwrite d1/d3/db/d35/d4d/fcd [0,4194304] 0 2024-08-18T22:41:49.939 INFO:tasks.workunit.client.1.smithi195.stdout:4/595: dread d0/d7/d1d/f52 [0,4194304] 0 2024-08-18T22:41:49.948 INFO:tasks.workunit.client.0.smithi121.stdout:2/690: write d2/d3/d53/f66 [6969746,99210] 0 2024-08-18T22:41:49.949 INFO:tasks.workunit.client.0.smithi121.stdout:5/990: truncate d3/d5/d13/d19/d24/d32/f44 1632392 0 2024-08-18T22:41:49.951 INFO:tasks.workunit.client.1.smithi195.stdout:8/732: rename d1/de/df/d1d/de5/dff/f10d to d1/d3/d1c/d21/daa/f111 0 2024-08-18T22:41:49.951 INFO:tasks.workunit.client.0.smithi121.stdout:2/691: readlink d2/d3/d48/d77/l43 0 2024-08-18T22:41:49.954 INFO:tasks.workunit.client.1.smithi195.stdout:7/757: dread dc/d1d/d29/ddb/d15/f42 [0,4194304] 0 2024-08-18T22:41:49.956 INFO:tasks.workunit.client.0.smithi121.stdout:2/692: creat d2/d3/dd6/fe2 x:0 0 0 2024-08-18T22:41:49.957 INFO:tasks.workunit.client.1.smithi195.stdout:6/576: dread da/d15/d1c/d2e/f60 [0,4194304] 0 2024-08-18T22:41:49.957 INFO:tasks.workunit.client.1.smithi195.stdout:2/447: unlink d1/d8/d27/f7f 0 2024-08-18T22:41:49.959 INFO:tasks.workunit.client.0.smithi121.stdout:0/886: dread d1/d4/da/f28 [0,4194304] 0 2024-08-18T22:41:49.959 INFO:tasks.workunit.client.0.smithi121.stdout:5/991: dwrite d3/d5/d13/d19/d24/fc9 [0,4194304] 0 2024-08-18T22:41:49.960 INFO:tasks.workunit.client.1.smithi195.stdout:6/577: mkdir da/db/d19/d67/da8 0 2024-08-18T22:41:49.961 INFO:tasks.workunit.client.1.smithi195.stdout:7/758: fsync f3 0 2024-08-18T22:41:49.963 INFO:tasks.workunit.client.1.smithi195.stdout:2/448: creat d1/d8/d27/f88 x:0 0 0 2024-08-18T22:41:49.963 INFO:tasks.workunit.client.1.smithi195.stdout:3/742: dread d7/da/df/d38/f45 [0,4194304] 0 2024-08-18T22:41:49.965 INFO:tasks.workunit.client.0.smithi121.stdout:2/693: write d2/d8/d19/d55/f70 [3477673,48502] 0 2024-08-18T22:41:49.966 INFO:tasks.workunit.client.1.smithi195.stdout:2/449: truncate d1/d24/d26/d42/d50/f77 733498 0 2024-08-18T22:41:49.967 INFO:tasks.workunit.client.1.smithi195.stdout:6/578: rename da/d22/d73 to da/db/d26/d2d/da1/da9 0 2024-08-18T22:41:49.967 INFO:tasks.workunit.client.0.smithi121.stdout:5/992: rename d3/d5/fe4 to d3/d5/d13/d19/d75/f13f 0 2024-08-18T22:41:49.970 INFO:tasks.workunit.client.0.smithi121.stdout:2/694: rename d2/d3/d53/fab to d2/d3/d48/d77/fe3 0 2024-08-18T22:41:49.971 INFO:tasks.workunit.client.1.smithi195.stdout:2/450: truncate d1/d8/d3d/fa 8791451 0 2024-08-18T22:41:49.971 INFO:tasks.workunit.client.0.smithi121.stdout:5/993: read d3/d5/d13/d19/d24/d4d/f4f [1845880,60611] 0 2024-08-18T22:41:49.971 INFO:tasks.workunit.client.0.smithi121.stdout:2/695: stat d2/c9 0 2024-08-18T22:41:49.972 INFO:tasks.workunit.client.0.smithi121.stdout:2/696: stat d2/d8/l5d 0 2024-08-18T22:41:49.972 INFO:tasks.workunit.client.1.smithi195.stdout:7/759: creat dc/d1d/d29/ddb/d15/d4d/d97/dfe/f108 x:0 0 0 2024-08-18T22:41:49.973 INFO:tasks.workunit.client.0.smithi121.stdout:5/994: readlink d3/d5/d13/d23/da4/da6/le0 0 2024-08-18T22:41:49.973 INFO:tasks.workunit.client.1.smithi195.stdout:6/579: mkdir da/db/d26/d2d/da1/da9/d77/daa 0 2024-08-18T22:41:49.974 INFO:tasks.workunit.client.0.smithi121.stdout:2/697: mkdir d2/d8/d9e/de4 0 2024-08-18T22:41:49.974 INFO:tasks.workunit.client.0.smithi121.stdout:5/995: write d3/d5/d13/d10b/d11e/fc0 [1026765,66079] 0 2024-08-18T22:41:49.976 INFO:tasks.workunit.client.1.smithi195.stdout:6/580: fdatasync da/db/d26/f95 0 2024-08-18T22:41:49.976 INFO:tasks.workunit.client.0.smithi121.stdout:5/996: write d3/d5/d3c/dd3/fe3 [275270,52940] 0 2024-08-18T22:41:49.977 INFO:tasks.workunit.client.0.smithi121.stdout:2/698: rename d2/d8/d19/d4a/d64/f8b to d2/d3/fe5 0 2024-08-18T22:41:49.978 INFO:tasks.workunit.client.1.smithi195.stdout:2/451: dwrite d1/d24/f73 [0,4194304] 0 2024-08-18T22:41:49.980 INFO:tasks.workunit.client.1.smithi195.stdout:7/760: dread dc/d2a/f65 [0,4194304] 0 2024-08-18T22:41:49.982 INFO:tasks.workunit.client.1.smithi195.stdout:6/581: rename da/db/d78/ca0 to da/d15/cab 0 2024-08-18T22:41:49.982 INFO:tasks.workunit.client.0.smithi121.stdout:2/699: dwrite d2/d8/d19/d4a/d64/fbe [0,4194304] 0 2024-08-18T22:41:49.984 INFO:tasks.workunit.client.1.smithi195.stdout:7/761: write dc/f1e [5902981,31117] 0 2024-08-18T22:41:49.985 INFO:tasks.workunit.client.0.smithi121.stdout:2/700: symlink d2/d8/d19/le6 0 2024-08-18T22:41:49.986 INFO:tasks.workunit.client.1.smithi195.stdout:7/762: chown dc/d8f 384512 1 2024-08-18T22:41:49.987 INFO:tasks.workunit.client.0.smithi121.stdout:2/701: write d2/d3/d48/d77/f6d [8010668,56901] 0 2024-08-18T22:41:49.989 INFO:tasks.workunit.client.1.smithi195.stdout:7/763: creat dc/d1d/d29/df0/f109 x:0 0 0 2024-08-18T22:41:49.992 INFO:tasks.workunit.client.1.smithi195.stdout:6/582: dwrite da/d15/d1c/f12 [0,4194304] 0 2024-08-18T22:41:49.994 INFO:tasks.workunit.client.1.smithi195.stdout:7/764: write dc/f72 [932448,82465] 0 2024-08-18T22:41:49.996 INFO:tasks.workunit.client.1.smithi195.stdout:6/583: unlink da/l1a 0 2024-08-18T22:41:50.001 INFO:tasks.workunit.client.1.smithi195.stdout:7/765: creat dc/d1d/d29/ddb/f10a x:0 0 0 2024-08-18T22:41:50.002 INFO:tasks.workunit.client.1.smithi195.stdout:7/766: dread - dc/d22/f103 zero size 2024-08-18T22:41:50.005 INFO:tasks.workunit.client.1.smithi195.stdout:7/767: truncate dc/d1d/d29/fd7 939816 0 2024-08-18T22:41:50.006 INFO:tasks.workunit.client.1.smithi195.stdout:2/452: truncate d1/d24/f56 3211695 0 2024-08-18T22:41:50.008 INFO:tasks.workunit.client.1.smithi195.stdout:7/768: creat dc/d1d/d29/ddb/d15/d4d/d97/dfe/d58/db6/df7/f10b x:0 0 0 2024-08-18T22:41:50.010 INFO:tasks.workunit.client.1.smithi195.stdout:2/453: dread d1/d8/f25 [4194304,4194304] 0 2024-08-18T22:41:50.011 INFO:tasks.workunit.client.1.smithi195.stdout:7/769: write dc/d1d/d29/ddb/d15/d4d/d97/dfe/d58/f6b [195707,128965] 0 2024-08-18T22:41:50.012 INFO:tasks.workunit.client.1.smithi195.stdout:2/454: rmdir d1/d24/d26/d42/d72 39 2024-08-18T22:41:50.013 INFO:tasks.workunit.client.1.smithi195.stdout:7/770: mkdir dc/d1d/d29/ddb/d15/d4d/d97/dfe/d58/db6/df7/d10c 0 2024-08-18T22:41:50.015 INFO:tasks.workunit.client.1.smithi195.stdout:2/455: rename d1/d22/d65/c75 to d1/d24/d26/d42/c89 0 2024-08-18T22:41:50.018 INFO:tasks.workunit.client.1.smithi195.stdout:0/696: sync 2024-08-18T22:41:50.033 INFO:tasks.workunit.client.1.smithi195.stdout:3/743: dread d7/da/d75/f78 [0,4194304] 0 2024-08-18T22:41:50.033 INFO:tasks.workunit.client.1.smithi195.stdout:0/697: readlink d0/dc/dd/l36 0 2024-08-18T22:41:50.034 INFO:tasks.workunit.client.1.smithi195.stdout:3/744: chown f6 261879 1 2024-08-18T22:41:50.037 INFO:tasks.workunit.client.1.smithi195.stdout:0/698: getdents d0/dc/d11/daa 0 2024-08-18T22:41:50.039 INFO:tasks.workunit.client.1.smithi195.stdout:2/456: dwrite d1/d8/d27/f88 [0,4194304] 0 2024-08-18T22:41:50.040 INFO:tasks.workunit.client.1.smithi195.stdout:3/745: truncate d7/f61 4476658 0 2024-08-18T22:41:50.041 INFO:tasks.workunit.client.1.smithi195.stdout:2/457: fdatasync d1/d24/d26/f2b 0 2024-08-18T22:41:50.042 INFO:tasks.workunit.client.1.smithi195.stdout:2/458: chown d1/d22/f30 1375166 1 2024-08-18T22:41:50.044 INFO:tasks.workunit.client.1.smithi195.stdout:6/584: creat da/db/d26/d2d/d8e/fac x:0 0 0 2024-08-18T22:41:50.045 INFO:tasks.workunit.client.1.smithi195.stdout:6/585: stat da/db/d26/f95 0 2024-08-18T22:41:50.047 INFO:tasks.workunit.client.1.smithi195.stdout:7/771: rename dc/d1d/d29/ddb/d15/d4d/d97/dfe/d58 to dc/d1d/d29/ddb/d10d 0 2024-08-18T22:41:50.048 INFO:tasks.workunit.client.1.smithi195.stdout:3/746: rename d7/d1f/d73/dae to d7/d1f/d73/dae/df7 22 2024-08-18T22:41:50.051 INFO:tasks.workunit.client.1.smithi195.stdout:7/772: rmdir dc/d2a/d4c 39 2024-08-18T22:41:50.053 INFO:tasks.workunit.client.1.smithi195.stdout:3/747: mkdir d7/da/df/dd3/df8 0 2024-08-18T22:41:50.054 INFO:tasks.workunit.client.1.smithi195.stdout:2/459: dread d1/d22/d51/f6e [0,4194304] 0 2024-08-18T22:41:50.054 INFO:tasks.workunit.client.1.smithi195.stdout:3/748: dread - d7/d1f/d73/fc0 zero size 2024-08-18T22:41:50.056 INFO:tasks.workunit.client.0.smithi121.stdout:0/887: dwrite d1/d4/db/d24/f29 [0,4194304] 0 2024-08-18T22:41:50.057 INFO:tasks.workunit.client.1.smithi195.stdout:3/749: rmdir d7/d54 39 2024-08-18T22:41:50.058 INFO:tasks.workunit.client.1.smithi195.stdout:0/699: dread d0/dc/d11/f79 [0,4194304] 0 2024-08-18T22:41:50.061 INFO:tasks.workunit.client.1.smithi195.stdout:3/750: rmdir d7/d1f/d49 39 2024-08-18T22:41:50.063 INFO:tasks.workunit.client.0.smithi121.stdout:2/702: truncate d2/d3/d53/f66 5446570 0 2024-08-18T22:41:50.063 INFO:tasks.workunit.client.0.smithi121.stdout:0/888: write d1/d4/db/d18/f3a [254873,110909] 0 2024-08-18T22:41:50.065 INFO:tasks.workunit.client.1.smithi195.stdout:0/700: creat d0/dc/d64/d81/d44/d41/d6d/d92/d66/d8d/dbe/ddd/fe3 x:0 0 0 2024-08-18T22:41:50.066 INFO:tasks.workunit.client.0.smithi121.stdout:2/703: rename d2/d8/fc4 to d2/d8/d9e/fe7 0 2024-08-18T22:41:50.067 INFO:tasks.workunit.client.1.smithi195.stdout:2/460: link d1/d8/d3d/c2d d1/d24/d26/d42/d72/d85/c8a 0 2024-08-18T22:41:50.068 INFO:tasks.workunit.client.1.smithi195.stdout:0/701: write d0/dc/d64/d81/d44/d41/d6d/d92/fab [420034,72568] 0 2024-08-18T22:41:50.070 INFO:tasks.workunit.client.1.smithi195.stdout:2/461: symlink d1/d24/d26/d42/d44/l8b 0 2024-08-18T22:41:50.070 INFO:tasks.workunit.client.1.smithi195.stdout:0/702: write d0/dc/d64/d81/d44/d41/d6d/fbd [358604,82878] 0 2024-08-18T22:41:50.071 INFO:tasks.workunit.client.0.smithi121.stdout:2/704: link d2/d73/fb9 d2/dd8/ddc/fe8 0 2024-08-18T22:41:50.072 INFO:tasks.workunit.client.0.smithi121.stdout:0/889: dread d1/d4/db/f1a [0,4194304] 0 2024-08-18T22:41:50.073 INFO:tasks.workunit.client.1.smithi195.stdout:0/703: write d0/dc/d64/d81/d44/d41/d6d/d92/d66/f86 [52356,126377] 0 2024-08-18T22:41:50.074 INFO:tasks.workunit.client.0.smithi121.stdout:2/705: rename d2/d8/fc2 to d2/d8/d9e/de4/fe9 0 2024-08-18T22:41:50.075 INFO:tasks.workunit.client.1.smithi195.stdout:2/462: symlink d1/d8/d3d/d6c/d7c/l8c 0 2024-08-18T22:41:50.075 INFO:tasks.workunit.client.1.smithi195.stdout:2/463: readlink d1/d22/l74 0 2024-08-18T22:41:50.075 INFO:tasks.workunit.client.0.smithi121.stdout:0/890: rmdir d1/d4/db/d24/d30/d6c/dde 39 2024-08-18T22:41:50.076 INFO:tasks.workunit.client.1.smithi195.stdout:0/704: rename d0/f6c to d0/dc/d25/d67/db8/fe4 0 2024-08-18T22:41:50.082 INFO:tasks.workunit.client.1.smithi195.stdout:6/586: dread da/d15/d1c/d2e/f85 [0,4194304] 0 2024-08-18T22:41:50.083 INFO:tasks.workunit.client.0.smithi121.stdout:2/706: truncate d2/d8/d19/d4a/d64/f79 4688289 0 2024-08-18T22:41:50.083 INFO:tasks.workunit.client.0.smithi121.stdout:0/891: dread d1/d4/db/d24/df/d8/d78/d7c/df5/daf/dd5/f46 [0,4194304] 0 2024-08-18T22:41:50.083 INFO:tasks.workunit.client.0.smithi121.stdout:0/892: mknod d1/d8a/c134 0 2024-08-18T22:41:50.084 INFO:tasks.workunit.client.1.smithi195.stdout:2/464: dwrite d1/f59 [0,4194304] 0 2024-08-18T22:41:50.085 INFO:tasks.workunit.client.1.smithi195.stdout:6/587: symlink da/d22/d86/lad 0 2024-08-18T22:41:50.086 INFO:tasks.workunit.client.0.smithi121.stdout:0/893: symlink d1/d4/db/d24/df/d8/d78/d7c/df5/daf/ddd/l135 0 2024-08-18T22:41:50.087 INFO:tasks.workunit.client.1.smithi195.stdout:6/588: write da/db/d26/f95 [1321649,21689] 0 2024-08-18T22:41:50.087 INFO:tasks.workunit.client.1.smithi195.stdout:2/465: symlink d1/d8/d3d/d3b/d46/l8d 0 2024-08-18T22:41:50.088 INFO:tasks.workunit.client.0.smithi121.stdout:0/894: read d1/d4/db/d24/f42 [337923,50124] 0 2024-08-18T22:41:50.090 INFO:tasks.workunit.client.1.smithi195.stdout:0/705: dread d0/dc/dd/f29 [0,4194304] 0 2024-08-18T22:41:50.092 INFO:tasks.workunit.client.0.smithi121.stdout:0/895: rmdir d1/d4/db/d18/d129 0 2024-08-18T22:41:50.092 INFO:tasks.workunit.client.1.smithi195.stdout:2/466: mkdir d1/d24/d26/d42/d44/d87/d8e 0 2024-08-18T22:41:50.093 INFO:tasks.workunit.client.0.smithi121.stdout:0/896: dread - d1/d4/db/d24/df/d8/d71/d79/f92 zero size 2024-08-18T22:41:50.093 INFO:tasks.workunit.client.1.smithi195.stdout:0/706: write d0/dc/d11/d23/d51/f72 [4603731,73347] 0 2024-08-18T22:41:50.095 INFO:tasks.workunit.client.1.smithi195.stdout:0/707: write d0/dc/d64/fa3 [2931868,95842] 0 2024-08-18T22:41:50.095 INFO:tasks.workunit.client.0.smithi121.stdout:0/897: chown d1/d4/db/d24/df/d8/d78/d7c/df5/daf/dd5/d5b/ff2 6928462 1 2024-08-18T22:41:50.096 INFO:tasks.workunit.client.0.smithi121.stdout:2/707: dread d2/d8/fa9 [0,4194304] 0 2024-08-18T22:41:50.096 INFO:tasks.workunit.client.1.smithi195.stdout:6/589: getdents da/d3b 0 2024-08-18T22:41:50.097 INFO:tasks.workunit.client.0.smithi121.stdout:2/708: chown d2/d3/d51/f81 79989531 1 2024-08-18T22:41:50.097 INFO:tasks.workunit.client.1.smithi195.stdout:0/708: chown d0/dc/d11/c95 472 1 2024-08-18T22:41:50.100 INFO:tasks.workunit.client.0.smithi121.stdout:0/898: rename d1/d4/db/d24/df/d8/d78/d7c/df5/f106 to d1/d47/f136 0 2024-08-18T22:41:50.105 INFO:tasks.workunit.client.0.smithi121.stdout:0/899: link d1/d4/db/d24/df/d8/d78/d7c/df5/daf/dd5/fb5 d1/d4/d53/f137 0 2024-08-18T22:41:50.105 INFO:tasks.workunit.client.1.smithi195.stdout:6/590: dwrite da/d15/d1c/d64/f8b [0,4194304] 0 2024-08-18T22:41:50.106 INFO:tasks.workunit.client.1.smithi195.stdout:0/709: chown d0/dc/d25/d67/db8/fe4 118 1 2024-08-18T22:41:50.106 INFO:tasks.workunit.client.0.smithi121.stdout:0/900: write d1/d4/db/d24/d30/f86 [3376652,88172] 0 2024-08-18T22:41:50.108 INFO:tasks.workunit.client.1.smithi195.stdout:0/710: mknod d0/dc/dd/ce5 0 2024-08-18T22:41:50.108 INFO:tasks.workunit.client.0.smithi121.stdout:0/901: symlink d1/d4/db/d24/df/d8/d78/d7c/df5/daf/df8/l138 0 2024-08-18T22:41:50.109 INFO:tasks.workunit.client.0.smithi121.stdout:0/902: mkdir d1/d8a/d139 0 2024-08-18T22:41:50.110 INFO:tasks.workunit.client.1.smithi195.stdout:6/591: mkdir da/db/d26/d2d/da1/dae 0 2024-08-18T22:41:50.111 INFO:tasks.workunit.client.1.smithi195.stdout:0/711: write d0/dc/dd/f29 [2511630,79328] 0 2024-08-18T22:41:50.112 INFO:tasks.workunit.client.1.smithi195.stdout:6/592: rmdir da/db/d78 39 2024-08-18T22:41:50.112 INFO:tasks.workunit.client.1.smithi195.stdout:0/712: readlink d0/dc/d11/l4e 0 2024-08-18T22:41:50.113 INFO:tasks.workunit.client.1.smithi195.stdout:6/593: dread - da/db/d19/d72/f76 zero size 2024-08-18T22:41:50.115 INFO:tasks.workunit.client.1.smithi195.stdout:0/713: symlink d0/dc/dd/le6 0 2024-08-18T22:41:50.117 INFO:tasks.workunit.client.0.smithi121.stdout:0/903: dwrite d1/d4/db/d24/df/d8/d78/d7c/df5/daf/dd5/f10f [0,4194304] 0 2024-08-18T22:41:50.117 INFO:tasks.workunit.client.1.smithi195.stdout:6/594: creat da/d22/d87/d91/faf x:0 0 0 2024-08-18T22:41:50.120 INFO:tasks.workunit.client.1.smithi195.stdout:2/467: dread d1/d24/d26/d42/d5c/f6a [0,4194304] 0 2024-08-18T22:41:50.120 INFO:tasks.workunit.client.1.smithi195.stdout:2/468: dread - d1/d24/f60 zero size 2024-08-18T22:41:50.122 INFO:tasks.workunit.client.1.smithi195.stdout:0/714: rename d0/dc/d64/d81/d44/d41/d6d/d92/fab to d0/dc/d11/d23/d51/dad/fe7 0 2024-08-18T22:41:50.124 INFO:tasks.workunit.client.1.smithi195.stdout:0/715: chown d0/dc/d64/d81/d44/d41/d6d/d92/d66/de0 0 1 2024-08-18T22:41:50.124 INFO:tasks.workunit.client.1.smithi195.stdout:2/469: creat d1/d8/d3d/d6c/f8f x:0 0 0 2024-08-18T22:41:50.128 INFO:tasks.workunit.client.0.smithi121.stdout:0/904: dwrite d1/d4/db/d24/df/d8/d78/d7c/df5/daf/dd5/d90/dc3/fc7 [4194304,4194304] 0 2024-08-18T22:41:50.128 INFO:tasks.workunit.client.1.smithi195.stdout:2/470: creat d1/d8/d27/f90 x:0 0 0 2024-08-18T22:41:50.131 INFO:tasks.workunit.client.1.smithi195.stdout:0/716: write d0/dc/d25/d67/db8/fe4 [738478,23834] 0 2024-08-18T22:41:50.133 INFO:tasks.workunit.client.1.smithi195.stdout:0/717: chown d0/dc/d64/d81/f89 195 1 2024-08-18T22:41:50.135 INFO:tasks.workunit.client.1.smithi195.stdout:0/718: symlink d0/dc/dd/d46/le8 0 2024-08-18T22:41:50.136 INFO:tasks.workunit.client.0.smithi121.stdout:0/905: dwrite d1/d4/da/d2f/f12a [0,4194304] 0 2024-08-18T22:41:50.147 INFO:tasks.workunit.client.1.smithi195.stdout:0/719: dwrite d0/dc/f33 [0,4194304] 0 2024-08-18T22:41:50.150 INFO:tasks.workunit.client.1.smithi195.stdout:0/720: fdatasync d0/dc/d11/d23/d51/f7a 0 2024-08-18T22:41:50.152 INFO:tasks.workunit.client.1.smithi195.stdout:0/721: dread d0/f3 [0,4194304] 0 2024-08-18T22:41:50.155 INFO:tasks.workunit.client.1.smithi195.stdout:0/722: mkdir d0/dc/d11/d23/de9 0 2024-08-18T22:41:50.156 INFO:tasks.workunit.client.1.smithi195.stdout:0/723: fsync d0/dc/dd/d46/f7e 0 2024-08-18T22:41:50.161 INFO:tasks.workunit.client.1.smithi195.stdout:0/724: link d0/dc/d64/d81/d44/l7f d0/dc/d64/d81/d44/lea 0 2024-08-18T22:41:50.166 INFO:tasks.workunit.client.0.smithi121.stdout:0/906: mkdir d1/d4/db/d24/df/d13a 0 2024-08-18T22:41:50.167 INFO:tasks.workunit.client.1.smithi195.stdout:0/725: dwrite d0/dc/d11/fd1 [0,4194304] 0 2024-08-18T22:41:50.168 INFO:tasks.workunit.client.1.smithi195.stdout:0/726: chown d0/dc/d64/d81/fc2 1189 1 2024-08-18T22:41:50.170 INFO:tasks.workunit.client.0.smithi121.stdout:0/907: link d1/d4/db/d18/cb6 d1/d4/da/d2f/c13b 0 2024-08-18T22:41:50.173 INFO:tasks.workunit.client.0.smithi121.stdout:0/908: symlink d1/d4/db/d24/df/d13a/l13c 0 2024-08-18T22:41:50.176 INFO:tasks.workunit.client.1.smithi195.stdout:0/727: write d0/dc/d11/d23/d51/f7a [1859024,105629] 0 2024-08-18T22:41:50.177 INFO:tasks.workunit.client.0.smithi121.stdout:0/909: creat d1/d4/db/d24/df/d8/d78/d7c/df5/daf/dd5/d90/dc3/f13d x:0 0 0 2024-08-18T22:41:50.178 INFO:tasks.workunit.client.0.smithi121.stdout:0/910: write d1/d4/db/d18/f2d [2245792,111068] 0 2024-08-18T22:41:50.179 INFO:tasks.workunit.client.1.smithi195.stdout:0/728: fdatasync d0/dc/d11/fd1 0 2024-08-18T22:41:50.181 INFO:tasks.workunit.client.0.smithi121.stdout:0/911: symlink d1/d4/db/d24/l13e 0 2024-08-18T22:41:50.182 INFO:tasks.workunit.client.1.smithi195.stdout:0/729: symlink d0/dc/d64/d81/d44/d41/leb 0 2024-08-18T22:41:50.183 INFO:tasks.workunit.client.1.smithi195.stdout:0/730: write d0/dc/d64/d81/d44/d41/d6d/d92/d66/d8d/f9a [874221,71077] 0 2024-08-18T22:41:50.184 INFO:tasks.workunit.client.0.smithi121.stdout:0/912: truncate d1/d4/db/d18/fbe 183825 0 2024-08-18T22:41:50.187 INFO:tasks.workunit.client.0.smithi121.stdout:0/913: truncate d1/d4/db/d24/d30/fc0 3201088 0 2024-08-18T22:41:50.190 INFO:tasks.workunit.client.0.smithi121.stdout:0/914: symlink d1/d4/db/d24/df/d8/d78/d7c/df5/daf/dd5/l13f 0 2024-08-18T22:41:50.191 INFO:tasks.workunit.client.0.smithi121.stdout:0/915: write d1/d4/db/d24/df/d8/d78/f7a [1301498,61803] 0 2024-08-18T22:41:50.192 INFO:tasks.workunit.client.0.smithi121.stdout:0/916: stat d1/d8a/d120 0 2024-08-18T22:41:50.193 INFO:tasks.workunit.client.1.smithi195.stdout:0/731: dwrite d0/dc/d64/d81/d44/d41/d6d/d92/f68 [0,4194304] 0 2024-08-18T22:41:50.198 INFO:tasks.workunit.client.1.smithi195.stdout:0/732: truncate d0/dc/dd/f58 3888512 0 2024-08-18T22:41:50.200 INFO:tasks.workunit.client.0.smithi121.stdout:0/917: dwrite d1/d4/db/f1a [0,4194304] 0 2024-08-18T22:41:50.201 INFO:tasks.workunit.client.0.smithi121.stdout:0/918: stat d1/d4/db/d24/d30/fc0 0 2024-08-18T22:41:50.205 INFO:tasks.workunit.client.1.smithi195.stdout:0/733: dwrite d0/dc/d11/fdf [0,4194304] 0 2024-08-18T22:41:50.207 INFO:tasks.workunit.client.0.smithi121.stdout:0/919: rename d1/d4/db/d24/df/d8/d78/d7c/df5/daf/dd5/d5b/da5 to d1/d4/db/d24/d30/d140 0 2024-08-18T22:41:50.210 INFO:tasks.workunit.client.0.smithi121.stdout:0/920: creat d1/d4/db/d24/df/d8/d78/d7c/df5/daf/df8/f141 x:0 0 0 2024-08-18T22:41:50.214 INFO:tasks.workunit.client.0.smithi121.stdout:0/921: unlink d1/d4/db/d24/df/d8/d78/d7c/df5/daf/dd5/f46 0 2024-08-18T22:41:50.215 INFO:tasks.workunit.client.0.smithi121.stdout:0/922: chown d1/d4/db/d18/d1c/caa 7 1 2024-08-18T22:41:50.216 INFO:tasks.workunit.client.1.smithi195.stdout:0/734: truncate d0/dc/d25/f54 113639 0 2024-08-18T22:41:50.217 INFO:tasks.workunit.client.0.smithi121.stdout:0/923: creat d1/d4/db/d24/df/d8/d78/d7c/df5/daf/df8/f142 x:0 0 0 2024-08-18T22:41:50.220 INFO:tasks.workunit.client.0.smithi121.stdout:0/924: mknod d1/d4/db/d24/df/d8/d78/d7c/df5/daf/df8/c143 0 2024-08-18T22:41:50.222 INFO:tasks.workunit.client.1.smithi195.stdout:0/735: dwrite d0/dc/d64/d81/d44/d41/d6d/f76 [0,4194304] 0 2024-08-18T22:41:50.223 INFO:tasks.workunit.client.0.smithi121.stdout:0/925: truncate d1/d4/db/d24/df/d8/d78/d7c/dba/fe4 11382 0 2024-08-18T22:41:50.225 INFO:tasks.workunit.client.1.smithi195.stdout:0/736: mknod d0/dc/d11/d23/de9/cec 0 2024-08-18T22:41:50.227 INFO:tasks.workunit.client.1.smithi195.stdout:0/737: write d0/dc/d64/d81/d44/d41/d6d/da5/fcc [3375883,98696] 0 2024-08-18T22:41:50.230 INFO:tasks.workunit.client.1.smithi195.stdout:0/738: creat d0/dc/d11/d23/de9/fed x:0 0 0 2024-08-18T22:41:50.232 INFO:tasks.workunit.client.1.smithi195.stdout:0/739: mknod d0/dc/d11/d23/cee 0 2024-08-18T22:41:50.233 INFO:tasks.workunit.client.0.smithi121.stdout:0/926: truncate d1/d4/db/d18/d1c/d5f/fa2 4014333 0 2024-08-18T22:41:50.235 INFO:tasks.workunit.client.1.smithi195.stdout:0/740: symlink d0/dc/d11/d23/d51/dad/lef 0 2024-08-18T22:41:50.236 INFO:tasks.workunit.client.0.smithi121.stdout:0/927: creat d1/d4/db/d24/d30/d6c/f144 x:0 0 0 2024-08-18T22:41:50.236 INFO:tasks.workunit.client.0.smithi121.stdout:0/928: readlink d1/d4/da/l1d 0 2024-08-18T22:41:50.238 INFO:tasks.workunit.client.1.smithi195.stdout:0/741: symlink d0/dc/d64/d81/d44/d41/d6d/d92/d66/de0/lf0 0 2024-08-18T22:41:50.238 INFO:tasks.workunit.client.0.smithi121.stdout:0/929: mknod d1/d4/db/d24/df/d8/d78/d7c/df5/daf/dd5/c145 0 2024-08-18T22:41:50.239 INFO:tasks.workunit.client.0.smithi121.stdout:0/930: fdatasync d1/d4/da/d2f/f5e 0 2024-08-18T22:41:50.240 INFO:tasks.workunit.client.0.smithi121.stdout:0/931: stat d1/d4/c1e 0 2024-08-18T22:41:50.240 INFO:tasks.workunit.client.0.smithi121.stdout:0/932: fsync d1/d4/f10d 0 2024-08-18T22:41:50.248 INFO:tasks.workunit.client.0.smithi121.stdout:0/933: truncate d1/d4/db/d18/d1c/d5f/fa2 1071693 0 2024-08-18T22:41:50.261 INFO:tasks.workunit.client.0.smithi121.stdout:0/934: dread d1/d4/d53/da7/f34 [0,4194304] 0 2024-08-18T22:41:50.261 INFO:tasks.workunit.client.0.smithi121.stdout:0/935: chown d1/f67 183752 1 2024-08-18T22:41:50.265 INFO:tasks.workunit.client.0.smithi121.stdout:0/936: rename d1/d4/db/d24/df/d8/dee/f10e to d1/d4/db/d24/d30/f146 0 2024-08-18T22:41:50.267 INFO:tasks.workunit.client.0.smithi121.stdout:5/997: sync 2024-08-18T22:41:50.269 INFO:tasks.workunit.client.0.smithi121.stdout:5/998: mknod d3/d5/dfa/c140 0 2024-08-18T22:41:50.270 INFO:tasks.workunit.client.0.smithi121.stdout:0/937: dwrite d1/d4/db/d24/df/d8/d78/d7c/df5/daf/dd5/f7e [0,4194304] 0 2024-08-18T22:41:50.271 INFO:tasks.workunit.client.0.smithi121.stdout:5/999: rmdir d3/d5/d13/d19/da3 39 2024-08-18T22:41:50.272 INFO:tasks.workunit.client.0.smithi121.stdout:0/938: readlink d1/d4/db/d24/df/d8/d78/d7c/df5/daf/df8/l138 0 2024-08-18T22:41:50.339 INFO:tasks.workunit.client.0.smithi121.stdout:0/939: link d1/d4/db/d24/df/d8/d78/d7c/df5/daf/dcb/ce6 d1/d4/db/d24/df/d8/d78/d7c/df5/daf/dd5/d90/c147 0 2024-08-18T22:41:50.339 INFO:tasks.workunit.client.0.smithi121.stdout:2/709: sync 2024-08-18T22:41:50.342 INFO:tasks.workunit.client.0.smithi121.stdout:2/710: creat d2/d8/d19/d4a/fea x:0 0 0 2024-08-18T22:41:50.343 INFO:tasks.workunit.client.0.smithi121.stdout:0/940: symlink d1/d4/db/d24/df/d8/d78/d7c/df5/daf/dd5/d5b/l148 0 2024-08-18T22:41:50.347 INFO:tasks.workunit.client.0.smithi121.stdout:0/941: creat d1/d4/db/d18/d1c/f149 x:0 0 0 2024-08-18T22:41:50.350 INFO:tasks.workunit.client.0.smithi121.stdout:2/711: creat d2/d8/feb x:0 0 0 2024-08-18T22:41:50.352 INFO:tasks.workunit.client.0.smithi121.stdout:0/942: fdatasync d1/d4/db/d18/d1c/d5f/f9a 0 2024-08-18T22:41:50.360 INFO:tasks.workunit.client.0.smithi121.stdout:0/943: truncate d1/d4/db/d24/d30/fc0 2202553 0 2024-08-18T22:41:50.362 INFO:tasks.workunit.client.0.smithi121.stdout:0/944: fdatasync d1/d4/da/d2f/da0/f3d 0 2024-08-18T22:41:50.365 INFO:tasks.workunit.client.0.smithi121.stdout:0/945: truncate d1/d4/db/d24/f2b 2193973 0 2024-08-18T22:41:50.366 INFO:tasks.workunit.client.0.smithi121.stdout:0/946: write d1/d4/da/f28 [1999046,48928] 0 2024-08-18T22:41:50.371 INFO:tasks.workunit.client.0.smithi121.stdout:0/947: fsync d1/d4/db/d24/df/d8/d78/d7c/df5/daf/dd5/fb5 0 2024-08-18T22:41:50.407 INFO:tasks.workunit.client.1.smithi195.stdout:5/608: sync 2024-08-18T22:41:50.407 INFO:tasks.workunit.client.1.smithi195.stdout:4/596: sync 2024-08-18T22:41:50.407 INFO:tasks.workunit.client.1.smithi195.stdout:9/665: sync 2024-08-18T22:41:50.407 INFO:tasks.workunit.client.1.smithi195.stdout:1/743: sync 2024-08-18T22:41:50.408 INFO:tasks.workunit.client.0.smithi121.stdout:2/712: dwrite d2/d8/d19/d4a/d64/f79 [4194304,4194304] 0 2024-08-18T22:41:50.409 INFO:tasks.workunit.client.1.smithi195.stdout:5/609: write d0/d3/df/d1a/fab [113845,83774] 0 2024-08-18T22:41:50.410 INFO:tasks.workunit.client.0.smithi121.stdout:2/713: mkdir d2/d3/d53/dec 0 2024-08-18T22:41:50.412 INFO:tasks.workunit.client.1.smithi195.stdout:4/597: truncate d0/d7/d1d/d69/db7/d3b/fcf 1765116 0 2024-08-18T22:41:50.412 INFO:tasks.workunit.client.1.smithi195.stdout:1/744: mknod da/d4c/d7a/dbd/ddb/d4e/ddc/c103 0 2024-08-18T22:41:50.413 INFO:tasks.workunit.client.1.smithi195.stdout:9/666: dread d1c/d70/fc0 [4194304,4194304] 0 2024-08-18T22:41:50.414 INFO:tasks.workunit.client.1.smithi195.stdout:5/610: write d0/d2/d29/f47 [4554613,20928] 0 2024-08-18T22:41:50.414 INFO:tasks.workunit.client.0.smithi121.stdout:2/714: read d2/d8/d19/d55/f70 [1939176,99425] 0 2024-08-18T22:41:50.415 INFO:tasks.workunit.client.1.smithi195.stdout:4/598: creat d0/d7/d1d/d69/db7/d3b/d6f/fd6 x:0 0 0 2024-08-18T22:41:50.416 INFO:tasks.workunit.client.1.smithi195.stdout:9/667: write d1c/d70/fc0 [7052078,116654] 0 2024-08-18T22:41:50.417 INFO:tasks.workunit.client.1.smithi195.stdout:9/668: dread - d1c/d74/fc9 zero size 2024-08-18T22:41:50.417 INFO:tasks.workunit.client.1.smithi195.stdout:5/611: creat d0/d2/d29/d88/d90/fbf x:0 0 0 2024-08-18T22:41:50.417 INFO:tasks.workunit.client.0.smithi121.stdout:2/715: creat d2/dd8/ddc/fed x:0 0 0 2024-08-18T22:41:50.418 INFO:tasks.workunit.client.0.smithi121.stdout:2/716: chown d2/d3/d84/l96 59847568 1 2024-08-18T22:41:50.420 INFO:tasks.workunit.client.1.smithi195.stdout:5/612: creat d0/d3/df/d5a/fc0 x:0 0 0 2024-08-18T22:41:50.420 INFO:tasks.workunit.client.0.smithi121.stdout:2/717: mknod d2/d3/d53/dec/cee 0 2024-08-18T22:41:50.422 INFO:tasks.workunit.client.1.smithi195.stdout:4/599: creat d0/d99/d98/fd7 x:0 0 0 2024-08-18T22:41:50.424 INFO:tasks.workunit.client.1.smithi195.stdout:5/613: creat d0/d2/d29/db5/fc1 x:0 0 0 2024-08-18T22:41:50.427 INFO:tasks.workunit.client.0.smithi121.stdout:2/718: write d2/d3/d48/d77/fe3 [798977,42736] 0 2024-08-18T22:41:50.427 INFO:tasks.workunit.client.1.smithi195.stdout:4/600: link d0/d7/d1d/d69/db7/d41/d66/l77 d0/d99/d98/db6/dca/ld8 0 2024-08-18T22:41:50.428 INFO:tasks.workunit.client.0.smithi121.stdout:2/719: chown d2/d3/d53/dec 494995 1 2024-08-18T22:41:50.431 INFO:tasks.workunit.client.0.smithi121.stdout:2/720: dread d2/d8/d19/f9a [0,4194304] 0 2024-08-18T22:41:50.433 INFO:tasks.workunit.client.1.smithi195.stdout:4/601: rename d0/d7/d1d/d69/c6d to d0/d7/d1d/cd9 0 2024-08-18T22:41:50.433 INFO:tasks.workunit.client.1.smithi195.stdout:5/614: dread d0/d3/df/d1a/f3f [0,4194304] 0 2024-08-18T22:41:50.433 INFO:tasks.workunit.client.0.smithi121.stdout:2/721: symlink d2/d8/d19/d55/lef 0 2024-08-18T22:41:50.434 INFO:tasks.workunit.client.1.smithi195.stdout:4/602: read - d0/d7/d1d/d69/db7/d6c/f9b zero size 2024-08-18T22:41:50.435 INFO:tasks.workunit.client.0.smithi121.stdout:2/722: rename d2/d8/d19/d4a/d64/lb0 to d2/d8/d9e/lf0 0 2024-08-18T22:41:50.436 INFO:tasks.workunit.client.1.smithi195.stdout:5/615: creat d0/d2/d53/fc2 x:0 0 0 2024-08-18T22:41:50.436 INFO:tasks.workunit.client.1.smithi195.stdout:5/616: chown d0/d3/df/dbb 299 1 2024-08-18T22:41:50.437 INFO:tasks.workunit.client.0.smithi121.stdout:2/723: rename d2/d3/dd6/fe2 to d2/dd8/ff1 0 2024-08-18T22:41:50.438 INFO:tasks.workunit.client.1.smithi195.stdout:5/617: unlink d0/f1d 0 2024-08-18T22:41:50.438 INFO:tasks.workunit.client.0.smithi121.stdout:2/724: symlink d2/d3/d53/dec/lf2 0 2024-08-18T22:41:50.439 INFO:tasks.workunit.client.1.smithi195.stdout:4/603: rename d0/d7/d1d/c82 to d0/d99/d85/d48/d4c/cda 0 2024-08-18T22:41:50.440 INFO:tasks.workunit.client.1.smithi195.stdout:1/745: dread da/f13 [0,4194304] 0 2024-08-18T22:41:50.442 INFO:tasks.workunit.client.1.smithi195.stdout:9/669: write d1c/f27 [243792,23503] 0 2024-08-18T22:41:50.547 INFO:tasks.workunit.client.0.smithi121.stdout:2/725: rmdir d2/d3/d53 39 2024-08-18T22:41:50.549 INFO:tasks.workunit.client.0.smithi121.stdout:2/726: getdents d2/dd8 0 2024-08-18T22:41:50.550 INFO:tasks.workunit.client.0.smithi121.stdout:2/727: stat d2/d8/d19/dc/ld5 0 2024-08-18T22:41:50.551 INFO:tasks.workunit.client.0.smithi121.stdout:2/728: readlink d2/d8/d9e/lde 0 2024-08-18T22:41:50.552 INFO:tasks.workunit.client.0.smithi121.stdout:2/729: creat d2/d8/d9e/ff3 x:0 0 0 2024-08-18T22:41:50.556 INFO:tasks.workunit.client.0.smithi121.stdout:2/730: write d2/d8/fa3 [479517,61397] 0 2024-08-18T22:41:50.556 INFO:tasks.workunit.client.0.smithi121.stdout:2/731: readlink d2/d3/d48/d77/l43 0 2024-08-18T22:41:50.557 INFO:tasks.workunit.client.1.smithi195.stdout:4/604: dwrite d0/d99/d98/d16/f5e [0,4194304] 0 2024-08-18T22:41:50.557 INFO:tasks.workunit.client.1.smithi195.stdout:9/670: dwrite d1c/f1f [0,4194304] 0 2024-08-18T22:41:50.558 INFO:tasks.workunit.client.1.smithi195.stdout:1/746: dread da/d4c/d7a/dbd/ddb/d4e/f6b [0,4194304] 0 2024-08-18T22:41:50.558 INFO:tasks.workunit.client.0.smithi121.stdout:2/732: unlink d2/d8/d19/d55/c69 0 2024-08-18T22:41:50.559 INFO:tasks.workunit.client.0.smithi121.stdout:2/733: stat d2/d3/c30 0 2024-08-18T22:41:50.560 INFO:tasks.workunit.client.1.smithi195.stdout:4/605: chown d0/d7/d1d/cd9 14059 1 2024-08-18T22:41:50.561 INFO:tasks.workunit.client.1.smithi195.stdout:1/747: unlink da/d18/d43/f89 0 2024-08-18T22:41:50.563 INFO:tasks.workunit.client.1.smithi195.stdout:9/671: dread d1c/d74/d8e/faf [0,4194304] 0 2024-08-18T22:41:50.563 INFO:tasks.workunit.client.1.smithi195.stdout:1/748: write da/d18/d43/fff [97302,118020] 0 2024-08-18T22:41:50.564 INFO:tasks.workunit.client.1.smithi195.stdout:4/606: creat d0/d99/d85/d48/fdb x:0 0 0 2024-08-18T22:41:50.566 INFO:tasks.workunit.client.1.smithi195.stdout:1/749: mknod da/d4c/d5d/c104 0 2024-08-18T22:41:50.566 INFO:tasks.workunit.client.1.smithi195.stdout:9/672: mkdir d1c/dd5 0 2024-08-18T22:41:50.569 INFO:tasks.workunit.client.1.smithi195.stdout:1/750: truncate da/d4c/d7a/dbd/ddb/d4e/d95/fd4 293523 0 2024-08-18T22:41:50.571 INFO:tasks.workunit.client.0.smithi121.stdout:2/734: dwrite d2/d3/d48/fad [0,4194304] 0 2024-08-18T22:41:50.571 INFO:tasks.workunit.client.1.smithi195.stdout:9/673: rename d1c/d70/f76 to d1c/d74/d8e/dcc/fd6 0 2024-08-18T22:41:50.572 INFO:tasks.workunit.client.1.smithi195.stdout:9/674: chown d1c/d74/d7b 133957 1 2024-08-18T22:41:50.576 INFO:tasks.workunit.client.1.smithi195.stdout:9/675: mknod d1c/d32/d37/d4b/dc8/cd7 0 2024-08-18T22:41:50.579 INFO:tasks.workunit.client.1.smithi195.stdout:4/607: dread d0/d99/d98/d16/f1b [0,4194304] 0 2024-08-18T22:41:50.579 INFO:tasks.workunit.client.1.smithi195.stdout:4/608: chown d0/f8 194 1 2024-08-18T22:41:50.591 INFO:tasks.workunit.client.0.smithi121.stdout:2/735: write d2/dd8/ddc/fe8 [97198,66964] 0 2024-08-18T22:41:50.593 INFO:tasks.workunit.client.0.smithi121.stdout:2/736: rmdir d2/d3/d53 39 2024-08-18T22:41:50.594 INFO:tasks.workunit.client.0.smithi121.stdout:2/737: write d2/d3/d48/d77/f3b [6994508,97046] 0 2024-08-18T22:41:50.594 INFO:tasks.workunit.client.1.smithi195.stdout:1/751: rmdir da/d4c/d5d 39 2024-08-18T22:41:50.596 INFO:tasks.workunit.client.0.smithi121.stdout:2/738: creat d2/d3/d51/ff4 x:0 0 0 2024-08-18T22:41:50.597 INFO:tasks.workunit.client.1.smithi195.stdout:1/752: symlink da/d4c/d7a/dbd/ddb/d4e/d95/d9c/l105 0 2024-08-18T22:41:50.597 INFO:tasks.workunit.client.1.smithi195.stdout:1/753: readlink da/la2 0 2024-08-18T22:41:50.599 INFO:tasks.workunit.client.1.smithi195.stdout:1/754: write da/d18/d28/d31/fee [779193,129562] 0 2024-08-18T22:41:50.600 INFO:tasks.workunit.client.0.smithi121.stdout:2/739: getdents d2/d3/d51 0 2024-08-18T22:41:50.605 INFO:tasks.workunit.client.0.smithi121.stdout:2/740: dwrite d2/d8/feb [0,4194304] 0 2024-08-18T22:41:50.608 INFO:tasks.workunit.client.0.smithi121.stdout:2/741: read d2/f92 [67290,24061] 0 2024-08-18T22:41:50.608 INFO:tasks.workunit.client.0.smithi121.stdout:2/742: stat d2/d73 0 2024-08-18T22:41:50.609 INFO:tasks.workunit.client.0.smithi121.stdout:2/743: dread - d2/d8/d19/d4a/fea zero size 2024-08-18T22:41:50.609 INFO:tasks.workunit.client.1.smithi195.stdout:1/755: dread da/d18/d43/f44 [0,4194304] 0 2024-08-18T22:41:50.610 INFO:tasks.workunit.client.1.smithi195.stdout:1/756: chown da/d18/f42 40 1 2024-08-18T22:41:50.615 INFO:tasks.workunit.client.1.smithi195.stdout:4/609: dread d0/d99/d98/d16/d49/f45 [0,4194304] 0 2024-08-18T22:41:50.617 INFO:tasks.workunit.client.1.smithi195.stdout:4/610: fsync d0/d7/d1d/d69/db7/d3b/f88 0 2024-08-18T22:41:50.619 INFO:tasks.workunit.client.0.smithi121.stdout:2/744: dwrite d2/d3/d48/d77/f8c [0,4194304] 0 2024-08-18T22:41:50.620 INFO:tasks.workunit.client.1.smithi195.stdout:4/611: fsync d0/d99/d98/d16/f42 0 2024-08-18T22:41:50.622 INFO:tasks.workunit.client.0.smithi121.stdout:2/745: symlink d2/d8/lf5 0 2024-08-18T22:41:50.623 INFO:tasks.workunit.client.1.smithi195.stdout:1/757: dwrite da/f60 [0,4194304] 0 2024-08-18T22:41:50.623 INFO:tasks.workunit.client.0.smithi121.stdout:2/746: symlink d2/d3/d48/d77/lf6 0 2024-08-18T22:41:50.624 INFO:tasks.workunit.client.0.smithi121.stdout:2/747: truncate d2/d73/f94 4619219 0 2024-08-18T22:41:50.625 INFO:tasks.workunit.client.0.smithi121.stdout:2/748: write d2/d8/feb [2421006,89742] 0 2024-08-18T22:41:50.627 INFO:tasks.workunit.client.1.smithi195.stdout:1/758: mknod da/d18/d28/d7b/df2/db1/dd6/c106 0 2024-08-18T22:41:50.627 INFO:tasks.workunit.client.0.smithi121.stdout:2/749: mkdir d2/d8/d9e/de4/df7 0 2024-08-18T22:41:50.631 INFO:tasks.workunit.client.1.smithi195.stdout:4/612: getdents d0/d99/d85/d48/d4c 0 2024-08-18T22:41:50.633 INFO:tasks.workunit.client.1.smithi195.stdout:1/759: creat da/d18/d28/d7b/f107 x:0 0 0 2024-08-18T22:41:50.634 INFO:tasks.workunit.client.0.smithi121.stdout:2/750: dwrite d2/d8/d1f/f28 [0,4194304] 0 2024-08-18T22:41:50.634 INFO:tasks.workunit.client.1.smithi195.stdout:4/613: creat d0/d99/d85/dc8/fdc x:0 0 0 2024-08-18T22:41:50.636 INFO:tasks.workunit.client.1.smithi195.stdout:1/760: creat da/d4c/d7a/dbd/ddb/d4e/d95/d9c/dc8/f108 x:0 0 0 2024-08-18T22:41:50.636 INFO:tasks.workunit.client.0.smithi121.stdout:2/751: fdatasync d2/d8/fa0 0 2024-08-18T22:41:50.636 INFO:tasks.workunit.client.1.smithi195.stdout:4/614: symlink d0/d99/d98/db6/ldd 0 2024-08-18T22:41:50.637 INFO:tasks.workunit.client.0.smithi121.stdout:0/948: sync 2024-08-18T22:41:50.639 INFO:tasks.workunit.client.1.smithi195.stdout:1/761: write da/d4c/d5d/de8/d99/ff3 [630380,70365] 0 2024-08-18T22:41:50.640 INFO:tasks.workunit.client.0.smithi121.stdout:2/752: creat d2/d8/d19/d55/ff8 x:0 0 0 2024-08-18T22:41:50.641 INFO:tasks.workunit.client.1.smithi195.stdout:4/615: link d0/d7/d1d/d69/fc7 d0/d7/d1d/d69/db7/d41/dbf/fde 0 2024-08-18T22:41:50.642 INFO:tasks.workunit.client.0.smithi121.stdout:2/753: chown d2/d8/d19/c14 1093311389 1 2024-08-18T22:41:50.642 INFO:tasks.workunit.client.1.smithi195.stdout:1/762: write da/d18/d28/d31/d77/f81 [7306049,33580] 0 2024-08-18T22:41:50.643 INFO:tasks.workunit.client.0.smithi121.stdout:2/754: dread - d2/d3/d48/d77/fe1 zero size 2024-08-18T22:41:50.644 INFO:tasks.workunit.client.0.smithi121.stdout:2/755: creat d2/d73/ff9 x:0 0 0 2024-08-18T22:41:50.645 INFO:tasks.workunit.client.0.smithi121.stdout:2/756: read d2/d8/feb [770989,26731] 0 2024-08-18T22:41:50.645 INFO:tasks.workunit.client.1.smithi195.stdout:1/763: unlink da/d18/f38 0 2024-08-18T22:41:50.646 INFO:tasks.workunit.client.1.smithi195.stdout:4/616: mknod d0/d7/d1d/d69/db7/d3b/d6f/cdf 0 2024-08-18T22:41:50.647 INFO:tasks.workunit.client.1.smithi195.stdout:1/764: dread - da/d3d/de0/feb zero size 2024-08-18T22:41:50.648 INFO:tasks.workunit.client.1.smithi195.stdout:4/617: mknod d0/d99/d81/ce0 0 2024-08-18T22:41:50.648 INFO:tasks.workunit.client.0.smithi121.stdout:2/757: getdents d2/d8/d1f 0 2024-08-18T22:41:50.650 INFO:tasks.workunit.client.0.smithi121.stdout:2/758: fdatasync d2/d3/d84/faa 0 2024-08-18T22:41:50.650 INFO:tasks.workunit.client.1.smithi195.stdout:4/618: write d0/d7/d1d/d69/db7/f44 [4825975,94146] 0 2024-08-18T22:41:50.650 INFO:tasks.workunit.client.0.smithi121.stdout:2/759: readlink d2/d8/d9e/lde 0 2024-08-18T22:41:50.651 INFO:tasks.workunit.client.0.smithi121.stdout:2/760: dread - d2/d3/d48/d77/fe1 zero size 2024-08-18T22:41:50.652 INFO:tasks.workunit.client.1.smithi195.stdout:4/619: stat d0/d7/d1d/d69 0 2024-08-18T22:41:50.653 INFO:tasks.workunit.client.0.smithi121.stdout:2/761: write d2/f54 [1011510,81037] 0 2024-08-18T22:41:50.654 INFO:tasks.workunit.client.0.smithi121.stdout:2/762: rmdir d2/dd8 39 2024-08-18T22:41:50.654 INFO:tasks.workunit.client.1.smithi195.stdout:1/765: dwrite da/d3d/fb9 [4194304,4194304] 0 2024-08-18T22:41:50.655 INFO:tasks.workunit.client.0.smithi121.stdout:2/763: chown d2/d3/d48/f8e 664 1 2024-08-18T22:41:50.656 INFO:tasks.workunit.client.1.smithi195.stdout:1/766: read - da/d3d/de0/feb zero size 2024-08-18T22:41:50.656 INFO:tasks.workunit.client.0.smithi121.stdout:0/949: write d1/d4/db/d24/df/d8/d78/d7c/df5/daf/dd5/d5b/f7b [1751718,107199] 0 2024-08-18T22:41:50.660 INFO:tasks.workunit.client.0.smithi121.stdout:2/764: dread d2/d8/feb [0,4194304] 0 2024-08-18T22:41:50.660 INFO:tasks.workunit.client.0.smithi121.stdout:0/950: read d1/d4/db/d24/df/d8/d78/d7c/f113 [238607,37092] 0 2024-08-18T22:41:50.660 INFO:tasks.workunit.client.1.smithi195.stdout:1/767: rename da/d18/d28/d31/c85 to da/d4c/d5d/c109 0 2024-08-18T22:41:50.662 INFO:tasks.workunit.client.1.smithi195.stdout:1/768: creat da/d4c/d7a/dbd/f10a x:0 0 0 2024-08-18T22:41:50.663 INFO:tasks.workunit.client.1.smithi195.stdout:4/620: rmdir d0/d7/d1d/d69 39 2024-08-18T22:41:50.664 INFO:tasks.workunit.client.1.smithi195.stdout:1/769: fsync da/d18/d28/d31/d77/f81 0 2024-08-18T22:41:50.664 INFO:tasks.workunit.client.0.smithi121.stdout:0/951: mkdir d1/d4/db/d24/df/d8/d78/d7c/df5/d14a 0 2024-08-18T22:41:50.667 INFO:tasks.workunit.client.1.smithi195.stdout:1/770: symlink da/d18/d28/d31/l10b 0 2024-08-18T22:41:50.667 INFO:tasks.workunit.client.0.smithi121.stdout:0/952: link d1/d4/d53/da7/c133 d1/d4/db/d24/df/d8/d78/d7c/df5/daf/dd5/d90/c14b 0 2024-08-18T22:41:50.668 INFO:tasks.workunit.client.1.smithi195.stdout:4/621: creat d0/d7/d1d/d69/db7/d3b/d6f/db0/fe1 x:0 0 0 2024-08-18T22:41:50.668 INFO:tasks.workunit.client.1.smithi195.stdout:1/771: rmdir da/d4c/d5d 39 2024-08-18T22:41:50.669 INFO:tasks.workunit.client.0.smithi121.stdout:2/765: write d2/d8/d19/d4a/f4d [2575218,128825] 0 2024-08-18T22:41:50.670 INFO:tasks.workunit.client.0.smithi121.stdout:0/953: symlink d1/d4/db/d24/df/d8/d78/d7c/df5/d9d/l14c 0 2024-08-18T22:41:50.670 INFO:tasks.workunit.client.0.smithi121.stdout:2/766: dread d2/f92 [0,4194304] 0 2024-08-18T22:41:50.671 INFO:tasks.workunit.client.0.smithi121.stdout:2/767: readlink d2/d3/l44 0 2024-08-18T22:41:50.672 INFO:tasks.workunit.client.1.smithi195.stdout:1/772: creat da/d4c/d7a/dbd/ddb/d4e/d95/d9c/dc8/f10c x:0 0 0 2024-08-18T22:41:50.675 INFO:tasks.workunit.client.1.smithi195.stdout:1/773: symlink da/d18/d28/d31/d77/l10d 0 2024-08-18T22:41:50.677 INFO:tasks.workunit.client.1.smithi195.stdout:4/622: dread d0/d7/d1d/d69/db7/d3b/f88 [0,4194304] 0 2024-08-18T22:41:50.678 INFO:tasks.workunit.client.1.smithi195.stdout:4/623: write d0/d7/d1d/d69/db7/d41/d66/fa1 [911679,78154] 0 2024-08-18T22:41:50.683 INFO:tasks.workunit.client.1.smithi195.stdout:4/624: rename d0/d7/d1d/d69/db7/f44 to d0/d99/fe2 0 2024-08-18T22:41:50.683 INFO:tasks.workunit.client.0.smithi121.stdout:0/954: dwrite d1/d4/db/d18/fbe [0,4194304] 0 2024-08-18T22:41:50.683 INFO:tasks.workunit.client.0.smithi121.stdout:2/768: dwrite d2/d3/d53/f66 [0,4194304] 0 2024-08-18T22:41:50.683 INFO:tasks.workunit.client.1.smithi195.stdout:1/774: dread da/f15 [0,4194304] 0 2024-08-18T22:41:50.684 INFO:tasks.workunit.client.0.smithi121.stdout:2/769: chown d2/d8/d1f/l3d 380111 1 2024-08-18T22:41:50.684 INFO:tasks.workunit.client.1.smithi195.stdout:4/625: creat d0/d99/d98/d16/dae/fe3 x:0 0 0 2024-08-18T22:41:50.685 INFO:tasks.workunit.client.1.smithi195.stdout:1/775: rmdir da/d18/d28/d7b 39 2024-08-18T22:41:50.686 INFO:tasks.workunit.client.0.smithi121.stdout:2/770: truncate d2/d8/d1f/fcc 4780812 0 2024-08-18T22:41:50.686 INFO:tasks.workunit.client.1.smithi195.stdout:4/626: write d0/d7/d1d/d69/db7/d3b/f88 [2981361,104198] 0 2024-08-18T22:41:50.688 INFO:tasks.workunit.client.0.smithi121.stdout:0/955: rename d1/d4/db/d24/df/d8/d71/de3 to d1/d4/db/d24/df/d8/dee/d14d 0 2024-08-18T22:41:50.689 INFO:tasks.workunit.client.1.smithi195.stdout:4/627: mkdir d0/d99/d98/d16/d94/db2/de4 0 2024-08-18T22:41:50.689 INFO:tasks.workunit.client.1.smithi195.stdout:1/776: truncate da/d18/d28/d7b/df2/db1/fe4 231903 0 2024-08-18T22:41:50.690 INFO:tasks.workunit.client.0.smithi121.stdout:0/956: fdatasync d1/d4/db/d18/d40/f96 0 2024-08-18T22:41:50.690 INFO:tasks.workunit.client.1.smithi195.stdout:1/777: readlink da/d4c/l71 0 2024-08-18T22:41:50.693 INFO:tasks.workunit.client.0.smithi121.stdout:0/957: write d1/d4/db/d24/df/d8/d78/d7c/df5/daf/dd5/f7e [259524,57145] 0 2024-08-18T22:41:50.698 INFO:tasks.workunit.client.0.smithi121.stdout:0/958: mknod d1/d4/db/d24/df/d8/d78/d7c/df5/d9d/c14e 0 2024-08-18T22:41:50.698 INFO:tasks.workunit.client.0.smithi121.stdout:0/959: chown d1/d4/da 0 1 2024-08-18T22:41:50.699 INFO:tasks.workunit.client.1.smithi195.stdout:4/628: link d0/d7/d1d/d69/db7/d41/d66/fa1 d0/d99/d81/fe5 0 2024-08-18T22:41:50.699 INFO:tasks.workunit.client.1.smithi195.stdout:1/778: mkdir da/d18/d28/d7b/df2/db1/dd6/df5/d10e 0 2024-08-18T22:41:50.703 INFO:tasks.workunit.client.1.smithi195.stdout:1/779: dread da/d3d/f88 [0,4194304] 0 2024-08-18T22:41:50.703 INFO:tasks.workunit.client.1.smithi195.stdout:1/780: chown da/f24 60 1 2024-08-18T22:41:50.704 INFO:tasks.workunit.client.1.smithi195.stdout:1/781: fsync da/f53 0 2024-08-18T22:41:50.705 INFO:tasks.workunit.client.0.smithi121.stdout:0/960: read d1/d8a/fa9 [2779777,70453] 0 2024-08-18T22:41:50.706 INFO:tasks.workunit.client.0.smithi121.stdout:0/961: write d1/d47/f81 [1741295,30303] 0 2024-08-18T22:41:50.706 INFO:tasks.workunit.client.0.smithi121.stdout:2/771: write d2/d3/d48/f8e [1965007,108639] 0 2024-08-18T22:41:50.709 INFO:tasks.workunit.client.0.smithi121.stdout:0/962: mkdir d1/d4/db/d24/df/d8/d71/d79/d14f 0 2024-08-18T22:41:50.709 INFO:tasks.workunit.client.1.smithi195.stdout:4/629: dread d0/d99/d85/d48/d4c/f63 [0,4194304] 0 2024-08-18T22:41:50.710 INFO:tasks.workunit.client.0.smithi121.stdout:0/963: dread - d1/d4/db/d24/df/d8/d78/d7c/df5/daf/dd5/d90/dc3/f13d zero size 2024-08-18T22:41:50.711 INFO:tasks.workunit.client.1.smithi195.stdout:4/630: creat d0/d99/d98/d16/dae/fe6 x:0 0 0 2024-08-18T22:41:50.712 INFO:tasks.workunit.client.1.smithi195.stdout:1/782: write da/d3d/f7c [1713243,74453] 0 2024-08-18T22:41:50.713 INFO:tasks.workunit.client.0.smithi121.stdout:0/964: rename d1/d4/db/d18/l89 to d1/d4/db/d24/df/l150 0 2024-08-18T22:41:50.717 INFO:tasks.workunit.client.1.smithi195.stdout:4/631: dwrite d0/f8 [0,4194304] 0 2024-08-18T22:41:50.719 INFO:tasks.workunit.client.1.smithi195.stdout:4/632: creat d0/d7/d1d/d69/db7/d41/dbf/fe7 x:0 0 0 2024-08-18T22:41:50.721 INFO:tasks.workunit.client.1.smithi195.stdout:4/633: chown d0/d7/d1d/d69/db7/d41/la9 8827815 1 2024-08-18T22:41:50.723 INFO:tasks.workunit.client.1.smithi195.stdout:4/634: symlink d0/d99/le8 0 2024-08-18T22:41:50.724 INFO:tasks.workunit.client.1.smithi195.stdout:4/635: fsync d0/d99/d98/d16/d49/f46 0 2024-08-18T22:41:50.726 INFO:tasks.workunit.client.1.smithi195.stdout:4/636: fdatasync d0/d99/d98/fc0 0 2024-08-18T22:41:50.726 INFO:tasks.workunit.client.1.smithi195.stdout:4/637: chown d0/d99/d81 1 1 2024-08-18T22:41:50.728 INFO:tasks.workunit.client.1.smithi195.stdout:1/783: dread f6 [0,4194304] 0 2024-08-18T22:41:50.734 INFO:tasks.workunit.client.1.smithi195.stdout:1/784: rename da/d4c/d7a to da/d4c/d5d/dcb/d10f 0 2024-08-18T22:41:50.735 INFO:tasks.workunit.client.1.smithi195.stdout:1/785: mknod da/d4c/d5d/de8/d99/c110 0 2024-08-18T22:41:50.736 INFO:tasks.workunit.client.1.smithi195.stdout:1/786: fdatasync da/d4c/f69 0 2024-08-18T22:41:50.739 INFO:tasks.workunit.client.1.smithi195.stdout:1/787: truncate da/d18/d28/d31/f46 2986383 0 2024-08-18T22:41:50.740 INFO:tasks.workunit.client.1.smithi195.stdout:4/638: dread d0/d7/d1d/f3d [4194304,4194304] 0 2024-08-18T22:41:50.741 INFO:tasks.workunit.client.1.smithi195.stdout:1/788: fdatasync da/d4c/d5d/d63/fa6 0 2024-08-18T22:41:50.741 INFO:tasks.workunit.client.1.smithi195.stdout:4/639: dread - d0/d99/d98/d16/dae/fe3 zero size 2024-08-18T22:41:50.742 INFO:tasks.workunit.client.1.smithi195.stdout:1/789: chown da/d4c/d5d/c104 35 1 2024-08-18T22:41:50.743 INFO:tasks.workunit.client.1.smithi195.stdout:1/790: readlink da/d18/d28/d7b/df2/ld1 0 2024-08-18T22:41:50.743 INFO:tasks.workunit.client.1.smithi195.stdout:4/640: write d0/d99/d85/d48/f60 [1005665,65052] 0 2024-08-18T22:41:50.748 INFO:tasks.workunit.client.1.smithi195.stdout:4/641: unlink d0/d7/d1d/d69/db7/f79 0 2024-08-18T22:41:50.749 INFO:tasks.workunit.client.0.smithi121.stdout:0/965: dwrite d1/d4/db/d24/df/d8/d78/d7c/df5/daf/df8/f142 [0,4194304] 0 2024-08-18T22:41:50.750 INFO:tasks.workunit.client.0.smithi121.stdout:0/966: chown d1/d4/db/d24/df/d8/d78/d7c/df5/daf/df8 1176 1 2024-08-18T22:41:50.753 INFO:tasks.workunit.client.0.smithi121.stdout:0/967: creat d1/d4/db/d24/df/d8/d78/d7c/df5/daf/dd5/f151 x:0 0 0 2024-08-18T22:41:50.753 INFO:tasks.workunit.client.0.smithi121.stdout:0/968: fdatasync d1/d4/db/d18/d1c/f59 0 2024-08-18T22:41:50.757 INFO:tasks.workunit.client.0.smithi121.stdout:0/969: dread d1/d4/db/d24/d30/d6c/f51 [0,4194304] 0 2024-08-18T22:41:50.758 INFO:tasks.workunit.client.0.smithi121.stdout:0/970: fsync d1/d4/db/d24/df/d8/d78/d7c/f113 0 2024-08-18T22:41:50.762 INFO:tasks.workunit.client.0.smithi121.stdout:0/971: truncate d1/d4/db/d24/df/d8/d71/d79/f92 882719 0 2024-08-18T22:41:50.763 INFO:tasks.workunit.client.1.smithi195.stdout:1/791: dread da/d18/d28/f50 [0,4194304] 0 2024-08-18T22:41:50.763 INFO:tasks.workunit.client.0.smithi121.stdout:0/972: truncate d1/d8a/fa9 3977763 0 2024-08-18T22:41:50.763 INFO:tasks.workunit.client.1.smithi195.stdout:1/792: write da/f1d [5191801,120755] 0 2024-08-18T22:41:50.766 INFO:tasks.workunit.client.0.smithi121.stdout:0/973: creat d1/d4/db/d24/df/d8/d78/d7c/df5/d131/f152 x:0 0 0 2024-08-18T22:41:50.771 INFO:tasks.workunit.client.0.smithi121.stdout:0/974: write d1/d4/db/d24/fb3 [326407,21863] 0 2024-08-18T22:41:50.773 INFO:tasks.workunit.client.0.smithi121.stdout:0/975: unlink d1/d4/da/d2f/da0/l64 0 2024-08-18T22:41:50.778 INFO:tasks.workunit.client.0.smithi121.stdout:0/976: dwrite d1/d4/f1f [0,4194304] 0 2024-08-18T22:41:50.780 INFO:tasks.workunit.client.0.smithi121.stdout:0/977: readlink d1/d4/db/d24/df/d8/d78/d7c/df5/lf0 0 2024-08-18T22:41:50.782 INFO:tasks.workunit.client.0.smithi121.stdout:0/978: creat d1/f153 x:0 0 0 2024-08-18T22:41:50.784 INFO:tasks.workunit.client.0.smithi121.stdout:0/979: fsync d1/d4/db/d24/df/d8/d78/d7c/df5/daf/fb7 0 2024-08-18T22:41:50.791 INFO:tasks.workunit.client.0.smithi121.stdout:0/980: dwrite d1/d4/db/d24/df/d8/d78/d7c/df5/daf/dd5/d90/f108 [0,4194304] 0 2024-08-18T22:41:50.792 INFO:tasks.workunit.client.0.smithi121.stdout:0/981: write d1/d4/db/d18/f2d [2431414,104322] 0 2024-08-18T22:41:50.794 INFO:tasks.workunit.client.1.smithi195.stdout:8/733: sync 2024-08-18T22:41:50.795 INFO:tasks.workunit.client.1.smithi195.stdout:8/734: fdatasync d1/d3/db/d35/d4d/d95/daf/fdc 0 2024-08-18T22:41:50.797 INFO:tasks.workunit.client.0.smithi121.stdout:0/982: link d1/d4/d53/leb d1/d4/db/d24/df/d8/dee/d14d/l154 0 2024-08-18T22:41:50.799 INFO:tasks.workunit.client.0.smithi121.stdout:0/983: creat d1/d4/db/d18/d1c/d5f/f155 x:0 0 0 2024-08-18T22:41:50.800 INFO:tasks.workunit.client.0.smithi121.stdout:0/984: chown d1/d4/db/d24/d30/d140 693439993 1 2024-08-18T22:41:50.800 INFO:tasks.workunit.client.0.smithi121.stdout:0/985: fdatasync d1/d4/db/d24/df/d8/fb9 0 2024-08-18T22:41:50.802 INFO:tasks.workunit.client.0.smithi121.stdout:0/986: symlink d1/d4/db/d24/df/d8/d71/d79/d14f/l156 0 2024-08-18T22:41:50.809 INFO:tasks.workunit.client.0.smithi121.stdout:0/987: write d1/f8e [77456,74] 0 2024-08-18T22:41:50.812 INFO:tasks.workunit.client.0.smithi121.stdout:0/988: creat d1/d4/db/d24/df/d8/d78/d7c/df5/d9d/f157 x:0 0 0 2024-08-18T22:41:50.815 INFO:tasks.workunit.client.0.smithi121.stdout:0/989: write d1/f67 [3866228,90706] 0 2024-08-18T22:41:50.817 INFO:tasks.workunit.client.0.smithi121.stdout:0/990: unlink d1/d4/da/d2f/da0/f6d 0 2024-08-18T22:41:50.821 INFO:tasks.workunit.client.0.smithi121.stdout:0/991: dread d1/d4/f1f [0,4194304] 0 2024-08-18T22:41:50.825 INFO:tasks.workunit.client.1.smithi195.stdout:4/642: rmdir d0/d99/d98/d16/d54 39 2024-08-18T22:41:50.826 INFO:tasks.workunit.client.1.smithi195.stdout:4/643: chown d0/d99/d98/d16/dae/fe3 47 1 2024-08-18T22:41:50.827 INFO:tasks.workunit.client.1.smithi195.stdout:1/793: rename da/d18/d28/d31/f9a to da/d4c/f111 0 2024-08-18T22:41:50.828 INFO:tasks.workunit.client.0.smithi121.stdout:0/992: dwrite d1/d4/db/d24/df/d8/d78/d7c/df5/daf/df8/f141 [0,4194304] 0 2024-08-18T22:41:50.829 INFO:tasks.workunit.client.1.smithi195.stdout:4/644: rmdir d0/d99/d98 39 2024-08-18T22:41:50.832 INFO:tasks.workunit.client.1.smithi195.stdout:4/645: readlink d0/d7/d1d/l90 0 2024-08-18T22:41:50.833 INFO:tasks.workunit.client.0.smithi121.stdout:0/993: unlink d1/d4/db/d24/df/d8/d78/d7c/df5/daf/dcb/lf7 0 2024-08-18T22:41:50.836 INFO:tasks.workunit.client.1.smithi195.stdout:1/794: dread da/d18/d28/d31/f84 [0,4194304] 0 2024-08-18T22:41:50.838 INFO:tasks.workunit.client.1.smithi195.stdout:1/795: creat da/d18/d28/d7b/f112 x:0 0 0 2024-08-18T22:41:50.839 INFO:tasks.workunit.client.0.smithi121.stdout:0/994: truncate d1/d4/db/d24/df/d8/d78/d7c/df5/daf/dd5/fb5 1111215 0 2024-08-18T22:41:50.843 INFO:tasks.workunit.client.1.smithi195.stdout:1/796: dwrite da/d18/d28/d31/d77/f9f [0,4194304] 0 2024-08-18T22:41:50.845 INFO:tasks.workunit.client.1.smithi195.stdout:1/797: rmdir da/d4c/d5d/dcb/d10f/dbd/ddb/d4e 39 2024-08-18T22:41:50.848 INFO:tasks.workunit.client.1.smithi195.stdout:1/798: truncate da/d18/d28/d7b/df2/db1/fe4 1168546 0 2024-08-18T22:41:50.851 INFO:tasks.workunit.client.1.smithi195.stdout:1/799: rename f7 to da/d18/d28/d31/d77/f113 0 2024-08-18T22:41:50.854 INFO:tasks.workunit.client.1.smithi195.stdout:1/800: rename da/d18/d28/d31/fbf to da/d4c/dd5/f114 0 2024-08-18T22:41:50.854 INFO:tasks.workunit.client.1.smithi195.stdout:1/801: write da/f11 [9446289,160] 0 2024-08-18T22:41:50.855 INFO:tasks.workunit.client.0.smithi121.stdout:0/995: dwrite d1/d4/d53/f137 [0,4194304] 0 2024-08-18T22:41:50.858 INFO:tasks.workunit.client.1.smithi195.stdout:1/802: getdents da/d18/d43 0 2024-08-18T22:41:50.862 INFO:tasks.workunit.client.0.smithi121.stdout:2/772: sync 2024-08-18T22:41:50.863 INFO:tasks.workunit.client.0.smithi121.stdout:0/996: truncate d1/d4/db/d18/f2d 4044504 0 2024-08-18T22:41:50.863 INFO:tasks.workunit.client.1.smithi195.stdout:1/803: dread da/d4c/d5d/dcb/d10f/dbd/ddb/d4e/f67 [0,4194304] 0 2024-08-18T22:41:50.863 INFO:tasks.workunit.client.0.smithi121.stdout:2/773: read - d2/d8/d9e/ff3 zero size 2024-08-18T22:41:50.864 INFO:tasks.workunit.client.0.smithi121.stdout:0/997: stat d1/d4/db/d18/f58 0 2024-08-18T22:41:50.864 INFO:tasks.workunit.client.0.smithi121.stdout:2/774: readlink d2/d8/l7d 0 2024-08-18T22:41:50.866 INFO:tasks.workunit.client.0.smithi121.stdout:2/775: creat d2/d8/d1f/ffa x:0 0 0 2024-08-18T22:41:50.868 INFO:tasks.workunit.client.0.smithi121.stdout:0/998: creat d1/d4/db/d24/d30/f158 x:0 0 0 2024-08-18T22:41:50.869 INFO:tasks.workunit.client.0.smithi121.stdout:2/776: rename d2/d3/lcf to d2/d3/dd6/lfb 0 2024-08-18T22:41:50.869 INFO:tasks.workunit.client.0.smithi121.stdout:0/999: write d1/d4/db/f5a [1798746,71233] 0 2024-08-18T22:41:50.870 INFO:tasks.workunit.client.0.smithi121.stdout:2/777: chown d2/d8/d9e/fe7 77932 1 2024-08-18T22:41:50.871 INFO:tasks.workunit.client.0.smithi121.stdout:2/778: read - d2/d8/d19/d55/ff8 zero size 2024-08-18T22:41:50.873 INFO:tasks.workunit.client.0.smithi121.stdout:2/779: symlink d2/d8/d9e/de4/lfc 0 2024-08-18T22:41:50.874 INFO:tasks.workunit.client.0.smithi121.stdout:2/780: chown d2/d3/l44 24078 1 2024-08-18T22:41:50.875 INFO:tasks.workunit.client.0.smithi121.stdout:2/781: stat d2/d8/d19/f13 0 2024-08-18T22:41:50.876 INFO:tasks.workunit.client.0.smithi121.stdout:2/782: rmdir d2/d3/d51 39 2024-08-18T22:41:50.876 INFO:tasks.workunit.client.0.smithi121.stdout:2/783: chown d2/d3/d53/dec/lf2 0 1 2024-08-18T22:41:50.879 INFO:tasks.workunit.client.0.smithi121.stdout:2/784: unlink d2/d3/d48/d77/ld1 0 2024-08-18T22:41:50.882 INFO:tasks.workunit.client.0.smithi121.stdout:2/785: fsync d2/d8/d19/d55/f78 0 2024-08-18T22:41:50.886 INFO:tasks.workunit.client.1.smithi195.stdout:1/804: dread da/d18/d43/f5b [0,4194304] 0 2024-08-18T22:41:50.888 INFO:tasks.workunit.client.1.smithi195.stdout:1/805: symlink da/d18/d43/l115 0 2024-08-18T22:41:50.888 INFO:tasks.workunit.client.0.smithi121.stdout:2/786: getdents d2/d3/d53 0 2024-08-18T22:41:50.888 INFO:tasks.workunit.client.1.smithi195.stdout:1/806: write da/d18/d28/d7b/df2/fb0 [3180115,15227] 0 2024-08-18T22:41:50.889 INFO:tasks.workunit.client.0.smithi121.stdout:2/787: mknod d2/d3/dd6/cfd 0 2024-08-18T22:41:50.892 INFO:tasks.workunit.client.0.smithi121.stdout:2/788: creat d2/dd8/ffe x:0 0 0 2024-08-18T22:41:50.892 INFO:tasks.workunit.client.1.smithi195.stdout:1/807: dread da/d4c/d5d/dcb/d10f/dbd/ddb/d4e/d95/d9c/fbb [0,4194304] 0 2024-08-18T22:41:50.893 INFO:tasks.workunit.client.0.smithi121.stdout:2/789: creat d2/d8/d19/d4a/d64/fff x:0 0 0 2024-08-18T22:41:50.894 INFO:tasks.workunit.client.1.smithi195.stdout:1/808: creat da/d18/d28/f116 x:0 0 0 2024-08-18T22:41:50.895 INFO:tasks.workunit.client.0.smithi121.stdout:2/790: symlink d2/d8/d9e/de4/l100 0 2024-08-18T22:41:50.902 INFO:tasks.workunit.client.1.smithi195.stdout:1/809: dwrite da/f24 [0,4194304] 0 2024-08-18T22:41:50.902 INFO:tasks.workunit.client.0.smithi121.stdout:2/791: getdents d2/d8/d19/d4a/d64 0 2024-08-18T22:41:50.904 INFO:tasks.workunit.client.1.smithi195.stdout:1/810: rename da/d18/d28/d31/lae to da/d18/d28/l117 0 2024-08-18T22:41:50.905 INFO:tasks.workunit.client.1.smithi195.stdout:1/811: chown da/d4c/d5d/dcb/d10f/dbd/ddb/d4e/f6f 76 1 2024-08-18T22:41:50.906 INFO:tasks.workunit.client.0.smithi121.stdout:2/792: truncate d2/d8/d19/d4a/f4d 1766833 0 2024-08-18T22:41:50.914 INFO:tasks.workunit.client.1.smithi195.stdout:1/812: dwrite da/f15 [0,4194304] 0 2024-08-18T22:41:50.918 INFO:tasks.workunit.client.1.smithi195.stdout:1/813: creat da/d18/d28/d7b/f118 x:0 0 0 2024-08-18T22:41:50.921 INFO:tasks.workunit.client.1.smithi195.stdout:1/814: dread da/d18/d28/d31/d77/f113 [0,4194304] 0 2024-08-18T22:41:50.923 INFO:tasks.workunit.client.1.smithi195.stdout:1/815: mknod da/d4c/d5d/de8/d99/c119 0 2024-08-18T22:41:50.924 INFO:tasks.workunit.client.1.smithi195.stdout:1/816: creat da/d4c/d5d/dcb/d10f/dbd/ddb/d4e/d95/d9c/f11a x:0 0 0 2024-08-18T22:41:50.925 INFO:tasks.workunit.client.1.smithi195.stdout:1/817: fdatasync da/d18/d28/d7b/df2/fb0 0 2024-08-18T22:41:50.926 INFO:tasks.workunit.client.1.smithi195.stdout:1/818: stat da/d4c/d5d/cc0 0 2024-08-18T22:41:50.988 INFO:tasks.workunit.client.1.smithi195.stdout:7/773: sync 2024-08-18T22:41:51.017 INFO:tasks.workunit.client.1.smithi195.stdout:1/819: write da/d4c/d5d/dcb/fd0 [110556,46395] 0 2024-08-18T22:41:51.018 INFO:tasks.workunit.client.1.smithi195.stdout:1/820: chown da/d18/d28/d31/d77/f113 204 1 2024-08-18T22:41:51.022 INFO:tasks.workunit.client.1.smithi195.stdout:1/821: dread da/d18/d28/d7b/df2/fb0 [0,4194304] 0 2024-08-18T22:41:51.023 INFO:tasks.workunit.client.1.smithi195.stdout:1/822: chown da/d18/d28/d7b/f112 824 1 2024-08-18T22:41:51.025 INFO:tasks.workunit.client.1.smithi195.stdout:1/823: mkdir da/d4c/d5d/d63/d11b 0 2024-08-18T22:41:51.026 INFO:tasks.workunit.client.1.smithi195.stdout:1/824: stat da/d18/d43/l115 0 2024-08-18T22:41:51.028 INFO:tasks.workunit.client.1.smithi195.stdout:7/774: dwrite dc/d1d/d29/d5d/f8b [0,4194304] 0 2024-08-18T22:41:51.028 INFO:tasks.workunit.client.1.smithi195.stdout:1/825: symlink da/d18/d28/d7b/df2/l11c 0 2024-08-18T22:41:51.030 INFO:tasks.workunit.client.1.smithi195.stdout:1/826: write da/d18/d28/d31/d77/f81 [9851459,66414] 0 2024-08-18T22:41:51.031 INFO:tasks.workunit.client.1.smithi195.stdout:7/775: chown dc/d2a/d4c/cce 0 1 2024-08-18T22:41:51.034 INFO:tasks.workunit.client.1.smithi195.stdout:1/827: rename da/d18/d28/d7b/f118 to da/d4c/dd5/f11d 0 2024-08-18T22:41:51.034 INFO:tasks.workunit.client.1.smithi195.stdout:7/776: read dc/d1d/d29/ddb/f3b [3425677,119563] 0 2024-08-18T22:41:51.042 INFO:tasks.workunit.client.1.smithi195.stdout:1/828: dwrite da/d4c/d5d/dcb/d10f/dbd/ddb/f3a [4194304,4194304] 0 2024-08-18T22:41:51.047 INFO:tasks.workunit.client.1.smithi195.stdout:1/829: link da/d4c/d5d/dcb/d10f/dbd/ddb/c76 da/d18/d28/d7b/df2/c11e 0 2024-08-18T22:41:51.049 INFO:tasks.workunit.client.1.smithi195.stdout:1/830: mkdir da/d3d/d11f 0 2024-08-18T22:41:51.052 INFO:tasks.workunit.client.1.smithi195.stdout:1/831: mknod da/d18/d28/d7b/df2/db1/dd6/df5/c120 0 2024-08-18T22:41:51.055 INFO:tasks.workunit.client.1.smithi195.stdout:7/777: dwrite dc/d1d/d29/ddb/d10d/f76 [0,4194304] 0 2024-08-18T22:41:51.057 INFO:tasks.workunit.client.1.smithi195.stdout:7/778: mkdir dc/d8f/d96/d10e 0 2024-08-18T22:41:51.060 INFO:tasks.workunit.client.1.smithi195.stdout:1/832: dwrite da/d4c/d5d/dcb/d10f/dbd/ddb/d4e/d95/d9c/f11a [0,4194304] 0 2024-08-18T22:41:51.063 INFO:tasks.workunit.client.1.smithi195.stdout:1/833: mknod da/d3d/d11f/c121 0 2024-08-18T22:41:51.066 INFO:tasks.workunit.client.1.smithi195.stdout:1/834: truncate da/d4c/f66 1095983 0 2024-08-18T22:41:51.069 INFO:tasks.workunit.client.1.smithi195.stdout:1/835: rename da/d18/l25 to da/d4c/d5d/dcb/d10f/dbd/l122 0 2024-08-18T22:41:51.073 INFO:tasks.workunit.client.1.smithi195.stdout:1/836: link da/d4c/d5d/de8/d99/fa8 da/d18/f123 0 2024-08-18T22:41:51.076 INFO:tasks.workunit.client.1.smithi195.stdout:7/779: dread dc/f1e [0,4194304] 0 2024-08-18T22:41:51.077 INFO:tasks.workunit.client.1.smithi195.stdout:1/837: dread da/d18/f1a [4194304,4194304] 0 2024-08-18T22:41:51.079 INFO:tasks.workunit.client.1.smithi195.stdout:7/780: creat dc/d1d/d29/ddb/d10d/db6/dd0/dde/f10f x:0 0 0 2024-08-18T22:41:51.079 INFO:tasks.workunit.client.1.smithi195.stdout:1/838: creat da/d18/d28/dba/f124 x:0 0 0 2024-08-18T22:41:51.081 INFO:tasks.workunit.client.1.smithi195.stdout:7/781: creat dc/d1d/d29/ddb/d10d/db6/df7/f110 x:0 0 0 2024-08-18T22:41:51.082 INFO:tasks.workunit.client.1.smithi195.stdout:1/839: symlink da/d4c/d5d/l125 0 2024-08-18T22:41:51.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:41:50 smithi121 ceph-mon[16788]: pgmap v9: 65 pgs: 65 active+clean; 3.3 GiB data, 11 GiB used, 525 GiB / 536 GiB avail; 108 MiB/s rd, 296 MiB/s wr, 588 op/s 2024-08-18T22:41:51.083 INFO:tasks.workunit.client.1.smithi195.stdout:1/840: write da/d18/d28/d7b/df2/fb0 [2206445,82007] 0 2024-08-18T22:41:51.084 INFO:tasks.workunit.client.1.smithi195.stdout:7/782: unlink dc/d1d/d29/ddb/d10d/f5a 0 2024-08-18T22:41:51.086 INFO:tasks.workunit.client.0.smithi121.stdout:2/793: sync 2024-08-18T22:41:51.095 INFO:tasks.workunit.client.0.smithi121.stdout:2/794: dwrite d2/f6 [0,4194304] 0 2024-08-18T22:41:51.098 INFO:tasks.workunit.client.1.smithi195.stdout:7/783: dwrite dc/d1d/d29/ddb/d2b/d81/d9c/fd1 [4194304,4194304] 0 2024-08-18T22:41:51.100 INFO:tasks.workunit.client.1.smithi195.stdout:7/784: chown dc/d1d/d29/ddb/d10d/db6/dd0/ff4 855 1 2024-08-18T22:41:51.100 INFO:tasks.workunit.client.0.smithi121.stdout:2/795: unlink d2/d8/d19/d4a/c5f 0 2024-08-18T22:41:51.105 INFO:tasks.workunit.client.1.smithi195.stdout:1/841: dread da/d18/d28/d7b/df2/db1/fdf [0,4194304] 0 2024-08-18T22:41:51.106 INFO:tasks.workunit.client.1.smithi195.stdout:7/785: dwrite dc/d1d/d29/ddb/f68 [0,4194304] 0 2024-08-18T22:41:51.109 INFO:tasks.workunit.client.1.smithi195.stdout:1/842: mknod da/d18/c126 0 2024-08-18T22:41:51.112 INFO:tasks.workunit.client.1.smithi195.stdout:1/843: link da/la2 da/d4c/l127 0 2024-08-18T22:41:51.114 INFO:tasks.workunit.client.1.smithi195.stdout:1/844: creat da/d3d/de0/f128 x:0 0 0 2024-08-18T22:41:51.115 INFO:tasks.workunit.client.1.smithi195.stdout:1/845: readlink da/d18/l20 0 2024-08-18T22:41:51.118 INFO:tasks.workunit.client.1.smithi195.stdout:1/846: dread f6 [0,4194304] 0 2024-08-18T22:41:51.119 INFO:tasks.workunit.client.1.smithi195.stdout:1/847: chown da/d18 190822881 1 2024-08-18T22:41:51.121 INFO:tasks.workunit.client.1.smithi195.stdout:1/848: creat da/d18/d43/f129 x:0 0 0 2024-08-18T22:41:51.121 INFO:tasks.workunit.client.1.smithi195.stdout:7/786: dread dc/d1d/d29/d5d/f6e [0,4194304] 0 2024-08-18T22:41:51.122 INFO:tasks.workunit.client.1.smithi195.stdout:1/849: fsync da/d3d/fb9 0 2024-08-18T22:41:51.123 INFO:tasks.workunit.client.1.smithi195.stdout:1/850: dread - da/d3d/de0/f128 zero size 2024-08-18T22:41:51.124 INFO:tasks.workunit.client.1.smithi195.stdout:1/851: chown da/d4c/f9b 865988164 1 2024-08-18T22:41:51.125 INFO:tasks.workunit.client.1.smithi195.stdout:6/595: sync 2024-08-18T22:41:51.125 INFO:tasks.workunit.client.1.smithi195.stdout:2/471: sync 2024-08-18T22:41:51.125 INFO:tasks.workunit.client.1.smithi195.stdout:3/751: sync 2024-08-18T22:41:51.127 INFO:tasks.workunit.client.1.smithi195.stdout:6/596: readlink da/db/l35 0 2024-08-18T22:41:51.129 INFO:tasks.workunit.client.1.smithi195.stdout:1/852: creat da/d18/d28/f12a x:0 0 0 2024-08-18T22:41:51.130 INFO:tasks.workunit.client.1.smithi195.stdout:7/787: dwrite dc/d1d/d29/ddb/d15/d4d/d97/dfe/d18/f5f [0,4194304] 0 2024-08-18T22:41:51.132 INFO:tasks.workunit.client.1.smithi195.stdout:2/472: creat d1/d24/d26/d42/d72/d85/f91 x:0 0 0 2024-08-18T22:41:51.135 INFO:tasks.workunit.client.1.smithi195.stdout:6/597: mknod da/d15/d1c/d2e/cb0 0 2024-08-18T22:41:51.137 INFO:tasks.workunit.client.1.smithi195.stdout:7/788: mkdir dc/d1d/d29/ddb/d10d/db6/dd0/dde/d111 0 2024-08-18T22:41:51.137 INFO:tasks.workunit.client.1.smithi195.stdout:2/473: fdatasync d1/f10 0 2024-08-18T22:41:51.140 INFO:tasks.workunit.client.1.smithi195.stdout:7/789: rmdir dc/d1d/d29/ddb/d10d/db6/df7 39 2024-08-18T22:41:51.140 INFO:tasks.workunit.client.1.smithi195.stdout:6/598: dread da/d22/d86/f79 [0,4194304] 0 2024-08-18T22:41:51.141 INFO:tasks.workunit.client.1.smithi195.stdout:7/790: stat dc/f25 0 2024-08-18T22:41:51.141 INFO:tasks.workunit.client.1.smithi195.stdout:2/474: write d1/d24/d26/d42/d50/f77 [249941,23328] 0 2024-08-18T22:41:51.143 INFO:tasks.workunit.client.1.smithi195.stdout:6/599: symlink da/db/d26/d2d/da1/lb1 0 2024-08-18T22:41:51.144 INFO:tasks.workunit.client.1.smithi195.stdout:7/791: mkdir dc/d2a/d112 0 2024-08-18T22:41:51.145 INFO:tasks.workunit.client.1.smithi195.stdout:2/475: write d1/d24/d26/f2c [1006083,20037] 0 2024-08-18T22:41:51.145 INFO:tasks.workunit.client.1.smithi195.stdout:7/792: fdatasync dc/d2a/f7d 0 2024-08-18T22:41:51.147 INFO:tasks.workunit.client.1.smithi195.stdout:6/600: getdents da/db/d26/d2d/da1/dae 0 2024-08-18T22:41:51.148 INFO:tasks.workunit.client.1.smithi195.stdout:7/793: chown dc/d2a/d56/cfd 1270 1 2024-08-18T22:41:51.150 INFO:tasks.workunit.client.1.smithi195.stdout:6/601: mknod da/db/d26/cb2 0 2024-08-18T22:41:51.151 INFO:tasks.workunit.client.1.smithi195.stdout:2/476: rmdir d1/d8/d3d/d3b/d53/d5b 0 2024-08-18T22:41:51.152 INFO:tasks.workunit.client.1.smithi195.stdout:6/602: creat da/d3b/fb3 x:0 0 0 2024-08-18T22:41:51.153 INFO:tasks.workunit.client.1.smithi195.stdout:2/477: mknod d1/c92 0 2024-08-18T22:41:51.155 INFO:tasks.workunit.client.1.smithi195.stdout:7/794: dwrite dc/d2a/d4c/fc2 [0,4194304] 0 2024-08-18T22:41:51.157 INFO:tasks.workunit.client.1.smithi195.stdout:6/603: truncate da/db/d19/f23 633255 0 2024-08-18T22:41:51.158 INFO:tasks.workunit.client.1.smithi195.stdout:6/604: chown da/d15/d1c/d2e/f60 7639 1 2024-08-18T22:41:51.158 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:41:50 smithi195 ceph-mon[23370]: pgmap v9: 65 pgs: 65 active+clean; 3.3 GiB data, 11 GiB used, 525 GiB / 536 GiB avail; 108 MiB/s rd, 296 MiB/s wr, 588 op/s 2024-08-18T22:41:51.164 INFO:tasks.workunit.client.1.smithi195.stdout:6/605: dwrite da/db/d26/d2d/da1/da9/f9d [0,4194304] 0 2024-08-18T22:41:51.166 INFO:tasks.workunit.client.1.smithi195.stdout:3/752: truncate d7/f89 6211124 0 2024-08-18T22:41:51.167 INFO:tasks.workunit.client.1.smithi195.stdout:6/606: chown da/c6a 194 1 2024-08-18T22:41:51.198 INFO:tasks.workunit.client.1.smithi195.stdout:6/607: write f5 [1516643,108008] 0 2024-08-18T22:41:51.199 INFO:tasks.workunit.client.1.smithi195.stdout:2/478: truncate d1/d8/d3d/d3b/d46/f66 1772904 0 2024-08-18T22:41:51.201 INFO:tasks.workunit.client.1.smithi195.stdout:3/753: mkdir d7/da/df/d8e/daa/df9 0 2024-08-18T22:41:51.202 INFO:tasks.workunit.client.1.smithi195.stdout:1/853: dwrite da/d18/d28/d31/fc9 [0,4194304] 0 2024-08-18T22:41:51.203 INFO:tasks.workunit.client.1.smithi195.stdout:3/754: dread - d7/da/df/fba zero size 2024-08-18T22:41:51.206 INFO:tasks.workunit.client.1.smithi195.stdout:1/854: fdatasync da/f10 0 2024-08-18T22:41:51.207 INFO:tasks.workunit.client.1.smithi195.stdout:1/855: dread - da/d68/f94 zero size 2024-08-18T22:41:51.214 INFO:tasks.workunit.client.1.smithi195.stdout:3/755: dwrite d7/da/df/d1c/d6a/d6c/f6e [0,4194304] 0 2024-08-18T22:41:51.216 INFO:tasks.workunit.client.1.smithi195.stdout:1/856: dread da/d18/d28/d7b/df2/fb0 [0,4194304] 0 2024-08-18T22:41:51.220 INFO:tasks.workunit.client.1.smithi195.stdout:3/756: rename d7/f10 to d7/da/df/d1c/dc6/ffa 0 2024-08-18T22:41:51.220 INFO:tasks.workunit.client.1.smithi195.stdout:2/479: dread d1/d24/d26/f2b [0,4194304] 0 2024-08-18T22:41:51.222 INFO:tasks.workunit.client.1.smithi195.stdout:3/757: write d7/da/df/f27 [1381708,86332] 0 2024-08-18T22:41:51.223 INFO:tasks.workunit.client.1.smithi195.stdout:1/857: dwrite da/f10 [0,4194304] 0 2024-08-18T22:41:51.224 INFO:tasks.workunit.client.1.smithi195.stdout:2/480: symlink d1/d8/d3d/d3b/d46/l93 0 2024-08-18T22:41:51.224 INFO:tasks.workunit.client.1.smithi195.stdout:3/758: readlink d7/da/df/d38/l72 0 2024-08-18T22:41:51.228 INFO:tasks.workunit.client.0.smithi121.stdout:2/796: sync 2024-08-18T22:41:51.232 INFO:tasks.workunit.client.0.smithi121.stdout:2/797: getdents d2/d8 0 2024-08-18T22:41:51.232 INFO:tasks.workunit.client.1.smithi195.stdout:3/759: read d7/da/f48 [2400672,47451] 0 2024-08-18T22:41:51.232 INFO:tasks.workunit.client.0.smithi121.stdout:2/798: dread - d2/d73/ff9 zero size 2024-08-18T22:41:51.233 INFO:tasks.workunit.client.1.smithi195.stdout:3/760: write d7/da/df/f69 [2573811,5058] 0 2024-08-18T22:41:51.236 INFO:tasks.workunit.client.1.smithi195.stdout:3/761: symlink d7/da/df/dca/lfb 0 2024-08-18T22:41:51.237 INFO:tasks.workunit.client.1.smithi195.stdout:2/481: write d1/d24/f56 [2180531,34668] 0 2024-08-18T22:41:51.239 INFO:tasks.workunit.client.1.smithi195.stdout:6/608: dread da/d15/d1c/d2e/f3d [0,4194304] 0 2024-08-18T22:41:51.241 INFO:tasks.workunit.client.0.smithi121.stdout:2/799: link d2/d8/d19/d4a/d64/l97 d2/d8/d19/d4a/d64/l101 0 2024-08-18T22:41:51.259 INFO:tasks.workunit.client.0.smithi121.stdout:2/800: dwrite d2/d8/d19/d4a/d64/f79 [4194304,4194304] 0 2024-08-18T22:41:51.262 INFO:tasks.workunit.client.0.smithi121.stdout:2/801: dread - d2/d3/d84/faa zero size 2024-08-18T22:41:51.266 INFO:tasks.workunit.client.0.smithi121.stdout:2/802: rename d2/d3/d48/fd7 to d2/d8/d9e/de4/f102 0 2024-08-18T22:41:51.276 INFO:tasks.workunit.client.1.smithi195.stdout:6/609: write da/f8d [238500,90618] 0 2024-08-18T22:41:51.278 INFO:tasks.workunit.client.1.smithi195.stdout:6/610: fdatasync da/d15/f2c 0 2024-08-18T22:41:51.280 INFO:tasks.workunit.client.1.smithi195.stdout:1/858: dwrite da/d18/d28/f2e [0,4194304] 0 2024-08-18T22:41:51.281 INFO:tasks.workunit.client.0.smithi121.stdout:2/803: truncate d2/d3/d53/f66 3413307 0 2024-08-18T22:41:51.282 INFO:tasks.workunit.client.1.smithi195.stdout:9/676: sync 2024-08-18T22:41:51.282 INFO:tasks.workunit.client.1.smithi195.stdout:5/618: sync 2024-08-18T22:41:51.282 INFO:tasks.workunit.client.1.smithi195.stdout:8/735: sync 2024-08-18T22:41:51.282 INFO:tasks.workunit.client.1.smithi195.stdout:4/646: sync 2024-08-18T22:41:51.283 INFO:tasks.workunit.client.1.smithi195.stdout:0/742: sync 2024-08-18T22:41:51.284 INFO:tasks.workunit.client.0.smithi121.stdout:2/804: creat d2/d8/d19/d4a/d64/f103 x:0 0 0 2024-08-18T22:41:51.285 INFO:tasks.workunit.client.1.smithi195.stdout:9/677: truncate d1c/f6a 803708 0 2024-08-18T22:41:51.285 INFO:tasks.workunit.client.1.smithi195.stdout:0/743: chown d0/dc/dd/l36 4837 1 2024-08-18T22:41:51.287 INFO:tasks.workunit.client.0.smithi121.stdout:2/805: creat d2/d8/d19/f104 x:0 0 0 2024-08-18T22:41:51.289 INFO:tasks.workunit.client.0.smithi121.stdout:2/806: truncate d2/d3/d53/fce 508338 0 2024-08-18T22:41:51.289 INFO:tasks.workunit.client.1.smithi195.stdout:1/859: dread da/d4c/d5d/dcb/d10f/dbd/ddb/d4e/f6b [0,4194304] 0 2024-08-18T22:41:51.299 INFO:tasks.workunit.client.1.smithi195.stdout:9/678: symlink d1c/d74/d7b/ld8 0 2024-08-18T22:41:51.299 INFO:tasks.workunit.client.0.smithi121.stdout:2/807: write d2/d8/d19/d4a/d64/f90 [84025,129915] 0 2024-08-18T22:41:51.301 INFO:tasks.workunit.client.0.smithi121.stdout:2/808: dread - d2/d8/d19/d4a/d64/fff zero size 2024-08-18T22:41:51.301 INFO:tasks.workunit.client.1.smithi195.stdout:3/762: getdents d7/da/df/d1c 0 2024-08-18T22:41:51.302 INFO:tasks.workunit.client.1.smithi195.stdout:3/763: write d7/da/df/d95/f9d [728387,19773] 0 2024-08-18T22:41:51.303 INFO:tasks.workunit.client.0.smithi121.stdout:2/809: fdatasync d2/d8/f3f 0 2024-08-18T22:41:51.304 INFO:tasks.workunit.client.1.smithi195.stdout:2/482: getdents d1/d24/d26/d42/d72 0 2024-08-18T22:41:51.305 INFO:tasks.workunit.client.0.smithi121.stdout:2/810: fdatasync d2/d8/d19/f7b 0 2024-08-18T22:41:51.308 INFO:tasks.workunit.client.0.smithi121.stdout:2/811: getdents d2/d3 0 2024-08-18T22:41:51.308 INFO:tasks.workunit.client.0.smithi121.stdout:2/812: stat d2/d8/d19/f104 0 2024-08-18T22:41:51.310 INFO:tasks.workunit.client.0.smithi121.stdout:2/813: symlink d2/d3/d51/l105 0 2024-08-18T22:41:51.310 INFO:tasks.workunit.client.1.smithi195.stdout:5/619: rename d0/d3/d66/la3 to d0/d2/d29/d88/lc3 0 2024-08-18T22:41:51.310 INFO:tasks.workunit.client.1.smithi195.stdout:9/679: truncate d1c/f35 611937 0 2024-08-18T22:41:51.312 INFO:tasks.workunit.client.1.smithi195.stdout:5/620: write d0/d3/d8/fb9 [289951,14192] 0 2024-08-18T22:41:51.313 INFO:tasks.workunit.client.1.smithi195.stdout:5/621: chown d0/d3/d8/f56 82 1 2024-08-18T22:41:51.314 INFO:tasks.workunit.client.1.smithi195.stdout:6/611: rmdir da/db/d26/d2d/da1/da9/d77/daa 0 2024-08-18T22:41:51.315 INFO:tasks.workunit.client.1.smithi195.stdout:5/622: stat d0/d3/d8/d3b/cae 0 2024-08-18T22:41:51.316 INFO:tasks.workunit.client.1.smithi195.stdout:5/623: write d0/d2/d29/d88/d90/fbf [655232,80870] 0 2024-08-18T22:41:51.318 INFO:tasks.workunit.client.1.smithi195.stdout:1/860: creat da/d18/d28/d31/f12b x:0 0 0 2024-08-18T22:41:51.319 INFO:tasks.workunit.client.1.smithi195.stdout:2/483: mkdir d1/d24/d26/d83/d94 0 2024-08-18T22:41:51.320 INFO:tasks.workunit.client.1.smithi195.stdout:6/612: symlink da/d15/lb4 0 2024-08-18T22:41:51.321 INFO:tasks.workunit.client.1.smithi195.stdout:4/647: getdents d0/d7/d1d/d69/db4 0 2024-08-18T22:41:51.321 INFO:tasks.workunit.client.0.smithi121.stdout:2/814: dwrite d2/d8/d19/f9a [0,4194304] 0 2024-08-18T22:41:51.321 INFO:tasks.workunit.client.1.smithi195.stdout:9/680: dread d1c/f27 [0,4194304] 0 2024-08-18T22:41:51.323 INFO:tasks.workunit.client.0.smithi121.stdout:2/815: mkdir d2/d3/d84/d106 0 2024-08-18T22:41:51.326 INFO:tasks.workunit.client.0.smithi121.stdout:2/816: fsync d2/d8/d19/d55/f70 0 2024-08-18T22:41:51.327 INFO:tasks.workunit.client.1.smithi195.stdout:1/861: unlink da/c17 0 2024-08-18T22:41:51.327 INFO:tasks.workunit.client.0.smithi121.stdout:2/817: chown d2/d3/d48/d77/lc9 369 1 2024-08-18T22:41:51.328 INFO:tasks.workunit.client.1.smithi195.stdout:2/484: creat d1/d8/d3d/d3b/d7d/f95 x:0 0 0 2024-08-18T22:41:51.329 INFO:tasks.workunit.client.0.smithi121.stdout:2/818: creat d2/d8/f107 x:0 0 0 2024-08-18T22:41:51.330 INFO:tasks.workunit.client.0.smithi121.stdout:2/819: creat d2/d3/dd6/f108 x:0 0 0 2024-08-18T22:41:51.331 INFO:tasks.workunit.client.1.smithi195.stdout:4/648: readlink d0/d99/la3 0 2024-08-18T22:41:51.332 INFO:tasks.workunit.client.1.smithi195.stdout:9/681: symlink d1c/d92/d96/d9d/db9/ld9 0 2024-08-18T22:41:51.333 INFO:tasks.workunit.client.1.smithi195.stdout:3/764: getdents d7/da/df/d8e 0 2024-08-18T22:41:51.341 INFO:tasks.workunit.client.1.smithi195.stdout:3/765: write d7/da/f48 [4071940,94238] 0 2024-08-18T22:41:51.344 INFO:tasks.workunit.client.1.smithi195.stdout:6/613: creat da/db/d26/fb5 x:0 0 0 2024-08-18T22:41:51.346 INFO:tasks.workunit.client.1.smithi195.stdout:2/485: getdents d1/d8/d3d/d6c/d7c 0 2024-08-18T22:41:51.347 INFO:tasks.workunit.client.1.smithi195.stdout:6/614: creat da/d15/d1c/d64/fb6 x:0 0 0 2024-08-18T22:41:51.350 INFO:tasks.workunit.client.1.smithi195.stdout:2/486: fsync d1/d8/f2f 0 2024-08-18T22:41:51.351 INFO:tasks.workunit.client.1.smithi195.stdout:9/682: dwrite d1c/d32/d37/fa0 [0,4194304] 0 2024-08-18T22:41:51.351 INFO:tasks.workunit.client.1.smithi195.stdout:1/862: dread da/d18/d28/d31/f46 [0,4194304] 0 2024-08-18T22:41:51.355 INFO:tasks.workunit.client.1.smithi195.stdout:3/766: dwrite d7/d1f/f26 [0,4194304] 0 2024-08-18T22:41:51.357 INFO:tasks.workunit.client.1.smithi195.stdout:1/863: symlink da/d3d/l12c 0 2024-08-18T22:41:51.360 INFO:tasks.workunit.client.1.smithi195.stdout:9/683: unlink d1c/d32/d71/dbe/c8c 0 2024-08-18T22:41:51.362 INFO:tasks.workunit.client.1.smithi195.stdout:2/487: dwrite d1/d8/d3d/fc [4194304,4194304] 0 2024-08-18T22:41:51.365 INFO:tasks.workunit.client.1.smithi195.stdout:1/864: rename da/d18/d28/d7b/df2/l11c to da/d4c/l12d 0 2024-08-18T22:41:51.368 INFO:tasks.workunit.client.1.smithi195.stdout:3/767: rename d7/da/df/dca/lfb to d7/d54/d9a/lfc 0 2024-08-18T22:41:51.370 INFO:tasks.workunit.client.1.smithi195.stdout:1/865: unlink da/d18/fa3 0 2024-08-18T22:41:51.378 INFO:tasks.workunit.client.1.smithi195.stdout:0/744: dwrite d0/dc/dd/d46/fa9 [0,4194304] 0 2024-08-18T22:41:51.382 INFO:tasks.workunit.client.1.smithi195.stdout:3/768: dwrite d7/da/df/dd3/fed [0,4194304] 0 2024-08-18T22:41:51.387 INFO:tasks.workunit.client.1.smithi195.stdout:5/624: write d0/d3/df/f74 [759864,58081] 0 2024-08-18T22:41:51.389 INFO:tasks.workunit.client.1.smithi195.stdout:5/625: write d0/d2/d79/f8a [260115,2666] 0 2024-08-18T22:41:51.391 INFO:tasks.workunit.client.1.smithi195.stdout:3/769: dwrite d7/da/df/f3b [0,4194304] 0 2024-08-18T22:41:51.393 INFO:tasks.workunit.client.1.smithi195.stdout:3/770: write d7/da/df/d38/fa1 [308769,107357] 0 2024-08-18T22:41:51.400 INFO:tasks.workunit.client.1.smithi195.stdout:9/684: fsync d1c/d32/d37/fa0 0 2024-08-18T22:41:51.402 INFO:tasks.workunit.client.1.smithi195.stdout:4/649: dwrite d0/d99/d85/d48/d4c/f63 [0,4194304] 0 2024-08-18T22:41:51.405 INFO:tasks.workunit.client.1.smithi195.stdout:2/488: rename d1/d24/d47/l79 to d1/d24/d26/d42/l96 0 2024-08-18T22:41:51.409 INFO:tasks.workunit.client.1.smithi195.stdout:0/745: mknod d0/dc/d64/d81/d44/d41/d6d/da5/cf1 0 2024-08-18T22:41:51.413 INFO:tasks.workunit.client.1.smithi195.stdout:4/650: dwrite d0/d7/d1d/d69/f7f [0,4194304] 0 2024-08-18T22:41:51.415 INFO:tasks.workunit.client.1.smithi195.stdout:3/771: creat d7/da/df/d95/ffd x:0 0 0 2024-08-18T22:41:51.419 INFO:tasks.workunit.client.1.smithi195.stdout:4/651: write d0/d7/d1d/d69/f8f [804894,43376] 0 2024-08-18T22:41:51.419 INFO:tasks.workunit.client.1.smithi195.stdout:6/615: dwrite da/db/d19/f23 [0,4194304] 0 2024-08-18T22:41:51.421 INFO:tasks.workunit.client.1.smithi195.stdout:1/866: rmdir da 39 2024-08-18T22:41:51.422 INFO:tasks.workunit.client.1.smithi195.stdout:4/652: dread - d0/d99/d85/d48/fdb zero size 2024-08-18T22:41:51.425 INFO:tasks.workunit.client.1.smithi195.stdout:7/795: sync 2024-08-18T22:41:51.426 INFO:tasks.workunit.client.1.smithi195.stdout:7/796: write dc/d22/f3e [8708608,78721] 0 2024-08-18T22:41:51.429 INFO:tasks.workunit.client.1.smithi195.stdout:4/653: chown d0/d99/d98/d16/f42 6 1 2024-08-18T22:41:51.431 INFO:tasks.workunit.client.1.smithi195.stdout:5/626: getdents d0/d2/d29 0 2024-08-18T22:41:51.433 INFO:tasks.workunit.client.1.smithi195.stdout:3/772: rename d7/da/d75/ca3 to d7/da/df/dd3/cfe 0 2024-08-18T22:41:51.434 INFO:tasks.workunit.client.1.smithi195.stdout:6/616: mkdir da/db/db7 0 2024-08-18T22:41:51.438 INFO:tasks.workunit.client.1.smithi195.stdout:7/797: getdents dc/d8f/d96/dc5/de7 0 2024-08-18T22:41:51.438 INFO:tasks.workunit.client.1.smithi195.stdout:6/617: readlink da/d15/d1c/d2e/l39 0 2024-08-18T22:41:51.439 INFO:tasks.workunit.client.1.smithi195.stdout:1/867: dwrite da/d18/d28/dba/f124 [0,4194304] 0 2024-08-18T22:41:51.443 INFO:tasks.workunit.client.1.smithi195.stdout:4/654: dread d0/d7/d1d/d69/f7f [0,4194304] 0 2024-08-18T22:41:51.443 INFO:tasks.workunit.client.1.smithi195.stdout:5/627: dwrite d0/d2/d79/f8a [0,4194304] 0 2024-08-18T22:41:51.445 INFO:tasks.workunit.client.1.smithi195.stdout:6/618: unlink da/db/cc 0 2024-08-18T22:41:51.451 INFO:tasks.workunit.client.1.smithi195.stdout:9/685: write d1c/f35 [262663,43690] 0 2024-08-18T22:41:51.451 INFO:tasks.workunit.client.1.smithi195.stdout:2/489: truncate d1/d24/d26/f36 7976793 0 2024-08-18T22:41:51.451 INFO:tasks.workunit.client.1.smithi195.stdout:3/773: dwrite d7/d1f/f34 [0,4194304] 0 2024-08-18T22:41:51.453 INFO:tasks.workunit.client.1.smithi195.stdout:4/655: creat d0/d7/d1d/d69/db7/d41/fe9 x:0 0 0 2024-08-18T22:41:51.463 INFO:tasks.workunit.client.1.smithi195.stdout:7/798: write dc/d1d/d29/ddb/d2b/f3a [569125,101369] 0 2024-08-18T22:41:51.463 INFO:tasks.workunit.client.1.smithi195.stdout:9/686: symlink d1c/d32/d71/dbe/d98/lda 0 2024-08-18T22:41:51.463 INFO:tasks.workunit.client.1.smithi195.stdout:6/619: dwrite da/d15/f2c [0,4194304] 0 2024-08-18T22:41:51.463 INFO:tasks.workunit.client.1.smithi195.stdout:9/687: chown d1c/d32/f84 2 1 2024-08-18T22:41:51.464 INFO:tasks.workunit.client.1.smithi195.stdout:2/490: mkdir d1/d97 0 2024-08-18T22:41:51.467 INFO:tasks.workunit.client.1.smithi195.stdout:1/868: rename da/d18/d28/d7b/df2/db1/dda/le9 to da/d3d/l12e 0 2024-08-18T22:41:51.468 INFO:tasks.workunit.client.1.smithi195.stdout:1/869: dread da/d18/d28/d31/f84 [0,4194304] 0 2024-08-18T22:41:51.469 INFO:tasks.workunit.client.1.smithi195.stdout:3/774: getdents d7/da/df/d1c/d6a/df1 0 2024-08-18T22:41:51.469 INFO:tasks.workunit.client.1.smithi195.stdout:9/688: creat d1c/d92/fdb x:0 0 0 2024-08-18T22:41:51.470 INFO:tasks.workunit.client.0.smithi121.stdout:2/820: sync 2024-08-18T22:41:51.471 INFO:tasks.workunit.client.1.smithi195.stdout:3/775: chown d7/d1f/d73/db0/fcb 1277969 1 2024-08-18T22:41:51.471 INFO:tasks.workunit.client.1.smithi195.stdout:5/628: link d0/d3/df/d1a/f3f d0/d2/d29/d88/d6a/d96/fc4 0 2024-08-18T22:41:51.472 INFO:tasks.workunit.client.1.smithi195.stdout:6/620: rename da/db/d26/d2d/da1/dae to da/d15/d1c/d2e/d74/db8 0 2024-08-18T22:41:51.472 INFO:tasks.workunit.client.1.smithi195.stdout:3/776: fsync d7/da/df/d1c/fe4 0 2024-08-18T22:41:51.473 INFO:tasks.workunit.client.1.smithi195.stdout:9/689: truncate d1c/d92/d96/d9d/db9/fbd 485365 0 2024-08-18T22:41:51.475 INFO:tasks.workunit.client.1.smithi195.stdout:7/799: truncate dc/d22/f7e 1361020 0 2024-08-18T22:41:51.478 INFO:tasks.workunit.client.1.smithi195.stdout:6/621: dread da/d3b/f49 [0,4194304] 0 2024-08-18T22:41:51.479 INFO:tasks.workunit.client.1.smithi195.stdout:5/629: mkdir d0/d2/d29/dc5 0 2024-08-18T22:41:51.480 INFO:tasks.workunit.client.1.smithi195.stdout:3/777: mknod d7/d1f/d73/dae/cff 0 2024-08-18T22:41:51.481 INFO:tasks.workunit.client.1.smithi195.stdout:4/656: write d0/d7/d1d/d69/db7/d41/d66/fa1 [175689,130814] 0 2024-08-18T22:41:51.482 INFO:tasks.workunit.client.1.smithi195.stdout:3/778: fsync d7/da/df/d1c/fe4 0 2024-08-18T22:41:51.482 INFO:tasks.workunit.client.0.smithi121.stdout:2/821: symlink d2/d8/d19/d55/l109 0 2024-08-18T22:41:51.483 INFO:tasks.workunit.client.1.smithi195.stdout:9/690: rename d1c/f21 to d1c/d32/d71/dbe/d98/fdc 0 2024-08-18T22:41:51.484 INFO:tasks.workunit.client.0.smithi121.stdout:2/822: creat d2/d3/f10a x:0 0 0 2024-08-18T22:41:51.486 INFO:tasks.workunit.client.0.smithi121.stdout:2/823: creat d2/d8/d19/d4a/d64/f10b x:0 0 0 2024-08-18T22:41:51.487 INFO:tasks.workunit.client.1.smithi195.stdout:4/657: symlink d0/d7/d1d/d69/db7/d6c/lea 0 2024-08-18T22:41:51.488 INFO:tasks.workunit.client.0.smithi121.stdout:2/824: creat d2/d8/d19/d4a/d64/f10c x:0 0 0 2024-08-18T22:41:51.489 INFO:tasks.workunit.client.1.smithi195.stdout:1/870: rmdir da/d4c/d5d/d63/d11b 0 2024-08-18T22:41:51.490 INFO:tasks.workunit.client.0.smithi121.stdout:2/825: unlink d2/d8/d19/d4a/la1 0 2024-08-18T22:41:51.491 INFO:tasks.workunit.client.1.smithi195.stdout:6/622: link da/db/d26/f95 da/db/d2a/fb9 0 2024-08-18T22:41:51.492 INFO:tasks.workunit.client.0.smithi121.stdout:2/826: creat d2/d8/d19/d4a/f10d x:0 0 0 2024-08-18T22:41:51.493 INFO:tasks.workunit.client.1.smithi195.stdout:5/630: dread d0/d3/d8/d64/f70 [0,4194304] 0 2024-08-18T22:41:51.493 INFO:tasks.workunit.client.1.smithi195.stdout:4/658: truncate d0/d7/d1d/d69/db7/d3b/f64 1159688 0 2024-08-18T22:41:51.494 INFO:tasks.workunit.client.0.smithi121.stdout:2/827: unlink d2/d8/d19/d55/f78 0 2024-08-18T22:41:51.494 INFO:tasks.workunit.client.1.smithi195.stdout:1/871: mknod da/d4c/d5d/d63/c12f 0 2024-08-18T22:41:51.496 INFO:tasks.workunit.client.1.smithi195.stdout:7/800: rename f1 to dc/d1d/d29/ddb/f113 0 2024-08-18T22:41:51.497 INFO:tasks.workunit.client.1.smithi195.stdout:3/779: dwrite d7/da/df/d1c/d6a/f76 [0,4194304] 0 2024-08-18T22:41:51.498 INFO:tasks.workunit.client.1.smithi195.stdout:6/623: mknod da/d15/d1c/d64/cba 0 2024-08-18T22:41:51.498 INFO:tasks.workunit.client.1.smithi195.stdout:1/872: chown da/d4c/d5d/dcb/lcc 501188 1 2024-08-18T22:41:51.499 INFO:tasks.workunit.client.1.smithi195.stdout:7/801: dread - dc/d1d/d29/ddb/f10a zero size 2024-08-18T22:41:51.500 INFO:tasks.workunit.client.1.smithi195.stdout:5/631: truncate d0/d3/d8/d64/fb6 1568275 0 2024-08-18T22:41:51.501 INFO:tasks.workunit.client.0.smithi121.stdout:2/828: mkdir d2/d3/d53/d10e 0 2024-08-18T22:41:51.502 INFO:tasks.workunit.client.1.smithi195.stdout:3/780: chown d7/d1f/d73/dae 468 1 2024-08-18T22:41:51.502 INFO:tasks.workunit.client.0.smithi121.stdout:2/829: chown d2/d8/d19/d4a/lb4 188 1 2024-08-18T22:41:51.504 INFO:tasks.workunit.client.0.smithi121.stdout:2/830: write d2/d8/d1f/ffa [436270,39944] 0 2024-08-18T22:41:51.505 INFO:tasks.workunit.client.0.smithi121.stdout:2/831: read - d2/d8/d19/d55/ff8 zero size 2024-08-18T22:41:51.507 INFO:tasks.workunit.client.0.smithi121.stdout:2/832: creat d2/d8/d9e/f10f x:0 0 0 2024-08-18T22:41:51.508 INFO:tasks.workunit.client.1.smithi195.stdout:4/659: dwrite d0/d7/fd4 [0,4194304] 0 2024-08-18T22:41:51.510 INFO:tasks.workunit.client.1.smithi195.stdout:9/691: getdents d1c/d32/d71/dbe/d98 0 2024-08-18T22:41:51.517 INFO:tasks.workunit.client.0.smithi121.stdout:2/833: rename d2/d8/d9e to d2/d3/d51/d110 0 2024-08-18T22:41:51.518 INFO:tasks.workunit.client.1.smithi195.stdout:4/660: creat d0/d99/d85/d48/feb x:0 0 0 2024-08-18T22:41:51.518 INFO:tasks.workunit.client.1.smithi195.stdout:5/632: dwrite d0/d46/f9c [0,4194304] 0 2024-08-18T22:41:51.519 INFO:tasks.workunit.client.1.smithi195.stdout:6/624: link da/db/d2a/c6c da/db/db7/cbb 0 2024-08-18T22:41:51.519 INFO:tasks.workunit.client.1.smithi195.stdout:7/802: dread f5 [0,4194304] 0 2024-08-18T22:41:51.520 INFO:tasks.workunit.client.1.smithi195.stdout:3/781: link d7/da/le8 d7/da/df/dd3/df8/l100 0 2024-08-18T22:41:51.521 INFO:tasks.workunit.client.1.smithi195.stdout:9/692: truncate d1c/d32/d37/d4b/f6b 273324 0 2024-08-18T22:41:51.522 INFO:tasks.workunit.client.1.smithi195.stdout:9/693: write d1c/d74/fc9 [803633,760] 0 2024-08-18T22:41:51.524 INFO:tasks.workunit.client.1.smithi195.stdout:9/694: write d1c/d32/d37/d4b/f5d [167165,76812] 0 2024-08-18T22:41:51.525 INFO:tasks.workunit.client.1.smithi195.stdout:5/633: rmdir d0/d3/d8/d3b 39 2024-08-18T22:41:51.526 INFO:tasks.workunit.client.1.smithi195.stdout:4/661: creat d0/d7/d1d/d69/db7/d41/dbf/fec x:0 0 0 2024-08-18T22:41:51.527 INFO:tasks.workunit.client.1.smithi195.stdout:3/782: dread d7/da/df/d1c/d6a/d6c/f6e [0,4194304] 0 2024-08-18T22:41:51.529 INFO:tasks.workunit.client.1.smithi195.stdout:9/695: mkdir d1c/d92/d96/ddd 0 2024-08-18T22:41:51.532 INFO:tasks.workunit.client.0.smithi121.stdout:2/834: dwrite d2/d8/d19/f93 [0,4194304] 0 2024-08-18T22:41:51.532 INFO:tasks.workunit.client.0.smithi121.stdout:2/835: read - d2/d3/d51/fdf zero size 2024-08-18T22:41:51.533 INFO:tasks.workunit.client.1.smithi195.stdout:9/696: read - d1c/d92/da1/fca zero size 2024-08-18T22:41:51.533 INFO:tasks.workunit.client.1.smithi195.stdout:4/662: mknod d0/d99/d85/d48/ced 0 2024-08-18T22:41:51.535 INFO:tasks.workunit.client.0.smithi121.stdout:2/836: getdents d2/d3/d51/d110/de4/df7 0 2024-08-18T22:41:51.537 INFO:tasks.workunit.client.1.smithi195.stdout:9/697: dread - d1c/f94 zero size 2024-08-18T22:41:51.537 INFO:tasks.workunit.client.0.smithi121.stdout:2/837: creat d2/dd8/ddc/f111 x:0 0 0 2024-08-18T22:41:51.539 INFO:tasks.workunit.client.0.smithi121.stdout:2/838: getdents d2/d8 0 2024-08-18T22:41:51.541 INFO:tasks.workunit.client.1.smithi195.stdout:6/625: dwrite da/d22/d86/f79 [0,4194304] 0 2024-08-18T22:41:51.541 INFO:tasks.workunit.client.0.smithi121.stdout:2/839: write d2/f1d [3101776,57938] 0 2024-08-18T22:41:51.542 INFO:tasks.workunit.client.0.smithi121.stdout:2/840: dread - d2/d8/fa0 zero size 2024-08-18T22:41:51.544 INFO:tasks.workunit.client.0.smithi121.stdout:2/841: creat d2/d3/d51/d110/f112 x:0 0 0 2024-08-18T22:41:51.546 INFO:tasks.workunit.client.1.smithi195.stdout:6/626: mknod da/db/d2a/cbc 0 2024-08-18T22:41:51.546 INFO:tasks.workunit.client.1.smithi195.stdout:4/663: dwrite d0/fb5 [0,4194304] 0 2024-08-18T22:41:51.548 INFO:tasks.workunit.client.0.smithi121.stdout:2/842: rename d2/d8/d19/d4a/d64/f90 to d2/dd8/ddc/f113 0 2024-08-18T22:41:51.551 INFO:tasks.workunit.client.1.smithi195.stdout:6/627: write da/d15/d1c/f9e [205988,101548] 0 2024-08-18T22:41:51.555 INFO:tasks.workunit.client.1.smithi195.stdout:5/634: dread d0/d2/d29/d88/d6a/f80 [0,4194304] 0 2024-08-18T22:41:51.556 INFO:tasks.workunit.client.0.smithi121.stdout:2/843: dwrite d2/f54 [0,4194304] 0 2024-08-18T22:41:51.556 INFO:tasks.workunit.client.1.smithi195.stdout:4/664: read d0/d99/d98/d16/d94/db2/da4/fce [4100763,110131] 0 2024-08-18T22:41:51.558 INFO:tasks.workunit.client.1.smithi195.stdout:5/635: write d0/d2/d29/d88/d90/f91 [439288,80624] 0 2024-08-18T22:41:51.559 INFO:tasks.workunit.client.1.smithi195.stdout:3/783: dread d7/d1f/d49/f93 [0,4194304] 0 2024-08-18T22:41:51.560 INFO:tasks.workunit.client.0.smithi121.stdout:2/844: creat d2/dd8/f114 x:0 0 0 2024-08-18T22:41:51.562 INFO:tasks.workunit.client.0.smithi121.stdout:2/845: write d2/d3/d48/f8e [1880755,64620] 0 2024-08-18T22:41:51.563 INFO:tasks.workunit.client.1.smithi195.stdout:6/628: dwrite da/db/d19/f1d [4194304,4194304] 0 2024-08-18T22:41:51.568 INFO:tasks.workunit.client.1.smithi195.stdout:4/665: rename d0/d99/d98/d16/d94/c9d to d0/d7/d1d/d69/db7/d3b/cee 0 2024-08-18T22:41:51.574 INFO:tasks.workunit.client.1.smithi195.stdout:6/629: rename da/db/d26/d2d/da1 to da/d15/d1c/d2e/dbd 0 2024-08-18T22:41:51.575 INFO:tasks.workunit.client.1.smithi195.stdout:5/636: mkdir d0/d3/d8/d3b/db1/dc6 0 2024-08-18T22:41:51.576 INFO:tasks.workunit.client.1.smithi195.stdout:4/666: creat d0/d99/d98/d16/d94/db2/da4/dad/fef x:0 0 0 2024-08-18T22:41:51.577 INFO:tasks.workunit.client.0.smithi121.stdout:2/846: dwrite d2/d3/f56 [0,4194304] 0 2024-08-18T22:41:51.579 INFO:tasks.workunit.client.1.smithi195.stdout:6/630: creat da/db/d19/d67/fbe x:0 0 0 2024-08-18T22:41:51.579 INFO:tasks.workunit.client.1.smithi195.stdout:4/667: write d0/d99/d98/fd7 [161516,121713] 0 2024-08-18T22:41:51.580 INFO:tasks.workunit.client.0.smithi121.stdout:2/847: mkdir d2/d3/d53/dec/d115 0 2024-08-18T22:41:51.580 INFO:tasks.workunit.client.1.smithi195.stdout:5/637: mkdir d0/d3/d8/d64/d87/dc7 0 2024-08-18T22:41:51.583 INFO:tasks.workunit.client.1.smithi195.stdout:3/784: dread d7/f9 [4194304,4194304] 0 2024-08-18T22:41:51.584 INFO:tasks.workunit.client.1.smithi195.stdout:6/631: write da/db/f82 [726504,5930] 0 2024-08-18T22:41:51.586 INFO:tasks.workunit.client.0.smithi121.stdout:2/848: read d2/d3/f8a [3010658,33767] 0 2024-08-18T22:41:51.587 INFO:tasks.workunit.client.1.smithi195.stdout:3/785: mknod d7/d1f/d73/c101 0 2024-08-18T22:41:51.587 INFO:tasks.workunit.client.1.smithi195.stdout:9/698: dread d1c/f58 [0,4194304] 0 2024-08-18T22:41:51.588 INFO:tasks.workunit.client.1.smithi195.stdout:3/786: dread - d7/da/df/d1c/d6a/d6c/fe3 zero size 2024-08-18T22:41:51.590 INFO:tasks.workunit.client.1.smithi195.stdout:6/632: creat da/d15/d1c/d2e/dbd/da9/fbf x:0 0 0 2024-08-18T22:41:51.590 INFO:tasks.workunit.client.1.smithi195.stdout:6/633: fdatasync da/d15/d1c/d64/fb6 0 2024-08-18T22:41:51.593 INFO:tasks.workunit.client.0.smithi121.stdout:2/849: dwrite d2/d8/d19/d4a/fc3 [0,4194304] 0 2024-08-18T22:41:51.593 INFO:tasks.workunit.client.1.smithi195.stdout:3/787: getdents d7/da/df/d1c/d6a/df1 0 2024-08-18T22:41:51.593 INFO:tasks.workunit.client.0.smithi121.stdout:2/850: chown d2/dd8 247 1 2024-08-18T22:41:51.594 INFO:tasks.workunit.client.0.smithi121.stdout:2/851: dread - d2/d8/d19/d4a/d64/f10c zero size 2024-08-18T22:41:51.594 INFO:tasks.workunit.client.1.smithi195.stdout:6/634: symlink da/lc0 0 2024-08-18T22:41:51.595 INFO:tasks.workunit.client.1.smithi195.stdout:3/788: write d7/fad [3465861,100965] 0 2024-08-18T22:41:51.596 INFO:tasks.workunit.client.0.smithi121.stdout:2/852: readlink d2/d3/l7 0 2024-08-18T22:41:51.599 INFO:tasks.workunit.client.1.smithi195.stdout:4/668: dwrite d0/d99/d98/d16/f61 [0,4194304] 0 2024-08-18T22:41:51.605 INFO:tasks.workunit.client.1.smithi195.stdout:6/635: dwrite da/d3b/f3e [4194304,4194304] 0 2024-08-18T22:41:51.621 INFO:tasks.workunit.client.1.smithi195.stdout:5/638: dread d0/d46/d6d/f8e [0,4194304] 0 2024-08-18T22:41:51.647 INFO:tasks.workunit.client.1.smithi195.stdout:8/736: sync 2024-08-18T22:41:51.684 INFO:tasks.workunit.client.1.smithi195.stdout:9/699: truncate d1c/f63 1291051 0 2024-08-18T22:41:51.685 INFO:tasks.workunit.client.1.smithi195.stdout:3/789: symlink d7/da/d75/l102 0 2024-08-18T22:41:51.687 INFO:tasks.workunit.client.1.smithi195.stdout:6/636: chown da/f13 618147 1 2024-08-18T22:41:51.688 INFO:tasks.workunit.client.1.smithi195.stdout:9/700: dread d1c/f58 [0,4194304] 0 2024-08-18T22:41:51.689 INFO:tasks.workunit.client.1.smithi195.stdout:5/639: creat d0/da6/fc8 x:0 0 0 2024-08-18T22:41:51.692 INFO:tasks.workunit.client.1.smithi195.stdout:9/701: dread d1c/d32/f91 [0,4194304] 0 2024-08-18T22:41:51.693 INFO:tasks.workunit.client.1.smithi195.stdout:3/790: mknod d7/d1f/c103 0 2024-08-18T22:41:51.695 INFO:tasks.workunit.client.1.smithi195.stdout:4/669: getdents d0/d99/d85/d48 0 2024-08-18T22:41:51.695 INFO:tasks.workunit.client.1.smithi195.stdout:6/637: symlink da/db/d26/d90/lc1 0 2024-08-18T22:41:51.697 INFO:tasks.workunit.client.1.smithi195.stdout:6/638: stat da/db/d19/d67/fa5 0 2024-08-18T22:41:51.698 INFO:tasks.workunit.client.1.smithi195.stdout:5/640: dwrite d0/f77 [0,4194304] 0 2024-08-18T22:41:51.698 INFO:tasks.workunit.client.1.smithi195.stdout:9/702: dread d1c/f31 [0,4194304] 0 2024-08-18T22:41:51.699 INFO:tasks.workunit.client.1.smithi195.stdout:5/641: fdatasync d0/d3/df/faf 0 2024-08-18T22:41:51.700 INFO:tasks.workunit.client.1.smithi195.stdout:3/791: fsync d7/da/df/d1c/f63 0 2024-08-18T22:41:51.700 INFO:tasks.workunit.client.1.smithi195.stdout:4/670: dread - d0/d99/d98/d16/d94/db2/da4/dad/fd0 zero size 2024-08-18T22:41:51.701 INFO:tasks.workunit.client.1.smithi195.stdout:9/703: creat d1c/d92/fde x:0 0 0 2024-08-18T22:41:51.702 INFO:tasks.workunit.client.1.smithi195.stdout:6/639: fsync da/d15/d1c/d2e/f60 0 2024-08-18T22:41:51.704 INFO:tasks.workunit.client.1.smithi195.stdout:9/704: chown d1c/d32/f66 6 1 2024-08-18T22:41:51.707 INFO:tasks.workunit.client.1.smithi195.stdout:4/671: mkdir d0/d99/d98/d16/d94/db2/da4/df0 0 2024-08-18T22:41:51.709 INFO:tasks.workunit.client.1.smithi195.stdout:4/672: read d0/d99/d85/d48/f83 [20571,56770] 0 2024-08-18T22:41:51.710 INFO:tasks.workunit.client.1.smithi195.stdout:9/705: rename d1c/l2d to d1c/d92/d96/ddd/ldf 0 2024-08-18T22:41:51.711 INFO:tasks.workunit.client.1.smithi195.stdout:5/642: getdents d0/d3/d8/d64 0 2024-08-18T22:41:51.714 INFO:tasks.workunit.client.1.smithi195.stdout:6/640: rename da/d22/d86/lad to da/d15/d1c/lc2 0 2024-08-18T22:41:51.714 INFO:tasks.workunit.client.1.smithi195.stdout:6/641: readlink da/db/d26/d90/lc1 0 2024-08-18T22:41:51.717 INFO:tasks.workunit.client.1.smithi195.stdout:9/706: fdatasync d1c/f2c 0 2024-08-18T22:41:51.718 INFO:tasks.workunit.client.1.smithi195.stdout:3/792: write d7/da/df/d1c/dc6/ffa [1827626,25636] 0 2024-08-18T22:41:51.721 INFO:tasks.workunit.client.1.smithi195.stdout:5/643: creat d0/d3/d5f/fc9 x:0 0 0 2024-08-18T22:41:51.721 INFO:tasks.workunit.client.1.smithi195.stdout:5/644: chown d0/d3/d8/c2b 371 1 2024-08-18T22:41:51.721 INFO:tasks.workunit.client.1.smithi195.stdout:6/642: mknod da/d15/d1c/d2e/cc3 0 2024-08-18T22:41:51.723 INFO:tasks.workunit.client.1.smithi195.stdout:4/673: link d0/d99/fe2 d0/d99/d98/d16/d94/db2/da4/dad/ff1 0 2024-08-18T22:41:51.724 INFO:tasks.workunit.client.1.smithi195.stdout:5/645: rmdir d0/d3/df/d5a 39 2024-08-18T22:41:51.726 INFO:tasks.workunit.client.1.smithi195.stdout:6/643: rename da/db/d26/d90/lc1 to da/db/d2a/lc4 0 2024-08-18T22:41:51.727 INFO:tasks.workunit.client.1.smithi195.stdout:3/793: write d7/da/d75/f78 [2726437,63268] 0 2024-08-18T22:41:51.729 INFO:tasks.workunit.client.1.smithi195.stdout:5/646: creat d0/d2/fca x:0 0 0 2024-08-18T22:41:51.731 INFO:tasks.workunit.client.1.smithi195.stdout:6/644: symlink da/db/d19/d72/da7/lc5 0 2024-08-18T22:41:51.731 INFO:tasks.workunit.client.1.smithi195.stdout:9/707: dread d1c/d32/d37/d4b/f6f [0,4194304] 0 2024-08-18T22:41:51.731 INFO:tasks.workunit.client.1.smithi195.stdout:3/794: fsync d7/da/df/dca/fbb 0 2024-08-18T22:41:51.732 INFO:tasks.workunit.client.1.smithi195.stdout:6/645: chown da/db/d26/l47 6 1 2024-08-18T22:41:51.733 INFO:tasks.workunit.client.1.smithi195.stdout:9/708: dread - d1c/d32/d37/fad zero size 2024-08-18T22:41:51.733 INFO:tasks.workunit.client.1.smithi195.stdout:4/674: getdents d0/d7/d1d/d69/db7/d41/dbf 0 2024-08-18T22:41:51.734 INFO:tasks.workunit.client.1.smithi195.stdout:9/709: write d1c/d32/fa5 [954674,5448] 0 2024-08-18T22:41:51.735 INFO:tasks.workunit.client.1.smithi195.stdout:3/795: mknod d7/d1f/d49/c104 0 2024-08-18T22:41:51.738 INFO:tasks.workunit.client.1.smithi195.stdout:9/710: truncate d1c/d32/d37/f5b 3993110 0 2024-08-18T22:41:51.741 INFO:tasks.workunit.client.1.smithi195.stdout:6/646: write da/d3b/f6d [878374,123793] 0 2024-08-18T22:41:51.742 INFO:tasks.workunit.client.1.smithi195.stdout:5/647: dwrite d0/d3/df/d5a/fc0 [0,4194304] 0 2024-08-18T22:41:51.743 INFO:tasks.workunit.client.1.smithi195.stdout:4/675: write d0/d99/d85/faa [559807,47017] 0 2024-08-18T22:41:51.743 INFO:tasks.workunit.client.1.smithi195.stdout:5/648: readlink d0/d3/df/la4 0 2024-08-18T22:41:51.744 INFO:tasks.workunit.client.1.smithi195.stdout:9/711: rmdir d1c/d32/d71/dbe/d98 39 2024-08-18T22:41:51.745 INFO:tasks.workunit.client.1.smithi195.stdout:6/647: stat da/d15/d1c/c55 0 2024-08-18T22:41:51.749 INFO:tasks.workunit.client.1.smithi195.stdout:9/712: mkdir d1c/d32/d37/de0 0 2024-08-18T22:41:51.749 INFO:tasks.workunit.client.1.smithi195.stdout:5/649: creat d0/d2/d29/dc5/fcb x:0 0 0 2024-08-18T22:41:51.751 INFO:tasks.workunit.client.1.smithi195.stdout:6/648: dread da/d15/f2c [0,4194304] 0 2024-08-18T22:41:51.752 INFO:tasks.workunit.client.1.smithi195.stdout:6/649: stat da/db/d19/f45 0 2024-08-18T22:41:51.755 INFO:tasks.workunit.client.1.smithi195.stdout:9/713: write f13 [997429,102872] 0 2024-08-18T22:41:51.757 INFO:tasks.workunit.client.1.smithi195.stdout:9/714: truncate d1c/fa9 4435183 0 2024-08-18T22:41:51.757 INFO:tasks.workunit.client.1.smithi195.stdout:5/650: dwrite d0/d46/d6d/f8e [4194304,4194304] 0 2024-08-18T22:41:51.760 INFO:tasks.workunit.client.1.smithi195.stdout:9/715: dread - d1c/d32/d71/dbe/d98/fcf zero size 2024-08-18T22:41:51.761 INFO:tasks.workunit.client.1.smithi195.stdout:5/651: mkdir d0/d37/dba/dcc 0 2024-08-18T22:41:51.762 INFO:tasks.workunit.client.1.smithi195.stdout:9/716: dread - d1c/d32/d71/f7d zero size 2024-08-18T22:41:51.764 INFO:tasks.workunit.client.1.smithi195.stdout:9/717: rename lc to d1c/d92/d96/d9d/le1 0 2024-08-18T22:41:51.765 INFO:tasks.workunit.client.1.smithi195.stdout:9/718: readlink d1c/l7f 0 2024-08-18T22:41:51.766 INFO:tasks.workunit.client.1.smithi195.stdout:5/652: dwrite d0/d2/d29/db5/fc1 [0,4194304] 0 2024-08-18T22:41:51.771 INFO:tasks.workunit.client.1.smithi195.stdout:9/719: creat d1c/d32/d37/d4b/dc8/fe2 x:0 0 0 2024-08-18T22:41:51.772 INFO:tasks.workunit.client.1.smithi195.stdout:5/653: truncate d0/d2/d29/d88/d6a/f7a 592552 0 2024-08-18T22:41:51.773 INFO:tasks.workunit.client.1.smithi195.stdout:5/654: fdatasync d0/d3/f27 0 2024-08-18T22:41:51.774 INFO:tasks.workunit.client.1.smithi195.stdout:3/796: read d7/da/f48 [4959455,77861] 0 2024-08-18T22:41:51.774 INFO:tasks.workunit.client.1.smithi195.stdout:5/655: dread - d0/d2/fca zero size 2024-08-18T22:41:51.776 INFO:tasks.workunit.client.1.smithi195.stdout:9/720: write d1c/f1d [2330353,59385] 0 2024-08-18T22:41:51.776 INFO:tasks.workunit.client.1.smithi195.stdout:3/797: write d7/f18 [1696226,45415] 0 2024-08-18T22:41:51.777 INFO:tasks.workunit.client.1.smithi195.stdout:5/656: read d0/d37/f68 [2198139,104841] 0 2024-08-18T22:41:51.779 INFO:tasks.workunit.client.1.smithi195.stdout:9/721: readlink d1c/d32/d71/l77 0 2024-08-18T22:41:51.781 INFO:tasks.workunit.client.1.smithi195.stdout:3/798: write d7/da/df/d38/f8d [95760,120536] 0 2024-08-18T22:41:51.782 INFO:tasks.workunit.client.1.smithi195.stdout:9/722: write d1c/d70/fb6 [934251,43435] 0 2024-08-18T22:41:51.783 INFO:tasks.workunit.client.1.smithi195.stdout:5/657: read d0/d2/d29/d88/d6a/f83 [23510,84188] 0 2024-08-18T22:41:51.783 INFO:tasks.workunit.client.1.smithi195.stdout:9/723: chown d1c/f94 236 1 2024-08-18T22:41:51.784 INFO:tasks.workunit.client.1.smithi195.stdout:3/799: stat d7/da/df/d8e/l9c 0 2024-08-18T22:41:51.785 INFO:tasks.workunit.client.1.smithi195.stdout:9/724: fdatasync d1c/d92/d96/d9d/db9/fc1 0 2024-08-18T22:41:51.786 INFO:tasks.workunit.client.1.smithi195.stdout:5/658: read d0/d2/d29/d88/d90/fbf [28959,29730] 0 2024-08-18T22:41:51.787 INFO:tasks.workunit.client.1.smithi195.stdout:5/659: chown d0/d2/d29/l73 21 1 2024-08-18T22:41:51.789 INFO:tasks.workunit.client.1.smithi195.stdout:6/650: dread da/d15/d1c/f12 [0,4194304] 0 2024-08-18T22:41:51.798 INFO:tasks.workunit.client.0.smithi121.stdout:2/853: sync 2024-08-18T22:41:51.801 INFO:tasks.workunit.client.0.smithi121.stdout:2/854: mkdir d2/d3/d84/d106/d116 0 2024-08-18T22:41:51.802 INFO:tasks.workunit.client.0.smithi121.stdout:2/855: fdatasync d2/f6 0 2024-08-18T22:41:51.809 INFO:tasks.workunit.client.0.smithi121.stdout:2/856: dwrite d2/d3/d48/d77/f42 [0,4194304] 0 2024-08-18T22:41:51.810 INFO:tasks.workunit.client.0.smithi121.stdout:2/857: write d2/d8/d19/d4a/d64/f10b [165867,68729] 0 2024-08-18T22:41:51.815 INFO:tasks.workunit.client.0.smithi121.stdout:2/858: dread d2/d3/d48/fad [0,4194304] 0 2024-08-18T22:41:51.817 INFO:tasks.workunit.client.0.smithi121.stdout:2/859: chown d2/d8/d19/d4a/d64/l101 7842 1 2024-08-18T22:41:51.818 INFO:tasks.workunit.client.0.smithi121.stdout:2/860: chown d2/d3/fe5 4125630 1 2024-08-18T22:41:51.877 INFO:tasks.workunit.client.1.smithi195.stdout:9/725: mkdir d1c/d32/d37/d4b/dc6/de3 0 2024-08-18T22:41:51.879 INFO:tasks.workunit.client.1.smithi195.stdout:5/660: rename d0/d3/d5f/fc9 to d0/d3/d8/d64/fcd 0 2024-08-18T22:41:51.882 INFO:tasks.workunit.client.1.smithi195.stdout:3/800: dwrite d7/f2b [0,4194304] 0 2024-08-18T22:41:51.882 INFO:tasks.workunit.client.1.smithi195.stdout:6/651: creat da/db/d78/fc6 x:0 0 0 2024-08-18T22:41:51.884 INFO:tasks.workunit.client.1.smithi195.stdout:6/652: write da/db/d78/fc6 [560199,50100] 0 2024-08-18T22:41:51.885 INFO:tasks.workunit.client.1.smithi195.stdout:9/726: mkdir d1c/d74/de4 0 2024-08-18T22:41:51.887 INFO:tasks.workunit.client.1.smithi195.stdout:5/661: creat d0/d46/d6d/da2/fce x:0 0 0 2024-08-18T22:41:51.888 INFO:tasks.workunit.client.1.smithi195.stdout:3/801: unlink d7/d1f/d49/f93 0 2024-08-18T22:41:51.888 INFO:tasks.workunit.client.1.smithi195.stdout:6/653: symlink da/db/d78/lc7 0 2024-08-18T22:41:51.889 INFO:tasks.workunit.client.1.smithi195.stdout:3/802: read - d7/d1f/d49/fdb zero size 2024-08-18T22:41:51.892 INFO:tasks.workunit.client.1.smithi195.stdout:9/727: getdents d1c/d74/d8e 0 2024-08-18T22:41:51.894 INFO:tasks.workunit.client.1.smithi195.stdout:9/728: dread - d1c/d92/d96/fba zero size 2024-08-18T22:41:51.894 INFO:tasks.workunit.client.1.smithi195.stdout:6/654: rename da/db/d26/l47 to da/d22/lc8 0 2024-08-18T22:41:51.894 INFO:tasks.workunit.client.1.smithi195.stdout:3/803: mknod d7/da/df/dca/dc9/c105 0 2024-08-18T22:41:51.897 INFO:tasks.workunit.client.1.smithi195.stdout:5/662: dwrite d0/d46/d6d/da2/fce [0,4194304] 0 2024-08-18T22:41:51.898 INFO:tasks.workunit.client.1.smithi195.stdout:9/729: mkdir d1c/d32/d37/d4b/dc6/de5 0 2024-08-18T22:41:51.899 INFO:tasks.workunit.client.1.smithi195.stdout:9/730: chown d1c/d32/d71/dbe 14101 1 2024-08-18T22:41:51.899 INFO:tasks.workunit.client.1.smithi195.stdout:6/655: rename da/d15/d1c/f28 to da/db/d2a/fc9 0 2024-08-18T22:41:51.904 INFO:tasks.workunit.client.1.smithi195.stdout:9/731: rename d1c/d32/d71/dbe/d98/f9f to d1c/dd5/fe6 0 2024-08-18T22:41:51.906 INFO:tasks.workunit.client.1.smithi195.stdout:6/656: creat da/fca x:0 0 0 2024-08-18T22:41:51.907 INFO:tasks.workunit.client.1.smithi195.stdout:5/663: link d0/d2/l69 d0/d2/lcf 0 2024-08-18T22:41:51.909 INFO:tasks.workunit.client.1.smithi195.stdout:5/664: truncate d0/d2/fca 625279 0 2024-08-18T22:41:51.910 INFO:tasks.workunit.client.1.smithi195.stdout:6/657: creat da/d15/fcb x:0 0 0 2024-08-18T22:41:51.915 INFO:tasks.workunit.client.1.smithi195.stdout:6/658: rename da/d15/d1c/d2e/d74/db8 to da/d15/d1c/d2e/d74/dcc 0 2024-08-18T22:41:51.917 INFO:tasks.workunit.client.1.smithi195.stdout:3/804: truncate d7/da/df/d1c/d6a/d6c/fc5 2802189 0 2024-08-18T22:41:51.917 INFO:tasks.workunit.client.1.smithi195.stdout:6/659: dread da/d15/d1c/d2e/f3d [4194304,4194304] 0 2024-08-18T22:41:51.919 INFO:tasks.workunit.client.1.smithi195.stdout:9/732: write d1c/d32/d37/f4d [1371559,109459] 0 2024-08-18T22:41:51.921 INFO:tasks.workunit.client.1.smithi195.stdout:5/665: truncate d0/d3/d8/d64/fac 1358910 0 2024-08-18T22:41:51.926 INFO:tasks.workunit.client.1.smithi195.stdout:6/660: dwrite da/db/d2a/f57 [0,4194304] 0 2024-08-18T22:41:51.930 INFO:tasks.workunit.client.1.smithi195.stdout:5/666: mknod d0/d3/d8/d3b/db1/dc6/cd0 0 2024-08-18T22:41:51.931 INFO:tasks.workunit.client.1.smithi195.stdout:6/661: write da/d15/d1c/f12 [4755816,44096] 0 2024-08-18T22:41:51.933 INFO:tasks.workunit.client.1.smithi195.stdout:5/667: creat d0/d2/d29/d88/fd1 x:0 0 0 2024-08-18T22:41:51.934 INFO:tasks.workunit.client.1.smithi195.stdout:6/662: mkdir da/db/d78/dcd 0 2024-08-18T22:41:51.936 INFO:tasks.workunit.client.1.smithi195.stdout:6/663: write da/d15/d1c/d2e/f60 [182808,46841] 0 2024-08-18T22:41:51.936 INFO:tasks.workunit.client.1.smithi195.stdout:5/668: write d0/d2/d29/d88/d6a/f83 [7661266,2120] 0 2024-08-18T22:41:51.938 INFO:tasks.workunit.client.1.smithi195.stdout:6/664: write da/d15/d1c/d2e/f85 [3971109,95135] 0 2024-08-18T22:41:51.938 INFO:tasks.workunit.client.1.smithi195.stdout:5/669: symlink d0/d2/ld2 0 2024-08-18T22:41:51.940 INFO:tasks.workunit.client.1.smithi195.stdout:6/665: creat da/d22/d87/fce x:0 0 0 2024-08-18T22:41:51.943 INFO:tasks.workunit.client.1.smithi195.stdout:6/666: rename da/d15/d1c/d2e/c80 to da/d15/d1c/d2e/dbd/da9/ccf 0 2024-08-18T22:41:51.946 INFO:tasks.workunit.client.1.smithi195.stdout:6/667: link da/db/l35 da/d15/d1c/ld0 0 2024-08-18T22:41:51.947 INFO:tasks.workunit.client.1.smithi195.stdout:9/733: dread d1c/d32/d37/f67 [0,4194304] 0 2024-08-18T22:41:51.948 INFO:tasks.workunit.client.1.smithi195.stdout:9/734: write d1c/f35 [1451116,74890] 0 2024-08-18T22:41:51.950 INFO:tasks.workunit.client.1.smithi195.stdout:6/668: dread da/db/d19/d67/fa5 [0,4194304] 0 2024-08-18T22:41:51.951 INFO:tasks.workunit.client.1.smithi195.stdout:6/669: stat da/d15/d1c/f12 0 2024-08-18T22:41:51.952 INFO:tasks.workunit.client.1.smithi195.stdout:6/670: write da/d15/f2c [1964961,85587] 0 2024-08-18T22:41:51.953 INFO:tasks.workunit.client.1.smithi195.stdout:6/671: write da/d15/f34 [4882333,518] 0 2024-08-18T22:41:51.954 INFO:tasks.workunit.client.1.smithi195.stdout:6/672: write da/d15/f31 [349900,43491] 0 2024-08-18T22:41:51.958 INFO:tasks.workunit.client.1.smithi195.stdout:5/670: dread d0/d3/f27 [0,4194304] 0 2024-08-18T22:41:51.958 INFO:tasks.workunit.client.1.smithi195.stdout:6/673: symlink da/d15/d1c/ld1 0 2024-08-18T22:41:51.959 INFO:tasks.workunit.client.1.smithi195.stdout:6/674: fsync da/d22/d86/f79 0 2024-08-18T22:41:51.959 INFO:tasks.workunit.client.1.smithi195.stdout:5/671: write d0/f77 [4596561,99520] 0 2024-08-18T22:41:51.960 INFO:tasks.workunit.client.1.smithi195.stdout:6/675: chown da/db/d19/d67/fbe 6 1 2024-08-18T22:41:51.961 INFO:tasks.workunit.client.1.smithi195.stdout:5/672: write d0/f4b [2093107,106185] 0 2024-08-18T22:41:51.963 INFO:tasks.workunit.client.1.smithi195.stdout:6/676: unlink da/db/d2a/fb9 0 2024-08-18T22:41:51.964 INFO:tasks.workunit.client.1.smithi195.stdout:5/673: write d0/d2/d29/d88/d90/f9a [1068313,90688] 0 2024-08-18T22:41:51.964 INFO:tasks.workunit.client.1.smithi195.stdout:6/677: chown da/d22/d86 1217 1 2024-08-18T22:41:51.965 INFO:tasks.workunit.client.0.smithi121.stdout:2/861: sync 2024-08-18T22:41:51.969 INFO:tasks.workunit.client.1.smithi195.stdout:9/735: dwrite d1c/f31 [0,4194304] 0 2024-08-18T22:41:51.970 INFO:tasks.workunit.client.1.smithi195.stdout:9/736: chown d1c/d32/d37/d4b/dc6 11816225 1 2024-08-18T22:41:51.970 INFO:tasks.workunit.client.0.smithi121.stdout:2/862: dwrite d2/dd8/ddc/f111 [0,4194304] 0 2024-08-18T22:41:51.971 INFO:tasks.workunit.client.1.smithi195.stdout:6/678: creat da/db/d78/fd2 x:0 0 0 2024-08-18T22:41:51.971 INFO:tasks.workunit.client.0.smithi121.stdout:2/863: chown d2/d8/d19/le6 185538490 1 2024-08-18T22:41:51.971 INFO:tasks.workunit.client.1.smithi195.stdout:6/679: stat da 0 2024-08-18T22:41:51.972 INFO:tasks.workunit.client.1.smithi195.stdout:5/674: dread d0/d2/d79/f8a [0,4194304] 0 2024-08-18T22:41:51.973 INFO:tasks.workunit.client.1.smithi195.stdout:6/680: mknod da/db/d19/cd3 0 2024-08-18T22:41:51.974 INFO:tasks.workunit.client.0.smithi121.stdout:2/864: getdents d2/d8 0 2024-08-18T22:41:51.975 INFO:tasks.workunit.client.1.smithi195.stdout:5/675: rename d0/d2/d79 to d0/d3/d66/daa/dd3 0 2024-08-18T22:41:51.975 INFO:tasks.workunit.client.1.smithi195.stdout:5/676: dread - d0/d2/d29/dc5/fcb zero size 2024-08-18T22:41:51.977 INFO:tasks.workunit.client.1.smithi195.stdout:6/681: dread da/d15/d1c/f9e [0,4194304] 0 2024-08-18T22:41:51.978 INFO:tasks.workunit.client.0.smithi121.stdout:2/865: unlink d2/d8/d1f/l3d 0 2024-08-18T22:41:51.980 INFO:tasks.workunit.client.1.smithi195.stdout:6/682: creat da/db/d19/fd4 x:0 0 0 2024-08-18T22:41:51.980 INFO:tasks.workunit.client.0.smithi121.stdout:2/866: symlink d2/d3/d84/d106/d116/l117 0 2024-08-18T22:41:51.982 INFO:tasks.workunit.client.0.smithi121.stdout:2/867: rmdir d2/d3/d51 39 2024-08-18T22:41:51.983 INFO:tasks.workunit.client.0.smithi121.stdout:2/868: creat d2/d8/d19/d4a/d64/f118 x:0 0 0 2024-08-18T22:41:51.984 INFO:tasks.workunit.client.0.smithi121.stdout:2/869: chown d2/f1d 133 1 2024-08-18T22:41:51.984 INFO:tasks.workunit.client.1.smithi195.stdout:5/677: write d0/f95 [1477187,104951] 0 2024-08-18T22:41:51.986 INFO:tasks.workunit.client.1.smithi195.stdout:6/683: dwrite da/d22/d87/fce [0,4194304] 0 2024-08-18T22:41:51.987 INFO:tasks.workunit.client.0.smithi121.stdout:2/870: getdents d2/d3/d84 0 2024-08-18T22:41:51.989 INFO:tasks.workunit.client.1.smithi195.stdout:5/678: write d0/d2/d29/d88/d6a/f80 [816961,12040] 0 2024-08-18T22:41:51.991 INFO:tasks.workunit.client.1.smithi195.stdout:6/684: mkdir da/dd5 0 2024-08-18T22:41:51.992 INFO:tasks.workunit.client.0.smithi121.stdout:2/871: link d2/d8/d19/ca7 d2/d3/d51/c119 0 2024-08-18T22:41:51.992 INFO:tasks.workunit.client.1.smithi195.stdout:6/685: fsync da/d15/d1c/d64/fb6 0 2024-08-18T22:41:51.993 INFO:tasks.workunit.client.0.smithi121.stdout:2/872: write d2/d8/d19/d4a/d64/f10c [851502,57206] 0 2024-08-18T22:41:51.997 INFO:tasks.workunit.client.1.smithi195.stdout:5/679: dwrite d0/d2/d29/d88/fd1 [0,4194304] 0 2024-08-18T22:41:51.998 INFO:tasks.workunit.client.1.smithi195.stdout:5/680: stat d0/db/fa9 0 2024-08-18T22:41:52.005 INFO:tasks.workunit.client.1.smithi195.stdout:5/681: dwrite d0/d46/d6d/da2/fce [0,4194304] 0 2024-08-18T22:41:52.006 INFO:tasks.workunit.client.1.smithi195.stdout:5/682: fdatasync d0/d2/d29/d88/d90/f91 0 2024-08-18T22:41:52.009 INFO:tasks.workunit.client.1.smithi195.stdout:5/683: rename d0/d46/d6d/f8e to d0/d3/d5f/fd4 0 2024-08-18T22:41:52.011 INFO:tasks.workunit.client.1.smithi195.stdout:5/684: creat d0/db/fd5 x:0 0 0 2024-08-18T22:41:52.013 INFO:tasks.workunit.client.1.smithi195.stdout:6/686: truncate da/d15/f2c 331084 0 2024-08-18T22:41:52.013 INFO:tasks.workunit.client.0.smithi121.stdout:2/873: getdents d2/d3/d84/d106/d116 0 2024-08-18T22:41:52.014 INFO:tasks.workunit.client.1.smithi195.stdout:5/685: creat d0/d2/d29/d88/d6a/d96/fd6 x:0 0 0 2024-08-18T22:41:52.014 INFO:tasks.workunit.client.1.smithi195.stdout:6/687: write da/d15/d1c/f8f [422538,111454] 0 2024-08-18T22:41:52.019 INFO:tasks.workunit.client.1.smithi195.stdout:5/686: dread d0/d2/d29/d88/d90/fbf [0,4194304] 0 2024-08-18T22:41:52.024 INFO:tasks.workunit.client.1.smithi195.stdout:5/687: dwrite d0/d2/d29/db5/fc1 [0,4194304] 0 2024-08-18T22:41:52.027 INFO:tasks.workunit.client.1.smithi195.stdout:5/688: creat d0/d2/d53/fd7 x:0 0 0 2024-08-18T22:41:52.029 INFO:tasks.workunit.client.0.smithi121.stdout:2/874: dread d2/f4b [0,4194304] 0 2024-08-18T22:41:52.031 INFO:tasks.workunit.client.1.smithi195.stdout:5/689: truncate d0/d2/d29/f67 4219225 0 2024-08-18T22:41:52.033 INFO:tasks.workunit.client.1.smithi195.stdout:5/690: write d0/db/fd5 [124919,120717] 0 2024-08-18T22:41:52.035 INFO:tasks.workunit.client.1.smithi195.stdout:5/691: rename d0/d3/df/lb2 to d0/ld8 0 2024-08-18T22:41:52.036 INFO:tasks.workunit.client.0.smithi121.stdout:2/875: dwrite d2/d8/d19/d4a/fea [0,4194304] 0 2024-08-18T22:41:52.037 INFO:tasks.workunit.client.1.smithi195.stdout:6/688: write da/db/f37 [220571,71283] 0 2024-08-18T22:41:52.039 INFO:tasks.workunit.client.0.smithi121.stdout:2/876: fdatasync d2/d3/d48/d77/f42 0 2024-08-18T22:41:52.041 INFO:tasks.workunit.client.0.smithi121.stdout:2/877: write d2/d3/d51/d110/f112 [891773,18128] 0 2024-08-18T22:41:52.042 INFO:tasks.workunit.client.1.smithi195.stdout:5/692: dwrite d0/d2/d29/dc5/fcb [0,4194304] 0 2024-08-18T22:41:52.042 INFO:tasks.workunit.client.1.smithi195.stdout:2/491: sync 2024-08-18T22:41:52.043 INFO:tasks.workunit.client.1.smithi195.stdout:0/746: sync 2024-08-18T22:41:52.046 INFO:tasks.workunit.client.0.smithi121.stdout:2/878: dread d2/d73/f94 [0,4194304] 0 2024-08-18T22:41:52.048 INFO:tasks.workunit.client.1.smithi195.stdout:2/492: truncate d1/d22/f31 2170712 0 2024-08-18T22:41:52.049 INFO:tasks.workunit.client.0.smithi121.stdout:2/879: symlink d2/d3/d53/dec/l11a 0 2024-08-18T22:41:52.049 INFO:tasks.workunit.client.1.smithi195.stdout:6/689: dwrite da/db/d19/d67/fa5 [0,4194304] 0 2024-08-18T22:41:52.052 INFO:tasks.workunit.client.1.smithi195.stdout:2/493: creat d1/d8/d3d/d6c/f98 x:0 0 0 2024-08-18T22:41:52.052 INFO:tasks.workunit.client.0.smithi121.stdout:2/880: dread d2/d3/d48/d77/f42 [0,4194304] 0 2024-08-18T22:41:52.052 INFO:tasks.workunit.client.1.smithi195.stdout:6/690: creat da/d15/d1c/d2e/fd6 x:0 0 0 2024-08-18T22:41:52.054 INFO:tasks.workunit.client.1.smithi195.stdout:5/693: read d0/d46/f6c [2110446,82716] 0 2024-08-18T22:41:52.055 INFO:tasks.workunit.client.0.smithi121.stdout:2/881: creat d2/d3/d51/d110/f11b x:0 0 0 2024-08-18T22:41:52.055 INFO:tasks.workunit.client.1.smithi195.stdout:6/691: write da/f8d [566226,92192] 0 2024-08-18T22:41:52.056 INFO:tasks.workunit.client.0.smithi121.stdout:2/882: write d2/d8/d19/d4a/d64/f10b [113163,80228] 0 2024-08-18T22:41:52.057 INFO:tasks.workunit.client.1.smithi195.stdout:2/494: creat d1/d8/d3d/f99 x:0 0 0 2024-08-18T22:41:52.057 INFO:tasks.workunit.client.1.smithi195.stdout:6/692: fdatasync da/db/f82 0 2024-08-18T22:41:52.057 INFO:tasks.workunit.client.0.smithi121.stdout:2/883: chown d2/d3/d51/d110/f10f 13398 1 2024-08-18T22:41:52.060 INFO:tasks.workunit.client.0.smithi121.stdout:2/884: getdents d2/d3/d53/dec/d115 0 2024-08-18T22:41:52.061 INFO:tasks.workunit.client.1.smithi195.stdout:2/495: mknod d1/d97/c9a 0 2024-08-18T22:41:52.063 INFO:tasks.workunit.client.1.smithi195.stdout:6/693: mkdir da/db/d19/d72/dd7 0 2024-08-18T22:41:52.063 INFO:tasks.workunit.client.1.smithi195.stdout:5/694: dwrite d0/d2/d29/f32 [4194304,4194304] 0 2024-08-18T22:41:52.064 INFO:tasks.workunit.client.1.smithi195.stdout:2/496: symlink d1/d97/l9b 0 2024-08-18T22:41:52.066 INFO:tasks.workunit.client.1.smithi195.stdout:5/695: symlink d0/da6/ld9 0 2024-08-18T22:41:52.068 INFO:tasks.workunit.client.1.smithi195.stdout:6/694: mknod da/d15/d1c/d2e/d74/cd8 0 2024-08-18T22:41:52.070 INFO:tasks.workunit.client.0.smithi121.stdout:2/885: fsync d2/d8/d19/d4a/d64/f10b 0 2024-08-18T22:41:52.070 INFO:tasks.workunit.client.1.smithi195.stdout:6/695: truncate f5 8419716 0 2024-08-18T22:41:52.072 INFO:tasks.workunit.client.0.smithi121.stdout:2/886: symlink d2/d3/d51/d110/de4/l11c 0 2024-08-18T22:41:52.073 INFO:tasks.workunit.client.0.smithi121.stdout:2/887: write d2/d8/fa3 [827372,8104] 0 2024-08-18T22:41:52.075 INFO:tasks.workunit.client.1.smithi195.stdout:5/696: dwrite d0/d3/d8/d64/f9d [0,4194304] 0 2024-08-18T22:41:52.077 INFO:tasks.workunit.client.1.smithi195.stdout:6/696: creat da/db/d78/dcd/fd9 x:0 0 0 2024-08-18T22:41:52.078 INFO:tasks.workunit.client.1.smithi195.stdout:5/697: rmdir d0/d2/d29 39 2024-08-18T22:41:52.081 INFO:tasks.workunit.client.0.smithi121.stdout:2/888: dwrite d2/d8/d19/d4a/d64/f10b [0,4194304] 0 2024-08-18T22:41:52.082 INFO:tasks.workunit.client.1.smithi195.stdout:2/497: write d1/d8/d3d/f3e [5398299,109743] 0 2024-08-18T22:41:52.083 INFO:tasks.workunit.client.0.smithi121.stdout:2/889: stat d2/d3/d84/l96 0 2024-08-18T22:41:52.084 INFO:tasks.workunit.client.0.smithi121.stdout:2/890: dread - d2/d8/d19/d55/ff8 zero size 2024-08-18T22:41:52.086 INFO:tasks.workunit.client.0.smithi121.stdout:2/891: dread - d2/d8/d19/f104 zero size 2024-08-18T22:41:52.086 INFO:tasks.workunit.client.0.smithi121.stdout:2/892: write d2/d8/f107 [951341,122946] 0 2024-08-18T22:41:52.087 INFO:tasks.workunit.client.0.smithi121.stdout:2/893: readlink d2/l86 0 2024-08-18T22:41:52.097 INFO:tasks.workunit.client.1.smithi195.stdout:2/498: truncate d1/d24/d26/d42/d5c/f6a 1527414 0 2024-08-18T22:41:52.098 INFO:tasks.workunit.client.0.smithi121.stdout:2/894: dread d2/d3/d51/d110/f112 [0,4194304] 0 2024-08-18T22:41:52.099 INFO:tasks.workunit.client.1.smithi195.stdout:2/499: write d1/f59 [4851045,18062] 0 2024-08-18T22:41:52.099 INFO:tasks.workunit.client.0.smithi121.stdout:2/895: mknod d2/dd8/ddc/c11d 0 2024-08-18T22:41:52.101 INFO:tasks.workunit.client.0.smithi121.stdout:2/896: mkdir d2/d3/d53/dec/d11e 0 2024-08-18T22:41:52.101 INFO:tasks.workunit.client.1.smithi195.stdout:2/500: creat d1/d8/d3d/d4d/f9c x:0 0 0 2024-08-18T22:41:52.101 INFO:tasks.workunit.client.1.smithi195.stdout:5/698: dwrite d0/d3/d8/f56 [0,4194304] 0 2024-08-18T22:41:52.102 INFO:tasks.workunit.client.0.smithi121.stdout:2/897: write d2/d8/d19/d4a/fea [680752,62012] 0 2024-08-18T22:41:52.103 INFO:tasks.workunit.client.0.smithi121.stdout:2/898: write d2/d8/d1f/ffa [62880,65859] 0 2024-08-18T22:41:52.110 INFO:tasks.workunit.client.0.smithi121.stdout:2/899: dwrite d2/dd8/ddc/f111 [0,4194304] 0 2024-08-18T22:41:52.112 INFO:tasks.workunit.client.0.smithi121.stdout:2/900: mkdir d2/d3/d48/d77/d11f 0 2024-08-18T22:41:52.118 INFO:tasks.workunit.client.1.smithi195.stdout:2/501: dread d1/d24/d26/f40 [0,4194304] 0 2024-08-18T22:41:52.119 INFO:tasks.workunit.client.1.smithi195.stdout:5/699: dwrite d0/db/fa9 [4194304,4194304] 0 2024-08-18T22:41:52.121 INFO:tasks.workunit.client.1.smithi195.stdout:2/502: mknod d1/c9d 0 2024-08-18T22:41:52.121 INFO:tasks.workunit.client.1.smithi195.stdout:5/700: mkdir d0/d3/d66/dda 0 2024-08-18T22:41:52.122 INFO:tasks.workunit.client.1.smithi195.stdout:5/701: dread - d0/d3/d8/d64/fcd zero size 2024-08-18T22:41:52.123 INFO:tasks.workunit.client.1.smithi195.stdout:5/702: write d0/d3/d8/d64/fcd [861965,50108] 0 2024-08-18T22:41:52.125 INFO:tasks.workunit.client.1.smithi195.stdout:5/703: mkdir d0/ddb 0 2024-08-18T22:41:52.126 INFO:tasks.workunit.client.1.smithi195.stdout:5/704: fsync d0/d3/d8/fb9 0 2024-08-18T22:41:52.128 INFO:tasks.workunit.client.1.smithi195.stdout:5/705: fsync d0/d2/d29/d88/d6a/f83 0 2024-08-18T22:41:52.128 INFO:tasks.workunit.client.1.smithi195.stdout:5/706: stat d0/f93 0 2024-08-18T22:41:52.128 INFO:tasks.workunit.client.1.smithi195.stdout:5/707: stat d0/d46/d6d/f97 0 2024-08-18T22:41:52.131 INFO:tasks.workunit.client.1.smithi195.stdout:5/708: truncate d0/d2/d29/d88/d90/fbf 165833 0 2024-08-18T22:41:52.141 INFO:tasks.workunit.client.1.smithi195.stdout:5/709: dread d0/d2/d29/d88/d90/f9a [0,4194304] 0 2024-08-18T22:41:52.143 INFO:tasks.workunit.client.1.smithi195.stdout:5/710: symlink d0/d3/d8/d64/d87/dbc/ldc 0 2024-08-18T22:41:52.144 INFO:tasks.workunit.client.1.smithi195.stdout:5/711: write d0/d3/df/d1a/fab [762070,6344] 0 2024-08-18T22:41:52.145 INFO:tasks.workunit.client.1.smithi195.stdout:5/712: creat d0/db/fdd x:0 0 0 2024-08-18T22:41:52.151 INFO:tasks.workunit.client.0.smithi121.stdout:2/901: dread d2/d8/d19/f52 [0,4194304] 0 2024-08-18T22:41:52.156 INFO:tasks.workunit.client.1.smithi195.stdout:5/713: dread d0/d2/d29/f47 [0,4194304] 0 2024-08-18T22:41:52.158 INFO:tasks.workunit.client.1.smithi195.stdout:5/714: creat d0/d37/dba/fde x:0 0 0 2024-08-18T22:41:52.159 INFO:tasks.workunit.client.1.smithi195.stdout:5/715: fsync d0/d2/d29/d88/d6a/d96/fd6 0 2024-08-18T22:41:52.160 INFO:tasks.workunit.client.1.smithi195.stdout:5/716: mknod d0/d3/d8/d3b/db1/cdf 0 2024-08-18T22:41:52.166 INFO:tasks.workunit.client.1.smithi195.stdout:5/717: getdents d0 0 2024-08-18T22:41:52.168 INFO:tasks.workunit.client.0.smithi121.stdout:2/902: readlink d2/d8/d19/dc/l74 0 2024-08-18T22:41:52.168 INFO:tasks.workunit.client.1.smithi195.stdout:5/718: creat d0/d2/d53/fe0 x:0 0 0 2024-08-18T22:41:52.169 INFO:tasks.workunit.client.0.smithi121.stdout:2/903: fsync d2/d8/d19/d4a/d64/fbe 0 2024-08-18T22:41:52.170 INFO:tasks.workunit.client.0.smithi121.stdout:2/904: symlink d2/d8/d19/d55/l120 0 2024-08-18T22:41:52.174 INFO:tasks.workunit.client.0.smithi121.stdout:2/905: dread d2/d8/fa3 [0,4194304] 0 2024-08-18T22:41:52.175 INFO:tasks.workunit.client.0.smithi121.stdout:2/906: fsync d2/dd8/ddc/f111 0 2024-08-18T22:41:52.176 INFO:tasks.workunit.client.1.smithi195.stdout:5/719: dread d0/d2/d29/d88/d6a/d96/fc4 [0,4194304] 0 2024-08-18T22:41:52.184 INFO:tasks.workunit.client.1.smithi195.stdout:5/720: dwrite d0/d2/f55 [4194304,4194304] 0 2024-08-18T22:41:52.187 INFO:tasks.workunit.client.1.smithi195.stdout:5/721: mknod d0/d37/d8b/ce1 0 2024-08-18T22:41:52.188 INFO:tasks.workunit.client.1.smithi195.stdout:5/722: unlink d0/d2/f55 0 2024-08-18T22:41:52.189 INFO:tasks.workunit.client.1.smithi195.stdout:5/723: write d0/d3/d8/fb9 [1029890,73703] 0 2024-08-18T22:41:52.191 INFO:tasks.workunit.client.1.smithi195.stdout:5/724: truncate d0/d46/d6d/fa1 807287 0 2024-08-18T22:41:52.192 INFO:tasks.workunit.client.1.smithi195.stdout:5/725: read d0/d46/d6d/da2/fce [2591240,251] 0 2024-08-18T22:41:52.194 INFO:tasks.workunit.client.1.smithi195.stdout:5/726: unlink d0/d37/dba/fde 0 2024-08-18T22:41:52.195 INFO:tasks.workunit.client.1.smithi195.stdout:5/727: fdatasync d0/da6/fc8 0 2024-08-18T22:41:52.197 INFO:tasks.workunit.client.0.smithi121.stdout:2/907: dwrite d2/d8/f3f [0,4194304] 0 2024-08-18T22:41:52.200 INFO:tasks.workunit.client.0.smithi121.stdout:2/908: creat d2/d3/d51/f121 x:0 0 0 2024-08-18T22:41:52.200 INFO:tasks.workunit.client.0.smithi121.stdout:2/909: chown d2/dd8/ddc/c11d 5868931 1 2024-08-18T22:41:52.200 INFO:tasks.workunit.client.1.smithi195.stdout:5/728: dread d0/d3/d8/d64/f9d [0,4194304] 0 2024-08-18T22:41:52.201 INFO:tasks.workunit.client.1.smithi195.stdout:5/729: chown d0/db/f5d 1292 1 2024-08-18T22:41:52.203 INFO:tasks.workunit.client.0.smithi121.stdout:2/910: creat d2/dd8/ddc/f122 x:0 0 0 2024-08-18T22:41:52.204 INFO:tasks.workunit.client.0.smithi121.stdout:2/911: creat d2/d3/d51/d110/de4/f123 x:0 0 0 2024-08-18T22:41:52.207 INFO:tasks.workunit.client.1.smithi195.stdout:5/730: dread d0/d3/df/f74 [0,4194304] 0 2024-08-18T22:41:52.207 INFO:tasks.workunit.client.0.smithi121.stdout:2/912: symlink d2/d3/d48/d77/l124 0 2024-08-18T22:41:52.207 INFO:tasks.workunit.client.1.smithi195.stdout:5/731: chown d0/d46/f6c 2503137 1 2024-08-18T22:41:52.208 INFO:tasks.workunit.client.1.smithi195.stdout:5/732: read d0/d2/d29/db5/fc1 [1687338,118617] 0 2024-08-18T22:41:52.214 INFO:tasks.workunit.client.1.smithi195.stdout:5/733: dwrite d0/db/fd5 [0,4194304] 0 2024-08-18T22:41:52.216 INFO:tasks.workunit.client.1.smithi195.stdout:5/734: write d0/d3/df/d5a/fc0 [3498191,123084] 0 2024-08-18T22:41:52.226 INFO:tasks.workunit.client.1.smithi195.stdout:5/735: dwrite d0/d3/d5f/f6b [4194304,4194304] 0 2024-08-18T22:41:52.228 INFO:tasks.workunit.client.1.smithi195.stdout:5/736: write d0/d46/d6d/fa1 [1655781,70216] 0 2024-08-18T22:41:52.228 INFO:tasks.workunit.client.1.smithi195.stdout:5/737: fsync d0/d46/f9c 0 2024-08-18T22:41:52.231 INFO:tasks.workunit.client.1.smithi195.stdout:5/738: read d0/f4b [722448,64050] 0 2024-08-18T22:41:52.234 INFO:tasks.workunit.client.1.smithi195.stdout:5/739: getdents d0/db 0 2024-08-18T22:41:52.275 INFO:tasks.workunit.client.1.smithi195.stdout:8/737: sync 2024-08-18T22:41:52.275 INFO:tasks.workunit.client.1.smithi195.stdout:7/803: sync 2024-08-18T22:41:52.275 INFO:tasks.workunit.client.1.smithi195.stdout:1/873: sync 2024-08-18T22:41:52.276 INFO:tasks.workunit.client.1.smithi195.stdout:1/874: readlink da/d3d/l61 0 2024-08-18T22:41:52.277 INFO:tasks.workunit.client.1.smithi195.stdout:8/738: fdatasync d1/f2a 0 2024-08-18T22:41:52.278 INFO:tasks.workunit.client.1.smithi195.stdout:7/804: creat dc/d8f/d96/d10e/f114 x:0 0 0 2024-08-18T22:41:52.280 INFO:tasks.workunit.client.1.smithi195.stdout:8/739: rename d1/de/dac to d1/de/d112 0 2024-08-18T22:41:52.282 INFO:tasks.workunit.client.1.smithi195.stdout:7/805: mkdir dc/d8f/d96/dc5/de7/d115 0 2024-08-18T22:41:52.285 INFO:tasks.workunit.client.1.smithi195.stdout:7/806: link dc/d1d/d29/fbe dc/d22/f116 0 2024-08-18T22:41:52.287 INFO:tasks.workunit.client.1.smithi195.stdout:7/807: mkdir dc/d2a/d4c/d117 0 2024-08-18T22:41:52.287 INFO:tasks.workunit.client.1.smithi195.stdout:8/740: write d1/de/fa8 [1521321,92993] 0 2024-08-18T22:41:52.291 INFO:tasks.workunit.client.1.smithi195.stdout:8/741: symlink d1/d3/db/d35/d4d/d5c/de9/l113 0 2024-08-18T22:41:52.291 INFO:tasks.workunit.client.1.smithi195.stdout:1/875: dread da/d18/d28/f2e [0,4194304] 0 2024-08-18T22:41:52.293 INFO:tasks.workunit.client.1.smithi195.stdout:7/808: rename dc/d2a/d4c/db8 to dc/d1d/d29/d118 0 2024-08-18T22:41:52.294 INFO:tasks.workunit.client.1.smithi195.stdout:1/876: dread - da/d3d/f40 zero size 2024-08-18T22:41:52.295 INFO:tasks.workunit.client.1.smithi195.stdout:8/742: truncate d1/d3/db/d35/f7e 691001 0 2024-08-18T22:41:52.295 INFO:tasks.workunit.client.1.smithi195.stdout:8/743: readlink d1/de/d67/la2 0 2024-08-18T22:41:52.300 INFO:tasks.workunit.client.1.smithi195.stdout:1/877: link da/d18/d28/d7b/df2/db1/dd6/fed da/d3d/d11f/f130 0 2024-08-18T22:41:52.301 INFO:tasks.workunit.client.1.smithi195.stdout:8/744: truncate d1/d3/db/d7a/f84 293232 0 2024-08-18T22:41:52.301 INFO:tasks.workunit.client.1.smithi195.stdout:8/745: fsync d1/de/fab 0 2024-08-18T22:41:52.301 INFO:tasks.workunit.client.1.smithi195.stdout:7/809: mknod dc/d1d/d29/ddb/d10d/db6/df7/d10c/c119 0 2024-08-18T22:41:52.304 INFO:tasks.workunit.client.1.smithi195.stdout:1/878: creat da/d3d/f131 x:0 0 0 2024-08-18T22:41:52.305 INFO:tasks.workunit.client.1.smithi195.stdout:8/746: dread d1/d3/d1c/d21/f3f [0,4194304] 0 2024-08-18T22:41:52.308 INFO:tasks.workunit.client.1.smithi195.stdout:7/810: dwrite dc/f32 [0,4194304] 0 2024-08-18T22:41:52.311 INFO:tasks.workunit.client.1.smithi195.stdout:8/747: dread d1/de/df/fc0 [0,4194304] 0 2024-08-18T22:41:52.314 INFO:tasks.workunit.client.1.smithi195.stdout:1/879: dread da/f15 [0,4194304] 0 2024-08-18T22:41:52.397 INFO:tasks.workunit.client.1.smithi195.stdout:8/748: creat d1/de/d27/d4f/f114 x:0 0 0 2024-08-18T22:41:52.399 INFO:tasks.workunit.client.1.smithi195.stdout:1/880: creat da/d4c/d5d/dcb/d10f/dbd/ddb/d4e/d95/d9c/dc8/f132 x:0 0 0 2024-08-18T22:41:52.399 INFO:tasks.workunit.client.1.smithi195.stdout:1/881: chown da/d4c/d5d/c9e 216067 1 2024-08-18T22:41:52.420 INFO:tasks.workunit.client.1.smithi195.stdout:1/882: link da/f11 da/d4c/d5d/de8/d99/f133 0 2024-08-18T22:41:52.422 INFO:tasks.workunit.client.1.smithi195.stdout:1/883: mknod da/d4c/d5d/dcb/d10f/dbd/ddb/d4e/ddc/c134 0 2024-08-18T22:41:52.427 INFO:tasks.workunit.client.1.smithi195.stdout:8/749: dread d1/d3/db/d39/d2e/f77 [0,4194304] 0 2024-08-18T22:41:52.431 INFO:tasks.workunit.client.1.smithi195.stdout:8/750: rename d1/de/df/d1d/l26 to d1/de/df/d1d/de5/df8/l115 0 2024-08-18T22:41:52.432 INFO:tasks.workunit.client.1.smithi195.stdout:8/751: readlink d1/de/d27/la4 0 2024-08-18T22:41:52.434 INFO:tasks.workunit.client.1.smithi195.stdout:8/752: mknod d1/de/d27/c116 0 2024-08-18T22:41:52.436 INFO:tasks.workunit.client.1.smithi195.stdout:8/753: symlink d1/d3/db/l117 0 2024-08-18T22:41:52.439 INFO:tasks.workunit.client.1.smithi195.stdout:8/754: rename d1/d3/db/d35/c75 to d1/d64/c118 0 2024-08-18T22:41:52.445 INFO:tasks.workunit.client.1.smithi195.stdout:1/884: write da/d68/fb5 [631743,28982] 0 2024-08-18T22:41:52.446 INFO:tasks.workunit.client.1.smithi195.stdout:1/885: fsync da/d18/d28/f50 0 2024-08-18T22:41:52.447 INFO:tasks.workunit.client.1.smithi195.stdout:8/755: write d1/de/d112/fdd [266150,62072] 0 2024-08-18T22:41:52.448 INFO:tasks.workunit.client.1.smithi195.stdout:1/886: symlink da/d18/d28/dba/l135 0 2024-08-18T22:41:52.453 INFO:tasks.workunit.client.1.smithi195.stdout:1/887: dread da/d4c/d5d/dcb/d10f/dbd/ddb/d4e/d95/d9c/dc8/fce [0,4194304] 0 2024-08-18T22:41:52.454 INFO:tasks.workunit.client.1.smithi195.stdout:4/676: sync 2024-08-18T22:41:52.454 INFO:tasks.workunit.client.1.smithi195.stdout:3/805: sync 2024-08-18T22:41:52.456 INFO:tasks.workunit.client.1.smithi195.stdout:8/756: dwrite d1/f7d [0,4194304] 0 2024-08-18T22:41:52.456 INFO:tasks.workunit.client.1.smithi195.stdout:4/677: write d0/d99/d85/dc8/fdc [212638,111159] 0 2024-08-18T22:41:52.460 INFO:tasks.workunit.client.1.smithi195.stdout:1/888: rename da/d4c/d5d/ff1 to da/d4c/d5d/dcb/d10f/dbd/ddb/d4e/d95/d9c/dc8/f136 0 2024-08-18T22:41:52.462 INFO:tasks.workunit.client.1.smithi195.stdout:4/678: mknod d0/cf2 0 2024-08-18T22:41:52.462 INFO:tasks.workunit.client.1.smithi195.stdout:3/806: dread d7/da/df/d1c/d6a/f76 [0,4194304] 0 2024-08-18T22:41:52.464 INFO:tasks.workunit.client.1.smithi195.stdout:4/679: rename d0/f3 to d0/d7/d1d/d69/ff3 0 2024-08-18T22:41:52.468 INFO:tasks.workunit.client.1.smithi195.stdout:1/889: link da/d18/d28/fe2 da/d18/d28/dba/de1/f137 0 2024-08-18T22:41:52.469 INFO:tasks.workunit.client.1.smithi195.stdout:1/890: write da/d4c/f69 [2201246,55385] 0 2024-08-18T22:41:52.470 INFO:tasks.workunit.client.1.smithi195.stdout:4/680: read d0/d7/d1d/d69/ff3 [3590057,46910] 0 2024-08-18T22:41:52.470 INFO:tasks.workunit.client.1.smithi195.stdout:3/807: rename d7/d1f/c88 to d7/da/df/dca/c106 0 2024-08-18T22:41:52.472 INFO:tasks.workunit.client.1.smithi195.stdout:3/808: readlink d7/da/df/d8e/lec 0 2024-08-18T22:41:52.472 INFO:tasks.workunit.client.1.smithi195.stdout:1/891: mknod da/d4c/d5d/dcb/d10f/dbd/ddb/d4e/d95/d9c/c138 0 2024-08-18T22:41:52.473 INFO:tasks.workunit.client.1.smithi195.stdout:1/892: stat da/d18/d28/d31/la4 0 2024-08-18T22:41:52.475 INFO:tasks.workunit.client.1.smithi195.stdout:3/809: link d7/da/df/d1c/d6a/cee d7/dc3/c107 0 2024-08-18T22:41:52.476 INFO:tasks.workunit.client.1.smithi195.stdout:3/810: mknod d7/d1f/d73/dae/c108 0 2024-08-18T22:41:52.478 INFO:tasks.workunit.client.1.smithi195.stdout:3/811: creat d7/da/df/d8e/f109 x:0 0 0 2024-08-18T22:41:52.481 INFO:tasks.workunit.client.1.smithi195.stdout:1/893: dwrite da/d4c/d5d/dcb/d10f/dbd/ddb/d4e/d95/d9c/dc8/fce [0,4194304] 0 2024-08-18T22:41:52.482 INFO:tasks.workunit.client.1.smithi195.stdout:3/812: mknod d7/da/df/d1c/d6a/df1/c10a 0 2024-08-18T22:41:52.483 INFO:tasks.workunit.client.1.smithi195.stdout:4/681: dread d0/d99/d81/fe5 [0,4194304] 0 2024-08-18T22:41:52.485 INFO:tasks.workunit.client.1.smithi195.stdout:3/813: fdatasync d7/d54/f94 0 2024-08-18T22:41:52.486 INFO:tasks.workunit.client.0.smithi121.stdout:2/913: sync 2024-08-18T22:41:52.486 INFO:tasks.workunit.client.1.smithi195.stdout:4/682: chown d0/d7/d1d/d69/db7/d3b/d6f/fd6 0 1 2024-08-18T22:41:52.489 INFO:tasks.workunit.client.0.smithi121.stdout:2/914: truncate d2/f92 1023476 0 2024-08-18T22:41:52.490 INFO:tasks.workunit.client.0.smithi121.stdout:2/915: dread - d2/d3/d51/f9d zero size 2024-08-18T22:41:52.490 INFO:tasks.workunit.client.1.smithi195.stdout:1/894: getdents da/d68 0 2024-08-18T22:41:52.492 INFO:tasks.workunit.client.1.smithi195.stdout:1/895: chown da/d4c/d5d/dcb/d10f/dbd/ddb/d4e/d95/d9c/dc8/f10c 2541 1 2024-08-18T22:41:52.493 INFO:tasks.workunit.client.1.smithi195.stdout:3/814: rename d7/da/df/f3b to d7/f10b 0 2024-08-18T22:41:52.494 INFO:tasks.workunit.client.1.smithi195.stdout:1/896: dread da/d18/f123 [0,4194304] 0 2024-08-18T22:41:52.496 INFO:tasks.workunit.client.0.smithi121.stdout:2/916: dwrite d2/d8/fa9 [0,4194304] 0 2024-08-18T22:41:52.498 INFO:tasks.workunit.client.1.smithi195.stdout:4/683: write d0/d7/d1d/f27 [530088,112687] 0 2024-08-18T22:41:52.498 INFO:tasks.workunit.client.0.smithi121.stdout:2/917: mknod d2/d8/d19/d4a/d64/c125 0 2024-08-18T22:41:52.500 INFO:tasks.workunit.client.0.smithi121.stdout:2/918: rmdir d2/d3/d84 39 2024-08-18T22:41:52.502 INFO:tasks.workunit.client.0.smithi121.stdout:2/919: write d2/d8/d19/d55/ff8 [246232,130531] 0 2024-08-18T22:41:52.503 INFO:tasks.workunit.client.1.smithi195.stdout:3/815: dwrite d7/da/df/d1c/fef [0,4194304] 0 2024-08-18T22:41:52.504 INFO:tasks.workunit.client.0.smithi121.stdout:2/920: creat d2/d3/dd6/f126 x:0 0 0 2024-08-18T22:41:52.504 INFO:tasks.workunit.client.1.smithi195.stdout:1/897: dwrite da/d4c/d5d/dcb/fd0 [4194304,4194304] 0 2024-08-18T22:41:52.506 INFO:tasks.workunit.client.1.smithi195.stdout:3/816: symlink d7/d54/d9a/l10c 0 2024-08-18T22:41:52.509 INFO:tasks.workunit.client.1.smithi195.stdout:1/898: unlink da/d18/d28/d7b/ca0 0 2024-08-18T22:41:52.512 INFO:tasks.workunit.client.1.smithi195.stdout:1/899: chown da/d4c/d5d/dcb/d10f/dbd/ddb/d4e/d95/fd4 1559 1 2024-08-18T22:41:52.514 INFO:tasks.workunit.client.1.smithi195.stdout:1/900: dread - da/d18/d28/d7b/df2/db1/dd6/fed zero size 2024-08-18T22:41:52.517 INFO:tasks.workunit.client.0.smithi121.stdout:2/921: truncate d2/d3/f56 7732464 0 2024-08-18T22:41:52.518 INFO:tasks.workunit.client.0.smithi121.stdout:2/922: mknod d2/d8/c127 0 2024-08-18T22:41:52.521 INFO:tasks.workunit.client.1.smithi195.stdout:3/817: dwrite d7/da/df/d1c/f63 [0,4194304] 0 2024-08-18T22:41:52.525 INFO:tasks.workunit.client.0.smithi121.stdout:2/923: dwrite d2/d3/d51/d110/f112 [0,4194304] 0 2024-08-18T22:41:52.526 INFO:tasks.workunit.client.1.smithi195.stdout:3/818: getdents d7/da/df/d1c/dc6 0 2024-08-18T22:41:52.527 INFO:tasks.workunit.client.0.smithi121.stdout:2/924: chown d2/d8/d19/c34 26484302 1 2024-08-18T22:41:52.528 INFO:tasks.workunit.client.1.smithi195.stdout:1/901: write da/d4c/d5d/d63/f64 [3329544,23236] 0 2024-08-18T22:41:52.531 INFO:tasks.workunit.client.0.smithi121.stdout:2/925: creat d2/d3/d48/f128 x:0 0 0 2024-08-18T22:41:52.532 INFO:tasks.workunit.client.1.smithi195.stdout:3/819: creat d7/d54/d9a/f10d x:0 0 0 2024-08-18T22:41:52.533 INFO:tasks.workunit.client.0.smithi121.stdout:2/926: creat d2/d8/d1f/f129 x:0 0 0 2024-08-18T22:41:52.538 INFO:tasks.workunit.client.1.smithi195.stdout:3/820: mknod d7/da/df/d1c/c10e 0 2024-08-18T22:41:52.538 INFO:tasks.workunit.client.1.smithi195.stdout:3/821: fdatasync d7/f89 0 2024-08-18T22:41:52.538 INFO:tasks.workunit.client.0.smithi121.stdout:2/927: read d2/d3/d48/d77/fe3 [2399,109143] 0 2024-08-18T22:41:52.539 INFO:tasks.workunit.client.1.smithi195.stdout:3/822: getdents d7/df6 0 2024-08-18T22:41:52.540 INFO:tasks.workunit.client.1.smithi195.stdout:1/902: write da/d3d/d11f/f130 [510473,94905] 0 2024-08-18T22:41:52.543 INFO:tasks.workunit.client.1.smithi195.stdout:4/684: dread d0/d99/d85/f4e [0,4194304] 0 2024-08-18T22:41:52.544 INFO:tasks.workunit.client.0.smithi121.stdout:2/928: truncate d2/d8/d19/f9a 3298706 0 2024-08-18T22:41:52.544 INFO:tasks.workunit.client.1.smithi195.stdout:1/903: creat da/d18/d28/f139 x:0 0 0 2024-08-18T22:41:52.545 INFO:tasks.workunit.client.0.smithi121.stdout:2/929: write d2/f6 [3470536,58795] 0 2024-08-18T22:41:52.545 INFO:tasks.workunit.client.1.smithi195.stdout:4/685: stat d0/d7/d1d/d69/db7/d41/d66/l77 0 2024-08-18T22:41:52.546 INFO:tasks.workunit.client.0.smithi121.stdout:2/930: chown d2/d3/f8a 253473776 1 2024-08-18T22:41:52.547 INFO:tasks.workunit.client.1.smithi195.stdout:3/823: rename d7/da/le8 to d7/da/df/d8e/l10f 0 2024-08-18T22:41:52.547 INFO:tasks.workunit.client.0.smithi121.stdout:2/931: write d2/f6 [4641732,14226] 0 2024-08-18T22:41:52.548 INFO:tasks.workunit.client.1.smithi195.stdout:3/824: chown d7/da/df/d1c 5969464 1 2024-08-18T22:41:52.548 INFO:tasks.workunit.client.1.smithi195.stdout:1/904: mkdir da/d18/d13a 0 2024-08-18T22:41:52.548 INFO:tasks.workunit.client.0.smithi121.stdout:2/932: dread - d2/d3/dd6/f108 zero size 2024-08-18T22:41:52.548 INFO:tasks.workunit.client.1.smithi195.stdout:4/686: symlink d0/d7/d1d/d69/db7/d41/lf4 0 2024-08-18T22:41:52.549 INFO:tasks.workunit.client.1.smithi195.stdout:1/905: rmdir da/d4c/d5d/dcb 39 2024-08-18T22:41:52.550 INFO:tasks.workunit.client.1.smithi195.stdout:3/825: truncate d7/da/df/dca/d81/fc2 621954 0 2024-08-18T22:41:52.551 INFO:tasks.workunit.client.1.smithi195.stdout:3/826: fdatasync d7/da/df/fde 0 2024-08-18T22:41:52.551 INFO:tasks.workunit.client.0.smithi121.stdout:2/933: dread d2/d8/f107 [0,4194304] 0 2024-08-18T22:41:52.552 INFO:tasks.workunit.client.1.smithi195.stdout:4/687: mkdir d0/d99/d98/d16/d94/db2/da4/df5 0 2024-08-18T22:41:52.552 INFO:tasks.workunit.client.1.smithi195.stdout:3/827: dread - d7/d54/f94 zero size 2024-08-18T22:41:52.552 INFO:tasks.workunit.client.1.smithi195.stdout:1/906: mkdir da/d18/d28/d7b/df2/db1/dda/d13b 0 2024-08-18T22:41:52.553 INFO:tasks.workunit.client.1.smithi195.stdout:1/907: fdatasync da/d3d/d11f/f130 0 2024-08-18T22:41:52.553 INFO:tasks.workunit.client.1.smithi195.stdout:3/828: fdatasync d7/d54/fc7 0 2024-08-18T22:41:52.554 INFO:tasks.workunit.client.0.smithi121.stdout:2/934: creat d2/d3/d84/f12a x:0 0 0 2024-08-18T22:41:52.554 INFO:tasks.workunit.client.0.smithi121.stdout:2/935: chown d2/d8/d19/d55 18 1 2024-08-18T22:41:52.554 INFO:tasks.workunit.client.1.smithi195.stdout:3/829: fsync d7/da/df/d1c/d6a/d6c/fa5 0 2024-08-18T22:41:52.554 INFO:tasks.workunit.client.1.smithi195.stdout:4/688: mknod d0/d7/d1d/d69/db7/d3b/d6f/db0/cf6 0 2024-08-18T22:41:52.555 INFO:tasks.workunit.client.1.smithi195.stdout:4/689: stat d0/d7/d1d/d69/db7/d41 0 2024-08-18T22:41:52.555 INFO:tasks.workunit.client.0.smithi121.stdout:2/936: mkdir d2/d8/d19/d12b 0 2024-08-18T22:41:52.556 INFO:tasks.workunit.client.1.smithi195.stdout:1/908: creat da/d18/d28/d7b/df2/db1/dd6/f13c x:0 0 0 2024-08-18T22:41:52.557 INFO:tasks.workunit.client.0.smithi121.stdout:2/937: dread d2/d73/fb9 [0,4194304] 0 2024-08-18T22:41:52.557 INFO:tasks.workunit.client.1.smithi195.stdout:3/830: chown d7/d54/d9a/lda 2779 1 2024-08-18T22:41:52.558 INFO:tasks.workunit.client.0.smithi121.stdout:2/938: write d2/d73/ff9 [593977,94014] 0 2024-08-18T22:41:52.559 INFO:tasks.workunit.client.1.smithi195.stdout:4/690: dread d0/d99/d98/d16/d94/db2/f87 [0,4194304] 0 2024-08-18T22:41:52.560 INFO:tasks.workunit.client.1.smithi195.stdout:3/831: creat d7/da/df/d38/f110 x:0 0 0 2024-08-18T22:41:52.560 INFO:tasks.workunit.client.1.smithi195.stdout:1/909: mkdir da/d4c/d5d/dcb/d10f/dbd/ddb/d4e/d95/d9c/dc8/d13d 0 2024-08-18T22:41:52.561 INFO:tasks.workunit.client.1.smithi195.stdout:3/832: rmdir d7/d1f/d73/db0 39 2024-08-18T22:41:52.565 INFO:tasks.workunit.client.1.smithi195.stdout:3/833: creat d7/da/df/f111 x:0 0 0 2024-08-18T22:41:52.566 INFO:tasks.workunit.client.1.smithi195.stdout:3/834: chown d7/da/df/d1c/c2c 99108 1 2024-08-18T22:41:52.566 INFO:tasks.workunit.client.1.smithi195.stdout:3/835: chown d7/f89 47 1 2024-08-18T22:41:52.569 INFO:tasks.workunit.client.1.smithi195.stdout:3/836: unlink d7/da/df/d1c/d6a/d6c/cc1 0 2024-08-18T22:41:52.571 INFO:tasks.workunit.client.1.smithi195.stdout:3/837: mknod d7/d1f/d73/db0/c112 0 2024-08-18T22:41:52.573 INFO:tasks.workunit.client.1.smithi195.stdout:3/838: mkdir d7/da/d75/d113 0 2024-08-18T22:41:52.576 INFO:tasks.workunit.client.1.smithi195.stdout:4/691: dwrite d0/d7/d1d/f31 [0,4194304] 0 2024-08-18T22:41:52.576 INFO:tasks.workunit.client.1.smithi195.stdout:1/910: dwrite da/d18/d28/d7b/df2/f101 [0,4194304] 0 2024-08-18T22:41:52.581 INFO:tasks.workunit.client.1.smithi195.stdout:4/692: symlink d0/d7/d1d/d69/db4/lf7 0 2024-08-18T22:41:52.581 INFO:tasks.workunit.client.1.smithi195.stdout:9/737: sync 2024-08-18T22:41:52.585 INFO:tasks.workunit.client.1.smithi195.stdout:4/693: mknod d0/d7/d1d/d69/db7/d3b/d6f/cf8 0 2024-08-18T22:41:52.587 INFO:tasks.workunit.client.1.smithi195.stdout:1/911: mkdir da/d18/d28/d7b/df2/db1/dd6/df5/d10e/d13e 0 2024-08-18T22:41:52.589 INFO:tasks.workunit.client.1.smithi195.stdout:1/912: symlink da/d18/d28/d7b/df2/db1/l13f 0 2024-08-18T22:41:52.590 INFO:tasks.workunit.client.1.smithi195.stdout:4/694: symlink d0/d7/d1d/d69/db7/d3b/d6f/lf9 0 2024-08-18T22:41:52.591 INFO:tasks.workunit.client.1.smithi195.stdout:1/913: chown da/d4c/f9b 4338386 1 2024-08-18T22:41:52.592 INFO:tasks.workunit.client.1.smithi195.stdout:1/914: chown da/d3d/f40 786607 1 2024-08-18T22:41:52.592 INFO:tasks.workunit.client.1.smithi195.stdout:3/839: dread d7/da/df/dca/fbb [0,4194304] 0 2024-08-18T22:41:52.593 INFO:tasks.workunit.client.1.smithi195.stdout:3/840: chown d7/d1f/f34 1772 1 2024-08-18T22:41:52.594 INFO:tasks.workunit.client.1.smithi195.stdout:3/841: write d7/fad [5082331,56221] 0 2024-08-18T22:41:52.595 INFO:tasks.workunit.client.1.smithi195.stdout:4/695: rmdir d0/d99/d98/d16/d94/db2/de4 0 2024-08-18T22:41:52.597 INFO:tasks.workunit.client.1.smithi195.stdout:3/842: creat d7/d54/f114 x:0 0 0 2024-08-18T22:41:52.599 INFO:tasks.workunit.client.1.smithi195.stdout:4/696: write d0/d99/d85/d48/d4c/f63 [1749878,12754] 0 2024-08-18T22:41:52.601 INFO:tasks.workunit.client.1.smithi195.stdout:1/915: dwrite da/d18/d28/f12a [0,4194304] 0 2024-08-18T22:41:52.602 INFO:tasks.workunit.client.1.smithi195.stdout:3/843: mkdir d7/da/df/d8e/d115 0 2024-08-18T22:41:52.608 INFO:tasks.workunit.client.1.smithi195.stdout:4/697: rename d0/d7/d1d/d69/db7/d3b/dd5 to d0/d7/d1d/d69/db7/d41/d66/dfa 0 2024-08-18T22:41:52.610 INFO:tasks.workunit.client.1.smithi195.stdout:9/738: dwrite d1c/d32/d71/dbe/d98/fdc [0,4194304] 0 2024-08-18T22:41:52.610 INFO:tasks.workunit.client.1.smithi195.stdout:3/844: write d7/da/df/d1c/dc6/fcd [4777612,67197] 0 2024-08-18T22:41:52.613 INFO:tasks.workunit.client.1.smithi195.stdout:1/916: dwrite da/d4c/d5d/dcb/d10f/fd2 [0,4194304] 0 2024-08-18T22:41:52.613 INFO:tasks.workunit.client.1.smithi195.stdout:4/698: truncate d0/d7/fd4 5063294 0 2024-08-18T22:41:52.620 INFO:tasks.workunit.client.1.smithi195.stdout:4/699: mkdir d0/d99/d98/d16/d94/db2/dfb 0 2024-08-18T22:41:52.620 INFO:tasks.workunit.client.1.smithi195.stdout:1/917: rmdir da/d3d 39 2024-08-18T22:41:52.622 INFO:tasks.workunit.client.1.smithi195.stdout:9/739: dwrite f14 [4194304,4194304] 0 2024-08-18T22:41:52.623 INFO:tasks.workunit.client.1.smithi195.stdout:1/918: read da/f24 [4103764,3011] 0 2024-08-18T22:41:52.625 INFO:tasks.workunit.client.1.smithi195.stdout:3/845: unlink d7/da/df/d8e/l9c 0 2024-08-18T22:41:52.626 INFO:tasks.workunit.client.1.smithi195.stdout:4/700: mknod d0/d99/d98/db6/cfc 0 2024-08-18T22:41:52.627 INFO:tasks.workunit.client.1.smithi195.stdout:9/740: symlink d1c/d32/le7 0 2024-08-18T22:41:52.629 INFO:tasks.workunit.client.1.smithi195.stdout:3/846: rename d7/d54/f114 to d7/da/d75/d113/f116 0 2024-08-18T22:41:52.631 INFO:tasks.workunit.client.1.smithi195.stdout:9/741: getdents d1c/d74/de4 0 2024-08-18T22:41:52.632 INFO:tasks.workunit.client.1.smithi195.stdout:9/742: chown d1c/d32/d37/fad 2015465173 1 2024-08-18T22:41:52.633 INFO:tasks.workunit.client.1.smithi195.stdout:1/919: getdents da/d4c/d5d/de8/d99 0 2024-08-18T22:41:52.634 INFO:tasks.workunit.client.1.smithi195.stdout:9/743: fdatasync d1c/d32/db1/fb3 0 2024-08-18T22:41:52.639 INFO:tasks.workunit.client.1.smithi195.stdout:1/920: mknod da/d4c/c140 0 2024-08-18T22:41:52.639 INFO:tasks.workunit.client.1.smithi195.stdout:3/847: link d7/da/df/dca/d81/cd7 d7/da/df/d8e/de2/c117 0 2024-08-18T22:41:52.639 INFO:tasks.workunit.client.1.smithi195.stdout:9/744: symlink d1c/d32/d71/dbe/le8 0 2024-08-18T22:41:52.641 INFO:tasks.workunit.client.1.smithi195.stdout:3/848: fdatasync d7/da/df/dca/fbb 0 2024-08-18T22:41:52.645 INFO:tasks.workunit.client.1.smithi195.stdout:4/701: dwrite d0/d99/d81/f8d [0,4194304] 0 2024-08-18T22:41:52.646 INFO:tasks.workunit.client.1.smithi195.stdout:9/745: rename d1c/d32/d37/d4b/dc6/de5 to d1c/d32/de9 0 2024-08-18T22:41:52.647 INFO:tasks.workunit.client.1.smithi195.stdout:4/702: dread - d0/d99/d98/db6/dca/fbc zero size 2024-08-18T22:41:52.648 INFO:tasks.workunit.client.1.smithi195.stdout:9/746: chown d1c/d32/l57 8763 1 2024-08-18T22:41:52.650 INFO:tasks.workunit.client.1.smithi195.stdout:1/921: rename da/d4c/d5d/dcb/d10f/dbd/ddb/d4e/f51 to da/d18/d28/d7b/df2/db1/dd6/df5/d10e/d13e/f141 0 2024-08-18T22:41:52.650 INFO:tasks.workunit.client.1.smithi195.stdout:9/747: read d1c/f35 [745247,27766] 0 2024-08-18T22:41:52.651 INFO:tasks.workunit.client.1.smithi195.stdout:1/922: read da/d4c/d5d/de8/d99/fa8 [7891,19885] 0 2024-08-18T22:41:52.653 INFO:tasks.workunit.client.1.smithi195.stdout:9/748: creat d1c/d92/d9a/fea x:0 0 0 2024-08-18T22:41:52.655 INFO:tasks.workunit.client.1.smithi195.stdout:4/703: creat d0/d7/d1d/d69/db7/d6c/d95/ffd x:0 0 0 2024-08-18T22:41:52.657 INFO:tasks.workunit.client.1.smithi195.stdout:4/704: stat d0/d99/d98/d16/c72 0 2024-08-18T22:41:52.657 INFO:tasks.workunit.client.1.smithi195.stdout:4/705: stat d0/d7/d1d/d69/l7a 0 2024-08-18T22:41:52.660 INFO:tasks.workunit.client.1.smithi195.stdout:1/923: link da/d3d/c5a da/d4c/d5d/dcb/d10f/dbd/ddb/d4e/d95/d9c/dc8/c142 0 2024-08-18T22:41:52.671 INFO:tasks.workunit.client.1.smithi195.stdout:3/849: dread d7/fad [0,4194304] 0 2024-08-18T22:41:52.673 INFO:tasks.workunit.client.1.smithi195.stdout:4/706: dwrite d0/d7/f80 [0,4194304] 0 2024-08-18T22:41:52.675 INFO:tasks.workunit.client.1.smithi195.stdout:1/924: dwrite da/d18/d28/f2f [0,4194304] 0 2024-08-18T22:41:52.675 INFO:tasks.workunit.client.1.smithi195.stdout:3/850: creat d7/df6/f118 x:0 0 0 2024-08-18T22:41:52.677 INFO:tasks.workunit.client.1.smithi195.stdout:1/925: write da/d18/d28/d31/d77/f93 [1995030,75603] 0 2024-08-18T22:41:52.678 INFO:tasks.workunit.client.1.smithi195.stdout:1/926: readlink da/d4c/d5d/l6c 0 2024-08-18T22:41:52.679 INFO:tasks.workunit.client.1.smithi195.stdout:4/707: mkdir d0/d7/d1d/d69/db7/d3b/d6f/db0/dfe 0 2024-08-18T22:41:52.681 INFO:tasks.workunit.client.1.smithi195.stdout:1/927: symlink da/l143 0 2024-08-18T22:41:52.684 INFO:tasks.workunit.client.1.smithi195.stdout:4/708: write d0/d7/d1d/d69/ff3 [2955844,56250] 0 2024-08-18T22:41:52.684 INFO:tasks.workunit.client.1.smithi195.stdout:3/851: getdents d7/d1f/d49 0 2024-08-18T22:41:52.686 INFO:tasks.workunit.client.0.smithi121.stdout:2/939: sync 2024-08-18T22:41:52.686 INFO:tasks.workunit.client.1.smithi195.stdout:1/928: rename da/d4c/d5d/dcb/d10f/dbd/ddb/d4e/d95/d9c/l105 to da/d68/l144 0 2024-08-18T22:41:52.687 INFO:tasks.workunit.client.1.smithi195.stdout:3/852: mkdir d7/da/df/dca/d81/d119 0 2024-08-18T22:41:52.688 INFO:tasks.workunit.client.1.smithi195.stdout:1/929: dread - da/d4c/d5d/dcb/d10f/dbd/ddb/d4e/ddc/ff9 zero size 2024-08-18T22:41:52.689 INFO:tasks.workunit.client.1.smithi195.stdout:4/709: unlink d0/d99/d98/d16/dae/fe3 0 2024-08-18T22:41:52.689 INFO:tasks.workunit.client.0.smithi121.stdout:2/940: unlink d2/d3/d51/d110/f10f 0 2024-08-18T22:41:52.694 INFO:tasks.workunit.client.1.smithi195.stdout:3/853: link d7/da/d75/l102 d7/da/df/d8e/daa/df9/l11a 0 2024-08-18T22:41:52.695 INFO:tasks.workunit.client.0.smithi121.stdout:2/941: dwrite d2/d3/d51/d110/f112 [0,4194304] 0 2024-08-18T22:41:52.697 INFO:tasks.workunit.client.1.smithi195.stdout:3/854: write d7/da/df/d1c/d6a/d6c/f9f [1808804,121168] 0 2024-08-18T22:41:52.698 INFO:tasks.workunit.client.1.smithi195.stdout:3/855: chown d7/d1f/d49/l50 44098495 1 2024-08-18T22:41:52.699 INFO:tasks.workunit.client.0.smithi121.stdout:2/942: write d2/d3/d48/d77/fe3 [1139587,126667] 0 2024-08-18T22:41:52.700 INFO:tasks.workunit.client.0.smithi121.stdout:2/943: readlink d2/d8/d19/d55/lef 0 2024-08-18T22:41:52.700 INFO:tasks.workunit.client.1.smithi195.stdout:4/710: dread d0/d7/d1d/d69/db7/d3b/f5a [0,4194304] 0 2024-08-18T22:41:52.701 INFO:tasks.workunit.client.1.smithi195.stdout:3/856: truncate d7/da/df/f111 446565 0 2024-08-18T22:41:52.701 INFO:tasks.workunit.client.0.smithi121.stdout:2/944: fsync d2/d3/d51/ff4 0 2024-08-18T22:41:52.702 INFO:tasks.workunit.client.0.smithi121.stdout:2/945: chown d2/d8/d19/d4a/d64/fff 12829 1 2024-08-18T22:41:52.705 INFO:tasks.workunit.client.0.smithi121.stdout:2/946: getdents d2/dd8 0 2024-08-18T22:41:52.706 INFO:tasks.workunit.client.1.smithi195.stdout:1/930: write da/d18/f4d [127345,59302] 0 2024-08-18T22:41:52.709 INFO:tasks.workunit.client.0.smithi121.stdout:2/947: mkdir d2/d3/d53/dec/d115/d12c 0 2024-08-18T22:41:52.709 INFO:tasks.workunit.client.1.smithi195.stdout:1/931: creat da/d18/d28/d7b/df2/db1/dd6/df5/d10e/f145 x:0 0 0 2024-08-18T22:41:52.711 INFO:tasks.workunit.client.0.smithi121.stdout:2/948: symlink d2/d3/l12d 0 2024-08-18T22:41:52.711 INFO:tasks.workunit.client.1.smithi195.stdout:1/932: unlink da/d18/d43/c98 0 2024-08-18T22:41:52.711 INFO:tasks.workunit.client.0.smithi121.stdout:2/949: chown d2/d3/l12d 34225806 1 2024-08-18T22:41:52.712 INFO:tasks.workunit.client.1.smithi195.stdout:3/857: write d7/da/df/d8e/fbe [374500,92063] 0 2024-08-18T22:41:52.713 INFO:tasks.workunit.client.0.smithi121.stdout:2/950: symlink d2/dd8/ddc/l12e 0 2024-08-18T22:41:52.713 INFO:tasks.workunit.client.1.smithi195.stdout:3/858: truncate d7/d1f/d49/fdb 212667 0 2024-08-18T22:41:52.714 INFO:tasks.workunit.client.0.smithi121.stdout:2/951: chown d2/d8/d19/c37 1619 1 2024-08-18T22:41:52.715 INFO:tasks.workunit.client.0.smithi121.stdout:2/952: write d2/d73/f94 [3931823,25041] 0 2024-08-18T22:41:52.715 INFO:tasks.workunit.client.1.smithi195.stdout:3/859: creat d7/da/df/d1c/d6a/df1/f11b x:0 0 0 2024-08-18T22:41:52.717 INFO:tasks.workunit.client.1.smithi195.stdout:3/860: mkdir d7/da/df/d11c 0 2024-08-18T22:41:52.719 INFO:tasks.workunit.client.1.smithi195.stdout:3/861: mknod d7/da/df/d1c/d6a/c11d 0 2024-08-18T22:41:52.720 INFO:tasks.workunit.client.1.smithi195.stdout:3/862: chown d7/d54/d9a/fab 129206750 1 2024-08-18T22:41:52.721 INFO:tasks.workunit.client.1.smithi195.stdout:3/863: write d7/da/df/dca/fbb [39590,11553] 0 2024-08-18T22:41:52.722 INFO:tasks.workunit.client.0.smithi121.stdout:2/953: dwrite d2/dd8/ddc/f122 [0,4194304] 0 2024-08-18T22:41:52.724 INFO:tasks.workunit.client.1.smithi195.stdout:1/933: dwrite da/d4c/d5d/de8/d99/f133 [4194304,4194304] 0 2024-08-18T22:41:52.725 INFO:tasks.workunit.client.1.smithi195.stdout:3/864: fsync d7/da/fb 0 2024-08-18T22:41:52.725 INFO:tasks.workunit.client.0.smithi121.stdout:2/954: rename d2/d3/d48/c7a to d2/d3/d51/c12f 0 2024-08-18T22:41:52.727 INFO:tasks.workunit.client.0.smithi121.stdout:2/955: creat d2/d8/d1f/f130 x:0 0 0 2024-08-18T22:41:52.728 INFO:tasks.workunit.client.0.smithi121.stdout:2/956: dread - d2/d3/d51/d110/de4/f123 zero size 2024-08-18T22:41:52.729 INFO:tasks.workunit.client.0.smithi121.stdout:2/957: fsync d2/d8/d19/d4a/d64/f118 0 2024-08-18T22:41:52.730 INFO:tasks.workunit.client.1.smithi195.stdout:3/865: rename d7/da/df/f69 to d7/d54/d9a/f11e 0 2024-08-18T22:41:52.730 INFO:tasks.workunit.client.0.smithi121.stdout:2/958: stat d2/d3/d51/f121 0 2024-08-18T22:41:52.732 INFO:tasks.workunit.client.0.smithi121.stdout:2/959: creat d2/d8/d19/d55/f131 x:0 0 0 2024-08-18T22:41:52.733 INFO:tasks.workunit.client.1.smithi195.stdout:1/934: getdents da/d4c/d5d/dcb/d10f/dbd/ddb/d4e 0 2024-08-18T22:41:52.736 INFO:tasks.workunit.client.1.smithi195.stdout:1/935: mknod da/d18/d28/c146 0 2024-08-18T22:41:52.737 INFO:tasks.workunit.client.1.smithi195.stdout:3/866: truncate d7/d1f/f37 2289133 0 2024-08-18T22:41:52.737 INFO:tasks.workunit.client.1.smithi195.stdout:1/936: rmdir da/d3d 39 2024-08-18T22:41:52.742 INFO:tasks.workunit.client.1.smithi195.stdout:1/937: creat da/d18/d28/d31/d77/f147 x:0 0 0 2024-08-18T22:41:52.742 INFO:tasks.workunit.client.1.smithi195.stdout:1/938: chown da/d4c/d5d/dcb 0 1 2024-08-18T22:41:52.742 INFO:tasks.workunit.client.0.smithi121.stdout:2/960: dwrite d2/d8/d19/f93 [4194304,4194304] 0 2024-08-18T22:41:52.743 INFO:tasks.workunit.client.1.smithi195.stdout:1/939: mkdir da/d4c/d5d/dcb/d10f/dbd/ddb/d4e/d95/d9c/d148 0 2024-08-18T22:41:52.748 INFO:tasks.workunit.client.1.smithi195.stdout:3/867: dread d7/da/df/d38/f3f [0,4194304] 0 2024-08-18T22:41:52.749 INFO:tasks.workunit.client.1.smithi195.stdout:3/868: read - d7/da/df/d38/f86 zero size 2024-08-18T22:41:52.750 INFO:tasks.workunit.client.0.smithi121.stdout:2/961: dwrite d2/d8/d19/f13 [0,4194304] 0 2024-08-18T22:41:52.751 INFO:tasks.workunit.client.1.smithi195.stdout:3/869: write d7/da/df/d1c/f23 [374069,12298] 0 2024-08-18T22:41:52.754 INFO:tasks.workunit.client.1.smithi195.stdout:1/940: write da/d18/d28/f34 [1662803,110540] 0 2024-08-18T22:41:52.755 INFO:tasks.workunit.client.1.smithi195.stdout:3/870: creat d7/da/df/d8e/daa/df9/f11f x:0 0 0 2024-08-18T22:41:52.755 INFO:tasks.workunit.client.1.smithi195.stdout:1/941: read - da/d18/d28/dba/ff8 zero size 2024-08-18T22:41:52.756 INFO:tasks.workunit.client.0.smithi121.stdout:2/962: creat d2/d8/d19/dc/f132 x:0 0 0 2024-08-18T22:41:52.757 INFO:tasks.workunit.client.0.smithi121.stdout:2/963: chown d2/d8/d1f/fcc 4892 1 2024-08-18T22:41:52.759 INFO:tasks.workunit.client.0.smithi121.stdout:2/964: write d2/d3/d48/d77/f8c [5160460,111743] 0 2024-08-18T22:41:52.759 INFO:tasks.workunit.client.1.smithi195.stdout:3/871: creat d7/da/df/d8e/daa/f120 x:0 0 0 2024-08-18T22:41:52.765 INFO:tasks.workunit.client.1.smithi195.stdout:1/942: dwrite da/d18/d28/dba/f124 [0,4194304] 0 2024-08-18T22:41:52.767 INFO:tasks.workunit.client.1.smithi195.stdout:3/872: dwrite d7/d54/d9a/fd8 [0,4194304] 0 2024-08-18T22:41:52.770 INFO:tasks.workunit.client.1.smithi195.stdout:3/873: write d7/d1f/d73/fc0 [950571,62970] 0 2024-08-18T22:41:52.772 INFO:tasks.workunit.client.1.smithi195.stdout:3/874: truncate d7/da/df/d38/f8d 543122 0 2024-08-18T22:41:52.774 INFO:tasks.workunit.client.1.smithi195.stdout:3/875: symlink d7/da/df/dca/d81/l121 0 2024-08-18T22:41:52.776 INFO:tasks.workunit.client.1.smithi195.stdout:3/876: symlink d7/d54/d9a/l122 0 2024-08-18T22:41:52.781 INFO:tasks.workunit.client.1.smithi195.stdout:3/877: dwrite d7/d1f/d73/db0/fcb [0,4194304] 0 2024-08-18T22:41:52.786 INFO:tasks.workunit.client.1.smithi195.stdout:3/878: getdents d7/da/df/d1c/d6a 0 2024-08-18T22:41:52.788 INFO:tasks.workunit.client.1.smithi195.stdout:3/879: creat d7/da/df/d1c/dc6/f123 x:0 0 0 2024-08-18T22:41:52.791 INFO:tasks.workunit.client.1.smithi195.stdout:3/880: dread d7/f56 [0,4194304] 0 2024-08-18T22:41:52.792 INFO:tasks.workunit.client.1.smithi195.stdout:5/740: sync 2024-08-18T22:41:52.792 INFO:tasks.workunit.client.1.smithi195.stdout:0/747: sync 2024-08-18T22:41:52.792 INFO:tasks.workunit.client.1.smithi195.stdout:2/503: sync 2024-08-18T22:41:52.792 INFO:tasks.workunit.client.1.smithi195.stdout:6/697: sync 2024-08-18T22:41:52.795 INFO:tasks.workunit.client.1.smithi195.stdout:5/741: creat d0/d46/d6d/fe2 x:0 0 0 2024-08-18T22:41:52.795 INFO:tasks.workunit.client.1.smithi195.stdout:1/943: write da/d4c/d5d/d63/f65 [1883127,52904] 0 2024-08-18T22:41:52.795 INFO:tasks.workunit.client.1.smithi195.stdout:0/748: chown d0/dc/d64/d81/d44/d41/fb1 1019233741 1 2024-08-18T22:41:52.797 INFO:tasks.workunit.client.1.smithi195.stdout:2/504: unlink d1/d22/d65/l6b 0 2024-08-18T22:41:52.797 INFO:tasks.workunit.client.0.smithi121.stdout:2/965: dread d2/d8/d1f/f35 [0,4194304] 0 2024-08-18T22:41:52.801 INFO:tasks.workunit.client.1.smithi195.stdout:3/881: dwrite d7/da/df/d8e/daa/f120 [0,4194304] 0 2024-08-18T22:41:52.802 INFO:tasks.workunit.client.0.smithi121.stdout:2/966: dread d2/d3/d48/d77/fe3 [0,4194304] 0 2024-08-18T22:41:52.802 INFO:tasks.workunit.client.1.smithi195.stdout:0/749: write d0/dc/d25/d67/db8/fe4 [919182,13052] 0 2024-08-18T22:41:52.803 INFO:tasks.workunit.client.0.smithi121.stdout:2/967: symlink d2/d3/d48/d77/l133 0 2024-08-18T22:41:52.803 INFO:tasks.workunit.client.0.smithi121.stdout:2/968: fsync d2/f6 0 2024-08-18T22:41:52.804 INFO:tasks.workunit.client.1.smithi195.stdout:6/698: getdents da/d15/d1c 0 2024-08-18T22:41:52.805 INFO:tasks.workunit.client.1.smithi195.stdout:2/505: rename d1/d22/d51/c55 to d1/d97/c9e 0 2024-08-18T22:41:52.806 INFO:tasks.workunit.client.1.smithi195.stdout:3/882: fsync d7/da/df/d1c/fe4 0 2024-08-18T22:41:52.808 INFO:tasks.workunit.client.1.smithi195.stdout:1/944: symlink da/d4c/d5d/dcb/d10f/dbd/ddb/d4e/ddc/l149 0 2024-08-18T22:41:52.809 INFO:tasks.workunit.client.1.smithi195.stdout:0/750: write d0/dc/d11/d23/de9/fed [410573,116215] 0 2024-08-18T22:41:52.809 INFO:tasks.workunit.client.0.smithi121.stdout:2/969: dwrite d2/f6 [0,4194304] 0 2024-08-18T22:41:52.813 INFO:tasks.workunit.client.0.smithi121.stdout:2/970: symlink d2/d3/d48/d77/d11f/l134 0 2024-08-18T22:41:52.813 INFO:tasks.workunit.client.1.smithi195.stdout:0/751: stat d0/dc/d64/cb3 0 2024-08-18T22:41:52.814 INFO:tasks.workunit.client.1.smithi195.stdout:1/945: mknod da/d4c/d5d/d63/c14a 0 2024-08-18T22:41:52.814 INFO:tasks.workunit.client.1.smithi195.stdout:5/742: dwrite d0/d3/d8/d64/fcd [0,4194304] 0 2024-08-18T22:41:52.815 INFO:tasks.workunit.client.1.smithi195.stdout:3/883: dread d7/da/df/d95/f9d [0,4194304] 0 2024-08-18T22:41:52.815 INFO:tasks.workunit.client.0.smithi121.stdout:2/971: truncate d2/d8/d19/f52 8827163 0 2024-08-18T22:41:52.818 INFO:tasks.workunit.client.0.smithi121.stdout:2/972: fsync d2/d8/d19/dc/f2d 0 2024-08-18T22:41:52.819 INFO:tasks.workunit.client.1.smithi195.stdout:0/752: stat d0/dc/d64/d81/d44/d41/d6d/d92/lae 0 2024-08-18T22:41:52.819 INFO:tasks.workunit.client.1.smithi195.stdout:2/506: dread d1/d24/d26/d42/d72/d85/f68 [0,4194304] 0 2024-08-18T22:41:52.820 INFO:tasks.workunit.client.1.smithi195.stdout:5/743: creat d0/d3/d66/daa/dd3/fe3 x:0 0 0 2024-08-18T22:41:52.822 INFO:tasks.workunit.client.1.smithi195.stdout:1/946: creat da/d4c/d5d/f14b x:0 0 0 2024-08-18T22:41:52.823 INFO:tasks.workunit.client.1.smithi195.stdout:2/507: dread - d1/d8/d3d/d3b/d7d/f82 zero size 2024-08-18T22:41:52.824 INFO:tasks.workunit.client.1.smithi195.stdout:6/699: dwrite da/db/d19/f27 [0,4194304] 0 2024-08-18T22:41:52.825 INFO:tasks.workunit.client.1.smithi195.stdout:5/744: chown d0/d2/d29/d88/d6a/d96/fc4 14868591 1 2024-08-18T22:41:52.826 INFO:tasks.workunit.client.1.smithi195.stdout:0/753: mknod d0/dc/d64/d81/d44/d41/d6d/d92/d66/cf2 0 2024-08-18T22:41:52.827 INFO:tasks.workunit.client.1.smithi195.stdout:2/508: creat d1/d97/f9f x:0 0 0 2024-08-18T22:41:52.830 INFO:tasks.workunit.client.1.smithi195.stdout:0/754: truncate d0/dc/d25/d67/db8/fe4 1555122 0 2024-08-18T22:41:52.832 INFO:tasks.workunit.client.1.smithi195.stdout:0/755: stat d0/dc/d11/d23/f45 0 2024-08-18T22:41:52.833 INFO:tasks.workunit.client.1.smithi195.stdout:5/745: dread d0/d2/d29/d88/d90/f91 [0,4194304] 0 2024-08-18T22:41:52.833 INFO:tasks.workunit.client.1.smithi195.stdout:2/509: dread d1/d8/d3d/f18 [0,4194304] 0 2024-08-18T22:41:52.834 INFO:tasks.workunit.client.1.smithi195.stdout:5/746: write d0/f77 [5098800,112186] 0 2024-08-18T22:41:52.836 INFO:tasks.workunit.client.1.smithi195.stdout:5/747: creat d0/d2/d29/fe4 x:0 0 0 2024-08-18T22:41:52.844 INFO:tasks.workunit.client.0.smithi121.stdout:2/973: write d2/d8/d19/d55/f70 [1331285,6506] 0 2024-08-18T22:41:52.845 INFO:tasks.workunit.client.0.smithi121.stdout:2/974: chown d2/d8/d19/f104 446 1 2024-08-18T22:41:52.846 INFO:tasks.workunit.client.0.smithi121.stdout:2/975: creat d2/d8/d1f/f135 x:0 0 0 2024-08-18T22:41:52.851 INFO:tasks.workunit.client.0.smithi121.stdout:2/976: write d2/d3/fe5 [1034057,4079] 0 2024-08-18T22:41:52.852 INFO:tasks.workunit.client.0.smithi121.stdout:2/977: chown d2/d73/lb3 271 1 2024-08-18T22:41:52.856 INFO:tasks.workunit.client.0.smithi121.stdout:2/978: dread d2/d3/d48/d77/f8c [4194304,4194304] 0 2024-08-18T22:41:52.861 INFO:tasks.workunit.client.0.smithi121.stdout:2/979: dwrite d2/d3/f10a [0,4194304] 0 2024-08-18T22:41:52.862 INFO:tasks.workunit.client.0.smithi121.stdout:2/980: fdatasync d2/d3/d51/d110/fb6 0 2024-08-18T22:41:52.865 INFO:tasks.workunit.client.0.smithi121.stdout:2/981: rename d2/d3/l12d to d2/d8/l136 0 2024-08-18T22:41:52.866 INFO:tasks.workunit.client.0.smithi121.stdout:2/982: readlink d2/d8/d19/dc/lac 0 2024-08-18T22:41:52.867 INFO:tasks.workunit.client.0.smithi121.stdout:2/983: getdents d2/d3/d53/dec/d115/d12c 0 2024-08-18T22:41:52.868 INFO:tasks.workunit.client.0.smithi121.stdout:2/984: stat d2/d8/d19/dc/ld5 0 2024-08-18T22:41:52.870 INFO:tasks.workunit.client.0.smithi121.stdout:2/985: creat d2/d8/d19/dc/f137 x:0 0 0 2024-08-18T22:41:52.871 INFO:tasks.workunit.client.0.smithi121.stdout:2/986: dread - d2/d8/d19/dc/f132 zero size 2024-08-18T22:41:52.871 INFO:tasks.workunit.client.0.smithi121.stdout:2/987: dread - d2/d3/d51/f121 zero size 2024-08-18T22:41:52.872 INFO:tasks.workunit.client.0.smithi121.stdout:2/988: chown d2/d3/d48/d77/f6d 235852 1 2024-08-18T22:41:52.873 INFO:tasks.workunit.client.0.smithi121.stdout:2/989: mknod d2/d8/d19/d4a/c138 0 2024-08-18T22:41:52.874 INFO:tasks.workunit.client.0.smithi121.stdout:2/990: getdents d2/d3/d53/dec/d11e 0 2024-08-18T22:41:52.876 INFO:tasks.workunit.client.0.smithi121.stdout:2/991: creat d2/d3/d84/d106/d116/f139 x:0 0 0 2024-08-18T22:41:52.877 INFO:tasks.workunit.client.0.smithi121.stdout:2/992: unlink d2/d73/fc1 0 2024-08-18T22:41:52.880 INFO:tasks.workunit.client.0.smithi121.stdout:2/993: dread d2/d8/d19/f9a [0,4194304] 0 2024-08-18T22:41:52.883 INFO:tasks.workunit.client.0.smithi121.stdout:2/994: dread d2/d73/f94 [0,4194304] 0 2024-08-18T22:41:52.890 INFO:tasks.workunit.client.1.smithi195.stdout:2/510: rename d1/d8/d3d/d3b/f3f to d1/d24/d26/d42/d44/d87/fa0 0 2024-08-18T22:41:52.892 INFO:tasks.workunit.client.1.smithi195.stdout:3/884: write d7/da/df/d38/f4a [1191625,21149] 0 2024-08-18T22:41:52.904 INFO:tasks.workunit.client.1.smithi195.stdout:5/748: dread d0/d3/d8/f14 [0,4194304] 0 2024-08-18T22:41:52.958 INFO:tasks.workunit.client.1.smithi195.stdout:9/749: sync 2024-08-18T22:41:52.958 INFO:tasks.workunit.client.1.smithi195.stdout:8/757: sync 2024-08-18T22:41:52.958 INFO:tasks.workunit.client.1.smithi195.stdout:7/811: sync 2024-08-18T22:41:52.958 INFO:tasks.workunit.client.1.smithi195.stdout:8/758: stat d1/d64/f73 0 2024-08-18T22:41:52.959 INFO:tasks.workunit.client.1.smithi195.stdout:1/947: write da/d4c/d5d/dcb/d10f/dbd/ddb/d4e/f8b [4987464,116243] 0 2024-08-18T22:41:52.961 INFO:tasks.workunit.client.1.smithi195.stdout:5/749: read d0/d3/d8/d64/fac [653236,75095] 0 2024-08-18T22:41:52.961 INFO:tasks.workunit.client.1.smithi195.stdout:7/812: mknod dc/d1d/d29/ddb/d15/c11a 0 2024-08-18T22:41:52.962 INFO:tasks.workunit.client.1.smithi195.stdout:5/750: dread - d0/db/fdd zero size 2024-08-18T22:41:52.966 INFO:tasks.workunit.client.1.smithi195.stdout:3/885: rename d7/d1f/c29 to d7/da/df/dca/d81/c124 0 2024-08-18T22:41:52.967 INFO:tasks.workunit.client.1.smithi195.stdout:2/511: write d1/d24/f56 [902048,8542] 0 2024-08-18T22:41:52.968 INFO:tasks.workunit.client.1.smithi195.stdout:8/759: write d1/de/d27/d4f/dde/fea [162022,7278] 0 2024-08-18T22:41:52.969 INFO:tasks.workunit.client.1.smithi195.stdout:1/948: mkdir da/d3d/d11f/d14c 0 2024-08-18T22:41:52.970 INFO:tasks.workunit.client.1.smithi195.stdout:1/949: stat da/d18/c23 0 2024-08-18T22:41:52.970 INFO:tasks.workunit.client.1.smithi195.stdout:2/512: chown d1/d24/d26/d42/d44/f57 0 1 2024-08-18T22:41:52.972 INFO:tasks.workunit.client.1.smithi195.stdout:7/813: rename dc/d1d/d29/ddb/d10d/db6/dd0 to dc/d8f/d96/dc5/d11b 0 2024-08-18T22:41:52.975 INFO:tasks.workunit.client.1.smithi195.stdout:3/886: rename d7/da/df/f27 to d7/da/df/d38/f125 0 2024-08-18T22:41:52.975 INFO:tasks.workunit.client.1.smithi195.stdout:2/513: truncate d1/d8/d3d/f48 2704278 0 2024-08-18T22:41:52.977 INFO:tasks.workunit.client.1.smithi195.stdout:1/950: rename da/d4c/d5d/de8/d99/lfd to da/d4c/d5d/dcb/d10f/dbd/ddb/d4e/d95/d9c/d148/l14d 0 2024-08-18T22:41:52.978 INFO:tasks.workunit.client.1.smithi195.stdout:1/951: chown da/d18/d28/d31/f12b 243599 1 2024-08-18T22:41:52.978 INFO:tasks.workunit.client.1.smithi195.stdout:3/887: truncate d7/d1f/f60 1024954 0 2024-08-18T22:41:52.981 INFO:tasks.workunit.client.1.smithi195.stdout:1/952: symlink da/d18/d28/l14e 0 2024-08-18T22:41:52.983 INFO:tasks.workunit.client.1.smithi195.stdout:3/888: rename f6 to d7/da/df/d1c/d6a/df1/f126 0 2024-08-18T22:41:52.986 INFO:tasks.workunit.client.1.smithi195.stdout:3/889: truncate d7/fc 1625564 0 2024-08-18T22:41:52.987 INFO:tasks.workunit.client.1.smithi195.stdout:8/760: truncate d1/d3/db/d35/d4d/d95/fa0 2561280 0 2024-08-18T22:41:52.989 INFO:tasks.workunit.client.1.smithi195.stdout:7/814: dread dc/d1d/d29/ddb/d15/f71 [0,4194304] 0 2024-08-18T22:41:52.990 INFO:tasks.workunit.client.1.smithi195.stdout:3/890: mknod d7/da/df/d8e/d115/c127 0 2024-08-18T22:41:52.990 INFO:tasks.workunit.client.1.smithi195.stdout:8/761: truncate d1/de/df/d1d/d1f/f98 1105501 0 2024-08-18T22:41:52.991 INFO:tasks.workunit.client.1.smithi195.stdout:1/953: rename da/d3d/c5a to da/d18/d28/d31/c14f 0 2024-08-18T22:41:52.992 INFO:tasks.workunit.client.1.smithi195.stdout:3/891: creat d7/d54/f128 x:0 0 0 2024-08-18T22:41:52.993 INFO:tasks.workunit.client.1.smithi195.stdout:8/762: symlink d1/dca/l119 0 2024-08-18T22:41:52.994 INFO:tasks.workunit.client.1.smithi195.stdout:7/815: creat dc/d1d/d29/ddb/d10d/db6/df7/f11c x:0 0 0 2024-08-18T22:41:52.996 INFO:tasks.workunit.client.1.smithi195.stdout:1/954: rename da/d4c/d5d/dcb/d10f/dbd/f10a to da/d4c/d5d/dcb/d10f/dbd/ddb/d4e/d95/d9c/dc8/f150 0 2024-08-18T22:41:52.998 INFO:tasks.workunit.client.1.smithi195.stdout:8/763: creat d1/d3/db/d35/d4d/d5c/de9/f11a x:0 0 0 2024-08-18T22:41:52.999 INFO:tasks.workunit.client.1.smithi195.stdout:1/955: mknod da/d3d/de0/c151 0 2024-08-18T22:41:53.001 INFO:tasks.workunit.client.1.smithi195.stdout:8/764: mknod d1/de/df/d1d/de5/c11b 0 2024-08-18T22:41:53.002 INFO:tasks.workunit.client.1.smithi195.stdout:1/956: mknod da/d68/c152 0 2024-08-18T22:41:53.003 INFO:tasks.workunit.client.1.smithi195.stdout:7/816: link dc/d8f/d96/dc5/l101 dc/d1d/d29/ddb/d2b/d81/d9c/l11d 0 2024-08-18T22:41:53.004 INFO:tasks.workunit.client.0.smithi121.stdout:2/995: sync 2024-08-18T22:41:53.005 INFO:tasks.workunit.client.1.smithi195.stdout:7/817: truncate dc/d1d/d29/df0/ff8 579617 0 2024-08-18T22:41:53.006 INFO:tasks.workunit.client.1.smithi195.stdout:1/957: rmdir da/d18/d28/d7b/df2/db1 39 2024-08-18T22:41:53.011 INFO:tasks.workunit.client.1.smithi195.stdout:3/892: truncate d7/da/df/d1c/d6a/d6c/f9f 479573 0 2024-08-18T22:41:53.012 INFO:tasks.workunit.client.1.smithi195.stdout:7/818: dread dc/f1e [0,4194304] 0 2024-08-18T22:41:53.015 INFO:tasks.workunit.client.1.smithi195.stdout:7/819: read - dc/d1d/d29/ddb/d15/d4d/d97/dfe/f108 zero size 2024-08-18T22:41:53.017 INFO:tasks.workunit.client.1.smithi195.stdout:7/820: mknod dc/d8f/d96/dc5/de7/c11e 0 2024-08-18T22:41:53.018 INFO:tasks.workunit.client.1.smithi195.stdout:3/893: link d7/da/f6b d7/da/df/d11c/f129 0 2024-08-18T22:41:53.019 INFO:tasks.workunit.client.1.smithi195.stdout:7/821: creat dc/d1d/d29/ddb/d2b/d81/f11f x:0 0 0 2024-08-18T22:41:53.020 INFO:tasks.workunit.client.1.smithi195.stdout:3/894: symlink d7/d1f/d73/dae/l12a 0 2024-08-18T22:41:53.021 INFO:tasks.workunit.client.1.smithi195.stdout:7/822: mkdir dc/d8f/d96/dc5/d120 0 2024-08-18T22:41:53.022 INFO:tasks.workunit.client.1.smithi195.stdout:8/765: dread d1/de/df/fb4 [0,4194304] 0 2024-08-18T22:41:53.024 INFO:tasks.workunit.client.1.smithi195.stdout:3/895: getdents d7/da/df/d1c/d6a/df1 0 2024-08-18T22:41:53.025 INFO:tasks.workunit.client.1.smithi195.stdout:8/766: mkdir d1/de/df/d1d/de5/dff/d11c 0 2024-08-18T22:41:53.029 INFO:tasks.workunit.client.1.smithi195.stdout:7/823: creat dc/d1d/d29/ddb/d10d/db6/f121 x:0 0 0 2024-08-18T22:41:53.031 INFO:tasks.workunit.client.1.smithi195.stdout:3/896: creat d7/da/df/f12b x:0 0 0 2024-08-18T22:41:53.032 INFO:tasks.workunit.client.1.smithi195.stdout:3/897: chown d7/d54/d9a/lda 16657415 1 2024-08-18T22:41:53.033 INFO:tasks.workunit.client.1.smithi195.stdout:8/767: rmdir d1/d3/db/d10f 0 2024-08-18T22:41:53.036 INFO:tasks.workunit.client.1.smithi195.stdout:3/898: dread d7/da/df/d38/fa1 [0,4194304] 0 2024-08-18T22:41:53.036 INFO:tasks.workunit.client.1.smithi195.stdout:7/824: link dc/d1d/c20 dc/d1d/d29/ddb/d15/d4d/d97/c122 0 2024-08-18T22:41:53.037 INFO:tasks.workunit.client.1.smithi195.stdout:8/768: symlink d1/d3/db/d39/d44/d79/df2/l11d 0 2024-08-18T22:41:53.037 INFO:tasks.workunit.client.1.smithi195.stdout:3/899: fdatasync d7/da/df/d38/f110 0 2024-08-18T22:41:53.039 INFO:tasks.workunit.client.1.smithi195.stdout:8/769: mknod d1/de/d67/c11e 0 2024-08-18T22:41:53.040 INFO:tasks.workunit.client.1.smithi195.stdout:7/825: mkdir dc/d1d/d29/ddb/d15/d4d/d97/dfe/d18/d89/d123 0 2024-08-18T22:41:53.041 INFO:tasks.workunit.client.1.smithi195.stdout:3/900: mkdir d7/da/df/dca/d12c 0 2024-08-18T22:41:53.042 INFO:tasks.workunit.client.1.smithi195.stdout:8/770: read d1/d3/db/d35/d56/f90 [143986,115985] 0 2024-08-18T22:41:53.042 INFO:tasks.workunit.client.1.smithi195.stdout:7/826: mknod dc/d8f/d96/dc5/de7/c124 0 2024-08-18T22:41:53.043 INFO:tasks.workunit.client.1.smithi195.stdout:8/771: stat d1/d3/db/d35/d4d 0 2024-08-18T22:41:53.043 INFO:tasks.workunit.client.1.smithi195.stdout:3/901: symlink d7/da/df/dca/d81/l12d 0 2024-08-18T22:41:53.045 INFO:tasks.workunit.client.1.smithi195.stdout:7/827: mkdir dc/d2a/d4c/d117/d125 0 2024-08-18T22:41:53.045 INFO:tasks.workunit.client.1.smithi195.stdout:7/828: readlink dc/d1d/lda 0 2024-08-18T22:41:53.049 INFO:tasks.workunit.client.1.smithi195.stdout:3/902: getdents d7/da/df/d8e/daa 0 2024-08-18T22:41:53.056 INFO:tasks.workunit.client.1.smithi195.stdout:3/903: write d7/f56 [1035592,41917] 0 2024-08-18T22:41:53.058 INFO:tasks.workunit.client.1.smithi195.stdout:3/904: write d7/da/df/d1c/fef [278513,35860] 0 2024-08-18T22:41:53.060 INFO:tasks.workunit.client.1.smithi195.stdout:8/772: dwrite d1/d3/db/d39/d44/d8c/fc9 [0,4194304] 0 2024-08-18T22:41:53.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:41:52 smithi121 ceph-mon[16788]: pgmap v10: 65 pgs: 65 active+clean; 3.3 GiB data, 11 GiB used, 525 GiB / 536 GiB avail; 97 MiB/s rd, 265 MiB/s wr, 526 op/s 2024-08-18T22:41:53.133 INFO:tasks.workunit.client.0.smithi121.stdout:2/996: sync 2024-08-18T22:41:53.137 INFO:tasks.workunit.client.0.smithi121.stdout:2/997: stat d2/d8/d19/d4a/d64/l101 0 2024-08-18T22:41:53.138 INFO:tasks.workunit.client.0.smithi121.stdout:2/998: write d2/d8/d19/d4a/d64/fbe [2095864,47695] 0 2024-08-18T22:41:53.151 INFO:tasks.workunit.client.0.smithi121.stdout:2/999: dread d2/d8/d19/f7b [0,4194304] 0 2024-08-18T22:41:53.153 INFO:tasks.workunit.client.1.smithi195.stdout:7/829: dread dc/d8f/d96/fc6 [0,4194304] 0 2024-08-18T22:41:53.154 INFO:tasks.workunit.client.1.smithi195.stdout:8/773: truncate d1/d3/db/d39/d44/d79/dd9/f109 1198532 0 2024-08-18T22:41:53.156 INFO:tasks.workunit.client.1.smithi195.stdout:7/830: symlink dc/d1d/d29/ddb/d10d/db6/l126 0 2024-08-18T22:41:53.158 INFO:tasks.workunit.client.1.smithi195.stdout:8/774: link d1/d3/db/d35/d4d/d95/daf/fdc d1/de/df/f11f 0 2024-08-18T22:41:53.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:41:52 smithi195 ceph-mon[23370]: pgmap v10: 65 pgs: 65 active+clean; 3.3 GiB data, 11 GiB used, 525 GiB / 536 GiB avail; 97 MiB/s rd, 265 MiB/s wr, 526 op/s 2024-08-18T22:41:53.162 INFO:tasks.workunit.client.1.smithi195.stdout:4/711: sync 2024-08-18T22:41:53.164 INFO:tasks.workunit.client.1.smithi195.stdout:4/712: symlink d0/d7/d1d/d69/db7/d3b/d6f/db0/lff 0 2024-08-18T22:41:53.166 INFO:tasks.workunit.client.1.smithi195.stdout:7/831: dread dc/d1d/d29/ddb/d2b/d81/d9c/f9e [0,4194304] 0 2024-08-18T22:41:53.169 INFO:tasks.workunit.client.1.smithi195.stdout:8/775: dwrite d1/d64/f80 [0,4194304] 0 2024-08-18T22:41:53.170 INFO:tasks.workunit.client.1.smithi195.stdout:8/776: chown d1/de/df/d1d 296 1 2024-08-18T22:41:53.172 INFO:tasks.workunit.client.1.smithi195.stdout:4/713: truncate d0/d99/d98/fd7 909 0 2024-08-18T22:41:53.175 INFO:tasks.workunit.client.1.smithi195.stdout:4/714: creat d0/d99/d98/db6/f100 x:0 0 0 2024-08-18T22:41:53.177 INFO:tasks.workunit.client.1.smithi195.stdout:4/715: write d0/d99/d81/f8d [416775,41316] 0 2024-08-18T22:41:53.178 INFO:tasks.workunit.client.1.smithi195.stdout:7/832: rename dc/d1d/d29/ddb/d10d/db6/fc4 to dc/d1d/d29/f127 0 2024-08-18T22:41:53.181 INFO:tasks.workunit.client.1.smithi195.stdout:4/716: write d0/d99/d98/d16/d94/db2/da4/dad/fef [322225,68824] 0 2024-08-18T22:41:53.182 INFO:tasks.workunit.client.1.smithi195.stdout:7/833: creat dc/d1d/d29/ddb/d10d/db6/df7/f128 x:0 0 0 2024-08-18T22:41:53.186 INFO:tasks.workunit.client.1.smithi195.stdout:8/777: dwrite d1/d3/d1c/d21/f3f [0,4194304] 0 2024-08-18T22:41:53.191 INFO:tasks.workunit.client.1.smithi195.stdout:7/834: getdents dc/d8f/d96/d10e 0 2024-08-18T22:41:53.191 INFO:tasks.workunit.client.1.smithi195.stdout:8/778: write d1/d3/db/d35/d4d/d8b/fb6 [181927,104727] 0 2024-08-18T22:41:53.192 INFO:tasks.workunit.client.1.smithi195.stdout:7/835: dread - dc/d1d/d29/ddb/d10d/db6/f121 zero size 2024-08-18T22:41:53.195 INFO:tasks.workunit.client.1.smithi195.stdout:8/779: creat d1/f120 x:0 0 0 2024-08-18T22:41:53.211 INFO:tasks.workunit.client.1.smithi195.stdout:7/836: truncate dc/f32 2662822 0 2024-08-18T22:41:53.215 INFO:tasks.workunit.client.1.smithi195.stdout:7/837: mknod dc/d1d/d29/ddb/d15/d4d/d97/dfe/d18/d89/d123/c129 0 2024-08-18T22:41:53.215 INFO:tasks.workunit.client.1.smithi195.stdout:8/780: dwrite d1/d3/db/d35/d4d/d5c/ddf/d107/f10e [0,4194304] 0 2024-08-18T22:41:53.218 INFO:tasks.workunit.client.1.smithi195.stdout:8/781: unlink d1/de/d31/d5a/l6c 0 2024-08-18T22:41:53.220 INFO:tasks.workunit.client.1.smithi195.stdout:4/717: dread d0/d99/d98/d16/d94/db2/da4/fce [0,4194304] 0 2024-08-18T22:41:53.220 INFO:tasks.workunit.client.1.smithi195.stdout:8/782: creat d1/de/df/d1d/de5/f121 x:0 0 0 2024-08-18T22:41:53.221 INFO:tasks.workunit.client.1.smithi195.stdout:4/718: chown d0/d7/d1d/c71 1715320 1 2024-08-18T22:41:53.222 INFO:tasks.workunit.client.1.smithi195.stdout:8/783: fsync d1/de/f54 0 2024-08-18T22:41:53.224 INFO:tasks.workunit.client.1.smithi195.stdout:4/719: unlink d0/d7/d1d/d69/db4/lf7 0 2024-08-18T22:41:53.234 INFO:tasks.workunit.client.1.smithi195.stdout:8/784: write d1/d3/d1c/fe8 [937381,56271] 0 2024-08-18T22:41:53.236 INFO:tasks.workunit.client.1.smithi195.stdout:8/785: truncate d1/d3/d1c/f45 462579 0 2024-08-18T22:41:53.239 INFO:tasks.workunit.client.1.smithi195.stdout:8/786: symlink d1/de/d31/l122 0 2024-08-18T22:41:53.239 INFO:tasks.workunit.client.1.smithi195.stdout:8/787: dread - d1/de/d27/ff5 zero size 2024-08-18T22:41:53.240 INFO:tasks.workunit.client.1.smithi195.stdout:8/788: fdatasync d1/d3/db/d39/d44/d79/fe2 0 2024-08-18T22:41:53.246 INFO:tasks.workunit.client.1.smithi195.stdout:8/789: write d1/de/d27/f29 [6393571,40149] 0 2024-08-18T22:41:53.246 INFO:tasks.workunit.client.1.smithi195.stdout:4/720: dread d0/d7/d1d/d69/db7/d6c/f91 [0,4194304] 0 2024-08-18T22:41:53.248 INFO:tasks.workunit.client.1.smithi195.stdout:4/721: dread - d0/d7/d1d/d69/db7/d3b/d6f/db0/fe1 zero size 2024-08-18T22:41:53.248 INFO:tasks.workunit.client.1.smithi195.stdout:8/790: mknod d1/d3/db/d35/d4d/d5c/de9/c123 0 2024-08-18T22:41:53.249 INFO:tasks.workunit.client.1.smithi195.stdout:4/722: write d0/d99/d85/d48/feb [133967,101762] 0 2024-08-18T22:41:53.255 INFO:tasks.workunit.client.1.smithi195.stdout:8/791: dwrite d1/d3/db/d7a/fb1 [0,4194304] 0 2024-08-18T22:41:53.255 INFO:tasks.workunit.client.1.smithi195.stdout:8/792: fsync d1/d64/fb9 0 2024-08-18T22:41:53.258 INFO:tasks.workunit.client.1.smithi195.stdout:8/793: creat d1/d3/db/d35/d4d/d8b/f124 x:0 0 0 2024-08-18T22:41:53.261 INFO:tasks.workunit.client.1.smithi195.stdout:8/794: rename d1/d3/db/d35/f7e to d1/d3/db/d35/f125 0 2024-08-18T22:41:53.274 INFO:tasks.workunit.client.1.smithi195.stdout:8/795: truncate d1/d3/db/d39/fd7 3932597 0 2024-08-18T22:41:53.275 INFO:tasks.workunit.client.1.smithi195.stdout:8/796: dread - d1/d3/db/d39/d2e/d78/fb5 zero size 2024-08-18T22:41:53.277 INFO:tasks.workunit.client.1.smithi195.stdout:8/797: symlink d1/d3/db/d35/d4d/d5c/ddf/d107/l126 0 2024-08-18T22:41:53.277 INFO:tasks.workunit.client.1.smithi195.stdout:8/798: chown d1/de/df/d1d/d1f/f98 1438402 1 2024-08-18T22:41:53.282 INFO:tasks.workunit.client.1.smithi195.stdout:8/799: write d1/d3/d1c/f65 [1461587,79711] 0 2024-08-18T22:41:53.285 INFO:tasks.workunit.client.1.smithi195.stdout:8/800: link d1/de/d27/d4f/f86 d1/de/df/d1d/d8e/d103/f127 0 2024-08-18T22:41:53.289 INFO:tasks.workunit.client.1.smithi195.stdout:8/801: write d1/d3/db/d35/d56/f90 [329568,111813] 0 2024-08-18T22:41:53.291 INFO:tasks.workunit.client.1.smithi195.stdout:8/802: unlink d1/d3/db/c8d 0 2024-08-18T22:41:53.294 INFO:tasks.workunit.client.1.smithi195.stdout:8/803: rename d1/d3/d1c/f52 to d1/d3/db/d39/d44/d79/f128 0 2024-08-18T22:41:53.295 INFO:tasks.workunit.client.1.smithi195.stdout:8/804: mkdir d1/de/d27/d4f/dde/d129 0 2024-08-18T22:41:53.296 INFO:tasks.workunit.client.1.smithi195.stdout:8/805: dread - d1/d3/d1c/d21/fb0 zero size 2024-08-18T22:41:53.297 INFO:tasks.workunit.client.1.smithi195.stdout:8/806: symlink d1/d3/db/d35/l12a 0 2024-08-18T22:41:53.299 INFO:tasks.workunit.client.1.smithi195.stdout:8/807: unlink d1/de/d27/fee 0 2024-08-18T22:41:53.300 INFO:tasks.workunit.client.1.smithi195.stdout:8/808: write d1/d3/db/fd [4700925,121623] 0 2024-08-18T22:41:53.301 INFO:tasks.workunit.client.1.smithi195.stdout:8/809: chown d1/de/df/d1d/d1f/f98 0 1 2024-08-18T22:41:53.303 INFO:tasks.workunit.client.1.smithi195.stdout:8/810: creat d1/d3/db/d35/dd1/f12b x:0 0 0 2024-08-18T22:41:53.305 INFO:tasks.workunit.client.1.smithi195.stdout:8/811: rmdir d1/d3/db/d35/d4d/d8b 39 2024-08-18T22:41:53.308 INFO:tasks.workunit.client.1.smithi195.stdout:8/812: mknod d1/d3/db/d35/d4d/d8b/c12c 0 2024-08-18T22:41:53.312 INFO:tasks.workunit.client.1.smithi195.stdout:8/813: link d1/de/d27/d4f/fd4 d1/ddb/f12d 0 2024-08-18T22:41:53.313 INFO:tasks.workunit.client.1.smithi195.stdout:8/814: rmdir d1/d3/d1c/d6a 39 2024-08-18T22:41:53.315 INFO:tasks.workunit.client.1.smithi195.stdout:8/815: fsync d1/d3/db/d35/f125 0 2024-08-18T22:41:53.317 INFO:tasks.workunit.client.1.smithi195.stdout:8/816: truncate d1/de/d27/ff5 341705 0 2024-08-18T22:41:53.318 INFO:tasks.workunit.client.1.smithi195.stdout:8/817: fsync d1/de/d27/fbf 0 2024-08-18T22:41:53.320 INFO:tasks.workunit.client.1.smithi195.stdout:8/818: creat d1/d3/db/d39/d44/dcb/f12e x:0 0 0 2024-08-18T22:41:53.320 INFO:tasks.workunit.client.1.smithi195.stdout:8/819: chown d1/d3/db/l117 9538461 1 2024-08-18T22:41:53.323 INFO:tasks.workunit.client.1.smithi195.stdout:8/820: getdents d1/d3/db/d7a 0 2024-08-18T22:41:53.325 INFO:tasks.workunit.client.1.smithi195.stdout:8/821: unlink d1/de/d27/d4f/f114 0 2024-08-18T22:41:53.326 INFO:tasks.workunit.client.1.smithi195.stdout:8/822: chown d1/de/df/d1d/d8e/f9a 377482919 1 2024-08-18T22:41:53.327 INFO:tasks.workunit.client.1.smithi195.stdout:8/823: mknod d1/d3/d1c/d6a/c12f 0 2024-08-18T22:41:53.328 INFO:tasks.workunit.client.1.smithi195.stdout:8/824: creat d1/de/df/d1d/d8e/f130 x:0 0 0 2024-08-18T22:41:53.331 INFO:tasks.workunit.client.1.smithi195.stdout:8/825: link d1/de/d112/lb8 d1/d3/db/l131 0 2024-08-18T22:41:53.332 INFO:tasks.workunit.client.1.smithi195.stdout:8/826: creat d1/f132 x:0 0 0 2024-08-18T22:41:53.334 INFO:tasks.workunit.client.1.smithi195.stdout:8/827: unlink d1/de/l85 0 2024-08-18T22:41:53.335 INFO:tasks.workunit.client.1.smithi195.stdout:8/828: mkdir d1/de/df/d1d/de5/df8/d133 0 2024-08-18T22:41:53.337 INFO:tasks.workunit.client.1.smithi195.stdout:8/829: getdents d1/d3/db/d35/d4d 0 2024-08-18T22:41:53.339 INFO:tasks.workunit.client.1.smithi195.stdout:0/756: sync 2024-08-18T22:41:53.340 INFO:tasks.workunit.client.1.smithi195.stdout:6/700: sync 2024-08-18T22:41:53.341 INFO:tasks.workunit.client.1.smithi195.stdout:0/757: mkdir d0/dc/d64/d81/df3 0 2024-08-18T22:41:53.342 INFO:tasks.workunit.client.1.smithi195.stdout:0/758: write d0/dc/d11/d23/d51/f9f [280165,62986] 0 2024-08-18T22:41:53.347 INFO:tasks.workunit.client.1.smithi195.stdout:8/830: write d1/de/df/d1d/d8e/fbb [344631,52817] 0 2024-08-18T22:41:53.347 INFO:tasks.workunit.client.1.smithi195.stdout:0/759: getdents d0 0 2024-08-18T22:41:53.350 INFO:tasks.workunit.client.1.smithi195.stdout:0/760: mkdir d0/dc/d11/d23/d51/dad/df4 0 2024-08-18T22:41:53.352 INFO:tasks.workunit.client.1.smithi195.stdout:0/761: write d0/dc/dd/d46/fa9 [897401,34369] 0 2024-08-18T22:41:53.353 INFO:tasks.workunit.client.1.smithi195.stdout:0/762: readlink d0/dc/dd/l36 0 2024-08-18T22:41:53.354 INFO:tasks.workunit.client.1.smithi195.stdout:8/831: dwrite d1/de/df/d1d/de5/f121 [0,4194304] 0 2024-08-18T22:41:53.355 INFO:tasks.workunit.client.1.smithi195.stdout:0/763: chown d0/dc/d11/d23/d51/dad 7419 1 2024-08-18T22:41:53.358 INFO:tasks.workunit.client.1.smithi195.stdout:8/832: mkdir d1/d3/db/d35/dd1/d134 0 2024-08-18T22:41:53.362 INFO:tasks.workunit.client.1.smithi195.stdout:8/833: truncate d1/d3/db/f34 3903891 0 2024-08-18T22:41:53.363 INFO:tasks.workunit.client.1.smithi195.stdout:0/764: dwrite d0/dc/d11/fd1 [0,4194304] 0 2024-08-18T22:41:53.367 INFO:tasks.workunit.client.1.smithi195.stdout:8/834: rename d1/de/d112 to d1/d3/db/d39/d44/dcb/d135 0 2024-08-18T22:41:53.371 INFO:tasks.workunit.client.1.smithi195.stdout:8/835: fdatasync d1/d3/db/f34 0 2024-08-18T22:41:53.371 INFO:tasks.workunit.client.1.smithi195.stdout:0/765: dwrite d0/dc/d64/d81/d44/d41/d6d/f76 [0,4194304] 0 2024-08-18T22:41:53.373 INFO:tasks.workunit.client.1.smithi195.stdout:8/836: dread - d1/de/df/d1d/d8e/fd0 zero size 2024-08-18T22:41:53.377 INFO:tasks.workunit.client.1.smithi195.stdout:0/766: creat d0/dc/d11/d6f/d9d/ff5 x:0 0 0 2024-08-18T22:41:53.394 INFO:tasks.workunit.client.1.smithi195.stdout:0/767: dread d0/f6b [0,4194304] 0 2024-08-18T22:41:53.395 INFO:tasks.workunit.client.1.smithi195.stdout:8/837: dread d1/d3/db/f5d [0,4194304] 0 2024-08-18T22:41:53.397 INFO:tasks.workunit.client.1.smithi195.stdout:8/838: write d1/d3/db/f5d [202473,42114] 0 2024-08-18T22:41:53.400 INFO:tasks.workunit.client.1.smithi195.stdout:0/768: dwrite d0/dc/d11/fd3 [4194304,4194304] 0 2024-08-18T22:41:53.411 INFO:tasks.workunit.client.1.smithi195.stdout:8/839: creat d1/de/d31/d5a/f136 x:0 0 0 2024-08-18T22:41:53.411 INFO:tasks.workunit.client.1.smithi195.stdout:0/769: rmdir d0 39 2024-08-18T22:41:53.413 INFO:tasks.workunit.client.1.smithi195.stdout:8/840: creat d1/de/df/d1d/d1f/f137 x:0 0 0 2024-08-18T22:41:53.414 INFO:tasks.workunit.client.1.smithi195.stdout:0/770: mknod d0/dc/d64/d81/d44/d41/d6d/d92/d66/d8d/cf6 0 2024-08-18T22:41:53.415 INFO:tasks.workunit.client.1.smithi195.stdout:8/841: creat d1/d3/d1c/d21/daa/f138 x:0 0 0 2024-08-18T22:41:53.416 INFO:tasks.workunit.client.1.smithi195.stdout:0/771: mknod d0/dc/d25/d67/cf7 0 2024-08-18T22:41:53.417 INFO:tasks.workunit.client.1.smithi195.stdout:8/842: read d1/d3/db/d35/d4d/d5c/ddf/d107/f10e [568254,73507] 0 2024-08-18T22:41:53.418 INFO:tasks.workunit.client.1.smithi195.stdout:0/772: fdatasync d0/dc/d11/d23/d51/dad/fe7 0 2024-08-18T22:41:53.419 INFO:tasks.workunit.client.1.smithi195.stdout:0/773: stat d0/dc/d64/d81/d44/d41/d6d/d92/d66/d8d/c93 0 2024-08-18T22:41:53.420 INFO:tasks.workunit.client.1.smithi195.stdout:8/843: rmdir d1/d3/db/d35/d56 39 2024-08-18T22:41:53.421 INFO:tasks.workunit.client.1.smithi195.stdout:0/774: creat d0/dc/dd/d46/ff8 x:0 0 0 2024-08-18T22:41:53.423 INFO:tasks.workunit.client.1.smithi195.stdout:0/775: dread - d0/dc/d64/d81/d44/d41/fb1 zero size 2024-08-18T22:41:53.425 INFO:tasks.workunit.client.1.smithi195.stdout:0/776: read d0/dc/d64/d81/d44/fbf [2247982,116552] 0 2024-08-18T22:41:53.427 INFO:tasks.workunit.client.1.smithi195.stdout:0/777: creat d0/dc/d25/d67/ff9 x:0 0 0 2024-08-18T22:41:53.429 INFO:tasks.workunit.client.1.smithi195.stdout:0/778: write d0/dc/d64/d81/d44/fbf [4679866,126265] 0 2024-08-18T22:41:53.433 INFO:tasks.workunit.client.1.smithi195.stdout:0/779: unlink d0/dc/d11/d23/d51/dad/lb4 0 2024-08-18T22:41:53.434 INFO:tasks.workunit.client.1.smithi195.stdout:0/780: write d0/dc/dd/f59 [4352157,83090] 0 2024-08-18T22:41:53.435 INFO:tasks.workunit.client.1.smithi195.stdout:0/781: chown d0/dc/d11/fd3 208223 1 2024-08-18T22:41:53.436 INFO:tasks.workunit.client.1.smithi195.stdout:0/782: chown d0/dc/d64/d81/d44/d41/d6d/d92 18 1 2024-08-18T22:41:53.443 INFO:tasks.workunit.client.1.smithi195.stdout:8/844: truncate d1/de/df/fb4 821057 0 2024-08-18T22:41:53.444 INFO:tasks.workunit.client.1.smithi195.stdout:0/783: dread d0/dc/dd/f3c [0,4194304] 0 2024-08-18T22:41:53.446 INFO:tasks.workunit.client.1.smithi195.stdout:8/845: mkdir d1/d3/db/d35/d139 0 2024-08-18T22:41:53.446 INFO:tasks.workunit.client.1.smithi195.stdout:0/784: getdents d0/dc/d64/d81/df3 0 2024-08-18T22:41:53.447 INFO:tasks.workunit.client.1.smithi195.stdout:0/785: readlink d0/dc/dd/d46/l7d 0 2024-08-18T22:41:53.448 INFO:tasks.workunit.client.1.smithi195.stdout:0/786: read d0/dc/dd/f3c [1407036,103576] 0 2024-08-18T22:41:53.453 INFO:tasks.workunit.client.1.smithi195.stdout:0/787: getdents d0/dc/d11/d23 0 2024-08-18T22:41:53.453 INFO:tasks.workunit.client.1.smithi195.stdout:8/846: dwrite d1/d3/db/d35/d4d/d5c/de9/f11a [0,4194304] 0 2024-08-18T22:41:53.459 INFO:tasks.workunit.client.1.smithi195.stdout:0/788: mkdir d0/dc/d64/d81/d44/d41/d6d/d97/dfa 0 2024-08-18T22:41:53.464 INFO:tasks.workunit.client.1.smithi195.stdout:0/789: getdents d0/dc/d11 0 2024-08-18T22:41:53.465 INFO:tasks.workunit.client.1.smithi195.stdout:8/847: dread d1/d3/db/d39/f59 [0,4194304] 0 2024-08-18T22:41:53.465 INFO:tasks.workunit.client.1.smithi195.stdout:8/848: chown d1/de/f54 76973 1 2024-08-18T22:41:53.467 INFO:tasks.workunit.client.1.smithi195.stdout:8/849: mknod d1/d3/db/d35/d139/c13a 0 2024-08-18T22:41:53.469 INFO:tasks.workunit.client.1.smithi195.stdout:8/850: fsync d1/de/df/d1d/d8e/fd0 0 2024-08-18T22:41:53.472 INFO:tasks.workunit.client.1.smithi195.stdout:8/851: rename d1/d3/db/c1a to d1/d3/db/d35/d56/c13b 0 2024-08-18T22:41:53.474 INFO:tasks.workunit.client.1.smithi195.stdout:8/852: mknod d1/d3/db/d39/d44/d8c/c13c 0 2024-08-18T22:41:53.482 INFO:tasks.workunit.client.1.smithi195.stdout:8/853: dwrite d1/d3/db/d35/d4d/d8b/f91 [0,4194304] 0 2024-08-18T22:41:53.483 INFO:tasks.workunit.client.1.smithi195.stdout:8/854: stat d1/d3/db/d39/d2e/f77 0 2024-08-18T22:41:53.486 INFO:tasks.workunit.client.1.smithi195.stdout:8/855: creat d1/d3/db/d35/d4d/f13d x:0 0 0 2024-08-18T22:41:53.494 INFO:tasks.workunit.client.1.smithi195.stdout:8/856: rename d1/d3/db/d39/d44/d79/f128 to d1/d3/db/d35/d4d/d95/daf/f13e 0 2024-08-18T22:41:53.496 INFO:tasks.workunit.client.1.smithi195.stdout:8/857: creat d1/d3/db/d35/d4d/d95/f13f x:0 0 0 2024-08-18T22:41:53.497 INFO:tasks.workunit.client.1.smithi195.stdout:8/858: write d1/d3/d1c/d21/daa/f111 [908683,41652] 0 2024-08-18T22:41:53.498 INFO:tasks.workunit.client.1.smithi195.stdout:8/859: chown d1/d64/ld5 2407 1 2024-08-18T22:41:53.500 INFO:tasks.workunit.client.1.smithi195.stdout:8/860: truncate d1/de/d67/fe6 713439 0 2024-08-18T22:41:53.503 INFO:tasks.workunit.client.1.smithi195.stdout:8/861: rename d1/de/df/d1d/de5/df8/ffe to d1/d3/db/d35/d4d/d5c/ddf/d107/f140 0 2024-08-18T22:41:53.504 INFO:tasks.workunit.client.1.smithi195.stdout:8/862: mkdir d1/d3/d141 0 2024-08-18T22:41:53.506 INFO:tasks.workunit.client.1.smithi195.stdout:8/863: symlink d1/d3/db/d35/dd1/d134/l142 0 2024-08-18T22:41:53.507 INFO:tasks.workunit.client.1.smithi195.stdout:8/864: chown d1/d3/db/d39/d44/d79/dd9/ca7 0 1 2024-08-18T22:41:53.508 INFO:tasks.workunit.client.1.smithi195.stdout:8/865: creat d1/de/df/d1d/de5/df8/f143 x:0 0 0 2024-08-18T22:41:53.509 INFO:tasks.workunit.client.1.smithi195.stdout:8/866: write d1/de/d27/f29 [5349808,55857] 0 2024-08-18T22:41:53.512 INFO:tasks.workunit.client.1.smithi195.stdout:8/867: dread d1/de/df/d1d/d1f/f98 [0,4194304] 0 2024-08-18T22:41:53.514 INFO:tasks.workunit.client.1.smithi195.stdout:8/868: creat d1/d3/d1c/d6a/f144 x:0 0 0 2024-08-18T22:41:53.515 INFO:tasks.workunit.client.1.smithi195.stdout:8/869: creat d1/de/df/d1d/de5/f145 x:0 0 0 2024-08-18T22:41:53.516 INFO:tasks.workunit.client.1.smithi195.stdout:8/870: truncate d1/de/d31/d5a/f136 946724 0 2024-08-18T22:41:53.547 INFO:tasks.workunit.client.1.smithi195.stdout:9/750: sync 2024-08-18T22:41:53.548 INFO:tasks.workunit.client.1.smithi195.stdout:9/751: rmdir d1c/d92/d9a 39 2024-08-18T22:41:53.548 INFO:tasks.workunit.client.1.smithi195.stdout:9/752: stat d1c/l2f 0 2024-08-18T22:41:53.550 INFO:tasks.workunit.client.1.smithi195.stdout:9/753: unlink d1c/c25 0 2024-08-18T22:41:53.559 INFO:tasks.workunit.client.1.smithi195.stdout:9/754: dwrite d1c/d74/d8e/f93 [0,4194304] 0 2024-08-18T22:41:53.560 INFO:tasks.workunit.client.1.smithi195.stdout:9/755: write d1c/d70/fb6 [47043,5145] 0 2024-08-18T22:41:53.563 INFO:tasks.workunit.client.1.smithi195.stdout:9/756: symlink d1c/d74/leb 0 2024-08-18T22:41:53.600 INFO:tasks.workunit.client.1.smithi195.stdout:9/757: dread d1c/d32/f46 [0,4194304] 0 2024-08-18T22:41:53.605 INFO:tasks.workunit.client.1.smithi195.stdout:9/758: dwrite d1c/d32/d37/d4b/f6f [0,4194304] 0 2024-08-18T22:41:53.606 INFO:tasks.workunit.client.1.smithi195.stdout:9/759: chown d1c/d74/f80 14872 1 2024-08-18T22:41:53.608 INFO:tasks.workunit.client.1.smithi195.stdout:9/760: read d1c/d32/d37/d4b/f6b [67021,7131] 0 2024-08-18T22:41:53.614 INFO:tasks.workunit.client.1.smithi195.stdout:9/761: dwrite d1c/d32/d37/fa0 [0,4194304] 0 2024-08-18T22:41:53.667 INFO:tasks.workunit.client.1.smithi195.stdout:9/762: dread d1c/f26 [0,4194304] 0 2024-08-18T22:41:53.668 INFO:tasks.workunit.client.1.smithi195.stdout:9/763: write f15 [2929945,8776] 0 2024-08-18T22:41:53.670 INFO:tasks.workunit.client.1.smithi195.stdout:9/764: mkdir d1c/d32/db1/dec 0 2024-08-18T22:41:53.671 INFO:tasks.workunit.client.1.smithi195.stdout:9/765: fsync d1c/d32/f91 0 2024-08-18T22:41:53.671 INFO:tasks.workunit.client.1.smithi195.stdout:9/766: chown d1c/d32 33258031 1 2024-08-18T22:41:53.673 INFO:tasks.workunit.client.1.smithi195.stdout:9/767: creat d1c/d92/da1/fed x:0 0 0 2024-08-18T22:41:53.678 INFO:tasks.workunit.client.1.smithi195.stdout:9/768: dwrite d1c/d92/d96/fba [0,4194304] 0 2024-08-18T22:41:53.681 INFO:tasks.workunit.client.1.smithi195.stdout:9/769: mknod d1c/d32/d71/dc4/cee 0 2024-08-18T22:41:53.683 INFO:tasks.workunit.client.1.smithi195.stdout:9/770: rmdir d1c/d32/d37/de0 0 2024-08-18T22:41:53.688 INFO:tasks.workunit.client.1.smithi195.stdout:9/771: dwrite d1c/d74/fc9 [0,4194304] 0 2024-08-18T22:41:53.698 INFO:tasks.workunit.client.1.smithi195.stdout:9/772: truncate d1c/f58 3283137 0 2024-08-18T22:41:53.714 INFO:tasks.workunit.client.1.smithi195.stdout:9/773: dwrite d1c/d32/f46 [0,4194304] 0 2024-08-18T22:41:53.715 INFO:tasks.workunit.client.1.smithi195.stdout:9/774: chown d1c/d74/d8e/f93 13077 1 2024-08-18T22:41:53.717 INFO:tasks.workunit.client.1.smithi195.stdout:9/775: creat d1c/d32/d71/dbe/fef x:0 0 0 2024-08-18T22:41:53.719 INFO:tasks.workunit.client.1.smithi195.stdout:9/776: getdents d1c/d32/d71 0 2024-08-18T22:41:53.730 INFO:tasks.workunit.client.1.smithi195.stdout:9/777: truncate d1c/d74/d8e/faf 3425610 0 2024-08-18T22:41:53.731 INFO:tasks.workunit.client.1.smithi195.stdout:9/778: creat d1c/d74/de4/ff0 x:0 0 0 2024-08-18T22:41:53.736 INFO:tasks.workunit.client.1.smithi195.stdout:5/751: sync 2024-08-18T22:41:53.739 INFO:tasks.workunit.client.1.smithi195.stdout:9/779: dread d1c/d32/d71/dbe/f9b [0,4194304] 0 2024-08-18T22:41:53.740 INFO:tasks.workunit.client.1.smithi195.stdout:9/780: dread - d1c/d32/d37/f6d zero size 2024-08-18T22:41:53.742 INFO:tasks.workunit.client.1.smithi195.stdout:9/781: rmdir d1c/d74/d8e/dcc 39 2024-08-18T22:41:53.747 INFO:tasks.workunit.client.1.smithi195.stdout:9/782: write d1c/d92/d96/f9c [5023231,100371] 0 2024-08-18T22:41:53.748 INFO:tasks.workunit.client.1.smithi195.stdout:5/752: dread d0/d3/d8/f56 [0,4194304] 0 2024-08-18T22:41:53.750 INFO:tasks.workunit.client.1.smithi195.stdout:5/753: mknod d0/d3/d66/dda/ce5 0 2024-08-18T22:41:53.751 INFO:tasks.workunit.client.1.smithi195.stdout:5/754: read d0/d3/df/d1a/fab [208137,108411] 0 2024-08-18T22:41:53.753 INFO:tasks.workunit.client.1.smithi195.stdout:9/783: dread d1c/f64 [0,4194304] 0 2024-08-18T22:41:53.753 INFO:tasks.workunit.client.1.smithi195.stdout:9/784: write d1c/d32/db1/fb3 [218137,11418] 0 2024-08-18T22:41:53.754 INFO:tasks.workunit.client.1.smithi195.stdout:5/755: mkdir d0/d3/d8/d64/d87/dc7/de6 0 2024-08-18T22:41:53.755 INFO:tasks.workunit.client.1.smithi195.stdout:9/785: mknod d1c/cf1 0 2024-08-18T22:41:53.756 INFO:tasks.workunit.client.1.smithi195.stdout:9/786: chown d1c/d32/d71/dbe/la6 47320 1 2024-08-18T22:41:53.757 INFO:tasks.workunit.client.1.smithi195.stdout:9/787: fsync d1c/f39 0 2024-08-18T22:41:53.759 INFO:tasks.workunit.client.1.smithi195.stdout:9/788: rename d1c/f35 to d1c/d92/da1/ff2 0 2024-08-18T22:41:53.759 INFO:tasks.workunit.client.1.smithi195.stdout:9/789: stat d1c/l41 0 2024-08-18T22:41:53.762 INFO:tasks.workunit.client.1.smithi195.stdout:5/756: write d0/db/f5d [1391402,16522] 0 2024-08-18T22:41:53.763 INFO:tasks.workunit.client.1.smithi195.stdout:5/757: mknod d0/d3/d66/dda/ce7 0 2024-08-18T22:41:53.764 INFO:tasks.workunit.client.1.smithi195.stdout:5/758: chown d0/d37/d8b 2951 1 2024-08-18T22:41:53.765 INFO:tasks.workunit.client.1.smithi195.stdout:9/790: write d1c/d74/d8e/faf [3475983,69403] 0 2024-08-18T22:41:53.766 INFO:tasks.workunit.client.1.smithi195.stdout:5/759: truncate d0/d2/d29/db5/fc1 3460770 0 2024-08-18T22:41:53.767 INFO:tasks.workunit.client.1.smithi195.stdout:5/760: unlink d0/d3/df/la4 0 2024-08-18T22:41:53.769 INFO:tasks.workunit.client.1.smithi195.stdout:9/791: creat d1c/d32/d37/d4b/dc6/de3/ff3 x:0 0 0 2024-08-18T22:41:53.769 INFO:tasks.workunit.client.1.smithi195.stdout:5/761: symlink d0/d46/d6d/le8 0 2024-08-18T22:41:53.775 INFO:tasks.workunit.client.1.smithi195.stdout:9/792: dwrite d1c/d74/d8e/dcc/fd6 [8388608,4194304] 0 2024-08-18T22:41:53.781 INFO:tasks.workunit.client.1.smithi195.stdout:9/793: link d1c/d32/db1/fb3 d1c/d92/d9a/ff4 0 2024-08-18T22:41:53.783 INFO:tasks.workunit.client.1.smithi195.stdout:5/762: dwrite d0/d2/d29/d88/d6a/f7a [0,4194304] 0 2024-08-18T22:41:53.785 INFO:tasks.workunit.client.1.smithi195.stdout:9/794: creat d1c/d92/da1/ff5 x:0 0 0 2024-08-18T22:41:53.785 INFO:tasks.workunit.client.1.smithi195.stdout:5/763: dread - d0/d46/d6d/f97 zero size 2024-08-18T22:41:53.788 INFO:tasks.workunit.client.1.smithi195.stdout:5/764: getdents d0/ddb 0 2024-08-18T22:41:53.791 INFO:tasks.workunit.client.1.smithi195.stdout:5/765: rename d0/d3/d8/d64/d87/dbc to d0/d46/d6d/da2/de9 0 2024-08-18T22:41:53.792 INFO:tasks.workunit.client.1.smithi195.stdout:5/766: chown d0/d3/d8/d3b/db1/dc6/cd0 212 1 2024-08-18T22:41:53.797 INFO:tasks.workunit.client.1.smithi195.stdout:9/795: dwrite d1c/f58 [0,4194304] 0 2024-08-18T22:41:53.837 INFO:tasks.workunit.client.1.smithi195.stdout:5/767: dread d0/d2/d29/f32 [0,4194304] 0 2024-08-18T22:41:53.839 INFO:tasks.workunit.client.1.smithi195.stdout:5/768: rename d0/d3/d66/daa to d0/dea 0 2024-08-18T22:41:53.841 INFO:tasks.workunit.client.1.smithi195.stdout:5/769: fdatasync d0/d3/f9e 0 2024-08-18T22:41:53.845 INFO:tasks.workunit.client.1.smithi195.stdout:5/770: unlink d0/d2/d29/d88/d90/f91 0 2024-08-18T22:41:53.848 INFO:tasks.workunit.client.1.smithi195.stdout:5/771: dread d0/d3/d8/f14 [0,4194304] 0 2024-08-18T22:41:53.850 INFO:tasks.workunit.client.1.smithi195.stdout:2/514: sync 2024-08-18T22:41:53.851 INFO:tasks.workunit.client.1.smithi195.stdout:2/515: truncate d1/d24/f60 879930 0 2024-08-18T22:41:53.854 INFO:tasks.workunit.client.1.smithi195.stdout:5/772: dwrite d0/db/fa9 [0,4194304] 0 2024-08-18T22:41:53.857 INFO:tasks.workunit.client.1.smithi195.stdout:5/773: rmdir d0/d37 39 2024-08-18T22:41:53.858 INFO:tasks.workunit.client.1.smithi195.stdout:5/774: readlink d0/d2/l10 0 2024-08-18T22:41:53.859 INFO:tasks.workunit.client.1.smithi195.stdout:5/775: mknod d0/d46/d6d/da2/de9/ceb 0 2024-08-18T22:41:53.861 INFO:tasks.workunit.client.1.smithi195.stdout:5/776: rmdir d0/d3/d8 39 2024-08-18T22:41:53.863 INFO:tasks.workunit.client.1.smithi195.stdout:5/777: mkdir d0/dea/dd3/dec 0 2024-08-18T22:41:53.864 INFO:tasks.workunit.client.1.smithi195.stdout:5/778: dread d0/d2/fca [0,4194304] 0 2024-08-18T22:41:53.865 INFO:tasks.workunit.client.1.smithi195.stdout:5/779: write d0/d2/d29/fe4 [359240,60363] 0 2024-08-18T22:41:53.868 INFO:tasks.workunit.client.1.smithi195.stdout:5/780: creat d0/dea/fed x:0 0 0 2024-08-18T22:41:53.869 INFO:tasks.workunit.client.1.smithi195.stdout:5/781: mknod d0/d2/d29/dc5/cee 0 2024-08-18T22:41:53.870 INFO:tasks.workunit.client.1.smithi195.stdout:5/782: readlink d0/d46/d6d/l75 0 2024-08-18T22:41:53.871 INFO:tasks.workunit.client.1.smithi195.stdout:5/783: stat d0/d46/f9c 0 2024-08-18T22:41:53.876 INFO:tasks.workunit.client.1.smithi195.stdout:5/784: dwrite d0/d3/d8/d64/f9d [0,4194304] 0 2024-08-18T22:41:53.878 INFO:tasks.workunit.client.1.smithi195.stdout:5/785: creat d0/d46/d6d/da2/fef x:0 0 0 2024-08-18T22:41:53.879 INFO:tasks.workunit.client.1.smithi195.stdout:5/786: stat d0/db/fd5 0 2024-08-18T22:41:53.879 INFO:tasks.workunit.client.1.smithi195.stdout:5/787: fsync d0/db/fa9 0 2024-08-18T22:41:53.880 INFO:tasks.workunit.client.1.smithi195.stdout:5/788: stat d0/d3/d66/dda/ce5 0 2024-08-18T22:41:53.882 INFO:tasks.workunit.client.1.smithi195.stdout:5/789: mkdir d0/d3/d8/d64/d87/df0 0 2024-08-18T22:41:53.882 INFO:tasks.workunit.client.1.smithi195.stdout:5/790: chown d0/d46/f6c 988302325 1 2024-08-18T22:41:53.898 INFO:tasks.workunit.client.1.smithi195.stdout:5/791: dwrite d0/d2/d29/d88/d6a/d96/fc4 [0,4194304] 0 2024-08-18T22:41:53.903 INFO:tasks.workunit.client.1.smithi195.stdout:5/792: creat d0/ddb/ff1 x:0 0 0 2024-08-18T22:41:53.908 INFO:tasks.workunit.client.1.smithi195.stdout:5/793: rename d0/d37/dba/dcc to d0/d3/df/df2 0 2024-08-18T22:41:53.913 INFO:tasks.workunit.client.1.smithi195.stdout:5/794: dwrite d0/d46/f9c [0,4194304] 0 2024-08-18T22:41:54.024 INFO:tasks.workunit.client.1.smithi195.stdout:3/905: sync 2024-08-18T22:41:54.024 INFO:tasks.workunit.client.1.smithi195.stdout:1/958: sync 2024-08-18T22:41:54.026 INFO:tasks.workunit.client.1.smithi195.stdout:3/906: unlink d7/da/df/dca/d81/cd2 0 2024-08-18T22:41:54.029 INFO:tasks.workunit.client.1.smithi195.stdout:3/907: rename d7/da/df/d1c/dc6/ld1 to d7/da/df/l12e 0 2024-08-18T22:41:54.033 INFO:tasks.workunit.client.1.smithi195.stdout:1/959: dread da/d18/d28/fc5 [0,4194304] 0 2024-08-18T22:41:54.037 INFO:tasks.workunit.client.1.smithi195.stdout:1/960: creat da/d18/d28/d7b/df2/db1/dd6/df5/d10e/f153 x:0 0 0 2024-08-18T22:41:54.037 INFO:tasks.workunit.client.1.smithi195.stdout:3/908: truncate d7/da/f48 5731938 0 2024-08-18T22:41:54.038 INFO:tasks.workunit.client.1.smithi195.stdout:1/961: write da/d18/d28/d31/d77/f93 [572776,114337] 0 2024-08-18T22:41:54.038 INFO:tasks.workunit.client.1.smithi195.stdout:3/909: read d7/d1f/fa9 [3716335,22854] 0 2024-08-18T22:41:54.040 INFO:tasks.workunit.client.1.smithi195.stdout:1/962: creat da/d4c/dd5/f154 x:0 0 0 2024-08-18T22:41:54.042 INFO:tasks.workunit.client.1.smithi195.stdout:3/910: mkdir d7/da/df/d8e/daa/df9/d12f 0 2024-08-18T22:41:54.042 INFO:tasks.workunit.client.1.smithi195.stdout:3/911: stat d7/d1f/d73/dae/cff 0 2024-08-18T22:41:54.044 INFO:tasks.workunit.client.1.smithi195.stdout:1/963: creat da/d18/d13a/f155 x:0 0 0 2024-08-18T22:41:54.045 INFO:tasks.workunit.client.1.smithi195.stdout:1/964: dread - da/d18/d13a/f155 zero size 2024-08-18T22:41:54.045 INFO:tasks.workunit.client.1.smithi195.stdout:3/912: dread - d7/faf zero size 2024-08-18T22:41:54.046 INFO:tasks.workunit.client.1.smithi195.stdout:3/913: chown d7/d1f/d49/l57 0 1 2024-08-18T22:41:54.048 INFO:tasks.workunit.client.1.smithi195.stdout:1/965: creat da/d4c/f156 x:0 0 0 2024-08-18T22:41:54.049 INFO:tasks.workunit.client.1.smithi195.stdout:3/914: getdents d7/da/df/dca/d12c 0 2024-08-18T22:41:54.050 INFO:tasks.workunit.client.1.smithi195.stdout:1/966: creat da/d18/d28/d7b/df2/db1/f157 x:0 0 0 2024-08-18T22:41:54.051 INFO:tasks.workunit.client.1.smithi195.stdout:3/915: creat d7/d54/f130 x:0 0 0 2024-08-18T22:41:54.051 INFO:tasks.workunit.client.1.smithi195.stdout:1/967: rmdir da/d4c/d5d/de8/d99 39 2024-08-18T22:41:54.054 INFO:tasks.workunit.client.1.smithi195.stdout:1/968: symlink da/d4c/d5d/dcb/d10f/dbd/ddb/d4e/ddc/l158 0 2024-08-18T22:41:54.055 INFO:tasks.workunit.client.1.smithi195.stdout:3/916: link d7/da/df/d8e/daa/df9/f11f d7/da/d75/d113/f131 0 2024-08-18T22:41:54.057 INFO:tasks.workunit.client.1.smithi195.stdout:1/969: getdents da/d4c/d5d/dcb/d10f/dbd/ddb/d4e 0 2024-08-18T22:41:54.061 INFO:tasks.workunit.client.1.smithi195.stdout:3/917: dwrite d7/da/df/fba [0,4194304] 0 2024-08-18T22:41:54.061 INFO:tasks.workunit.client.1.smithi195.stdout:1/970: creat da/d4c/d5d/dcb/d10f/dbd/ddb/d4e/f159 x:0 0 0 2024-08-18T22:41:54.063 INFO:tasks.workunit.client.1.smithi195.stdout:3/918: truncate d7/d54/d9a/f10d 184707 0 2024-08-18T22:41:54.064 INFO:tasks.workunit.client.1.smithi195.stdout:3/919: read d7/f4c [310456,121093] 0 2024-08-18T22:41:54.064 INFO:tasks.workunit.client.1.smithi195.stdout:1/971: creat da/d18/d28/d7b/df2/db1/dd6/df5/d10e/f15a x:0 0 0 2024-08-18T22:41:54.066 INFO:tasks.workunit.client.1.smithi195.stdout:3/920: chown d7/d1f/l5a 520874 1 2024-08-18T22:41:54.068 INFO:tasks.workunit.client.1.smithi195.stdout:3/921: mkdir d7/da/d132 0 2024-08-18T22:41:54.071 INFO:tasks.workunit.client.1.smithi195.stdout:3/922: getdents d7/d54 0 2024-08-18T22:41:54.073 INFO:tasks.workunit.client.1.smithi195.stdout:3/923: truncate d7/d1f/f60 1739564 0 2024-08-18T22:41:54.074 INFO:tasks.workunit.client.1.smithi195.stdout:3/924: fsync d7/d54/f128 0 2024-08-18T22:41:54.076 INFO:tasks.workunit.client.1.smithi195.stdout:3/925: fsync d7/f51 0 2024-08-18T22:41:54.080 INFO:tasks.workunit.client.1.smithi195.stdout:3/926: link d7/f51 d7/da/df/d8e/f133 0 2024-08-18T22:41:54.080 INFO:tasks.workunit.client.1.smithi195.stdout:3/927: stat d7/da/df/l2f 0 2024-08-18T22:41:54.083 INFO:tasks.workunit.client.1.smithi195.stdout:3/928: truncate d7/da/f48 1473565 0 2024-08-18T22:41:54.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:41:53 smithi121 ceph-mon[16788]: from='mgr.24377 172.21.15.195:0/2331273060' entity='mgr.smithi195.acttsj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-18T22:41:54.084 INFO:tasks.workunit.client.1.smithi195.stdout:3/929: fdatasync d7/fad 0 2024-08-18T22:41:54.085 INFO:tasks.workunit.client.1.smithi195.stdout:3/930: write d7/da/df/fba [3703485,52376] 0 2024-08-18T22:41:54.086 INFO:tasks.workunit.client.1.smithi195.stdout:1/972: dread da/d18/d28/f34 [0,4194304] 0 2024-08-18T22:41:54.087 INFO:tasks.workunit.client.1.smithi195.stdout:3/931: chown d7/da/df/d11c/f129 1995 1 2024-08-18T22:41:54.089 INFO:tasks.workunit.client.1.smithi195.stdout:1/973: mkdir da/d18/d28/d7b/df2/db1/d15b 0 2024-08-18T22:41:54.093 INFO:tasks.workunit.client.1.smithi195.stdout:3/932: link d7/da/df/d38/f8d d7/da/d132/f134 0 2024-08-18T22:41:54.095 INFO:tasks.workunit.client.1.smithi195.stdout:3/933: chown d7/da/df/dd3/fed 15121 1 2024-08-18T22:41:54.096 INFO:tasks.workunit.client.1.smithi195.stdout:1/974: dwrite da/d18/d28/d7b/df2/db1/dd6/fed [0,4194304] 0 2024-08-18T22:41:54.098 INFO:tasks.workunit.client.1.smithi195.stdout:1/975: stat da/d4c/d5d/dcb/d10f/dbd/ddb/d4e 0 2024-08-18T22:41:54.098 INFO:tasks.workunit.client.1.smithi195.stdout:3/934: unlink d7/da/df/d1c/f63 0 2024-08-18T22:41:54.099 INFO:tasks.workunit.client.1.smithi195.stdout:1/976: chown da/f78 2782846 1 2024-08-18T22:41:54.101 INFO:tasks.workunit.client.1.smithi195.stdout:1/977: chown da/d4c/d5d/de8/d99 970563468 1 2024-08-18T22:41:54.104 INFO:tasks.workunit.client.1.smithi195.stdout:1/978: mkdir da/d4c/d5d/de8/d99/d15c 0 2024-08-18T22:41:54.104 INFO:tasks.workunit.client.1.smithi195.stdout:3/935: dwrite d7/d1f/f34 [0,4194304] 0 2024-08-18T22:41:54.106 INFO:tasks.workunit.client.1.smithi195.stdout:1/979: symlink da/d4c/d5d/dcb/l15d 0 2024-08-18T22:41:54.107 INFO:tasks.workunit.client.1.smithi195.stdout:1/980: truncate da/d3d/f131 417745 0 2024-08-18T22:41:54.109 INFO:tasks.workunit.client.1.smithi195.stdout:1/981: rename da/d18/d28/d7b/df2/db1/dd6/c100 to da/d18/d13a/c15e 0 2024-08-18T22:41:54.110 INFO:tasks.workunit.client.1.smithi195.stdout:1/982: chown da/d18/d28/d31/fc4 416869520 1 2024-08-18T22:41:54.111 INFO:tasks.workunit.client.1.smithi195.stdout:1/983: rmdir da/d4c/d5d/de8 39 2024-08-18T22:41:54.113 INFO:tasks.workunit.client.1.smithi195.stdout:1/984: mknod da/d18/d28/d31/c15f 0 2024-08-18T22:41:54.114 INFO:tasks.workunit.client.1.smithi195.stdout:1/985: read da/d3d/d11f/f130 [294075,34109] 0 2024-08-18T22:41:54.114 INFO:tasks.workunit.client.1.smithi195.stdout:4/723: sync 2024-08-18T22:41:54.114 INFO:tasks.workunit.client.1.smithi195.stdout:7/838: sync 2024-08-18T22:41:54.117 INFO:tasks.workunit.client.1.smithi195.stdout:1/986: write da/d4c/d5d/de8/d99/ff3 [1261697,56383] 0 2024-08-18T22:41:54.119 INFO:tasks.workunit.client.1.smithi195.stdout:4/724: symlink d0/d7/d1d/d69/db7/d6c/l101 0 2024-08-18T22:41:54.120 INFO:tasks.workunit.client.1.smithi195.stdout:1/987: rename da/f11 to da/d18/d28/dba/f160 0 2024-08-18T22:41:54.122 INFO:tasks.workunit.client.1.smithi195.stdout:4/725: mkdir d0/d7/d1d/d69/db7/d41/d66/dfa/d102 0 2024-08-18T22:41:54.123 INFO:tasks.workunit.client.1.smithi195.stdout:1/988: fsync da/d18/d28/dba/de1/f137 0 2024-08-18T22:41:54.125 INFO:tasks.workunit.client.1.smithi195.stdout:4/726: rename d0/d99/d98/d16/f42 to d0/d99/d98/d16/dae/f103 0 2024-08-18T22:41:54.126 INFO:tasks.workunit.client.1.smithi195.stdout:1/989: mknod da/d4c/d5d/dcb/d10f/dbd/ddb/d4e/d95/c161 0 2024-08-18T22:41:54.128 INFO:tasks.workunit.client.1.smithi195.stdout:4/727: mkdir d0/d7/d1d/d69/db7/d3b/d6f/db0/d104 0 2024-08-18T22:41:54.130 INFO:tasks.workunit.client.1.smithi195.stdout:7/839: write dc/d22/fc9 [770130,48149] 0 2024-08-18T22:41:54.131 INFO:tasks.workunit.client.1.smithi195.stdout:7/840: readlink dc/d2a/l38 0 2024-08-18T22:41:54.134 INFO:tasks.workunit.client.1.smithi195.stdout:1/990: dwrite da/d18/dc6/fd9 [4194304,4194304] 0 2024-08-18T22:41:54.137 INFO:tasks.workunit.client.1.smithi195.stdout:7/841: creat dc/d1d/d29/f12a x:0 0 0 2024-08-18T22:41:54.137 INFO:tasks.workunit.client.1.smithi195.stdout:3/936: dread d7/da/df/d1c/f23 [4194304,4194304] 0 2024-08-18T22:41:54.137 INFO:tasks.workunit.client.1.smithi195.stdout:1/991: fsync da/d4c/d5d/de8/d99/fb3 0 2024-08-18T22:41:54.138 INFO:tasks.workunit.client.1.smithi195.stdout:7/842: chown dc/d22/f116 0 1 2024-08-18T22:41:54.140 INFO:tasks.workunit.client.1.smithi195.stdout:1/992: write da/d4c/d5d/dcb/d10f/dbd/ddb/d4e/f8b [5995197,77970] 0 2024-08-18T22:41:54.142 INFO:tasks.workunit.client.1.smithi195.stdout:1/993: stat da/d68 0 2024-08-18T22:41:54.147 INFO:tasks.workunit.client.1.smithi195.stdout:3/937: dwrite d7/da/df/d8e/fbe [0,4194304] 0 2024-08-18T22:41:54.148 INFO:tasks.workunit.client.1.smithi195.stdout:3/938: fdatasync d7/d54/d9a/fd8 0 2024-08-18T22:41:54.149 INFO:tasks.workunit.client.1.smithi195.stdout:1/994: creat da/d18/d28/d7b/df2/db1/dd6/df5/d10e/d13e/f162 x:0 0 0 2024-08-18T22:41:54.149 INFO:tasks.workunit.client.1.smithi195.stdout:7/843: dwrite dc/d8f/d96/dc5/d11b/dde/ffc [0,4194304] 0 2024-08-18T22:41:54.151 INFO:tasks.workunit.client.1.smithi195.stdout:3/939: write d7/d54/f128 [411789,87810] 0 2024-08-18T22:41:54.155 INFO:tasks.workunit.client.1.smithi195.stdout:1/995: mkdir da/d18/d28/d7b/df2/db1/dda/d163 0 2024-08-18T22:41:54.157 INFO:tasks.workunit.client.1.smithi195.stdout:1/996: write da/d18/d28/d7b/f107 [1021125,102931] 0 2024-08-18T22:41:54.157 INFO:tasks.workunit.client.1.smithi195.stdout:3/940: symlink d7/da/df/d11c/l135 0 2024-08-18T22:41:54.158 INFO:tasks.workunit.client.1.smithi195.stdout:1/997: fsync da/d18/d28/d31/d77/f147 0 2024-08-18T22:41:54.158 INFO:tasks.workunit.client.1.smithi195.stdout:7/844: dread dc/d22/f7e [0,4194304] 0 2024-08-18T22:41:54.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:41:53 smithi195 ceph-mon[23370]: from='mgr.24377 172.21.15.195:0/2331273060' entity='mgr.smithi195.acttsj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-18T22:41:54.162 INFO:tasks.workunit.client.1.smithi195.stdout:7/845: rmdir dc/d1d/d29/ddb/d2b/d81 39 2024-08-18T22:41:54.165 INFO:tasks.workunit.client.1.smithi195.stdout:7/846: creat dc/d1d/f12b x:0 0 0 2024-08-18T22:41:54.165 INFO:tasks.workunit.client.1.smithi195.stdout:1/998: dwrite da/d18/d28/d31/d77/f9f [0,4194304] 0 2024-08-18T22:41:54.167 INFO:tasks.workunit.client.1.smithi195.stdout:1/999: read - da/d4c/d5d/f14b zero size 2024-08-18T22:41:54.168 INFO:tasks.workunit.client.1.smithi195.stdout:7/847: creat dc/d8f/d96/dc5/de7/f12c x:0 0 0 2024-08-18T22:41:54.170 INFO:tasks.workunit.client.1.smithi195.stdout:7/848: readlink dc/d1d/d29/d5d/l53 0 2024-08-18T22:41:54.174 INFO:tasks.workunit.client.1.smithi195.stdout:7/849: rmdir dc/d1d/d29/ddb/d10d/db6/df7 39 2024-08-18T22:41:54.174 INFO:tasks.workunit.client.1.smithi195.stdout:7/850: fdatasync dc/d8f/d96/dc5/d11b/ff4 0 2024-08-18T22:41:54.180 INFO:tasks.workunit.client.1.smithi195.stdout:7/851: dwrite dc/d1d/d29/ddb/d10d/fe9 [0,4194304] 0 2024-08-18T22:41:54.183 INFO:tasks.workunit.client.1.smithi195.stdout:7/852: symlink dc/d2a/d4c/l12d 0 2024-08-18T22:41:54.190 INFO:tasks.workunit.client.1.smithi195.stdout:7/853: dwrite dc/feb [0,4194304] 0 2024-08-18T22:41:54.194 INFO:tasks.workunit.client.1.smithi195.stdout:7/854: chown dc/d1d/d29/ddb/d15/d4d/ldc 6587552 1 2024-08-18T22:41:54.195 INFO:tasks.workunit.client.1.smithi195.stdout:7/855: mknod dc/d8f/d96/c12e 0 2024-08-18T22:41:54.201 INFO:tasks.workunit.client.1.smithi195.stdout:7/856: dwrite dc/d1d/d29/ddb/f10a [0,4194304] 0 2024-08-18T22:41:54.209 INFO:tasks.workunit.client.1.smithi195.stdout:7/857: dwrite dc/d1d/d29/d5d/f105 [0,4194304] 0 2024-08-18T22:41:54.283 INFO:tasks.workunit.client.1.smithi195.stdout:6/701: sync 2024-08-18T22:41:54.283 INFO:tasks.workunit.client.1.smithi195.stdout:8/871: sync 2024-08-18T22:41:54.284 INFO:tasks.workunit.client.1.smithi195.stdout:9/796: sync 2024-08-18T22:41:54.284 INFO:tasks.workunit.client.1.smithi195.stdout:0/790: sync 2024-08-18T22:41:54.284 INFO:tasks.workunit.client.1.smithi195.stdout:5/795: sync 2024-08-18T22:41:54.284 INFO:tasks.workunit.client.1.smithi195.stdout:2/516: sync 2024-08-18T22:41:54.285 INFO:tasks.workunit.client.1.smithi195.stdout:9/797: chown d1c/d92/d96/d9d/db9 1076 1 2024-08-18T22:41:54.286 INFO:tasks.workunit.client.1.smithi195.stdout:8/872: rmdir d1/d64 39 2024-08-18T22:41:54.287 INFO:tasks.workunit.client.1.smithi195.stdout:6/702: symlink da/db/d19/d72/lda 0 2024-08-18T22:41:54.293 INFO:tasks.workunit.client.1.smithi195.stdout:8/873: mkdir d1/d3/db/d35/d4d/d5c/de9/d146 0 2024-08-18T22:41:54.296 INFO:tasks.workunit.client.1.smithi195.stdout:9/798: truncate d1c/f1d 285554 0 2024-08-18T22:41:54.298 INFO:tasks.workunit.client.1.smithi195.stdout:2/517: dwrite d1/f2 [0,4194304] 0 2024-08-18T22:41:54.298 INFO:tasks.workunit.client.1.smithi195.stdout:8/874: write d1/d3/d1c/fe8 [220095,101111] 0 2024-08-18T22:41:54.300 INFO:tasks.workunit.client.1.smithi195.stdout:8/875: stat d1/d3/l43 0 2024-08-18T22:41:54.301 INFO:tasks.workunit.client.1.smithi195.stdout:6/703: dwrite f5 [4194304,4194304] 0 2024-08-18T22:41:54.303 INFO:tasks.workunit.client.1.smithi195.stdout:0/791: dread d0/dc/d11/d23/d51/fb7 [0,4194304] 0 2024-08-18T22:41:54.304 INFO:tasks.workunit.client.1.smithi195.stdout:5/796: dread d0/d2/d29/dc5/fcb [0,4194304] 0 2024-08-18T22:41:54.309 INFO:tasks.workunit.client.1.smithi195.stdout:9/799: dread d1c/d32/d37/d4b/f6e [0,4194304] 0 2024-08-18T22:41:54.309 INFO:tasks.workunit.client.1.smithi195.stdout:5/797: dread - d0/d3/df/faf zero size 2024-08-18T22:41:54.309 INFO:tasks.workunit.client.1.smithi195.stdout:2/518: unlink d1/d8/d3d/f48 0 2024-08-18T22:41:54.309 INFO:tasks.workunit.client.1.smithi195.stdout:6/704: read da/db/d26/f95 [3616772,90250] 0 2024-08-18T22:41:54.314 INFO:tasks.workunit.client.1.smithi195.stdout:0/792: mkdir d0/dc/d64/d81/d44/d41/d6d/d97/dfb 0 2024-08-18T22:41:54.315 INFO:tasks.workunit.client.1.smithi195.stdout:9/800: write d1c/d32/d37/d4b/f5d [1728065,123442] 0 2024-08-18T22:41:54.318 INFO:tasks.workunit.client.1.smithi195.stdout:9/801: fsync d1c/d32/d71/dbe/fef 0 2024-08-18T22:41:54.320 INFO:tasks.workunit.client.1.smithi195.stdout:5/798: getdents d0/d3/d8/d3b/db1 0 2024-08-18T22:41:54.321 INFO:tasks.workunit.client.1.smithi195.stdout:9/802: chown d1c/f33 0 1 2024-08-18T22:41:54.323 INFO:tasks.workunit.client.1.smithi195.stdout:5/799: readlink d0/d3/l92 0 2024-08-18T22:41:54.324 INFO:tasks.workunit.client.1.smithi195.stdout:8/876: dwrite d1/d3/db/d35/d56/fd6 [0,4194304] 0 2024-08-18T22:41:54.324 INFO:tasks.workunit.client.1.smithi195.stdout:9/803: fdatasync d1c/f3a 0 2024-08-18T22:41:54.328 INFO:tasks.workunit.client.1.smithi195.stdout:5/800: symlink d0/d2/d53/lf3 0 2024-08-18T22:41:54.328 INFO:tasks.workunit.client.1.smithi195.stdout:2/519: dwrite d1/d24/d26/f2b [4194304,4194304] 0 2024-08-18T22:41:54.330 INFO:tasks.workunit.client.1.smithi195.stdout:6/705: dwrite da/db/d19/d72/f8a [0,4194304] 0 2024-08-18T22:41:54.332 INFO:tasks.workunit.client.1.smithi195.stdout:2/520: chown d1/d8/d3d/d3b/d53 460 1 2024-08-18T22:41:54.332 INFO:tasks.workunit.client.1.smithi195.stdout:8/877: getdents d1/de/d27 0 2024-08-18T22:41:54.333 INFO:tasks.workunit.client.1.smithi195.stdout:5/801: symlink d0/d46/d6d/lf4 0 2024-08-18T22:41:54.336 INFO:tasks.workunit.client.1.smithi195.stdout:2/521: creat d1/fa1 x:0 0 0 2024-08-18T22:41:54.337 INFO:tasks.workunit.client.1.smithi195.stdout:8/878: dread - d1/d3/db/d35/d4d/d5c/ddf/d107/f140 zero size 2024-08-18T22:41:54.339 INFO:tasks.workunit.client.1.smithi195.stdout:6/706: rmdir da/d15/d1c/d2e/d74/dcc 0 2024-08-18T22:41:54.340 INFO:tasks.workunit.client.1.smithi195.stdout:8/879: fsync d1/d3/db/fd 0 2024-08-18T22:41:54.341 INFO:tasks.workunit.client.1.smithi195.stdout:6/707: fsync da/db/d78/dcd/fd9 0 2024-08-18T22:41:54.344 INFO:tasks.workunit.client.1.smithi195.stdout:5/802: dwrite d0/dea/fed [0,4194304] 0 2024-08-18T22:41:54.345 INFO:tasks.workunit.client.1.smithi195.stdout:5/803: chown d0/dea/dd3/f8a 492 1 2024-08-18T22:41:54.346 INFO:tasks.workunit.client.1.smithi195.stdout:5/804: chown d0/d2/d29/d88/d6a/d96 12623 1 2024-08-18T22:41:54.346 INFO:tasks.workunit.client.1.smithi195.stdout:2/522: getdents d1/d24/d26/d42/d50 0 2024-08-18T22:41:54.348 INFO:tasks.workunit.client.1.smithi195.stdout:6/708: fsync da/d22/d86/f7e 0 2024-08-18T22:41:54.349 INFO:tasks.workunit.client.1.smithi195.stdout:8/880: truncate d1/d3/d1c/d21/f28 3002608 0 2024-08-18T22:41:54.356 INFO:tasks.workunit.client.1.smithi195.stdout:8/881: truncate d1/de/df/d1d/d8e/f9a 610079 0 2024-08-18T22:41:54.357 INFO:tasks.workunit.client.1.smithi195.stdout:6/709: dwrite da/db/d2a/f57 [0,4194304] 0 2024-08-18T22:41:54.358 INFO:tasks.workunit.client.1.smithi195.stdout:5/805: dwrite d0/d2/d29/f47 [8388608,4194304] 0 2024-08-18T22:41:54.359 INFO:tasks.workunit.client.1.smithi195.stdout:8/882: write d1/d3/db/d7a/fb1 [4944164,23971] 0 2024-08-18T22:41:54.367 INFO:tasks.workunit.client.1.smithi195.stdout:6/710: dwrite da/db/d19/d67/fbe [0,4194304] 0 2024-08-18T22:41:54.368 INFO:tasks.workunit.client.1.smithi195.stdout:8/883: fdatasync d1/d3/db/d35/d56/fb2 0 2024-08-18T22:41:54.372 INFO:tasks.workunit.client.1.smithi195.stdout:2/523: write d1/d22/f6d [384442,79047] 0 2024-08-18T22:41:54.375 INFO:tasks.workunit.client.1.smithi195.stdout:5/806: dread d0/d2/d29/f67 [0,4194304] 0 2024-08-18T22:41:54.377 INFO:tasks.workunit.client.1.smithi195.stdout:8/884: dread d1/d3/db/f5d [0,4194304] 0 2024-08-18T22:41:54.378 INFO:tasks.workunit.client.1.smithi195.stdout:2/524: creat d1/d22/d51/fa2 x:0 0 0 2024-08-18T22:41:54.382 INFO:tasks.workunit.client.1.smithi195.stdout:6/711: creat da/fdb x:0 0 0 2024-08-18T22:41:54.386 INFO:tasks.workunit.client.1.smithi195.stdout:8/885: getdents d1/de/d31 0 2024-08-18T22:41:54.446 INFO:tasks.workunit.client.1.smithi195.stdout:6/712: rename da/db/d19/d72 to da/ddc 0 2024-08-18T22:41:54.448 INFO:tasks.workunit.client.1.smithi195.stdout:8/886: symlink d1/d3/db/d35/d4d/d5c/ddf/d107/l147 0 2024-08-18T22:41:54.448 INFO:tasks.workunit.client.1.smithi195.stdout:6/713: write da/db/d19/d67/fbe [2791291,89392] 0 2024-08-18T22:41:54.451 INFO:tasks.workunit.client.1.smithi195.stdout:5/807: truncate d0/d46/f9c 1431474 0 2024-08-18T22:41:54.452 INFO:tasks.workunit.client.1.smithi195.stdout:2/525: truncate d1/d24/f73 2247531 0 2024-08-18T22:41:54.459 INFO:tasks.workunit.client.1.smithi195.stdout:8/887: dread d1/de/d31/d5a/f57 [0,4194304] 0 2024-08-18T22:41:54.472 INFO:tasks.workunit.client.1.smithi195.stdout:5/808: symlink d0/d37/lf5 0 2024-08-18T22:41:54.473 INFO:tasks.workunit.client.1.smithi195.stdout:2/526: rmdir d1/d24/d26/d42/d72 39 2024-08-18T22:41:54.473 INFO:tasks.workunit.client.1.smithi195.stdout:2/527: chown d1/d8 1664 1 2024-08-18T22:41:54.475 INFO:tasks.workunit.client.1.smithi195.stdout:2/528: read d1/f1b [2294820,56444] 0 2024-08-18T22:41:54.476 INFO:tasks.workunit.client.1.smithi195.stdout:2/529: truncate d1/fa1 215052 0 2024-08-18T22:41:54.479 INFO:tasks.workunit.client.1.smithi195.stdout:8/888: getdents d1/de/d67 0 2024-08-18T22:41:54.481 INFO:tasks.workunit.client.1.smithi195.stdout:2/530: unlink d1/d8/d3d/f18 0 2024-08-18T22:41:54.485 INFO:tasks.workunit.client.1.smithi195.stdout:8/889: creat d1/dca/f148 x:0 0 0 2024-08-18T22:41:54.486 INFO:tasks.workunit.client.1.smithi195.stdout:5/809: link d0/d2/d29/d88/d90/fbf d0/d3/d5f/ff6 0 2024-08-18T22:41:54.487 INFO:tasks.workunit.client.1.smithi195.stdout:5/810: chown d0/d46/d6d/le8 1 1 2024-08-18T22:41:54.489 INFO:tasks.workunit.client.1.smithi195.stdout:5/811: rmdir d0/d2/d53 39 2024-08-18T22:41:54.490 INFO:tasks.workunit.client.1.smithi195.stdout:5/812: stat d0/d2/d29/d88/d6a/f7a 0 2024-08-18T22:41:54.495 INFO:tasks.workunit.client.1.smithi195.stdout:8/890: dread d1/de/f3b [0,4194304] 0 2024-08-18T22:41:54.501 INFO:tasks.workunit.client.1.smithi195.stdout:8/891: dwrite d1/d3/db/d7a/fb1 [4194304,4194304] 0 2024-08-18T22:41:54.565 INFO:tasks.workunit.client.1.smithi195.stdout:4/728: sync 2024-08-18T22:41:54.584 INFO:tasks.workunit.client.1.smithi195.stdout:5/813: rename d0/d37/lf5 to d0/d37/lf7 0 2024-08-18T22:41:54.586 INFO:tasks.workunit.client.1.smithi195.stdout:5/814: rmdir d0 39 2024-08-18T22:41:54.589 INFO:tasks.workunit.client.1.smithi195.stdout:8/892: link d1/d3/db/d39/d44/d8c/fc9 d1/d3/db/d39/d44/f149 0 2024-08-18T22:41:54.590 INFO:tasks.workunit.client.1.smithi195.stdout:4/729: getdents d0/d7/d1d/d69/db7/d41/d66/dfa 0 2024-08-18T22:41:54.592 INFO:tasks.workunit.client.1.smithi195.stdout:8/893: mknod d1/d3/db/d35/d4d/c14a 0 2024-08-18T22:41:54.593 INFO:tasks.workunit.client.1.smithi195.stdout:4/730: fdatasync d0/d99/d98/d16/d49/f45 0 2024-08-18T22:41:54.593 INFO:tasks.workunit.client.1.smithi195.stdout:8/894: dread - d1/d3/d1c/d6a/f144 zero size 2024-08-18T22:41:54.594 INFO:tasks.workunit.client.1.smithi195.stdout:5/815: getdents d0/d46 0 2024-08-18T22:41:54.596 INFO:tasks.workunit.client.1.smithi195.stdout:8/895: mkdir d1/de/df/d1d/d1f/d14b 0 2024-08-18T22:41:54.598 INFO:tasks.workunit.client.1.smithi195.stdout:8/896: fdatasync d1/de/df/d1d/d8e/f130 0 2024-08-18T22:41:54.599 INFO:tasks.workunit.client.1.smithi195.stdout:4/731: dwrite d0/d99/d85/dc8/fdc [0,4194304] 0 2024-08-18T22:41:54.601 INFO:tasks.workunit.client.1.smithi195.stdout:4/732: chown d0/d99/d98/d16/d94/db2 25852326 1 2024-08-18T22:41:54.601 INFO:tasks.workunit.client.1.smithi195.stdout:5/816: rename d0/d46/d6d/da2/de9/ceb to d0/d3/d8/cf8 0 2024-08-18T22:41:54.604 INFO:tasks.workunit.client.1.smithi195.stdout:5/817: truncate d0/f77 6193490 0 2024-08-18T22:41:54.606 INFO:tasks.workunit.client.1.smithi195.stdout:5/818: mkdir d0/d2/d29/df9 0 2024-08-18T22:41:54.607 INFO:tasks.workunit.client.1.smithi195.stdout:8/897: read d1/d3/db/d35/d4d/d95/fa6 [1676864,26284] 0 2024-08-18T22:41:54.608 INFO:tasks.workunit.client.1.smithi195.stdout:8/898: stat d1/d3/d1c/d6a/f144 0 2024-08-18T22:41:54.609 INFO:tasks.workunit.client.1.smithi195.stdout:5/819: mknod d0/d3/d5f/cfa 0 2024-08-18T22:41:54.609 INFO:tasks.workunit.client.1.smithi195.stdout:4/733: dread d0/d99/d98/f92 [0,4194304] 0 2024-08-18T22:41:54.610 INFO:tasks.workunit.client.1.smithi195.stdout:4/734: chown d0/d7/d1d/d69/db7/d41 59 1 2024-08-18T22:41:54.611 INFO:tasks.workunit.client.1.smithi195.stdout:4/735: fsync d0/d7/d1d/d69/db7/d6c/d95/ffd 0 2024-08-18T22:41:54.612 INFO:tasks.workunit.client.1.smithi195.stdout:8/899: creat d1/d3/db/d35/da9/f14c x:0 0 0 2024-08-18T22:41:54.613 INFO:tasks.workunit.client.1.smithi195.stdout:5/820: mkdir d0/d3/d8/d3b/dfb 0 2024-08-18T22:41:54.614 INFO:tasks.workunit.client.1.smithi195.stdout:4/736: symlink d0/d99/d98/d16/d94/db2/da4/l105 0 2024-08-18T22:41:54.616 INFO:tasks.workunit.client.1.smithi195.stdout:8/900: rename d1/d3/db/d35/dd1/f12b to d1/dca/f14d 0 2024-08-18T22:41:54.618 INFO:tasks.workunit.client.1.smithi195.stdout:5/821: symlink d0/d2/lfc 0 2024-08-18T22:41:54.620 INFO:tasks.workunit.client.1.smithi195.stdout:8/901: creat d1/d3/db/d35/d4d/d5c/de4/f14e x:0 0 0 2024-08-18T22:41:54.622 INFO:tasks.workunit.client.1.smithi195.stdout:4/737: dread d0/d99/d85/faa [0,4194304] 0 2024-08-18T22:41:54.622 INFO:tasks.workunit.client.1.smithi195.stdout:5/822: link d0/d3/d66/dda/ce7 d0/d37/d8b/cfd 0 2024-08-18T22:41:54.622 INFO:tasks.workunit.client.1.smithi195.stdout:8/902: read d1/d3/db/d39/fc4 [231734,81793] 0 2024-08-18T22:41:54.624 INFO:tasks.workunit.client.1.smithi195.stdout:5/823: mkdir d0/d3/d8/d3b/dfe 0 2024-08-18T22:41:54.624 INFO:tasks.workunit.client.1.smithi195.stdout:5/824: readlink d0/d3/df/l2e 0 2024-08-18T22:41:54.625 INFO:tasks.workunit.client.1.smithi195.stdout:4/738: creat d0/d99/d98/d16/d94/db2/da4/f106 x:0 0 0 2024-08-18T22:41:54.628 INFO:tasks.workunit.client.1.smithi195.stdout:5/825: rename d0/d3/d8/d3b/l85 to d0/db/lff 0 2024-08-18T22:41:54.629 INFO:tasks.workunit.client.1.smithi195.stdout:4/739: mkdir d0/d7/d1d/d69/db7/d41/d66/dfa/d107 0 2024-08-18T22:41:54.633 INFO:tasks.workunit.client.1.smithi195.stdout:4/740: creat d0/d99/d98/d16/d94/db2/da4/dad/f108 x:0 0 0 2024-08-18T22:41:54.634 INFO:tasks.workunit.client.1.smithi195.stdout:5/826: dwrite d0/d3/f8d [0,4194304] 0 2024-08-18T22:41:54.635 INFO:tasks.workunit.client.1.smithi195.stdout:8/903: dread d1/d3/db/d35/d4d/d8b/f91 [0,4194304] 0 2024-08-18T22:41:54.636 INFO:tasks.workunit.client.1.smithi195.stdout:4/741: fdatasync d0/d7/d1d/d69/db7/d3b/fd1 0 2024-08-18T22:41:54.637 INFO:tasks.workunit.client.1.smithi195.stdout:8/904: write d1/d3/d1c/d21/daa/f111 [1084924,118680] 0 2024-08-18T22:41:54.638 INFO:tasks.workunit.client.1.smithi195.stdout:5/827: rename d0/d3/d8/d64/fcd to d0/d46/d6d/f100 0 2024-08-18T22:41:54.642 INFO:tasks.workunit.client.1.smithi195.stdout:5/828: mkdir d0/d3/d66/d101 0 2024-08-18T22:41:54.646 INFO:tasks.workunit.client.1.smithi195.stdout:5/829: mkdir d0/d3/d8/d64/d87/dc7/d102 0 2024-08-18T22:41:54.647 INFO:tasks.workunit.client.1.smithi195.stdout:4/742: getdents d0/d99/d98/d16/d94 0 2024-08-18T22:41:54.649 INFO:tasks.workunit.client.1.smithi195.stdout:8/905: dread d1/de/d27/f29 [0,4194304] 0 2024-08-18T22:41:54.651 INFO:tasks.workunit.client.1.smithi195.stdout:4/743: symlink d0/d99/d98/d16/l109 0 2024-08-18T22:41:54.653 INFO:tasks.workunit.client.1.smithi195.stdout:8/906: symlink d1/d64/l14f 0 2024-08-18T22:41:54.654 INFO:tasks.workunit.client.1.smithi195.stdout:4/744: mknod d0/d99/d98/d16/d54/c10a 0 2024-08-18T22:41:54.654 INFO:tasks.workunit.client.1.smithi195.stdout:8/907: write d1/de/df/d1d/d8e/f130 [887412,125214] 0 2024-08-18T22:41:54.655 INFO:tasks.workunit.client.1.smithi195.stdout:4/745: write d0/d7/d1d/d69/db7/d6c/fcc [229908,19571] 0 2024-08-18T22:41:54.656 INFO:tasks.workunit.client.1.smithi195.stdout:8/908: chown d1/d3/db/d35/da9 386095 1 2024-08-18T22:41:54.659 INFO:tasks.workunit.client.1.smithi195.stdout:4/746: fsync d0/d7/d1d/f2f 0 2024-08-18T22:41:54.659 INFO:tasks.workunit.client.1.smithi195.stdout:4/747: chown d0/d99/d98/db6/dca 569294029 1 2024-08-18T22:41:54.660 INFO:tasks.workunit.client.1.smithi195.stdout:8/909: mknod d1/c150 0 2024-08-18T22:41:54.663 INFO:tasks.workunit.client.1.smithi195.stdout:8/910: mkdir d1/de/d27/d4f/dde/d151 0 2024-08-18T22:41:54.664 INFO:tasks.workunit.client.1.smithi195.stdout:4/748: creat d0/d99/d98/d16/f10b x:0 0 0 2024-08-18T22:41:54.667 INFO:tasks.workunit.client.1.smithi195.stdout:4/749: unlink d0/d99/d98/d16/dae/cb1 0 2024-08-18T22:41:54.669 INFO:tasks.workunit.client.1.smithi195.stdout:8/911: dwrite d1/de/d27/ff5 [0,4194304] 0 2024-08-18T22:41:54.671 INFO:tasks.workunit.client.1.smithi195.stdout:4/750: read - d0/d99/d98/d16/d94/db2/da4/dad/fd0 zero size 2024-08-18T22:41:54.672 INFO:tasks.workunit.client.1.smithi195.stdout:3/941: sync 2024-08-18T22:41:54.672 INFO:tasks.workunit.client.1.smithi195.stdout:7/858: sync 2024-08-18T22:41:54.676 INFO:tasks.workunit.client.1.smithi195.stdout:4/751: fdatasync d0/d7/d1d/d69/ff3 0 2024-08-18T22:41:54.676 INFO:tasks.workunit.client.1.smithi195.stdout:8/912: symlink d1/d3/db/d35/d4d/d5c/ddf/d107/l152 0 2024-08-18T22:41:54.679 INFO:tasks.workunit.client.1.smithi195.stdout:5/830: dwrite d0/d3/f9e [0,4194304] 0 2024-08-18T22:41:54.682 INFO:tasks.workunit.client.1.smithi195.stdout:4/752: truncate d0/d7/d1d/d69/db7/d3b/d6f/db0/fe1 92331 0 2024-08-18T22:41:54.682 INFO:tasks.workunit.client.1.smithi195.stdout:7/859: creat dc/d8f/d96/dc5/d11b/dde/d111/f12f x:0 0 0 2024-08-18T22:41:54.685 INFO:tasks.workunit.client.1.smithi195.stdout:5/831: creat d0/d37/f103 x:0 0 0 2024-08-18T22:41:54.688 INFO:tasks.workunit.client.1.smithi195.stdout:3/942: write d7/d1f/fa9 [1469942,95129] 0 2024-08-18T22:41:54.689 INFO:tasks.workunit.client.1.smithi195.stdout:8/913: write d1/de/d67/fe1 [851931,128365] 0 2024-08-18T22:41:54.691 INFO:tasks.workunit.client.1.smithi195.stdout:8/914: dread - d1/d3/db/d39/d44/dcb/f105 zero size 2024-08-18T22:41:54.692 INFO:tasks.workunit.client.1.smithi195.stdout:5/832: rename d0/d2/d53/lf3 to d0/dea/dd3/dec/l104 0 2024-08-18T22:41:54.694 INFO:tasks.workunit.client.1.smithi195.stdout:5/833: write d0/d2/d29/f47 [4590491,106034] 0 2024-08-18T22:41:54.697 INFO:tasks.workunit.client.1.smithi195.stdout:3/943: read d7/da/df/d1c/d6a/d6c/f9f [174295,113871] 0 2024-08-18T22:41:54.698 INFO:tasks.workunit.client.1.smithi195.stdout:7/860: link dc/d1d/d29/ddb/d15/d4d/f79 dc/d1d/d29/ddb/d10d/db6/f130 0 2024-08-18T22:41:54.699 INFO:tasks.workunit.client.1.smithi195.stdout:0/793: sync 2024-08-18T22:41:54.699 INFO:tasks.workunit.client.1.smithi195.stdout:9/804: sync 2024-08-18T22:41:54.700 INFO:tasks.workunit.client.1.smithi195.stdout:5/834: write d0/d2/d29/dc5/fcb [628025,3771] 0 2024-08-18T22:41:54.702 INFO:tasks.workunit.client.1.smithi195.stdout:8/915: write d1/d64/f73 [48549,53191] 0 2024-08-18T22:41:54.704 INFO:tasks.workunit.client.1.smithi195.stdout:4/753: dwrite d0/d7/d1d/f2f [0,4194304] 0 2024-08-18T22:41:54.705 INFO:tasks.workunit.client.1.smithi195.stdout:9/805: write d1c/d92/da1/fca [266296,103707] 0 2024-08-18T22:41:54.706 INFO:tasks.workunit.client.1.smithi195.stdout:7/861: write dc/d1d/d29/f34 [1870757,69170] 0 2024-08-18T22:41:54.712 INFO:tasks.workunit.client.1.smithi195.stdout:4/754: write d0/d99/d98/d16/f10b [86848,11479] 0 2024-08-18T22:41:54.712 INFO:tasks.workunit.client.1.smithi195.stdout:7/862: chown dc/d1d/d29/ddb/d15/d4d/d97/dfe/d18/d89 99 1 2024-08-18T22:41:54.714 INFO:tasks.workunit.client.1.smithi195.stdout:8/916: mkdir d1/d3/db/d35/d4d/d5c/ddf/d153 0 2024-08-18T22:41:54.716 INFO:tasks.workunit.client.1.smithi195.stdout:7/863: dread dc/d22/f7e [0,4194304] 0 2024-08-18T22:41:54.720 INFO:tasks.workunit.client.1.smithi195.stdout:4/755: creat d0/d7/d1d/d69/db7/d3b/f10c x:0 0 0 2024-08-18T22:41:54.721 INFO:tasks.workunit.client.1.smithi195.stdout:0/794: link d0/dc/d64/d81/d44/d41/d6d/d92/faf d0/dc/d64/d81/d44/d41/d4c/dd9/ffc 0 2024-08-18T22:41:54.721 INFO:tasks.workunit.client.1.smithi195.stdout:9/806: getdents d1c/d70 0 2024-08-18T22:41:54.723 INFO:tasks.workunit.client.1.smithi195.stdout:3/944: dread d7/d54/fc7 [0,4194304] 0 2024-08-18T22:41:54.725 INFO:tasks.workunit.client.1.smithi195.stdout:5/835: rename d0/d37/d8b/cfd to d0/c105 0 2024-08-18T22:41:54.726 INFO:tasks.workunit.client.1.smithi195.stdout:4/756: creat d0/d99/d98/d16/d94/f10d x:0 0 0 2024-08-18T22:41:54.727 INFO:tasks.workunit.client.1.smithi195.stdout:0/795: write d0/dc/dd/d46/ff8 [834011,108284] 0 2024-08-18T22:41:54.728 INFO:tasks.workunit.client.1.smithi195.stdout:9/807: mkdir d1c/d32/d71/dbe/d98/df6 0 2024-08-18T22:41:54.730 INFO:tasks.workunit.client.1.smithi195.stdout:0/796: mknod d0/cfd 0 2024-08-18T22:41:54.731 INFO:tasks.workunit.client.1.smithi195.stdout:3/945: fsync d7/da/f48 0 2024-08-18T22:41:54.733 INFO:tasks.workunit.client.1.smithi195.stdout:7/864: rename dc/d1d/d29/ddb/d15/d4d/d97/dfe/c8d to dc/d1d/d29/ddb/d15/d4d/d97/dfe/d18/c131 0 2024-08-18T22:41:54.734 INFO:tasks.workunit.client.1.smithi195.stdout:8/917: dwrite d1/d3/d1c/d21/f62 [4194304,4194304] 0 2024-08-18T22:41:54.734 INFO:tasks.workunit.client.1.smithi195.stdout:4/757: dread - d0/d7/d1d/d69/db7/d3b/d6f/fd6 zero size 2024-08-18T22:41:54.739 INFO:tasks.workunit.client.1.smithi195.stdout:5/836: link d0/d3/d8/fb9 d0/d2/d29/df9/f106 0 2024-08-18T22:41:54.742 INFO:tasks.workunit.client.1.smithi195.stdout:3/946: truncate d7/d54/f94 70106 0 2024-08-18T22:41:54.742 INFO:tasks.workunit.client.1.smithi195.stdout:8/918: write d1/d3/db/d39/d44/d79/df2/f110 [912995,58663] 0 2024-08-18T22:41:54.743 INFO:tasks.workunit.client.1.smithi195.stdout:7/865: mkdir dc/d132 0 2024-08-18T22:41:54.745 INFO:tasks.workunit.client.1.smithi195.stdout:9/808: dwrite d1c/d32/d37/d4b/dc6/fd4 [0,4194304] 0 2024-08-18T22:41:54.745 INFO:tasks.workunit.client.1.smithi195.stdout:0/797: symlink d0/dc/d25/lfe 0 2024-08-18T22:41:54.746 INFO:tasks.workunit.client.1.smithi195.stdout:4/758: link d0/d7/l68 d0/d99/d81/l10e 0 2024-08-18T22:41:54.748 INFO:tasks.workunit.client.1.smithi195.stdout:5/837: write d0/d2/d29/fe4 [726603,146] 0 2024-08-18T22:41:54.753 INFO:tasks.workunit.client.1.smithi195.stdout:8/919: rmdir d1/d3/db/d35/d4d 39 2024-08-18T22:41:54.753 INFO:tasks.workunit.client.1.smithi195.stdout:2/531: sync 2024-08-18T22:41:54.753 INFO:tasks.workunit.client.1.smithi195.stdout:6/714: sync 2024-08-18T22:41:54.755 INFO:tasks.workunit.client.1.smithi195.stdout:8/920: mknod d1/d3/d1c/d6a/c154 0 2024-08-18T22:41:54.755 INFO:tasks.workunit.client.1.smithi195.stdout:0/798: creat d0/dc/d64/d81/d44/d41/d6d/d92/d66/d8d/dbe/fff x:0 0 0 2024-08-18T22:41:54.755 INFO:tasks.workunit.client.1.smithi195.stdout:9/809: mknod d1c/d92/d96/d9d/cf7 0 2024-08-18T22:41:54.758 INFO:tasks.workunit.client.1.smithi195.stdout:4/759: mknod d0/d7/d1d/c10f 0 2024-08-18T22:41:54.758 INFO:tasks.workunit.client.1.smithi195.stdout:6/715: mknod da/d22/d87/cdd 0 2024-08-18T22:41:54.758 INFO:tasks.workunit.client.1.smithi195.stdout:2/532: truncate d1/f10 2168581 0 2024-08-18T22:41:54.759 INFO:tasks.workunit.client.1.smithi195.stdout:9/810: read d1c/d70/fb6 [370727,58887] 0 2024-08-18T22:41:54.759 INFO:tasks.workunit.client.1.smithi195.stdout:7/866: mkdir dc/d1d/d29/ddb/d133 0 2024-08-18T22:41:54.765 INFO:tasks.workunit.client.1.smithi195.stdout:5/838: dread d0/d3/df/d1a/fab [0,4194304] 0 2024-08-18T22:41:54.766 INFO:tasks.workunit.client.1.smithi195.stdout:6/716: unlink da/ddc/lda 0 2024-08-18T22:41:54.784 INFO:tasks.workunit.client.1.smithi195.stdout:3/947: write d7/f61 [2772898,36362] 0 2024-08-18T22:41:54.786 INFO:tasks.workunit.client.1.smithi195.stdout:6/717: creat da/d15/d1c/d2e/dbd/da9/d77/fde x:0 0 0 2024-08-18T22:41:54.788 INFO:tasks.workunit.client.1.smithi195.stdout:0/799: dread d0/dc/d11/d23/d51/f72 [0,4194304] 0 2024-08-18T22:41:54.788 INFO:tasks.workunit.client.1.smithi195.stdout:8/921: truncate d1/de/d27/ff5 1549112 0 2024-08-18T22:41:54.794 INFO:tasks.workunit.client.1.smithi195.stdout:2/533: dread d1/d24/d26/d42/d5c/f7e [0,4194304] 0 2024-08-18T22:41:54.794 INFO:tasks.workunit.client.1.smithi195.stdout:5/839: truncate d0/db/fa9 2413422 0 2024-08-18T22:41:54.795 INFO:tasks.workunit.client.1.smithi195.stdout:6/718: write da/d15/d1c/d2e/f60 [3839300,50731] 0 2024-08-18T22:41:54.798 INFO:tasks.workunit.client.1.smithi195.stdout:9/811: dwrite d1c/d70/f86 [0,4194304] 0 2024-08-18T22:41:54.802 INFO:tasks.workunit.client.1.smithi195.stdout:3/948: creat d7/d1f/f136 x:0 0 0 2024-08-18T22:41:54.803 INFO:tasks.workunit.client.1.smithi195.stdout:6/719: stat da/db/d26/f7d 0 2024-08-18T22:41:54.806 INFO:tasks.workunit.client.1.smithi195.stdout:2/534: unlink d1/d24/d26/f40 0 2024-08-18T22:41:54.809 INFO:tasks.workunit.client.1.smithi195.stdout:3/949: read - d7/da/df/d1c/dc6/f123 zero size 2024-08-18T22:41:54.809 INFO:tasks.workunit.client.1.smithi195.stdout:6/720: write da/db/d2a/f57 [2300599,64683] 0 2024-08-18T22:41:54.811 INFO:tasks.workunit.client.1.smithi195.stdout:3/950: chown d7/d54/d9a 74029 1 2024-08-18T22:41:54.814 INFO:tasks.workunit.client.1.smithi195.stdout:7/867: dwrite dc/d1d/d29/ddb/d15/d4d/d97/dfe/fd6 [0,4194304] 0 2024-08-18T22:41:54.815 INFO:tasks.workunit.client.1.smithi195.stdout:9/812: dwrite f0 [0,4194304] 0 2024-08-18T22:41:54.817 INFO:tasks.workunit.client.1.smithi195.stdout:8/922: creat d1/de/df/d1d/de5/df8/d133/f155 x:0 0 0 2024-08-18T22:41:54.821 INFO:tasks.workunit.client.1.smithi195.stdout:6/721: write da/db/d26/d2d/d8e/fac [278089,86394] 0 2024-08-18T22:41:54.821 INFO:tasks.workunit.client.1.smithi195.stdout:0/800: dread d0/dc/d25/d67/fb0 [0,4194304] 0 2024-08-18T22:41:54.823 INFO:tasks.workunit.client.1.smithi195.stdout:2/535: creat d1/d22/d51/fa3 x:0 0 0 2024-08-18T22:41:54.825 INFO:tasks.workunit.client.1.smithi195.stdout:2/536: chown d1/d24/d47 152642282 1 2024-08-18T22:41:54.828 INFO:tasks.workunit.client.1.smithi195.stdout:2/537: truncate d1/d8/d3d/d6c/f8f 675447 0 2024-08-18T22:41:54.829 INFO:tasks.workunit.client.1.smithi195.stdout:5/840: truncate d0/d2/d29/f32 7456834 0 2024-08-18T22:41:54.831 INFO:tasks.workunit.client.1.smithi195.stdout:6/722: symlink da/db/d26/d2d/d8e/ldf 0 2024-08-18T22:41:54.832 INFO:tasks.workunit.client.1.smithi195.stdout:8/923: dwrite d1/de/df/d1d/de5/df8/d133/f155 [0,4194304] 0 2024-08-18T22:41:54.834 INFO:tasks.workunit.client.1.smithi195.stdout:2/538: chown d1/d8/d3d/d3b/d53/f76 22 1 2024-08-18T22:41:54.834 INFO:tasks.workunit.client.1.smithi195.stdout:3/951: mkdir d7/da/df/dca/d12c/d137 0 2024-08-18T22:41:54.836 INFO:tasks.workunit.client.1.smithi195.stdout:9/813: link d1c/d32/d71/dbe/d98/fcf d1c/dd5/ff8 0 2024-08-18T22:41:54.836 INFO:tasks.workunit.client.1.smithi195.stdout:2/539: dread - d1/d22/d51/fa2 zero size 2024-08-18T22:41:54.837 INFO:tasks.workunit.client.1.smithi195.stdout:7/868: dread dc/d1d/d29/ddb/d2b/f3a [0,4194304] 0 2024-08-18T22:41:54.838 INFO:tasks.workunit.client.1.smithi195.stdout:6/723: mkdir da/ddc/da7/de0 0 2024-08-18T22:41:54.840 INFO:tasks.workunit.client.1.smithi195.stdout:6/724: chown da/d15/d1c/d2e/dbd/da9/d77/fde 2194 1 2024-08-18T22:41:54.841 INFO:tasks.workunit.client.1.smithi195.stdout:3/952: dread d7/d54/f94 [0,4194304] 0 2024-08-18T22:41:54.842 INFO:tasks.workunit.client.1.smithi195.stdout:8/924: symlink d1/d3/db/d7a/l156 0 2024-08-18T22:41:54.842 INFO:tasks.workunit.client.1.smithi195.stdout:6/725: chown da/d15/d1c/d64/fb6 6 1 2024-08-18T22:41:54.842 INFO:tasks.workunit.client.1.smithi195.stdout:3/953: read - d7/faf zero size 2024-08-18T22:41:54.844 INFO:tasks.workunit.client.1.smithi195.stdout:5/841: creat d0/d2/f107 x:0 0 0 2024-08-18T22:41:54.844 INFO:tasks.workunit.client.1.smithi195.stdout:0/801: getdents d0/dc/d25/d67 0 2024-08-18T22:41:54.846 INFO:tasks.workunit.client.1.smithi195.stdout:7/869: truncate dc/d1d/d29/ddb/d10d/db6/df7/f128 943674 0 2024-08-18T22:41:54.848 INFO:tasks.workunit.client.1.smithi195.stdout:8/925: stat d1/d64/l6d 0 2024-08-18T22:41:54.849 INFO:tasks.workunit.client.1.smithi195.stdout:6/726: creat da/db/d26/d2d/d8e/fe1 x:0 0 0 2024-08-18T22:41:54.850 INFO:tasks.workunit.client.1.smithi195.stdout:3/954: creat d7/da/df/d1c/f138 x:0 0 0 2024-08-18T22:41:54.852 INFO:tasks.workunit.client.1.smithi195.stdout:9/814: creat d1c/d92/ff9 x:0 0 0 2024-08-18T22:41:54.853 INFO:tasks.workunit.client.1.smithi195.stdout:3/955: chown d7/da/df/d38 45038 1 2024-08-18T22:41:54.856 INFO:tasks.workunit.client.1.smithi195.stdout:5/842: dwrite d0/d2/d29/d88/fd1 [0,4194304] 0 2024-08-18T22:41:54.858 INFO:tasks.workunit.client.1.smithi195.stdout:3/956: read d7/da/df/d1c/f58 [1956280,69133] 0 2024-08-18T22:41:54.861 INFO:tasks.workunit.client.1.smithi195.stdout:6/727: link da/db/d78/fc6 da/d15/d1c/fe2 0 2024-08-18T22:41:54.862 INFO:tasks.workunit.client.1.smithi195.stdout:9/815: mkdir d1c/d32/d71/dbe/d98/df6/dfa 0 2024-08-18T22:41:54.865 INFO:tasks.workunit.client.1.smithi195.stdout:3/957: creat d7/d1f/d73/dae/f139 x:0 0 0 2024-08-18T22:41:54.865 INFO:tasks.workunit.client.1.smithi195.stdout:7/870: dwrite dc/d1d/d29/ddb/d15/d4d/d97/dfe/d18/f1c [0,4194304] 0 2024-08-18T22:41:54.865 INFO:tasks.workunit.client.1.smithi195.stdout:9/816: read d1c/d32/d37/d4b/f6e [387998,91204] 0 2024-08-18T22:41:54.867 INFO:tasks.workunit.client.1.smithi195.stdout:5/843: creat d0/d3/d8/d3b/db1/dc6/f108 x:0 0 0 2024-08-18T22:41:54.872 INFO:tasks.workunit.client.1.smithi195.stdout:9/817: symlink d1c/d74/d8e/lfb 0 2024-08-18T22:41:54.881 INFO:tasks.workunit.client.1.smithi195.stdout:5/844: dread d0/d3/f9e [0,4194304] 0 2024-08-18T22:41:54.881 INFO:tasks.workunit.client.1.smithi195.stdout:8/926: dwrite d1/d3/db/d35/d56/f76 [4194304,4194304] 0 2024-08-18T22:41:54.881 INFO:tasks.workunit.client.1.smithi195.stdout:3/958: dwrite d7/df6/f118 [0,4194304] 0 2024-08-18T22:41:54.884 INFO:tasks.workunit.client.1.smithi195.stdout:8/927: chown d1/d3/db/d39/d2e/f4c 2686838 1 2024-08-18T22:41:54.886 INFO:tasks.workunit.client.1.smithi195.stdout:5/845: fdatasync d0/d2/d29/d88/d6a/d96/fd6 0 2024-08-18T22:41:54.886 INFO:tasks.workunit.client.1.smithi195.stdout:7/871: truncate dc/d1d/d29/ddb/d15/d4d/d97/dfe/d18/f57 1230021 0 2024-08-18T22:41:54.886 INFO:tasks.workunit.client.1.smithi195.stdout:3/959: unlink d7/da/df/dca/d81/f83 0 2024-08-18T22:41:54.892 INFO:tasks.workunit.client.1.smithi195.stdout:6/728: dread da/d15/d1c/d2e/f85 [0,4194304] 0 2024-08-18T22:41:54.892 INFO:tasks.workunit.client.1.smithi195.stdout:5/846: mkdir d0/d3/d8/d3b/db1/dc6/d109 0 2024-08-18T22:41:54.893 INFO:tasks.workunit.client.1.smithi195.stdout:9/818: dwrite d1c/d32/d37/f6d [0,4194304] 0 2024-08-18T22:41:54.897 INFO:tasks.workunit.client.1.smithi195.stdout:3/960: rename d7/d1f/d49/l66 to d7/d1f/d49/l13a 0 2024-08-18T22:41:54.898 INFO:tasks.workunit.client.1.smithi195.stdout:5/847: chown d0/c1 217057 1 2024-08-18T22:41:54.899 INFO:tasks.workunit.client.1.smithi195.stdout:6/729: truncate da/d15/d1c/d64/fb6 944351 0 2024-08-18T22:41:54.900 INFO:tasks.workunit.client.1.smithi195.stdout:8/928: write d1/d3/d1c/d6a/f10a [1124860,51267] 0 2024-08-18T22:41:54.901 INFO:tasks.workunit.client.1.smithi195.stdout:7/872: dwrite dc/d1d/d29/f127 [0,4194304] 0 2024-08-18T22:41:54.905 INFO:tasks.workunit.client.1.smithi195.stdout:6/730: write da/db/d26/fb5 [1019154,54194] 0 2024-08-18T22:41:54.906 INFO:tasks.workunit.client.1.smithi195.stdout:5/848: write d0/d2/d29/d88/d6a/d96/fd6 [379502,92961] 0 2024-08-18T22:41:54.909 INFO:tasks.workunit.client.1.smithi195.stdout:8/929: chown d1/d3/db/d35/d4d/d5c/ddf/d107/l147 856658 1 2024-08-18T22:41:54.909 INFO:tasks.workunit.client.1.smithi195.stdout:6/731: mkdir da/d15/d1c/de3 0 2024-08-18T22:41:54.912 INFO:tasks.workunit.client.1.smithi195.stdout:5/849: mkdir d0/d2/d29/df9/d10a 0 2024-08-18T22:41:54.913 INFO:tasks.workunit.client.1.smithi195.stdout:3/961: dwrite d7/da/df/d8e/ff5 [0,4194304] 0 2024-08-18T22:41:54.915 INFO:tasks.workunit.client.1.smithi195.stdout:8/930: getdents d1/d3 0 2024-08-18T22:41:54.916 INFO:tasks.workunit.client.1.smithi195.stdout:6/732: rename da/fdb to da/db/fe4 0 2024-08-18T22:41:54.917 INFO:tasks.workunit.client.1.smithi195.stdout:5/850: creat d0/d2/d29/d88/d90/f10b x:0 0 0 2024-08-18T22:41:54.920 INFO:tasks.workunit.client.1.smithi195.stdout:8/931: dread d1/de/df/d1d/d8e/f130 [0,4194304] 0 2024-08-18T22:41:54.924 INFO:tasks.workunit.client.1.smithi195.stdout:8/932: symlink d1/d3/db/d35/dd1/d134/l157 0 2024-08-18T22:41:54.926 INFO:tasks.workunit.client.1.smithi195.stdout:3/962: rename d7/da/d75/f78 to d7/da/df/d8e/f13b 0 2024-08-18T22:41:54.926 INFO:tasks.workunit.client.1.smithi195.stdout:9/819: truncate d1c/d92/d96/f9c 950361 0 2024-08-18T22:41:54.928 INFO:tasks.workunit.client.1.smithi195.stdout:5/851: creat d0/f10c x:0 0 0 2024-08-18T22:41:54.933 INFO:tasks.workunit.client.1.smithi195.stdout:6/733: rename da/db/d19/f23 to da/dd5/fe5 0 2024-08-18T22:41:54.933 INFO:tasks.workunit.client.1.smithi195.stdout:9/820: creat d1c/d92/d9a/ffc x:0 0 0 2024-08-18T22:41:54.934 INFO:tasks.workunit.client.1.smithi195.stdout:3/963: symlink d7/da/df/d1c/d6a/df1/l13c 0 2024-08-18T22:41:54.935 INFO:tasks.workunit.client.1.smithi195.stdout:9/821: write d1c/d74/d8e/dcc/fd6 [7322424,34685] 0 2024-08-18T22:41:54.936 INFO:tasks.workunit.client.1.smithi195.stdout:3/964: chown d7/da/df/d1c/c7c 338 1 2024-08-18T22:41:54.937 INFO:tasks.workunit.client.1.smithi195.stdout:8/933: creat d1/de/df/d1d/de5/dff/d11c/f158 x:0 0 0 2024-08-18T22:41:54.940 INFO:tasks.workunit.client.1.smithi195.stdout:6/734: symlink da/dd5/le6 0 2024-08-18T22:41:54.942 INFO:tasks.workunit.client.1.smithi195.stdout:9/822: mkdir d1c/d32/d37/d4b/dfd 0 2024-08-18T22:41:54.943 INFO:tasks.workunit.client.1.smithi195.stdout:3/965: creat d7/da/df/d8e/daa/df9/f13d x:0 0 0 2024-08-18T22:41:54.946 INFO:tasks.workunit.client.1.smithi195.stdout:6/735: rename da/db/d2a/c6c to da/db/d19/d67/ce7 0 2024-08-18T22:41:54.948 INFO:tasks.workunit.client.1.smithi195.stdout:3/966: unlink d7/d1f/d73/dae/l12a 0 2024-08-18T22:41:54.949 INFO:tasks.workunit.client.1.smithi195.stdout:3/967: chown d7/d54/d9a/lda 111133 1 2024-08-18T22:41:54.950 INFO:tasks.workunit.client.1.smithi195.stdout:3/968: fdatasync d7/da/df/d8e/fbe 0 2024-08-18T22:41:54.953 INFO:tasks.workunit.client.1.smithi195.stdout:6/736: creat da/db/d19/d67/da8/fe8 x:0 0 0 2024-08-18T22:41:54.954 INFO:tasks.workunit.client.1.smithi195.stdout:3/969: read - d7/da/fa0 zero size 2024-08-18T22:41:54.954 INFO:tasks.workunit.client.1.smithi195.stdout:6/737: fdatasync da/db/d26/fb5 0 2024-08-18T22:41:54.954 INFO:tasks.workunit.client.1.smithi195.stdout:9/823: link d1c/d74/cd1 d1c/d74/cfe 0 2024-08-18T22:41:54.955 INFO:tasks.workunit.client.1.smithi195.stdout:3/970: dread - d7/da/df/f12b zero size 2024-08-18T22:41:54.957 INFO:tasks.workunit.client.1.smithi195.stdout:6/738: creat da/ddc/dd7/fe9 x:0 0 0 2024-08-18T22:41:54.959 INFO:tasks.workunit.client.1.smithi195.stdout:9/824: rename d1c/d32/db1/fae to d1c/d32/d71/dbe/d90/fff 0 2024-08-18T22:41:54.960 INFO:tasks.workunit.client.1.smithi195.stdout:8/934: dread d1/de/df/f19 [0,4194304] 0 2024-08-18T22:41:54.963 INFO:tasks.workunit.client.1.smithi195.stdout:3/971: mkdir d7/da/df/dca/d12c/d137/d13e 0 2024-08-18T22:41:54.964 INFO:tasks.workunit.client.1.smithi195.stdout:3/972: write d7/d1f/d73/fc0 [1028321,15414] 0 2024-08-18T22:41:54.964 INFO:tasks.workunit.client.1.smithi195.stdout:9/825: creat d1c/d32/d37/d4b/f100 x:0 0 0 2024-08-18T22:41:54.966 INFO:tasks.workunit.client.1.smithi195.stdout:3/973: stat d7/da/df/d1c/dc6/ffa 0 2024-08-18T22:41:54.969 INFO:tasks.workunit.client.1.smithi195.stdout:6/739: dread da/d22/d87/fce [0,4194304] 0 2024-08-18T22:41:54.971 INFO:tasks.workunit.client.1.smithi195.stdout:3/974: rename d7/da/d75 to d7/da/df/d95/d13f 0 2024-08-18T22:41:54.974 INFO:tasks.workunit.client.1.smithi195.stdout:6/740: rename da/db/d19/d67/da8/fe8 to da/d15/d1c/fea 0 2024-08-18T22:41:54.977 INFO:tasks.workunit.client.1.smithi195.stdout:3/975: rename d7/da/df/d8e/daa/cdc to d7/da/df/d1c/c140 0 2024-08-18T22:41:54.978 INFO:tasks.workunit.client.1.smithi195.stdout:3/976: write d7/df6/f118 [1207060,52850] 0 2024-08-18T22:41:54.979 INFO:tasks.workunit.client.1.smithi195.stdout:8/935: write d1/d3/db/d35/d56/fc7 [4635642,119322] 0 2024-08-18T22:41:54.982 INFO:tasks.workunit.client.1.smithi195.stdout:3/977: chown d7/dc3/c107 2359 1 2024-08-18T22:41:54.983 INFO:tasks.workunit.client.1.smithi195.stdout:3/978: dread - d7/da/df/f12b zero size 2024-08-18T22:41:54.984 INFO:tasks.workunit.client.1.smithi195.stdout:8/936: symlink d1/de/df/d1d/d1f/d14b/l159 0 2024-08-18T22:41:54.985 INFO:tasks.workunit.client.1.smithi195.stdout:3/979: dread - d7/d54/f130 zero size 2024-08-18T22:41:54.987 INFO:tasks.workunit.client.1.smithi195.stdout:6/741: truncate da/d15/d1c/d2e/f3d 943045 0 2024-08-18T22:41:54.987 INFO:tasks.workunit.client.1.smithi195.stdout:9/826: dwrite d1c/f94 [0,4194304] 0 2024-08-18T22:41:54.989 INFO:tasks.workunit.client.1.smithi195.stdout:3/980: write d7/da/df/d38/f3f [705946,67247] 0 2024-08-18T22:41:54.993 INFO:tasks.workunit.client.1.smithi195.stdout:8/937: truncate d1/de/fab 424223 0 2024-08-18T22:41:54.993 INFO:tasks.workunit.client.1.smithi195.stdout:9/827: chown c1 1187418434 1 2024-08-18T22:41:55.007 INFO:tasks.workunit.client.1.smithi195.stdout:9/828: dwrite d1c/f3a [4194304,4194304] 0 2024-08-18T22:41:55.010 INFO:tasks.workunit.client.1.smithi195.stdout:8/938: dwrite d1/d3/db/d39/d2e/f61 [4194304,4194304] 0 2024-08-18T22:41:55.014 INFO:tasks.workunit.client.1.smithi195.stdout:6/742: dread da/d15/d1c/d2e/f3d [0,4194304] 0 2024-08-18T22:41:55.014 INFO:tasks.workunit.client.1.smithi195.stdout:9/829: rename d1c/d70/f86 to d1c/d74/d7b/f101 0 2024-08-18T22:41:55.014 INFO:tasks.workunit.client.1.smithi195.stdout:3/981: dread d7/d1f/f34 [0,4194304] 0 2024-08-18T22:41:55.017 INFO:tasks.workunit.client.1.smithi195.stdout:3/982: rmdir d7/da/df/d95/d13f/d113 39 2024-08-18T22:41:55.020 INFO:tasks.workunit.client.1.smithi195.stdout:9/830: mknod d1c/d32/db1/c102 0 2024-08-18T22:41:55.020 INFO:tasks.workunit.client.1.smithi195.stdout:8/939: getdents d1/d3/db/d35/d4d/d5c/de9 0 2024-08-18T22:41:55.021 INFO:tasks.workunit.client.1.smithi195.stdout:9/831: dread - d1c/d32/d37/fad zero size 2024-08-18T22:41:55.022 INFO:tasks.workunit.client.1.smithi195.stdout:3/983: unlink d7/d1f/d73/db0/c112 0 2024-08-18T22:41:55.024 INFO:tasks.workunit.client.1.smithi195.stdout:8/940: mkdir d1/d3/db/d35/d4d/d5c/de4/d15a 0 2024-08-18T22:41:55.026 INFO:tasks.workunit.client.1.smithi195.stdout:9/832: write d1c/d92/d9a/ff4 [1094030,101738] 0 2024-08-18T22:41:55.026 INFO:tasks.workunit.client.1.smithi195.stdout:8/941: chown d1/d3/db/d39/d44/d79/cc5 724521 1 2024-08-18T22:41:55.028 INFO:tasks.workunit.client.1.smithi195.stdout:3/984: mknod d7/da/df/d8e/de2/c141 0 2024-08-18T22:41:55.029 INFO:tasks.workunit.client.1.smithi195.stdout:9/833: dread d1c/d32/f91 [0,4194304] 0 2024-08-18T22:41:55.030 INFO:tasks.workunit.client.1.smithi195.stdout:8/942: creat d1/d3/db/d39/d44/d79/f15b x:0 0 0 2024-08-18T22:41:55.030 INFO:tasks.workunit.client.1.smithi195.stdout:9/834: chown d1c/f58 55 1 2024-08-18T22:41:55.034 INFO:tasks.workunit.client.1.smithi195.stdout:9/835: unlink d1c/d32/d37/d4b/f100 0 2024-08-18T22:41:55.035 INFO:tasks.workunit.client.1.smithi195.stdout:8/943: fdatasync d1/de/df/d1d/d8e/d103/f127 0 2024-08-18T22:41:55.039 INFO:tasks.workunit.client.1.smithi195.stdout:6/743: dread da/db/d26/d2d/f93 [0,4194304] 0 2024-08-18T22:41:55.040 INFO:tasks.workunit.client.1.smithi195.stdout:8/944: creat d1/d3/db/d35/d4d/d5c/ddf/d107/f15c x:0 0 0 2024-08-18T22:41:55.040 INFO:tasks.workunit.client.1.smithi195.stdout:3/985: truncate d7/d1f/d73/fc0 322341 0 2024-08-18T22:41:55.041 INFO:tasks.workunit.client.1.smithi195.stdout:6/744: readlink da/db/l1e 0 2024-08-18T22:41:55.043 INFO:tasks.workunit.client.1.smithi195.stdout:9/836: creat d1c/d32/d37/f103 x:0 0 0 2024-08-18T22:41:55.047 INFO:tasks.workunit.client.1.smithi195.stdout:8/945: truncate d1/de/df/d1d/d8e/f9a 885783 0 2024-08-18T22:41:55.047 INFO:tasks.workunit.client.1.smithi195.stdout:3/986: dwrite d7/f56 [0,4194304] 0 2024-08-18T22:41:55.047 INFO:tasks.workunit.client.1.smithi195.stdout:6/745: link da/d15/d1c/c9f da/d15/d1c/d2e/dbd/ceb 0 2024-08-18T22:41:55.049 INFO:tasks.workunit.client.1.smithi195.stdout:8/946: write d1/d3/db/d35/d4d/d5c/f108 [72033,79332] 0 2024-08-18T22:41:55.050 INFO:tasks.workunit.client.1.smithi195.stdout:9/837: rename d1c/d32/d37/d4b/f6e to d1c/d74/d8e/f104 0 2024-08-18T22:41:55.050 INFO:tasks.workunit.client.1.smithi195.stdout:3/987: mknod d7/df6/c142 0 2024-08-18T22:41:55.052 INFO:tasks.workunit.client.1.smithi195.stdout:6/746: mknod da/db/d26/cec 0 2024-08-18T22:41:55.052 INFO:tasks.workunit.client.1.smithi195.stdout:8/947: mkdir d1/d3/db/d35/da9/d15d 0 2024-08-18T22:41:55.053 INFO:tasks.workunit.client.1.smithi195.stdout:8/948: stat d1/de/df/l12 0 2024-08-18T22:41:55.054 INFO:tasks.workunit.client.1.smithi195.stdout:6/747: mkdir da/d15/d1c/ded 0 2024-08-18T22:41:55.055 INFO:tasks.workunit.client.1.smithi195.stdout:3/988: mkdir d7/d143 0 2024-08-18T22:41:55.055 INFO:tasks.workunit.client.1.smithi195.stdout:6/748: rmdir da/d3b 39 2024-08-18T22:41:55.056 INFO:tasks.workunit.client.1.smithi195.stdout:8/949: rename d1/d3/db/d35/lb7 to d1/de/d27/d4f/l15e 0 2024-08-18T22:41:55.059 INFO:tasks.workunit.client.1.smithi195.stdout:8/950: unlink d1/d64/l6d 0 2024-08-18T22:41:55.062 INFO:tasks.workunit.client.1.smithi195.stdout:8/951: chown d1/de/df/d1d/d1f/l7c 102 1 2024-08-18T22:41:55.063 INFO:tasks.workunit.client.1.smithi195.stdout:6/749: dwrite da/db/d19/f1d [8388608,4194304] 0 2024-08-18T22:41:55.065 INFO:tasks.workunit.client.1.smithi195.stdout:3/989: dwrite d7/f10b [0,4194304] 0 2024-08-18T22:41:55.065 INFO:tasks.workunit.client.1.smithi195.stdout:8/952: chown d1/d3/db/d35/dd1/d134 445 1 2024-08-18T22:41:55.068 INFO:tasks.workunit.client.1.smithi195.stdout:6/750: mkdir da/d3b/dee 0 2024-08-18T22:41:55.069 INFO:tasks.workunit.client.1.smithi195.stdout:6/751: chown da/d22/d87 113188 1 2024-08-18T22:41:55.072 INFO:tasks.workunit.client.1.smithi195.stdout:6/752: mkdir da/d22/d87/def 0 2024-08-18T22:41:55.073 INFO:tasks.workunit.client.1.smithi195.stdout:6/753: chown da/db/d19/c29 112384 1 2024-08-18T22:41:55.074 INFO:tasks.workunit.client.1.smithi195.stdout:3/990: link d7/da/df/l16 d7/da/df/dca/d12c/d137/l144 0 2024-08-18T22:41:55.075 INFO:tasks.workunit.client.1.smithi195.stdout:3/991: chown d7/da/df/dca/d12c/d137/d13e 1570 1 2024-08-18T22:41:55.076 INFO:tasks.workunit.client.1.smithi195.stdout:6/754: rmdir da/d22/d86 39 2024-08-18T22:41:55.078 INFO:tasks.workunit.client.1.smithi195.stdout:3/992: mkdir d7/da/df/d1c/d6a/d145 0 2024-08-18T22:41:55.082 INFO:tasks.workunit.client.1.smithi195.stdout:9/838: dread d1c/f44 [0,4194304] 0 2024-08-18T22:41:55.083 INFO:tasks.workunit.client.1.smithi195.stdout:6/755: dread da/f13 [0,4194304] 0 2024-08-18T22:41:55.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:41:54 smithi121 ceph-mon[16788]: pgmap v11: 65 pgs: 65 active+clean; 3.3 GiB data, 11 GiB used, 525 GiB / 536 GiB avail; 97 MiB/s rd, 265 MiB/s wr, 526 op/s 2024-08-18T22:41:55.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:41:54 smithi121 ceph-mon[16788]: from='mgr.24377 ' entity='mgr.smithi195.acttsj' 2024-08-18T22:41:55.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:41:54 smithi121 ceph-mon[16788]: from='mgr.24377 ' entity='mgr.smithi195.acttsj' 2024-08-18T22:41:55.084 INFO:tasks.workunit.client.1.smithi195.stdout:3/993: truncate d7/da/df/d11c/f129 2264686 0 2024-08-18T22:41:55.084 INFO:tasks.workunit.client.1.smithi195.stdout:9/839: chown d1c/d32/d71/dbe/la6 19 1 2024-08-18T22:41:55.089 INFO:tasks.workunit.client.1.smithi195.stdout:6/756: creat da/db/db7/ff0 x:0 0 0 2024-08-18T22:41:55.089 INFO:tasks.workunit.client.1.smithi195.stdout:9/840: truncate d1c/f3c 2760305 0 2024-08-18T22:41:55.090 INFO:tasks.workunit.client.1.smithi195.stdout:6/757: write da/db/d19/fd4 [556508,32137] 0 2024-08-18T22:41:55.092 INFO:tasks.workunit.client.1.smithi195.stdout:6/758: mkdir da/db/d26/d2d/d8e/df1 0 2024-08-18T22:41:55.094 INFO:tasks.workunit.client.1.smithi195.stdout:9/841: fdatasync d1c/d92/da1/ff2 0 2024-08-18T22:41:55.100 INFO:tasks.workunit.client.1.smithi195.stdout:3/994: write d7/d1f/d49/f7f [1413766,109125] 0 2024-08-18T22:41:55.102 INFO:tasks.workunit.client.1.smithi195.stdout:3/995: fsync d7/d54/d9a/fab 0 2024-08-18T22:41:55.103 INFO:tasks.workunit.client.1.smithi195.stdout:9/842: write d1c/f63 [1027278,112896] 0 2024-08-18T22:41:55.105 INFO:tasks.workunit.client.1.smithi195.stdout:3/996: creat d7/d1f/d49/f146 x:0 0 0 2024-08-18T22:41:55.111 INFO:tasks.workunit.client.1.smithi195.stdout:9/843: dwrite d1c/d92/d9a/ff4 [0,4194304] 0 2024-08-18T22:41:55.111 INFO:tasks.workunit.client.1.smithi195.stdout:6/759: dread da/db/d26/f95 [0,4194304] 0 2024-08-18T22:41:55.112 INFO:tasks.workunit.client.1.smithi195.stdout:9/844: fsync d1c/f44 0 2024-08-18T22:41:55.114 INFO:tasks.workunit.client.1.smithi195.stdout:6/760: symlink da/db/lf2 0 2024-08-18T22:41:55.118 INFO:tasks.workunit.client.1.smithi195.stdout:9/845: getdents d1c/d74/d8e/dcc 0 2024-08-18T22:41:55.119 INFO:tasks.workunit.client.1.smithi195.stdout:6/761: getdents da/d15/d1c/d2e 0 2024-08-18T22:41:55.120 INFO:tasks.workunit.client.1.smithi195.stdout:9/846: symlink d1c/d92/d9a/l105 0 2024-08-18T22:41:55.122 INFO:tasks.workunit.client.1.smithi195.stdout:6/762: truncate da/db/d26/f95 5690204 0 2024-08-18T22:41:55.123 INFO:tasks.workunit.client.1.smithi195.stdout:9/847: creat d1c/d92/f106 x:0 0 0 2024-08-18T22:41:55.124 INFO:tasks.workunit.client.1.smithi195.stdout:3/997: dread d7/da/df/d38/f45 [0,4194304] 0 2024-08-18T22:41:55.125 INFO:tasks.workunit.client.1.smithi195.stdout:9/848: unlink d1c/d74/d8e/faf 0 2024-08-18T22:41:55.127 INFO:tasks.workunit.client.1.smithi195.stdout:6/763: rename da/db/d2a to da/d22/d86/df3 0 2024-08-18T22:41:55.128 INFO:tasks.workunit.client.1.smithi195.stdout:6/764: write da/db/d19/d67/fbe [2542652,58630] 0 2024-08-18T22:41:55.129 INFO:tasks.workunit.client.1.smithi195.stdout:3/998: fdatasync d7/d54/f8a 0 2024-08-18T22:41:55.130 INFO:tasks.workunit.client.1.smithi195.stdout:3/999: write d7/df6/f118 [735459,127445] 0 2024-08-18T22:41:55.131 INFO:tasks.workunit.client.1.smithi195.stdout:6/765: creat da/d15/d1c/d2e/d74/ff4 x:0 0 0 2024-08-18T22:41:55.132 INFO:tasks.workunit.client.1.smithi195.stdout:6/766: fsync da/d3b/f6d 0 2024-08-18T22:41:55.134 INFO:tasks.workunit.client.1.smithi195.stdout:6/767: truncate da/d15/d1c/d2e/dbd/da9/fbf 281168 0 2024-08-18T22:41:55.135 INFO:tasks.workunit.client.1.smithi195.stdout:6/768: readlink da/l61 0 2024-08-18T22:41:55.137 INFO:tasks.workunit.client.1.smithi195.stdout:6/769: mknod da/d15/d1c/d2e/dbd/da9/d77/cf5 0 2024-08-18T22:41:55.137 INFO:tasks.workunit.client.1.smithi195.stdout:6/770: readlink da/d15/d1c/la6 0 2024-08-18T22:41:55.138 INFO:tasks.workunit.client.1.smithi195.stdout:6/771: chown da/db/f37 129992263 1 2024-08-18T22:41:55.140 INFO:tasks.workunit.client.1.smithi195.stdout:6/772: creat da/db/d26/ff6 x:0 0 0 2024-08-18T22:41:55.142 INFO:tasks.workunit.client.1.smithi195.stdout:6/773: rename da/db/d78/fc6 to da/d15/d1c/d2e/dbd/da9/d77/ff7 0 2024-08-18T22:41:55.151 INFO:tasks.workunit.client.1.smithi195.stdout:6/774: dwrite da/db/d26/f7d [0,4194304] 0 2024-08-18T22:41:55.156 INFO:tasks.workunit.client.1.smithi195.stdout:6/775: dwrite da/d22/d86/df3/f57 [0,4194304] 0 2024-08-18T22:41:55.158 INFO:tasks.workunit.client.1.smithi195.stdout:6/776: rmdir da/d15/d1c 39 2024-08-18T22:41:55.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:41:54 smithi195 ceph-mon[23370]: pgmap v11: 65 pgs: 65 active+clean; 3.3 GiB data, 11 GiB used, 525 GiB / 536 GiB avail; 97 MiB/s rd, 265 MiB/s wr, 526 op/s 2024-08-18T22:41:55.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:41:54 smithi195 ceph-mon[23370]: from='mgr.24377 ' entity='mgr.smithi195.acttsj' 2024-08-18T22:41:55.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:41:54 smithi195 ceph-mon[23370]: from='mgr.24377 ' entity='mgr.smithi195.acttsj' 2024-08-18T22:41:55.162 INFO:tasks.workunit.client.1.smithi195.stdout:6/777: mknod da/d22/cf8 0 2024-08-18T22:41:55.162 INFO:tasks.workunit.client.1.smithi195.stdout:6/778: stat da/db/d19/c29 0 2024-08-18T22:41:55.164 INFO:tasks.workunit.client.1.smithi195.stdout:6/779: truncate da/ddc/f76 483278 0 2024-08-18T22:41:55.167 INFO:tasks.workunit.client.1.smithi195.stdout:6/780: dread da/db/f70 [0,4194304] 0 2024-08-18T22:41:55.171 INFO:tasks.workunit.client.1.smithi195.stdout:6/781: rmdir da/d15/d1c/de3 0 2024-08-18T22:41:55.173 INFO:tasks.workunit.client.1.smithi195.stdout:6/782: mknod da/d15/d1c/d2e/cf9 0 2024-08-18T22:41:55.176 INFO:tasks.workunit.client.1.smithi195.stdout:6/783: rename da/d15/d1c/ded to da/d22/d86/dfa 0 2024-08-18T22:41:55.178 INFO:tasks.workunit.client.1.smithi195.stdout:6/784: chown da/d22/d86/df3/lc4 36509 1 2024-08-18T22:41:55.180 INFO:tasks.workunit.client.1.smithi195.stdout:6/785: rename da/db/d78/c89 to da/ddc/cfb 0 2024-08-18T22:41:55.182 INFO:tasks.workunit.client.1.smithi195.stdout:6/786: mknod da/d15/d1c/d2e/dbd/da9/d77/cfc 0 2024-08-18T22:41:55.183 INFO:tasks.workunit.client.1.smithi195.stdout:6/787: read da/db/d26/f7d [4160739,47978] 0 2024-08-18T22:41:55.185 INFO:tasks.workunit.client.1.smithi195.stdout:6/788: fsync da/d22/d87/fce 0 2024-08-18T22:41:55.191 INFO:tasks.workunit.client.1.smithi195.stdout:6/789: dwrite da/d15/d1c/d2e/dbd/da9/f9d [0,4194304] 0 2024-08-18T22:41:55.195 INFO:tasks.workunit.client.1.smithi195.stdout:6/790: creat da/d22/ffd x:0 0 0 2024-08-18T22:41:55.198 INFO:tasks.workunit.client.1.smithi195.stdout:6/791: getdents da/db/d26/d90 0 2024-08-18T22:41:55.199 INFO:tasks.workunit.client.1.smithi195.stdout:6/792: mkdir da/db/d78/dfe 0 2024-08-18T22:41:55.201 INFO:tasks.workunit.client.1.smithi195.stdout:6/793: mknod da/db/d19/d67/da8/cff 0 2024-08-18T22:41:55.202 INFO:tasks.workunit.client.1.smithi195.stdout:6/794: fsync da/d3b/f6d 0 2024-08-18T22:41:55.203 INFO:tasks.workunit.client.1.smithi195.stdout:6/795: truncate da/d22/ffd 577913 0 2024-08-18T22:41:55.219 INFO:tasks.workunit.client.1.smithi195.stdout:6/796: dread da/d22/d86/df3/fc9 [0,4194304] 0 2024-08-18T22:41:55.219 INFO:tasks.workunit.client.1.smithi195.stdout:6/797: readlink da/lc0 0 2024-08-18T22:41:55.220 INFO:tasks.workunit.client.1.smithi195.stdout:6/798: write f5 [4500975,23982] 0 2024-08-18T22:41:55.222 INFO:tasks.workunit.client.1.smithi195.stdout:6/799: mknod da/ddc/c100 0 2024-08-18T22:41:55.222 INFO:tasks.workunit.client.1.smithi195.stdout:6/800: chown da/db/d78/fd2 3 1 2024-08-18T22:41:55.223 INFO:tasks.workunit.client.1.smithi195.stdout:6/801: truncate da/d15/d1c/f9e 841930 0 2024-08-18T22:41:55.225 INFO:tasks.workunit.client.1.smithi195.stdout:6/802: unlink da/d15/d1c/d2e/d74/ff4 0 2024-08-18T22:41:55.231 INFO:tasks.workunit.client.1.smithi195.stdout:6/803: write da/d22/d86/df3/fc9 [2740756,42897] 0 2024-08-18T22:41:55.233 INFO:tasks.workunit.client.1.smithi195.stdout:6/804: truncate da/db/d19/d67/f75 5483961 0 2024-08-18T22:41:55.235 INFO:tasks.workunit.client.1.smithi195.stdout:6/805: rename da/d15/c1f to da/db/d19/d67/c101 0 2024-08-18T22:41:55.240 INFO:tasks.workunit.client.1.smithi195.stdout:6/806: dwrite da/db/d19/f45 [4194304,4194304] 0 2024-08-18T22:41:55.252 INFO:tasks.workunit.client.1.smithi195.stdout:6/807: dwrite da/db/d19/d67/f97 [0,4194304] 0 2024-08-18T22:41:55.253 INFO:tasks.workunit.client.1.smithi195.stdout:6/808: chown da/db/d26/f7d 405 1 2024-08-18T22:41:55.256 INFO:tasks.workunit.client.1.smithi195.stdout:6/809: mknod da/db/d19/c102 0 2024-08-18T22:41:55.258 INFO:tasks.workunit.client.1.smithi195.stdout:6/810: rename da/d22/c4a to da/db/d78/c103 0 2024-08-18T22:41:55.258 INFO:tasks.workunit.client.1.smithi195.stdout:6/811: read - da/d22/d87/d91/faf zero size 2024-08-18T22:41:55.260 INFO:tasks.workunit.client.1.smithi195.stdout:6/812: mknod da/ddc/da7/de0/c104 0 2024-08-18T22:41:55.262 INFO:tasks.workunit.client.1.smithi195.stdout:6/813: creat da/ddc/da7/f105 x:0 0 0 2024-08-18T22:41:55.262 INFO:tasks.workunit.client.1.smithi195.stdout:6/814: fsync da/db/d26/ff6 0 2024-08-18T22:41:55.264 INFO:tasks.workunit.client.1.smithi195.stdout:6/815: unlink da/d15/d1c/d2e/cf9 0 2024-08-18T22:41:55.274 INFO:tasks.workunit.client.1.smithi195.stdout:6/816: dread da/dd5/fe5 [0,4194304] 0 2024-08-18T22:41:55.279 INFO:tasks.workunit.client.1.smithi195.stdout:6/817: dwrite da/db/d19/f45 [4194304,4194304] 0 2024-08-18T22:41:55.280 INFO:tasks.workunit.client.1.smithi195.stdout:6/818: write da/d22/ffd [1220416,47299] 0 2024-08-18T22:41:55.283 INFO:tasks.workunit.client.1.smithi195.stdout:6/819: creat da/d15/d1c/d2e/dbd/f106 x:0 0 0 2024-08-18T22:41:55.285 INFO:tasks.workunit.client.1.smithi195.stdout:6/820: mkdir da/d22/d86/d107 0 2024-08-18T22:41:55.288 INFO:tasks.workunit.client.1.smithi195.stdout:6/821: mknod da/d15/d1c/d2e/dbd/da9/d77/c108 0 2024-08-18T22:41:55.291 INFO:tasks.workunit.client.1.smithi195.stdout:6/822: creat da/d22/d86/dfa/f109 x:0 0 0 2024-08-18T22:41:55.293 INFO:tasks.workunit.client.1.smithi195.stdout:6/823: write da/d22/d87/fce [2735382,11664] 0 2024-08-18T22:41:55.309 INFO:tasks.workunit.client.1.smithi195.stdout:4/760: sync 2024-08-18T22:41:55.312 INFO:tasks.workunit.client.1.smithi195.stdout:4/761: getdents d0/d7/d1d/d69/db7/d3b/d6f/db0 0 2024-08-18T22:41:55.314 INFO:tasks.workunit.client.1.smithi195.stdout:4/762: mknod d0/d99/d98/d16/d94/c110 0 2024-08-18T22:41:55.315 INFO:tasks.workunit.client.1.smithi195.stdout:4/763: chown d0/d7/d1d 1917702 1 2024-08-18T22:41:55.316 INFO:tasks.workunit.client.1.smithi195.stdout:4/764: creat d0/d7/d1d/d69/db4/f111 x:0 0 0 2024-08-18T22:41:55.320 INFO:tasks.workunit.client.1.smithi195.stdout:4/765: creat d0/d7/d1d/d69/db7/d3b/d6f/db0/d104/f112 x:0 0 0 2024-08-18T22:41:55.320 INFO:tasks.workunit.client.1.smithi195.stdout:4/766: dread - d0/d99/d98/db6/f100 zero size 2024-08-18T22:41:55.321 INFO:tasks.workunit.client.1.smithi195.stdout:4/767: chown d0/d99/d98/d16/f61 8804 1 2024-08-18T22:41:55.324 INFO:tasks.workunit.client.1.smithi195.stdout:4/768: creat d0/d99/d98/f113 x:0 0 0 2024-08-18T22:41:55.327 INFO:tasks.workunit.client.1.smithi195.stdout:4/769: rename d0/d7/d1d/lc3 to d0/d99/d98/d16/d94/db2/l114 0 2024-08-18T22:41:55.331 INFO:tasks.workunit.client.1.smithi195.stdout:4/770: link d0/fb5 d0/d7/d1d/d69/db4/f115 0 2024-08-18T22:41:55.335 INFO:tasks.workunit.client.1.smithi195.stdout:4/771: rename d0/d7/d1d/d69/fa5 to d0/d99/d98/d16/d94/f116 0 2024-08-18T22:41:55.339 INFO:tasks.workunit.client.1.smithi195.stdout:4/772: link d0/cc9 d0/d7/c117 0 2024-08-18T22:41:55.340 INFO:tasks.workunit.client.1.smithi195.stdout:4/773: rmdir d0/d99 39 2024-08-18T22:41:55.349 INFO:tasks.workunit.client.1.smithi195.stdout:4/774: dwrite d0/d99/d85/d48/fdb [0,4194304] 0 2024-08-18T22:41:55.360 INFO:tasks.workunit.client.1.smithi195.stdout:4/775: dwrite d0/d99/d98/d16/d94/db2/da4/fce [0,4194304] 0 2024-08-18T22:41:55.363 INFO:tasks.workunit.client.1.smithi195.stdout:4/776: unlink d0/d99/d85/d48/d4c/cda 0 2024-08-18T22:41:55.365 INFO:tasks.workunit.client.1.smithi195.stdout:4/777: rmdir d0/d7/d1d 39 2024-08-18T22:41:55.368 INFO:tasks.workunit.client.1.smithi195.stdout:4/778: read d0/d99/d98/d16/d49/f35 [1877411,89541] 0 2024-08-18T22:41:55.370 INFO:tasks.workunit.client.1.smithi195.stdout:4/779: chown d0/d7/d1d/d69/f7f 1171 1 2024-08-18T22:41:55.372 INFO:tasks.workunit.client.1.smithi195.stdout:4/780: truncate d0/d99/d85/f4e 1817399 0 2024-08-18T22:41:55.374 INFO:tasks.workunit.client.1.smithi195.stdout:4/781: truncate d0/d99/d98/d16/d94/db2/da4/f106 241497 0 2024-08-18T22:41:55.397 INFO:tasks.workunit.client.1.smithi195.stdout:2/540: sync 2024-08-18T22:41:55.397 INFO:tasks.workunit.client.1.smithi195.stdout:7/873: sync 2024-08-18T22:41:55.397 INFO:tasks.workunit.client.1.smithi195.stdout:0/802: sync 2024-08-18T22:41:55.406 INFO:tasks.workunit.client.1.smithi195.stdout:2/541: write d1/d22/d51/fa2 [952971,40399] 0 2024-08-18T22:41:55.406 INFO:tasks.workunit.client.1.smithi195.stdout:7/874: chown dc/d2a/d4c/d117/d125 18634747 1 2024-08-18T22:41:55.408 INFO:tasks.workunit.client.1.smithi195.stdout:7/875: chown dc/d1d/d29/ddb/d2b/c78 361154 1 2024-08-18T22:41:55.411 INFO:tasks.workunit.client.1.smithi195.stdout:7/876: read dc/d1d/d29/ddb/f3b [6744651,108760] 0 2024-08-18T22:41:55.411 INFO:tasks.workunit.client.1.smithi195.stdout:0/803: dread d0/dc/d25/d67/db8/fe4 [0,4194304] 0 2024-08-18T22:41:55.416 INFO:tasks.workunit.client.1.smithi195.stdout:0/804: truncate d0/dc/d11/d6f/d9d/ff5 377869 0 2024-08-18T22:41:55.417 INFO:tasks.workunit.client.1.smithi195.stdout:2/542: dwrite d1/d8/d3d/d3b/d7d/f82 [0,4194304] 0 2024-08-18T22:41:55.430 INFO:tasks.workunit.client.1.smithi195.stdout:2/543: rmdir d1/d8/d3d/d6c/d7c 39 2024-08-18T22:41:55.434 INFO:tasks.workunit.client.1.smithi195.stdout:0/805: rename d0/dc/d64/d81/d44/d41/d6d/d92/d66/d8d/c90 to d0/c100 0 2024-08-18T22:41:55.435 INFO:tasks.workunit.client.1.smithi195.stdout:2/544: dread d1/d8/d3d/d3b/d7d/f82 [0,4194304] 0 2024-08-18T22:41:55.442 INFO:tasks.workunit.client.1.smithi195.stdout:7/877: getdents dc/d1d/d29/ddb/d10d 0 2024-08-18T22:41:55.443 INFO:tasks.workunit.client.1.smithi195.stdout:0/806: fdatasync d0/dc/d64/d81/d44/d41/d6d/d92/d66/f8b 0 2024-08-18T22:41:55.456 INFO:tasks.workunit.client.1.smithi195.stdout:0/807: rmdir d0/dc/d64/d81/d44/d41 39 2024-08-18T22:41:55.459 INFO:tasks.workunit.client.1.smithi195.stdout:0/808: chown d0/dc/d64/d81/d44/d41/d6d/d92/lae 798114 1 2024-08-18T22:41:55.465 INFO:tasks.workunit.client.1.smithi195.stdout:7/878: dwrite dc/ff3 [0,4194304] 0 2024-08-18T22:41:55.465 INFO:tasks.workunit.client.1.smithi195.stdout:2/545: dwrite d1/d8/d3d/d3b/d46/f66 [0,4194304] 0 2024-08-18T22:41:55.468 INFO:tasks.workunit.client.1.smithi195.stdout:7/879: creat dc/d1d/d29/ddb/d15/d4d/d97/f134 x:0 0 0 2024-08-18T22:41:55.471 INFO:tasks.workunit.client.1.smithi195.stdout:7/880: mkdir dc/d2a/d4c/d135 0 2024-08-18T22:41:55.473 INFO:tasks.workunit.client.1.smithi195.stdout:0/809: dwrite d0/dc/d11/fdf [0,4194304] 0 2024-08-18T22:41:55.474 INFO:tasks.workunit.client.1.smithi195.stdout:0/810: stat d0/dc/d11/d23/d51 0 2024-08-18T22:41:55.479 INFO:tasks.workunit.client.1.smithi195.stdout:0/811: symlink d0/dc/d25/l101 0 2024-08-18T22:41:55.480 INFO:tasks.workunit.client.1.smithi195.stdout:7/881: rmdir dc/d8f/d96/dc5/d120 0 2024-08-18T22:41:55.483 INFO:tasks.workunit.client.1.smithi195.stdout:7/882: chown dc/d1d/d29/ddb/d15/d4d/d97/dfe/d18/f57 39519 1 2024-08-18T22:41:55.484 INFO:tasks.workunit.client.1.smithi195.stdout:7/883: chown dc/d1d/d29/ddb/d2b/d82/l9d 172069 1 2024-08-18T22:41:55.485 INFO:tasks.workunit.client.1.smithi195.stdout:0/812: link d0/dc/l19 d0/dc/d64/d81/d44/d41/d6d/d92/db6/l102 0 2024-08-18T22:41:55.486 INFO:tasks.workunit.client.1.smithi195.stdout:7/884: chown dc/d8f/d96/la7 3899832 1 2024-08-18T22:41:55.486 INFO:tasks.workunit.client.1.smithi195.stdout:7/885: chown dc/d1d/lda 123649 1 2024-08-18T22:41:55.498 INFO:tasks.workunit.client.1.smithi195.stdout:0/813: dwrite d0/dc/d64/fa3 [0,4194304] 0 2024-08-18T22:41:55.499 INFO:tasks.workunit.client.1.smithi195.stdout:0/814: chown d0/dc/d11/d23/d51/dad/df4 3222 1 2024-08-18T22:41:55.503 INFO:tasks.workunit.client.1.smithi195.stdout:0/815: dread d0/dc/d64/d81/d44/d41/d6d/fbd [0,4194304] 0 2024-08-18T22:41:55.505 INFO:tasks.workunit.client.1.smithi195.stdout:0/816: write d0/dc/dd/d46/fa9 [2506153,126616] 0 2024-08-18T22:41:55.507 INFO:tasks.workunit.client.1.smithi195.stdout:0/817: mkdir d0/dc/d11/d23/d51/d103 0 2024-08-18T22:41:55.509 INFO:tasks.workunit.client.1.smithi195.stdout:0/818: creat d0/dc/d64/de2/f104 x:0 0 0 2024-08-18T22:41:55.512 INFO:tasks.workunit.client.1.smithi195.stdout:7/886: dread dc/d22/f3e [0,4194304] 0 2024-08-18T22:41:55.512 INFO:tasks.workunit.client.1.smithi195.stdout:0/819: creat d0/dc/d64/f105 x:0 0 0 2024-08-18T22:41:55.515 INFO:tasks.workunit.client.1.smithi195.stdout:7/887: mkdir dc/d1d/d29/ddb/d15/d4d/d97/dfe/d18/d89/d136 0 2024-08-18T22:41:55.517 INFO:tasks.workunit.client.1.smithi195.stdout:0/820: truncate d0/dc/d64/d81/d44/d41/d6d/d92/d66/fcd 468635 0 2024-08-18T22:41:55.518 INFO:tasks.workunit.client.1.smithi195.stdout:0/821: chown d0/dc/d64/d81/d44/fbb 12669179 1 2024-08-18T22:41:55.520 INFO:tasks.workunit.client.1.smithi195.stdout:0/822: write d0/dc/dd/d46/ff8 [1401549,97839] 0 2024-08-18T22:41:55.524 INFO:tasks.workunit.client.1.smithi195.stdout:7/888: write dc/d2a/d56/f84 [152452,15718] 0 2024-08-18T22:41:55.527 INFO:tasks.workunit.client.1.smithi195.stdout:7/889: mkdir dc/d1d/d29/ddb/d10d/db6/d137 0 2024-08-18T22:41:55.529 INFO:tasks.workunit.client.1.smithi195.stdout:0/823: dwrite d0/dc/dd/f6e [0,4194304] 0 2024-08-18T22:41:55.533 INFO:tasks.workunit.client.1.smithi195.stdout:0/824: mkdir d0/dc/d64/d81/d44/d41/d6d/d92/d66/d106 0 2024-08-18T22:41:55.537 INFO:tasks.workunit.client.1.smithi195.stdout:0/825: rename d0/dc/d25/d67 to d0/d107 0 2024-08-18T22:41:55.539 INFO:tasks.workunit.client.1.smithi195.stdout:7/890: dwrite dc/d1d/d29/ddb/d2b/fb4 [0,4194304] 0 2024-08-18T22:41:55.541 INFO:tasks.workunit.client.1.smithi195.stdout:0/826: symlink d0/dc/d64/d81/d44/d41/d4c/l108 0 2024-08-18T22:41:55.542 INFO:tasks.workunit.client.1.smithi195.stdout:7/891: creat dc/d8f/d96/dc5/f138 x:0 0 0 2024-08-18T22:41:55.544 INFO:tasks.workunit.client.1.smithi195.stdout:0/827: creat d0/dc/dd/f109 x:0 0 0 2024-08-18T22:41:55.548 INFO:tasks.workunit.client.1.smithi195.stdout:7/892: mknod dc/d1d/d29/ddb/d2b/d81/d9c/c139 0 2024-08-18T22:41:55.549 INFO:tasks.workunit.client.1.smithi195.stdout:0/828: creat d0/dc/f10a x:0 0 0 2024-08-18T22:41:55.550 INFO:tasks.workunit.client.1.smithi195.stdout:7/893: write dc/d1d/d29/ddb/fbd [141810,6582] 0 2024-08-18T22:41:55.551 INFO:tasks.workunit.client.1.smithi195.stdout:0/829: symlink d0/d107/db8/l10b 0 2024-08-18T22:41:55.555 INFO:tasks.workunit.client.1.smithi195.stdout:7/894: rename dc/d1d/d29/ddb/d15/d4d/d97/f134 to dc/d1d/d29/ddb/d10d/f13a 0 2024-08-18T22:41:55.562 INFO:tasks.workunit.client.1.smithi195.stdout:7/895: write dc/d1d/d29/d5d/fa3 [1007830,44089] 0 2024-08-18T22:41:55.563 INFO:tasks.workunit.client.1.smithi195.stdout:0/830: dread d0/dc/d64/d81/d44/fbf [0,4194304] 0 2024-08-18T22:41:55.563 INFO:tasks.workunit.client.1.smithi195.stdout:7/896: chown dc/d132 13401 1 2024-08-18T22:41:55.564 INFO:tasks.workunit.client.1.smithi195.stdout:0/831: chown d0/dc/d11/d23/d51/f52 102185345 1 2024-08-18T22:41:55.568 INFO:tasks.workunit.client.1.smithi195.stdout:0/832: link d0/dc/d64/d81/d44/fbf d0/dc/d64/d81/d44/d41/d6d/d92/d66/de0/f10c 0 2024-08-18T22:41:55.568 INFO:tasks.workunit.client.1.smithi195.stdout:5/852: sync 2024-08-18T22:41:55.569 INFO:tasks.workunit.client.1.smithi195.stdout:5/853: mkdir d0/d37/dba/d10d 0 2024-08-18T22:41:55.579 INFO:tasks.workunit.client.1.smithi195.stdout:0/833: getdents d0/dc/d64/d81/d44/d41/d6d/d92/d66/d8d/dbe/ddd 0 2024-08-18T22:41:55.583 INFO:tasks.workunit.client.1.smithi195.stdout:0/834: symlink d0/dc/l10d 0 2024-08-18T22:41:55.583 INFO:tasks.workunit.client.1.smithi195.stdout:5/854: dwrite d0/dea/fed [0,4194304] 0 2024-08-18T22:41:55.584 INFO:tasks.workunit.client.1.smithi195.stdout:7/897: dread dc/d1d/d29/ddb/d15/fa8 [0,4194304] 0 2024-08-18T22:41:55.587 INFO:tasks.workunit.client.1.smithi195.stdout:0/835: mkdir d0/dc/d64/d81/d44/d10e 0 2024-08-18T22:41:55.589 INFO:tasks.workunit.client.1.smithi195.stdout:0/836: stat d0/dc/d11/d23/fcb 0 2024-08-18T22:41:55.591 INFO:tasks.workunit.client.1.smithi195.stdout:0/837: mknod d0/dc/d11/d6f/d9d/c10f 0 2024-08-18T22:41:55.592 INFO:tasks.workunit.client.1.smithi195.stdout:7/898: write dc/d1d/d29/ddb/d10d/f6b [562632,109945] 0 2024-08-18T22:41:55.596 INFO:tasks.workunit.client.1.smithi195.stdout:0/838: creat d0/dc/d64/d81/d44/d41/d6d/d92/d66/d8d/dbe/f110 x:0 0 0 2024-08-18T22:41:55.597 INFO:tasks.workunit.client.1.smithi195.stdout:7/899: creat dc/d2a/d4c/d117/d125/f13b x:0 0 0 2024-08-18T22:41:55.599 INFO:tasks.workunit.client.1.smithi195.stdout:7/900: creat dc/d1d/d29/ddb/d15/f13c x:0 0 0 2024-08-18T22:41:55.600 INFO:tasks.workunit.client.1.smithi195.stdout:7/901: chown dc/d2a/d4c/fc2 7 1 2024-08-18T22:41:55.602 INFO:tasks.workunit.client.1.smithi195.stdout:5/855: dread d0/d3/df/d1a/f3f [0,4194304] 0 2024-08-18T22:41:55.603 INFO:tasks.workunit.client.1.smithi195.stdout:7/902: symlink dc/d8f/d96/dc5/d11b/dde/d111/l13d 0 2024-08-18T22:41:55.606 INFO:tasks.workunit.client.1.smithi195.stdout:7/903: mkdir dc/d1d/d29/ddb/d133/d13e 0 2024-08-18T22:41:55.608 INFO:tasks.workunit.client.1.smithi195.stdout:7/904: chown dc/d1d/d29/ddb/d10d/db6/df7/f110 29575798 1 2024-08-18T22:41:55.608 INFO:tasks.workunit.client.1.smithi195.stdout:5/856: dwrite d0/ddb/ff1 [0,4194304] 0 2024-08-18T22:41:55.610 INFO:tasks.workunit.client.1.smithi195.stdout:7/905: symlink dc/d22/l13f 0 2024-08-18T22:41:55.611 INFO:tasks.workunit.client.1.smithi195.stdout:7/906: chown dc/d2a/l38 8 1 2024-08-18T22:41:55.612 INFO:tasks.workunit.client.1.smithi195.stdout:0/839: dread d0/dc/d11/f79 [0,4194304] 0 2024-08-18T22:41:55.613 INFO:tasks.workunit.client.1.smithi195.stdout:0/840: truncate d0/dc/dd/f59 5452886 0 2024-08-18T22:41:55.616 INFO:tasks.workunit.client.1.smithi195.stdout:0/841: symlink d0/dc/d11/d6f/l111 0 2024-08-18T22:41:55.617 INFO:tasks.workunit.client.1.smithi195.stdout:7/907: write dc/d1d/d29/fd7 [1542000,31714] 0 2024-08-18T22:41:55.618 INFO:tasks.workunit.client.1.smithi195.stdout:0/842: mknod d0/dc/d11/d6f/d9d/c112 0 2024-08-18T22:41:55.622 INFO:tasks.workunit.client.1.smithi195.stdout:0/843: dread - d0/dc/d64/f105 zero size 2024-08-18T22:41:55.622 INFO:tasks.workunit.client.1.smithi195.stdout:7/908: dread dc/d1d/d29/ddb/d2b/f3a [0,4194304] 0 2024-08-18T22:41:55.625 INFO:tasks.workunit.client.1.smithi195.stdout:7/909: dwrite fb [8388608,4194304] 0 2024-08-18T22:41:55.626 INFO:tasks.workunit.client.1.smithi195.stdout:7/910: chown dc/d8f/d96/d10e/f114 3415 1 2024-08-18T22:41:55.629 INFO:tasks.workunit.client.1.smithi195.stdout:7/911: unlink dc/d1d/d29/ddb/d2b/d82/fef 0 2024-08-18T22:41:55.630 INFO:tasks.workunit.client.1.smithi195.stdout:7/912: dread - dc/d1d/d29/ddb/d15/f60 zero size 2024-08-18T22:41:55.632 INFO:tasks.workunit.client.1.smithi195.stdout:7/913: creat dc/d1d/d29/ddb/d2b/d82/f140 x:0 0 0 2024-08-18T22:41:55.637 INFO:tasks.workunit.client.1.smithi195.stdout:5/857: dread d0/d3/d5f/f6b [0,4194304] 0 2024-08-18T22:41:55.638 INFO:tasks.workunit.client.1.smithi195.stdout:5/858: chown d0/dea/dd3/dec 0 1 2024-08-18T22:41:55.639 INFO:tasks.workunit.client.1.smithi195.stdout:5/859: write d0/d2/d29/d88/d6a/d96/fd6 [252452,31004] 0 2024-08-18T22:41:55.640 INFO:tasks.workunit.client.1.smithi195.stdout:7/914: dread dc/d1d/d29/ddb/f49 [0,4194304] 0 2024-08-18T22:41:55.641 INFO:tasks.workunit.client.1.smithi195.stdout:7/915: fdatasync dc/d1d/d29/ddb/d10d/f76 0 2024-08-18T22:41:55.643 INFO:tasks.workunit.client.1.smithi195.stdout:5/860: creat d0/d2/d29/df9/f10e x:0 0 0 2024-08-18T22:41:55.644 INFO:tasks.workunit.client.1.smithi195.stdout:7/916: write dc/d1d/d29/ddb/d15/d4d/d97/dfe/d18/f5f [33823,51088] 0 2024-08-18T22:41:55.644 INFO:tasks.workunit.client.1.smithi195.stdout:5/861: rename d0/d3/d8/d3b/dfb to d0/d3/d8/d3b/dfb/d10f 22 2024-08-18T22:41:55.645 INFO:tasks.workunit.client.1.smithi195.stdout:5/862: write d0/d2/d29/f47 [3665129,52740] 0 2024-08-18T22:41:55.646 INFO:tasks.workunit.client.1.smithi195.stdout:7/917: mknod dc/d1d/d29/ddb/d15/d4d/c141 0 2024-08-18T22:41:55.648 INFO:tasks.workunit.client.1.smithi195.stdout:5/863: read d0/d46/d6d/da2/fce [3717066,79710] 0 2024-08-18T22:41:55.652 INFO:tasks.workunit.client.1.smithi195.stdout:5/864: rename d0/da6 to d0/d3/df/df2/d110 0 2024-08-18T22:41:55.655 INFO:tasks.workunit.client.1.smithi195.stdout:7/918: write dc/d1d/d29/d118/fe1 [29718,43794] 0 2024-08-18T22:41:55.657 INFO:tasks.workunit.client.1.smithi195.stdout:5/865: getdents d0/d3/df/df2 0 2024-08-18T22:41:55.658 INFO:tasks.workunit.client.1.smithi195.stdout:5/866: readlink d0/d3/df/d5a/l60 0 2024-08-18T22:41:55.658 INFO:tasks.workunit.client.1.smithi195.stdout:7/919: unlink dc/d1d/lda 0 2024-08-18T22:41:55.659 INFO:tasks.workunit.client.1.smithi195.stdout:5/867: creat d0/d3/d5f/f111 x:0 0 0 2024-08-18T22:41:55.661 INFO:tasks.workunit.client.1.smithi195.stdout:5/868: read d0/d2/d29/fe4 [424876,46475] 0 2024-08-18T22:41:55.664 INFO:tasks.workunit.client.1.smithi195.stdout:5/869: creat d0/d2/d53/f112 x:0 0 0 2024-08-18T22:41:55.664 INFO:tasks.workunit.client.1.smithi195.stdout:7/920: dwrite dc/d2a/d4c/d117/d125/f13b [0,4194304] 0 2024-08-18T22:41:55.667 INFO:tasks.workunit.client.1.smithi195.stdout:7/921: mknod dc/d1d/d29/df0/c142 0 2024-08-18T22:41:55.668 INFO:tasks.workunit.client.1.smithi195.stdout:7/922: chown dc/d2a/d4c/d117 202887322 1 2024-08-18T22:41:55.670 INFO:tasks.workunit.client.1.smithi195.stdout:5/870: dwrite d0/d2/d29/d88/fd1 [0,4194304] 0 2024-08-18T22:41:55.676 INFO:tasks.workunit.client.1.smithi195.stdout:7/923: rename dc/d2a to dc/d1d/d29/ddb/d15/d4d/d97/dfe/d143 0 2024-08-18T22:41:55.676 INFO:tasks.workunit.client.1.smithi195.stdout:7/924: chown dc/d8f/db5 2690880 1 2024-08-18T22:41:55.682 INFO:tasks.workunit.client.1.smithi195.stdout:7/925: dwrite dc/d1d/d29/ddb/d10d/f76 [0,4194304] 0 2024-08-18T22:41:55.685 INFO:tasks.workunit.client.1.smithi195.stdout:7/926: chown dc/d1d/d29/d5d/c67 3 1 2024-08-18T22:41:55.686 INFO:tasks.workunit.client.1.smithi195.stdout:5/871: dwrite d0/d3/df/f58 [0,4194304] 0 2024-08-18T22:41:55.687 INFO:tasks.workunit.client.1.smithi195.stdout:5/872: dread - d0/d3/df/df2/d110/fc8 zero size 2024-08-18T22:41:55.687 INFO:tasks.workunit.client.1.smithi195.stdout:7/927: read - dc/d1d/d29/df0/f109 zero size 2024-08-18T22:41:55.687 INFO:tasks.workunit.client.1.smithi195.stdout:5/873: readlink d0/db/l21 0 2024-08-18T22:41:55.690 INFO:tasks.workunit.client.1.smithi195.stdout:5/874: creat d0/d46/d6d/f113 x:0 0 0 2024-08-18T22:41:55.692 INFO:tasks.workunit.client.1.smithi195.stdout:7/928: creat dc/d1d/d29/ddb/d15/d4d/d97/dfe/d143/d4c/d117/f144 x:0 0 0 2024-08-18T22:41:55.694 INFO:tasks.workunit.client.1.smithi195.stdout:5/875: truncate d0/d2/d29/db5/fc1 1215964 0 2024-08-18T22:41:55.696 INFO:tasks.workunit.client.1.smithi195.stdout:7/929: getdents dc/d8f/d96/dc5 0 2024-08-18T22:41:55.697 INFO:tasks.workunit.client.1.smithi195.stdout:7/930: stat dc/d1d/d29/ddb/d15 0 2024-08-18T22:41:55.698 INFO:tasks.workunit.client.1.smithi195.stdout:5/876: creat d0/d2/d29/df9/d10a/f114 x:0 0 0 2024-08-18T22:41:55.698 INFO:tasks.workunit.client.1.smithi195.stdout:5/877: stat d0/d2/d29 0 2024-08-18T22:41:55.699 INFO:tasks.workunit.client.1.smithi195.stdout:7/931: creat dc/d1d/d29/ddb/d2b/dbc/f145 x:0 0 0 2024-08-18T22:41:55.700 INFO:tasks.workunit.client.1.smithi195.stdout:5/878: creat d0/d3/d8/d3b/db1/f115 x:0 0 0 2024-08-18T22:41:55.707 INFO:tasks.workunit.client.1.smithi195.stdout:7/932: dwrite dc/d1d/d29/ddb/d10d/ff1 [0,4194304] 0 2024-08-18T22:41:55.708 INFO:tasks.workunit.client.1.smithi195.stdout:7/933: chown dc/d22/fc9 1353503740 1 2024-08-18T22:41:55.710 INFO:tasks.workunit.client.1.smithi195.stdout:7/934: mknod dc/d1d/d29/ddb/d10d/db6/df7/d10c/c146 0 2024-08-18T22:41:55.713 INFO:tasks.workunit.client.1.smithi195.stdout:7/935: symlink dc/d1d/d29/ddb/d2b/d81/d9c/l147 0 2024-08-18T22:41:55.713 INFO:tasks.workunit.client.1.smithi195.stdout:5/879: dwrite d0/d2/d29/f3d [0,4194304] 0 2024-08-18T22:41:55.715 INFO:tasks.workunit.client.1.smithi195.stdout:5/880: write d0/d2/d29/d88/d6a/d96/fd6 [625395,114882] 0 2024-08-18T22:41:55.715 INFO:tasks.workunit.client.1.smithi195.stdout:7/936: fdatasync dc/d1d/d29/ddb/ffa 0 2024-08-18T22:41:55.718 INFO:tasks.workunit.client.1.smithi195.stdout:7/937: symlink dc/d1d/d29/ddb/d133/l148 0 2024-08-18T22:41:55.721 INFO:tasks.workunit.client.1.smithi195.stdout:5/881: rename d0/db/fdd to d0/d3/d8/d3b/db1/f116 0 2024-08-18T22:41:55.727 INFO:tasks.workunit.client.1.smithi195.stdout:7/938: write dc/d8f/d96/dc5/d11b/f104 [448054,129810] 0 2024-08-18T22:41:55.728 INFO:tasks.workunit.client.1.smithi195.stdout:5/882: write d0/d3/f8d [5222258,80497] 0 2024-08-18T22:41:55.730 INFO:tasks.workunit.client.1.smithi195.stdout:5/883: creat d0/d37/dba/d10d/f117 x:0 0 0 2024-08-18T22:41:55.731 INFO:tasks.workunit.client.1.smithi195.stdout:5/884: dread - d0/d3/d8/d3b/db1/f115 zero size 2024-08-18T22:41:55.732 INFO:tasks.workunit.client.1.smithi195.stdout:5/885: readlink d0/d3/d8/d3b/l44 0 2024-08-18T22:41:55.735 INFO:tasks.workunit.client.1.smithi195.stdout:7/939: dwrite dc/d1d/d29/ddb/d10d/db6/df7/f110 [0,4194304] 0 2024-08-18T22:41:55.737 INFO:tasks.workunit.client.1.smithi195.stdout:7/940: creat dc/d1d/d29/ddb/d2b/dbc/f149 x:0 0 0 2024-08-18T22:41:55.741 INFO:tasks.workunit.client.1.smithi195.stdout:5/886: dwrite d0/d3/d8/d3b/db1/f115 [0,4194304] 0 2024-08-18T22:41:55.742 INFO:tasks.workunit.client.1.smithi195.stdout:5/887: chown d0/d3/d66/dda/ce5 246156874 1 2024-08-18T22:41:55.745 INFO:tasks.workunit.client.1.smithi195.stdout:7/941: rename dc/d1d/d29/ddb/d15/d4d/d97/dfe/d18/f7b to dc/d8f/d96/dc5/de7/d115/f14a 0 2024-08-18T22:41:55.748 INFO:tasks.workunit.client.1.smithi195.stdout:7/942: symlink dc/d1d/d29/ddb/d10d/db6/df7/d10c/l14b 0 2024-08-18T22:41:55.751 INFO:tasks.workunit.client.1.smithi195.stdout:7/943: rename dc/d1d/d29/ddb/d133/l148 to dc/d1d/d29/ddb/d15/d4d/d97/dfe/d143/d112/l14c 0 2024-08-18T22:41:55.757 INFO:tasks.workunit.client.1.smithi195.stdout:7/944: write dc/d1d/d29/fbe [4635623,62510] 0 2024-08-18T22:41:55.759 INFO:tasks.workunit.client.1.smithi195.stdout:7/945: chown dc/d1d/d29/d5d/c50 565415419 1 2024-08-18T22:41:55.762 INFO:tasks.workunit.client.1.smithi195.stdout:7/946: write dc/d1d/d29/ddb/f102 [287917,50859] 0 2024-08-18T22:41:55.763 INFO:tasks.workunit.client.1.smithi195.stdout:7/947: stat dc/d1d/d29/ddb/d15/d4d/d97/dfe/d143/d112 0 2024-08-18T22:41:55.765 INFO:tasks.workunit.client.1.smithi195.stdout:7/948: mkdir dc/d1d/d29/ddb/d2b/d81/d14d 0 2024-08-18T22:41:55.766 INFO:tasks.workunit.client.1.smithi195.stdout:7/949: mkdir dc/d132/d14e 0 2024-08-18T22:41:55.774 INFO:tasks.workunit.client.1.smithi195.stdout:7/950: dread dc/d1d/d29/ddb/d2b/d81/d9c/f9e [0,4194304] 0 2024-08-18T22:41:55.779 INFO:tasks.workunit.client.1.smithi195.stdout:7/951: dwrite dc/d1d/d29/ddb/d10d/db6/df7/f11c [0,4194304] 0 2024-08-18T22:41:55.782 INFO:tasks.workunit.client.1.smithi195.stdout:7/952: creat dc/d1d/d29/ddb/d15/f14f x:0 0 0 2024-08-18T22:41:55.783 INFO:tasks.workunit.client.1.smithi195.stdout:7/953: dread - dc/d1d/d29/ddb/d15/d4d/d97/dfe/f108 zero size 2024-08-18T22:41:55.783 INFO:tasks.workunit.client.1.smithi195.stdout:7/954: truncate dc/d22/fc9 1607108 0 2024-08-18T22:41:55.793 INFO:tasks.workunit.client.1.smithi195.stdout:7/955: write dc/d1d/d29/ddb/d15/f42 [3555495,9866] 0 2024-08-18T22:41:55.794 INFO:tasks.workunit.client.1.smithi195.stdout:7/956: read - dc/d1d/d29/ddb/d15/f14f zero size 2024-08-18T22:41:55.796 INFO:tasks.workunit.client.1.smithi195.stdout:7/957: creat dc/d1d/d29/ddb/d133/f150 x:0 0 0 2024-08-18T22:41:55.797 INFO:tasks.workunit.client.1.smithi195.stdout:7/958: stat dc/d1d/d29/ddb/d15/d4d/d97/dfe/d143/l91 0 2024-08-18T22:41:55.798 INFO:tasks.workunit.client.1.smithi195.stdout:7/959: dread - dc/d1d/d29/ddb/d15/d4d/d97/dfe/fb1 zero size 2024-08-18T22:41:55.801 INFO:tasks.workunit.client.1.smithi195.stdout:7/960: creat dc/d1d/d29/ddb/d10d/db6/d137/f151 x:0 0 0 2024-08-18T22:41:55.803 INFO:tasks.workunit.client.1.smithi195.stdout:7/961: creat dc/d1d/d29/ddb/d15/d4d/d97/dfe/d143/d4c/d135/f152 x:0 0 0 2024-08-18T22:41:55.806 INFO:tasks.workunit.client.1.smithi195.stdout:7/962: rename dc/d8f/d96 to dc/d1d/d29/ddb/d2b/d153 0 2024-08-18T22:41:55.809 INFO:tasks.workunit.client.1.smithi195.stdout:7/963: rename dc/d1d/d29/ddb/d2b/d153/dc5/d11b/dde/d111 to dc/d1d/d29/ddb/d2b/dbc/d154 0 2024-08-18T22:41:55.811 INFO:tasks.workunit.client.1.smithi195.stdout:7/964: mknod dc/d1d/d29/ddb/d2b/d82/c155 0 2024-08-18T22:41:55.812 INFO:tasks.workunit.client.1.smithi195.stdout:7/965: creat dc/d1d/f156 x:0 0 0 2024-08-18T22:41:55.813 INFO:tasks.workunit.client.1.smithi195.stdout:7/966: creat dc/d1d/d29/ddb/d2b/dbc/f157 x:0 0 0 2024-08-18T22:41:55.818 INFO:tasks.workunit.client.1.smithi195.stdout:7/967: dwrite dc/d1d/d29/ddb/f113 [4194304,4194304] 0 2024-08-18T22:41:55.832 INFO:tasks.workunit.client.1.smithi195.stdout:7/968: dwrite dc/d1d/d29/ddb/d10d/db6/f130 [0,4194304] 0 2024-08-18T22:41:55.835 INFO:tasks.workunit.client.1.smithi195.stdout:7/969: symlink dc/d1d/d29/ddb/d2b/d153/dc5/de7/d115/l158 0 2024-08-18T22:41:55.837 INFO:tasks.workunit.client.1.smithi195.stdout:7/970: write dc/d1d/d29/fd7 [771212,78688] 0 2024-08-18T22:41:55.838 INFO:tasks.workunit.client.1.smithi195.stdout:7/971: write dc/d1d/d29/d5d/f105 [4065271,104565] 0 2024-08-18T22:41:55.840 INFO:tasks.workunit.client.1.smithi195.stdout:7/972: creat dc/d1d/d29/ddb/d2b/d81/d9c/f159 x:0 0 0 2024-08-18T22:41:55.844 INFO:tasks.workunit.client.1.smithi195.stdout:7/973: truncate dc/d1d/d29/ddb/d2b/d153/dc5/de7/d115/f14a 194936 0 2024-08-18T22:41:55.845 INFO:tasks.workunit.client.1.smithi195.stdout:7/974: dread - dc/d1d/d29/ddb/d15/d4d/d97/dfe/f108 zero size 2024-08-18T22:41:55.848 INFO:tasks.workunit.client.1.smithi195.stdout:7/975: unlink dc/d1d/d29/ddb/d15/d4d/d97/dfe/d18/f107 0 2024-08-18T22:41:55.850 INFO:tasks.workunit.client.1.smithi195.stdout:8/953: sync 2024-08-18T22:41:55.852 INFO:tasks.workunit.client.1.smithi195.stdout:8/954: chown d1/d3/db/d35/d4d/c99 116 1 2024-08-18T22:41:55.853 INFO:tasks.workunit.client.1.smithi195.stdout:7/976: write dc/d1d/d29/ddb/d15/d4d/d97/dfe/d143/f65 [2303127,99328] 0 2024-08-18T22:41:55.855 INFO:tasks.workunit.client.1.smithi195.stdout:8/955: rename d1/d64/ld5 to d1/de/d31/d5a/l15f 0 2024-08-18T22:41:55.856 INFO:tasks.workunit.client.1.smithi195.stdout:7/977: dread dc/d1d/d29/df0/ff8 [0,4194304] 0 2024-08-18T22:41:55.857 INFO:tasks.workunit.client.1.smithi195.stdout:8/956: read d1/d3/d1c/d21/f7f [3810629,110671] 0 2024-08-18T22:41:55.859 INFO:tasks.workunit.client.1.smithi195.stdout:7/978: dread dc/d22/f3e [4194304,4194304] 0 2024-08-18T22:41:55.860 INFO:tasks.workunit.client.1.smithi195.stdout:8/957: symlink d1/d3/db/d35/d4d/l160 0 2024-08-18T22:41:55.861 INFO:tasks.workunit.client.1.smithi195.stdout:7/979: mknod dc/d1d/d29/ddb/d2b/d153/d10e/c15a 0 2024-08-18T22:41:55.867 INFO:tasks.workunit.client.1.smithi195.stdout:8/958: dwrite d1/d3/db/d35/d4d/d5c/ddf/d107/f15c [0,4194304] 0 2024-08-18T22:41:55.870 INFO:tasks.workunit.client.1.smithi195.stdout:7/980: dwrite dc/d1d/d29/ddb/d2b/d153/dc5/de7/f12c [0,4194304] 0 2024-08-18T22:41:55.871 INFO:tasks.workunit.client.1.smithi195.stdout:8/959: rmdir d1/de/df/d1d/de5/df8 39 2024-08-18T22:41:55.872 INFO:tasks.workunit.client.1.smithi195.stdout:7/981: stat dc/d1d/d29/ddb/d15/d4d/d97/dfe/d143/d4c/d135 0 2024-08-18T22:41:55.876 INFO:tasks.workunit.client.1.smithi195.stdout:7/982: mkdir dc/d1d/d29/ddb/d2b/dbc/d15b 0 2024-08-18T22:41:55.880 INFO:tasks.workunit.client.1.smithi195.stdout:7/983: symlink dc/d1d/d29/ddb/d15/d4d/d97/dfe/d143/d4c/d117/d125/l15c 0 2024-08-18T22:41:55.886 INFO:tasks.workunit.client.1.smithi195.stdout:7/984: dwrite dc/d1d/d29/ddb/d10d/db6/f121 [0,4194304] 0 2024-08-18T22:41:55.888 INFO:tasks.workunit.client.1.smithi195.stdout:8/960: write d1/de/d27/d4f/fd4 [1494488,63671] 0 2024-08-18T22:41:55.893 INFO:tasks.workunit.client.1.smithi195.stdout:8/961: creat d1/de/d27/d4f/dde/f161 x:0 0 0 2024-08-18T22:41:55.896 INFO:tasks.workunit.client.1.smithi195.stdout:7/985: dwrite dc/d1d/d29/ddb/d15/d4d/d97/dfe/f108 [0,4194304] 0 2024-08-18T22:41:55.899 INFO:tasks.workunit.client.1.smithi195.stdout:7/986: mkdir dc/d1d/d29/ddb/d2b/d153/dc5/d11b/dde/d15d 0 2024-08-18T22:41:55.904 INFO:tasks.workunit.client.1.smithi195.stdout:7/987: symlink dc/d1d/d29/ddb/d133/d13e/l15e 0 2024-08-18T22:41:55.906 INFO:tasks.workunit.client.1.smithi195.stdout:7/988: symlink dc/d1d/d29/ddb/d10d/db6/d137/l15f 0 2024-08-18T22:41:55.909 INFO:tasks.workunit.client.1.smithi195.stdout:7/989: symlink dc/d1d/d29/ddb/d15/d4d/d97/dfe/d143/d4c/d117/d125/l160 0 2024-08-18T22:41:55.910 INFO:tasks.workunit.client.1.smithi195.stdout:7/990: chown dc/d1d/d29/ddb/d2b/d82 775539 1 2024-08-18T22:41:55.915 INFO:tasks.workunit.client.1.smithi195.stdout:7/991: dwrite dc/d1d/d29/ddb/d2b/dbc/f149 [0,4194304] 0 2024-08-18T22:41:55.917 INFO:tasks.workunit.client.1.smithi195.stdout:7/992: getdents dc/d132/d14e 0 2024-08-18T22:41:55.921 INFO:tasks.workunit.client.1.smithi195.stdout:7/993: creat dc/d1d/f161 x:0 0 0 2024-08-18T22:41:55.922 INFO:tasks.workunit.client.1.smithi195.stdout:7/994: mkdir dc/d1d/d29/d162 0 2024-08-18T22:41:55.925 INFO:tasks.workunit.client.1.smithi195.stdout:7/995: rename dc/d132/d14e to dc/d1d/d29/ddb/d2b/d153/dc5/d11b/dde/d15d/d163 0 2024-08-18T22:41:55.931 INFO:tasks.workunit.client.1.smithi195.stdout:7/996: dwrite dc/d1d/d29/ddb/d133/f150 [0,4194304] 0 2024-08-18T22:41:55.933 INFO:tasks.workunit.client.1.smithi195.stdout:7/997: chown dc/d1d/d29/ddb/d2b/dbc 5928 1 2024-08-18T22:41:55.934 INFO:tasks.workunit.client.1.smithi195.stdout:7/998: fdatasync dc/d1d/d29/ddb/d15/d4d/d97/dfe/d143/f65 0 2024-08-18T22:41:55.937 INFO:tasks.workunit.client.1.smithi195.stdout:7/999: creat dc/d1d/d29/ddb/d15/d4d/d97/dfe/d143/d56/f164 x:0 0 0 2024-08-18T22:41:56.071 INFO:tasks.workunit.client.1.smithi195.stdout:9/849: sync 2024-08-18T22:41:56.074 INFO:tasks.workunit.client.1.smithi195.stdout:9/850: unlink d1c/d92/d96/d9d/db9/fc1 0 2024-08-18T22:41:56.076 INFO:tasks.workunit.client.1.smithi195.stdout:9/851: read d1c/f3c [2523352,8390] 0 2024-08-18T22:41:56.077 INFO:tasks.workunit.client.1.smithi195.stdout:9/852: truncate d1c/d32/d37/f67 4334359 0 2024-08-18T22:41:56.078 INFO:tasks.workunit.client.1.smithi195.stdout:9/853: truncate d1c/d32/d71/dbe/fef 887252 0 2024-08-18T22:41:56.080 INFO:tasks.workunit.client.1.smithi195.stdout:9/854: fsync d1c/d32/d71/dbe/f9b 0 2024-08-18T22:41:56.084 INFO:tasks.workunit.client.1.smithi195.stdout:9/855: rename d1c/d32/d37/d4b/dc8 to d1c/d32/d71/dbe/d98/df6/d107 0 2024-08-18T22:41:56.086 INFO:tasks.workunit.client.1.smithi195.stdout:9/856: creat d1c/d74/de4/f108 x:0 0 0 2024-08-18T22:41:56.087 INFO:tasks.workunit.client.1.smithi195.stdout:9/857: mkdir d1c/d32/d71/dbe/d90/d109 0 2024-08-18T22:41:56.089 INFO:tasks.workunit.client.1.smithi195.stdout:9/858: creat d1c/d92/d96/d9d/db9/f10a x:0 0 0 2024-08-18T22:41:56.091 INFO:tasks.workunit.client.1.smithi195.stdout:9/859: link d1c/d92/d9a/cac d1c/d32/db1/c10b 0 2024-08-18T22:41:56.091 INFO:tasks.workunit.client.1.smithi195.stdout:9/860: dread - d1c/d92/f106 zero size 2024-08-18T22:41:56.096 INFO:tasks.workunit.client.1.smithi195.stdout:9/861: write d1c/d32/f50 [2323751,48351] 0 2024-08-18T22:41:56.097 INFO:tasks.workunit.client.1.smithi195.stdout:9/862: creat d1c/d32/f10c x:0 0 0 2024-08-18T22:41:56.099 INFO:tasks.workunit.client.1.smithi195.stdout:9/863: creat d1c/d92/da1/f10d x:0 0 0 2024-08-18T22:41:56.108 INFO:tasks.workunit.client.1.smithi195.stdout:9/864: dwrite d1c/d74/d8e/f104 [0,4194304] 0 2024-08-18T22:41:56.112 INFO:tasks.workunit.client.1.smithi195.stdout:9/865: link d1c/d32/d71/dbe/d90/cb0 d1c/d32/de9/c10e 0 2024-08-18T22:41:56.113 INFO:tasks.workunit.client.1.smithi195.stdout:9/866: creat d1c/d32/d71/dc4/f10f x:0 0 0 2024-08-18T22:41:56.121 INFO:tasks.workunit.client.1.smithi195.stdout:9/867: dwrite d1c/f26 [0,4194304] 0 2024-08-18T22:41:56.124 INFO:tasks.workunit.client.1.smithi195.stdout:9/868: creat d1c/d32/d71/dc4/f110 x:0 0 0 2024-08-18T22:41:56.217 INFO:tasks.workunit.client.1.smithi195.stdout:6/824: sync 2024-08-18T22:41:56.218 INFO:tasks.workunit.client.1.smithi195.stdout:4/782: sync 2024-08-18T22:41:56.225 INFO:tasks.workunit.client.1.smithi195.stdout:4/783: dwrite d0/d7/d1d/f47 [0,4194304] 0 2024-08-18T22:41:56.227 INFO:tasks.workunit.client.1.smithi195.stdout:4/784: symlink d0/d7/d1d/d69/db7/d41/l118 0 2024-08-18T22:41:56.238 INFO:tasks.workunit.client.1.smithi195.stdout:4/785: dwrite d0/d99/d98/d16/dae/f103 [4194304,4194304] 0 2024-08-18T22:41:56.282 INFO:tasks.workunit.client.1.smithi195.stdout:2/546: sync 2024-08-18T22:41:56.282 INFO:tasks.workunit.client.1.smithi195.stdout:8/962: sync 2024-08-18T22:41:56.282 INFO:tasks.workunit.client.1.smithi195.stdout:0/844: sync 2024-08-18T22:41:56.282 INFO:tasks.workunit.client.1.smithi195.stdout:5/888: sync 2024-08-18T22:41:56.282 INFO:tasks.workunit.client.1.smithi195.stdout:9/869: sync 2024-08-18T22:41:56.285 INFO:tasks.workunit.client.1.smithi195.stdout:9/870: chown d1c/d32/d37/d4b/f7a 57528 1 2024-08-18T22:41:56.292 INFO:tasks.workunit.client.1.smithi195.stdout:8/963: dwrite d1/d3/db/d35/d4d/d8b/f124 [0,4194304] 0 2024-08-18T22:41:56.294 INFO:tasks.workunit.client.1.smithi195.stdout:8/964: write d1/d3/db/d39/d2e/f61 [8210830,43288] 0 2024-08-18T22:41:56.297 INFO:tasks.workunit.client.1.smithi195.stdout:2/547: dread d1/f59 [0,4194304] 0 2024-08-18T22:41:56.298 INFO:tasks.workunit.client.1.smithi195.stdout:2/548: write d1/d24/d26/f2b [1102342,90042] 0 2024-08-18T22:41:56.300 INFO:tasks.workunit.client.1.smithi195.stdout:2/549: fdatasync d1/d24/d26/d42/d50/f77 0 2024-08-18T22:41:56.300 INFO:tasks.workunit.client.1.smithi195.stdout:0/845: creat d0/dc/dd/d46/f113 x:0 0 0 2024-08-18T22:41:56.301 INFO:tasks.workunit.client.1.smithi195.stdout:2/550: fsync d1/d24/f56 0 2024-08-18T22:41:56.302 INFO:tasks.workunit.client.1.smithi195.stdout:5/889: creat d0/d3/df/df2/d110/f118 x:0 0 0 2024-08-18T22:41:56.308 INFO:tasks.workunit.client.1.smithi195.stdout:4/786: creat d0/d99/d98/d16/d94/db2/da4/df5/f119 x:0 0 0 2024-08-18T22:41:56.309 INFO:tasks.workunit.client.1.smithi195.stdout:4/787: chown d0/d99/d98/fc0 283 1 2024-08-18T22:41:56.317 INFO:tasks.workunit.client.1.smithi195.stdout:0/846: truncate d0/dc/d11/d23/f45 4262980 0 2024-08-18T22:41:56.318 INFO:tasks.workunit.client.1.smithi195.stdout:0/847: truncate d0/dc/d11/fd1 4602754 0 2024-08-18T22:41:56.326 INFO:tasks.workunit.client.1.smithi195.stdout:5/890: link d0/d3/d8/c2b d0/ddb/c119 0 2024-08-18T22:41:56.328 INFO:tasks.workunit.client.1.smithi195.stdout:0/848: creat d0/dc/d64/d81/d44/d41/d6d/d97/db5/f114 x:0 0 0 2024-08-18T22:41:56.329 INFO:tasks.workunit.client.1.smithi195.stdout:0/849: dread - d0/dc/dd/d46/f113 zero size 2024-08-18T22:41:56.330 INFO:tasks.workunit.client.1.smithi195.stdout:0/850: write d0/dc/dd/d46/fa9 [2022390,99182] 0 2024-08-18T22:41:56.331 INFO:tasks.workunit.client.1.smithi195.stdout:4/788: getdents d0 0 2024-08-18T22:41:56.333 INFO:tasks.workunit.client.1.smithi195.stdout:5/891: creat d0/d3/d8/d3b/dfe/f11a x:0 0 0 2024-08-18T22:41:56.333 INFO:tasks.workunit.client.1.smithi195.stdout:4/789: chown d0/d7/d1d/d69/db7/d3b/d6f/db0/f62 206 1 2024-08-18T22:41:56.335 INFO:tasks.workunit.client.1.smithi195.stdout:0/851: rename d0/dc/d11/d23/d51/f9f to d0/d107/f115 0 2024-08-18T22:41:56.336 INFO:tasks.workunit.client.1.smithi195.stdout:4/790: truncate d0/d7/d1d/d69/db7/d6c/fcc 1029914 0 2024-08-18T22:41:56.337 INFO:tasks.workunit.client.1.smithi195.stdout:4/791: chown d0/d99/d98/d16/dae/fe6 72 1 2024-08-18T22:41:56.337 INFO:tasks.workunit.client.1.smithi195.stdout:5/892: symlink d0/d3/d8/d64/d87/dc7/l11b 0 2024-08-18T22:41:56.338 INFO:tasks.workunit.client.1.smithi195.stdout:5/893: stat d0/dea/dd3/fe3 0 2024-08-18T22:41:56.339 INFO:tasks.workunit.client.1.smithi195.stdout:0/852: fsync d0/dc/d64/d81/d44/fbf 0 2024-08-18T22:41:56.341 INFO:tasks.workunit.client.1.smithi195.stdout:5/894: symlink d0/d3/d8/d3b/db1/dc6/l11c 0 2024-08-18T22:41:56.341 INFO:tasks.workunit.client.1.smithi195.stdout:5/895: readlink d0/d2/d29/l73 0 2024-08-18T22:41:56.344 INFO:tasks.workunit.client.1.smithi195.stdout:6/825: sync 2024-08-18T22:41:56.345 INFO:tasks.workunit.client.1.smithi195.stdout:6/826: readlink da/d15/d1c/d2e/l39 0 2024-08-18T22:41:56.346 INFO:tasks.workunit.client.1.smithi195.stdout:6/827: fdatasync da/d22/d87/fce 0 2024-08-18T22:41:56.348 INFO:tasks.workunit.client.1.smithi195.stdout:6/828: read da/d22/ffd [1085542,12397] 0 2024-08-18T22:41:56.350 INFO:tasks.workunit.client.1.smithi195.stdout:6/829: symlink da/d22/d86/l10a 0 2024-08-18T22:41:56.353 INFO:tasks.workunit.client.1.smithi195.stdout:6/830: unlink da/d22/d86/df3/cbc 0 2024-08-18T22:41:56.354 INFO:tasks.workunit.client.1.smithi195.stdout:0/853: dread d0/dc/d64/d81/d44/d41/d4c/dd9/ffc [0,4194304] 0 2024-08-18T22:41:56.357 INFO:tasks.workunit.client.1.smithi195.stdout:0/854: write d0/f6b [626280,86765] 0 2024-08-18T22:41:56.358 INFO:tasks.workunit.client.1.smithi195.stdout:0/855: read - d0/d107/ff9 zero size 2024-08-18T22:41:56.358 INFO:tasks.workunit.client.1.smithi195.stdout:6/831: fsync da/db/d26/f95 0 2024-08-18T22:41:56.362 INFO:tasks.workunit.client.1.smithi195.stdout:6/832: symlink da/d15/d1c/d64/l10b 0 2024-08-18T22:41:56.363 INFO:tasks.workunit.client.1.smithi195.stdout:0/856: mkdir d0/dc/d64/d81/d44/d41/d6d/d97/db5/d116 0 2024-08-18T22:41:56.366 INFO:tasks.workunit.client.1.smithi195.stdout:0/857: symlink d0/dc/d11/d23/d51/dad/l117 0 2024-08-18T22:41:56.368 INFO:tasks.workunit.client.1.smithi195.stdout:6/833: dread da/d22/ffd [0,4194304] 0 2024-08-18T22:41:56.372 INFO:tasks.workunit.client.1.smithi195.stdout:0/858: truncate d0/dc/d64/d81/d44/d41/d4c/f61 3412756 0 2024-08-18T22:41:56.373 INFO:tasks.workunit.client.1.smithi195.stdout:0/859: truncate d0/d107/f115 1610634 0 2024-08-18T22:41:56.376 INFO:tasks.workunit.client.1.smithi195.stdout:6/834: link da/d22/lc8 da/dd5/l10c 0 2024-08-18T22:41:56.378 INFO:tasks.workunit.client.1.smithi195.stdout:6/835: write da/dd5/fe5 [3359920,80059] 0 2024-08-18T22:41:56.381 INFO:tasks.workunit.client.1.smithi195.stdout:6/836: rmdir da/d15/d1c/d2e/dbd 39 2024-08-18T22:41:56.383 INFO:tasks.workunit.client.1.smithi195.stdout:6/837: mkdir da/db/d19/d10d 0 2024-08-18T22:41:56.384 INFO:tasks.workunit.client.1.smithi195.stdout:9/871: mknod d1c/d32/d37/d4b/c111 0 2024-08-18T22:41:56.385 INFO:tasks.workunit.client.1.smithi195.stdout:9/872: chown d1c/d32/db1/cb7 3 1 2024-08-18T22:41:56.385 INFO:tasks.workunit.client.1.smithi195.stdout:6/838: symlink da/db/d26/d2d/d8e/l10e 0 2024-08-18T22:41:56.387 INFO:tasks.workunit.client.1.smithi195.stdout:6/839: read da/d3b/f3e [4773155,35564] 0 2024-08-18T22:41:56.387 INFO:tasks.workunit.client.1.smithi195.stdout:9/873: rmdir d1c/d32/d71/dbe 39 2024-08-18T22:41:56.388 INFO:tasks.workunit.client.1.smithi195.stdout:9/874: write d1c/d32/d37/fad [262055,82388] 0 2024-08-18T22:41:56.392 INFO:tasks.workunit.client.1.smithi195.stdout:6/840: unlink da/db/d78/c103 0 2024-08-18T22:41:56.396 INFO:tasks.workunit.client.1.smithi195.stdout:9/875: symlink d1c/d32/d71/dbe/d90/d109/l112 0 2024-08-18T22:41:56.398 INFO:tasks.workunit.client.1.smithi195.stdout:9/876: unlink d1c/d32/d37/d4b/dc6/fd4 0 2024-08-18T22:41:56.398 INFO:tasks.workunit.client.1.smithi195.stdout:9/877: stat d1c/f1f 0 2024-08-18T22:41:56.400 INFO:tasks.workunit.client.1.smithi195.stdout:8/965: write d1/de/d31/d5a/f57 [2688538,22830] 0 2024-08-18T22:41:56.412 INFO:tasks.workunit.client.1.smithi195.stdout:8/966: creat d1/d3/db/d35/f162 x:0 0 0 2024-08-18T22:41:56.413 INFO:tasks.workunit.client.1.smithi195.stdout:2/551: write d1/d8/d27/f3a [4065986,35507] 0 2024-08-18T22:41:56.418 INFO:tasks.workunit.client.1.smithi195.stdout:8/967: dwrite d1/de/d67/fe1 [0,4194304] 0 2024-08-18T22:41:56.431 INFO:tasks.workunit.client.1.smithi195.stdout:5/896: write d0/d2/fca [1284360,119412] 0 2024-08-18T22:41:56.446 INFO:tasks.workunit.client.1.smithi195.stdout:5/897: read d0/d3/d66/f8c [671002,47074] 0 2024-08-18T22:41:56.446 INFO:tasks.workunit.client.1.smithi195.stdout:8/968: creat d1/d3/db/d35/d4d/d5c/de9/d146/f163 x:0 0 0 2024-08-18T22:41:56.446 INFO:tasks.workunit.client.1.smithi195.stdout:2/552: write d1/d24/d26/d42/d72/d85/f68 [3380560,34906] 0 2024-08-18T22:41:56.447 INFO:tasks.workunit.client.1.smithi195.stdout:5/898: chown d0/d3/d5f/ff6 675317964 1 2024-08-18T22:41:56.448 INFO:tasks.workunit.client.1.smithi195.stdout:5/899: readlink d0/d3/d8/d3b/db1/dc6/l11c 0 2024-08-18T22:41:56.449 INFO:tasks.workunit.client.1.smithi195.stdout:2/553: mknod d1/d24/ca4 0 2024-08-18T22:41:56.450 INFO:tasks.workunit.client.1.smithi195.stdout:2/554: chown d1/d24/c4e 16978 1 2024-08-18T22:41:56.451 INFO:tasks.workunit.client.1.smithi195.stdout:2/555: readlink d1/d8/d3d/d3b/d46/l5f 0 2024-08-18T22:41:56.452 INFO:tasks.workunit.client.1.smithi195.stdout:4/792: rename d0/d7/d1d/c74 to d0/d7/d1d/d69/db7/c11a 0 2024-08-18T22:41:56.455 INFO:tasks.workunit.client.1.smithi195.stdout:0/860: rename d0/dc/d64/f105 to d0/dc/d64/d81/d44/d41/d6d/d92/f118 0 2024-08-18T22:41:56.457 INFO:tasks.workunit.client.1.smithi195.stdout:0/861: rmdir d0 39 2024-08-18T22:41:56.458 INFO:tasks.workunit.client.1.smithi195.stdout:8/969: unlink d1/d3/db/d35/d4d/d5c/f108 0 2024-08-18T22:41:56.460 INFO:tasks.workunit.client.1.smithi195.stdout:2/556: rename d1/f2 to d1/d8/fa5 0 2024-08-18T22:41:56.462 INFO:tasks.workunit.client.1.smithi195.stdout:8/970: mkdir d1/de/df/d1d/d8e/d164 0 2024-08-18T22:41:56.464 INFO:tasks.workunit.client.1.smithi195.stdout:8/971: truncate d1/de/df/f11f 72087 0 2024-08-18T22:41:56.468 INFO:tasks.workunit.client.1.smithi195.stdout:2/557: rename d1/f38 to d1/d8/d3d/d6c/d7c/fa6 0 2024-08-18T22:41:56.468 INFO:tasks.workunit.client.1.smithi195.stdout:6/841: write da/db/d19/d67/f75 [5260007,23802] 0 2024-08-18T22:41:56.469 INFO:tasks.workunit.client.1.smithi195.stdout:2/558: readlink d1/d24/d26/d42/d44/l4a 0 2024-08-18T22:41:56.471 INFO:tasks.workunit.client.1.smithi195.stdout:8/972: mkdir d1/d3/db/d39/d2e/d165 0 2024-08-18T22:41:56.474 INFO:tasks.workunit.client.1.smithi195.stdout:2/559: read d1/f10 [1311661,8297] 0 2024-08-18T22:41:56.476 INFO:tasks.workunit.client.1.smithi195.stdout:6/842: rename da/d15/d1c/d2e to da/d15/d1c/d64/d10f 0 2024-08-18T22:41:56.477 INFO:tasks.workunit.client.1.smithi195.stdout:9/878: truncate d1c/d70/fc0 882645 0 2024-08-18T22:41:56.478 INFO:tasks.workunit.client.1.smithi195.stdout:8/973: fsync d1/d3/db/d35/d4d/d95/fa6 0 2024-08-18T22:41:56.479 INFO:tasks.workunit.client.1.smithi195.stdout:0/862: link d0/dc/dd/f58 d0/dc/d64/d81/d44/d41/d6d/d92/d66/d8d/f119 0 2024-08-18T22:41:56.484 INFO:tasks.workunit.client.1.smithi195.stdout:6/843: mkdir da/d3b/dee/d110 0 2024-08-18T22:41:56.484 INFO:tasks.workunit.client.1.smithi195.stdout:6/844: fdatasync da/d15/f34 0 2024-08-18T22:41:56.485 INFO:tasks.workunit.client.1.smithi195.stdout:6/845: readlink da/db/l56 0 2024-08-18T22:41:56.485 INFO:tasks.workunit.client.1.smithi195.stdout:0/863: rename d0/dc/d11/d23/lc8 to d0/dc/d11/d23/d51/d103/l11a 0 2024-08-18T22:41:56.486 INFO:tasks.workunit.client.1.smithi195.stdout:6/846: dread - da/db/fe4 zero size 2024-08-18T22:41:56.487 INFO:tasks.workunit.client.1.smithi195.stdout:0/864: readlink d0/dc/d64/d81/d44/d41/d4c/l108 0 2024-08-18T22:41:56.490 INFO:tasks.workunit.client.1.smithi195.stdout:9/879: dread d1c/d74/d7b/f101 [0,4194304] 0 2024-08-18T22:41:56.491 INFO:tasks.workunit.client.1.smithi195.stdout:9/880: dread - d1c/d92/d9a/ffc zero size 2024-08-18T22:41:56.492 INFO:tasks.workunit.client.1.smithi195.stdout:2/560: link d1/d8/d3d/d6c/d7c/l8c d1/d8/la7 0 2024-08-18T22:41:56.493 INFO:tasks.workunit.client.1.smithi195.stdout:6/847: symlink da/d15/d1c/d64/d10f/dbd/da9/l111 0 2024-08-18T22:41:56.495 INFO:tasks.workunit.client.1.smithi195.stdout:0/865: dwrite d0/dc/dd/d46/ff8 [0,4194304] 0 2024-08-18T22:41:56.496 INFO:tasks.workunit.client.1.smithi195.stdout:0/866: dread - d0/dc/dd/d46/f113 zero size 2024-08-18T22:41:56.497 INFO:tasks.workunit.client.1.smithi195.stdout:2/561: truncate d1/f59 1258613 0 2024-08-18T22:41:56.499 INFO:tasks.workunit.client.1.smithi195.stdout:4/793: creat d0/d99/d98/d16/d94/f11b x:0 0 0 2024-08-18T22:41:56.502 INFO:tasks.workunit.client.1.smithi195.stdout:9/881: rename d1c/d32/d71/dbe/d98/fdc to d1c/d92/f113 0 2024-08-18T22:41:56.503 INFO:tasks.workunit.client.1.smithi195.stdout:6/848: dwrite da/db/f37 [0,4194304] 0 2024-08-18T22:41:56.504 INFO:tasks.workunit.client.1.smithi195.stdout:9/882: dread - d1c/d32/f10c zero size 2024-08-18T22:41:56.505 INFO:tasks.workunit.client.1.smithi195.stdout:2/562: unlink d1/d8/d3d/d4d/f9c 0 2024-08-18T22:41:56.505 INFO:tasks.workunit.client.1.smithi195.stdout:2/563: stat d1/c9d 0 2024-08-18T22:41:56.511 INFO:tasks.workunit.client.1.smithi195.stdout:4/794: read d0/d7/d1d/f28 [910348,61798] 0 2024-08-18T22:41:56.513 INFO:tasks.workunit.client.1.smithi195.stdout:2/564: mkdir d1/d22/d51/da8 0 2024-08-18T22:41:56.517 INFO:tasks.workunit.client.1.smithi195.stdout:2/565: mkdir d1/d24/d26/d42/d72/d85/da9 0 2024-08-18T22:41:56.519 INFO:tasks.workunit.client.1.smithi195.stdout:2/566: chown d1/d24/d26 8159 1 2024-08-18T22:41:56.520 INFO:tasks.workunit.client.1.smithi195.stdout:5/900: write d0/db/fd5 [4337607,41889] 0 2024-08-18T22:41:56.520 INFO:tasks.workunit.client.1.smithi195.stdout:4/795: dwrite d0/d7/d1d/f31 [0,4194304] 0 2024-08-18T22:41:56.528 INFO:tasks.workunit.client.1.smithi195.stdout:2/567: rename d1/d22/c39 to d1/d97/caa 0 2024-08-18T22:41:56.531 INFO:tasks.workunit.client.1.smithi195.stdout:5/901: creat d0/d2/d29/dc5/f11d x:0 0 0 2024-08-18T22:41:56.533 INFO:tasks.workunit.client.1.smithi195.stdout:4/796: mknod d0/d7/d1d/d69/db7/d3b/d6f/db0/c11c 0 2024-08-18T22:41:56.533 INFO:tasks.workunit.client.1.smithi195.stdout:9/883: dread f16 [0,4194304] 0 2024-08-18T22:41:56.539 INFO:tasks.workunit.client.1.smithi195.stdout:2/568: dread d1/d22/d51/fa2 [0,4194304] 0 2024-08-18T22:41:56.539 INFO:tasks.workunit.client.1.smithi195.stdout:0/867: dread d0/dc/d11/d23/d51/f7a [0,4194304] 0 2024-08-18T22:41:56.540 INFO:tasks.workunit.client.1.smithi195.stdout:5/902: rename d0/d2/d29/f47 to d0/d46/f11e 0 2024-08-18T22:41:56.540 INFO:tasks.workunit.client.1.smithi195.stdout:8/974: write d1/f2a [3850726,92185] 0 2024-08-18T22:41:56.541 INFO:tasks.workunit.client.1.smithi195.stdout:6/849: dread da/d22/d86/df3/fc9 [0,4194304] 0 2024-08-18T22:41:56.542 INFO:tasks.workunit.client.1.smithi195.stdout:4/797: write d0/d7/d1d/d69/db7/d6c/f91 [3853706,104246] 0 2024-08-18T22:41:56.542 INFO:tasks.workunit.client.1.smithi195.stdout:5/903: fsync d0/f77 0 2024-08-18T22:41:56.542 INFO:tasks.workunit.client.1.smithi195.stdout:0/868: readlink d0/dc/dd/le6 0 2024-08-18T22:41:56.544 INFO:tasks.workunit.client.1.smithi195.stdout:9/884: creat d1c/d32/d71/dc4/f114 x:0 0 0 2024-08-18T22:41:56.547 INFO:tasks.workunit.client.1.smithi195.stdout:9/885: truncate d1c/d32/f99 884986 0 2024-08-18T22:41:56.548 INFO:tasks.workunit.client.1.smithi195.stdout:6/850: creat da/ddc/da7/f112 x:0 0 0 2024-08-18T22:41:56.552 INFO:tasks.workunit.client.1.smithi195.stdout:5/904: mknod d0/d37/dba/d10d/c11f 0 2024-08-18T22:41:56.554 INFO:tasks.workunit.client.1.smithi195.stdout:2/569: fsync d1/d22/f31 0 2024-08-18T22:41:56.556 INFO:tasks.workunit.client.1.smithi195.stdout:8/975: rename d1/d3/db/d35/dd1 to d1/de/df/d1d/d1f/d166 0 2024-08-18T22:41:56.557 INFO:tasks.workunit.client.1.smithi195.stdout:9/886: mkdir d1c/d32/d37/d4b/d115 0 2024-08-18T22:41:56.559 INFO:tasks.workunit.client.1.smithi195.stdout:6/851: unlink da/d22/d86/c6f 0 2024-08-18T22:41:56.561 INFO:tasks.workunit.client.1.smithi195.stdout:4/798: creat d0/d99/d98/d16/d94/db2/da4/df0/f11d x:0 0 0 2024-08-18T22:41:56.563 INFO:tasks.workunit.client.1.smithi195.stdout:8/976: creat d1/de/df/d1d/de5/dff/f167 x:0 0 0 2024-08-18T22:41:56.566 INFO:tasks.workunit.client.1.smithi195.stdout:6/852: mknod da/db/d19/d67/da8/c113 0 2024-08-18T22:41:56.567 INFO:tasks.workunit.client.1.smithi195.stdout:6/853: stat da/db/f82 0 2024-08-18T22:41:56.567 INFO:tasks.workunit.client.1.smithi195.stdout:4/799: dread d0/d99/d98/d16/dae/f103 [4194304,4194304] 0 2024-08-18T22:41:56.569 INFO:tasks.workunit.client.1.smithi195.stdout:6/854: truncate da/d22/d86/df3/fc9 4467306 0 2024-08-18T22:41:56.581 INFO:tasks.workunit.client.1.smithi195.stdout:2/570: truncate d1/d22/f31 1441704 0 2024-08-18T22:41:56.581 INFO:tasks.workunit.client.1.smithi195.stdout:0/869: dwrite d0/dc/d11/d23/fcb [0,4194304] 0 2024-08-18T22:41:56.581 INFO:tasks.workunit.client.1.smithi195.stdout:8/977: dread d1/d3/f6 [0,4194304] 0 2024-08-18T22:41:56.588 INFO:tasks.workunit.client.1.smithi195.stdout:6/855: dread da/db/d19/d67/fbe [0,4194304] 0 2024-08-18T22:41:56.589 INFO:tasks.workunit.client.1.smithi195.stdout:8/978: write d1/de/df/d1d/de5/df8/f143 [241716,37246] 0 2024-08-18T22:41:56.591 INFO:tasks.workunit.client.1.smithi195.stdout:0/870: mkdir d0/d107/d11b 0 2024-08-18T22:41:56.591 INFO:tasks.workunit.client.1.smithi195.stdout:6/856: fsync da/ddc/f8a 0 2024-08-18T22:41:56.594 INFO:tasks.workunit.client.1.smithi195.stdout:2/571: write d1/d22/f31 [813917,81] 0 2024-08-18T22:41:56.597 INFO:tasks.workunit.client.1.smithi195.stdout:6/857: truncate f6 3657907 0 2024-08-18T22:41:56.599 INFO:tasks.workunit.client.1.smithi195.stdout:9/887: dwrite d1c/d32/d71/dbe/d90/fff [0,4194304] 0 2024-08-18T22:41:56.603 INFO:tasks.workunit.client.1.smithi195.stdout:0/871: dread d0/dc/d64/d81/d44/fbb [0,4194304] 0 2024-08-18T22:41:56.603 INFO:tasks.workunit.client.1.smithi195.stdout:6/858: mknod da/d22/d87/def/c114 0 2024-08-18T22:41:56.604 INFO:tasks.workunit.client.1.smithi195.stdout:8/979: dwrite d1/d3/db/d35/d4d/d8b/f124 [0,4194304] 0 2024-08-18T22:41:56.606 INFO:tasks.workunit.client.1.smithi195.stdout:9/888: mknod d1c/d92/d9a/c116 0 2024-08-18T22:41:56.607 INFO:tasks.workunit.client.1.smithi195.stdout:2/572: write d1/d24/d26/d42/d50/f6f [796542,37045] 0 2024-08-18T22:41:56.608 INFO:tasks.workunit.client.1.smithi195.stdout:8/980: stat d1/d3/d1c/d21/daa/f138 0 2024-08-18T22:41:56.610 INFO:tasks.workunit.client.1.smithi195.stdout:0/872: read - d0/dc/d64/d81/d44/d41/d6d/d92/d66/d8d/dbe/fff zero size 2024-08-18T22:41:56.612 INFO:tasks.workunit.client.1.smithi195.stdout:8/981: write d1/d3/d1c/d6a/f10a [984608,51680] 0 2024-08-18T22:41:56.613 INFO:tasks.workunit.client.1.smithi195.stdout:9/889: symlink d1c/d32/d71/dbe/d98/l117 0 2024-08-18T22:41:56.614 INFO:tasks.workunit.client.1.smithi195.stdout:2/573: creat d1/d24/d26/d42/d72/fab x:0 0 0 2024-08-18T22:41:56.616 INFO:tasks.workunit.client.1.smithi195.stdout:6/859: getdents da/d22/d86/df3 0 2024-08-18T22:41:56.618 INFO:tasks.workunit.client.1.smithi195.stdout:9/890: creat d1c/d32/d37/d4b/d115/f118 x:0 0 0 2024-08-18T22:41:56.618 INFO:tasks.workunit.client.1.smithi195.stdout:6/860: stat da/d15/d1c/d64/d10f/d74/cd8 0 2024-08-18T22:41:56.619 INFO:tasks.workunit.client.1.smithi195.stdout:2/574: creat d1/d24/d26/d42/d44/d87/d8e/fac x:0 0 0 2024-08-18T22:41:56.623 INFO:tasks.workunit.client.1.smithi195.stdout:2/575: creat d1/d24/d26/d83/fad x:0 0 0 2024-08-18T22:41:56.625 INFO:tasks.workunit.client.1.smithi195.stdout:6/861: rename da/d15/d1c/d64/d10f/dbd to da/d3b/dee/d115 0 2024-08-18T22:41:56.625 INFO:tasks.workunit.client.1.smithi195.stdout:2/576: read d1/d8/f25 [481434,43288] 0 2024-08-18T22:41:56.626 INFO:tasks.workunit.client.1.smithi195.stdout:9/891: write d1c/dd5/fe6 [75978,43943] 0 2024-08-18T22:41:56.629 INFO:tasks.workunit.client.1.smithi195.stdout:2/577: mknod d1/d24/d26/d42/d44/cae 0 2024-08-18T22:41:56.629 INFO:tasks.workunit.client.1.smithi195.stdout:0/873: dread d0/dc/d25/f7c [0,4194304] 0 2024-08-18T22:41:56.634 INFO:tasks.workunit.client.1.smithi195.stdout:0/874: symlink d0/dc/d11/d23/d51/dad/l11c 0 2024-08-18T22:41:56.635 INFO:tasks.workunit.client.1.smithi195.stdout:6/862: dwrite da/db/fe4 [0,4194304] 0 2024-08-18T22:41:56.635 INFO:tasks.workunit.client.1.smithi195.stdout:9/892: write d1c/f2c [2103848,7051] 0 2024-08-18T22:41:56.642 INFO:tasks.workunit.client.1.smithi195.stdout:2/578: dwrite d1/d24/f60 [0,4194304] 0 2024-08-18T22:41:56.643 INFO:tasks.workunit.client.1.smithi195.stdout:6/863: mkdir da/d22/d87/d116 0 2024-08-18T22:41:56.643 INFO:tasks.workunit.client.1.smithi195.stdout:0/875: chown d0/dc/d64/d81/d44/d41/d6d/da5/fcc 0 1 2024-08-18T22:41:56.643 INFO:tasks.workunit.client.1.smithi195.stdout:6/864: fsync da/d22/d87/fce 0 2024-08-18T22:41:56.643 INFO:tasks.workunit.client.1.smithi195.stdout:0/876: stat d0/dc/dd/ce5 0 2024-08-18T22:41:56.643 INFO:tasks.workunit.client.1.smithi195.stdout:9/893: mknod d1c/d92/d96/d9d/db9/c119 0 2024-08-18T22:41:56.646 INFO:tasks.workunit.client.1.smithi195.stdout:6/865: rename da/d22/d86/df3/l9b to da/db/d78/dfe/l117 0 2024-08-18T22:41:56.650 INFO:tasks.workunit.client.1.smithi195.stdout:6/866: rename da/fca to da/d22/d86/df3/f118 0 2024-08-18T22:41:56.651 INFO:tasks.workunit.client.1.smithi195.stdout:0/877: creat d0/dc/d64/d81/d44/f11d x:0 0 0 2024-08-18T22:41:56.653 INFO:tasks.workunit.client.1.smithi195.stdout:6/867: unlink da/d22/d86/f79 0 2024-08-18T22:41:56.655 INFO:tasks.workunit.client.1.smithi195.stdout:9/894: write d1c/d32/fd2 [1465774,128921] 0 2024-08-18T22:41:56.657 INFO:tasks.workunit.client.1.smithi195.stdout:6/868: mknod da/d3b/dee/d115/c119 0 2024-08-18T22:41:56.657 INFO:tasks.workunit.client.1.smithi195.stdout:0/878: mknod d0/dc/d11/d23/d51/dad/df4/c11e 0 2024-08-18T22:41:56.657 INFO:tasks.workunit.client.1.smithi195.stdout:2/579: dwrite d1/d8/d27/f88 [0,4194304] 0 2024-08-18T22:41:56.660 INFO:tasks.workunit.client.1.smithi195.stdout:2/580: chown d1/d8/d3d/d3b/d7d 197685 1 2024-08-18T22:41:56.661 INFO:tasks.workunit.client.1.smithi195.stdout:6/869: rmdir da/ddc/da7/de0 39 2024-08-18T22:41:56.665 INFO:tasks.workunit.client.1.smithi195.stdout:9/895: dwrite f15 [0,4194304] 0 2024-08-18T22:41:56.666 INFO:tasks.workunit.client.1.smithi195.stdout:2/581: truncate d1/d8/f2f 240782 0 2024-08-18T22:41:56.668 INFO:tasks.workunit.client.1.smithi195.stdout:6/870: dread da/db/f37 [0,4194304] 0 2024-08-18T22:41:56.669 INFO:tasks.workunit.client.1.smithi195.stdout:2/582: symlink d1/d8/d3d/d3b/laf 0 2024-08-18T22:41:56.670 INFO:tasks.workunit.client.1.smithi195.stdout:6/871: chown da/d22/lc8 91 1 2024-08-18T22:41:56.672 INFO:tasks.workunit.client.1.smithi195.stdout:9/896: link d1c/d32/fd2 d1c/d74/de4/f11a 0 2024-08-18T22:41:56.676 INFO:tasks.workunit.client.1.smithi195.stdout:9/897: symlink d1c/d32/de9/l11b 0 2024-08-18T22:41:56.677 INFO:tasks.workunit.client.1.smithi195.stdout:9/898: chown d1c/d32/d37/d4b/dc6/de3/ff3 765 1 2024-08-18T22:41:56.679 INFO:tasks.workunit.client.1.smithi195.stdout:6/872: getdents da/d3b 0 2024-08-18T22:41:56.682 INFO:tasks.workunit.client.1.smithi195.stdout:2/583: write d1/d24/d26/d42/d72/d85/f91 [212069,118506] 0 2024-08-18T22:41:56.684 INFO:tasks.workunit.client.1.smithi195.stdout:6/873: truncate da/db/d26/d2d/d8e/fe1 471187 0 2024-08-18T22:41:56.686 INFO:tasks.workunit.client.1.smithi195.stdout:9/899: dwrite d1c/d92/d96/d9d/db9/f10a [0,4194304] 0 2024-08-18T22:41:56.687 INFO:tasks.workunit.client.1.smithi195.stdout:2/584: rmdir d1/d24/d26/d42/d72/d85 39 2024-08-18T22:41:56.689 INFO:tasks.workunit.client.1.smithi195.stdout:9/900: read - d1c/d92/da1/ff5 zero size 2024-08-18T22:41:56.691 INFO:tasks.workunit.client.1.smithi195.stdout:6/874: write da/d3b/f7a [4939539,61001] 0 2024-08-18T22:41:56.692 INFO:tasks.workunit.client.1.smithi195.stdout:9/901: write d1c/d32/f46 [2549151,101887] 0 2024-08-18T22:41:56.695 INFO:tasks.workunit.client.1.smithi195.stdout:6/875: creat da/d22/d87/d116/f11a x:0 0 0 2024-08-18T22:41:56.697 INFO:tasks.workunit.client.1.smithi195.stdout:9/902: link d1c/d32/f46 d1c/d92/d96/ddd/f11c 0 2024-08-18T22:41:56.701 INFO:tasks.workunit.client.1.smithi195.stdout:2/585: dread d1/d24/f73 [0,4194304] 0 2024-08-18T22:41:56.702 INFO:tasks.workunit.client.1.smithi195.stdout:0/879: dread d0/dc/d64/d81/d44/d41/d6d/d92/d66/d8d/f119 [0,4194304] 0 2024-08-18T22:41:56.706 INFO:tasks.workunit.client.1.smithi195.stdout:0/880: symlink d0/dc/d11/d23/d51/dad/df4/l11f 0 2024-08-18T22:41:56.710 INFO:tasks.workunit.client.1.smithi195.stdout:9/903: dread d1c/d32/db1/fb3 [0,4194304] 0 2024-08-18T22:41:56.711 INFO:tasks.workunit.client.1.smithi195.stdout:0/881: getdents d0/dc/d64/d81/d44/d41/d4c 0 2024-08-18T22:41:56.712 INFO:tasks.workunit.client.1.smithi195.stdout:2/586: dread d1/d8/d3d/f1c [0,4194304] 0 2024-08-18T22:41:56.713 INFO:tasks.workunit.client.1.smithi195.stdout:9/904: unlink f3 0 2024-08-18T22:41:56.714 INFO:tasks.workunit.client.1.smithi195.stdout:0/882: fsync d0/dc/d64/d81/d44/d41/d6d/d92/d66/d8d/f119 0 2024-08-18T22:41:56.715 INFO:tasks.workunit.client.1.smithi195.stdout:9/905: symlink d1c/d70/l11d 0 2024-08-18T22:41:56.716 INFO:tasks.workunit.client.1.smithi195.stdout:9/906: fdatasync d1c/d32/d71/dc4/f10f 0 2024-08-18T22:41:56.717 INFO:tasks.workunit.client.1.smithi195.stdout:0/883: dread - d0/dc/d64/d81/d44/d41/d6d/d92/f118 zero size 2024-08-18T22:41:56.718 INFO:tasks.workunit.client.1.smithi195.stdout:2/587: creat d1/d24/d26/d83/d94/fb0 x:0 0 0 2024-08-18T22:41:56.720 INFO:tasks.workunit.client.1.smithi195.stdout:6/876: dread da/d3b/f7a [0,4194304] 0 2024-08-18T22:41:56.724 INFO:tasks.workunit.client.1.smithi195.stdout:0/884: write d0/dc/d11/d23/f9b [362679,82113] 0 2024-08-18T22:41:56.725 INFO:tasks.workunit.client.1.smithi195.stdout:9/907: dwrite d1c/d92/da1/f10d [0,4194304] 0 2024-08-18T22:41:56.726 INFO:tasks.workunit.client.1.smithi195.stdout:6/877: dread da/d15/d1c/f9e [0,4194304] 0 2024-08-18T22:41:56.728 INFO:tasks.workunit.client.1.smithi195.stdout:9/908: mkdir d1c/d92/da1/d11e 0 2024-08-18T22:41:56.730 INFO:tasks.workunit.client.1.smithi195.stdout:9/909: stat d1c/d32/d37/d4b/dc6/de3 0 2024-08-18T22:41:56.730 INFO:tasks.workunit.client.1.smithi195.stdout:0/885: mknod d0/dc/d64/d81/d44/d10e/c120 0 2024-08-18T22:41:56.731 INFO:tasks.workunit.client.1.smithi195.stdout:6/878: rmdir da/db/d19/d67/da8 39 2024-08-18T22:41:56.734 INFO:tasks.workunit.client.1.smithi195.stdout:9/910: truncate d1c/d32/d37/f42 95883 0 2024-08-18T22:41:56.736 INFO:tasks.workunit.client.1.smithi195.stdout:0/886: link d0/dc/dd/d46/c69 d0/dc/dd/c121 0 2024-08-18T22:41:56.738 INFO:tasks.workunit.client.1.smithi195.stdout:9/911: link d1c/f31 d1c/d32/d71/dbe/d98/df6/f11f 0 2024-08-18T22:41:56.740 INFO:tasks.workunit.client.1.smithi195.stdout:0/887: creat d0/dc/d11/d23/de9/f122 x:0 0 0 2024-08-18T22:41:56.740 INFO:tasks.workunit.client.1.smithi195.stdout:6/879: write da/d22/ffd [129654,129757] 0 2024-08-18T22:41:56.746 INFO:tasks.workunit.client.1.smithi195.stdout:6/880: mkdir da/ddc/da7/d11b 0 2024-08-18T22:41:56.746 INFO:tasks.workunit.client.1.smithi195.stdout:9/912: write d1c/f27 [584549,82341] 0 2024-08-18T22:41:56.747 INFO:tasks.workunit.client.1.smithi195.stdout:0/888: write d0/dc/dd/f29 [2859265,57282] 0 2024-08-18T22:41:56.748 INFO:tasks.workunit.client.1.smithi195.stdout:6/881: mknod da/d3b/c11c 0 2024-08-18T22:41:56.749 INFO:tasks.workunit.client.1.smithi195.stdout:9/913: creat d1c/d92/d9a/f120 x:0 0 0 2024-08-18T22:41:56.749 INFO:tasks.workunit.client.1.smithi195.stdout:0/889: write d0/dc/d11/d23/de9/fed [336329,27441] 0 2024-08-18T22:41:56.752 INFO:tasks.workunit.client.1.smithi195.stdout:6/882: link da/d3b/f49 da/ddc/f11d 0 2024-08-18T22:41:56.755 INFO:tasks.workunit.client.1.smithi195.stdout:0/890: rename d0/dc/d64/d81/d44/d41/d6d/d92/d66/fcd to d0/dc/d64/d81/d44/d41/d4c/dd9/f123 0 2024-08-18T22:41:56.756 INFO:tasks.workunit.client.1.smithi195.stdout:9/914: write d1c/f47 [1616773,16683] 0 2024-08-18T22:41:56.756 INFO:tasks.workunit.client.1.smithi195.stdout:9/915: readlink l18 0 2024-08-18T22:41:56.756 INFO:tasks.workunit.client.1.smithi195.stdout:6/883: creat da/d3b/dee/d110/f11e x:0 0 0 2024-08-18T22:41:56.758 INFO:tasks.workunit.client.1.smithi195.stdout:9/916: creat d1c/d92/da1/f121 x:0 0 0 2024-08-18T22:41:56.759 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:41:56 smithi195 ceph-mon[23370]: from='mgr.24377 ' entity='mgr.smithi195.acttsj' 2024-08-18T22:41:56.759 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:41:56 smithi195 ceph-mon[23370]: from='mgr.24377 ' entity='mgr.smithi195.acttsj' 2024-08-18T22:41:56.759 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:41:56 smithi195 ceph-mon[23370]: from='mgr.24377 172.21.15.195:0/2331273060' entity='mgr.smithi195.acttsj' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-08-18T22:41:56.759 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:41:56 smithi195 ceph-mon[23370]: from='mgr.24377 ' entity='mgr.smithi195.acttsj' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-08-18T22:41:56.759 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:41:56 smithi195 ceph-mon[23370]: from='mgr.24377 172.21.15.195:0/2331273060' entity='mgr.smithi195.acttsj' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-08-18T22:41:56.759 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:41:56 smithi195 ceph-mon[23370]: from='mgr.24377 ' entity='mgr.smithi195.acttsj' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-08-18T22:41:56.759 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:41:56 smithi195 ceph-mon[23370]: from='mgr.24377 172.21.15.195:0/2331273060' entity='mgr.smithi195.acttsj' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-08-18T22:41:56.759 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:41:56 smithi195 ceph-mon[23370]: from='mgr.24377 ' entity='mgr.smithi195.acttsj' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-08-18T22:41:56.759 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:41:56 smithi195 ceph-mon[23370]: Adjusting osd_memory_target on smithi121 to 1557M 2024-08-18T22:41:56.759 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:41:56 smithi195 ceph-mon[23370]: from='mgr.24377 ' entity='mgr.smithi195.acttsj' 2024-08-18T22:41:56.759 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:41:56 smithi195 ceph-mon[23370]: pgmap v12: 65 pgs: 65 active+clean; 3.7 GiB data, 12 GiB used, 524 GiB / 536 GiB avail; 134 MiB/s rd, 341 MiB/s wr, 712 op/s 2024-08-18T22:41:56.760 INFO:tasks.workunit.client.1.smithi195.stdout:0/891: creat d0/dc/d64/d81/d44/d41/d6d/d97/dfa/f124 x:0 0 0 2024-08-18T22:41:56.760 INFO:tasks.workunit.client.1.smithi195.stdout:6/884: symlink da/d22/d86/d107/l11f 0 2024-08-18T22:41:56.760 INFO:tasks.workunit.client.1.smithi195.stdout:9/917: rmdir d1c/dd5 39 2024-08-18T22:41:56.761 INFO:tasks.workunit.client.1.smithi195.stdout:0/892: fdatasync d0/dc/d11/f15 0 2024-08-18T22:41:56.762 INFO:tasks.workunit.client.1.smithi195.stdout:9/918: read - d1c/d32/d37/d4b/dc6/de3/ff3 zero size 2024-08-18T22:41:56.763 INFO:tasks.workunit.client.1.smithi195.stdout:9/919: chown d1c/d32/d71/dbe/d98/fa7 7 1 2024-08-18T22:41:56.764 INFO:tasks.workunit.client.1.smithi195.stdout:6/885: rename da/db/lf2 to da/l120 0 2024-08-18T22:41:56.766 INFO:tasks.workunit.client.1.smithi195.stdout:9/920: creat d1c/d32/f122 x:0 0 0 2024-08-18T22:41:56.770 INFO:tasks.workunit.client.1.smithi195.stdout:0/893: dwrite d0/dc/d64/d81/d44/d41/d6d/d97/dfa/f124 [0,4194304] 0 2024-08-18T22:41:56.770 INFO:tasks.workunit.client.1.smithi195.stdout:9/921: symlink d1c/d92/d9a/l123 0 2024-08-18T22:41:56.771 INFO:tasks.workunit.client.1.smithi195.stdout:6/886: creat da/db/f121 x:0 0 0 2024-08-18T22:41:56.774 INFO:tasks.workunit.client.1.smithi195.stdout:9/922: creat d1c/d32/d37/d4b/dfd/f124 x:0 0 0 2024-08-18T22:41:56.774 INFO:tasks.workunit.client.1.smithi195.stdout:9/923: readlink d1c/l62 0 2024-08-18T22:41:56.777 INFO:tasks.workunit.client.1.smithi195.stdout:0/894: rename d0/dc/d11/l57 to d0/dc/d64/d81/d44/d41/d6d/d97/dfb/l125 0 2024-08-18T22:41:56.778 INFO:tasks.workunit.client.1.smithi195.stdout:6/887: creat da/ddc/da7/de0/f122 x:0 0 0 2024-08-18T22:41:56.778 INFO:tasks.workunit.client.1.smithi195.stdout:9/924: symlink d1c/d32/d71/dbe/d90/l125 0 2024-08-18T22:41:56.783 INFO:tasks.workunit.client.1.smithi195.stdout:9/925: rename d1c/d32/d37/d4b/c4c to d1c/d32/d71/dbe/d90/c126 0 2024-08-18T22:41:56.785 INFO:tasks.workunit.client.1.smithi195.stdout:9/926: fdatasync d1c/fa8 0 2024-08-18T22:41:56.789 INFO:tasks.workunit.client.1.smithi195.stdout:9/927: rename d1c/d32/d37/d4b/l78 to d1c/d74/d8e/dcc/l127 0 2024-08-18T22:41:56.789 INFO:tasks.workunit.client.1.smithi195.stdout:6/888: dread da/d15/d1c/d64/d10f/f85 [0,4194304] 0 2024-08-18T22:41:56.791 INFO:tasks.workunit.client.1.smithi195.stdout:9/928: creat d1c/d32/f128 x:0 0 0 2024-08-18T22:41:56.792 INFO:tasks.workunit.client.1.smithi195.stdout:0/895: dwrite d0/dc/d64/d81/d44/d41/d4c/dd9/f123 [0,4194304] 0 2024-08-18T22:41:56.792 INFO:tasks.workunit.client.1.smithi195.stdout:6/889: fdatasync da/d22/d86/f7e 0 2024-08-18T22:41:56.794 INFO:tasks.workunit.client.1.smithi195.stdout:9/929: write d1c/d32/fa5 [1818129,42316] 0 2024-08-18T22:41:56.795 INFO:tasks.workunit.client.1.smithi195.stdout:9/930: write d1c/d32/f66 [4958112,89141] 0 2024-08-18T22:41:56.797 INFO:tasks.workunit.client.1.smithi195.stdout:0/896: rmdir d0/dc/d25 39 2024-08-18T22:41:56.800 INFO:tasks.workunit.client.1.smithi195.stdout:9/931: chown d1c/d74/cfe 713 1 2024-08-18T22:41:56.801 INFO:tasks.workunit.client.1.smithi195.stdout:0/897: chown d0/dc/le1 24579920 1 2024-08-18T22:41:56.802 INFO:tasks.workunit.client.1.smithi195.stdout:9/932: rmdir d1c/d32/d37/d4b 39 2024-08-18T22:41:56.804 INFO:tasks.workunit.client.1.smithi195.stdout:6/890: write da/d15/d1c/fe2 [279090,112202] 0 2024-08-18T22:41:56.805 INFO:tasks.workunit.client.1.smithi195.stdout:0/898: getdents d0/dc/d11/daa 0 2024-08-18T22:41:56.809 INFO:tasks.workunit.client.1.smithi195.stdout:0/899: unlink d0/d107/db8/lb9 0 2024-08-18T22:41:56.810 INFO:tasks.workunit.client.1.smithi195.stdout:6/891: write da/d3b/f3e [4041923,65126] 0 2024-08-18T22:41:56.810 INFO:tasks.workunit.client.1.smithi195.stdout:9/933: dwrite d1c/d74/d7b/f101 [0,4194304] 0 2024-08-18T22:41:56.813 INFO:tasks.workunit.client.1.smithi195.stdout:0/900: readlink d0/dc/d11/d23/d51/dad/df4/l11f 0 2024-08-18T22:41:56.814 INFO:tasks.workunit.client.1.smithi195.stdout:0/901: chown d0/dc/d64/d81/d44/d43 7 1 2024-08-18T22:41:56.815 INFO:tasks.workunit.client.1.smithi195.stdout:6/892: link da/d3b/f3e da/d3b/f123 0 2024-08-18T22:41:56.815 INFO:tasks.workunit.client.1.smithi195.stdout:9/934: mknod d1c/d92/da1/d11e/c129 0 2024-08-18T22:41:56.817 INFO:tasks.workunit.client.1.smithi195.stdout:6/893: fsync da/d15/f2c 0 2024-08-18T22:41:56.818 INFO:tasks.workunit.client.1.smithi195.stdout:0/902: rmdir d0/dc/d64/de2 39 2024-08-18T22:41:56.821 INFO:tasks.workunit.client.1.smithi195.stdout:6/894: getdents da/db/d26/d2d/d8e/df1 0 2024-08-18T22:41:56.822 INFO:tasks.workunit.client.1.smithi195.stdout:9/935: creat d1c/d32/d37/d4b/dc6/de3/f12a x:0 0 0 2024-08-18T22:41:56.822 INFO:tasks.workunit.client.1.smithi195.stdout:0/903: mknod d0/dc/d11/d6f/c126 0 2024-08-18T22:41:56.823 INFO:tasks.workunit.client.1.smithi195.stdout:6/895: rmdir da/d22/d87/def 39 2024-08-18T22:41:56.824 INFO:tasks.workunit.client.1.smithi195.stdout:9/936: creat d1c/d70/f12b x:0 0 0 2024-08-18T22:41:56.825 INFO:tasks.workunit.client.1.smithi195.stdout:0/904: mkdir d0/dc/d11/d23/d127 0 2024-08-18T22:41:56.827 INFO:tasks.workunit.client.1.smithi195.stdout:6/896: rename da/db/d26 to da/d22/d86/dfa/d124 0 2024-08-18T22:41:56.828 INFO:tasks.workunit.client.1.smithi195.stdout:9/937: mkdir d1c/d74/de4/d12c 0 2024-08-18T22:41:56.829 INFO:tasks.workunit.client.1.smithi195.stdout:0/905: fsync d0/dc/d11/fd1 0 2024-08-18T22:41:56.830 INFO:tasks.workunit.client.1.smithi195.stdout:6/897: symlink da/d3b/dee/d115/l125 0 2024-08-18T22:41:56.833 INFO:tasks.workunit.client.1.smithi195.stdout:0/906: truncate d0/dc/f84 925675 0 2024-08-18T22:41:56.833 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:41:56 smithi121 ceph-mon[16788]: from='mgr.24377 ' entity='mgr.smithi195.acttsj' 2024-08-18T22:41:56.833 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:41:56 smithi121 ceph-mon[16788]: from='mgr.24377 ' entity='mgr.smithi195.acttsj' 2024-08-18T22:41:56.834 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:41:56 smithi121 ceph-mon[16788]: from='mgr.24377 172.21.15.195:0/2331273060' entity='mgr.smithi195.acttsj' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-08-18T22:41:56.834 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:41:56 smithi121 ceph-mon[16788]: from='mgr.24377 ' entity='mgr.smithi195.acttsj' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-08-18T22:41:56.834 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:41:56 smithi121 ceph-mon[16788]: from='mgr.24377 172.21.15.195:0/2331273060' entity='mgr.smithi195.acttsj' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-08-18T22:41:56.834 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:41:56 smithi121 ceph-mon[16788]: from='mgr.24377 ' entity='mgr.smithi195.acttsj' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-08-18T22:41:56.834 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:41:56 smithi121 ceph-mon[16788]: from='mgr.24377 172.21.15.195:0/2331273060' entity='mgr.smithi195.acttsj' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-08-18T22:41:56.834 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:41:56 smithi121 ceph-mon[16788]: from='mgr.24377 ' entity='mgr.smithi195.acttsj' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-08-18T22:41:56.834 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:41:56 smithi121 ceph-mon[16788]: Adjusting osd_memory_target on smithi121 to 1557M 2024-08-18T22:41:56.834 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:41:56 smithi121 ceph-mon[16788]: from='mgr.24377 ' entity='mgr.smithi195.acttsj' 2024-08-18T22:41:56.834 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:41:56 smithi121 ceph-mon[16788]: pgmap v12: 65 pgs: 65 active+clean; 3.7 GiB data, 12 GiB used, 524 GiB / 536 GiB avail; 134 MiB/s rd, 341 MiB/s wr, 712 op/s 2024-08-18T22:41:56.835 INFO:tasks.workunit.client.1.smithi195.stdout:6/898: creat da/d3b/dee/f126 x:0 0 0 2024-08-18T22:41:56.837 INFO:tasks.workunit.client.1.smithi195.stdout:9/938: rename d1c/d74 to d1c/d92/d9a/d12d 0 2024-08-18T22:41:56.839 INFO:tasks.workunit.client.1.smithi195.stdout:9/939: dread - d1c/d92/d9a/f120 zero size 2024-08-18T22:41:56.842 INFO:tasks.workunit.client.1.smithi195.stdout:0/907: dwrite d0/d107/f115 [0,4194304] 0 2024-08-18T22:41:56.845 INFO:tasks.workunit.client.1.smithi195.stdout:9/940: creat d1c/d32/d71/dc4/f12e x:0 0 0 2024-08-18T22:41:56.846 INFO:tasks.workunit.client.1.smithi195.stdout:9/941: chown d1c/d92/d9a/l105 4334 1 2024-08-18T22:41:56.847 INFO:tasks.workunit.client.1.smithi195.stdout:6/899: dwrite da/d15/d1c/f9e [0,4194304] 0 2024-08-18T22:41:56.849 INFO:tasks.workunit.client.1.smithi195.stdout:0/908: creat d0/dc/d64/d81/d44/d41/d6d/d92/f128 x:0 0 0 2024-08-18T22:41:56.851 INFO:tasks.workunit.client.1.smithi195.stdout:0/909: readlink d0/d107/db8/ld4 0 2024-08-18T22:41:56.853 INFO:tasks.workunit.client.1.smithi195.stdout:6/900: creat da/d15/d1c/d64/d10f/f127 x:0 0 0 2024-08-18T22:41:56.854 INFO:tasks.workunit.client.1.smithi195.stdout:9/942: dwrite f0 [0,4194304] 0 2024-08-18T22:41:56.857 INFO:tasks.workunit.client.1.smithi195.stdout:0/910: rename d0/dc/d64/d81/d44/d41/fca to d0/d107/d11b/f129 0 2024-08-18T22:41:56.858 INFO:tasks.workunit.client.1.smithi195.stdout:6/901: creat da/d3b/dee/d115/f128 x:0 0 0 2024-08-18T22:41:56.859 INFO:tasks.workunit.client.1.smithi195.stdout:9/943: creat d1c/d32/d71/dbe/d98/df6/f12f x:0 0 0 2024-08-18T22:41:56.860 INFO:tasks.workunit.client.1.smithi195.stdout:0/911: mknod d0/dc/d11/d23/de9/c12a 0 2024-08-18T22:41:56.860 INFO:tasks.workunit.client.1.smithi195.stdout:9/944: read d1c/d32/db1/fb3 [1672192,113006] 0 2024-08-18T22:41:56.861 INFO:tasks.workunit.client.1.smithi195.stdout:6/902: mkdir da/db/d78/dcd/d129 0 2024-08-18T22:41:56.864 INFO:tasks.workunit.client.1.smithi195.stdout:9/945: mkdir d1c/d92/d9a/d12d/de4/d130 0 2024-08-18T22:41:56.865 INFO:tasks.workunit.client.1.smithi195.stdout:9/946: read d1c/d92/d9a/ff4 [3392390,52189] 0 2024-08-18T22:41:56.865 INFO:tasks.workunit.client.1.smithi195.stdout:6/903: mknod da/d22/d87/c12a 0 2024-08-18T22:41:56.865 INFO:tasks.workunit.client.1.smithi195.stdout:0/912: dread d0/dc/d11/d23/de9/fed [0,4194304] 0 2024-08-18T22:41:56.867 INFO:tasks.workunit.client.1.smithi195.stdout:9/947: rmdir d1c/d32/d37/d4b/d115 39 2024-08-18T22:41:56.870 INFO:tasks.workunit.client.1.smithi195.stdout:6/904: rename da/d3b/c11c to da/ddc/da7/de0/c12b 0 2024-08-18T22:41:56.870 INFO:tasks.workunit.client.1.smithi195.stdout:9/948: mknod d1c/d32/d71/dbe/d98/c131 0 2024-08-18T22:41:56.872 INFO:tasks.workunit.client.1.smithi195.stdout:6/905: dread da/d22/ffd [0,4194304] 0 2024-08-18T22:41:56.873 INFO:tasks.workunit.client.1.smithi195.stdout:9/949: rename d1c/d92/d9a/d12d/d7b/lb2 to d1c/d92/d96/ddd/l132 0 2024-08-18T22:41:56.874 INFO:tasks.workunit.client.1.smithi195.stdout:6/906: chown da/db/d78/dfe/l117 205944 1 2024-08-18T22:41:56.877 INFO:tasks.workunit.client.1.smithi195.stdout:9/950: rename d1c/d32/db1/dec to d1c/d32/d37/d4b/dc6/d133 0 2024-08-18T22:41:56.877 INFO:tasks.workunit.client.1.smithi195.stdout:6/907: rename da/d15/d1c/d64 to da/d15/d1c/d64/d10f/d74/d12c 22 2024-08-18T22:41:56.880 INFO:tasks.workunit.client.1.smithi195.stdout:9/951: creat d1c/d32/d71/dbe/f134 x:0 0 0 2024-08-18T22:41:56.885 INFO:tasks.workunit.client.1.smithi195.stdout:9/952: dwrite d1c/d32/f8f [4194304,4194304] 0 2024-08-18T22:41:56.887 INFO:tasks.workunit.client.1.smithi195.stdout:6/908: write da/d22/d86/dfa/d124/f95 [634785,101132] 0 2024-08-18T22:41:56.889 INFO:tasks.workunit.client.1.smithi195.stdout:9/953: creat d1c/d32/d37/d4b/dc6/de3/f135 x:0 0 0 2024-08-18T22:41:56.890 INFO:tasks.workunit.client.1.smithi195.stdout:6/909: write da/d15/d1c/f9e [2369993,32236] 0 2024-08-18T22:41:56.892 INFO:tasks.workunit.client.1.smithi195.stdout:9/954: mkdir d1c/d92/d9a/d12d/d136 0 2024-08-18T22:41:56.893 INFO:tasks.workunit.client.1.smithi195.stdout:6/910: readlink da/l120 0 2024-08-18T22:41:56.900 INFO:tasks.workunit.client.1.smithi195.stdout:9/955: dwrite d1c/d92/da1/f121 [0,4194304] 0 2024-08-18T22:41:56.908 INFO:tasks.workunit.client.1.smithi195.stdout:6/911: dwrite da/d22/d86/dfa/d124/d2d/f93 [0,4194304] 0 2024-08-18T22:41:56.909 INFO:tasks.workunit.client.1.smithi195.stdout:9/956: rename d1c/dd5 to d1c/d32/d37/d4b/d115/d137 0 2024-08-18T22:41:56.910 INFO:tasks.workunit.client.1.smithi195.stdout:6/912: chown da/d22/lc8 0 1 2024-08-18T22:41:56.913 INFO:tasks.workunit.client.1.smithi195.stdout:6/913: mkdir da/d22/d86/dfa/d12d 0 2024-08-18T22:41:56.915 INFO:tasks.workunit.client.1.smithi195.stdout:6/914: write da/f13 [1468395,88821] 0 2024-08-18T22:41:56.915 INFO:tasks.workunit.client.1.smithi195.stdout:9/957: link d1c/d32/db1/laa d1c/d92/d9a/d12d/de4/d130/l138 0 2024-08-18T22:41:56.916 INFO:tasks.workunit.client.1.smithi195.stdout:6/915: fsync da/ddc/dd7/fe9 0 2024-08-18T22:41:56.920 INFO:tasks.workunit.client.1.smithi195.stdout:9/958: rename d1c/d92/d9a/d12d/d7b/ld8 to d1c/d92/d9a/d12d/de4/d130/l139 0 2024-08-18T22:41:56.921 INFO:tasks.workunit.client.1.smithi195.stdout:6/916: creat da/ddc/da7/f12e x:0 0 0 2024-08-18T22:41:56.922 INFO:tasks.workunit.client.1.smithi195.stdout:9/959: creat d1c/d92/d9a/d12d/d7b/f13a x:0 0 0 2024-08-18T22:41:56.923 INFO:tasks.workunit.client.1.smithi195.stdout:9/960: dread - d1c/d32/f122 zero size 2024-08-18T22:41:56.923 INFO:tasks.workunit.client.1.smithi195.stdout:6/917: fdatasync da/d22/d86/dfa/d124/d90/f9c 0 2024-08-18T22:41:56.925 INFO:tasks.workunit.client.1.smithi195.stdout:6/918: write da/db/f121 [974354,15081] 0 2024-08-18T22:41:57.351 INFO:tasks.workunit.client.1.smithi195.stdout:5/905: sync 2024-08-18T22:41:57.351 INFO:tasks.workunit.client.1.smithi195.stdout:4/800: sync 2024-08-18T22:41:57.351 INFO:tasks.workunit.client.1.smithi195.stdout:0/913: sync 2024-08-18T22:41:57.351 INFO:tasks.workunit.client.1.smithi195.stdout:8/982: sync 2024-08-18T22:41:57.351 INFO:tasks.workunit.client.1.smithi195.stdout:2/588: sync 2024-08-18T22:41:57.351 INFO:tasks.workunit.client.1.smithi195.stdout:9/961: sync 2024-08-18T22:41:57.351 INFO:tasks.workunit.client.1.smithi195.stdout:6/919: sync 2024-08-18T22:41:57.351 INFO:tasks.workunit.client.1.smithi195.stdout:9/962: readlink d1c/l7f 0 2024-08-18T22:41:57.352 INFO:tasks.workunit.client.1.smithi195.stdout:5/906: rmdir d0/d3/d66/dda 39 2024-08-18T22:41:57.353 INFO:tasks.workunit.client.1.smithi195.stdout:6/920: truncate da/d15/d1c/fea 536459 0 2024-08-18T22:41:57.357 INFO:tasks.workunit.client.1.smithi195.stdout:8/983: rename d1/d3/db/d35/f42 to d1/d3/db/d39/d44/d79/df2/f168 0 2024-08-18T22:41:57.359 INFO:tasks.workunit.client.1.smithi195.stdout:6/921: stat da/db/d19/d67/da8/cff 0 2024-08-18T22:41:57.361 INFO:tasks.workunit.client.1.smithi195.stdout:4/801: rename d0/d99/d98/d16/d94/db2/f96 to d0/d7/d1d/d69/db7/d6c/d95/f11e 0 2024-08-18T22:41:57.365 INFO:tasks.workunit.client.1.smithi195.stdout:0/914: dwrite d0/dc/d11/d23/f80 [0,4194304] 0 2024-08-18T22:41:57.365 INFO:tasks.workunit.client.1.smithi195.stdout:8/984: symlink d1/d3/db/d39/d44/l169 0 2024-08-18T22:41:57.371 INFO:tasks.workunit.client.1.smithi195.stdout:9/963: dwrite d1c/d92/da1/ff2 [0,4194304] 0 2024-08-18T22:41:57.371 INFO:tasks.workunit.client.1.smithi195.stdout:5/907: dwrite d0/f11 [0,4194304] 0 2024-08-18T22:41:57.372 INFO:tasks.workunit.client.1.smithi195.stdout:8/985: chown d1/d3/db/d35/d4d/d5c/ddf/d153 41 1 2024-08-18T22:41:57.374 INFO:tasks.workunit.client.1.smithi195.stdout:4/802: mknod d0/d99/d98/d16/d94/db2/da4/dad/c11f 0 2024-08-18T22:41:57.382 INFO:tasks.workunit.client.1.smithi195.stdout:4/803: fsync d0/d7/d1d/d69/db7/d3b/d6f/db0/f62 0 2024-08-18T22:41:57.388 INFO:tasks.workunit.client.1.smithi195.stdout:4/804: rename d0/d99/d98/d16 to d0/d7/d1d/d69/db7/d3b/d120 0 2024-08-18T22:41:57.388 INFO:tasks.workunit.client.1.smithi195.stdout:9/964: write d1c/f64 [1320241,84570] 0 2024-08-18T22:41:57.391 INFO:tasks.workunit.client.1.smithi195.stdout:6/922: truncate da/d3b/dee/d115/da9/f9d 4192132 0 2024-08-18T22:41:57.396 INFO:tasks.workunit.client.1.smithi195.stdout:6/923: creat da/db/d78/dcd/d129/f12f x:0 0 0 2024-08-18T22:41:57.397 INFO:tasks.workunit.client.1.smithi195.stdout:0/915: dwrite d0/dc/d11/f79 [0,4194304] 0 2024-08-18T22:41:57.398 INFO:tasks.workunit.client.1.smithi195.stdout:8/986: dwrite d1/d3/ffa [0,4194304] 0 2024-08-18T22:41:57.399 INFO:tasks.workunit.client.1.smithi195.stdout:4/805: rename d0/d7/d1d/d69/db7/d3b/d120/d94/db2/da4/dad/fef to d0/d7/d1d/d69/db7/d3b/f121 0 2024-08-18T22:41:57.405 INFO:tasks.workunit.client.1.smithi195.stdout:8/987: creat d1/de/d27/d4f/f16a x:0 0 0 2024-08-18T22:41:57.407 INFO:tasks.workunit.client.1.smithi195.stdout:6/924: symlink da/db/d19/d10d/l130 0 2024-08-18T22:41:57.408 INFO:tasks.workunit.client.1.smithi195.stdout:8/988: mkdir d1/d3/d1c/d6a/d16b 0 2024-08-18T22:41:57.416 INFO:tasks.workunit.client.1.smithi195.stdout:0/916: creat d0/dc/d64/f12b x:0 0 0 2024-08-18T22:41:57.416 INFO:tasks.workunit.client.1.smithi195.stdout:6/925: symlink da/db/d19/d10d/l131 0 2024-08-18T22:41:57.416 INFO:tasks.workunit.client.1.smithi195.stdout:0/917: dread - d0/dc/f10a zero size 2024-08-18T22:41:57.422 INFO:tasks.workunit.client.1.smithi195.stdout:0/918: dwrite d0/dc/dd/f109 [0,4194304] 0 2024-08-18T22:41:57.423 INFO:tasks.workunit.client.1.smithi195.stdout:0/919: chown d0/dc/d11/d23/d51/dad/l11c 7808211 1 2024-08-18T22:41:57.428 INFO:tasks.workunit.client.1.smithi195.stdout:4/806: write d0/d7/d1d/d69/db7/d6c/d95/f11e [644940,46201] 0 2024-08-18T22:41:57.443 INFO:tasks.workunit.client.1.smithi195.stdout:0/920: rename d0/dc/d64/d81/l3e to d0/dc/d64/d81/d44/d41/d4c/dd9/l12c 0 2024-08-18T22:41:57.443 INFO:tasks.workunit.client.1.smithi195.stdout:4/807: chown d0/d7/d1d/d69/db7/l67 2 1 2024-08-18T22:41:57.444 INFO:tasks.workunit.client.1.smithi195.stdout:8/989: symlink d1/d3/db/d35/d4d/l16c 0 2024-08-18T22:41:57.447 INFO:tasks.workunit.client.1.smithi195.stdout:4/808: mknod d0/d7/d1d/d69/db7/d6c/c122 0 2024-08-18T22:41:57.448 INFO:tasks.workunit.client.1.smithi195.stdout:4/809: chown d0/d7/d1d/d69/db7/d6c/fcc 57615 1 2024-08-18T22:41:57.450 INFO:tasks.workunit.client.1.smithi195.stdout:0/921: symlink d0/dc/d64/d81/d44/d41/d6d/d97/db5/d116/l12d 0 2024-08-18T22:41:57.452 INFO:tasks.workunit.client.1.smithi195.stdout:6/926: dread da/d15/d1c/d64/f8b [0,4194304] 0 2024-08-18T22:41:57.452 INFO:tasks.workunit.client.1.smithi195.stdout:4/810: rename d0/d99/d85/faa to d0/d7/d1d/d69/f123 0 2024-08-18T22:41:57.454 INFO:tasks.workunit.client.1.smithi195.stdout:4/811: chown d0/c12 11 1 2024-08-18T22:41:57.459 INFO:tasks.workunit.client.1.smithi195.stdout:4/812: write d0/d7/d1d/d69/db7/d3b/d120/f1b [2141905,62360] 0 2024-08-18T22:41:57.462 INFO:tasks.workunit.client.1.smithi195.stdout:6/927: dwrite da/ddc/f76 [0,4194304] 0 2024-08-18T22:41:57.463 INFO:tasks.workunit.client.1.smithi195.stdout:8/990: dread d1/d3/db/d35/d4d/d95/daf/f13e [0,4194304] 0 2024-08-18T22:41:57.465 INFO:tasks.workunit.client.1.smithi195.stdout:6/928: readlink da/d22/d86/l10a 0 2024-08-18T22:41:57.466 INFO:tasks.workunit.client.1.smithi195.stdout:0/922: dread d0/dc/dd/f29 [0,4194304] 0 2024-08-18T22:41:57.468 INFO:tasks.workunit.client.1.smithi195.stdout:6/929: chown da/d3b/dee/d115/da9/d77/fde 0 1 2024-08-18T22:41:57.470 INFO:tasks.workunit.client.1.smithi195.stdout:8/991: creat d1/d3/db/d35/d4d/d5c/de4/d15a/f16d x:0 0 0 2024-08-18T22:41:57.473 INFO:tasks.workunit.client.1.smithi195.stdout:6/930: write da/d3b/f7a [1814296,65901] 0 2024-08-18T22:41:57.478 INFO:tasks.workunit.client.1.smithi195.stdout:4/813: dwrite d0/d7/d1d/d69/db7/d3b/d120/d94/db2/f87 [0,4194304] 0 2024-08-18T22:41:57.480 INFO:tasks.workunit.client.1.smithi195.stdout:6/931: stat da/d22/d86/dfa/d124/c59 0 2024-08-18T22:41:57.482 INFO:tasks.workunit.client.1.smithi195.stdout:8/992: dwrite d1/de/d27/d4f/f16a [0,4194304] 0 2024-08-18T22:41:57.484 INFO:tasks.workunit.client.1.smithi195.stdout:6/932: chown da/db/d19/d67/fa5 1 1 2024-08-18T22:41:57.484 INFO:tasks.workunit.client.1.smithi195.stdout:0/923: write d0/dc/d25/f54 [841168,18565] 0 2024-08-18T22:41:57.485 INFO:tasks.workunit.client.1.smithi195.stdout:8/993: chown d1/de/d27/d4f 86578 1 2024-08-18T22:41:57.487 INFO:tasks.workunit.client.1.smithi195.stdout:4/814: write d0/d99/d85/d48/fac [171509,22057] 0 2024-08-18T22:41:57.490 INFO:tasks.workunit.client.1.smithi195.stdout:0/924: mknod d0/dc/d11/d23/d127/c12e 0 2024-08-18T22:41:57.491 INFO:tasks.workunit.client.1.smithi195.stdout:4/815: creat d0/d99/d85/dc8/f124 x:0 0 0 2024-08-18T22:41:57.492 INFO:tasks.workunit.client.1.smithi195.stdout:8/994: symlink d1/d3/db/d35/d4d/d5c/ddf/d153/l16e 0 2024-08-18T22:41:57.492 INFO:tasks.workunit.client.1.smithi195.stdout:8/995: chown d1/d3/d1c 38314 1 2024-08-18T22:41:57.493 INFO:tasks.workunit.client.1.smithi195.stdout:0/925: symlink d0/dc/d11/d6f/d9d/l12f 0 2024-08-18T22:41:57.493 INFO:tasks.workunit.client.1.smithi195.stdout:6/933: write da/db/d19/d67/fa5 [3504431,119089] 0 2024-08-18T22:41:57.495 INFO:tasks.workunit.client.1.smithi195.stdout:6/934: dread - da/d22/d86/dfa/d124/d90/f9c zero size 2024-08-18T22:41:57.496 INFO:tasks.workunit.client.1.smithi195.stdout:8/996: chown d1/d3/db/d39/d44/d79/df2/f168 0 1 2024-08-18T22:41:57.497 INFO:tasks.workunit.client.1.smithi195.stdout:4/816: rename d0/d7/d1d/f2f to d0/d7/d1d/d69/db7/d3b/d120/d94/db2/da4/dad/f125 0 2024-08-18T22:41:57.499 INFO:tasks.workunit.client.1.smithi195.stdout:6/935: symlink da/d22/d86/d107/l132 0 2024-08-18T22:41:57.499 INFO:tasks.workunit.client.1.smithi195.stdout:4/817: fsync d0/d99/d98/db6/dca/fbc 0 2024-08-18T22:41:57.500 INFO:tasks.workunit.client.1.smithi195.stdout:8/997: creat d1/d3/d1c/d6a/f16f x:0 0 0 2024-08-18T22:41:57.500 INFO:tasks.workunit.client.1.smithi195.stdout:6/936: fsync da/d3b/dee/d115/da9/d77/fde 0 2024-08-18T22:41:57.500 INFO:tasks.workunit.client.1.smithi195.stdout:8/998: chown d1/d3/db/d7a 1006990808 1 2024-08-18T22:41:57.501 INFO:tasks.workunit.client.1.smithi195.stdout:8/999: truncate d1/dca/f14d 749342 0 2024-08-18T22:41:57.501 INFO:tasks.workunit.client.1.smithi195.stdout:0/926: rename d0/dc/d64/d81/d44/d41/d6d/da5/cf1 to d0/dc/d64/d81/d44/d41/d6d/d97/db5/d116/c130 0 2024-08-18T22:41:57.503 INFO:tasks.workunit.client.1.smithi195.stdout:6/937: unlink da/db/d19/c102 0 2024-08-18T22:41:57.505 INFO:tasks.workunit.client.1.smithi195.stdout:0/927: chown d0/dc/d64/d81/d44/d41/d4c/dd9/l12c 10537 1 2024-08-18T22:41:57.511 INFO:tasks.workunit.client.1.smithi195.stdout:0/928: link d0/dc/d11/d23/de9/c12a d0/d107/db8/c131 0 2024-08-18T22:41:57.513 INFO:tasks.workunit.client.1.smithi195.stdout:6/938: write da/d22/d86/f7e [854293,365] 0 2024-08-18T22:41:57.514 INFO:tasks.workunit.client.1.smithi195.stdout:0/929: truncate d0/d107/d11b/f129 2332150 0 2024-08-18T22:41:57.515 INFO:tasks.workunit.client.1.smithi195.stdout:6/939: chown da/d15/l58 10499492 1 2024-08-18T22:41:57.515 INFO:tasks.workunit.client.1.smithi195.stdout:6/940: readlink l8 0 2024-08-18T22:41:57.518 INFO:tasks.workunit.client.1.smithi195.stdout:4/818: dwrite d0/d99/d85/f4e [0,4194304] 0 2024-08-18T22:41:57.519 INFO:tasks.workunit.client.1.smithi195.stdout:6/941: creat da/db/f133 x:0 0 0 2024-08-18T22:41:57.521 INFO:tasks.workunit.client.1.smithi195.stdout:0/930: creat d0/dc/d64/d81/d44/d41/f132 x:0 0 0 2024-08-18T22:41:57.523 INFO:tasks.workunit.client.1.smithi195.stdout:6/942: write da/db/fe4 [4632755,100260] 0 2024-08-18T22:41:57.523 INFO:tasks.workunit.client.1.smithi195.stdout:4/819: mkdir d0/d7/d1d/d69/db7/d6c/d95/d126 0 2024-08-18T22:41:57.529 INFO:tasks.workunit.client.1.smithi195.stdout:4/820: rename d0/d7/d1d/d69/db7/d41/la9 to d0/d7/d1d/d69/db7/d3b/d120/d94/db2/da4/dad/l127 0 2024-08-18T22:41:57.530 INFO:tasks.workunit.client.1.smithi195.stdout:6/943: rmdir da/d22/d86/dfa/d124/d2d/d8e/df1 0 2024-08-18T22:41:57.534 INFO:tasks.workunit.client.1.smithi195.stdout:6/944: rename da/d3b/dee/d115/da9/d77 to da/d22/d87/d91/d134 0 2024-08-18T22:41:57.535 INFO:tasks.workunit.client.1.smithi195.stdout:6/945: dread - da/d3b/dee/d115/f106 zero size 2024-08-18T22:41:57.535 INFO:tasks.workunit.client.1.smithi195.stdout:0/931: dread d0/dc/d11/d23/f70 [0,4194304] 0 2024-08-18T22:41:57.537 INFO:tasks.workunit.client.1.smithi195.stdout:6/946: mknod da/d3b/dee/d115/c135 0 2024-08-18T22:41:57.539 INFO:tasks.workunit.client.1.smithi195.stdout:6/947: fsync da/d15/d1c/f8f 0 2024-08-18T22:41:57.542 INFO:tasks.workunit.client.1.smithi195.stdout:0/932: write d0/dc/d64/d81/d44/d41/d6d/d92/d66/d8d/fa6 [4826583,127874] 0 2024-08-18T22:41:57.544 INFO:tasks.workunit.client.1.smithi195.stdout:6/948: getdents da/db/db7 0 2024-08-18T22:41:57.546 INFO:tasks.workunit.client.1.smithi195.stdout:6/949: creat da/d22/d87/d91/f136 x:0 0 0 2024-08-18T22:41:57.546 INFO:tasks.workunit.client.1.smithi195.stdout:0/933: mknod d0/dc/d64/d81/d44/d41/c133 0 2024-08-18T22:41:57.546 INFO:tasks.workunit.client.1.smithi195.stdout:6/950: stat da/d15/d1c/d64/d10f/d74 0 2024-08-18T22:41:57.547 INFO:tasks.workunit.client.1.smithi195.stdout:0/934: read - d0/dc/d11/d23/de9/f122 zero size 2024-08-18T22:41:57.549 INFO:tasks.workunit.client.1.smithi195.stdout:0/935: chown d0/dc/d11/fdf 2250 1 2024-08-18T22:41:57.550 INFO:tasks.workunit.client.1.smithi195.stdout:0/936: chown d0/dc/d64/d81/d44/d41/d6d/d92/d66/de0/f10c 2648 1 2024-08-18T22:41:57.550 INFO:tasks.workunit.client.1.smithi195.stdout:2/589: sync 2024-08-18T22:41:57.552 INFO:tasks.workunit.client.1.smithi195.stdout:4/821: dread d0/fb5 [0,4194304] 0 2024-08-18T22:41:57.553 INFO:tasks.workunit.client.1.smithi195.stdout:2/590: truncate d1/d24/d26/d42/d72/f86 371130 0 2024-08-18T22:41:57.554 INFO:tasks.workunit.client.1.smithi195.stdout:2/591: chown d1/d8/d3d/d6c/d7c 7323536 1 2024-08-18T22:41:57.554 INFO:tasks.workunit.client.1.smithi195.stdout:0/937: creat d0/dc/d64/d81/d44/d41/d6d/d92/d66/de0/f134 x:0 0 0 2024-08-18T22:41:57.555 INFO:tasks.workunit.client.1.smithi195.stdout:2/592: stat d1/d24/d26/d83/fad 0 2024-08-18T22:41:57.556 INFO:tasks.workunit.client.1.smithi195.stdout:2/593: fdatasync d1/d24/d26/d83/d94/fb0 0 2024-08-18T22:41:57.557 INFO:tasks.workunit.client.1.smithi195.stdout:4/822: dread d0/d99/d98/f92 [0,4194304] 0 2024-08-18T22:41:57.558 INFO:tasks.workunit.client.1.smithi195.stdout:2/594: rmdir d1/d8/d3d 39 2024-08-18T22:41:57.558 INFO:tasks.workunit.client.1.smithi195.stdout:0/938: getdents d0/dc/d64/de2 0 2024-08-18T22:41:57.559 INFO:tasks.workunit.client.1.smithi195.stdout:4/823: rmdir d0/d7/d1d/d69/db7/d3b/d120/d94/db2 39 2024-08-18T22:41:57.562 INFO:tasks.workunit.client.1.smithi195.stdout:6/951: dread da/db/f3c [0,4194304] 0 2024-08-18T22:41:57.564 INFO:tasks.workunit.client.1.smithi195.stdout:0/939: rename d0/cfd to d0/dc/d64/d81/d44/d41/d6d/d97/dfb/c135 0 2024-08-18T22:41:57.567 INFO:tasks.workunit.client.1.smithi195.stdout:6/952: rename da/db/d19/d67/f75 to da/ddc/da7/de0/f137 0 2024-08-18T22:41:57.567 INFO:tasks.workunit.client.1.smithi195.stdout:6/953: readlink da/d15/l58 0 2024-08-18T22:41:57.569 INFO:tasks.workunit.client.1.smithi195.stdout:4/824: truncate d0/d99/d81/f8d 888933 0 2024-08-18T22:41:57.570 INFO:tasks.workunit.client.1.smithi195.stdout:6/954: stat da/d22/d86/dfa/d124/d2d/d8e/ldf 0 2024-08-18T22:41:57.570 INFO:tasks.workunit.client.1.smithi195.stdout:2/595: dwrite d1/d22/d51/f6e [0,4194304] 0 2024-08-18T22:41:57.574 INFO:tasks.workunit.client.1.smithi195.stdout:0/940: link d0/d107/cd2 d0/dc/d11/d23/de9/c136 0 2024-08-18T22:41:57.576 INFO:tasks.workunit.client.1.smithi195.stdout:6/955: link da/d22/c51 da/d22/c138 0 2024-08-18T22:41:57.577 INFO:tasks.workunit.client.1.smithi195.stdout:6/956: write da/db/f133 [684634,45240] 0 2024-08-18T22:41:57.579 INFO:tasks.workunit.client.1.smithi195.stdout:4/825: rename d0/d7/d1d/d69/db7/d3b/d120/d94/db2/da4/dad/fd0 to d0/d99/d98/f128 0 2024-08-18T22:41:57.584 INFO:tasks.workunit.client.1.smithi195.stdout:4/826: chown d0/d7/c117 0 1 2024-08-18T22:41:57.585 INFO:tasks.workunit.client.1.smithi195.stdout:0/941: rename d0/dc/d64/d81/d44/d41/d6d/d92/d66/de0/lf0 to d0/dc/d64/d81/d44/d41/d6d/d92/d66/d106/l137 0 2024-08-18T22:41:57.585 INFO:tasks.workunit.client.1.smithi195.stdout:4/827: fdatasync d0/d7/d1d/d69/db7/d3b/d120/d94/f11b 0 2024-08-18T22:41:57.586 INFO:tasks.workunit.client.1.smithi195.stdout:4/828: stat d0/d7/d1d/d69/f8f 0 2024-08-18T22:41:57.587 INFO:tasks.workunit.client.1.smithi195.stdout:2/596: truncate d1/d8/d3d/d3b/d46/f66 3089622 0 2024-08-18T22:41:57.589 INFO:tasks.workunit.client.1.smithi195.stdout:4/829: chown d0/d7/d1d/d69/db7/d3b/d120/d94/f116 11762581 1 2024-08-18T22:41:57.591 INFO:tasks.workunit.client.1.smithi195.stdout:0/942: rmdir d0/dc/d64/d81/d44/d41/d6d/d92 39 2024-08-18T22:41:57.597 INFO:tasks.workunit.client.1.smithi195.stdout:6/957: dwrite da/d22/d86/f99 [0,4194304] 0 2024-08-18T22:41:57.601 INFO:tasks.workunit.client.1.smithi195.stdout:5/908: sync 2024-08-18T22:41:57.601 INFO:tasks.workunit.client.1.smithi195.stdout:9/965: sync 2024-08-18T22:41:57.602 INFO:tasks.workunit.client.1.smithi195.stdout:6/958: symlink da/d22/d86/df3/l139 0 2024-08-18T22:41:57.605 INFO:tasks.workunit.client.1.smithi195.stdout:9/966: stat d1c/d70/fc0 0 2024-08-18T22:41:57.606 INFO:tasks.workunit.client.1.smithi195.stdout:4/830: dwrite d0/d7/d1d/d69/db7/d3b/d6f/db0/fe1 [0,4194304] 0 2024-08-18T22:41:57.610 INFO:tasks.workunit.client.1.smithi195.stdout:2/597: dwrite d1/d8/d3d/d6c/d7c/fa6 [0,4194304] 0 2024-08-18T22:41:57.612 INFO:tasks.workunit.client.1.smithi195.stdout:5/909: mknod d0/d3/d8/d3b/dfb/c120 0 2024-08-18T22:41:57.617 INFO:tasks.workunit.client.1.smithi195.stdout:0/943: dwrite d0/dc/d64/d81/d44/fbf [4194304,4194304] 0 2024-08-18T22:41:57.619 INFO:tasks.workunit.client.1.smithi195.stdout:4/831: creat d0/d7/d1d/d69/db7/d3b/d120/d94/db2/da4/f129 x:0 0 0 2024-08-18T22:41:57.619 INFO:tasks.workunit.client.1.smithi195.stdout:2/598: mknod d1/d24/d26/d42/d44/d87/cb1 0 2024-08-18T22:41:57.620 INFO:tasks.workunit.client.1.smithi195.stdout:9/967: write d1c/d32/d71/dbe/d98/df6/d107/fe2 [697058,44856] 0 2024-08-18T22:41:57.623 INFO:tasks.workunit.client.1.smithi195.stdout:6/959: dwrite da/ddc/f8a [0,4194304] 0 2024-08-18T22:41:57.623 INFO:tasks.workunit.client.1.smithi195.stdout:9/968: dread - d1c/d32/f128 zero size 2024-08-18T22:41:57.625 INFO:tasks.workunit.client.1.smithi195.stdout:9/969: chown d1c/d92/d96/d9d/fbf 55 1 2024-08-18T22:41:57.625 INFO:tasks.workunit.client.1.smithi195.stdout:4/832: symlink d0/d7/d1d/d69/db7/d3b/d120/d49/l12a 0 2024-08-18T22:41:57.626 INFO:tasks.workunit.client.1.smithi195.stdout:5/910: mkdir d0/d46/d121 0 2024-08-18T22:41:57.627 INFO:tasks.workunit.client.1.smithi195.stdout:0/944: symlink d0/dc/d64/d81/df3/l138 0 2024-08-18T22:41:57.630 INFO:tasks.workunit.client.1.smithi195.stdout:2/599: truncate d1/d8/f2f 982501 0 2024-08-18T22:41:57.630 INFO:tasks.workunit.client.1.smithi195.stdout:9/970: write d1c/d32/db1/fb3 [2982275,38584] 0 2024-08-18T22:41:57.632 INFO:tasks.workunit.client.1.smithi195.stdout:5/911: rename d0/d3/d8/d64/d87/df0 to d0/dea/dd3/d122 0 2024-08-18T22:41:57.633 INFO:tasks.workunit.client.1.smithi195.stdout:5/912: fsync d0/d2/f107 0 2024-08-18T22:41:57.634 INFO:tasks.workunit.client.1.smithi195.stdout:9/971: chown d1c/d32/d71/dbe/d90/cb0 11 1 2024-08-18T22:41:57.635 INFO:tasks.workunit.client.1.smithi195.stdout:9/972: write d1c/f2c [3269968,76179] 0 2024-08-18T22:41:57.636 INFO:tasks.workunit.client.1.smithi195.stdout:5/913: mknod d0/d2/d53/c123 0 2024-08-18T22:41:57.637 INFO:tasks.workunit.client.1.smithi195.stdout:5/914: readlink d0/d3/df/l8f 0 2024-08-18T22:41:57.637 INFO:tasks.workunit.client.1.smithi195.stdout:9/973: dread - d1c/d32/d71/dc4/f12e zero size 2024-08-18T22:41:57.638 INFO:tasks.workunit.client.1.smithi195.stdout:4/833: getdents d0/d7/d1d/d69/db7/d3b/d120 0 2024-08-18T22:41:57.640 INFO:tasks.workunit.client.1.smithi195.stdout:2/600: getdents d1/d8/d3d/d3b/d46 0 2024-08-18T22:41:57.641 INFO:tasks.workunit.client.1.smithi195.stdout:6/960: dread da/ddc/da7/de0/f137 [0,4194304] 0 2024-08-18T22:41:57.642 INFO:tasks.workunit.client.1.smithi195.stdout:9/974: mknod d1c/c13b 0 2024-08-18T22:41:57.642 INFO:tasks.workunit.client.1.smithi195.stdout:4/834: chown d0/d7/d1d/d69/db7/d3b/d6f/cdf 44255 1 2024-08-18T22:41:57.643 INFO:tasks.workunit.client.1.smithi195.stdout:9/975: read d1c/f64 [872758,105136] 0 2024-08-18T22:41:57.643 INFO:tasks.workunit.client.1.smithi195.stdout:5/915: rename d0/c40 to d0/d3/d8/d64/d87/dc7/c124 0 2024-08-18T22:41:57.644 INFO:tasks.workunit.client.1.smithi195.stdout:2/601: rmdir d1/d8/d3d/d3b/d53 39 2024-08-18T22:41:57.644 INFO:tasks.workunit.client.1.smithi195.stdout:6/961: symlink da/d3b/dee/l13a 0 2024-08-18T22:41:57.645 INFO:tasks.workunit.client.1.smithi195.stdout:9/976: read - d1c/d92/fdb zero size 2024-08-18T22:41:57.650 INFO:tasks.workunit.client.1.smithi195.stdout:9/977: read f13 [478693,80350] 0 2024-08-18T22:41:57.652 INFO:tasks.workunit.client.1.smithi195.stdout:2/602: link d1/d22/d51/fa2 d1/d8/d3d/fb2 0 2024-08-18T22:41:57.652 INFO:tasks.workunit.client.1.smithi195.stdout:9/978: mknod d1c/d92/da1/d11e/c13c 0 2024-08-18T22:41:57.656 INFO:tasks.workunit.client.1.smithi195.stdout:2/603: mknod d1/d24/d26/d42/d72/cb3 0 2024-08-18T22:41:57.657 INFO:tasks.workunit.client.1.smithi195.stdout:6/962: dread da/dd5/fe5 [0,4194304] 0 2024-08-18T22:41:57.662 INFO:tasks.workunit.client.1.smithi195.stdout:2/604: dwrite d1/d8/d27/f3a [0,4194304] 0 2024-08-18T22:41:57.664 INFO:tasks.workunit.client.1.smithi195.stdout:6/963: dwrite da/d3b/dee/f126 [0,4194304] 0 2024-08-18T22:41:57.666 INFO:tasks.workunit.client.1.smithi195.stdout:6/964: write da/d3b/dee/d115/f128 [940726,21627] 0 2024-08-18T22:41:57.674 INFO:tasks.workunit.client.1.smithi195.stdout:6/965: symlink da/d22/d86/d107/l13b 0 2024-08-18T22:41:57.675 INFO:tasks.workunit.client.1.smithi195.stdout:6/966: chown da/d22/d86/dfa/d124/d2d 18573297 1 2024-08-18T22:41:57.677 INFO:tasks.workunit.client.1.smithi195.stdout:6/967: chown da/d15/d1c/d64/d10f/c48 3 1 2024-08-18T22:41:57.679 INFO:tasks.workunit.client.1.smithi195.stdout:2/605: write d1/d24/d26/f36 [8424438,18684] 0 2024-08-18T22:41:57.682 INFO:tasks.workunit.client.1.smithi195.stdout:2/606: mknod d1/d8/d3d/cb4 0 2024-08-18T22:41:57.684 INFO:tasks.workunit.client.1.smithi195.stdout:6/968: dwrite da/d15/d1c/d64/d10f/d74/f81 [0,4194304] 0 2024-08-18T22:41:57.686 INFO:tasks.workunit.client.1.smithi195.stdout:2/607: getdents d1/d8/d3d/d3b/d46 0 2024-08-18T22:41:57.687 INFO:tasks.workunit.client.1.smithi195.stdout:2/608: mknod d1/d8/d3d/d4d/cb5 0 2024-08-18T22:41:57.689 INFO:tasks.workunit.client.1.smithi195.stdout:2/609: mkdir d1/d24/d26/d83/db6 0 2024-08-18T22:41:57.691 INFO:tasks.workunit.client.1.smithi195.stdout:6/969: dwrite da/d15/d1c/d64/d10f/f85 [4194304,4194304] 0 2024-08-18T22:41:57.692 INFO:tasks.workunit.client.1.smithi195.stdout:2/610: creat d1/d8/d27/fb7 x:0 0 0 2024-08-18T22:41:57.694 INFO:tasks.workunit.client.1.smithi195.stdout:6/970: symlink da/d15/d1c/d64/l13c 0 2024-08-18T22:41:57.696 INFO:tasks.workunit.client.1.smithi195.stdout:2/611: creat d1/d24/d26/fb8 x:0 0 0 2024-08-18T22:41:57.700 INFO:tasks.workunit.client.1.smithi195.stdout:6/971: creat da/d15/d1c/d64/d10f/f13d x:0 0 0 2024-08-18T22:41:57.700 INFO:tasks.workunit.client.1.smithi195.stdout:2/612: symlink d1/d8/lb9 0 2024-08-18T22:41:57.702 INFO:tasks.workunit.client.1.smithi195.stdout:2/613: mknod d1/d22/d51/da8/cba 0 2024-08-18T22:41:57.704 INFO:tasks.workunit.client.1.smithi195.stdout:2/614: mknod d1/d24/d26/d83/db6/cbb 0 2024-08-18T22:41:57.705 INFO:tasks.workunit.client.1.smithi195.stdout:2/615: fsync d1/d8/fa5 0 2024-08-18T22:41:57.707 INFO:tasks.workunit.client.1.smithi195.stdout:2/616: symlink d1/d24/d26/d83/db6/lbc 0 2024-08-18T22:41:57.710 INFO:tasks.workunit.client.1.smithi195.stdout:2/617: getdents d1/d24/d26/d42/d72 0 2024-08-18T22:41:57.715 INFO:tasks.workunit.client.1.smithi195.stdout:2/618: write d1/d24/d26/f2c [2967463,14184] 0 2024-08-18T22:41:57.717 INFO:tasks.workunit.client.1.smithi195.stdout:2/619: unlink d1/d24/d26/d42/d72/d85/f91 0 2024-08-18T22:41:57.719 INFO:tasks.workunit.client.1.smithi195.stdout:2/620: symlink d1/d24/d26/d42/d44/d87/lbd 0 2024-08-18T22:41:57.719 INFO:tasks.workunit.client.1.smithi195.stdout:2/621: chown d1/d8/d3d/d3b/d7d 405 1 2024-08-18T22:41:57.720 INFO:tasks.workunit.client.1.smithi195.stdout:2/622: fdatasync d1/d22/f6d 0 2024-08-18T22:41:57.722 INFO:tasks.workunit.client.1.smithi195.stdout:2/623: creat d1/d24/d26/d42/d5c/fbe x:0 0 0 2024-08-18T22:41:57.725 INFO:tasks.workunit.client.1.smithi195.stdout:2/624: link d1/d24/d26/d42/d44/d87/fa0 d1/d24/d26/d83/db6/fbf 0 2024-08-18T22:41:57.734 INFO:tasks.workunit.client.1.smithi195.stdout:2/625: dwrite d1/d8/d3d/d3b/f81 [0,4194304] 0 2024-08-18T22:41:57.735 INFO:tasks.workunit.client.1.smithi195.stdout:2/626: chown d1/d24/d26/f36 523687 1 2024-08-18T22:41:57.735 INFO:tasks.workunit.client.1.smithi195.stdout:2/627: readlink d1/d24/l62 0 2024-08-18T22:41:57.737 INFO:tasks.workunit.client.1.smithi195.stdout:2/628: write d1/d24/d26/d42/d44/f57 [4671921,91790] 0 2024-08-18T22:41:57.738 INFO:tasks.workunit.client.1.smithi195.stdout:2/629: mknod d1/d24/cc0 0 2024-08-18T22:41:57.739 INFO:tasks.workunit.client.1.smithi195.stdout:2/630: fdatasync d1/f10 0 2024-08-18T22:41:57.741 INFO:tasks.workunit.client.1.smithi195.stdout:2/631: rmdir d1/d24/d26/d83/d94 39 2024-08-18T22:41:57.742 INFO:tasks.workunit.client.1.smithi195.stdout:2/632: chown d1/d22/l32 63498832 1 2024-08-18T22:41:57.742 INFO:tasks.workunit.client.1.smithi195.stdout:2/633: readlink d1/d8/d3d/d3b/d46/l93 0 2024-08-18T22:41:57.756 INFO:tasks.workunit.client.1.smithi195.stdout:2/634: dwrite d1/d8/f2f [0,4194304] 0 2024-08-18T22:41:57.757 INFO:tasks.workunit.client.1.smithi195.stdout:2/635: fsync d1/d24/d26/d42/d72/fab 0 2024-08-18T22:41:57.759 INFO:tasks.workunit.client.1.smithi195.stdout:2/636: mkdir d1/d8/dc1 0 2024-08-18T22:41:57.761 INFO:tasks.workunit.client.1.smithi195.stdout:2/637: symlink d1/d24/d26/d83/d94/lc2 0 2024-08-18T22:41:57.764 INFO:tasks.workunit.client.1.smithi195.stdout:2/638: creat d1/d24/d26/d83/db6/fc3 x:0 0 0 2024-08-18T22:41:57.766 INFO:tasks.workunit.client.1.smithi195.stdout:2/639: read d1/d24/d26/d42/d50/f6f [545086,120356] 0 2024-08-18T22:41:57.772 INFO:tasks.workunit.client.1.smithi195.stdout:2/640: write d1/d24/f73 [838422,112349] 0 2024-08-18T22:41:57.775 INFO:tasks.workunit.client.1.smithi195.stdout:2/641: fsync d1/d24/d26/d42/d44/d87/fa0 0 2024-08-18T22:41:57.778 INFO:tasks.workunit.client.1.smithi195.stdout:2/642: creat d1/d8/d3d/d3b/d53/fc4 x:0 0 0 2024-08-18T22:41:57.781 INFO:tasks.workunit.client.1.smithi195.stdout:2/643: write d1/d8/d3d/d3b/d7d/f95 [617321,21435] 0 2024-08-18T22:41:57.787 INFO:tasks.workunit.client.1.smithi195.stdout:2/644: dread d1/d24/d26/f2b [0,4194304] 0 2024-08-18T22:41:57.789 INFO:tasks.workunit.client.1.smithi195.stdout:2/645: dread d1/d24/f73 [0,4194304] 0 2024-08-18T22:41:57.790 INFO:tasks.workunit.client.1.smithi195.stdout:2/646: fsync d1/d24/d26/d42/d72/d85/f68 0 2024-08-18T22:41:57.791 INFO:tasks.workunit.client.1.smithi195.stdout:2/647: fdatasync d1/d24/f73 0 2024-08-18T22:41:57.792 INFO:tasks.workunit.client.1.smithi195.stdout:2/648: readlink d1/d24/d26/d83/db6/lbc 0 2024-08-18T22:41:57.794 INFO:tasks.workunit.client.1.smithi195.stdout:2/649: symlink d1/d24/d26/d42/d72/lc5 0 2024-08-18T22:41:57.797 INFO:tasks.workunit.client.1.smithi195.stdout:2/650: link d1/d24/c28 d1/d8/d27/cc6 0 2024-08-18T22:41:57.798 INFO:tasks.workunit.client.1.smithi195.stdout:2/651: read d1/f1f [1222387,67930] 0 2024-08-18T22:41:57.799 INFO:tasks.workunit.client.1.smithi195.stdout:2/652: read d1/d24/f73 [308076,99322] 0 2024-08-18T22:41:57.803 INFO:tasks.workunit.client.1.smithi195.stdout:2/653: rename d1/d24/d26/d42/d50/f77 to d1/d24/d26/d83/fc7 0 2024-08-18T22:41:57.804 INFO:tasks.workunit.client.1.smithi195.stdout:2/654: symlink d1/d24/lc8 0 2024-08-18T22:41:57.805 INFO:tasks.workunit.client.1.smithi195.stdout:2/655: chown d1/d24/l5d 3 1 2024-08-18T22:41:57.810 INFO:tasks.workunit.client.1.smithi195.stdout:2/656: dwrite d1/d24/d26/fb8 [0,4194304] 0 2024-08-18T22:41:57.812 INFO:tasks.workunit.client.1.smithi195.stdout:2/657: creat d1/d8/d3d/d3b/d53/fc9 x:0 0 0 2024-08-18T22:41:57.814 INFO:tasks.workunit.client.1.smithi195.stdout:2/658: symlink d1/d8/d3d/d3b/d7d/lca 0 2024-08-18T22:41:57.815 INFO:tasks.workunit.client.1.smithi195.stdout:2/659: write d1/d24/d26/d42/d5c/fbe [88537,115240] 0 2024-08-18T22:41:57.817 INFO:tasks.workunit.client.1.smithi195.stdout:2/660: fdatasync d1/d22/d51/fa2 0 2024-08-18T22:41:57.821 INFO:tasks.workunit.client.1.smithi195.stdout:2/661: getdents d1/d97 0 2024-08-18T22:41:57.831 INFO:tasks.workunit.client.1.smithi195.stdout:2/662: dread d1/d22/f30 [0,4194304] 0 2024-08-18T22:41:57.835 INFO:tasks.workunit.client.1.smithi195.stdout:2/663: write d1/d8/d3d/d6c/f98 [620987,69736] 0 2024-08-18T22:41:57.845 INFO:tasks.workunit.client.1.smithi195.stdout:2/664: dread d1/d8/d3d/d3b/d7d/f82 [0,4194304] 0 2024-08-18T22:41:57.851 INFO:tasks.workunit.client.1.smithi195.stdout:2/665: dread d1/d24/d26/d42/d44/f57 [0,4194304] 0 2024-08-18T22:41:57.853 INFO:tasks.workunit.client.1.smithi195.stdout:2/666: unlink d1/d8/d3d/d3b/d53/fc9 0 2024-08-18T22:41:57.856 INFO:tasks.workunit.client.1.smithi195.stdout:2/667: creat d1/d24/d26/d42/d72/fcb x:0 0 0 2024-08-18T22:41:57.857 INFO:tasks.workunit.client.1.smithi195.stdout:2/668: write d1/d8/d3d/d6c/f98 [510901,34264] 0 2024-08-18T22:41:57.860 INFO:tasks.workunit.client.1.smithi195.stdout:2/669: rmdir d1/d24/d47 0 2024-08-18T22:41:57.865 INFO:tasks.workunit.client.1.smithi195.stdout:2/670: dread d1/d8/d3d/d3b/d7d/f95 [0,4194304] 0 2024-08-18T22:41:57.867 INFO:tasks.workunit.client.1.smithi195.stdout:2/671: rename d1/d22/d51/da8/cba to d1/d8/d3d/d3b/ccc 0 2024-08-18T22:41:57.869 INFO:tasks.workunit.client.1.smithi195.stdout:2/672: creat d1/d24/d26/d42/d44/fcd x:0 0 0 2024-08-18T22:41:57.870 INFO:tasks.workunit.client.1.smithi195.stdout:2/673: write d1/d8/d3d/d3b/f81 [782748,95346] 0 2024-08-18T22:41:57.872 INFO:tasks.workunit.client.1.smithi195.stdout:2/674: mkdir d1/d8/d3d/d3b/d7d/dce 0 2024-08-18T22:41:57.873 INFO:tasks.workunit.client.1.smithi195.stdout:2/675: fsync d1/d24/d26/d42/d44/d87/d8e/fac 0 2024-08-18T22:41:57.957 INFO:tasks.workunit.client.1.smithi195.stdout:2/676: dwrite d1/d24/f56 [0,4194304] 0 2024-08-18T22:41:57.960 INFO:tasks.workunit.client.1.smithi195.stdout:2/677: creat d1/d24/d26/d42/d5c/fcf x:0 0 0 2024-08-18T22:41:57.962 INFO:tasks.workunit.client.1.smithi195.stdout:2/678: symlink d1/d8/d3d/d3b/d7d/ld0 0 2024-08-18T22:41:57.964 INFO:tasks.workunit.client.1.smithi195.stdout:2/679: link d1/d97/caa d1/cd1 0 2024-08-18T22:41:57.966 INFO:tasks.workunit.client.1.smithi195.stdout:2/680: mkdir d1/d8/d3d/d3b/d7d/dd2 0 2024-08-18T22:41:57.967 INFO:tasks.workunit.client.1.smithi195.stdout:2/681: write d1/d24/d26/d42/d44/fcd [718204,80405] 0 2024-08-18T22:41:57.969 INFO:tasks.workunit.client.1.smithi195.stdout:2/682: chown d1/d24/d26/d42/d72/lc5 3 1 2024-08-18T22:41:57.976 INFO:tasks.workunit.client.1.smithi195.stdout:2/683: dwrite d1/d24/d26/d42/d72/f86 [0,4194304] 0 2024-08-18T22:41:57.979 INFO:tasks.workunit.client.1.smithi195.stdout:2/684: write d1/d24/d26/d42/d72/d85/f68 [1268544,14419] 0 2024-08-18T22:41:57.981 INFO:tasks.workunit.client.1.smithi195.stdout:2/685: mknod d1/d22/cd3 0 2024-08-18T22:41:57.982 INFO:tasks.workunit.client.1.smithi195.stdout:2/686: mknod d1/d24/d26/d83/d94/cd4 0 2024-08-18T22:41:57.992 INFO:tasks.workunit.client.1.smithi195.stdout:2/687: dread d1/d8/d3d/d3b/d53/f76 [0,4194304] 0 2024-08-18T22:41:57.993 INFO:tasks.workunit.client.1.smithi195.stdout:2/688: chown d1/d8 487422825 1 2024-08-18T22:41:57.993 INFO:tasks.workunit.client.1.smithi195.stdout:2/689: readlink d1/d24/lc8 0 2024-08-18T22:41:57.995 INFO:tasks.workunit.client.1.smithi195.stdout:2/690: truncate d1/d8/d3d/d3b/d7d/f82 4064650 0 2024-08-18T22:41:57.996 INFO:tasks.workunit.client.1.smithi195.stdout:2/691: write d1/d8/d27/f88 [838220,4545] 0 2024-08-18T22:41:57.997 INFO:tasks.workunit.client.1.smithi195.stdout:2/692: rmdir d1/d24/d26/d42 39 2024-08-18T22:41:58.125 INFO:tasks.workunit.client.1.smithi195.stdout:0/945: sync 2024-08-18T22:41:58.125 INFO:tasks.workunit.client.1.smithi195.stdout:4/835: sync 2024-08-18T22:41:58.126 INFO:tasks.workunit.client.1.smithi195.stdout:4/836: dread - d0/d7/d1d/d69/db7/d41/dbf/fec zero size 2024-08-18T22:41:58.127 INFO:tasks.workunit.client.1.smithi195.stdout:0/946: read d0/dc/dd/d46/f7e [59500,61192] 0 2024-08-18T22:41:58.127 INFO:tasks.workunit.client.1.smithi195.stdout:4/837: write d0/d7/d1d/f47 [4349058,72489] 0 2024-08-18T22:41:58.128 INFO:tasks.workunit.client.1.smithi195.stdout:0/947: chown d0/dc/d11/d23/d51/f52 0 1 2024-08-18T22:41:58.130 INFO:tasks.workunit.client.1.smithi195.stdout:4/838: mkdir d0/d7/d1d/d69/db7/d3b/d6f/db0/d12b 0 2024-08-18T22:41:58.131 INFO:tasks.workunit.client.1.smithi195.stdout:0/948: rename d0/dc/le1 to d0/dc/d64/d81/df3/l139 0 2024-08-18T22:41:58.132 INFO:tasks.workunit.client.1.smithi195.stdout:4/839: rmdir d0/d99 39 2024-08-18T22:41:58.134 INFO:tasks.workunit.client.1.smithi195.stdout:0/949: mknod d0/dc/d11/d23/d127/c13a 0 2024-08-18T22:41:58.143 INFO:tasks.workunit.client.1.smithi195.stdout:0/950: rename d0/d107/d11b/f129 to d0/dc/d64/d81/d44/d41/f13b 0 2024-08-18T22:41:58.145 INFO:tasks.workunit.client.1.smithi195.stdout:4/840: dwrite d0/d7/d1d/d69/db7/d3b/d120/d94/db2/fa8 [0,4194304] 0 2024-08-18T22:41:58.151 INFO:tasks.workunit.client.1.smithi195.stdout:4/841: write d0/d7/d1d/d69/db7/d3b/f4b [4780889,81871] 0 2024-08-18T22:41:58.153 INFO:tasks.workunit.client.1.smithi195.stdout:0/951: dread d0/dc/d64/d81/d44/d41/d6d/d92/d66/f86 [0,4194304] 0 2024-08-18T22:41:58.155 INFO:tasks.workunit.client.1.smithi195.stdout:0/952: write d0/dc/d11/d23/f9b [1408327,110683] 0 2024-08-18T22:41:58.160 INFO:tasks.workunit.client.1.smithi195.stdout:4/842: dwrite d0/d99/d85/f4e [4194304,4194304] 0 2024-08-18T22:41:58.165 INFO:tasks.workunit.client.1.smithi195.stdout:4/843: link d0/d7/d1d/d69/db7/d3b/d120/d94/db2/f87 d0/d99/d85/d48/d4c/f12c 0 2024-08-18T22:41:58.171 INFO:tasks.workunit.client.1.smithi195.stdout:0/953: dwrite d0/dc/d64/d81/d44/d41/d6d/fbd [0,4194304] 0 2024-08-18T22:41:58.173 INFO:tasks.workunit.client.1.smithi195.stdout:4/844: write d0/d7/d1d/d69/db7/d3b/d120/dae/fe6 [37906,19981] 0 2024-08-18T22:41:58.175 INFO:tasks.workunit.client.1.smithi195.stdout:4/845: chown d0/d99/d85/d48/feb 512666254 1 2024-08-18T22:41:58.177 INFO:tasks.workunit.client.1.smithi195.stdout:5/916: sync 2024-08-18T22:41:58.177 INFO:tasks.workunit.client.1.smithi195.stdout:6/972: sync 2024-08-18T22:41:58.177 INFO:tasks.workunit.client.1.smithi195.stdout:2/693: sync 2024-08-18T22:41:58.177 INFO:tasks.workunit.client.1.smithi195.stdout:9/979: sync 2024-08-18T22:41:58.178 INFO:tasks.workunit.client.1.smithi195.stdout:4/846: mkdir d0/d99/d85/dc8/d12d 0 2024-08-18T22:41:58.179 INFO:tasks.workunit.client.1.smithi195.stdout:2/694: creat d1/d97/fd5 x:0 0 0 2024-08-18T22:41:58.184 INFO:tasks.workunit.client.1.smithi195.stdout:9/980: rename d1c/d32/d71/dbe/fef to d1c/d92/da1/d11e/f13d 0 2024-08-18T22:41:58.185 INFO:tasks.workunit.client.1.smithi195.stdout:6/973: link da/dd5/le6 da/d22/d87/l13e 0 2024-08-18T22:41:58.186 INFO:tasks.workunit.client.1.smithi195.stdout:6/974: write da/d3b/f6d [1406946,48765] 0 2024-08-18T22:41:58.188 INFO:tasks.workunit.client.1.smithi195.stdout:2/695: chown d1/d24/d26/d42/d72/d85/c64 316672615 1 2024-08-18T22:41:58.189 INFO:tasks.workunit.client.1.smithi195.stdout:6/975: write da/d22/d86/dfa/f109 [127128,31470] 0 2024-08-18T22:41:58.190 INFO:tasks.workunit.client.1.smithi195.stdout:4/847: creat d0/d7/d1d/d69/db7/d3b/d120/d94/f12e x:0 0 0 2024-08-18T22:41:58.192 INFO:tasks.workunit.client.1.smithi195.stdout:6/976: read - da/d3b/dee/d110/f11e zero size 2024-08-18T22:41:58.192 INFO:tasks.workunit.client.1.smithi195.stdout:2/696: mkdir d1/d24/d26/d42/d44/d87/dd6 0 2024-08-18T22:41:58.192 INFO:tasks.workunit.client.1.smithi195.stdout:0/954: dread d0/dc/dd/f63 [0,4194304] 0 2024-08-18T22:41:58.195 INFO:tasks.workunit.client.1.smithi195.stdout:9/981: rename d1c/d92/fde to d1c/d32/d71/dbe/f13e 0 2024-08-18T22:41:58.196 INFO:tasks.workunit.client.1.smithi195.stdout:5/917: dread d0/d3/d8/d3b/db1/f115 [0,4194304] 0 2024-08-18T22:41:58.198 INFO:tasks.workunit.client.1.smithi195.stdout:9/982: readlink d1c/d32/d71/dbe/d98/l117 0 2024-08-18T22:41:58.200 INFO:tasks.workunit.client.1.smithi195.stdout:0/955: mkdir d0/dc/d64/d81/d44/d41/d6d/d92/d66/de0/d13c 0 2024-08-18T22:41:58.201 INFO:tasks.workunit.client.1.smithi195.stdout:6/977: dwrite da/f13 [0,4194304] 0 2024-08-18T22:41:58.201 INFO:tasks.workunit.client.1.smithi195.stdout:5/918: creat d0/d37/dba/d10d/f125 x:0 0 0 2024-08-18T22:41:58.202 INFO:tasks.workunit.client.1.smithi195.stdout:4/848: link d0/d7/d1d/d69/db7/d3b/fcf d0/d7/d1d/d69/db7/d3b/d120/dae/f12f 0 2024-08-18T22:41:58.204 INFO:tasks.workunit.client.1.smithi195.stdout:9/983: symlink d1c/d92/d96/ddd/l13f 0 2024-08-18T22:41:58.204 INFO:tasks.workunit.client.1.smithi195.stdout:9/984: chown d1c/f26 3 1 2024-08-18T22:41:58.207 INFO:tasks.workunit.client.1.smithi195.stdout:4/849: chown d0/d7/l68 18819232 1 2024-08-18T22:41:58.208 INFO:tasks.workunit.client.1.smithi195.stdout:9/985: dread - d1c/d32/f128 zero size 2024-08-18T22:41:58.209 INFO:tasks.workunit.client.1.smithi195.stdout:6/978: rename da/ddc/da7 to da/d3b/dee/d115/d13f 0 2024-08-18T22:41:58.209 INFO:tasks.workunit.client.1.smithi195.stdout:5/919: dwrite d0/dea/fed [0,4194304] 0 2024-08-18T22:41:58.209 INFO:tasks.workunit.client.1.smithi195.stdout:2/697: truncate d1/d8/d27/f88 390082 0 2024-08-18T22:41:58.210 INFO:tasks.workunit.client.1.smithi195.stdout:9/986: chown d1c/fa8 4371 1 2024-08-18T22:41:58.211 INFO:tasks.workunit.client.1.smithi195.stdout:4/850: rmdir d0/d99/d98 39 2024-08-18T22:41:58.212 INFO:tasks.workunit.client.1.smithi195.stdout:6/979: mknod da/db/d19/d10d/c140 0 2024-08-18T22:41:58.214 INFO:tasks.workunit.client.1.smithi195.stdout:9/987: creat d1c/d92/da1/f140 x:0 0 0 2024-08-18T22:41:58.214 INFO:tasks.workunit.client.1.smithi195.stdout:6/980: fsync da/d22/d86/f7e 0 2024-08-18T22:41:58.214 INFO:tasks.workunit.client.1.smithi195.stdout:0/956: getdents d0/dc/d64/d81/d44/d41/d6d/d92/d66/d8d/dbe/ddd 0 2024-08-18T22:41:58.221 INFO:tasks.workunit.client.1.smithi195.stdout:9/988: mkdir d1c/d32/de9/d141 0 2024-08-18T22:41:58.223 INFO:tasks.workunit.client.1.smithi195.stdout:5/920: creat d0/d3/d66/f126 x:0 0 0 2024-08-18T22:41:58.226 INFO:tasks.workunit.client.1.smithi195.stdout:0/957: dwrite d0/dc/d64/d81/d44/fbb [0,4194304] 0 2024-08-18T22:41:58.230 INFO:tasks.workunit.client.1.smithi195.stdout:6/981: dwrite da/d22/d86/dfa/d124/d2d/f93 [0,4194304] 0 2024-08-18T22:41:58.231 INFO:tasks.workunit.client.1.smithi195.stdout:4/851: write d0/d7/d1d/d69/db7/d3b/d120/f61 [750582,34457] 0 2024-08-18T22:41:58.232 INFO:tasks.workunit.client.1.smithi195.stdout:0/958: write d0/dc/d25/f54 [353626,61918] 0 2024-08-18T22:41:58.233 INFO:tasks.workunit.client.1.smithi195.stdout:9/989: dread d1c/d92/d96/d9d/db9/fbd [0,4194304] 0 2024-08-18T22:41:58.238 INFO:tasks.workunit.client.1.smithi195.stdout:6/982: write da/d15/d1c/d64/d10f/f13d [551906,69864] 0 2024-08-18T22:41:58.241 INFO:tasks.workunit.client.1.smithi195.stdout:9/990: creat d1c/d92/d9a/d12d/d136/f142 x:0 0 0 2024-08-18T22:41:58.241 INFO:tasks.workunit.client.1.smithi195.stdout:0/959: truncate d0/dc/d64/d81/fd8 592060 0 2024-08-18T22:41:58.241 INFO:tasks.workunit.client.1.smithi195.stdout:2/698: dwrite d1/d8/d3d/fb2 [0,4194304] 0 2024-08-18T22:41:58.243 INFO:tasks.workunit.client.1.smithi195.stdout:9/991: write d1c/d92/da1/fed [306918,103828] 0 2024-08-18T22:41:58.243 INFO:tasks.workunit.client.1.smithi195.stdout:6/983: chown da/d15/d1c/c83 192 1 2024-08-18T22:41:58.244 INFO:tasks.workunit.client.1.smithi195.stdout:4/852: mknod d0/d7/d1d/d69/db7/d41/d66/dfa/c130 0 2024-08-18T22:41:58.246 INFO:tasks.workunit.client.1.smithi195.stdout:5/921: getdents d0/d46/d6d/da2 0 2024-08-18T22:41:58.247 INFO:tasks.workunit.client.1.smithi195.stdout:2/699: creat d1/d22/d51/da8/fd7 x:0 0 0 2024-08-18T22:41:58.249 INFO:tasks.workunit.client.1.smithi195.stdout:0/960: rename d0/dc/d25/lfe to d0/dc/d11/d23/d127/l13d 0 2024-08-18T22:41:58.252 INFO:tasks.workunit.client.1.smithi195.stdout:0/961: chown d0/dc/d64/d81/d44/d41/d6d/d97/dfa 69700 1 2024-08-18T22:41:58.253 INFO:tasks.workunit.client.1.smithi195.stdout:6/984: rename da/d3b/f6d to da/ddc/dd7/f141 0 2024-08-18T22:41:58.254 INFO:tasks.workunit.client.1.smithi195.stdout:5/922: dwrite d0/ddb/ff1 [0,4194304] 0 2024-08-18T22:41:58.257 INFO:tasks.workunit.client.1.smithi195.stdout:6/985: write da/d22/ffd [1337001,66037] 0 2024-08-18T22:41:58.260 INFO:tasks.workunit.client.1.smithi195.stdout:2/700: read d1/d22/f31 [1116424,121322] 0 2024-08-18T22:41:58.262 INFO:tasks.workunit.client.1.smithi195.stdout:2/701: fdatasync d1/d24/d26/d42/d44/d87/fa0 0 2024-08-18T22:41:58.267 INFO:tasks.workunit.client.1.smithi195.stdout:6/986: dwrite da/d22/d86/df3/fc9 [0,4194304] 0 2024-08-18T22:41:58.274 INFO:tasks.workunit.client.1.smithi195.stdout:6/987: link da/db/d19/f45 da/d15/d1c/d64/f142 0 2024-08-18T22:41:58.276 INFO:tasks.workunit.client.1.smithi195.stdout:6/988: mknod da/d3b/dee/d115/c143 0 2024-08-18T22:41:58.283 INFO:tasks.workunit.client.1.smithi195.stdout:9/992: dwrite d1c/d32/d71/fb8 [0,4194304] 0 2024-08-18T22:41:58.284 INFO:tasks.workunit.client.1.smithi195.stdout:0/962: dwrite d0/dc/f84 [0,4194304] 0 2024-08-18T22:41:58.286 INFO:tasks.workunit.client.1.smithi195.stdout:9/993: readlink d1c/d32/d71/dbe/le8 0 2024-08-18T22:41:58.288 INFO:tasks.workunit.client.1.smithi195.stdout:2/702: dwrite d1/d24/d26/d83/db6/fbf [0,4194304] 0 2024-08-18T22:41:58.290 INFO:tasks.workunit.client.1.smithi195.stdout:6/989: write da/d3b/f123 [8227866,128630] 0 2024-08-18T22:41:58.292 INFO:tasks.workunit.client.1.smithi195.stdout:6/990: chown da/d3b/dee/f126 600 1 2024-08-18T22:41:58.293 INFO:tasks.workunit.client.1.smithi195.stdout:0/963: chown d0/dc/d64/d81/d44/d41/d6d/d92/d66/f8b 33554251 1 2024-08-18T22:41:58.298 INFO:tasks.workunit.client.1.smithi195.stdout:0/964: mkdir d0/dc/d64/d81/d44/d43/d13e 0 2024-08-18T22:41:58.299 INFO:tasks.workunit.client.1.smithi195.stdout:2/703: creat d1/d8/d3d/d3b/fd8 x:0 0 0 2024-08-18T22:41:58.304 INFO:tasks.workunit.client.1.smithi195.stdout:2/704: mkdir d1/d24/d26/dd9 0 2024-08-18T22:41:58.304 INFO:tasks.workunit.client.1.smithi195.stdout:6/991: dwrite da/d15/f2c [4194304,4194304] 0 2024-08-18T22:41:58.305 INFO:tasks.workunit.client.1.smithi195.stdout:0/965: symlink d0/dc/d64/d81/d44/d41/d6d/d97/l13f 0 2024-08-18T22:41:58.306 INFO:tasks.workunit.client.1.smithi195.stdout:2/705: write d1/d97/f9f [992961,45758] 0 2024-08-18T22:41:58.307 INFO:tasks.workunit.client.1.smithi195.stdout:6/992: stat da/d3b/dee/d115/d13f/de0 0 2024-08-18T22:41:58.309 INFO:tasks.workunit.client.1.smithi195.stdout:0/966: stat d0/dc/d64/d81/d44/d41/d4c/dd9/l12c 0 2024-08-18T22:41:58.311 INFO:tasks.workunit.client.1.smithi195.stdout:9/994: dread d1c/f2c [0,4194304] 0 2024-08-18T22:41:58.314 INFO:tasks.workunit.client.1.smithi195.stdout:6/993: creat da/d22/d86/dfa/d124/f144 x:0 0 0 2024-08-18T22:41:58.318 INFO:tasks.workunit.client.1.smithi195.stdout:0/967: dwrite d0/dc/d64/d81/d44/d41/d6d/d92/d66/d8d/fa6 [4194304,4194304] 0 2024-08-18T22:41:58.319 INFO:tasks.workunit.client.1.smithi195.stdout:6/994: rmdir da/d15/d1c 39 2024-08-18T22:41:58.322 INFO:tasks.workunit.client.1.smithi195.stdout:2/706: link d1/d8/d3d/d3b/d46/l8d d1/d8/d3d/lda 0 2024-08-18T22:41:58.323 INFO:tasks.workunit.client.1.smithi195.stdout:0/968: symlink d0/dc/d64/d81/d44/d41/d6d/d97/db5/d116/l140 0 2024-08-18T22:41:58.325 INFO:tasks.workunit.client.1.smithi195.stdout:6/995: mkdir da/d22/d86/dfa/d124/d145 0 2024-08-18T22:41:58.326 INFO:tasks.workunit.client.1.smithi195.stdout:0/969: fdatasync d0/dc/d64/d81/d44/d41/d6d/d97/db5/f114 0 2024-08-18T22:41:58.327 INFO:tasks.workunit.client.1.smithi195.stdout:2/707: symlink d1/d8/dc1/ldb 0 2024-08-18T22:41:58.329 INFO:tasks.workunit.client.1.smithi195.stdout:9/995: dwrite d1c/d70/fc0 [0,4194304] 0 2024-08-18T22:41:58.331 INFO:tasks.workunit.client.1.smithi195.stdout:2/708: mkdir d1/d97/ddc 0 2024-08-18T22:41:58.331 INFO:tasks.workunit.client.1.smithi195.stdout:0/970: mknod d0/dc/d11/d6f/d9d/c141 0 2024-08-18T22:41:58.332 INFO:tasks.workunit.client.1.smithi195.stdout:0/971: stat d0/dc/d11/d23/c26 0 2024-08-18T22:41:58.335 INFO:tasks.workunit.client.1.smithi195.stdout:6/996: write da/db/f3c [3920869,127147] 0 2024-08-18T22:41:58.335 INFO:tasks.workunit.client.1.smithi195.stdout:0/972: readlink d0/dc/d64/d81/dc5/la2 0 2024-08-18T22:41:58.337 INFO:tasks.workunit.client.1.smithi195.stdout:2/709: dread d1/d8/d3d/fc [4194304,4194304] 0 2024-08-18T22:41:58.340 INFO:tasks.workunit.client.1.smithi195.stdout:0/973: link d0/dc/d11/d6f/d9d/c112 d0/d107/d11b/c142 0 2024-08-18T22:41:58.342 INFO:tasks.workunit.client.1.smithi195.stdout:2/710: rename d1/d8/c67 to d1/d24/d26/cdd 0 2024-08-18T22:41:58.344 INFO:tasks.workunit.client.1.smithi195.stdout:2/711: write d1/d22/d51/f6e [1958120,127507] 0 2024-08-18T22:41:58.346 INFO:tasks.workunit.client.1.smithi195.stdout:0/974: link d0/dc/d64/d81/d44/d41/d6d/d92/d66/d8d/cf6 d0/dc/d64/d81/d44/d41/c143 0 2024-08-18T22:41:58.352 INFO:tasks.workunit.client.1.smithi195.stdout:2/712: write d1/f59 [1802645,23747] 0 2024-08-18T22:41:58.357 INFO:tasks.workunit.client.1.smithi195.stdout:2/713: dwrite d1/d97/f9f [0,4194304] 0 2024-08-18T22:41:58.359 INFO:tasks.workunit.client.1.smithi195.stdout:2/714: chown d1/d24/d26/d42/d5c/fcf 4822399 1 2024-08-18T22:41:58.359 INFO:tasks.workunit.client.1.smithi195.stdout:6/997: dread da/d3b/f123 [0,4194304] 0 2024-08-18T22:41:58.360 INFO:tasks.workunit.client.1.smithi195.stdout:2/715: fdatasync d1/d8/d3d/f99 0 2024-08-18T22:41:58.362 INFO:tasks.workunit.client.1.smithi195.stdout:2/716: chown d1/d24/d26/d42/d50/f6f 40 1 2024-08-18T22:41:58.364 INFO:tasks.workunit.client.1.smithi195.stdout:0/975: dread d0/d107/f88 [0,4194304] 0 2024-08-18T22:41:58.364 INFO:tasks.workunit.client.1.smithi195.stdout:2/717: truncate d1/d24/f34 4850600 0 2024-08-18T22:41:58.365 INFO:tasks.workunit.client.1.smithi195.stdout:6/998: creat da/db/d19/f146 x:0 0 0 2024-08-18T22:41:58.491 INFO:tasks.workunit.client.1.smithi195.stdout:2/718: symlink d1/d24/d26/d42/d44/d87/lde 0 2024-08-18T22:41:58.495 INFO:tasks.workunit.client.1.smithi195.stdout:0/976: dread d0/dc/d64/d81/d44/d41/d6d/d92/d66/d8d/f119 [4194304,4194304] 0 2024-08-18T22:41:58.500 INFO:tasks.workunit.client.1.smithi195.stdout:0/977: dwrite d0/dc/dd/d46/f113 [0,4194304] 0 2024-08-18T22:41:58.522 INFO:tasks.workunit.client.1.smithi195.stdout:0/978: mknod d0/dc/d11/d23/c144 0 2024-08-18T22:41:58.522 INFO:tasks.workunit.client.1.smithi195.stdout:6/999: dread da/d15/d1c/d64/d10f/f13d [0,4194304] 0 2024-08-18T22:41:58.527 INFO:tasks.workunit.client.1.smithi195.stdout:0/979: creat d0/dc/d64/d81/d44/d41/f145 x:0 0 0 2024-08-18T22:41:58.527 INFO:tasks.workunit.client.1.smithi195.stdout:0/980: chown d0/dc/d64/d81/d44/d41/d6d/d97/dfa/f124 340 1 2024-08-18T22:41:58.529 INFO:tasks.workunit.client.1.smithi195.stdout:0/981: read d0/d107/db8/fe4 [605143,89605] 0 2024-08-18T22:41:58.531 INFO:tasks.workunit.client.1.smithi195.stdout:0/982: mknod d0/dc/d64/d81/d44/d41/d6d/d92/d66/d8d/dbe/c146 0 2024-08-18T22:41:58.533 INFO:tasks.workunit.client.1.smithi195.stdout:0/983: mknod d0/dc/d64/d81/d44/d41/d6d/d92/c147 0 2024-08-18T22:41:58.533 INFO:tasks.workunit.client.1.smithi195.stdout:0/984: chown d0/dc/d11/d23/de9 87475 1 2024-08-18T22:41:58.535 INFO:tasks.workunit.client.1.smithi195.stdout:0/985: write d0/dc/d64/d81/d44/d41/d6d/d92/d66/d8d/dbe/fff [466922,66172] 0 2024-08-18T22:41:58.541 INFO:tasks.workunit.client.1.smithi195.stdout:0/986: dwrite d0/dc/d64/f12b [0,4194304] 0 2024-08-18T22:41:58.544 INFO:tasks.workunit.client.1.smithi195.stdout:0/987: mkdir d0/dc/d11/d6f/d9d/d148 0 2024-08-18T22:41:58.549 INFO:tasks.workunit.client.1.smithi195.stdout:2/719: dwrite d1/d8/d3d/f99 [0,4194304] 0 2024-08-18T22:41:58.550 INFO:tasks.workunit.client.1.smithi195.stdout:0/988: truncate d0/dc/dd/f3c 3654916 0 2024-08-18T22:41:58.551 INFO:tasks.workunit.client.1.smithi195.stdout:2/720: read d1/f1f [4331711,33573] 0 2024-08-18T22:41:58.554 INFO:tasks.workunit.client.1.smithi195.stdout:2/721: chown d1/d24/d26/d42/d44/d87/d8e/fac 3263 1 2024-08-18T22:41:58.555 INFO:tasks.workunit.client.1.smithi195.stdout:2/722: chown d1/d24/c4e 7276 1 2024-08-18T22:41:58.556 INFO:tasks.workunit.client.1.smithi195.stdout:2/723: stat d1/d24/f60 0 2024-08-18T22:41:58.560 INFO:tasks.workunit.client.1.smithi195.stdout:0/989: write d0/d107/db8/fe4 [2216834,99340] 0 2024-08-18T22:41:58.562 INFO:tasks.workunit.client.1.smithi195.stdout:2/724: dwrite d1/d8/fa5 [0,4194304] 0 2024-08-18T22:41:58.562 INFO:tasks.workunit.client.1.smithi195.stdout:0/990: chown d0/dc/d64/d81/d44/d41/d6d/d92/d66/de0 1529988 1 2024-08-18T22:41:58.563 INFO:tasks.workunit.client.1.smithi195.stdout:0/991: dread - d0/dc/d64/d81/d44/d41/f132 zero size 2024-08-18T22:41:58.564 INFO:tasks.workunit.client.1.smithi195.stdout:0/992: readlink d0/d107/db8/ld4 0 2024-08-18T22:41:58.565 INFO:tasks.workunit.client.1.smithi195.stdout:2/725: mknod d1/d24/d26/d42/d72/cdf 0 2024-08-18T22:41:58.570 INFO:tasks.workunit.client.1.smithi195.stdout:2/726: dread d1/d24/d26/d42/d50/f52 [0,4194304] 0 2024-08-18T22:41:58.570 INFO:tasks.workunit.client.1.smithi195.stdout:5/923: sync 2024-08-18T22:41:58.570 INFO:tasks.workunit.client.1.smithi195.stdout:4/853: sync 2024-08-18T22:41:58.573 INFO:tasks.workunit.client.1.smithi195.stdout:4/854: creat d0/d7/d1d/d69/db7/d3b/f131 x:0 0 0 2024-08-18T22:41:58.575 INFO:tasks.workunit.client.1.smithi195.stdout:5/924: write d0/d46/f11e [6726530,86903] 0 2024-08-18T22:41:58.576 INFO:tasks.workunit.client.1.smithi195.stdout:2/727: rename d1/cd1 to d1/d24/d26/d42/d44/d87/ce0 0 2024-08-18T22:41:58.578 INFO:tasks.workunit.client.1.smithi195.stdout:2/728: write d1/d8/f2f [3201485,41108] 0 2024-08-18T22:41:58.579 INFO:tasks.workunit.client.1.smithi195.stdout:5/925: fdatasync d0/d3/d8/f14 0 2024-08-18T22:41:58.581 INFO:tasks.workunit.client.1.smithi195.stdout:0/993: dwrite d0/dc/dd/d46/ff8 [4194304,4194304] 0 2024-08-18T22:41:58.582 INFO:tasks.workunit.client.1.smithi195.stdout:5/926: fsync d0/d37/dba/d10d/f125 0 2024-08-18T22:41:58.584 INFO:tasks.workunit.client.1.smithi195.stdout:5/927: stat d0/d2/d29/c2c 0 2024-08-18T22:41:58.584 INFO:tasks.workunit.client.1.smithi195.stdout:2/729: read d1/d24/d26/d42/d44/fcd [322506,30889] 0 2024-08-18T22:41:58.587 INFO:tasks.workunit.client.1.smithi195.stdout:5/928: dread - d0/d37/dba/d10d/f117 zero size 2024-08-18T22:41:58.590 INFO:tasks.workunit.client.1.smithi195.stdout:4/855: dwrite d0/d99/d85/d48/d4c/f12c [0,4194304] 0 2024-08-18T22:41:58.591 INFO:tasks.workunit.client.1.smithi195.stdout:2/730: rename d1/d22/d51/fa2 to d1/d24/d26/d42/d5c/fe1 0 2024-08-18T22:41:58.594 INFO:tasks.workunit.client.1.smithi195.stdout:2/731: write d1/d24/d26/d83/db6/fc3 [876525,97911] 0 2024-08-18T22:41:58.598 INFO:tasks.workunit.client.1.smithi195.stdout:5/929: getdents d0/d2/d29/d88/d6a/d96 0 2024-08-18T22:41:58.599 INFO:tasks.workunit.client.1.smithi195.stdout:0/994: write d0/dc/d64/d81/d44/d41/f13b [1964715,94510] 0 2024-08-18T22:41:58.601 INFO:tasks.workunit.client.1.smithi195.stdout:0/995: fsync d0/dc/d25/f54 0 2024-08-18T22:41:58.602 INFO:tasks.workunit.client.1.smithi195.stdout:5/930: creat d0/d2/d29/d88/f127 x:0 0 0 2024-08-18T22:41:58.602 INFO:tasks.workunit.client.1.smithi195.stdout:4/856: dwrite d0/d7/d1d/d69/db7/d3b/d120/dae/f103 [4194304,4194304] 0 2024-08-18T22:41:58.604 INFO:tasks.workunit.client.1.smithi195.stdout:0/996: rmdir d0/d107/db8 39 2024-08-18T22:41:58.606 INFO:tasks.workunit.client.1.smithi195.stdout:5/931: dread - d0/d2/d29/d88/d90/f10b zero size 2024-08-18T22:41:58.609 INFO:tasks.workunit.client.1.smithi195.stdout:4/857: chown d0/d7/d1d/d69/db7/d3b/fcf 158 1 2024-08-18T22:41:58.609 INFO:tasks.workunit.client.1.smithi195.stdout:2/732: dwrite d1/d24/d26/d83/db6/fbf [0,4194304] 0 2024-08-18T22:41:58.610 INFO:tasks.workunit.client.1.smithi195.stdout:5/932: unlink d0/d37/d8b/ce1 0 2024-08-18T22:41:58.611 INFO:tasks.workunit.client.1.smithi195.stdout:5/933: dread - d0/d3/df/faf zero size 2024-08-18T22:41:58.613 INFO:tasks.workunit.client.1.smithi195.stdout:4/858: rmdir d0/d7/d1d/d69/db7/d3b/d120/d94/db2/da4 39 2024-08-18T22:41:58.613 INFO:tasks.workunit.client.1.smithi195.stdout:2/733: rmdir d1/d8 39 2024-08-18T22:41:58.617 INFO:tasks.workunit.client.1.smithi195.stdout:5/934: fdatasync d0/d2/d29/f67 0 2024-08-18T22:41:58.620 INFO:tasks.workunit.client.1.smithi195.stdout:5/935: truncate d0/d46/d6d/da2/fef 127371 0 2024-08-18T22:41:58.630 INFO:tasks.workunit.client.1.smithi195.stdout:0/997: dwrite d0/dc/d64/d81/f89 [4194304,4194304] 0 2024-08-18T22:41:58.631 INFO:tasks.workunit.client.1.smithi195.stdout:4/859: dwrite d0/d7/d1d/d69/db7/d3b/d120/f38 [0,4194304] 0 2024-08-18T22:41:58.634 INFO:tasks.workunit.client.1.smithi195.stdout:5/936: dread d0/d3/d5f/f6b [4194304,4194304] 0 2024-08-18T22:41:58.634 INFO:tasks.workunit.client.1.smithi195.stdout:2/734: dread d1/d8/f25 [4194304,4194304] 0 2024-08-18T22:41:58.634 INFO:tasks.workunit.client.1.smithi195.stdout:9/996: sync 2024-08-18T22:41:58.634 INFO:tasks.workunit.client.1.smithi195.stdout:0/998: chown d0/dc/l19 599794 1 2024-08-18T22:41:58.637 INFO:tasks.workunit.client.1.smithi195.stdout:9/997: chown d1c/d32/d71/c8d 697574 1 2024-08-18T22:41:58.641 INFO:tasks.workunit.client.1.smithi195.stdout:0/999: symlink d0/dc/d64/d81/d44/d41/d6d/da5/l149 0 2024-08-18T22:41:58.643 INFO:tasks.workunit.client.1.smithi195.stdout:2/735: dwrite d1/d8/d27/fb7 [0,4194304] 0 2024-08-18T22:41:58.645 INFO:tasks.workunit.client.1.smithi195.stdout:4/860: link d0/d7/d1d/d69/db7/d3b/d120/f10b d0/d7/d1d/d69/db7/d41/dbf/f132 0 2024-08-18T22:41:58.647 INFO:tasks.workunit.client.1.smithi195.stdout:9/998: link d1c/l2f d1c/d92/d9a/d12d/d136/l143 0 2024-08-18T22:41:58.650 INFO:tasks.workunit.client.1.smithi195.stdout:4/861: mknod d0/d7/d1d/d69/db7/d41/dbf/c133 0 2024-08-18T22:41:58.651 INFO:tasks.workunit.client.1.smithi195.stdout:9/999: fdatasync d1c/d32/d37/d4b/d115/d137/ff8 0 2024-08-18T22:41:58.663 INFO:tasks.workunit.client.1.smithi195.stdout:2/736: dwrite d1/d8/d3d/d3b/d53/f76 [0,4194304] 0 2024-08-18T22:41:58.666 INFO:tasks.workunit.client.1.smithi195.stdout:2/737: mkdir d1/d97/de2 0 2024-08-18T22:41:58.667 INFO:tasks.workunit.client.1.smithi195.stdout:4/862: dwrite d0/d7/d1d/d69/db7/d41/dbf/fde [0,4194304] 0 2024-08-18T22:41:58.673 INFO:tasks.workunit.client.1.smithi195.stdout:2/738: mkdir d1/d24/d26/d42/d72/d85/de3 0 2024-08-18T22:41:58.674 INFO:tasks.workunit.client.1.smithi195.stdout:4/863: dwrite d0/d99/d85/f4e [0,4194304] 0 2024-08-18T22:41:58.686 INFO:tasks.workunit.client.1.smithi195.stdout:2/739: write d1/d8/d27/f88 [872275,122452] 0 2024-08-18T22:41:58.688 INFO:tasks.workunit.client.1.smithi195.stdout:2/740: write d1/d8/d27/f88 [120043,72293] 0 2024-08-18T22:41:58.692 INFO:tasks.workunit.client.1.smithi195.stdout:4/864: dwrite d0/d99/d98/fc0 [0,4194304] 0 2024-08-18T22:41:58.693 INFO:tasks.workunit.client.1.smithi195.stdout:2/741: creat d1/d8/fe4 x:0 0 0 2024-08-18T22:41:58.698 INFO:tasks.workunit.client.1.smithi195.stdout:2/742: creat d1/d24/d26/d42/d72/d85/de3/fe5 x:0 0 0 2024-08-18T22:41:58.707 INFO:tasks.workunit.client.1.smithi195.stdout:4/865: dwrite d0/d7/fd4 [0,4194304] 0 2024-08-18T22:41:58.707 INFO:tasks.workunit.client.1.smithi195.stdout:4/866: readlink d0/d99/la3 0 2024-08-18T22:41:58.707 INFO:tasks.workunit.client.1.smithi195.stdout:4/867: chown d0/d99/d85/d48 21430300 1 2024-08-18T22:41:58.707 INFO:tasks.workunit.client.1.smithi195.stdout:2/743: link d1/d8/la7 d1/d24/d26/d42/d44/d87/d8e/le6 0 2024-08-18T22:41:58.710 INFO:tasks.workunit.client.1.smithi195.stdout:2/744: link d1/d8/d3d/f99 d1/d24/d26/d42/d44/d87/d8e/fe7 0 2024-08-18T22:41:58.711 INFO:tasks.workunit.client.1.smithi195.stdout:2/745: fdatasync d1/f1f 0 2024-08-18T22:41:58.713 INFO:tasks.workunit.client.1.smithi195.stdout:2/746: write d1/d8/d3d/d6c/d7c/fa6 [241317,51543] 0 2024-08-18T22:41:58.719 INFO:tasks.workunit.client.1.smithi195.stdout:2/747: dwrite d1/d24/d26/d42/d5c/fe1 [0,4194304] 0 2024-08-18T22:41:58.721 INFO:tasks.workunit.client.1.smithi195.stdout:4/868: truncate d0/d99/d85/d48/d4c/f12c 3362874 0 2024-08-18T22:41:58.724 INFO:tasks.workunit.client.1.smithi195.stdout:2/748: mknod d1/d8/ce8 0 2024-08-18T22:41:58.727 INFO:tasks.workunit.client.1.smithi195.stdout:2/749: symlink d1/d24/d26/d83/db6/le9 0 2024-08-18T22:41:58.729 INFO:tasks.workunit.client.1.smithi195.stdout:4/869: dwrite d0/d99/d98/f113 [0,4194304] 0 2024-08-18T22:41:58.740 INFO:tasks.workunit.client.1.smithi195.stdout:4/870: rename d0/d7/d1d/d69/db7/d3b/f64 to d0/d7/d1d/d69/db7/d3b/d6f/db0/d12b/f134 0 2024-08-18T22:41:58.740 INFO:tasks.workunit.client.1.smithi195.stdout:4/871: readlink d0/d99/la3 0 2024-08-18T22:41:58.741 INFO:tasks.workunit.client.1.smithi195.stdout:2/750: truncate d1/d8/d27/f3a 1880617 0 2024-08-18T22:41:58.743 INFO:tasks.workunit.client.1.smithi195.stdout:2/751: creat d1/d24/d26/d42/d44/fea x:0 0 0 2024-08-18T22:41:58.744 INFO:tasks.workunit.client.1.smithi195.stdout:4/872: symlink d0/d7/d1d/d69/db7/d6c/d95/d126/l135 0 2024-08-18T22:41:58.744 INFO:tasks.workunit.client.1.smithi195.stdout:2/752: readlink d1/d24/d26/d42/d44/d87/lbd 0 2024-08-18T22:41:58.752 INFO:tasks.workunit.client.1.smithi195.stdout:2/753: dwrite d1/d24/d26/d83/db6/fc3 [0,4194304] 0 2024-08-18T22:41:58.752 INFO:tasks.workunit.client.1.smithi195.stdout:4/873: dwrite d0/d7/d1d/d69/db7/d3b/d6f/db0/d104/f112 [0,4194304] 0 2024-08-18T22:41:58.763 INFO:tasks.workunit.client.1.smithi195.stdout:2/754: link d1/d24/d26/d42/d44/d87/ce0 d1/d24/d26/ceb 0 2024-08-18T22:41:58.770 INFO:tasks.workunit.client.1.smithi195.stdout:2/755: dwrite d1/d8/d3d/d6c/f8f [0,4194304] 0 2024-08-18T22:41:58.771 INFO:tasks.workunit.client.1.smithi195.stdout:4/874: dread d0/d7/d1d/d69/f8f [0,4194304] 0 2024-08-18T22:41:58.775 INFO:tasks.workunit.client.1.smithi195.stdout:4/875: mkdir d0/d7/d1d/d69/db7/d41/d66/dfa/d102/d136 0 2024-08-18T22:41:58.775 INFO:tasks.workunit.client.1.smithi195.stdout:2/756: dread d1/d22/f6d [0,4194304] 0 2024-08-18T22:41:58.779 INFO:tasks.workunit.client.1.smithi195.stdout:2/757: unlink d1/d24/d26/d83/d94/cd4 0 2024-08-18T22:41:58.786 INFO:tasks.workunit.client.1.smithi195.stdout:2/758: dwrite d1/d8/d3d/d3b/f81 [0,4194304] 0 2024-08-18T22:41:58.787 INFO:tasks.workunit.client.1.smithi195.stdout:5/937: sync 2024-08-18T22:41:58.790 INFO:tasks.workunit.client.1.smithi195.stdout:5/938: mknod d0/d2/d29/dc5/c128 0 2024-08-18T22:41:58.793 INFO:tasks.workunit.client.1.smithi195.stdout:5/939: dread - d0/d3/df/df2/d110/f118 zero size 2024-08-18T22:41:58.793 INFO:tasks.workunit.client.1.smithi195.stdout:4/876: dread d0/d7/d1d/d69/db7/d3b/d120/d54/f5c [0,4194304] 0 2024-08-18T22:41:58.793 INFO:tasks.workunit.client.1.smithi195.stdout:2/759: dwrite d1/d24/d26/f2c [0,4194304] 0 2024-08-18T22:41:58.798 INFO:tasks.workunit.client.1.smithi195.stdout:5/940: fdatasync d0/d3/d8/d64/f70 0 2024-08-18T22:41:58.799 INFO:tasks.workunit.client.1.smithi195.stdout:4/877: unlink d0/d7/d1d/d69/db7/d6c/f9b 0 2024-08-18T22:41:58.800 INFO:tasks.workunit.client.1.smithi195.stdout:4/878: write d0/d99/d98/f113 [1999245,58155] 0 2024-08-18T22:41:58.803 INFO:tasks.workunit.client.1.smithi195.stdout:5/941: unlink d0/d3/d66/dda/ce5 0 2024-08-18T22:41:58.809 INFO:tasks.workunit.client.1.smithi195.stdout:5/942: getdents d0/d3/d8/d3b/db1 0 2024-08-18T22:41:58.812 INFO:tasks.workunit.client.1.smithi195.stdout:5/943: unlink d0/f77 0 2024-08-18T22:41:58.817 INFO:tasks.workunit.client.1.smithi195.stdout:4/879: write d0/d7/d1d/d69/db7/d3b/d120/d94/db2/f9c [1095323,105008] 0 2024-08-18T22:41:58.823 INFO:tasks.workunit.client.1.smithi195.stdout:5/944: dwrite d0/d2/d29/d88/d6a/f80 [4194304,4194304] 0 2024-08-18T22:41:58.824 INFO:tasks.workunit.client.1.smithi195.stdout:4/880: rename d0/d7/d1d/l90 to d0/d7/d1d/d69/db7/d3b/d120/d94/db2/da4/dad/l137 0 2024-08-18T22:41:58.826 INFO:tasks.workunit.client.1.smithi195.stdout:5/945: truncate d0/dea/dd3/f8a 1559878 0 2024-08-18T22:41:58.826 INFO:tasks.workunit.client.1.smithi195.stdout:4/881: creat d0/d99/d85/dc8/f138 x:0 0 0 2024-08-18T22:41:58.828 INFO:tasks.workunit.client.1.smithi195.stdout:5/946: creat d0/d3/d5f/f129 x:0 0 0 2024-08-18T22:41:58.828 INFO:tasks.workunit.client.1.smithi195.stdout:4/882: dread - d0/d7/d1d/d69/db4/f111 zero size 2024-08-18T22:41:58.830 INFO:tasks.workunit.client.1.smithi195.stdout:5/947: creat d0/d3/d5f/f12a x:0 0 0 2024-08-18T22:41:58.830 INFO:tasks.workunit.client.1.smithi195.stdout:4/883: read d0/d7/d1d/d69/db7/d3b/fd1 [2628775,126377] 0 2024-08-18T22:41:58.830 INFO:tasks.workunit.client.1.smithi195.stdout:5/948: fdatasync d0/d3/d66/f126 0 2024-08-18T22:41:58.833 INFO:tasks.workunit.client.1.smithi195.stdout:4/884: mknod d0/d7/d1d/d69/db7/d6c/d95/c139 0 2024-08-18T22:41:58.834 INFO:tasks.workunit.client.1.smithi195.stdout:5/949: truncate d0/d46/d6d/fa1 980039 0 2024-08-18T22:41:58.836 INFO:tasks.workunit.client.1.smithi195.stdout:5/950: creat d0/d46/d6d/da2/f12b x:0 0 0 2024-08-18T22:41:58.840 INFO:tasks.workunit.client.1.smithi195.stdout:5/951: read d0/d46/d6d/da2/fce [2567118,82348] 0 2024-08-18T22:41:58.841 INFO:tasks.workunit.client.1.smithi195.stdout:5/952: write d0/d2/fca [1545240,74996] 0 2024-08-18T22:41:58.843 INFO:tasks.workunit.client.1.smithi195.stdout:5/953: stat d0/d46/f11e 0 2024-08-18T22:41:58.847 INFO:tasks.workunit.client.1.smithi195.stdout:5/954: symlink d0/d3/d8/d3b/dfe/l12c 0 2024-08-18T22:41:58.847 INFO:tasks.workunit.client.1.smithi195.stdout:4/885: truncate d0/d7/d1d/d69/db7/d3b/d6f/db0/fe1 3195067 0 2024-08-18T22:41:58.850 INFO:tasks.workunit.client.1.smithi195.stdout:5/955: mknod d0/d3/d8/d3b/dfe/c12d 0 2024-08-18T22:41:58.851 INFO:tasks.workunit.client.1.smithi195.stdout:4/886: creat d0/d7/d1d/d69/db7/d3b/d6f/db0/d12b/f13a x:0 0 0 2024-08-18T22:41:58.851 INFO:tasks.workunit.client.1.smithi195.stdout:4/887: chown d0/d99/d81/fc1 0 1 2024-08-18T22:41:58.852 INFO:tasks.workunit.client.1.smithi195.stdout:5/956: creat d0/d3/d8/d3b/db1/f12e x:0 0 0 2024-08-18T22:41:58.854 INFO:tasks.workunit.client.1.smithi195.stdout:4/888: chown d0/c12 3 1 2024-08-18T22:41:58.854 INFO:tasks.workunit.client.1.smithi195.stdout:4/889: chown d0/d99/d81 807825 1 2024-08-18T22:41:58.855 INFO:tasks.workunit.client.1.smithi195.stdout:4/890: stat d0/d7/d1d/d69/ca0 0 2024-08-18T22:41:58.856 INFO:tasks.workunit.client.1.smithi195.stdout:5/957: getdents d0/d2/d29/d88 0 2024-08-18T22:41:58.862 INFO:tasks.workunit.client.1.smithi195.stdout:5/958: truncate d0/d2/d29/fe4 279510 0 2024-08-18T22:41:58.996 INFO:tasks.workunit.client.1.smithi195.stdout:2/760: sync 2024-08-18T22:41:58.998 INFO:tasks.workunit.client.1.smithi195.stdout:2/761: mkdir d1/d22/d65/dec 0 2024-08-18T22:41:58.999 INFO:tasks.workunit.client.1.smithi195.stdout:2/762: unlink d1/l23 0 2024-08-18T22:41:59.001 INFO:tasks.workunit.client.1.smithi195.stdout:2/763: write d1/d24/d26/d42/d5c/f6a [4760215,48546] 0 2024-08-18T22:41:59.002 INFO:tasks.workunit.client.1.smithi195.stdout:2/764: write d1/d24/d26/d83/db6/fc3 [466629,57609] 0 2024-08-18T22:41:59.004 INFO:tasks.workunit.client.1.smithi195.stdout:2/765: fsync d1/d22/d51/fa3 0 2024-08-18T22:41:59.005 INFO:tasks.workunit.client.1.smithi195.stdout:2/766: fdatasync d1/d24/d26/d42/d5c/fe1 0 2024-08-18T22:41:59.007 INFO:tasks.workunit.client.1.smithi195.stdout:2/767: write d1/d24/d26/d42/d50/f6f [1810434,70654] 0 2024-08-18T22:41:59.010 INFO:tasks.workunit.client.1.smithi195.stdout:2/768: stat d1/d8/d27/l35 0 2024-08-18T22:41:59.012 INFO:tasks.workunit.client.1.smithi195.stdout:2/769: mknod d1/d24/d26/ced 0 2024-08-18T22:41:59.013 INFO:tasks.workunit.client.1.smithi195.stdout:2/770: chown d1/d24/d26/dd9 1037862 1 2024-08-18T22:41:59.018 INFO:tasks.workunit.client.1.smithi195.stdout:2/771: truncate d1/d8/d3d/d6c/f98 499665 0 2024-08-18T22:41:59.018 INFO:tasks.workunit.client.1.smithi195.stdout:2/772: chown d1/d22/d65 15827680 1 2024-08-18T22:41:59.025 INFO:tasks.workunit.client.1.smithi195.stdout:2/773: dwrite d1/d8/d27/fb7 [0,4194304] 0 2024-08-18T22:41:59.027 INFO:tasks.workunit.client.1.smithi195.stdout:2/774: chown d1/d97/caa 5126838 1 2024-08-18T22:41:59.034 INFO:tasks.workunit.client.1.smithi195.stdout:2/775: truncate d1/d8/d3d/d3b/d7d/f95 241239 0 2024-08-18T22:41:59.037 INFO:tasks.workunit.client.1.smithi195.stdout:2/776: dread d1/d8/d3d/d6c/f8f [0,4194304] 0 2024-08-18T22:41:59.039 INFO:tasks.workunit.client.1.smithi195.stdout:2/777: mknod d1/d24/d26/d42/d72/d85/de3/cee 0 2024-08-18T22:41:59.041 INFO:tasks.workunit.client.1.smithi195.stdout:2/778: write d1/d8/d3d/d3b/d53/fc4 [437724,26387] 0 2024-08-18T22:41:59.045 INFO:tasks.workunit.client.1.smithi195.stdout:2/779: dread d1/d97/f9f [0,4194304] 0 2024-08-18T22:41:59.047 INFO:tasks.workunit.client.1.smithi195.stdout:2/780: creat d1/d8/fef x:0 0 0 2024-08-18T22:41:59.049 INFO:tasks.workunit.client.1.smithi195.stdout:2/781: creat d1/d22/ff0 x:0 0 0 2024-08-18T22:41:59.050 INFO:tasks.workunit.client.1.smithi195.stdout:2/782: getdents d1/d8/d3d/d3b/d7d/dd2 0 2024-08-18T22:41:59.052 INFO:tasks.workunit.client.1.smithi195.stdout:2/783: creat d1/d22/d65/dec/ff1 x:0 0 0 2024-08-18T22:41:59.054 INFO:tasks.workunit.client.1.smithi195.stdout:2/784: getdents d1/d24/d26/d42/d44 0 2024-08-18T22:41:59.056 INFO:tasks.workunit.client.1.smithi195.stdout:2/785: mknod d1/d22/d65/dec/cf2 0 2024-08-18T22:41:59.058 INFO:tasks.workunit.client.1.smithi195.stdout:2/786: creat d1/d22/d65/ff3 x:0 0 0 2024-08-18T22:41:59.061 INFO:tasks.workunit.client.1.smithi195.stdout:4/891: sync 2024-08-18T22:41:59.062 INFO:tasks.workunit.client.1.smithi195.stdout:4/892: readlink d0/d99/d98/db6/dca/ld8 0 2024-08-18T22:41:59.062 INFO:tasks.workunit.client.1.smithi195.stdout:2/787: dread d1/d8/d27/fb7 [0,4194304] 0 2024-08-18T22:41:59.062 INFO:tasks.workunit.client.1.smithi195.stdout:4/893: fdatasync d0/d7/d1d/f31 0 2024-08-18T22:41:59.064 INFO:tasks.workunit.client.1.smithi195.stdout:4/894: write d0/d99/d85/dc8/fdc [2693362,124961] 0 2024-08-18T22:41:59.065 INFO:tasks.workunit.client.1.smithi195.stdout:4/895: stat d0/d99/d85/dc8/f138 0 2024-08-18T22:41:59.066 INFO:tasks.workunit.client.1.smithi195.stdout:2/788: mkdir d1/d8/d27/df4 0 2024-08-18T22:41:59.066 INFO:tasks.workunit.client.1.smithi195.stdout:2/789: chown d1/d8/d3d 181560179 1 2024-08-18T22:41:59.069 INFO:tasks.workunit.client.1.smithi195.stdout:4/896: creat d0/d7/d1d/d69/db7/d6c/d95/d126/f13b x:0 0 0 2024-08-18T22:41:59.071 INFO:tasks.workunit.client.1.smithi195.stdout:2/790: getdents d1/d24/d26/d42/d50 0 2024-08-18T22:41:59.071 INFO:tasks.workunit.client.1.smithi195.stdout:4/897: fsync d0/d7/d1d/d69/db7/d3b/d120/d49/f46 0 2024-08-18T22:41:59.072 INFO:tasks.workunit.client.1.smithi195.stdout:2/791: chown d1/d24/d26/d42/d72/cdf 0 1 2024-08-18T22:41:59.074 INFO:tasks.workunit.client.1.smithi195.stdout:2/792: chown d1/d8/la7 115 1 2024-08-18T22:41:59.076 INFO:tasks.workunit.client.1.smithi195.stdout:2/793: rename d1/d8/fe4 to d1/d22/d65/dec/ff5 0 2024-08-18T22:41:59.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:41:58 smithi121 ceph-mon[16788]: pgmap v13: 65 pgs: 65 active+clean; 3.7 GiB data, 12 GiB used, 524 GiB / 536 GiB avail; 88 MiB/s rd, 204 MiB/s wr, 453 op/s 2024-08-18T22:41:59.087 INFO:tasks.workunit.client.1.smithi195.stdout:2/794: dwrite d1/d8/d27/f3a [0,4194304] 0 2024-08-18T22:41:59.088 INFO:tasks.workunit.client.1.smithi195.stdout:4/898: dread d0/ff [0,4194304] 0 2024-08-18T22:41:59.089 INFO:tasks.workunit.client.1.smithi195.stdout:2/795: write d1/d24/d26/d42/d72/d85/de3/fe5 [944938,78779] 0 2024-08-18T22:41:59.094 INFO:tasks.workunit.client.1.smithi195.stdout:2/796: symlink d1/d24/d26/d42/d44/lf6 0 2024-08-18T22:41:59.094 INFO:tasks.workunit.client.1.smithi195.stdout:4/899: getdents d0/d99/d81 0 2024-08-18T22:41:59.096 INFO:tasks.workunit.client.1.smithi195.stdout:4/900: chown d0/d7/d1d/d69/db7/d6c/d95/f11e 3637 1 2024-08-18T22:41:59.098 INFO:tasks.workunit.client.1.smithi195.stdout:4/901: write d0/d7/d1d/d69/db7/d3b/f10c [78059,59595] 0 2024-08-18T22:41:59.099 INFO:tasks.workunit.client.1.smithi195.stdout:2/797: truncate d1/d8/d3d/d6c/f98 390400 0 2024-08-18T22:41:59.101 INFO:tasks.workunit.client.1.smithi195.stdout:4/902: creat d0/d7/d1d/f13c x:0 0 0 2024-08-18T22:41:59.102 INFO:tasks.workunit.client.1.smithi195.stdout:2/798: mkdir d1/d22/d65/dec/df7 0 2024-08-18T22:41:59.103 INFO:tasks.workunit.client.1.smithi195.stdout:4/903: creat d0/d7/d1d/d69/db7/d41/f13d x:0 0 0 2024-08-18T22:41:59.104 INFO:tasks.workunit.client.1.smithi195.stdout:4/904: chown d0/d99/d85/cb3 182 1 2024-08-18T22:41:59.104 INFO:tasks.workunit.client.1.smithi195.stdout:2/799: creat d1/d24/d26/d42/d72/d85/ff8 x:0 0 0 2024-08-18T22:41:59.105 INFO:tasks.workunit.client.1.smithi195.stdout:2/800: stat d1/d24/d26/d42/d72/d85 0 2024-08-18T22:41:59.108 INFO:tasks.workunit.client.1.smithi195.stdout:4/905: rename d0/d7/d1d/f27 to d0/d7/d1d/d69/db7/d3b/f13e 0 2024-08-18T22:41:59.109 INFO:tasks.workunit.client.1.smithi195.stdout:5/959: sync 2024-08-18T22:41:59.110 INFO:tasks.workunit.client.1.smithi195.stdout:2/801: rename d1/d8/d3d/d3b/d46/l93 to d1/d8/d3d/d3b/lf9 0 2024-08-18T22:41:59.112 INFO:tasks.workunit.client.1.smithi195.stdout:2/802: creat d1/d22/d65/ffa x:0 0 0 2024-08-18T22:41:59.114 INFO:tasks.workunit.client.1.smithi195.stdout:2/803: write d1/d22/d65/dec/ff1 [496284,78223] 0 2024-08-18T22:41:59.118 INFO:tasks.workunit.client.1.smithi195.stdout:2/804: read d1/d24/d26/d42/d72/f86 [1848632,116325] 0 2024-08-18T22:41:59.119 INFO:tasks.workunit.client.1.smithi195.stdout:2/805: dread - d1/d24/d26/d83/fad zero size 2024-08-18T22:41:59.120 INFO:tasks.workunit.client.1.smithi195.stdout:5/960: write d0/d3/d8/d64/f70 [4329541,130135] 0 2024-08-18T22:41:59.124 INFO:tasks.workunit.client.1.smithi195.stdout:2/806: dread d1/d24/d26/d42/d5c/fe1 [0,4194304] 0 2024-08-18T22:41:59.126 INFO:tasks.workunit.client.1.smithi195.stdout:5/961: link d0/d2/d53/c61 d0/d3/df/df2/d110/c12f 0 2024-08-18T22:41:59.128 INFO:tasks.workunit.client.1.smithi195.stdout:2/807: rename d1/d24/d26/d83/d94/fb0 to d1/d8/d3d/d3b/d7d/dce/ffb 0 2024-08-18T22:41:59.128 INFO:tasks.workunit.client.1.smithi195.stdout:5/962: truncate d0/d46/d6d/f97 328609 0 2024-08-18T22:41:59.134 INFO:tasks.workunit.client.1.smithi195.stdout:5/963: rename d0/d2 to d0/d3/df/df2/d130 0 2024-08-18T22:41:59.137 INFO:tasks.workunit.client.1.smithi195.stdout:5/964: mkdir d0/d3/d8/d64/d87/dc7/de6/d131 0 2024-08-18T22:41:59.139 INFO:tasks.workunit.client.1.smithi195.stdout:5/965: symlink d0/d3/df/df2/d130/l132 0 2024-08-18T22:41:59.139 INFO:tasks.workunit.client.1.smithi195.stdout:5/966: chown d0/d37/dba 106 1 2024-08-18T22:41:59.142 INFO:tasks.workunit.client.1.smithi195.stdout:5/967: getdents d0/d3/d8/d64/d87/dc7 0 2024-08-18T22:41:59.143 INFO:tasks.workunit.client.1.smithi195.stdout:5/968: creat d0/dea/f133 x:0 0 0 2024-08-18T22:41:59.144 INFO:tasks.workunit.client.1.smithi195.stdout:2/808: dread d1/d8/d3d/f20 [0,4194304] 0 2024-08-18T22:41:59.151 INFO:tasks.workunit.client.1.smithi195.stdout:2/809: dread d1/f10 [0,4194304] 0 2024-08-18T22:41:59.153 INFO:tasks.workunit.client.1.smithi195.stdout:2/810: creat d1/d24/d26/d42/d72/d85/de3/ffc x:0 0 0 2024-08-18T22:41:59.154 INFO:tasks.workunit.client.1.smithi195.stdout:5/969: dread d0/d3/df/df2/d130/d29/f67 [0,4194304] 0 2024-08-18T22:41:59.157 INFO:tasks.workunit.client.1.smithi195.stdout:2/811: dread d1/d8/d27/f3a [0,4194304] 0 2024-08-18T22:41:59.158 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:41:58 smithi195 ceph-mon[23370]: pgmap v13: 65 pgs: 65 active+clean; 3.7 GiB data, 12 GiB used, 524 GiB / 536 GiB avail; 88 MiB/s rd, 204 MiB/s wr, 453 op/s 2024-08-18T22:41:59.161 INFO:tasks.workunit.client.1.smithi195.stdout:2/812: getdents d1/d8/d3d/d3b/d7d 0 2024-08-18T22:41:59.166 INFO:tasks.workunit.client.1.smithi195.stdout:2/813: dread d1/d8/d3d/fc [0,4194304] 0 2024-08-18T22:41:59.168 INFO:tasks.workunit.client.1.smithi195.stdout:2/814: mknod d1/d24/d26/d42/d72/d85/cfd 0 2024-08-18T22:41:59.170 INFO:tasks.workunit.client.1.smithi195.stdout:2/815: truncate d1/d24/d26/d42/d44/d87/d8e/fe7 4917118 0 2024-08-18T22:41:59.171 INFO:tasks.workunit.client.1.smithi195.stdout:2/816: mknod d1/d24/d26/d42/d44/d87/d8e/cfe 0 2024-08-18T22:41:59.173 INFO:tasks.workunit.client.1.smithi195.stdout:2/817: symlink d1/d8/d3d/d3b/d53/lff 0 2024-08-18T22:41:59.174 INFO:tasks.workunit.client.1.smithi195.stdout:2/818: write d1/f59 [1273774,61455] 0 2024-08-18T22:41:59.178 INFO:tasks.workunit.client.1.smithi195.stdout:2/819: link d1/d24/d26/d42/c89 d1/d8/d3d/c100 0 2024-08-18T22:41:59.178 INFO:tasks.workunit.client.1.smithi195.stdout:2/820: fsync d1/d8/d3d/d3b/d53/f76 0 2024-08-18T22:41:59.179 INFO:tasks.workunit.client.1.smithi195.stdout:2/821: write d1/d22/f6d [1202305,14206] 0 2024-08-18T22:41:59.181 INFO:tasks.workunit.client.1.smithi195.stdout:2/822: symlink d1/d8/d3d/d3b/d46/l101 0 2024-08-18T22:41:59.187 INFO:tasks.workunit.client.1.smithi195.stdout:2/823: dwrite d1/d22/d51/fa3 [0,4194304] 0 2024-08-18T22:41:59.195 INFO:tasks.workunit.client.1.smithi195.stdout:2/824: dwrite d1/d24/d26/d42/d44/fea [0,4194304] 0 2024-08-18T22:41:59.198 INFO:tasks.workunit.client.1.smithi195.stdout:2/825: creat d1/d24/d26/d42/d72/d85/f102 x:0 0 0 2024-08-18T22:41:59.199 INFO:tasks.workunit.client.1.smithi195.stdout:2/826: fsync d1/d24/d26/d42/d50/f6f 0 2024-08-18T22:41:59.201 INFO:tasks.workunit.client.1.smithi195.stdout:2/827: mknod d1/d22/d65/dec/c103 0 2024-08-18T22:41:59.216 INFO:tasks.workunit.client.1.smithi195.stdout:2/828: dread d1/d22/f31 [0,4194304] 0 2024-08-18T22:41:59.219 INFO:tasks.workunit.client.1.smithi195.stdout:2/829: getdents d1/d22/d51 0 2024-08-18T22:41:59.220 INFO:tasks.workunit.client.1.smithi195.stdout:2/830: truncate d1/fa1 1226509 0 2024-08-18T22:41:59.221 INFO:tasks.workunit.client.1.smithi195.stdout:2/831: dread d1/d24/d26/d42/d50/f52 [0,4194304] 0 2024-08-18T22:41:59.222 INFO:tasks.workunit.client.1.smithi195.stdout:2/832: read d1/d8/d27/f3a [563815,54672] 0 2024-08-18T22:41:59.223 INFO:tasks.workunit.client.1.smithi195.stdout:2/833: write d1/d24/d26/d42/d72/d85/f68 [1124121,122113] 0 2024-08-18T22:41:59.226 INFO:tasks.workunit.client.1.smithi195.stdout:2/834: creat d1/d8/d3d/d3b/f104 x:0 0 0 2024-08-18T22:41:59.228 INFO:tasks.workunit.client.1.smithi195.stdout:2/835: symlink d1/d8/d3d/d3b/d7d/dce/l105 0 2024-08-18T22:41:59.229 INFO:tasks.workunit.client.1.smithi195.stdout:2/836: rmdir d1/d24/d26/d42/d5c 39 2024-08-18T22:41:59.230 INFO:tasks.workunit.client.1.smithi195.stdout:2/837: chown d1/d8/d3d/f1c 2026431120 1 2024-08-18T22:41:59.235 INFO:tasks.workunit.client.1.smithi195.stdout:2/838: truncate d1/d8/f2f 2138428 0 2024-08-18T22:41:59.238 INFO:tasks.workunit.client.1.smithi195.stdout:2/839: creat d1/d24/d26/d42/f106 x:0 0 0 2024-08-18T22:41:59.240 INFO:tasks.workunit.client.1.smithi195.stdout:2/840: creat d1/d24/d26/d83/f107 x:0 0 0 2024-08-18T22:41:59.242 INFO:tasks.workunit.client.1.smithi195.stdout:2/841: mknod d1/d8/d3d/d3b/d7d/dce/c108 0 2024-08-18T22:41:59.243 INFO:tasks.workunit.client.1.smithi195.stdout:2/842: write d1/d22/d51/f6e [250805,110933] 0 2024-08-18T22:41:59.244 INFO:tasks.workunit.client.1.smithi195.stdout:2/843: rmdir d1/d24 39 2024-08-18T22:41:59.259 INFO:tasks.workunit.client.1.smithi195.stdout:2/844: dread d1/d24/d26/d42/d5c/f6a [0,4194304] 0 2024-08-18T22:41:59.260 INFO:tasks.workunit.client.1.smithi195.stdout:2/845: truncate d1/d8/d3d/d3b/f81 4219233 0 2024-08-18T22:41:59.261 INFO:tasks.workunit.client.1.smithi195.stdout:2/846: write d1/d24/d26/d42/d50/f6f [957750,36933] 0 2024-08-18T22:41:59.292 INFO:tasks.workunit.client.1.smithi195.stdout:4/906: sync 2024-08-18T22:41:59.294 INFO:tasks.workunit.client.1.smithi195.stdout:4/907: creat d0/d7/d1d/d69/db7/d3b/d120/d49/f13f x:0 0 0 2024-08-18T22:41:59.296 INFO:tasks.workunit.client.1.smithi195.stdout:4/908: symlink d0/d7/d1d/d69/db7/d41/d66/dfa/d102/l140 0 2024-08-18T22:41:59.298 INFO:tasks.workunit.client.1.smithi195.stdout:4/909: unlink d0/d7/d1d/d69/db7/d3b/d120/l109 0 2024-08-18T22:41:59.302 INFO:tasks.workunit.client.1.smithi195.stdout:4/910: getdents d0/d99/d98/db6/dca 0 2024-08-18T22:41:59.302 INFO:tasks.workunit.client.1.smithi195.stdout:4/911: chown d0/d7/d1d/d69/db7/d3b/d6f/db0/fe1 12266 1 2024-08-18T22:41:59.321 INFO:tasks.workunit.client.1.smithi195.stdout:4/912: dwrite d0/d7/d1d/d69/db7/d3b/d120/d49/f35 [4194304,4194304] 0 2024-08-18T22:41:59.323 INFO:tasks.workunit.client.1.smithi195.stdout:4/913: fsync d0/d99/d81/fe5 0 2024-08-18T22:41:59.327 INFO:tasks.workunit.client.1.smithi195.stdout:4/914: mknod d0/d7/d1d/d69/db7/d3b/d6f/db0/d12b/c141 0 2024-08-18T22:41:59.443 INFO:tasks.workunit.client.1.smithi195.stdout:5/970: sync 2024-08-18T22:41:59.444 INFO:tasks.workunit.client.1.smithi195.stdout:5/971: readlink d0/d3/l92 0 2024-08-18T22:41:59.447 INFO:tasks.workunit.client.1.smithi195.stdout:5/972: symlink d0/d3/d8/d64/d87/dc7/de6/l134 0 2024-08-18T22:41:59.449 INFO:tasks.workunit.client.1.smithi195.stdout:5/973: mknod d0/d3/d66/c135 0 2024-08-18T22:41:59.451 INFO:tasks.workunit.client.1.smithi195.stdout:5/974: symlink d0/d46/d6d/da2/de9/l136 0 2024-08-18T22:41:59.454 INFO:tasks.workunit.client.1.smithi195.stdout:5/975: fsync d0/d3/df/df2/d130/d29/d88/d90/f9a 0 2024-08-18T22:41:59.464 INFO:tasks.workunit.client.1.smithi195.stdout:5/976: dwrite d0/d3/df/df2/d130/d29/d88/d6a/d96/fad [0,4194304] 0 2024-08-18T22:41:59.465 INFO:tasks.workunit.client.1.smithi195.stdout:5/977: readlink d0/d3/df/l8f 0 2024-08-18T22:41:59.468 INFO:tasks.workunit.client.1.smithi195.stdout:5/978: unlink d0/d3/l92 0 2024-08-18T22:41:59.471 INFO:tasks.workunit.client.1.smithi195.stdout:5/979: getdents d0/d3/d8/d64/d87/dc7 0 2024-08-18T22:41:59.474 INFO:tasks.workunit.client.1.smithi195.stdout:5/980: symlink d0/d3/df/df2/d130/d29/d88/d6a/d96/l137 0 2024-08-18T22:41:59.476 INFO:tasks.workunit.client.1.smithi195.stdout:5/981: read d0/d46/d6d/da2/fce [2220007,71168] 0 2024-08-18T22:41:59.479 INFO:tasks.workunit.client.1.smithi195.stdout:5/982: link d0/d3/df/faf d0/d3/df/f138 0 2024-08-18T22:41:59.482 INFO:tasks.workunit.client.1.smithi195.stdout:5/983: read d0/d3/df/df2/d130/d29/fe4 [180940,85184] 0 2024-08-18T22:41:59.483 INFO:tasks.workunit.client.1.smithi195.stdout:5/984: rmdir d0/d3/df/df2/d130/d29/db5 39 2024-08-18T22:41:59.484 INFO:tasks.workunit.client.1.smithi195.stdout:5/985: symlink d0/d3/df/df2/d110/l139 0 2024-08-18T22:41:59.485 INFO:tasks.workunit.client.1.smithi195.stdout:5/986: readlink d0/d3/d8/d3b/dfe/l12c 0 2024-08-18T22:41:59.498 INFO:tasks.workunit.client.1.smithi195.stdout:5/987: dwrite d0/d3/df/df2/d130/d29/f67 [0,4194304] 0 2024-08-18T22:41:59.498 INFO:tasks.workunit.client.1.smithi195.stdout:5/988: dread - d0/d37/dba/d10d/f125 zero size 2024-08-18T22:41:59.499 INFO:tasks.workunit.client.1.smithi195.stdout:5/989: dread - d0/d3/df/df2/d130/f107 zero size 2024-08-18T22:41:59.514 INFO:tasks.workunit.client.1.smithi195.stdout:2/847: sync 2024-08-18T22:41:59.514 INFO:tasks.workunit.client.1.smithi195.stdout:4/915: sync 2024-08-18T22:41:59.520 INFO:tasks.workunit.client.1.smithi195.stdout:5/990: mkdir d0/d3/df/df2/d130/d29/d88/d6a/d96/d13a 0 2024-08-18T22:41:59.521 INFO:tasks.workunit.client.1.smithi195.stdout:2/848: creat d1/d22/d51/da8/f109 x:0 0 0 2024-08-18T22:41:59.521 INFO:tasks.workunit.client.1.smithi195.stdout:4/916: rmdir d0/d7/d1d/d69/db7 39 2024-08-18T22:41:59.523 INFO:tasks.workunit.client.1.smithi195.stdout:4/917: write d0/d99/d85/dc8/fdc [909648,48314] 0 2024-08-18T22:41:59.525 INFO:tasks.workunit.client.1.smithi195.stdout:2/849: rmdir d1/d24/d26/d42/d72/d85 39 2024-08-18T22:41:59.530 INFO:tasks.workunit.client.1.smithi195.stdout:5/991: dwrite d0/d3/df/df2/d130/d29/d88/f127 [0,4194304] 0 2024-08-18T22:41:59.531 INFO:tasks.workunit.client.1.smithi195.stdout:4/918: mknod d0/d7/d1d/d69/db7/c142 0 2024-08-18T22:41:59.535 INFO:tasks.workunit.client.1.smithi195.stdout:2/850: rename d1/d24/l33 to d1/d8/d27/l10a 0 2024-08-18T22:41:59.536 INFO:tasks.workunit.client.1.smithi195.stdout:5/992: write d0/d3/df/df2/d130/d29/d88/d6a/d96/fc4 [4427245,57854] 0 2024-08-18T22:41:59.538 INFO:tasks.workunit.client.1.smithi195.stdout:2/851: symlink d1/d24/d26/d42/d50/l10b 0 2024-08-18T22:41:59.540 INFO:tasks.workunit.client.1.smithi195.stdout:5/993: write d0/d3/df/df2/d130/d29/f67 [2159352,89113] 0 2024-08-18T22:41:59.543 INFO:tasks.workunit.client.1.smithi195.stdout:5/994: mknod d0/d37/c13b 0 2024-08-18T22:41:59.543 INFO:tasks.workunit.client.1.smithi195.stdout:2/852: mknod d1/d97/de2/c10c 0 2024-08-18T22:41:59.544 INFO:tasks.workunit.client.1.smithi195.stdout:5/995: dread - d0/d3/df/df2/d110/fc8 zero size 2024-08-18T22:41:59.545 INFO:tasks.workunit.client.1.smithi195.stdout:5/996: chown d0/d3/df/df2/d130/d29/d88/d6a/f80 5060526 1 2024-08-18T22:41:59.550 INFO:tasks.workunit.client.1.smithi195.stdout:5/997: truncate d0/d3/df/f74 72285 0 2024-08-18T22:41:59.554 INFO:tasks.workunit.client.1.smithi195.stdout:5/998: write d0/d3/df/df2/d130/d29/d88/d6a/d96/fad [2775258,110147] 0 2024-08-18T22:41:59.555 INFO:tasks.workunit.client.1.smithi195.stdout:5/999: stat d0/d3/df/df2/d130/d29/d88/d6a/f83 0 2024-08-18T22:41:59.556 INFO:tasks.workunit.client.1.smithi195.stdout:4/919: dread d0/d7/d1d/d69/db7/d3b/d120/d94/db2/da4/fce [0,4194304] 0 2024-08-18T22:41:59.557 INFO:tasks.workunit.client.1.smithi195.stdout:4/920: chown d0/ff 0 1 2024-08-18T22:41:59.561 INFO:tasks.workunit.client.1.smithi195.stdout:4/921: dread d0/d99/d85/f4e [0,4194304] 0 2024-08-18T22:41:59.565 INFO:tasks.workunit.client.1.smithi195.stdout:4/922: mkdir d0/d7/d1d/d69/db7/d3b/d120/d49/d143 0 2024-08-18T22:41:59.568 INFO:tasks.workunit.client.1.smithi195.stdout:2/853: dwrite d1/d8/d27/f90 [0,4194304] 0 2024-08-18T22:41:59.570 INFO:tasks.workunit.client.1.smithi195.stdout:4/923: symlink d0/d7/d1d/d69/db7/d3b/d120/d94/db2/l144 0 2024-08-18T22:41:59.571 INFO:tasks.workunit.client.1.smithi195.stdout:2/854: mkdir d1/d97/ddc/d10d 0 2024-08-18T22:41:59.571 INFO:tasks.workunit.client.1.smithi195.stdout:4/924: read d0/d99/d98/f113 [2771746,85256] 0 2024-08-18T22:41:59.575 INFO:tasks.workunit.client.1.smithi195.stdout:4/925: rmdir d0/d99/d85/d48 39 2024-08-18T22:41:59.577 INFO:tasks.workunit.client.1.smithi195.stdout:2/855: rename d1/d24/d26/d42/d44/d87/lde to d1/d22/d65/dec/df7/l10e 0 2024-08-18T22:41:59.579 INFO:tasks.workunit.client.1.smithi195.stdout:4/926: getdents d0/d7/d1d/d69/db7/d3b/d120/d49/d143 0 2024-08-18T22:41:59.583 INFO:tasks.workunit.client.1.smithi195.stdout:2/856: dwrite d1/d24/d26/f2c [0,4194304] 0 2024-08-18T22:41:59.586 INFO:tasks.workunit.client.1.smithi195.stdout:2/857: link d1/c9d d1/d8/d3d/d3b/d46/c10f 0 2024-08-18T22:41:59.593 INFO:tasks.workunit.client.1.smithi195.stdout:2/858: dwrite d1/d24/d26/d42/d5c/fbe [0,4194304] 0 2024-08-18T22:41:59.596 INFO:tasks.workunit.client.1.smithi195.stdout:2/859: read d1/fa1 [582807,14202] 0 2024-08-18T22:41:59.604 INFO:tasks.workunit.client.1.smithi195.stdout:2/860: dwrite d1/f59 [0,4194304] 0 2024-08-18T22:41:59.608 INFO:tasks.workunit.client.1.smithi195.stdout:2/861: creat d1/d8/d3d/d3b/d7d/dd2/f110 x:0 0 0 2024-08-18T22:41:59.625 INFO:tasks.workunit.client.1.smithi195.stdout:2/862: dwrite d1/d8/d3d/fa [0,4194304] 0 2024-08-18T22:41:59.627 INFO:tasks.workunit.client.1.smithi195.stdout:2/863: chown d1/d24/d26/d42/d72/cb3 0 1 2024-08-18T22:41:59.631 INFO:tasks.workunit.client.1.smithi195.stdout:2/864: creat d1/d8/d3d/d3b/d7d/dce/f111 x:0 0 0 2024-08-18T22:41:59.631 INFO:tasks.workunit.client.1.smithi195.stdout:2/865: readlink d1/d24/d26/d42/d44/l4a 0 2024-08-18T22:41:59.643 INFO:tasks.workunit.client.1.smithi195.stdout:2/866: dread d1/f1f [4194304,4194304] 0 2024-08-18T22:41:59.651 INFO:tasks.workunit.client.1.smithi195.stdout:2/867: dwrite d1/d8/d3d/d3b/d7d/f95 [0,4194304] 0 2024-08-18T22:41:59.652 INFO:tasks.workunit.client.1.smithi195.stdout:2/868: readlink d1/d97/l9b 0 2024-08-18T22:41:59.656 INFO:tasks.workunit.client.1.smithi195.stdout:2/869: write d1/d8/d3d/f3e [8426332,90655] 0 2024-08-18T22:41:59.657 INFO:tasks.workunit.client.1.smithi195.stdout:2/870: chown d1/d8/d3d/c2d 46079 1 2024-08-18T22:41:59.664 INFO:tasks.workunit.client.1.smithi195.stdout:2/871: dwrite d1/d24/d26/d42/d44/d87/d8e/fac [0,4194304] 0 2024-08-18T22:41:59.665 INFO:tasks.workunit.client.1.smithi195.stdout:2/872: dread - d1/d22/d65/dec/ff5 zero size 2024-08-18T22:41:59.668 INFO:tasks.workunit.client.1.smithi195.stdout:2/873: symlink d1/d97/l112 0 2024-08-18T22:41:59.669 INFO:tasks.workunit.client.1.smithi195.stdout:2/874: chown d1/fa1 3 1 2024-08-18T22:41:59.669 INFO:tasks.workunit.client.1.smithi195.stdout:2/875: stat d1/d8/d3d 0 2024-08-18T22:41:59.670 INFO:tasks.workunit.client.1.smithi195.stdout:2/876: creat d1/d8/d3d/d3b/d7d/dd2/f113 x:0 0 0 2024-08-18T22:41:59.674 INFO:tasks.workunit.client.1.smithi195.stdout:2/877: link d1/d8/f2f d1/d24/d26/d42/d5c/f114 0 2024-08-18T22:41:59.677 INFO:tasks.workunit.client.1.smithi195.stdout:2/878: dread d1/d24/f56 [0,4194304] 0 2024-08-18T22:41:59.680 INFO:tasks.workunit.client.1.smithi195.stdout:2/879: mknod d1/d24/d26/d42/d72/d85/de3/c115 0 2024-08-18T22:41:59.682 INFO:tasks.workunit.client.1.smithi195.stdout:2/880: mknod d1/d24/d26/d42/d72/d85/da9/c116 0 2024-08-18T22:41:59.685 INFO:tasks.workunit.client.1.smithi195.stdout:2/881: getdents d1/d8/d3d/d3b/d7d 0 2024-08-18T22:41:59.695 INFO:tasks.workunit.client.1.smithi195.stdout:2/882: dread d1/d24/d26/d42/d5c/f114 [0,4194304] 0 2024-08-18T22:41:59.697 INFO:tasks.workunit.client.1.smithi195.stdout:2/883: mkdir d1/d24/d26/d83/d117 0 2024-08-18T22:41:59.699 INFO:tasks.workunit.client.1.smithi195.stdout:4/927: sync 2024-08-18T22:41:59.702 INFO:tasks.workunit.client.1.smithi195.stdout:2/884: dwrite d1/d24/d26/d42/d44/f57 [0,4194304] 0 2024-08-18T22:41:59.704 INFO:tasks.workunit.client.1.smithi195.stdout:4/928: getdents d0/d7/d1d/d69/db7/d41/d66 0 2024-08-18T22:41:59.706 INFO:tasks.workunit.client.1.smithi195.stdout:4/929: read - d0/d7/d1d/d69/db7/d3b/d120/d94/db2/da4/dad/f108 zero size 2024-08-18T22:41:59.710 INFO:tasks.workunit.client.1.smithi195.stdout:2/885: dwrite d1/d24/d26/d42/d72/d85/de3/fe5 [0,4194304] 0 2024-08-18T22:41:59.718 INFO:tasks.workunit.client.1.smithi195.stdout:4/930: rename d0/d7/d1d/d69/db7/d3b/d120/d94/db2/da4/dad/f108 to d0/d7/d1d/d69/db4/f145 0 2024-08-18T22:41:59.718 INFO:tasks.workunit.client.1.smithi195.stdout:2/886: dread d1/d8/d27/f3a [0,4194304] 0 2024-08-18T22:41:59.718 INFO:tasks.workunit.client.1.smithi195.stdout:4/931: read d0/d7/d1d/d69/db7/d3b/fd1 [2957156,31652] 0 2024-08-18T22:41:59.731 INFO:tasks.workunit.client.1.smithi195.stdout:2/887: fsync d1/d8/d3d/f99 0 2024-08-18T22:41:59.745 INFO:tasks.workunit.client.1.smithi195.stdout:4/932: dread d0/d99/d85/d48/fdb [0,4194304] 0 2024-08-18T22:41:59.748 INFO:tasks.workunit.client.1.smithi195.stdout:4/933: unlink d0/d7/d1d/d69/db7/d41/dbf/lcb 0 2024-08-18T22:41:59.749 INFO:tasks.workunit.client.1.smithi195.stdout:4/934: truncate d0/d7/d1d/d69/db7/d3b/d120/d94/f10d 612776 0 2024-08-18T22:41:59.752 INFO:tasks.workunit.client.1.smithi195.stdout:4/935: link d0/d7/d1d/d69/db7/d3b/d120/d94/f10d d0/d99/d85/d48/d4c/f146 0 2024-08-18T22:41:59.755 INFO:tasks.workunit.client.1.smithi195.stdout:4/936: link d0/d7/d1d/d69/db7/d3b/d120/d49/l12a d0/d99/d85/d48/l147 0 2024-08-18T22:41:59.756 INFO:tasks.workunit.client.1.smithi195.stdout:4/937: write d0/d7/d1d/d69/db7/d3b/f131 [925736,56861] 0 2024-08-18T22:41:59.765 INFO:tasks.workunit.client.1.smithi195.stdout:4/938: dwrite d0/d99/d85/d48/d4c/f63 [0,4194304] 0 2024-08-18T22:41:59.767 INFO:tasks.workunit.client.1.smithi195.stdout:4/939: mknod d0/d99/d85/d48/d4c/c148 0 2024-08-18T22:41:59.768 INFO:tasks.workunit.client.1.smithi195.stdout:4/940: stat d0/d7/d1d/d69/db7/d41/d66/l77 0 2024-08-18T22:41:59.880 INFO:tasks.workunit.client.1.smithi195.stdout:2/888: sync 2024-08-18T22:41:59.881 INFO:tasks.workunit.client.1.smithi195.stdout:2/889: write d1/d24/d26/d42/d44/d87/d8e/fac [2067533,90669] 0 2024-08-18T22:41:59.947 INFO:tasks.workunit.client.1.smithi195.stdout:4/941: sync 2024-08-18T22:41:59.950 INFO:tasks.workunit.client.1.smithi195.stdout:4/942: link d0/d7/lb d0/d7/d1d/l149 0 2024-08-18T22:41:59.951 INFO:tasks.workunit.client.1.smithi195.stdout:4/943: chown d0/d7/d1d/d69/db7/d41/lf4 107169368 1 2024-08-18T22:41:59.956 INFO:tasks.workunit.client.1.smithi195.stdout:4/944: dwrite d0/d99/d85/d48/fdb [0,4194304] 0 2024-08-18T22:41:59.959 INFO:tasks.workunit.client.1.smithi195.stdout:4/945: read d0/d99/d85/dc8/fdc [1447860,130498] 0 2024-08-18T22:41:59.962 INFO:tasks.workunit.client.1.smithi195.stdout:4/946: symlink d0/d7/d1d/d69/db7/d41/d66/dfa/l14a 0 2024-08-18T22:41:59.963 INFO:tasks.workunit.client.1.smithi195.stdout:4/947: chown d0/d7/d1d/d69/db7/d3b/d120/d54/l6a 53028469 1 2024-08-18T22:41:59.982 INFO:tasks.workunit.client.1.smithi195.stdout:4/948: dwrite d0/d7/d1d/d69/f7f [0,4194304] 0 2024-08-18T22:41:59.983 INFO:tasks.workunit.client.1.smithi195.stdout:2/890: sync 2024-08-18T22:41:59.990 INFO:tasks.workunit.client.1.smithi195.stdout:2/891: link d1/d8/d3d/d3b/d46/f66 d1/d24/f118 0 2024-08-18T22:41:59.992 INFO:tasks.workunit.client.1.smithi195.stdout:2/892: write d1/d24/d26/d42/d5c/fcf [887019,79837] 0 2024-08-18T22:41:59.994 INFO:tasks.workunit.client.1.smithi195.stdout:2/893: chown d1/d24/d26/d42/d50 443965059 1 2024-08-18T22:41:59.994 INFO:tasks.workunit.client.1.smithi195.stdout:4/949: dwrite d0/d7/d1d/d69/db7/d3b/d120/f5e [4194304,4194304] 0 2024-08-18T22:41:59.996 INFO:tasks.workunit.client.1.smithi195.stdout:4/950: readlink d0/d99/d98/db6/ldd 0 2024-08-18T22:42:00.001 INFO:tasks.workunit.client.1.smithi195.stdout:4/951: symlink d0/d7/d1d/d69/db7/d41/d66/dfa/d102/d136/l14b 0 2024-08-18T22:42:00.002 INFO:tasks.workunit.client.1.smithi195.stdout:2/894: dwrite d1/f59 [0,4194304] 0 2024-08-18T22:42:00.009 INFO:tasks.workunit.client.1.smithi195.stdout:2/895: creat d1/d8/d3d/d3b/d46/f119 x:0 0 0 2024-08-18T22:42:00.009 INFO:tasks.workunit.client.1.smithi195.stdout:4/952: creat d0/d99/d85/f14c x:0 0 0 2024-08-18T22:42:00.012 INFO:tasks.workunit.client.1.smithi195.stdout:4/953: unlink d0/d7/d1d/d69/db7/d3b/d120/f61 0 2024-08-18T22:42:00.014 INFO:tasks.workunit.client.1.smithi195.stdout:4/954: chown d0/d99/d98/db6/ldd 197478 1 2024-08-18T22:42:00.014 INFO:tasks.workunit.client.1.smithi195.stdout:2/896: dwrite d1/d24/d26/d42/d72/d85/f102 [0,4194304] 0 2024-08-18T22:42:00.018 INFO:tasks.workunit.client.1.smithi195.stdout:2/897: mknod d1/d24/d26/d42/d44/c11a 0 2024-08-18T22:42:00.019 INFO:tasks.workunit.client.1.smithi195.stdout:4/955: write d0/d7/d1d/d69/db7/d3b/d120/d94/db2/da4/dad/f125 [3105722,97646] 0 2024-08-18T22:42:00.021 INFO:tasks.workunit.client.1.smithi195.stdout:2/898: symlink d1/l11b 0 2024-08-18T22:42:00.024 INFO:tasks.workunit.client.1.smithi195.stdout:2/899: mknod d1/d97/ddc/c11c 0 2024-08-18T22:42:00.026 INFO:tasks.workunit.client.1.smithi195.stdout:2/900: write d1/d24/d26/d42/d5c/fcf [1085447,93079] 0 2024-08-18T22:42:00.028 INFO:tasks.workunit.client.1.smithi195.stdout:4/956: dwrite d0/d7/d1d/d69/f123 [0,4194304] 0 2024-08-18T22:42:00.030 INFO:tasks.workunit.client.1.smithi195.stdout:2/901: dread d1/d24/d26/d42/d5c/f6a [4194304,4194304] 0 2024-08-18T22:42:00.032 INFO:tasks.workunit.client.1.smithi195.stdout:4/957: mknod d0/d7/d1d/d69/db7/d3b/d120/d94/db2/da4/dad/c14d 0 2024-08-18T22:42:00.034 INFO:tasks.workunit.client.1.smithi195.stdout:2/902: rename d1/d8/d3d/d6c/d7c to d1/d24/d26/d42/d44/d87/d11d 0 2024-08-18T22:42:00.037 INFO:tasks.workunit.client.1.smithi195.stdout:4/958: getdents d0/d7/d1d/d69/db7/d6c 0 2024-08-18T22:42:00.038 INFO:tasks.workunit.client.1.smithi195.stdout:2/903: creat d1/d24/d26/d42/d72/d85/da9/f11e x:0 0 0 2024-08-18T22:42:00.040 INFO:tasks.workunit.client.1.smithi195.stdout:2/904: fsync d1/d24/d26/d42/d72/d85/f68 0 2024-08-18T22:42:00.041 INFO:tasks.workunit.client.1.smithi195.stdout:4/959: symlink d0/d7/d1d/d69/db7/d3b/d120/dae/l14e 0 2024-08-18T22:42:00.043 INFO:tasks.workunit.client.1.smithi195.stdout:2/905: unlink d1/d24/d26/d42/d72/cdf 0 2024-08-18T22:42:00.043 INFO:tasks.workunit.client.1.smithi195.stdout:4/960: read d0/d7/d1d/d69/db7/d3b/f131 [414259,77410] 0 2024-08-18T22:42:00.044 INFO:tasks.workunit.client.1.smithi195.stdout:2/906: dread - d1/d24/d26/d83/f107 zero size 2024-08-18T22:42:00.046 INFO:tasks.workunit.client.1.smithi195.stdout:4/961: symlink d0/d7/d1d/d69/db7/d6c/d95/d126/l14f 0 2024-08-18T22:42:00.047 INFO:tasks.workunit.client.1.smithi195.stdout:2/907: creat d1/d22/d65/f11f x:0 0 0 2024-08-18T22:42:00.049 INFO:tasks.workunit.client.1.smithi195.stdout:2/908: rmdir d1/d22/d65/dec 39 2024-08-18T22:42:00.050 INFO:tasks.workunit.client.1.smithi195.stdout:2/909: write d1/d8/f25 [4427904,80021] 0 2024-08-18T22:42:00.056 INFO:tasks.workunit.client.1.smithi195.stdout:2/910: dwrite d1/d24/d26/d42/d44/d87/d11d/fa6 [0,4194304] 0 2024-08-18T22:42:00.059 INFO:tasks.workunit.client.1.smithi195.stdout:4/962: dwrite d0/d99/d81/f8d [0,4194304] 0 2024-08-18T22:42:00.063 INFO:tasks.workunit.client.1.smithi195.stdout:2/911: dread d1/d24/f56 [0,4194304] 0 2024-08-18T22:42:00.064 INFO:tasks.workunit.client.1.smithi195.stdout:4/963: rmdir d0/d7/d1d/d69/db7/d3b/d120 39 2024-08-18T22:42:00.073 INFO:tasks.workunit.client.1.smithi195.stdout:2/912: dwrite d1/d97/fd5 [0,4194304] 0 2024-08-18T22:42:00.078 INFO:tasks.workunit.client.1.smithi195.stdout:2/913: rename d1/d24/d26/d42/d44/d87/d11d/fa6 to d1/d24/d26/d42/d44/d87/d11d/f120 0 2024-08-18T22:42:00.080 INFO:tasks.workunit.client.1.smithi195.stdout:2/914: mkdir d1/d24/d26/dd9/d121 0 2024-08-18T22:42:00.081 INFO:tasks.workunit.client.1.smithi195.stdout:2/915: stat d1/d24/d26/d42/f4c 0 2024-08-18T22:42:00.081 INFO:tasks.workunit.client.1.smithi195.stdout:2/916: chown d1/d8/d3d/d4d 245 1 2024-08-18T22:42:00.084 INFO:tasks.workunit.client.1.smithi195.stdout:2/917: symlink d1/d24/d26/d42/d44/d87/dd6/l122 0 2024-08-18T22:42:00.087 INFO:tasks.workunit.client.1.smithi195.stdout:2/918: dread d1/d97/fd5 [0,4194304] 0 2024-08-18T22:42:00.089 INFO:tasks.workunit.client.1.smithi195.stdout:2/919: creat d1/d97/ddc/f123 x:0 0 0 2024-08-18T22:42:00.092 INFO:tasks.workunit.client.1.smithi195.stdout:2/920: rename d1/d24/d26/f36 to d1/f124 0 2024-08-18T22:42:00.092 INFO:tasks.workunit.client.1.smithi195.stdout:4/964: write d0/d99/d98/fd7 [177158,71147] 0 2024-08-18T22:42:00.094 INFO:tasks.workunit.client.1.smithi195.stdout:2/921: chown d1/d24/f56 33420 1 2024-08-18T22:42:00.096 INFO:tasks.workunit.client.1.smithi195.stdout:4/965: creat d0/d99/d98/db6/dca/f150 x:0 0 0 2024-08-18T22:42:00.097 INFO:tasks.workunit.client.1.smithi195.stdout:2/922: link d1/d24/d26/d42/d5c/fcf d1/d8/dc1/f125 0 2024-08-18T22:42:00.098 INFO:tasks.workunit.client.1.smithi195.stdout:4/966: creat d0/d99/d85/d48/d4c/f151 x:0 0 0 2024-08-18T22:42:00.100 INFO:tasks.workunit.client.1.smithi195.stdout:2/923: creat d1/d8/d3d/d3b/f126 x:0 0 0 2024-08-18T22:42:00.100 INFO:tasks.workunit.client.1.smithi195.stdout:4/967: fsync d0/d7/d1d/d69/db7/d41/fe9 0 2024-08-18T22:42:00.102 INFO:tasks.workunit.client.1.smithi195.stdout:4/968: readlink d0/d7/d1d/d69/db7/d6c/d95/d126/l14f 0 2024-08-18T22:42:00.102 INFO:tasks.workunit.client.1.smithi195.stdout:2/924: mkdir d1/d24/d127 0 2024-08-18T22:42:00.104 INFO:tasks.workunit.client.1.smithi195.stdout:4/969: symlink d0/l152 0 2024-08-18T22:42:00.106 INFO:tasks.workunit.client.1.smithi195.stdout:2/925: mkdir d1/d8/d3d/d3b/d53/d128 0 2024-08-18T22:42:00.111 INFO:tasks.workunit.client.1.smithi195.stdout:4/970: dwrite d0/d7/d1d/d69/db7/d6c/f91 [0,4194304] 0 2024-08-18T22:42:00.119 INFO:tasks.workunit.client.1.smithi195.stdout:2/926: dwrite d1/d24/d26/d42/d5c/f7e [0,4194304] 0 2024-08-18T22:42:00.122 INFO:tasks.workunit.client.1.smithi195.stdout:2/927: write d1/d24/f56 [5192797,80086] 0 2024-08-18T22:42:00.127 INFO:tasks.workunit.client.1.smithi195.stdout:4/971: dwrite d0/d7/d1d/f13c [0,4194304] 0 2024-08-18T22:42:00.129 INFO:tasks.workunit.client.1.smithi195.stdout:4/972: mkdir d0/d7/d1d/d69/db7/d41/d153 0 2024-08-18T22:42:00.131 INFO:tasks.workunit.client.1.smithi195.stdout:2/928: dread d1/d8/f1a [0,4194304] 0 2024-08-18T22:42:00.134 INFO:tasks.workunit.client.1.smithi195.stdout:2/929: mknod d1/d24/d26/d42/d44/d87/dd6/c129 0 2024-08-18T22:42:00.135 INFO:tasks.workunit.client.1.smithi195.stdout:4/973: mknod d0/d7/d1d/d69/db7/d3b/d120/d94/db2/dfb/c154 0 2024-08-18T22:42:00.137 INFO:tasks.workunit.client.1.smithi195.stdout:2/930: mkdir d1/d22/d65/d12a 0 2024-08-18T22:42:00.138 INFO:tasks.workunit.client.1.smithi195.stdout:4/974: creat d0/d7/d1d/d69/db7/d3b/d120/d94/db2/f155 x:0 0 0 2024-08-18T22:42:00.139 INFO:tasks.workunit.client.1.smithi195.stdout:2/931: truncate d1/d8/f1a 1458404 0 2024-08-18T22:42:00.139 INFO:tasks.workunit.client.1.smithi195.stdout:4/975: chown d0/d99/d98/f113 908532556 1 2024-08-18T22:42:00.148 INFO:tasks.workunit.client.1.smithi195.stdout:2/932: write d1/d24/d26/d42/d50/f52 [1098324,52732] 0 2024-08-18T22:42:00.153 INFO:tasks.workunit.client.1.smithi195.stdout:4/976: dwrite d0/d7/d1d/d69/db7/d3b/fd1 [0,4194304] 0 2024-08-18T22:42:00.154 INFO:tasks.workunit.client.1.smithi195.stdout:2/933: link d1/d24/d26/d42/f106 d1/d24/d26/d42/d72/d85/da9/f12b 0 2024-08-18T22:42:00.154 INFO:tasks.workunit.client.1.smithi195.stdout:4/977: chown d0/d7/c39 73288444 1 2024-08-18T22:42:00.156 INFO:tasks.workunit.client.1.smithi195.stdout:4/978: fsync d0/d99/d85/d48/d4c/f63 0 2024-08-18T22:42:00.161 INFO:tasks.workunit.client.1.smithi195.stdout:4/979: unlink d0/d7/d1d/d69/db7/f57 0 2024-08-18T22:42:00.162 INFO:tasks.workunit.client.1.smithi195.stdout:2/934: link d1/d22/d65/dec/c103 d1/d22/d65/dec/df7/c12c 0 2024-08-18T22:42:00.164 INFO:tasks.workunit.client.1.smithi195.stdout:4/980: unlink d0/d99/d98/f92 0 2024-08-18T22:42:00.166 INFO:tasks.workunit.client.1.smithi195.stdout:4/981: creat d0/d7/d1d/d69/db7/d3b/d120/dae/f156 x:0 0 0 2024-08-18T22:42:00.168 INFO:tasks.workunit.client.1.smithi195.stdout:4/982: write d0/d99/d98/f128 [296808,48955] 0 2024-08-18T22:42:00.171 INFO:tasks.workunit.client.1.smithi195.stdout:2/935: truncate d1/d24/d26/fb8 3517245 0 2024-08-18T22:42:00.175 INFO:tasks.workunit.client.1.smithi195.stdout:4/983: dwrite d0/d99/d85/d48/d4c/f151 [0,4194304] 0 2024-08-18T22:42:00.176 INFO:tasks.workunit.client.1.smithi195.stdout:4/984: dread - d0/d99/d98/db6/f100 zero size 2024-08-18T22:42:00.184 INFO:tasks.workunit.client.1.smithi195.stdout:4/985: dread d0/d7/d1d/d69/db7/d3b/f131 [0,4194304] 0 2024-08-18T22:42:00.186 INFO:tasks.workunit.client.1.smithi195.stdout:4/986: mknod d0/d7/d1d/d69/db7/d6c/c157 0 2024-08-18T22:42:00.188 INFO:tasks.workunit.client.1.smithi195.stdout:4/987: mknod d0/c158 0 2024-08-18T22:42:00.189 INFO:tasks.workunit.client.1.smithi195.stdout:4/988: fsync d0/d99/d98/f113 0 2024-08-18T22:42:00.328 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:42:00 smithi195 ceph-mon[23370]: from='mgr.24377 ' entity='mgr.smithi195.acttsj' 2024-08-18T22:42:00.329 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:42:00 smithi195 ceph-mon[23370]: from='mgr.24377 ' entity='mgr.smithi195.acttsj' 2024-08-18T22:42:00.329 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:42:00 smithi195 ceph-mon[23370]: pgmap v14: 65 pgs: 65 active+clean; 4.0 GiB data, 13 GiB used, 523 GiB / 536 GiB avail; 114 MiB/s rd, 263 MiB/s wr, 596 op/s 2024-08-18T22:42:00.329 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:42:00 smithi195 ceph-mon[23370]: from='mgr.24377 ' entity='mgr.smithi195.acttsj' 2024-08-18T22:42:00.329 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:42:00 smithi195 ceph-mon[23370]: from='mgr.24377 ' entity='mgr.smithi195.acttsj' 2024-08-18T22:42:00.334 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:42:00 smithi121 ceph-mon[16788]: from='mgr.24377 ' entity='mgr.smithi195.acttsj' 2024-08-18T22:42:00.334 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:42:00 smithi121 ceph-mon[16788]: from='mgr.24377 ' entity='mgr.smithi195.acttsj' 2024-08-18T22:42:00.334 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:42:00 smithi121 ceph-mon[16788]: pgmap v14: 65 pgs: 65 active+clean; 4.0 GiB data, 13 GiB used, 523 GiB / 536 GiB avail; 114 MiB/s rd, 263 MiB/s wr, 596 op/s 2024-08-18T22:42:00.334 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:42:00 smithi121 ceph-mon[16788]: from='mgr.24377 ' entity='mgr.smithi195.acttsj' 2024-08-18T22:42:00.334 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:42:00 smithi121 ceph-mon[16788]: from='mgr.24377 ' entity='mgr.smithi195.acttsj' 2024-08-18T22:42:00.366 INFO:tasks.workunit.client.1.smithi195.stdout:2/936: sync 2024-08-18T22:42:00.367 INFO:tasks.workunit.client.1.smithi195.stdout:4/989: sync 2024-08-18T22:42:00.370 INFO:tasks.workunit.client.1.smithi195.stdout:4/990: write d0/d7/d1d/d69/db7/d3b/f131 [738836,77923] 0 2024-08-18T22:42:00.371 INFO:tasks.workunit.client.1.smithi195.stdout:4/991: write d0/d99/d85/dc8/f124 [1026356,82709] 0 2024-08-18T22:42:00.375 INFO:tasks.workunit.client.1.smithi195.stdout:4/992: mknod d0/d7/d1d/d69/db7/d3b/d120/d54/c159 0 2024-08-18T22:42:00.376 INFO:tasks.workunit.client.1.smithi195.stdout:4/993: mkdir d0/d7/d1d/d69/db4/d15a 0 2024-08-18T22:42:00.385 INFO:tasks.workunit.client.1.smithi195.stdout:4/994: dread d0/d99/d98/f18 [0,4194304] 0 2024-08-18T22:42:00.387 INFO:tasks.workunit.client.1.smithi195.stdout:4/995: read d0/d7/d1d/d69/db7/d3b/d120/d94/db2/da4/f106 [76214,17662] 0 2024-08-18T22:42:00.389 INFO:tasks.workunit.client.1.smithi195.stdout:4/996: write d0/d7/d1d/d69/db4/f145 [949019,42441] 0 2024-08-18T22:42:00.393 INFO:tasks.workunit.client.1.smithi195.stdout:4/997: getdents d0/d7/d1d 0 2024-08-18T22:42:00.399 INFO:tasks.workunit.client.1.smithi195.stdout:4/998: dwrite d0/d7/d1d/d69/db4/f111 [0,4194304] 0 2024-08-18T22:42:00.404 INFO:tasks.workunit.client.1.smithi195.stdout:4/999: getdents d0/d7/d1d/d69/db7/d3b/d6f/db0 0 2024-08-18T22:42:00.557 INFO:tasks.workunit.client.1.smithi195.stdout:2/937: sync 2024-08-18T22:42:00.560 INFO:tasks.workunit.client.1.smithi195.stdout:2/938: dread d1/d24/d26/d42/d5c/fe1 [0,4194304] 0 2024-08-18T22:42:00.562 INFO:tasks.workunit.client.1.smithi195.stdout:2/939: dread d1/fa1 [0,4194304] 0 2024-08-18T22:42:00.562 INFO:tasks.workunit.client.1.smithi195.stdout:2/940: chown d1/d8/d27/f3a 566026 1 2024-08-18T22:42:00.563 INFO:tasks.workunit.client.1.smithi195.stdout:2/941: write d1/d24/d26/d42/d44/f57 [2955172,85170] 0 2024-08-18T22:42:00.564 INFO:tasks.workunit.client.1.smithi195.stdout:2/942: truncate d1/d22/d65/ff3 307785 0 2024-08-18T22:42:00.584 INFO:tasks.workunit.client.1.smithi195.stdout:2/943: truncate d1/d24/f60 3202004 0 2024-08-18T22:42:00.586 INFO:tasks.workunit.client.1.smithi195.stdout:2/944: getdents d1/d22 0 2024-08-18T22:42:00.592 INFO:tasks.workunit.client.1.smithi195.stdout:2/945: dwrite d1/d24/d26/d42/d72/fcb [0,4194304] 0 2024-08-18T22:42:00.593 INFO:tasks.workunit.client.1.smithi195.stdout:2/946: chown d1/d24/lc8 784657 1 2024-08-18T22:42:00.594 INFO:tasks.workunit.client.1.smithi195.stdout:2/947: chown d1/d24/cc0 216753107 1 2024-08-18T22:42:00.597 INFO:tasks.workunit.client.1.smithi195.stdout:2/948: write d1/d24/d26/d42/f4c [1196050,96764] 0 2024-08-18T22:42:00.598 INFO:tasks.workunit.client.1.smithi195.stdout:2/949: dread - d1/d24/d26/d83/f107 zero size 2024-08-18T22:42:00.784 INFO:tasks.workunit.client.1.smithi195.stdout:2/950: sync 2024-08-18T22:42:00.786 INFO:tasks.workunit.client.1.smithi195.stdout:2/951: symlink d1/d22/d65/dec/l12d 0 2024-08-18T22:42:00.788 INFO:tasks.workunit.client.1.smithi195.stdout:2/952: mknod d1/d24/d26/d42/c12e 0 2024-08-18T22:42:00.789 INFO:tasks.workunit.client.1.smithi195.stdout:2/953: creat d1/d22/d65/d12a/f12f x:0 0 0 2024-08-18T22:42:00.791 INFO:tasks.workunit.client.1.smithi195.stdout:2/954: creat d1/d24/d26/d42/f130 x:0 0 0 2024-08-18T22:42:00.793 INFO:tasks.workunit.client.1.smithi195.stdout:2/955: mkdir d1/d24/d26/d83/d131 0 2024-08-18T22:42:00.796 INFO:tasks.workunit.client.1.smithi195.stdout:2/956: truncate d1/d24/d26/d42/d5c/fe1 1011180 0 2024-08-18T22:42:00.797 INFO:tasks.workunit.client.1.smithi195.stdout:2/957: rmdir d1/d24/d26/d42/d72/d85/de3 39 2024-08-18T22:42:00.799 INFO:tasks.workunit.client.1.smithi195.stdout:2/958: getdents d1/d24/d26/d83/d131 0 2024-08-18T22:42:00.809 INFO:tasks.workunit.client.1.smithi195.stdout:2/959: dread d1/d24/f34 [0,4194304] 0 2024-08-18T22:42:00.823 INFO:tasks.workunit.client.1.smithi195.stdout:2/960: dread d1/d24/d26/d42/d44/d87/d8e/fe7 [0,4194304] 0 2024-08-18T22:42:00.825 INFO:tasks.workunit.client.1.smithi195.stdout:2/961: mknod d1/d24/d127/c132 0 2024-08-18T22:42:00.826 INFO:tasks.workunit.client.1.smithi195.stdout:2/962: symlink d1/d24/d26/l133 0 2024-08-18T22:42:00.835 INFO:tasks.workunit.client.1.smithi195.stdout:2/963: dwrite d1/f10 [0,4194304] 0 2024-08-18T22:42:00.852 INFO:tasks.workunit.client.1.smithi195.stdout:2/964: dread d1/d8/fa5 [0,4194304] 0 2024-08-18T22:42:00.852 INFO:tasks.workunit.client.1.smithi195.stdout:2/965: chown d1/d22/d65/dec/df7 20845714 1 2024-08-18T22:42:00.853 INFO:tasks.workunit.client.1.smithi195.stdout:2/966: dread - d1/d24/d26/d42/f106 zero size 2024-08-18T22:42:00.856 INFO:tasks.workunit.client.1.smithi195.stdout:2/967: creat d1/d22/d65/f134 x:0 0 0 2024-08-18T22:42:00.860 INFO:tasks.workunit.client.1.smithi195.stdout:2/968: dread d1/d24/f73 [0,4194304] 0 2024-08-18T22:42:00.865 INFO:tasks.workunit.client.1.smithi195.stdout:2/969: dwrite d1/d24/d26/d42/d50/f52 [0,4194304] 0 2024-08-18T22:42:00.866 INFO:tasks.workunit.client.1.smithi195.stdout:2/970: write d1/d24/d26/d42/d5c/fbe [3177136,56083] 0 2024-08-18T22:42:00.868 INFO:tasks.workunit.client.1.smithi195.stdout:2/971: write d1/d24/d26/d42/d44/d87/fa0 [3389359,26278] 0 2024-08-18T22:42:00.873 INFO:tasks.workunit.client.1.smithi195.stdout:2/972: link d1/d22/f6d d1/d24/d26/d42/d72/f135 0 2024-08-18T22:42:00.891 INFO:tasks.workunit.client.1.smithi195.stdout:2/973: dread d1/f124 [0,4194304] 0 2024-08-18T22:42:00.893 INFO:tasks.workunit.client.1.smithi195.stdout:2/974: mknod d1/d24/d26/d42/d44/d87/d8e/c136 0 2024-08-18T22:42:00.894 INFO:tasks.workunit.client.1.smithi195.stdout:2/975: creat d1/d24/d26/d83/d117/f137 x:0 0 0 2024-08-18T22:42:00.895 INFO:tasks.workunit.client.1.smithi195.stdout:2/976: creat d1/d97/f138 x:0 0 0 2024-08-18T22:42:00.901 INFO:tasks.workunit.client.1.smithi195.stdout:2/977: dwrite d1/f124 [0,4194304] 0 2024-08-18T22:42:00.909 INFO:tasks.workunit.client.1.smithi195.stdout:2/978: dread d1/d24/d26/d83/fc7 [0,4194304] 0 2024-08-18T22:42:00.910 INFO:tasks.workunit.client.1.smithi195.stdout:2/979: write d1/d22/d65/f134 [808381,38823] 0 2024-08-18T22:42:00.914 INFO:tasks.workunit.client.1.smithi195.stdout:2/980: dread d1/d8/d3d/d3b/d7d/f95 [0,4194304] 0 2024-08-18T22:42:00.917 INFO:tasks.workunit.client.1.smithi195.stdout:2/981: creat d1/d97/f139 x:0 0 0 2024-08-18T22:42:00.920 INFO:tasks.workunit.client.1.smithi195.stdout:2/982: mkdir d1/d8/d3d/d3b/d53/d128/d13a 0 2024-08-18T22:42:00.922 INFO:tasks.workunit.client.1.smithi195.stdout:2/983: creat d1/d8/f13b x:0 0 0 2024-08-18T22:42:00.923 INFO:tasks.workunit.client.1.smithi195.stdout:2/984: chown d1/d97/f138 422302 1 2024-08-18T22:42:00.924 INFO:tasks.workunit.client.1.smithi195.stdout:2/985: read d1/d8/d3d/d3b/d7d/f82 [2745719,69260] 0 2024-08-18T22:42:00.933 INFO:tasks.workunit.client.1.smithi195.stdout:2/986: dread d1/d8/d27/fb7 [0,4194304] 0 2024-08-18T22:42:00.934 INFO:tasks.workunit.client.1.smithi195.stdout:2/987: symlink d1/d24/d26/dd9/l13c 0 2024-08-18T22:42:00.935 INFO:tasks.workunit.client.1.smithi195.stdout:2/988: symlink d1/d24/d26/d42/d72/d85/da9/l13d 0 2024-08-18T22:42:00.936 INFO:tasks.workunit.client.1.smithi195.stdout:2/989: chown d1/d24/f56 130909 1 2024-08-18T22:42:00.936 INFO:tasks.workunit.client.1.smithi195.stdout:2/990: chown d1/d97/c9e 41723661 1 2024-08-18T22:42:00.938 INFO:tasks.workunit.client.1.smithi195.stdout:2/991: rename d1/d8/c1e to d1/d8/d3d/d3b/d53/d128/c13e 0 2024-08-18T22:42:00.950 INFO:tasks.workunit.client.1.smithi195.stdout:2/992: dwrite d1/d8/d3d/d6c/f98 [0,4194304] 0 2024-08-18T22:42:00.951 INFO:tasks.workunit.client.1.smithi195.stdout:2/993: write d1/d24/d26/d42/d44/d87/d8e/fe7 [5328658,75295] 0 2024-08-18T22:42:00.951 INFO:tasks.workunit.client.1.smithi195.stdout:2/994: readlink d1/l11b 0 2024-08-18T22:42:01.097 INFO:tasks.workunit.client.1.smithi195.stdout:2/995: sync 2024-08-18T22:42:01.098 INFO:tasks.workunit.client.1.smithi195.stdout:2/996: write d1/d24/d26/d42/d72/d85/f68 [4468009,88312] 0 2024-08-18T22:42:01.099 INFO:tasks.workunit.client.1.smithi195.stdout:2/997: write d1/d22/d65/d12a/f12f [623496,9851] 0 2024-08-18T22:42:01.101 INFO:tasks.workunit.client.1.smithi195.stdout:2/998: fdatasync d1/f1b 0 2024-08-18T22:42:01.103 INFO:tasks.workunit.client.1.smithi195.stdout:2/999: write d1/d24/d26/d42/d44/fcd [191431,41740] 0 2024-08-18T22:42:01.107 INFO:tasks.workunit.client.1.smithi195.stderr:+ rm -rf -- ./tmp.Jv9LMPp3wl 2024-08-18T22:42:03.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:42:02 smithi121 ceph-mon[16788]: pgmap v15: 65 pgs: 65 active+clean; 4.0 GiB data, 13 GiB used, 523 GiB / 536 GiB avail; 62 MiB/s rd, 135 MiB/s wr, 329 op/s 2024-08-18T22:42:03.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:42:02 smithi195 ceph-mon[23370]: pgmap v15: 65 pgs: 65 active+clean; 4.0 GiB data, 13 GiB used, 523 GiB / 536 GiB avail; 62 MiB/s rd, 135 MiB/s wr, 329 op/s 2024-08-18T22:42:05.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:42:04 smithi121 ceph-mon[16788]: pgmap v16: 65 pgs: 65 active+clean; 4.0 GiB data, 13 GiB used, 523 GiB / 536 GiB avail; 62 MiB/s rd, 135 MiB/s wr, 329 op/s 2024-08-18T22:42:05.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:42:04 smithi121 ceph-mon[16788]: from='mgr.24377 ' entity='mgr.smithi195.acttsj' 2024-08-18T22:42:05.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:42:04 smithi121 ceph-mon[16788]: from='mgr.24377 ' entity='mgr.smithi195.acttsj' 2024-08-18T22:42:05.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:42:04 smithi121 ceph-mon[16788]: from='mgr.24377 172.21.15.195:0/2331273060' entity='mgr.smithi195.acttsj' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-08-18T22:42:05.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:42:04 smithi121 ceph-mon[16788]: from='mgr.24377 ' entity='mgr.smithi195.acttsj' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-08-18T22:42:05.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:42:04 smithi121 ceph-mon[16788]: from='mgr.24377 172.21.15.195:0/2331273060' entity='mgr.smithi195.acttsj' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-08-18T22:42:05.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:42:04 smithi121 ceph-mon[16788]: from='mgr.24377 ' entity='mgr.smithi195.acttsj' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-08-18T22:42:05.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:42:04 smithi121 ceph-mon[16788]: from='mgr.24377 172.21.15.195:0/2331273060' entity='mgr.smithi195.acttsj' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-08-18T22:42:05.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:42:04 smithi121 ceph-mon[16788]: from='mgr.24377 ' entity='mgr.smithi195.acttsj' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-08-18T22:42:05.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:42:04 smithi121 ceph-mon[16788]: from='mgr.24377 ' entity='mgr.smithi195.acttsj' 2024-08-18T22:42:05.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:42:04 smithi121 ceph-mon[16788]: from='mgr.24377 172.21.15.195:0/2331273060' entity='mgr.smithi195.acttsj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:42:05.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:42:04 smithi121 ceph-mon[16788]: from='mgr.24377 172.21.15.195:0/2331273060' entity='mgr.smithi195.acttsj' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-18T22:42:05.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:42:04 smithi195 ceph-mon[23370]: pgmap v16: 65 pgs: 65 active+clean; 4.0 GiB data, 13 GiB used, 523 GiB / 536 GiB avail; 62 MiB/s rd, 135 MiB/s wr, 329 op/s 2024-08-18T22:42:05.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:42:04 smithi195 ceph-mon[23370]: from='mgr.24377 ' entity='mgr.smithi195.acttsj' 2024-08-18T22:42:05.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:42:04 smithi195 ceph-mon[23370]: from='mgr.24377 ' entity='mgr.smithi195.acttsj' 2024-08-18T22:42:05.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:42:04 smithi195 ceph-mon[23370]: from='mgr.24377 172.21.15.195:0/2331273060' entity='mgr.smithi195.acttsj' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-08-18T22:42:05.160 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:42:04 smithi195 ceph-mon[23370]: from='mgr.24377 ' entity='mgr.smithi195.acttsj' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-08-18T22:42:05.160 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:42:04 smithi195 ceph-mon[23370]: from='mgr.24377 172.21.15.195:0/2331273060' entity='mgr.smithi195.acttsj' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-08-18T22:42:05.160 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:42:04 smithi195 ceph-mon[23370]: from='mgr.24377 ' entity='mgr.smithi195.acttsj' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-08-18T22:42:05.160 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:42:04 smithi195 ceph-mon[23370]: from='mgr.24377 172.21.15.195:0/2331273060' entity='mgr.smithi195.acttsj' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-08-18T22:42:05.160 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:42:04 smithi195 ceph-mon[23370]: from='mgr.24377 ' entity='mgr.smithi195.acttsj' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-08-18T22:42:05.160 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:42:04 smithi195 ceph-mon[23370]: from='mgr.24377 ' entity='mgr.smithi195.acttsj' 2024-08-18T22:42:05.160 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:42:04 smithi195 ceph-mon[23370]: from='mgr.24377 172.21.15.195:0/2331273060' entity='mgr.smithi195.acttsj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:42:05.160 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:42:04 smithi195 ceph-mon[23370]: from='mgr.24377 172.21.15.195:0/2331273060' entity='mgr.smithi195.acttsj' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-18T22:42:06.068 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:42:05 smithi121 ceph-mon[16788]: Adjusting osd_memory_target on smithi195 to 2581M 2024-08-18T22:42:06.068 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:42:05 smithi121 ceph-mon[16788]: Updating smithi121:/etc/ceph/ceph.conf 2024-08-18T22:42:06.068 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:42:05 smithi121 ceph-mon[16788]: Updating smithi195:/etc/ceph/ceph.conf 2024-08-18T22:42:06.068 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:42:05 smithi121 ceph-mon[16788]: Updating smithi121:/var/lib/ceph/b003123a-5db1-11ef-bccf-c7b262605968/config/ceph.conf 2024-08-18T22:42:06.068 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:42:05 smithi121 ceph-mon[16788]: Updating smithi195:/var/lib/ceph/b003123a-5db1-11ef-bccf-c7b262605968/config/ceph.conf 2024-08-18T22:42:06.068 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:42:05 smithi121 ceph-mon[16788]: Updating smithi121:/etc/ceph/ceph.client.admin.keyring 2024-08-18T22:42:06.068 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:42:05 smithi121 ceph-mon[16788]: Updating smithi195:/etc/ceph/ceph.client.admin.keyring 2024-08-18T22:42:06.069 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:42:05 smithi121 ceph-mon[16788]: from='mgr.24377 ' entity='mgr.smithi195.acttsj' 2024-08-18T22:42:06.069 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:42:05 smithi121 ceph-mon[16788]: from='mgr.24377 ' entity='mgr.smithi195.acttsj' 2024-08-18T22:42:06.069 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:42:05 smithi121 ceph-mon[16788]: from='mgr.24377 ' entity='mgr.smithi195.acttsj' 2024-08-18T22:42:06.069 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:42:05 smithi121 ceph-mon[16788]: from='mgr.24377 ' entity='mgr.smithi195.acttsj' 2024-08-18T22:42:06.069 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:42:05 smithi121 ceph-mon[16788]: from='mgr.24377 ' entity='mgr.smithi195.acttsj' 2024-08-18T22:42:06.069 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:42:05 smithi121 ceph-mon[16788]: from='mgr.24377 ' entity='mgr.smithi195.acttsj' 2024-08-18T22:42:06.069 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:42:05 smithi121 ceph-mon[16788]: from='mgr.24377 ' entity='mgr.smithi195.acttsj' 2024-08-18T22:42:06.069 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:42:05 smithi121 ceph-mon[16788]: from='mgr.24377 ' entity='mgr.smithi195.acttsj' 2024-08-18T22:42:06.069 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:42:05 smithi121 ceph-mon[16788]: from='mgr.24377 ' entity='mgr.smithi195.acttsj' 2024-08-18T22:42:06.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:42:05 smithi195 ceph-mon[23370]: Adjusting osd_memory_target on smithi195 to 2581M 2024-08-18T22:42:06.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:42:05 smithi195 ceph-mon[23370]: Updating smithi121:/etc/ceph/ceph.conf 2024-08-18T22:42:06.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:42:05 smithi195 ceph-mon[23370]: Updating smithi195:/etc/ceph/ceph.conf 2024-08-18T22:42:06.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:42:05 smithi195 ceph-mon[23370]: Updating smithi121:/var/lib/ceph/b003123a-5db1-11ef-bccf-c7b262605968/config/ceph.conf 2024-08-18T22:42:06.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:42:05 smithi195 ceph-mon[23370]: Updating smithi195:/var/lib/ceph/b003123a-5db1-11ef-bccf-c7b262605968/config/ceph.conf 2024-08-18T22:42:06.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:42:05 smithi195 ceph-mon[23370]: Updating smithi121:/etc/ceph/ceph.client.admin.keyring 2024-08-18T22:42:06.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:42:05 smithi195 ceph-mon[23370]: Updating smithi195:/etc/ceph/ceph.client.admin.keyring 2024-08-18T22:42:06.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:42:05 smithi195 ceph-mon[23370]: from='mgr.24377 ' entity='mgr.smithi195.acttsj' 2024-08-18T22:42:06.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:42:05 smithi195 ceph-mon[23370]: from='mgr.24377 ' entity='mgr.smithi195.acttsj' 2024-08-18T22:42:06.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:42:05 smithi195 ceph-mon[23370]: from='mgr.24377 ' entity='mgr.smithi195.acttsj' 2024-08-18T22:42:06.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:42:05 smithi195 ceph-mon[23370]: from='mgr.24377 ' entity='mgr.smithi195.acttsj' 2024-08-18T22:42:06.160 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:42:05 smithi195 ceph-mon[23370]: from='mgr.24377 ' entity='mgr.smithi195.acttsj' 2024-08-18T22:42:06.160 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:42:05 smithi195 ceph-mon[23370]: from='mgr.24377 ' entity='mgr.smithi195.acttsj' 2024-08-18T22:42:06.160 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:42:05 smithi195 ceph-mon[23370]: from='mgr.24377 ' entity='mgr.smithi195.acttsj' 2024-08-18T22:42:06.160 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:42:05 smithi195 ceph-mon[23370]: from='mgr.24377 ' entity='mgr.smithi195.acttsj' 2024-08-18T22:42:06.160 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:42:05 smithi195 ceph-mon[23370]: from='mgr.24377 ' entity='mgr.smithi195.acttsj' 2024-08-18T22:42:07.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:42:06 smithi121 ceph-mon[16788]: Updating smithi121:/var/lib/ceph/b003123a-5db1-11ef-bccf-c7b262605968/config/ceph.client.admin.keyring 2024-08-18T22:42:07.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:42:06 smithi121 ceph-mon[16788]: Updating smithi195:/var/lib/ceph/b003123a-5db1-11ef-bccf-c7b262605968/config/ceph.client.admin.keyring 2024-08-18T22:42:07.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:42:06 smithi121 ceph-mon[16788]: Reconfiguring node-exporter.smithi121 (dependencies changed)... 2024-08-18T22:42:07.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:42:06 smithi121 ceph-mon[16788]: Reconfiguring daemon node-exporter.smithi121 on smithi121 2024-08-18T22:42:07.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:42:06 smithi121 ceph-mon[16788]: pgmap v17: 65 pgs: 65 active+clean; 3.9 GiB data, 13 GiB used, 524 GiB / 536 GiB avail; 68 MiB/s rd, 148 MiB/s wr, 404 op/s 2024-08-18T22:42:07.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:42:06 smithi195 ceph-mon[23370]: Updating smithi121:/var/lib/ceph/b003123a-5db1-11ef-bccf-c7b262605968/config/ceph.client.admin.keyring 2024-08-18T22:42:07.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:42:06 smithi195 ceph-mon[23370]: Updating smithi195:/var/lib/ceph/b003123a-5db1-11ef-bccf-c7b262605968/config/ceph.client.admin.keyring 2024-08-18T22:42:07.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:42:06 smithi195 ceph-mon[23370]: Reconfiguring node-exporter.smithi121 (dependencies changed)... 2024-08-18T22:42:07.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:42:06 smithi195 ceph-mon[23370]: Reconfiguring daemon node-exporter.smithi121 on smithi121 2024-08-18T22:42:07.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:42:06 smithi195 ceph-mon[23370]: pgmap v17: 65 pgs: 65 active+clean; 3.9 GiB data, 13 GiB used, 524 GiB / 536 GiB avail; 68 MiB/s rd, 148 MiB/s wr, 404 op/s 2024-08-18T22:42:08.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:42:08 smithi195 ceph-mon[23370]: from='mgr.24377 ' entity='mgr.smithi195.acttsj' 2024-08-18T22:42:08.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:42:08 smithi195 ceph-mon[23370]: from='mgr.24377 ' entity='mgr.smithi195.acttsj' 2024-08-18T22:42:08.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:42:08 smithi195 ceph-mon[23370]: Reconfiguring alertmanager.smithi121 (dependencies changed)... 2024-08-18T22:42:08.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:42:08 smithi195 ceph-mon[23370]: Reconfiguring daemon alertmanager.smithi121 on smithi121 2024-08-18T22:42:08.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:42:08 smithi195 ceph-mon[23370]: pgmap v18: 65 pgs: 65 active+clean; 3.9 GiB data, 13 GiB used, 524 GiB / 536 GiB avail; 32 MiB/s rd, 73 MiB/s wr, 217 op/s 2024-08-18T22:42:08.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:42:08 smithi195 ceph-mon[23370]: from='mgr.24377 172.21.15.195:0/2331273060' entity='mgr.smithi195.acttsj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-18T22:42:09.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:42:08 smithi121 ceph-mon[16788]: from='mgr.24377 ' entity='mgr.smithi195.acttsj' 2024-08-18T22:42:09.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:42:08 smithi121 ceph-mon[16788]: from='mgr.24377 ' entity='mgr.smithi195.acttsj' 2024-08-18T22:42:09.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:42:08 smithi121 ceph-mon[16788]: Reconfiguring alertmanager.smithi121 (dependencies changed)... 2024-08-18T22:42:09.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:42:08 smithi121 ceph-mon[16788]: Reconfiguring daemon alertmanager.smithi121 on smithi121 2024-08-18T22:42:09.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:42:08 smithi121 ceph-mon[16788]: pgmap v18: 65 pgs: 65 active+clean; 3.9 GiB data, 13 GiB used, 524 GiB / 536 GiB avail; 32 MiB/s rd, 73 MiB/s wr, 217 op/s 2024-08-18T22:42:09.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:42:08 smithi121 ceph-mon[16788]: from='mgr.24377 172.21.15.195:0/2331273060' entity='mgr.smithi195.acttsj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-18T22:42:10.646 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-08-18T22:42:10.646 DEBUG:teuthology.orchestra.run.smithi195:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.1/client.1/tmp 2024-08-18T22:42:11.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:42:10 smithi121 ceph-mon[16788]: pgmap v19: 65 pgs: 65 active+clean; 3.1 GiB data, 11 GiB used, 526 GiB / 536 GiB avail; 32 MiB/s rd, 73 MiB/s wr, 289 op/s 2024-08-18T22:42:11.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:42:10 smithi195 ceph-mon[23370]: pgmap v19: 65 pgs: 65 active+clean; 3.1 GiB data, 11 GiB used, 526 GiB / 536 GiB avail; 32 MiB/s rd, 73 MiB/s wr, 289 op/s 2024-08-18T22:42:12.391 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:12.387+0000 7f8976fcd640 1 -- 172.21.15.121:0/1632463877 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f89700fe320 msgr2=0x7f89700fa480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:42:12.391 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:12.387+0000 7f8976fcd640 1 --2- 172.21.15.121:0/1632463877 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f89700fe320 0x7f89700fa480 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f89600048d0 tx=0x7f8960009da0 comp rx=0 tx=0).stop 2024-08-18T22:42:12.391 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:12.387+0000 7f8976fcd640 1 -- 172.21.15.121:0/1632463877 shutdown_connections 2024-08-18T22:42:12.391 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:12.387+0000 7f8976fcd640 1 --2- 172.21.15.121:0/1632463877 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f89700fe320 0x7f89700fa480 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:42:12.391 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:12.387+0000 7f8976fcd640 1 --2- 172.21.15.121:0/1632463877 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f89700fd9d0 0x7f89700fdde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:42:12.391 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:12.387+0000 7f8976fcd640 1 -- 172.21.15.121:0/1632463877 >> 172.21.15.121:0/1632463877 conn(0x7f89700f6130 msgr2=0x7f89700f8540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:42:12.391 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:12.387+0000 7f8976fcd640 1 -- 172.21.15.121:0/1632463877 shutdown_connections 2024-08-18T22:42:12.391 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:12.387+0000 7f8976fcd640 1 -- 172.21.15.121:0/1632463877 wait complete. 2024-08-18T22:42:12.391 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:12.388+0000 7f8976fcd640 1 Processor -- start 2024-08-18T22:42:12.391 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:12.388+0000 7f8976fcd640 1 -- start start 2024-08-18T22:42:12.392 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:12.388+0000 7f8976fcd640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f89700fd9d0 0x7f897010cef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:42:12.392 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:12.388+0000 7f8976fcd640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f89700fe320 0x7f897010d430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:42:12.392 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:12.388+0000 7f8976fcd640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f897010e160 con 0x7f89700fe320 2024-08-18T22:42:12.392 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:12.388+0000 7f8976fcd640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f897010e2d0 con 0x7f89700fd9d0 2024-08-18T22:42:12.392 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:12.388+0000 7f896ffff640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f89700fe320 0x7f897010d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:42:12.392 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:12.388+0000 7f8974d69640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f89700fd9d0 0x7f897010cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:42:12.392 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:12.388+0000 7f896ffff640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f89700fe320 0x7f897010d430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:51150/0 (socket says 172.21.15.121:51150) 2024-08-18T22:42:12.392 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:12.389+0000 7f896ffff640 1 -- 172.21.15.121:0/2520852859 learned_addr learned my addr 172.21.15.121:0/2520852859 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-18T22:42:12.392 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:12.389+0000 7f896ffff640 1 -- 172.21.15.121:0/2520852859 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f89700fd9d0 msgr2=0x7f897010cef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:42:12.392 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:12.389+0000 7f896ffff640 1 --2- 172.21.15.121:0/2520852859 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f89700fd9d0 0x7f897010cef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:42:12.392 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:12.389+0000 7f896ffff640 1 -- 172.21.15.121:0/2520852859 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8960005040 con 0x7f89700fe320 2024-08-18T22:42:12.392 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:12.389+0000 7f8974d69640 1 --2- 172.21.15.121:0/2520852859 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f89700fd9d0 0x7f897010cef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:42:12.392 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:12.389+0000 7f896ffff640 1 --2- 172.21.15.121:0/2520852859 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f89700fe320 0x7f897010d430 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f896002d040 tx=0x7f8960009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:42:12.393 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:12.389+0000 7f896d7fa640 1 -- 172.21.15.121:0/2520852859 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8960038070 con 0x7f89700fe320 2024-08-18T22:42:12.393 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:12.389+0000 7f8976fcd640 1 -- 172.21.15.121:0/2520852859 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f897010e550 con 0x7f89700fe320 2024-08-18T22:42:12.393 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:12.389+0000 7f896d7fa640 1 -- 172.21.15.121:0/2520852859 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f896002ae90 con 0x7f89700fe320 2024-08-18T22:42:12.393 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:12.389+0000 7f896d7fa640 1 -- 172.21.15.121:0/2520852859 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f896003e670 con 0x7f89700fe320 2024-08-18T22:42:12.393 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:12.389+0000 7f8976fcd640 1 -- 172.21.15.121:0/2520852859 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f897010eaf0 con 0x7f89700fe320 2024-08-18T22:42:12.394 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:12.390+0000 7f8966ffd640 1 -- 172.21.15.121:0/2520852859 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8954005210 con 0x7f89700fe320 2024-08-18T22:42:12.394 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:12.391+0000 7f896d7fa640 1 -- 172.21.15.121:0/2520852859 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 25) v1 ==== 88617+0+0 (secure 0 0 0) 0x7f8960030020 con 0x7f89700fe320 2024-08-18T22:42:12.394 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:12.391+0000 7f896d7fa640 1 --2- 172.21.15.121:0/2520852859 >> [v2:172.21.15.195:6828/1174410756,v1:172.21.15.195:6829/1174410756] conn(0x7f895c06a6d0 0x7f895c06cb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:42:12.394 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:12.391+0000 7f896d7fa640 1 -- 172.21.15.121:0/2520852859 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f89600a9080 con 0x7f89700fe320 2024-08-18T22:42:12.394 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:12.391+0000 7f8974d69640 1 --2- 172.21.15.121:0/2520852859 >> [v2:172.21.15.195:6828/1174410756,v1:172.21.15.195:6829/1174410756] conn(0x7f895c06a6d0 0x7f895c06cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:42:12.394 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:12.392+0000 7f8974d69640 1 --2- 172.21.15.121:0/2520852859 >> [v2:172.21.15.195:6828/1174410756,v1:172.21.15.195:6829/1174410756] conn(0x7f895c06a6d0 0x7f895c06cb80 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f8968004fd0 tx=0x7f896800b040 comp rx=0 tx=0).ready entity=mgr.24377 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:42:12.396 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:12.396+0000 7f896d7fa640 1 -- 172.21.15.121:0/2520852859 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7f8960072d00 con 0x7f89700fe320 2024-08-18T22:42:12.587 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:12.586+0000 7f8966ffd640 1 -- 172.21.15.121:0/2520852859 --> [v2:172.21.15.195:6828/1174410756,v1:172.21.15.195:6829/1174410756] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f8954000bc0 con 0x7f895c06a6d0 2024-08-18T22:42:12.588 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:12.587+0000 7f896d7fa640 1 -- 172.21.15.121:0/2520852859 <== mgr.24377 v2:172.21.15.195:6828/1174410756 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+318 (secure 0 0 0) 0x7f8954000bc0 con 0x7f895c06a6d0 2024-08-18T22:42:12.590 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:12.589+0000 7f8966ffd640 1 -- 172.21.15.121:0/2520852859 >> [v2:172.21.15.195:6828/1174410756,v1:172.21.15.195:6829/1174410756] conn(0x7f895c06a6d0 msgr2=0x7f895c06cb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:42:12.590 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:12.589+0000 7f8966ffd640 1 --2- 172.21.15.121:0/2520852859 >> [v2:172.21.15.195:6828/1174410756,v1:172.21.15.195:6829/1174410756] conn(0x7f895c06a6d0 0x7f895c06cb80 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f8968004fd0 tx=0x7f896800b040 comp rx=0 tx=0).stop 2024-08-18T22:42:12.591 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:12.589+0000 7f8966ffd640 1 -- 172.21.15.121:0/2520852859 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f89700fe320 msgr2=0x7f897010d430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:42:12.591 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:12.589+0000 7f8966ffd640 1 --2- 172.21.15.121:0/2520852859 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f89700fe320 0x7f897010d430 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f896002d040 tx=0x7f8960009da0 comp rx=0 tx=0).stop 2024-08-18T22:42:12.591 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:12.589+0000 7f8966ffd640 1 -- 172.21.15.121:0/2520852859 shutdown_connections 2024-08-18T22:42:12.591 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:12.589+0000 7f8966ffd640 1 --2- 172.21.15.121:0/2520852859 >> [v2:172.21.15.195:6828/1174410756,v1:172.21.15.195:6829/1174410756] conn(0x7f895c06a6d0 0x7f895c06cb80 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:42:12.591 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:12.589+0000 7f8966ffd640 1 --2- 172.21.15.121:0/2520852859 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f89700fe320 0x7f897010d430 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:42:12.591 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:12.589+0000 7f8966ffd640 1 --2- 172.21.15.121:0/2520852859 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f89700fd9d0 0x7f897010cef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:42:12.591 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:12.589+0000 7f8966ffd640 1 -- 172.21.15.121:0/2520852859 >> 172.21.15.121:0/2520852859 conn(0x7f89700f6130 msgr2=0x7f89700f7890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:42:12.591 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:12.589+0000 7f8966ffd640 1 -- 172.21.15.121:0/2520852859 shutdown_connections 2024-08-18T22:42:12.591 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:12.589+0000 7f8966ffd640 1 -- 172.21.15.121:0/2520852859 wait complete. 2024-08-18T22:42:12.599 INFO:teuthology.orchestra.run.smithi121.stdout:true 2024-08-18T22:42:12.673 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:12.671+0000 7f7996cad640 1 -- 172.21.15.121:0/3418473291 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f79900fc4a0 msgr2=0x7f79900fc910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:42:12.673 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:12.671+0000 7f7996cad640 1 --2- 172.21.15.121:0/3418473291 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f79900fc4a0 0x7f79900fc910 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f797c0048d0 tx=0x7f797c009da0 comp rx=0 tx=0).stop 2024-08-18T22:42:12.673 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:12.671+0000 7f7996cad640 1 -- 172.21.15.121:0/3418473291 shutdown_connections 2024-08-18T22:42:12.673 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:12.671+0000 7f7996cad640 1 --2- 172.21.15.121:0/3418473291 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f79900fc4a0 0x7f79900fc910 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:42:12.673 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:12.671+0000 7f7996cad640 1 --2- 172.21.15.121:0/3418473291 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f79900fb1d0 0x7f79900fb5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:42:12.673 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:12.671+0000 7f7996cad640 1 -- 172.21.15.121:0/3418473291 >> 172.21.15.121:0/3418473291 conn(0x7f79900f69b0 msgr2=0x7f79900f8dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:42:12.673 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:12.671+0000 7f7996cad640 1 -- 172.21.15.121:0/3418473291 shutdown_connections 2024-08-18T22:42:12.673 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:12.671+0000 7f7996cad640 1 -- 172.21.15.121:0/3418473291 wait complete. 2024-08-18T22:42:12.673 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:12.672+0000 7f7996cad640 1 Processor -- start 2024-08-18T22:42:12.674 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:12.672+0000 7f7996cad640 1 -- start start 2024-08-18T22:42:12.675 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:12.672+0000 7f7996cad640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f79900fb1d0 0x7f799010ce50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:42:12.676 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:12.672+0000 7f7996cad640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f79900fc4a0 0x7f799010d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:42:12.676 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:12.672+0000 7f7996cad640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f799010d9e0 con 0x7f79900fb1d0 2024-08-18T22:42:12.676 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:12.672+0000 7f7996cad640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f799010e120 con 0x7f79900fc4a0 2024-08-18T22:42:12.676 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:12.672+0000 7f7994a49640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f79900fb1d0 0x7f799010ce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:42:12.676 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:12.672+0000 7f7994a49640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f79900fb1d0 0x7f799010ce50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:51168/0 (socket says 172.21.15.121:51168) 2024-08-18T22:42:12.676 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:12.672+0000 7f7994a49640 1 -- 172.21.15.121:0/4187507085 learned_addr learned my addr 172.21.15.121:0/4187507085 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-18T22:42:12.676 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:12.673+0000 7f798ffff640 1 --2- 172.21.15.121:0/4187507085 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f79900fc4a0 0x7f799010d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:42:12.676 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:12.673+0000 7f7994a49640 1 -- 172.21.15.121:0/4187507085 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f79900fc4a0 msgr2=0x7f799010d390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:42:12.676 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:12.673+0000 7f7994a49640 1 --2- 172.21.15.121:0/4187507085 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f79900fc4a0 0x7f799010d390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:42:12.676 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:12.673+0000 7f7994a49640 1 -- 172.21.15.121:0/4187507085 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f797c005040 con 0x7f79900fb1d0 2024-08-18T22:42:12.676 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:12.673+0000 7f7994a49640 1 --2- 172.21.15.121:0/4187507085 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f79900fb1d0 0x7f799010ce50 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f7984002a50 tx=0x7f7984004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:42:12.676 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:12.673+0000 7f798d7fa640 1 -- 172.21.15.121:0/4187507085 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7984007c30 con 0x7f79900fb1d0 2024-08-18T22:42:12.677 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:12.673+0000 7f798d7fa640 1 -- 172.21.15.121:0/4187507085 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f798400f040 con 0x7f79900fb1d0 2024-08-18T22:42:12.677 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:12.673+0000 7f7996cad640 1 -- 172.21.15.121:0/4187507085 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f799010e3b0 con 0x7f79900fb1d0 2024-08-18T22:42:12.677 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:12.673+0000 7f798d7fa640 1 -- 172.21.15.121:0/4187507085 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f798400dad0 con 0x7f79900fb1d0 2024-08-18T22:42:12.677 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:12.673+0000 7f7996cad640 1 -- 172.21.15.121:0/4187507085 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f799010e950 con 0x7f79900fb1d0 2024-08-18T22:42:12.677 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:12.674+0000 7f7996cad640 1 -- 172.21.15.121:0/4187507085 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79900fa630 con 0x7f79900fb1d0 2024-08-18T22:42:12.677 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:12.675+0000 7f798d7fa640 1 -- 172.21.15.121:0/4187507085 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 25) v1 ==== 88617+0+0 (secure 0 0 0) 0x7f798400dc30 con 0x7f79900fb1d0 2024-08-18T22:42:12.677 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:12.675+0000 7f798d7fa640 1 --2- 172.21.15.121:0/4187507085 >> [v2:172.21.15.195:6828/1174410756,v1:172.21.15.195:6829/1174410756] conn(0x7f798006a6d0 0x7f798006cb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:42:12.678 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:12.675+0000 7f798d7fa640 1 -- 172.21.15.121:0/4187507085 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f7984088f70 con 0x7f79900fb1d0 2024-08-18T22:42:12.678 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:12.675+0000 7f798ffff640 1 --2- 172.21.15.121:0/4187507085 >> [v2:172.21.15.195:6828/1174410756,v1:172.21.15.195:6829/1174410756] conn(0x7f798006a6d0 0x7f798006cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:42:12.678 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:12.676+0000 7f798ffff640 1 --2- 172.21.15.121:0/4187507085 >> [v2:172.21.15.195:6828/1174410756,v1:172.21.15.195:6829/1174410756] conn(0x7f798006a6d0 0x7f798006cb80 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f797c00b020 tx=0x7f797c035040 comp rx=0 tx=0).ready entity=mgr.24377 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:42:12.680 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:12.680+0000 7f798d7fa640 1 -- 172.21.15.121:0/4187507085 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7f79840bd670 con 0x7f79900fb1d0 2024-08-18T22:42:12.833 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:42:12 smithi121 ceph-mon[16788]: pgmap v20: 65 pgs: 65 active+clean; 3.1 GiB data, 11 GiB used, 526 GiB / 536 GiB avail; 6.1 MiB/s rd, 14 MiB/s wr, 146 op/s 2024-08-18T22:42:12.871 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:12.870+0000 7f7996cad640 1 -- 172.21.15.121:0/4187507085 --> [v2:172.21.15.195:6828/1174410756,v1:172.21.15.195:6829/1174410756] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f799010eb70 con 0x7f798006a6d0 2024-08-18T22:42:12.872 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:12.871+0000 7f798d7fa640 1 -- 172.21.15.121:0/4187507085 <== mgr.24377 v2:172.21.15.195:6828/1174410756 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+318 (secure 0 0 0) 0x7f799010eb70 con 0x7f798006a6d0 2024-08-18T22:42:12.874 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:12.873+0000 7f7996cad640 1 -- 172.21.15.121:0/4187507085 >> [v2:172.21.15.195:6828/1174410756,v1:172.21.15.195:6829/1174410756] conn(0x7f798006a6d0 msgr2=0x7f798006cb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:42:12.874 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:12.873+0000 7f7996cad640 1 --2- 172.21.15.121:0/4187507085 >> [v2:172.21.15.195:6828/1174410756,v1:172.21.15.195:6829/1174410756] conn(0x7f798006a6d0 0x7f798006cb80 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f797c00b020 tx=0x7f797c035040 comp rx=0 tx=0).stop 2024-08-18T22:42:12.874 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:12.873+0000 7f7996cad640 1 -- 172.21.15.121:0/4187507085 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f79900fb1d0 msgr2=0x7f799010ce50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:42:12.874 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:12.873+0000 7f7996cad640 1 --2- 172.21.15.121:0/4187507085 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f79900fb1d0 0x7f799010ce50 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f7984002a50 tx=0x7f7984004600 comp rx=0 tx=0).stop 2024-08-18T22:42:12.874 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:12.873+0000 7f7996cad640 1 -- 172.21.15.121:0/4187507085 shutdown_connections 2024-08-18T22:42:12.874 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:12.873+0000 7f7996cad640 1 --2- 172.21.15.121:0/4187507085 >> [v2:172.21.15.195:6828/1174410756,v1:172.21.15.195:6829/1174410756] conn(0x7f798006a6d0 0x7f798006cb80 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:42:12.875 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:12.873+0000 7f7996cad640 1 --2- 172.21.15.121:0/4187507085 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f79900fc4a0 0x7f799010d390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:42:12.875 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:12.873+0000 7f7996cad640 1 --2- 172.21.15.121:0/4187507085 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f79900fb1d0 0x7f799010ce50 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:42:12.875 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:12.873+0000 7f7996cad640 1 -- 172.21.15.121:0/4187507085 >> 172.21.15.121:0/4187507085 conn(0x7f79900f69b0 msgr2=0x7f7990065380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:42:12.875 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:12.873+0000 7f7996cad640 1 -- 172.21.15.121:0/4187507085 shutdown_connections 2024-08-18T22:42:12.875 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:12.873+0000 7f7996cad640 1 -- 172.21.15.121:0/4187507085 wait complete. 2024-08-18T22:42:12.958 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:12.957+0000 7f52155ad640 1 -- 172.21.15.121:0/1098012541 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5210066270 msgr2=0x7f52100feed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:42:12.958 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:12.957+0000 7f52155ad640 1 --2- 172.21.15.121:0/1098012541 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5210066270 0x7f52100feed0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f52000048d0 tx=0x7f5200009da0 comp rx=0 tx=0).stop 2024-08-18T22:42:12.958 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:12.957+0000 7f52155ad640 1 -- 172.21.15.121:0/1098012541 shutdown_connections 2024-08-18T22:42:12.958 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:12.957+0000 7f52155ad640 1 --2- 172.21.15.121:0/1098012541 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f52100ff410 0x7f52101017f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:42:12.959 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:12.957+0000 7f52155ad640 1 --2- 172.21.15.121:0/1098012541 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5210066270 0x7f52100feed0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:42:12.959 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:12.957+0000 7f52155ad640 1 -- 172.21.15.121:0/1098012541 >> 172.21.15.121:0/1098012541 conn(0x7f52100f69a0 msgr2=0x7f52100f8db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:42:12.959 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:12.957+0000 7f52155ad640 1 -- 172.21.15.121:0/1098012541 shutdown_connections 2024-08-18T22:42:12.959 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:12.957+0000 7f52155ad640 1 -- 172.21.15.121:0/1098012541 wait complete. 2024-08-18T22:42:12.960 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:12.958+0000 7f52155ad640 1 Processor -- start 2024-08-18T22:42:12.960 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:12.958+0000 7f52155ad640 1 -- start start 2024-08-18T22:42:12.960 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:12.958+0000 7f52155ad640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5210066270 0x7f52100fc890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:42:12.960 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:12.958+0000 7f52155ad640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f52100ff410 0x7f52100fadd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:42:12.960 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:12.958+0000 7f52155ad640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52100fb310 con 0x7f52100ff410 2024-08-18T22:42:12.960 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:12.958+0000 7f52155ad640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52100fb450 con 0x7f5210066270 2024-08-18T22:42:12.961 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:12.958+0000 7f520e7fc640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f52100ff410 0x7f52100fadd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:42:12.961 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:12.958+0000 7f520e7fc640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f52100ff410 0x7f52100fadd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:51194/0 (socket says 172.21.15.121:51194) 2024-08-18T22:42:12.961 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:12.958+0000 7f520e7fc640 1 -- 172.21.15.121:0/100828054 learned_addr learned my addr 172.21.15.121:0/100828054 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-18T22:42:12.961 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:12.958+0000 7f520effd640 1 --2- 172.21.15.121:0/100828054 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5210066270 0x7f52100fc890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:42:12.961 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:12.959+0000 7f520e7fc640 1 -- 172.21.15.121:0/100828054 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5210066270 msgr2=0x7f52100fc890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:42:12.961 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:12.959+0000 7f520e7fc640 1 --2- 172.21.15.121:0/100828054 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5210066270 0x7f52100fc890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:42:12.961 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:12.959+0000 7f520e7fc640 1 -- 172.21.15.121:0/100828054 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5200005040 con 0x7f52100ff410 2024-08-18T22:42:12.961 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:12.959+0000 7f520e7fc640 1 --2- 172.21.15.121:0/100828054 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f52100ff410 0x7f52100fadd0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f520400eb70 tx=0x7f520400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:42:12.961 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:12.959+0000 7f51f77fe640 1 -- 172.21.15.121:0/100828054 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5204007c30 con 0x7f52100ff410 2024-08-18T22:42:12.961 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:12.959+0000 7f51f77fe640 1 -- 172.21.15.121:0/100828054 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f520400f040 con 0x7f52100ff410 2024-08-18T22:42:12.961 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:12.959+0000 7f51f77fe640 1 -- 172.21.15.121:0/100828054 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f520400ca60 con 0x7f52100ff410 2024-08-18T22:42:12.961 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:12.959+0000 7f52155ad640 1 -- 172.21.15.121:0/100828054 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52100fb6d0 con 0x7f52100ff410 2024-08-18T22:42:12.961 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:12.959+0000 7f52155ad640 1 -- 172.21.15.121:0/100828054 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5210114f10 con 0x7f52100ff410 2024-08-18T22:42:12.962 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:12.960+0000 7f52155ad640 1 -- 172.21.15.121:0/100828054 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f521004b4c0 con 0x7f52100ff410 2024-08-18T22:42:12.962 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:12.960+0000 7f51f77fe640 1 -- 172.21.15.121:0/100828054 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 25) v1 ==== 88617+0+0 (secure 0 0 0) 0x7f520400cbc0 con 0x7f52100ff410 2024-08-18T22:42:12.963 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:12.961+0000 7f51f77fe640 1 --2- 172.21.15.121:0/100828054 >> [v2:172.21.15.195:6828/1174410756,v1:172.21.15.195:6829/1174410756] conn(0x7f51f806a6d0 0x7f51f806cb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:42:12.963 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:12.961+0000 7f51f77fe640 1 -- 172.21.15.121:0/100828054 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f5204088c60 con 0x7f52100ff410 2024-08-18T22:42:12.963 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:12.961+0000 7f520effd640 1 --2- 172.21.15.121:0/100828054 >> [v2:172.21.15.195:6828/1174410756,v1:172.21.15.195:6829/1174410756] conn(0x7f51f806a6d0 0x7f51f806cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:42:12.963 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:12.961+0000 7f520effd640 1 --2- 172.21.15.121:0/100828054 >> [v2:172.21.15.195:6828/1174410756,v1:172.21.15.195:6829/1174410756] conn(0x7f51f806a6d0 0x7f51f806cb80 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f5200000c00 tx=0x7f5200035040 comp rx=0 tx=0).ready entity=mgr.24377 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:42:12.966 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:12.965+0000 7f51f77fe640 1 -- 172.21.15.121:0/100828054 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7f52040528c0 con 0x7f52100ff410 2024-08-18T22:42:13.158 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:42:12 smithi195 ceph-mon[23370]: pgmap v20: 65 pgs: 65 active+clean; 3.1 GiB data, 11 GiB used, 526 GiB / 536 GiB avail; 6.1 MiB/s rd, 14 MiB/s wr, 146 op/s 2024-08-18T22:42:13.204 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:13.203+0000 7f52155ad640 1 -- 172.21.15.121:0/100828054 --> [v2:172.21.15.195:6828/1174410756,v1:172.21.15.195:6829/1174410756] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f5210104ce0 con 0x7f51f806a6d0 2024-08-18T22:42:13.232 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:13.231+0000 7f51f77fe640 1 -- 172.21.15.121:0/100828054 <== mgr.24377 v2:172.21.15.195:6828/1174410756 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f5210104ce0 con 0x7f51f806a6d0 2024-08-18T22:42:13.233 INFO:teuthology.orchestra.run.smithi121.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-08-18T22:42:13.233 INFO:teuthology.orchestra.run.smithi121.stdout:alertmanager.smithi121 smithi121 *:9093,9094 starting - - - - 2024-08-18T22:42:13.233 INFO:teuthology.orchestra.run.smithi121.stdout:crash.smithi121 smithi121 running (8m) 18s ago 8m 6899k - 17.2.7-1406-gdf62bdcc 774894bef55f cf3deea293c3 2024-08-18T22:42:13.233 INFO:teuthology.orchestra.run.smithi121.stdout:crash.smithi195 smithi195 running (7m) 14s ago 7m 6899k - 17.2.7-1406-gdf62bdcc 774894bef55f 98aa377daf77 2024-08-18T22:42:13.233 INFO:teuthology.orchestra.run.smithi121.stdout:grafana.smithi121 smithi121 *:3000 running (6m) 18s ago 7m 87.2M - 9.4.7 954c08fa6188 07c3d993780f 2024-08-18T22:42:13.233 INFO:teuthology.orchestra.run.smithi121.stdout:mds.cephfs.smithi121.gbickb smithi121 running (2m) 18s ago 2m 134M - 17.2.7-1406-gdf62bdcc 774894bef55f 484da0bc2c95 2024-08-18T22:42:13.233 INFO:teuthology.orchestra.run.smithi121.stdout:mds.cephfs.smithi121.xuzsdg smithi121 running (3m) 18s ago 3m 12.0M - 17.2.7-1406-gdf62bdcc 774894bef55f 6976b708cdcd 2024-08-18T22:42:13.233 INFO:teuthology.orchestra.run.smithi121.stdout:mds.cephfs.smithi195.buqvbr smithi195 running (3m) 14s ago 3m 118M - 17.2.7-1406-gdf62bdcc 774894bef55f 11a3703b4276 2024-08-18T22:42:13.233 INFO:teuthology.orchestra.run.smithi121.stdout:mds.cephfs.smithi195.nptgyc smithi195 running (2m) 14s ago 2m 16.2M - 17.2.7-1406-gdf62bdcc 774894bef55f b9f8043ea83e 2024-08-18T22:42:13.233 INFO:teuthology.orchestra.run.smithi121.stdout:mgr.smithi121.lopxqc smithi121 *:9283,8765,8443 running (9m) 18s ago 9m 256M - 17.2.7-1406-gdf62bdcc 774894bef55f 3ac16dcb26e3 2024-08-18T22:42:13.233 INFO:teuthology.orchestra.run.smithi121.stdout:mgr.smithi195.acttsj smithi195 *:8443,9283 running (66s) 14s ago 7m 481M - 19.1.0-1382-gde09dd01 ea7a5189f30b eaf531f5f439 2024-08-18T22:42:13.234 INFO:teuthology.orchestra.run.smithi121.stdout:mon.smithi121 smithi121 running (9m) 18s ago 9m 53.1M 2048M 17.2.7-1406-gdf62bdcc 774894bef55f 4a7bead235ac 2024-08-18T22:42:13.234 INFO:teuthology.orchestra.run.smithi121.stdout:mon.smithi195 smithi195 running (7m) 14s ago 7m 39.9M 2048M 17.2.7-1406-gdf62bdcc 774894bef55f ced63ecfbfae 2024-08-18T22:42:13.234 INFO:teuthology.orchestra.run.smithi121.stdout:node-exporter.smithi121 smithi121 *:9100 starting - - - - 2024-08-18T22:42:13.234 INFO:teuthology.orchestra.run.smithi121.stdout:node-exporter.smithi195 smithi195 *:9100 running (7m) 14s ago 7m 15.5M - 1.5.0 0da6a335fe13 e09a01163b83 2024-08-18T22:42:13.234 INFO:teuthology.orchestra.run.smithi121.stdout:osd.0 smithi121 running (6m) 18s ago 6m 221M 1557M 17.2.7-1406-gdf62bdcc 774894bef55f 30859216633d 2024-08-18T22:42:13.234 INFO:teuthology.orchestra.run.smithi121.stdout:osd.1 smithi121 running (6m) 18s ago 6m 235M 1557M 17.2.7-1406-gdf62bdcc 774894bef55f ef5fadfd753f 2024-08-18T22:42:13.234 INFO:teuthology.orchestra.run.smithi121.stdout:osd.2 smithi121 running (5m) 18s ago 5m 201M 1557M 17.2.7-1406-gdf62bdcc 774894bef55f 3fa061e41f99 2024-08-18T22:42:13.234 INFO:teuthology.orchestra.run.smithi121.stdout:osd.3 smithi195 running (5m) 14s ago 5m 254M 2581M 17.2.7-1406-gdf62bdcc 774894bef55f 15d30b1b459e 2024-08-18T22:42:13.234 INFO:teuthology.orchestra.run.smithi121.stdout:osd.4 smithi195 running (4m) 14s ago 4m 199M 2581M 17.2.7-1406-gdf62bdcc 774894bef55f 99ed156dfd36 2024-08-18T22:42:13.234 INFO:teuthology.orchestra.run.smithi121.stdout:osd.5 smithi195 running (4m) 14s ago 4m 242M 2581M 17.2.7-1406-gdf62bdcc 774894bef55f e7eff7bdb752 2024-08-18T22:42:13.234 INFO:teuthology.orchestra.run.smithi121.stdout:prometheus.smithi121 smithi121 *:9095 running (6m) 18s ago 7m 56.4M - 2.43.0 a07b618ecd1d d6016f1b45a3 2024-08-18T22:42:13.235 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:13.234+0000 7f52155ad640 1 -- 172.21.15.121:0/100828054 >> [v2:172.21.15.195:6828/1174410756,v1:172.21.15.195:6829/1174410756] conn(0x7f51f806a6d0 msgr2=0x7f51f806cb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:42:13.235 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:13.234+0000 7f52155ad640 1 --2- 172.21.15.121:0/100828054 >> [v2:172.21.15.195:6828/1174410756,v1:172.21.15.195:6829/1174410756] conn(0x7f51f806a6d0 0x7f51f806cb80 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f5200000c00 tx=0x7f5200035040 comp rx=0 tx=0).stop 2024-08-18T22:42:13.235 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:13.234+0000 7f52155ad640 1 -- 172.21.15.121:0/100828054 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f52100ff410 msgr2=0x7f52100fadd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:42:13.235 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:13.234+0000 7f52155ad640 1 --2- 172.21.15.121:0/100828054 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f52100ff410 0x7f52100fadd0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f520400eb70 tx=0x7f520400b040 comp rx=0 tx=0).stop 2024-08-18T22:42:13.235 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:13.234+0000 7f52155ad640 1 -- 172.21.15.121:0/100828054 shutdown_connections 2024-08-18T22:42:13.235 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:13.234+0000 7f52155ad640 1 --2- 172.21.15.121:0/100828054 >> [v2:172.21.15.195:6828/1174410756,v1:172.21.15.195:6829/1174410756] conn(0x7f51f806a6d0 0x7f51f806cb80 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:42:13.235 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:13.234+0000 7f52155ad640 1 --2- 172.21.15.121:0/100828054 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f52100ff410 0x7f52100fadd0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:42:13.236 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:13.234+0000 7f52155ad640 1 --2- 172.21.15.121:0/100828054 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5210066270 0x7f52100fc890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:42:13.236 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:13.234+0000 7f52155ad640 1 -- 172.21.15.121:0/100828054 >> 172.21.15.121:0/100828054 conn(0x7f52100f69a0 msgr2=0x7f52100f6d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:42:13.236 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:13.234+0000 7f52155ad640 1 -- 172.21.15.121:0/100828054 shutdown_connections 2024-08-18T22:42:13.236 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:13.234+0000 7f52155ad640 1 -- 172.21.15.121:0/100828054 wait complete. 2024-08-18T22:42:13.318 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:13.317+0000 7f2c3d214640 1 -- 172.21.15.121:0/1678058938 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2c380fc4a0 msgr2=0x7f2c380fc910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:42:13.318 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:13.317+0000 7f2c3d214640 1 --2- 172.21.15.121:0/1678058938 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2c380fc4a0 0x7f2c380fc910 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f2c200048d0 tx=0x7f2c20009da0 comp rx=0 tx=0).stop 2024-08-18T22:42:13.318 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:13.317+0000 7f2c3d214640 1 -- 172.21.15.121:0/1678058938 shutdown_connections 2024-08-18T22:42:13.318 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:13.317+0000 7f2c3d214640 1 --2- 172.21.15.121:0/1678058938 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2c380fc4a0 0x7f2c380fc910 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:42:13.319 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:13.317+0000 7f2c3d214640 1 --2- 172.21.15.121:0/1678058938 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2c380fb1d0 0x7f2c380fb5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:42:13.319 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:13.317+0000 7f2c3d214640 1 -- 172.21.15.121:0/1678058938 >> 172.21.15.121:0/1678058938 conn(0x7f2c380f69b0 msgr2=0x7f2c380f8dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:42:13.319 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:13.317+0000 7f2c3d214640 1 -- 172.21.15.121:0/1678058938 shutdown_connections 2024-08-18T22:42:13.319 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:13.317+0000 7f2c3d214640 1 -- 172.21.15.121:0/1678058938 wait complete. 2024-08-18T22:42:13.320 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:13.318+0000 7f2c3d214640 1 Processor -- start 2024-08-18T22:42:13.321 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:13.318+0000 7f2c3d214640 1 -- start start 2024-08-18T22:42:13.321 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:13.318+0000 7f2c3d214640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2c380fb1d0 0x7f2c3810f050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:42:13.321 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:13.318+0000 7f2c3d214640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2c380fc4a0 0x7f2c3810f590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:42:13.321 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:13.318+0000 7f2c3d214640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c3810fbe0 con 0x7f2c380fc4a0 2024-08-18T22:42:13.321 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:13.318+0000 7f2c3d214640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c38110400 con 0x7f2c380fb1d0 2024-08-18T22:42:13.321 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:13.318+0000 7f2c36d9d640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2c380fb1d0 0x7f2c3810f050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:42:13.321 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:13.318+0000 7f2c36d9d640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2c380fb1d0 0x7f2c3810f050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.121:50268/0 (socket says 172.21.15.121:50268) 2024-08-18T22:42:13.321 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:13.318+0000 7f2c36d9d640 1 -- 172.21.15.121:0/644452593 learned_addr learned my addr 172.21.15.121:0/644452593 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-18T22:42:13.321 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:13.319+0000 7f2c36d9d640 1 -- 172.21.15.121:0/644452593 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2c380fc4a0 msgr2=0x7f2c3810f590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:42:13.321 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:13.319+0000 7f2c2ffff640 1 --2- 172.21.15.121:0/644452593 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2c380fc4a0 0x7f2c3810f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:42:13.321 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:13.319+0000 7f2c36d9d640 1 --2- 172.21.15.121:0/644452593 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2c380fc4a0 0x7f2c3810f590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:42:13.321 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:13.319+0000 7f2c36d9d640 1 -- 172.21.15.121:0/644452593 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c20005040 con 0x7f2c380fb1d0 2024-08-18T22:42:13.322 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:13.319+0000 7f2c2ffff640 1 --2- 172.21.15.121:0/644452593 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2c380fc4a0 0x7f2c3810f590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:42:13.322 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:13.319+0000 7f2c36d9d640 1 --2- 172.21.15.121:0/644452593 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2c380fb1d0 0x7f2c3810f050 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f2c2800eb70 tx=0x7f2c2800b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:42:13.322 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:13.319+0000 7f2c2f7fe640 1 -- 172.21.15.121:0/644452593 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2c28007c30 con 0x7f2c380fb1d0 2024-08-18T22:42:13.322 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:13.319+0000 7f2c2f7fe640 1 -- 172.21.15.121:0/644452593 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f2c2800f040 con 0x7f2c380fb1d0 2024-08-18T22:42:13.322 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:13.319+0000 7f2c2f7fe640 1 -- 172.21.15.121:0/644452593 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2c280094e0 con 0x7f2c380fb1d0 2024-08-18T22:42:13.322 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:13.319+0000 7f2c3d214640 1 -- 172.21.15.121:0/644452593 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c38110630 con 0x7f2c380fb1d0 2024-08-18T22:42:13.322 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:13.319+0000 7f2c3d214640 1 -- 172.21.15.121:0/644452593 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c38110bd0 con 0x7f2c380fb1d0 2024-08-18T22:42:13.323 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:13.321+0000 7f2c3d214640 1 -- 172.21.15.121:0/644452593 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c380fa630 con 0x7f2c380fb1d0 2024-08-18T22:42:13.323 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:13.321+0000 7f2c2f7fe640 1 -- 172.21.15.121:0/644452593 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 25) v1 ==== 88617+0+0 (secure 0 0 0) 0x7f2c28009640 con 0x7f2c380fb1d0 2024-08-18T22:42:13.323 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:13.321+0000 7f2c2f7fe640 1 --2- 172.21.15.121:0/644452593 >> [v2:172.21.15.195:6828/1174410756,v1:172.21.15.195:6829/1174410756] conn(0x7f2c2406a6d0 0x7f2c2406cb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:42:13.323 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:13.321+0000 7f2c2f7fe640 1 -- 172.21.15.121:0/644452593 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f2c28088e10 con 0x7f2c380fb1d0 2024-08-18T22:42:13.323 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:13.321+0000 7f2c2ffff640 1 --2- 172.21.15.121:0/644452593 >> [v2:172.21.15.195:6828/1174410756,v1:172.21.15.195:6829/1174410756] conn(0x7f2c2406a6d0 0x7f2c2406cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:42:13.323 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:13.322+0000 7f2c2ffff640 1 --2- 172.21.15.121:0/644452593 >> [v2:172.21.15.195:6828/1174410756,v1:172.21.15.195:6829/1174410756] conn(0x7f2c2406a6d0 0x7f2c2406cb80 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f2c2000b020 tx=0x7f2c20009da0 comp rx=0 tx=0).ready entity=mgr.24377 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:42:13.330 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:13.329+0000 7f2c2f7fe640 1 -- 172.21.15.121:0/644452593 <== mon.1 v2:172.21.15.195:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7f2c280528d0 con 0x7f2c380fb1d0 2024-08-18T22:42:13.587 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:13.586+0000 7f2c3d214640 1 -- 172.21.15.121:0/644452593 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f2c38100da0 con 0x7f2c380fb1d0 2024-08-18T22:42:13.587 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:13.586+0000 7f2c2f7fe640 1 -- 172.21.15.121:0/644452593 <== mon.1 v2:172.21.15.195:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+849 (secure 0 0 0) 0x7f2c28055f90 con 0x7f2c380fb1d0 2024-08-18T22:42:13.588 INFO:teuthology.orchestra.run.smithi121.stdout:{ 2024-08-18T22:42:13.588 INFO:teuthology.orchestra.run.smithi121.stdout: "mon": { 2024-08-18T22:42:13.588 INFO:teuthology.orchestra.run.smithi121.stdout: "ceph version 17.2.7-1406-gdf62bdcc (df62bdccd9a13bf566b27a250eddfdd89be3072d) quincy (stable)": 2 2024-08-18T22:42:13.588 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-18T22:42:13.588 INFO:teuthology.orchestra.run.smithi121.stdout: "mgr": { 2024-08-18T22:42:13.588 INFO:teuthology.orchestra.run.smithi121.stdout: "ceph version 17.2.7-1406-gdf62bdcc (df62bdccd9a13bf566b27a250eddfdd89be3072d) quincy (stable)": 1, 2024-08-18T22:42:13.588 INFO:teuthology.orchestra.run.smithi121.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 1 2024-08-18T22:42:13.588 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-18T22:42:13.588 INFO:teuthology.orchestra.run.smithi121.stdout: "osd": { 2024-08-18T22:42:13.588 INFO:teuthology.orchestra.run.smithi121.stdout: "ceph version 17.2.7-1406-gdf62bdcc (df62bdccd9a13bf566b27a250eddfdd89be3072d) quincy (stable)": 6 2024-08-18T22:42:13.589 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-18T22:42:13.589 INFO:teuthology.orchestra.run.smithi121.stdout: "mds": { 2024-08-18T22:42:13.589 INFO:teuthology.orchestra.run.smithi121.stdout: "ceph version 17.2.7-1406-gdf62bdcc (df62bdccd9a13bf566b27a250eddfdd89be3072d) quincy (stable)": 4 2024-08-18T22:42:13.589 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-18T22:42:13.589 INFO:teuthology.orchestra.run.smithi121.stdout: "overall": { 2024-08-18T22:42:13.589 INFO:teuthology.orchestra.run.smithi121.stdout: "ceph version 17.2.7-1406-gdf62bdcc (df62bdccd9a13bf566b27a250eddfdd89be3072d) quincy (stable)": 13, 2024-08-18T22:42:13.589 INFO:teuthology.orchestra.run.smithi121.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 1 2024-08-18T22:42:13.589 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-08-18T22:42:13.589 INFO:teuthology.orchestra.run.smithi121.stdout:} 2024-08-18T22:42:13.590 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:13.588+0000 7f2c3d214640 1 -- 172.21.15.121:0/644452593 >> [v2:172.21.15.195:6828/1174410756,v1:172.21.15.195:6829/1174410756] conn(0x7f2c2406a6d0 msgr2=0x7f2c2406cb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:42:13.590 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:13.588+0000 7f2c3d214640 1 --2- 172.21.15.121:0/644452593 >> [v2:172.21.15.195:6828/1174410756,v1:172.21.15.195:6829/1174410756] conn(0x7f2c2406a6d0 0x7f2c2406cb80 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f2c2000b020 tx=0x7f2c20009da0 comp rx=0 tx=0).stop 2024-08-18T22:42:13.590 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:13.588+0000 7f2c3d214640 1 -- 172.21.15.121:0/644452593 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2c380fb1d0 msgr2=0x7f2c3810f050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:42:13.590 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:13.588+0000 7f2c3d214640 1 --2- 172.21.15.121:0/644452593 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2c380fb1d0 0x7f2c3810f050 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f2c2800eb70 tx=0x7f2c2800b040 comp rx=0 tx=0).stop 2024-08-18T22:42:13.590 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:13.588+0000 7f2c3d214640 1 -- 172.21.15.121:0/644452593 shutdown_connections 2024-08-18T22:42:13.590 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:13.588+0000 7f2c3d214640 1 --2- 172.21.15.121:0/644452593 >> [v2:172.21.15.195:6828/1174410756,v1:172.21.15.195:6829/1174410756] conn(0x7f2c2406a6d0 0x7f2c2406cb80 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:42:13.590 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:13.588+0000 7f2c3d214640 1 --2- 172.21.15.121:0/644452593 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2c380fc4a0 0x7f2c3810f590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:42:13.590 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:13.588+0000 7f2c3d214640 1 --2- 172.21.15.121:0/644452593 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2c380fb1d0 0x7f2c3810f050 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:42:13.590 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:13.588+0000 7f2c3d214640 1 -- 172.21.15.121:0/644452593 >> 172.21.15.121:0/644452593 conn(0x7f2c380f69b0 msgr2=0x7f2c38065350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:42:13.591 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:13.588+0000 7f2c3d214640 1 -- 172.21.15.121:0/644452593 shutdown_connections 2024-08-18T22:42:13.591 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:13.588+0000 7f2c3d214640 1 -- 172.21.15.121:0/644452593 wait complete. 2024-08-18T22:42:13.672 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:13.671+0000 7f9c29620640 1 -- 172.21.15.121:0/2643933887 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9c240fd590 msgr2=0x7f9c240fda00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:42:13.672 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:13.671+0000 7f9c29620640 1 --2- 172.21.15.121:0/2643933887 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9c240fd590 0x7f9c240fda00 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f9c180048d0 tx=0x7f9c18009da0 comp rx=0 tx=0).stop 2024-08-18T22:42:13.672 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:13.671+0000 7f9c29620640 1 -- 172.21.15.121:0/2643933887 shutdown_connections 2024-08-18T22:42:13.672 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:13.671+0000 7f9c29620640 1 --2- 172.21.15.121:0/2643933887 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9c240fd590 0x7f9c240fda00 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:42:13.672 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:13.671+0000 7f9c29620640 1 --2- 172.21.15.121:0/2643933887 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9c240fc2c0 0x7f9c240fc6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:42:13.672 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:13.671+0000 7f9c29620640 1 -- 172.21.15.121:0/2643933887 >> 172.21.15.121:0/2643933887 conn(0x7f9c240f7a80 msgr2=0x7f9c240f9eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:42:13.673 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:13.671+0000 7f9c29620640 1 -- 172.21.15.121:0/2643933887 shutdown_connections 2024-08-18T22:42:13.673 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:13.671+0000 7f9c29620640 1 -- 172.21.15.121:0/2643933887 wait complete. 2024-08-18T22:42:13.673 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:13.672+0000 7f9c29620640 1 Processor -- start 2024-08-18T22:42:13.674 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:13.672+0000 7f9c29620640 1 -- start start 2024-08-18T22:42:13.674 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:13.672+0000 7f9c29620640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9c240fc2c0 0x7f9c2410ce60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:42:13.674 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:13.672+0000 7f9c29620640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9c240fd590 0x7f9c2410d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:42:13.674 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:13.672+0000 7f9c29620640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c2410d9f0 con 0x7f9c240fd590 2024-08-18T22:42:13.674 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:13.672+0000 7f9c29620640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c2410e130 con 0x7f9c240fc2c0 2024-08-18T22:42:13.675 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:13.672+0000 7f9c22ffd640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9c240fc2c0 0x7f9c2410ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:42:13.675 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:13.672+0000 7f9c22ffd640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9c240fc2c0 0x7f9c2410ce60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.121:50286/0 (socket says 172.21.15.121:50286) 2024-08-18T22:42:13.675 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:13.672+0000 7f9c22ffd640 1 -- 172.21.15.121:0/461540931 learned_addr learned my addr 172.21.15.121:0/461540931 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-18T22:42:13.675 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:13.672+0000 7f9c227fc640 1 --2- 172.21.15.121:0/461540931 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9c240fd590 0x7f9c2410d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:42:13.675 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:13.673+0000 7f9c22ffd640 1 -- 172.21.15.121:0/461540931 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9c240fd590 msgr2=0x7f9c2410d3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:42:13.675 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:13.673+0000 7f9c22ffd640 1 --2- 172.21.15.121:0/461540931 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9c240fd590 0x7f9c2410d3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:42:13.675 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:13.673+0000 7f9c22ffd640 1 -- 172.21.15.121:0/461540931 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c18005040 con 0x7f9c240fc2c0 2024-08-18T22:42:13.675 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:13.673+0000 7f9c22ffd640 1 --2- 172.21.15.121:0/461540931 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9c240fc2c0 0x7f9c2410ce60 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f9c1400eb70 tx=0x7f9c1400b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:42:13.675 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:13.673+0000 7f9c0b7fe640 1 -- 172.21.15.121:0/461540931 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9c14007c30 con 0x7f9c240fc2c0 2024-08-18T22:42:13.675 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:13.673+0000 7f9c0b7fe640 1 -- 172.21.15.121:0/461540931 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f9c1400f040 con 0x7f9c240fc2c0 2024-08-18T22:42:13.675 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:13.673+0000 7f9c29620640 1 -- 172.21.15.121:0/461540931 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c2410e360 con 0x7f9c240fc2c0 2024-08-18T22:42:13.676 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:13.674+0000 7f9c0b7fe640 1 -- 172.21.15.121:0/461540931 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9c14009550 con 0x7f9c240fc2c0 2024-08-18T22:42:13.676 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:13.674+0000 7f9c29620640 1 -- 172.21.15.121:0/461540931 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c2410e900 con 0x7f9c240fc2c0 2024-08-18T22:42:13.676 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:13.675+0000 7f9c0b7fe640 1 -- 172.21.15.121:0/461540931 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 25) v1 ==== 88617+0+0 (secure 0 0 0) 0x7f9c14009840 con 0x7f9c240fc2c0 2024-08-18T22:42:13.676 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:13.675+0000 7f9c29620640 1 -- 172.21.15.121:0/461540931 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c240fb720 con 0x7f9c240fc2c0 2024-08-18T22:42:13.677 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:13.675+0000 7f9c0b7fe640 1 --2- 172.21.15.121:0/461540931 >> [v2:172.21.15.195:6828/1174410756,v1:172.21.15.195:6829/1174410756] conn(0x7f9c0c06a6d0 0x7f9c0c06cb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:42:13.677 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:13.675+0000 7f9c0b7fe640 1 -- 172.21.15.121:0/461540931 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f9c14088f20 con 0x7f9c240fc2c0 2024-08-18T22:42:13.677 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:13.675+0000 7f9c227fc640 1 --2- 172.21.15.121:0/461540931 >> [v2:172.21.15.195:6828/1174410756,v1:172.21.15.195:6829/1174410756] conn(0x7f9c0c06a6d0 0x7f9c0c06cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:42:13.677 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:13.676+0000 7f9c227fc640 1 --2- 172.21.15.121:0/461540931 >> [v2:172.21.15.195:6828/1174410756,v1:172.21.15.195:6829/1174410756] conn(0x7f9c0c06a6d0 0x7f9c0c06cb80 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f9c18004540 tx=0x7f9c1803b040 comp rx=0 tx=0).ready entity=mgr.24377 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:42:13.681 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:13.681+0000 7f9c0b7fe640 1 -- 172.21.15.121:0/461540931 <== mon.1 v2:172.21.15.195:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7f9c14052a90 con 0x7f9c240fc2c0 2024-08-18T22:42:13.900 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:13.899+0000 7f9c29620640 1 -- 172.21.15.121:0/461540931 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f9c24104cc0 con 0x7f9c240fc2c0 2024-08-18T22:42:13.900 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:42:13 smithi121 ceph-mon[16788]: from='client.14676 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-18T22:42:13.900 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:42:13 smithi121 ceph-mon[16788]: from='client.14680 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-18T22:42:13.901 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:42:13 smithi121 ceph-mon[16788]: from='mgr.24377 ' entity='mgr.smithi195.acttsj' 2024-08-18T22:42:13.901 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:42:13 smithi121 ceph-mon[16788]: from='mgr.24377 ' entity='mgr.smithi195.acttsj' 2024-08-18T22:42:13.901 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:42:13 smithi121 ceph-mon[16788]: from='client.? 172.21.15.121:0/644452593' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-08-18T22:42:13.901 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:13.899+0000 7f9c0b7fe640 1 -- 172.21.15.121:0/461540931 <== mon.1 v2:172.21.15.195:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 18 v18) v1 ==== 76+0+1835 (secure 0 0 0) 0x7f9c14056150 con 0x7f9c240fc2c0 2024-08-18T22:42:13.901 INFO:teuthology.orchestra.run.smithi121.stdout:e18 2024-08-18T22:42:13.901 INFO:teuthology.orchestra.run.smithi121.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-08-18T22:42:13.901 INFO:teuthology.orchestra.run.smithi121.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-08-18T22:42:13.902 INFO:teuthology.orchestra.run.smithi121.stdout:legacy client fscid: 1 2024-08-18T22:42:13.902 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-08-18T22:42:13.902 INFO:teuthology.orchestra.run.smithi121.stdout:Filesystem 'cephfs' (1) 2024-08-18T22:42:13.902 INFO:teuthology.orchestra.run.smithi121.stdout:fs_name cephfs 2024-08-18T22:42:13.902 INFO:teuthology.orchestra.run.smithi121.stdout:epoch 18 2024-08-18T22:42:13.902 INFO:teuthology.orchestra.run.smithi121.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-08-18T22:42:13.902 INFO:teuthology.orchestra.run.smithi121.stdout:created 2024-08-18T22:39:04.054074+0000 2024-08-18T22:42:13.902 INFO:teuthology.orchestra.run.smithi121.stdout:modified 2024-08-18T22:41:01.169096+0000 2024-08-18T22:42:13.902 INFO:teuthology.orchestra.run.smithi121.stdout:tableserver 0 2024-08-18T22:42:13.902 INFO:teuthology.orchestra.run.smithi121.stdout:root 0 2024-08-18T22:42:13.902 INFO:teuthology.orchestra.run.smithi121.stdout:session_timeout 60 2024-08-18T22:42:13.902 INFO:teuthology.orchestra.run.smithi121.stdout:session_autoclose 300 2024-08-18T22:42:13.902 INFO:teuthology.orchestra.run.smithi121.stdout:max_file_size 1099511627776 2024-08-18T22:42:13.903 INFO:teuthology.orchestra.run.smithi121.stdout:required_client_features {} 2024-08-18T22:42:13.903 INFO:teuthology.orchestra.run.smithi121.stdout:last_failure 0 2024-08-18T22:42:13.903 INFO:teuthology.orchestra.run.smithi121.stdout:last_failure_osd_epoch 47 2024-08-18T22:42:13.903 INFO:teuthology.orchestra.run.smithi121.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-08-18T22:42:13.903 INFO:teuthology.orchestra.run.smithi121.stdout:max_mds 2 2024-08-18T22:42:13.903 INFO:teuthology.orchestra.run.smithi121.stdout:in 0,1 2024-08-18T22:42:13.903 INFO:teuthology.orchestra.run.smithi121.stdout:up {0=14474,1=24249} 2024-08-18T22:42:13.903 INFO:teuthology.orchestra.run.smithi121.stdout:failed 2024-08-18T22:42:13.903 INFO:teuthology.orchestra.run.smithi121.stdout:damaged 2024-08-18T22:42:13.903 INFO:teuthology.orchestra.run.smithi121.stdout:stopped 2024-08-18T22:42:13.903 INFO:teuthology.orchestra.run.smithi121.stdout:data_pools [3] 2024-08-18T22:42:13.903 INFO:teuthology.orchestra.run.smithi121.stdout:metadata_pool 2 2024-08-18T22:42:13.903 INFO:teuthology.orchestra.run.smithi121.stdout:inline_data disabled 2024-08-18T22:42:13.903 INFO:teuthology.orchestra.run.smithi121.stdout:balancer 2024-08-18T22:42:13.904 INFO:teuthology.orchestra.run.smithi121.stdout:standby_count_wanted 1 2024-08-18T22:42:13.904 INFO:teuthology.orchestra.run.smithi121.stdout:[mds.cephfs.smithi121.gbickb{0:14474} state up:active seq 6 export targets 1 join_fscid=1 addr [v2:172.21.15.121:6828/2277706406,v1:172.21.15.121:6829/2277706406] compat {c=[1],r=[1],i=[7ff]}] 2024-08-18T22:42:13.904 INFO:teuthology.orchestra.run.smithi121.stdout:[mds.cephfs.smithi195.buqvbr{1:24249} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.195:6824/2414511859,v1:172.21.15.195:6825/2414511859] compat {c=[1],r=[1],i=[7ff]}] 2024-08-18T22:42:13.904 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-08-18T22:42:13.904 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-08-18T22:42:13.904 INFO:teuthology.orchestra.run.smithi121.stdout:Standby daemons: 2024-08-18T22:42:13.904 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-08-18T22:42:13.904 INFO:teuthology.orchestra.run.smithi121.stdout:[mds.cephfs.smithi121.xuzsdg{-1:14490} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.121:6826/91588128,v1:172.21.15.121:6827/91588128] compat {c=[1],r=[1],i=[7ff]}] 2024-08-18T22:42:13.904 INFO:teuthology.orchestra.run.smithi121.stdout:[mds.cephfs.smithi195.nptgyc{-1:24259} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.195:6826/238549847,v1:172.21.15.195:6827/238549847] compat {c=[1],r=[1],i=[7ff]}] 2024-08-18T22:42:13.905 INFO:teuthology.orchestra.run.smithi121.stderr:dumped fsmap epoch 18 2024-08-18T22:42:13.905 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:13.902+0000 7f9c29620640 1 -- 172.21.15.121:0/461540931 >> [v2:172.21.15.195:6828/1174410756,v1:172.21.15.195:6829/1174410756] conn(0x7f9c0c06a6d0 msgr2=0x7f9c0c06cb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:42:13.905 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:13.902+0000 7f9c29620640 1 --2- 172.21.15.121:0/461540931 >> [v2:172.21.15.195:6828/1174410756,v1:172.21.15.195:6829/1174410756] conn(0x7f9c0c06a6d0 0x7f9c0c06cb80 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f9c18004540 tx=0x7f9c1803b040 comp rx=0 tx=0).stop 2024-08-18T22:42:13.905 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:13.902+0000 7f9c29620640 1 -- 172.21.15.121:0/461540931 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9c240fc2c0 msgr2=0x7f9c2410ce60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:42:13.905 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:13.902+0000 7f9c29620640 1 --2- 172.21.15.121:0/461540931 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9c240fc2c0 0x7f9c2410ce60 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f9c1400eb70 tx=0x7f9c1400b040 comp rx=0 tx=0).stop 2024-08-18T22:42:13.905 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:13.902+0000 7f9c29620640 1 -- 172.21.15.121:0/461540931 shutdown_connections 2024-08-18T22:42:13.905 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:13.902+0000 7f9c29620640 1 --2- 172.21.15.121:0/461540931 >> [v2:172.21.15.195:6828/1174410756,v1:172.21.15.195:6829/1174410756] conn(0x7f9c0c06a6d0 0x7f9c0c06cb80 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:42:13.905 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:13.902+0000 7f9c29620640 1 --2- 172.21.15.121:0/461540931 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9c240fd590 0x7f9c2410d3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:42:13.905 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:13.902+0000 7f9c29620640 1 --2- 172.21.15.121:0/461540931 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9c240fc2c0 0x7f9c2410ce60 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:42:13.906 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:13.902+0000 7f9c29620640 1 -- 172.21.15.121:0/461540931 >> 172.21.15.121:0/461540931 conn(0x7f9c240f7a80 msgr2=0x7f9c240f9250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:42:13.906 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:13.903+0000 7f9c29620640 1 -- 172.21.15.121:0/461540931 shutdown_connections 2024-08-18T22:42:13.906 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:13.903+0000 7f9c29620640 1 -- 172.21.15.121:0/461540931 wait complete. 2024-08-18T22:42:13.985 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:13.984+0000 7fcaaf139640 1 -- 172.21.15.121:0/1263638314 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcaa80fc4a0 msgr2=0x7fcaa80fc910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:42:13.985 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:13.984+0000 7fcaaf139640 1 --2- 172.21.15.121:0/1263638314 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcaa80fc4a0 0x7fcaa80fc910 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fca940048d0 tx=0x7fca94009da0 comp rx=0 tx=0).stop 2024-08-18T22:42:13.985 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:13.984+0000 7fcaaf139640 1 -- 172.21.15.121:0/1263638314 shutdown_connections 2024-08-18T22:42:13.985 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:13.984+0000 7fcaaf139640 1 --2- 172.21.15.121:0/1263638314 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcaa80fc4a0 0x7fcaa80fc910 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:42:13.985 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:13.984+0000 7fcaaf139640 1 --2- 172.21.15.121:0/1263638314 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcaa80fb1d0 0x7fcaa80fb5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:42:13.986 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:13.984+0000 7fcaaf139640 1 -- 172.21.15.121:0/1263638314 >> 172.21.15.121:0/1263638314 conn(0x7fcaa80f69b0 msgr2=0x7fcaa80f8dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:42:13.986 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:13.984+0000 7fcaaf139640 1 -- 172.21.15.121:0/1263638314 shutdown_connections 2024-08-18T22:42:13.986 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:13.984+0000 7fcaaf139640 1 -- 172.21.15.121:0/1263638314 wait complete. 2024-08-18T22:42:13.986 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:13.984+0000 7fcaaf139640 1 Processor -- start 2024-08-18T22:42:13.986 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:13.984+0000 7fcaaf139640 1 -- start start 2024-08-18T22:42:13.987 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:13.985+0000 7fcaaf139640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcaa80fb1d0 0x7fcaa810ce40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:42:13.987 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:13.985+0000 7fcaaf139640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcaa80fc4a0 0x7fcaa810d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:42:13.987 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:13.985+0000 7fcaaf139640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcaa810d9d0 con 0x7fcaa80fb1d0 2024-08-18T22:42:13.987 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:13.985+0000 7fcaaf139640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcaa810e110 con 0x7fcaa80fc4a0 2024-08-18T22:42:13.987 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:13.985+0000 7fcaaced5640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcaa80fb1d0 0x7fcaa810ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:42:13.988 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:13.985+0000 7fcaaced5640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcaa80fb1d0 0x7fcaa810ce40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:51280/0 (socket says 172.21.15.121:51280) 2024-08-18T22:42:13.988 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:13.985+0000 7fcaaced5640 1 -- 172.21.15.121:0/1357968257 learned_addr learned my addr 172.21.15.121:0/1357968257 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-18T22:42:13.988 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:13.985+0000 7fcaa7fff640 1 --2- 172.21.15.121:0/1357968257 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcaa80fc4a0 0x7fcaa810d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:42:13.988 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:13.985+0000 7fcaaced5640 1 -- 172.21.15.121:0/1357968257 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcaa80fc4a0 msgr2=0x7fcaa810d380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:42:13.988 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:13.985+0000 7fcaaced5640 1 --2- 172.21.15.121:0/1357968257 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcaa80fc4a0 0x7fcaa810d380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:42:13.988 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:13.985+0000 7fcaaced5640 1 -- 172.21.15.121:0/1357968257 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca94005040 con 0x7fcaa80fb1d0 2024-08-18T22:42:13.988 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:13.985+0000 7fcaaced5640 1 --2- 172.21.15.121:0/1357968257 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcaa80fb1d0 0x7fcaa810ce40 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fca9c00eb70 tx=0x7fca9c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:42:13.988 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:13.985+0000 7fcaa57fa640 1 -- 172.21.15.121:0/1357968257 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fca9c007c30 con 0x7fcaa80fb1d0 2024-08-18T22:42:13.988 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:13.986+0000 7fcaaf139640 1 -- 172.21.15.121:0/1357968257 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcaa810e340 con 0x7fcaa80fb1d0 2024-08-18T22:42:13.988 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:13.986+0000 7fcaa57fa640 1 -- 172.21.15.121:0/1357968257 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fca9c00f040 con 0x7fcaa80fb1d0 2024-08-18T22:42:13.988 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:13.986+0000 7fcaa57fa640 1 -- 172.21.15.121:0/1357968257 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fca9c0094e0 con 0x7fcaa80fb1d0 2024-08-18T22:42:13.988 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:13.986+0000 7fcaaf139640 1 -- 172.21.15.121:0/1357968257 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcaa810e8e0 con 0x7fcaa80fb1d0 2024-08-18T22:42:13.989 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:13.987+0000 7fcaaf139640 1 -- 172.21.15.121:0/1357968257 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcaa80fa630 con 0x7fcaa80fb1d0 2024-08-18T22:42:13.989 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:13.988+0000 7fcaa57fa640 1 -- 172.21.15.121:0/1357968257 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 25) v1 ==== 88617+0+0 (secure 0 0 0) 0x7fca9c009720 con 0x7fcaa80fb1d0 2024-08-18T22:42:13.989 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:13.988+0000 7fcaa57fa640 1 --2- 172.21.15.121:0/1357968257 >> [v2:172.21.15.195:6828/1174410756,v1:172.21.15.195:6829/1174410756] conn(0x7fca9806a6d0 0x7fca9806cb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:42:13.989 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:13.988+0000 7fcaa57fa640 1 -- 172.21.15.121:0/1357968257 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5808+0+0 (secure 0 0 0) 0x7fca9c088db0 con 0x7fcaa80fb1d0 2024-08-18T22:42:13.990 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:13.988+0000 7fcaa7fff640 1 --2- 172.21.15.121:0/1357968257 >> [v2:172.21.15.195:6828/1174410756,v1:172.21.15.195:6829/1174410756] conn(0x7fca9806a6d0 0x7fca9806cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:42:13.990 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:13.989+0000 7fcaa7fff640 1 --2- 172.21.15.121:0/1357968257 >> [v2:172.21.15.195:6828/1174410756,v1:172.21.15.195:6829/1174410756] conn(0x7fca9806a6d0 0x7fca9806cb80 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fca94004540 tx=0x7fca94035040 comp rx=0 tx=0).ready entity=mgr.24377 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:42:13.993 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:13.993+0000 7fcaa57fa640 1 -- 172.21.15.121:0/1357968257 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7fca9c050670 con 0x7fcaa80fb1d0 2024-08-18T22:42:14.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:42:13 smithi195 ceph-mon[23370]: from='client.14676 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-18T22:42:14.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:42:13 smithi195 ceph-mon[23370]: from='client.14680 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-18T22:42:14.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:42:13 smithi195 ceph-mon[23370]: from='mgr.24377 ' entity='mgr.smithi195.acttsj' 2024-08-18T22:42:14.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:42:13 smithi195 ceph-mon[23370]: from='mgr.24377 ' entity='mgr.smithi195.acttsj' 2024-08-18T22:42:14.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:42:13 smithi195 ceph-mon[23370]: from='client.? 172.21.15.121:0/644452593' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-08-18T22:42:14.247 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:14.246+0000 7fcaaf139640 1 -- 172.21.15.121:0/1357968257 --> [v2:172.21.15.195:6828/1174410756,v1:172.21.15.195:6829/1174410756] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fcaa8103ce0 con 0x7fca9806a6d0 2024-08-18T22:42:14.248 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:14.248+0000 7fcaa57fa640 1 -- 172.21.15.121:0/1357968257 <== mgr.24377 v2:172.21.15.195:6828/1174410756 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+318 (secure 0 0 0) 0x7fcaa8103ce0 con 0x7fca9806a6d0 2024-08-18T22:42:14.249 INFO:teuthology.orchestra.run.smithi121.stdout:{ 2024-08-18T22:42:14.249 INFO:teuthology.orchestra.run.smithi121.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9", 2024-08-18T22:42:14.249 INFO:teuthology.orchestra.run.smithi121.stdout: "in_progress": true, 2024-08-18T22:42:14.249 INFO:teuthology.orchestra.run.smithi121.stdout: "which": "Upgrading all daemon types on all hosts", 2024-08-18T22:42:14.249 INFO:teuthology.orchestra.run.smithi121.stdout: "services_complete": [], 2024-08-18T22:42:14.249 INFO:teuthology.orchestra.run.smithi121.stdout: "progress": "1/21 daemons upgraded", 2024-08-18T22:42:14.249 INFO:teuthology.orchestra.run.smithi121.stdout: "message": "", 2024-08-18T22:42:14.249 INFO:teuthology.orchestra.run.smithi121.stdout: "is_paused": false 2024-08-18T22:42:14.249 INFO:teuthology.orchestra.run.smithi121.stdout:} 2024-08-18T22:42:14.251 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:14.250+0000 7fcaaf139640 1 -- 172.21.15.121:0/1357968257 >> [v2:172.21.15.195:6828/1174410756,v1:172.21.15.195:6829/1174410756] conn(0x7fca9806a6d0 msgr2=0x7fca9806cb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:42:14.251 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:14.250+0000 7fcaaf139640 1 --2- 172.21.15.121:0/1357968257 >> [v2:172.21.15.195:6828/1174410756,v1:172.21.15.195:6829/1174410756] conn(0x7fca9806a6d0 0x7fca9806cb80 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fca94004540 tx=0x7fca94035040 comp rx=0 tx=0).stop 2024-08-18T22:42:14.251 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:14.250+0000 7fcaaf139640 1 -- 172.21.15.121:0/1357968257 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcaa80fb1d0 msgr2=0x7fcaa810ce40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:42:14.251 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:14.250+0000 7fcaaf139640 1 --2- 172.21.15.121:0/1357968257 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcaa80fb1d0 0x7fcaa810ce40 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fca9c00eb70 tx=0x7fca9c00b040 comp rx=0 tx=0).stop 2024-08-18T22:42:14.252 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:14.250+0000 7fcaaf139640 1 -- 172.21.15.121:0/1357968257 shutdown_connections 2024-08-18T22:42:14.252 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:14.250+0000 7fcaaf139640 1 --2- 172.21.15.121:0/1357968257 >> [v2:172.21.15.195:6828/1174410756,v1:172.21.15.195:6829/1174410756] conn(0x7fca9806a6d0 0x7fca9806cb80 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:42:14.252 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:14.250+0000 7fcaaf139640 1 --2- 172.21.15.121:0/1357968257 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcaa80fc4a0 0x7fcaa810d380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:42:14.252 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:14.250+0000 7fcaaf139640 1 --2- 172.21.15.121:0/1357968257 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcaa80fb1d0 0x7fcaa810ce40 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:42:14.252 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:14.250+0000 7fcaaf139640 1 -- 172.21.15.121:0/1357968257 >> 172.21.15.121:0/1357968257 conn(0x7fcaa80f69b0 msgr2=0x7fcaa8065300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:42:14.252 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:14.250+0000 7fcaaf139640 1 -- 172.21.15.121:0/1357968257 shutdown_connections 2024-08-18T22:42:14.252 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:14.250+0000 7fcaaf139640 1 -- 172.21.15.121:0/1357968257 wait complete. 2024-08-18T22:42:14.334 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:14.332+0000 7f9b3c2ad640 1 -- 172.21.15.121:0/2680987248 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9b340fc4a0 msgr2=0x7f9b340fc910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:42:14.334 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:14.332+0000 7f9b3c2ad640 1 --2- 172.21.15.121:0/2680987248 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9b340fc4a0 0x7f9b340fc910 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f9b300048d0 tx=0x7f9b30009da0 comp rx=0 tx=0).stop 2024-08-18T22:42:14.334 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:14.332+0000 7f9b3c2ad640 1 -- 172.21.15.121:0/2680987248 shutdown_connections 2024-08-18T22:42:14.334 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:14.332+0000 7f9b3c2ad640 1 --2- 172.21.15.121:0/2680987248 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9b340fc4a0 0x7f9b340fc910 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:42:14.335 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:14.332+0000 7f9b3c2ad640 1 --2- 172.21.15.121:0/2680987248 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9b340fb1d0 0x7f9b340fb5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:42:14.335 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:14.332+0000 7f9b3c2ad640 1 -- 172.21.15.121:0/2680987248 >> 172.21.15.121:0/2680987248 conn(0x7f9b340f69b0 msgr2=0x7f9b340f8dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:42:14.335 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:14.332+0000 7f9b3c2ad640 1 -- 172.21.15.121:0/2680987248 shutdown_connections 2024-08-18T22:42:14.335 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:14.332+0000 7f9b3c2ad640 1 -- 172.21.15.121:0/2680987248 wait complete. 2024-08-18T22:42:14.335 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:14.332+0000 7f9b3c2ad640 1 Processor -- start 2024-08-18T22:42:14.335 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:14.333+0000 7f9b3c2ad640 1 -- start start 2024-08-18T22:42:14.335 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:14.333+0000 7f9b3c2ad640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9b340fb1d0 0x7f9b3410bd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:42:14.335 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:14.333+0000 7f9b3c2ad640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9b340fc4a0 0x7f9b3410c2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:42:14.335 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:14.333+0000 7f9b3c2ad640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b3410c920 con 0x7f9b340fc4a0 2024-08-18T22:42:14.335 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:14.333+0000 7f9b3c2ad640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b3410d060 con 0x7f9b340fb1d0 2024-08-18T22:42:14.335 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:14.333+0000 7f9b39848640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9b340fc4a0 0x7f9b3410c2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:42:14.335 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:14.333+0000 7f9b39848640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9b340fc4a0 0x7f9b3410c2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:51290/0 (socket says 172.21.15.121:51290) 2024-08-18T22:42:14.335 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:14.333+0000 7f9b3a049640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9b340fb1d0 0x7f9b3410bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:42:14.336 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:14.333+0000 7f9b39848640 1 -- 172.21.15.121:0/126700442 learned_addr learned my addr 172.21.15.121:0/126700442 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-18T22:42:14.336 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:14.333+0000 7f9b39848640 1 -- 172.21.15.121:0/126700442 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9b340fb1d0 msgr2=0x7f9b3410bd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:42:14.336 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:14.333+0000 7f9b39848640 1 --2- 172.21.15.121:0/126700442 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9b340fb1d0 0x7f9b3410bd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:42:14.336 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:14.333+0000 7f9b39848640 1 -- 172.21.15.121:0/126700442 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b30005040 con 0x7f9b340fc4a0 2024-08-18T22:42:14.336 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:14.333+0000 7f9b3a049640 1 --2- 172.21.15.121:0/126700442 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9b340fb1d0 0x7f9b3410bd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:42:14.336 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:14.333+0000 7f9b39848640 1 --2- 172.21.15.121:0/126700442 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9b340fc4a0 0x7f9b3410c2d0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f9b300048a0 tx=0x7f9b30009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:42:14.337 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:14.334+0000 7f9b2affd640 1 -- 172.21.15.121:0/126700442 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9b30038070 con 0x7f9b340fc4a0 2024-08-18T22:42:14.337 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:14.334+0000 7f9b2affd640 1 -- 172.21.15.121:0/126700442 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f9b30004290 con 0x7f9b340fc4a0 2024-08-18T22:42:14.337 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:14.334+0000 7f9b2affd640 1 -- 172.21.15.121:0/126700442 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9b30033660 con 0x7f9b340fc4a0 2024-08-18T22:42:14.337 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:14.334+0000 7f9b3c2ad640 1 -- 172.21.15.121:0/126700442 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b3410d290 con 0x7f9b340fc4a0 2024-08-18T22:42:14.338 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:14.334+0000 7f9b3c2ad640 1 -- 172.21.15.121:0/126700442 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b3410d7d0 con 0x7f9b340fc4a0 2024-08-18T22:42:14.338 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:14.335+0000 7f9b3c2ad640 1 -- 172.21.15.121:0/126700442 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b340fa630 con 0x7f9b340fc4a0 2024-08-18T22:42:14.338 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:14.336+0000 7f9b2affd640 1 -- 172.21.15.121:0/126700442 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 25) v1 ==== 88617+0+0 (secure 0 0 0) 0x7f9b30030020 con 0x7f9b340fc4a0 2024-08-18T22:42:14.338 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:14.336+0000 7f9b2affd640 1 --2- 172.21.15.121:0/126700442 >> [v2:172.21.15.195:6828/1174410756,v1:172.21.15.195:6829/1174410756] conn(0x7f9b2006a6d0 0x7f9b2006cb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:42:14.338 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:14.337+0000 7f9b2affd640 1 -- 172.21.15.121:0/126700442 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f9b300a9050 con 0x7f9b340fc4a0 2024-08-18T22:42:14.338 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:14.337+0000 7f9b3a049640 1 --2- 172.21.15.121:0/126700442 >> [v2:172.21.15.195:6828/1174410756,v1:172.21.15.195:6829/1174410756] conn(0x7f9b2006a6d0 0x7f9b2006cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:42:14.338 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:14.337+0000 7f9b3a049640 1 --2- 172.21.15.121:0/126700442 >> [v2:172.21.15.195:6828/1174410756,v1:172.21.15.195:6829/1174410756] conn(0x7f9b2006a6d0 0x7f9b2006cb80 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f9b3410bb20 tx=0x7f9b2400b040 comp rx=0 tx=0).ready entity=mgr.24377 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:42:14.342 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:14.341+0000 7f9b2affd640 1 -- 172.21.15.121:0/126700442 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7f9b30072d50 con 0x7f9b340fc4a0 2024-08-18T22:42:14.593 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:14.592+0000 7f9b3c2ad640 1 -- 172.21.15.121:0/126700442 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f9b3404b4c0 con 0x7f9b340fc4a0 2024-08-18T22:42:14.593 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:14.592+0000 7f9b2affd640 1 -- 172.21.15.121:0/126700442 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f9b3002c870 con 0x7f9b340fc4a0 2024-08-18T22:42:14.593 INFO:teuthology.orchestra.run.smithi121.stdout:HEALTH_OK 2024-08-18T22:42:14.595 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:14.594+0000 7f9b3c2ad640 1 -- 172.21.15.121:0/126700442 >> [v2:172.21.15.195:6828/1174410756,v1:172.21.15.195:6829/1174410756] conn(0x7f9b2006a6d0 msgr2=0x7f9b2006cb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:42:14.595 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:14.594+0000 7f9b3c2ad640 1 --2- 172.21.15.121:0/126700442 >> [v2:172.21.15.195:6828/1174410756,v1:172.21.15.195:6829/1174410756] conn(0x7f9b2006a6d0 0x7f9b2006cb80 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f9b3410bb20 tx=0x7f9b2400b040 comp rx=0 tx=0).stop 2024-08-18T22:42:14.595 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:14.594+0000 7f9b3c2ad640 1 -- 172.21.15.121:0/126700442 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9b340fc4a0 msgr2=0x7f9b3410c2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:42:14.595 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:14.594+0000 7f9b3c2ad640 1 --2- 172.21.15.121:0/126700442 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9b340fc4a0 0x7f9b3410c2d0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f9b300048a0 tx=0x7f9b30009da0 comp rx=0 tx=0).stop 2024-08-18T22:42:14.595 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:14.594+0000 7f9b3c2ad640 1 -- 172.21.15.121:0/126700442 shutdown_connections 2024-08-18T22:42:14.595 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:14.594+0000 7f9b3c2ad640 1 --2- 172.21.15.121:0/126700442 >> [v2:172.21.15.195:6828/1174410756,v1:172.21.15.195:6829/1174410756] conn(0x7f9b2006a6d0 0x7f9b2006cb80 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:42:14.596 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:14.594+0000 7f9b3c2ad640 1 --2- 172.21.15.121:0/126700442 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9b340fc4a0 0x7f9b3410c2d0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:42:14.596 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:14.594+0000 7f9b3c2ad640 1 --2- 172.21.15.121:0/126700442 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9b340fb1d0 0x7f9b3410bd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:42:14.596 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:14.594+0000 7f9b3c2ad640 1 -- 172.21.15.121:0/126700442 >> 172.21.15.121:0/126700442 conn(0x7f9b340f69b0 msgr2=0x7f9b340f8190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:42:14.596 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:14.594+0000 7f9b3c2ad640 1 -- 172.21.15.121:0/126700442 shutdown_connections 2024-08-18T22:42:14.596 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:14.594+0000 7f9b3c2ad640 1 -- 172.21.15.121:0/126700442 wait complete. 2024-08-18T22:42:15.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:42:14 smithi121 ceph-mon[16788]: Reconfiguring grafana.smithi121 (dependencies changed)... 2024-08-18T22:42:15.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:42:14 smithi121 ceph-mon[16788]: Reconfiguring daemon grafana.smithi121 on smithi121 2024-08-18T22:42:15.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:42:14 smithi121 ceph-mon[16788]: from='client.14684 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-18T22:42:15.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:42:14 smithi121 ceph-mon[16788]: pgmap v21: 65 pgs: 65 active+clean; 3.1 GiB data, 11 GiB used, 526 GiB / 536 GiB avail; 6.1 MiB/s rd, 14 MiB/s wr, 146 op/s 2024-08-18T22:42:15.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:42:14 smithi121 ceph-mon[16788]: from='client.? 172.21.15.121:0/461540931' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-08-18T22:42:15.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:42:14 smithi121 ceph-mon[16788]: from='client.? 172.21.15.121:0/126700442' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-08-18T22:42:15.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:42:14 smithi195 ceph-mon[23370]: Reconfiguring grafana.smithi121 (dependencies changed)... 2024-08-18T22:42:15.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:42:14 smithi195 ceph-mon[23370]: Reconfiguring daemon grafana.smithi121 on smithi121 2024-08-18T22:42:15.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:42:14 smithi195 ceph-mon[23370]: from='client.14684 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-18T22:42:15.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:42:14 smithi195 ceph-mon[23370]: pgmap v21: 65 pgs: 65 active+clean; 3.1 GiB data, 11 GiB used, 526 GiB / 536 GiB avail; 6.1 MiB/s rd, 14 MiB/s wr, 146 op/s 2024-08-18T22:42:15.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:42:14 smithi195 ceph-mon[23370]: from='client.? 172.21.15.121:0/461540931' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-08-18T22:42:15.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:42:14 smithi195 ceph-mon[23370]: from='client.? 172.21.15.121:0/126700442' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-08-18T22:42:16.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:42:15 smithi121 ceph-mon[16788]: from='client.14694 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-18T22:42:16.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:42:15 smithi195 ceph-mon[23370]: from='client.14694 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-18T22:42:17.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:42:16 smithi121 ceph-mon[16788]: pgmap v22: 65 pgs: 65 active+clean; 2.0 GiB data, 7.7 GiB used, 529 GiB / 536 GiB avail; 6.2 MiB/s rd, 14 MiB/s wr, 230 op/s 2024-08-18T22:42:17.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:42:16 smithi195 ceph-mon[23370]: pgmap v22: 65 pgs: 65 active+clean; 2.0 GiB data, 7.7 GiB used, 529 GiB / 536 GiB avail; 6.2 MiB/s rd, 14 MiB/s wr, 230 op/s 2024-08-18T22:42:18.060 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:42:17 smithi195 ceph-mon[23370]: fsmap cephfs:2 {0=cephfs.smithi121.gbickb=up:active,1=cephfs.smithi195.buqvbr=up:active} 2 up:standby 2024-08-18T22:42:18.078 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:42:17 smithi121 ceph-mon[16788]: fsmap cephfs:2 {0=cephfs.smithi121.gbickb=up:active,1=cephfs.smithi195.buqvbr=up:active} 2 up:standby 2024-08-18T22:42:19.071 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:42:18 smithi121 ceph-mon[16788]: pgmap v23: 65 pgs: 65 active+clean; 2.0 GiB data, 7.7 GiB used, 529 GiB / 536 GiB avail; 20 KiB/s rd, 1.1 MiB/s wr, 155 op/s 2024-08-18T22:42:19.071 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:42:18 smithi121 ceph-mon[16788]: from='mgr.24377 ' entity='mgr.smithi195.acttsj' 2024-08-18T22:42:19.071 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:42:18 smithi121 ceph-mon[16788]: from='mgr.24377 ' entity='mgr.smithi195.acttsj' 2024-08-18T22:42:19.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:42:18 smithi195 ceph-mon[23370]: pgmap v23: 65 pgs: 65 active+clean; 2.0 GiB data, 7.7 GiB used, 529 GiB / 536 GiB avail; 20 KiB/s rd, 1.1 MiB/s wr, 155 op/s 2024-08-18T22:42:19.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:42:18 smithi195 ceph-mon[23370]: from='mgr.24377 ' entity='mgr.smithi195.acttsj' 2024-08-18T22:42:19.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:42:18 smithi195 ceph-mon[23370]: from='mgr.24377 ' entity='mgr.smithi195.acttsj' 2024-08-18T22:42:20.075 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:42:19 smithi121 ceph-mon[16788]: Reconfiguring prometheus.smithi121 (dependencies changed)... 2024-08-18T22:42:20.075 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:42:19 smithi121 ceph-mon[16788]: Reconfiguring daemon prometheus.smithi121 on smithi121 2024-08-18T22:42:20.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:42:19 smithi195 ceph-mon[23370]: Reconfiguring prometheus.smithi121 (dependencies changed)... 2024-08-18T22:42:20.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:42:19 smithi195 ceph-mon[23370]: Reconfiguring daemon prometheus.smithi121 on smithi121 2024-08-18T22:42:20.942 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:42:20 smithi121 ceph-mon[16788]: pgmap v24: 65 pgs: 65 active+clean; 2.0 GiB data, 7.7 GiB used, 529 GiB / 536 GiB avail; 36 KiB/s rd, 1.8 MiB/s wr, 329 op/s 2024-08-18T22:42:21.158 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:42:20 smithi195 ceph-mon[23370]: pgmap v24: 65 pgs: 65 active+clean; 2.0 GiB data, 7.7 GiB used, 529 GiB / 536 GiB avail; 36 KiB/s rd, 1.8 MiB/s wr, 329 op/s 2024-08-18T22:42:22.926 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:42:22 smithi121 ceph-mon[16788]: pgmap v25: 65 pgs: 65 active+clean; 2.0 GiB data, 7.7 GiB used, 529 GiB / 536 GiB avail; 28 KiB/s rd, 1.2 MiB/s wr, 257 op/s 2024-08-18T22:42:23.158 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:42:22 smithi195 ceph-mon[23370]: pgmap v25: 65 pgs: 65 active+clean; 2.0 GiB data, 7.7 GiB used, 529 GiB / 536 GiB avail; 28 KiB/s rd, 1.2 MiB/s wr, 257 op/s 2024-08-18T22:42:24.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:42:23 smithi121 ceph-mon[16788]: from='mgr.24377 172.21.15.195:0/2331273060' entity='mgr.smithi195.acttsj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-18T22:42:24.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:42:23 smithi121 ceph-mon[16788]: from='mgr.24377 ' entity='mgr.smithi195.acttsj' 2024-08-18T22:42:24.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:42:23 smithi121 ceph-mon[16788]: from='mgr.24377 ' entity='mgr.smithi195.acttsj' 2024-08-18T22:42:24.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:42:23 smithi195 ceph-mon[23370]: from='mgr.24377 172.21.15.195:0/2331273060' entity='mgr.smithi195.acttsj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-18T22:42:24.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:42:23 smithi195 ceph-mon[23370]: from='mgr.24377 ' entity='mgr.smithi195.acttsj' 2024-08-18T22:42:24.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:42:23 smithi195 ceph-mon[23370]: from='mgr.24377 ' entity='mgr.smithi195.acttsj' 2024-08-18T22:42:25.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:42:24 smithi121 ceph-mon[16788]: Reconfiguring node-exporter.smithi195 (dependencies changed)... 2024-08-18T22:42:25.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:42:24 smithi121 ceph-mon[16788]: Reconfiguring daemon node-exporter.smithi195 on smithi195 2024-08-18T22:42:25.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:42:24 smithi121 ceph-mon[16788]: pgmap v26: 65 pgs: 65 active+clean; 2.0 GiB data, 7.7 GiB used, 529 GiB / 536 GiB avail; 28 KiB/s rd, 1.2 MiB/s wr, 257 op/s 2024-08-18T22:42:25.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:42:24 smithi195 ceph-mon[23370]: Reconfiguring node-exporter.smithi195 (dependencies changed)... 2024-08-18T22:42:25.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:42:24 smithi195 ceph-mon[23370]: Reconfiguring daemon node-exporter.smithi195 on smithi195 2024-08-18T22:42:25.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:42:24 smithi195 ceph-mon[23370]: pgmap v26: 65 pgs: 65 active+clean; 2.0 GiB data, 7.7 GiB used, 529 GiB / 536 GiB avail; 28 KiB/s rd, 1.2 MiB/s wr, 257 op/s 2024-08-18T22:42:27.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:42:26 smithi121 ceph-mon[16788]: pgmap v27: 65 pgs: 65 active+clean; 2.0 GiB data, 7.6 GiB used, 529 GiB / 536 GiB avail; 44 KiB/s rd, 1.9 MiB/s wr, 423 op/s 2024-08-18T22:42:27.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:42:26 smithi195 ceph-mon[23370]: pgmap v27: 65 pgs: 65 active+clean; 2.0 GiB data, 7.6 GiB used, 529 GiB / 536 GiB avail; 44 KiB/s rd, 1.9 MiB/s wr, 423 op/s 2024-08-18T22:42:29.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:42:28 smithi121 ceph-mon[16788]: pgmap v28: 65 pgs: 65 active+clean; 2.0 GiB data, 7.6 GiB used, 529 GiB / 536 GiB avail; 33 KiB/s rd, 1.3 MiB/s wr, 339 op/s 2024-08-18T22:42:29.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:42:28 smithi195 ceph-mon[23370]: pgmap v28: 65 pgs: 65 active+clean; 2.0 GiB data, 7.6 GiB used, 529 GiB / 536 GiB avail; 33 KiB/s rd, 1.3 MiB/s wr, 339 op/s 2024-08-18T22:42:31.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:42:30 smithi121 ceph-mon[16788]: pgmap v29: 65 pgs: 65 active+clean; 2.0 GiB data, 7.6 GiB used, 529 GiB / 536 GiB avail; 46 KiB/s rd, 1.9 MiB/s wr, 460 op/s 2024-08-18T22:42:31.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:42:30 smithi195 ceph-mon[23370]: pgmap v29: 65 pgs: 65 active+clean; 2.0 GiB data, 7.6 GiB used, 529 GiB / 536 GiB avail; 46 KiB/s rd, 1.9 MiB/s wr, 460 op/s 2024-08-18T22:42:33.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:42:32 smithi121 ceph-mon[16788]: pgmap v30: 65 pgs: 65 active+clean; 2.0 GiB data, 7.6 GiB used, 529 GiB / 536 GiB avail; 29 KiB/s rd, 1.2 MiB/s wr, 287 op/s 2024-08-18T22:42:33.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:42:32 smithi195 ceph-mon[23370]: pgmap v30: 65 pgs: 65 active+clean; 2.0 GiB data, 7.6 GiB used, 529 GiB / 536 GiB avail; 29 KiB/s rd, 1.2 MiB/s wr, 287 op/s 2024-08-18T22:42:35.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:42:34 smithi121 ceph-mon[16788]: pgmap v31: 65 pgs: 65 active+clean; 2.0 GiB data, 7.6 GiB used, 529 GiB / 536 GiB avail; 29 KiB/s rd, 1.2 MiB/s wr, 287 op/s 2024-08-18T22:42:35.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:42:34 smithi195 ceph-mon[23370]: pgmap v31: 65 pgs: 65 active+clean; 2.0 GiB data, 7.6 GiB used, 529 GiB / 536 GiB avail; 29 KiB/s rd, 1.2 MiB/s wr, 287 op/s 2024-08-18T22:42:37.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:42:36 smithi195 ceph-mon[23370]: pgmap v32: 65 pgs: 65 active+clean; 2.0 GiB data, 7.6 GiB used, 529 GiB / 536 GiB avail; 42 KiB/s rd, 1.6 MiB/s wr, 416 op/s 2024-08-18T22:42:37.333 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:42:36 smithi121 ceph-mon[16788]: pgmap v32: 65 pgs: 65 active+clean; 2.0 GiB data, 7.6 GiB used, 529 GiB / 536 GiB avail; 42 KiB/s rd, 1.6 MiB/s wr, 416 op/s 2024-08-18T22:42:39.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:42:38 smithi121 ceph-mon[16788]: pgmap v33: 65 pgs: 65 active+clean; 2.0 GiB data, 7.6 GiB used, 529 GiB / 536 GiB avail; 25 KiB/s rd, 954 KiB/s wr, 250 op/s 2024-08-18T22:42:39.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:42:38 smithi121 ceph-mon[16788]: from='mgr.24377 172.21.15.195:0/2331273060' entity='mgr.smithi195.acttsj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-18T22:42:39.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:42:38 smithi195 ceph-mon[23370]: pgmap v33: 65 pgs: 65 active+clean; 2.0 GiB data, 7.6 GiB used, 529 GiB / 536 GiB avail; 25 KiB/s rd, 954 KiB/s wr, 250 op/s 2024-08-18T22:42:39.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:42:38 smithi195 ceph-mon[23370]: from='mgr.24377 172.21.15.195:0/2331273060' entity='mgr.smithi195.acttsj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-18T22:42:39.996 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:42:39 smithi121 ceph-mon[16788]: from='mgr.24377 ' entity='mgr.smithi195.acttsj' 2024-08-18T22:42:39.996 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:42:39 smithi121 ceph-mon[16788]: from='mgr.24377 ' entity='mgr.smithi195.acttsj' 2024-08-18T22:42:39.996 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:42:39 smithi121 ceph-mon[16788]: from='mgr.24377 172.21.15.195:0/2331273060' entity='mgr.smithi195.acttsj' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-08-18T22:42:39.997 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:42:39 smithi121 ceph-mon[16788]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-08-18T22:42:39.997 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:42:39 smithi121 ceph-mon[16788]: from='mgr.24377 172.21.15.195:0/2331273060' entity='mgr.smithi195.acttsj' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi121.front.sepia.ceph.com:9093"}]: dispatch 2024-08-18T22:42:39.997 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:42:39 smithi121 ceph-mon[16788]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi121.front.sepia.ceph.com:9093"}]: dispatch 2024-08-18T22:42:39.997 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:42:39 smithi121 ceph-mon[16788]: from='mgr.24377 ' entity='mgr.smithi195.acttsj' 2024-08-18T22:42:39.997 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:42:39 smithi121 ceph-mon[16788]: from='mgr.24377 172.21.15.195:0/2331273060' entity='mgr.smithi195.acttsj' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-08-18T22:42:39.997 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:42:39 smithi121 ceph-mon[16788]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-08-18T22:42:39.997 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:42:39 smithi121 ceph-mon[16788]: from='mgr.24377 172.21.15.195:0/2331273060' entity='mgr.smithi195.acttsj' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi121.front.sepia.ceph.com:3000"}]: dispatch 2024-08-18T22:42:39.997 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:42:39 smithi121 ceph-mon[16788]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi121.front.sepia.ceph.com:3000"}]: dispatch 2024-08-18T22:42:39.997 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:42:39 smithi121 ceph-mon[16788]: from='mgr.24377 ' entity='mgr.smithi195.acttsj' 2024-08-18T22:42:39.997 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:42:39 smithi121 ceph-mon[16788]: from='mgr.24377 172.21.15.195:0/2331273060' entity='mgr.smithi195.acttsj' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-08-18T22:42:39.997 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:42:39 smithi121 ceph-mon[16788]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-08-18T22:42:39.997 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:42:39 smithi121 ceph-mon[16788]: from='mgr.24377 172.21.15.195:0/2331273060' entity='mgr.smithi195.acttsj' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi121.front.sepia.ceph.com:9095"}]: dispatch 2024-08-18T22:42:39.997 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:42:39 smithi121 ceph-mon[16788]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi121.front.sepia.ceph.com:9095"}]: dispatch 2024-08-18T22:42:39.998 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:42:39 smithi121 ceph-mon[16788]: from='mgr.24377 ' entity='mgr.smithi195.acttsj' 2024-08-18T22:42:39.998 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:42:39 smithi121 ceph-mon[16788]: from='mgr.24377 172.21.15.195:0/2331273060' entity='mgr.smithi195.acttsj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-18T22:42:40.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:42:39 smithi195 ceph-mon[23370]: from='mgr.24377 ' entity='mgr.smithi195.acttsj' 2024-08-18T22:42:40.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:42:39 smithi195 ceph-mon[23370]: from='mgr.24377 ' entity='mgr.smithi195.acttsj' 2024-08-18T22:42:40.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:42:39 smithi195 ceph-mon[23370]: from='mgr.24377 172.21.15.195:0/2331273060' entity='mgr.smithi195.acttsj' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-08-18T22:42:40.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:42:39 smithi195 ceph-mon[23370]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-08-18T22:42:40.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:42:39 smithi195 ceph-mon[23370]: from='mgr.24377 172.21.15.195:0/2331273060' entity='mgr.smithi195.acttsj' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi121.front.sepia.ceph.com:9093"}]: dispatch 2024-08-18T22:42:40.160 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:42:39 smithi195 ceph-mon[23370]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi121.front.sepia.ceph.com:9093"}]: dispatch 2024-08-18T22:42:40.160 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:42:39 smithi195 ceph-mon[23370]: from='mgr.24377 ' entity='mgr.smithi195.acttsj' 2024-08-18T22:42:40.160 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:42:39 smithi195 ceph-mon[23370]: from='mgr.24377 172.21.15.195:0/2331273060' entity='mgr.smithi195.acttsj' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-08-18T22:42:40.160 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:42:39 smithi195 ceph-mon[23370]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-08-18T22:42:40.160 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:42:39 smithi195 ceph-mon[23370]: from='mgr.24377 172.21.15.195:0/2331273060' entity='mgr.smithi195.acttsj' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi121.front.sepia.ceph.com:3000"}]: dispatch 2024-08-18T22:42:40.160 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:42:39 smithi195 ceph-mon[23370]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi121.front.sepia.ceph.com:3000"}]: dispatch 2024-08-18T22:42:40.160 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:42:39 smithi195 ceph-mon[23370]: from='mgr.24377 ' entity='mgr.smithi195.acttsj' 2024-08-18T22:42:40.160 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:42:39 smithi195 ceph-mon[23370]: from='mgr.24377 172.21.15.195:0/2331273060' entity='mgr.smithi195.acttsj' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-08-18T22:42:40.160 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:42:39 smithi195 ceph-mon[23370]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-08-18T22:42:40.160 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:42:39 smithi195 ceph-mon[23370]: from='mgr.24377 172.21.15.195:0/2331273060' entity='mgr.smithi195.acttsj' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi121.front.sepia.ceph.com:9095"}]: dispatch 2024-08-18T22:42:40.160 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:42:39 smithi195 ceph-mon[23370]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi121.front.sepia.ceph.com:9095"}]: dispatch 2024-08-18T22:42:40.160 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:42:39 smithi195 ceph-mon[23370]: from='mgr.24377 ' entity='mgr.smithi195.acttsj' 2024-08-18T22:42:40.160 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:42:39 smithi195 ceph-mon[23370]: from='mgr.24377 172.21.15.195:0/2331273060' entity='mgr.smithi195.acttsj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-18T22:42:41.143 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:42:40 smithi121 ceph-mon[16788]: Upgrade: Need to upgrade myself (mgr.smithi195.acttsj) 2024-08-18T22:42:41.143 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:42:40 smithi121 ceph-mon[16788]: Upgrade: Need to upgrade myself (mgr.smithi195.acttsj) 2024-08-18T22:42:41.143 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:42:40 smithi121 ceph-mon[16788]: pgmap v34: 65 pgs: 65 active+clean; 2.0 GiB data, 7.6 GiB used, 529 GiB / 536 GiB avail; 39 KiB/s rd, 1.4 MiB/s wr, 379 op/s 2024-08-18T22:42:41.143 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:42:40 smithi121 ceph-mon[16788]: from='mgr.24377 ' entity='mgr.smithi195.acttsj' 2024-08-18T22:42:41.143 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:42:40 smithi121 ceph-mon[16788]: from='mgr.24377 172.21.15.195:0/2331273060' entity='mgr.smithi195.acttsj' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi121.lopxqc", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-08-18T22:42:41.143 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:42:40 smithi121 ceph-mon[16788]: from='mgr.24377 ' entity='mgr.smithi195.acttsj' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi121.lopxqc", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-08-18T22:42:41.143 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:42:40 smithi121 ceph-mon[16788]: from='mgr.24377 172.21.15.195:0/2331273060' entity='mgr.smithi195.acttsj' cmd=[{"prefix": "mgr services"}]: dispatch 2024-08-18T22:42:41.143 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:42:40 smithi121 ceph-mon[16788]: from='mgr.24377 172.21.15.195:0/2331273060' entity='mgr.smithi195.acttsj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:42:41.409 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:42:40 smithi195 ceph-mon[23370]: Upgrade: Need to upgrade myself (mgr.smithi195.acttsj) 2024-08-18T22:42:41.409 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:42:40 smithi195 ceph-mon[23370]: Upgrade: Need to upgrade myself (mgr.smithi195.acttsj) 2024-08-18T22:42:41.409 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:42:40 smithi195 ceph-mon[23370]: pgmap v34: 65 pgs: 65 active+clean; 2.0 GiB data, 7.6 GiB used, 529 GiB / 536 GiB avail; 39 KiB/s rd, 1.4 MiB/s wr, 379 op/s 2024-08-18T22:42:41.409 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:42:40 smithi195 ceph-mon[23370]: from='mgr.24377 ' entity='mgr.smithi195.acttsj' 2024-08-18T22:42:41.409 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:42:40 smithi195 ceph-mon[23370]: from='mgr.24377 172.21.15.195:0/2331273060' entity='mgr.smithi195.acttsj' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi121.lopxqc", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-08-18T22:42:41.409 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:42:40 smithi195 ceph-mon[23370]: from='mgr.24377 ' entity='mgr.smithi195.acttsj' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi121.lopxqc", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-08-18T22:42:41.409 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:42:40 smithi195 ceph-mon[23370]: from='mgr.24377 172.21.15.195:0/2331273060' entity='mgr.smithi195.acttsj' cmd=[{"prefix": "mgr services"}]: dispatch 2024-08-18T22:42:41.409 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:42:40 smithi195 ceph-mon[23370]: from='mgr.24377 172.21.15.195:0/2331273060' entity='mgr.smithi195.acttsj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:42:42.217 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:42:41 smithi121 ceph-mon[16788]: Upgrade: Updating mgr.smithi121.lopxqc 2024-08-18T22:42:42.217 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:42:41 smithi121 ceph-mon[16788]: Deploying daemon mgr.smithi121.lopxqc on smithi121 2024-08-18T22:42:42.409 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:42:41 smithi195 ceph-mon[23370]: Upgrade: Updating mgr.smithi121.lopxqc 2024-08-18T22:42:42.409 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:42:41 smithi195 ceph-mon[23370]: Deploying daemon mgr.smithi121.lopxqc on smithi121 2024-08-18T22:42:43.262 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:42:42 smithi121 ceph-mon[16788]: pgmap v35: 65 pgs: 65 active+clean; 2.0 GiB data, 7.6 GiB used, 529 GiB / 536 GiB avail; 27 KiB/s rd, 800 KiB/s wr, 258 op/s 2024-08-18T22:42:43.409 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:42:42 smithi195 ceph-mon[23370]: pgmap v35: 65 pgs: 65 active+clean; 2.0 GiB data, 7.6 GiB used, 529 GiB / 536 GiB avail; 27 KiB/s rd, 800 KiB/s wr, 258 op/s 2024-08-18T22:42:44.698 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:44.694+0000 7fb07abe7640 1 -- 172.21.15.121:0/1869988938 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb0740fc4a0 msgr2=0x7fb0740fc910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:42:44.698 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:44.694+0000 7fb07abe7640 1 --2- 172.21.15.121:0/1869988938 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb0740fc4a0 0x7fb0740fc910 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fb0600048d0 tx=0x7fb060009da0 comp rx=0 tx=0).stop 2024-08-18T22:42:44.698 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:44.695+0000 7fb07abe7640 1 -- 172.21.15.121:0/1869988938 shutdown_connections 2024-08-18T22:42:44.698 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:44.695+0000 7fb07abe7640 1 --2- 172.21.15.121:0/1869988938 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb0740fc4a0 0x7fb0740fc910 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:42:44.698 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:44.695+0000 7fb07abe7640 1 --2- 172.21.15.121:0/1869988938 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb0740fb1d0 0x7fb0740fb5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:42:44.699 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:44.695+0000 7fb07abe7640 1 -- 172.21.15.121:0/1869988938 >> 172.21.15.121:0/1869988938 conn(0x7fb0740f69b0 msgr2=0x7fb0740f8dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:42:44.699 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:44.695+0000 7fb07abe7640 1 -- 172.21.15.121:0/1869988938 shutdown_connections 2024-08-18T22:42:44.699 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:44.695+0000 7fb07abe7640 1 -- 172.21.15.121:0/1869988938 wait complete. 2024-08-18T22:42:44.699 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:44.695+0000 7fb07abe7640 1 Processor -- start 2024-08-18T22:42:44.699 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:44.696+0000 7fb07abe7640 1 -- start start 2024-08-18T22:42:44.699 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:44.696+0000 7fb07abe7640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb0740fb1d0 0x7fb07410bd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:42:44.699 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:44.696+0000 7fb07abe7640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb0740fc4a0 0x7fb07410c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:42:44.699 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:44.696+0000 7fb07abe7640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb07410cff0 con 0x7fb0740fc4a0 2024-08-18T22:42:44.699 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:44.696+0000 7fb07abe7640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb07410d160 con 0x7fb0740fb1d0 2024-08-18T22:42:44.699 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:44.696+0000 7fb078983640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb0740fb1d0 0x7fb07410bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:42:44.699 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:44.696+0000 7fb078983640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb0740fb1d0 0x7fb07410bd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.121:55864/0 (socket says 172.21.15.121:55864) 2024-08-18T22:42:44.699 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:44.696+0000 7fb078983640 1 -- 172.21.15.121:0/902294252 learned_addr learned my addr 172.21.15.121:0/902294252 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-18T22:42:44.700 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:44.696+0000 7fb073fff640 1 --2- 172.21.15.121:0/902294252 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb0740fc4a0 0x7fb07410c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:42:44.700 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:44.697+0000 7fb078983640 1 -- 172.21.15.121:0/902294252 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb0740fc4a0 msgr2=0x7fb07410c2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:42:44.700 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:44.697+0000 7fb078983640 1 --2- 172.21.15.121:0/902294252 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb0740fc4a0 0x7fb07410c2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:42:44.700 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:44.697+0000 7fb078983640 1 -- 172.21.15.121:0/902294252 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb060005040 con 0x7fb0740fb1d0 2024-08-18T22:42:44.700 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:44.697+0000 7fb078983640 1 --2- 172.21.15.121:0/902294252 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb0740fb1d0 0x7fb07410bd80 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fb06800eb70 tx=0x7fb06800b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:42:44.700 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:44.697+0000 7fb0717fa640 1 -- 172.21.15.121:0/902294252 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb068007c30 con 0x7fb0740fb1d0 2024-08-18T22:42:44.701 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:44.697+0000 7fb07abe7640 1 -- 172.21.15.121:0/902294252 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb07410d3e0 con 0x7fb0740fb1d0 2024-08-18T22:42:44.701 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:44.698+0000 7fb07abe7640 1 -- 172.21.15.121:0/902294252 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb07410d980 con 0x7fb0740fb1d0 2024-08-18T22:42:44.701 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:44.698+0000 7fb0717fa640 1 -- 172.21.15.121:0/902294252 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fb06800f040 con 0x7fb0740fb1d0 2024-08-18T22:42:44.701 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:44.698+0000 7fb0717fa640 1 -- 172.21.15.121:0/902294252 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb0680094e0 con 0x7fb0740fb1d0 2024-08-18T22:42:44.701 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:44.699+0000 7fb07abe7640 1 -- 172.21.15.121:0/902294252 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0741043e0 con 0x7fb0740fb1d0 2024-08-18T22:42:44.701 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:44.700+0000 7fb0717fa640 1 -- 172.21.15.121:0/902294252 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 25) v1 ==== 88617+0+0 (secure 0 0 0) 0x7fb068009740 con 0x7fb0740fb1d0 2024-08-18T22:42:44.702 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:44.701+0000 7fb0717fa640 1 --2- 172.21.15.121:0/902294252 >> [v2:172.21.15.195:6828/1174410756,v1:172.21.15.195:6829/1174410756] conn(0x7fb06406a6d0 0x7fb06406cb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:42:44.702 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:44.701+0000 7fb0717fa640 1 -- 172.21.15.121:0/902294252 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5808+0+0 (secure 0 0 0) 0x7fb068088f50 con 0x7fb0740fb1d0 2024-08-18T22:42:44.702 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:44.701+0000 7fb073fff640 1 --2- 172.21.15.121:0/902294252 >> [v2:172.21.15.195:6828/1174410756,v1:172.21.15.195:6829/1174410756] conn(0x7fb06406a6d0 0x7fb06406cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:42:44.703 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:44.702+0000 7fb073fff640 1 --2- 172.21.15.121:0/902294252 >> [v2:172.21.15.195:6828/1174410756,v1:172.21.15.195:6829/1174410756] conn(0x7fb06406a6d0 0x7fb06406cb80 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fb060007ac0 tx=0x7fb060035040 comp rx=0 tx=0).ready entity=mgr.24377 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:42:44.705 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:44.704+0000 7fb0717fa640 1 -- 172.21.15.121:0/902294252 <== mon.1 v2:172.21.15.195:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7fb068052b40 con 0x7fb0740fb1d0 2024-08-18T22:42:44.939 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:44.938+0000 7fb07abe7640 1 -- 172.21.15.121:0/902294252 --> [v2:172.21.15.195:6828/1174410756,v1:172.21.15.195:6829/1174410756] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fb07410dc60 con 0x7fb06406a6d0 2024-08-18T22:42:44.940 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:44.939+0000 7fb0717fa640 1 -- 172.21.15.121:0/902294252 <== mgr.24377 v2:172.21.15.195:6828/1174410756 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+328 (secure 0 0 0) 0x7fb07410dc60 con 0x7fb06406a6d0 2024-08-18T22:42:44.943 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:44.942+0000 7fb07abe7640 1 -- 172.21.15.121:0/902294252 >> [v2:172.21.15.195:6828/1174410756,v1:172.21.15.195:6829/1174410756] conn(0x7fb06406a6d0 msgr2=0x7fb06406cb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:42:44.943 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:44.942+0000 7fb07abe7640 1 --2- 172.21.15.121:0/902294252 >> [v2:172.21.15.195:6828/1174410756,v1:172.21.15.195:6829/1174410756] conn(0x7fb06406a6d0 0x7fb06406cb80 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fb060007ac0 tx=0x7fb060035040 comp rx=0 tx=0).stop 2024-08-18T22:42:44.944 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:44.942+0000 7fb07abe7640 1 -- 172.21.15.121:0/902294252 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb0740fb1d0 msgr2=0x7fb07410bd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:42:44.944 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:44.942+0000 7fb07abe7640 1 --2- 172.21.15.121:0/902294252 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb0740fb1d0 0x7fb07410bd80 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fb06800eb70 tx=0x7fb06800b040 comp rx=0 tx=0).stop 2024-08-18T22:42:44.944 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:44.942+0000 7fb07abe7640 1 -- 172.21.15.121:0/902294252 shutdown_connections 2024-08-18T22:42:44.944 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:44.942+0000 7fb07abe7640 1 --2- 172.21.15.121:0/902294252 >> [v2:172.21.15.195:6828/1174410756,v1:172.21.15.195:6829/1174410756] conn(0x7fb06406a6d0 0x7fb06406cb80 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:42:44.944 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:44.942+0000 7fb07abe7640 1 --2- 172.21.15.121:0/902294252 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb0740fc4a0 0x7fb07410c2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:42:44.944 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:44.942+0000 7fb07abe7640 1 --2- 172.21.15.121:0/902294252 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb0740fb1d0 0x7fb07410bd80 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:42:44.944 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:44.942+0000 7fb07abe7640 1 -- 172.21.15.121:0/902294252 >> 172.21.15.121:0/902294252 conn(0x7fb0740f69b0 msgr2=0x7fb0740f8150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:42:44.944 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:44.942+0000 7fb07abe7640 1 -- 172.21.15.121:0/902294252 shutdown_connections 2024-08-18T22:42:44.944 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:44.942+0000 7fb07abe7640 1 -- 172.21.15.121:0/902294252 wait complete. 2024-08-18T22:42:44.952 INFO:teuthology.orchestra.run.smithi121.stdout:true 2024-08-18T22:42:44.958 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:42:44 smithi121 ceph-mon[16788]: pgmap v36: 65 pgs: 65 active+clean; 2.0 GiB data, 7.6 GiB used, 529 GiB / 536 GiB avail; 27 KiB/s rd, 800 KiB/s wr, 258 op/s 2024-08-18T22:42:44.958 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:42:44 smithi121 ceph-mon[16788]: from='mgr.24377 ' entity='mgr.smithi195.acttsj' 2024-08-18T22:42:44.958 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:42:44 smithi121 ceph-mon[16788]: from='mgr.24377 ' entity='mgr.smithi195.acttsj' 2024-08-18T22:42:44.958 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:42:44 smithi121 ceph-mon[16788]: from='mgr.24377 172.21.15.195:0/2331273060' entity='mgr.smithi195.acttsj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-18T22:42:45.031 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:45.028+0000 7fafd0ea7640 1 -- 172.21.15.121:0/4277919945 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fafcc0fc490 msgr2=0x7fafcc0fc900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:42:45.031 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:45.028+0000 7fafd0ea7640 1 --2- 172.21.15.121:0/4277919945 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fafcc0fc490 0x7fafcc0fc900 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fafb40048d0 tx=0x7fafb4009da0 comp rx=0 tx=0).stop 2024-08-18T22:42:45.031 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:45.028+0000 7fafd0ea7640 1 -- 172.21.15.121:0/4277919945 shutdown_connections 2024-08-18T22:42:45.031 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:45.029+0000 7fafd0ea7640 1 --2- 172.21.15.121:0/4277919945 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fafcc0fc490 0x7fafcc0fc900 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:42:45.031 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:45.029+0000 7fafd0ea7640 1 --2- 172.21.15.121:0/4277919945 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fafcc0fb1c0 0x7fafcc0fb5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:42:45.032 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:45.029+0000 7fafd0ea7640 1 -- 172.21.15.121:0/4277919945 >> 172.21.15.121:0/4277919945 conn(0x7fafcc0f69a0 msgr2=0x7fafcc0f8db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:42:45.032 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:45.029+0000 7fafd0ea7640 1 -- 172.21.15.121:0/4277919945 shutdown_connections 2024-08-18T22:42:45.032 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:45.029+0000 7fafd0ea7640 1 -- 172.21.15.121:0/4277919945 wait complete. 2024-08-18T22:42:45.032 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:45.029+0000 7fafd0ea7640 1 Processor -- start 2024-08-18T22:42:45.032 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:45.029+0000 7fafd0ea7640 1 -- start start 2024-08-18T22:42:45.032 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:45.030+0000 7fafd0ea7640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fafcc0fb1c0 0x7fafcc10cf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:42:45.032 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:45.030+0000 7fafd0ea7640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fafcc0fc490 0x7fafcc10d460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:42:45.032 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:45.030+0000 7fafd0ea7640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafcc10e140 con 0x7fafcc0fc490 2024-08-18T22:42:45.032 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:45.030+0000 7fafd0ea7640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafcc10e2b0 con 0x7fafcc0fb1c0 2024-08-18T22:42:45.032 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:45.030+0000 7fafc3fff640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fafcc0fc490 0x7fafcc10d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:42:45.032 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:45.030+0000 7fafca59c640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fafcc0fb1c0 0x7fafcc10cf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:42:45.032 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:45.030+0000 7fafca59c640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fafcc0fb1c0 0x7fafcc10cf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.121:55876/0 (socket says 172.21.15.121:55876) 2024-08-18T22:42:45.032 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:45.030+0000 7fafca59c640 1 -- 172.21.15.121:0/2361089251 learned_addr learned my addr 172.21.15.121:0/2361089251 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-18T22:42:45.033 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:45.030+0000 7fafca59c640 1 -- 172.21.15.121:0/2361089251 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fafcc0fc490 msgr2=0x7fafcc10d460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:42:45.033 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:45.030+0000 7fafca59c640 1 --2- 172.21.15.121:0/2361089251 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fafcc0fc490 0x7fafcc10d460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:42:45.033 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:45.030+0000 7fafca59c640 1 -- 172.21.15.121:0/2361089251 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafb4005040 con 0x7fafcc0fb1c0 2024-08-18T22:42:45.033 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:45.030+0000 7fafc3fff640 1 --2- 172.21.15.121:0/2361089251 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fafcc0fc490 0x7fafcc10d460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:42:45.034 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:45.031+0000 7fafca59c640 1 --2- 172.21.15.121:0/2361089251 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fafcc0fb1c0 0x7fafcc10cf20 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fafbc00eb70 tx=0x7fafbc00b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:42:45.034 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:45.031+0000 7fafc2ffd640 1 -- 172.21.15.121:0/2361089251 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fafbc007c30 con 0x7fafcc0fb1c0 2024-08-18T22:42:45.034 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:45.031+0000 7fafd0ea7640 1 -- 172.21.15.121:0/2361089251 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fafcc10e530 con 0x7fafcc0fb1c0 2024-08-18T22:42:45.034 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:45.031+0000 7fafd0ea7640 1 -- 172.21.15.121:0/2361089251 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fafcc10ead0 con 0x7fafcc0fb1c0 2024-08-18T22:42:45.034 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:45.031+0000 7fafc2ffd640 1 -- 172.21.15.121:0/2361089251 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fafbc00f040 con 0x7fafcc0fb1c0 2024-08-18T22:42:45.034 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:45.031+0000 7fafc2ffd640 1 -- 172.21.15.121:0/2361089251 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fafbc0094e0 con 0x7fafcc0fb1c0 2024-08-18T22:42:45.034 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:45.032+0000 7fafd0ea7640 1 -- 172.21.15.121:0/2361089251 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fafcc1043d0 con 0x7fafcc0fb1c0 2024-08-18T22:42:45.035 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:45.033+0000 7fafc2ffd640 1 -- 172.21.15.121:0/2361089251 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 25) v1 ==== 88617+0+0 (secure 0 0 0) 0x7fafbc009760 con 0x7fafcc0fb1c0 2024-08-18T22:42:45.035 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:45.034+0000 7fafc2ffd640 1 --2- 172.21.15.121:0/2361089251 >> [v2:172.21.15.195:6828/1174410756,v1:172.21.15.195:6829/1174410756] conn(0x7fafb806a6d0 0x7fafb806cb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:42:45.035 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:45.034+0000 7fafc2ffd640 1 -- 172.21.15.121:0/2361089251 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5808+0+0 (secure 0 0 0) 0x7fafbc088b20 con 0x7fafcc0fb1c0 2024-08-18T22:42:45.035 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:45.034+0000 7fafc3fff640 1 --2- 172.21.15.121:0/2361089251 >> [v2:172.21.15.195:6828/1174410756,v1:172.21.15.195:6829/1174410756] conn(0x7fafb806a6d0 0x7fafb806cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:42:45.036 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:45.035+0000 7fafc3fff640 1 --2- 172.21.15.121:0/2361089251 >> [v2:172.21.15.195:6828/1174410756,v1:172.21.15.195:6829/1174410756] conn(0x7fafb806a6d0 0x7fafb806cb80 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fafcc10ccd0 tx=0x7fafb4035040 comp rx=0 tx=0).ready entity=mgr.24377 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:42:45.040 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:45.039+0000 7fafc2ffd640 1 -- 172.21.15.121:0/2361089251 <== mon.1 v2:172.21.15.195:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7fafbc052710 con 0x7fafcc0fb1c0 2024-08-18T22:42:45.268 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:42:44 smithi195 ceph-mon[23370]: pgmap v36: 65 pgs: 65 active+clean; 2.0 GiB data, 7.6 GiB used, 529 GiB / 536 GiB avail; 27 KiB/s rd, 800 KiB/s wr, 258 op/s 2024-08-18T22:42:45.268 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:42:44 smithi195 ceph-mon[23370]: from='mgr.24377 ' entity='mgr.smithi195.acttsj' 2024-08-18T22:42:45.268 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:42:44 smithi195 ceph-mon[23370]: from='mgr.24377 ' entity='mgr.smithi195.acttsj' 2024-08-18T22:42:45.268 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:42:44 smithi195 ceph-mon[23370]: from='mgr.24377 172.21.15.195:0/2331273060' entity='mgr.smithi195.acttsj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-18T22:42:45.307 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:45.305+0000 7fafd0ea7640 1 -- 172.21.15.121:0/2361089251 --> [v2:172.21.15.195:6828/1174410756,v1:172.21.15.195:6829/1174410756] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fafcc103c30 con 0x7fafb806a6d0 2024-08-18T22:42:45.308 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:45.308+0000 7fafc2ffd640 1 -- 172.21.15.121:0/2361089251 <== mgr.24377 v2:172.21.15.195:6828/1174410756 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+328 (secure 0 0 0) 0x7fafcc103c30 con 0x7fafb806a6d0 2024-08-18T22:42:45.312 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:45.311+0000 7fafd0ea7640 1 -- 172.21.15.121:0/2361089251 >> [v2:172.21.15.195:6828/1174410756,v1:172.21.15.195:6829/1174410756] conn(0x7fafb806a6d0 msgr2=0x7fafb806cb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:42:45.312 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:45.311+0000 7fafd0ea7640 1 --2- 172.21.15.121:0/2361089251 >> [v2:172.21.15.195:6828/1174410756,v1:172.21.15.195:6829/1174410756] conn(0x7fafb806a6d0 0x7fafb806cb80 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fafcc10ccd0 tx=0x7fafb4035040 comp rx=0 tx=0).stop 2024-08-18T22:42:45.312 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:45.311+0000 7fafd0ea7640 1 -- 172.21.15.121:0/2361089251 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fafcc0fb1c0 msgr2=0x7fafcc10cf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:42:45.312 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:45.311+0000 7fafd0ea7640 1 --2- 172.21.15.121:0/2361089251 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fafcc0fb1c0 0x7fafcc10cf20 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fafbc00eb70 tx=0x7fafbc00b040 comp rx=0 tx=0).stop 2024-08-18T22:42:45.312 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:45.311+0000 7fafd0ea7640 1 -- 172.21.15.121:0/2361089251 shutdown_connections 2024-08-18T22:42:45.312 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:45.311+0000 7fafd0ea7640 1 --2- 172.21.15.121:0/2361089251 >> [v2:172.21.15.195:6828/1174410756,v1:172.21.15.195:6829/1174410756] conn(0x7fafb806a6d0 0x7fafb806cb80 secure :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fafcc10ccd0 tx=0x7fafb4035040 comp rx=0 tx=0).stop 2024-08-18T22:42:45.312 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:45.311+0000 7fafd0ea7640 1 --2- 172.21.15.121:0/2361089251 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fafcc0fc490 0x7fafcc10d460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:42:45.313 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:45.311+0000 7fafd0ea7640 1 --2- 172.21.15.121:0/2361089251 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fafcc0fb1c0 0x7fafcc10cf20 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:42:45.313 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:45.311+0000 7fafd0ea7640 1 -- 172.21.15.121:0/2361089251 >> 172.21.15.121:0/2361089251 conn(0x7fafcc0f69a0 msgr2=0x7fafcc065c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:42:45.313 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:45.312+0000 7fafd0ea7640 1 -- 172.21.15.121:0/2361089251 shutdown_connections 2024-08-18T22:42:45.313 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:45.312+0000 7fafd0ea7640 1 -- 172.21.15.121:0/2361089251 wait complete. 2024-08-18T22:42:45.418 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:45.415+0000 7f1028abe640 1 -- 172.21.15.121:0/3718246800 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f10240fc2f0 msgr2=0x7f10240fc700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:42:45.418 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:45.415+0000 7f1028abe640 1 --2- 172.21.15.121:0/3718246800 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f10240fc2f0 0x7f10240fc700 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f10140048d0 tx=0x7f1014009da0 comp rx=0 tx=0).stop 2024-08-18T22:42:45.418 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:45.415+0000 7f1028abe640 1 -- 172.21.15.121:0/3718246800 shutdown_connections 2024-08-18T22:42:45.418 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:45.415+0000 7f1028abe640 1 --2- 172.21.15.121:0/3718246800 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f10240fd5c0 0x7f10240fda30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:42:45.418 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:45.415+0000 7f1028abe640 1 --2- 172.21.15.121:0/3718246800 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f10240fc2f0 0x7f10240fc700 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:42:45.419 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:45.415+0000 7f1028abe640 1 -- 172.21.15.121:0/3718246800 >> 172.21.15.121:0/3718246800 conn(0x7f10240f7ad0 msgr2=0x7f10240f9ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:42:45.419 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:45.415+0000 7f1028abe640 1 -- 172.21.15.121:0/3718246800 shutdown_connections 2024-08-18T22:42:45.419 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:45.415+0000 7f1028abe640 1 -- 172.21.15.121:0/3718246800 wait complete. 2024-08-18T22:42:45.419 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:45.416+0000 7f1028abe640 1 Processor -- start 2024-08-18T22:42:45.419 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:45.416+0000 7f1028abe640 1 -- start start 2024-08-18T22:42:45.419 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:45.416+0000 7f1028abe640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f10240fc2f0 0x7f102410cee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:42:45.419 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:45.416+0000 7f1028abe640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f10240fd5c0 0x7f102410d420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:42:45.419 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:45.416+0000 7f1028abe640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f102410e150 con 0x7f10240fd5c0 2024-08-18T22:42:45.419 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:45.416+0000 7f1028abe640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f102410e2c0 con 0x7f10240fc2f0 2024-08-18T22:42:45.419 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:45.416+0000 7f101bfff640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f10240fd5c0 0x7f102410d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:42:45.419 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:45.417+0000 7f101bfff640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f10240fd5c0 0x7f102410d420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:59936/0 (socket says 172.21.15.121:59936) 2024-08-18T22:42:45.419 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:45.417+0000 7f101bfff640 1 -- 172.21.15.121:0/2202059836 learned_addr learned my addr 172.21.15.121:0/2202059836 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-18T22:42:45.419 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:45.417+0000 7f102259c640 1 --2- 172.21.15.121:0/2202059836 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f10240fc2f0 0x7f102410cee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:42:45.419 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:45.417+0000 7f101bfff640 1 -- 172.21.15.121:0/2202059836 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f10240fc2f0 msgr2=0x7f102410cee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:42:45.420 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:45.417+0000 7f101bfff640 1 --2- 172.21.15.121:0/2202059836 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f10240fc2f0 0x7f102410cee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:42:45.420 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:45.417+0000 7f101bfff640 1 -- 172.21.15.121:0/2202059836 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1014005040 con 0x7f10240fd5c0 2024-08-18T22:42:45.420 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:45.417+0000 7f101bfff640 1 --2- 172.21.15.121:0/2202059836 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f10240fd5c0 0x7f102410d420 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f100c00eb70 tx=0x7f100c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:42:45.420 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:45.417+0000 7f101affd640 1 -- 172.21.15.121:0/2202059836 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f100c007c30 con 0x7f10240fd5c0 2024-08-18T22:42:45.420 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:45.417+0000 7f101affd640 1 -- 172.21.15.121:0/2202059836 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f100c00f040 con 0x7f10240fd5c0 2024-08-18T22:42:45.420 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:45.417+0000 7f1028abe640 1 -- 172.21.15.121:0/2202059836 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f102410e540 con 0x7f10240fd5c0 2024-08-18T22:42:45.420 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:45.417+0000 7f101affd640 1 -- 172.21.15.121:0/2202059836 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f100c0094e0 con 0x7f10240fd5c0 2024-08-18T22:42:45.420 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:45.417+0000 7f1028abe640 1 -- 172.21.15.121:0/2202059836 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f102410eae0 con 0x7f10240fd5c0 2024-08-18T22:42:45.421 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:45.418+0000 7f1028abe640 1 -- 172.21.15.121:0/2202059836 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10240fb750 con 0x7f10240fd5c0 2024-08-18T22:42:45.421 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:45.419+0000 7f101affd640 1 -- 172.21.15.121:0/2202059836 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 25) v1 ==== 88617+0+0 (secure 0 0 0) 0x7f100c009640 con 0x7f10240fd5c0 2024-08-18T22:42:45.421 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:45.419+0000 7f101affd640 1 --2- 172.21.15.121:0/2202059836 >> [v2:172.21.15.195:6828/1174410756,v1:172.21.15.195:6829/1174410756] conn(0x7f101006a6d0 0x7f101006cb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:42:45.421 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:45.419+0000 7f101affd640 1 -- 172.21.15.121:0/2202059836 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f100c088d90 con 0x7f10240fd5c0 2024-08-18T22:42:45.421 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:45.420+0000 7f102259c640 1 --2- 172.21.15.121:0/2202059836 >> [v2:172.21.15.195:6828/1174410756,v1:172.21.15.195:6829/1174410756] conn(0x7f101006a6d0 0x7f101006cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:42:45.421 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:45.420+0000 7f102259c640 1 --2- 172.21.15.121:0/2202059836 >> [v2:172.21.15.195:6828/1174410756,v1:172.21.15.195:6829/1174410756] conn(0x7f101006a6d0 0x7f101006cb80 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f1014007ac0 tx=0x7f1014035040 comp rx=0 tx=0).ready entity=mgr.24377 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:42:45.425 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:45.424+0000 7f101affd640 1 -- 172.21.15.121:0/2202059836 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7f100c0528d0 con 0x7f10240fd5c0 2024-08-18T22:42:45.647 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:45.646+0000 7f1028abe640 1 -- 172.21.15.121:0/2202059836 --> [v2:172.21.15.195:6828/1174410756,v1:172.21.15.195:6829/1174410756] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f102410edc0 con 0x7f101006a6d0 2024-08-18T22:42:45.656 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:45.655+0000 7f101affd640 1 -- 172.21.15.121:0/2202059836 <== mgr.24377 v2:172.21.15.195:6828/1174410756 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f102410edc0 con 0x7f101006a6d0 2024-08-18T22:42:45.657 INFO:teuthology.orchestra.run.smithi121.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-08-18T22:42:45.657 INFO:teuthology.orchestra.run.smithi121.stdout:alertmanager.smithi121 smithi121 *:9093,9094 starting - - - - 2024-08-18T22:42:45.657 INFO:teuthology.orchestra.run.smithi121.stdout:crash.smithi121 smithi121 running (8m) 50s ago 8m 6899k - 17.2.7-1406-gdf62bdcc 774894bef55f cf3deea293c3 2024-08-18T22:42:45.657 INFO:teuthology.orchestra.run.smithi121.stdout:crash.smithi195 smithi195 running (7m) 46s ago 7m 6899k - 17.2.7-1406-gdf62bdcc 774894bef55f 98aa377daf77 2024-08-18T22:42:45.657 INFO:teuthology.orchestra.run.smithi121.stdout:grafana.smithi121 smithi121 *:3000 starting - - - - 2024-08-18T22:42:45.657 INFO:teuthology.orchestra.run.smithi121.stdout:mds.cephfs.smithi121.gbickb smithi121 running (3m) 50s ago 3m 134M - 17.2.7-1406-gdf62bdcc 774894bef55f 484da0bc2c95 2024-08-18T22:42:45.657 INFO:teuthology.orchestra.run.smithi121.stdout:mds.cephfs.smithi121.xuzsdg smithi121 running (3m) 50s ago 3m 12.0M - 17.2.7-1406-gdf62bdcc 774894bef55f 6976b708cdcd 2024-08-18T22:42:45.657 INFO:teuthology.orchestra.run.smithi121.stdout:mds.cephfs.smithi195.buqvbr smithi195 running (3m) 46s ago 3m 118M - 17.2.7-1406-gdf62bdcc 774894bef55f 11a3703b4276 2024-08-18T22:42:45.657 INFO:teuthology.orchestra.run.smithi121.stdout:mds.cephfs.smithi195.nptgyc smithi195 running (3m) 46s ago 3m 16.2M - 17.2.7-1406-gdf62bdcc 774894bef55f b9f8043ea83e 2024-08-18T22:42:45.657 INFO:teuthology.orchestra.run.smithi121.stdout:mgr.smithi121.lopxqc smithi121 *:8443,9283,8765 starting - - - - 2024-08-18T22:42:45.657 INFO:teuthology.orchestra.run.smithi121.stdout:mgr.smithi195.acttsj smithi195 *:8443,9283 running (99s) 46s ago 7m 481M - 19.1.0-1382-gde09dd01 ea7a5189f30b eaf531f5f439 2024-08-18T22:42:45.657 INFO:teuthology.orchestra.run.smithi121.stdout:mon.smithi121 smithi121 running (9m) 50s ago 10m 53.1M 2048M 17.2.7-1406-gdf62bdcc 774894bef55f 4a7bead235ac 2024-08-18T22:42:45.658 INFO:teuthology.orchestra.run.smithi121.stdout:mon.smithi195 smithi195 running (7m) 46s ago 7m 39.9M 2048M 17.2.7-1406-gdf62bdcc 774894bef55f ced63ecfbfae 2024-08-18T22:42:45.658 INFO:teuthology.orchestra.run.smithi121.stdout:node-exporter.smithi121 smithi121 *:9100 starting - - - - 2024-08-18T22:42:45.658 INFO:teuthology.orchestra.run.smithi121.stdout:node-exporter.smithi195 smithi195 *:9100 starting - - - - 2024-08-18T22:42:45.658 INFO:teuthology.orchestra.run.smithi121.stdout:osd.0 smithi121 running (7m) 50s ago 7m 221M 1557M 17.2.7-1406-gdf62bdcc 774894bef55f 30859216633d 2024-08-18T22:42:45.658 INFO:teuthology.orchestra.run.smithi121.stdout:osd.1 smithi121 running (6m) 50s ago 6m 235M 1557M 17.2.7-1406-gdf62bdcc 774894bef55f ef5fadfd753f 2024-08-18T22:42:45.658 INFO:teuthology.orchestra.run.smithi121.stdout:osd.2 smithi121 running (6m) 50s ago 6m 201M 1557M 17.2.7-1406-gdf62bdcc 774894bef55f 3fa061e41f99 2024-08-18T22:42:45.658 INFO:teuthology.orchestra.run.smithi121.stdout:osd.3 smithi195 running (5m) 46s ago 5m 254M 2581M 17.2.7-1406-gdf62bdcc 774894bef55f 15d30b1b459e 2024-08-18T22:42:45.658 INFO:teuthology.orchestra.run.smithi121.stdout:osd.4 smithi195 running (5m) 46s ago 5m 199M 2581M 17.2.7-1406-gdf62bdcc 774894bef55f 99ed156dfd36 2024-08-18T22:42:45.658 INFO:teuthology.orchestra.run.smithi121.stdout:osd.5 smithi195 running (5m) 46s ago 5m 242M 2581M 17.2.7-1406-gdf62bdcc 774894bef55f e7eff7bdb752 2024-08-18T22:42:45.658 INFO:teuthology.orchestra.run.smithi121.stdout:prometheus.smithi121 smithi121 *:9095 starting - - - - 2024-08-18T22:42:45.660 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:45.659+0000 7f1028abe640 1 -- 172.21.15.121:0/2202059836 >> [v2:172.21.15.195:6828/1174410756,v1:172.21.15.195:6829/1174410756] conn(0x7f101006a6d0 msgr2=0x7f101006cb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:42:45.660 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:45.659+0000 7f1028abe640 1 --2- 172.21.15.121:0/2202059836 >> [v2:172.21.15.195:6828/1174410756,v1:172.21.15.195:6829/1174410756] conn(0x7f101006a6d0 0x7f101006cb80 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f1014007ac0 tx=0x7f1014035040 comp rx=0 tx=0).stop 2024-08-18T22:42:45.660 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:45.659+0000 7f1028abe640 1 -- 172.21.15.121:0/2202059836 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f10240fd5c0 msgr2=0x7f102410d420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:42:45.660 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:45.659+0000 7f1028abe640 1 --2- 172.21.15.121:0/2202059836 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f10240fd5c0 0x7f102410d420 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f100c00eb70 tx=0x7f100c00b040 comp rx=0 tx=0).stop 2024-08-18T22:42:45.660 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:45.659+0000 7f1028abe640 1 -- 172.21.15.121:0/2202059836 shutdown_connections 2024-08-18T22:42:45.660 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:45.659+0000 7f1028abe640 1 --2- 172.21.15.121:0/2202059836 >> [v2:172.21.15.195:6828/1174410756,v1:172.21.15.195:6829/1174410756] conn(0x7f101006a6d0 0x7f101006cb80 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:42:45.660 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:45.659+0000 7f1028abe640 1 --2- 172.21.15.121:0/2202059836 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f10240fd5c0 0x7f102410d420 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:42:45.661 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:45.659+0000 7f1028abe640 1 --2- 172.21.15.121:0/2202059836 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f10240fc2f0 0x7f102410cee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:42:45.661 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:45.659+0000 7f1028abe640 1 -- 172.21.15.121:0/2202059836 >> 172.21.15.121:0/2202059836 conn(0x7f10240f7ad0 msgr2=0x7f10240f92a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:42:45.661 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:45.659+0000 7f1028abe640 1 -- 172.21.15.121:0/2202059836 shutdown_connections 2024-08-18T22:42:45.661 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:45.659+0000 7f1028abe640 1 -- 172.21.15.121:0/2202059836 wait complete. 2024-08-18T22:42:45.746 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:45.745+0000 7fa80ced3640 1 -- 172.21.15.121:0/3713219037 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa808065960 msgr2=0x7fa8080fef10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:42:45.746 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:45.745+0000 7fa80ced3640 1 --2- 172.21.15.121:0/3713219037 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa808065960 0x7fa8080fef10 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fa7f80048d0 tx=0x7fa7f8009da0 comp rx=0 tx=0).stop 2024-08-18T22:42:45.747 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:45.745+0000 7fa80ced3640 1 -- 172.21.15.121:0/3713219037 shutdown_connections 2024-08-18T22:42:45.747 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:45.745+0000 7fa80ced3640 1 --2- 172.21.15.121:0/3713219037 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa8080ff450 0x7fa808101830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:42:45.747 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:45.745+0000 7fa80ced3640 1 --2- 172.21.15.121:0/3713219037 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa808065960 0x7fa8080fef10 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:42:45.747 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:45.745+0000 7fa80ced3640 1 -- 172.21.15.121:0/3713219037 >> 172.21.15.121:0/3713219037 conn(0x7fa8080f6920 msgr2=0x7fa8080f8d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:42:45.747 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:45.745+0000 7fa80ced3640 1 -- 172.21.15.121:0/3713219037 shutdown_connections 2024-08-18T22:42:45.748 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:45.745+0000 7fa80ced3640 1 -- 172.21.15.121:0/3713219037 wait complete. 2024-08-18T22:42:45.748 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:45.746+0000 7fa80ced3640 1 Processor -- start 2024-08-18T22:42:45.748 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:45.746+0000 7fa80ced3640 1 -- start start 2024-08-18T22:42:45.749 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:45.746+0000 7fa80ced3640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa808065960 0x7fa80810ac60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:42:45.749 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:45.746+0000 7fa80ced3640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa8080ff450 0x7fa80810b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:42:45.749 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:45.746+0000 7fa80ced3640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa80810b7a0 con 0x7fa8080ff450 2024-08-18T22:42:45.749 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:45.746+0000 7fa80ced3640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa80810c010 con 0x7fa808065960 2024-08-18T22:42:45.749 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:45.747+0000 7fa80659c640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa808065960 0x7fa80810ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:42:45.749 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:45.747+0000 7fa80659c640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa808065960 0x7fa80810ac60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.121:55926/0 (socket says 172.21.15.121:55926) 2024-08-18T22:42:45.749 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:45.747+0000 7fa80659c640 1 -- 172.21.15.121:0/3315454381 learned_addr learned my addr 172.21.15.121:0/3315454381 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-18T22:42:45.749 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:45.747+0000 7fa80659c640 1 -- 172.21.15.121:0/3315454381 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa8080ff450 msgr2=0x7fa80810b1a0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-08-18T22:42:45.749 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:45.747+0000 7fa805d9b640 1 --2- 172.21.15.121:0/3315454381 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa8080ff450 0x7fa80810b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:42:45.749 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:45.747+0000 7fa80659c640 1 --2- 172.21.15.121:0/3315454381 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa8080ff450 0x7fa80810b1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:42:45.749 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:45.747+0000 7fa80659c640 1 -- 172.21.15.121:0/3315454381 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7f8005040 con 0x7fa808065960 2024-08-18T22:42:45.749 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:45.747+0000 7fa805d9b640 1 --2- 172.21.15.121:0/3315454381 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa8080ff450 0x7fa80810b1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:42:45.749 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:45.748+0000 7fa80659c640 1 --2- 172.21.15.121:0/3315454381 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa808065960 0x7fa80810ac60 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fa7f802d040 tx=0x7fa7f8009da0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:42:45.750 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:45.748+0000 7fa7f6ffd640 1 -- 172.21.15.121:0/3315454381 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa7f8038070 con 0x7fa808065960 2024-08-18T22:42:45.750 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:45.748+0000 7fa7f6ffd640 1 -- 172.21.15.121:0/3315454381 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fa7f802ae90 con 0x7fa808065960 2024-08-18T22:42:45.750 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:45.748+0000 7fa7f6ffd640 1 -- 172.21.15.121:0/3315454381 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa7f803e670 con 0x7fa808065960 2024-08-18T22:42:45.750 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:45.748+0000 7fa80ced3640 1 -- 172.21.15.121:0/3315454381 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa80810c210 con 0x7fa808065960 2024-08-18T22:42:45.750 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:45.748+0000 7fa80ced3640 1 -- 172.21.15.121:0/3315454381 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa80810c7b0 con 0x7fa808065960 2024-08-18T22:42:45.751 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:45.750+0000 7fa80ced3640 1 -- 172.21.15.121:0/3315454381 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa80805eb10 con 0x7fa808065960 2024-08-18T22:42:45.751 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:45.750+0000 7fa7f6ffd640 1 -- 172.21.15.121:0/3315454381 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 25) v1 ==== 88617+0+0 (secure 0 0 0) 0x7fa7f8030020 con 0x7fa808065960 2024-08-18T22:42:45.751 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:45.750+0000 7fa7f6ffd640 1 --2- 172.21.15.121:0/3315454381 >> [v2:172.21.15.195:6828/1174410756,v1:172.21.15.195:6829/1174410756] conn(0x7fa7f006a780 0x7fa7f006cc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:42:45.752 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:45.751+0000 7fa7f6ffd640 1 -- 172.21.15.121:0/3315454381 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5808+0+0 (secure 0 0 0) 0x7fa7f80a8f60 con 0x7fa808065960 2024-08-18T22:42:45.752 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:45.751+0000 7fa805d9b640 1 --2- 172.21.15.121:0/3315454381 >> [v2:172.21.15.195:6828/1174410756,v1:172.21.15.195:6829/1174410756] conn(0x7fa7f006a780 0x7fa7f006cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:42:45.752 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:45.751+0000 7fa805d9b640 1 --2- 172.21.15.121:0/3315454381 >> [v2:172.21.15.195:6828/1174410756,v1:172.21.15.195:6829/1174410756] conn(0x7fa7f006a780 0x7fa7f006cc30 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fa808065e00 tx=0x7fa7fc00b040 comp rx=0 tx=0).ready entity=mgr.24377 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:42:45.756 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:45.755+0000 7fa7f6ffd640 1 -- 172.21.15.121:0/3315454381 <== mon.1 v2:172.21.15.195:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7fa7f80dd670 con 0x7fa808065960 2024-08-18T22:42:46.069 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:42:45 smithi121 ceph-mon[16788]: from='client.24467 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-18T22:42:46.084 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:46.082+0000 7fa80ced3640 1 -- 172.21.15.121:0/3315454381 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fa8080f8430 con 0x7fa808065960 2024-08-18T22:42:46.084 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:46.083+0000 7fa7f6ffd640 1 -- 172.21.15.121:0/3315454381 <== mon.1 v2:172.21.15.195:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+849 (secure 0 0 0) 0x7fa7f8072c70 con 0x7fa808065960 2024-08-18T22:42:46.084 INFO:teuthology.orchestra.run.smithi121.stdout:{ 2024-08-18T22:42:46.084 INFO:teuthology.orchestra.run.smithi121.stdout: "mon": { 2024-08-18T22:42:46.084 INFO:teuthology.orchestra.run.smithi121.stdout: "ceph version 17.2.7-1406-gdf62bdcc (df62bdccd9a13bf566b27a250eddfdd89be3072d) quincy (stable)": 2 2024-08-18T22:42:46.084 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-18T22:42:46.084 INFO:teuthology.orchestra.run.smithi121.stdout: "mgr": { 2024-08-18T22:42:46.084 INFO:teuthology.orchestra.run.smithi121.stdout: "ceph version 17.2.7-1406-gdf62bdcc (df62bdccd9a13bf566b27a250eddfdd89be3072d) quincy (stable)": 1, 2024-08-18T22:42:46.084 INFO:teuthology.orchestra.run.smithi121.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 1 2024-08-18T22:42:46.084 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-18T22:42:46.085 INFO:teuthology.orchestra.run.smithi121.stdout: "osd": { 2024-08-18T22:42:46.085 INFO:teuthology.orchestra.run.smithi121.stdout: "ceph version 17.2.7-1406-gdf62bdcc (df62bdccd9a13bf566b27a250eddfdd89be3072d) quincy (stable)": 6 2024-08-18T22:42:46.085 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-18T22:42:46.085 INFO:teuthology.orchestra.run.smithi121.stdout: "mds": { 2024-08-18T22:42:46.085 INFO:teuthology.orchestra.run.smithi121.stdout: "ceph version 17.2.7-1406-gdf62bdcc (df62bdccd9a13bf566b27a250eddfdd89be3072d) quincy (stable)": 4 2024-08-18T22:42:46.085 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-18T22:42:46.085 INFO:teuthology.orchestra.run.smithi121.stdout: "overall": { 2024-08-18T22:42:46.085 INFO:teuthology.orchestra.run.smithi121.stdout: "ceph version 17.2.7-1406-gdf62bdcc (df62bdccd9a13bf566b27a250eddfdd89be3072d) quincy (stable)": 13, 2024-08-18T22:42:46.085 INFO:teuthology.orchestra.run.smithi121.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 1 2024-08-18T22:42:46.085 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-08-18T22:42:46.085 INFO:teuthology.orchestra.run.smithi121.stdout:} 2024-08-18T22:42:46.086 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:46.085+0000 7fa80ced3640 1 -- 172.21.15.121:0/3315454381 >> [v2:172.21.15.195:6828/1174410756,v1:172.21.15.195:6829/1174410756] conn(0x7fa7f006a780 msgr2=0x7fa7f006cc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:42:46.086 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:46.085+0000 7fa80ced3640 1 --2- 172.21.15.121:0/3315454381 >> [v2:172.21.15.195:6828/1174410756,v1:172.21.15.195:6829/1174410756] conn(0x7fa7f006a780 0x7fa7f006cc30 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fa808065e00 tx=0x7fa7fc00b040 comp rx=0 tx=0).stop 2024-08-18T22:42:46.086 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:46.085+0000 7fa80ced3640 1 -- 172.21.15.121:0/3315454381 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa808065960 msgr2=0x7fa80810ac60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:42:46.086 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:46.085+0000 7fa80ced3640 1 --2- 172.21.15.121:0/3315454381 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa808065960 0x7fa80810ac60 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fa7f802d040 tx=0x7fa7f8009da0 comp rx=0 tx=0).stop 2024-08-18T22:42:46.086 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:46.085+0000 7fa80ced3640 1 -- 172.21.15.121:0/3315454381 shutdown_connections 2024-08-18T22:42:46.086 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:46.085+0000 7fa80ced3640 1 --2- 172.21.15.121:0/3315454381 >> [v2:172.21.15.195:6828/1174410756,v1:172.21.15.195:6829/1174410756] conn(0x7fa7f006a780 0x7fa7f006cc30 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:42:46.086 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:46.085+0000 7fa80ced3640 1 --2- 172.21.15.121:0/3315454381 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa8080ff450 0x7fa80810b1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:42:46.086 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:46.085+0000 7fa80ced3640 1 --2- 172.21.15.121:0/3315454381 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa808065960 0x7fa80810ac60 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:42:46.086 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:46.085+0000 7fa80ced3640 1 -- 172.21.15.121:0/3315454381 >> 172.21.15.121:0/3315454381 conn(0x7fa8080f6920 msgr2=0x7fa8080fb0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:42:46.087 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:46.085+0000 7fa80ced3640 1 -- 172.21.15.121:0/3315454381 shutdown_connections 2024-08-18T22:42:46.087 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:46.085+0000 7fa80ced3640 1 -- 172.21.15.121:0/3315454381 wait complete. 2024-08-18T22:42:46.161 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:42:45 smithi195 ceph-mon[23370]: from='client.24467 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-18T22:42:46.183 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:46.182+0000 7fe510b78640 1 -- 172.21.15.121:0/2683951871 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe50c0663d0 msgr2=0x7fe50c0fef70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:42:46.184 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:46.182+0000 7fe510b78640 1 --2- 172.21.15.121:0/2683951871 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe50c0663d0 0x7fe50c0fef70 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fe4fc0048d0 tx=0x7fe4fc009da0 comp rx=0 tx=0).stop 2024-08-18T22:42:46.184 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:46.182+0000 7fe510b78640 1 -- 172.21.15.121:0/2683951871 shutdown_connections 2024-08-18T22:42:46.184 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:46.182+0000 7fe510b78640 1 --2- 172.21.15.121:0/2683951871 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe50c0ff4b0 0x7fe50c101890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:42:46.184 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:46.182+0000 7fe510b78640 1 --2- 172.21.15.121:0/2683951871 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe50c0663d0 0x7fe50c0fef70 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:42:46.184 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:46.182+0000 7fe510b78640 1 -- 172.21.15.121:0/2683951871 >> 172.21.15.121:0/2683951871 conn(0x7fe50c0f69c0 msgr2=0x7fe50c0f8dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:42:46.184 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:46.183+0000 7fe510b78640 1 -- 172.21.15.121:0/2683951871 shutdown_connections 2024-08-18T22:42:46.184 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:46.183+0000 7fe510b78640 1 -- 172.21.15.121:0/2683951871 wait complete. 2024-08-18T22:42:46.185 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:46.183+0000 7fe510b78640 1 Processor -- start 2024-08-18T22:42:46.185 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:46.183+0000 7fe510b78640 1 -- start start 2024-08-18T22:42:46.185 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:46.184+0000 7fe510b78640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe50c0663d0 0x7fe50c10cea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:42:46.185 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:46.184+0000 7fe510b78640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe50c0ff4b0 0x7fe50c10d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:42:46.185 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:46.184+0000 7fe510b78640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe50c10da30 con 0x7fe50c0663d0 2024-08-18T22:42:46.185 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:46.184+0000 7fe510b78640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe50c10e250 con 0x7fe50c0ff4b0 2024-08-18T22:42:46.186 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:46.184+0000 7fe50a59c640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe50c0663d0 0x7fe50c10cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:42:46.186 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:46.184+0000 7fe50a59c640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe50c0663d0 0x7fe50c10cea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:59966/0 (socket says 172.21.15.121:59966) 2024-08-18T22:42:46.186 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:46.184+0000 7fe50a59c640 1 -- 172.21.15.121:0/1426879938 learned_addr learned my addr 172.21.15.121:0/1426879938 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-18T22:42:46.186 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:46.185+0000 7fe50a59c640 1 -- 172.21.15.121:0/1426879938 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe50c0ff4b0 msgr2=0x7fe50c10d3e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-18T22:42:46.186 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:46.185+0000 7fe50a59c640 1 --2- 172.21.15.121:0/1426879938 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe50c0ff4b0 0x7fe50c10d3e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:42:46.186 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:46.185+0000 7fe50a59c640 1 -- 172.21.15.121:0/1426879938 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4f4005040 con 0x7fe50c0663d0 2024-08-18T22:42:46.186 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:46.185+0000 7fe50a59c640 1 --2- 172.21.15.121:0/1426879938 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe50c0663d0 0x7fe50c10cea0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fe4fc0094f0 tx=0x7fe4fc009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:42:46.187 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:46.185+0000 7fe502ffd640 1 -- 172.21.15.121:0/1426879938 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe4fc038070 con 0x7fe50c0663d0 2024-08-18T22:42:46.187 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:46.186+0000 7fe502ffd640 1 -- 172.21.15.121:0/1426879938 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fe4fc02ae90 con 0x7fe50c0663d0 2024-08-18T22:42:46.187 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:46.186+0000 7fe502ffd640 1 -- 172.21.15.121:0/1426879938 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe4fc033660 con 0x7fe50c0663d0 2024-08-18T22:42:46.187 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:46.186+0000 7fe510b78640 1 -- 172.21.15.121:0/1426879938 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4fc005040 con 0x7fe50c0663d0 2024-08-18T22:42:46.187 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:46.186+0000 7fe510b78640 1 -- 172.21.15.121:0/1426879938 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe50c10e7d0 con 0x7fe50c0663d0 2024-08-18T22:42:46.188 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:46.188+0000 7fe510b78640 1 -- 172.21.15.121:0/1426879938 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4ec005240 con 0x7fe50c0663d0 2024-08-18T22:42:46.190 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:46.188+0000 7fe502ffd640 1 -- 172.21.15.121:0/1426879938 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 25) v1 ==== 88617+0+0 (secure 0 0 0) 0x7fe4fc030020 con 0x7fe50c0663d0 2024-08-18T22:42:46.190 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:46.189+0000 7fe502ffd640 1 --2- 172.21.15.121:0/1426879938 >> [v2:172.21.15.195:6828/1174410756,v1:172.21.15.195:6829/1174410756] conn(0x7fe4f806a7a0 0x7fe4f806cc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:42:46.190 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:46.189+0000 7fe502ffd640 1 -- 172.21.15.121:0/1426879938 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5808+0+0 (secure 0 0 0) 0x7fe4fc0a9020 con 0x7fe50c0663d0 2024-08-18T22:42:46.190 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:46.189+0000 7fe503fff640 1 --2- 172.21.15.121:0/1426879938 >> [v2:172.21.15.195:6828/1174410756,v1:172.21.15.195:6829/1174410756] conn(0x7fe4f806a7a0 0x7fe4f806cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:42:46.191 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:46.190+0000 7fe503fff640 1 --2- 172.21.15.121:0/1426879938 >> [v2:172.21.15.195:6828/1174410756,v1:172.21.15.195:6829/1174410756] conn(0x7fe4f806a7a0 0x7fe4f806cc50 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fe4f4007fd0 tx=0x7fe4f4009da0 comp rx=0 tx=0).ready entity=mgr.24377 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:42:46.196 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:46.195+0000 7fe502ffd640 1 -- 172.21.15.121:0/1426879938 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7fe4fc0dd670 con 0x7fe50c0663d0 2024-08-18T22:42:46.516 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:46.515+0000 7fe510b78640 1 -- 172.21.15.121:0/1426879938 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fe4ec0057c0 con 0x7fe50c0663d0 2024-08-18T22:42:46.516 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:46.515+0000 7fe502ffd640 1 -- 172.21.15.121:0/1426879938 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 19 v19) v1 ==== 76+0+1852 (secure 0 0 0) 0x7fe4fc072bf0 con 0x7fe50c0663d0 2024-08-18T22:42:46.516 INFO:teuthology.orchestra.run.smithi121.stdout:e19 2024-08-18T22:42:46.516 INFO:teuthology.orchestra.run.smithi121.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-08-18T22:42:46.517 INFO:teuthology.orchestra.run.smithi121.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-08-18T22:42:46.517 INFO:teuthology.orchestra.run.smithi121.stdout:legacy client fscid: 1 2024-08-18T22:42:46.517 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-08-18T22:42:46.517 INFO:teuthology.orchestra.run.smithi121.stdout:Filesystem 'cephfs' (1) 2024-08-18T22:42:46.517 INFO:teuthology.orchestra.run.smithi121.stdout:fs_name cephfs 2024-08-18T22:42:46.517 INFO:teuthology.orchestra.run.smithi121.stdout:epoch 19 2024-08-18T22:42:46.517 INFO:teuthology.orchestra.run.smithi121.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-08-18T22:42:46.517 INFO:teuthology.orchestra.run.smithi121.stdout:created 2024-08-18T22:39:04.054074+0000 2024-08-18T22:42:46.517 INFO:teuthology.orchestra.run.smithi121.stdout:modified 2024-08-18T22:42:16.794905+0000 2024-08-18T22:42:46.517 INFO:teuthology.orchestra.run.smithi121.stdout:tableserver 0 2024-08-18T22:42:46.517 INFO:teuthology.orchestra.run.smithi121.stdout:root 0 2024-08-18T22:42:46.517 INFO:teuthology.orchestra.run.smithi121.stdout:session_timeout 60 2024-08-18T22:42:46.518 INFO:teuthology.orchestra.run.smithi121.stdout:session_autoclose 300 2024-08-18T22:42:46.518 INFO:teuthology.orchestra.run.smithi121.stdout:max_file_size 1099511627776 2024-08-18T22:42:46.518 INFO:teuthology.orchestra.run.smithi121.stdout:required_client_features {} 2024-08-18T22:42:46.518 INFO:teuthology.orchestra.run.smithi121.stdout:last_failure 0 2024-08-18T22:42:46.518 INFO:teuthology.orchestra.run.smithi121.stdout:last_failure_osd_epoch 47 2024-08-18T22:42:46.518 INFO:teuthology.orchestra.run.smithi121.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-08-18T22:42:46.518 INFO:teuthology.orchestra.run.smithi121.stdout:max_mds 2 2024-08-18T22:42:46.518 INFO:teuthology.orchestra.run.smithi121.stdout:in 0,1 2024-08-18T22:42:46.518 INFO:teuthology.orchestra.run.smithi121.stdout:up {0=14474,1=24249} 2024-08-18T22:42:46.518 INFO:teuthology.orchestra.run.smithi121.stdout:failed 2024-08-18T22:42:46.518 INFO:teuthology.orchestra.run.smithi121.stdout:damaged 2024-08-18T22:42:46.518 INFO:teuthology.orchestra.run.smithi121.stdout:stopped 2024-08-18T22:42:46.518 INFO:teuthology.orchestra.run.smithi121.stdout:data_pools [3] 2024-08-18T22:42:46.518 INFO:teuthology.orchestra.run.smithi121.stdout:metadata_pool 2 2024-08-18T22:42:46.519 INFO:teuthology.orchestra.run.smithi121.stdout:inline_data disabled 2024-08-18T22:42:46.519 INFO:teuthology.orchestra.run.smithi121.stdout:balancer 2024-08-18T22:42:46.519 INFO:teuthology.orchestra.run.smithi121.stdout:standby_count_wanted 1 2024-08-18T22:42:46.519 INFO:teuthology.orchestra.run.smithi121.stdout:[mds.cephfs.smithi121.gbickb{0:14474} state up:active seq 6 export targets 1 join_fscid=1 addr [v2:172.21.15.121:6828/2277706406,v1:172.21.15.121:6829/2277706406] compat {c=[1],r=[1],i=[7ff]}] 2024-08-18T22:42:46.519 INFO:teuthology.orchestra.run.smithi121.stdout:[mds.cephfs.smithi195.buqvbr{1:24249} state up:active seq 4 export targets 0 join_fscid=1 addr [v2:172.21.15.195:6824/2414511859,v1:172.21.15.195:6825/2414511859] compat {c=[1],r=[1],i=[7ff]}] 2024-08-18T22:42:46.519 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-08-18T22:42:46.519 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-08-18T22:42:46.519 INFO:teuthology.orchestra.run.smithi121.stdout:Standby daemons: 2024-08-18T22:42:46.519 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-08-18T22:42:46.519 INFO:teuthology.orchestra.run.smithi121.stdout:[mds.cephfs.smithi121.xuzsdg{-1:14490} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.121:6826/91588128,v1:172.21.15.121:6827/91588128] compat {c=[1],r=[1],i=[7ff]}] 2024-08-18T22:42:46.519 INFO:teuthology.orchestra.run.smithi121.stdout:[mds.cephfs.smithi195.nptgyc{-1:24259} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.195:6826/238549847,v1:172.21.15.195:6827/238549847] compat {c=[1],r=[1],i=[7ff]}] 2024-08-18T22:42:46.520 INFO:teuthology.orchestra.run.smithi121.stderr:dumped fsmap epoch 19 2024-08-18T22:42:46.520 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:46.517+0000 7fe510b78640 1 -- 172.21.15.121:0/1426879938 >> [v2:172.21.15.195:6828/1174410756,v1:172.21.15.195:6829/1174410756] conn(0x7fe4f806a7a0 msgr2=0x7fe4f806cc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:42:46.520 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:46.517+0000 7fe510b78640 1 --2- 172.21.15.121:0/1426879938 >> [v2:172.21.15.195:6828/1174410756,v1:172.21.15.195:6829/1174410756] conn(0x7fe4f806a7a0 0x7fe4f806cc50 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fe4f4007fd0 tx=0x7fe4f4009da0 comp rx=0 tx=0).stop 2024-08-18T22:42:46.520 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:46.517+0000 7fe510b78640 1 -- 172.21.15.121:0/1426879938 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe50c0663d0 msgr2=0x7fe50c10cea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:42:46.520 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:46.517+0000 7fe510b78640 1 --2- 172.21.15.121:0/1426879938 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe50c0663d0 0x7fe50c10cea0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fe4fc0094f0 tx=0x7fe4fc009da0 comp rx=0 tx=0).stop 2024-08-18T22:42:46.520 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:46.517+0000 7fe510b78640 1 -- 172.21.15.121:0/1426879938 shutdown_connections 2024-08-18T22:42:46.520 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:46.517+0000 7fe510b78640 1 --2- 172.21.15.121:0/1426879938 >> [v2:172.21.15.195:6828/1174410756,v1:172.21.15.195:6829/1174410756] conn(0x7fe4f806a7a0 0x7fe4f806cc50 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:42:46.521 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:46.517+0000 7fe510b78640 1 --2- 172.21.15.121:0/1426879938 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe50c0ff4b0 0x7fe50c10d3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:42:46.521 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:46.517+0000 7fe510b78640 1 --2- 172.21.15.121:0/1426879938 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe50c0663d0 0x7fe50c10cea0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:42:46.521 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:46.517+0000 7fe510b78640 1 -- 172.21.15.121:0/1426879938 >> 172.21.15.121:0/1426879938 conn(0x7fe50c0f69c0 msgr2=0x7fe50c0f6d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:42:46.521 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:46.517+0000 7fe510b78640 1 -- 172.21.15.121:0/1426879938 shutdown_connections 2024-08-18T22:42:46.521 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:46.517+0000 7fe510b78640 1 -- 172.21.15.121:0/1426879938 wait complete. 2024-08-18T22:42:46.608 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:46.606+0000 7f3b9a3ca640 1 -- 172.21.15.121:0/3403655759 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3b940659e0 msgr2=0x7f3b940feee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:42:46.608 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:46.606+0000 7f3b9a3ca640 1 --2- 172.21.15.121:0/3403655759 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3b940659e0 0x7f3b940feee0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f3b840048d0 tx=0x7f3b84009da0 comp rx=0 tx=0).stop 2024-08-18T22:42:46.608 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:46.607+0000 7f3b9a3ca640 1 -- 172.21.15.121:0/3403655759 shutdown_connections 2024-08-18T22:42:46.608 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:46.607+0000 7f3b9a3ca640 1 --2- 172.21.15.121:0/3403655759 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3b940ff420 0x7f3b94101800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:42:46.608 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:46.607+0000 7f3b9a3ca640 1 --2- 172.21.15.121:0/3403655759 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3b940659e0 0x7f3b940feee0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:42:46.608 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:46.607+0000 7f3b9a3ca640 1 -- 172.21.15.121:0/3403655759 >> 172.21.15.121:0/3403655759 conn(0x7f3b940f69b0 msgr2=0x7f3b940f8dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:42:46.608 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:46.607+0000 7f3b9a3ca640 1 -- 172.21.15.121:0/3403655759 shutdown_connections 2024-08-18T22:42:46.608 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:46.607+0000 7f3b9a3ca640 1 -- 172.21.15.121:0/3403655759 wait complete. 2024-08-18T22:42:46.610 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:46.607+0000 7f3b9a3ca640 1 Processor -- start 2024-08-18T22:42:46.610 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:46.608+0000 7f3b9a3ca640 1 -- start start 2024-08-18T22:42:46.610 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:46.608+0000 7f3b9a3ca640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3b940659e0 0x7f3b9410cf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:42:46.610 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:46.608+0000 7f3b9a3ca640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3b940ff420 0x7f3b9410d490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:42:46.610 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:46.608+0000 7f3b9a3ca640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b9410e170 con 0x7f3b940ff420 2024-08-18T22:42:46.610 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:46.608+0000 7f3b9a3ca640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b9410e2e0 con 0x7f3b940659e0 2024-08-18T22:42:46.610 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:46.608+0000 7f3b937fe640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3b940ff420 0x7f3b9410d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:42:46.611 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:46.608+0000 7f3b937fe640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3b940ff420 0x7f3b9410d490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:59992/0 (socket says 172.21.15.121:59992) 2024-08-18T22:42:46.611 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:46.608+0000 7f3b937fe640 1 -- 172.21.15.121:0/1951986884 learned_addr learned my addr 172.21.15.121:0/1951986884 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-18T22:42:46.611 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:46.608+0000 7f3b93fff640 1 --2- 172.21.15.121:0/1951986884 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3b940659e0 0x7f3b9410cf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:42:46.611 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:46.608+0000 7f3b937fe640 1 -- 172.21.15.121:0/1951986884 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3b940659e0 msgr2=0x7f3b9410cf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:42:46.611 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:46.608+0000 7f3b937fe640 1 --2- 172.21.15.121:0/1951986884 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3b940659e0 0x7f3b9410cf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:42:46.611 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:46.608+0000 7f3b937fe640 1 -- 172.21.15.121:0/1951986884 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b84005040 con 0x7f3b940ff420 2024-08-18T22:42:46.611 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:46.609+0000 7f3b937fe640 1 --2- 172.21.15.121:0/1951986884 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3b940ff420 0x7f3b9410d490 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f3b8800eb70 tx=0x7f3b8800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:42:46.611 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:46.609+0000 7f3b90ff9640 1 -- 172.21.15.121:0/1951986884 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3b88007c30 con 0x7f3b940ff420 2024-08-18T22:42:46.611 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:46.609+0000 7f3b90ff9640 1 -- 172.21.15.121:0/1951986884 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f3b8800f040 con 0x7f3b940ff420 2024-08-18T22:42:46.611 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:46.609+0000 7f3b90ff9640 1 -- 172.21.15.121:0/1951986884 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3b8800ca60 con 0x7f3b940ff420 2024-08-18T22:42:46.611 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:46.609+0000 7f3b9a3ca640 1 -- 172.21.15.121:0/1951986884 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b9410e560 con 0x7f3b940ff420 2024-08-18T22:42:46.611 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:46.609+0000 7f3b9a3ca640 1 -- 172.21.15.121:0/1951986884 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b9410eb00 con 0x7f3b940ff420 2024-08-18T22:42:46.612 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:46.610+0000 7f3b9a3ca640 1 -- 172.21.15.121:0/1951986884 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b940fa630 con 0x7f3b940ff420 2024-08-18T22:42:46.612 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:46.611+0000 7f3b90ff9640 1 -- 172.21.15.121:0/1951986884 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 25) v1 ==== 88617+0+0 (secure 0 0 0) 0x7f3b8800cbc0 con 0x7f3b940ff420 2024-08-18T22:42:46.613 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:46.611+0000 7f3b90ff9640 1 --2- 172.21.15.121:0/1951986884 >> [v2:172.21.15.195:6828/1174410756,v1:172.21.15.195:6829/1174410756] conn(0x7f3b7c06a6d0 0x7f3b7c06cb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:42:46.613 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:46.612+0000 7f3b90ff9640 1 -- 172.21.15.121:0/1951986884 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f3b88088ca0 con 0x7f3b940ff420 2024-08-18T22:42:46.613 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:46.612+0000 7f3b93fff640 1 --2- 172.21.15.121:0/1951986884 >> [v2:172.21.15.195:6828/1174410756,v1:172.21.15.195:6829/1174410756] conn(0x7f3b7c06a6d0 0x7f3b7c06cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:42:46.613 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:46.612+0000 7f3b93fff640 1 --2- 172.21.15.121:0/1951986884 >> [v2:172.21.15.195:6828/1174410756,v1:172.21.15.195:6829/1174410756] conn(0x7f3b7c06a6d0 0x7f3b7c06cb80 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f3b84007ac0 tx=0x7f3b84035040 comp rx=0 tx=0).ready entity=mgr.24377 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:42:46.616 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:46.616+0000 7f3b90ff9640 1 -- 172.21.15.121:0/1951986884 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7f3b88052850 con 0x7f3b940ff420 2024-08-18T22:42:46.904 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:46.902+0000 7f3b9a3ca640 1 -- 172.21.15.121:0/1951986884 --> [v2:172.21.15.195:6828/1174410756,v1:172.21.15.195:6829/1174410756] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f3b9410ed70 con 0x7f3b7c06a6d0 2024-08-18T22:42:46.904 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:46.904+0000 7f3b90ff9640 1 -- 172.21.15.121:0/1951986884 <== mgr.24377 v2:172.21.15.195:6828/1174410756 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+328 (secure 0 0 0) 0x7f3b9410ed70 con 0x7f3b7c06a6d0 2024-08-18T22:42:46.905 INFO:teuthology.orchestra.run.smithi121.stdout:{ 2024-08-18T22:42:46.905 INFO:teuthology.orchestra.run.smithi121.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9", 2024-08-18T22:42:46.905 INFO:teuthology.orchestra.run.smithi121.stdout: "in_progress": true, 2024-08-18T22:42:46.905 INFO:teuthology.orchestra.run.smithi121.stdout: "which": "Upgrading all daemon types on all hosts", 2024-08-18T22:42:46.905 INFO:teuthology.orchestra.run.smithi121.stdout: "services_complete": [], 2024-08-18T22:42:46.905 INFO:teuthology.orchestra.run.smithi121.stdout: "progress": "", 2024-08-18T22:42:46.905 INFO:teuthology.orchestra.run.smithi121.stdout: "message": "Currently upgrading mgr daemons", 2024-08-18T22:42:46.905 INFO:teuthology.orchestra.run.smithi121.stdout: "is_paused": false 2024-08-18T22:42:46.905 INFO:teuthology.orchestra.run.smithi121.stdout:} 2024-08-18T22:42:46.907 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:46.906+0000 7f3b9a3ca640 1 -- 172.21.15.121:0/1951986884 >> [v2:172.21.15.195:6828/1174410756,v1:172.21.15.195:6829/1174410756] conn(0x7f3b7c06a6d0 msgr2=0x7f3b7c06cb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:42:46.907 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:46.906+0000 7f3b9a3ca640 1 --2- 172.21.15.121:0/1951986884 >> [v2:172.21.15.195:6828/1174410756,v1:172.21.15.195:6829/1174410756] conn(0x7f3b7c06a6d0 0x7f3b7c06cb80 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f3b84007ac0 tx=0x7f3b84035040 comp rx=0 tx=0).stop 2024-08-18T22:42:46.907 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:46.906+0000 7f3b9a3ca640 1 -- 172.21.15.121:0/1951986884 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3b940ff420 msgr2=0x7f3b9410d490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:42:46.907 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:46.906+0000 7f3b9a3ca640 1 --2- 172.21.15.121:0/1951986884 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3b940ff420 0x7f3b9410d490 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f3b8800eb70 tx=0x7f3b8800b040 comp rx=0 tx=0).stop 2024-08-18T22:42:46.907 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:46.906+0000 7f3b9a3ca640 1 -- 172.21.15.121:0/1951986884 shutdown_connections 2024-08-18T22:42:46.907 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:46.906+0000 7f3b9a3ca640 1 --2- 172.21.15.121:0/1951986884 >> [v2:172.21.15.195:6828/1174410756,v1:172.21.15.195:6829/1174410756] conn(0x7f3b7c06a6d0 0x7f3b7c06cb80 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:42:46.907 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:46.906+0000 7f3b9a3ca640 1 --2- 172.21.15.121:0/1951986884 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3b940ff420 0x7f3b9410d490 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:42:46.908 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:46.906+0000 7f3b9a3ca640 1 --2- 172.21.15.121:0/1951986884 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3b940659e0 0x7f3b9410cf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:42:46.908 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:46.906+0000 7f3b9a3ca640 1 -- 172.21.15.121:0/1951986884 >> 172.21.15.121:0/1951986884 conn(0x7f3b940f69b0 msgr2=0x7f3b940f6d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:42:46.908 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:46.906+0000 7f3b9a3ca640 1 -- 172.21.15.121:0/1951986884 shutdown_connections 2024-08-18T22:42:46.908 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:46.906+0000 7f3b9a3ca640 1 -- 172.21.15.121:0/1951986884 wait complete. 2024-08-18T22:42:47.011 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:47.010+0000 7f823438d640 1 -- 172.21.15.121:0/2303411960 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f822c0fd590 msgr2=0x7f822c0fda00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:42:47.012 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:47.010+0000 7f823438d640 1 --2- 172.21.15.121:0/2303411960 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f822c0fd590 0x7f822c0fda00 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f821c0048d0 tx=0x7f821c009da0 comp rx=0 tx=0).stop 2024-08-18T22:42:47.012 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:47.011+0000 7f823438d640 1 -- 172.21.15.121:0/2303411960 shutdown_connections 2024-08-18T22:42:47.012 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:47.011+0000 7f823438d640 1 --2- 172.21.15.121:0/2303411960 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f822c0fd590 0x7f822c0fda00 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:42:47.012 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:47.011+0000 7f823438d640 1 --2- 172.21.15.121:0/2303411960 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f822c0fc2c0 0x7f822c0fc6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:42:47.012 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:47.011+0000 7f823438d640 1 -- 172.21.15.121:0/2303411960 >> 172.21.15.121:0/2303411960 conn(0x7f822c0f7a80 msgr2=0x7f822c0f9eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:42:47.012 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:47.011+0000 7f823438d640 1 -- 172.21.15.121:0/2303411960 shutdown_connections 2024-08-18T22:42:47.012 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:47.011+0000 7f823438d640 1 -- 172.21.15.121:0/2303411960 wait complete. 2024-08-18T22:42:47.013 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:47.011+0000 7f823438d640 1 Processor -- start 2024-08-18T22:42:47.013 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:47.011+0000 7f823438d640 1 -- start start 2024-08-18T22:42:47.013 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:47.012+0000 7f823438d640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f822c0fc2c0 0x7f822c10ce80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:42:47.013 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:47.012+0000 7f823438d640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f822c0fd590 0x7f822c10d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:42:47.014 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:47.012+0000 7f823438d640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f822c10da10 con 0x7f822c0fc2c0 2024-08-18T22:42:47.014 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:47.012+0000 7f823438d640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f822c10e150 con 0x7f822c0fd590 2024-08-18T22:42:47.014 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:47.012+0000 7f8232129640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f822c0fc2c0 0x7f822c10ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:42:47.014 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:47.012+0000 7f8231928640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f822c0fd590 0x7f822c10d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:42:47.014 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:47.012+0000 7f8232129640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f822c0fc2c0 0x7f822c10ce80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:55808/0 (socket says 172.21.15.121:55808) 2024-08-18T22:42:47.014 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:47.012+0000 7f8232129640 1 -- 172.21.15.121:0/1347846135 learned_addr learned my addr 172.21.15.121:0/1347846135 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-18T22:42:47.014 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:47.012+0000 7f8231928640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f822c0fd590 0x7f822c10d3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.121:45366/0 (socket says 172.21.15.121:45366) 2024-08-18T22:42:47.014 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:47.012+0000 7f8231928640 1 -- 172.21.15.121:0/1347846135 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f822c0fc2c0 msgr2=0x7f822c10ce80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:42:47.014 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:47.012+0000 7f8231928640 1 --2- 172.21.15.121:0/1347846135 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f822c0fc2c0 0x7f822c10ce80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:42:47.014 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:47.012+0000 7f8231928640 1 -- 172.21.15.121:0/1347846135 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f821c005040 con 0x7f822c0fd590 2024-08-18T22:42:47.014 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:47.012+0000 7f8232129640 1 --2- 172.21.15.121:0/1347846135 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f822c0fc2c0 0x7f822c10ce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:42:47.014 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:47.013+0000 7f8231928640 1 --2- 172.21.15.121:0/1347846135 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f822c0fd590 0x7f822c10d3c0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f821c02a530 tx=0x7f821c009da0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:42:47.015 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:47.013+0000 7f8222ffd640 1 -- 172.21.15.121:0/1347846135 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f821c038070 con 0x7f822c0fd590 2024-08-18T22:42:47.015 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:47.013+0000 7f8222ffd640 1 -- 172.21.15.121:0/1347846135 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f821c02ae90 con 0x7f822c0fd590 2024-08-18T22:42:47.015 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:47.013+0000 7f8222ffd640 1 -- 172.21.15.121:0/1347846135 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f821c03e670 con 0x7f822c0fd590 2024-08-18T22:42:47.015 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:47.013+0000 7f823438d640 1 -- 172.21.15.121:0/1347846135 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f822c10e380 con 0x7f822c0fd590 2024-08-18T22:42:47.015 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:47.013+0000 7f823438d640 1 -- 172.21.15.121:0/1347846135 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f822c10e860 con 0x7f822c0fd590 2024-08-18T22:42:47.015 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:47.014+0000 7f823438d640 1 -- 172.21.15.121:0/1347846135 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f822c0fb720 con 0x7f822c0fd590 2024-08-18T22:42:47.016 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:47.015+0000 7f8222ffd640 1 -- 172.21.15.121:0/1347846135 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 25) v1 ==== 88617+0+0 (secure 0 0 0) 0x7f821c030020 con 0x7f822c0fd590 2024-08-18T22:42:47.016 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:47.015+0000 7f8222ffd640 1 --2- 172.21.15.121:0/1347846135 >> [v2:172.21.15.195:6828/1174410756,v1:172.21.15.195:6829/1174410756] conn(0x7f821806a6d0 0x7f821806cb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:42:47.016 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:47.015+0000 7f8222ffd640 1 -- 172.21.15.121:0/1347846135 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f821c0a9080 con 0x7f822c0fd590 2024-08-18T22:42:47.017 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:47.016+0000 7f8232129640 1 --2- 172.21.15.121:0/1347846135 >> [v2:172.21.15.195:6828/1174410756,v1:172.21.15.195:6829/1174410756] conn(0x7f821806a6d0 0x7f821806cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:42:47.017 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:47.016+0000 7f8232129640 1 --2- 172.21.15.121:0/1347846135 >> [v2:172.21.15.195:6828/1174410756,v1:172.21.15.195:6829/1174410756] conn(0x7f821806a6d0 0x7f821806cb80 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f822c10cc10 tx=0x7f822800b040 comp rx=0 tx=0).ready entity=mgr.24377 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:42:47.022 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:47.021+0000 7f8222ffd640 1 -- 172.21.15.121:0/1347846135 <== mon.1 v2:172.21.15.195:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7f821c072d10 con 0x7f822c0fd590 2024-08-18T22:42:47.182 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:42:46 smithi121 ceph-mon[16788]: from='client.24471 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-18T22:42:47.182 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:42:46 smithi121 ceph-mon[16788]: from='client.14714 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-18T22:42:47.182 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:42:46 smithi121 ceph-mon[16788]: pgmap v37: 65 pgs: 65 active+clean; 2.0 GiB data, 7.6 GiB used, 529 GiB / 536 GiB avail; 39 KiB/s rd, 1.2 MiB/s wr, 379 op/s 2024-08-18T22:42:47.182 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:42:46 smithi121 ceph-mon[16788]: from='client.? 172.21.15.121:0/3315454381' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-08-18T22:42:47.182 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:42:46 smithi121 ceph-mon[16788]: from='client.? 172.21.15.121:0/1426879938' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-08-18T22:42:47.367 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:47.366+0000 7f823438d640 1 -- 172.21.15.121:0/1347846135 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f822c104ce0 con 0x7f822c0fd590 2024-08-18T22:42:47.367 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:47.366+0000 7f8222ffd640 1 -- 172.21.15.121:0/1347846135 <== mon.1 v2:172.21.15.195:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f821c0763d0 con 0x7f822c0fd590 2024-08-18T22:42:47.368 INFO:teuthology.orchestra.run.smithi121.stdout:HEALTH_OK 2024-08-18T22:42:47.371 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:47.370+0000 7f823438d640 1 -- 172.21.15.121:0/1347846135 >> [v2:172.21.15.195:6828/1174410756,v1:172.21.15.195:6829/1174410756] conn(0x7f821806a6d0 msgr2=0x7f821806cb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:42:47.371 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:47.370+0000 7f823438d640 1 --2- 172.21.15.121:0/1347846135 >> [v2:172.21.15.195:6828/1174410756,v1:172.21.15.195:6829/1174410756] conn(0x7f821806a6d0 0x7f821806cb80 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f822c10cc10 tx=0x7f822800b040 comp rx=0 tx=0).stop 2024-08-18T22:42:47.372 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:47.371+0000 7f823438d640 1 -- 172.21.15.121:0/1347846135 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f822c0fd590 msgr2=0x7f822c10d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:42:47.372 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:47.371+0000 7f823438d640 1 --2- 172.21.15.121:0/1347846135 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f822c0fd590 0x7f822c10d3c0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f821c02a530 tx=0x7f821c009da0 comp rx=0 tx=0).stop 2024-08-18T22:42:47.372 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:47.371+0000 7f823438d640 1 -- 172.21.15.121:0/1347846135 shutdown_connections 2024-08-18T22:42:47.372 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:47.371+0000 7f823438d640 1 --2- 172.21.15.121:0/1347846135 >> [v2:172.21.15.195:6828/1174410756,v1:172.21.15.195:6829/1174410756] conn(0x7f821806a6d0 0x7f821806cb80 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:42:47.372 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:47.371+0000 7f823438d640 1 --2- 172.21.15.121:0/1347846135 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f822c0fd590 0x7f822c10d3c0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:42:47.373 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:47.371+0000 7f823438d640 1 --2- 172.21.15.121:0/1347846135 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f822c0fc2c0 0x7f822c10ce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:42:47.373 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:47.371+0000 7f823438d640 1 -- 172.21.15.121:0/1347846135 >> 172.21.15.121:0/1347846135 conn(0x7f822c0f7a80 msgr2=0x7f822c0f9200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:42:47.373 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:47.371+0000 7f823438d640 1 -- 172.21.15.121:0/1347846135 shutdown_connections 2024-08-18T22:42:47.373 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:42:47.371+0000 7f823438d640 1 -- 172.21.15.121:0/1347846135 wait complete. 2024-08-18T22:42:47.409 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:42:46 smithi195 ceph-mon[23370]: from='client.24471 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-18T22:42:47.409 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:42:46 smithi195 ceph-mon[23370]: from='client.14714 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-18T22:42:47.409 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:42:46 smithi195 ceph-mon[23370]: pgmap v37: 65 pgs: 65 active+clean; 2.0 GiB data, 7.6 GiB used, 529 GiB / 536 GiB avail; 39 KiB/s rd, 1.2 MiB/s wr, 379 op/s 2024-08-18T22:42:47.409 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:42:46 smithi195 ceph-mon[23370]: from='client.? 172.21.15.121:0/3315454381' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-08-18T22:42:47.409 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:42:46 smithi195 ceph-mon[23370]: from='client.? 172.21.15.121:0/1426879938' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-08-18T22:42:48.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:42:47 smithi121 ceph-mon[16788]: from='client.14724 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-18T22:42:48.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:42:47 smithi121 ceph-mon[16788]: from='mgr.24377 ' entity='mgr.smithi195.acttsj' 2024-08-18T22:42:48.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:42:47 smithi121 ceph-mon[16788]: from='mgr.24377 ' entity='mgr.smithi195.acttsj' 2024-08-18T22:42:48.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:42:47 smithi121 ceph-mon[16788]: from='client.? 172.21.15.121:0/1347846135' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-08-18T22:42:48.310 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:42:47 smithi195 ceph-mon[23370]: from='client.14724 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-18T22:42:48.310 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:42:47 smithi195 ceph-mon[23370]: from='mgr.24377 ' entity='mgr.smithi195.acttsj' 2024-08-18T22:42:48.310 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:42:47 smithi195 ceph-mon[23370]: from='mgr.24377 ' entity='mgr.smithi195.acttsj' 2024-08-18T22:42:48.310 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:42:47 smithi195 ceph-mon[23370]: from='client.? 172.21.15.121:0/1347846135' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-08-18T22:42:49.280 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:42:48 smithi195 ceph-mon[23370]: pgmap v38: 65 pgs: 65 active+clean; 2.0 GiB data, 7.6 GiB used, 529 GiB / 536 GiB avail; 26 KiB/s rd, 894 KiB/s wr, 250 op/s 2024-08-18T22:42:49.333 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:42:48 smithi121 ceph-mon[16788]: pgmap v38: 65 pgs: 65 active+clean; 2.0 GiB data, 7.6 GiB used, 529 GiB / 536 GiB avail; 26 KiB/s rd, 894 KiB/s wr, 250 op/s 2024-08-18T22:42:51.334 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:42:50 smithi121 ceph-mon[16788]: pgmap v39: 65 pgs: 65 active+clean; 2.0 GiB data, 7.6 GiB used, 529 GiB / 536 GiB avail; 34 KiB/s rd, 1.2 MiB/s wr, 334 op/s 2024-08-18T22:42:51.334 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:42:50 smithi121 ceph-mon[16788]: from='mgr.24377 ' entity='mgr.smithi195.acttsj' 2024-08-18T22:42:51.334 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:42:50 smithi121 ceph-mon[16788]: from='mgr.24377 ' entity='mgr.smithi195.acttsj' 2024-08-18T22:42:51.334 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:42:50 smithi121 ceph-mon[16788]: Standby manager daemon smithi121.lopxqc restarted 2024-08-18T22:42:51.335 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:42:50 smithi121 ceph-mon[16788]: Standby manager daemon smithi121.lopxqc started 2024-08-18T22:42:51.335 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:42:50 smithi121 ceph-mon[16788]: from='mgr.? 172.21.15.121:0/3084939281' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi121.lopxqc/crt"}]: dispatch 2024-08-18T22:42:51.335 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:42:50 smithi121 ceph-mon[16788]: from='mgr.? 172.21.15.121:0/3084939281' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-08-18T22:42:51.335 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:42:50 smithi121 ceph-mon[16788]: from='mgr.? 172.21.15.121:0/3084939281' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi121.lopxqc/key"}]: dispatch 2024-08-18T22:42:51.335 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:42:50 smithi121 ceph-mon[16788]: from='mgr.? 172.21.15.121:0/3084939281' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-08-18T22:42:51.409 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:42:50 smithi195 ceph-mon[23370]: pgmap v39: 65 pgs: 65 active+clean; 2.0 GiB data, 7.6 GiB used, 529 GiB / 536 GiB avail; 34 KiB/s rd, 1.2 MiB/s wr, 334 op/s 2024-08-18T22:42:51.409 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:42:50 smithi195 ceph-mon[23370]: from='mgr.24377 ' entity='mgr.smithi195.acttsj' 2024-08-18T22:42:51.409 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:42:50 smithi195 ceph-mon[23370]: from='mgr.24377 ' entity='mgr.smithi195.acttsj' 2024-08-18T22:42:51.409 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:42:50 smithi195 ceph-mon[23370]: Standby manager daemon smithi121.lopxqc restarted 2024-08-18T22:42:51.409 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:42:50 smithi195 ceph-mon[23370]: Standby manager daemon smithi121.lopxqc started 2024-08-18T22:42:51.409 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:42:50 smithi195 ceph-mon[23370]: from='mgr.? 172.21.15.121:0/3084939281' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi121.lopxqc/crt"}]: dispatch 2024-08-18T22:42:51.409 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:42:50 smithi195 ceph-mon[23370]: from='mgr.? 172.21.15.121:0/3084939281' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-08-18T22:42:51.410 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:42:50 smithi195 ceph-mon[23370]: from='mgr.? 172.21.15.121:0/3084939281' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi121.lopxqc/key"}]: dispatch 2024-08-18T22:42:51.410 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:42:50 smithi195 ceph-mon[23370]: from='mgr.? 172.21.15.121:0/3084939281' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-08-18T22:42:51.723 INFO:tasks.workunit:Stopping ['suites/fsstress.sh'] on client.1... 2024-08-18T22:42:51.723 DEBUG:teuthology.orchestra.run.smithi195:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.1 /home/ubuntu/cephtest/clone.client.1 2024-08-18T22:42:52.020 DEBUG:teuthology.parallel:result is None 2024-08-18T22:42:52.314 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:42:51 smithi121 ceph-mon[16788]: from='mgr.24377 ' entity='mgr.smithi195.acttsj' 2024-08-18T22:42:52.314 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:42:51 smithi121 ceph-mon[16788]: from='mgr.24377 ' entity='mgr.smithi195.acttsj' 2024-08-18T22:42:52.314 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:42:51 smithi121 ceph-mon[16788]: mgrmap e26: smithi195.acttsj(active, since 73s), standbys: smithi121.lopxqc 2024-08-18T22:42:52.314 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:42:51 smithi121 ceph-mon[16788]: pgmap v40: 65 pgs: 65 active+clean; 2.0 GiB data, 7.6 GiB used, 529 GiB / 536 GiB avail; 21 KiB/s rd, 827 KiB/s wr, 204 op/s 2024-08-18T22:42:52.409 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:42:51 smithi195 ceph-mon[23370]: from='mgr.24377 ' entity='mgr.smithi195.acttsj' 2024-08-18T22:42:52.409 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:42:51 smithi195 ceph-mon[23370]: from='mgr.24377 ' entity='mgr.smithi195.acttsj' 2024-08-18T22:42:52.409 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:42:51 smithi195 ceph-mon[23370]: mgrmap e26: smithi195.acttsj(active, since 73s), standbys: smithi121.lopxqc 2024-08-18T22:42:52.409 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:42:51 smithi195 ceph-mon[23370]: pgmap v40: 65 pgs: 65 active+clean; 2.0 GiB data, 7.6 GiB used, 529 GiB / 536 GiB avail; 21 KiB/s rd, 827 KiB/s wr, 204 op/s 2024-08-18T22:42:53.333 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:42:53 smithi121 ceph-mon[16788]: from='mgr.24377 172.21.15.195:0/2331273060' entity='mgr.smithi195.acttsj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-18T22:42:53.659 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:42:53 smithi195 ceph-mon[23370]: from='mgr.24377 172.21.15.195:0/2331273060' entity='mgr.smithi195.acttsj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-18T22:42:54.455 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:42:54 smithi121 ceph-mon[16788]: pgmap v41: 65 pgs: 65 active+clean; 2.0 GiB data, 7.6 GiB used, 529 GiB / 536 GiB avail; 21 KiB/s rd, 827 KiB/s wr, 204 op/s 2024-08-18T22:42:54.659 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:42:54 smithi195 ceph-mon[23370]: pgmap v41: 65 pgs: 65 active+clean; 2.0 GiB data, 7.6 GiB used, 529 GiB / 536 GiB avail; 21 KiB/s rd, 827 KiB/s wr, 204 op/s 2024-08-18T22:42:57.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:42:56 smithi121 ceph-mon[16788]: pgmap v42: 65 pgs: 65 active+clean; 2.0 GiB data, 7.5 GiB used, 529 GiB / 536 GiB avail; 33 KiB/s rd, 1.1 MiB/s wr, 314 op/s 2024-08-18T22:42:57.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:42:56 smithi195 ceph-mon[23370]: pgmap v42: 65 pgs: 65 active+clean; 2.0 GiB data, 7.5 GiB used, 529 GiB / 536 GiB avail; 33 KiB/s rd, 1.1 MiB/s wr, 314 op/s 2024-08-18T22:42:58.833 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:42:58 smithi121 ceph-mon[16788]: pgmap v43: 65 pgs: 65 active+clean; 2.0 GiB data, 7.5 GiB used, 529 GiB / 536 GiB avail; 20 KiB/s rd, 641 KiB/s wr, 193 op/s 2024-08-18T22:42:59.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:42:58 smithi195 ceph-mon[23370]: pgmap v43: 65 pgs: 65 active+clean; 2.0 GiB data, 7.5 GiB used, 529 GiB / 536 GiB avail; 20 KiB/s rd, 641 KiB/s wr, 193 op/s 2024-08-18T22:43:01.054 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:00 smithi195 ceph-mon[23370]: pgmap v44: 65 pgs: 65 active+clean; 2.0 GiB data, 7.5 GiB used, 529 GiB / 536 GiB avail; 20 KiB/s rd, 642 KiB/s wr, 194 op/s 2024-08-18T22:43:01.054 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:00 smithi195 ceph-mon[23370]: from='mgr.24377 ' entity='mgr.smithi195.acttsj' 2024-08-18T22:43:01.055 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:00 smithi195 ceph-mon[23370]: from='mgr.24377 ' entity='mgr.smithi195.acttsj' 2024-08-18T22:43:01.055 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:00 smithi195 ceph-mon[23370]: from='mgr.24377 172.21.15.195:0/2331273060' entity='mgr.smithi195.acttsj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:43:01.055 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:00 smithi195 ceph-mon[23370]: from='mgr.24377 172.21.15.195:0/2331273060' entity='mgr.smithi195.acttsj' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-18T22:43:01.055 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:00 smithi195 ceph-mon[23370]: from='mgr.24377 ' entity='mgr.smithi195.acttsj' 2024-08-18T22:43:01.055 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:00 smithi195 ceph-mon[23370]: from='mgr.24377 172.21.15.195:0/2331273060' entity='mgr.smithi195.acttsj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-18T22:43:01.055 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:00 smithi195 ceph-mon[23370]: from='mgr.24377 172.21.15.195:0/2331273060' entity='mgr.smithi195.acttsj' cmd=[{"prefix": "mgr fail", "who": "smithi195.acttsj"}]: dispatch 2024-08-18T22:43:01.055 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:00 smithi195 ceph-mon[23370]: from='mgr.24377 ' entity='mgr.smithi195.acttsj' cmd=[{"prefix": "mgr fail", "who": "smithi195.acttsj"}]: dispatch 2024-08-18T22:43:01.055 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:00 smithi195 ceph-mon[23370]: Activating manager daemon smithi121.lopxqc 2024-08-18T22:43:01.055 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:00 smithi195 ceph-mon[23370]: osdmap e49: 6 total, 6 up, 6 in 2024-08-18T22:43:01.055 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:00 smithi195 ceph-mon[23370]: from='mgr.24377 ' entity='mgr.smithi195.acttsj' cmd='[{"prefix": "mgr fail", "who": "smithi195.acttsj"}]': finished 2024-08-18T22:43:01.055 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:00 smithi195 ceph-mon[23370]: mgrmap e27: smithi121.lopxqc(active, starting, since 0.00634872s) 2024-08-18T22:43:01.055 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:00 smithi195 ceph-mon[23370]: from='mgr.14702 172.21.15.121:0/3084939281' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "mon metadata", "id": "smithi121"}]: dispatch 2024-08-18T22:43:01.055 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:00 smithi195 ceph-mon[23370]: from='mgr.14702 172.21.15.121:0/3084939281' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "mon metadata", "id": "smithi195"}]: dispatch 2024-08-18T22:43:01.056 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:00 smithi195 ceph-mon[23370]: from='mgr.14702 172.21.15.121:0/3084939281' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi121.gbickb"}]: dispatch 2024-08-18T22:43:01.056 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:00 smithi195 ceph-mon[23370]: from='mgr.14702 172.21.15.121:0/3084939281' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi121.xuzsdg"}]: dispatch 2024-08-18T22:43:01.056 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:00 smithi195 ceph-mon[23370]: from='mgr.14702 172.21.15.121:0/3084939281' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi195.buqvbr"}]: dispatch 2024-08-18T22:43:01.056 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:00 smithi195 ceph-mon[23370]: from='mgr.14702 172.21.15.121:0/3084939281' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi195.nptgyc"}]: dispatch 2024-08-18T22:43:01.056 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:00 smithi195 ceph-mon[23370]: from='mgr.14702 172.21.15.121:0/3084939281' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "mgr metadata", "who": "smithi121.lopxqc", "id": "smithi121.lopxqc"}]: dispatch 2024-08-18T22:43:01.056 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:00 smithi195 ceph-mon[23370]: from='mgr.14702 172.21.15.121:0/3084939281' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-08-18T22:43:01.056 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:00 smithi195 ceph-mon[23370]: from='mgr.14702 172.21.15.121:0/3084939281' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-08-18T22:43:01.056 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:00 smithi195 ceph-mon[23370]: from='mgr.14702 172.21.15.121:0/3084939281' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-08-18T22:43:01.056 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:00 smithi195 ceph-mon[23370]: from='mgr.14702 172.21.15.121:0/3084939281' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-08-18T22:43:01.056 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:00 smithi195 ceph-mon[23370]: from='mgr.14702 172.21.15.121:0/3084939281' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-08-18T22:43:01.056 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:00 smithi195 ceph-mon[23370]: from='mgr.14702 172.21.15.121:0/3084939281' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-08-18T22:43:01.056 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:00 smithi195 ceph-mon[23370]: from='mgr.14702 172.21.15.121:0/3084939281' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-08-18T22:43:01.056 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:00 smithi195 ceph-mon[23370]: from='mgr.14702 172.21.15.121:0/3084939281' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-08-18T22:43:01.057 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:00 smithi195 ceph-mon[23370]: from='mgr.14702 172.21.15.121:0/3084939281' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-08-18T22:43:01.057 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:00 smithi195 ceph-mon[23370]: Manager daemon smithi121.lopxqc is now available 2024-08-18T22:43:01.057 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:00 smithi195 ceph-mon[23370]: from='mgr.14702 172.21.15.121:0/3084939281' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-18T22:43:01.057 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:00 smithi195 ceph-mon[23370]: from='mgr.14702 172.21.15.121:0/3084939281' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-18T22:43:01.057 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:00 smithi195 ceph-mon[23370]: from='mgr.14702 172.21.15.121:0/3084939281' entity='mgr.smithi121.lopxqc' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi121.lopxqc/mirror_snapshot_schedule"}]: dispatch 2024-08-18T22:43:01.057 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:00 smithi195 ceph-mon[23370]: from='mgr.14702 172.21.15.121:0/3084939281' entity='mgr.smithi121.lopxqc' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi121.lopxqc/trash_purge_schedule"}]: dispatch 2024-08-18T22:43:01.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:00 smithi121 ceph-mon[16788]: pgmap v44: 65 pgs: 65 active+clean; 2.0 GiB data, 7.5 GiB used, 529 GiB / 536 GiB avail; 20 KiB/s rd, 642 KiB/s wr, 194 op/s 2024-08-18T22:43:01.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:00 smithi121 ceph-mon[16788]: from='mgr.24377 ' entity='mgr.smithi195.acttsj' 2024-08-18T22:43:01.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:00 smithi121 ceph-mon[16788]: from='mgr.24377 ' entity='mgr.smithi195.acttsj' 2024-08-18T22:43:01.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:00 smithi121 ceph-mon[16788]: from='mgr.24377 172.21.15.195:0/2331273060' entity='mgr.smithi195.acttsj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:43:01.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:00 smithi121 ceph-mon[16788]: from='mgr.24377 172.21.15.195:0/2331273060' entity='mgr.smithi195.acttsj' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-18T22:43:01.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:00 smithi121 ceph-mon[16788]: from='mgr.24377 ' entity='mgr.smithi195.acttsj' 2024-08-18T22:43:01.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:00 smithi121 ceph-mon[16788]: from='mgr.24377 172.21.15.195:0/2331273060' entity='mgr.smithi195.acttsj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-18T22:43:01.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:00 smithi121 ceph-mon[16788]: from='mgr.24377 172.21.15.195:0/2331273060' entity='mgr.smithi195.acttsj' cmd=[{"prefix": "mgr fail", "who": "smithi195.acttsj"}]: dispatch 2024-08-18T22:43:01.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:00 smithi121 ceph-mon[16788]: from='mgr.24377 ' entity='mgr.smithi195.acttsj' cmd=[{"prefix": "mgr fail", "who": "smithi195.acttsj"}]: dispatch 2024-08-18T22:43:01.085 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:00 smithi121 ceph-mon[16788]: Activating manager daemon smithi121.lopxqc 2024-08-18T22:43:01.085 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:00 smithi121 ceph-mon[16788]: osdmap e49: 6 total, 6 up, 6 in 2024-08-18T22:43:01.085 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:00 smithi121 ceph-mon[16788]: from='mgr.24377 ' entity='mgr.smithi195.acttsj' cmd='[{"prefix": "mgr fail", "who": "smithi195.acttsj"}]': finished 2024-08-18T22:43:01.085 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:00 smithi121 ceph-mon[16788]: mgrmap e27: smithi121.lopxqc(active, starting, since 0.00634872s) 2024-08-18T22:43:01.085 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:00 smithi121 ceph-mon[16788]: from='mgr.14702 172.21.15.121:0/3084939281' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "mon metadata", "id": "smithi121"}]: dispatch 2024-08-18T22:43:01.085 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:00 smithi121 ceph-mon[16788]: from='mgr.14702 172.21.15.121:0/3084939281' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "mon metadata", "id": "smithi195"}]: dispatch 2024-08-18T22:43:01.085 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:00 smithi121 ceph-mon[16788]: from='mgr.14702 172.21.15.121:0/3084939281' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi121.gbickb"}]: dispatch 2024-08-18T22:43:01.085 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:00 smithi121 ceph-mon[16788]: from='mgr.14702 172.21.15.121:0/3084939281' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi121.xuzsdg"}]: dispatch 2024-08-18T22:43:01.085 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:00 smithi121 ceph-mon[16788]: from='mgr.14702 172.21.15.121:0/3084939281' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi195.buqvbr"}]: dispatch 2024-08-18T22:43:01.085 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:00 smithi121 ceph-mon[16788]: from='mgr.14702 172.21.15.121:0/3084939281' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi195.nptgyc"}]: dispatch 2024-08-18T22:43:01.085 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:00 smithi121 ceph-mon[16788]: from='mgr.14702 172.21.15.121:0/3084939281' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "mgr metadata", "who": "smithi121.lopxqc", "id": "smithi121.lopxqc"}]: dispatch 2024-08-18T22:43:01.085 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:00 smithi121 ceph-mon[16788]: from='mgr.14702 172.21.15.121:0/3084939281' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-08-18T22:43:01.085 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:00 smithi121 ceph-mon[16788]: from='mgr.14702 172.21.15.121:0/3084939281' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-08-18T22:43:01.086 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:00 smithi121 ceph-mon[16788]: from='mgr.14702 172.21.15.121:0/3084939281' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-08-18T22:43:01.086 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:00 smithi121 ceph-mon[16788]: from='mgr.14702 172.21.15.121:0/3084939281' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-08-18T22:43:01.086 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:00 smithi121 ceph-mon[16788]: from='mgr.14702 172.21.15.121:0/3084939281' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-08-18T22:43:01.086 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:00 smithi121 ceph-mon[16788]: from='mgr.14702 172.21.15.121:0/3084939281' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-08-18T22:43:01.086 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:00 smithi121 ceph-mon[16788]: from='mgr.14702 172.21.15.121:0/3084939281' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-08-18T22:43:01.086 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:00 smithi121 ceph-mon[16788]: from='mgr.14702 172.21.15.121:0/3084939281' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-08-18T22:43:01.086 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:00 smithi121 ceph-mon[16788]: from='mgr.14702 172.21.15.121:0/3084939281' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-08-18T22:43:01.086 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:00 smithi121 ceph-mon[16788]: Manager daemon smithi121.lopxqc is now available 2024-08-18T22:43:01.086 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:00 smithi121 ceph-mon[16788]: from='mgr.14702 172.21.15.121:0/3084939281' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-18T22:43:01.086 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:00 smithi121 ceph-mon[16788]: from='mgr.14702 172.21.15.121:0/3084939281' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-18T22:43:01.086 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:00 smithi121 ceph-mon[16788]: from='mgr.14702 172.21.15.121:0/3084939281' entity='mgr.smithi121.lopxqc' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi121.lopxqc/mirror_snapshot_schedule"}]: dispatch 2024-08-18T22:43:01.086 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:00 smithi121 ceph-mon[16788]: from='mgr.14702 172.21.15.121:0/3084939281' entity='mgr.smithi121.lopxqc' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi121.lopxqc/trash_purge_schedule"}]: dispatch 2024-08-18T22:43:02.423 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:02 smithi195 ceph-mon[23370]: mgrmap e28: smithi121.lopxqc(active, since 1.00891s) 2024-08-18T22:43:02.423 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:02 smithi195 ceph-mon[23370]: pgmap v3: 65 pgs: 65 active+clean; 2.0 GiB data, 7.5 GiB used, 529 GiB / 536 GiB avail 2024-08-18T22:43:02.490 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:02 smithi121 ceph-mon[16788]: mgrmap e28: smithi121.lopxqc(active, since 1.00891s) 2024-08-18T22:43:02.491 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:02 smithi121 ceph-mon[16788]: pgmap v3: 65 pgs: 65 active+clean; 2.0 GiB data, 7.5 GiB used, 529 GiB / 536 GiB avail 2024-08-18T22:43:03.334 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:03 smithi121 ceph-mon[16788]: [18/Aug/2024:22:43:02] ENGINE Bus STARTING 2024-08-18T22:43:03.334 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:03 smithi121 ceph-mon[16788]: pgmap v4: 65 pgs: 65 active+clean; 2.0 GiB data, 7.5 GiB used, 529 GiB / 536 GiB avail 2024-08-18T22:43:03.334 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:03 smithi121 ceph-mon[16788]: [18/Aug/2024:22:43:02] ENGINE Serving on https://172.21.15.121:7150 2024-08-18T22:43:03.334 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:03 smithi121 ceph-mon[16788]: [18/Aug/2024:22:43:02] ENGINE Error in HTTPServer.serve 2024-08-18T22:43:03.334 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout: Traceback (most recent call last): 2024-08-18T22:43:03.335 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-08-18T22:43:03.335 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout: self._connections.run(self.expiration_interval) 2024-08-18T22:43:03.335 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-08-18T22:43:03.335 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout: self._run(expiration_interval) 2024-08-18T22:43:03.335 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-08-18T22:43:03.335 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-08-18T22:43:03.335 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-08-18T22:43:03.335 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-08-18T22:43:03.335 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-08-18T22:43:03.335 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout: s = self.context.wrap_socket( 2024-08-18T22:43:03.335 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-08-18T22:43:03.335 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout: return self.sslsocket_class._create( 2024-08-18T22:43:03.335 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-08-18T22:43:03.336 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout: self.do_handshake() 2024-08-18T22:43:03.336 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-08-18T22:43:03.336 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout: self._sslobj.do_handshake() 2024-08-18T22:43:03.336 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-08-18T22:43:03.409 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:03 smithi195 ceph-mon[23370]: [18/Aug/2024:22:43:02] ENGINE Bus STARTING 2024-08-18T22:43:03.409 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:03 smithi195 ceph-mon[23370]: pgmap v4: 65 pgs: 65 active+clean; 2.0 GiB data, 7.5 GiB used, 529 GiB / 536 GiB avail 2024-08-18T22:43:03.409 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:03 smithi195 ceph-mon[23370]: [18/Aug/2024:22:43:02] ENGINE Serving on https://172.21.15.121:7150 2024-08-18T22:43:03.409 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:03 smithi195 ceph-mon[23370]: [18/Aug/2024:22:43:02] ENGINE Error in HTTPServer.serve 2024-08-18T22:43:03.409 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: Traceback (most recent call last): 2024-08-18T22:43:03.409 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-08-18T22:43:03.409 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: self._connections.run(self.expiration_interval) 2024-08-18T22:43:03.410 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-08-18T22:43:03.410 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: self._run(expiration_interval) 2024-08-18T22:43:03.410 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-08-18T22:43:03.410 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-08-18T22:43:03.410 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-08-18T22:43:03.410 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-08-18T22:43:03.410 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-08-18T22:43:03.410 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: s = self.context.wrap_socket( 2024-08-18T22:43:03.410 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-08-18T22:43:03.410 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: return self.sslsocket_class._create( 2024-08-18T22:43:03.410 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-08-18T22:43:03.410 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: self.do_handshake() 2024-08-18T22:43:03.410 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-08-18T22:43:03.411 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: self._sslobj.do_handshake() 2024-08-18T22:43:03.411 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-08-18T22:43:04.409 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:04 smithi195 ceph-mon[23370]: [18/Aug/2024:22:43:02] ENGINE Serving on http://172.21.15.121:8765 2024-08-18T22:43:04.409 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:04 smithi195 ceph-mon[23370]: [18/Aug/2024:22:43:02] ENGINE Bus STARTED 2024-08-18T22:43:04.409 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:04 smithi195 ceph-mon[23370]: mgrmap e29: smithi121.lopxqc(active, since 3s) 2024-08-18T22:43:04.409 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:04 smithi195 ceph-mon[23370]: from='mgr.14702 172.21.15.121:0/3084939281' entity='mgr.smithi121.lopxqc' 2024-08-18T22:43:04.409 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:04 smithi195 ceph-mon[23370]: from='mgr.14702 172.21.15.121:0/3084939281' entity='mgr.smithi121.lopxqc' 2024-08-18T22:43:04.435 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:04 smithi121 ceph-mon[16788]: [18/Aug/2024:22:43:02] ENGINE Serving on http://172.21.15.121:8765 2024-08-18T22:43:04.435 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:04 smithi121 ceph-mon[16788]: [18/Aug/2024:22:43:02] ENGINE Bus STARTED 2024-08-18T22:43:04.435 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:04 smithi121 ceph-mon[16788]: mgrmap e29: smithi121.lopxqc(active, since 3s) 2024-08-18T22:43:04.435 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:04 smithi121 ceph-mon[16788]: from='mgr.14702 172.21.15.121:0/3084939281' entity='mgr.smithi121.lopxqc' 2024-08-18T22:43:04.435 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:04 smithi121 ceph-mon[16788]: from='mgr.14702 172.21.15.121:0/3084939281' entity='mgr.smithi121.lopxqc' 2024-08-18T22:43:05.406 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:05 smithi121 ceph-mon[16788]: pgmap v5: 65 pgs: 65 active+clean; 2.0 GiB data, 7.5 GiB used, 529 GiB / 536 GiB avail 2024-08-18T22:43:05.406 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:05 smithi121 ceph-mon[16788]: from='mgr.14702 172.21.15.121:0/3084939281' entity='mgr.smithi121.lopxqc' 2024-08-18T22:43:05.406 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:05 smithi121 ceph-mon[16788]: from='mgr.14702 172.21.15.121:0/3084939281' entity='mgr.smithi121.lopxqc' 2024-08-18T22:43:05.659 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:05 smithi195 ceph-mon[23370]: pgmap v5: 65 pgs: 65 active+clean; 2.0 GiB data, 7.5 GiB used, 529 GiB / 536 GiB avail 2024-08-18T22:43:05.659 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:05 smithi195 ceph-mon[23370]: from='mgr.14702 172.21.15.121:0/3084939281' entity='mgr.smithi121.lopxqc' 2024-08-18T22:43:05.659 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:05 smithi195 ceph-mon[23370]: from='mgr.14702 172.21.15.121:0/3084939281' entity='mgr.smithi121.lopxqc' 2024-08-18T22:43:06.583 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:06 smithi121 ceph-mon[16788]: Standby manager daemon smithi195.acttsj started 2024-08-18T22:43:06.584 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:06 smithi121 ceph-mon[16788]: from='mgr.? 172.21.15.195:0/176672026' entity='mgr.smithi195.acttsj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi195.acttsj/crt"}]: dispatch 2024-08-18T22:43:06.584 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:06 smithi121 ceph-mon[16788]: from='mgr.? 172.21.15.195:0/176672026' entity='mgr.smithi195.acttsj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-08-18T22:43:06.584 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:06 smithi121 ceph-mon[16788]: from='mgr.? 172.21.15.195:0/176672026' entity='mgr.smithi195.acttsj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi195.acttsj/key"}]: dispatch 2024-08-18T22:43:06.584 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:06 smithi121 ceph-mon[16788]: from='mgr.? 172.21.15.195:0/176672026' entity='mgr.smithi195.acttsj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-08-18T22:43:06.584 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:06 smithi121 ceph-mon[16788]: mgrmap e30: smithi121.lopxqc(active, since 5s), standbys: smithi195.acttsj 2024-08-18T22:43:06.585 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:06 smithi121 ceph-mon[16788]: from='mgr.14702 172.21.15.121:0/3084939281' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "mgr metadata", "who": "smithi195.acttsj", "id": "smithi195.acttsj"}]: dispatch 2024-08-18T22:43:06.585 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:06 smithi121 ceph-mon[16788]: from='mgr.14702 172.21.15.121:0/3084939281' entity='mgr.smithi121.lopxqc' 2024-08-18T22:43:06.585 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:06 smithi121 ceph-mon[16788]: from='mgr.14702 172.21.15.121:0/3084939281' entity='mgr.smithi121.lopxqc' 2024-08-18T22:43:06.659 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:06 smithi195 ceph-mon[23370]: Standby manager daemon smithi195.acttsj started 2024-08-18T22:43:06.659 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:06 smithi195 ceph-mon[23370]: from='mgr.? 172.21.15.195:0/176672026' entity='mgr.smithi195.acttsj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi195.acttsj/crt"}]: dispatch 2024-08-18T22:43:06.659 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:06 smithi195 ceph-mon[23370]: from='mgr.? 172.21.15.195:0/176672026' entity='mgr.smithi195.acttsj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-08-18T22:43:06.660 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:06 smithi195 ceph-mon[23370]: from='mgr.? 172.21.15.195:0/176672026' entity='mgr.smithi195.acttsj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi195.acttsj/key"}]: dispatch 2024-08-18T22:43:06.660 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:06 smithi195 ceph-mon[23370]: from='mgr.? 172.21.15.195:0/176672026' entity='mgr.smithi195.acttsj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-08-18T22:43:06.660 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:06 smithi195 ceph-mon[23370]: mgrmap e30: smithi121.lopxqc(active, since 5s), standbys: smithi195.acttsj 2024-08-18T22:43:06.660 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:06 smithi195 ceph-mon[23370]: from='mgr.14702 172.21.15.121:0/3084939281' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "mgr metadata", "who": "smithi195.acttsj", "id": "smithi195.acttsj"}]: dispatch 2024-08-18T22:43:06.660 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:06 smithi195 ceph-mon[23370]: from='mgr.14702 172.21.15.121:0/3084939281' entity='mgr.smithi121.lopxqc' 2024-08-18T22:43:06.661 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:06 smithi195 ceph-mon[23370]: from='mgr.14702 172.21.15.121:0/3084939281' entity='mgr.smithi121.lopxqc' 2024-08-18T22:43:07.565 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:07 smithi121 ceph-mon[16788]: pgmap v6: 65 pgs: 65 active+clean; 2.0 GiB data, 7.5 GiB used, 529 GiB / 536 GiB avail 2024-08-18T22:43:07.565 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:07 smithi121 ceph-mon[16788]: from='mgr.14702 172.21.15.121:0/3084939281' entity='mgr.smithi121.lopxqc' 2024-08-18T22:43:07.565 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:07 smithi121 ceph-mon[16788]: from='mgr.14702 172.21.15.121:0/3084939281' entity='mgr.smithi121.lopxqc' 2024-08-18T22:43:07.659 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:07 smithi195 ceph-mon[23370]: pgmap v6: 65 pgs: 65 active+clean; 2.0 GiB data, 7.5 GiB used, 529 GiB / 536 GiB avail 2024-08-18T22:43:07.659 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:07 smithi195 ceph-mon[23370]: from='mgr.14702 172.21.15.121:0/3084939281' entity='mgr.smithi121.lopxqc' 2024-08-18T22:43:07.659 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:07 smithi195 ceph-mon[23370]: from='mgr.14702 172.21.15.121:0/3084939281' entity='mgr.smithi121.lopxqc' 2024-08-18T22:43:09.583 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:09 smithi121 ceph-mon[16788]: pgmap v7: 65 pgs: 65 active+clean; 2.0 GiB data, 7.5 GiB used, 529 GiB / 536 GiB avail; 29 KiB/s rd, 0 B/s wr, 16 op/s 2024-08-18T22:43:09.659 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:09 smithi195 ceph-mon[23370]: pgmap v7: 65 pgs: 65 active+clean; 2.0 GiB data, 7.5 GiB used, 529 GiB / 536 GiB avail; 29 KiB/s rd, 0 B/s wr, 16 op/s 2024-08-18T22:43:10.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:10 smithi195 ceph-mon[23370]: from='mgr.14702 172.21.15.121:0/3084939281' entity='mgr.smithi121.lopxqc' 2024-08-18T22:43:10.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:10 smithi195 ceph-mon[23370]: from='mgr.14702 172.21.15.121:0/3084939281' entity='mgr.smithi121.lopxqc' 2024-08-18T22:43:10.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:10 smithi195 ceph-mon[23370]: from='mgr.14702 172.21.15.121:0/3084939281' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:43:10.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:10 smithi195 ceph-mon[23370]: from='mgr.14702 172.21.15.121:0/3084939281' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-18T22:43:10.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:10 smithi195 ceph-mon[23370]: Updating smithi121:/etc/ceph/ceph.conf 2024-08-18T22:43:10.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:10 smithi195 ceph-mon[23370]: Updating smithi195:/etc/ceph/ceph.conf 2024-08-18T22:43:10.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:10 smithi195 ceph-mon[23370]: Updating smithi121:/var/lib/ceph/b003123a-5db1-11ef-bccf-c7b262605968/config/ceph.conf 2024-08-18T22:43:10.910 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:10 smithi195 ceph-mon[23370]: Updating smithi195:/var/lib/ceph/b003123a-5db1-11ef-bccf-c7b262605968/config/ceph.conf 2024-08-18T22:43:10.910 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:10 smithi195 ceph-mon[23370]: Updating smithi121:/etc/ceph/ceph.client.admin.keyring 2024-08-18T22:43:10.910 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:10 smithi195 ceph-mon[23370]: Updating smithi195:/etc/ceph/ceph.client.admin.keyring 2024-08-18T22:43:10.910 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:10 smithi195 ceph-mon[23370]: pgmap v8: 65 pgs: 65 active+clean; 2.0 GiB data, 7.5 GiB used, 529 GiB / 536 GiB avail; 23 KiB/s rd, 0 B/s wr, 12 op/s 2024-08-18T22:43:10.910 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:10 smithi195 ceph-mon[23370]: from='mgr.14702 172.21.15.121:0/3084939281' entity='mgr.smithi121.lopxqc' 2024-08-18T22:43:10.910 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:10 smithi195 ceph-mon[23370]: from='mgr.14702 172.21.15.121:0/3084939281' entity='mgr.smithi121.lopxqc' 2024-08-18T22:43:10.910 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:10 smithi195 ceph-mon[23370]: from='mgr.14702 172.21.15.121:0/3084939281' entity='mgr.smithi121.lopxqc' 2024-08-18T22:43:10.910 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:10 smithi195 ceph-mon[23370]: from='mgr.14702 172.21.15.121:0/3084939281' entity='mgr.smithi121.lopxqc' 2024-08-18T22:43:10.910 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:10 smithi195 ceph-mon[23370]: from='mgr.14702 172.21.15.121:0/3084939281' entity='mgr.smithi121.lopxqc' 2024-08-18T22:43:11.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:10 smithi121 ceph-mon[16788]: from='mgr.14702 172.21.15.121:0/3084939281' entity='mgr.smithi121.lopxqc' 2024-08-18T22:43:11.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:10 smithi121 ceph-mon[16788]: from='mgr.14702 172.21.15.121:0/3084939281' entity='mgr.smithi121.lopxqc' 2024-08-18T22:43:11.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:10 smithi121 ceph-mon[16788]: from='mgr.14702 172.21.15.121:0/3084939281' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:43:11.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:10 smithi121 ceph-mon[16788]: from='mgr.14702 172.21.15.121:0/3084939281' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-18T22:43:11.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:10 smithi121 ceph-mon[16788]: Updating smithi121:/etc/ceph/ceph.conf 2024-08-18T22:43:11.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:10 smithi121 ceph-mon[16788]: Updating smithi195:/etc/ceph/ceph.conf 2024-08-18T22:43:11.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:10 smithi121 ceph-mon[16788]: Updating smithi121:/var/lib/ceph/b003123a-5db1-11ef-bccf-c7b262605968/config/ceph.conf 2024-08-18T22:43:11.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:10 smithi121 ceph-mon[16788]: Updating smithi195:/var/lib/ceph/b003123a-5db1-11ef-bccf-c7b262605968/config/ceph.conf 2024-08-18T22:43:11.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:10 smithi121 ceph-mon[16788]: Updating smithi121:/etc/ceph/ceph.client.admin.keyring 2024-08-18T22:43:11.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:10 smithi121 ceph-mon[16788]: Updating smithi195:/etc/ceph/ceph.client.admin.keyring 2024-08-18T22:43:11.085 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:10 smithi121 ceph-mon[16788]: pgmap v8: 65 pgs: 65 active+clean; 2.0 GiB data, 7.5 GiB used, 529 GiB / 536 GiB avail; 23 KiB/s rd, 0 B/s wr, 12 op/s 2024-08-18T22:43:11.085 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:10 smithi121 ceph-mon[16788]: from='mgr.14702 172.21.15.121:0/3084939281' entity='mgr.smithi121.lopxqc' 2024-08-18T22:43:11.085 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:10 smithi121 ceph-mon[16788]: from='mgr.14702 172.21.15.121:0/3084939281' entity='mgr.smithi121.lopxqc' 2024-08-18T22:43:11.085 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:10 smithi121 ceph-mon[16788]: from='mgr.14702 172.21.15.121:0/3084939281' entity='mgr.smithi121.lopxqc' 2024-08-18T22:43:11.085 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:10 smithi121 ceph-mon[16788]: from='mgr.14702 172.21.15.121:0/3084939281' entity='mgr.smithi121.lopxqc' 2024-08-18T22:43:11.085 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:10 smithi121 ceph-mon[16788]: from='mgr.14702 172.21.15.121:0/3084939281' entity='mgr.smithi121.lopxqc' 2024-08-18T22:43:11.834 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:11 smithi121 ceph-mon[16788]: Updating smithi121:/var/lib/ceph/b003123a-5db1-11ef-bccf-c7b262605968/config/ceph.client.admin.keyring 2024-08-18T22:43:11.834 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:11 smithi121 ceph-mon[16788]: Updating smithi195:/var/lib/ceph/b003123a-5db1-11ef-bccf-c7b262605968/config/ceph.client.admin.keyring 2024-08-18T22:43:11.834 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:11 smithi121 ceph-mon[16788]: Reconfiguring prometheus.smithi121 (dependencies changed)... 2024-08-18T22:43:11.834 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:11 smithi121 ceph-mon[16788]: Reconfiguring daemon prometheus.smithi121 on smithi121 2024-08-18T22:43:11.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:11 smithi195 ceph-mon[23370]: Updating smithi121:/var/lib/ceph/b003123a-5db1-11ef-bccf-c7b262605968/config/ceph.client.admin.keyring 2024-08-18T22:43:11.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:11 smithi195 ceph-mon[23370]: Updating smithi195:/var/lib/ceph/b003123a-5db1-11ef-bccf-c7b262605968/config/ceph.client.admin.keyring 2024-08-18T22:43:11.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:11 smithi195 ceph-mon[23370]: Reconfiguring prometheus.smithi121 (dependencies changed)... 2024-08-18T22:43:11.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:11 smithi195 ceph-mon[23370]: Reconfiguring daemon prometheus.smithi121 on smithi121 2024-08-18T22:43:12.833 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:12 smithi121 ceph-mon[16788]: pgmap v9: 65 pgs: 65 active+clean; 2.0 GiB data, 7.5 GiB used, 529 GiB / 536 GiB avail; 19 KiB/s rd, 0 B/s wr, 10 op/s 2024-08-18T22:43:12.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:12 smithi195 ceph-mon[23370]: pgmap v9: 65 pgs: 65 active+clean; 2.0 GiB data, 7.5 GiB used, 529 GiB / 536 GiB avail; 19 KiB/s rd, 0 B/s wr, 10 op/s 2024-08-18T22:43:14.333 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:14 smithi121 ceph-mon[16788]: pgmap v10: 65 pgs: 65 active+clean; 2.0 GiB data, 7.5 GiB used, 529 GiB / 536 GiB avail; 17 KiB/s rd, 0 B/s wr, 9 op/s 2024-08-18T22:43:14.659 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:14 smithi195 ceph-mon[23370]: pgmap v10: 65 pgs: 65 active+clean; 2.0 GiB data, 7.5 GiB used, 529 GiB / 536 GiB avail; 17 KiB/s rd, 0 B/s wr, 9 op/s 2024-08-18T22:43:16.834 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:16 smithi121 ceph-mon[16788]: from='mgr.14702 172.21.15.121:0/3084939281' entity='mgr.smithi121.lopxqc' 2024-08-18T22:43:16.834 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:16 smithi121 ceph-mon[16788]: from='mgr.14702 172.21.15.121:0/3084939281' entity='mgr.smithi121.lopxqc' 2024-08-18T22:43:16.834 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:16 smithi121 ceph-mon[16788]: from='mgr.14702 172.21.15.121:0/3084939281' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-08-18T22:43:16.834 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:16 smithi121 ceph-mon[16788]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-08-18T22:43:16.834 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:16 smithi121 ceph-mon[16788]: from='mgr.14702 172.21.15.121:0/3084939281' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi121:9095"}]: dispatch 2024-08-18T22:43:16.834 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:16 smithi121 ceph-mon[16788]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi121:9095"}]: dispatch 2024-08-18T22:43:16.834 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:16 smithi121 ceph-mon[16788]: from='mgr.14702 172.21.15.121:0/3084939281' entity='mgr.smithi121.lopxqc' 2024-08-18T22:43:16.834 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:16 smithi121 ceph-mon[16788]: from='mgr.14702 172.21.15.121:0/3084939281' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-18T22:43:16.834 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:16 smithi121 ceph-mon[16788]: from='mgr.14702 172.21.15.121:0/3084939281' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-18T22:43:16.834 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:16 smithi121 ceph-mon[16788]: pgmap v11: 65 pgs: 65 active+clean; 2.0 GiB data, 7.5 GiB used, 529 GiB / 536 GiB avail; 17 KiB/s rd, 0 B/s wr, 9 op/s 2024-08-18T22:43:16.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:16 smithi195 ceph-mon[23370]: from='mgr.14702 172.21.15.121:0/3084939281' entity='mgr.smithi121.lopxqc' 2024-08-18T22:43:16.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:16 smithi195 ceph-mon[23370]: from='mgr.14702 172.21.15.121:0/3084939281' entity='mgr.smithi121.lopxqc' 2024-08-18T22:43:16.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:16 smithi195 ceph-mon[23370]: from='mgr.14702 172.21.15.121:0/3084939281' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-08-18T22:43:16.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:16 smithi195 ceph-mon[23370]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-08-18T22:43:16.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:16 smithi195 ceph-mon[23370]: from='mgr.14702 172.21.15.121:0/3084939281' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi121:9095"}]: dispatch 2024-08-18T22:43:16.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:16 smithi195 ceph-mon[23370]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi121:9095"}]: dispatch 2024-08-18T22:43:16.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:16 smithi195 ceph-mon[23370]: from='mgr.14702 172.21.15.121:0/3084939281' entity='mgr.smithi121.lopxqc' 2024-08-18T22:43:16.910 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:16 smithi195 ceph-mon[23370]: from='mgr.14702 172.21.15.121:0/3084939281' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-18T22:43:16.910 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:16 smithi195 ceph-mon[23370]: from='mgr.14702 172.21.15.121:0/3084939281' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-18T22:43:16.910 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:16 smithi195 ceph-mon[23370]: pgmap v11: 65 pgs: 65 active+clean; 2.0 GiB data, 7.5 GiB used, 529 GiB / 536 GiB avail; 17 KiB/s rd, 0 B/s wr, 9 op/s 2024-08-18T22:43:17.466 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:17.463+0000 7f1becf4f640 1 -- 172.21.15.121:0/1531923628 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1be80fd5c0 msgr2=0x7f1be80fda30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:43:17.467 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:17.463+0000 7f1becf4f640 1 --2- 172.21.15.121:0/1531923628 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1be80fd5c0 0x7f1be80fda30 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f1bd00048d0 tx=0x7f1bd0009da0 comp rx=0 tx=0).stop 2024-08-18T22:43:17.467 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:17.463+0000 7f1becf4f640 1 -- 172.21.15.121:0/1531923628 shutdown_connections 2024-08-18T22:43:17.467 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:17.463+0000 7f1becf4f640 1 --2- 172.21.15.121:0/1531923628 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1be80fd5c0 0x7f1be80fda30 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:43:17.467 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:17.463+0000 7f1becf4f640 1 --2- 172.21.15.121:0/1531923628 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1be80fc2f0 0x7f1be80fc700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:43:17.467 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:17.463+0000 7f1becf4f640 1 -- 172.21.15.121:0/1531923628 >> 172.21.15.121:0/1531923628 conn(0x7f1be80f7ad0 msgr2=0x7f1be80f9ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:43:17.467 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:17.463+0000 7f1becf4f640 1 -- 172.21.15.121:0/1531923628 shutdown_connections 2024-08-18T22:43:17.467 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:17.464+0000 7f1becf4f640 1 -- 172.21.15.121:0/1531923628 wait complete. 2024-08-18T22:43:17.467 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:17.464+0000 7f1becf4f640 1 Processor -- start 2024-08-18T22:43:17.468 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:17.464+0000 7f1becf4f640 1 -- start start 2024-08-18T22:43:17.468 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:17.464+0000 7f1becf4f640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1be80fc2f0 0x7f1be810cee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:43:17.468 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:17.464+0000 7f1becf4f640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1be80fd5c0 0x7f1be810d420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:43:17.468 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:17.464+0000 7f1becf4f640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1be810e150 con 0x7f1be80fc2f0 2024-08-18T22:43:17.468 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:17.464+0000 7f1becf4f640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1be810e2c0 con 0x7f1be80fd5c0 2024-08-18T22:43:17.468 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:17.465+0000 7f1be659c640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1be80fc2f0 0x7f1be810cee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:43:17.468 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:17.465+0000 7f1be659c640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1be80fc2f0 0x7f1be810cee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:48990/0 (socket says 172.21.15.121:48990) 2024-08-18T22:43:17.468 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:17.465+0000 7f1be659c640 1 -- 172.21.15.121:0/2007144983 learned_addr learned my addr 172.21.15.121:0/2007144983 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-18T22:43:17.468 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:17.465+0000 7f1bdffff640 1 --2- 172.21.15.121:0/2007144983 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1be80fd5c0 0x7f1be810d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:43:17.468 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:17.465+0000 7f1be659c640 1 -- 172.21.15.121:0/2007144983 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1be80fd5c0 msgr2=0x7f1be810d420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:43:17.468 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:17.465+0000 7f1be659c640 1 --2- 172.21.15.121:0/2007144983 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1be80fd5c0 0x7f1be810d420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:43:17.468 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:17.465+0000 7f1be659c640 1 -- 172.21.15.121:0/2007144983 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bd0005040 con 0x7f1be80fc2f0 2024-08-18T22:43:17.468 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:17.465+0000 7f1be659c640 1 --2- 172.21.15.121:0/2007144983 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1be80fc2f0 0x7f1be810cee0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f1bd8002a50 tx=0x7f1bd8004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:43:17.468 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:17.465+0000 7f1bdeffd640 1 -- 172.21.15.121:0/2007144983 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1bd8007c30 con 0x7f1be80fc2f0 2024-08-18T22:43:17.469 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:17.465+0000 7f1becf4f640 1 -- 172.21.15.121:0/2007144983 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1be810e5a0 con 0x7f1be80fc2f0 2024-08-18T22:43:17.469 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:17.465+0000 7f1bdeffd640 1 -- 172.21.15.121:0/2007144983 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f1bd800f040 con 0x7f1be80fc2f0 2024-08-18T22:43:17.469 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:17.465+0000 7f1bdeffd640 1 -- 172.21.15.121:0/2007144983 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1bd800da10 con 0x7f1be80fc2f0 2024-08-18T22:43:17.469 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:17.465+0000 7f1becf4f640 1 -- 172.21.15.121:0/2007144983 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1be810eb40 con 0x7f1be80fc2f0 2024-08-18T22:43:17.470 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:17.466+0000 7f1becf4f640 1 -- 172.21.15.121:0/2007144983 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1be8105520 con 0x7f1be80fc2f0 2024-08-18T22:43:17.470 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:17.467+0000 7f1bdeffd640 1 -- 172.21.15.121:0/2007144983 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 30) v1 ==== 92029+0+0 (secure 0 0 0) 0x7f1bd800dc80 con 0x7f1be80fc2f0 2024-08-18T22:43:17.470 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:17.467+0000 7f1bdeffd640 1 --2- 172.21.15.121:0/2007144983 >> [v2:172.21.15.121:6800/1096247887,v1:172.21.15.121:6801/1096247887] conn(0x7f1bd406dae0 0x7f1bd406ff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:43:17.470 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:17.467+0000 7f1bdeffd640 1 -- 172.21.15.121:0/2007144983 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6152+0+0 (secure 0 0 0) 0x7f1bd808cc70 con 0x7f1be80fc2f0 2024-08-18T22:43:17.470 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:17.467+0000 7f1bdffff640 1 --2- 172.21.15.121:0/2007144983 >> [v2:172.21.15.121:6800/1096247887,v1:172.21.15.121:6801/1096247887] conn(0x7f1bd406dae0 0x7f1bd406ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:43:17.470 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:17.468+0000 7f1bdffff640 1 --2- 172.21.15.121:0/2007144983 >> [v2:172.21.15.121:6800/1096247887,v1:172.21.15.121:6801/1096247887] conn(0x7f1bd406dae0 0x7f1bd406ff90 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f1be810cc90 tx=0x7f1bd0035040 comp rx=0 tx=0).ready entity=mgr.14702 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:43:17.473 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:17.472+0000 7f1bdeffd640 1 -- 172.21.15.121:0/2007144983 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7f1bd8056680 con 0x7f1be80fc2f0 2024-08-18T22:43:17.654 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:17.653+0000 7f1becf4f640 1 -- 172.21.15.121:0/2007144983 --> [v2:172.21.15.121:6800/1096247887,v1:172.21.15.121:6801/1096247887] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f1be810ed60 con 0x7f1bd406dae0 2024-08-18T22:43:17.655 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:17.654+0000 7f1bdeffd640 1 -- 172.21.15.121:0/2007144983 <== mgr.14702 v2:172.21.15.121:6800/1096247887 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+368 (secure 0 0 0) 0x7f1be810ed60 con 0x7f1bd406dae0 2024-08-18T22:43:17.657 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:17.656+0000 7f1becf4f640 1 -- 172.21.15.121:0/2007144983 >> [v2:172.21.15.121:6800/1096247887,v1:172.21.15.121:6801/1096247887] conn(0x7f1bd406dae0 msgr2=0x7f1bd406ff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:43:17.657 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:17.656+0000 7f1becf4f640 1 --2- 172.21.15.121:0/2007144983 >> [v2:172.21.15.121:6800/1096247887,v1:172.21.15.121:6801/1096247887] conn(0x7f1bd406dae0 0x7f1bd406ff90 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f1be810cc90 tx=0x7f1bd0035040 comp rx=0 tx=0).stop 2024-08-18T22:43:17.657 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:17.656+0000 7f1becf4f640 1 -- 172.21.15.121:0/2007144983 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1be80fc2f0 msgr2=0x7f1be810cee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:43:17.657 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:17.656+0000 7f1becf4f640 1 --2- 172.21.15.121:0/2007144983 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1be80fc2f0 0x7f1be810cee0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f1bd8002a50 tx=0x7f1bd8004600 comp rx=0 tx=0).stop 2024-08-18T22:43:17.657 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:17.656+0000 7f1becf4f640 1 -- 172.21.15.121:0/2007144983 shutdown_connections 2024-08-18T22:43:17.657 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:17.656+0000 7f1becf4f640 1 --2- 172.21.15.121:0/2007144983 >> [v2:172.21.15.121:6800/1096247887,v1:172.21.15.121:6801/1096247887] conn(0x7f1bd406dae0 0x7f1bd406ff90 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:43:17.658 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:17.656+0000 7f1becf4f640 1 --2- 172.21.15.121:0/2007144983 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1be80fd5c0 0x7f1be810d420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:43:17.658 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:17.656+0000 7f1becf4f640 1 --2- 172.21.15.121:0/2007144983 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1be80fc2f0 0x7f1be810cee0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:43:17.658 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:17.656+0000 7f1becf4f640 1 -- 172.21.15.121:0/2007144983 >> 172.21.15.121:0/2007144983 conn(0x7f1be80f7ad0 msgr2=0x7f1be80f9240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:43:17.658 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:17.656+0000 7f1becf4f640 1 -- 172.21.15.121:0/2007144983 shutdown_connections 2024-08-18T22:43:17.658 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:17.656+0000 7f1becf4f640 1 -- 172.21.15.121:0/2007144983 wait complete. 2024-08-18T22:43:17.658 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:17 smithi195 ceph-mon[23370]: Upgrade: Updating mgr.smithi195.acttsj 2024-08-18T22:43:17.658 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:17 smithi195 ceph-mon[23370]: from='mgr.14702 172.21.15.121:0/3084939281' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi195.acttsj", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-08-18T22:43:17.659 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:17 smithi195 ceph-mon[23370]: from='mgr.14702 172.21.15.121:0/3084939281' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "mgr services"}]: dispatch 2024-08-18T22:43:17.659 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:17 smithi195 ceph-mon[23370]: from='mgr.14702 172.21.15.121:0/3084939281' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:43:17.659 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:17 smithi195 ceph-mon[23370]: Deploying daemon mgr.smithi195.acttsj on smithi195 2024-08-18T22:43:17.665 INFO:teuthology.orchestra.run.smithi121.stdout:true 2024-08-18T22:43:17.735 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:17.734+0000 7fa4737aa640 1 -- 172.21.15.121:0/4226188873 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa46c0fc4a0 msgr2=0x7fa46c0fc910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:43:17.736 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:17.734+0000 7fa4737aa640 1 --2- 172.21.15.121:0/4226188873 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa46c0fc4a0 0x7fa46c0fc910 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fa4600048d0 tx=0x7fa460009da0 comp rx=0 tx=0).stop 2024-08-18T22:43:17.736 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:17.734+0000 7fa4737aa640 1 -- 172.21.15.121:0/4226188873 shutdown_connections 2024-08-18T22:43:17.736 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:17.734+0000 7fa4737aa640 1 --2- 172.21.15.121:0/4226188873 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa46c0fc4a0 0x7fa46c0fc910 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:43:17.736 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:17.734+0000 7fa4737aa640 1 --2- 172.21.15.121:0/4226188873 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa46c0fb1d0 0x7fa46c0fb5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:43:17.736 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:17.734+0000 7fa4737aa640 1 -- 172.21.15.121:0/4226188873 >> 172.21.15.121:0/4226188873 conn(0x7fa46c0f69b0 msgr2=0x7fa46c0f8dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:43:17.736 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:17 smithi121 ceph-mon[16788]: Upgrade: Updating mgr.smithi195.acttsj 2024-08-18T22:43:17.736 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:17 smithi121 ceph-mon[16788]: from='mgr.14702 172.21.15.121:0/3084939281' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi195.acttsj", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-08-18T22:43:17.736 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:17 smithi121 ceph-mon[16788]: from='mgr.14702 172.21.15.121:0/3084939281' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "mgr services"}]: dispatch 2024-08-18T22:43:17.736 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:17 smithi121 ceph-mon[16788]: from='mgr.14702 172.21.15.121:0/3084939281' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:43:17.736 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:17 smithi121 ceph-mon[16788]: Deploying daemon mgr.smithi195.acttsj on smithi195 2024-08-18T22:43:17.738 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:17.735+0000 7fa4737aa640 1 -- 172.21.15.121:0/4226188873 shutdown_connections 2024-08-18T22:43:17.738 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:17.735+0000 7fa4737aa640 1 -- 172.21.15.121:0/4226188873 wait complete. 2024-08-18T22:43:17.738 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:17.735+0000 7fa4737aa640 1 Processor -- start 2024-08-18T22:43:17.738 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:17.735+0000 7fa4737aa640 1 -- start start 2024-08-18T22:43:17.738 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:17.736+0000 7fa4737aa640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa46c0fb1d0 0x7fa46c10ce90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:43:17.738 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:17.736+0000 7fa4737aa640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa46c0fc4a0 0x7fa46c10d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:43:17.738 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:17.736+0000 7fa4737aa640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa46c10da20 con 0x7fa46c0fc4a0 2024-08-18T22:43:17.738 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:17.736+0000 7fa4737aa640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa46c10e160 con 0x7fa46c0fb1d0 2024-08-18T22:43:17.739 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:17.736+0000 7fa470d45640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa46c0fc4a0 0x7fa46c10d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:43:17.739 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:17.736+0000 7fa470d45640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa46c0fc4a0 0x7fa46c10d3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:49010/0 (socket says 172.21.15.121:49010) 2024-08-18T22:43:17.739 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:17.736+0000 7fa470d45640 1 -- 172.21.15.121:0/3663928224 learned_addr learned my addr 172.21.15.121:0/3663928224 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-18T22:43:17.739 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:17.736+0000 7fa471546640 1 --2- 172.21.15.121:0/3663928224 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa46c0fb1d0 0x7fa46c10ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:43:17.739 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:17.736+0000 7fa470d45640 1 -- 172.21.15.121:0/3663928224 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa46c0fb1d0 msgr2=0x7fa46c10ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:43:17.739 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:17.736+0000 7fa470d45640 1 --2- 172.21.15.121:0/3663928224 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa46c0fb1d0 0x7fa46c10ce90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:43:17.739 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:17.736+0000 7fa470d45640 1 -- 172.21.15.121:0/3663928224 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa460005040 con 0x7fa46c0fc4a0 2024-08-18T22:43:17.739 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:17.736+0000 7fa470d45640 1 --2- 172.21.15.121:0/3663928224 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa46c0fc4a0 0x7fa46c10d3d0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fa4600043d0 tx=0x7fa460009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:43:17.739 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:17.737+0000 7fa45dffb640 1 -- 172.21.15.121:0/3663928224 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa460038070 con 0x7fa46c0fc4a0 2024-08-18T22:43:17.739 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:17.737+0000 7fa45dffb640 1 -- 172.21.15.121:0/3663928224 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fa46002ae90 con 0x7fa46c0fc4a0 2024-08-18T22:43:17.739 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:17.737+0000 7fa4737aa640 1 -- 172.21.15.121:0/3663928224 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa46c10e390 con 0x7fa46c0fc4a0 2024-08-18T22:43:17.739 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:17.737+0000 7fa45dffb640 1 -- 172.21.15.121:0/3663928224 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa46003e670 con 0x7fa46c0fc4a0 2024-08-18T22:43:17.739 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:17.737+0000 7fa4737aa640 1 -- 172.21.15.121:0/3663928224 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa46c10e930 con 0x7fa46c0fc4a0 2024-08-18T22:43:17.740 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:17.738+0000 7fa4737aa640 1 -- 172.21.15.121:0/3663928224 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa46c0fa630 con 0x7fa46c0fc4a0 2024-08-18T22:43:17.740 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:17.738+0000 7fa45dffb640 1 -- 172.21.15.121:0/3663928224 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 30) v1 ==== 92029+0+0 (secure 0 0 0) 0x7fa460030020 con 0x7fa46c0fc4a0 2024-08-18T22:43:17.740 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:17.739+0000 7fa45dffb640 1 --2- 172.21.15.121:0/3663928224 >> [v2:172.21.15.121:6800/1096247887,v1:172.21.15.121:6801/1096247887] conn(0x7fa45806dae0 0x7fa45806ff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:43:17.741 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:17.739+0000 7fa45dffb640 1 -- 172.21.15.121:0/3663928224 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6152+0+0 (secure 0 0 0) 0x7fa4600ad4b0 con 0x7fa46c0fc4a0 2024-08-18T22:43:17.741 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:17.739+0000 7fa471546640 1 --2- 172.21.15.121:0/3663928224 >> [v2:172.21.15.121:6800/1096247887,v1:172.21.15.121:6801/1096247887] conn(0x7fa45806dae0 0x7fa45806ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:43:17.741 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:17.740+0000 7fa471546640 1 --2- 172.21.15.121:0/3663928224 >> [v2:172.21.15.121:6800/1096247887,v1:172.21.15.121:6801/1096247887] conn(0x7fa45806dae0 0x7fa45806ff90 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fa46c10cc20 tx=0x7fa46800b040 comp rx=0 tx=0).ready entity=mgr.14702 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:43:17.744 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:17.743+0000 7fa45dffb640 1 -- 172.21.15.121:0/3663928224 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7fa460077050 con 0x7fa46c0fc4a0 2024-08-18T22:43:17.927 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:17.926+0000 7fa4737aa640 1 -- 172.21.15.121:0/3663928224 --> [v2:172.21.15.121:6800/1096247887,v1:172.21.15.121:6801/1096247887] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fa46c10edd0 con 0x7fa45806dae0 2024-08-18T22:43:17.928 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:17.927+0000 7fa45dffb640 1 -- 172.21.15.121:0/3663928224 <== mgr.14702 v2:172.21.15.121:6800/1096247887 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+368 (secure 0 0 0) 0x7fa46c10edd0 con 0x7fa45806dae0 2024-08-18T22:43:17.930 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:17.929+0000 7fa4737aa640 1 -- 172.21.15.121:0/3663928224 >> [v2:172.21.15.121:6800/1096247887,v1:172.21.15.121:6801/1096247887] conn(0x7fa45806dae0 msgr2=0x7fa45806ff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:43:17.930 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:17.929+0000 7fa4737aa640 1 --2- 172.21.15.121:0/3663928224 >> [v2:172.21.15.121:6800/1096247887,v1:172.21.15.121:6801/1096247887] conn(0x7fa45806dae0 0x7fa45806ff90 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fa46c10cc20 tx=0x7fa46800b040 comp rx=0 tx=0).stop 2024-08-18T22:43:17.930 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:17.929+0000 7fa4737aa640 1 -- 172.21.15.121:0/3663928224 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa46c0fc4a0 msgr2=0x7fa46c10d3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:43:17.931 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:17.929+0000 7fa4737aa640 1 --2- 172.21.15.121:0/3663928224 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa46c0fc4a0 0x7fa46c10d3d0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fa4600043d0 tx=0x7fa460009da0 comp rx=0 tx=0).stop 2024-08-18T22:43:17.931 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:17.929+0000 7fa4737aa640 1 -- 172.21.15.121:0/3663928224 shutdown_connections 2024-08-18T22:43:17.931 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:17.929+0000 7fa4737aa640 1 --2- 172.21.15.121:0/3663928224 >> [v2:172.21.15.121:6800/1096247887,v1:172.21.15.121:6801/1096247887] conn(0x7fa45806dae0 0x7fa45806ff90 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:43:17.931 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:17.929+0000 7fa4737aa640 1 --2- 172.21.15.121:0/3663928224 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa46c0fc4a0 0x7fa46c10d3d0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:43:17.931 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:17.929+0000 7fa4737aa640 1 --2- 172.21.15.121:0/3663928224 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa46c0fb1d0 0x7fa46c10ce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:43:17.931 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:17.929+0000 7fa4737aa640 1 -- 172.21.15.121:0/3663928224 >> 172.21.15.121:0/3663928224 conn(0x7fa46c0f69b0 msgr2=0x7fa46c0f8190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:43:17.931 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:17.929+0000 7fa4737aa640 1 -- 172.21.15.121:0/3663928224 shutdown_connections 2024-08-18T22:43:17.931 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:17.929+0000 7fa4737aa640 1 -- 172.21.15.121:0/3663928224 wait complete. 2024-08-18T22:43:18.009 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:18.006+0000 7fa9d7f95640 1 -- 172.21.15.121:0/739004120 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa9d00fb1d0 msgr2=0x7fa9d00fb5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:43:18.009 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:18.006+0000 7fa9d7f95640 1 --2- 172.21.15.121:0/739004120 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa9d00fb1d0 0x7fa9d00fb5e0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fa9cc0048d0 tx=0x7fa9cc009da0 comp rx=0 tx=0).stop 2024-08-18T22:43:18.009 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:18.007+0000 7fa9d7f95640 1 -- 172.21.15.121:0/739004120 shutdown_connections 2024-08-18T22:43:18.009 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:18.007+0000 7fa9d7f95640 1 --2- 172.21.15.121:0/739004120 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa9d00fc4a0 0x7fa9d00fc910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:43:18.010 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:18.007+0000 7fa9d7f95640 1 --2- 172.21.15.121:0/739004120 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa9d00fb1d0 0x7fa9d00fb5e0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:43:18.010 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:18.007+0000 7fa9d7f95640 1 -- 172.21.15.121:0/739004120 >> 172.21.15.121:0/739004120 conn(0x7fa9d00f69b0 msgr2=0x7fa9d00f8dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:43:18.010 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:18.007+0000 7fa9d7f95640 1 -- 172.21.15.121:0/739004120 shutdown_connections 2024-08-18T22:43:18.010 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:18.007+0000 7fa9d7f95640 1 -- 172.21.15.121:0/739004120 wait complete. 2024-08-18T22:43:18.010 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:18.007+0000 7fa9d7f95640 1 Processor -- start 2024-08-18T22:43:18.010 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:18.007+0000 7fa9d7f95640 1 -- start start 2024-08-18T22:43:18.010 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:18.007+0000 7fa9d7f95640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa9d00fb1d0 0x7fa9d010be10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:43:18.010 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:18.007+0000 7fa9d7f95640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa9d00fc4a0 0x7fa9d010c350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:43:18.010 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:18.007+0000 7fa9d7f95640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9d010c9d0 con 0x7fa9d00fc4a0 2024-08-18T22:43:18.010 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:18.007+0000 7fa9d7f95640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9d010d0f0 con 0x7fa9d00fb1d0 2024-08-18T22:43:18.010 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:18.007+0000 7fa9d5530640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa9d00fc4a0 0x7fa9d010c350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:43:18.010 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:18.008+0000 7fa9d5530640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa9d00fc4a0 0x7fa9d010c350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:49026/0 (socket says 172.21.15.121:49026) 2024-08-18T22:43:18.011 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:18.008+0000 7fa9d5530640 1 -- 172.21.15.121:0/1326248296 learned_addr learned my addr 172.21.15.121:0/1326248296 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-18T22:43:18.011 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:18.008+0000 7fa9d5d31640 1 --2- 172.21.15.121:0/1326248296 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa9d00fb1d0 0x7fa9d010be10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:43:18.011 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:18.008+0000 7fa9d5530640 1 -- 172.21.15.121:0/1326248296 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa9d00fb1d0 msgr2=0x7fa9d010be10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:43:18.011 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:18.008+0000 7fa9d5530640 1 --2- 172.21.15.121:0/1326248296 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa9d00fb1d0 0x7fa9d010be10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:43:18.011 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:18.008+0000 7fa9d5530640 1 -- 172.21.15.121:0/1326248296 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9cc005040 con 0x7fa9d00fc4a0 2024-08-18T22:43:18.011 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:18.008+0000 7fa9d5530640 1 --2- 172.21.15.121:0/1326248296 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa9d00fc4a0 0x7fa9d010c350 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fa9c000b790 tx=0x7fa9c00091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:43:18.011 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:18.008+0000 7fa9c67fc640 1 -- 172.21.15.121:0/1326248296 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa9c000c700 con 0x7fa9d00fc4a0 2024-08-18T22:43:18.011 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:18.008+0000 7fa9d7f95640 1 -- 172.21.15.121:0/1326248296 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9d010d3d0 con 0x7fa9d00fc4a0 2024-08-18T22:43:18.011 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:18.008+0000 7fa9c67fc640 1 -- 172.21.15.121:0/1326248296 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fa9c000cd00 con 0x7fa9d00fc4a0 2024-08-18T22:43:18.011 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:18.008+0000 7fa9c67fc640 1 -- 172.21.15.121:0/1326248296 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa9c0015e70 con 0x7fa9d00fc4a0 2024-08-18T22:43:18.011 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:18.008+0000 7fa9d7f95640 1 -- 172.21.15.121:0/1326248296 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9d010d8f0 con 0x7fa9d00fc4a0 2024-08-18T22:43:18.012 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:18.009+0000 7fa9d7f95640 1 -- 172.21.15.121:0/1326248296 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9d01055e0 con 0x7fa9d00fc4a0 2024-08-18T22:43:18.012 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:18.010+0000 7fa9c67fc640 1 -- 172.21.15.121:0/1326248296 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 30) v1 ==== 92029+0+0 (secure 0 0 0) 0x7fa9c0012070 con 0x7fa9d00fc4a0 2024-08-18T22:43:18.012 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:18.010+0000 7fa9c67fc640 1 --2- 172.21.15.121:0/1326248296 >> [v2:172.21.15.121:6800/1096247887,v1:172.21.15.121:6801/1096247887] conn(0x7fa9bc06dae0 0x7fa9bc06ff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:43:18.012 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:18.010+0000 7fa9c67fc640 1 -- 172.21.15.121:0/1326248296 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6152+0+0 (secure 0 0 0) 0x7fa9c008cf60 con 0x7fa9d00fc4a0 2024-08-18T22:43:18.013 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:18.010+0000 7fa9d5d31640 1 --2- 172.21.15.121:0/1326248296 >> [v2:172.21.15.121:6800/1096247887,v1:172.21.15.121:6801/1096247887] conn(0x7fa9bc06dae0 0x7fa9bc06ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:43:18.013 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:18.011+0000 7fa9d5d31640 1 --2- 172.21.15.121:0/1326248296 >> [v2:172.21.15.121:6800/1096247887,v1:172.21.15.121:6801/1096247887] conn(0x7fa9bc06dae0 0x7fa9bc06ff90 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fa9cc007ac0 tx=0x7fa9cc009da0 comp rx=0 tx=0).ready entity=mgr.14702 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:43:18.015 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:18.015+0000 7fa9c67fc640 1 -- 172.21.15.121:0/1326248296 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7fa9c00c1670 con 0x7fa9d00fc4a0 2024-08-18T22:43:18.188 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:18.187+0000 7fa9d7f95640 1 -- 172.21.15.121:0/1326248296 --> [v2:172.21.15.121:6800/1096247887,v1:172.21.15.121:6801/1096247887] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fa9d010dcd0 con 0x7fa9bc06dae0 2024-08-18T22:43:18.196 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:18.195+0000 7fa9c67fc640 1 -- 172.21.15.121:0/1326248296 <== mgr.14702 v2:172.21.15.121:6800/1096247887 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7fa9d010dcd0 con 0x7fa9bc06dae0 2024-08-18T22:43:18.197 INFO:teuthology.orchestra.run.smithi121.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-08-18T22:43:18.197 INFO:teuthology.orchestra.run.smithi121.stdout:alertmanager.smithi121 smithi121 *:9093,9094 running (65s) 12s ago 9m 15.5M - 0.25.0 c8568f914cd2 c421c5e6a02b 2024-08-18T22:43:18.197 INFO:teuthology.orchestra.run.smithi121.stdout:crash.smithi121 smithi121 running (9m) 12s ago 9m 6899k - 17.2.7-1406-gdf62bdcc 774894bef55f cf3deea293c3 2024-08-18T22:43:18.197 INFO:teuthology.orchestra.run.smithi121.stdout:crash.smithi195 smithi195 running (8m) 14s ago 8m 6899k - 17.2.7-1406-gdf62bdcc 774894bef55f 98aa377daf77 2024-08-18T22:43:18.197 INFO:teuthology.orchestra.run.smithi121.stdout:grafana.smithi121 smithi121 *:3000 running (60s) 12s ago 8m 80.3M - 9.4.7 954c08fa6188 091a5fd17e8a 2024-08-18T22:43:18.197 INFO:teuthology.orchestra.run.smithi121.stdout:mds.cephfs.smithi121.gbickb smithi121 running (4m) 12s ago 4m 156M - 17.2.7-1406-gdf62bdcc 774894bef55f 484da0bc2c95 2024-08-18T22:43:18.197 INFO:teuthology.orchestra.run.smithi121.stdout:mds.cephfs.smithi121.xuzsdg smithi121 running (4m) 12s ago 4m 12.5M - 17.2.7-1406-gdf62bdcc 774894bef55f 6976b708cdcd 2024-08-18T22:43:18.197 INFO:teuthology.orchestra.run.smithi121.stdout:mds.cephfs.smithi195.buqvbr smithi195 running (4m) 14s ago 4m 116M - 17.2.7-1406-gdf62bdcc 774894bef55f 11a3703b4276 2024-08-18T22:43:18.197 INFO:teuthology.orchestra.run.smithi121.stdout:mds.cephfs.smithi195.nptgyc smithi195 running (4m) 14s ago 4m 16.7M - 17.2.7-1406-gdf62bdcc 774894bef55f b9f8043ea83e 2024-08-18T22:43:18.197 INFO:teuthology.orchestra.run.smithi121.stdout:mgr.smithi121.lopxqc smithi121 *:8443,9283,8765 running (34s) 12s ago 10m 475M - 19.1.0-1382-gde09dd01 ea7a5189f30b 9079701e6516 2024-08-18T22:43:18.198 INFO:teuthology.orchestra.run.smithi121.stdout:mgr.smithi195.acttsj smithi195 *:8443,9283 running (2m) 14s ago 8m 106M - 19.1.0-1382-gde09dd01 ea7a5189f30b eaf531f5f439 2024-08-18T22:43:18.198 INFO:teuthology.orchestra.run.smithi121.stdout:mon.smithi121 smithi121 running (10m) 12s ago 10m 53.4M 2048M 17.2.7-1406-gdf62bdcc 774894bef55f 4a7bead235ac 2024-08-18T22:43:18.198 INFO:teuthology.orchestra.run.smithi121.stdout:mon.smithi195 smithi195 running (8m) 14s ago 8m 42.5M 2048M 17.2.7-1406-gdf62bdcc 774894bef55f ced63ecfbfae 2024-08-18T22:43:18.198 INFO:teuthology.orchestra.run.smithi121.stdout:node-exporter.smithi121 smithi121 *:9100 running (71s) 12s ago 9m 8795k - 1.5.0 0da6a335fe13 bc4b5355a507 2024-08-18T22:43:18.198 INFO:teuthology.orchestra.run.smithi121.stdout:node-exporter.smithi195 smithi195 *:9100 running (43s) 14s ago 8m 15.9M - 1.5.0 0da6a335fe13 146efcb79663 2024-08-18T22:43:18.198 INFO:teuthology.orchestra.run.smithi121.stdout:osd.0 smithi121 running (7m) 12s ago 7m 192M 1557M 17.2.7-1406-gdf62bdcc 774894bef55f 30859216633d 2024-08-18T22:43:18.198 INFO:teuthology.orchestra.run.smithi121.stdout:osd.1 smithi121 running (7m) 12s ago 7m 221M 1557M 17.2.7-1406-gdf62bdcc 774894bef55f ef5fadfd753f 2024-08-18T22:43:18.198 INFO:teuthology.orchestra.run.smithi121.stdout:osd.2 smithi121 running (6m) 12s ago 6m 181M 1557M 17.2.7-1406-gdf62bdcc 774894bef55f 3fa061e41f99 2024-08-18T22:43:18.198 INFO:teuthology.orchestra.run.smithi121.stdout:osd.3 smithi195 running (6m) 14s ago 6m 238M 2581M 17.2.7-1406-gdf62bdcc 774894bef55f 15d30b1b459e 2024-08-18T22:43:18.198 INFO:teuthology.orchestra.run.smithi121.stdout:osd.4 smithi195 running (5m) 14s ago 5m 207M 2581M 17.2.7-1406-gdf62bdcc 774894bef55f 99ed156dfd36 2024-08-18T22:43:18.198 INFO:teuthology.orchestra.run.smithi121.stdout:osd.5 smithi195 running (5m) 14s ago 5m 213M 2581M 17.2.7-1406-gdf62bdcc 774894bef55f e7eff7bdb752 2024-08-18T22:43:18.198 INFO:teuthology.orchestra.run.smithi121.stdout:prometheus.smithi121 smithi121 *:9095 starting - - - - 2024-08-18T22:43:18.199 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:18.197+0000 7fa9d7f95640 1 -- 172.21.15.121:0/1326248296 >> [v2:172.21.15.121:6800/1096247887,v1:172.21.15.121:6801/1096247887] conn(0x7fa9bc06dae0 msgr2=0x7fa9bc06ff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:43:18.199 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:18.197+0000 7fa9d7f95640 1 --2- 172.21.15.121:0/1326248296 >> [v2:172.21.15.121:6800/1096247887,v1:172.21.15.121:6801/1096247887] conn(0x7fa9bc06dae0 0x7fa9bc06ff90 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fa9cc007ac0 tx=0x7fa9cc009da0 comp rx=0 tx=0).stop 2024-08-18T22:43:18.199 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:18.198+0000 7fa9d7f95640 1 -- 172.21.15.121:0/1326248296 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa9d00fc4a0 msgr2=0x7fa9d010c350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:43:18.199 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:18.198+0000 7fa9d7f95640 1 --2- 172.21.15.121:0/1326248296 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa9d00fc4a0 0x7fa9d010c350 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fa9c000b790 tx=0x7fa9c00091d0 comp rx=0 tx=0).stop 2024-08-18T22:43:18.199 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:18.198+0000 7fa9d7f95640 1 -- 172.21.15.121:0/1326248296 shutdown_connections 2024-08-18T22:43:18.199 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:18.198+0000 7fa9d7f95640 1 --2- 172.21.15.121:0/1326248296 >> [v2:172.21.15.121:6800/1096247887,v1:172.21.15.121:6801/1096247887] conn(0x7fa9bc06dae0 0x7fa9bc06ff90 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:43:18.200 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:18.198+0000 7fa9d7f95640 1 --2- 172.21.15.121:0/1326248296 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa9d00fc4a0 0x7fa9d010c350 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:43:18.200 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:18.198+0000 7fa9d7f95640 1 --2- 172.21.15.121:0/1326248296 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa9d00fb1d0 0x7fa9d010be10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:43:18.200 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:18.198+0000 7fa9d7f95640 1 -- 172.21.15.121:0/1326248296 >> 172.21.15.121:0/1326248296 conn(0x7fa9d00f69b0 msgr2=0x7fa9d00ff790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:43:18.200 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:18.198+0000 7fa9d7f95640 1 -- 172.21.15.121:0/1326248296 shutdown_connections 2024-08-18T22:43:18.200 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:18.198+0000 7fa9d7f95640 1 -- 172.21.15.121:0/1326248296 wait complete. 2024-08-18T22:43:18.276 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:18.274+0000 7f19bdff7640 1 -- 172.21.15.121:0/3376578210 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f19b80fe290 msgr2=0x7f19b80fa3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:43:18.276 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:18.274+0000 7f19bdff7640 1 --2- 172.21.15.121:0/3376578210 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f19b80fe290 0x7f19b80fa3f0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f19ac0048d0 tx=0x7f19ac009da0 comp rx=0 tx=0).stop 2024-08-18T22:43:18.276 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:18.274+0000 7f19bdff7640 1 -- 172.21.15.121:0/3376578210 shutdown_connections 2024-08-18T22:43:18.276 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:18.274+0000 7f19bdff7640 1 --2- 172.21.15.121:0/3376578210 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f19b80fe290 0x7f19b80fa3f0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:43:18.276 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:18.274+0000 7f19bdff7640 1 --2- 172.21.15.121:0/3376578210 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f19b80fd940 0x7f19b80fdd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:43:18.276 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:18.274+0000 7f19bdff7640 1 -- 172.21.15.121:0/3376578210 >> 172.21.15.121:0/3376578210 conn(0x7f19b80f6140 msgr2=0x7f19b80f8570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:43:18.277 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:18.274+0000 7f19bdff7640 1 -- 172.21.15.121:0/3376578210 shutdown_connections 2024-08-18T22:43:18.277 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:18.274+0000 7f19bdff7640 1 -- 172.21.15.121:0/3376578210 wait complete. 2024-08-18T22:43:18.277 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:18.275+0000 7f19bdff7640 1 Processor -- start 2024-08-18T22:43:18.278 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:18.275+0000 7f19bdff7640 1 -- start start 2024-08-18T22:43:18.278 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:18.275+0000 7f19bdff7640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f19b80fd940 0x7f19b810cf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:43:18.278 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:18.275+0000 7f19bdff7640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f19b80fe290 0x7f19b810d480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:43:18.278 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:18.275+0000 7f19bdff7640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19b810e1c0 con 0x7f19b80fd940 2024-08-18T22:43:18.278 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:18.275+0000 7f19bdff7640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19b810e330 con 0x7f19b80fe290 2024-08-18T22:43:18.279 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:18.275+0000 7f19b77fe640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f19b80fd940 0x7f19b810cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:43:18.279 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:18.275+0000 7f19b77fe640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f19b80fd940 0x7f19b810cf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:49056/0 (socket says 172.21.15.121:49056) 2024-08-18T22:43:18.279 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:18.275+0000 7f19b77fe640 1 -- 172.21.15.121:0/2708744135 learned_addr learned my addr 172.21.15.121:0/2708744135 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-18T22:43:18.279 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:18.276+0000 7f19b6ffd640 1 --2- 172.21.15.121:0/2708744135 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f19b80fe290 0x7f19b810d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:43:18.279 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:18.276+0000 7f19b77fe640 1 -- 172.21.15.121:0/2708744135 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f19b80fe290 msgr2=0x7f19b810d480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:43:18.279 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:18.276+0000 7f19b77fe640 1 --2- 172.21.15.121:0/2708744135 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f19b80fe290 0x7f19b810d480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:43:18.279 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:18.276+0000 7f19b77fe640 1 -- 172.21.15.121:0/2708744135 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19ac005040 con 0x7f19b80fd940 2024-08-18T22:43:18.279 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:18.276+0000 7f19b77fe640 1 --2- 172.21.15.121:0/2708744135 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f19b80fd940 0x7f19b810cf40 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f19a800bbb0 tx=0x7f19a8009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:43:18.279 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:18.276+0000 7f199ffff640 1 -- 172.21.15.121:0/2708744135 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f19a800c9c0 con 0x7f19b80fd940 2024-08-18T22:43:18.279 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:18.276+0000 7f19bdff7640 1 -- 172.21.15.121:0/2708744135 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19b810e610 con 0x7f19b80fd940 2024-08-18T22:43:18.279 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:18.276+0000 7f199ffff640 1 -- 172.21.15.121:0/2708744135 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f19a80092e0 con 0x7f19b80fd940 2024-08-18T22:43:18.279 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:18.276+0000 7f199ffff640 1 -- 172.21.15.121:0/2708744135 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f19a8007640 con 0x7f19b80fd940 2024-08-18T22:43:18.279 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:18.276+0000 7f19bdff7640 1 -- 172.21.15.121:0/2708744135 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19b810eb30 con 0x7f19b80fd940 2024-08-18T22:43:18.280 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:18.277+0000 7f19bdff7640 1 -- 172.21.15.121:0/2708744135 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19b81055a0 con 0x7f19b80fd940 2024-08-18T22:43:18.280 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:18.278+0000 7f199ffff640 1 -- 172.21.15.121:0/2708744135 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 30) v1 ==== 92029+0+0 (secure 0 0 0) 0x7f19a8012070 con 0x7f19b80fd940 2024-08-18T22:43:18.280 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:18.279+0000 7f199ffff640 1 --2- 172.21.15.121:0/2708744135 >> [v2:172.21.15.121:6800/1096247887,v1:172.21.15.121:6801/1096247887] conn(0x7f19a006dae0 0x7f19a006ff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:43:18.280 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:18.279+0000 7f199ffff640 1 -- 172.21.15.121:0/2708744135 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6152+0+0 (secure 0 0 0) 0x7f19a808d340 con 0x7f19b80fd940 2024-08-18T22:43:18.280 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:18.279+0000 7f19b6ffd640 1 --2- 172.21.15.121:0/2708744135 >> [v2:172.21.15.121:6800/1096247887,v1:172.21.15.121:6801/1096247887] conn(0x7f19a006dae0 0x7f19a006ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:43:18.281 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:18.279+0000 7f19b6ffd640 1 --2- 172.21.15.121:0/2708744135 >> [v2:172.21.15.121:6800/1096247887,v1:172.21.15.121:6801/1096247887] conn(0x7f19a006dae0 0x7f19a006ff90 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f19ac000c00 tx=0x7f19ac009da0 comp rx=0 tx=0).ready entity=mgr.14702 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:43:18.284 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:18.283+0000 7f199ffff640 1 -- 172.21.15.121:0/2708744135 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7f19a8056e30 con 0x7f19b80fd940 2024-08-18T22:43:18.519 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:18.518+0000 7f19bdff7640 1 -- 172.21.15.121:0/2708744135 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f19b8104f10 con 0x7f19b80fd940 2024-08-18T22:43:18.519 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:18.518+0000 7f199ffff640 1 -- 172.21.15.121:0/2708744135 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+741 (secure 0 0 0) 0x7f19a805a4f0 con 0x7f19b80fd940 2024-08-18T22:43:18.520 INFO:teuthology.orchestra.run.smithi121.stdout:{ 2024-08-18T22:43:18.520 INFO:teuthology.orchestra.run.smithi121.stdout: "mon": { 2024-08-18T22:43:18.520 INFO:teuthology.orchestra.run.smithi121.stdout: "ceph version 17.2.7-1406-gdf62bdcc (df62bdccd9a13bf566b27a250eddfdd89be3072d) quincy (stable)": 2 2024-08-18T22:43:18.520 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-18T22:43:18.520 INFO:teuthology.orchestra.run.smithi121.stdout: "mgr": { 2024-08-18T22:43:18.520 INFO:teuthology.orchestra.run.smithi121.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 2 2024-08-18T22:43:18.520 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-18T22:43:18.520 INFO:teuthology.orchestra.run.smithi121.stdout: "osd": { 2024-08-18T22:43:18.520 INFO:teuthology.orchestra.run.smithi121.stdout: "ceph version 17.2.7-1406-gdf62bdcc (df62bdccd9a13bf566b27a250eddfdd89be3072d) quincy (stable)": 6 2024-08-18T22:43:18.520 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-18T22:43:18.520 INFO:teuthology.orchestra.run.smithi121.stdout: "mds": { 2024-08-18T22:43:18.521 INFO:teuthology.orchestra.run.smithi121.stdout: "ceph version 17.2.7-1406-gdf62bdcc (df62bdccd9a13bf566b27a250eddfdd89be3072d) quincy (stable)": 4 2024-08-18T22:43:18.521 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-18T22:43:18.521 INFO:teuthology.orchestra.run.smithi121.stdout: "overall": { 2024-08-18T22:43:18.521 INFO:teuthology.orchestra.run.smithi121.stdout: "ceph version 17.2.7-1406-gdf62bdcc (df62bdccd9a13bf566b27a250eddfdd89be3072d) quincy (stable)": 12, 2024-08-18T22:43:18.521 INFO:teuthology.orchestra.run.smithi121.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 2 2024-08-18T22:43:18.521 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-08-18T22:43:18.521 INFO:teuthology.orchestra.run.smithi121.stdout:} 2024-08-18T22:43:18.522 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:18.520+0000 7f19bdff7640 1 -- 172.21.15.121:0/2708744135 >> [v2:172.21.15.121:6800/1096247887,v1:172.21.15.121:6801/1096247887] conn(0x7f19a006dae0 msgr2=0x7f19a006ff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:43:18.522 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:18.520+0000 7f19bdff7640 1 --2- 172.21.15.121:0/2708744135 >> [v2:172.21.15.121:6800/1096247887,v1:172.21.15.121:6801/1096247887] conn(0x7f19a006dae0 0x7f19a006ff90 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f19ac000c00 tx=0x7f19ac009da0 comp rx=0 tx=0).stop 2024-08-18T22:43:18.522 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:18.520+0000 7f19bdff7640 1 -- 172.21.15.121:0/2708744135 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f19b80fd940 msgr2=0x7f19b810cf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:43:18.522 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:18.520+0000 7f19bdff7640 1 --2- 172.21.15.121:0/2708744135 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f19b80fd940 0x7f19b810cf40 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f19a800bbb0 tx=0x7f19a8009840 comp rx=0 tx=0).stop 2024-08-18T22:43:18.522 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:18.521+0000 7f19bdff7640 1 -- 172.21.15.121:0/2708744135 shutdown_connections 2024-08-18T22:43:18.522 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:18.521+0000 7f19bdff7640 1 --2- 172.21.15.121:0/2708744135 >> [v2:172.21.15.121:6800/1096247887,v1:172.21.15.121:6801/1096247887] conn(0x7f19a006dae0 0x7f19a006ff90 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:43:18.522 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:18.521+0000 7f19bdff7640 1 --2- 172.21.15.121:0/2708744135 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f19b80fe290 0x7f19b810d480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:43:18.522 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:18.521+0000 7f19bdff7640 1 --2- 172.21.15.121:0/2708744135 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f19b80fd940 0x7f19b810cf40 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:43:18.522 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:18.521+0000 7f19bdff7640 1 -- 172.21.15.121:0/2708744135 >> 172.21.15.121:0/2708744135 conn(0x7f19b80f6140 msgr2=0x7f19b80f7900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:43:18.522 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:18.521+0000 7f19bdff7640 1 -- 172.21.15.121:0/2708744135 shutdown_connections 2024-08-18T22:43:18.523 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:18.521+0000 7f19bdff7640 1 -- 172.21.15.121:0/2708744135 wait complete. 2024-08-18T22:43:18.583 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:18 smithi121 ceph-mon[16788]: from='client.14760 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-18T22:43:18.583 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:18 smithi121 ceph-mon[16788]: from='client.14764 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-18T22:43:18.583 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:18 smithi121 ceph-mon[16788]: pgmap v12: 65 pgs: 65 active+clean; 2.0 GiB data, 7.5 GiB used, 529 GiB / 536 GiB avail; 17 KiB/s rd, 0 B/s wr, 9 op/s 2024-08-18T22:43:18.584 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:18 smithi121 ceph-mon[16788]: from='client.14768 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-18T22:43:18.600 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:18.598+0000 7f42be15d640 1 -- 172.21.15.121:0/3458374183 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f42b80ff4c0 msgr2=0x7f42b81018a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:43:18.600 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:18.598+0000 7f42be15d640 1 --2- 172.21.15.121:0/3458374183 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f42b80ff4c0 0x7f42b81018a0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f42ac0048d0 tx=0x7f42ac009da0 comp rx=0 tx=0).stop 2024-08-18T22:43:18.600 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:18.598+0000 7f42be15d640 1 -- 172.21.15.121:0/3458374183 shutdown_connections 2024-08-18T22:43:18.600 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:18.598+0000 7f42be15d640 1 --2- 172.21.15.121:0/3458374183 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f42b80ff4c0 0x7f42b81018a0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:43:18.600 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:18.598+0000 7f42be15d640 1 --2- 172.21.15.121:0/3458374183 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f42b8066450 0x7f42b80fef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:43:18.600 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:18.598+0000 7f42be15d640 1 -- 172.21.15.121:0/3458374183 >> 172.21.15.121:0/3458374183 conn(0x7f42b80f69b0 msgr2=0x7f42b80f8de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:43:18.600 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:18.599+0000 7f42be15d640 1 -- 172.21.15.121:0/3458374183 shutdown_connections 2024-08-18T22:43:18.600 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:18.599+0000 7f42be15d640 1 -- 172.21.15.121:0/3458374183 wait complete. 2024-08-18T22:43:18.600 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:18.599+0000 7f42be15d640 1 Processor -- start 2024-08-18T22:43:18.600 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:18.599+0000 7f42be15d640 1 -- start start 2024-08-18T22:43:18.602 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:18.599+0000 7f42be15d640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f42b8066450 0x7f42b810cef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:43:18.602 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:18.599+0000 7f42be15d640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f42b80ff4c0 0x7f42b810d430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:43:18.602 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:18.599+0000 7f42be15d640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42b810e160 con 0x7f42b8066450 2024-08-18T22:43:18.602 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:18.599+0000 7f42be15d640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42b810e2d0 con 0x7f42b80ff4c0 2024-08-18T22:43:18.602 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:18.600+0000 7f42b77fe640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f42b8066450 0x7f42b810cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:43:18.602 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:18.600+0000 7f42b77fe640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f42b8066450 0x7f42b810cef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:49076/0 (socket says 172.21.15.121:49076) 2024-08-18T22:43:18.602 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:18.600+0000 7f42b77fe640 1 -- 172.21.15.121:0/3853183772 learned_addr learned my addr 172.21.15.121:0/3853183772 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-18T22:43:18.602 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:18.600+0000 7f42b6ffd640 1 --2- 172.21.15.121:0/3853183772 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f42b80ff4c0 0x7f42b810d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:43:18.602 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:18.600+0000 7f42b77fe640 1 -- 172.21.15.121:0/3853183772 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f42b80ff4c0 msgr2=0x7f42b810d430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:43:18.602 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:18.600+0000 7f42b77fe640 1 --2- 172.21.15.121:0/3853183772 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f42b80ff4c0 0x7f42b810d430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:43:18.603 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:18.600+0000 7f42b77fe640 1 -- 172.21.15.121:0/3853183772 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42ac005040 con 0x7f42b8066450 2024-08-18T22:43:18.603 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:18.600+0000 7f42b77fe640 1 --2- 172.21.15.121:0/3853183772 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f42b8066450 0x7f42b810cef0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f42a800db00 tx=0x7f42a8004e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:43:18.603 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:18.600+0000 7f429ffff640 1 -- 172.21.15.121:0/3853183772 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f42a800b890 con 0x7f42b8066450 2024-08-18T22:43:18.603 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:18.600+0000 7f429ffff640 1 -- 172.21.15.121:0/3853183772 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f42a800f040 con 0x7f42b8066450 2024-08-18T22:43:18.603 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:18.600+0000 7f42be15d640 1 -- 172.21.15.121:0/3853183772 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42b810e5b0 con 0x7f42b8066450 2024-08-18T22:43:18.603 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:18.600+0000 7f429ffff640 1 -- 172.21.15.121:0/3853183772 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f42a8012390 con 0x7f42b8066450 2024-08-18T22:43:18.603 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:18.600+0000 7f42be15d640 1 -- 172.21.15.121:0/3853183772 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42b810eb20 con 0x7f42b8066450 2024-08-18T22:43:18.604 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:18.601+0000 7f42be15d640 1 -- 172.21.15.121:0/3853183772 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42b8105530 con 0x7f42b8066450 2024-08-18T22:43:18.604 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:18.602+0000 7f429ffff640 1 -- 172.21.15.121:0/3853183772 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 30) v1 ==== 92029+0+0 (secure 0 0 0) 0x7f42a800b9f0 con 0x7f42b8066450 2024-08-18T22:43:18.604 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:18.602+0000 7f429ffff640 1 --2- 172.21.15.121:0/3853183772 >> [v2:172.21.15.121:6800/1096247887,v1:172.21.15.121:6801/1096247887] conn(0x7f42a006dae0 0x7f42a006ff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:43:18.604 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:18.602+0000 7f429ffff640 1 -- 172.21.15.121:0/3853183772 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6152+0+0 (secure 0 0 0) 0x7f42a808d920 con 0x7f42b8066450 2024-08-18T22:43:18.604 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:18.602+0000 7f42b6ffd640 1 --2- 172.21.15.121:0/3853183772 >> [v2:172.21.15.121:6800/1096247887,v1:172.21.15.121:6801/1096247887] conn(0x7f42a006dae0 0x7f42a006ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:43:18.604 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:18.603+0000 7f42b6ffd640 1 --2- 172.21.15.121:0/3853183772 >> [v2:172.21.15.121:6800/1096247887,v1:172.21.15.121:6801/1096247887] conn(0x7f42a006dae0 0x7f42a006ff90 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f42ac000c00 tx=0x7f42ac035040 comp rx=0 tx=0).ready entity=mgr.14702 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:43:18.607 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:18.607+0000 7f429ffff640 1 -- 172.21.15.121:0/3853183772 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7f42a8057280 con 0x7f42b8066450 2024-08-18T22:43:18.659 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:18 smithi195 ceph-mon[23370]: from='client.14760 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-18T22:43:18.659 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:18 smithi195 ceph-mon[23370]: from='client.14764 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-18T22:43:18.659 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:18 smithi195 ceph-mon[23370]: pgmap v12: 65 pgs: 65 active+clean; 2.0 GiB data, 7.5 GiB used, 529 GiB / 536 GiB avail; 17 KiB/s rd, 0 B/s wr, 9 op/s 2024-08-18T22:43:18.659 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:18 smithi195 ceph-mon[23370]: from='client.14768 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-18T22:43:18.807 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:18.806+0000 7f42be15d640 1 -- 172.21.15.121:0/3853183772 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f42b804b4c0 con 0x7f42b8066450 2024-08-18T22:43:18.807 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:18.806+0000 7f429ffff640 1 -- 172.21.15.121:0/3853183772 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 19 v19) v1 ==== 76+0+1852 (secure 0 0 0) 0x7f42b804b4c0 con 0x7f42b8066450 2024-08-18T22:43:18.808 INFO:teuthology.orchestra.run.smithi121.stdout:e19 2024-08-18T22:43:18.808 INFO:teuthology.orchestra.run.smithi121.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-08-18T22:43:18.808 INFO:teuthology.orchestra.run.smithi121.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-08-18T22:43:18.808 INFO:teuthology.orchestra.run.smithi121.stdout:legacy client fscid: 1 2024-08-18T22:43:18.808 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-08-18T22:43:18.808 INFO:teuthology.orchestra.run.smithi121.stdout:Filesystem 'cephfs' (1) 2024-08-18T22:43:18.808 INFO:teuthology.orchestra.run.smithi121.stdout:fs_name cephfs 2024-08-18T22:43:18.808 INFO:teuthology.orchestra.run.smithi121.stdout:epoch 19 2024-08-18T22:43:18.808 INFO:teuthology.orchestra.run.smithi121.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-08-18T22:43:18.808 INFO:teuthology.orchestra.run.smithi121.stdout:created 2024-08-18T22:39:04.054074+0000 2024-08-18T22:43:18.808 INFO:teuthology.orchestra.run.smithi121.stdout:modified 2024-08-18T22:42:16.794905+0000 2024-08-18T22:43:18.808 INFO:teuthology.orchestra.run.smithi121.stdout:tableserver 0 2024-08-18T22:43:18.808 INFO:teuthology.orchestra.run.smithi121.stdout:root 0 2024-08-18T22:43:18.809 INFO:teuthology.orchestra.run.smithi121.stdout:session_timeout 60 2024-08-18T22:43:18.809 INFO:teuthology.orchestra.run.smithi121.stdout:session_autoclose 300 2024-08-18T22:43:18.809 INFO:teuthology.orchestra.run.smithi121.stdout:max_file_size 1099511627776 2024-08-18T22:43:18.809 INFO:teuthology.orchestra.run.smithi121.stdout:required_client_features {} 2024-08-18T22:43:18.809 INFO:teuthology.orchestra.run.smithi121.stdout:last_failure 0 2024-08-18T22:43:18.809 INFO:teuthology.orchestra.run.smithi121.stdout:last_failure_osd_epoch 47 2024-08-18T22:43:18.809 INFO:teuthology.orchestra.run.smithi121.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-08-18T22:43:18.809 INFO:teuthology.orchestra.run.smithi121.stdout:max_mds 2 2024-08-18T22:43:18.809 INFO:teuthology.orchestra.run.smithi121.stdout:in 0,1 2024-08-18T22:43:18.809 INFO:teuthology.orchestra.run.smithi121.stdout:up {0=14474,1=24249} 2024-08-18T22:43:18.809 INFO:teuthology.orchestra.run.smithi121.stdout:failed 2024-08-18T22:43:18.809 INFO:teuthology.orchestra.run.smithi121.stdout:damaged 2024-08-18T22:43:18.810 INFO:teuthology.orchestra.run.smithi121.stdout:stopped 2024-08-18T22:43:18.810 INFO:teuthology.orchestra.run.smithi121.stdout:data_pools [3] 2024-08-18T22:43:18.810 INFO:teuthology.orchestra.run.smithi121.stdout:metadata_pool 2 2024-08-18T22:43:18.810 INFO:teuthology.orchestra.run.smithi121.stdout:inline_data disabled 2024-08-18T22:43:18.810 INFO:teuthology.orchestra.run.smithi121.stdout:balancer 2024-08-18T22:43:18.810 INFO:teuthology.orchestra.run.smithi121.stdout:standby_count_wanted 1 2024-08-18T22:43:18.810 INFO:teuthology.orchestra.run.smithi121.stdout:[mds.cephfs.smithi121.gbickb{0:14474} state up:active seq 6 export targets 1 join_fscid=1 addr [v2:172.21.15.121:6828/2277706406,v1:172.21.15.121:6829/2277706406] compat {c=[1],r=[1],i=[7ff]}] 2024-08-18T22:43:18.810 INFO:teuthology.orchestra.run.smithi121.stdout:[mds.cephfs.smithi195.buqvbr{1:24249} state up:active seq 4 export targets 0 join_fscid=1 addr [v2:172.21.15.195:6824/2414511859,v1:172.21.15.195:6825/2414511859] compat {c=[1],r=[1],i=[7ff]}] 2024-08-18T22:43:18.810 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-08-18T22:43:18.810 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-08-18T22:43:18.810 INFO:teuthology.orchestra.run.smithi121.stdout:Standby daemons: 2024-08-18T22:43:18.810 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-08-18T22:43:18.811 INFO:teuthology.orchestra.run.smithi121.stdout:[mds.cephfs.smithi121.xuzsdg{-1:14490} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.121:6826/91588128,v1:172.21.15.121:6827/91588128] compat {c=[1],r=[1],i=[7ff]}] 2024-08-18T22:43:18.811 INFO:teuthology.orchestra.run.smithi121.stdout:[mds.cephfs.smithi195.nptgyc{-1:24259} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.195:6826/238549847,v1:172.21.15.195:6827/238549847] compat {c=[1],r=[1],i=[7ff]}] 2024-08-18T22:43:18.811 INFO:teuthology.orchestra.run.smithi121.stderr:dumped fsmap epoch 19 2024-08-18T22:43:18.812 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:18.808+0000 7f42be15d640 1 -- 172.21.15.121:0/3853183772 >> [v2:172.21.15.121:6800/1096247887,v1:172.21.15.121:6801/1096247887] conn(0x7f42a006dae0 msgr2=0x7f42a006ff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:43:18.812 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:18.808+0000 7f42be15d640 1 --2- 172.21.15.121:0/3853183772 >> [v2:172.21.15.121:6800/1096247887,v1:172.21.15.121:6801/1096247887] conn(0x7f42a006dae0 0x7f42a006ff90 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f42ac000c00 tx=0x7f42ac035040 comp rx=0 tx=0).stop 2024-08-18T22:43:18.812 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:18.808+0000 7f42be15d640 1 -- 172.21.15.121:0/3853183772 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f42b8066450 msgr2=0x7f42b810cef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:43:18.812 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:18.808+0000 7f42be15d640 1 --2- 172.21.15.121:0/3853183772 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f42b8066450 0x7f42b810cef0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f42a800db00 tx=0x7f42a8004e30 comp rx=0 tx=0).stop 2024-08-18T22:43:18.812 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:18.808+0000 7f42be15d640 1 -- 172.21.15.121:0/3853183772 shutdown_connections 2024-08-18T22:43:18.812 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:18.808+0000 7f42be15d640 1 --2- 172.21.15.121:0/3853183772 >> [v2:172.21.15.121:6800/1096247887,v1:172.21.15.121:6801/1096247887] conn(0x7f42a006dae0 0x7f42a006ff90 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:43:18.812 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:18.808+0000 7f42be15d640 1 --2- 172.21.15.121:0/3853183772 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f42b80ff4c0 0x7f42b810d430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:43:18.812 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:18.808+0000 7f42be15d640 1 --2- 172.21.15.121:0/3853183772 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f42b8066450 0x7f42b810cef0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:43:18.812 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:18.808+0000 7f42be15d640 1 -- 172.21.15.121:0/3853183772 >> 172.21.15.121:0/3853183772 conn(0x7f42b80f69b0 msgr2=0x7f42b80f6dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:43:18.812 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:18.808+0000 7f42be15d640 1 -- 172.21.15.121:0/3853183772 shutdown_connections 2024-08-18T22:43:18.812 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:18.808+0000 7f42be15d640 1 -- 172.21.15.121:0/3853183772 wait complete. 2024-08-18T22:43:18.892 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:18.886+0000 7fa7985b2640 1 -- 172.21.15.121:0/3773061248 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa7900fda20 msgr2=0x7fa7900fde30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:43:18.892 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:18.886+0000 7fa7985b2640 1 --2- 172.21.15.121:0/3773061248 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa7900fda20 0x7fa7900fde30 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fa78c0048d0 tx=0x7fa78c009da0 comp rx=0 tx=0).stop 2024-08-18T22:43:18.893 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:18.886+0000 7fa7985b2640 1 -- 172.21.15.121:0/3773061248 shutdown_connections 2024-08-18T22:43:18.893 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:18.886+0000 7fa7985b2640 1 --2- 172.21.15.121:0/3773061248 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa7900fe370 0x7fa7900fa4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:43:18.893 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:18.886+0000 7fa7985b2640 1 --2- 172.21.15.121:0/3773061248 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa7900fda20 0x7fa7900fde30 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:43:18.893 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:18.886+0000 7fa7985b2640 1 -- 172.21.15.121:0/3773061248 >> 172.21.15.121:0/3773061248 conn(0x7fa7900f6160 msgr2=0x7fa7900f8590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:43:18.893 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:18.886+0000 7fa7985b2640 1 -- 172.21.15.121:0/3773061248 shutdown_connections 2024-08-18T22:43:18.893 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:18.886+0000 7fa7985b2640 1 -- 172.21.15.121:0/3773061248 wait complete. 2024-08-18T22:43:18.893 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:18.887+0000 7fa7985b2640 1 Processor -- start 2024-08-18T22:43:18.894 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:18.887+0000 7fa7985b2640 1 -- start start 2024-08-18T22:43:18.894 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:18.887+0000 7fa7985b2640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa7900fda20 0x7fa79010cf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:43:18.894 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:18.887+0000 7fa7985b2640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa7900fe370 0x7fa79010d490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:43:18.894 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:18.887+0000 7fa7985b2640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa79010e300 con 0x7fa7900fe370 2024-08-18T22:43:18.894 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:18.887+0000 7fa7985b2640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa79010e470 con 0x7fa7900fda20 2024-08-18T22:43:18.894 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:18.887+0000 7fa795b4d640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa7900fe370 0x7fa79010d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:43:18.894 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:18.887+0000 7fa795b4d640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa7900fe370 0x7fa79010d490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:49100/0 (socket says 172.21.15.121:49100) 2024-08-18T22:43:18.895 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:18.887+0000 7fa795b4d640 1 -- 172.21.15.121:0/4105541191 learned_addr learned my addr 172.21.15.121:0/4105541191 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-18T22:43:18.895 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:18.887+0000 7fa79634e640 1 --2- 172.21.15.121:0/4105541191 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa7900fda20 0x7fa79010cf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:43:18.895 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:18.887+0000 7fa795b4d640 1 -- 172.21.15.121:0/4105541191 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa7900fda20 msgr2=0x7fa79010cf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:43:18.895 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:18.887+0000 7fa795b4d640 1 --2- 172.21.15.121:0/4105541191 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa7900fda20 0x7fa79010cf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:43:18.896 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:18.887+0000 7fa795b4d640 1 -- 172.21.15.121:0/4105541191 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa78c005040 con 0x7fa7900fe370 2024-08-18T22:43:18.896 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:18.888+0000 7fa795b4d640 1 --2- 172.21.15.121:0/4105541191 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa7900fe370 0x7fa79010d490 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fa78000b580 tx=0x7fa7800091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:43:18.896 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:18.888+0000 7fa786ffd640 1 -- 172.21.15.121:0/4105541191 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa78000f6f0 con 0x7fa7900fe370 2024-08-18T22:43:18.896 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:18.888+0000 7fa786ffd640 1 -- 172.21.15.121:0/4105541191 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fa78000fcf0 con 0x7fa7900fe370 2024-08-18T22:43:18.896 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:18.888+0000 7fa786ffd640 1 -- 172.21.15.121:0/4105541191 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa7800103a0 con 0x7fa7900fe370 2024-08-18T22:43:18.896 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:18.888+0000 7fa7985b2640 1 -- 172.21.15.121:0/4105541191 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa79010e750 con 0x7fa7900fe370 2024-08-18T22:43:18.896 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:18.888+0000 7fa7985b2640 1 -- 172.21.15.121:0/4105541191 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa79010ec70 con 0x7fa7900fe370 2024-08-18T22:43:18.897 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:18.889+0000 7fa7985b2640 1 -- 172.21.15.121:0/4105541191 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7900f9e00 con 0x7fa7900fe370 2024-08-18T22:43:18.897 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:18.889+0000 7fa786ffd640 1 -- 172.21.15.121:0/4105541191 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 30) v1 ==== 92029+0+0 (secure 0 0 0) 0x7fa7800116b0 con 0x7fa7900fe370 2024-08-18T22:43:18.897 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:18.890+0000 7fa786ffd640 1 --2- 172.21.15.121:0/4105541191 >> [v2:172.21.15.121:6800/1096247887,v1:172.21.15.121:6801/1096247887] conn(0x7fa77c06dae0 0x7fa77c06ff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:43:18.897 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:18.890+0000 7fa786ffd640 1 -- 172.21.15.121:0/4105541191 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6152+0+0 (secure 0 0 0) 0x7fa78008d110 con 0x7fa7900fe370 2024-08-18T22:43:18.897 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:18.890+0000 7fa79634e640 1 --2- 172.21.15.121:0/4105541191 >> [v2:172.21.15.121:6800/1096247887,v1:172.21.15.121:6801/1096247887] conn(0x7fa77c06dae0 0x7fa77c06ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:43:18.897 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:18.891+0000 7fa79634e640 1 --2- 172.21.15.121:0/4105541191 >> [v2:172.21.15.121:6800/1096247887,v1:172.21.15.121:6801/1096247887] conn(0x7fa77c06dae0 0x7fa77c06ff90 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fa78c000c00 tx=0x7fa78c035040 comp rx=0 tx=0).ready entity=mgr.14702 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:43:18.898 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:18.894+0000 7fa786ffd640 1 -- 172.21.15.121:0/4105541191 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7fa78005a7d0 con 0x7fa7900fe370 2024-08-18T22:43:19.077 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:19.076+0000 7fa7985b2640 1 -- 172.21.15.121:0/4105541191 --> [v2:172.21.15.121:6800/1096247887,v1:172.21.15.121:6801/1096247887] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fa79010efa0 con 0x7fa77c06dae0 2024-08-18T22:43:19.078 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:19.077+0000 7fa786ffd640 1 -- 172.21.15.121:0/4105541191 <== mgr.14702 v2:172.21.15.121:6800/1096247887 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+368 (secure 0 0 0) 0x7fa79010efa0 con 0x7fa77c06dae0 2024-08-18T22:43:19.079 INFO:teuthology.orchestra.run.smithi121.stdout:{ 2024-08-18T22:43:19.079 INFO:teuthology.orchestra.run.smithi121.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9", 2024-08-18T22:43:19.079 INFO:teuthology.orchestra.run.smithi121.stdout: "in_progress": true, 2024-08-18T22:43:19.079 INFO:teuthology.orchestra.run.smithi121.stdout: "which": "Upgrading all daemon types on all hosts", 2024-08-18T22:43:19.079 INFO:teuthology.orchestra.run.smithi121.stdout: "services_complete": [ 2024-08-18T22:43:19.079 INFO:teuthology.orchestra.run.smithi121.stdout: "mgr" 2024-08-18T22:43:19.079 INFO:teuthology.orchestra.run.smithi121.stdout: ], 2024-08-18T22:43:19.079 INFO:teuthology.orchestra.run.smithi121.stdout: "progress": "2/21 daemons upgraded", 2024-08-18T22:43:19.079 INFO:teuthology.orchestra.run.smithi121.stdout: "message": "Currently upgrading mgr daemons", 2024-08-18T22:43:19.079 INFO:teuthology.orchestra.run.smithi121.stdout: "is_paused": false 2024-08-18T22:43:19.079 INFO:teuthology.orchestra.run.smithi121.stdout:} 2024-08-18T22:43:19.080 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:19.079+0000 7fa7985b2640 1 -- 172.21.15.121:0/4105541191 >> [v2:172.21.15.121:6800/1096247887,v1:172.21.15.121:6801/1096247887] conn(0x7fa77c06dae0 msgr2=0x7fa77c06ff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:43:19.081 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:19.079+0000 7fa7985b2640 1 --2- 172.21.15.121:0/4105541191 >> [v2:172.21.15.121:6800/1096247887,v1:172.21.15.121:6801/1096247887] conn(0x7fa77c06dae0 0x7fa77c06ff90 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fa78c000c00 tx=0x7fa78c035040 comp rx=0 tx=0).stop 2024-08-18T22:43:19.081 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:19.079+0000 7fa7985b2640 1 -- 172.21.15.121:0/4105541191 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa7900fe370 msgr2=0x7fa79010d490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:43:19.081 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:19.079+0000 7fa7985b2640 1 --2- 172.21.15.121:0/4105541191 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa7900fe370 0x7fa79010d490 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fa78000b580 tx=0x7fa7800091a0 comp rx=0 tx=0).stop 2024-08-18T22:43:19.081 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:19.079+0000 7fa7985b2640 1 -- 172.21.15.121:0/4105541191 shutdown_connections 2024-08-18T22:43:19.081 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:19.079+0000 7fa7985b2640 1 --2- 172.21.15.121:0/4105541191 >> [v2:172.21.15.121:6800/1096247887,v1:172.21.15.121:6801/1096247887] conn(0x7fa77c06dae0 0x7fa77c06ff90 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:43:19.081 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:19.079+0000 7fa7985b2640 1 --2- 172.21.15.121:0/4105541191 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa7900fe370 0x7fa79010d490 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:43:19.081 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:19.079+0000 7fa7985b2640 1 --2- 172.21.15.121:0/4105541191 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa7900fda20 0x7fa79010cf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:43:19.081 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:19.079+0000 7fa7985b2640 1 -- 172.21.15.121:0/4105541191 >> 172.21.15.121:0/4105541191 conn(0x7fa7900f6160 msgr2=0x7fa7900f7950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:43:19.081 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:19.080+0000 7fa7985b2640 1 -- 172.21.15.121:0/4105541191 shutdown_connections 2024-08-18T22:43:19.081 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:19.080+0000 7fa7985b2640 1 -- 172.21.15.121:0/4105541191 wait complete. 2024-08-18T22:43:19.160 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:19.157+0000 7fb09c81a640 1 -- 172.21.15.121:0/315581022 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb0980fb1f0 msgr2=0x7fb0980fb600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:43:19.160 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:19.157+0000 7fb09c81a640 1 --2- 172.21.15.121:0/315581022 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb0980fb1f0 0x7fb0980fb600 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fb0880048d0 tx=0x7fb088009da0 comp rx=0 tx=0).stop 2024-08-18T22:43:19.160 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:19.157+0000 7fb09c81a640 1 -- 172.21.15.121:0/315581022 shutdown_connections 2024-08-18T22:43:19.160 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:19.157+0000 7fb09c81a640 1 --2- 172.21.15.121:0/315581022 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb0980fc4c0 0x7fb0980fc930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:43:19.160 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:19.157+0000 7fb09c81a640 1 --2- 172.21.15.121:0/315581022 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb0980fb1f0 0x7fb0980fb600 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:43:19.160 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:19.157+0000 7fb09c81a640 1 -- 172.21.15.121:0/315581022 >> 172.21.15.121:0/315581022 conn(0x7fb0980f69b0 msgr2=0x7fb0980f8de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:43:19.160 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:19.157+0000 7fb09c81a640 1 -- 172.21.15.121:0/315581022 shutdown_connections 2024-08-18T22:43:19.160 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:19.157+0000 7fb09c81a640 1 -- 172.21.15.121:0/315581022 wait complete. 2024-08-18T22:43:19.161 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:19.157+0000 7fb09c81a640 1 Processor -- start 2024-08-18T22:43:19.161 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:19.157+0000 7fb09c81a640 1 -- start start 2024-08-18T22:43:19.161 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:19.158+0000 7fb09c81a640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb0980fb1f0 0x7fb09810cef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:43:19.161 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:19.158+0000 7fb09c81a640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb0980fc4c0 0x7fb09810d430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:43:19.161 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:19.158+0000 7fb09c81a640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb09810e160 con 0x7fb0980fb1f0 2024-08-18T22:43:19.161 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:19.158+0000 7fb09c81a640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb09810e2d0 con 0x7fb0980fc4c0 2024-08-18T22:43:19.161 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:19.158+0000 7fb09659c640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb0980fb1f0 0x7fb09810cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:43:19.161 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:19.158+0000 7fb09659c640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb0980fb1f0 0x7fb09810cef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:49118/0 (socket says 172.21.15.121:49118) 2024-08-18T22:43:19.161 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:19.158+0000 7fb09659c640 1 -- 172.21.15.121:0/2306495316 learned_addr learned my addr 172.21.15.121:0/2306495316 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-18T22:43:19.161 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:19.158+0000 7fb08ffff640 1 --2- 172.21.15.121:0/2306495316 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb0980fc4c0 0x7fb09810d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:43:19.161 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:19.158+0000 7fb09659c640 1 -- 172.21.15.121:0/2306495316 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb0980fc4c0 msgr2=0x7fb09810d430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:43:19.162 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:19.158+0000 7fb09659c640 1 --2- 172.21.15.121:0/2306495316 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb0980fc4c0 0x7fb09810d430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:43:19.162 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:19.158+0000 7fb09659c640 1 -- 172.21.15.121:0/2306495316 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb088005040 con 0x7fb0980fb1f0 2024-08-18T22:43:19.162 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:19.158+0000 7fb09659c640 1 --2- 172.21.15.121:0/2306495316 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb0980fb1f0 0x7fb09810cef0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fb0880043d0 tx=0x7fb088009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:43:19.162 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:19.158+0000 7fb08effd640 1 -- 172.21.15.121:0/2306495316 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb088038070 con 0x7fb0980fb1f0 2024-08-18T22:43:19.162 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:19.158+0000 7fb09c81a640 1 -- 172.21.15.121:0/2306495316 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb09810e550 con 0x7fb0980fb1f0 2024-08-18T22:43:19.162 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:19.158+0000 7fb09c81a640 1 -- 172.21.15.121:0/2306495316 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb09810eaf0 con 0x7fb0980fb1f0 2024-08-18T22:43:19.162 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:19.158+0000 7fb08effd640 1 -- 172.21.15.121:0/2306495316 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fb08802ae90 con 0x7fb0980fb1f0 2024-08-18T22:43:19.162 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:19.159+0000 7fb08effd640 1 -- 172.21.15.121:0/2306495316 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb08803e670 con 0x7fb0980fb1f0 2024-08-18T22:43:19.163 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:19.159+0000 7fb09c81a640 1 -- 172.21.15.121:0/2306495316 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb078005210 con 0x7fb0980fb1f0 2024-08-18T22:43:19.163 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:19.160+0000 7fb08effd640 1 -- 172.21.15.121:0/2306495316 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 30) v1 ==== 92029+0+0 (secure 0 0 0) 0x7fb088030020 con 0x7fb0980fb1f0 2024-08-18T22:43:19.163 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:19.161+0000 7fb08effd640 1 --2- 172.21.15.121:0/2306495316 >> [v2:172.21.15.121:6800/1096247887,v1:172.21.15.121:6801/1096247887] conn(0x7fb08406dae0 0x7fb08406ff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:43:19.164 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:19.161+0000 7fb08effd640 1 -- 172.21.15.121:0/2306495316 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6152+0+0 (secure 0 0 0) 0x7fb0880ad480 con 0x7fb0980fb1f0 2024-08-18T22:43:19.164 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:19.161+0000 7fb08ffff640 1 --2- 172.21.15.121:0/2306495316 >> [v2:172.21.15.121:6800/1096247887,v1:172.21.15.121:6801/1096247887] conn(0x7fb08406dae0 0x7fb08406ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:43:19.164 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:19.161+0000 7fb08ffff640 1 --2- 172.21.15.121:0/2306495316 >> [v2:172.21.15.121:6800/1096247887,v1:172.21.15.121:6801/1096247887] conn(0x7fb08406dae0 0x7fb08406ff90 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fb09810cca0 tx=0x7fb08000b040 comp rx=0 tx=0).ready entity=mgr.14702 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:43:19.166 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:19.165+0000 7fb08effd640 1 -- 172.21.15.121:0/2306495316 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7fb088077020 con 0x7fb0980fb1f0 2024-08-18T22:43:19.394 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:19.393+0000 7fb09c81a640 1 -- 172.21.15.121:0/2306495316 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fb078005790 con 0x7fb0980fb1f0 2024-08-18T22:43:19.394 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:19.393+0000 7fb08effd640 1 -- 172.21.15.121:0/2306495316 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7fb08807a6e0 con 0x7fb0980fb1f0 2024-08-18T22:43:19.395 INFO:teuthology.orchestra.run.smithi121.stdout:HEALTH_OK 2024-08-18T22:43:19.396 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:19.395+0000 7fb09c81a640 1 -- 172.21.15.121:0/2306495316 >> [v2:172.21.15.121:6800/1096247887,v1:172.21.15.121:6801/1096247887] conn(0x7fb08406dae0 msgr2=0x7fb08406ff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:43:19.396 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:19.395+0000 7fb09c81a640 1 --2- 172.21.15.121:0/2306495316 >> [v2:172.21.15.121:6800/1096247887,v1:172.21.15.121:6801/1096247887] conn(0x7fb08406dae0 0x7fb08406ff90 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fb09810cca0 tx=0x7fb08000b040 comp rx=0 tx=0).stop 2024-08-18T22:43:19.396 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:19.395+0000 7fb09c81a640 1 -- 172.21.15.121:0/2306495316 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb0980fb1f0 msgr2=0x7fb09810cef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:43:19.396 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:19.395+0000 7fb09c81a640 1 --2- 172.21.15.121:0/2306495316 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb0980fb1f0 0x7fb09810cef0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fb0880043d0 tx=0x7fb088009da0 comp rx=0 tx=0).stop 2024-08-18T22:43:19.396 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:19.395+0000 7fb09c81a640 1 -- 172.21.15.121:0/2306495316 shutdown_connections 2024-08-18T22:43:19.397 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:19.395+0000 7fb09c81a640 1 --2- 172.21.15.121:0/2306495316 >> [v2:172.21.15.121:6800/1096247887,v1:172.21.15.121:6801/1096247887] conn(0x7fb08406dae0 0x7fb08406ff90 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:43:19.397 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:19.395+0000 7fb09c81a640 1 --2- 172.21.15.121:0/2306495316 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb0980fc4c0 0x7fb09810d430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:43:19.397 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:19.395+0000 7fb09c81a640 1 --2- 172.21.15.121:0/2306495316 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb0980fb1f0 0x7fb09810cef0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:43:19.397 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:19.395+0000 7fb09c81a640 1 -- 172.21.15.121:0/2306495316 >> 172.21.15.121:0/2306495316 conn(0x7fb0980f69b0 msgr2=0x7fb098065ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:43:19.397 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:19.395+0000 7fb09c81a640 1 -- 172.21.15.121:0/2306495316 shutdown_connections 2024-08-18T22:43:19.397 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:19.395+0000 7fb09c81a640 1 -- 172.21.15.121:0/2306495316 wait complete. 2024-08-18T22:43:19.801 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:19 smithi195 ceph-mon[23370]: from='client.? 172.21.15.121:0/2708744135' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-08-18T22:43:19.801 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:19 smithi195 ceph-mon[23370]: from='client.? 172.21.15.121:0/3853183772' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-08-18T22:43:19.801 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:19 smithi195 ceph-mon[23370]: from='client.14780 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-18T22:43:19.801 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:19 smithi195 ceph-mon[23370]: from='client.? 172.21.15.121:0/2306495316' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-08-18T22:43:19.833 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:19 smithi121 ceph-mon[16788]: from='client.? 172.21.15.121:0/2708744135' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-08-18T22:43:19.833 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:19 smithi121 ceph-mon[16788]: from='client.? 172.21.15.121:0/3853183772' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-08-18T22:43:19.833 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:19 smithi121 ceph-mon[16788]: from='client.14780 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-18T22:43:19.833 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:19 smithi121 ceph-mon[16788]: from='client.? 172.21.15.121:0/2306495316' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-08-18T22:43:20.833 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:20 smithi121 ceph-mon[16788]: pgmap v13: 65 pgs: 65 active+clean; 2.0 GiB data, 7.5 GiB used, 529 GiB / 536 GiB avail 2024-08-18T22:43:20.833 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:20 smithi121 ceph-mon[16788]: from='mgr.14702 172.21.15.121:0/3084939281' entity='mgr.smithi121.lopxqc' 2024-08-18T22:43:20.833 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:20 smithi121 ceph-mon[16788]: from='mgr.14702 172.21.15.121:0/3084939281' entity='mgr.smithi121.lopxqc' 2024-08-18T22:43:20.834 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:20 smithi121 ceph-mon[16788]: from='mgr.14702 172.21.15.121:0/3084939281' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-18T22:43:20.837 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:20 smithi195 ceph-mon[23370]: pgmap v13: 65 pgs: 65 active+clean; 2.0 GiB data, 7.5 GiB used, 529 GiB / 536 GiB avail 2024-08-18T22:43:20.838 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:20 smithi195 ceph-mon[23370]: from='mgr.14702 172.21.15.121:0/3084939281' entity='mgr.smithi121.lopxqc' 2024-08-18T22:43:20.838 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:20 smithi195 ceph-mon[23370]: from='mgr.14702 172.21.15.121:0/3084939281' entity='mgr.smithi121.lopxqc' 2024-08-18T22:43:20.838 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:20 smithi195 ceph-mon[23370]: from='mgr.14702 172.21.15.121:0/3084939281' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-18T22:43:22.541 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:22 smithi121 ceph-mon[16788]: pgmap v14: 65 pgs: 65 active+clean; 2.0 GiB data, 7.5 GiB used, 529 GiB / 536 GiB avail 2024-08-18T22:43:22.556 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:22 smithi195 ceph-mon[23370]: pgmap v14: 65 pgs: 65 active+clean; 2.0 GiB data, 7.5 GiB used, 529 GiB / 536 GiB avail 2024-08-18T22:43:24.471 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:24 smithi195 ceph-mon[23370]: from='mgr.14702 172.21.15.121:0/3084939281' entity='mgr.smithi121.lopxqc' 2024-08-18T22:43:24.472 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:24 smithi195 ceph-mon[23370]: from='mgr.14702 172.21.15.121:0/3084939281' entity='mgr.smithi121.lopxqc' 2024-08-18T22:43:24.472 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:24 smithi195 ceph-mon[23370]: from='mgr.14702 172.21.15.121:0/3084939281' entity='mgr.smithi121.lopxqc' 2024-08-18T22:43:24.472 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:24 smithi195 ceph-mon[23370]: from='mgr.14702 172.21.15.121:0/3084939281' entity='mgr.smithi121.lopxqc' 2024-08-18T22:43:24.472 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:24 smithi195 ceph-mon[23370]: pgmap v15: 65 pgs: 65 active+clean; 2.0 GiB data, 7.5 GiB used, 529 GiB / 536 GiB avail 2024-08-18T22:43:24.579 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:24 smithi121 ceph-mon[16788]: from='mgr.14702 172.21.15.121:0/3084939281' entity='mgr.smithi121.lopxqc' 2024-08-18T22:43:24.580 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:24 smithi121 ceph-mon[16788]: from='mgr.14702 172.21.15.121:0/3084939281' entity='mgr.smithi121.lopxqc' 2024-08-18T22:43:24.580 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:24 smithi121 ceph-mon[16788]: from='mgr.14702 172.21.15.121:0/3084939281' entity='mgr.smithi121.lopxqc' 2024-08-18T22:43:24.580 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:24 smithi121 ceph-mon[16788]: from='mgr.14702 172.21.15.121:0/3084939281' entity='mgr.smithi121.lopxqc' 2024-08-18T22:43:24.580 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:24 smithi121 ceph-mon[16788]: pgmap v15: 65 pgs: 65 active+clean; 2.0 GiB data, 7.5 GiB used, 529 GiB / 536 GiB avail 2024-08-18T22:43:26.409 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:26 smithi195 ceph-mon[23370]: from='mgr.14702 172.21.15.121:0/3084939281' entity='mgr.smithi121.lopxqc' 2024-08-18T22:43:26.409 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:26 smithi195 ceph-mon[23370]: from='mgr.14702 172.21.15.121:0/3084939281' entity='mgr.smithi121.lopxqc' 2024-08-18T22:43:26.410 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:26 smithi195 ceph-mon[23370]: Standby manager daemon smithi195.acttsj restarted 2024-08-18T22:43:26.410 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:26 smithi195 ceph-mon[23370]: Standby manager daemon smithi195.acttsj started 2024-08-18T22:43:26.410 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:26 smithi195 ceph-mon[23370]: from='mgr.? 172.21.15.195:0/1298263182' entity='mgr.smithi195.acttsj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi195.acttsj/crt"}]: dispatch 2024-08-18T22:43:26.410 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:26 smithi195 ceph-mon[23370]: from='mgr.? 172.21.15.195:0/1298263182' entity='mgr.smithi195.acttsj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-08-18T22:43:26.410 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:26 smithi195 ceph-mon[23370]: from='mgr.? 172.21.15.195:0/1298263182' entity='mgr.smithi195.acttsj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi195.acttsj/key"}]: dispatch 2024-08-18T22:43:26.410 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:26 smithi195 ceph-mon[23370]: from='mgr.? 172.21.15.195:0/1298263182' entity='mgr.smithi195.acttsj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-08-18T22:43:26.522 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:26 smithi121 ceph-mon[16788]: from='mgr.14702 172.21.15.121:0/3084939281' entity='mgr.smithi121.lopxqc' 2024-08-18T22:43:26.522 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:26 smithi121 ceph-mon[16788]: from='mgr.14702 172.21.15.121:0/3084939281' entity='mgr.smithi121.lopxqc' 2024-08-18T22:43:26.522 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:26 smithi121 ceph-mon[16788]: Standby manager daemon smithi195.acttsj restarted 2024-08-18T22:43:26.522 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:26 smithi121 ceph-mon[16788]: Standby manager daemon smithi195.acttsj started 2024-08-18T22:43:26.522 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:26 smithi121 ceph-mon[16788]: from='mgr.? 172.21.15.195:0/1298263182' entity='mgr.smithi195.acttsj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi195.acttsj/crt"}]: dispatch 2024-08-18T22:43:26.522 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:26 smithi121 ceph-mon[16788]: from='mgr.? 172.21.15.195:0/1298263182' entity='mgr.smithi195.acttsj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-08-18T22:43:26.523 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:26 smithi121 ceph-mon[16788]: from='mgr.? 172.21.15.195:0/1298263182' entity='mgr.smithi195.acttsj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi195.acttsj/key"}]: dispatch 2024-08-18T22:43:26.523 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:26 smithi121 ceph-mon[16788]: from='mgr.? 172.21.15.195:0/1298263182' entity='mgr.smithi195.acttsj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-08-18T22:43:27.409 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:27 smithi195 ceph-mon[23370]: mgrmap e31: smithi121.lopxqc(active, since 25s), standbys: smithi195.acttsj 2024-08-18T22:43:27.409 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:27 smithi195 ceph-mon[23370]: pgmap v16: 65 pgs: 65 active+clean; 2.0 GiB data, 7.5 GiB used, 529 GiB / 536 GiB avail 2024-08-18T22:43:27.409 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:27 smithi195 ceph-mon[23370]: from='mgr.14702 172.21.15.121:0/3084939281' entity='mgr.smithi121.lopxqc' 2024-08-18T22:43:27.409 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:27 smithi195 ceph-mon[23370]: from='mgr.14702 172.21.15.121:0/3084939281' entity='mgr.smithi121.lopxqc' 2024-08-18T22:43:27.410 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:27 smithi195 ceph-mon[23370]: from='mgr.14702 172.21.15.121:0/3084939281' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:43:27.410 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:27 smithi195 ceph-mon[23370]: from='mgr.14702 172.21.15.121:0/3084939281' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-18T22:43:27.410 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:27 smithi195 ceph-mon[23370]: from='mgr.14702 172.21.15.121:0/3084939281' entity='mgr.smithi121.lopxqc' 2024-08-18T22:43:27.410 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:27 smithi195 ceph-mon[23370]: from='mgr.14702 172.21.15.121:0/3084939281' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-18T22:43:27.410 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:27 smithi195 ceph-mon[23370]: from='mgr.14702 172.21.15.121:0/3084939281' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "versions"}]: dispatch 2024-08-18T22:43:27.410 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:27 smithi195 ceph-mon[23370]: from='mgr.14702 172.21.15.121:0/3084939281' entity='mgr.smithi121.lopxqc' 2024-08-18T22:43:27.410 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:27 smithi195 ceph-mon[23370]: from='mgr.14702 172.21.15.121:0/3084939281' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi121.lopxqc"}]: dispatch 2024-08-18T22:43:27.410 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:27 smithi195 ceph-mon[23370]: from='mgr.14702 172.21.15.121:0/3084939281' entity='mgr.smithi121.lopxqc' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi121.lopxqc"}]': finished 2024-08-18T22:43:27.410 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:27 smithi195 ceph-mon[23370]: from='mgr.14702 172.21.15.121:0/3084939281' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi195.acttsj"}]: dispatch 2024-08-18T22:43:27.410 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:27 smithi195 ceph-mon[23370]: from='mgr.14702 172.21.15.121:0/3084939281' entity='mgr.smithi121.lopxqc' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi195.acttsj"}]': finished 2024-08-18T22:43:27.410 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:27 smithi195 ceph-mon[23370]: from='mgr.14702 172.21.15.121:0/3084939281' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-08-18T22:43:27.459 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:27 smithi121 ceph-mon[16788]: mgrmap e31: smithi121.lopxqc(active, since 25s), standbys: smithi195.acttsj 2024-08-18T22:43:27.459 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:27 smithi121 ceph-mon[16788]: pgmap v16: 65 pgs: 65 active+clean; 2.0 GiB data, 7.5 GiB used, 529 GiB / 536 GiB avail 2024-08-18T22:43:27.459 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:27 smithi121 ceph-mon[16788]: from='mgr.14702 172.21.15.121:0/3084939281' entity='mgr.smithi121.lopxqc' 2024-08-18T22:43:27.459 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:27 smithi121 ceph-mon[16788]: from='mgr.14702 172.21.15.121:0/3084939281' entity='mgr.smithi121.lopxqc' 2024-08-18T22:43:27.459 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:27 smithi121 ceph-mon[16788]: from='mgr.14702 172.21.15.121:0/3084939281' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:43:27.459 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:27 smithi121 ceph-mon[16788]: from='mgr.14702 172.21.15.121:0/3084939281' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-18T22:43:27.459 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:27 smithi121 ceph-mon[16788]: from='mgr.14702 172.21.15.121:0/3084939281' entity='mgr.smithi121.lopxqc' 2024-08-18T22:43:27.459 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:27 smithi121 ceph-mon[16788]: from='mgr.14702 172.21.15.121:0/3084939281' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-18T22:43:27.459 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:27 smithi121 ceph-mon[16788]: from='mgr.14702 172.21.15.121:0/3084939281' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "versions"}]: dispatch 2024-08-18T22:43:27.459 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:27 smithi121 ceph-mon[16788]: from='mgr.14702 172.21.15.121:0/3084939281' entity='mgr.smithi121.lopxqc' 2024-08-18T22:43:27.459 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:27 smithi121 ceph-mon[16788]: from='mgr.14702 172.21.15.121:0/3084939281' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi121.lopxqc"}]: dispatch 2024-08-18T22:43:27.460 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:27 smithi121 ceph-mon[16788]: from='mgr.14702 172.21.15.121:0/3084939281' entity='mgr.smithi121.lopxqc' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi121.lopxqc"}]': finished 2024-08-18T22:43:27.460 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:27 smithi121 ceph-mon[16788]: from='mgr.14702 172.21.15.121:0/3084939281' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi195.acttsj"}]: dispatch 2024-08-18T22:43:27.460 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:27 smithi121 ceph-mon[16788]: from='mgr.14702 172.21.15.121:0/3084939281' entity='mgr.smithi121.lopxqc' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi195.acttsj"}]': finished 2024-08-18T22:43:27.460 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:27 smithi121 ceph-mon[16788]: from='mgr.14702 172.21.15.121:0/3084939281' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-08-18T22:43:28.400 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:28 smithi121 ceph-mon[16788]: Upgrade: Setting container_image for all mgr 2024-08-18T22:43:28.409 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:28 smithi195 ceph-mon[23370]: Upgrade: Setting container_image for all mgr 2024-08-18T22:43:29.334 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:29 smithi121 ceph-mon[16788]: pgmap v17: 65 pgs: 65 active+clean; 2.0 GiB data, 7.5 GiB used, 529 GiB / 536 GiB avail 2024-08-18T22:43:29.334 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:29 smithi121 ceph-mon[16788]: from='mgr.14702 172.21.15.121:0/3084939281' entity='mgr.smithi121.lopxqc' 2024-08-18T22:43:29.334 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:29 smithi121 ceph-mon[16788]: from='mgr.14702 172.21.15.121:0/3084939281' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-08-18T22:43:29.334 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:29 smithi121 ceph-mon[16788]: from='mgr.14702 172.21.15.121:0/3084939281' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-08-18T22:43:29.334 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:29 smithi121 ceph-mon[16788]: from='mgr.14702 172.21.15.121:0/3084939281' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:43:29.409 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:29 smithi195 ceph-mon[23370]: pgmap v17: 65 pgs: 65 active+clean; 2.0 GiB data, 7.5 GiB used, 529 GiB / 536 GiB avail 2024-08-18T22:43:29.409 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:29 smithi195 ceph-mon[23370]: from='mgr.14702 172.21.15.121:0/3084939281' entity='mgr.smithi121.lopxqc' 2024-08-18T22:43:29.409 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:29 smithi195 ceph-mon[23370]: from='mgr.14702 172.21.15.121:0/3084939281' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-08-18T22:43:29.409 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:29 smithi195 ceph-mon[23370]: from='mgr.14702 172.21.15.121:0/3084939281' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-08-18T22:43:29.409 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:29 smithi195 ceph-mon[23370]: from='mgr.14702 172.21.15.121:0/3084939281' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:43:30.197 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:30 smithi121 ceph-mon[16788]: Upgrade: Updating mon.smithi121 2024-08-18T22:43:30.197 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:30 smithi121 ceph-mon[16788]: Deploying daemon mon.smithi121 on smithi121 2024-08-18T22:43:30.409 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:30 smithi195 ceph-mon[23370]: Upgrade: Updating mon.smithi121 2024-08-18T22:43:30.409 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:30 smithi195 ceph-mon[23370]: Deploying daemon mon.smithi121 on smithi121 2024-08-18T22:43:30.449 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:30 smithi121 systemd[1]: Stopping Ceph mon.smithi121 for b003123a-5db1-11ef-bccf-c7b262605968... 2024-08-18T22:43:30.449 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:30 smithi121 ceph-b003123a-5db1-11ef-bccf-c7b262605968-mon-smithi121[16784]: 2024-08-18T22:43:30.443+0000 7f676cfe5640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi121 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-08-18T22:43:30.449 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:30 smithi121 ceph-b003123a-5db1-11ef-bccf-c7b262605968-mon-smithi121[16784]: 2024-08-18T22:43:30.443+0000 7f676cfe5640 -1 mon.smithi121@0(leader) e2 *** Got Signal Terminated *** 2024-08-18T22:43:30.833 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:30 smithi121 podman[80882]: 2024-08-18 22:43:30.6891278 +0000 UTC m=+0.342073543 container died 4a7bead235acbc79f51e325fd860dc47cc2c9674a3c2e24147caa0317fba5595 (image=quay.ceph.io/ceph-ci/ceph:quincy, name=ceph-b003123a-5db1-11ef-bccf-c7b262605968-mon-smithi121, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.license=GPLv2, io.buildah.version=1.36.0, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, RELEASE=quincy-df62bdc, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-08-18T22:43:31.320 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:31 smithi121 podman[80882]: 2024-08-18 22:43:31.11887327 +0000 UTC m=+0.771819058 container cleanup 4a7bead235acbc79f51e325fd860dc47cc2c9674a3c2e24147caa0317fba5595 (image=quay.ceph.io/ceph-ci/ceph:quincy, name=ceph-b003123a-5db1-11ef-bccf-c7b262605968-mon-smithi121, GIT_BRANCH=HEAD, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=quincy-df62bdc, io.buildah.version=1.36.0, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS) 2024-08-18T22:43:31.321 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:31 smithi121 bash[80882]: ceph-b003123a-5db1-11ef-bccf-c7b262605968-mon-smithi121 2024-08-18T22:43:31.583 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:31 smithi121 podman[80893]: 2024-08-18 22:43:31.320310099 +0000 UTC m=+0.630793263 container remove 4a7bead235acbc79f51e325fd860dc47cc2c9674a3c2e24147caa0317fba5595 (image=quay.ceph.io/ceph-ci/ceph:quincy, name=ceph-b003123a-5db1-11ef-bccf-c7b262605968-mon-smithi121, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, io.buildah.version=1.36.0, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, ceph=True, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=quincy-df62bdc, org.label-schema.schema-version=1.0) 2024-08-18T22:43:31.583 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:31 smithi121 systemd[1]: ceph-b003123a-5db1-11ef-bccf-c7b262605968@mon.smithi121.service: Deactivated successfully. 2024-08-18T22:43:31.583 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:31 smithi121 systemd[1]: Stopped Ceph mon.smithi121 for b003123a-5db1-11ef-bccf-c7b262605968. 2024-08-18T22:43:31.583 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:31 smithi121 systemd[1]: ceph-b003123a-5db1-11ef-bccf-c7b262605968@mon.smithi121.service: Consumed 9.960s CPU time. 2024-08-18T22:43:32.080 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:31 smithi121 systemd[1]: Starting Ceph mon.smithi121 for b003123a-5db1-11ef-bccf-c7b262605968... 2024-08-18T22:43:32.080 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:31 smithi121 podman[81034]: 2024-08-18 22:43:31.962898719 +0000 UTC m=+0.106094023 container create d71695a4fb56e5aee853ed2634967de22964c5047716447f055b737a82b6e55e (image=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-b003123a-5db1-11ef-bccf-c7b262605968-mon-smithi121, RELEASE=squid-de09dd0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_BRANCH=HEAD, io.buildah.version=1.36.0, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-08-18T22:43:32.080 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:31 smithi121 podman[81034]: 2024-08-18 22:43:31.873785272 +0000 UTC m=+0.016980586 image pull ea7a5189f30bad3aca9524788e2965d2368d7ce786df09d4edcd8c3edf9cefba quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9 2024-08-18T22:43:32.334 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:32 smithi121 podman[81034]: 2024-08-18 22:43:32.207436889 +0000 UTC m=+0.350632185 container init d71695a4fb56e5aee853ed2634967de22964c5047716447f055b737a82b6e55e (image=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-b003123a-5db1-11ef-bccf-c7b262605968-mon-smithi121, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, RELEASE=squid-de09dd0, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, io.buildah.version=1.36.0, ceph=True, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-08-18T22:43:32.334 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:32 smithi121 podman[81034]: 2024-08-18 22:43:32.211001492 +0000 UTC m=+0.354196788 container start d71695a4fb56e5aee853ed2634967de22964c5047716447f055b737a82b6e55e (image=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-b003123a-5db1-11ef-bccf-c7b262605968-mon-smithi121, org.label-schema.license=GPLv2, RELEASE=squid-de09dd0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, ceph=True, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, io.buildah.version=1.36.0, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD) 2024-08-18T22:43:32.334 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:32 smithi121 ceph-mon[81053]: set uid:gid to 167:167 (ceph:ceph) 2024-08-18T22:43:32.334 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:32 smithi121 ceph-mon[81053]: ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc), process ceph-mon, pid 2 2024-08-18T22:43:32.334 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:32 smithi121 ceph-mon[81053]: pidfile_write: ignore empty --pid-file 2024-08-18T22:43:32.334 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:32 smithi121 ceph-mon[81053]: load: jerasure load: lrc 2024-08-18T22:43:32.334 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:32 smithi121 ceph-mon[81053]: rocksdb: RocksDB version: 7.9.2 2024-08-18T22:43:32.334 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:32 smithi121 ceph-mon[81053]: rocksdb: Git sha 0 2024-08-18T22:43:32.334 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:32 smithi121 ceph-mon[81053]: rocksdb: Compile date 2024-08-18 15:19:56 2024-08-18T22:43:32.334 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:32 smithi121 ceph-mon[81053]: rocksdb: DB SUMMARY 2024-08-18T22:43:32.335 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:32 smithi121 ceph-mon[81053]: rocksdb: DB Session ID: YE8WF9DOA62KTGS4B4VA 2024-08-18T22:43:32.335 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:32 smithi121 ceph-mon[81053]: rocksdb: CURRENT file: CURRENT 2024-08-18T22:43:32.335 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:32 smithi121 ceph-mon[81053]: rocksdb: IDENTITY file: IDENTITY 2024-08-18T22:43:32.335 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:32 smithi121 ceph-mon[81053]: rocksdb: MANIFEST file: MANIFEST-000015 size: 972 Bytes 2024-08-18T22:43:32.335 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:32 smithi121 ceph-mon[81053]: rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi121/store.db dir, Total Num: 1, files: 000030.sst 2024-08-18T22:43:32.335 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:32 smithi121 ceph-mon[81053]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi121/store.db: 000028.log size: 2150027 ; 2024-08-18T22:43:32.335 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:32 smithi121 ceph-mon[81053]: rocksdb: Options.error_if_exists: 0 2024-08-18T22:43:32.335 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:32 smithi121 ceph-mon[81053]: rocksdb: Options.create_if_missing: 0 2024-08-18T22:43:32.335 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:32 smithi121 ceph-mon[81053]: rocksdb: Options.paranoid_checks: 1 2024-08-18T22:43:32.335 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:32 smithi121 ceph-mon[81053]: rocksdb: Options.flush_verify_memtable_count: 1 2024-08-18T22:43:32.335 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:32 smithi121 ceph-mon[81053]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-08-18T22:43:32.335 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:32 smithi121 ceph-mon[81053]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-08-18T22:43:32.335 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:32 smithi121 ceph-mon[81053]: rocksdb: Options.env: 0x55f8d1b4e7a0 2024-08-18T22:43:32.335 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:32 smithi121 ceph-mon[81053]: rocksdb: Options.fs: PosixFileSystem 2024-08-18T22:43:32.336 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:32 smithi121 ceph-mon[81053]: rocksdb: Options.info_log: 0x55f8d2e3b6e0 2024-08-18T22:43:32.336 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:32 smithi121 ceph-mon[81053]: rocksdb: Options.max_file_opening_threads: 16 2024-08-18T22:43:32.337 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:32 smithi121 ceph-mon[81053]: rocksdb: Options.statistics: (nil) 2024-08-18T22:43:32.337 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:32 smithi121 ceph-mon[81053]: rocksdb: Options.use_fsync: 0 2024-08-18T22:43:32.337 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:32 smithi121 ceph-mon[81053]: rocksdb: Options.max_log_file_size: 0 2024-08-18T22:43:32.337 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:32 smithi121 ceph-mon[81053]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-08-18T22:43:32.338 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:32 smithi121 ceph-mon[81053]: rocksdb: Options.log_file_time_to_roll: 0 2024-08-18T22:43:32.338 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:32 smithi121 ceph-mon[81053]: rocksdb: Options.keep_log_file_num: 1000 2024-08-18T22:43:32.338 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:32 smithi121 ceph-mon[81053]: rocksdb: Options.recycle_log_file_num: 0 2024-08-18T22:43:32.338 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:32 smithi121 ceph-mon[81053]: rocksdb: Options.allow_fallocate: 1 2024-08-18T22:43:32.338 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:32 smithi121 ceph-mon[81053]: rocksdb: Options.allow_mmap_reads: 0 2024-08-18T22:43:32.338 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:32 smithi121 ceph-mon[81053]: rocksdb: Options.allow_mmap_writes: 0 2024-08-18T22:43:32.338 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:32 smithi121 ceph-mon[81053]: rocksdb: Options.use_direct_reads: 0 2024-08-18T22:43:32.338 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:32 smithi121 ceph-mon[81053]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-08-18T22:43:32.338 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:32 smithi121 ceph-mon[81053]: rocksdb: Options.create_missing_column_families: 0 2024-08-18T22:43:32.338 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:32 smithi121 ceph-mon[81053]: rocksdb: Options.db_log_dir: 2024-08-18T22:43:32.338 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:32 smithi121 ceph-mon[81053]: rocksdb: Options.wal_dir: 2024-08-18T22:43:32.338 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:32 smithi121 ceph-mon[81053]: rocksdb: Options.table_cache_numshardbits: 6 2024-08-18T22:43:32.338 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:32 smithi121 ceph-mon[81053]: rocksdb: Options.WAL_ttl_seconds: 0 2024-08-18T22:43:32.339 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:32 smithi121 ceph-mon[81053]: rocksdb: Options.WAL_size_limit_MB: 0 2024-08-18T22:43:32.339 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:32 smithi121 ceph-mon[81053]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-08-18T22:43:32.339 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:32 smithi121 ceph-mon[81053]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-08-18T22:43:32.339 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:32 smithi121 ceph-mon[81053]: rocksdb: Options.is_fd_close_on_exec: 1 2024-08-18T22:43:32.339 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:32 smithi121 ceph-mon[81053]: rocksdb: Options.advise_random_on_open: 1 2024-08-18T22:43:32.339 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:32 smithi121 ceph-mon[81053]: rocksdb: Options.db_write_buffer_size: 0 2024-08-18T22:43:32.339 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:32 smithi121 ceph-mon[81053]: rocksdb: Options.write_buffer_manager: 0x55f8d2e4adc0 2024-08-18T22:43:32.339 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:32 smithi121 ceph-mon[81053]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-08-18T22:43:32.339 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:32 smithi121 ceph-mon[81053]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-08-18T22:43:32.339 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:32 smithi121 ceph-mon[81053]: rocksdb: Options.use_adaptive_mutex: 0 2024-08-18T22:43:32.339 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:32 smithi121 ceph-mon[81053]: rocksdb: Options.rate_limiter: (nil) 2024-08-18T22:43:32.339 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:32 smithi121 ceph-mon[81053]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-08-18T22:43:32.339 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:32 smithi121 ceph-mon[81053]: rocksdb: Options.wal_recovery_mode: 2 2024-08-18T22:43:32.339 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:32 smithi121 ceph-mon[81053]: rocksdb: Options.enable_thread_tracking: 0 2024-08-18T22:43:32.340 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:32 smithi121 ceph-mon[81053]: rocksdb: Options.enable_pipelined_write: 0 2024-08-18T22:43:32.340 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:32 smithi121 ceph-mon[81053]: rocksdb: Options.unordered_write: 0 2024-08-18T22:43:32.340 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:32 smithi121 ceph-mon[81053]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-08-18T22:43:32.340 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:32 smithi121 ceph-mon[81053]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-08-18T22:43:32.340 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:32 smithi121 ceph-mon[81053]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-08-18T22:43:32.340 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:32 smithi121 ceph-mon[81053]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-08-18T22:43:32.340 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:32 smithi121 ceph-mon[81053]: rocksdb: Options.row_cache: None 2024-08-18T22:43:32.340 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:32 smithi121 ceph-mon[81053]: rocksdb: Options.wal_filter: None 2024-08-18T22:43:32.340 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:32 smithi121 ceph-mon[81053]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-08-18T22:43:32.341 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:32 smithi121 ceph-mon[81053]: rocksdb: Options.allow_ingest_behind: 0 2024-08-18T22:43:32.341 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:32 smithi121 ceph-mon[81053]: rocksdb: Options.two_write_queues: 0 2024-08-18T22:43:32.341 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:32 smithi121 ceph-mon[81053]: rocksdb: Options.manual_wal_flush: 0 2024-08-18T22:43:32.341 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:32 smithi121 ceph-mon[81053]: rocksdb: Options.wal_compression: 0 2024-08-18T22:43:32.341 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:32 smithi121 ceph-mon[81053]: rocksdb: Options.atomic_flush: 0 2024-08-18T22:43:32.341 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:32 smithi121 ceph-mon[81053]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-08-18T22:43:32.341 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:32 smithi121 ceph-mon[81053]: rocksdb: Options.persist_stats_to_disk: 0 2024-08-18T22:43:32.341 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:32 smithi121 ceph-mon[81053]: rocksdb: Options.write_dbid_to_manifest: 0 2024-08-18T22:43:32.341 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:32 smithi121 ceph-mon[81053]: rocksdb: Options.log_readahead_size: 0 2024-08-18T22:43:32.341 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:32 smithi121 ceph-mon[81053]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-08-18T22:43:32.341 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:32 smithi121 ceph-mon[81053]: rocksdb: Options.best_efforts_recovery: 0 2024-08-18T22:43:32.341 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:32 smithi121 ceph-mon[81053]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-08-18T22:43:32.341 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:32 smithi121 ceph-mon[81053]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-08-18T22:43:32.341 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:32 smithi121 ceph-mon[81053]: rocksdb: Options.allow_data_in_errors: 0 2024-08-18T22:43:32.342 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:32 smithi121 ceph-mon[81053]: rocksdb: Options.db_host_id: __hostname__ 2024-08-18T22:43:32.342 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:32 smithi121 ceph-mon[81053]: rocksdb: Options.enforce_single_del_contracts: true 2024-08-18T22:43:32.342 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:32 smithi121 ceph-mon[81053]: rocksdb: Options.max_background_jobs: 2 2024-08-18T22:43:32.342 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:32 smithi121 ceph-mon[81053]: rocksdb: Options.max_background_compactions: -1 2024-08-18T22:43:32.342 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:32 smithi121 ceph-mon[81053]: rocksdb: Options.max_subcompactions: 1 2024-08-18T22:43:32.342 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:32 smithi121 ceph-mon[81053]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-08-18T22:43:32.342 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:32 smithi121 ceph-mon[81053]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-08-18T22:43:32.342 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:32 smithi121 ceph-mon[81053]: rocksdb: Options.delayed_write_rate : 16777216 2024-08-18T22:43:32.342 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:32 smithi121 ceph-mon[81053]: rocksdb: Options.max_total_wal_size: 0 2024-08-18T22:43:32.342 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:32 smithi121 ceph-mon[81053]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-08-18T22:43:32.342 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:32 smithi121 ceph-mon[81053]: rocksdb: Options.stats_dump_period_sec: 600 2024-08-18T22:43:32.342 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:32 smithi121 ceph-mon[81053]: rocksdb: Options.stats_persist_period_sec: 600 2024-08-18T22:43:32.342 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:32 smithi121 ceph-mon[81053]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-08-18T22:43:32.343 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:32 smithi121 ceph-mon[81053]: rocksdb: Options.max_open_files: -1 2024-08-18T22:43:32.343 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:32 smithi121 ceph-mon[81053]: rocksdb: Options.bytes_per_sync: 0 2024-08-18T22:43:32.343 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:32 smithi121 ceph-mon[81053]: rocksdb: Options.wal_bytes_per_sync: 0 2024-08-18T22:43:32.343 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:32 smithi121 ceph-mon[81053]: rocksdb: Options.strict_bytes_per_sync: 0 2024-08-18T22:43:32.343 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:32 smithi121 ceph-mon[81053]: rocksdb: Options.compaction_readahead_size: 0 2024-08-18T22:43:32.343 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:32 smithi121 ceph-mon[81053]: rocksdb: Options.max_background_flushes: -1 2024-08-18T22:43:32.343 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:32 smithi121 ceph-mon[81053]: rocksdb: Compression algorithms supported: 2024-08-18T22:43:32.343 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:32 smithi121 ceph-mon[81053]: rocksdb: kZSTD supported: 0 2024-08-18T22:43:32.343 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:32 smithi121 ceph-mon[81053]: rocksdb: kXpressCompression supported: 0 2024-08-18T22:43:32.343 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:32 smithi121 ceph-mon[81053]: rocksdb: kBZip2Compression supported: 0 2024-08-18T22:43:32.344 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:32 smithi121 ceph-mon[81053]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-08-18T22:43:32.344 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:32 smithi121 ceph-mon[81053]: rocksdb: kLZ4Compression supported: 1 2024-08-18T22:43:32.344 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:32 smithi121 ceph-mon[81053]: rocksdb: kZlibCompression supported: 1 2024-08-18T22:43:32.344 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:32 smithi121 ceph-mon[81053]: rocksdb: kLZ4HCCompression supported: 1 2024-08-18T22:43:32.344 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:32 smithi121 ceph-mon[81053]: rocksdb: kSnappyCompression supported: 1 2024-08-18T22:43:32.344 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:32 smithi121 ceph-mon[81053]: rocksdb: Fast CRC32 supported: Supported on x86 2024-08-18T22:43:32.344 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:32 smithi121 ceph-mon[81053]: rocksdb: DMutex implementation: pthread_mutex_t 2024-08-18T22:43:32.344 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:32 smithi121 ceph-mon[81053]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi121/store.db/MANIFEST-000015 2024-08-18T22:43:32.344 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:32 smithi121 ceph-mon[81053]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-08-18T22:43:32.344 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:32 smithi121 ceph-mon[81053]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-08-18T22:43:32.344 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:32 smithi121 ceph-mon[81053]: rocksdb: Options.merge_operator: 2024-08-18T22:43:32.344 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:32 smithi121 ceph-mon[81053]: rocksdb: Options.compaction_filter: None 2024-08-18T22:43:32.344 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:32 smithi121 ceph-mon[81053]: rocksdb: Options.compaction_filter_factory: None 2024-08-18T22:43:32.345 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:32 smithi121 ceph-mon[81053]: rocksdb: Options.sst_partitioner_factory: None 2024-08-18T22:43:32.345 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:32 smithi121 ceph-mon[81053]: rocksdb: Options.memtable_factory: SkipListFactory 2024-08-18T22:43:32.345 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:32 smithi121 ceph-mon[81053]: rocksdb: Options.table_factory: BlockBasedTable 2024-08-18T22:43:32.345 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:32 smithi121 ceph-mon[81053]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55f8d2e3b320) 2024-08-18T22:43:32.345 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout: cache_index_and_filter_blocks: 1 2024-08-18T22:43:32.345 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-08-18T22:43:32.345 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-08-18T22:43:32.345 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout: pin_top_level_index_and_filter: 1 2024-08-18T22:43:32.345 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout: index_type: 0 2024-08-18T22:43:32.345 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout: data_block_index_type: 0 2024-08-18T22:43:32.345 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout: index_shortening: 1 2024-08-18T22:43:32.345 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout: data_block_hash_table_util_ratio: 0.750000 2024-08-18T22:43:32.345 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout: checksum: 4 2024-08-18T22:43:32.345 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout: no_block_cache: 0 2024-08-18T22:43:32.346 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout: block_cache: 0x55f8d2e2f090 2024-08-18T22:43:32.346 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout: block_cache_name: BinnedLRUCache 2024-08-18T22:43:32.346 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout: block_cache_options: 2024-08-18T22:43:32.346 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout: capacity : 536870912 2024-08-18T22:43:32.346 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout: num_shard_bits : 4 2024-08-18T22:43:32.346 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout: strict_capacity_limit : 0 2024-08-18T22:43:32.346 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout: high_pri_pool_ratio: 0.000 2024-08-18T22:43:32.346 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout: block_cache_compressed: (nil) 2024-08-18T22:43:32.346 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout: persistent_cache: (nil) 2024-08-18T22:43:32.346 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout: block_size: 4096 2024-08-18T22:43:32.346 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout: block_size_deviation: 10 2024-08-18T22:43:32.346 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout: block_restart_interval: 16 2024-08-18T22:43:32.346 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout: index_block_restart_interval: 1 2024-08-18T22:43:32.346 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout: metadata_block_size: 4096 2024-08-18T22:43:32.347 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout: partition_filters: 0 2024-08-18T22:43:32.347 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout: use_delta_encoding: 1 2024-08-18T22:43:32.347 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout: filter_policy: bloomfilter 2024-08-18T22:43:32.347 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout: whole_key_filtering: 1 2024-08-18T22:43:32.347 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout: verify_compression: 0 2024-08-18T22:43:32.347 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout: read_amp_bytes_per_bit: 0 2024-08-18T22:43:32.347 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout: format_version: 5 2024-08-18T22:43:32.347 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout: enable_index_compression: 1 2024-08-18T22:43:32.347 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout: block_align: 0 2024-08-18T22:43:32.347 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout: max_auto_readahead_size: 262144 2024-08-18T22:43:32.347 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout: prepopulate_block_cache: 0 2024-08-18T22:43:32.347 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout: initial_auto_readahead_size: 8192 2024-08-18T22:43:32.347 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout: num_file_reads_for_auto_readahead: 2 2024-08-18T22:43:32.347 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:32 smithi121 ceph-mon[81053]: rocksdb: Options.write_buffer_size: 33554432 2024-08-18T22:43:32.347 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:32 smithi121 ceph-mon[81053]: rocksdb: Options.max_write_buffer_number: 2 2024-08-18T22:43:32.348 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:32 smithi121 ceph-mon[81053]: rocksdb: Options.compression: NoCompression 2024-08-18T22:43:32.348 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:32 smithi121 ceph-mon[81053]: rocksdb: Options.bottommost_compression: Disabled 2024-08-18T22:43:32.348 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:32 smithi121 ceph-mon[81053]: rocksdb: Options.prefix_extractor: nullptr 2024-08-18T22:43:32.348 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:32 smithi121 ceph-mon[81053]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-08-18T22:43:32.348 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:32 smithi121 ceph-mon[81053]: rocksdb: Options.num_levels: 7 2024-08-18T22:43:32.348 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:32 smithi121 ceph-mon[81053]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-08-18T22:43:32.348 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:32 smithi121 ceph-mon[81053]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-08-18T22:43:32.348 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:32 smithi121 ceph-mon[81053]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-08-18T22:43:32.348 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:32 smithi121 ceph-mon[81053]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-08-18T22:43:32.348 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:32 smithi121 ceph-mon[81053]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-08-18T22:43:32.348 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:32 smithi121 ceph-mon[81053]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-08-18T22:43:32.348 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:32 smithi121 ceph-mon[81053]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-08-18T22:43:32.348 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:32 smithi121 ceph-mon[81053]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-08-18T22:43:32.348 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:32 smithi121 ceph-mon[81053]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-08-18T22:43:32.349 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:32 smithi121 ceph-mon[81053]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-08-18T22:43:32.349 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:32 smithi121 ceph-mon[81053]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-08-18T22:43:32.349 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:32 smithi121 ceph-mon[81053]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-08-18T22:43:32.349 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:32 smithi121 ceph-mon[81053]: rocksdb: Options.compression_opts.window_bits: -14 2024-08-18T22:43:32.349 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:32 smithi121 ceph-mon[81053]: rocksdb: Options.compression_opts.level: 32767 2024-08-18T22:43:32.349 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:32 smithi121 ceph-mon[81053]: rocksdb: Options.compression_opts.strategy: 0 2024-08-18T22:43:32.349 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:32 smithi121 ceph-mon[81053]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-08-18T22:43:32.349 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:32 smithi121 ceph-mon[81053]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-08-18T22:43:32.349 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:32 smithi121 ceph-mon[81053]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-08-18T22:43:32.349 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:32 smithi121 ceph-mon[81053]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-08-18T22:43:32.349 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:32 smithi121 ceph-mon[81053]: rocksdb: Options.compression_opts.enabled: false 2024-08-18T22:43:32.349 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:32 smithi121 ceph-mon[81053]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-08-18T22:43:32.349 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:32 smithi121 ceph-mon[81053]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-08-18T22:43:32.349 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:32 smithi121 ceph-mon[81053]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-08-18T22:43:32.349 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:32 smithi121 ceph-mon[81053]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-08-18T22:43:32.350 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:32 smithi121 ceph-mon[81053]: rocksdb: Options.target_file_size_base: 67108864 2024-08-18T22:43:32.350 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:32 smithi121 ceph-mon[81053]: rocksdb: Options.target_file_size_multiplier: 1 2024-08-18T22:43:32.350 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:32 smithi121 ceph-mon[81053]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-08-18T22:43:32.350 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:32 smithi121 ceph-mon[81053]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-08-18T22:43:32.350 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:32 smithi121 ceph-mon[81053]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-08-18T22:43:32.350 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:32 smithi121 ceph-mon[81053]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-08-18T22:43:32.350 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:32 smithi121 ceph-mon[81053]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-08-18T22:43:32.350 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:32 smithi121 ceph-mon[81053]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-08-18T22:43:32.350 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:32 smithi121 ceph-mon[81053]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-08-18T22:43:32.350 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:32 smithi121 ceph-mon[81053]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-08-18T22:43:32.350 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:32 smithi121 ceph-mon[81053]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-08-18T22:43:32.350 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:32 smithi121 ceph-mon[81053]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-08-18T22:43:32.350 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:32 smithi121 ceph-mon[81053]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-08-18T22:43:32.351 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:32 smithi121 ceph-mon[81053]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-08-18T22:43:32.351 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:32 smithi121 ceph-mon[81053]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-08-18T22:43:32.351 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:32 smithi121 ceph-mon[81053]: rocksdb: Options.arena_block_size: 1048576 2024-08-18T22:43:32.351 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:32 smithi121 ceph-mon[81053]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-08-18T22:43:32.351 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:32 smithi121 ceph-mon[81053]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-08-18T22:43:32.351 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:32 smithi121 ceph-mon[81053]: rocksdb: Options.disable_auto_compactions: 0 2024-08-18T22:43:32.351 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:32 smithi121 ceph-mon[81053]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-08-18T22:43:32.351 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:32 smithi121 ceph-mon[81053]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-08-18T22:43:32.351 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:32 smithi121 ceph-mon[81053]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-08-18T22:43:32.351 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:32 smithi121 ceph-mon[81053]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-08-18T22:43:32.351 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:32 smithi121 ceph-mon[81053]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-08-18T22:43:32.351 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:32 smithi121 ceph-mon[81053]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-08-18T22:43:32.351 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:32 smithi121 ceph-mon[81053]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-08-18T22:43:32.351 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:32 smithi121 ceph-mon[81053]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-08-18T22:43:32.352 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:32 smithi121 ceph-mon[81053]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-08-18T22:43:32.352 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:32 smithi121 ceph-mon[81053]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-08-18T22:43:32.352 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:32 smithi121 ceph-mon[81053]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-08-18T22:43:32.352 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:32 smithi121 ceph-mon[81053]: rocksdb: Options.inplace_update_support: 0 2024-08-18T22:43:32.352 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:32 smithi121 ceph-mon[81053]: rocksdb: Options.inplace_update_num_locks: 10000 2024-08-18T22:43:32.352 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:32 smithi121 ceph-mon[81053]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-08-18T22:43:32.352 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:32 smithi121 ceph-mon[81053]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-08-18T22:43:32.352 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:32 smithi121 ceph-mon[81053]: rocksdb: Options.memtable_huge_page_size: 0 2024-08-18T22:43:32.352 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:32 smithi121 ceph-mon[81053]: rocksdb: Options.bloom_locality: 0 2024-08-18T22:43:32.352 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:32 smithi121 ceph-mon[81053]: rocksdb: Options.max_successive_merges: 0 2024-08-18T22:43:32.352 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:32 smithi121 ceph-mon[81053]: rocksdb: Options.optimize_filters_for_hits: 0 2024-08-18T22:43:32.352 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:32 smithi121 ceph-mon[81053]: rocksdb: Options.paranoid_file_checks: 0 2024-08-18T22:43:32.352 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:32 smithi121 ceph-mon[81053]: rocksdb: Options.force_consistency_checks: 1 2024-08-18T22:43:32.352 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:32 smithi121 ceph-mon[81053]: rocksdb: Options.report_bg_io_stats: 0 2024-08-18T22:43:32.352 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:32 smithi121 ceph-mon[81053]: rocksdb: Options.ttl: 2592000 2024-08-18T22:43:32.353 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:32 smithi121 ceph-mon[81053]: rocksdb: Options.periodic_compaction_seconds: 0 2024-08-18T22:43:32.353 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:32 smithi121 ceph-mon[81053]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-08-18T22:43:32.353 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:32 smithi121 ceph-mon[81053]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-08-18T22:43:32.353 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:32 smithi121 ceph-mon[81053]: rocksdb: Options.enable_blob_files: false 2024-08-18T22:43:32.353 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:32 smithi121 ceph-mon[81053]: rocksdb: Options.min_blob_size: 0 2024-08-18T22:43:32.353 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:32 smithi121 ceph-mon[81053]: rocksdb: Options.blob_file_size: 268435456 2024-08-18T22:43:32.353 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:32 smithi121 ceph-mon[81053]: rocksdb: Options.blob_compression_type: NoCompression 2024-08-18T22:43:32.353 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:32 smithi121 ceph-mon[81053]: rocksdb: Options.enable_blob_garbage_collection: false 2024-08-18T22:43:32.353 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:32 smithi121 ceph-mon[81053]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-08-18T22:43:32.353 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:32 smithi121 ceph-mon[81053]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-08-18T22:43:32.353 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:32 smithi121 ceph-mon[81053]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-08-18T22:43:32.353 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:32 smithi121 ceph-mon[81053]: rocksdb: Options.blob_file_starting_level: 0 2024-08-18T22:43:32.353 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:32 smithi121 ceph-mon[81053]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-08-18T22:43:32.353 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:32 smithi121 ceph-mon[81053]: rocksdb: [table/block_based/block_based_table_reader.cc:721] At least one SST file opened without unique ID to verify: 30.sst 2024-08-18T22:43:32.354 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:32 smithi121 ceph-mon[81053]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-08-18T22:43:32.354 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:32 smithi121 ceph-mon[81053]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi121/store.db/MANIFEST-000015 succeeded,manifest_file_number is 15, next_file_number is 32, last_sequence is 10174, log_number is 28,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-08-18T22:43:32.354 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:32 smithi121 ceph-mon[81053]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 28 2024-08-18T22:43:32.354 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:32 smithi121 ceph-mon[81053]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: f0f26910-b19d-4768-825a-e441b4a17c7e 2024-08-18T22:43:32.354 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:32 smithi121 ceph-mon[81053]: rocksdb: EVENT_LOG_v1 {"time_micros": 1724021012238333, "job": 1, "event": "recovery_started", "wal_files": [28]} 2024-08-18T22:43:32.354 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:32 smithi121 ceph-mon[81053]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #28 mode 2 2024-08-18T22:43:32.354 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:32 smithi121 ceph-mon[81053]: rocksdb: EVENT_LOG_v1 {"time_micros": 1724021012246344, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 33, "file_size": 1984639, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 10175, "largest_seqno": 10972, "table_properties": {"data_size": 1980177, "index_size": 2462, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 965, "raw_key_size": 9176, "raw_average_key_size": 24, "raw_value_size": 1971853, "raw_average_value_size": 5189, "num_data_blocks": 112, "num_entries": 380, "num_filter_entries": 380, "num_deletions": 2, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1724021012, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "f0f26910-b19d-4768-825a-e441b4a17c7e", "db_session_id": "YE8WF9DOA62KTGS4B4VA", "orig_file_number": 33, "seqno_to_time_mapping": "N/A"}} 2024-08-18T22:43:32.354 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:32 smithi121 ceph-mon[81053]: rocksdb: EVENT_LOG_v1 {"time_micros": 1724021012246504, "job": 1, "event": "recovery_finished"} 2024-08-18T22:43:32.354 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:32 smithi121 ceph-mon[81053]: rocksdb: [db/version_set.cc:5047] Creating manifest 35 2024-08-18T22:43:32.354 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:32 smithi121 ceph-mon[81053]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-08-18T22:43:32.354 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:32 smithi121 ceph-mon[81053]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-smithi121/store.db/000028.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-08-18T22:43:32.354 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:32 smithi121 ceph-mon[81053]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55f8d2e5ce00 2024-08-18T22:43:32.354 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:32 smithi121 ceph-mon[81053]: rocksdb: DB pointer 0x55f8d2f56000 2024-08-18T22:43:32.355 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:32 smithi121 ceph-mon[81053]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-08-18T22:43:32.355 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:32 smithi121 ceph-mon[81053]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-08-18T22:43:32.355 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout: ** DB Stats ** 2024-08-18T22:43:32.355 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-08-18T22:43:32.355 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-08-18T22:43:32.355 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-08-18T22:43:32.355 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-08-18T22:43:32.355 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-08-18T22:43:32.355 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-08-18T22:43:32.355 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-08-18T22:43:32.355 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout: 2024-08-18T22:43:32.355 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout: ** Compaction Stats [default] ** 2024-08-18T22:43:32.355 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-08-18T22:43:32.355 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-08-18T22:43:32.356 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout: L0 1/0 1.89 MB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 460.3 0.00 0.00 1 0.004 0 0 0.0 0.0 2024-08-18T22:43:32.356 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout: L6 1/0 5.09 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 2024-08-18T22:43:32.356 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout: Sum 2/0 6.98 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 460.3 0.00 0.00 1 0.004 0 0 0.0 0.0 2024-08-18T22:43:32.356 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 460.3 0.00 0.00 1 0.004 0 0 0.0 0.0 2024-08-18T22:43:32.356 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout: 2024-08-18T22:43:32.356 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout: ** Compaction Stats [default] ** 2024-08-18T22:43:32.356 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-08-18T22:43:32.356 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-08-18T22:43:32.356 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 460.3 0.00 0.00 1 0.004 0 0 0.0 0.0 2024-08-18T22:43:32.356 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout: 2024-08-18T22:43:32.356 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-08-18T22:43:32.356 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout: 2024-08-18T22:43:32.356 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-08-18T22:43:32.356 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout: Flush(GB): cumulative 0.002, interval 0.002 2024-08-18T22:43:32.356 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-08-18T22:43:32.357 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-08-18T22:43:32.357 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-08-18T22:43:32.357 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout: AddFile(Keys): cumulative 0, interval 0 2024-08-18T22:43:32.357 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout: Cumulative compaction: 0.00 GB write, 153.74 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-08-18T22:43:32.357 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout: Interval compaction: 0.00 GB write, 153.74 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-08-18T22:43:32.357 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-08-18T22:43:32.357 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout: Block cache BinnedLRUCache@0x55f8d2e2f090#2 capacity: 512.00 MB usage: 3.61 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.1e-05 secs_since: 0 2024-08-18T22:43:32.357 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,1.03 KB,0.000196695%) IndexBlock(1,2.58 KB,0.000491738%) Misc(1,0.00 KB,0%) 2024-08-18T22:43:32.357 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout: 2024-08-18T22:43:32.357 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout: ** File Read Latency Histogram By Level [default] ** 2024-08-18T22:43:32.357 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:32 smithi121 ceph-mon[81053]: starting mon.smithi121 rank 0 at public addrs [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] at bind addrs [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi121 fsid b003123a-5db1-11ef-bccf-c7b262605968 2024-08-18T22:43:32.357 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:32 smithi121 ceph-mon[81053]: mon.smithi121@-1(???) e2 preinit fsid b003123a-5db1-11ef-bccf-c7b262605968 2024-08-18T22:43:32.357 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:32 smithi121 ceph-mon[81053]: mon.smithi121@-1(???).mds e19 new map 2024-08-18T22:43:32.357 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:32 smithi121 ceph-mon[81053]: mon.smithi121@-1(???).mds e19 print_map 2024-08-18T22:43:32.358 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout: e19 2024-08-18T22:43:32.358 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout: btime 1970-01-01T00:00:00:000000+0000 2024-08-18T22:43:32.358 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-08-18T22:43:32.358 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-08-18T22:43:32.358 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout: legacy client fscid: 1 2024-08-18T22:43:32.358 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout: 2024-08-18T22:43:32.358 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout: Filesystem 'cephfs' (1) 2024-08-18T22:43:32.358 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout: fs_name cephfs 2024-08-18T22:43:32.358 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout: epoch 19 2024-08-18T22:43:32.358 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout: flags 12 joinable allow_snaps allow_multimds_snaps 2024-08-18T22:43:32.358 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout: created 2024-08-18T22:39:04.054074+0000 2024-08-18T22:43:32.358 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout: modified 2024-08-18T22:42:16.794905+0000 2024-08-18T22:43:32.358 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout: tableserver 0 2024-08-18T22:43:32.359 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout: root 0 2024-08-18T22:43:32.359 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout: session_timeout 60 2024-08-18T22:43:32.359 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout: session_autoclose 300 2024-08-18T22:43:32.359 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout: max_file_size 1099511627776 2024-08-18T22:43:32.359 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout: max_xattr_size 65536 2024-08-18T22:43:32.359 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout: required_client_features {} 2024-08-18T22:43:32.359 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout: last_failure 0 2024-08-18T22:43:32.359 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout: last_failure_osd_epoch 47 2024-08-18T22:43:32.359 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout: compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-08-18T22:43:32.359 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout: max_mds 2 2024-08-18T22:43:32.359 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout: in 0,1 2024-08-18T22:43:32.359 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout: up {0=14474,1=24249} 2024-08-18T22:43:32.359 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout: failed 2024-08-18T22:43:32.359 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout: damaged 2024-08-18T22:43:32.360 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout: stopped 2024-08-18T22:43:32.360 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout: data_pools [3] 2024-08-18T22:43:32.360 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout: metadata_pool 2 2024-08-18T22:43:32.360 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout: inline_data disabled 2024-08-18T22:43:32.360 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout: balancer 2024-08-18T22:43:32.360 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout: bal_rank_mask -1 2024-08-18T22:43:32.360 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout: standby_count_wanted 1 2024-08-18T22:43:32.360 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout: qdb_cluster leader: 0 members: 2024-08-18T22:43:32.360 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout: [mds.cephfs.smithi121.gbickb{0:14474} state up:active seq 6 export targets 1 join_fscid=1 addr [v2:172.21.15.121:6828/2277706406,v1:172.21.15.121:6829/2277706406] compat {c=[1],r=[1],i=[7ff]}] 2024-08-18T22:43:32.360 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout: [mds.cephfs.smithi195.buqvbr{1:24249} state up:active seq 4 export targets 0 join_fscid=1 addr [v2:172.21.15.195:6824/2414511859,v1:172.21.15.195:6825/2414511859] compat {c=[1],r=[1],i=[7ff]}] 2024-08-18T22:43:32.360 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout: 2024-08-18T22:43:32.360 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout: 2024-08-18T22:43:32.360 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout: Standby daemons: 2024-08-18T22:43:32.360 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout: 2024-08-18T22:43:32.360 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout: [mds.cephfs.smithi121.xuzsdg{-1:14490} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.121:6826/91588128,v1:172.21.15.121:6827/91588128] compat {c=[1],r=[1],i=[7ff]}] 2024-08-18T22:43:32.361 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout: [mds.cephfs.smithi195.nptgyc{-1:24259} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.195:6826/238549847,v1:172.21.15.195:6827/238549847] compat {c=[1],r=[1],i=[7ff]}] 2024-08-18T22:43:32.361 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:32 smithi121 ceph-mon[81053]: mon.smithi121@-1(???).osd e49 crush map has features 3314933000852226048, adjusting msgr requires 2024-08-18T22:43:32.361 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:32 smithi121 ceph-mon[81053]: mon.smithi121@-1(???).osd e49 crush map has features 288514051259236352, adjusting msgr requires 2024-08-18T22:43:32.361 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:32 smithi121 ceph-mon[81053]: mon.smithi121@-1(???).osd e49 crush map has features 288514051259236352, adjusting msgr requires 2024-08-18T22:43:32.361 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:32 smithi121 ceph-mon[81053]: mon.smithi121@-1(???).osd e49 crush map has features 288514051259236352, adjusting msgr requires 2024-08-18T22:43:32.361 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:32 smithi121 ceph-mon[81053]: mon.smithi121@-1(???).paxosservice(auth 1..20) refresh upgraded, format 0 -> 3 2024-08-18T22:43:32.361 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:32 smithi121 bash[81034]: d71695a4fb56e5aee853ed2634967de22964c5047716447f055b737a82b6e55e 2024-08-18T22:43:32.361 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:32 smithi121 systemd[1]: Started Ceph mon.smithi121 for b003123a-5db1-11ef-bccf-c7b262605968. 2024-08-18T22:43:33.833 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:33 smithi121 ceph-mon[81053]: from='mgr.14702 172.21.15.121:0/3084939281' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "mon metadata", "id": "smithi121"}]: dispatch 2024-08-18T22:43:33.834 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:33 smithi121 ceph-mon[81053]: from='mgr.14702 172.21.15.121:0/3084939281' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "mon metadata", "id": "smithi195"}]: dispatch 2024-08-18T22:43:33.834 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:33 smithi121 ceph-mon[81053]: from='mgr.14702 172.21.15.121:0/3084939281' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-18T22:43:33.834 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:33 smithi121 ceph-mon[81053]: pgmap v19: 65 pgs: 65 active+clean; 2.0 GiB data, 7.5 GiB used, 529 GiB / 536 GiB avail 2024-08-18T22:43:33.834 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:33 smithi121 ceph-mon[81053]: mon.smithi121 calling monitor election 2024-08-18T22:43:33.834 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:33 smithi121 ceph-mon[81053]: mon.smithi121 is new leader, mons smithi121,smithi195 in quorum (ranks 0,1) 2024-08-18T22:43:33.834 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:33 smithi121 ceph-mon[81053]: monmap epoch 2 2024-08-18T22:43:33.834 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:33 smithi121 ceph-mon[81053]: fsid b003123a-5db1-11ef-bccf-c7b262605968 2024-08-18T22:43:33.834 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:33 smithi121 ceph-mon[81053]: last_changed 2024-08-18T22:35:01.759705+0000 2024-08-18T22:43:33.834 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:33 smithi121 ceph-mon[81053]: created 2024-08-18T22:32:38.034362+0000 2024-08-18T22:43:33.834 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:33 smithi121 ceph-mon[81053]: min_mon_release 17 (quincy) 2024-08-18T22:43:33.835 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:33 smithi121 ceph-mon[81053]: election_strategy: 1 2024-08-18T22:43:33.835 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:33 smithi121 ceph-mon[81053]: 0: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.smithi121 2024-08-18T22:43:33.835 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:33 smithi121 ceph-mon[81053]: 1: [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] mon.smithi195 2024-08-18T22:43:33.835 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:33 smithi121 ceph-mon[81053]: fsmap cephfs:2 {0=cephfs.smithi121.gbickb=up:active,1=cephfs.smithi195.buqvbr=up:active} 2 up:standby 2024-08-18T22:43:33.835 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:33 smithi121 ceph-mon[81053]: osdmap e49: 6 total, 6 up, 6 in 2024-08-18T22:43:33.835 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:33 smithi121 ceph-mon[81053]: mgrmap e31: smithi121.lopxqc(active, since 33s), standbys: smithi195.acttsj 2024-08-18T22:43:33.835 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:33 smithi121 ceph-mon[81053]: overall HEALTH_OK 2024-08-18T22:43:33.835 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:33 smithi121 ceph-mon[81053]: from='mgr.14702 ' entity='' 2024-08-18T22:43:33.835 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:33 smithi121 ceph-mon[81053]: mgrmap e32: smithi121.lopxqc(active, since 33s), standbys: smithi195.acttsj 2024-08-18T22:43:33.983 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:33 smithi195 ceph-mon[23370]: from='mgr.14702 172.21.15.121:0/3084939281' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "mon metadata", "id": "smithi121"}]: dispatch 2024-08-18T22:43:33.984 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:33 smithi195 ceph-mon[23370]: from='mgr.14702 172.21.15.121:0/3084939281' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "mon metadata", "id": "smithi195"}]: dispatch 2024-08-18T22:43:33.984 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:33 smithi195 ceph-mon[23370]: from='mgr.14702 172.21.15.121:0/3084939281' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-18T22:43:33.984 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:33 smithi195 ceph-mon[23370]: pgmap v19: 65 pgs: 65 active+clean; 2.0 GiB data, 7.5 GiB used, 529 GiB / 536 GiB avail 2024-08-18T22:43:33.984 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:33 smithi195 ceph-mon[23370]: mon.smithi121 calling monitor election 2024-08-18T22:43:33.984 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:33 smithi195 ceph-mon[23370]: mon.smithi121 is new leader, mons smithi121,smithi195 in quorum (ranks 0,1) 2024-08-18T22:43:33.984 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:33 smithi195 ceph-mon[23370]: monmap epoch 2 2024-08-18T22:43:33.984 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:33 smithi195 ceph-mon[23370]: fsid b003123a-5db1-11ef-bccf-c7b262605968 2024-08-18T22:43:33.984 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:33 smithi195 ceph-mon[23370]: last_changed 2024-08-18T22:35:01.759705+0000 2024-08-18T22:43:33.984 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:33 smithi195 ceph-mon[23370]: created 2024-08-18T22:32:38.034362+0000 2024-08-18T22:43:33.984 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:33 smithi195 ceph-mon[23370]: min_mon_release 17 (quincy) 2024-08-18T22:43:33.984 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:33 smithi195 ceph-mon[23370]: election_strategy: 1 2024-08-18T22:43:33.984 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:33 smithi195 ceph-mon[23370]: 0: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.smithi121 2024-08-18T22:43:33.985 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:33 smithi195 ceph-mon[23370]: 1: [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] mon.smithi195 2024-08-18T22:43:33.985 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:33 smithi195 ceph-mon[23370]: fsmap cephfs:2 {0=cephfs.smithi121.gbickb=up:active,1=cephfs.smithi195.buqvbr=up:active} 2 up:standby 2024-08-18T22:43:33.985 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:33 smithi195 ceph-mon[23370]: osdmap e49: 6 total, 6 up, 6 in 2024-08-18T22:43:33.985 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:33 smithi195 ceph-mon[23370]: mgrmap e31: smithi121.lopxqc(active, since 33s), standbys: smithi195.acttsj 2024-08-18T22:43:33.985 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:33 smithi195 ceph-mon[23370]: overall HEALTH_OK 2024-08-18T22:43:33.985 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:33 smithi195 ceph-mon[23370]: from='mgr.14702 ' entity='' 2024-08-18T22:43:33.985 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:33 smithi195 ceph-mon[23370]: mgrmap e32: smithi121.lopxqc(active, since 33s), standbys: smithi195.acttsj 2024-08-18T22:43:38.760 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:38 smithi195 ceph-mon[23370]: Standby manager daemon smithi195.acttsj restarted 2024-08-18T22:43:38.760 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:38 smithi195 ceph-mon[23370]: Standby manager daemon smithi195.acttsj started 2024-08-18T22:43:38.760 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:38 smithi195 ceph-mon[23370]: Active manager daemon smithi121.lopxqc restarted 2024-08-18T22:43:38.760 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:38 smithi195 ceph-mon[23370]: Activating manager daemon smithi121.lopxqc 2024-08-18T22:43:38.760 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:38 smithi195 ceph-mon[23370]: from='mgr.? 172.21.15.195:0/596552522' entity='mgr.smithi195.acttsj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi195.acttsj/crt"}]: dispatch 2024-08-18T22:43:38.760 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:38 smithi195 ceph-mon[23370]: from='mgr.? 172.21.15.195:0/596552522' entity='mgr.smithi195.acttsj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-08-18T22:43:38.760 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:38 smithi195 ceph-mon[23370]: osdmap e50: 6 total, 6 up, 6 in 2024-08-18T22:43:38.761 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:38 smithi195 ceph-mon[23370]: mgrmap e33: smithi121.lopxqc(active, starting, since 0.00560351s), standbys: smithi195.acttsj 2024-08-18T22:43:38.761 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:38 smithi195 ceph-mon[23370]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "mon metadata", "id": "smithi121"}]: dispatch 2024-08-18T22:43:38.761 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:38 smithi195 ceph-mon[23370]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "mon metadata", "id": "smithi195"}]: dispatch 2024-08-18T22:43:38.761 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:38 smithi195 ceph-mon[23370]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi121.gbickb"}]: dispatch 2024-08-18T22:43:38.761 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:38 smithi195 ceph-mon[23370]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi121.xuzsdg"}]: dispatch 2024-08-18T22:43:38.761 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:38 smithi195 ceph-mon[23370]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi195.buqvbr"}]: dispatch 2024-08-18T22:43:38.761 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:38 smithi195 ceph-mon[23370]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi195.nptgyc"}]: dispatch 2024-08-18T22:43:38.761 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:38 smithi195 ceph-mon[23370]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "mgr metadata", "who": "smithi121.lopxqc", "id": "smithi121.lopxqc"}]: dispatch 2024-08-18T22:43:38.761 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:38 smithi195 ceph-mon[23370]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "mgr metadata", "who": "smithi195.acttsj", "id": "smithi195.acttsj"}]: dispatch 2024-08-18T22:43:38.761 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:38 smithi195 ceph-mon[23370]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-08-18T22:43:38.761 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:38 smithi195 ceph-mon[23370]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-08-18T22:43:38.761 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:38 smithi195 ceph-mon[23370]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-08-18T22:43:38.761 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:38 smithi195 ceph-mon[23370]: from='mgr.? 172.21.15.195:0/596552522' entity='mgr.smithi195.acttsj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi195.acttsj/key"}]: dispatch 2024-08-18T22:43:38.762 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:38 smithi195 ceph-mon[23370]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-08-18T22:43:38.762 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:38 smithi195 ceph-mon[23370]: from='mgr.? 172.21.15.195:0/596552522' entity='mgr.smithi195.acttsj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-08-18T22:43:38.762 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:38 smithi195 ceph-mon[23370]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-08-18T22:43:38.762 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:38 smithi195 ceph-mon[23370]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-08-18T22:43:38.762 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:38 smithi195 ceph-mon[23370]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-08-18T22:43:38.762 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:38 smithi195 ceph-mon[23370]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-08-18T22:43:38.762 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:38 smithi195 ceph-mon[23370]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-08-18T22:43:38.762 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:38 smithi195 ceph-mon[23370]: Manager daemon smithi121.lopxqc is now available 2024-08-18T22:43:38.762 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:38 smithi195 ceph-mon[23370]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-18T22:43:38.834 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:38 smithi121 ceph-mon[81053]: Standby manager daemon smithi195.acttsj restarted 2024-08-18T22:43:38.834 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:38 smithi121 ceph-mon[81053]: Standby manager daemon smithi195.acttsj started 2024-08-18T22:43:38.834 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:38 smithi121 ceph-mon[81053]: Active manager daemon smithi121.lopxqc restarted 2024-08-18T22:43:38.835 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:38 smithi121 ceph-mon[81053]: Activating manager daemon smithi121.lopxqc 2024-08-18T22:43:38.835 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:38 smithi121 ceph-mon[81053]: from='mgr.? 172.21.15.195:0/596552522' entity='mgr.smithi195.acttsj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi195.acttsj/crt"}]: dispatch 2024-08-18T22:43:38.835 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:38 smithi121 ceph-mon[81053]: from='mgr.? 172.21.15.195:0/596552522' entity='mgr.smithi195.acttsj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-08-18T22:43:38.835 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:38 smithi121 ceph-mon[81053]: osdmap e50: 6 total, 6 up, 6 in 2024-08-18T22:43:38.836 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:38 smithi121 ceph-mon[81053]: mgrmap e33: smithi121.lopxqc(active, starting, since 0.00560351s), standbys: smithi195.acttsj 2024-08-18T22:43:38.836 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:38 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "mon metadata", "id": "smithi121"}]: dispatch 2024-08-18T22:43:38.836 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:38 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "mon metadata", "id": "smithi195"}]: dispatch 2024-08-18T22:43:38.836 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:38 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi121.gbickb"}]: dispatch 2024-08-18T22:43:38.836 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:38 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi121.xuzsdg"}]: dispatch 2024-08-18T22:43:38.836 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:38 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi195.buqvbr"}]: dispatch 2024-08-18T22:43:38.836 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:38 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi195.nptgyc"}]: dispatch 2024-08-18T22:43:38.836 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:38 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "mgr metadata", "who": "smithi121.lopxqc", "id": "smithi121.lopxqc"}]: dispatch 2024-08-18T22:43:38.836 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:38 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "mgr metadata", "who": "smithi195.acttsj", "id": "smithi195.acttsj"}]: dispatch 2024-08-18T22:43:38.836 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:38 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-08-18T22:43:38.836 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:38 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-08-18T22:43:38.836 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:38 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-08-18T22:43:38.836 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:38 smithi121 ceph-mon[81053]: from='mgr.? 172.21.15.195:0/596552522' entity='mgr.smithi195.acttsj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi195.acttsj/key"}]: dispatch 2024-08-18T22:43:38.837 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:38 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-08-18T22:43:38.837 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:38 smithi121 ceph-mon[81053]: from='mgr.? 172.21.15.195:0/596552522' entity='mgr.smithi195.acttsj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-08-18T22:43:38.837 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:38 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-08-18T22:43:38.837 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:38 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-08-18T22:43:38.837 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:38 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-08-18T22:43:38.837 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:38 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-08-18T22:43:38.837 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:38 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-08-18T22:43:38.838 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:38 smithi121 ceph-mon[81053]: Manager daemon smithi121.lopxqc is now available 2024-08-18T22:43:38.838 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:38 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-18T22:43:39.773 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:39 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-18T22:43:39.773 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:39 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi121.lopxqc/mirror_snapshot_schedule"}]: dispatch 2024-08-18T22:43:39.773 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:39 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi121.lopxqc/trash_purge_schedule"}]: dispatch 2024-08-18T22:43:39.773 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:39 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:43:39.774 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:39 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:43:39.774 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:39 smithi121 ceph-mon[81053]: mgrmap e34: smithi121.lopxqc(active, since 1.00949s), standbys: smithi195.acttsj 2024-08-18T22:43:39.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:39 smithi195 ceph-mon[23370]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-18T22:43:39.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:39 smithi195 ceph-mon[23370]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi121.lopxqc/mirror_snapshot_schedule"}]: dispatch 2024-08-18T22:43:39.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:39 smithi195 ceph-mon[23370]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi121.lopxqc/trash_purge_schedule"}]: dispatch 2024-08-18T22:43:39.910 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:39 smithi195 ceph-mon[23370]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:43:39.910 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:39 smithi195 ceph-mon[23370]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:43:39.910 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:39 smithi195 ceph-mon[23370]: mgrmap e34: smithi121.lopxqc(active, since 1.00949s), standbys: smithi195.acttsj 2024-08-18T22:43:40.833 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:40 smithi121 ceph-mon[81053]: [18/Aug/2024:22:43:39] ENGINE Bus STARTING 2024-08-18T22:43:40.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:40 smithi195 ceph-mon[23370]: [18/Aug/2024:22:43:39] ENGINE Bus STARTING 2024-08-18T22:43:41.834 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:41 smithi121 ceph-mon[81053]: [18/Aug/2024:22:43:39] ENGINE Serving on https://172.21.15.121:7150 2024-08-18T22:43:41.834 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:41 smithi121 ceph-mon[81053]: [18/Aug/2024:22:43:39] ENGINE Error in HTTPServer.serve 2024-08-18T22:43:41.834 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout: Traceback (most recent call last): 2024-08-18T22:43:41.834 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-08-18T22:43:41.834 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout: self._connections.run(self.expiration_interval) 2024-08-18T22:43:41.835 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-08-18T22:43:41.835 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout: self._run(expiration_interval) 2024-08-18T22:43:41.835 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-08-18T22:43:41.835 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-08-18T22:43:41.835 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-08-18T22:43:41.835 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-08-18T22:43:41.835 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-08-18T22:43:41.835 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout: s = self.context.wrap_socket( 2024-08-18T22:43:41.835 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-08-18T22:43:41.835 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout: return self.sslsocket_class._create( 2024-08-18T22:43:41.835 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-08-18T22:43:41.835 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout: self.do_handshake() 2024-08-18T22:43:41.835 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-08-18T22:43:41.835 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout: self._sslobj.do_handshake() 2024-08-18T22:43:41.836 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-08-18T22:43:41.836 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:41 smithi121 ceph-mon[81053]: [18/Aug/2024:22:43:39] ENGINE Serving on http://172.21.15.121:8765 2024-08-18T22:43:41.836 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:41 smithi121 ceph-mon[81053]: [18/Aug/2024:22:43:39] ENGINE Bus STARTED 2024-08-18T22:43:41.836 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:41 smithi121 ceph-mon[81053]: pgmap v4: 65 pgs: 65 active+clean; 2.0 GiB data, 7.5 GiB used, 529 GiB / 536 GiB avail 2024-08-18T22:43:41.836 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:41 smithi121 ceph-mon[81053]: mgrmap e35: smithi121.lopxqc(active, since 2s), standbys: smithi195.acttsj 2024-08-18T22:43:41.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:41 smithi195 ceph-mon[23370]: [18/Aug/2024:22:43:39] ENGINE Serving on https://172.21.15.121:7150 2024-08-18T22:43:41.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:41 smithi195 ceph-mon[23370]: [18/Aug/2024:22:43:39] ENGINE Error in HTTPServer.serve 2024-08-18T22:43:41.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: Traceback (most recent call last): 2024-08-18T22:43:41.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-08-18T22:43:41.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: self._connections.run(self.expiration_interval) 2024-08-18T22:43:41.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-08-18T22:43:41.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: self._run(expiration_interval) 2024-08-18T22:43:41.910 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-08-18T22:43:41.910 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-08-18T22:43:41.910 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-08-18T22:43:41.910 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-08-18T22:43:41.910 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-08-18T22:43:41.910 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: s = self.context.wrap_socket( 2024-08-18T22:43:41.910 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-08-18T22:43:41.910 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: return self.sslsocket_class._create( 2024-08-18T22:43:41.910 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-08-18T22:43:41.910 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: self.do_handshake() 2024-08-18T22:43:41.910 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-08-18T22:43:41.910 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: self._sslobj.do_handshake() 2024-08-18T22:43:41.910 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-08-18T22:43:41.910 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:41 smithi195 ceph-mon[23370]: [18/Aug/2024:22:43:39] ENGINE Serving on http://172.21.15.121:8765 2024-08-18T22:43:41.911 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:41 smithi195 ceph-mon[23370]: [18/Aug/2024:22:43:39] ENGINE Bus STARTED 2024-08-18T22:43:41.911 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:41 smithi195 ceph-mon[23370]: pgmap v4: 65 pgs: 65 active+clean; 2.0 GiB data, 7.5 GiB used, 529 GiB / 536 GiB avail 2024-08-18T22:43:41.911 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:41 smithi195 ceph-mon[23370]: mgrmap e35: smithi121.lopxqc(active, since 2s), standbys: smithi195.acttsj 2024-08-18T22:43:42.860 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:42 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:43:42.860 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:42 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:43:42.860 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:42 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:43:42.860 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:42 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:43:42.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:42 smithi195 ceph-mon[23370]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:43:42.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:42 smithi195 ceph-mon[23370]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:43:42.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:42 smithi195 ceph-mon[23370]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:43:42.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:42 smithi195 ceph-mon[23370]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:43:43.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:43 smithi195 ceph-mon[23370]: pgmap v5: 65 pgs: 65 active+clean; 2.0 GiB data, 7.5 GiB used, 529 GiB / 536 GiB avail 2024-08-18T22:43:43.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:43 smithi195 ceph-mon[23370]: mgrmap e36: smithi121.lopxqc(active, since 4s), standbys: smithi195.acttsj 2024-08-18T22:43:44.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:43 smithi121 ceph-mon[81053]: pgmap v5: 65 pgs: 65 active+clean; 2.0 GiB data, 7.5 GiB used, 529 GiB / 536 GiB avail 2024-08-18T22:43:44.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:43 smithi121 ceph-mon[81053]: mgrmap e36: smithi121.lopxqc(active, since 4s), standbys: smithi195.acttsj 2024-08-18T22:43:45.317 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:45 smithi195 ceph-mon[23370]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:43:45.317 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:45 smithi195 ceph-mon[23370]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:43:45.317 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:45 smithi195 ceph-mon[23370]: pgmap v6: 65 pgs: 65 active+clean; 2.0 GiB data, 7.5 GiB used, 529 GiB / 536 GiB avail 2024-08-18T22:43:45.317 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:45 smithi195 ceph-mon[23370]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:43:45.318 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:45 smithi195 ceph-mon[23370]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:43:45.333 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:45 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:43:45.333 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:45 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:43:45.333 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:45 smithi121 ceph-mon[81053]: pgmap v6: 65 pgs: 65 active+clean; 2.0 GiB data, 7.5 GiB used, 529 GiB / 536 GiB avail 2024-08-18T22:43:45.333 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:45 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:43:45.333 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:45 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:43:46.659 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:46 smithi195 ceph-mon[23370]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:43:46.659 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:46 smithi195 ceph-mon[23370]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:43:46.659 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:46 smithi195 ceph-mon[23370]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:43:46.659 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:46 smithi195 ceph-mon[23370]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-18T22:43:46.659 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:46 smithi195 ceph-mon[23370]: Updating smithi121:/etc/ceph/ceph.conf 2024-08-18T22:43:46.659 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:46 smithi195 ceph-mon[23370]: Updating smithi195:/etc/ceph/ceph.conf 2024-08-18T22:43:46.660 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:46 smithi195 ceph-mon[23370]: Updating smithi121:/var/lib/ceph/b003123a-5db1-11ef-bccf-c7b262605968/config/ceph.conf 2024-08-18T22:43:46.660 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:46 smithi195 ceph-mon[23370]: Updating smithi195:/var/lib/ceph/b003123a-5db1-11ef-bccf-c7b262605968/config/ceph.conf 2024-08-18T22:43:46.660 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:46 smithi195 ceph-mon[23370]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:43:46.660 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:46 smithi195 ceph-mon[23370]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:43:46.660 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:46 smithi195 ceph-mon[23370]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:43:46.660 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:46 smithi195 ceph-mon[23370]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:43:46.660 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:46 smithi195 ceph-mon[23370]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:43:46.660 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:46 smithi195 ceph-mon[23370]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-18T22:43:46.660 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:46 smithi195 ceph-mon[23370]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "versions"}]: dispatch 2024-08-18T22:43:46.660 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:46 smithi195 ceph-mon[23370]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-08-18T22:43:46.833 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:46 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:43:46.834 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:46 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:43:46.834 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:46 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:43:46.834 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:46 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-18T22:43:46.834 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:46 smithi121 ceph-mon[81053]: Updating smithi121:/etc/ceph/ceph.conf 2024-08-18T22:43:46.834 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:46 smithi121 ceph-mon[81053]: Updating smithi195:/etc/ceph/ceph.conf 2024-08-18T22:43:46.834 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:46 smithi121 ceph-mon[81053]: Updating smithi121:/var/lib/ceph/b003123a-5db1-11ef-bccf-c7b262605968/config/ceph.conf 2024-08-18T22:43:46.834 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:46 smithi121 ceph-mon[81053]: Updating smithi195:/var/lib/ceph/b003123a-5db1-11ef-bccf-c7b262605968/config/ceph.conf 2024-08-18T22:43:46.834 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:46 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:43:46.834 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:46 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:43:46.834 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:46 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:43:46.835 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:46 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:43:46.835 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:46 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:43:46.835 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:46 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-18T22:43:46.835 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:46 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "versions"}]: dispatch 2024-08-18T22:43:46.835 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:46 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-08-18T22:43:47.627 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:47 smithi195 ceph-mon[23370]: Updating smithi121:/etc/ceph/ceph.client.admin.keyring 2024-08-18T22:43:47.627 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:47 smithi195 ceph-mon[23370]: Updating smithi195:/etc/ceph/ceph.client.admin.keyring 2024-08-18T22:43:47.627 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:47 smithi195 ceph-mon[23370]: Updating smithi121:/var/lib/ceph/b003123a-5db1-11ef-bccf-c7b262605968/config/ceph.client.admin.keyring 2024-08-18T22:43:47.627 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:47 smithi195 ceph-mon[23370]: Updating smithi195:/var/lib/ceph/b003123a-5db1-11ef-bccf-c7b262605968/config/ceph.client.admin.keyring 2024-08-18T22:43:47.627 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:47 smithi195 ceph-mon[23370]: pgmap v7: 65 pgs: 65 active+clean; 2.0 GiB data, 7.5 GiB used, 529 GiB / 536 GiB avail; 29 KiB/s rd, 0 B/s wr, 16 op/s 2024-08-18T22:43:47.833 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:47 smithi121 ceph-mon[81053]: Updating smithi121:/etc/ceph/ceph.client.admin.keyring 2024-08-18T22:43:47.834 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:47 smithi121 ceph-mon[81053]: Updating smithi195:/etc/ceph/ceph.client.admin.keyring 2024-08-18T22:43:47.834 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:47 smithi121 ceph-mon[81053]: Updating smithi121:/var/lib/ceph/b003123a-5db1-11ef-bccf-c7b262605968/config/ceph.client.admin.keyring 2024-08-18T22:43:47.834 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:47 smithi121 ceph-mon[81053]: Updating smithi195:/var/lib/ceph/b003123a-5db1-11ef-bccf-c7b262605968/config/ceph.client.admin.keyring 2024-08-18T22:43:47.834 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:47 smithi121 ceph-mon[81053]: pgmap v7: 65 pgs: 65 active+clean; 2.0 GiB data, 7.5 GiB used, 529 GiB / 536 GiB avail; 29 KiB/s rd, 0 B/s wr, 16 op/s 2024-08-18T22:43:48.942 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:48 smithi195 ceph-mon[23370]: Upgrade: Updating mon.smithi195 2024-08-18T22:43:48.942 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:48 smithi195 ceph-mon[23370]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:43:48.942 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:48 smithi195 ceph-mon[23370]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-08-18T22:43:48.942 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:48 smithi195 ceph-mon[23370]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-08-18T22:43:48.942 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:48 smithi195 ceph-mon[23370]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:43:48.942 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:48 smithi195 ceph-mon[23370]: Deploying daemon mon.smithi195 on smithi195 2024-08-18T22:43:49.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:48 smithi121 ceph-mon[81053]: Upgrade: Updating mon.smithi195 2024-08-18T22:43:49.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:48 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:43:49.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:48 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-08-18T22:43:49.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:48 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-08-18T22:43:49.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:48 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:43:49.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:48 smithi121 ceph-mon[81053]: Deploying daemon mon.smithi195 on smithi195 2024-08-18T22:43:49.499 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:49.495+0000 7fd7d6d99640 1 -- 172.21.15.121:0/3905741887 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd7d00fd5a0 msgr2=0x7fd7d00fda10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:43:49.500 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:49.495+0000 7fd7d6d99640 1 --2- 172.21.15.121:0/3905741887 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd7d00fd5a0 0x7fd7d00fda10 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fd7c40048d0 tx=0x7fd7c4009da0 comp rx=0 tx=0).stop 2024-08-18T22:43:49.500 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:49.495+0000 7fd7d6d99640 1 -- 172.21.15.121:0/3905741887 shutdown_connections 2024-08-18T22:43:49.500 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:49.495+0000 7fd7d6d99640 1 --2- 172.21.15.121:0/3905741887 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd7d00fd5a0 0x7fd7d00fda10 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:43:49.500 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:49.495+0000 7fd7d6d99640 1 --2- 172.21.15.121:0/3905741887 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd7d00fc2d0 0x7fd7d00fc6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:43:49.500 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:49.495+0000 7fd7d6d99640 1 -- 172.21.15.121:0/3905741887 >> 172.21.15.121:0/3905741887 conn(0x7fd7d00f7ab0 msgr2=0x7fd7d00f9ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:43:49.500 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:49.495+0000 7fd7d6d99640 1 -- 172.21.15.121:0/3905741887 shutdown_connections 2024-08-18T22:43:49.501 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:49.495+0000 7fd7d6d99640 1 -- 172.21.15.121:0/3905741887 wait complete. 2024-08-18T22:43:49.501 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:49.495+0000 7fd7d6d99640 1 Processor -- start 2024-08-18T22:43:49.501 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:49.495+0000 7fd7d6d99640 1 -- start start 2024-08-18T22:43:49.501 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:49.496+0000 7fd7d6d99640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd7d00fc2d0 0x7fd7d010cea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:43:49.501 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:49.496+0000 7fd7d6d99640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd7d00fd5a0 0x7fd7d010d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:43:49.501 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:49.496+0000 7fd7d6d99640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7d010e250 con 0x7fd7d00fc2d0 2024-08-18T22:43:49.501 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:49.496+0000 7fd7d6d99640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7d010e3c0 con 0x7fd7d00fd5a0 2024-08-18T22:43:49.501 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:49.496+0000 7fd7d4b35640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd7d00fc2d0 0x7fd7d010cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:43:49.501 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:49.496+0000 7fd7d4b35640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd7d00fc2d0 0x7fd7d010cea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:53426/0 (socket says 172.21.15.121:53426) 2024-08-18T22:43:49.501 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:49.496+0000 7fd7d4b35640 1 -- 172.21.15.121:0/1916477728 learned_addr learned my addr 172.21.15.121:0/1916477728 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-18T22:43:49.502 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:49.496+0000 7fd7cffff640 1 -- 172.21.15.121:0/1916477728 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd7d00fd5a0 msgr2=0x7fd7d010d3e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.195:3300/0 2024-08-18T22:43:49.502 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:49.496+0000 7fd7cffff640 1 --2- 172.21.15.121:0/1916477728 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd7d00fd5a0 0x7fd7d010d3e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-18T22:43:49.502 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:49.496+0000 7fd7d4b35640 1 -- 172.21.15.121:0/1916477728 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd7d00fd5a0 msgr2=0x7fd7d010d3e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-18T22:43:49.502 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:49.496+0000 7fd7d4b35640 1 --2- 172.21.15.121:0/1916477728 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd7d00fd5a0 0x7fd7d010d3e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:43:49.502 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:49.496+0000 7fd7d4b35640 1 -- 172.21.15.121:0/1916477728 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7c4005040 con 0x7fd7d00fc2d0 2024-08-18T22:43:49.502 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:49.496+0000 7fd7d4b35640 1 --2- 172.21.15.121:0/1916477728 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd7d00fc2d0 0x7fd7d010cea0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fd7c000b560 tx=0x7fd7c00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:43:49.502 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:49.497+0000 7fd7cd7fa640 1 -- 172.21.15.121:0/1916477728 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd7c0010790 con 0x7fd7d00fc2d0 2024-08-18T22:43:49.503 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:49.497+0000 7fd7cd7fa640 1 -- 172.21.15.121:0/1916477728 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fd7c0010d90 con 0x7fd7d00fc2d0 2024-08-18T22:43:49.503 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:49.497+0000 7fd7cd7fa640 1 -- 172.21.15.121:0/1916477728 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd7c000f300 con 0x7fd7d00fc2d0 2024-08-18T22:43:49.503 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:49.497+0000 7fd7d6d99640 1 -- 172.21.15.121:0/1916477728 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7d010e6a0 con 0x7fd7d00fc2d0 2024-08-18T22:43:49.503 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:49.497+0000 7fd7d6d99640 1 -- 172.21.15.121:0/1916477728 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7d010ec40 con 0x7fd7d00fc2d0 2024-08-18T22:43:49.504 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:49.498+0000 7fd7d6d99640 1 -- 172.21.15.121:0/1916477728 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7d00fb730 con 0x7fd7d00fc2d0 2024-08-18T22:43:49.504 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:49.498+0000 7fd7cd7fa640 1 -- 172.21.15.121:0/1916477728 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 36) v1 ==== 92307+0+0 (secure 0 0 0) 0x7fd7c0011440 con 0x7fd7d00fc2d0 2024-08-18T22:43:49.505 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:49.498+0000 7fd7cd7fa640 1 --2- 172.21.15.121:0/1916477728 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7fd7b806e120 0x7fd7b80705d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:43:49.505 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:49.499+0000 7fd7cd7fa640 1 -- 172.21.15.121:0/1916477728 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6496+0+0 (secure 0 0 0) 0x7fd7c008def0 con 0x7fd7d00fc2d0 2024-08-18T22:43:49.505 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:49.499+0000 7fd7cffff640 1 --2- 172.21.15.121:0/1916477728 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7fd7b806e120 0x7fd7b80705d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:43:49.505 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:49.499+0000 7fd7cffff640 1 --2- 172.21.15.121:0/1916477728 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7fd7b806e120 0x7fd7b80705d0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fd7c4007ac0 tx=0x7fd7c4009da0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:43:49.506 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:49.503+0000 7fd7cd7fa640 1 -- 172.21.15.121:0/1916477728 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7fd7c0057190 con 0x7fd7d00fc2d0 2024-08-18T22:43:49.657 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:49 smithi195 systemd[1]: Stopping Ceph mon.smithi195 for b003123a-5db1-11ef-bccf-c7b262605968... 2024-08-18T22:43:49.657 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:49 smithi195 ceph-b003123a-5db1-11ef-bccf-c7b262605968-mon-smithi195[23355]: 2024-08-18T22:43:49.462+0000 7fced635e640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi195 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-08-18T22:43:49.657 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:49 smithi195 ceph-b003123a-5db1-11ef-bccf-c7b262605968-mon-smithi195[23355]: 2024-08-18T22:43:49.462+0000 7fced635e640 -1 mon.smithi195@1(peon) e2 *** Got Signal Terminated *** 2024-08-18T22:43:49.691 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:49.689+0000 7fd7d6d99640 1 -- 172.21.15.121:0/1916477728 --> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fd7d010eeb0 con 0x7fd7b806e120 2024-08-18T22:43:49.692 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:49.690+0000 7fd7cd7fa640 1 -- 172.21.15.121:0/1916477728 <== mgr.34102 v2:172.21.15.121:6800/3037387239 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+368 (secure 0 0 0) 0x7fd7d010eeb0 con 0x7fd7b806e120 2024-08-18T22:43:49.694 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:49.692+0000 7fd7d6d99640 1 -- 172.21.15.121:0/1916477728 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7fd7b806e120 msgr2=0x7fd7b80705d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:43:49.694 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:49.692+0000 7fd7d6d99640 1 --2- 172.21.15.121:0/1916477728 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7fd7b806e120 0x7fd7b80705d0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fd7c4007ac0 tx=0x7fd7c4009da0 comp rx=0 tx=0).stop 2024-08-18T22:43:49.694 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:49.692+0000 7fd7d6d99640 1 -- 172.21.15.121:0/1916477728 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd7d00fc2d0 msgr2=0x7fd7d010cea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:43:49.695 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:49.692+0000 7fd7d6d99640 1 --2- 172.21.15.121:0/1916477728 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd7d00fc2d0 0x7fd7d010cea0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fd7c000b560 tx=0x7fd7c00091a0 comp rx=0 tx=0).stop 2024-08-18T22:43:49.695 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:49.692+0000 7fd7d6d99640 1 -- 172.21.15.121:0/1916477728 shutdown_connections 2024-08-18T22:43:49.695 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:49.692+0000 7fd7d6d99640 1 --2- 172.21.15.121:0/1916477728 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7fd7b806e120 0x7fd7b80705d0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:43:49.695 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:49.692+0000 7fd7d6d99640 1 --2- 172.21.15.121:0/1916477728 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd7d00fd5a0 0x7fd7d010d3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:43:49.695 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:49.692+0000 7fd7d6d99640 1 --2- 172.21.15.121:0/1916477728 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd7d00fc2d0 0x7fd7d010cea0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:43:49.695 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:49.692+0000 7fd7d6d99640 1 -- 172.21.15.121:0/1916477728 >> 172.21.15.121:0/1916477728 conn(0x7fd7d00f7ab0 msgr2=0x7fd7d00f9280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:43:49.695 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:49.692+0000 7fd7d6d99640 1 -- 172.21.15.121:0/1916477728 shutdown_connections 2024-08-18T22:43:49.695 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:49.692+0000 7fd7d6d99640 1 -- 172.21.15.121:0/1916477728 wait complete. 2024-08-18T22:43:49.703 INFO:teuthology.orchestra.run.smithi121.stdout:true 2024-08-18T22:43:49.774 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:49.771+0000 7f4ebe3db640 1 -- 172.21.15.121:0/3718377564 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4eb80664b0 msgr2=0x7f4eb80fef00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:43:49.774 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:49.771+0000 7f4ebe3db640 1 --2- 172.21.15.121:0/3718377564 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4eb80664b0 0x7f4eb80fef00 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f4ea80048d0 tx=0x7f4ea8009da0 comp rx=0 tx=0).stop 2024-08-18T22:43:49.774 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:49.771+0000 7f4ebe3db640 1 -- 172.21.15.121:0/3718377564 shutdown_connections 2024-08-18T22:43:49.774 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:49.771+0000 7f4ebe3db640 1 --2- 172.21.15.121:0/3718377564 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4eb80ff440 0x7f4eb8101820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:43:49.774 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:49.771+0000 7f4ebe3db640 1 --2- 172.21.15.121:0/3718377564 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4eb80664b0 0x7f4eb80fef00 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:43:49.775 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:49.771+0000 7f4ebe3db640 1 -- 172.21.15.121:0/3718377564 >> 172.21.15.121:0/3718377564 conn(0x7f4eb80f69b0 msgr2=0x7f4eb80f8de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:43:49.775 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:49.771+0000 7f4ebe3db640 1 -- 172.21.15.121:0/3718377564 shutdown_connections 2024-08-18T22:43:49.775 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:49.771+0000 7f4ebe3db640 1 -- 172.21.15.121:0/3718377564 wait complete. 2024-08-18T22:43:49.775 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:49.771+0000 7f4ebe3db640 1 Processor -- start 2024-08-18T22:43:49.775 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:49.772+0000 7f4ebe3db640 1 -- start start 2024-08-18T22:43:49.775 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:49.772+0000 7f4ebe3db640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4eb80664b0 0x7f4eb810cf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:43:49.775 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:49.772+0000 7f4ebe3db640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4eb80ff440 0x7f4eb810d460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:43:49.775 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:49.772+0000 7f4ebe3db640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4eb810e2d0 con 0x7f4eb80ff440 2024-08-18T22:43:49.775 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:49.772+0000 7f4ebe3db640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4eb810e440 con 0x7f4eb80664b0 2024-08-18T22:43:49.775 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:49.772+0000 7f4eb7fff640 1 -- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4eb80664b0 msgr2=0x7f4eb810cf20 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.195:3300/0 2024-08-18T22:43:49.775 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:49.772+0000 7f4eb7fff640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4eb80664b0 0x7f4eb810cf20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-18T22:43:49.775 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:49.772+0000 7f4eb77fe640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4eb80ff440 0x7f4eb810d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:43:49.775 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:49.772+0000 7f4eb77fe640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4eb80ff440 0x7f4eb810d460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:53440/0 (socket says 172.21.15.121:53440) 2024-08-18T22:43:49.776 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:49.772+0000 7f4eb77fe640 1 -- 172.21.15.121:0/496214817 learned_addr learned my addr 172.21.15.121:0/496214817 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-18T22:43:49.776 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:49.772+0000 7f4eb77fe640 1 -- 172.21.15.121:0/496214817 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4eb80664b0 msgr2=0x7f4eb810cf20 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-18T22:43:49.776 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:49.772+0000 7f4eb77fe640 1 --2- 172.21.15.121:0/496214817 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4eb80664b0 0x7f4eb810cf20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:43:49.776 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:49.772+0000 7f4eb77fe640 1 -- 172.21.15.121:0/496214817 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ea8005040 con 0x7f4eb80ff440 2024-08-18T22:43:49.777 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:49.773+0000 7f4eb77fe640 1 --2- 172.21.15.121:0/496214817 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4eb80ff440 0x7f4eb810d460 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f4ea000b560 tx=0x7f4ea00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:43:49.777 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:49.773+0000 7f4eb4ff9640 1 -- 172.21.15.121:0/496214817 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4ea0010790 con 0x7f4eb80ff440 2024-08-18T22:43:49.777 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:49.773+0000 7f4eb4ff9640 1 -- 172.21.15.121:0/496214817 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f4ea0010d90 con 0x7f4eb80ff440 2024-08-18T22:43:49.777 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:49.773+0000 7f4ebe3db640 1 -- 172.21.15.121:0/496214817 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4eb810e720 con 0x7f4eb80ff440 2024-08-18T22:43:49.777 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:49.773+0000 7f4eb4ff9640 1 -- 172.21.15.121:0/496214817 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4ea000f300 con 0x7f4eb80ff440 2024-08-18T22:43:49.777 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:49.773+0000 7f4ebe3db640 1 -- 172.21.15.121:0/496214817 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4eb810ecc0 con 0x7f4eb80ff440 2024-08-18T22:43:49.777 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:49.774+0000 7f4ebe3db640 1 -- 172.21.15.121:0/496214817 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4eb80fa650 con 0x7f4eb80ff440 2024-08-18T22:43:49.777 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:49.775+0000 7f4eb4ff9640 1 -- 172.21.15.121:0/496214817 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 36) v1 ==== 92307+0+0 (secure 0 0 0) 0x7f4ea001b460 con 0x7f4eb80ff440 2024-08-18T22:43:49.778 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:49.775+0000 7f4eb4ff9640 1 --2- 172.21.15.121:0/496214817 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f4ea406e120 0x7f4ea40705d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:43:49.778 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:49.775+0000 7f4eb4ff9640 1 -- 172.21.15.121:0/496214817 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f4ea008df00 con 0x7f4eb80ff440 2024-08-18T22:43:49.778 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:49.775+0000 7f4eb7fff640 1 --2- 172.21.15.121:0/496214817 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f4ea406e120 0x7f4ea40705d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:43:49.778 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:49.776+0000 7f4eb7fff640 1 --2- 172.21.15.121:0/496214817 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f4ea406e120 0x7f4ea40705d0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f4ea8007ac0 tx=0x7f4ea8009da0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:43:49.782 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:49.780+0000 7f4eb4ff9640 1 -- 172.21.15.121:0/496214817 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f4ea0057210 con 0x7f4eb80ff440 2024-08-18T22:43:49.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:49 smithi195 podman[68669]: 2024-08-18 22:43:49.656506879 +0000 UTC m=+0.287566884 container died ced63ecfbfae2548ebe7798acf587c0801bc69538a5d127e8d66e5503a23d510 (image=quay.ceph.io/ceph-ci/ceph@sha256:bf20fb88c15fff689cf84383793d3756b4df7aceb11592a28c78dd893a0b3e7d, name=ceph-b003123a-5db1-11ef-bccf-c7b262605968-mon-smithi195, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=quincy-df62bdc, org.label-schema.license=GPLv2, ceph=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, io.buildah.version=1.36.0, org.label-schema.vendor=CentOS) 2024-08-18T22:43:49.963 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:49.961+0000 7f4ebe3db640 1 -- 172.21.15.121:0/496214817 --> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f4eb810ef30 con 0x7f4ea406e120 2024-08-18T22:43:49.964 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:49.962+0000 7f4eb4ff9640 1 -- 172.21.15.121:0/496214817 <== mgr.34102 v2:172.21.15.121:6800/3037387239 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+368 (secure 0 0 0) 0x7f4eb810ef30 con 0x7f4ea406e120 2024-08-18T22:43:49.966 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:49.964+0000 7f4ebe3db640 1 -- 172.21.15.121:0/496214817 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f4ea406e120 msgr2=0x7f4ea40705d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:43:49.966 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:49.964+0000 7f4ebe3db640 1 --2- 172.21.15.121:0/496214817 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f4ea406e120 0x7f4ea40705d0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f4ea8007ac0 tx=0x7f4ea8009da0 comp rx=0 tx=0).stop 2024-08-18T22:43:49.966 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:49.964+0000 7f4ebe3db640 1 -- 172.21.15.121:0/496214817 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4eb80ff440 msgr2=0x7f4eb810d460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:43:49.966 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:49.964+0000 7f4ebe3db640 1 --2- 172.21.15.121:0/496214817 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4eb80ff440 0x7f4eb810d460 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f4ea000b560 tx=0x7f4ea00091a0 comp rx=0 tx=0).stop 2024-08-18T22:43:49.966 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:49.964+0000 7f4ebe3db640 1 -- 172.21.15.121:0/496214817 shutdown_connections 2024-08-18T22:43:49.966 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:49.964+0000 7f4ebe3db640 1 --2- 172.21.15.121:0/496214817 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f4ea406e120 0x7f4ea40705d0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:43:49.966 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:49.964+0000 7f4ebe3db640 1 --2- 172.21.15.121:0/496214817 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4eb80ff440 0x7f4eb810d460 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:43:49.967 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:49.964+0000 7f4ebe3db640 1 --2- 172.21.15.121:0/496214817 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4eb80664b0 0x7f4eb810cf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:43:49.967 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:49.964+0000 7f4ebe3db640 1 -- 172.21.15.121:0/496214817 >> 172.21.15.121:0/496214817 conn(0x7f4eb80f69b0 msgr2=0x7f4eb80f6dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:43:49.967 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:49.964+0000 7f4ebe3db640 1 -- 172.21.15.121:0/496214817 shutdown_connections 2024-08-18T22:43:49.967 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:49.964+0000 7f4ebe3db640 1 -- 172.21.15.121:0/496214817 wait complete. 2024-08-18T22:43:50.046 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:50.042+0000 7f72fa82f640 1 -- 172.21.15.121:0/3774469970 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f72f40fc2f0 msgr2=0x7f72f40fc700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:43:50.047 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:50.042+0000 7f72fa82f640 1 --2- 172.21.15.121:0/3774469970 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f72f40fc2f0 0x7f72f40fc700 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f72e40048d0 tx=0x7f72e4009da0 comp rx=0 tx=0).stop 2024-08-18T22:43:50.047 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:50.042+0000 7f72fa82f640 1 -- 172.21.15.121:0/3774469970 shutdown_connections 2024-08-18T22:43:50.047 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:50.042+0000 7f72fa82f640 1 --2- 172.21.15.121:0/3774469970 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f72f40fd5c0 0x7f72f40fda30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:43:50.047 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:50.042+0000 7f72fa82f640 1 --2- 172.21.15.121:0/3774469970 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f72f40fc2f0 0x7f72f40fc700 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:43:50.047 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:50.042+0000 7f72fa82f640 1 -- 172.21.15.121:0/3774469970 >> 172.21.15.121:0/3774469970 conn(0x7f72f40f7ad0 msgr2=0x7f72f40f9ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:43:50.047 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:50.042+0000 7f72fa82f640 1 -- 172.21.15.121:0/3774469970 shutdown_connections 2024-08-18T22:43:50.048 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:50.042+0000 7f72fa82f640 1 -- 172.21.15.121:0/3774469970 wait complete. 2024-08-18T22:43:50.048 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:50.042+0000 7f72fa82f640 1 Processor -- start 2024-08-18T22:43:50.048 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:50.043+0000 7f72fa82f640 1 -- start start 2024-08-18T22:43:50.048 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:50.043+0000 7f72fa82f640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f72f40fc2f0 0x7f72f410cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:43:50.048 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:50.043+0000 7f72fa82f640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f72f40fd5c0 0x7f72f410d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:43:50.048 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:50.043+0000 7f72fa82f640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72f410e1d0 con 0x7f72f40fd5c0 2024-08-18T22:43:50.049 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:50.043+0000 7f72fa82f640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72f410e340 con 0x7f72f40fc2f0 2024-08-18T22:43:50.049 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:50.043+0000 7f72f3fff640 1 -- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f72f40fc2f0 msgr2=0x7f72f410cf00 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.195:3300/0 2024-08-18T22:43:50.049 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:50.043+0000 7f72f3fff640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f72f40fc2f0 0x7f72f410cf00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-18T22:43:50.049 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:50.043+0000 7f72ebfff640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f72f40fd5c0 0x7f72f410d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:43:50.049 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:50.043+0000 7f72ebfff640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f72f40fd5c0 0x7f72f410d440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:53472/0 (socket says 172.21.15.121:53472) 2024-08-18T22:43:50.049 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:50.043+0000 7f72ebfff640 1 -- 172.21.15.121:0/3667133797 learned_addr learned my addr 172.21.15.121:0/3667133797 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-18T22:43:50.049 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:50.043+0000 7f72ebfff640 1 -- 172.21.15.121:0/3667133797 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f72f40fc2f0 msgr2=0x7f72f410cf00 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-18T22:43:50.049 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:50.043+0000 7f72ebfff640 1 --2- 172.21.15.121:0/3667133797 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f72f40fc2f0 0x7f72f410cf00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:43:50.049 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:50.043+0000 7f72ebfff640 1 -- 172.21.15.121:0/3667133797 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72e4005040 con 0x7f72f40fd5c0 2024-08-18T22:43:50.049 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:50.043+0000 7f72ebfff640 1 --2- 172.21.15.121:0/3667133797 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f72f40fd5c0 0x7f72f410d440 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f72dc00b560 tx=0x7f72dc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:43:50.049 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:50.044+0000 7f72f17fa640 1 -- 172.21.15.121:0/3667133797 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f72dc010790 con 0x7f72f40fd5c0 2024-08-18T22:43:50.049 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:50.044+0000 7f72f17fa640 1 -- 172.21.15.121:0/3667133797 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f72dc010d90 con 0x7f72f40fd5c0 2024-08-18T22:43:50.049 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:50.044+0000 7f72f17fa640 1 -- 172.21.15.121:0/3667133797 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f72dc00f300 con 0x7f72f40fd5c0 2024-08-18T22:43:50.049 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:50.044+0000 7f72fa82f640 1 -- 172.21.15.121:0/3667133797 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72f410e620 con 0x7f72f40fd5c0 2024-08-18T22:43:50.050 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:50.044+0000 7f72fa82f640 1 -- 172.21.15.121:0/3667133797 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72f410eb40 con 0x7f72f40fd5c0 2024-08-18T22:43:50.050 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:50.045+0000 7f72fa82f640 1 -- 172.21.15.121:0/3667133797 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72f40fb750 con 0x7f72f40fd5c0 2024-08-18T22:43:50.051 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:50.045+0000 7f72f17fa640 1 -- 172.21.15.121:0/3667133797 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 36) v1 ==== 92307+0+0 (secure 0 0 0) 0x7f72dc011440 con 0x7f72f40fd5c0 2024-08-18T22:43:50.051 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:50.046+0000 7f72f17fa640 1 --2- 172.21.15.121:0/3667133797 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f72e006e120 0x7f72e00705d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:43:50.051 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:50.046+0000 7f72f17fa640 1 -- 172.21.15.121:0/3667133797 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f72dc08def0 con 0x7f72f40fd5c0 2024-08-18T22:43:50.051 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:50.046+0000 7f72f3fff640 1 --2- 172.21.15.121:0/3667133797 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f72e006e120 0x7f72e00705d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:43:50.051 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:50.046+0000 7f72f3fff640 1 --2- 172.21.15.121:0/3667133797 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f72e006e120 0x7f72e00705d0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f72e4007ac0 tx=0x7f72e4009da0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:43:50.052 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:50.050+0000 7f72f17fa640 1 -- 172.21.15.121:0/3667133797 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f72dc057190 con 0x7f72f40fd5c0 2024-08-18T22:43:50.224 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:50.222+0000 7f72fa82f640 1 -- 172.21.15.121:0/3667133797 --> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f72f410ee70 con 0x7f72e006e120 2024-08-18T22:43:50.233 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:50.231+0000 7f72f17fa640 1 -- 172.21.15.121:0/3667133797 <== mgr.34102 v2:172.21.15.121:6800/3037387239 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7f72f410ee70 con 0x7f72e006e120 2024-08-18T22:43:50.233 INFO:teuthology.orchestra.run.smithi121.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-08-18T22:43:50.234 INFO:teuthology.orchestra.run.smithi121.stdout:alertmanager.smithi121 smithi121 *:9093,9094 running (97s) 6s ago 9m 15.5M - 0.25.0 c8568f914cd2 c421c5e6a02b 2024-08-18T22:43:50.234 INFO:teuthology.orchestra.run.smithi121.stdout:crash.smithi121 smithi121 running (9m) 6s ago 9m 6899k - 17.2.7-1406-gdf62bdcc 774894bef55f cf3deea293c3 2024-08-18T22:43:50.234 INFO:teuthology.orchestra.run.smithi121.stdout:crash.smithi195 smithi195 running (9m) 8s ago 8m 6899k - 17.2.7-1406-gdf62bdcc 774894bef55f 98aa377daf77 2024-08-18T22:43:50.234 INFO:teuthology.orchestra.run.smithi121.stdout:grafana.smithi121 smithi121 *:3000 running (92s) 6s ago 9m 80.4M - 9.4.7 954c08fa6188 091a5fd17e8a 2024-08-18T22:43:50.234 INFO:teuthology.orchestra.run.smithi121.stdout:mds.cephfs.smithi121.gbickb smithi121 running (4m) 6s ago 4m 156M - 17.2.7-1406-gdf62bdcc 774894bef55f 484da0bc2c95 2024-08-18T22:43:50.234 INFO:teuthology.orchestra.run.smithi121.stdout:mds.cephfs.smithi121.xuzsdg smithi121 running (4m) 6s ago 4m 13.0M - 17.2.7-1406-gdf62bdcc 774894bef55f 6976b708cdcd 2024-08-18T22:43:50.234 INFO:teuthology.orchestra.run.smithi121.stdout:mds.cephfs.smithi195.buqvbr smithi195 running (4m) 8s ago 4m 116M - 17.2.7-1406-gdf62bdcc 774894bef55f 11a3703b4276 2024-08-18T22:43:50.234 INFO:teuthology.orchestra.run.smithi121.stdout:mds.cephfs.smithi195.nptgyc smithi195 running (4m) 8s ago 4m 17.0M - 17.2.7-1406-gdf62bdcc 774894bef55f b9f8043ea83e 2024-08-18T22:43:50.234 INFO:teuthology.orchestra.run.smithi121.stdout:mgr.smithi121.lopxqc smithi121 *:8443,9283,8765 running (66s) 6s ago 11m 473M - 19.1.0-1382-gde09dd01 ea7a5189f30b 9079701e6516 2024-08-18T22:43:50.234 INFO:teuthology.orchestra.run.smithi121.stdout:mgr.smithi195.acttsj smithi195 *:8443,9283,8765 running (30s) 8s ago 8m 437M - 19.1.0-1382-gde09dd01 ea7a5189f30b 7b4027a33daa 2024-08-18T22:43:50.234 INFO:teuthology.orchestra.run.smithi121.stdout:mon.smithi121 smithi121 running (18s) 6s ago 11m 31.2M 2048M 19.1.0-1382-gde09dd01 ea7a5189f30b d71695a4fb56 2024-08-18T22:43:50.234 INFO:teuthology.orchestra.run.smithi121.stdout:mon.smithi195 smithi195 running (8m) 8s ago 8m 47.2M 2048M 17.2.7-1406-gdf62bdcc 774894bef55f ced63ecfbfae 2024-08-18T22:43:50.234 INFO:teuthology.orchestra.run.smithi121.stdout:node-exporter.smithi121 smithi121 *:9100 running (103s) 6s ago 9m 8258k - 1.5.0 0da6a335fe13 bc4b5355a507 2024-08-18T22:43:50.235 INFO:teuthology.orchestra.run.smithi121.stdout:node-exporter.smithi195 smithi195 *:9100 running (75s) 8s ago 8m 16.8M - 1.5.0 0da6a335fe13 146efcb79663 2024-08-18T22:43:50.235 INFO:teuthology.orchestra.run.smithi121.stdout:osd.0 smithi121 running (8m) 6s ago 8m 192M 1557M 17.2.7-1406-gdf62bdcc 774894bef55f 30859216633d 2024-08-18T22:43:50.235 INFO:teuthology.orchestra.run.smithi121.stdout:osd.1 smithi121 running (7m) 6s ago 7m 222M 1557M 17.2.7-1406-gdf62bdcc 774894bef55f ef5fadfd753f 2024-08-18T22:43:50.235 INFO:teuthology.orchestra.run.smithi121.stdout:osd.2 smithi121 running (7m) 6s ago 7m 182M 1557M 17.2.7-1406-gdf62bdcc 774894bef55f 3fa061e41f99 2024-08-18T22:43:50.235 INFO:teuthology.orchestra.run.smithi121.stdout:osd.3 smithi195 running (6m) 8s ago 6m 238M 2581M 17.2.7-1406-gdf62bdcc 774894bef55f 15d30b1b459e 2024-08-18T22:43:50.235 INFO:teuthology.orchestra.run.smithi121.stdout:osd.4 smithi195 running (6m) 8s ago 6m 209M 2581M 17.2.7-1406-gdf62bdcc 774894bef55f 99ed156dfd36 2024-08-18T22:43:50.235 INFO:teuthology.orchestra.run.smithi121.stdout:osd.5 smithi195 running (6m) 8s ago 6m 213M 2581M 17.2.7-1406-gdf62bdcc 774894bef55f e7eff7bdb752 2024-08-18T22:43:50.235 INFO:teuthology.orchestra.run.smithi121.stdout:prometheus.smithi121 smithi121 *:9095 running (35s) 6s ago 9m 46.4M - 2.43.0 a07b618ecd1d 00c4f776d23a 2024-08-18T22:43:50.236 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:50.234+0000 7f72fa82f640 1 -- 172.21.15.121:0/3667133797 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f72e006e120 msgr2=0x7f72e00705d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:43:50.236 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:50.234+0000 7f72fa82f640 1 --2- 172.21.15.121:0/3667133797 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f72e006e120 0x7f72e00705d0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f72e4007ac0 tx=0x7f72e4009da0 comp rx=0 tx=0).stop 2024-08-18T22:43:50.236 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:50.234+0000 7f72fa82f640 1 -- 172.21.15.121:0/3667133797 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f72f40fd5c0 msgr2=0x7f72f410d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:43:50.236 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:50.234+0000 7f72fa82f640 1 --2- 172.21.15.121:0/3667133797 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f72f40fd5c0 0x7f72f410d440 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f72dc00b560 tx=0x7f72dc0091a0 comp rx=0 tx=0).stop 2024-08-18T22:43:50.236 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:50.234+0000 7f72fa82f640 1 -- 172.21.15.121:0/3667133797 shutdown_connections 2024-08-18T22:43:50.236 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:50.234+0000 7f72fa82f640 1 --2- 172.21.15.121:0/3667133797 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f72e006e120 0x7f72e00705d0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:43:50.236 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:50.234+0000 7f72fa82f640 1 --2- 172.21.15.121:0/3667133797 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f72f40fd5c0 0x7f72f410d440 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:43:50.236 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:50.234+0000 7f72fa82f640 1 --2- 172.21.15.121:0/3667133797 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f72f40fc2f0 0x7f72f410cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:43:50.236 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:50.234+0000 7f72fa82f640 1 -- 172.21.15.121:0/3667133797 >> 172.21.15.121:0/3667133797 conn(0x7f72f40f7ad0 msgr2=0x7f72f40f9250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:43:50.237 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:50.234+0000 7f72fa82f640 1 -- 172.21.15.121:0/3667133797 shutdown_connections 2024-08-18T22:43:50.237 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:50.234+0000 7f72fa82f640 1 -- 172.21.15.121:0/3667133797 wait complete. 2024-08-18T22:43:50.314 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:50.310+0000 7f2925771640 1 -- 172.21.15.121:0/2250940097 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f29200fc2f0 msgr2=0x7f29200fc700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:43:50.314 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:50.310+0000 7f2925771640 1 --2- 172.21.15.121:0/2250940097 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f29200fc2f0 0x7f29200fc700 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f29080048d0 tx=0x7f2908009da0 comp rx=0 tx=0).stop 2024-08-18T22:43:50.314 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:50.310+0000 7f2925771640 1 -- 172.21.15.121:0/2250940097 shutdown_connections 2024-08-18T22:43:50.314 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:50.310+0000 7f2925771640 1 --2- 172.21.15.121:0/2250940097 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f29200fd5c0 0x7f29200fda30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:43:50.314 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:50.310+0000 7f2925771640 1 --2- 172.21.15.121:0/2250940097 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f29200fc2f0 0x7f29200fc700 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:43:50.314 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:50.311+0000 7f2925771640 1 -- 172.21.15.121:0/2250940097 >> 172.21.15.121:0/2250940097 conn(0x7f29200f7ad0 msgr2=0x7f29200f9ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:43:50.314 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:50.311+0000 7f2925771640 1 -- 172.21.15.121:0/2250940097 shutdown_connections 2024-08-18T22:43:50.314 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:50.311+0000 7f2925771640 1 -- 172.21.15.121:0/2250940097 wait complete. 2024-08-18T22:43:50.314 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:50.311+0000 7f2925771640 1 Processor -- start 2024-08-18T22:43:50.314 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:50.311+0000 7f2925771640 1 -- start start 2024-08-18T22:43:50.315 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:50.312+0000 7f2925771640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f29200fc2f0 0x7f292010cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:43:50.315 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:50.312+0000 7f2925771640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f29200fd5c0 0x7f292010d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:43:50.315 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:50.312+0000 7f2925771640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f292010e1d0 con 0x7f29200fc2f0 2024-08-18T22:43:50.315 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:50.312+0000 7f2925771640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f292010e340 con 0x7f29200fd5c0 2024-08-18T22:43:50.315 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:50.312+0000 7f291e7fc640 1 -- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f29200fd5c0 msgr2=0x7f292010d440 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.195:3300/0 2024-08-18T22:43:50.315 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:50.312+0000 7f291effd640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f29200fc2f0 0x7f292010cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:43:50.315 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:50.312+0000 7f291e7fc640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f29200fd5c0 0x7f292010d440 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-18T22:43:50.315 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:50.312+0000 7f291effd640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f29200fc2f0 0x7f292010cf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:53488/0 (socket says 172.21.15.121:53488) 2024-08-18T22:43:50.315 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:50.312+0000 7f291effd640 1 -- 172.21.15.121:0/2031878368 learned_addr learned my addr 172.21.15.121:0/2031878368 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-18T22:43:50.315 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:50.312+0000 7f291effd640 1 -- 172.21.15.121:0/2031878368 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f29200fd5c0 msgr2=0x7f292010d440 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-18T22:43:50.315 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:50.312+0000 7f291effd640 1 --2- 172.21.15.121:0/2031878368 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f29200fd5c0 0x7f292010d440 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:43:50.315 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:50.312+0000 7f291effd640 1 -- 172.21.15.121:0/2031878368 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2908005040 con 0x7f29200fc2f0 2024-08-18T22:43:50.317 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:50.312+0000 7f291effd640 1 --2- 172.21.15.121:0/2031878368 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f29200fc2f0 0x7f292010cf00 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f2908009ac0 tx=0x7f2908009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:43:50.317 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:50.312+0000 7f29177fe640 1 -- 172.21.15.121:0/2031878368 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2908038070 con 0x7f29200fc2f0 2024-08-18T22:43:50.317 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:50.312+0000 7f2925771640 1 -- 172.21.15.121:0/2031878368 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f292010e5c0 con 0x7f29200fc2f0 2024-08-18T22:43:50.317 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:50.312+0000 7f29177fe640 1 -- 172.21.15.121:0/2031878368 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f2908033cb0 con 0x7f29200fc2f0 2024-08-18T22:43:50.317 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:50.313+0000 7f2925771640 1 -- 172.21.15.121:0/2031878368 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f292010ea20 con 0x7f29200fc2f0 2024-08-18T22:43:50.317 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:50.313+0000 7f29177fe640 1 -- 172.21.15.121:0/2031878368 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f290803cb40 con 0x7f29200fc2f0 2024-08-18T22:43:50.317 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:50.313+0000 7f2925771640 1 -- 172.21.15.121:0/2031878368 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2900005240 con 0x7f29200fc2f0 2024-08-18T22:43:50.317 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:50.314+0000 7f29177fe640 1 -- 172.21.15.121:0/2031878368 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 36) v1 ==== 92307+0+0 (secure 0 0 0) 0x7f2908030020 con 0x7f29200fc2f0 2024-08-18T22:43:50.317 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:50.315+0000 7f29177fe640 1 --2- 172.21.15.121:0/2031878368 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f290c06e120 0x7f290c0705d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:43:50.317 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:50.315+0000 7f29177fe640 1 -- 172.21.15.121:0/2031878368 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f29080ade50 con 0x7f29200fc2f0 2024-08-18T22:43:50.317 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:50.315+0000 7f291e7fc640 1 --2- 172.21.15.121:0/2031878368 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f290c06e120 0x7f290c0705d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:43:50.318 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:50.315+0000 7f291e7fc640 1 --2- 172.21.15.121:0/2031878368 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f290c06e120 0x7f290c0705d0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f2910001050 tx=0x7f2910006d60 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:43:50.321 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:50.319+0000 7f29177fe640 1 -- 172.21.15.121:0/2031878368 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f2908077070 con 0x7f29200fc2f0 2024-08-18T22:43:50.409 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:50 smithi195 podman[68669]: 2024-08-18 22:43:50.012598317 +0000 UTC m=+0.643658309 container cleanup ced63ecfbfae2548ebe7798acf587c0801bc69538a5d127e8d66e5503a23d510 (image=quay.ceph.io/ceph-ci/ceph@sha256:bf20fb88c15fff689cf84383793d3756b4df7aceb11592a28c78dd893a0b3e7d, name=ceph-b003123a-5db1-11ef-bccf-c7b262605968-mon-smithi195, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=quincy-df62bdc, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_CLEAN=True, org.label-schema.license=GPLv2, io.buildah.version=1.36.0, org.label-schema.vendor=CentOS) 2024-08-18T22:43:50.409 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:50 smithi195 bash[68669]: ceph-b003123a-5db1-11ef-bccf-c7b262605968-mon-smithi195 2024-08-18T22:43:50.409 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:50 smithi195 podman[68681]: 2024-08-18 22:43:50.188732263 +0000 UTC m=+0.533660946 container remove ced63ecfbfae2548ebe7798acf587c0801bc69538a5d127e8d66e5503a23d510 (image=quay.ceph.io/ceph-ci/ceph@sha256:bf20fb88c15fff689cf84383793d3756b4df7aceb11592a28c78dd893a0b3e7d, name=ceph-b003123a-5db1-11ef-bccf-c7b262605968-mon-smithi195, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , io.buildah.version=1.36.0, ceph=True, RELEASE=quincy-df62bdc, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True) 2024-08-18T22:43:50.557 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:50.555+0000 7f2925771640 1 -- 172.21.15.121:0/2031878368 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f29000057c0 con 0x7f29200fc2f0 2024-08-18T22:43:50.557 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:50.555+0000 7f29177fe640 1 -- 172.21.15.121:0/2031878368 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+844 (secure 0 0 0) 0x7f290807a730 con 0x7f29200fc2f0 2024-08-18T22:43:50.558 INFO:teuthology.orchestra.run.smithi121.stdout:{ 2024-08-18T22:43:50.558 INFO:teuthology.orchestra.run.smithi121.stdout: "mon": { 2024-08-18T22:43:50.558 INFO:teuthology.orchestra.run.smithi121.stdout: "ceph version 17.2.7-1406-gdf62bdcc (df62bdccd9a13bf566b27a250eddfdd89be3072d) quincy (stable)": 1, 2024-08-18T22:43:50.558 INFO:teuthology.orchestra.run.smithi121.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 1 2024-08-18T22:43:50.558 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-18T22:43:50.558 INFO:teuthology.orchestra.run.smithi121.stdout: "mgr": { 2024-08-18T22:43:50.558 INFO:teuthology.orchestra.run.smithi121.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 2 2024-08-18T22:43:50.558 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-18T22:43:50.558 INFO:teuthology.orchestra.run.smithi121.stdout: "osd": { 2024-08-18T22:43:50.558 INFO:teuthology.orchestra.run.smithi121.stdout: "ceph version 17.2.7-1406-gdf62bdcc (df62bdccd9a13bf566b27a250eddfdd89be3072d) quincy (stable)": 6 2024-08-18T22:43:50.558 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-18T22:43:50.559 INFO:teuthology.orchestra.run.smithi121.stdout: "mds": { 2024-08-18T22:43:50.559 INFO:teuthology.orchestra.run.smithi121.stdout: "ceph version 17.2.7-1406-gdf62bdcc (df62bdccd9a13bf566b27a250eddfdd89be3072d) quincy (stable)": 4 2024-08-18T22:43:50.559 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-18T22:43:50.559 INFO:teuthology.orchestra.run.smithi121.stdout: "overall": { 2024-08-18T22:43:50.559 INFO:teuthology.orchestra.run.smithi121.stdout: "ceph version 17.2.7-1406-gdf62bdcc (df62bdccd9a13bf566b27a250eddfdd89be3072d) quincy (stable)": 11, 2024-08-18T22:43:50.559 INFO:teuthology.orchestra.run.smithi121.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 3 2024-08-18T22:43:50.559 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-08-18T22:43:50.559 INFO:teuthology.orchestra.run.smithi121.stdout:} 2024-08-18T22:43:50.560 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:50.558+0000 7f2925771640 1 -- 172.21.15.121:0/2031878368 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f290c06e120 msgr2=0x7f290c0705d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:43:50.560 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:50.558+0000 7f2925771640 1 --2- 172.21.15.121:0/2031878368 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f290c06e120 0x7f290c0705d0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f2910001050 tx=0x7f2910006d60 comp rx=0 tx=0).stop 2024-08-18T22:43:50.560 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:50.558+0000 7f2925771640 1 -- 172.21.15.121:0/2031878368 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f29200fc2f0 msgr2=0x7f292010cf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:43:50.560 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:50.558+0000 7f2925771640 1 --2- 172.21.15.121:0/2031878368 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f29200fc2f0 0x7f292010cf00 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f2908009ac0 tx=0x7f2908009da0 comp rx=0 tx=0).stop 2024-08-18T22:43:50.560 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:50.558+0000 7f2925771640 1 -- 172.21.15.121:0/2031878368 shutdown_connections 2024-08-18T22:43:50.560 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:50.558+0000 7f2925771640 1 --2- 172.21.15.121:0/2031878368 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f290c06e120 0x7f290c0705d0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:43:50.560 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:50.558+0000 7f2925771640 1 --2- 172.21.15.121:0/2031878368 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f29200fd5c0 0x7f292010d440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:43:50.560 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:50.558+0000 7f2925771640 1 --2- 172.21.15.121:0/2031878368 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f29200fc2f0 0x7f292010cf00 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:43:50.560 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:50.558+0000 7f2925771640 1 -- 172.21.15.121:0/2031878368 >> 172.21.15.121:0/2031878368 conn(0x7f29200f7ad0 msgr2=0x7f29200f9250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:43:50.561 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:50.558+0000 7f2925771640 1 -- 172.21.15.121:0/2031878368 shutdown_connections 2024-08-18T22:43:50.561 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:50.558+0000 7f2925771640 1 -- 172.21.15.121:0/2031878368 wait complete. 2024-08-18T22:43:50.639 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:50.636+0000 7f2012182640 1 -- 172.21.15.121:0/4035896860 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f200c0fc2f0 msgr2=0x7f200c0fc700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:43:50.639 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:50.636+0000 7f2012182640 1 --2- 172.21.15.121:0/4035896860 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f200c0fc2f0 0x7f200c0fc700 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f1ffc0048d0 tx=0x7f1ffc009da0 comp rx=0 tx=0).stop 2024-08-18T22:43:50.639 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:50.636+0000 7f2012182640 1 -- 172.21.15.121:0/4035896860 shutdown_connections 2024-08-18T22:43:50.640 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:50.636+0000 7f2012182640 1 --2- 172.21.15.121:0/4035896860 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f200c0fd5c0 0x7f200c0fda30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:43:50.640 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:50.636+0000 7f2012182640 1 --2- 172.21.15.121:0/4035896860 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f200c0fc2f0 0x7f200c0fc700 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:43:50.640 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:50.636+0000 7f2012182640 1 -- 172.21.15.121:0/4035896860 >> 172.21.15.121:0/4035896860 conn(0x7f200c0f7ad0 msgr2=0x7f200c0f9ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:43:50.640 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:50.636+0000 7f2012182640 1 -- 172.21.15.121:0/4035896860 shutdown_connections 2024-08-18T22:43:50.640 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:50.636+0000 7f2012182640 1 -- 172.21.15.121:0/4035896860 wait complete. 2024-08-18T22:43:50.640 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:50.636+0000 7f2012182640 1 Processor -- start 2024-08-18T22:43:50.640 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:50.637+0000 7f2012182640 1 -- start start 2024-08-18T22:43:50.640 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:50.637+0000 7f2012182640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f200c0fc2f0 0x7f200c10cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:43:50.640 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:50.637+0000 7f2012182640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f200c0fd5c0 0x7f200c10d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:43:50.640 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:50.637+0000 7f2012182640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f200c10e1d0 con 0x7f200c0fd5c0 2024-08-18T22:43:50.640 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:50.637+0000 7f2012182640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f200c10e340 con 0x7f200c0fc2f0 2024-08-18T22:43:50.640 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:50.637+0000 7f200b7fe640 1 -- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f200c0fc2f0 msgr2=0x7f200c10cf00 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.195:3300/0 2024-08-18T22:43:50.640 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:50.637+0000 7f200b7fe640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f200c0fc2f0 0x7f200c10cf00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-18T22:43:50.640 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:50.637+0000 7f200affd640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f200c0fd5c0 0x7f200c10d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:43:50.641 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:50.637+0000 7f200affd640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f200c0fd5c0 0x7f200c10d440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:53516/0 (socket says 172.21.15.121:53516) 2024-08-18T22:43:50.641 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:50.637+0000 7f200affd640 1 -- 172.21.15.121:0/3698414967 learned_addr learned my addr 172.21.15.121:0/3698414967 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-18T22:43:50.641 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:50.637+0000 7f200affd640 1 -- 172.21.15.121:0/3698414967 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f200c0fc2f0 msgr2=0x7f200c10cf00 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-18T22:43:50.641 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:50.637+0000 7f200affd640 1 --2- 172.21.15.121:0/3698414967 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f200c0fc2f0 0x7f200c10cf00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:43:50.641 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:50.637+0000 7f200affd640 1 -- 172.21.15.121:0/3698414967 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ffc005040 con 0x7f200c0fd5c0 2024-08-18T22:43:50.641 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:50.637+0000 7f200affd640 1 --2- 172.21.15.121:0/3698414967 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f200c0fd5c0 0x7f200c10d440 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f200000b560 tx=0x7f20000091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:43:50.642 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:50.638+0000 7f1ff3fff640 1 -- 172.21.15.121:0/3698414967 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2000010790 con 0x7f200c0fd5c0 2024-08-18T22:43:50.642 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:50.638+0000 7f1ff3fff640 1 -- 172.21.15.121:0/3698414967 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f2000010d90 con 0x7f200c0fd5c0 2024-08-18T22:43:50.642 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:50.638+0000 7f2012182640 1 -- 172.21.15.121:0/3698414967 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f200c10e620 con 0x7f200c0fd5c0 2024-08-18T22:43:50.642 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:50.638+0000 7f1ff3fff640 1 -- 172.21.15.121:0/3698414967 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f200000f300 con 0x7f200c0fd5c0 2024-08-18T22:43:50.642 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:50.638+0000 7f2012182640 1 -- 172.21.15.121:0/3698414967 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f200c10eb40 con 0x7f200c0fd5c0 2024-08-18T22:43:50.643 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:50.639+0000 7f2012182640 1 -- 172.21.15.121:0/3698414967 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f200c0fb750 con 0x7f200c0fd5c0 2024-08-18T22:43:50.643 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:50.639+0000 7f1ff3fff640 1 -- 172.21.15.121:0/3698414967 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 36) v1 ==== 92307+0+0 (secure 0 0 0) 0x7f2000011440 con 0x7f200c0fd5c0 2024-08-18T22:43:50.643 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:50.640+0000 7f1ff3fff640 1 --2- 172.21.15.121:0/3698414967 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f1ff406e120 0x7f1ff40705d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:43:50.643 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:50.640+0000 7f1ff3fff640 1 -- 172.21.15.121:0/3698414967 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f200008dfa0 con 0x7f200c0fd5c0 2024-08-18T22:43:50.643 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:50.640+0000 7f200b7fe640 1 --2- 172.21.15.121:0/3698414967 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f1ff406e120 0x7f1ff40705d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:43:50.643 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:50.640+0000 7f200b7fe640 1 --2- 172.21.15.121:0/3698414967 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f1ff406e120 0x7f1ff40705d0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f1ffc007ac0 tx=0x7f1ffc009da0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:43:50.646 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:50.644+0000 7f1ff3fff640 1 -- 172.21.15.121:0/3698414967 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f20000c2df0 con 0x7f200c0fd5c0 2024-08-18T22:43:50.719 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:50 smithi195 systemd[1]: ceph-b003123a-5db1-11ef-bccf-c7b262605968@mon.smithi195.service: Deactivated successfully. 2024-08-18T22:43:50.719 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:50 smithi195 systemd[1]: Stopped Ceph mon.smithi195 for b003123a-5db1-11ef-bccf-c7b262605968. 2024-08-18T22:43:50.720 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:50 smithi195 systemd[1]: ceph-b003123a-5db1-11ef-bccf-c7b262605968@mon.smithi195.service: Consumed 5.678s CPU time. 2024-08-18T22:43:50.720 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:50 smithi195 systemd[1]: Starting Ceph mon.smithi195 for b003123a-5db1-11ef-bccf-c7b262605968... 2024-08-18T22:43:50.847 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:50.845+0000 7f2012182640 1 -- 172.21.15.121:0/3698414967 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f200c104d90 con 0x7f200c0fd5c0 2024-08-18T22:43:50.847 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:50.845+0000 7f1ff3fff640 1 -- 172.21.15.121:0/3698414967 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 19 v19) v1 ==== 76+0+1960 (secure 0 0 0) 0x7f20000571c0 con 0x7f200c0fd5c0 2024-08-18T22:43:50.848 INFO:teuthology.orchestra.run.smithi121.stdout:e19 2024-08-18T22:43:50.848 INFO:teuthology.orchestra.run.smithi121.stdout:btime 1970-01-01T00:00:00:000000+0000 2024-08-18T22:43:50.848 INFO:teuthology.orchestra.run.smithi121.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-08-18T22:43:50.848 INFO:teuthology.orchestra.run.smithi121.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-08-18T22:43:50.848 INFO:teuthology.orchestra.run.smithi121.stdout:legacy client fscid: 1 2024-08-18T22:43:50.848 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-08-18T22:43:50.849 INFO:teuthology.orchestra.run.smithi121.stdout:Filesystem 'cephfs' (1) 2024-08-18T22:43:50.849 INFO:teuthology.orchestra.run.smithi121.stdout:fs_name cephfs 2024-08-18T22:43:50.849 INFO:teuthology.orchestra.run.smithi121.stdout:epoch 19 2024-08-18T22:43:50.849 INFO:teuthology.orchestra.run.smithi121.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-08-18T22:43:50.849 INFO:teuthology.orchestra.run.smithi121.stdout:created 2024-08-18T22:39:04.054074+0000 2024-08-18T22:43:50.849 INFO:teuthology.orchestra.run.smithi121.stdout:modified 2024-08-18T22:42:16.794905+0000 2024-08-18T22:43:50.849 INFO:teuthology.orchestra.run.smithi121.stdout:tableserver 0 2024-08-18T22:43:50.849 INFO:teuthology.orchestra.run.smithi121.stdout:root 0 2024-08-18T22:43:50.849 INFO:teuthology.orchestra.run.smithi121.stdout:session_timeout 60 2024-08-18T22:43:50.849 INFO:teuthology.orchestra.run.smithi121.stdout:session_autoclose 300 2024-08-18T22:43:50.849 INFO:teuthology.orchestra.run.smithi121.stdout:max_file_size 1099511627776 2024-08-18T22:43:50.849 INFO:teuthology.orchestra.run.smithi121.stdout:max_xattr_size 65536 2024-08-18T22:43:50.849 INFO:teuthology.orchestra.run.smithi121.stdout:required_client_features {} 2024-08-18T22:43:50.850 INFO:teuthology.orchestra.run.smithi121.stdout:last_failure 0 2024-08-18T22:43:50.850 INFO:teuthology.orchestra.run.smithi121.stdout:last_failure_osd_epoch 47 2024-08-18T22:43:50.850 INFO:teuthology.orchestra.run.smithi121.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-08-18T22:43:50.850 INFO:teuthology.orchestra.run.smithi121.stdout:max_mds 2 2024-08-18T22:43:50.850 INFO:teuthology.orchestra.run.smithi121.stdout:in 0,1 2024-08-18T22:43:50.850 INFO:teuthology.orchestra.run.smithi121.stdout:up {0=14474,1=24249} 2024-08-18T22:43:50.850 INFO:teuthology.orchestra.run.smithi121.stdout:failed 2024-08-18T22:43:50.850 INFO:teuthology.orchestra.run.smithi121.stdout:damaged 2024-08-18T22:43:50.850 INFO:teuthology.orchestra.run.smithi121.stdout:stopped 2024-08-18T22:43:50.850 INFO:teuthology.orchestra.run.smithi121.stdout:data_pools [3] 2024-08-18T22:43:50.850 INFO:teuthology.orchestra.run.smithi121.stdout:metadata_pool 2 2024-08-18T22:43:50.850 INFO:teuthology.orchestra.run.smithi121.stdout:inline_data disabled 2024-08-18T22:43:50.850 INFO:teuthology.orchestra.run.smithi121.stdout:balancer 2024-08-18T22:43:50.851 INFO:teuthology.orchestra.run.smithi121.stdout:bal_rank_mask -1 2024-08-18T22:43:50.851 INFO:teuthology.orchestra.run.smithi121.stdout:standby_count_wanted 1 2024-08-18T22:43:50.851 INFO:teuthology.orchestra.run.smithi121.stdout:qdb_cluster leader: 0 members: 2024-08-18T22:43:50.851 INFO:teuthology.orchestra.run.smithi121.stdout:[mds.cephfs.smithi121.gbickb{0:14474} state up:active seq 6 export targets 1 join_fscid=1 addr [v2:172.21.15.121:6828/2277706406,v1:172.21.15.121:6829/2277706406] compat {c=[1],r=[1],i=[7ff]}] 2024-08-18T22:43:50.851 INFO:teuthology.orchestra.run.smithi121.stdout:[mds.cephfs.smithi195.buqvbr{1:24249} state up:active seq 4 export targets 0 join_fscid=1 addr [v2:172.21.15.195:6824/2414511859,v1:172.21.15.195:6825/2414511859] compat {c=[1],r=[1],i=[7ff]}] 2024-08-18T22:43:50.851 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-08-18T22:43:50.851 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-08-18T22:43:50.851 INFO:teuthology.orchestra.run.smithi121.stdout:Standby daemons: 2024-08-18T22:43:50.851 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-08-18T22:43:50.851 INFO:teuthology.orchestra.run.smithi121.stdout:[mds.cephfs.smithi121.xuzsdg{-1:14490} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.121:6826/91588128,v1:172.21.15.121:6827/91588128] compat {c=[1],r=[1],i=[7ff]}] 2024-08-18T22:43:50.851 INFO:teuthology.orchestra.run.smithi121.stdout:[mds.cephfs.smithi195.nptgyc{-1:24259} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.195:6826/238549847,v1:172.21.15.195:6827/238549847] compat {c=[1],r=[1],i=[7ff]}] 2024-08-18T22:43:50.852 INFO:teuthology.orchestra.run.smithi121.stderr:dumped fsmap epoch 19 2024-08-18T22:43:50.852 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:50.847+0000 7f2012182640 1 -- 172.21.15.121:0/3698414967 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f1ff406e120 msgr2=0x7f1ff40705d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:43:50.852 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:50.847+0000 7f2012182640 1 --2- 172.21.15.121:0/3698414967 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f1ff406e120 0x7f1ff40705d0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f1ffc007ac0 tx=0x7f1ffc009da0 comp rx=0 tx=0).stop 2024-08-18T22:43:50.852 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:50.847+0000 7f2012182640 1 -- 172.21.15.121:0/3698414967 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f200c0fd5c0 msgr2=0x7f200c10d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:43:50.852 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:50.847+0000 7f2012182640 1 --2- 172.21.15.121:0/3698414967 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f200c0fd5c0 0x7f200c10d440 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f200000b560 tx=0x7f20000091a0 comp rx=0 tx=0).stop 2024-08-18T22:43:50.852 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:50.847+0000 7f2012182640 1 -- 172.21.15.121:0/3698414967 shutdown_connections 2024-08-18T22:43:50.853 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:50.847+0000 7f2012182640 1 --2- 172.21.15.121:0/3698414967 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f1ff406e120 0x7f1ff40705d0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:43:50.853 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:50.847+0000 7f2012182640 1 --2- 172.21.15.121:0/3698414967 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f200c0fd5c0 0x7f200c10d440 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:43:50.853 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:50.847+0000 7f2012182640 1 --2- 172.21.15.121:0/3698414967 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f200c0fc2f0 0x7f200c10cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:43:50.853 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:50.847+0000 7f2012182640 1 -- 172.21.15.121:0/3698414967 >> 172.21.15.121:0/3698414967 conn(0x7f200c0f7ad0 msgr2=0x7f200c0f9250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:43:50.853 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:50.848+0000 7f2012182640 1 -- 172.21.15.121:0/3698414967 shutdown_connections 2024-08-18T22:43:50.853 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:50.848+0000 7f2012182640 1 -- 172.21.15.121:0/3698414967 wait complete. 2024-08-18T22:43:50.929 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:50.926+0000 7f62a885b640 1 -- 172.21.15.121:0/2980524552 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f62a40fb1d0 msgr2=0x7f62a40fb5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:43:50.929 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:50.926+0000 7f62a885b640 1 --2- 172.21.15.121:0/2980524552 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f62a40fb1d0 0x7f62a40fb5e0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f62940048d0 tx=0x7f6294009da0 comp rx=0 tx=0).stop 2024-08-18T22:43:50.929 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:50.926+0000 7f62a885b640 1 -- 172.21.15.121:0/2980524552 shutdown_connections 2024-08-18T22:43:50.929 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:50.926+0000 7f62a885b640 1 --2- 172.21.15.121:0/2980524552 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f62a40fc4a0 0x7f62a40fc910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:43:50.930 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:50.926+0000 7f62a885b640 1 --2- 172.21.15.121:0/2980524552 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f62a40fb1d0 0x7f62a40fb5e0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:43:50.930 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:50.926+0000 7f62a885b640 1 -- 172.21.15.121:0/2980524552 >> 172.21.15.121:0/2980524552 conn(0x7f62a40f69b0 msgr2=0x7f62a40f8dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:43:50.930 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:50.926+0000 7f62a885b640 1 -- 172.21.15.121:0/2980524552 shutdown_connections 2024-08-18T22:43:50.930 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:50.926+0000 7f62a885b640 1 -- 172.21.15.121:0/2980524552 wait complete. 2024-08-18T22:43:50.930 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:50.927+0000 7f62a885b640 1 Processor -- start 2024-08-18T22:43:50.930 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:50.927+0000 7f62a885b640 1 -- start start 2024-08-18T22:43:50.930 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:50.927+0000 7f62a885b640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f62a40fb1d0 0x7f62a410cef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:43:50.930 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:50.927+0000 7f62a885b640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f62a40fc4a0 0x7f62a410d430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:43:50.930 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:50.927+0000 7f62a885b640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62a410e1c0 con 0x7f62a40fb1d0 2024-08-18T22:43:50.930 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:50.927+0000 7f62a885b640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62a410e330 con 0x7f62a40fc4a0 2024-08-18T22:43:50.930 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:50.927+0000 7f629bfff640 1 -- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f62a40fc4a0 msgr2=0x7f62a410d430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.195:3300/0 2024-08-18T22:43:50.930 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:50.927+0000 7f62a259c640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f62a40fb1d0 0x7f62a410cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:43:50.930 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:50.927+0000 7f629bfff640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f62a40fc4a0 0x7f62a410d430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-18T22:43:50.931 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:50.927+0000 7f62a259c640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f62a40fb1d0 0x7f62a410cef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:53528/0 (socket says 172.21.15.121:53528) 2024-08-18T22:43:50.931 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:50.927+0000 7f62a259c640 1 -- 172.21.15.121:0/289759576 learned_addr learned my addr 172.21.15.121:0/289759576 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-18T22:43:50.931 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:50.927+0000 7f62a259c640 1 -- 172.21.15.121:0/289759576 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f62a40fc4a0 msgr2=0x7f62a410d430 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-18T22:43:50.931 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:50.927+0000 7f62a259c640 1 --2- 172.21.15.121:0/289759576 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f62a40fc4a0 0x7f62a410d430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:43:50.931 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:50.927+0000 7f62a259c640 1 -- 172.21.15.121:0/289759576 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6294005040 con 0x7f62a40fb1d0 2024-08-18T22:43:50.932 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:50.928+0000 7f62a259c640 1 --2- 172.21.15.121:0/289759576 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f62a40fb1d0 0x7f62a410cef0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f6294009ac0 tx=0x7f6294009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:43:50.932 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:50.928+0000 7f629affd640 1 -- 172.21.15.121:0/289759576 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6294038070 con 0x7f62a40fb1d0 2024-08-18T22:43:50.933 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:50.928+0000 7f629affd640 1 -- 172.21.15.121:0/289759576 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f6294033cb0 con 0x7f62a40fb1d0 2024-08-18T22:43:50.933 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:50.928+0000 7f62a885b640 1 -- 172.21.15.121:0/289759576 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62a410e5b0 con 0x7f62a40fb1d0 2024-08-18T22:43:50.933 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:50.928+0000 7f629affd640 1 -- 172.21.15.121:0/289759576 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f629403cb40 con 0x7f62a40fb1d0 2024-08-18T22:43:50.933 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:50.928+0000 7f62a885b640 1 -- 172.21.15.121:0/289759576 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62a410ea10 con 0x7f62a40fb1d0 2024-08-18T22:43:50.933 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:50.929+0000 7f62a885b640 1 -- 172.21.15.121:0/289759576 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62a40fa630 con 0x7f62a40fb1d0 2024-08-18T22:43:50.933 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:50.929+0000 7f629affd640 1 -- 172.21.15.121:0/289759576 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 36) v1 ==== 92307+0+0 (secure 0 0 0) 0x7f6294030020 con 0x7f62a40fb1d0 2024-08-18T22:43:50.934 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:50.930+0000 7f629affd640 1 --2- 172.21.15.121:0/289759576 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f629006e120 0x7f62900705d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:43:50.934 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:50.930+0000 7f629affd640 1 -- 172.21.15.121:0/289759576 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f62940adf80 con 0x7f62a40fb1d0 2024-08-18T22:43:50.934 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:50.930+0000 7f629bfff640 1 --2- 172.21.15.121:0/289759576 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f629006e120 0x7f62900705d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:43:50.934 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:50.931+0000 7f629bfff640 1 --2- 172.21.15.121:0/289759576 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f629006e120 0x7f62900705d0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f628c001050 tx=0x7f628c006d60 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:43:50.937 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:50.935+0000 7f629affd640 1 -- 172.21.15.121:0/289759576 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f62940e2df0 con 0x7f62a40fb1d0 2024-08-18T22:43:51.026 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:50 smithi195 podman[68812]: 2024-08-18 22:43:50.786209344 +0000 UTC m=+0.017926270 image pull ea7a5189f30bad3aca9524788e2965d2368d7ce786df09d4edcd8c3edf9cefba quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9 2024-08-18T22:43:51.026 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:50 smithi195 podman[68812]: 2024-08-18 22:43:50.914981663 +0000 UTC m=+0.146698580 container create a9bb94ba3b56650f5a5000faf001d16dac61f58cad8af1485605838311cd7916 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-b003123a-5db1-11ef-bccf-c7b262605968-mon-smithi195, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.license=GPLv2, io.buildah.version=1.36.0, RELEASE=squid-de09dd0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD) 2024-08-18T22:43:51.122 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:51.120+0000 7f62a885b640 1 -- 172.21.15.121:0/289759576 --> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f62a410ede0 con 0x7f629006e120 2024-08-18T22:43:51.123 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:51.121+0000 7f629affd640 1 -- 172.21.15.121:0/289759576 <== mgr.34102 v2:172.21.15.121:6800/3037387239 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+368 (secure 0 0 0) 0x7f62a410ede0 con 0x7f629006e120 2024-08-18T22:43:51.123 INFO:teuthology.orchestra.run.smithi121.stdout:{ 2024-08-18T22:43:51.123 INFO:teuthology.orchestra.run.smithi121.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9", 2024-08-18T22:43:51.123 INFO:teuthology.orchestra.run.smithi121.stdout: "in_progress": true, 2024-08-18T22:43:51.123 INFO:teuthology.orchestra.run.smithi121.stdout: "which": "Upgrading all daemon types on all hosts", 2024-08-18T22:43:51.123 INFO:teuthology.orchestra.run.smithi121.stdout: "services_complete": [ 2024-08-18T22:43:51.124 INFO:teuthology.orchestra.run.smithi121.stdout: "mgr" 2024-08-18T22:43:51.124 INFO:teuthology.orchestra.run.smithi121.stdout: ], 2024-08-18T22:43:51.124 INFO:teuthology.orchestra.run.smithi121.stdout: "progress": "3/21 daemons upgraded", 2024-08-18T22:43:51.124 INFO:teuthology.orchestra.run.smithi121.stdout: "message": "Currently upgrading mon daemons", 2024-08-18T22:43:51.124 INFO:teuthology.orchestra.run.smithi121.stdout: "is_paused": false 2024-08-18T22:43:51.124 INFO:teuthology.orchestra.run.smithi121.stdout:} 2024-08-18T22:43:51.125 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:51.123+0000 7f62a885b640 1 -- 172.21.15.121:0/289759576 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f629006e120 msgr2=0x7f62900705d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:43:51.125 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:51.123+0000 7f62a885b640 1 --2- 172.21.15.121:0/289759576 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f629006e120 0x7f62900705d0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f628c001050 tx=0x7f628c006d60 comp rx=0 tx=0).stop 2024-08-18T22:43:51.125 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:51.123+0000 7f62a885b640 1 -- 172.21.15.121:0/289759576 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f62a40fb1d0 msgr2=0x7f62a410cef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:43:51.125 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:51.123+0000 7f62a885b640 1 --2- 172.21.15.121:0/289759576 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f62a40fb1d0 0x7f62a410cef0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f6294009ac0 tx=0x7f6294009da0 comp rx=0 tx=0).stop 2024-08-18T22:43:51.126 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:51.123+0000 7f62a885b640 1 -- 172.21.15.121:0/289759576 shutdown_connections 2024-08-18T22:43:51.126 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:51.123+0000 7f62a885b640 1 --2- 172.21.15.121:0/289759576 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f629006e120 0x7f62900705d0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:43:51.126 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:51.123+0000 7f62a885b640 1 --2- 172.21.15.121:0/289759576 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f62a40fc4a0 0x7f62a410d430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:43:51.126 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:51.123+0000 7f62a885b640 1 --2- 172.21.15.121:0/289759576 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f62a40fb1d0 0x7f62a410cef0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:43:51.126 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:51.123+0000 7f62a885b640 1 -- 172.21.15.121:0/289759576 >> 172.21.15.121:0/289759576 conn(0x7f62a40f69b0 msgr2=0x7f62a4064d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:43:51.126 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:51.123+0000 7f62a885b640 1 -- 172.21.15.121:0/289759576 shutdown_connections 2024-08-18T22:43:51.126 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:51.123+0000 7f62a885b640 1 -- 172.21.15.121:0/289759576 wait complete. 2024-08-18T22:43:51.204 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:51.202+0000 7f4d2ab42640 1 -- 172.21.15.121:0/3238111774 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4d240fb1f0 msgr2=0x7f4d240fb600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:43:51.204 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:51.202+0000 7f4d2ab42640 1 --2- 172.21.15.121:0/3238111774 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4d240fb1f0 0x7f4d240fb600 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f4d180048d0 tx=0x7f4d18009da0 comp rx=0 tx=0).stop 2024-08-18T22:43:51.204 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:51.202+0000 7f4d2ab42640 1 -- 172.21.15.121:0/3238111774 shutdown_connections 2024-08-18T22:43:51.204 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:51.202+0000 7f4d2ab42640 1 --2- 172.21.15.121:0/3238111774 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4d240fc4c0 0x7f4d240fc930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:43:51.205 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:51.202+0000 7f4d2ab42640 1 --2- 172.21.15.121:0/3238111774 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4d240fb1f0 0x7f4d240fb600 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:43:51.205 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:51.202+0000 7f4d2ab42640 1 -- 172.21.15.121:0/3238111774 >> 172.21.15.121:0/3238111774 conn(0x7f4d240f69b0 msgr2=0x7f4d240f8de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:43:51.205 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:51.202+0000 7f4d2ab42640 1 -- 172.21.15.121:0/3238111774 shutdown_connections 2024-08-18T22:43:51.205 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:51.202+0000 7f4d2ab42640 1 -- 172.21.15.121:0/3238111774 wait complete. 2024-08-18T22:43:51.207 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:51.203+0000 7f4d2ab42640 1 Processor -- start 2024-08-18T22:43:51.208 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:51.203+0000 7f4d2ab42640 1 -- start start 2024-08-18T22:43:51.208 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:51.203+0000 7f4d2ab42640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4d240fb1f0 0x7f4d2410bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:43:51.208 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:51.203+0000 7f4d2ab42640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4d240fc4c0 0x7f4d2410c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:43:51.208 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:51.203+0000 7f4d2ab42640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d2410c940 con 0x7f4d240fb1f0 2024-08-18T22:43:51.208 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:51.203+0000 7f4d2ab42640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d2410d080 con 0x7f4d240fc4c0 2024-08-18T22:43:51.208 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:51.203+0000 7f4d288de640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4d240fb1f0 0x7f4d2410bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:43:51.209 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:51.203+0000 7f4d288de640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4d240fb1f0 0x7f4d2410bdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:53556/0 (socket says 172.21.15.121:53556) 2024-08-18T22:43:51.209 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:51.203+0000 7f4d288de640 1 -- 172.21.15.121:0/2688559420 learned_addr learned my addr 172.21.15.121:0/2688559420 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-18T22:43:51.209 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:51.203+0000 7f4d23fff640 1 --2- 172.21.15.121:0/2688559420 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4d240fc4c0 0x7f4d2410c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:43:51.209 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:51.203+0000 7f4d23fff640 1 -- 172.21.15.121:0/2688559420 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4d240fc4c0 msgr2=0x7f4d2410c2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-08-18T22:43:51.209 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:51.203+0000 7f4d23fff640 1 -- 172.21.15.121:0/2688559420 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4d240fc4c0 msgr2=0x7f4d2410c2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-08-18T22:43:51.209 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:51.203+0000 7f4d23fff640 1 --2- 172.21.15.121:0/2688559420 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4d240fc4c0 0x7f4d2410c2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-08-18T22:43:51.209 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:51.203+0000 7f4d23fff640 1 --2- 172.21.15.121:0/2688559420 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4d240fc4c0 0x7f4d2410c2f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-18T22:43:51.209 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:51.204+0000 7f4d288de640 1 -- 172.21.15.121:0/2688559420 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4d240fc4c0 msgr2=0x7f4d2410c2f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-18T22:43:51.209 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:51.204+0000 7f4d288de640 1 --2- 172.21.15.121:0/2688559420 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4d240fc4c0 0x7f4d2410c2f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:43:51.209 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:51.204+0000 7f4d288de640 1 -- 172.21.15.121:0/2688559420 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d18005040 con 0x7f4d240fb1f0 2024-08-18T22:43:51.209 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:51.204+0000 7f4d288de640 1 --2- 172.21.15.121:0/2688559420 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4d240fb1f0 0x7f4d2410bdb0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f4d180043d0 tx=0x7f4d18009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:43:51.210 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:51.204+0000 7f4d217fa640 1 -- 172.21.15.121:0/2688559420 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4d18038070 con 0x7f4d240fb1f0 2024-08-18T22:43:51.210 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:51.204+0000 7f4d217fa640 1 -- 172.21.15.121:0/2688559420 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f4d1802ae90 con 0x7f4d240fb1f0 2024-08-18T22:43:51.210 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:51.204+0000 7f4d2ab42640 1 -- 172.21.15.121:0/2688559420 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d2410d2b0 con 0x7f4d240fb1f0 2024-08-18T22:43:51.210 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:51.204+0000 7f4d217fa640 1 -- 172.21.15.121:0/2688559420 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4d1803e670 con 0x7f4d240fb1f0 2024-08-18T22:43:51.210 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:51.204+0000 7f4d2ab42640 1 -- 172.21.15.121:0/2688559420 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d2410d850 con 0x7f4d240fb1f0 2024-08-18T22:43:51.210 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:51.205+0000 7f4d2ab42640 1 -- 172.21.15.121:0/2688559420 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d240fa650 con 0x7f4d240fb1f0 2024-08-18T22:43:51.210 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:51.205+0000 7f4d217fa640 1 -- 172.21.15.121:0/2688559420 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 36) v1 ==== 92307+0+0 (secure 0 0 0) 0x7f4d18030020 con 0x7f4d240fb1f0 2024-08-18T22:43:51.211 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:51.206+0000 7f4d217fa640 1 --2- 172.21.15.121:0/2688559420 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f4d1406e1e0 0x7f4d14070690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:43:51.211 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:51.206+0000 7f4d217fa640 1 -- 172.21.15.121:0/2688559420 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f4d180aded0 con 0x7f4d240fb1f0 2024-08-18T22:43:51.211 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:51.206+0000 7f4d23fff640 1 --2- 172.21.15.121:0/2688559420 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f4d1406e1e0 0x7f4d14070690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:43:51.211 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:51.207+0000 7f4d23fff640 1 --2- 172.21.15.121:0/2688559420 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f4d1406e1e0 0x7f4d14070690 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f4d10009fd0 tx=0x7f4d10009ee0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:43:51.212 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:51.210+0000 7f4d217fa640 1 -- 172.21.15.121:0/2688559420 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f4d18077170 con 0x7f4d240fb1f0 2024-08-18T22:43:51.410 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:51 smithi195 podman[68812]: 2024-08-18 22:43:51.125609244 +0000 UTC m=+0.357326162 container init a9bb94ba3b56650f5a5000faf001d16dac61f58cad8af1485605838311cd7916 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-b003123a-5db1-11ef-bccf-c7b262605968-mon-smithi195, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=squid-de09dd0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.36.0) 2024-08-18T22:43:51.410 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:51 smithi195 podman[68812]: 2024-08-18 22:43:51.129023645 +0000 UTC m=+0.360740574 container start a9bb94ba3b56650f5a5000faf001d16dac61f58cad8af1485605838311cd7916 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-b003123a-5db1-11ef-bccf-c7b262605968-mon-smithi195, org.label-schema.build-date=20240731, ceph=True, RELEASE=squid-de09dd0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, io.buildah.version=1.36.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image) 2024-08-18T22:43:51.410 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:51 smithi195 ceph-mon[68841]: set uid:gid to 167:167 (ceph:ceph) 2024-08-18T22:43:51.410 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:51 smithi195 ceph-mon[68841]: ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc), process ceph-mon, pid 2 2024-08-18T22:43:51.410 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:51 smithi195 ceph-mon[68841]: pidfile_write: ignore empty --pid-file 2024-08-18T22:43:51.410 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:51 smithi195 ceph-mon[68841]: load: jerasure load: lrc 2024-08-18T22:43:51.410 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:51 smithi195 ceph-mon[68841]: rocksdb: RocksDB version: 7.9.2 2024-08-18T22:43:51.411 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:51 smithi195 ceph-mon[68841]: rocksdb: Git sha 0 2024-08-18T22:43:51.411 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:51 smithi195 ceph-mon[68841]: rocksdb: Compile date 2024-08-18 15:19:56 2024-08-18T22:43:51.411 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:51 smithi195 ceph-mon[68841]: rocksdb: DB SUMMARY 2024-08-18T22:43:51.411 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:51 smithi195 ceph-mon[68841]: rocksdb: DB Session ID: NLBAOWN47XXUK4B80N6X 2024-08-18T22:43:51.411 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:51 smithi195 ceph-mon[68841]: rocksdb: CURRENT file: CURRENT 2024-08-18T22:43:51.411 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:51 smithi195 ceph-mon[68841]: rocksdb: IDENTITY file: IDENTITY 2024-08-18T22:43:51.411 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:51 smithi195 ceph-mon[68841]: rocksdb: MANIFEST file: MANIFEST-000009 size: 897 Bytes 2024-08-18T22:43:51.412 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:51 smithi195 ceph-mon[68841]: rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi195/store.db dir, Total Num: 1, files: 000024.sst 2024-08-18T22:43:51.412 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:51 smithi195 ceph-mon[68841]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi195/store.db: 000022.log size: 5844175 ; 2024-08-18T22:43:51.412 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:51 smithi195 ceph-mon[68841]: rocksdb: Options.error_if_exists: 0 2024-08-18T22:43:51.412 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:51 smithi195 ceph-mon[68841]: rocksdb: Options.create_if_missing: 0 2024-08-18T22:43:51.412 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:51 smithi195 ceph-mon[68841]: rocksdb: Options.paranoid_checks: 1 2024-08-18T22:43:51.412 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:51 smithi195 ceph-mon[68841]: rocksdb: Options.flush_verify_memtable_count: 1 2024-08-18T22:43:51.412 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:51 smithi195 ceph-mon[68841]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-08-18T22:43:51.412 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:51 smithi195 ceph-mon[68841]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-08-18T22:43:51.412 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:51 smithi195 ceph-mon[68841]: rocksdb: Options.env: 0x55bc2fc8c7a0 2024-08-18T22:43:51.413 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:51 smithi195 ceph-mon[68841]: rocksdb: Options.fs: PosixFileSystem 2024-08-18T22:43:51.413 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:51 smithi195 ceph-mon[68841]: rocksdb: Options.info_log: 0x55bc319336e0 2024-08-18T22:43:51.413 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:51 smithi195 ceph-mon[68841]: rocksdb: Options.max_file_opening_threads: 16 2024-08-18T22:43:51.413 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:51 smithi195 ceph-mon[68841]: rocksdb: Options.statistics: (nil) 2024-08-18T22:43:51.413 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:51 smithi195 ceph-mon[68841]: rocksdb: Options.use_fsync: 0 2024-08-18T22:43:51.413 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:51 smithi195 ceph-mon[68841]: rocksdb: Options.max_log_file_size: 0 2024-08-18T22:43:51.413 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:51 smithi195 ceph-mon[68841]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-08-18T22:43:51.413 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:51 smithi195 ceph-mon[68841]: rocksdb: Options.log_file_time_to_roll: 0 2024-08-18T22:43:51.413 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:51 smithi195 ceph-mon[68841]: rocksdb: Options.keep_log_file_num: 1000 2024-08-18T22:43:51.414 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:51 smithi195 ceph-mon[68841]: rocksdb: Options.recycle_log_file_num: 0 2024-08-18T22:43:51.414 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:51 smithi195 ceph-mon[68841]: rocksdb: Options.allow_fallocate: 1 2024-08-18T22:43:51.414 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:51 smithi195 ceph-mon[68841]: rocksdb: Options.allow_mmap_reads: 0 2024-08-18T22:43:51.414 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:51 smithi195 ceph-mon[68841]: rocksdb: Options.allow_mmap_writes: 0 2024-08-18T22:43:51.414 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:51 smithi195 ceph-mon[68841]: rocksdb: Options.use_direct_reads: 0 2024-08-18T22:43:51.414 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:51 smithi195 ceph-mon[68841]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-08-18T22:43:51.414 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:51 smithi195 ceph-mon[68841]: rocksdb: Options.create_missing_column_families: 0 2024-08-18T22:43:51.414 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:51 smithi195 ceph-mon[68841]: rocksdb: Options.db_log_dir: 2024-08-18T22:43:51.414 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:51 smithi195 ceph-mon[68841]: rocksdb: Options.wal_dir: 2024-08-18T22:43:51.414 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:51 smithi195 ceph-mon[68841]: rocksdb: Options.table_cache_numshardbits: 6 2024-08-18T22:43:51.414 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:51 smithi195 ceph-mon[68841]: rocksdb: Options.WAL_ttl_seconds: 0 2024-08-18T22:43:51.415 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:51 smithi195 ceph-mon[68841]: rocksdb: Options.WAL_size_limit_MB: 0 2024-08-18T22:43:51.415 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:51 smithi195 ceph-mon[68841]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-08-18T22:43:51.415 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:51 smithi195 ceph-mon[68841]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-08-18T22:43:51.415 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:51 smithi195 ceph-mon[68841]: rocksdb: Options.is_fd_close_on_exec: 1 2024-08-18T22:43:51.415 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:51 smithi195 ceph-mon[68841]: rocksdb: Options.advise_random_on_open: 1 2024-08-18T22:43:51.415 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:51 smithi195 ceph-mon[68841]: rocksdb: Options.db_write_buffer_size: 0 2024-08-18T22:43:51.415 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:51 smithi195 ceph-mon[68841]: rocksdb: Options.write_buffer_manager: 0x55bc31942dc0 2024-08-18T22:43:51.415 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:51 smithi195 ceph-mon[68841]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-08-18T22:43:51.415 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:51 smithi195 ceph-mon[68841]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-08-18T22:43:51.416 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:51 smithi195 ceph-mon[68841]: rocksdb: Options.use_adaptive_mutex: 0 2024-08-18T22:43:51.416 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:51 smithi195 ceph-mon[68841]: rocksdb: Options.rate_limiter: (nil) 2024-08-18T22:43:51.416 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:51 smithi195 ceph-mon[68841]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-08-18T22:43:51.416 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:51 smithi195 ceph-mon[68841]: rocksdb: Options.wal_recovery_mode: 2 2024-08-18T22:43:51.416 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:51 smithi195 ceph-mon[68841]: rocksdb: Options.enable_thread_tracking: 0 2024-08-18T22:43:51.416 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:51 smithi195 ceph-mon[68841]: rocksdb: Options.enable_pipelined_write: 0 2024-08-18T22:43:51.416 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:51 smithi195 ceph-mon[68841]: rocksdb: Options.unordered_write: 0 2024-08-18T22:43:51.416 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:51 smithi195 ceph-mon[68841]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-08-18T22:43:51.416 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:51 smithi195 ceph-mon[68841]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-08-18T22:43:51.416 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:51 smithi195 ceph-mon[68841]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-08-18T22:43:51.416 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:51 smithi195 ceph-mon[68841]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-08-18T22:43:51.416 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:51 smithi195 ceph-mon[68841]: rocksdb: Options.row_cache: None 2024-08-18T22:43:51.417 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:51 smithi195 ceph-mon[68841]: rocksdb: Options.wal_filter: None 2024-08-18T22:43:51.418 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:51 smithi195 ceph-mon[68841]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-08-18T22:43:51.418 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:51 smithi195 ceph-mon[68841]: rocksdb: Options.allow_ingest_behind: 0 2024-08-18T22:43:51.418 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:51 smithi195 ceph-mon[68841]: rocksdb: Options.two_write_queues: 0 2024-08-18T22:43:51.419 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:51 smithi195 ceph-mon[68841]: rocksdb: Options.manual_wal_flush: 0 2024-08-18T22:43:51.419 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:51 smithi195 ceph-mon[68841]: rocksdb: Options.wal_compression: 0 2024-08-18T22:43:51.419 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:51 smithi195 ceph-mon[68841]: rocksdb: Options.atomic_flush: 0 2024-08-18T22:43:51.419 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:51 smithi195 ceph-mon[68841]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-08-18T22:43:51.419 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:51 smithi195 ceph-mon[68841]: rocksdb: Options.persist_stats_to_disk: 0 2024-08-18T22:43:51.419 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:51 smithi195 ceph-mon[68841]: rocksdb: Options.write_dbid_to_manifest: 0 2024-08-18T22:43:51.419 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:51 smithi195 ceph-mon[68841]: rocksdb: Options.log_readahead_size: 0 2024-08-18T22:43:51.419 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:51 smithi195 ceph-mon[68841]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-08-18T22:43:51.419 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:51 smithi195 ceph-mon[68841]: rocksdb: Options.best_efforts_recovery: 0 2024-08-18T22:43:51.419 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:51 smithi195 ceph-mon[68841]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-08-18T22:43:51.419 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:51 smithi195 ceph-mon[68841]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-08-18T22:43:51.419 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:51 smithi195 ceph-mon[68841]: rocksdb: Options.allow_data_in_errors: 0 2024-08-18T22:43:51.419 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:51 smithi195 ceph-mon[68841]: rocksdb: Options.db_host_id: __hostname__ 2024-08-18T22:43:51.420 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:51 smithi195 ceph-mon[68841]: rocksdb: Options.enforce_single_del_contracts: true 2024-08-18T22:43:51.420 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:51 smithi195 ceph-mon[68841]: rocksdb: Options.max_background_jobs: 2 2024-08-18T22:43:51.420 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:51 smithi195 ceph-mon[68841]: rocksdb: Options.max_background_compactions: -1 2024-08-18T22:43:51.420 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:51 smithi195 ceph-mon[68841]: rocksdb: Options.max_subcompactions: 1 2024-08-18T22:43:51.420 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:51 smithi195 ceph-mon[68841]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-08-18T22:43:51.420 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:51 smithi195 ceph-mon[68841]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-08-18T22:43:51.420 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:51 smithi195 ceph-mon[68841]: rocksdb: Options.delayed_write_rate : 16777216 2024-08-18T22:43:51.420 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:51 smithi195 ceph-mon[68841]: rocksdb: Options.max_total_wal_size: 0 2024-08-18T22:43:51.420 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:51 smithi195 ceph-mon[68841]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-08-18T22:43:51.420 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:51 smithi195 ceph-mon[68841]: rocksdb: Options.stats_dump_period_sec: 600 2024-08-18T22:43:51.420 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:51 smithi195 ceph-mon[68841]: rocksdb: Options.stats_persist_period_sec: 600 2024-08-18T22:43:51.420 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:51 smithi195 ceph-mon[68841]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-08-18T22:43:51.420 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:51 smithi195 ceph-mon[68841]: rocksdb: Options.max_open_files: -1 2024-08-18T22:43:51.420 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:51 smithi195 ceph-mon[68841]: rocksdb: Options.bytes_per_sync: 0 2024-08-18T22:43:51.421 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:51 smithi195 ceph-mon[68841]: rocksdb: Options.wal_bytes_per_sync: 0 2024-08-18T22:43:51.421 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:51 smithi195 ceph-mon[68841]: rocksdb: Options.strict_bytes_per_sync: 0 2024-08-18T22:43:51.421 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:51 smithi195 ceph-mon[68841]: rocksdb: Options.compaction_readahead_size: 0 2024-08-18T22:43:51.421 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:51 smithi195 ceph-mon[68841]: rocksdb: Options.max_background_flushes: -1 2024-08-18T22:43:51.421 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:51 smithi195 ceph-mon[68841]: rocksdb: Compression algorithms supported: 2024-08-18T22:43:51.421 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:51 smithi195 ceph-mon[68841]: rocksdb: kZSTD supported: 0 2024-08-18T22:43:51.421 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:51 smithi195 ceph-mon[68841]: rocksdb: kXpressCompression supported: 0 2024-08-18T22:43:51.421 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:51 smithi195 ceph-mon[68841]: rocksdb: kBZip2Compression supported: 0 2024-08-18T22:43:51.421 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:51 smithi195 ceph-mon[68841]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-08-18T22:43:51.421 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:51 smithi195 ceph-mon[68841]: rocksdb: kLZ4Compression supported: 1 2024-08-18T22:43:51.421 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:51 smithi195 ceph-mon[68841]: rocksdb: kZlibCompression supported: 1 2024-08-18T22:43:51.421 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:51 smithi195 ceph-mon[68841]: rocksdb: kLZ4HCCompression supported: 1 2024-08-18T22:43:51.421 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:51 smithi195 ceph-mon[68841]: rocksdb: kSnappyCompression supported: 1 2024-08-18T22:43:51.421 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:51 smithi195 ceph-mon[68841]: rocksdb: Fast CRC32 supported: Supported on x86 2024-08-18T22:43:51.422 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:51 smithi195 ceph-mon[68841]: rocksdb: DMutex implementation: pthread_mutex_t 2024-08-18T22:43:51.422 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:51 smithi195 ceph-mon[68841]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi195/store.db/MANIFEST-000009 2024-08-18T22:43:51.422 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:51 smithi195 ceph-mon[68841]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-08-18T22:43:51.422 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:51 smithi195 ceph-mon[68841]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-08-18T22:43:51.422 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:51 smithi195 ceph-mon[68841]: rocksdb: Options.merge_operator: 2024-08-18T22:43:51.422 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:51 smithi195 ceph-mon[68841]: rocksdb: Options.compaction_filter: None 2024-08-18T22:43:51.422 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:51 smithi195 ceph-mon[68841]: rocksdb: Options.compaction_filter_factory: None 2024-08-18T22:43:51.422 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:51 smithi195 ceph-mon[68841]: rocksdb: Options.sst_partitioner_factory: None 2024-08-18T22:43:51.422 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:51 smithi195 ceph-mon[68841]: rocksdb: Options.memtable_factory: SkipListFactory 2024-08-18T22:43:51.422 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:51 smithi195 ceph-mon[68841]: rocksdb: Options.table_factory: BlockBasedTable 2024-08-18T22:43:51.422 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:51 smithi195 ceph-mon[68841]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55bc31933320) 2024-08-18T22:43:51.422 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: cache_index_and_filter_blocks: 1 2024-08-18T22:43:51.423 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-08-18T22:43:51.423 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-08-18T22:43:51.423 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: pin_top_level_index_and_filter: 1 2024-08-18T22:43:51.423 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: index_type: 0 2024-08-18T22:43:51.423 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: data_block_index_type: 0 2024-08-18T22:43:51.423 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: index_shortening: 1 2024-08-18T22:43:51.423 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: data_block_hash_table_util_ratio: 0.750000 2024-08-18T22:43:51.423 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: checksum: 4 2024-08-18T22:43:51.423 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: no_block_cache: 0 2024-08-18T22:43:51.423 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: block_cache: 0x55bc31927090 2024-08-18T22:43:51.424 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: block_cache_name: BinnedLRUCache 2024-08-18T22:43:51.424 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: block_cache_options: 2024-08-18T22:43:51.424 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: capacity : 536870912 2024-08-18T22:43:51.424 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: num_shard_bits : 4 2024-08-18T22:43:51.424 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: strict_capacity_limit : 0 2024-08-18T22:43:51.424 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: high_pri_pool_ratio: 0.000 2024-08-18T22:43:51.424 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: block_cache_compressed: (nil) 2024-08-18T22:43:51.424 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: persistent_cache: (nil) 2024-08-18T22:43:51.424 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: block_size: 4096 2024-08-18T22:43:51.424 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: block_size_deviation: 10 2024-08-18T22:43:51.424 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: block_restart_interval: 16 2024-08-18T22:43:51.424 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: index_block_restart_interval: 1 2024-08-18T22:43:51.424 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: metadata_block_size: 4096 2024-08-18T22:43:51.424 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: partition_filters: 0 2024-08-18T22:43:51.425 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: use_delta_encoding: 1 2024-08-18T22:43:51.425 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: filter_policy: bloomfilter 2024-08-18T22:43:51.425 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: whole_key_filtering: 1 2024-08-18T22:43:51.425 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: verify_compression: 0 2024-08-18T22:43:51.425 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: read_amp_bytes_per_bit: 0 2024-08-18T22:43:51.425 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: format_version: 5 2024-08-18T22:43:51.425 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: enable_index_compression: 1 2024-08-18T22:43:51.425 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: block_align: 0 2024-08-18T22:43:51.425 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: max_auto_readahead_size: 262144 2024-08-18T22:43:51.425 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: prepopulate_block_cache: 0 2024-08-18T22:43:51.425 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: initial_auto_readahead_size: 8192 2024-08-18T22:43:51.425 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: num_file_reads_for_auto_readahead: 2 2024-08-18T22:43:51.426 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:51 smithi195 ceph-mon[68841]: rocksdb: Options.write_buffer_size: 33554432 2024-08-18T22:43:51.426 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:51 smithi195 ceph-mon[68841]: rocksdb: Options.max_write_buffer_number: 2 2024-08-18T22:43:51.426 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:51 smithi195 ceph-mon[68841]: rocksdb: Options.compression: NoCompression 2024-08-18T22:43:51.426 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:51 smithi195 ceph-mon[68841]: rocksdb: Options.bottommost_compression: Disabled 2024-08-18T22:43:51.426 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:51 smithi195 ceph-mon[68841]: rocksdb: Options.prefix_extractor: nullptr 2024-08-18T22:43:51.426 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:51 smithi195 ceph-mon[68841]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-08-18T22:43:51.426 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:51 smithi195 ceph-mon[68841]: rocksdb: Options.num_levels: 7 2024-08-18T22:43:51.426 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:51 smithi195 ceph-mon[68841]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-08-18T22:43:51.426 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:51 smithi195 ceph-mon[68841]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-08-18T22:43:51.426 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:51 smithi195 ceph-mon[68841]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-08-18T22:43:51.426 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:51 smithi195 ceph-mon[68841]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-08-18T22:43:51.426 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:51 smithi195 ceph-mon[68841]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-08-18T22:43:51.426 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:51 smithi195 ceph-mon[68841]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-08-18T22:43:51.427 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:51 smithi195 ceph-mon[68841]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-08-18T22:43:51.427 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:51 smithi195 ceph-mon[68841]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-08-18T22:43:51.427 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:51 smithi195 ceph-mon[68841]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-08-18T22:43:51.427 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:51 smithi195 ceph-mon[68841]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-08-18T22:43:51.427 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:51 smithi195 ceph-mon[68841]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-08-18T22:43:51.427 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:51 smithi195 ceph-mon[68841]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-08-18T22:43:51.427 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:51 smithi195 ceph-mon[68841]: rocksdb: Options.compression_opts.window_bits: -14 2024-08-18T22:43:51.427 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:51 smithi195 ceph-mon[68841]: rocksdb: Options.compression_opts.level: 32767 2024-08-18T22:43:51.427 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:51 smithi195 ceph-mon[68841]: rocksdb: Options.compression_opts.strategy: 0 2024-08-18T22:43:51.427 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:51 smithi195 ceph-mon[68841]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-08-18T22:43:51.427 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:51 smithi195 ceph-mon[68841]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-08-18T22:43:51.427 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:51 smithi195 ceph-mon[68841]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-08-18T22:43:51.428 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:51 smithi195 ceph-mon[68841]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-08-18T22:43:51.428 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:51 smithi195 ceph-mon[68841]: rocksdb: Options.compression_opts.enabled: false 2024-08-18T22:43:51.428 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:51 smithi195 ceph-mon[68841]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-08-18T22:43:51.428 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:51 smithi195 ceph-mon[68841]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-08-18T22:43:51.428 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:51 smithi195 ceph-mon[68841]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-08-18T22:43:51.428 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:51 smithi195 ceph-mon[68841]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-08-18T22:43:51.428 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:51 smithi195 ceph-mon[68841]: rocksdb: Options.target_file_size_base: 67108864 2024-08-18T22:43:51.428 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:51 smithi195 ceph-mon[68841]: rocksdb: Options.target_file_size_multiplier: 1 2024-08-18T22:43:51.428 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:51 smithi195 ceph-mon[68841]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-08-18T22:43:51.428 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:51 smithi195 ceph-mon[68841]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-08-18T22:43:51.429 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:51 smithi195 ceph-mon[68841]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-08-18T22:43:51.429 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:51 smithi195 ceph-mon[68841]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-08-18T22:43:51.429 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:51 smithi195 ceph-mon[68841]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-08-18T22:43:51.429 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:51 smithi195 ceph-mon[68841]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-08-18T22:43:51.429 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:51 smithi195 ceph-mon[68841]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-08-18T22:43:51.429 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:51 smithi195 ceph-mon[68841]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-08-18T22:43:51.429 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:51 smithi195 ceph-mon[68841]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-08-18T22:43:51.430 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:51 smithi195 ceph-mon[68841]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-08-18T22:43:51.430 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:51 smithi195 ceph-mon[68841]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-08-18T22:43:51.430 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:51 smithi195 ceph-mon[68841]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-08-18T22:43:51.430 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:51 smithi195 ceph-mon[68841]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-08-18T22:43:51.430 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:51 smithi195 ceph-mon[68841]: rocksdb: Options.arena_block_size: 1048576 2024-08-18T22:43:51.430 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:51 smithi195 ceph-mon[68841]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-08-18T22:43:51.430 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:51 smithi195 ceph-mon[68841]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-08-18T22:43:51.430 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:51 smithi195 ceph-mon[68841]: rocksdb: Options.disable_auto_compactions: 0 2024-08-18T22:43:51.431 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:51 smithi195 ceph-mon[68841]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-08-18T22:43:51.431 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:51 smithi195 ceph-mon[68841]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-08-18T22:43:51.431 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:51 smithi195 ceph-mon[68841]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-08-18T22:43:51.431 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:51 smithi195 ceph-mon[68841]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-08-18T22:43:51.431 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:51 smithi195 ceph-mon[68841]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-08-18T22:43:51.431 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:51 smithi195 ceph-mon[68841]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-08-18T22:43:51.431 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:51 smithi195 ceph-mon[68841]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-08-18T22:43:51.431 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:51 smithi195 ceph-mon[68841]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-08-18T22:43:51.431 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:51 smithi195 ceph-mon[68841]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-08-18T22:43:51.431 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:51 smithi195 ceph-mon[68841]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-08-18T22:43:51.431 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:51 smithi195 ceph-mon[68841]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-08-18T22:43:51.432 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:51 smithi195 ceph-mon[68841]: rocksdb: Options.inplace_update_support: 0 2024-08-18T22:43:51.432 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:51 smithi195 ceph-mon[68841]: rocksdb: Options.inplace_update_num_locks: 10000 2024-08-18T22:43:51.432 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:51 smithi195 ceph-mon[68841]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-08-18T22:43:51.432 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:51 smithi195 ceph-mon[68841]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-08-18T22:43:51.432 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:51 smithi195 ceph-mon[68841]: rocksdb: Options.memtable_huge_page_size: 0 2024-08-18T22:43:51.432 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:51 smithi195 ceph-mon[68841]: rocksdb: Options.bloom_locality: 0 2024-08-18T22:43:51.432 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:51 smithi195 ceph-mon[68841]: rocksdb: Options.max_successive_merges: 0 2024-08-18T22:43:51.432 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:51 smithi195 ceph-mon[68841]: rocksdb: Options.optimize_filters_for_hits: 0 2024-08-18T22:43:51.432 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:51 smithi195 ceph-mon[68841]: rocksdb: Options.paranoid_file_checks: 0 2024-08-18T22:43:51.432 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:51 smithi195 ceph-mon[68841]: rocksdb: Options.force_consistency_checks: 1 2024-08-18T22:43:51.432 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:51 smithi195 ceph-mon[68841]: rocksdb: Options.report_bg_io_stats: 0 2024-08-18T22:43:51.432 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:51 smithi195 ceph-mon[68841]: rocksdb: Options.ttl: 2592000 2024-08-18T22:43:51.432 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:51 smithi195 ceph-mon[68841]: rocksdb: Options.periodic_compaction_seconds: 0 2024-08-18T22:43:51.433 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:51 smithi195 ceph-mon[68841]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-08-18T22:43:51.433 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:51 smithi195 ceph-mon[68841]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-08-18T22:43:51.433 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:51 smithi195 ceph-mon[68841]: rocksdb: Options.enable_blob_files: false 2024-08-18T22:43:51.433 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:51 smithi195 ceph-mon[68841]: rocksdb: Options.min_blob_size: 0 2024-08-18T22:43:51.433 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:51 smithi195 ceph-mon[68841]: rocksdb: Options.blob_file_size: 268435456 2024-08-18T22:43:51.433 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:51 smithi195 ceph-mon[68841]: rocksdb: Options.blob_compression_type: NoCompression 2024-08-18T22:43:51.433 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:51 smithi195 ceph-mon[68841]: rocksdb: Options.enable_blob_garbage_collection: false 2024-08-18T22:43:51.433 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:51 smithi195 ceph-mon[68841]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-08-18T22:43:51.433 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:51 smithi195 ceph-mon[68841]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-08-18T22:43:51.433 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:51 smithi195 ceph-mon[68841]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-08-18T22:43:51.433 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:51 smithi195 ceph-mon[68841]: rocksdb: Options.blob_file_starting_level: 0 2024-08-18T22:43:51.433 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:51 smithi195 ceph-mon[68841]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-08-18T22:43:51.433 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:51 smithi195 ceph-mon[68841]: rocksdb: [table/block_based/block_based_table_reader.cc:721] At least one SST file opened without unique ID to verify: 24.sst 2024-08-18T22:43:51.434 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:51 smithi195 ceph-mon[68841]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-08-18T22:43:51.434 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:51 smithi195 ceph-mon[68841]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi195/store.db/MANIFEST-000009 succeeded,manifest_file_number is 9, next_file_number is 26, last_sequence is 10270, log_number is 22,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-08-18T22:43:51.434 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:51 smithi195 ceph-mon[68841]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 22 2024-08-18T22:43:51.434 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:51 smithi195 ceph-mon[68841]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 09bc1e56-e0bb-4c77-a2d8-c59935ba6dd5 2024-08-18T22:43:51.434 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:51 smithi195 ceph-mon[68841]: rocksdb: EVENT_LOG_v1 {"time_micros": 1724021031156021, "job": 1, "event": "recovery_started", "wal_files": [22]} 2024-08-18T22:43:51.434 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:51 smithi195 ceph-mon[68841]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #22 mode 2 2024-08-18T22:43:51.434 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:51 smithi195 ceph-mon[68841]: rocksdb: EVENT_LOG_v1 {"time_micros": 1724021031168808, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 27, "file_size": 3517805, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 10275, "largest_seqno": 11611, "table_properties": {"data_size": 3511497, "index_size": 3791, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 1477, "raw_key_size": 13755, "raw_average_key_size": 23, "raw_value_size": 3499117, "raw_average_value_size": 6074, "num_data_blocks": 172, "num_entries": 576, "num_filter_entries": 576, "num_deletions": 2, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1724021031, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "09bc1e56-e0bb-4c77-a2d8-c59935ba6dd5", "db_session_id": "NLBAOWN47XXUK4B80N6X", "orig_file_number": 27, "seqno_to_time_mapping": "N/A"}} 2024-08-18T22:43:51.434 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:51 smithi195 ceph-mon[68841]: rocksdb: EVENT_LOG_v1 {"time_micros": 1724021031168940, "job": 1, "event": "recovery_finished"} 2024-08-18T22:43:51.434 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:51 smithi195 ceph-mon[68841]: rocksdb: [db/version_set.cc:5047] Creating manifest 29 2024-08-18T22:43:51.434 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:51 smithi195 ceph-mon[68841]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-08-18T22:43:51.434 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:51 smithi195 ceph-mon[68841]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-smithi195/store.db/000022.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-08-18T22:43:51.435 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:51 smithi195 ceph-mon[68841]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55bc31954e00 2024-08-18T22:43:51.435 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:51 smithi195 ceph-mon[68841]: rocksdb: DB pointer 0x55bc31a4e000 2024-08-18T22:43:51.435 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:51 smithi195 ceph-mon[68841]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-08-18T22:43:51.435 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:51 smithi195 ceph-mon[68841]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-08-18T22:43:51.435 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: ** DB Stats ** 2024-08-18T22:43:51.435 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-08-18T22:43:51.435 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-08-18T22:43:51.435 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-08-18T22:43:51.435 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-08-18T22:43:51.435 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-08-18T22:43:51.435 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-08-18T22:43:51.435 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-08-18T22:43:51.435 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: 2024-08-18T22:43:51.435 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: ** Compaction Stats [default] ** 2024-08-18T22:43:51.436 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-08-18T22:43:51.436 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-08-18T22:43:51.436 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: L0 1/0 3.35 MB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 608.3 0.01 0.00 1 0.006 0 0 0.0 0.0 2024-08-18T22:43:51.436 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: L6 1/0 5.09 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 2024-08-18T22:43:51.436 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: Sum 2/0 8.45 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 608.3 0.01 0.00 1 0.006 0 0 0.0 0.0 2024-08-18T22:43:51.436 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 608.3 0.01 0.00 1 0.006 0 0 0.0 0.0 2024-08-18T22:43:51.436 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: 2024-08-18T22:43:51.436 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: ** Compaction Stats [default] ** 2024-08-18T22:43:51.436 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-08-18T22:43:51.436 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-08-18T22:43:51.436 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 608.3 0.01 0.00 1 0.006 0 0 0.0 0.0 2024-08-18T22:43:51.436 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: 2024-08-18T22:43:51.436 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-08-18T22:43:51.437 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: 2024-08-18T22:43:51.437 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-08-18T22:43:51.437 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: Flush(GB): cumulative 0.003, interval 0.003 2024-08-18T22:43:51.437 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-08-18T22:43:51.437 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-08-18T22:43:51.437 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-08-18T22:43:51.437 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: AddFile(Keys): cumulative 0, interval 0 2024-08-18T22:43:51.437 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: Cumulative compaction: 0.00 GB write, 216.16 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-08-18T22:43:51.437 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: Interval compaction: 0.00 GB write, 216.16 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-08-18T22:43:51.437 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-08-18T22:43:51.438 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: Block cache BinnedLRUCache@0x55bc31927090#2 capacity: 512.00 MB usage: 5.61 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.2e-05 secs_since: 0 2024-08-18T22:43:51.438 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,1.53 KB,0.000292063%) IndexBlock(1,4.08 KB,0.000777841%) Misc(1,0.00 KB,0%) 2024-08-18T22:43:51.438 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: 2024-08-18T22:43:51.438 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: ** File Read Latency Histogram By Level [default] ** 2024-08-18T22:43:51.438 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:51 smithi195 ceph-mon[68841]: starting mon.smithi195 rank 1 at public addrs [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] at bind addrs [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi195 fsid b003123a-5db1-11ef-bccf-c7b262605968 2024-08-18T22:43:51.438 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:51 smithi195 ceph-mon[68841]: mon.smithi195@-1(???) e2 preinit fsid b003123a-5db1-11ef-bccf-c7b262605968 2024-08-18T22:43:51.438 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:51 smithi195 ceph-mon[68841]: mon.smithi195@-1(???).mds e19 new map 2024-08-18T22:43:51.438 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:51 smithi195 ceph-mon[68841]: mon.smithi195@-1(???).mds e19 print_map 2024-08-18T22:43:51.438 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: e19 2024-08-18T22:43:51.438 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: btime 1970-01-01T00:00:00:000000+0000 2024-08-18T22:43:51.438 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-08-18T22:43:51.439 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-08-18T22:43:51.439 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: legacy client fscid: 1 2024-08-18T22:43:51.439 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: 2024-08-18T22:43:51.439 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: Filesystem 'cephfs' (1) 2024-08-18T22:43:51.439 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: fs_name cephfs 2024-08-18T22:43:51.439 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: epoch 19 2024-08-18T22:43:51.439 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: flags 12 joinable allow_snaps allow_multimds_snaps 2024-08-18T22:43:51.439 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: created 2024-08-18T22:39:04.054074+0000 2024-08-18T22:43:51.439 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: modified 2024-08-18T22:42:16.794905+0000 2024-08-18T22:43:51.439 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: tableserver 0 2024-08-18T22:43:51.439 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: root 0 2024-08-18T22:43:51.439 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: session_timeout 60 2024-08-18T22:43:51.439 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: session_autoclose 300 2024-08-18T22:43:51.439 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: max_file_size 1099511627776 2024-08-18T22:43:51.440 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: max_xattr_size 65536 2024-08-18T22:43:51.440 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: required_client_features {} 2024-08-18T22:43:51.440 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: last_failure 0 2024-08-18T22:43:51.440 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: last_failure_osd_epoch 47 2024-08-18T22:43:51.440 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-08-18T22:43:51.440 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: max_mds 2 2024-08-18T22:43:51.440 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: in 0,1 2024-08-18T22:43:51.440 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: up {0=14474,1=24249} 2024-08-18T22:43:51.440 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: failed 2024-08-18T22:43:51.440 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: damaged 2024-08-18T22:43:51.440 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: stopped 2024-08-18T22:43:51.441 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: data_pools [3] 2024-08-18T22:43:51.441 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: metadata_pool 2 2024-08-18T22:43:51.441 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: inline_data disabled 2024-08-18T22:43:51.441 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: balancer 2024-08-18T22:43:51.441 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: bal_rank_mask -1 2024-08-18T22:43:51.441 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: standby_count_wanted 1 2024-08-18T22:43:51.441 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: qdb_cluster leader: 0 members: 2024-08-18T22:43:51.441 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: [mds.cephfs.smithi121.gbickb{0:14474} state up:active seq 6 export targets 1 join_fscid=1 addr [v2:172.21.15.121:6828/2277706406,v1:172.21.15.121:6829/2277706406] compat {c=[1],r=[1],i=[7ff]}] 2024-08-18T22:43:51.442 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: [mds.cephfs.smithi195.buqvbr{1:24249} state up:active seq 4 export targets 0 join_fscid=1 addr [v2:172.21.15.195:6824/2414511859,v1:172.21.15.195:6825/2414511859] compat {c=[1],r=[1],i=[7ff]}] 2024-08-18T22:43:51.442 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: 2024-08-18T22:43:51.442 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: 2024-08-18T22:43:51.442 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: Standby daemons: 2024-08-18T22:43:51.442 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: 2024-08-18T22:43:51.442 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: [mds.cephfs.smithi121.xuzsdg{-1:14490} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.121:6826/91588128,v1:172.21.15.121:6827/91588128] compat {c=[1],r=[1],i=[7ff]}] 2024-08-18T22:43:51.442 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: [mds.cephfs.smithi195.nptgyc{-1:24259} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.195:6826/238549847,v1:172.21.15.195:6827/238549847] compat {c=[1],r=[1],i=[7ff]}] 2024-08-18T22:43:51.442 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:51 smithi195 ceph-mon[68841]: mon.smithi195@-1(???).osd e50 crush map has features 3314933000852226048, adjusting msgr requires 2024-08-18T22:43:51.443 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:51 smithi195 ceph-mon[68841]: mon.smithi195@-1(???).osd e50 crush map has features 288514051259236352, adjusting msgr requires 2024-08-18T22:43:51.443 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:51 smithi195 ceph-mon[68841]: mon.smithi195@-1(???).osd e50 crush map has features 288514051259236352, adjusting msgr requires 2024-08-18T22:43:51.443 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:51 smithi195 ceph-mon[68841]: mon.smithi195@-1(???).osd e50 crush map has features 288514051259236352, adjusting msgr requires 2024-08-18T22:43:51.443 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:51 smithi195 ceph-mon[68841]: mon.smithi195@-1(???).paxosservice(auth 1..21) refresh upgraded, format 0 -> 3 2024-08-18T22:43:51.443 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:51 smithi195 bash[68812]: a9bb94ba3b56650f5a5000faf001d16dac61f58cad8af1485605838311cd7916 2024-08-18T22:43:51.443 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:51 smithi195 systemd[1]: Started Ceph mon.smithi195 for b003123a-5db1-11ef-bccf-c7b262605968. 2024-08-18T22:43:51.444 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:51.442+0000 7f4d2ab42640 1 -- 172.21.15.121:0/2688559420 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f4d2404b4c0 con 0x7f4d240fb1f0 2024-08-18T22:43:51.444 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:51.442+0000 7f4d217fa640 1 -- 172.21.15.121:0/2688559420 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f4d1807a830 con 0x7f4d240fb1f0 2024-08-18T22:43:51.444 INFO:teuthology.orchestra.run.smithi121.stdout:HEALTH_OK 2024-08-18T22:43:51.451 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:51.444+0000 7f4d2ab42640 1 -- 172.21.15.121:0/2688559420 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f4d1406e1e0 msgr2=0x7f4d14070690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:43:51.451 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:51.444+0000 7f4d2ab42640 1 --2- 172.21.15.121:0/2688559420 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f4d1406e1e0 0x7f4d14070690 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f4d10009fd0 tx=0x7f4d10009ee0 comp rx=0 tx=0).stop 2024-08-18T22:43:51.452 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:51.444+0000 7f4d2ab42640 1 -- 172.21.15.121:0/2688559420 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4d240fb1f0 msgr2=0x7f4d2410bdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:43:51.452 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:51.444+0000 7f4d2ab42640 1 --2- 172.21.15.121:0/2688559420 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4d240fb1f0 0x7f4d2410bdb0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f4d180043d0 tx=0x7f4d18009da0 comp rx=0 tx=0).stop 2024-08-18T22:43:51.452 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:51.444+0000 7f4d2ab42640 1 -- 172.21.15.121:0/2688559420 shutdown_connections 2024-08-18T22:43:51.452 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:51.444+0000 7f4d2ab42640 1 --2- 172.21.15.121:0/2688559420 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f4d1406e1e0 0x7f4d14070690 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:43:51.452 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:51.444+0000 7f4d2ab42640 1 --2- 172.21.15.121:0/2688559420 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4d240fc4c0 0x7f4d2410c2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:43:51.452 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:51.444+0000 7f4d2ab42640 1 --2- 172.21.15.121:0/2688559420 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4d240fb1f0 0x7f4d2410bdb0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:43:51.452 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:51.444+0000 7f4d2ab42640 1 -- 172.21.15.121:0/2688559420 >> 172.21.15.121:0/2688559420 conn(0x7f4d240f69b0 msgr2=0x7f4d240f81b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:43:51.453 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:51.444+0000 7f4d2ab42640 1 -- 172.21.15.121:0/2688559420 shutdown_connections 2024-08-18T22:43:51.453 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:43:51.444+0000 7f4d2ab42640 1 -- 172.21.15.121:0/2688559420 wait complete. 2024-08-18T22:43:53.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:52 smithi121 ceph-mon[81053]: pgmap v8: 65 pgs: 65 active+clean; 2.0 GiB data, 7.5 GiB used, 529 GiB / 536 GiB avail; 23 KiB/s rd, 0 B/s wr, 12 op/s 2024-08-18T22:43:53.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:52 smithi195 ceph-mon[68841]: pgmap v8: 65 pgs: 65 active+clean; 2.0 GiB data, 7.5 GiB used, 529 GiB / 536 GiB avail; 23 KiB/s rd, 0 B/s wr, 12 op/s 2024-08-18T22:43:53.834 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:53 smithi121 ceph-mon[81053]: pgmap v10: 65 pgs: 65 active+clean; 2.0 GiB data, 7.5 GiB used, 529 GiB / 536 GiB avail; 17 KiB/s rd, 0 B/s wr, 9 op/s 2024-08-18T22:43:53.834 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:53 smithi121 ceph-mon[81053]: overall HEALTH_OK 2024-08-18T22:43:53.834 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:53 smithi121 ceph-mon[81053]: mon.smithi195 calling monitor election 2024-08-18T22:43:53.834 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:53 smithi121 ceph-mon[81053]: mon.smithi121 calling monitor election 2024-08-18T22:43:53.834 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:53 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "mon metadata", "id": "smithi121"}]: dispatch 2024-08-18T22:43:53.834 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:53 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "mon metadata", "id": "smithi195"}]: dispatch 2024-08-18T22:43:53.834 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:53 smithi121 ceph-mon[81053]: mon.smithi121 is new leader, mons smithi121,smithi195 in quorum (ranks 0,1) 2024-08-18T22:43:53.834 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:53 smithi121 ceph-mon[81053]: monmap epoch 3 2024-08-18T22:43:53.835 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:53 smithi121 ceph-mon[81053]: fsid b003123a-5db1-11ef-bccf-c7b262605968 2024-08-18T22:43:53.835 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:53 smithi121 ceph-mon[81053]: last_changed 2024-08-18T22:43:52.698736+0000 2024-08-18T22:43:53.835 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:53 smithi121 ceph-mon[81053]: created 2024-08-18T22:32:38.034362+0000 2024-08-18T22:43:53.835 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:53 smithi121 ceph-mon[81053]: min_mon_release 19 (squid) 2024-08-18T22:43:53.835 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:53 smithi121 ceph-mon[81053]: election_strategy: 1 2024-08-18T22:43:53.835 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:53 smithi121 ceph-mon[81053]: 0: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.smithi121 2024-08-18T22:43:53.835 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:53 smithi121 ceph-mon[81053]: 1: [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] mon.smithi195 2024-08-18T22:43:53.835 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:53 smithi121 ceph-mon[81053]: fsmap cephfs:2 {0=cephfs.smithi121.gbickb=up:active,1=cephfs.smithi195.buqvbr=up:active} 2 up:standby 2024-08-18T22:43:53.835 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:53 smithi121 ceph-mon[81053]: osdmap e50: 6 total, 6 up, 6 in 2024-08-18T22:43:53.835 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:53 smithi121 ceph-mon[81053]: mgrmap e36: smithi121.lopxqc(active, since 14s), standbys: smithi195.acttsj 2024-08-18T22:43:53.835 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:53 smithi121 ceph-mon[81053]: overall HEALTH_OK 2024-08-18T22:43:53.836 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:53 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:43:53.836 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:53 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:43:53.836 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:53 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-18T22:43:53.836 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:53 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-18T22:43:53.981 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:53 smithi195 ceph-mon[68841]: pgmap v10: 65 pgs: 65 active+clean; 2.0 GiB data, 7.5 GiB used, 529 GiB / 536 GiB avail; 17 KiB/s rd, 0 B/s wr, 9 op/s 2024-08-18T22:43:53.982 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:53 smithi195 ceph-mon[68841]: overall HEALTH_OK 2024-08-18T22:43:53.982 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:53 smithi195 ceph-mon[68841]: mon.smithi195 calling monitor election 2024-08-18T22:43:53.982 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:53 smithi195 ceph-mon[68841]: mon.smithi121 calling monitor election 2024-08-18T22:43:53.982 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:53 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "mon metadata", "id": "smithi121"}]: dispatch 2024-08-18T22:43:53.982 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:53 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "mon metadata", "id": "smithi195"}]: dispatch 2024-08-18T22:43:53.982 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:53 smithi195 ceph-mon[68841]: mon.smithi121 is new leader, mons smithi121,smithi195 in quorum (ranks 0,1) 2024-08-18T22:43:53.982 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:53 smithi195 ceph-mon[68841]: monmap epoch 3 2024-08-18T22:43:53.982 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:53 smithi195 ceph-mon[68841]: fsid b003123a-5db1-11ef-bccf-c7b262605968 2024-08-18T22:43:53.982 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:53 smithi195 ceph-mon[68841]: last_changed 2024-08-18T22:43:52.698736+0000 2024-08-18T22:43:53.982 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:53 smithi195 ceph-mon[68841]: created 2024-08-18T22:32:38.034362+0000 2024-08-18T22:43:53.982 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:53 smithi195 ceph-mon[68841]: min_mon_release 19 (squid) 2024-08-18T22:43:53.982 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:53 smithi195 ceph-mon[68841]: election_strategy: 1 2024-08-18T22:43:53.983 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:53 smithi195 ceph-mon[68841]: 0: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.smithi121 2024-08-18T22:43:53.983 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:53 smithi195 ceph-mon[68841]: 1: [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] mon.smithi195 2024-08-18T22:43:53.983 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:53 smithi195 ceph-mon[68841]: fsmap cephfs:2 {0=cephfs.smithi121.gbickb=up:active,1=cephfs.smithi195.buqvbr=up:active} 2 up:standby 2024-08-18T22:43:53.983 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:53 smithi195 ceph-mon[68841]: osdmap e50: 6 total, 6 up, 6 in 2024-08-18T22:43:53.983 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:53 smithi195 ceph-mon[68841]: mgrmap e36: smithi121.lopxqc(active, since 14s), standbys: smithi195.acttsj 2024-08-18T22:43:53.983 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:53 smithi195 ceph-mon[68841]: overall HEALTH_OK 2024-08-18T22:43:53.983 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:53 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:43:53.983 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:53 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:43:53.983 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:53 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-18T22:43:53.983 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:53 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-18T22:43:56.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:55 smithi121 ceph-mon[81053]: pgmap v11: 65 pgs: 65 active+clean; 2.0 GiB data, 7.5 GiB used, 529 GiB / 536 GiB avail; 17 KiB/s rd, 0 B/s wr, 9 op/s 2024-08-18T22:43:56.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:55 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:43:56.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:55 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:43:56.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:55 smithi195 ceph-mon[68841]: pgmap v11: 65 pgs: 65 active+clean; 2.0 GiB data, 7.5 GiB used, 529 GiB / 536 GiB avail; 17 KiB/s rd, 0 B/s wr, 9 op/s 2024-08-18T22:43:56.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:55 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:43:56.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:55 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:43:57.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:57 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:43:57.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:57 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:43:57.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:57 smithi195 ceph-mon[68841]: pgmap v12: 65 pgs: 65 active+clean; 2.0 GiB data, 7.5 GiB used, 529 GiB / 536 GiB avail; 17 KiB/s rd, 0 B/s wr, 9 op/s 2024-08-18T22:43:57.333 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:57 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:43:57.333 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:57 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:43:57.334 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:57 smithi121 ceph-mon[81053]: pgmap v12: 65 pgs: 65 active+clean; 2.0 GiB data, 7.5 GiB used, 529 GiB / 536 GiB avail; 17 KiB/s rd, 0 B/s wr, 9 op/s 2024-08-18T22:43:59.833 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:59 smithi121 ceph-mon[81053]: pgmap v13: 65 pgs: 65 active+clean; 2.0 GiB data, 7.5 GiB used, 529 GiB / 536 GiB avail 2024-08-18T22:43:59.834 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:59 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:43:59.834 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:59 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:43:59.834 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:59 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:43:59.834 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:59 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-18T22:43:59.834 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:59 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:43:59.834 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:59 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-08-18T22:43:59.834 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:59 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-08-18T22:43:59.834 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:43:59 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:43:59.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:59 smithi195 ceph-mon[68841]: pgmap v13: 65 pgs: 65 active+clean; 2.0 GiB data, 7.5 GiB used, 529 GiB / 536 GiB avail 2024-08-18T22:43:59.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:59 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:43:59.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:59 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:43:59.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:59 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:43:59.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:59 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-18T22:43:59.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:59 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:43:59.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:59 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-08-18T22:43:59.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:59 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-08-18T22:43:59.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:43:59 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:44:00.834 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:44:00 smithi121 ceph-mon[81053]: Reconfiguring mon.smithi121 (monmap changed)... 2024-08-18T22:44:00.834 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:44:00 smithi121 ceph-mon[81053]: Reconfiguring daemon mon.smithi121 on smithi121 2024-08-18T22:44:00.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:44:00 smithi195 ceph-mon[68841]: Reconfiguring mon.smithi121 (monmap changed)... 2024-08-18T22:44:00.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:44:00 smithi195 ceph-mon[68841]: Reconfiguring daemon mon.smithi121 on smithi121 2024-08-18T22:44:01.833 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:44:01 smithi121 ceph-mon[81053]: pgmap v14: 65 pgs: 65 active+clean; 2.0 GiB data, 7.5 GiB used, 529 GiB / 536 GiB avail 2024-08-18T22:44:01.834 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:44:01 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:44:01.834 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:44:01 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:44:01.834 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:44:01 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi121.lopxqc", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-08-18T22:44:01.834 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:44:01 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "mgr services"}]: dispatch 2024-08-18T22:44:01.834 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:44:01 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:44:01.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:44:01 smithi195 ceph-mon[68841]: pgmap v14: 65 pgs: 65 active+clean; 2.0 GiB data, 7.5 GiB used, 529 GiB / 536 GiB avail 2024-08-18T22:44:01.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:44:01 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:44:01.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:44:01 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:44:01.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:44:01 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi121.lopxqc", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-08-18T22:44:01.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:44:01 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "mgr services"}]: dispatch 2024-08-18T22:44:01.910 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:44:01 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:44:02.659 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:44:02 smithi195 ceph-mon[68841]: Reconfiguring mgr.smithi121.lopxqc (monmap changed)... 2024-08-18T22:44:02.659 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:44:02 smithi195 ceph-mon[68841]: Reconfiguring daemon mgr.smithi121.lopxqc on smithi121 2024-08-18T22:44:02.659 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:44:02 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:44:02.659 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:44:02 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:44:02.659 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:44:02 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi121", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-08-18T22:44:02.659 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:44:02 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:44:02.834 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:44:02 smithi121 ceph-mon[81053]: Reconfiguring mgr.smithi121.lopxqc (monmap changed)... 2024-08-18T22:44:02.834 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:44:02 smithi121 ceph-mon[81053]: Reconfiguring daemon mgr.smithi121.lopxqc on smithi121 2024-08-18T22:44:02.834 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:44:02 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:44:02.834 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:44:02 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:44:02.834 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:44:02 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi121", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-08-18T22:44:02.834 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:44:02 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:44:03.834 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:44:03 smithi121 ceph-mon[81053]: Reconfiguring crash.smithi121 (monmap changed)... 2024-08-18T22:44:03.834 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:44:03 smithi121 ceph-mon[81053]: Reconfiguring daemon crash.smithi121 on smithi121 2024-08-18T22:44:03.834 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:44:03 smithi121 ceph-mon[81053]: pgmap v15: 65 pgs: 65 active+clean; 2.0 GiB data, 7.5 GiB used, 529 GiB / 536 GiB avail 2024-08-18T22:44:03.834 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:44:03 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:44:03.835 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:44:03 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:44:03.835 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:44:03 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-08-18T22:44:03.835 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:44:03 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:44:03.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:44:03 smithi195 ceph-mon[68841]: Reconfiguring crash.smithi121 (monmap changed)... 2024-08-18T22:44:03.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:44:03 smithi195 ceph-mon[68841]: Reconfiguring daemon crash.smithi121 on smithi121 2024-08-18T22:44:03.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:44:03 smithi195 ceph-mon[68841]: pgmap v15: 65 pgs: 65 active+clean; 2.0 GiB data, 7.5 GiB used, 529 GiB / 536 GiB avail 2024-08-18T22:44:03.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:44:03 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:44:03.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:44:03 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:44:03.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:44:03 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-08-18T22:44:03.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:44:03 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:44:04.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:44:04 smithi195 ceph-mon[68841]: Reconfiguring osd.0 (monmap changed)... 2024-08-18T22:44:04.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:44:04 smithi195 ceph-mon[68841]: Reconfiguring daemon osd.0 on smithi121 2024-08-18T22:44:04.932 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:44:04 smithi121 ceph-mon[81053]: Reconfiguring osd.0 (monmap changed)... 2024-08-18T22:44:04.932 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:44:04 smithi121 ceph-mon[81053]: Reconfiguring daemon osd.0 on smithi121 2024-08-18T22:44:05.773 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:44:05 smithi121 ceph-mon[81053]: pgmap v16: 65 pgs: 65 active+clean; 2.0 GiB data, 7.5 GiB used, 529 GiB / 536 GiB avail 2024-08-18T22:44:05.773 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:44:05 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:44:05.773 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:44:05 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:44:05.773 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:44:05 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-08-18T22:44:05.773 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:44:05 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:44:05.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:44:05 smithi195 ceph-mon[68841]: pgmap v16: 65 pgs: 65 active+clean; 2.0 GiB data, 7.5 GiB used, 529 GiB / 536 GiB avail 2024-08-18T22:44:05.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:44:05 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:44:05.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:44:05 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:44:05.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:44:05 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-08-18T22:44:05.910 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:44:05 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:44:06.833 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:44:06 smithi121 ceph-mon[81053]: Reconfiguring osd.1 (monmap changed)... 2024-08-18T22:44:06.833 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:44:06 smithi121 ceph-mon[81053]: Reconfiguring daemon osd.1 on smithi121 2024-08-18T22:44:06.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:44:06 smithi195 ceph-mon[68841]: Reconfiguring osd.1 (monmap changed)... 2024-08-18T22:44:06.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:44:06 smithi195 ceph-mon[68841]: Reconfiguring daemon osd.1 on smithi121 2024-08-18T22:44:07.900 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:44:07 smithi121 ceph-mon[81053]: pgmap v17: 65 pgs: 65 active+clean; 2.0 GiB data, 7.5 GiB used, 529 GiB / 536 GiB avail 2024-08-18T22:44:07.901 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:44:07 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:44:07.901 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:44:07 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:44:07.901 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:44:07 smithi121 ceph-mon[81053]: Reconfiguring osd.2 (monmap changed)... 2024-08-18T22:44:07.901 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:44:07 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-08-18T22:44:07.901 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:44:07 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:44:07.901 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:44:07 smithi121 ceph-mon[81053]: Reconfiguring daemon osd.2 on smithi121 2024-08-18T22:44:07.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:44:07 smithi195 ceph-mon[68841]: pgmap v17: 65 pgs: 65 active+clean; 2.0 GiB data, 7.5 GiB used, 529 GiB / 536 GiB avail 2024-08-18T22:44:07.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:44:07 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:44:07.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:44:07 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:44:07.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:44:07 smithi195 ceph-mon[68841]: Reconfiguring osd.2 (monmap changed)... 2024-08-18T22:44:07.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:44:07 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-08-18T22:44:07.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:44:07 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:44:07.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:44:07 smithi195 ceph-mon[68841]: Reconfiguring daemon osd.2 on smithi121 2024-08-18T22:44:09.333 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:44:08 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:44:09.333 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:44:08 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:44:09.334 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:44:08 smithi121 ceph-mon[81053]: Reconfiguring mds.cephfs.smithi121.xuzsdg (monmap changed)... 2024-08-18T22:44:09.334 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:44:08 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi121.xuzsdg", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-08-18T22:44:09.334 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:44:08 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:44:09.334 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:44:08 smithi121 ceph-mon[81053]: Reconfiguring daemon mds.cephfs.smithi121.xuzsdg on smithi121 2024-08-18T22:44:09.334 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:44:08 smithi121 ceph-mon[81053]: pgmap v18: 65 pgs: 65 active+clean; 2.0 GiB data, 7.5 GiB used, 529 GiB / 536 GiB avail 2024-08-18T22:44:09.334 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:44:08 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-18T22:44:09.409 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:44:08 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:44:09.409 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:44:08 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:44:09.409 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:44:08 smithi195 ceph-mon[68841]: Reconfiguring mds.cephfs.smithi121.xuzsdg (monmap changed)... 2024-08-18T22:44:09.409 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:44:08 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi121.xuzsdg", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-08-18T22:44:09.409 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:44:08 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:44:09.409 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:44:08 smithi195 ceph-mon[68841]: Reconfiguring daemon mds.cephfs.smithi121.xuzsdg on smithi121 2024-08-18T22:44:09.409 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:44:08 smithi195 ceph-mon[68841]: pgmap v18: 65 pgs: 65 active+clean; 2.0 GiB data, 7.5 GiB used, 529 GiB / 536 GiB avail 2024-08-18T22:44:09.410 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:44:08 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-18T22:44:10.743 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:44:10 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:44:10.744 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:44:10 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:44:10.744 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:44:10 smithi121 ceph-mon[81053]: Reconfiguring mds.cephfs.smithi121.gbickb (monmap changed)... 2024-08-18T22:44:10.744 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:44:10 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi121.gbickb", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-08-18T22:44:10.744 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:44:10 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:44:10.744 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:44:10 smithi121 ceph-mon[81053]: Reconfiguring daemon mds.cephfs.smithi121.gbickb on smithi121 2024-08-18T22:44:10.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:44:10 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:44:10.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:44:10 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:44:10.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:44:10 smithi195 ceph-mon[68841]: Reconfiguring mds.cephfs.smithi121.gbickb (monmap changed)... 2024-08-18T22:44:10.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:44:10 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi121.gbickb", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-08-18T22:44:10.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:44:10 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:44:10.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:44:10 smithi195 ceph-mon[68841]: Reconfiguring daemon mds.cephfs.smithi121.gbickb on smithi121 2024-08-18T22:44:11.446 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:44:11 smithi195 ceph-mon[68841]: pgmap v19: 65 pgs: 65 active+clean; 2.0 GiB data, 7.5 GiB used, 529 GiB / 536 GiB avail 2024-08-18T22:44:11.446 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:44:11 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:44:11.446 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:44:11 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:44:11.446 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:44:11 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi195", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-08-18T22:44:11.446 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:44:11 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:44:11.583 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:44:11 smithi121 ceph-mon[81053]: pgmap v19: 65 pgs: 65 active+clean; 2.0 GiB data, 7.5 GiB used, 529 GiB / 536 GiB avail 2024-08-18T22:44:11.584 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:44:11 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:44:11.584 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:44:11 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:44:11.584 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:44:11 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi195", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-08-18T22:44:11.584 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:44:11 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:44:12.583 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:44:12 smithi121 ceph-mon[81053]: Reconfiguring crash.smithi195 (monmap changed)... 2024-08-18T22:44:12.583 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:44:12 smithi121 ceph-mon[81053]: Reconfiguring daemon crash.smithi195 on smithi195 2024-08-18T22:44:12.584 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:44:12 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:44:12.584 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:44:12 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:44:12.584 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:44:12 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi195.acttsj", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-08-18T22:44:12.584 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:44:12 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "mgr services"}]: dispatch 2024-08-18T22:44:12.584 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:44:12 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:44:12.656 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:44:12 smithi195 ceph-mon[68841]: Reconfiguring crash.smithi195 (monmap changed)... 2024-08-18T22:44:12.656 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:44:12 smithi195 ceph-mon[68841]: Reconfiguring daemon crash.smithi195 on smithi195 2024-08-18T22:44:12.656 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:44:12 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:44:12.656 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:44:12 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:44:12.656 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:44:12 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi195.acttsj", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-08-18T22:44:12.656 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:44:12 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "mgr services"}]: dispatch 2024-08-18T22:44:12.656 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:44:12 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:44:13.695 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:44:13 smithi195 ceph-mon[68841]: Reconfiguring mgr.smithi195.acttsj (monmap changed)... 2024-08-18T22:44:13.695 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:44:13 smithi195 ceph-mon[68841]: Reconfiguring daemon mgr.smithi195.acttsj on smithi195 2024-08-18T22:44:13.695 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:44:13 smithi195 ceph-mon[68841]: pgmap v20: 65 pgs: 65 active+clean; 2.0 GiB data, 7.5 GiB used, 529 GiB / 536 GiB avail 2024-08-18T22:44:13.833 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:44:13 smithi121 ceph-mon[81053]: Reconfiguring mgr.smithi195.acttsj (monmap changed)... 2024-08-18T22:44:13.834 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:44:13 smithi121 ceph-mon[81053]: Reconfiguring daemon mgr.smithi195.acttsj on smithi195 2024-08-18T22:44:13.834 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:44:13 smithi121 ceph-mon[81053]: pgmap v20: 65 pgs: 65 active+clean; 2.0 GiB data, 7.5 GiB used, 529 GiB / 536 GiB avail 2024-08-18T22:44:14.834 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:44:14 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:44:14.834 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:44:14 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:44:14.834 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:44:14 smithi121 ceph-mon[81053]: Reconfiguring mon.smithi195 (monmap changed)... 2024-08-18T22:44:14.834 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:44:14 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-08-18T22:44:14.834 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:44:14 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-08-18T22:44:14.834 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:44:14 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:44:14.834 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:44:14 smithi121 ceph-mon[81053]: Reconfiguring daemon mon.smithi195 on smithi195 2024-08-18T22:44:14.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:44:14 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:44:14.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:44:14 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:44:14.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:44:14 smithi195 ceph-mon[68841]: Reconfiguring mon.smithi195 (monmap changed)... 2024-08-18T22:44:14.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:44:14 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-08-18T22:44:14.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:44:14 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-08-18T22:44:14.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:44:14 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:44:14.910 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:44:14 smithi195 ceph-mon[68841]: Reconfiguring daemon mon.smithi195 on smithi195 2024-08-18T22:44:15.791 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:44:15 smithi195 ceph-mon[68841]: pgmap v21: 65 pgs: 65 active+clean; 2.0 GiB data, 7.5 GiB used, 529 GiB / 536 GiB avail 2024-08-18T22:44:15.791 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:44:15 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:44:15.791 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:44:15 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:44:15.791 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:44:15 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-08-18T22:44:15.791 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:44:15 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:44:16.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:44:15 smithi121 ceph-mon[81053]: pgmap v21: 65 pgs: 65 active+clean; 2.0 GiB data, 7.5 GiB used, 529 GiB / 536 GiB avail 2024-08-18T22:44:16.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:44:15 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:44:16.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:44:15 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:44:16.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:44:15 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-08-18T22:44:16.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:44:15 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:44:16.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:44:16 smithi195 ceph-mon[68841]: Reconfiguring osd.3 (monmap changed)... 2024-08-18T22:44:16.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:44:16 smithi195 ceph-mon[68841]: Reconfiguring daemon osd.3 on smithi195 2024-08-18T22:44:16.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:44:16 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:44:17.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:44:16 smithi121 ceph-mon[81053]: Reconfiguring osd.3 (monmap changed)... 2024-08-18T22:44:17.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:44:16 smithi121 ceph-mon[81053]: Reconfiguring daemon osd.3 on smithi195 2024-08-18T22:44:17.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:44:16 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:44:17.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:44:17 smithi195 ceph-mon[68841]: pgmap v22: 65 pgs: 65 active+clean; 2.0 GiB data, 7.5 GiB used, 529 GiB / 536 GiB avail 2024-08-18T22:44:17.910 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:44:17 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:44:17.910 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:44:17 smithi195 ceph-mon[68841]: Reconfiguring osd.4 (monmap changed)... 2024-08-18T22:44:17.910 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:44:17 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-08-18T22:44:17.910 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:44:17 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:44:17.910 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:44:17 smithi195 ceph-mon[68841]: Reconfiguring daemon osd.4 on smithi195 2024-08-18T22:44:18.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:44:17 smithi121 ceph-mon[81053]: pgmap v22: 65 pgs: 65 active+clean; 2.0 GiB data, 7.5 GiB used, 529 GiB / 536 GiB avail 2024-08-18T22:44:18.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:44:17 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:44:18.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:44:17 smithi121 ceph-mon[81053]: Reconfiguring osd.4 (monmap changed)... 2024-08-18T22:44:18.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:44:17 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-08-18T22:44:18.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:44:17 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:44:18.085 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:44:17 smithi121 ceph-mon[81053]: Reconfiguring daemon osd.4 on smithi195 2024-08-18T22:44:19.333 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:44:19 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:44:19.334 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:44:19 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:44:19.334 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:44:19 smithi121 ceph-mon[81053]: Reconfiguring osd.5 (monmap changed)... 2024-08-18T22:44:19.334 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:44:19 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-08-18T22:44:19.334 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:44:19 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:44:19.334 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:44:19 smithi121 ceph-mon[81053]: Reconfiguring daemon osd.5 on smithi195 2024-08-18T22:44:19.334 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:44:19 smithi121 ceph-mon[81053]: pgmap v23: 65 pgs: 65 active+clean; 2.0 GiB data, 7.5 GiB used, 529 GiB / 536 GiB avail 2024-08-18T22:44:19.350 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:44:19 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:44:19.351 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:44:19 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:44:19.351 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:44:19 smithi195 ceph-mon[68841]: Reconfiguring osd.5 (monmap changed)... 2024-08-18T22:44:19.351 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:44:19 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-08-18T22:44:19.351 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:44:19 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:44:19.351 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:44:19 smithi195 ceph-mon[68841]: Reconfiguring daemon osd.5 on smithi195 2024-08-18T22:44:19.351 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:44:19 smithi195 ceph-mon[68841]: pgmap v23: 65 pgs: 65 active+clean; 2.0 GiB data, 7.5 GiB used, 529 GiB / 536 GiB avail 2024-08-18T22:44:20.833 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:44:20 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:44:20.834 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:44:20 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:44:20.834 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:44:20 smithi121 ceph-mon[81053]: Reconfiguring mds.cephfs.smithi195.buqvbr (monmap changed)... 2024-08-18T22:44:20.834 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:44:20 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi195.buqvbr", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-08-18T22:44:20.834 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:44:20 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:44:20.834 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:44:20 smithi121 ceph-mon[81053]: Reconfiguring daemon mds.cephfs.smithi195.buqvbr on smithi195 2024-08-18T22:44:20.874 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:44:20 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:44:20.874 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:44:20 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:44:20.874 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:44:20 smithi195 ceph-mon[68841]: Reconfiguring mds.cephfs.smithi195.buqvbr (monmap changed)... 2024-08-18T22:44:20.874 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:44:20 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi195.buqvbr", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-08-18T22:44:20.874 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:44:20 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:44:20.874 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:44:20 smithi195 ceph-mon[68841]: Reconfiguring daemon mds.cephfs.smithi195.buqvbr on smithi195 2024-08-18T22:44:21.534 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:44:21 smithi121 ceph-mon[81053]: pgmap v24: 65 pgs: 65 active+clean; 2.0 GiB data, 7.5 GiB used, 529 GiB / 536 GiB avail 2024-08-18T22:44:21.534 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:44:21 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:44:21.534 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:44:21 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:44:21.534 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:44:21 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi195.nptgyc", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-08-18T22:44:21.535 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:44:21 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:44:21.536 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:21.532+0000 7f5ea9de0640 1 -- 172.21.15.121:0/3283782085 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5ea4066410 msgr2=0x7f5ea40fefc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:44:21.536 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:21.532+0000 7f5ea9de0640 1 --2- 172.21.15.121:0/3283782085 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5ea4066410 0x7f5ea40fefc0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f5e940048d0 tx=0x7f5e94009da0 comp rx=0 tx=0).stop 2024-08-18T22:44:21.536 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:21.532+0000 7f5ea9de0640 1 -- 172.21.15.121:0/3283782085 shutdown_connections 2024-08-18T22:44:21.536 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:21.532+0000 7f5ea9de0640 1 --2- 172.21.15.121:0/3283782085 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5ea40ff500 0x7f5ea41018e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:44:21.536 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:21.532+0000 7f5ea9de0640 1 --2- 172.21.15.121:0/3283782085 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5ea4066410 0x7f5ea40fefc0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:44:21.536 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:21.532+0000 7f5ea9de0640 1 -- 172.21.15.121:0/3283782085 >> 172.21.15.121:0/3283782085 conn(0x7f5ea40f69b0 msgr2=0x7f5ea40f8de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:44:21.536 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:21.532+0000 7f5ea9de0640 1 -- 172.21.15.121:0/3283782085 shutdown_connections 2024-08-18T22:44:21.536 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:21.532+0000 7f5ea9de0640 1 -- 172.21.15.121:0/3283782085 wait complete. 2024-08-18T22:44:21.537 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:21.533+0000 7f5ea9de0640 1 Processor -- start 2024-08-18T22:44:21.537 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:21.533+0000 7f5ea9de0640 1 -- start start 2024-08-18T22:44:21.537 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:21.533+0000 7f5ea9de0640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5ea4066410 0x7f5ea40fc9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:44:21.537 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:21.533+0000 7f5ea9de0640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5ea40ff500 0x7f5ea40faec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:44:21.537 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:21.533+0000 7f5ea9de0640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ea40fb450 con 0x7f5ea40ff500 2024-08-18T22:44:21.537 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:21.533+0000 7f5ea9de0640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ea40fb590 con 0x7f5ea4066410 2024-08-18T22:44:21.537 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:21.533+0000 7f5ea2ffd640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5ea40ff500 0x7f5ea40faec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:44:21.537 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:21.534+0000 7f5ea2ffd640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5ea40ff500 0x7f5ea40faec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:54376/0 (socket says 172.21.15.121:54376) 2024-08-18T22:44:21.537 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:21.534+0000 7f5ea2ffd640 1 -- 172.21.15.121:0/2060837812 learned_addr learned my addr 172.21.15.121:0/2060837812 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-18T22:44:21.538 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:21.534+0000 7f5ea37fe640 1 --2- 172.21.15.121:0/2060837812 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5ea4066410 0x7f5ea40fc9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:44:21.538 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:21.534+0000 7f5ea2ffd640 1 -- 172.21.15.121:0/2060837812 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5ea4066410 msgr2=0x7f5ea40fc9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:44:21.538 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:21.534+0000 7f5ea2ffd640 1 --2- 172.21.15.121:0/2060837812 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5ea4066410 0x7f5ea40fc9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:44:21.538 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:21.534+0000 7f5ea2ffd640 1 -- 172.21.15.121:0/2060837812 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e94005040 con 0x7f5ea40ff500 2024-08-18T22:44:21.538 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:21.534+0000 7f5ea37fe640 1 --2- 172.21.15.121:0/2060837812 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5ea4066410 0x7f5ea40fc9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:44:21.538 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:21.534+0000 7f5ea2ffd640 1 --2- 172.21.15.121:0/2060837812 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5ea40ff500 0x7f5ea40faec0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f5e9800c810 tx=0x7f5e980043c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:44:21.538 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:21.534+0000 7f5e8bfff640 1 -- 172.21.15.121:0/2060837812 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5e9800a820 con 0x7f5ea40ff500 2024-08-18T22:44:21.538 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:21.534+0000 7f5ea9de0640 1 -- 172.21.15.121:0/2060837812 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ea40fb870 con 0x7f5ea40ff500 2024-08-18T22:44:21.538 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:21.534+0000 7f5e8bfff640 1 -- 172.21.15.121:0/2060837812 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f5e9800ae20 con 0x7f5ea40ff500 2024-08-18T22:44:21.538 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:21.534+0000 7f5e8bfff640 1 -- 172.21.15.121:0/2060837812 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5e98011380 con 0x7f5ea40ff500 2024-08-18T22:44:21.538 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:21.534+0000 7f5ea9de0640 1 -- 172.21.15.121:0/2060837812 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ea4114e60 con 0x7f5ea40ff500 2024-08-18T22:44:21.539 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:21.535+0000 7f5ea9de0640 1 -- 172.21.15.121:0/2060837812 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ea40fa650 con 0x7f5ea40ff500 2024-08-18T22:44:21.539 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:21.536+0000 7f5e8bfff640 1 -- 172.21.15.121:0/2060837812 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 36) v1 ==== 92307+0+0 (secure 0 0 0) 0x7f5e980127b0 con 0x7f5ea40ff500 2024-08-18T22:44:21.539 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:21.536+0000 7f5e8bfff640 1 --2- 172.21.15.121:0/2060837812 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f5e8c06e1e0 0x7f5e8c070690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:44:21.539 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:21.537+0000 7f5e8bfff640 1 -- 172.21.15.121:0/2060837812 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f5e9808e120 con 0x7f5ea40ff500 2024-08-18T22:44:21.539 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:21.537+0000 7f5ea37fe640 1 --2- 172.21.15.121:0/2060837812 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f5e8c06e1e0 0x7f5e8c070690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:44:21.540 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:21.537+0000 7f5ea37fe640 1 --2- 172.21.15.121:0/2060837812 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f5e8c06e1e0 0x7f5e8c070690 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f5ea40fc780 tx=0x7f5e94035040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:44:21.542 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:21.541+0000 7f5e8bfff640 1 -- 172.21.15.121:0/2060837812 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f5e980573c0 con 0x7f5ea40ff500 2024-08-18T22:44:21.569 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:44:21 smithi195 ceph-mon[68841]: pgmap v24: 65 pgs: 65 active+clean; 2.0 GiB data, 7.5 GiB used, 529 GiB / 536 GiB avail 2024-08-18T22:44:21.569 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:44:21 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:44:21.569 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:44:21 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:44:21.569 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:44:21 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi195.nptgyc", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-08-18T22:44:21.569 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:44:21 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:44:21.727 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:21.726+0000 7f5ea9de0640 1 -- 172.21.15.121:0/2060837812 --> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f5ea40f84f0 con 0x7f5e8c06e1e0 2024-08-18T22:44:21.728 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:21.727+0000 7f5e8bfff640 1 -- 172.21.15.121:0/2060837812 <== mgr.34102 v2:172.21.15.121:6800/3037387239 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+383 (secure 0 0 0) 0x7f5ea40f84f0 con 0x7f5e8c06e1e0 2024-08-18T22:44:21.731 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:21.729+0000 7f5ea9de0640 1 -- 172.21.15.121:0/2060837812 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f5e8c06e1e0 msgr2=0x7f5e8c070690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:44:21.731 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:21.729+0000 7f5ea9de0640 1 --2- 172.21.15.121:0/2060837812 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f5e8c06e1e0 0x7f5e8c070690 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f5ea40fc780 tx=0x7f5e94035040 comp rx=0 tx=0).stop 2024-08-18T22:44:21.731 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:21.729+0000 7f5ea9de0640 1 -- 172.21.15.121:0/2060837812 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5ea40ff500 msgr2=0x7f5ea40faec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:44:21.731 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:21.729+0000 7f5ea9de0640 1 --2- 172.21.15.121:0/2060837812 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5ea40ff500 0x7f5ea40faec0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f5e9800c810 tx=0x7f5e980043c0 comp rx=0 tx=0).stop 2024-08-18T22:44:21.731 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:21.729+0000 7f5ea9de0640 1 -- 172.21.15.121:0/2060837812 shutdown_connections 2024-08-18T22:44:21.731 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:21.729+0000 7f5ea9de0640 1 --2- 172.21.15.121:0/2060837812 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f5e8c06e1e0 0x7f5e8c070690 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:44:21.731 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:21.729+0000 7f5ea9de0640 1 --2- 172.21.15.121:0/2060837812 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5ea40ff500 0x7f5ea40faec0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:44:21.732 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:21.729+0000 7f5ea9de0640 1 --2- 172.21.15.121:0/2060837812 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5ea4066410 0x7f5ea40fc9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:44:21.732 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:21.729+0000 7f5ea9de0640 1 -- 172.21.15.121:0/2060837812 >> 172.21.15.121:0/2060837812 conn(0x7f5ea40f69b0 msgr2=0x7f5ea40f6dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:44:21.732 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:21.730+0000 7f5ea9de0640 1 -- 172.21.15.121:0/2060837812 shutdown_connections 2024-08-18T22:44:21.732 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:21.730+0000 7f5ea9de0640 1 -- 172.21.15.121:0/2060837812 wait complete. 2024-08-18T22:44:21.739 INFO:teuthology.orchestra.run.smithi121.stdout:true 2024-08-18T22:44:21.811 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:21.808+0000 7f996c729640 1 -- 172.21.15.121:0/1060326619 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f99640fd590 msgr2=0x7f99640fda00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:44:21.812 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:21.808+0000 7f996c729640 1 --2- 172.21.15.121:0/1060326619 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f99640fd590 0x7f99640fda00 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f99600048d0 tx=0x7f9960009da0 comp rx=0 tx=0).stop 2024-08-18T22:44:21.812 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:21.809+0000 7f996c729640 1 -- 172.21.15.121:0/1060326619 shutdown_connections 2024-08-18T22:44:21.812 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:21.809+0000 7f996c729640 1 --2- 172.21.15.121:0/1060326619 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f99640fd590 0x7f99640fda00 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:44:21.812 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:21.809+0000 7f996c729640 1 --2- 172.21.15.121:0/1060326619 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f99640fc2c0 0x7f99640fc6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:44:21.812 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:21.809+0000 7f996c729640 1 -- 172.21.15.121:0/1060326619 >> 172.21.15.121:0/1060326619 conn(0x7f99640f7a80 msgr2=0x7f99640f9eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:44:21.812 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:21.809+0000 7f996c729640 1 -- 172.21.15.121:0/1060326619 shutdown_connections 2024-08-18T22:44:21.812 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:21.809+0000 7f996c729640 1 -- 172.21.15.121:0/1060326619 wait complete. 2024-08-18T22:44:21.812 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:21.809+0000 7f996c729640 1 Processor -- start 2024-08-18T22:44:21.812 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:21.809+0000 7f996c729640 1 -- start start 2024-08-18T22:44:21.812 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:21.809+0000 7f996c729640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f99640fc2c0 0x7f996410ce80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:44:21.812 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:21.809+0000 7f996c729640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f99640fd590 0x7f996410d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:44:21.812 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:21.809+0000 7f996c729640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f996410da10 con 0x7f99640fd590 2024-08-18T22:44:21.812 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:21.809+0000 7f996c729640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f996410e150 con 0x7f99640fc2c0 2024-08-18T22:44:21.813 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:21.810+0000 7f9969cc4640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f99640fd590 0x7f996410d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:44:21.813 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:21.810+0000 7f9969cc4640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f99640fd590 0x7f996410d3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:54384/0 (socket says 172.21.15.121:54384) 2024-08-18T22:44:21.813 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:21.810+0000 7f9969cc4640 1 -- 172.21.15.121:0/6422544 learned_addr learned my addr 172.21.15.121:0/6422544 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-18T22:44:21.813 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:21.810+0000 7f996a4c5640 1 --2- 172.21.15.121:0/6422544 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f99640fc2c0 0x7f996410ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:44:21.813 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:21.810+0000 7f9969cc4640 1 -- 172.21.15.121:0/6422544 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f99640fc2c0 msgr2=0x7f996410ce80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:44:21.813 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:21.810+0000 7f9969cc4640 1 --2- 172.21.15.121:0/6422544 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f99640fc2c0 0x7f996410ce80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:44:21.813 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:21.810+0000 7f9969cc4640 1 -- 172.21.15.121:0/6422544 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9960005040 con 0x7f99640fd590 2024-08-18T22:44:21.813 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:21.810+0000 7f9969cc4640 1 --2- 172.21.15.121:0/6422544 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f99640fd590 0x7f996410d3c0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f99600043d0 tx=0x7f9960009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:44:21.813 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:21.810+0000 7f995affd640 1 -- 172.21.15.121:0/6422544 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9960038070 con 0x7f99640fd590 2024-08-18T22:44:21.813 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:21.810+0000 7f996c729640 1 -- 172.21.15.121:0/6422544 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f996410e380 con 0x7f99640fd590 2024-08-18T22:44:21.813 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:21.810+0000 7f996c729640 1 -- 172.21.15.121:0/6422544 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f996410e920 con 0x7f99640fd590 2024-08-18T22:44:21.814 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:21.810+0000 7f995affd640 1 -- 172.21.15.121:0/6422544 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f996002ae90 con 0x7f99640fd590 2024-08-18T22:44:21.814 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:21.811+0000 7f995affd640 1 -- 172.21.15.121:0/6422544 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f996003e670 con 0x7f99640fd590 2024-08-18T22:44:21.815 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:21.812+0000 7f996c729640 1 -- 172.21.15.121:0/6422544 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9948005240 con 0x7f99640fd590 2024-08-18T22:44:21.815 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:21.812+0000 7f995affd640 1 -- 172.21.15.121:0/6422544 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 36) v1 ==== 92307+0+0 (secure 0 0 0) 0x7f9960030020 con 0x7f99640fd590 2024-08-18T22:44:21.815 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:21.812+0000 7f995affd640 1 --2- 172.21.15.121:0/6422544 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f995006e1e0 0x7f9950070690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:44:21.815 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:21.812+0000 7f995affd640 1 -- 172.21.15.121:0/6422544 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f99600add30 con 0x7f99640fd590 2024-08-18T22:44:21.815 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:21.812+0000 7f996a4c5640 1 --2- 172.21.15.121:0/6422544 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f995006e1e0 0x7f9950070690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:44:21.815 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:21.813+0000 7f996a4c5640 1 --2- 172.21.15.121:0/6422544 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f995006e1e0 0x7f9950070690 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f995c004fd0 tx=0x7f995c009040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:44:21.818 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:21.817+0000 7f995affd640 1 -- 172.21.15.121:0/6422544 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f9960077080 con 0x7f99640fd590 2024-08-18T22:44:21.998 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:21.997+0000 7f996c729640 1 -- 172.21.15.121:0/6422544 --> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f9948000bf0 con 0x7f995006e1e0 2024-08-18T22:44:21.999 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:21.998+0000 7f995affd640 1 -- 172.21.15.121:0/6422544 <== mgr.34102 v2:172.21.15.121:6800/3037387239 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+383 (secure 0 0 0) 0x7f9948000bf0 con 0x7f995006e1e0 2024-08-18T22:44:22.001 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:22.000+0000 7f996c729640 1 -- 172.21.15.121:0/6422544 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f995006e1e0 msgr2=0x7f9950070690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:44:22.001 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:22.000+0000 7f996c729640 1 --2- 172.21.15.121:0/6422544 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f995006e1e0 0x7f9950070690 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f995c004fd0 tx=0x7f995c009040 comp rx=0 tx=0).stop 2024-08-18T22:44:22.002 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:22.000+0000 7f996c729640 1 -- 172.21.15.121:0/6422544 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f99640fd590 msgr2=0x7f996410d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:44:22.002 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:22.000+0000 7f996c729640 1 --2- 172.21.15.121:0/6422544 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f99640fd590 0x7f996410d3c0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f99600043d0 tx=0x7f9960009da0 comp rx=0 tx=0).stop 2024-08-18T22:44:22.002 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:22.000+0000 7f996c729640 1 -- 172.21.15.121:0/6422544 shutdown_connections 2024-08-18T22:44:22.002 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:22.000+0000 7f996c729640 1 --2- 172.21.15.121:0/6422544 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f995006e1e0 0x7f9950070690 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:44:22.002 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:22.000+0000 7f996c729640 1 --2- 172.21.15.121:0/6422544 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f99640fd590 0x7f996410d3c0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:44:22.002 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:22.000+0000 7f996c729640 1 --2- 172.21.15.121:0/6422544 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f99640fc2c0 0x7f996410ce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:44:22.002 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:22.000+0000 7f996c729640 1 -- 172.21.15.121:0/6422544 >> 172.21.15.121:0/6422544 conn(0x7f99640f7a80 msgr2=0x7f99640f9200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:44:22.002 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:22.000+0000 7f996c729640 1 -- 172.21.15.121:0/6422544 shutdown_connections 2024-08-18T22:44:22.002 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:22.000+0000 7f996c729640 1 -- 172.21.15.121:0/6422544 wait complete. 2024-08-18T22:44:22.080 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:22.078+0000 7fcd8eda1640 1 -- 172.21.15.121:0/3272766151 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcd880659a0 msgr2=0x7fcd880fef20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:44:22.080 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:22.078+0000 7fcd8eda1640 1 --2- 172.21.15.121:0/3272766151 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcd880659a0 0x7fcd880fef20 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fcd7c0048d0 tx=0x7fcd7c009da0 comp rx=0 tx=0).stop 2024-08-18T22:44:22.080 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:22.079+0000 7fcd8eda1640 1 -- 172.21.15.121:0/3272766151 shutdown_connections 2024-08-18T22:44:22.080 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:22.079+0000 7fcd8eda1640 1 --2- 172.21.15.121:0/3272766151 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcd880ff460 0x7fcd88101840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:44:22.080 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:22.079+0000 7fcd8eda1640 1 --2- 172.21.15.121:0/3272766151 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcd880659a0 0x7fcd880fef20 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:44:22.081 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:22.079+0000 7fcd8eda1640 1 -- 172.21.15.121:0/3272766151 >> 172.21.15.121:0/3272766151 conn(0x7fcd880f69b0 msgr2=0x7fcd880f8dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:44:22.081 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:22.079+0000 7fcd8eda1640 1 -- 172.21.15.121:0/3272766151 shutdown_connections 2024-08-18T22:44:22.081 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:22.079+0000 7fcd8eda1640 1 -- 172.21.15.121:0/3272766151 wait complete. 2024-08-18T22:44:22.081 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:22.079+0000 7fcd8eda1640 1 Processor -- start 2024-08-18T22:44:22.081 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:22.079+0000 7fcd8eda1640 1 -- start start 2024-08-18T22:44:22.082 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:22.079+0000 7fcd8eda1640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcd880659a0 0x7fcd8810cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:44:22.082 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:22.080+0000 7fcd8eda1640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcd880ff460 0x7fcd8810d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:44:22.082 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:22.080+0000 7fcd8eda1640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd8810e1d0 con 0x7fcd880ff460 2024-08-18T22:44:22.082 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:22.080+0000 7fcd8eda1640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd8810e340 con 0x7fcd880659a0 2024-08-18T22:44:22.082 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:22.080+0000 7fcd87fff640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcd880ff460 0x7fcd8810d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:44:22.083 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:22.080+0000 7fcd8cb3d640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcd880659a0 0x7fcd8810cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:44:22.083 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:22.080+0000 7fcd8cb3d640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcd880659a0 0x7fcd8810cf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.121:33640/0 (socket says 172.21.15.121:33640) 2024-08-18T22:44:22.083 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:22.080+0000 7fcd87fff640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcd880ff460 0x7fcd8810d440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:54400/0 (socket says 172.21.15.121:54400) 2024-08-18T22:44:22.083 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:22.080+0000 7fcd8cb3d640 1 -- 172.21.15.121:0/3187173090 learned_addr learned my addr 172.21.15.121:0/3187173090 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-18T22:44:22.083 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:22.080+0000 7fcd87fff640 1 -- 172.21.15.121:0/3187173090 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcd880659a0 msgr2=0x7fcd8810cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:44:22.083 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:22.080+0000 7fcd87fff640 1 --2- 172.21.15.121:0/3187173090 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcd880659a0 0x7fcd8810cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:44:22.083 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:22.080+0000 7fcd87fff640 1 -- 172.21.15.121:0/3187173090 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd7c005040 con 0x7fcd880ff460 2024-08-18T22:44:22.083 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:22.080+0000 7fcd87fff640 1 --2- 172.21.15.121:0/3187173090 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcd880ff460 0x7fcd8810d440 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fcd7400b4e0 tx=0x7fcd74009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:44:22.083 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:22.080+0000 7fcd857fa640 1 -- 172.21.15.121:0/3187173090 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcd7400f6f0 con 0x7fcd880ff460 2024-08-18T22:44:22.083 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:22.080+0000 7fcd857fa640 1 -- 172.21.15.121:0/3187173090 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fcd7400fcf0 con 0x7fcd880ff460 2024-08-18T22:44:22.083 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:22.080+0000 7fcd8eda1640 1 -- 172.21.15.121:0/3187173090 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd8810e620 con 0x7fcd880ff460 2024-08-18T22:44:22.083 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:22.081+0000 7fcd857fa640 1 -- 172.21.15.121:0/3187173090 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcd74011e70 con 0x7fcd880ff460 2024-08-18T22:44:22.083 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:22.081+0000 7fcd8eda1640 1 -- 172.21.15.121:0/3187173090 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd8810eb40 con 0x7fcd880ff460 2024-08-18T22:44:22.084 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:22.082+0000 7fcd8eda1640 1 -- 172.21.15.121:0/3187173090 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd880fa630 con 0x7fcd880ff460 2024-08-18T22:44:22.084 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:22.082+0000 7fcd857fa640 1 -- 172.21.15.121:0/3187173090 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 36) v1 ==== 92307+0+0 (secure 0 0 0) 0x7fcd74011620 con 0x7fcd880ff460 2024-08-18T22:44:22.084 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:22.083+0000 7fcd857fa640 1 --2- 172.21.15.121:0/3187173090 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7fcd7806e1e0 0x7fcd78070690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:44:22.085 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:22.083+0000 7fcd8cb3d640 1 --2- 172.21.15.121:0/3187173090 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7fcd7806e1e0 0x7fcd78070690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:44:22.085 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:22.083+0000 7fcd857fa640 1 -- 172.21.15.121:0/3187173090 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6496+0+0 (secure 0 0 0) 0x7fcd7408db00 con 0x7fcd880ff460 2024-08-18T22:44:22.085 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:22.083+0000 7fcd8cb3d640 1 --2- 172.21.15.121:0/3187173090 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7fcd7806e1e0 0x7fcd78070690 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fcd7c000c00 tx=0x7fcd7c035040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:44:22.088 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:22.087+0000 7fcd857fa640 1 -- 172.21.15.121:0/3187173090 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7fcd74056da0 con 0x7fcd880ff460 2024-08-18T22:44:22.262 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:22.261+0000 7fcd8eda1640 1 -- 172.21.15.121:0/3187173090 --> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fcd8810edc0 con 0x7fcd7806e1e0 2024-08-18T22:44:22.271 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:22.270+0000 7fcd857fa640 1 -- 172.21.15.121:0/3187173090 <== mgr.34102 v2:172.21.15.121:6800/3037387239 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7fcd8810edc0 con 0x7fcd7806e1e0 2024-08-18T22:44:22.271 INFO:teuthology.orchestra.run.smithi121.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-08-18T22:44:22.271 INFO:teuthology.orchestra.run.smithi121.stdout:alertmanager.smithi121 smithi121 *:9093,9094 running (2m) 38s ago 10m 15.5M - 0.25.0 c8568f914cd2 c421c5e6a02b 2024-08-18T22:44:22.271 INFO:teuthology.orchestra.run.smithi121.stdout:crash.smithi121 smithi121 running (10m) 38s ago 10m 6899k - 17.2.7-1406-gdf62bdcc 774894bef55f cf3deea293c3 2024-08-18T22:44:22.271 INFO:teuthology.orchestra.run.smithi121.stdout:crash.smithi195 smithi195 running (9m) 26s ago 9m 6899k - 17.2.7-1406-gdf62bdcc 774894bef55f 98aa377daf77 2024-08-18T22:44:22.271 INFO:teuthology.orchestra.run.smithi121.stdout:grafana.smithi121 smithi121 *:3000 running (2m) 38s ago 9m 80.4M - 9.4.7 954c08fa6188 091a5fd17e8a 2024-08-18T22:44:22.271 INFO:teuthology.orchestra.run.smithi121.stdout:mds.cephfs.smithi121.gbickb smithi121 running (5m) 38s ago 5m 156M - 17.2.7-1406-gdf62bdcc 774894bef55f 484da0bc2c95 2024-08-18T22:44:22.271 INFO:teuthology.orchestra.run.smithi121.stdout:mds.cephfs.smithi121.xuzsdg smithi121 running (5m) 38s ago 5m 13.0M - 17.2.7-1406-gdf62bdcc 774894bef55f 6976b708cdcd 2024-08-18T22:44:22.271 INFO:teuthology.orchestra.run.smithi121.stdout:mds.cephfs.smithi195.buqvbr smithi195 running (5m) 26s ago 5m 115M - 17.2.7-1406-gdf62bdcc 774894bef55f 11a3703b4276 2024-08-18T22:44:22.271 INFO:teuthology.orchestra.run.smithi121.stdout:mds.cephfs.smithi195.nptgyc smithi195 running (5m) 26s ago 5m 17.4M - 17.2.7-1406-gdf62bdcc 774894bef55f b9f8043ea83e 2024-08-18T22:44:22.272 INFO:teuthology.orchestra.run.smithi121.stdout:mgr.smithi121.lopxqc smithi121 *:8443,9283,8765 running (98s) 38s ago 11m 473M - 19.1.0-1382-gde09dd01 ea7a5189f30b 9079701e6516 2024-08-18T22:44:22.272 INFO:teuthology.orchestra.run.smithi121.stdout:mgr.smithi195.acttsj smithi195 *:8443,9283,8765 running (62s) 26s ago 9m 438M - 19.1.0-1382-gde09dd01 ea7a5189f30b 7b4027a33daa 2024-08-18T22:44:22.272 INFO:teuthology.orchestra.run.smithi121.stdout:mon.smithi121 smithi121 running (50s) 38s ago 11m 31.2M 2048M 19.1.0-1382-gde09dd01 ea7a5189f30b d71695a4fb56 2024-08-18T22:44:22.272 INFO:teuthology.orchestra.run.smithi121.stdout:mon.smithi195 smithi195 running (31s) 26s ago 9m 22.5M 2048M 19.1.0-1382-gde09dd01 ea7a5189f30b a9bb94ba3b56 2024-08-18T22:44:22.272 INFO:teuthology.orchestra.run.smithi121.stdout:node-exporter.smithi121 smithi121 *:9100 running (2m) 38s ago 10m 8258k - 1.5.0 0da6a335fe13 bc4b5355a507 2024-08-18T22:44:22.272 INFO:teuthology.orchestra.run.smithi121.stdout:node-exporter.smithi195 smithi195 *:9100 running (107s) 26s ago 9m 16.0M - 1.5.0 0da6a335fe13 146efcb79663 2024-08-18T22:44:22.272 INFO:teuthology.orchestra.run.smithi121.stdout:osd.0 smithi121 running (8m) 38s ago 8m 192M 1557M 17.2.7-1406-gdf62bdcc 774894bef55f 30859216633d 2024-08-18T22:44:22.272 INFO:teuthology.orchestra.run.smithi121.stdout:osd.1 smithi121 running (8m) 38s ago 8m 222M 1557M 17.2.7-1406-gdf62bdcc 774894bef55f ef5fadfd753f 2024-08-18T22:44:22.272 INFO:teuthology.orchestra.run.smithi121.stdout:osd.2 smithi121 running (7m) 38s ago 7m 182M 1557M 17.2.7-1406-gdf62bdcc 774894bef55f 3fa061e41f99 2024-08-18T22:44:22.272 INFO:teuthology.orchestra.run.smithi121.stdout:osd.3 smithi195 running (7m) 26s ago 7m 239M 2581M 17.2.7-1406-gdf62bdcc 774894bef55f 15d30b1b459e 2024-08-18T22:44:22.272 INFO:teuthology.orchestra.run.smithi121.stdout:osd.4 smithi195 running (7m) 26s ago 7m 207M 2581M 17.2.7-1406-gdf62bdcc 774894bef55f 99ed156dfd36 2024-08-18T22:44:22.272 INFO:teuthology.orchestra.run.smithi121.stdout:osd.5 smithi195 running (6m) 26s ago 6m 213M 2581M 17.2.7-1406-gdf62bdcc 774894bef55f e7eff7bdb752 2024-08-18T22:44:22.272 INFO:teuthology.orchestra.run.smithi121.stdout:prometheus.smithi121 smithi121 *:9095 running (67s) 38s ago 9m 46.4M - 2.43.0 a07b618ecd1d 00c4f776d23a 2024-08-18T22:44:22.273 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:22.272+0000 7fcd8eda1640 1 -- 172.21.15.121:0/3187173090 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7fcd7806e1e0 msgr2=0x7fcd78070690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:44:22.273 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:22.272+0000 7fcd8eda1640 1 --2- 172.21.15.121:0/3187173090 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7fcd7806e1e0 0x7fcd78070690 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fcd7c000c00 tx=0x7fcd7c035040 comp rx=0 tx=0).stop 2024-08-18T22:44:22.274 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:22.272+0000 7fcd8eda1640 1 -- 172.21.15.121:0/3187173090 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcd880ff460 msgr2=0x7fcd8810d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:44:22.274 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:22.272+0000 7fcd8eda1640 1 --2- 172.21.15.121:0/3187173090 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcd880ff460 0x7fcd8810d440 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fcd7400b4e0 tx=0x7fcd74009120 comp rx=0 tx=0).stop 2024-08-18T22:44:22.274 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:22.272+0000 7fcd8eda1640 1 -- 172.21.15.121:0/3187173090 shutdown_connections 2024-08-18T22:44:22.274 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:22.272+0000 7fcd8eda1640 1 --2- 172.21.15.121:0/3187173090 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7fcd7806e1e0 0x7fcd78070690 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:44:22.274 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:22.272+0000 7fcd8eda1640 1 --2- 172.21.15.121:0/3187173090 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcd880ff460 0x7fcd8810d440 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:44:22.274 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:22.272+0000 7fcd8eda1640 1 --2- 172.21.15.121:0/3187173090 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcd880659a0 0x7fcd8810cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:44:22.274 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:22.272+0000 7fcd8eda1640 1 -- 172.21.15.121:0/3187173090 >> 172.21.15.121:0/3187173090 conn(0x7fcd880f69b0 msgr2=0x7fcd880f6d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:44:22.274 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:22.272+0000 7fcd8eda1640 1 -- 172.21.15.121:0/3187173090 shutdown_connections 2024-08-18T22:44:22.274 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:22.272+0000 7fcd8eda1640 1 -- 172.21.15.121:0/3187173090 wait complete. 2024-08-18T22:44:22.354 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:22.351+0000 7fed74928640 1 -- 172.21.15.121:0/377708418 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fed700fc4a0 msgr2=0x7fed700fc910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:44:22.354 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:22.351+0000 7fed74928640 1 --2- 172.21.15.121:0/377708418 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fed700fc4a0 0x7fed700fc910 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fed640048d0 tx=0x7fed64009da0 comp rx=0 tx=0).stop 2024-08-18T22:44:22.354 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:22.351+0000 7fed74928640 1 -- 172.21.15.121:0/377708418 shutdown_connections 2024-08-18T22:44:22.354 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:22.351+0000 7fed74928640 1 --2- 172.21.15.121:0/377708418 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fed700fc4a0 0x7fed700fc910 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:44:22.354 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:22.351+0000 7fed74928640 1 --2- 172.21.15.121:0/377708418 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fed700fb1d0 0x7fed700fb5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:44:22.354 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:22.351+0000 7fed74928640 1 -- 172.21.15.121:0/377708418 >> 172.21.15.121:0/377708418 conn(0x7fed700f69b0 msgr2=0x7fed700f8dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:44:22.354 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:22.351+0000 7fed74928640 1 -- 172.21.15.121:0/377708418 shutdown_connections 2024-08-18T22:44:22.354 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:22.351+0000 7fed74928640 1 -- 172.21.15.121:0/377708418 wait complete. 2024-08-18T22:44:22.354 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:22.351+0000 7fed74928640 1 Processor -- start 2024-08-18T22:44:22.355 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:22.352+0000 7fed74928640 1 -- start start 2024-08-18T22:44:22.355 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:22.352+0000 7fed74928640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fed700fb1d0 0x7fed7010fb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:44:22.355 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:22.352+0000 7fed74928640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fed700fc4a0 0x7fed70112050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:44:22.355 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:22.352+0000 7fed74928640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed70065a60 con 0x7fed700fb1d0 2024-08-18T22:44:22.355 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:22.352+0000 7fed74928640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed70065bd0 con 0x7fed700fc4a0 2024-08-18T22:44:22.355 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:22.352+0000 7fed6e59c640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fed700fb1d0 0x7fed7010fb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:44:22.355 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:22.352+0000 7fed6e59c640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fed700fb1d0 0x7fed7010fb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:54410/0 (socket says 172.21.15.121:54410) 2024-08-18T22:44:22.355 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:22.352+0000 7fed6e59c640 1 -- 172.21.15.121:0/644656938 learned_addr learned my addr 172.21.15.121:0/644656938 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-18T22:44:22.355 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:22.352+0000 7fed6dd9b640 1 --2- 172.21.15.121:0/644656938 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fed700fc4a0 0x7fed70112050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:44:22.355 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:22.352+0000 7fed6e59c640 1 -- 172.21.15.121:0/644656938 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fed700fc4a0 msgr2=0x7fed70112050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:44:22.355 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:22.352+0000 7fed6e59c640 1 --2- 172.21.15.121:0/644656938 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fed700fc4a0 0x7fed70112050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:44:22.355 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:22.352+0000 7fed6e59c640 1 -- 172.21.15.121:0/644656938 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed64005040 con 0x7fed700fb1d0 2024-08-18T22:44:22.355 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:22.352+0000 7fed6e59c640 1 --2- 172.21.15.121:0/644656938 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fed700fb1d0 0x7fed7010fb00 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fed6000eb70 tx=0x7fed6000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:44:22.356 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:22.352+0000 7fed5effd640 1 -- 172.21.15.121:0/644656938 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fed60007c30 con 0x7fed700fb1d0 2024-08-18T22:44:22.356 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:22.353+0000 7fed5effd640 1 -- 172.21.15.121:0/644656938 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fed6000f040 con 0x7fed700fb1d0 2024-08-18T22:44:22.356 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:22.353+0000 7fed74928640 1 -- 172.21.15.121:0/644656938 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed701125f0 con 0x7fed700fb1d0 2024-08-18T22:44:22.356 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:22.353+0000 7fed5effd640 1 -- 172.21.15.121:0/644656938 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fed6000ca60 con 0x7fed700fb1d0 2024-08-18T22:44:22.356 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:22.353+0000 7fed74928640 1 -- 172.21.15.121:0/644656938 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed70112b60 con 0x7fed700fb1d0 2024-08-18T22:44:22.356 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:22.354+0000 7fed74928640 1 -- 172.21.15.121:0/644656938 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed700fa630 con 0x7fed700fb1d0 2024-08-18T22:44:22.357 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:22.355+0000 7fed5effd640 1 -- 172.21.15.121:0/644656938 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 36) v1 ==== 92307+0+0 (secure 0 0 0) 0x7fed6000cbc0 con 0x7fed700fb1d0 2024-08-18T22:44:22.357 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:22.356+0000 7fed5effd640 1 --2- 172.21.15.121:0/644656938 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7fed5806e1e0 0x7fed58070690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:44:22.357 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:22.356+0000 7fed5effd640 1 -- 172.21.15.121:0/644656938 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6496+0+0 (secure 0 0 0) 0x7fed6008dee0 con 0x7fed700fb1d0 2024-08-18T22:44:22.357 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:22.356+0000 7fed6dd9b640 1 --2- 172.21.15.121:0/644656938 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7fed5806e1e0 0x7fed58070690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:44:22.357 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:22.356+0000 7fed6dd9b640 1 --2- 172.21.15.121:0/644656938 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7fed5806e1e0 0x7fed58070690 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fed64000c00 tx=0x7fed64035040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:44:22.360 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:22.359+0000 7fed5effd640 1 -- 172.21.15.121:0/644656938 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7fed600571e0 con 0x7fed700fb1d0 2024-08-18T22:44:22.612 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:22.611+0000 7fed74928640 1 -- 172.21.15.121:0/644656938 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fed70103bf0 con 0x7fed700fb1d0 2024-08-18T22:44:22.613 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:44:22 smithi121 ceph-mon[81053]: Reconfiguring mds.cephfs.smithi195.nptgyc (monmap changed)... 2024-08-18T22:44:22.613 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:44:22 smithi121 ceph-mon[81053]: Reconfiguring daemon mds.cephfs.smithi195.nptgyc on smithi195 2024-08-18T22:44:22.613 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:44:22 smithi121 ceph-mon[81053]: from='client.34160 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-18T22:44:22.613 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:44:22 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:44:22.613 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:44:22 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:44:22.613 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:44:22 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-18T22:44:22.613 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:44:22 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "versions"}]: dispatch 2024-08-18T22:44:22.613 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:44:22 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "versions"}]: dispatch 2024-08-18T22:44:22.613 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:44:22 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:44:22.613 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:44:22 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi121"}]: dispatch 2024-08-18T22:44:22.613 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:44:22 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi121"}]': finished 2024-08-18T22:44:22.614 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:44:22 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi195"}]: dispatch 2024-08-18T22:44:22.614 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:44:22 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi195"}]': finished 2024-08-18T22:44:22.614 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:22.612+0000 7fed5effd640 1 -- 172.21.15.121:0/644656938 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+736 (secure 0 0 0) 0x7fed6005a8a0 con 0x7fed700fb1d0 2024-08-18T22:44:22.614 INFO:teuthology.orchestra.run.smithi121.stdout:{ 2024-08-18T22:44:22.614 INFO:teuthology.orchestra.run.smithi121.stdout: "mon": { 2024-08-18T22:44:22.614 INFO:teuthology.orchestra.run.smithi121.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 2 2024-08-18T22:44:22.614 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-18T22:44:22.614 INFO:teuthology.orchestra.run.smithi121.stdout: "mgr": { 2024-08-18T22:44:22.615 INFO:teuthology.orchestra.run.smithi121.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 2 2024-08-18T22:44:22.615 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-18T22:44:22.615 INFO:teuthology.orchestra.run.smithi121.stdout: "osd": { 2024-08-18T22:44:22.615 INFO:teuthology.orchestra.run.smithi121.stdout: "ceph version 17.2.7-1406-gdf62bdcc (df62bdccd9a13bf566b27a250eddfdd89be3072d) quincy (stable)": 6 2024-08-18T22:44:22.615 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-18T22:44:22.615 INFO:teuthology.orchestra.run.smithi121.stdout: "mds": { 2024-08-18T22:44:22.615 INFO:teuthology.orchestra.run.smithi121.stdout: "ceph version 17.2.7-1406-gdf62bdcc (df62bdccd9a13bf566b27a250eddfdd89be3072d) quincy (stable)": 4 2024-08-18T22:44:22.615 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-18T22:44:22.615 INFO:teuthology.orchestra.run.smithi121.stdout: "overall": { 2024-08-18T22:44:22.615 INFO:teuthology.orchestra.run.smithi121.stdout: "ceph version 17.2.7-1406-gdf62bdcc (df62bdccd9a13bf566b27a250eddfdd89be3072d) quincy (stable)": 10, 2024-08-18T22:44:22.615 INFO:teuthology.orchestra.run.smithi121.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 4 2024-08-18T22:44:22.615 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-08-18T22:44:22.615 INFO:teuthology.orchestra.run.smithi121.stdout:} 2024-08-18T22:44:22.616 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:22.614+0000 7fed74928640 1 -- 172.21.15.121:0/644656938 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7fed5806e1e0 msgr2=0x7fed58070690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:44:22.616 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:22.614+0000 7fed74928640 1 --2- 172.21.15.121:0/644656938 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7fed5806e1e0 0x7fed58070690 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fed64000c00 tx=0x7fed64035040 comp rx=0 tx=0).stop 2024-08-18T22:44:22.616 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:22.614+0000 7fed74928640 1 -- 172.21.15.121:0/644656938 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fed700fb1d0 msgr2=0x7fed7010fb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:44:22.616 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:22.614+0000 7fed74928640 1 --2- 172.21.15.121:0/644656938 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fed700fb1d0 0x7fed7010fb00 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fed6000eb70 tx=0x7fed6000b040 comp rx=0 tx=0).stop 2024-08-18T22:44:22.616 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:22.614+0000 7fed74928640 1 -- 172.21.15.121:0/644656938 shutdown_connections 2024-08-18T22:44:22.616 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:22.614+0000 7fed74928640 1 --2- 172.21.15.121:0/644656938 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7fed5806e1e0 0x7fed58070690 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:44:22.616 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:22.614+0000 7fed74928640 1 --2- 172.21.15.121:0/644656938 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fed700fc4a0 0x7fed70112050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:44:22.616 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:22.614+0000 7fed74928640 1 --2- 172.21.15.121:0/644656938 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fed700fb1d0 0x7fed7010fb00 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:44:22.616 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:22.614+0000 7fed74928640 1 -- 172.21.15.121:0/644656938 >> 172.21.15.121:0/644656938 conn(0x7fed700f69b0 msgr2=0x7fed700f8190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:44:22.617 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:22.614+0000 7fed74928640 1 -- 172.21.15.121:0/644656938 shutdown_connections 2024-08-18T22:44:22.617 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:22.614+0000 7fed74928640 1 -- 172.21.15.121:0/644656938 wait complete. 2024-08-18T22:44:22.659 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:44:22 smithi195 ceph-mon[68841]: Reconfiguring mds.cephfs.smithi195.nptgyc (monmap changed)... 2024-08-18T22:44:22.659 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:44:22 smithi195 ceph-mon[68841]: Reconfiguring daemon mds.cephfs.smithi195.nptgyc on smithi195 2024-08-18T22:44:22.659 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:44:22 smithi195 ceph-mon[68841]: from='client.34160 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-18T22:44:22.659 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:44:22 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:44:22.659 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:44:22 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:44:22.659 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:44:22 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-18T22:44:22.660 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:44:22 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "versions"}]: dispatch 2024-08-18T22:44:22.660 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:44:22 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "versions"}]: dispatch 2024-08-18T22:44:22.660 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:44:22 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:44:22.660 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:44:22 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi121"}]: dispatch 2024-08-18T22:44:22.660 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:44:22 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi121"}]': finished 2024-08-18T22:44:22.660 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:44:22 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi195"}]: dispatch 2024-08-18T22:44:22.660 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:44:22 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi195"}]': finished 2024-08-18T22:44:22.703 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:22.700+0000 7f69ab351640 1 -- 172.21.15.121:0/4055879347 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f69a40fd590 msgr2=0x7f69a40fda00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:44:22.703 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:22.700+0000 7f69ab351640 1 --2- 172.21.15.121:0/4055879347 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f69a40fd590 0x7f69a40fda00 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f69940048d0 tx=0x7f6994009da0 comp rx=0 tx=0).stop 2024-08-18T22:44:22.704 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:22.700+0000 7f69ab351640 1 -- 172.21.15.121:0/4055879347 shutdown_connections 2024-08-18T22:44:22.704 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:22.700+0000 7f69ab351640 1 --2- 172.21.15.121:0/4055879347 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f69a40fd590 0x7f69a40fda00 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:44:22.704 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:22.700+0000 7f69ab351640 1 --2- 172.21.15.121:0/4055879347 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f69a40fc2c0 0x7f69a40fc6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:44:22.704 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:22.700+0000 7f69ab351640 1 -- 172.21.15.121:0/4055879347 >> 172.21.15.121:0/4055879347 conn(0x7f69a40f7a80 msgr2=0x7f69a40f9eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:44:22.704 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:22.700+0000 7f69ab351640 1 -- 172.21.15.121:0/4055879347 shutdown_connections 2024-08-18T22:44:22.704 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:22.700+0000 7f69ab351640 1 -- 172.21.15.121:0/4055879347 wait complete. 2024-08-18T22:44:22.704 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:22.701+0000 7f69ab351640 1 Processor -- start 2024-08-18T22:44:22.704 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:22.701+0000 7f69ab351640 1 -- start start 2024-08-18T22:44:22.704 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:22.701+0000 7f69ab351640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f69a40fc2c0 0x7f69a410cef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:44:22.704 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:22.701+0000 7f69ab351640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f69a40fd590 0x7f69a410d430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:44:22.704 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:22.701+0000 7f69ab351640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69a410e1c0 con 0x7f69a40fc2c0 2024-08-18T22:44:22.704 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:22.701+0000 7f69ab351640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69a410e330 con 0x7f69a40fd590 2024-08-18T22:44:22.704 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:22.701+0000 7f69a90ed640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f69a40fc2c0 0x7f69a410cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:44:22.704 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:22.701+0000 7f69a90ed640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f69a40fc2c0 0x7f69a410cef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:54414/0 (socket says 172.21.15.121:54414) 2024-08-18T22:44:22.705 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:22.701+0000 7f69a90ed640 1 -- 172.21.15.121:0/1041269129 learned_addr learned my addr 172.21.15.121:0/1041269129 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-18T22:44:22.705 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:22.701+0000 7f69a88ec640 1 --2- 172.21.15.121:0/1041269129 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f69a40fd590 0x7f69a410d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:44:22.705 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:22.702+0000 7f69a90ed640 1 -- 172.21.15.121:0/1041269129 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f69a40fd590 msgr2=0x7f69a410d430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:44:22.705 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:22.702+0000 7f69a90ed640 1 --2- 172.21.15.121:0/1041269129 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f69a40fd590 0x7f69a410d430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:44:22.705 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:22.702+0000 7f69a90ed640 1 -- 172.21.15.121:0/1041269129 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6994005040 con 0x7f69a40fc2c0 2024-08-18T22:44:22.705 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:22.702+0000 7f69a90ed640 1 --2- 172.21.15.121:0/1041269129 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f69a40fc2c0 0x7f69a410cef0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f69a000b790 tx=0x7f69a00091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:44:22.705 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:22.702+0000 7f6999ffb640 1 -- 172.21.15.121:0/1041269129 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f69a000c700 con 0x7f69a40fc2c0 2024-08-18T22:44:22.705 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:22.702+0000 7f69ab351640 1 -- 172.21.15.121:0/1041269129 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69a410e610 con 0x7f69a40fc2c0 2024-08-18T22:44:22.705 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:22.702+0000 7f6999ffb640 1 -- 172.21.15.121:0/1041269129 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f69a000cd00 con 0x7f69a40fc2c0 2024-08-18T22:44:22.705 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:22.702+0000 7f69ab351640 1 -- 172.21.15.121:0/1041269129 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69a410eb30 con 0x7f69a40fc2c0 2024-08-18T22:44:22.705 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:22.702+0000 7f6999ffb640 1 -- 172.21.15.121:0/1041269129 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f69a0015e80 con 0x7f69a40fc2c0 2024-08-18T22:44:22.706 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:22.703+0000 7f69ab351640 1 -- 172.21.15.121:0/1041269129 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69a4105550 con 0x7f69a40fc2c0 2024-08-18T22:44:22.706 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:22.704+0000 7f6999ffb640 1 -- 172.21.15.121:0/1041269129 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 36) v1 ==== 92307+0+0 (secure 0 0 0) 0x7f69a0012070 con 0x7f69a40fc2c0 2024-08-18T22:44:22.706 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:22.704+0000 7f6999ffb640 1 --2- 172.21.15.121:0/1041269129 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f699006e1e0 0x7f6990070690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:44:22.707 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:22.704+0000 7f6999ffb640 1 -- 172.21.15.121:0/1041269129 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f69a008d600 con 0x7f69a40fc2c0 2024-08-18T22:44:22.707 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:22.704+0000 7f69a88ec640 1 --2- 172.21.15.121:0/1041269129 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f699006e1e0 0x7f6990070690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:44:22.707 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:22.704+0000 7f69a88ec640 1 --2- 172.21.15.121:0/1041269129 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f699006e1e0 0x7f6990070690 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f6994000c00 tx=0x7f6994035040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:44:22.709 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:22.708+0000 7f6999ffb640 1 -- 172.21.15.121:0/1041269129 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f69a0056820 con 0x7f69a40fc2c0 2024-08-18T22:44:22.919 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:22.918+0000 7f69ab351640 1 -- 172.21.15.121:0/1041269129 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f69a410edb0 con 0x7f69a40fc2c0 2024-08-18T22:44:22.919 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:22.918+0000 7f6999ffb640 1 -- 172.21.15.121:0/1041269129 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 19 v19) v1 ==== 76+0+1960 (secure 0 0 0) 0x7f69a0059ee0 con 0x7f69a40fc2c0 2024-08-18T22:44:22.920 INFO:teuthology.orchestra.run.smithi121.stdout:e19 2024-08-18T22:44:22.920 INFO:teuthology.orchestra.run.smithi121.stdout:btime 1970-01-01T00:00:00:000000+0000 2024-08-18T22:44:22.920 INFO:teuthology.orchestra.run.smithi121.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-08-18T22:44:22.920 INFO:teuthology.orchestra.run.smithi121.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-08-18T22:44:22.920 INFO:teuthology.orchestra.run.smithi121.stdout:legacy client fscid: 1 2024-08-18T22:44:22.920 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-08-18T22:44:22.920 INFO:teuthology.orchestra.run.smithi121.stdout:Filesystem 'cephfs' (1) 2024-08-18T22:44:22.920 INFO:teuthology.orchestra.run.smithi121.stdout:fs_name cephfs 2024-08-18T22:44:22.921 INFO:teuthology.orchestra.run.smithi121.stdout:epoch 19 2024-08-18T22:44:22.921 INFO:teuthology.orchestra.run.smithi121.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-08-18T22:44:22.921 INFO:teuthology.orchestra.run.smithi121.stdout:created 2024-08-18T22:39:04.054074+0000 2024-08-18T22:44:22.921 INFO:teuthology.orchestra.run.smithi121.stdout:modified 2024-08-18T22:42:16.794905+0000 2024-08-18T22:44:22.921 INFO:teuthology.orchestra.run.smithi121.stdout:tableserver 0 2024-08-18T22:44:22.921 INFO:teuthology.orchestra.run.smithi121.stdout:root 0 2024-08-18T22:44:22.921 INFO:teuthology.orchestra.run.smithi121.stdout:session_timeout 60 2024-08-18T22:44:22.921 INFO:teuthology.orchestra.run.smithi121.stdout:session_autoclose 300 2024-08-18T22:44:22.921 INFO:teuthology.orchestra.run.smithi121.stdout:max_file_size 1099511627776 2024-08-18T22:44:22.921 INFO:teuthology.orchestra.run.smithi121.stdout:max_xattr_size 65536 2024-08-18T22:44:22.921 INFO:teuthology.orchestra.run.smithi121.stdout:required_client_features {} 2024-08-18T22:44:22.922 INFO:teuthology.orchestra.run.smithi121.stdout:last_failure 0 2024-08-18T22:44:22.922 INFO:teuthology.orchestra.run.smithi121.stdout:last_failure_osd_epoch 47 2024-08-18T22:44:22.922 INFO:teuthology.orchestra.run.smithi121.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-08-18T22:44:22.922 INFO:teuthology.orchestra.run.smithi121.stdout:max_mds 2 2024-08-18T22:44:22.922 INFO:teuthology.orchestra.run.smithi121.stdout:in 0,1 2024-08-18T22:44:22.922 INFO:teuthology.orchestra.run.smithi121.stdout:up {0=14474,1=24249} 2024-08-18T22:44:22.922 INFO:teuthology.orchestra.run.smithi121.stdout:failed 2024-08-18T22:44:22.922 INFO:teuthology.orchestra.run.smithi121.stdout:damaged 2024-08-18T22:44:22.922 INFO:teuthology.orchestra.run.smithi121.stdout:stopped 2024-08-18T22:44:22.922 INFO:teuthology.orchestra.run.smithi121.stdout:data_pools [3] 2024-08-18T22:44:22.922 INFO:teuthology.orchestra.run.smithi121.stdout:metadata_pool 2 2024-08-18T22:44:22.923 INFO:teuthology.orchestra.run.smithi121.stdout:inline_data disabled 2024-08-18T22:44:22.923 INFO:teuthology.orchestra.run.smithi121.stdout:balancer 2024-08-18T22:44:22.923 INFO:teuthology.orchestra.run.smithi121.stdout:bal_rank_mask -1 2024-08-18T22:44:22.923 INFO:teuthology.orchestra.run.smithi121.stdout:standby_count_wanted 1 2024-08-18T22:44:22.923 INFO:teuthology.orchestra.run.smithi121.stdout:qdb_cluster leader: 0 members: 2024-08-18T22:44:22.923 INFO:teuthology.orchestra.run.smithi121.stdout:[mds.cephfs.smithi121.gbickb{0:14474} state up:active seq 6 export targets 1 join_fscid=1 addr [v2:172.21.15.121:6828/2277706406,v1:172.21.15.121:6829/2277706406] compat {c=[1],r=[1],i=[7ff]}] 2024-08-18T22:44:22.923 INFO:teuthology.orchestra.run.smithi121.stdout:[mds.cephfs.smithi195.buqvbr{1:24249} state up:active seq 4 export targets 0 join_fscid=1 addr [v2:172.21.15.195:6824/2414511859,v1:172.21.15.195:6825/2414511859] compat {c=[1],r=[1],i=[7ff]}] 2024-08-18T22:44:22.923 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-08-18T22:44:22.923 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-08-18T22:44:22.923 INFO:teuthology.orchestra.run.smithi121.stdout:Standby daemons: 2024-08-18T22:44:22.923 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-08-18T22:44:22.923 INFO:teuthology.orchestra.run.smithi121.stdout:[mds.cephfs.smithi121.xuzsdg{-1:14490} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.121:6826/91588128,v1:172.21.15.121:6827/91588128] compat {c=[1],r=[1],i=[7ff]}] 2024-08-18T22:44:22.924 INFO:teuthology.orchestra.run.smithi121.stdout:[mds.cephfs.smithi195.nptgyc{-1:24259} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.195:6826/238549847,v1:172.21.15.195:6827/238549847] compat {c=[1],r=[1],i=[7ff]}] 2024-08-18T22:44:22.924 INFO:teuthology.orchestra.run.smithi121.stderr:dumped fsmap epoch 19 2024-08-18T22:44:22.924 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:22.921+0000 7f69ab351640 1 -- 172.21.15.121:0/1041269129 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f699006e1e0 msgr2=0x7f6990070690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:44:22.924 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:22.921+0000 7f69ab351640 1 --2- 172.21.15.121:0/1041269129 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f699006e1e0 0x7f6990070690 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f6994000c00 tx=0x7f6994035040 comp rx=0 tx=0).stop 2024-08-18T22:44:22.925 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:22.921+0000 7f69ab351640 1 -- 172.21.15.121:0/1041269129 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f69a40fc2c0 msgr2=0x7f69a410cef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:44:22.925 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:22.921+0000 7f69ab351640 1 --2- 172.21.15.121:0/1041269129 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f69a40fc2c0 0x7f69a410cef0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f69a000b790 tx=0x7f69a00091d0 comp rx=0 tx=0).stop 2024-08-18T22:44:22.925 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:22.921+0000 7f69ab351640 1 -- 172.21.15.121:0/1041269129 shutdown_connections 2024-08-18T22:44:22.925 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:22.921+0000 7f69ab351640 1 --2- 172.21.15.121:0/1041269129 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f699006e1e0 0x7f6990070690 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:44:22.925 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:22.921+0000 7f69ab351640 1 --2- 172.21.15.121:0/1041269129 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f69a40fd590 0x7f69a410d430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:44:22.925 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:22.921+0000 7f69ab351640 1 --2- 172.21.15.121:0/1041269129 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f69a40fc2c0 0x7f69a410cef0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:44:22.925 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:22.921+0000 7f69ab351640 1 -- 172.21.15.121:0/1041269129 >> 172.21.15.121:0/1041269129 conn(0x7f69a40f7a80 msgr2=0x7f69a40f9210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:44:22.925 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:22.921+0000 7f69ab351640 1 -- 172.21.15.121:0/1041269129 shutdown_connections 2024-08-18T22:44:22.925 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:22.921+0000 7f69ab351640 1 -- 172.21.15.121:0/1041269129 wait complete. 2024-08-18T22:44:23.005 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:23.001+0000 7f1d5bb27640 1 -- 172.21.15.121:0/891309352 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1d540fd5e0 msgr2=0x7f1d540fda50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:44:23.005 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:23.001+0000 7f1d5bb27640 1 --2- 172.21.15.121:0/891309352 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1d540fd5e0 0x7f1d540fda50 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f1d440048d0 tx=0x7f1d44009da0 comp rx=0 tx=0).stop 2024-08-18T22:44:23.005 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:23.001+0000 7f1d5bb27640 1 -- 172.21.15.121:0/891309352 shutdown_connections 2024-08-18T22:44:23.005 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:23.001+0000 7f1d5bb27640 1 --2- 172.21.15.121:0/891309352 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1d540fd5e0 0x7f1d540fda50 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:44:23.005 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:23.001+0000 7f1d5bb27640 1 --2- 172.21.15.121:0/891309352 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1d540fc310 0x7f1d540fc720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:44:23.005 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:23.001+0000 7f1d5bb27640 1 -- 172.21.15.121:0/891309352 >> 172.21.15.121:0/891309352 conn(0x7f1d540f7ad0 msgr2=0x7f1d540f9f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:44:23.006 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:23.001+0000 7f1d5bb27640 1 -- 172.21.15.121:0/891309352 shutdown_connections 2024-08-18T22:44:23.006 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:23.001+0000 7f1d5bb27640 1 -- 172.21.15.121:0/891309352 wait complete. 2024-08-18T22:44:23.006 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:23.001+0000 7f1d5bb27640 1 Processor -- start 2024-08-18T22:44:23.006 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:23.001+0000 7f1d5bb27640 1 -- start start 2024-08-18T22:44:23.006 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:23.002+0000 7f1d5bb27640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1d540fc310 0x7f1d5410ce60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:44:23.006 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:23.002+0000 7f1d5bb27640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1d540fd5e0 0x7f1d5410d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:44:23.006 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:23.002+0000 7f1d5bb27640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d5410d9f0 con 0x7f1d540fd5e0 2024-08-18T22:44:23.006 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:23.002+0000 7f1d5bb27640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d5410e130 con 0x7f1d540fc310 2024-08-18T22:44:23.006 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:23.002+0000 7f1d590c2640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1d540fd5e0 0x7f1d5410d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:44:23.006 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:23.002+0000 7f1d590c2640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1d540fd5e0 0x7f1d5410d3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:54426/0 (socket says 172.21.15.121:54426) 2024-08-18T22:44:23.006 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:23.002+0000 7f1d590c2640 1 -- 172.21.15.121:0/1153956919 learned_addr learned my addr 172.21.15.121:0/1153956919 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-18T22:44:23.007 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:23.002+0000 7f1d598c3640 1 --2- 172.21.15.121:0/1153956919 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1d540fc310 0x7f1d5410ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:44:23.007 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:23.002+0000 7f1d590c2640 1 -- 172.21.15.121:0/1153956919 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1d540fc310 msgr2=0x7f1d5410ce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:44:23.007 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:23.002+0000 7f1d590c2640 1 --2- 172.21.15.121:0/1153956919 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1d540fc310 0x7f1d5410ce60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:44:23.007 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:23.002+0000 7f1d590c2640 1 -- 172.21.15.121:0/1153956919 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d44005040 con 0x7f1d540fd5e0 2024-08-18T22:44:23.007 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:23.002+0000 7f1d590c2640 1 --2- 172.21.15.121:0/1153956919 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1d540fd5e0 0x7f1d5410d3a0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f1d44003080 tx=0x7f1d44009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:44:23.007 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:23.002+0000 7f1d4a7fc640 1 -- 172.21.15.121:0/1153956919 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1d44038070 con 0x7f1d540fd5e0 2024-08-18T22:44:23.007 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:23.002+0000 7f1d4a7fc640 1 -- 172.21.15.121:0/1153956919 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f1d4402abd0 con 0x7f1d540fd5e0 2024-08-18T22:44:23.007 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:23.002+0000 7f1d5bb27640 1 -- 172.21.15.121:0/1153956919 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d5410e360 con 0x7f1d540fd5e0 2024-08-18T22:44:23.007 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:23.003+0000 7f1d4a7fc640 1 -- 172.21.15.121:0/1153956919 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1d4403e670 con 0x7f1d540fd5e0 2024-08-18T22:44:23.007 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:23.003+0000 7f1d5bb27640 1 -- 172.21.15.121:0/1153956919 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d5410e900 con 0x7f1d540fd5e0 2024-08-18T22:44:23.007 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:23.003+0000 7f1d5bb27640 1 -- 172.21.15.121:0/1153956919 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d540fb770 con 0x7f1d540fd5e0 2024-08-18T22:44:23.007 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:23.004+0000 7f1d4a7fc640 1 -- 172.21.15.121:0/1153956919 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 36) v1 ==== 92307+0+0 (secure 0 0 0) 0x7f1d44030020 con 0x7f1d540fd5e0 2024-08-18T22:44:23.008 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:23.005+0000 7f1d4a7fc640 1 --2- 172.21.15.121:0/1153956919 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f1d4006e1e0 0x7f1d40070690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:44:23.008 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:23.005+0000 7f1d598c3640 1 --2- 172.21.15.121:0/1153956919 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f1d4006e1e0 0x7f1d40070690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:44:23.008 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:23.005+0000 7f1d4a7fc640 1 -- 172.21.15.121:0/1153956919 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f1d440ae0a0 con 0x7f1d540fd5e0 2024-08-18T22:44:23.008 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:23.005+0000 7f1d598c3640 1 --2- 172.21.15.121:0/1153956919 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f1d4006e1e0 0x7f1d40070690 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f1d5410cbf0 tx=0x7f1d50009040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:44:23.010 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:23.009+0000 7f1d4a7fc640 1 -- 172.21.15.121:0/1153956919 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f1d44077370 con 0x7f1d540fd5e0 2024-08-18T22:44:23.200 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:23.199+0000 7f1d5bb27640 1 -- 172.21.15.121:0/1153956919 --> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f1d5410ec90 con 0x7f1d4006e1e0 2024-08-18T22:44:23.201 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:23.200+0000 7f1d4a7fc640 1 -- 172.21.15.121:0/1153956919 <== mgr.34102 v2:172.21.15.121:6800/3037387239 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+385 (secure 0 0 0) 0x7f1d5410ec90 con 0x7f1d4006e1e0 2024-08-18T22:44:23.201 INFO:teuthology.orchestra.run.smithi121.stdout:{ 2024-08-18T22:44:23.201 INFO:teuthology.orchestra.run.smithi121.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9", 2024-08-18T22:44:23.201 INFO:teuthology.orchestra.run.smithi121.stdout: "in_progress": true, 2024-08-18T22:44:23.202 INFO:teuthology.orchestra.run.smithi121.stdout: "which": "Upgrading all daemon types on all hosts", 2024-08-18T22:44:23.202 INFO:teuthology.orchestra.run.smithi121.stdout: "services_complete": [ 2024-08-18T22:44:23.202 INFO:teuthology.orchestra.run.smithi121.stdout: "mgr", 2024-08-18T22:44:23.202 INFO:teuthology.orchestra.run.smithi121.stdout: "mon" 2024-08-18T22:44:23.202 INFO:teuthology.orchestra.run.smithi121.stdout: ], 2024-08-18T22:44:23.202 INFO:teuthology.orchestra.run.smithi121.stdout: "progress": "4/21 daemons upgraded", 2024-08-18T22:44:23.202 INFO:teuthology.orchestra.run.smithi121.stdout: "message": "Currently upgrading crash daemons", 2024-08-18T22:44:23.202 INFO:teuthology.orchestra.run.smithi121.stdout: "is_paused": false 2024-08-18T22:44:23.202 INFO:teuthology.orchestra.run.smithi121.stdout:} 2024-08-18T22:44:23.203 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:23.202+0000 7f1d5bb27640 1 -- 172.21.15.121:0/1153956919 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f1d4006e1e0 msgr2=0x7f1d40070690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:44:23.204 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:23.202+0000 7f1d5bb27640 1 --2- 172.21.15.121:0/1153956919 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f1d4006e1e0 0x7f1d40070690 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f1d5410cbf0 tx=0x7f1d50009040 comp rx=0 tx=0).stop 2024-08-18T22:44:23.204 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:23.202+0000 7f1d5bb27640 1 -- 172.21.15.121:0/1153956919 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1d540fd5e0 msgr2=0x7f1d5410d3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:44:23.204 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:23.202+0000 7f1d5bb27640 1 --2- 172.21.15.121:0/1153956919 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1d540fd5e0 0x7f1d5410d3a0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f1d44003080 tx=0x7f1d44009da0 comp rx=0 tx=0).stop 2024-08-18T22:44:23.204 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:23.202+0000 7f1d5bb27640 1 -- 172.21.15.121:0/1153956919 shutdown_connections 2024-08-18T22:44:23.204 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:23.202+0000 7f1d5bb27640 1 --2- 172.21.15.121:0/1153956919 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f1d4006e1e0 0x7f1d40070690 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:44:23.204 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:23.202+0000 7f1d5bb27640 1 --2- 172.21.15.121:0/1153956919 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1d540fd5e0 0x7f1d5410d3a0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:44:23.204 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:23.202+0000 7f1d5bb27640 1 --2- 172.21.15.121:0/1153956919 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1d540fc310 0x7f1d5410ce60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:44:23.204 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:23.202+0000 7f1d5bb27640 1 -- 172.21.15.121:0/1153956919 >> 172.21.15.121:0/1153956919 conn(0x7f1d540f7ad0 msgr2=0x7f1d540f9250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:44:23.204 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:23.202+0000 7f1d5bb27640 1 -- 172.21.15.121:0/1153956919 shutdown_connections 2024-08-18T22:44:23.204 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:23.202+0000 7f1d5bb27640 1 -- 172.21.15.121:0/1153956919 wait complete. 2024-08-18T22:44:23.281 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:23.280+0000 7fb6be1a7640 1 -- 172.21.15.121:0/2381558874 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb6b80ff4e0 msgr2=0x7fb6b81018c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:44:23.282 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:23.280+0000 7fb6be1a7640 1 --2- 172.21.15.121:0/2381558874 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb6b80ff4e0 0x7fb6b81018c0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fb6ac0048d0 tx=0x7fb6ac009da0 comp rx=0 tx=0).stop 2024-08-18T22:44:23.282 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:23.280+0000 7fb6be1a7640 1 -- 172.21.15.121:0/2381558874 shutdown_connections 2024-08-18T22:44:23.282 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:23.280+0000 7fb6be1a7640 1 --2- 172.21.15.121:0/2381558874 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb6b80ff4e0 0x7fb6b81018c0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:44:23.282 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:23.280+0000 7fb6be1a7640 1 --2- 172.21.15.121:0/2381558874 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb6b8065920 0x7fb6b80fefa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:44:23.282 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:23.280+0000 7fb6be1a7640 1 -- 172.21.15.121:0/2381558874 >> 172.21.15.121:0/2381558874 conn(0x7fb6b80f69b0 msgr2=0x7fb6b80f8dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:44:23.282 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:23.280+0000 7fb6be1a7640 1 -- 172.21.15.121:0/2381558874 shutdown_connections 2024-08-18T22:44:23.282 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:23.280+0000 7fb6be1a7640 1 -- 172.21.15.121:0/2381558874 wait complete. 2024-08-18T22:44:23.282 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:23.281+0000 7fb6be1a7640 1 Processor -- start 2024-08-18T22:44:23.284 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:23.281+0000 7fb6be1a7640 1 -- start start 2024-08-18T22:44:23.284 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:23.281+0000 7fb6be1a7640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb6b8065920 0x7fb6b810cee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:44:23.284 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:23.281+0000 7fb6be1a7640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb6b80ff4e0 0x7fb6b810d420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:44:23.284 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:23.281+0000 7fb6be1a7640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6b810da70 con 0x7fb6b8065920 2024-08-18T22:44:23.284 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:23.281+0000 7fb6be1a7640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6b810e160 con 0x7fb6b80ff4e0 2024-08-18T22:44:23.284 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:23.281+0000 7fb6b77fe640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb6b8065920 0x7fb6b810cee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:44:23.284 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:23.281+0000 7fb6b77fe640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb6b8065920 0x7fb6b810cee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:54440/0 (socket says 172.21.15.121:54440) 2024-08-18T22:44:23.284 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:23.281+0000 7fb6b77fe640 1 -- 172.21.15.121:0/938696652 learned_addr learned my addr 172.21.15.121:0/938696652 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-18T22:44:23.284 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:23.281+0000 7fb6b6ffd640 1 --2- 172.21.15.121:0/938696652 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb6b80ff4e0 0x7fb6b810d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:44:23.285 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:23.282+0000 7fb6b77fe640 1 -- 172.21.15.121:0/938696652 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb6b80ff4e0 msgr2=0x7fb6b810d420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:44:23.285 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:23.282+0000 7fb6b77fe640 1 --2- 172.21.15.121:0/938696652 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb6b80ff4e0 0x7fb6b810d420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:44:23.285 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:23.282+0000 7fb6b77fe640 1 -- 172.21.15.121:0/938696652 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6ac005040 con 0x7fb6b8065920 2024-08-18T22:44:23.285 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:23.282+0000 7fb6b6ffd640 1 --2- 172.21.15.121:0/938696652 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb6b80ff4e0 0x7fb6b810d420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:44:23.285 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:23.282+0000 7fb6b77fe640 1 --2- 172.21.15.121:0/938696652 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb6b8065920 0x7fb6b810cee0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fb6a800c7e0 tx=0x7fb6a80043c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:44:23.285 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:23.282+0000 7fb69ffff640 1 -- 172.21.15.121:0/938696652 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb6a800a820 con 0x7fb6b8065920 2024-08-18T22:44:23.285 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:23.282+0000 7fb6be1a7640 1 -- 172.21.15.121:0/938696652 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6b810e3f0 con 0x7fb6b8065920 2024-08-18T22:44:23.285 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:23.282+0000 7fb69ffff640 1 -- 172.21.15.121:0/938696652 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fb6a800ae20 con 0x7fb6b8065920 2024-08-18T22:44:23.285 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:23.282+0000 7fb69ffff640 1 -- 172.21.15.121:0/938696652 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb6a80113a0 con 0x7fb6b8065920 2024-08-18T22:44:23.285 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:23.282+0000 7fb6be1a7640 1 -- 172.21.15.121:0/938696652 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6b810e990 con 0x7fb6b8065920 2024-08-18T22:44:23.285 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:23.283+0000 7fb6be1a7640 1 -- 172.21.15.121:0/938696652 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6b80fa630 con 0x7fb6b8065920 2024-08-18T22:44:23.286 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:23.283+0000 7fb69ffff640 1 -- 172.21.15.121:0/938696652 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 36) v1 ==== 92307+0+0 (secure 0 0 0) 0x7fb6a8012400 con 0x7fb6b8065920 2024-08-18T22:44:23.286 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:23.284+0000 7fb69ffff640 1 --2- 172.21.15.121:0/938696652 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7fb6a006e1e0 0x7fb6a0070690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:44:23.286 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:23.284+0000 7fb6b6ffd640 1 --2- 172.21.15.121:0/938696652 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7fb6a006e1e0 0x7fb6a0070690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:44:23.286 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:23.284+0000 7fb69ffff640 1 -- 172.21.15.121:0/938696652 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6496+0+0 (secure 0 0 0) 0x7fb6a808dec0 con 0x7fb6b8065920 2024-08-18T22:44:23.286 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:23.285+0000 7fb6b6ffd640 1 --2- 172.21.15.121:0/938696652 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7fb6a006e1e0 0x7fb6a0070690 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fb6ac00b020 tx=0x7fb6ac009da0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:44:23.289 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:23.289+0000 7fb69ffff640 1 -- 172.21.15.121:0/938696652 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7fb6a8057160 con 0x7fb6b8065920 2024-08-18T22:44:23.528 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:23.526+0000 7fb6be1a7640 1 -- 172.21.15.121:0/938696652 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fb6b804b4c0 con 0x7fb6b8065920 2024-08-18T22:44:23.528 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:23.527+0000 7fb69ffff640 1 -- 172.21.15.121:0/938696652 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7fb6a805a820 con 0x7fb6b8065920 2024-08-18T22:44:23.528 INFO:teuthology.orchestra.run.smithi121.stdout:HEALTH_OK 2024-08-18T22:44:23.530 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:23.529+0000 7fb6be1a7640 1 -- 172.21.15.121:0/938696652 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7fb6a006e1e0 msgr2=0x7fb6a0070690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:44:23.530 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:23.529+0000 7fb6be1a7640 1 --2- 172.21.15.121:0/938696652 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7fb6a006e1e0 0x7fb6a0070690 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fb6ac00b020 tx=0x7fb6ac009da0 comp rx=0 tx=0).stop 2024-08-18T22:44:23.530 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:23.529+0000 7fb6be1a7640 1 -- 172.21.15.121:0/938696652 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb6b8065920 msgr2=0x7fb6b810cee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:44:23.530 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:23.529+0000 7fb6be1a7640 1 --2- 172.21.15.121:0/938696652 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb6b8065920 0x7fb6b810cee0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fb6a800c7e0 tx=0x7fb6a80043c0 comp rx=0 tx=0).stop 2024-08-18T22:44:23.531 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:23.529+0000 7fb6be1a7640 1 -- 172.21.15.121:0/938696652 shutdown_connections 2024-08-18T22:44:23.531 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:23.529+0000 7fb6be1a7640 1 --2- 172.21.15.121:0/938696652 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7fb6a006e1e0 0x7fb6a0070690 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:44:23.531 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:23.529+0000 7fb6be1a7640 1 --2- 172.21.15.121:0/938696652 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb6b80ff4e0 0x7fb6b810d420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:44:23.531 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:23.529+0000 7fb6be1a7640 1 --2- 172.21.15.121:0/938696652 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb6b8065920 0x7fb6b810cee0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:44:23.531 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:23.529+0000 7fb6be1a7640 1 -- 172.21.15.121:0/938696652 >> 172.21.15.121:0/938696652 conn(0x7fb6b80f69b0 msgr2=0x7fb6b80f6d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:44:23.531 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:23.529+0000 7fb6be1a7640 1 -- 172.21.15.121:0/938696652 shutdown_connections 2024-08-18T22:44:23.531 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:23.529+0000 7fb6be1a7640 1 -- 172.21.15.121:0/938696652 wait complete. 2024-08-18T22:44:23.788 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:44:23 smithi121 ceph-mon[81053]: from='client.34164 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-18T22:44:23.788 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:44:23 smithi121 ceph-mon[81053]: from='client.34168 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-18T22:44:23.788 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:44:23 smithi121 ceph-mon[81053]: Upgrade: Setting container_image for all mon 2024-08-18T22:44:23.788 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:44:23 smithi121 ceph-mon[81053]: pgmap v25: 65 pgs: 65 active+clean; 2.0 GiB data, 7.5 GiB used, 529 GiB / 536 GiB avail 2024-08-18T22:44:23.788 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:44:23 smithi121 ceph-mon[81053]: from='client.? 172.21.15.121:0/644656938' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-08-18T22:44:23.788 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:44:23 smithi121 ceph-mon[81053]: from='client.? 172.21.15.121:0/1041269129' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-08-18T22:44:23.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:44:23 smithi195 ceph-mon[68841]: from='client.34164 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-18T22:44:23.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:44:23 smithi195 ceph-mon[68841]: from='client.34168 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-18T22:44:23.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:44:23 smithi195 ceph-mon[68841]: Upgrade: Setting container_image for all mon 2024-08-18T22:44:23.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:44:23 smithi195 ceph-mon[68841]: pgmap v25: 65 pgs: 65 active+clean; 2.0 GiB data, 7.5 GiB used, 529 GiB / 536 GiB avail 2024-08-18T22:44:23.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:44:23 smithi195 ceph-mon[68841]: from='client.? 172.21.15.121:0/644656938' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-08-18T22:44:23.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:44:23 smithi195 ceph-mon[68841]: from='client.? 172.21.15.121:0/1041269129' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-08-18T22:44:24.537 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:44:24 smithi121 ceph-mon[81053]: from='client.34180 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-18T22:44:24.538 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:44:24 smithi121 ceph-mon[81053]: from='client.? 172.21.15.121:0/938696652' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-08-18T22:44:24.538 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:44:24 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-18T22:44:24.538 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:44:24 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:44:24.538 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:44:24 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi121", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-08-18T22:44:24.538 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:44:24 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:44:24.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:44:24 smithi195 ceph-mon[68841]: from='client.34180 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-18T22:44:24.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:44:24 smithi195 ceph-mon[68841]: from='client.? 172.21.15.121:0/938696652' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-08-18T22:44:24.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:44:24 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-18T22:44:24.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:44:24 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:44:24.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:44:24 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi121", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-08-18T22:44:24.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:44:24 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:44:25.763 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:44:25 smithi121 ceph-mon[81053]: Upgrade: Updating crash.smithi121 (1/2) 2024-08-18T22:44:25.763 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:44:25 smithi121 ceph-mon[81053]: Deploying daemon crash.smithi121 on smithi121 2024-08-18T22:44:25.763 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:44:25 smithi121 ceph-mon[81053]: pgmap v26: 65 pgs: 65 active+clean; 2.0 GiB data, 7.5 GiB used, 529 GiB / 536 GiB avail 2024-08-18T22:44:25.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:44:25 smithi195 ceph-mon[68841]: Upgrade: Updating crash.smithi121 (1/2) 2024-08-18T22:44:25.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:44:25 smithi195 ceph-mon[68841]: Deploying daemon crash.smithi121 on smithi121 2024-08-18T22:44:25.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:44:25 smithi195 ceph-mon[68841]: pgmap v26: 65 pgs: 65 active+clean; 2.0 GiB data, 7.5 GiB used, 529 GiB / 536 GiB avail 2024-08-18T22:44:27.834 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:44:27 smithi121 ceph-mon[81053]: pgmap v27: 65 pgs: 65 active+clean; 2.0 GiB data, 7.5 GiB used, 529 GiB / 536 GiB avail 2024-08-18T22:44:27.834 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:44:27 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:44:27.834 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:44:27 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:44:27.872 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:44:27 smithi195 ceph-mon[68841]: pgmap v27: 65 pgs: 65 active+clean; 2.0 GiB data, 7.5 GiB used, 529 GiB / 536 GiB avail 2024-08-18T22:44:27.873 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:44:27 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:44:27.873 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:44:27 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:44:29.834 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:44:29 smithi121 ceph-mon[81053]: pgmap v28: 65 pgs: 65 active+clean; 2.0 GiB data, 7.5 GiB used, 529 GiB / 536 GiB avail 2024-08-18T22:44:29.834 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:44:29 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:44:29.834 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:44:29 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi195", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-08-18T22:44:29.834 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:44:29 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:44:29.887 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:44:29 smithi195 ceph-mon[68841]: pgmap v28: 65 pgs: 65 active+clean; 2.0 GiB data, 7.5 GiB used, 529 GiB / 536 GiB avail 2024-08-18T22:44:29.888 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:44:29 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:44:29.888 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:44:29 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi195", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-08-18T22:44:29.888 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:44:29 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:44:30.727 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:44:30 smithi195 ceph-mon[68841]: Upgrade: Updating crash.smithi195 (2/2) 2024-08-18T22:44:30.727 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:44:30 smithi195 ceph-mon[68841]: Deploying daemon crash.smithi195 on smithi195 2024-08-18T22:44:30.727 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:44:30 smithi195 ceph-mon[68841]: 3 slow requests, 3 included below; oldest blocked for > 181.866976 secs 2024-08-18T22:44:30.727 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:44:30 smithi195 ceph-mon[68841]: slow request 181.866975 seconds old, received at 2024-08-18T22:41:28.419036+0000: client_request(client.14514:12135 unlink #0x1000000463d/f3 2024-08-18T22:41:28.418931+0000 caller_uid=1000, caller_gid=1333{6,36,1000,1333,}) currently failed to xlock, waiting 2024-08-18T22:44:30.727 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:44:30 smithi195 ceph-mon[68841]: slow request 181.865060 seconds old, received at 2024-08-18T22:41:28.420952+0000: client_request(mds.0:6 rename #0x1000000463d/f3 #0x603/1000000466a caller_uid=0, caller_gid=0{}) currently acquired locks 2024-08-18T22:44:30.727 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:44:30 smithi195 ceph-mon[68841]: slow request 181.847279 seconds old, received at 2024-08-18T22:41:28.438732+0000: client_request(mds.0:7 rename #0x1000000463d/f3 #0x603/1000000466a caller_uid=0, caller_gid=0{}) currently acquired locks 2024-08-18T22:44:31.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:44:30 smithi121 ceph-mon[81053]: Upgrade: Updating crash.smithi195 (2/2) 2024-08-18T22:44:31.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:44:30 smithi121 ceph-mon[81053]: Deploying daemon crash.smithi195 on smithi195 2024-08-18T22:44:31.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:44:30 smithi121 ceph-mon[81053]: 3 slow requests, 3 included below; oldest blocked for > 181.866976 secs 2024-08-18T22:44:31.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:44:30 smithi121 ceph-mon[81053]: slow request 181.866975 seconds old, received at 2024-08-18T22:41:28.419036+0000: client_request(client.14514:12135 unlink #0x1000000463d/f3 2024-08-18T22:41:28.418931+0000 caller_uid=1000, caller_gid=1333{6,36,1000,1333,}) currently failed to xlock, waiting 2024-08-18T22:44:31.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:44:30 smithi121 ceph-mon[81053]: slow request 181.865060 seconds old, received at 2024-08-18T22:41:28.420952+0000: client_request(mds.0:6 rename #0x1000000463d/f3 #0x603/1000000466a caller_uid=0, caller_gid=0{}) currently acquired locks 2024-08-18T22:44:31.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:44:30 smithi121 ceph-mon[81053]: slow request 181.847279 seconds old, received at 2024-08-18T22:41:28.438732+0000: client_request(mds.0:7 rename #0x1000000463d/f3 #0x603/1000000466a caller_uid=0, caller_gid=0{}) currently acquired locks 2024-08-18T22:44:31.659 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:44:31 smithi195 ceph-mon[68841]: pgmap v29: 65 pgs: 65 active+clean; 2.0 GiB data, 7.5 GiB used, 529 GiB / 536 GiB avail 2024-08-18T22:44:31.833 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:44:31 smithi121 ceph-mon[81053]: pgmap v29: 65 pgs: 65 active+clean; 2.0 GiB data, 7.5 GiB used, 529 GiB / 536 GiB avail 2024-08-18T22:44:32.594 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:44:32 smithi195 ceph-mon[68841]: Health check failed: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2024-08-18T22:44:32.594 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:44:32 smithi195 ceph-mon[68841]: mds.0 [v2:172.21.15.121:6828/2277706406,v1:172.21.15.121:6829/2277706406] up:active 2024-08-18T22:44:32.594 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:44:32 smithi195 ceph-mon[68841]: fsmap cephfs:2 {0=cephfs.smithi121.gbickb=up:active,1=cephfs.smithi195.buqvbr=up:active} 2 up:standby 2024-08-18T22:44:32.594 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:44:32 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:44:32.594 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:44:32 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:44:32.595 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:44:32 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-18T22:44:32.938 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:44:32 smithi121 ceph-mon[81053]: Health check failed: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2024-08-18T22:44:32.938 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:44:32 smithi121 ceph-mon[81053]: mds.0 [v2:172.21.15.121:6828/2277706406,v1:172.21.15.121:6829/2277706406] up:active 2024-08-18T22:44:32.939 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:44:32 smithi121 ceph-mon[81053]: fsmap cephfs:2 {0=cephfs.smithi121.gbickb=up:active,1=cephfs.smithi195.buqvbr=up:active} 2 up:standby 2024-08-18T22:44:32.939 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:44:32 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:44:32.939 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:44:32 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:44:32.939 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:44:32 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-18T22:44:33.659 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:44:33 smithi195 ceph-mon[68841]: pgmap v30: 65 pgs: 65 active+clean; 2.0 GiB data, 7.5 GiB used, 529 GiB / 536 GiB avail 2024-08-18T22:44:33.833 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:44:33 smithi121 ceph-mon[81053]: pgmap v30: 65 pgs: 65 active+clean; 2.0 GiB data, 7.5 GiB used, 529 GiB / 536 GiB avail 2024-08-18T22:44:35.884 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:44:35 smithi121 ceph-mon[81053]: pgmap v31: 65 pgs: 65 active+clean; 2.0 GiB data, 7.5 GiB used, 529 GiB / 536 GiB avail 2024-08-18T22:44:35.884 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:44:35 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:44:35.884 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:44:35 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:44:35.885 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:44:35 smithi121 ceph-mon[81053]: 3 slow requests, 0 included below; oldest blocked for > 186.867047 secs 2024-08-18T22:44:35.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:44:35 smithi195 ceph-mon[68841]: pgmap v31: 65 pgs: 65 active+clean; 2.0 GiB data, 7.5 GiB used, 529 GiB / 536 GiB avail 2024-08-18T22:44:35.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:44:35 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:44:35.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:44:35 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:44:35.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:44:35 smithi195 ceph-mon[68841]: 3 slow requests, 0 included below; oldest blocked for > 186.867047 secs 2024-08-18T22:44:36.899 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:44:36 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:44:36.899 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:44:36 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:44:37.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:44:36 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:44:37.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:44:36 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:44:37.882 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:44:37 smithi195 ceph-mon[68841]: pgmap v32: 65 pgs: 65 active+clean; 2.0 GiB data, 7.5 GiB used, 529 GiB / 536 GiB avail 2024-08-18T22:44:37.882 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:44:37 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:44:37.882 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:44:37 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:44:38.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:44:37 smithi121 ceph-mon[81053]: pgmap v32: 65 pgs: 65 active+clean; 2.0 GiB data, 7.5 GiB used, 529 GiB / 536 GiB avail 2024-08-18T22:44:38.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:44:37 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:44:38.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:44:37 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:44:39.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:44:38 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:44:39.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:44:38 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:44:39.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:44:38 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:44:39.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:44:38 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:44:39.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:44:38 smithi195 ceph-mon[68841]: pgmap v33: 65 pgs: 65 active+clean; 2.0 GiB data, 7.5 GiB used, 529 GiB / 536 GiB avail 2024-08-18T22:44:39.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:44:38 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:44:39.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:44:38 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-18T22:44:39.179 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:44:38 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:44:39.179 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:44:38 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:44:39.180 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:44:38 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:44:39.180 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:44:38 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:44:39.180 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:44:38 smithi121 ceph-mon[81053]: pgmap v33: 65 pgs: 65 active+clean; 2.0 GiB data, 7.5 GiB used, 529 GiB / 536 GiB avail 2024-08-18T22:44:39.180 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:44:38 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:44:39.180 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:44:38 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-18T22:44:40.670 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:44:40 smithi121 ceph-mon[81053]: 3 slow requests, 0 included below; oldest blocked for > 191.867112 secs 2024-08-18T22:44:40.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:44:40 smithi195 ceph-mon[68841]: 3 slow requests, 0 included below; oldest blocked for > 191.867112 secs 2024-08-18T22:44:41.673 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:44:41 smithi121 ceph-mon[81053]: pgmap v34: 65 pgs: 65 active+clean; 2.0 GiB data, 7.5 GiB used, 529 GiB / 536 GiB avail 2024-08-18T22:44:41.673 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:44:41 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:44:41.673 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:44:41 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:44:41.673 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:44:41 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:44:41.673 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:44:41 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-18T22:44:41.673 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:44:41 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:44:41.673 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:44:41 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-18T22:44:41.673 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:44:41 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "versions"}]: dispatch 2024-08-18T22:44:41.673 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:44:41 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "versions"}]: dispatch 2024-08-18T22:44:41.673 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:44:41 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "versions"}]: dispatch 2024-08-18T22:44:41.673 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:44:41 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:44:41.674 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:44:41 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi121"}]: dispatch 2024-08-18T22:44:41.674 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:44:41 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi121"}]': finished 2024-08-18T22:44:41.674 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:44:41 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi195"}]: dispatch 2024-08-18T22:44:41.674 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:44:41 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi195"}]': finished 2024-08-18T22:44:41.674 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:44:41 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-08-18T22:44:41.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:44:41 smithi195 ceph-mon[68841]: pgmap v34: 65 pgs: 65 active+clean; 2.0 GiB data, 7.5 GiB used, 529 GiB / 536 GiB avail 2024-08-18T22:44:41.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:44:41 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:44:41.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:44:41 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:44:41.910 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:44:41 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:44:41.910 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:44:41 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-18T22:44:41.910 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:44:41 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:44:41.910 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:44:41 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-18T22:44:41.910 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:44:41 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "versions"}]: dispatch 2024-08-18T22:44:41.910 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:44:41 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "versions"}]: dispatch 2024-08-18T22:44:41.910 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:44:41 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "versions"}]: dispatch 2024-08-18T22:44:41.910 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:44:41 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:44:41.910 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:44:41 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi121"}]: dispatch 2024-08-18T22:44:41.910 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:44:41 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi121"}]': finished 2024-08-18T22:44:41.910 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:44:41 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi195"}]: dispatch 2024-08-18T22:44:41.910 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:44:41 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi195"}]': finished 2024-08-18T22:44:41.911 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:44:41 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-08-18T22:44:42.583 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:44:42 smithi121 ceph-mon[81053]: Upgrade: Setting container_image for all crash 2024-08-18T22:44:42.583 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:44:42 smithi121 ceph-mon[81053]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-08-18T22:44:42.583 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:44:42 smithi121 ceph-mon[81053]: Upgrade: osd.0 is safe to restart 2024-08-18T22:44:42.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:44:42 smithi195 ceph-mon[68841]: Upgrade: Setting container_image for all crash 2024-08-18T22:44:42.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:44:42 smithi195 ceph-mon[68841]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-08-18T22:44:42.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:44:42 smithi195 ceph-mon[68841]: Upgrade: osd.0 is safe to restart 2024-08-18T22:44:44.056 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:44:43 smithi195 ceph-mon[68841]: pgmap v35: 65 pgs: 65 active+clean; 2.0 GiB data, 7.5 GiB used, 529 GiB / 536 GiB avail 2024-08-18T22:44:44.056 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:44:43 smithi195 ceph-mon[68841]: Upgrade: Updating osd.0 2024-08-18T22:44:44.056 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:44:43 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:44:44.056 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:44:43 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-08-18T22:44:44.056 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:44:43 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:44:44.056 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:44:43 smithi195 ceph-mon[68841]: Deploying daemon osd.0 on smithi121 2024-08-18T22:44:44.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:44:43 smithi121 ceph-mon[81053]: pgmap v35: 65 pgs: 65 active+clean; 2.0 GiB data, 7.5 GiB used, 529 GiB / 536 GiB avail 2024-08-18T22:44:44.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:44:43 smithi121 ceph-mon[81053]: Upgrade: Updating osd.0 2024-08-18T22:44:44.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:44:43 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:44:44.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:44:43 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-08-18T22:44:44.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:44:43 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:44:44.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:44:43 smithi121 ceph-mon[81053]: Deploying daemon osd.0 on smithi121 2024-08-18T22:44:45.876 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:44:45 smithi121 ceph-mon[81053]: pgmap v36: 65 pgs: 65 active+clean; 2.0 GiB data, 7.5 GiB used, 529 GiB / 536 GiB avail 2024-08-18T22:44:45.876 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:44:45 smithi121 ceph-mon[81053]: 3 slow requests, 0 included below; oldest blocked for > 196.867182 secs 2024-08-18T22:44:45.876 INFO:journalctl@ceph.osd.0.smithi121.stdout:Aug 18 22:44:45 smithi121 systemd[1]: Stopping Ceph osd.0 for b003123a-5db1-11ef-bccf-c7b262605968... 2024-08-18T22:44:46.162 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:44:45 smithi195 ceph-mon[68841]: pgmap v36: 65 pgs: 65 active+clean; 2.0 GiB data, 7.5 GiB used, 529 GiB / 536 GiB avail 2024-08-18T22:44:46.162 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:44:45 smithi195 ceph-mon[68841]: 3 slow requests, 0 included below; oldest blocked for > 196.867182 secs 2024-08-18T22:44:46.334 INFO:journalctl@ceph.osd.0.smithi121.stdout:Aug 18 22:44:45 smithi121 ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-0[35316]: 2024-08-18T22:44:45.874+0000 7f813678c640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-18T22:44:46.334 INFO:journalctl@ceph.osd.0.smithi121.stdout:Aug 18 22:44:45 smithi121 ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-0[35316]: 2024-08-18T22:44:45.874+0000 7f813678c640 -1 osd.0 50 *** Got signal Terminated *** 2024-08-18T22:44:46.334 INFO:journalctl@ceph.osd.0.smithi121.stdout:Aug 18 22:44:45 smithi121 ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-0[35316]: 2024-08-18T22:44:45.874+0000 7f813678c640 -1 osd.0 50 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-08-18T22:44:47.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:44:46 smithi121 ceph-mon[81053]: osd.0 marked itself down and dead 2024-08-18T22:44:47.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:44:46 smithi195 ceph-mon[68841]: osd.0 marked itself down and dead 2024-08-18T22:44:47.583 INFO:journalctl@ceph.osd.0.smithi121.stdout:Aug 18 22:44:47 smithi121 podman[88826]: 2024-08-18 22:44:47.20450709 +0000 UTC m=+1.447222654 container died 30859216633d8b78229ca8c2a335c6e57a50be17070c8b966d2567b55cef4561 (image=quay.ceph.io/ceph-ci/ceph@sha256:bf20fb88c15fff689cf84383793d3756b4df7aceb11592a28c78dd893a0b3e7d, name=ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-0, org.label-schema.build-date=20240731, ceph=True, io.buildah.version=1.36.0, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_CLEAN=True, RELEASE=quincy-df62bdc, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-08-18T22:44:48.060 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:44:47 smithi195 ceph-mon[68841]: pgmap v37: 65 pgs: 65 active+clean; 2.0 GiB data, 7.5 GiB used, 529 GiB / 536 GiB avail 2024-08-18T22:44:48.061 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:44:47 smithi195 ceph-mon[68841]: Health check failed: 1 osds down (OSD_DOWN) 2024-08-18T22:44:48.061 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:44:47 smithi195 ceph-mon[68841]: osdmap e51: 6 total, 5 up, 6 in 2024-08-18T22:44:48.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:44:47 smithi121 ceph-mon[81053]: pgmap v37: 65 pgs: 65 active+clean; 2.0 GiB data, 7.5 GiB used, 529 GiB / 536 GiB avail 2024-08-18T22:44:48.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:44:47 smithi121 ceph-mon[81053]: Health check failed: 1 osds down (OSD_DOWN) 2024-08-18T22:44:48.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:44:47 smithi121 ceph-mon[81053]: osdmap e51: 6 total, 5 up, 6 in 2024-08-18T22:44:48.084 INFO:journalctl@ceph.osd.0.smithi121.stdout:Aug 18 22:44:47 smithi121 podman[88826]: 2024-08-18 22:44:47.625918406 +0000 UTC m=+1.868634013 container cleanup 30859216633d8b78229ca8c2a335c6e57a50be17070c8b966d2567b55cef4561 (image=quay.ceph.io/ceph-ci/ceph@sha256:bf20fb88c15fff689cf84383793d3756b4df7aceb11592a28c78dd893a0b3e7d, name=ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-0, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, io.buildah.version=1.36.0, GIT_CLEAN=True, ceph=True, RELEASE=quincy-df62bdc, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-08-18T22:44:48.084 INFO:journalctl@ceph.osd.0.smithi121.stdout:Aug 18 22:44:47 smithi121 bash[88826]: ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-0 2024-08-18T22:44:48.084 INFO:journalctl@ceph.osd.0.smithi121.stdout:Aug 18 22:44:47 smithi121 podman[88843]: 2024-08-18 22:44:47.818578181 +0000 UTC m=+0.612787511 container remove 30859216633d8b78229ca8c2a335c6e57a50be17070c8b966d2567b55cef4561 (image=quay.ceph.io/ceph-ci/ceph@sha256:bf20fb88c15fff689cf84383793d3756b4df7aceb11592a28c78dd893a0b3e7d, name=ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=quincy-df62bdc, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, io.buildah.version=1.36.0, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, ceph=True) 2024-08-18T22:44:48.555 INFO:journalctl@ceph.osd.0.smithi121.stdout:Aug 18 22:44:48 smithi121 podman[88932]: 2024-08-18 22:44:48.163354841 +0000 UTC m=+0.017130379 image pull ea7a5189f30bad3aca9524788e2965d2368d7ce786df09d4edcd8c3edf9cefba quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9 2024-08-18T22:44:48.556 INFO:journalctl@ceph.osd.0.smithi121.stdout:Aug 18 22:44:48 smithi121 podman[88932]: 2024-08-18 22:44:48.327743351 +0000 UTC m=+0.181518880 container create 188f6f0d3d46ecaec85753f73f3c00ad64a21e72b86b0f198b128e9088042af1 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-0-deactivate, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, ceph=True, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, io.buildah.version=1.36.0, org.label-schema.vendor=CentOS, RELEASE=squid-de09dd0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731) 2024-08-18T22:44:48.556 INFO:journalctl@ceph.osd.0.smithi121.stdout:Aug 18 22:44:48 smithi121 podman[88932]: 2024-08-18 22:44:48.555225717 +0000 UTC m=+0.409001246 container init 188f6f0d3d46ecaec85753f73f3c00ad64a21e72b86b0f198b128e9088042af1 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-0-deactivate, io.buildah.version=1.36.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, RELEASE=squid-de09dd0, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, ceph=True, GIT_CLEAN=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image) 2024-08-18T22:44:48.833 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:44:48 smithi121 ceph-mon[81053]: osdmap e52: 6 total, 5 up, 6 in 2024-08-18T22:44:48.834 INFO:journalctl@ceph.osd.0.smithi121.stdout:Aug 18 22:44:48 smithi121 podman[88932]: 2024-08-18 22:44:48.559408224 +0000 UTC m=+0.413183756 container start 188f6f0d3d46ecaec85753f73f3c00ad64a21e72b86b0f198b128e9088042af1 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-0-deactivate, GIT_CLEAN=True, io.buildah.version=1.36.0, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-de09dd0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2) 2024-08-18T22:44:48.834 INFO:journalctl@ceph.osd.0.smithi121.stdout:Aug 18 22:44:48 smithi121 podman[88932]: 2024-08-18 22:44:48.63018961 +0000 UTC m=+0.483965143 container attach 188f6f0d3d46ecaec85753f73f3c00ad64a21e72b86b0f198b128e9088042af1 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-0-deactivate, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.36.0, org.label-schema.vendor=CentOS, RELEASE=squid-de09dd0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, ceph=True, GIT_CLEAN=True, GIT_BRANCH=HEAD) 2024-08-18T22:44:48.834 INFO:journalctl@ceph.osd.0.smithi121.stdout:Aug 18 22:44:48 smithi121 podman[88932]: 2024-08-18 22:44:48.746975176 +0000 UTC m=+0.600750705 container died 188f6f0d3d46ecaec85753f73f3c00ad64a21e72b86b0f198b128e9088042af1 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-0-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, RELEASE=squid-de09dd0, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, io.buildah.version=1.36.0, ceph=True) 2024-08-18T22:44:49.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:44:48 smithi195 ceph-mon[68841]: osdmap e52: 6 total, 5 up, 6 in 2024-08-18T22:44:49.698 INFO:journalctl@ceph.osd.0.smithi121.stdout:Aug 18 22:44:49 smithi121 podman[88954]: 2024-08-18 22:44:49.418044578 +0000 UTC m=+0.665117080 container remove 188f6f0d3d46ecaec85753f73f3c00ad64a21e72b86b0f198b128e9088042af1 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-0-deactivate, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.36.0, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=squid-de09dd0, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True) 2024-08-18T22:44:49.699 INFO:journalctl@ceph.osd.0.smithi121.stdout:Aug 18 22:44:49 smithi121 systemd[1]: ceph-b003123a-5db1-11ef-bccf-c7b262605968@osd.0.service: Deactivated successfully. 2024-08-18T22:44:49.699 INFO:journalctl@ceph.osd.0.smithi121.stdout:Aug 18 22:44:49 smithi121 systemd[1]: Stopped Ceph osd.0 for b003123a-5db1-11ef-bccf-c7b262605968. 2024-08-18T22:44:49.699 INFO:journalctl@ceph.osd.0.smithi121.stdout:Aug 18 22:44:49 smithi121 systemd[1]: ceph-b003123a-5db1-11ef-bccf-c7b262605968@osd.0.service: Consumed 43.083s CPU time. 2024-08-18T22:44:49.699 INFO:journalctl@ceph.osd.0.smithi121.stdout:Aug 18 22:44:49 smithi121 systemd[1]: Starting Ceph osd.0 for b003123a-5db1-11ef-bccf-c7b262605968... 2024-08-18T22:44:49.978 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:44:49 smithi121 ceph-mon[81053]: pgmap v40: 65 pgs: 9 stale+active+clean, 56 active+clean; 2.0 GiB data, 7.5 GiB used, 529 GiB / 536 GiB avail 2024-08-18T22:44:49.978 INFO:journalctl@ceph.osd.0.smithi121.stdout:Aug 18 22:44:49 smithi121 podman[89055]: 2024-08-18 22:44:49.762391705 +0000 UTC m=+0.017525430 image pull ea7a5189f30bad3aca9524788e2965d2368d7ce786df09d4edcd8c3edf9cefba quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9 2024-08-18T22:44:50.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:44:49 smithi195 ceph-mon[68841]: pgmap v40: 65 pgs: 9 stale+active+clean, 56 active+clean; 2.0 GiB data, 7.5 GiB used, 529 GiB / 536 GiB avail 2024-08-18T22:44:50.322 INFO:journalctl@ceph.osd.0.smithi121.stdout:Aug 18 22:44:49 smithi121 podman[89055]: 2024-08-18 22:44:49.977580003 +0000 UTC m=+0.232713719 container create 4c9e2cf0872c826871b50f78518b609d9ad5ddcd43b955beb7eb0992eaff934f (image=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-0-activate, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.36.0, RELEASE=squid-de09dd0, org.label-schema.license=GPLv2) 2024-08-18T22:44:50.322 INFO:journalctl@ceph.osd.0.smithi121.stdout:Aug 18 22:44:50 smithi121 podman[89055]: 2024-08-18 22:44:50.205031052 +0000 UTC m=+0.460164778 container init 4c9e2cf0872c826871b50f78518b609d9ad5ddcd43b955beb7eb0992eaff934f (image=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-0-activate, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.schema-version=1.0, RELEASE=squid-de09dd0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, io.buildah.version=1.36.0, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS) 2024-08-18T22:44:50.322 INFO:journalctl@ceph.osd.0.smithi121.stdout:Aug 18 22:44:50 smithi121 podman[89055]: 2024-08-18 22:44:50.2085447 +0000 UTC m=+0.463678417 container start 4c9e2cf0872c826871b50f78518b609d9ad5ddcd43b955beb7eb0992eaff934f (image=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-0-activate, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, ceph=True, org.label-schema.build-date=20240731, RELEASE=squid-de09dd0, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.36.0, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=) 2024-08-18T22:44:50.322 INFO:journalctl@ceph.osd.0.smithi121.stdout:Aug 18 22:44:50 smithi121 podman[89055]: 2024-08-18 22:44:50.321724926 +0000 UTC m=+0.576858635 container attach 4c9e2cf0872c826871b50f78518b609d9ad5ddcd43b955beb7eb0992eaff934f (image=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-0-activate, io.buildah.version=1.36.0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, RELEASE=squid-de09dd0, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2) 2024-08-18T22:44:50.584 INFO:journalctl@ceph.osd.0.smithi121.stdout:Aug 18 22:44:50 smithi121 ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-0-activate[89069]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-08-18T22:44:50.584 INFO:journalctl@ceph.osd.0.smithi121.stdout:Aug 18 22:44:50 smithi121 bash[89055]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-08-18T22:44:50.584 INFO:journalctl@ceph.osd.0.smithi121.stdout:Aug 18 22:44:50 smithi121 ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-0-activate[89069]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-08-18T22:44:50.584 INFO:journalctl@ceph.osd.0.smithi121.stdout:Aug 18 22:44:50 smithi121 bash[89055]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-08-18T22:44:50.584 INFO:journalctl@ceph.osd.0.smithi121.stdout:Aug 18 22:44:50 smithi121 ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-0-activate[89069]: --> Failed to activate via raw: activate() takes 1 positional argument but 5 were given 2024-08-18T22:44:50.584 INFO:journalctl@ceph.osd.0.smithi121.stdout:Aug 18 22:44:50 smithi121 bash[89055]: --> Failed to activate via raw: activate() takes 1 positional argument but 5 were given 2024-08-18T22:44:50.584 INFO:journalctl@ceph.osd.0.smithi121.stdout:Aug 18 22:44:50 smithi121 ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-0-activate[89069]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-08-18T22:44:50.584 INFO:journalctl@ceph.osd.0.smithi121.stdout:Aug 18 22:44:50 smithi121 bash[89055]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-08-18T22:44:50.584 INFO:journalctl@ceph.osd.0.smithi121.stdout:Aug 18 22:44:50 smithi121 ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-0-activate[89069]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-08-18T22:44:50.585 INFO:journalctl@ceph.osd.0.smithi121.stdout:Aug 18 22:44:50 smithi121 bash[89055]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-08-18T22:44:50.585 INFO:journalctl@ceph.osd.0.smithi121.stdout:Aug 18 22:44:50 smithi121 ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-0-activate[89069]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-08-18T22:44:50.585 INFO:journalctl@ceph.osd.0.smithi121.stdout:Aug 18 22:44:50 smithi121 bash[89055]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-08-18T22:44:50.585 INFO:journalctl@ceph.osd.0.smithi121.stdout:Aug 18 22:44:50 smithi121 ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-0-activate[89069]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_4 --path /var/lib/ceph/osd/ceph-0 --no-mon-config 2024-08-18T22:44:50.585 INFO:journalctl@ceph.osd.0.smithi121.stdout:Aug 18 22:44:50 smithi121 bash[89055]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_4 --path /var/lib/ceph/osd/ceph-0 --no-mon-config 2024-08-18T22:44:50.585 INFO:journalctl@ceph.osd.0.smithi121.stdout:Aug 18 22:44:50 smithi121 ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-0-activate[89069]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-0/block 2024-08-18T22:44:50.585 INFO:journalctl@ceph.osd.0.smithi121.stdout:Aug 18 22:44:50 smithi121 bash[89055]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-0/block 2024-08-18T22:44:50.585 INFO:journalctl@ceph.osd.0.smithi121.stdout:Aug 18 22:44:50 smithi121 ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-0-activate[89069]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-0/block 2024-08-18T22:44:50.585 INFO:journalctl@ceph.osd.0.smithi121.stdout:Aug 18 22:44:50 smithi121 bash[89055]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-0/block 2024-08-18T22:44:50.585 INFO:journalctl@ceph.osd.0.smithi121.stdout:Aug 18 22:44:50 smithi121 ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-0-activate[89069]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-08-18T22:44:50.585 INFO:journalctl@ceph.osd.0.smithi121.stdout:Aug 18 22:44:50 smithi121 bash[89055]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-08-18T22:44:50.585 INFO:journalctl@ceph.osd.0.smithi121.stdout:Aug 18 22:44:50 smithi121 ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-0-activate[89069]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-08-18T22:44:50.585 INFO:journalctl@ceph.osd.0.smithi121.stdout:Aug 18 22:44:50 smithi121 bash[89055]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-08-18T22:44:50.586 INFO:journalctl@ceph.osd.0.smithi121.stdout:Aug 18 22:44:50 smithi121 ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-0-activate[89069]: --> ceph-volume lvm activate successful for osd ID: 0 2024-08-18T22:44:50.586 INFO:journalctl@ceph.osd.0.smithi121.stdout:Aug 18 22:44:50 smithi121 bash[89055]: --> ceph-volume lvm activate successful for osd ID: 0 2024-08-18T22:44:50.586 INFO:journalctl@ceph.osd.0.smithi121.stdout:Aug 18 22:44:50 smithi121 podman[89055]: 2024-08-18 22:44:50.491884461 +0000 UTC m=+0.747018169 container died 4c9e2cf0872c826871b50f78518b609d9ad5ddcd43b955beb7eb0992eaff934f (image=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-0-activate, org.label-schema.build-date=20240731, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , io.buildah.version=1.36.0, RELEASE=squid-de09dd0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2) 2024-08-18T22:44:50.980 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:44:50 smithi121 ceph-mon[81053]: 3 slow requests, 0 included below; oldest blocked for > 201.867271 secs 2024-08-18T22:44:51.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:44:50 smithi195 ceph-mon[68841]: 3 slow requests, 0 included below; oldest blocked for > 201.867271 secs 2024-08-18T22:44:51.293 INFO:journalctl@ceph.osd.0.smithi121.stdout:Aug 18 22:44:51 smithi121 podman[89178]: 2024-08-18 22:44:51.084142456 +0000 UTC m=+0.586059874 container remove 4c9e2cf0872c826871b50f78518b609d9ad5ddcd43b955beb7eb0992eaff934f (image=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-0-activate, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, maintainer=Guillaume Abrioux , RELEASE=squid-de09dd0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.36.0, ceph=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0) 2024-08-18T22:44:51.545 INFO:journalctl@ceph.osd.0.smithi121.stdout:Aug 18 22:44:51 smithi121 podman[89239]: 2024-08-18 22:44:51.293480808 +0000 UTC m=+0.113539949 container create d378dd46eeb6920fbd6fccca9ddd1cd477d678eedd7275915f8473f4c786c4ef (image=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-0, io.buildah.version=1.36.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-de09dd0, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, ceph=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-08-18T22:44:51.545 INFO:journalctl@ceph.osd.0.smithi121.stdout:Aug 18 22:44:51 smithi121 podman[89239]: 2024-08-18 22:44:51.197085466 +0000 UTC m=+0.017144620 image pull ea7a5189f30bad3aca9524788e2965d2368d7ce786df09d4edcd8c3edf9cefba quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9 2024-08-18T22:44:51.545 INFO:journalctl@ceph.osd.0.smithi121.stdout:Aug 18 22:44:51 smithi121 podman[89239]: 2024-08-18 22:44:51.52059772 +0000 UTC m=+0.340656856 container init d378dd46eeb6920fbd6fccca9ddd1cd477d678eedd7275915f8473f4c786c4ef (image=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, RELEASE=squid-de09dd0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.36.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image) 2024-08-18T22:44:51.545 INFO:journalctl@ceph.osd.0.smithi121.stdout:Aug 18 22:44:51 smithi121 podman[89239]: 2024-08-18 22:44:51.523891496 +0000 UTC m=+0.343950633 container start d378dd46eeb6920fbd6fccca9ddd1cd477d678eedd7275915f8473f4c786c4ef (image=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-0, ceph=True, io.buildah.version=1.36.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-de09dd0, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS) 2024-08-18T22:44:51.545 INFO:journalctl@ceph.osd.0.smithi121.stdout:Aug 18 22:44:51 smithi121 ceph-osd[89258]: -- 172.21.15.121:0/3323864450 <== mon.0 v2:172.21.15.121:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5565d8b221e0 con 0x5565d7cd5c00 2024-08-18T22:44:51.833 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:44:51 smithi121 ceph-mon[81053]: pgmap v41: 65 pgs: 1 active+undersized, 33 active+undersized+degraded, 31 active+clean; 2.0 GiB data, 7.5 GiB used, 529 GiB / 536 GiB avail; 5064/34143 objects degraded (14.832%) 2024-08-18T22:44:51.834 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:44:51 smithi121 ceph-mon[81053]: Health check failed: Degraded data redundancy: 5064/34143 objects degraded (14.832%), 33 pgs degraded (PG_DEGRADED) 2024-08-18T22:44:51.834 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:44:51 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:44:51.834 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:44:51 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:44:51.834 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:44:51 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-18T22:44:51.834 INFO:journalctl@ceph.osd.0.smithi121.stdout:Aug 18 22:44:51 smithi121 bash[89239]: d378dd46eeb6920fbd6fccca9ddd1cd477d678eedd7275915f8473f4c786c4ef 2024-08-18T22:44:51.834 INFO:journalctl@ceph.osd.0.smithi121.stdout:Aug 18 22:44:51 smithi121 systemd[1]: Started Ceph osd.0 for b003123a-5db1-11ef-bccf-c7b262605968. 2024-08-18T22:44:52.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:44:51 smithi195 ceph-mon[68841]: pgmap v41: 65 pgs: 1 active+undersized, 33 active+undersized+degraded, 31 active+clean; 2.0 GiB data, 7.5 GiB used, 529 GiB / 536 GiB avail; 5064/34143 objects degraded (14.832%) 2024-08-18T22:44:52.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:44:51 smithi195 ceph-mon[68841]: Health check failed: Degraded data redundancy: 5064/34143 objects degraded (14.832%), 33 pgs degraded (PG_DEGRADED) 2024-08-18T22:44:52.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:44:51 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:44:52.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:44:51 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:44:52.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:44:51 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-18T22:44:52.333 INFO:journalctl@ceph.osd.0.smithi121.stdout:Aug 18 22:44:52 smithi121 ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-0[89254]: 2024-08-18T22:44:52.067+0000 7fc1f996f640 -1 Falling back to public interface 2024-08-18T22:44:53.261 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:44:52 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:44:53.261 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:44:52 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:44:53.261 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:44:52 smithi121 ceph-mon[81053]: pgmap v42: 65 pgs: 1 active+undersized, 33 active+undersized+degraded, 31 active+clean; 2.0 GiB data, 7.5 GiB used, 529 GiB / 536 GiB avail; 5064/34143 objects degraded (14.832%) 2024-08-18T22:44:53.409 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:44:52 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:44:53.409 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:44:52 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:44:53.409 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:44:52 smithi195 ceph-mon[68841]: pgmap v42: 65 pgs: 1 active+undersized, 33 active+undersized+degraded, 31 active+clean; 2.0 GiB data, 7.5 GiB used, 529 GiB / 536 GiB avail; 5064/34143 objects degraded (14.832%) 2024-08-18T22:44:53.616 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:53.613+0000 7f91764c0640 1 -- 172.21.15.121:0/1783720734 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f91700fb1d0 msgr2=0x7f91700fb5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:44:53.616 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:53.613+0000 7f91764c0640 1 --2- 172.21.15.121:0/1783720734 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f91700fb1d0 0x7f91700fb5e0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f91600048d0 tx=0x7f9160009da0 comp rx=0 tx=0).stop 2024-08-18T22:44:53.616 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:53.613+0000 7f91764c0640 1 -- 172.21.15.121:0/1783720734 shutdown_connections 2024-08-18T22:44:53.616 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:53.613+0000 7f91764c0640 1 --2- 172.21.15.121:0/1783720734 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f91700fc4a0 0x7f91700fc910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:44:53.616 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:53.613+0000 7f91764c0640 1 --2- 172.21.15.121:0/1783720734 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f91700fb1d0 0x7f91700fb5e0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:44:53.616 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:53.613+0000 7f91764c0640 1 -- 172.21.15.121:0/1783720734 >> 172.21.15.121:0/1783720734 conn(0x7f91700f69b0 msgr2=0x7f91700f8dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:44:53.617 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:53.613+0000 7f91764c0640 1 -- 172.21.15.121:0/1783720734 shutdown_connections 2024-08-18T22:44:53.617 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:53.613+0000 7f91764c0640 1 -- 172.21.15.121:0/1783720734 wait complete. 2024-08-18T22:44:53.617 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:53.613+0000 7f91764c0640 1 Processor -- start 2024-08-18T22:44:53.617 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:53.613+0000 7f91764c0640 1 -- start start 2024-08-18T22:44:53.617 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:53.614+0000 7f91764c0640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f91700fb1d0 0x7f917010bd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:44:53.617 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:53.614+0000 7f91764c0640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f91700fc4a0 0x7f917010c2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:44:53.617 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:53.614+0000 7f91764c0640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f917010c900 con 0x7f91700fc4a0 2024-08-18T22:44:53.617 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:53.614+0000 7f91764c0640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f917010d040 con 0x7f91700fb1d0 2024-08-18T22:44:53.617 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:53.614+0000 7f9167fff640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f91700fc4a0 0x7f917010c2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:44:53.617 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:53.614+0000 7f9167fff640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f91700fc4a0 0x7f917010c2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:60796/0 (socket says 172.21.15.121:60796) 2024-08-18T22:44:53.617 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:53.614+0000 7f9167fff640 1 -- 172.21.15.121:0/2929120319 learned_addr learned my addr 172.21.15.121:0/2929120319 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-18T22:44:53.617 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:53.614+0000 7f916ffff640 1 --2- 172.21.15.121:0/2929120319 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f91700fb1d0 0x7f917010bd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:44:53.618 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:53.614+0000 7f9167fff640 1 -- 172.21.15.121:0/2929120319 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f91700fb1d0 msgr2=0x7f917010bd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:44:53.618 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:53.614+0000 7f9167fff640 1 --2- 172.21.15.121:0/2929120319 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f91700fb1d0 0x7f917010bd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:44:53.618 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:53.614+0000 7f9167fff640 1 -- 172.21.15.121:0/2929120319 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9160005040 con 0x7f91700fc4a0 2024-08-18T22:44:53.618 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:53.614+0000 7f9167fff640 1 --2- 172.21.15.121:0/2929120319 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f91700fc4a0 0x7f917010c2b0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f915800c810 tx=0x7f91580043c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:44:53.618 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:53.614+0000 7f916d7fa640 1 -- 172.21.15.121:0/2929120319 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f915800a7a0 con 0x7f91700fc4a0 2024-08-18T22:44:53.618 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:53.614+0000 7f916d7fa640 1 -- 172.21.15.121:0/2929120319 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f915800ada0 con 0x7f91700fc4a0 2024-08-18T22:44:53.618 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:53.614+0000 7f91764c0640 1 -- 172.21.15.121:0/2929120319 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f917010d2d0 con 0x7f91700fc4a0 2024-08-18T22:44:53.618 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:53.614+0000 7f916d7fa640 1 -- 172.21.15.121:0/2929120319 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9158011380 con 0x7f91700fc4a0 2024-08-18T22:44:53.618 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:53.614+0000 7f91764c0640 1 -- 172.21.15.121:0/2929120319 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f917010d870 con 0x7f91700fc4a0 2024-08-18T22:44:53.619 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:53.615+0000 7f91764c0640 1 -- 172.21.15.121:0/2929120319 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91700fa630 con 0x7f91700fc4a0 2024-08-18T22:44:53.619 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:53.616+0000 7f916d7fa640 1 -- 172.21.15.121:0/2929120319 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 36) v1 ==== 92307+0+0 (secure 0 0 0) 0x7f91580127d0 con 0x7f91700fc4a0 2024-08-18T22:44:53.619 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:53.616+0000 7f916d7fa640 1 --2- 172.21.15.121:0/2929120319 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f915c06e1e0 0x7f915c070690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:44:53.619 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:53.617+0000 7f916d7fa640 1 -- 172.21.15.121:0/2929120319 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f915808e260 con 0x7f91700fc4a0 2024-08-18T22:44:53.620 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:53.617+0000 7f916ffff640 1 --2- 172.21.15.121:0/2929120319 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f915c06e1e0 0x7f915c070690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:44:53.620 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:53.617+0000 7f916ffff640 1 --2- 172.21.15.121:0/2929120319 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f915c06e1e0 0x7f915c070690 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f9160000c00 tx=0x7f9160035040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:44:53.622 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:53.621+0000 7f916d7fa640 1 -- 172.21.15.121:0/2929120319 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f915805afb0 con 0x7f91700fc4a0 2024-08-18T22:44:53.813 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:53.812+0000 7f91764c0640 1 -- 172.21.15.121:0/2929120319 --> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f917010dd90 con 0x7f915c06e1e0 2024-08-18T22:44:53.814 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:53.813+0000 7f916d7fa640 1 -- 172.21.15.121:0/2929120319 <== mgr.34102 v2:172.21.15.121:6800/3037387239 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f917010dd90 con 0x7f915c06e1e0 2024-08-18T22:44:53.817 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:53.815+0000 7f91764c0640 1 -- 172.21.15.121:0/2929120319 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f915c06e1e0 msgr2=0x7f915c070690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:44:53.817 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:53.815+0000 7f91764c0640 1 --2- 172.21.15.121:0/2929120319 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f915c06e1e0 0x7f915c070690 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f9160000c00 tx=0x7f9160035040 comp rx=0 tx=0).stop 2024-08-18T22:44:53.817 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:53.816+0000 7f91764c0640 1 -- 172.21.15.121:0/2929120319 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f91700fc4a0 msgr2=0x7f917010c2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:44:53.817 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:53.816+0000 7f91764c0640 1 --2- 172.21.15.121:0/2929120319 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f91700fc4a0 0x7f917010c2b0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f915800c810 tx=0x7f91580043c0 comp rx=0 tx=0).stop 2024-08-18T22:44:53.817 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:53.816+0000 7f91764c0640 1 -- 172.21.15.121:0/2929120319 shutdown_connections 2024-08-18T22:44:53.817 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:53.816+0000 7f91764c0640 1 --2- 172.21.15.121:0/2929120319 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f915c06e1e0 0x7f915c070690 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:44:53.817 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:53.816+0000 7f91764c0640 1 --2- 172.21.15.121:0/2929120319 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f91700fc4a0 0x7f917010c2b0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:44:53.818 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:53.816+0000 7f91764c0640 1 --2- 172.21.15.121:0/2929120319 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f91700fb1d0 0x7f917010bd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:44:53.818 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:53.816+0000 7f91764c0640 1 -- 172.21.15.121:0/2929120319 >> 172.21.15.121:0/2929120319 conn(0x7f91700f69b0 msgr2=0x7f91700f8180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:44:53.818 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:53.816+0000 7f91764c0640 1 -- 172.21.15.121:0/2929120319 shutdown_connections 2024-08-18T22:44:53.818 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:53.816+0000 7f91764c0640 1 -- 172.21.15.121:0/2929120319 wait complete. 2024-08-18T22:44:53.825 INFO:teuthology.orchestra.run.smithi121.stdout:true 2024-08-18T22:44:53.899 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:53.896+0000 7fee11dc5640 1 -- 172.21.15.121:0/2481882721 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fee0c0fc4a0 msgr2=0x7fee0c0fc910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:44:53.899 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:53.896+0000 7fee11dc5640 1 --2- 172.21.15.121:0/2481882721 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fee0c0fc4a0 0x7fee0c0fc910 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fedfc0048d0 tx=0x7fedfc009da0 comp rx=0 tx=0).stop 2024-08-18T22:44:53.899 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:53.897+0000 7fee11dc5640 1 -- 172.21.15.121:0/2481882721 shutdown_connections 2024-08-18T22:44:53.900 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:53.897+0000 7fee11dc5640 1 --2- 172.21.15.121:0/2481882721 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fee0c0fc4a0 0x7fee0c0fc910 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:44:53.900 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:53.897+0000 7fee11dc5640 1 --2- 172.21.15.121:0/2481882721 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fee0c0fb1d0 0x7fee0c0fb5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:44:53.900 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:53.897+0000 7fee11dc5640 1 -- 172.21.15.121:0/2481882721 >> 172.21.15.121:0/2481882721 conn(0x7fee0c0f69b0 msgr2=0x7fee0c0f8dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:44:53.900 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:53.897+0000 7fee11dc5640 1 -- 172.21.15.121:0/2481882721 shutdown_connections 2024-08-18T22:44:53.900 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:53.897+0000 7fee11dc5640 1 -- 172.21.15.121:0/2481882721 wait complete. 2024-08-18T22:44:53.900 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:53.897+0000 7fee11dc5640 1 Processor -- start 2024-08-18T22:44:53.900 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:53.897+0000 7fee11dc5640 1 -- start start 2024-08-18T22:44:53.900 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:53.897+0000 7fee11dc5640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fee0c0fb1d0 0x7fee0c10cee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:44:53.900 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:53.897+0000 7fee11dc5640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fee0c0fc4a0 0x7fee0c10d420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:44:53.900 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:53.897+0000 7fee11dc5640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee0c10e1b0 con 0x7fee0c0fb1d0 2024-08-18T22:44:53.900 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:53.897+0000 7fee11dc5640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee0c10e320 con 0x7fee0c0fc4a0 2024-08-18T22:44:53.900 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:53.898+0000 7fee0b7fe640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fee0c0fb1d0 0x7fee0c10cee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:44:53.900 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:53.898+0000 7fee0b7fe640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fee0c0fb1d0 0x7fee0c10cee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:60818/0 (socket says 172.21.15.121:60818) 2024-08-18T22:44:53.901 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:53.898+0000 7fee0b7fe640 1 -- 172.21.15.121:0/3900993929 learned_addr learned my addr 172.21.15.121:0/3900993929 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-18T22:44:53.901 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:53.898+0000 7fee0affd640 1 --2- 172.21.15.121:0/3900993929 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fee0c0fc4a0 0x7fee0c10d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:44:53.901 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:53.898+0000 7fee0b7fe640 1 -- 172.21.15.121:0/3900993929 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fee0c0fc4a0 msgr2=0x7fee0c10d420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:44:53.901 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:53.898+0000 7fee0b7fe640 1 --2- 172.21.15.121:0/3900993929 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fee0c0fc4a0 0x7fee0c10d420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:44:53.901 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:53.898+0000 7fee0b7fe640 1 -- 172.21.15.121:0/3900993929 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedfc005040 con 0x7fee0c0fb1d0 2024-08-18T22:44:53.901 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:53.898+0000 7fee0b7fe640 1 --2- 172.21.15.121:0/3900993929 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fee0c0fb1d0 0x7fee0c10cee0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fee0000b790 tx=0x7fee000091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:44:53.901 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:53.898+0000 7fedf3fff640 1 -- 172.21.15.121:0/3900993929 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fee0000c700 con 0x7fee0c0fb1d0 2024-08-18T22:44:53.901 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:53.898+0000 7fedf3fff640 1 -- 172.21.15.121:0/3900993929 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fee0000cd00 con 0x7fee0c0fb1d0 2024-08-18T22:44:53.901 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:53.898+0000 7fee11dc5640 1 -- 172.21.15.121:0/3900993929 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee0c10e600 con 0x7fee0c0fb1d0 2024-08-18T22:44:53.901 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:53.898+0000 7fedf3fff640 1 -- 172.21.15.121:0/3900993929 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fee00015e70 con 0x7fee0c0fb1d0 2024-08-18T22:44:53.901 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:53.898+0000 7fee11dc5640 1 -- 172.21.15.121:0/3900993929 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee0c10eb20 con 0x7fee0c0fb1d0 2024-08-18T22:44:53.902 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:53.899+0000 7fee11dc5640 1 -- 172.21.15.121:0/3900993929 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee0c104460 con 0x7fee0c0fb1d0 2024-08-18T22:44:53.902 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:53.900+0000 7fedf3fff640 1 -- 172.21.15.121:0/3900993929 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 36) v1 ==== 92307+0+0 (secure 0 0 0) 0x7fee00012070 con 0x7fee0c0fb1d0 2024-08-18T22:44:53.902 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:53.900+0000 7fedf3fff640 1 --2- 172.21.15.121:0/3900993929 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7fedf406e1e0 0x7fedf4070690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:44:53.902 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:53.901+0000 7fee0affd640 1 --2- 172.21.15.121:0/3900993929 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7fedf406e1e0 0x7fedf4070690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:44:53.902 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:53.901+0000 7fedf3fff640 1 -- 172.21.15.121:0/3900993929 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6496+0+0 (secure 0 0 0) 0x7fee0008d920 con 0x7fee0c0fb1d0 2024-08-18T22:44:53.903 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:53.901+0000 7fee0affd640 1 --2- 172.21.15.121:0/3900993929 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7fedf406e1e0 0x7fedf4070690 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fedfc007ac0 tx=0x7fedfc035040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:44:53.906 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:53.905+0000 7fedf3fff640 1 -- 172.21.15.121:0/3900993929 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7fee00056b40 con 0x7fee0c0fb1d0 2024-08-18T22:44:54.093 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:54.092+0000 7fee11dc5640 1 -- 172.21.15.121:0/3900993929 --> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fee0c10eda0 con 0x7fedf406e1e0 2024-08-18T22:44:54.094 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:54.094+0000 7fedf3fff640 1 -- 172.21.15.121:0/3900993929 <== mgr.34102 v2:172.21.15.121:6800/3037387239 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7fee0c10eda0 con 0x7fedf406e1e0 2024-08-18T22:44:54.097 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:54.096+0000 7fee11dc5640 1 -- 172.21.15.121:0/3900993929 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7fedf406e1e0 msgr2=0x7fedf4070690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:44:54.097 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:54.096+0000 7fee11dc5640 1 --2- 172.21.15.121:0/3900993929 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7fedf406e1e0 0x7fedf4070690 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fedfc007ac0 tx=0x7fedfc035040 comp rx=0 tx=0).stop 2024-08-18T22:44:54.097 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:54.096+0000 7fee11dc5640 1 -- 172.21.15.121:0/3900993929 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fee0c0fb1d0 msgr2=0x7fee0c10cee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:44:54.097 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:54.096+0000 7fee11dc5640 1 --2- 172.21.15.121:0/3900993929 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fee0c0fb1d0 0x7fee0c10cee0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fee0000b790 tx=0x7fee000091d0 comp rx=0 tx=0).stop 2024-08-18T22:44:54.097 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:54.096+0000 7fee11dc5640 1 -- 172.21.15.121:0/3900993929 shutdown_connections 2024-08-18T22:44:54.097 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:54.096+0000 7fee11dc5640 1 --2- 172.21.15.121:0/3900993929 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7fedf406e1e0 0x7fedf4070690 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:44:54.097 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:54.096+0000 7fee11dc5640 1 --2- 172.21.15.121:0/3900993929 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fee0c0fc4a0 0x7fee0c10d420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:44:54.097 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:54.096+0000 7fee11dc5640 1 --2- 172.21.15.121:0/3900993929 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fee0c0fb1d0 0x7fee0c10cee0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:44:54.097 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:54.096+0000 7fee11dc5640 1 -- 172.21.15.121:0/3900993929 >> 172.21.15.121:0/3900993929 conn(0x7fee0c0f69b0 msgr2=0x7fee0c064d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:44:54.097 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:54.096+0000 7fee11dc5640 1 -- 172.21.15.121:0/3900993929 shutdown_connections 2024-08-18T22:44:54.097 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:54.096+0000 7fee11dc5640 1 -- 172.21.15.121:0/3900993929 wait complete. 2024-08-18T22:44:54.176 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:54.174+0000 7f1a0b947640 1 -- 172.21.15.121:0/1182861505 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1a040fc2c0 msgr2=0x7f1a040fc6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:44:54.176 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:54.174+0000 7f1a0b947640 1 --2- 172.21.15.121:0/1182861505 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1a040fc2c0 0x7f1a040fc6d0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f1a000048d0 tx=0x7f1a00009da0 comp rx=0 tx=0).stop 2024-08-18T22:44:54.176 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:54.174+0000 7f1a0b947640 1 -- 172.21.15.121:0/1182861505 shutdown_connections 2024-08-18T22:44:54.176 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:54.174+0000 7f1a0b947640 1 --2- 172.21.15.121:0/1182861505 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1a040fd590 0x7f1a040fda00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:44:54.176 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:54.174+0000 7f1a0b947640 1 --2- 172.21.15.121:0/1182861505 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1a040fc2c0 0x7f1a040fc6d0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:44:54.176 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:54.174+0000 7f1a0b947640 1 -- 172.21.15.121:0/1182861505 >> 172.21.15.121:0/1182861505 conn(0x7f1a040f7a80 msgr2=0x7f1a040f9eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:44:54.176 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:54.175+0000 7f1a0b947640 1 -- 172.21.15.121:0/1182861505 shutdown_connections 2024-08-18T22:44:54.176 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:54.175+0000 7f1a0b947640 1 -- 172.21.15.121:0/1182861505 wait complete. 2024-08-18T22:44:54.178 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:54.175+0000 7f1a0b947640 1 Processor -- start 2024-08-18T22:44:54.178 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:54.175+0000 7f1a0b947640 1 -- start start 2024-08-18T22:44:54.178 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:54.175+0000 7f1a0b947640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1a040fc2c0 0x7f1a0410cee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:44:54.178 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:54.175+0000 7f1a0b947640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1a040fd590 0x7f1a0410d420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:44:54.178 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:54.175+0000 7f1a0b947640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a0410e150 con 0x7f1a040fd590 2024-08-18T22:44:54.178 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:54.175+0000 7f1a0b947640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a0410e2c0 con 0x7f1a040fc2c0 2024-08-18T22:44:54.179 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:54.175+0000 7f1a08ee2640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1a040fd590 0x7f1a0410d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:44:54.179 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:54.176+0000 7f1a08ee2640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1a040fd590 0x7f1a0410d420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:60834/0 (socket says 172.21.15.121:60834) 2024-08-18T22:44:54.179 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:54.176+0000 7f1a08ee2640 1 -- 172.21.15.121:0/89278821 learned_addr learned my addr 172.21.15.121:0/89278821 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-18T22:44:54.179 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:54.176+0000 7f1a096e3640 1 --2- 172.21.15.121:0/89278821 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1a040fc2c0 0x7f1a0410cee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:44:54.179 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:54.176+0000 7f1a08ee2640 1 -- 172.21.15.121:0/89278821 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1a040fc2c0 msgr2=0x7f1a0410cee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:44:54.179 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:54.176+0000 7f1a08ee2640 1 --2- 172.21.15.121:0/89278821 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1a040fc2c0 0x7f1a0410cee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:44:54.179 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:54.176+0000 7f1a08ee2640 1 -- 172.21.15.121:0/89278821 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a00005040 con 0x7f1a040fd590 2024-08-18T22:44:54.179 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:54.176+0000 7f1a08ee2640 1 --2- 172.21.15.121:0/89278821 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1a040fd590 0x7f1a0410d420 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f19f400b790 tx=0x7f19f40091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:44:54.179 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:54.176+0000 7f19f9ffb640 1 -- 172.21.15.121:0/89278821 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f19f400c700 con 0x7f1a040fd590 2024-08-18T22:44:54.179 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:54.176+0000 7f1a0b947640 1 -- 172.21.15.121:0/89278821 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a0410e5a0 con 0x7f1a040fd590 2024-08-18T22:44:54.179 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:54.176+0000 7f19f9ffb640 1 -- 172.21.15.121:0/89278821 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f19f400cd00 con 0x7f1a040fd590 2024-08-18T22:44:54.179 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:54.176+0000 7f19f9ffb640 1 -- 172.21.15.121:0/89278821 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f19f4015e70 con 0x7f1a040fd590 2024-08-18T22:44:54.179 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:54.176+0000 7f1a0b947640 1 -- 172.21.15.121:0/89278821 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a0410eac0 con 0x7f1a040fd590 2024-08-18T22:44:54.179 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:54.177+0000 7f1a0b947640 1 -- 172.21.15.121:0/89278821 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a040fb720 con 0x7f1a040fd590 2024-08-18T22:44:54.180 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:54.178+0000 7f19f9ffb640 1 -- 172.21.15.121:0/89278821 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 36) v1 ==== 92307+0+0 (secure 0 0 0) 0x7f19f4012070 con 0x7f1a040fd590 2024-08-18T22:44:54.180 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:54.178+0000 7f19f9ffb640 1 --2- 172.21.15.121:0/89278821 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f19f006e1e0 0x7f19f0070690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:44:54.180 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:54.178+0000 7f19f9ffb640 1 -- 172.21.15.121:0/89278821 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f19f408d920 con 0x7f1a040fd590 2024-08-18T22:44:54.180 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:54.178+0000 7f1a096e3640 1 --2- 172.21.15.121:0/89278821 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f19f006e1e0 0x7f19f0070690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:44:54.181 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:54.179+0000 7f1a096e3640 1 --2- 172.21.15.121:0/89278821 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f19f006e1e0 0x7f19f0070690 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f1a00007ac0 tx=0x7f1a00035040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:44:54.183 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:54.183+0000 7f19f9ffb640 1 -- 172.21.15.121:0/89278821 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f19f4056b40 con 0x7f1a040fd590 2024-08-18T22:44:54.374 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:54.373+0000 7f1a0b947640 1 -- 172.21.15.121:0/89278821 --> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f1a0410ed40 con 0x7f19f006e1e0 2024-08-18T22:44:54.383 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:54.382+0000 7f19f9ffb640 1 -- 172.21.15.121:0/89278821 <== mgr.34102 v2:172.21.15.121:6800/3037387239 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f1a0410ed40 con 0x7f19f006e1e0 2024-08-18T22:44:54.383 INFO:teuthology.orchestra.run.smithi121.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-08-18T22:44:54.383 INFO:teuthology.orchestra.run.smithi121.stdout:alertmanager.smithi121 smithi121 *:9093,9094 running (2m) 17s ago 10m 15.7M - 0.25.0 c8568f914cd2 c421c5e6a02b 2024-08-18T22:44:54.383 INFO:teuthology.orchestra.run.smithi121.stdout:crash.smithi121 smithi121 running (27s) 17s ago 11m 6903k - 19.1.0-1382-gde09dd01 ea7a5189f30b 3cf5c666a0e6 2024-08-18T22:44:54.383 INFO:teuthology.orchestra.run.smithi121.stdout:crash.smithi195 smithi195 running (22s) 19s ago 10m 6895k - 19.1.0-1382-gde09dd01 ea7a5189f30b fbb586fb9834 2024-08-18T22:44:54.383 INFO:teuthology.orchestra.run.smithi121.stdout:grafana.smithi121 smithi121 *:3000 running (2m) 17s ago 10m 79.4M - 9.4.7 954c08fa6188 091a5fd17e8a 2024-08-18T22:44:54.383 INFO:teuthology.orchestra.run.smithi121.stdout:mds.cephfs.smithi121.gbickb smithi121 running (5m) 17s ago 5m 156M - 17.2.7-1406-gdf62bdcc 774894bef55f 484da0bc2c95 2024-08-18T22:44:54.383 INFO:teuthology.orchestra.run.smithi121.stdout:mds.cephfs.smithi121.xuzsdg smithi121 running (5m) 17s ago 5m 13.3M - 17.2.7-1406-gdf62bdcc 774894bef55f 6976b708cdcd 2024-08-18T22:44:54.383 INFO:teuthology.orchestra.run.smithi121.stdout:mds.cephfs.smithi195.buqvbr smithi195 running (5m) 19s ago 5m 115M - 17.2.7-1406-gdf62bdcc 774894bef55f 11a3703b4276 2024-08-18T22:44:54.383 INFO:teuthology.orchestra.run.smithi121.stdout:mds.cephfs.smithi195.nptgyc smithi195 running (5m) 19s ago 5m 17.6M - 17.2.7-1406-gdf62bdcc 774894bef55f b9f8043ea83e 2024-08-18T22:44:54.384 INFO:teuthology.orchestra.run.smithi121.stdout:mgr.smithi121.lopxqc smithi121 *:8443,9283,8765 running (2m) 17s ago 12m 492M - 19.1.0-1382-gde09dd01 ea7a5189f30b 9079701e6516 2024-08-18T22:44:54.384 INFO:teuthology.orchestra.run.smithi121.stdout:mgr.smithi195.acttsj smithi195 *:8443,9283,8765 running (94s) 19s ago 9m 439M - 19.1.0-1382-gde09dd01 ea7a5189f30b 7b4027a33daa 2024-08-18T22:44:54.384 INFO:teuthology.orchestra.run.smithi121.stdout:mon.smithi121 smithi121 running (82s) 17s ago 12m 44.0M 2048M 19.1.0-1382-gde09dd01 ea7a5189f30b d71695a4fb56 2024-08-18T22:44:54.384 INFO:teuthology.orchestra.run.smithi121.stdout:mon.smithi195 smithi195 running (63s) 19s ago 9m 35.1M 2048M 19.1.0-1382-gde09dd01 ea7a5189f30b a9bb94ba3b56 2024-08-18T22:44:54.384 INFO:teuthology.orchestra.run.smithi121.stdout:node-exporter.smithi121 smithi121 *:9100 running (2m) 17s ago 10m 8456k - 1.5.0 0da6a335fe13 bc4b5355a507 2024-08-18T22:44:54.384 INFO:teuthology.orchestra.run.smithi121.stdout:node-exporter.smithi195 smithi195 *:9100 running (2m) 19s ago 9m 16.4M - 1.5.0 0da6a335fe13 146efcb79663 2024-08-18T22:44:54.384 INFO:teuthology.orchestra.run.smithi121.stdout:osd.0 smithi121 starting - - - 1557M 2024-08-18T22:44:54.384 INFO:teuthology.orchestra.run.smithi121.stdout:osd.1 smithi121 running (8m) 17s ago 8m 222M 1557M 17.2.7-1406-gdf62bdcc 774894bef55f ef5fadfd753f 2024-08-18T22:44:54.384 INFO:teuthology.orchestra.run.smithi121.stdout:osd.2 smithi121 running (8m) 17s ago 8m 183M 1557M 17.2.7-1406-gdf62bdcc 774894bef55f 3fa061e41f99 2024-08-18T22:44:54.384 INFO:teuthology.orchestra.run.smithi121.stdout:osd.3 smithi195 running (7m) 19s ago 7m 239M 2581M 17.2.7-1406-gdf62bdcc 774894bef55f 15d30b1b459e 2024-08-18T22:44:54.384 INFO:teuthology.orchestra.run.smithi121.stdout:osd.4 smithi195 running (7m) 19s ago 7m 207M 2581M 17.2.7-1406-gdf62bdcc 774894bef55f 99ed156dfd36 2024-08-18T22:44:54.384 INFO:teuthology.orchestra.run.smithi121.stdout:osd.5 smithi195 running (7m) 19s ago 7m 213M 2581M 17.2.7-1406-gdf62bdcc 774894bef55f e7eff7bdb752 2024-08-18T22:44:54.384 INFO:teuthology.orchestra.run.smithi121.stdout:prometheus.smithi121 smithi121 *:9095 running (99s) 17s ago 10m 49.2M - 2.43.0 a07b618ecd1d 00c4f776d23a 2024-08-18T22:44:54.385 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:54.384+0000 7f1a0b947640 1 -- 172.21.15.121:0/89278821 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f19f006e1e0 msgr2=0x7f19f0070690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:44:54.385 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:54.384+0000 7f1a0b947640 1 --2- 172.21.15.121:0/89278821 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f19f006e1e0 0x7f19f0070690 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f1a00007ac0 tx=0x7f1a00035040 comp rx=0 tx=0).stop 2024-08-18T22:44:54.385 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:54.384+0000 7f1a0b947640 1 -- 172.21.15.121:0/89278821 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1a040fd590 msgr2=0x7f1a0410d420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:44:54.385 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:54.384+0000 7f1a0b947640 1 --2- 172.21.15.121:0/89278821 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1a040fd590 0x7f1a0410d420 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f19f400b790 tx=0x7f19f40091d0 comp rx=0 tx=0).stop 2024-08-18T22:44:54.385 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:54.384+0000 7f1a0b947640 1 -- 172.21.15.121:0/89278821 shutdown_connections 2024-08-18T22:44:54.385 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:54.384+0000 7f1a0b947640 1 --2- 172.21.15.121:0/89278821 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f19f006e1e0 0x7f19f0070690 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:44:54.386 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:54.384+0000 7f1a0b947640 1 --2- 172.21.15.121:0/89278821 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1a040fd590 0x7f1a0410d420 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:44:54.386 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:54.384+0000 7f1a0b947640 1 --2- 172.21.15.121:0/89278821 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1a040fc2c0 0x7f1a0410cee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:44:54.386 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:54.384+0000 7f1a0b947640 1 -- 172.21.15.121:0/89278821 >> 172.21.15.121:0/89278821 conn(0x7f1a040f7a80 msgr2=0x7f1a040f9220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:44:54.386 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:54.384+0000 7f1a0b947640 1 -- 172.21.15.121:0/89278821 shutdown_connections 2024-08-18T22:44:54.386 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:54.384+0000 7f1a0b947640 1 -- 172.21.15.121:0/89278821 wait complete. 2024-08-18T22:44:54.463 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:54.461+0000 7fe47198c640 1 -- 172.21.15.121:0/690505846 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe46c0fb1d0 msgr2=0x7fe46c0fb5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:44:54.463 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:54.461+0000 7fe47198c640 1 --2- 172.21.15.121:0/690505846 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe46c0fb1d0 0x7fe46c0fb5e0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fe464009c50 tx=0x7fe464004d10 comp rx=0 tx=0).stop 2024-08-18T22:44:54.463 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:54.461+0000 7fe47198c640 1 -- 172.21.15.121:0/690505846 shutdown_connections 2024-08-18T22:44:54.463 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:54.461+0000 7fe47198c640 1 --2- 172.21.15.121:0/690505846 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe46c0fc4a0 0x7fe46c0fc910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:44:54.463 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:54.461+0000 7fe47198c640 1 --2- 172.21.15.121:0/690505846 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe46c0fb1d0 0x7fe46c0fb5e0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:44:54.463 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:54.461+0000 7fe47198c640 1 -- 172.21.15.121:0/690505846 >> 172.21.15.121:0/690505846 conn(0x7fe46c0f69b0 msgr2=0x7fe46c0f8dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:44:54.463 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:54.461+0000 7fe47198c640 1 -- 172.21.15.121:0/690505846 shutdown_connections 2024-08-18T22:44:54.463 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:54.461+0000 7fe47198c640 1 -- 172.21.15.121:0/690505846 wait complete. 2024-08-18T22:44:54.465 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:54.462+0000 7fe47198c640 1 Processor -- start 2024-08-18T22:44:54.465 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:54.462+0000 7fe47198c640 1 -- start start 2024-08-18T22:44:54.465 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:54.462+0000 7fe47198c640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe46c0fb1d0 0x7fe46c10fb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:44:54.465 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:54.462+0000 7fe47198c640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe46c0fc4a0 0x7fe46c112050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:44:54.465 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:54.462+0000 7fe47198c640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe46c065a60 con 0x7fe46c0fb1d0 2024-08-18T22:44:54.465 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:54.462+0000 7fe47198c640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe46c065bd0 con 0x7fe46c0fc4a0 2024-08-18T22:44:54.465 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:54.463+0000 7fe46affd640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe46c0fb1d0 0x7fe46c10fb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:44:54.465 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:54.463+0000 7fe46affd640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe46c0fb1d0 0x7fe46c10fb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:60846/0 (socket says 172.21.15.121:60846) 2024-08-18T22:44:54.465 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:54.463+0000 7fe46affd640 1 -- 172.21.15.121:0/3577513391 learned_addr learned my addr 172.21.15.121:0/3577513391 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-18T22:44:54.465 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:54.463+0000 7fe46a7fc640 1 --2- 172.21.15.121:0/3577513391 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe46c0fc4a0 0x7fe46c112050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:44:54.466 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:54.463+0000 7fe46affd640 1 -- 172.21.15.121:0/3577513391 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe46c0fc4a0 msgr2=0x7fe46c112050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:44:54.466 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:54.463+0000 7fe46affd640 1 --2- 172.21.15.121:0/3577513391 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe46c0fc4a0 0x7fe46c112050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:44:54.466 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:54.463+0000 7fe46affd640 1 -- 172.21.15.121:0/3577513391 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4640098b0 con 0x7fe46c0fb1d0 2024-08-18T22:44:54.466 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:54.463+0000 7fe46a7fc640 1 --2- 172.21.15.121:0/3577513391 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe46c0fc4a0 0x7fe46c112050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:44:54.466 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:54.463+0000 7fe46affd640 1 --2- 172.21.15.121:0/3577513391 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe46c0fb1d0 0x7fe46c10fb00 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fe464004a30 tx=0x7fe464004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:44:54.466 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:54.463+0000 7fe4637fe640 1 -- 172.21.15.121:0/3577513391 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe464009710 con 0x7fe46c0fb1d0 2024-08-18T22:44:54.466 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:54.463+0000 7fe4637fe640 1 -- 172.21.15.121:0/3577513391 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fe464032b10 con 0x7fe46c0fb1d0 2024-08-18T22:44:54.466 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:54.463+0000 7fe47198c640 1 -- 172.21.15.121:0/3577513391 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe46c1125f0 con 0x7fe46c0fb1d0 2024-08-18T22:44:54.466 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:54.463+0000 7fe4637fe640 1 -- 172.21.15.121:0/3577513391 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe46403db10 con 0x7fe46c0fb1d0 2024-08-18T22:44:54.466 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:54.464+0000 7fe47198c640 1 -- 172.21.15.121:0/3577513391 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe46c112b60 con 0x7fe46c0fb1d0 2024-08-18T22:44:54.467 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:54.464+0000 7fe47198c640 1 -- 172.21.15.121:0/3577513391 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe46c0fa630 con 0x7fe46c0fb1d0 2024-08-18T22:44:54.467 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:54.465+0000 7fe4637fe640 1 -- 172.21.15.121:0/3577513391 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 36) v1 ==== 92307+0+0 (secure 0 0 0) 0x7fe46402f030 con 0x7fe46c0fb1d0 2024-08-18T22:44:54.467 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:54.465+0000 7fe4637fe640 1 --2- 172.21.15.121:0/3577513391 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7fe45806e1e0 0x7fe458070690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:44:54.467 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:54.465+0000 7fe4637fe640 1 -- 172.21.15.121:0/3577513391 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6496+0+0 (secure 0 0 0) 0x7fe4640af580 con 0x7fe46c0fb1d0 2024-08-18T22:44:54.468 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:54.465+0000 7fe46a7fc640 1 --2- 172.21.15.121:0/3577513391 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7fe45806e1e0 0x7fe458070690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:44:54.468 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:54.466+0000 7fe46a7fc640 1 --2- 172.21.15.121:0/3577513391 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7fe45806e1e0 0x7fe458070690 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fe454007fd0 tx=0x7fe454009e90 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:44:54.470 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:54.469+0000 7fe4637fe640 1 -- 172.21.15.121:0/3577513391 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7fe464078690 con 0x7fe46c0fb1d0 2024-08-18T22:44:54.749 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:54.748+0000 7fe47198c640 1 -- 172.21.15.121:0/3577513391 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fe46c04b4c0 con 0x7fe46c0fb1d0 2024-08-18T22:44:54.750 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:44:54 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:44:54.750 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:44:54 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-18T22:44:54.750 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:54.749+0000 7fe4637fe640 1 -- 172.21.15.121:0/3577513391 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+735 (secure 0 0 0) 0x7fe46407bd50 con 0x7fe46c0fb1d0 2024-08-18T22:44:54.750 INFO:teuthology.orchestra.run.smithi121.stdout:{ 2024-08-18T22:44:54.751 INFO:teuthology.orchestra.run.smithi121.stdout: "mon": { 2024-08-18T22:44:54.751 INFO:teuthology.orchestra.run.smithi121.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 2 2024-08-18T22:44:54.751 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-18T22:44:54.751 INFO:teuthology.orchestra.run.smithi121.stdout: "mgr": { 2024-08-18T22:44:54.751 INFO:teuthology.orchestra.run.smithi121.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 2 2024-08-18T22:44:54.751 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-18T22:44:54.751 INFO:teuthology.orchestra.run.smithi121.stdout: "osd": { 2024-08-18T22:44:54.751 INFO:teuthology.orchestra.run.smithi121.stdout: "ceph version 17.2.7-1406-gdf62bdcc (df62bdccd9a13bf566b27a250eddfdd89be3072d) quincy (stable)": 5 2024-08-18T22:44:54.751 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-18T22:44:54.751 INFO:teuthology.orchestra.run.smithi121.stdout: "mds": { 2024-08-18T22:44:54.751 INFO:teuthology.orchestra.run.smithi121.stdout: "ceph version 17.2.7-1406-gdf62bdcc (df62bdccd9a13bf566b27a250eddfdd89be3072d) quincy (stable)": 4 2024-08-18T22:44:54.751 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-18T22:44:54.751 INFO:teuthology.orchestra.run.smithi121.stdout: "overall": { 2024-08-18T22:44:54.752 INFO:teuthology.orchestra.run.smithi121.stdout: "ceph version 17.2.7-1406-gdf62bdcc (df62bdccd9a13bf566b27a250eddfdd89be3072d) quincy (stable)": 9, 2024-08-18T22:44:54.752 INFO:teuthology.orchestra.run.smithi121.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 4 2024-08-18T22:44:54.752 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-08-18T22:44:54.752 INFO:teuthology.orchestra.run.smithi121.stdout:} 2024-08-18T22:44:54.752 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:54.751+0000 7fe47198c640 1 -- 172.21.15.121:0/3577513391 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7fe45806e1e0 msgr2=0x7fe458070690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:44:54.752 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:54.751+0000 7fe47198c640 1 --2- 172.21.15.121:0/3577513391 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7fe45806e1e0 0x7fe458070690 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fe454007fd0 tx=0x7fe454009e90 comp rx=0 tx=0).stop 2024-08-18T22:44:54.753 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:54.751+0000 7fe47198c640 1 -- 172.21.15.121:0/3577513391 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe46c0fb1d0 msgr2=0x7fe46c10fb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:44:54.753 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:54.751+0000 7fe47198c640 1 --2- 172.21.15.121:0/3577513391 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe46c0fb1d0 0x7fe46c10fb00 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fe464004a30 tx=0x7fe464004d10 comp rx=0 tx=0).stop 2024-08-18T22:44:54.753 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:54.751+0000 7fe47198c640 1 -- 172.21.15.121:0/3577513391 shutdown_connections 2024-08-18T22:44:54.753 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:54.751+0000 7fe47198c640 1 --2- 172.21.15.121:0/3577513391 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7fe45806e1e0 0x7fe458070690 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:44:54.753 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:54.751+0000 7fe47198c640 1 --2- 172.21.15.121:0/3577513391 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe46c0fc4a0 0x7fe46c112050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:44:54.753 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:54.751+0000 7fe47198c640 1 --2- 172.21.15.121:0/3577513391 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe46c0fb1d0 0x7fe46c10fb00 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:44:54.753 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:54.751+0000 7fe47198c640 1 -- 172.21.15.121:0/3577513391 >> 172.21.15.121:0/3577513391 conn(0x7fe46c0f69b0 msgr2=0x7fe46c0f8180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:44:54.753 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:54.751+0000 7fe47198c640 1 -- 172.21.15.121:0/3577513391 shutdown_connections 2024-08-18T22:44:54.753 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:54.751+0000 7fe47198c640 1 -- 172.21.15.121:0/3577513391 wait complete. 2024-08-18T22:44:54.835 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:54.832+0000 7fbec895b640 1 -- 172.21.15.121:0/3869068824 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbec40fc4a0 msgr2=0x7fbec40fc910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:44:54.835 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:54.832+0000 7fbec895b640 1 --2- 172.21.15.121:0/3869068824 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbec40fc4a0 0x7fbec40fc910 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fbeac0048d0 tx=0x7fbeac009da0 comp rx=0 tx=0).stop 2024-08-18T22:44:54.835 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:54.832+0000 7fbec895b640 1 -- 172.21.15.121:0/3869068824 shutdown_connections 2024-08-18T22:44:54.835 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:54.832+0000 7fbec895b640 1 --2- 172.21.15.121:0/3869068824 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbec40fc4a0 0x7fbec40fc910 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:44:54.835 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:54.832+0000 7fbec895b640 1 --2- 172.21.15.121:0/3869068824 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbec40fb1d0 0x7fbec40fb5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:44:54.835 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:54.832+0000 7fbec895b640 1 -- 172.21.15.121:0/3869068824 >> 172.21.15.121:0/3869068824 conn(0x7fbec40f69b0 msgr2=0x7fbec40f8dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:44:54.835 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:54.832+0000 7fbec895b640 1 -- 172.21.15.121:0/3869068824 shutdown_connections 2024-08-18T22:44:54.835 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:54.832+0000 7fbec895b640 1 -- 172.21.15.121:0/3869068824 wait complete. 2024-08-18T22:44:54.835 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:54.833+0000 7fbec895b640 1 Processor -- start 2024-08-18T22:44:54.835 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:54.833+0000 7fbec895b640 1 -- start start 2024-08-18T22:44:54.836 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:54.833+0000 7fbec895b640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbec40fb1d0 0x7fbec410fb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:44:54.836 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:54.833+0000 7fbec895b640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbec40fc4a0 0x7fbec4112090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:44:54.836 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:54.833+0000 7fbec895b640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbec4065a20 con 0x7fbec40fc4a0 2024-08-18T22:44:54.836 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:54.833+0000 7fbec895b640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbec4065b90 con 0x7fbec40fb1d0 2024-08-18T22:44:54.836 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:54.833+0000 7fbebbfff640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbec40fc4a0 0x7fbec4112090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:44:54.836 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:54.833+0000 7fbebbfff640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbec40fc4a0 0x7fbec4112090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:60864/0 (socket says 172.21.15.121:60864) 2024-08-18T22:44:54.836 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:54.833+0000 7fbebbfff640 1 -- 172.21.15.121:0/662360687 learned_addr learned my addr 172.21.15.121:0/662360687 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-18T22:44:54.836 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:54.833+0000 7fbec259c640 1 --2- 172.21.15.121:0/662360687 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbec40fb1d0 0x7fbec410fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:44:54.836 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:54.833+0000 7fbebbfff640 1 -- 172.21.15.121:0/662360687 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbec40fb1d0 msgr2=0x7fbec410fb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:44:54.836 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:54.833+0000 7fbebbfff640 1 --2- 172.21.15.121:0/662360687 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbec40fb1d0 0x7fbec410fb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:44:54.836 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:54.833+0000 7fbebbfff640 1 -- 172.21.15.121:0/662360687 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbeac005040 con 0x7fbec40fc4a0 2024-08-18T22:44:54.837 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:54.834+0000 7fbebbfff640 1 --2- 172.21.15.121:0/662360687 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbec40fc4a0 0x7fbec4112090 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fbeac0043d0 tx=0x7fbeac009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:44:54.837 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:54.834+0000 7fbebaffd640 1 -- 172.21.15.121:0/662360687 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbeac038070 con 0x7fbec40fc4a0 2024-08-18T22:44:54.837 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:54.834+0000 7fbec895b640 1 -- 172.21.15.121:0/662360687 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbec41125d0 con 0x7fbec40fc4a0 2024-08-18T22:44:54.837 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:54.834+0000 7fbebaffd640 1 -- 172.21.15.121:0/662360687 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fbeac02ae90 con 0x7fbec40fc4a0 2024-08-18T22:44:54.837 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:54.835+0000 7fbebaffd640 1 -- 172.21.15.121:0/662360687 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbeac03e670 con 0x7fbec40fc4a0 2024-08-18T22:44:54.837 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:54.835+0000 7fbec895b640 1 -- 172.21.15.121:0/662360687 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbec4112b70 con 0x7fbec40fc4a0 2024-08-18T22:44:54.838 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:54.836+0000 7fbec895b640 1 -- 172.21.15.121:0/662360687 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbec40fa630 con 0x7fbec40fc4a0 2024-08-18T22:44:54.838 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:54.836+0000 7fbebaffd640 1 -- 172.21.15.121:0/662360687 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 36) v1 ==== 92307+0+0 (secure 0 0 0) 0x7fbeac030020 con 0x7fbec40fc4a0 2024-08-18T22:44:54.838 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:54.836+0000 7fbebaffd640 1 --2- 172.21.15.121:0/662360687 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7fbeb006e1e0 0x7fbeb0070690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:44:54.838 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:54.837+0000 7fbebaffd640 1 -- 172.21.15.121:0/662360687 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6496+0+0 (secure 0 0 0) 0x7fbeac0ad810 con 0x7fbec40fc4a0 2024-08-18T22:44:54.838 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:54.837+0000 7fbec259c640 1 --2- 172.21.15.121:0/662360687 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7fbeb006e1e0 0x7fbeb0070690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:44:54.838 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:54.837+0000 7fbec259c640 1 --2- 172.21.15.121:0/662360687 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7fbeb006e1e0 0x7fbeb0070690 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fbec4065710 tx=0x7fbeb400b040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:44:54.842 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:54.841+0000 7fbebaffd640 1 -- 172.21.15.121:0/662360687 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7fbeac076ae0 con 0x7fbec40fc4a0 2024-08-18T22:44:54.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:44:54 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:44:54.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:44:54 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-18T22:44:55.061 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:55.059+0000 7fbec895b640 1 -- 172.21.15.121:0/662360687 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fbec4103bf0 con 0x7fbec40fc4a0 2024-08-18T22:44:55.061 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:55.059+0000 7fbebaffd640 1 -- 172.21.15.121:0/662360687 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 20 v20) v1 ==== 76+0+1976 (secure 0 0 0) 0x7fbeac07a1a0 con 0x7fbec40fc4a0 2024-08-18T22:44:55.061 INFO:teuthology.orchestra.run.smithi121.stdout:e20 2024-08-18T22:44:55.062 INFO:teuthology.orchestra.run.smithi121.stdout:btime 2024-08-18T22:44:31:584746+0000 2024-08-18T22:44:55.062 INFO:teuthology.orchestra.run.smithi121.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-08-18T22:44:55.062 INFO:teuthology.orchestra.run.smithi121.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-08-18T22:44:55.062 INFO:teuthology.orchestra.run.smithi121.stdout:legacy client fscid: 1 2024-08-18T22:44:55.062 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-08-18T22:44:55.062 INFO:teuthology.orchestra.run.smithi121.stdout:Filesystem 'cephfs' (1) 2024-08-18T22:44:55.063 INFO:teuthology.orchestra.run.smithi121.stdout:fs_name cephfs 2024-08-18T22:44:55.063 INFO:teuthology.orchestra.run.smithi121.stdout:epoch 20 2024-08-18T22:44:55.063 INFO:teuthology.orchestra.run.smithi121.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-08-18T22:44:55.063 INFO:teuthology.orchestra.run.smithi121.stdout:created 2024-08-18T22:39:04.054074+0000 2024-08-18T22:44:55.063 INFO:teuthology.orchestra.run.smithi121.stdout:modified 2024-08-18T22:44:31.584739+0000 2024-08-18T22:44:55.063 INFO:teuthology.orchestra.run.smithi121.stdout:tableserver 0 2024-08-18T22:44:55.064 INFO:teuthology.orchestra.run.smithi121.stdout:root 0 2024-08-18T22:44:55.064 INFO:teuthology.orchestra.run.smithi121.stdout:session_timeout 60 2024-08-18T22:44:55.064 INFO:teuthology.orchestra.run.smithi121.stdout:session_autoclose 300 2024-08-18T22:44:55.064 INFO:teuthology.orchestra.run.smithi121.stdout:max_file_size 1099511627776 2024-08-18T22:44:55.064 INFO:teuthology.orchestra.run.smithi121.stdout:max_xattr_size 65536 2024-08-18T22:44:55.064 INFO:teuthology.orchestra.run.smithi121.stdout:required_client_features {} 2024-08-18T22:44:55.064 INFO:teuthology.orchestra.run.smithi121.stdout:last_failure 0 2024-08-18T22:44:55.065 INFO:teuthology.orchestra.run.smithi121.stdout:last_failure_osd_epoch 47 2024-08-18T22:44:55.065 INFO:teuthology.orchestra.run.smithi121.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-08-18T22:44:55.065 INFO:teuthology.orchestra.run.smithi121.stdout:max_mds 2 2024-08-18T22:44:55.065 INFO:teuthology.orchestra.run.smithi121.stdout:in 0,1 2024-08-18T22:44:55.065 INFO:teuthology.orchestra.run.smithi121.stdout:up {0=14474,1=24249} 2024-08-18T22:44:55.065 INFO:teuthology.orchestra.run.smithi121.stdout:failed 2024-08-18T22:44:55.066 INFO:teuthology.orchestra.run.smithi121.stdout:damaged 2024-08-18T22:44:55.066 INFO:teuthology.orchestra.run.smithi121.stdout:stopped 2024-08-18T22:44:55.066 INFO:teuthology.orchestra.run.smithi121.stdout:data_pools [3] 2024-08-18T22:44:55.066 INFO:teuthology.orchestra.run.smithi121.stdout:metadata_pool 2 2024-08-18T22:44:55.066 INFO:teuthology.orchestra.run.smithi121.stdout:inline_data disabled 2024-08-18T22:44:55.066 INFO:teuthology.orchestra.run.smithi121.stdout:balancer 2024-08-18T22:44:55.066 INFO:teuthology.orchestra.run.smithi121.stdout:bal_rank_mask -1 2024-08-18T22:44:55.067 INFO:teuthology.orchestra.run.smithi121.stdout:standby_count_wanted 1 2024-08-18T22:44:55.067 INFO:teuthology.orchestra.run.smithi121.stdout:qdb_cluster leader: 14474 members: 14474,24249 2024-08-18T22:44:55.067 INFO:teuthology.orchestra.run.smithi121.stdout:[mds.cephfs.smithi121.gbickb{0:14474} state up:active seq 83 export targets 1 join_fscid=1 addr [v2:172.21.15.121:6828/2277706406,v1:172.21.15.121:6829/2277706406] compat {c=[1],r=[1],i=[7ff]}] 2024-08-18T22:44:55.067 INFO:teuthology.orchestra.run.smithi121.stdout:[mds.cephfs.smithi195.buqvbr{1:24249} state up:active seq 4 export targets 0 join_fscid=1 addr [v2:172.21.15.195:6824/2414511859,v1:172.21.15.195:6825/2414511859] compat {c=[1],r=[1],i=[7ff]}] 2024-08-18T22:44:55.067 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-08-18T22:44:55.067 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-08-18T22:44:55.067 INFO:teuthology.orchestra.run.smithi121.stdout:Standby daemons: 2024-08-18T22:44:55.067 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-08-18T22:44:55.068 INFO:teuthology.orchestra.run.smithi121.stdout:[mds.cephfs.smithi121.xuzsdg{-1:14490} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.121:6826/91588128,v1:172.21.15.121:6827/91588128] compat {c=[1],r=[1],i=[7ff]}] 2024-08-18T22:44:55.068 INFO:teuthology.orchestra.run.smithi121.stdout:[mds.cephfs.smithi195.nptgyc{-1:24259} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.195:6826/238549847,v1:172.21.15.195:6827/238549847] compat {c=[1],r=[1],i=[7ff]}] 2024-08-18T22:44:55.069 INFO:teuthology.orchestra.run.smithi121.stderr:dumped fsmap epoch 20 2024-08-18T22:44:55.069 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:55.062+0000 7fbec895b640 1 -- 172.21.15.121:0/662360687 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7fbeb006e1e0 msgr2=0x7fbeb0070690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:44:55.069 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:55.062+0000 7fbec895b640 1 --2- 172.21.15.121:0/662360687 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7fbeb006e1e0 0x7fbeb0070690 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fbec4065710 tx=0x7fbeb400b040 comp rx=0 tx=0).stop 2024-08-18T22:44:55.069 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:55.062+0000 7fbec895b640 1 -- 172.21.15.121:0/662360687 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbec40fc4a0 msgr2=0x7fbec4112090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:44:55.069 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:55.062+0000 7fbec895b640 1 --2- 172.21.15.121:0/662360687 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbec40fc4a0 0x7fbec4112090 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fbeac0043d0 tx=0x7fbeac009da0 comp rx=0 tx=0).stop 2024-08-18T22:44:55.070 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:55.062+0000 7fbec895b640 1 -- 172.21.15.121:0/662360687 shutdown_connections 2024-08-18T22:44:55.071 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:55.062+0000 7fbec895b640 1 --2- 172.21.15.121:0/662360687 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7fbeb006e1e0 0x7fbeb0070690 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:44:55.071 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:55.062+0000 7fbec895b640 1 --2- 172.21.15.121:0/662360687 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbec40fc4a0 0x7fbec4112090 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:44:55.071 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:55.062+0000 7fbec895b640 1 --2- 172.21.15.121:0/662360687 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbec40fb1d0 0x7fbec410fb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:44:55.071 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:55.062+0000 7fbec895b640 1 -- 172.21.15.121:0/662360687 >> 172.21.15.121:0/662360687 conn(0x7fbec40f69b0 msgr2=0x7fbec40f8190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:44:55.071 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:55.062+0000 7fbec895b640 1 -- 172.21.15.121:0/662360687 shutdown_connections 2024-08-18T22:44:55.071 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:55.062+0000 7fbec895b640 1 -- 172.21.15.121:0/662360687 wait complete. 2024-08-18T22:44:55.160 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:55.157+0000 7f83e2c88640 1 -- 172.21.15.121:0/2231457502 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f83dc0ff4a0 msgr2=0x7f83dc101880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:44:55.160 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:55.157+0000 7f83e2c88640 1 --2- 172.21.15.121:0/2231457502 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f83dc0ff4a0 0x7f83dc101880 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f83c80048d0 tx=0x7f83c8009da0 comp rx=0 tx=0).stop 2024-08-18T22:44:55.160 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:55.157+0000 7f83e2c88640 1 -- 172.21.15.121:0/2231457502 shutdown_connections 2024-08-18T22:44:55.160 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:55.157+0000 7f83e2c88640 1 --2- 172.21.15.121:0/2231457502 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f83dc0ff4a0 0x7f83dc101880 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:44:55.160 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:55.157+0000 7f83e2c88640 1 --2- 172.21.15.121:0/2231457502 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f83dc065960 0x7f83dc0fef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:44:55.161 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:55.157+0000 7f83e2c88640 1 -- 172.21.15.121:0/2231457502 >> 172.21.15.121:0/2231457502 conn(0x7f83dc0f69b0 msgr2=0x7f83dc0f8dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:44:55.161 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:55.157+0000 7f83e2c88640 1 -- 172.21.15.121:0/2231457502 shutdown_connections 2024-08-18T22:44:55.161 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:55.157+0000 7f83e2c88640 1 -- 172.21.15.121:0/2231457502 wait complete. 2024-08-18T22:44:55.161 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:55.158+0000 7f83e2c88640 1 Processor -- start 2024-08-18T22:44:55.161 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:55.158+0000 7f83e2c88640 1 -- start start 2024-08-18T22:44:55.161 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:55.158+0000 7f83e2c88640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f83dc065960 0x7f83dc10ce90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:44:55.161 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:55.158+0000 7f83e2c88640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f83dc0ff4a0 0x7f83dc10d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:44:55.161 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:55.158+0000 7f83e2c88640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83dc10da20 con 0x7f83dc0ff4a0 2024-08-18T22:44:55.161 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:55.158+0000 7f83e2c88640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83dc10e160 con 0x7f83dc065960 2024-08-18T22:44:55.161 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:55.158+0000 7f83dbfff640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f83dc0ff4a0 0x7f83dc10d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:44:55.161 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:55.158+0000 7f83dbfff640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f83dc0ff4a0 0x7f83dc10d3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:60876/0 (socket says 172.21.15.121:60876) 2024-08-18T22:44:55.161 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:55.158+0000 7f83dbfff640 1 -- 172.21.15.121:0/2688699701 learned_addr learned my addr 172.21.15.121:0/2688699701 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-18T22:44:55.161 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:55.159+0000 7f83e0a24640 1 --2- 172.21.15.121:0/2688699701 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f83dc065960 0x7f83dc10ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:44:55.161 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:55.159+0000 7f83dbfff640 1 -- 172.21.15.121:0/2688699701 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f83dc065960 msgr2=0x7f83dc10ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:44:55.162 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:55.159+0000 7f83dbfff640 1 --2- 172.21.15.121:0/2688699701 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f83dc065960 0x7f83dc10ce90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:44:55.162 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:55.159+0000 7f83dbfff640 1 -- 172.21.15.121:0/2688699701 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83c8005040 con 0x7f83dc0ff4a0 2024-08-18T22:44:55.162 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:55.159+0000 7f83e0a24640 1 --2- 172.21.15.121:0/2688699701 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f83dc065960 0x7f83dc10ce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:44:55.162 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:55.159+0000 7f83dbfff640 1 --2- 172.21.15.121:0/2688699701 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f83dc0ff4a0 0x7f83dc10d3d0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f83c80043d0 tx=0x7f83c8009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:44:55.162 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:55.159+0000 7f83d97fa640 1 -- 172.21.15.121:0/2688699701 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f83c8038070 con 0x7f83dc0ff4a0 2024-08-18T22:44:55.162 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:55.159+0000 7f83d97fa640 1 -- 172.21.15.121:0/2688699701 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f83c802ae90 con 0x7f83dc0ff4a0 2024-08-18T22:44:55.162 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:55.159+0000 7f83d97fa640 1 -- 172.21.15.121:0/2688699701 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f83c803e670 con 0x7f83dc0ff4a0 2024-08-18T22:44:55.162 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:55.159+0000 7f83e2c88640 1 -- 172.21.15.121:0/2688699701 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83dc10e390 con 0x7f83dc0ff4a0 2024-08-18T22:44:55.162 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:55.159+0000 7f83e2c88640 1 -- 172.21.15.121:0/2688699701 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83dc10e8e0 con 0x7f83dc0ff4a0 2024-08-18T22:44:55.163 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:55.160+0000 7f83e2c88640 1 -- 172.21.15.121:0/2688699701 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83dc0fa630 con 0x7f83dc0ff4a0 2024-08-18T22:44:55.163 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:55.161+0000 7f83d97fa640 1 -- 172.21.15.121:0/2688699701 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 36) v1 ==== 92307+0+0 (secure 0 0 0) 0x7f83c8030020 con 0x7f83dc0ff4a0 2024-08-18T22:44:55.163 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:55.161+0000 7f83d97fa640 1 --2- 172.21.15.121:0/2688699701 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f83cc06e1e0 0x7f83cc070690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:44:55.163 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:55.161+0000 7f83d97fa640 1 -- 172.21.15.121:0/2688699701 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f83c80adf30 con 0x7f83dc0ff4a0 2024-08-18T22:44:55.163 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:55.161+0000 7f83e0a24640 1 --2- 172.21.15.121:0/2688699701 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f83cc06e1e0 0x7f83cc070690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:44:55.163 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:55.162+0000 7f83e0a24640 1 --2- 172.21.15.121:0/2688699701 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f83cc06e1e0 0x7f83cc070690 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f83dc10cc20 tx=0x7f83d000b040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:44:55.166 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:55.165+0000 7f83d97fa640 1 -- 172.21.15.121:0/2688699701 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f83c8077150 con 0x7f83dc0ff4a0 2024-08-18T22:44:55.355 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:55.354+0000 7f83e2c88640 1 -- 172.21.15.121:0/2688699701 --> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f83dc10ed40 con 0x7f83cc06e1e0 2024-08-18T22:44:55.359 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:55.356+0000 7f83d97fa640 1 -- 172.21.15.121:0/2688699701 <== mgr.34102 v2:172.21.15.121:6800/3037387239 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f83dc10ed40 con 0x7f83cc06e1e0 2024-08-18T22:44:55.359 INFO:teuthology.orchestra.run.smithi121.stdout:{ 2024-08-18T22:44:55.359 INFO:teuthology.orchestra.run.smithi121.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9", 2024-08-18T22:44:55.359 INFO:teuthology.orchestra.run.smithi121.stdout: "in_progress": true, 2024-08-18T22:44:55.359 INFO:teuthology.orchestra.run.smithi121.stdout: "which": "Upgrading all daemon types on all hosts", 2024-08-18T22:44:55.359 INFO:teuthology.orchestra.run.smithi121.stdout: "services_complete": [ 2024-08-18T22:44:55.360 INFO:teuthology.orchestra.run.smithi121.stdout: "mgr", 2024-08-18T22:44:55.360 INFO:teuthology.orchestra.run.smithi121.stdout: "mon", 2024-08-18T22:44:55.360 INFO:teuthology.orchestra.run.smithi121.stdout: "crash" 2024-08-18T22:44:55.360 INFO:teuthology.orchestra.run.smithi121.stdout: ], 2024-08-18T22:44:55.360 INFO:teuthology.orchestra.run.smithi121.stdout: "progress": "6/21 daemons upgraded", 2024-08-18T22:44:55.360 INFO:teuthology.orchestra.run.smithi121.stdout: "message": "Currently upgrading osd daemons", 2024-08-18T22:44:55.360 INFO:teuthology.orchestra.run.smithi121.stdout: "is_paused": false 2024-08-18T22:44:55.360 INFO:teuthology.orchestra.run.smithi121.stdout:} 2024-08-18T22:44:55.360 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:55.358+0000 7f83e2c88640 1 -- 172.21.15.121:0/2688699701 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f83cc06e1e0 msgr2=0x7f83cc070690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:44:55.361 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:55.358+0000 7f83e2c88640 1 --2- 172.21.15.121:0/2688699701 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f83cc06e1e0 0x7f83cc070690 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f83dc10cc20 tx=0x7f83d000b040 comp rx=0 tx=0).stop 2024-08-18T22:44:55.361 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:55.358+0000 7f83e2c88640 1 -- 172.21.15.121:0/2688699701 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f83dc0ff4a0 msgr2=0x7f83dc10d3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:44:55.361 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:55.358+0000 7f83e2c88640 1 --2- 172.21.15.121:0/2688699701 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f83dc0ff4a0 0x7f83dc10d3d0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f83c80043d0 tx=0x7f83c8009da0 comp rx=0 tx=0).stop 2024-08-18T22:44:55.361 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:55.358+0000 7f83e2c88640 1 -- 172.21.15.121:0/2688699701 shutdown_connections 2024-08-18T22:44:55.361 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:55.358+0000 7f83e2c88640 1 --2- 172.21.15.121:0/2688699701 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f83cc06e1e0 0x7f83cc070690 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:44:55.361 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:55.358+0000 7f83e2c88640 1 --2- 172.21.15.121:0/2688699701 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f83dc0ff4a0 0x7f83dc10d3d0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:44:55.361 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:55.358+0000 7f83e2c88640 1 --2- 172.21.15.121:0/2688699701 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f83dc065960 0x7f83dc10ce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:44:55.361 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:55.358+0000 7f83e2c88640 1 -- 172.21.15.121:0/2688699701 >> 172.21.15.121:0/2688699701 conn(0x7f83dc0f69b0 msgr2=0x7f83dc0f6d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:44:55.361 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:55.358+0000 7f83e2c88640 1 -- 172.21.15.121:0/2688699701 shutdown_connections 2024-08-18T22:44:55.361 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:55.358+0000 7f83e2c88640 1 -- 172.21.15.121:0/2688699701 wait complete. 2024-08-18T22:44:55.440 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:55.437+0000 7fc25781d640 1 -- 172.21.15.121:0/4144609349 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc2500fb1c0 msgr2=0x7fc2500fb5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:44:55.440 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:55.437+0000 7fc25781d640 1 --2- 172.21.15.121:0/4144609349 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc2500fb1c0 0x7fc2500fb5d0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fc24c0048d0 tx=0x7fc24c009da0 comp rx=0 tx=0).stop 2024-08-18T22:44:55.440 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:55.437+0000 7fc25781d640 1 -- 172.21.15.121:0/4144609349 shutdown_connections 2024-08-18T22:44:55.441 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:55.437+0000 7fc25781d640 1 --2- 172.21.15.121:0/4144609349 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc2500fc490 0x7fc2500fc900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:44:55.441 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:55.437+0000 7fc25781d640 1 --2- 172.21.15.121:0/4144609349 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc2500fb1c0 0x7fc2500fb5d0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:44:55.441 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:55.437+0000 7fc25781d640 1 -- 172.21.15.121:0/4144609349 >> 172.21.15.121:0/4144609349 conn(0x7fc2500f69a0 msgr2=0x7fc2500f8db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:44:55.441 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:55.437+0000 7fc25781d640 1 -- 172.21.15.121:0/4144609349 shutdown_connections 2024-08-18T22:44:55.441 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:55.438+0000 7fc25781d640 1 -- 172.21.15.121:0/4144609349 wait complete. 2024-08-18T22:44:55.441 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:55.438+0000 7fc25781d640 1 Processor -- start 2024-08-18T22:44:55.441 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:55.438+0000 7fc25781d640 1 -- start start 2024-08-18T22:44:55.441 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:55.438+0000 7fc25781d640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc2500fb1c0 0x7fc25010bde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:44:55.441 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:55.438+0000 7fc25781d640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc2500fc490 0x7fc25010c320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:44:55.441 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:55.438+0000 7fc25781d640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc25010c9a0 con 0x7fc2500fb1c0 2024-08-18T22:44:55.441 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:55.438+0000 7fc25781d640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc25010d110 con 0x7fc2500fc490 2024-08-18T22:44:55.441 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:55.438+0000 7fc2555b9640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc2500fb1c0 0x7fc25010bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:44:55.441 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:55.438+0000 7fc2555b9640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc2500fb1c0 0x7fc25010bde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:60894/0 (socket says 172.21.15.121:60894) 2024-08-18T22:44:55.442 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:55.438+0000 7fc2555b9640 1 -- 172.21.15.121:0/3210709945 learned_addr learned my addr 172.21.15.121:0/3210709945 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-18T22:44:55.442 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:55.439+0000 7fc254db8640 1 --2- 172.21.15.121:0/3210709945 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc2500fc490 0x7fc25010c320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:44:55.442 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:55.439+0000 7fc2555b9640 1 -- 172.21.15.121:0/3210709945 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc2500fc490 msgr2=0x7fc25010c320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:44:55.442 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:55.439+0000 7fc2555b9640 1 --2- 172.21.15.121:0/3210709945 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc2500fc490 0x7fc25010c320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:44:55.442 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:55.439+0000 7fc2555b9640 1 -- 172.21.15.121:0/3210709945 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc24c005040 con 0x7fc2500fb1c0 2024-08-18T22:44:55.442 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:55.439+0000 7fc254db8640 1 --2- 172.21.15.121:0/3210709945 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc2500fc490 0x7fc25010c320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:44:55.442 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:55.439+0000 7fc2555b9640 1 --2- 172.21.15.121:0/3210709945 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc2500fb1c0 0x7fc25010bde0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fc24c003080 tx=0x7fc24c009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:44:55.442 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:55.439+0000 7fc245ffb640 1 -- 172.21.15.121:0/3210709945 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc24c038070 con 0x7fc2500fb1c0 2024-08-18T22:44:55.442 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:55.439+0000 7fc245ffb640 1 -- 172.21.15.121:0/3210709945 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fc24c02abd0 con 0x7fc2500fb1c0 2024-08-18T22:44:55.442 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:55.439+0000 7fc245ffb640 1 -- 172.21.15.121:0/3210709945 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc24c03e670 con 0x7fc2500fb1c0 2024-08-18T22:44:55.442 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:55.439+0000 7fc25781d640 1 -- 172.21.15.121:0/3210709945 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc25010d390 con 0x7fc2500fb1c0 2024-08-18T22:44:55.442 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:55.440+0000 7fc25781d640 1 -- 172.21.15.121:0/3210709945 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc25010d7a0 con 0x7fc2500fb1c0 2024-08-18T22:44:55.444 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:55.442+0000 7fc245ffb640 1 -- 172.21.15.121:0/3210709945 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 36) v1 ==== 92307+0+0 (secure 0 0 0) 0x7fc24c030020 con 0x7fc2500fb1c0 2024-08-18T22:44:55.444 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:55.443+0000 7fc245ffb640 1 --2- 172.21.15.121:0/3210709945 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7fc23c06e230 0x7fc23c0706e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:44:55.444 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:55.443+0000 7fc245ffb640 1 -- 172.21.15.121:0/3210709945 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6496+0+0 (secure 0 0 0) 0x7fc24c0ae1d0 con 0x7fc2500fb1c0 2024-08-18T22:44:55.445 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:55.444+0000 7fc254db8640 1 --2- 172.21.15.121:0/3210709945 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7fc23c06e230 0x7fc23c0706e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:44:55.445 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:55.444+0000 7fc25781d640 1 -- 172.21.15.121:0/3210709945 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2501055d0 con 0x7fc2500fb1c0 2024-08-18T22:44:55.445 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:55.445+0000 7fc254db8640 1 --2- 172.21.15.121:0/3210709945 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7fc23c06e230 0x7fc23c0706e0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fc25010bb90 tx=0x7fc240008040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:44:55.450 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:55.449+0000 7fc245ffb640 1 -- 172.21.15.121:0/3210709945 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7fc24c077370 con 0x7fc2500fb1c0 2024-08-18T22:44:55.583 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:44:55 smithi121 ceph-mon[81053]: from='client.34190 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-18T22:44:55.583 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:44:55 smithi121 ceph-mon[81053]: from='client.34194 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-18T22:44:55.583 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:44:55 smithi121 ceph-mon[81053]: from='client.34198 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-18T22:44:55.583 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:44:55 smithi121 ceph-mon[81053]: pgmap v43: 65 pgs: 1 active+undersized, 33 active+undersized+degraded, 31 active+clean; 2.0 GiB data, 7.5 GiB used, 529 GiB / 536 GiB avail; 5064/34143 objects degraded (14.832%) 2024-08-18T22:44:55.584 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:44:55 smithi121 ceph-mon[81053]: from='client.? 172.21.15.121:0/3577513391' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-08-18T22:44:55.584 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:44:55 smithi121 ceph-mon[81053]: from='client.? 172.21.15.121:0/662360687' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-08-18T22:44:55.584 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:44:55 smithi121 ceph-mon[81053]: 3 slow requests, 0 included below; oldest blocked for > 206.867340 secs 2024-08-18T22:44:55.694 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:55.693+0000 7fc25781d640 1 -- 172.21.15.121:0/3210709945 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fc250103c40 con 0x7fc2500fb1c0 2024-08-18T22:44:55.694 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:55.693+0000 7fc245ffb640 1 -- 172.21.15.121:0/3210709945 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+2274 (secure 0 0 0) 0x7fc24c07aa30 con 0x7fc2500fb1c0 2024-08-18T22:44:55.694 INFO:teuthology.orchestra.run.smithi121.stdout:HEALTH_WARN 1 MDSs report slow requests; 1 osds down; Degraded data redundancy: 5064/34143 objects degraded (14.832%), 33 pgs degraded 2024-08-18T22:44:55.695 INFO:teuthology.orchestra.run.smithi121.stdout:[WRN] MDS_SLOW_REQUEST: 1 MDSs report slow requests 2024-08-18T22:44:55.695 INFO:teuthology.orchestra.run.smithi121.stdout: mds.cephfs.smithi121.gbickb(mds.0): 3 slow requests are blocked > 180 secs 2024-08-18T22:44:55.695 INFO:teuthology.orchestra.run.smithi121.stdout:[WRN] OSD_DOWN: 1 osds down 2024-08-18T22:44:55.695 INFO:teuthology.orchestra.run.smithi121.stdout: osd.0 (root=default,host=smithi121) is down 2024-08-18T22:44:55.695 INFO:teuthology.orchestra.run.smithi121.stdout:[WRN] PG_DEGRADED: Degraded data redundancy: 5064/34143 objects degraded (14.832%), 33 pgs degraded 2024-08-18T22:44:55.695 INFO:teuthology.orchestra.run.smithi121.stdout: pg 1.0 is active+undersized+degraded, acting [3,1] 2024-08-18T22:44:55.695 INFO:teuthology.orchestra.run.smithi121.stdout: pg 2.0 is active+undersized+degraded, acting [3,1] 2024-08-18T22:44:55.695 INFO:teuthology.orchestra.run.smithi121.stdout: pg 2.1 is active+undersized+degraded, acting [2,1] 2024-08-18T22:44:55.695 INFO:teuthology.orchestra.run.smithi121.stdout: pg 2.2 is active+undersized+degraded, acting [5,1] 2024-08-18T22:44:55.695 INFO:teuthology.orchestra.run.smithi121.stdout: pg 2.4 is active+undersized+degraded, acting [1,4] 2024-08-18T22:44:55.695 INFO:teuthology.orchestra.run.smithi121.stdout: pg 2.5 is active+undersized+degraded, acting [3,4] 2024-08-18T22:44:55.695 INFO:teuthology.orchestra.run.smithi121.stdout: pg 2.8 is active+undersized+degraded, acting [3,5] 2024-08-18T22:44:55.695 INFO:teuthology.orchestra.run.smithi121.stdout: pg 2.9 is active+undersized+degraded, acting [1,4] 2024-08-18T22:44:55.696 INFO:teuthology.orchestra.run.smithi121.stdout: pg 2.e is active+undersized+degraded, acting [2,3] 2024-08-18T22:44:55.696 INFO:teuthology.orchestra.run.smithi121.stdout: pg 2.f is active+undersized+degraded, acting [4,5] 2024-08-18T22:44:55.696 INFO:teuthology.orchestra.run.smithi121.stdout: pg 2.10 is active+undersized+degraded, acting [2,1] 2024-08-18T22:44:55.696 INFO:teuthology.orchestra.run.smithi121.stdout: pg 2.12 is active+undersized+degraded, acting [3,1] 2024-08-18T22:44:55.696 INFO:teuthology.orchestra.run.smithi121.stdout: pg 2.13 is active+undersized+degraded, acting [4,2] 2024-08-18T22:44:55.696 INFO:teuthology.orchestra.run.smithi121.stdout: pg 2.15 is active+undersized+degraded, acting [1,3] 2024-08-18T22:44:55.696 INFO:teuthology.orchestra.run.smithi121.stdout: pg 2.19 is active+undersized+degraded, acting [4,2] 2024-08-18T22:44:55.696 INFO:teuthology.orchestra.run.smithi121.stdout: pg 2.1b is active+undersized+degraded, acting [1,5] 2024-08-18T22:44:55.696 INFO:teuthology.orchestra.run.smithi121.stdout: pg 2.1d is active+undersized+degraded, acting [3,5] 2024-08-18T22:44:55.696 INFO:teuthology.orchestra.run.smithi121.stdout: pg 2.1e is active+undersized+degraded, acting [2,5] 2024-08-18T22:44:55.696 INFO:teuthology.orchestra.run.smithi121.stdout: pg 2.1f is active+undersized+degraded, acting [3,4] 2024-08-18T22:44:55.696 INFO:teuthology.orchestra.run.smithi121.stdout: pg 3.1 is active+undersized+degraded, acting [4,2] 2024-08-18T22:44:55.696 INFO:teuthology.orchestra.run.smithi121.stdout: pg 3.3 is active+undersized+degraded, acting [4,3] 2024-08-18T22:44:55.696 INFO:teuthology.orchestra.run.smithi121.stdout: pg 3.6 is active+undersized+degraded, acting [1,4] 2024-08-18T22:44:55.697 INFO:teuthology.orchestra.run.smithi121.stdout: pg 3.b is active+undersized+degraded, acting [1,4] 2024-08-18T22:44:55.697 INFO:teuthology.orchestra.run.smithi121.stdout: pg 3.c is active+undersized+degraded, acting [5,3] 2024-08-18T22:44:55.697 INFO:teuthology.orchestra.run.smithi121.stdout: pg 3.f is active+undersized+degraded, acting [5,3] 2024-08-18T22:44:55.697 INFO:teuthology.orchestra.run.smithi121.stdout: pg 3.10 is active+undersized+degraded, acting [5,1] 2024-08-18T22:44:55.697 INFO:teuthology.orchestra.run.smithi121.stdout: pg 3.11 is active+undersized+degraded, acting [3,4] 2024-08-18T22:44:55.697 INFO:teuthology.orchestra.run.smithi121.stdout: pg 3.12 is active+undersized+degraded, acting [3,1] 2024-08-18T22:44:55.697 INFO:teuthology.orchestra.run.smithi121.stdout: pg 3.15 is active+undersized+degraded, acting [3,4] 2024-08-18T22:44:55.697 INFO:teuthology.orchestra.run.smithi121.stdout: pg 3.17 is active+undersized+degraded, acting [5,2] 2024-08-18T22:44:55.697 INFO:teuthology.orchestra.run.smithi121.stdout: pg 3.18 is active+undersized+degraded, acting [2,1] 2024-08-18T22:44:55.697 INFO:teuthology.orchestra.run.smithi121.stdout: pg 3.1b is active+undersized+degraded, acting [4,3] 2024-08-18T22:44:55.697 INFO:teuthology.orchestra.run.smithi121.stdout: pg 3.1f is active+undersized+degraded, acting [3,2] 2024-08-18T22:44:55.698 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:55.696+0000 7fc25781d640 1 -- 172.21.15.121:0/3210709945 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7fc23c06e230 msgr2=0x7fc23c0706e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:44:55.698 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:55.696+0000 7fc25781d640 1 --2- 172.21.15.121:0/3210709945 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7fc23c06e230 0x7fc23c0706e0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fc25010bb90 tx=0x7fc240008040 comp rx=0 tx=0).stop 2024-08-18T22:44:55.698 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:55.696+0000 7fc25781d640 1 -- 172.21.15.121:0/3210709945 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc2500fb1c0 msgr2=0x7fc25010bde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:44:55.698 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:55.696+0000 7fc25781d640 1 --2- 172.21.15.121:0/3210709945 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc2500fb1c0 0x7fc25010bde0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fc24c003080 tx=0x7fc24c009da0 comp rx=0 tx=0).stop 2024-08-18T22:44:55.698 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:55.696+0000 7fc25781d640 1 -- 172.21.15.121:0/3210709945 shutdown_connections 2024-08-18T22:44:55.698 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:55.696+0000 7fc25781d640 1 --2- 172.21.15.121:0/3210709945 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7fc23c06e230 0x7fc23c0706e0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:44:55.698 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:55.696+0000 7fc25781d640 1 --2- 172.21.15.121:0/3210709945 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc2500fc490 0x7fc25010c320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:44:55.698 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:55.696+0000 7fc25781d640 1 --2- 172.21.15.121:0/3210709945 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc2500fb1c0 0x7fc25010bde0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:44:55.699 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:55.696+0000 7fc25781d640 1 -- 172.21.15.121:0/3210709945 >> 172.21.15.121:0/3210709945 conn(0x7fc2500f69a0 msgr2=0x7fc2500ff7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:44:55.699 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:55.696+0000 7fc25781d640 1 -- 172.21.15.121:0/3210709945 shutdown_connections 2024-08-18T22:44:55.699 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:44:55.696+0000 7fc25781d640 1 -- 172.21.15.121:0/3210709945 wait complete. 2024-08-18T22:44:55.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:44:55 smithi195 ceph-mon[68841]: from='client.34190 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-18T22:44:55.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:44:55 smithi195 ceph-mon[68841]: from='client.34194 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-18T22:44:55.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:44:55 smithi195 ceph-mon[68841]: from='client.34198 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-18T22:44:55.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:44:55 smithi195 ceph-mon[68841]: pgmap v43: 65 pgs: 1 active+undersized, 33 active+undersized+degraded, 31 active+clean; 2.0 GiB data, 7.5 GiB used, 529 GiB / 536 GiB avail; 5064/34143 objects degraded (14.832%) 2024-08-18T22:44:55.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:44:55 smithi195 ceph-mon[68841]: from='client.? 172.21.15.121:0/3577513391' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-08-18T22:44:55.910 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:44:55 smithi195 ceph-mon[68841]: from='client.? 172.21.15.121:0/662360687' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-08-18T22:44:55.910 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:44:55 smithi195 ceph-mon[68841]: 3 slow requests, 0 included below; oldest blocked for > 206.867340 secs 2024-08-18T22:44:56.583 INFO:journalctl@ceph.osd.0.smithi121.stdout:Aug 18 22:44:56 smithi121 ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-0[89254]: 2024-08-18T22:44:56.362+0000 7fc1f996f640 -1 osd.0 50 log_to_monitors true 2024-08-18T22:44:56.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:44:56 smithi195 ceph-mon[68841]: from='client.34210 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-18T22:44:56.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:44:56 smithi195 ceph-mon[68841]: from='client.? 172.21.15.121:0/3210709945' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-08-18T22:44:56.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:44:56 smithi195 ceph-mon[68841]: from='osd.0 [v2:172.21.15.121:6802/251161776,v1:172.21.15.121:6803/251161776]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-08-18T22:44:57.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:44:56 smithi121 ceph-mon[81053]: from='client.34210 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-18T22:44:57.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:44:56 smithi121 ceph-mon[81053]: from='client.? 172.21.15.121:0/3210709945' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-08-18T22:44:57.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:44:56 smithi121 ceph-mon[81053]: from='osd.0 [v2:172.21.15.121:6802/251161776,v1:172.21.15.121:6803/251161776]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-08-18T22:44:57.833 INFO:journalctl@ceph.osd.0.smithi121.stdout:Aug 18 22:44:57 smithi121 ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-0[89254]: 2024-08-18T22:44:57.422+0000 7fc1ed701640 -1 osd.0 50 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-18T22:44:57.834 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:44:57 smithi121 ceph-mon[81053]: pgmap v44: 65 pgs: 1 active+undersized, 33 active+undersized+degraded, 31 active+clean; 2.0 GiB data, 7.5 GiB used, 529 GiB / 536 GiB avail; 5064/34143 objects degraded (14.832%) 2024-08-18T22:44:57.834 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:44:57 smithi121 ceph-mon[81053]: from='osd.0 [v2:172.21.15.121:6802/251161776,v1:172.21.15.121:6803/251161776]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-08-18T22:44:57.834 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:44:57 smithi121 ceph-mon[81053]: osdmap e53: 6 total, 5 up, 6 in 2024-08-18T22:44:57.834 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:44:57 smithi121 ceph-mon[81053]: from='osd.0 [v2:172.21.15.121:6802/251161776,v1:172.21.15.121:6803/251161776]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi121", "root=default"]}]: dispatch 2024-08-18T22:44:57.834 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:44:57 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:44:57.834 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:44:57 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:44:57.834 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:44:57 smithi121 ceph-mon[81053]: from='osd.0 [v2:172.21.15.121:6802/251161776,v1:172.21.15.121:6803/251161776]' entity='osd.0' 2024-08-18T22:44:57.834 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:44:57 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:44:57.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:44:57 smithi195 ceph-mon[68841]: pgmap v44: 65 pgs: 1 active+undersized, 33 active+undersized+degraded, 31 active+clean; 2.0 GiB data, 7.5 GiB used, 529 GiB / 536 GiB avail; 5064/34143 objects degraded (14.832%) 2024-08-18T22:44:57.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:44:57 smithi195 ceph-mon[68841]: from='osd.0 [v2:172.21.15.121:6802/251161776,v1:172.21.15.121:6803/251161776]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-08-18T22:44:57.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:44:57 smithi195 ceph-mon[68841]: osdmap e53: 6 total, 5 up, 6 in 2024-08-18T22:44:57.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:44:57 smithi195 ceph-mon[68841]: from='osd.0 [v2:172.21.15.121:6802/251161776,v1:172.21.15.121:6803/251161776]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi121", "root=default"]}]: dispatch 2024-08-18T22:44:57.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:44:57 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:44:57.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:44:57 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:44:57.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:44:57 smithi195 ceph-mon[68841]: from='osd.0 [v2:172.21.15.121:6802/251161776,v1:172.21.15.121:6803/251161776]' entity='osd.0' 2024-08-18T22:44:57.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:44:57 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:44:58.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:44:58 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:44:58.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:44:58 smithi195 ceph-mon[68841]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-08-18T22:44:58.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:44:58 smithi195 ceph-mon[68841]: osd.0 [v2:172.21.15.121:6802/251161776,v1:172.21.15.121:6803/251161776] boot 2024-08-18T22:44:58.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:44:58 smithi195 ceph-mon[68841]: osdmap e54: 6 total, 6 up, 6 in 2024-08-18T22:44:58.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:44:58 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-08-18T22:44:58.975 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:44:58 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:44:58.975 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:44:58 smithi121 ceph-mon[81053]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-08-18T22:44:58.975 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:44:58 smithi121 ceph-mon[81053]: osd.0 [v2:172.21.15.121:6802/251161776,v1:172.21.15.121:6803/251161776] boot 2024-08-18T22:44:58.976 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:44:58 smithi121 ceph-mon[81053]: osdmap e54: 6 total, 6 up, 6 in 2024-08-18T22:44:58.976 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:44:58 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-08-18T22:44:59.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:44:59 smithi195 ceph-mon[68841]: pgmap v47: 65 pgs: 1 active+undersized, 33 active+undersized+degraded, 31 active+clean; 2.0 GiB data, 7.3 GiB used, 529 GiB / 536 GiB avail; 5064/34143 objects degraded (14.832%) 2024-08-18T22:44:59.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:44:59 smithi195 ceph-mon[68841]: osdmap e55: 6 total, 6 up, 6 in 2024-08-18T22:45:00.016 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:44:59 smithi121 ceph-mon[81053]: pgmap v47: 65 pgs: 1 active+undersized, 33 active+undersized+degraded, 31 active+clean; 2.0 GiB data, 7.3 GiB used, 529 GiB / 536 GiB avail; 5064/34143 objects degraded (14.832%) 2024-08-18T22:45:00.016 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:44:59 smithi121 ceph-mon[81053]: osdmap e55: 6 total, 6 up, 6 in 2024-08-18T22:45:00.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:45:00 smithi195 ceph-mon[68841]: 3 slow requests, 0 included below; oldest blocked for > 211.867403 secs 2024-08-18T22:45:00.928 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:45:00 smithi121 ceph-mon[81053]: 3 slow requests, 0 included below; oldest blocked for > 211.867403 secs 2024-08-18T22:45:01.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:45:01 smithi195 ceph-mon[68841]: pgmap v49: 65 pgs: 9 active+undersized+degraded, 56 active+clean; 2.0 GiB data, 7.3 GiB used, 529 GiB / 536 GiB avail; 2111/34143 objects degraded (6.183%) 2024-08-18T22:45:01.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:45:01 smithi195 ceph-mon[68841]: Health check update: Degraded data redundancy: 2111/34143 objects degraded (6.183%), 9 pgs degraded (PG_DEGRADED) 2024-08-18T22:45:01.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:45:01 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:45:01.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:45:01 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:45:01.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:45:01 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:45:01.910 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:45:01 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-18T22:45:01.910 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:45:01 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:45:01.910 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:45:01 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-18T22:45:01.910 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:45:01 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "versions"}]: dispatch 2024-08-18T22:45:01.910 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:45:01 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "versions"}]: dispatch 2024-08-18T22:45:01.910 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:45:01 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "versions"}]: dispatch 2024-08-18T22:45:01.910 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:45:01 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-08-18T22:45:02.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:45:01 smithi121 ceph-mon[81053]: pgmap v49: 65 pgs: 9 active+undersized+degraded, 56 active+clean; 2.0 GiB data, 7.3 GiB used, 529 GiB / 536 GiB avail; 2111/34143 objects degraded (6.183%) 2024-08-18T22:45:02.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:45:01 smithi121 ceph-mon[81053]: Health check update: Degraded data redundancy: 2111/34143 objects degraded (6.183%), 9 pgs degraded (PG_DEGRADED) 2024-08-18T22:45:02.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:45:01 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:45:02.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:45:01 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:45:02.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:45:01 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:45:02.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:45:01 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-18T22:45:02.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:45:01 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:45:02.085 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:45:01 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-18T22:45:02.085 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:45:01 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "versions"}]: dispatch 2024-08-18T22:45:02.085 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:45:01 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "versions"}]: dispatch 2024-08-18T22:45:02.085 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:45:01 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "versions"}]: dispatch 2024-08-18T22:45:02.085 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:45:01 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-08-18T22:45:02.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:45:02 smithi195 ceph-mon[68841]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-08-18T22:45:02.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:45:02 smithi195 ceph-mon[68841]: Upgrade: unsafe to stop osd(s) at this time (2 PGs are or would become offline) 2024-08-18T22:45:03.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:45:02 smithi121 ceph-mon[81053]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-08-18T22:45:03.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:45:02 smithi121 ceph-mon[81053]: Upgrade: unsafe to stop osd(s) at this time (2 PGs are or would become offline) 2024-08-18T22:45:03.834 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:45:03 smithi121 ceph-mon[81053]: pgmap v50: 65 pgs: 65 active+clean; 2.0 GiB data, 7.3 GiB used, 529 GiB / 536 GiB avail 2024-08-18T22:45:03.834 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:45:03 smithi121 ceph-mon[81053]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 2111/34143 objects degraded (6.183%), 9 pgs degraded) 2024-08-18T22:45:03.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:45:03 smithi195 ceph-mon[68841]: pgmap v50: 65 pgs: 65 active+clean; 2.0 GiB data, 7.3 GiB used, 529 GiB / 536 GiB avail 2024-08-18T22:45:03.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:45:03 smithi195 ceph-mon[68841]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 2111/34143 objects degraded (6.183%), 9 pgs degraded) 2024-08-18T22:45:05.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:45:05 smithi195 ceph-mon[68841]: pgmap v51: 65 pgs: 65 active+clean; 2.0 GiB data, 7.3 GiB used, 529 GiB / 536 GiB avail 2024-08-18T22:45:05.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:45:05 smithi195 ceph-mon[68841]: 3 slow requests, 0 included below; oldest blocked for > 216.867502 secs 2024-08-18T22:45:06.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:45:05 smithi121 ceph-mon[81053]: pgmap v51: 65 pgs: 65 active+clean; 2.0 GiB data, 7.3 GiB used, 529 GiB / 536 GiB avail 2024-08-18T22:45:06.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:45:05 smithi121 ceph-mon[81053]: 3 slow requests, 0 included below; oldest blocked for > 216.867502 secs 2024-08-18T22:45:07.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:45:07 smithi195 ceph-mon[68841]: pgmap v52: 65 pgs: 65 active+clean; 2.0 GiB data, 7.3 GiB used, 529 GiB / 536 GiB avail 2024-08-18T22:45:08.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:45:07 smithi121 ceph-mon[81053]: pgmap v52: 65 pgs: 65 active+clean; 2.0 GiB data, 7.3 GiB used, 529 GiB / 536 GiB avail 2024-08-18T22:45:09.833 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:45:09 smithi121 ceph-mon[81053]: pgmap v53: 65 pgs: 65 active+clean; 2.0 GiB data, 7.3 GiB used, 529 GiB / 536 GiB avail 2024-08-18T22:45:09.834 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:45:09 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:45:09.834 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:45:09 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-18T22:45:09.834 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:45:09 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:45:09.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:45:09 smithi195 ceph-mon[68841]: pgmap v53: 65 pgs: 65 active+clean; 2.0 GiB data, 7.3 GiB used, 529 GiB / 536 GiB avail 2024-08-18T22:45:09.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:45:09 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:45:09.910 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:45:09 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-18T22:45:09.910 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:45:09 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:45:10.833 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:45:10 smithi121 ceph-mon[81053]: 3 slow requests, 0 included below; oldest blocked for > 221.867618 secs 2024-08-18T22:45:10.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:45:10 smithi195 ceph-mon[68841]: 3 slow requests, 0 included below; oldest blocked for > 221.867618 secs 2024-08-18T22:45:11.833 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:45:11 smithi121 ceph-mon[81053]: pgmap v54: 65 pgs: 65 active+clean; 2.0 GiB data, 7.3 GiB used, 529 GiB / 536 GiB avail; 553 B/s wr, 0 op/s 2024-08-18T22:45:11.834 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:45:11 smithi121 ceph-mon[81053]: mgrmap e37: smithi121.lopxqc(active, since 92s), standbys: smithi195.acttsj 2024-08-18T22:45:11.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:45:11 smithi195 ceph-mon[68841]: pgmap v54: 65 pgs: 65 active+clean; 2.0 GiB data, 7.3 GiB used, 529 GiB / 536 GiB avail; 553 B/s wr, 0 op/s 2024-08-18T22:45:11.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:45:11 smithi195 ceph-mon[68841]: mgrmap e37: smithi121.lopxqc(active, since 92s), standbys: smithi195.acttsj 2024-08-18T22:45:13.833 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:45:13 smithi121 ceph-mon[81053]: pgmap v55: 65 pgs: 65 active+clean; 2.0 GiB data, 7.3 GiB used, 529 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-08-18T22:45:13.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:45:13 smithi195 ceph-mon[68841]: pgmap v55: 65 pgs: 65 active+clean; 2.0 GiB data, 7.3 GiB used, 529 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-08-18T22:45:15.833 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:45:15 smithi121 ceph-mon[81053]: pgmap v56: 65 pgs: 65 active+clean; 2.0 GiB data, 7.3 GiB used, 529 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-08-18T22:45:15.833 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:45:15 smithi121 ceph-mon[81053]: 3 slow requests, 0 included below; oldest blocked for > 226.867736 secs 2024-08-18T22:45:15.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:45:15 smithi195 ceph-mon[68841]: pgmap v56: 65 pgs: 65 active+clean; 2.0 GiB data, 7.3 GiB used, 529 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-08-18T22:45:15.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:45:15 smithi195 ceph-mon[68841]: 3 slow requests, 0 included below; oldest blocked for > 226.867736 secs 2024-08-18T22:45:16.760 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:45:16 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-08-18T22:45:16.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:45:16 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-08-18T22:45:17.769 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:45:17 smithi121 ceph-mon[81053]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-08-18T22:45:17.770 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:45:17 smithi121 ceph-mon[81053]: Upgrade: osd.1 is safe to restart 2024-08-18T22:45:17.770 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:45:17 smithi121 ceph-mon[81053]: pgmap v57: 65 pgs: 65 active+clean; 2.0 GiB data, 7.3 GiB used, 529 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-08-18T22:45:17.770 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:45:17 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:45:17.770 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:45:17 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-08-18T22:45:17.770 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:45:17 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:45:17.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:45:17 smithi195 ceph-mon[68841]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-08-18T22:45:17.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:45:17 smithi195 ceph-mon[68841]: Upgrade: osd.1 is safe to restart 2024-08-18T22:45:17.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:45:17 smithi195 ceph-mon[68841]: pgmap v57: 65 pgs: 65 active+clean; 2.0 GiB data, 7.3 GiB used, 529 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-08-18T22:45:17.910 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:45:17 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:45:17.910 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:45:17 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-08-18T22:45:17.910 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:45:17 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:45:18.833 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:45:18 smithi121 ceph-mon[81053]: Upgrade: Updating osd.1 2024-08-18T22:45:18.834 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:45:18 smithi121 ceph-mon[81053]: Deploying daemon osd.1 on smithi121 2024-08-18T22:45:18.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:45:18 smithi195 ceph-mon[68841]: Upgrade: Updating osd.1 2024-08-18T22:45:18.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:45:18 smithi195 ceph-mon[68841]: Deploying daemon osd.1 on smithi121 2024-08-18T22:45:19.906 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:45:19 smithi121 ceph-mon[81053]: pgmap v58: 65 pgs: 65 active+clean; 2.0 GiB data, 7.3 GiB used, 529 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-08-18T22:45:19.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:45:19 smithi195 ceph-mon[68841]: pgmap v58: 65 pgs: 65 active+clean; 2.0 GiB data, 7.3 GiB used, 529 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-08-18T22:45:20.537 INFO:journalctl@ceph.osd.1.smithi121.stdout:Aug 18 22:45:20 smithi121 systemd[1]: Stopping Ceph osd.1 for b003123a-5db1-11ef-bccf-c7b262605968... 2024-08-18T22:45:20.833 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:45:20 smithi121 ceph-mon[81053]: 3 slow requests, 0 included below; oldest blocked for > 231.867811 secs 2024-08-18T22:45:20.834 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:45:20 smithi121 ceph-mon[81053]: osd.1 marked itself down and dead 2024-08-18T22:45:20.834 INFO:journalctl@ceph.osd.1.smithi121.stdout:Aug 18 22:45:20 smithi121 ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-1[42807]: 2024-08-18T22:45:20.535+0000 7f36cdb56640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-18T22:45:20.834 INFO:journalctl@ceph.osd.1.smithi121.stdout:Aug 18 22:45:20 smithi121 ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-1[42807]: 2024-08-18T22:45:20.535+0000 7f36cdb56640 -1 osd.1 55 *** Got signal Terminated *** 2024-08-18T22:45:20.834 INFO:journalctl@ceph.osd.1.smithi121.stdout:Aug 18 22:45:20 smithi121 ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-1[42807]: 2024-08-18T22:45:20.535+0000 7f36cdb56640 -1 osd.1 55 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-08-18T22:45:20.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:45:20 smithi195 ceph-mon[68841]: 3 slow requests, 0 included below; oldest blocked for > 231.867811 secs 2024-08-18T22:45:20.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:45:20 smithi195 ceph-mon[68841]: osd.1 marked itself down and dead 2024-08-18T22:45:21.370 INFO:journalctl@ceph.osd.1.smithi121.stdout:Aug 18 22:45:21 smithi121 podman[94142]: 2024-08-18 22:45:21.107551324 +0000 UTC m=+0.681134827 container died ef5fadfd753f454ad08af3d66a83b33aff9243fd93fc4713473d80e0741aa05d (image=quay.ceph.io/ceph-ci/ceph@sha256:bf20fb88c15fff689cf84383793d3756b4df7aceb11592a28c78dd893a0b3e7d, name=ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-1, ceph=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, io.buildah.version=1.36.0, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=quincy-df62bdc, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0) 2024-08-18T22:45:21.804 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:45:21 smithi121 ceph-mon[81053]: pgmap v59: 65 pgs: 65 active+clean; 2.0 GiB data, 7.3 GiB used, 529 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-08-18T22:45:21.804 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:45:21 smithi121 ceph-mon[81053]: Health check failed: 1 osds down (OSD_DOWN) 2024-08-18T22:45:21.804 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:45:21 smithi121 ceph-mon[81053]: fsmap cephfs:2 {0=cephfs.smithi121.gbickb=up:active,1=cephfs.smithi195.buqvbr=up:active} 2 up:standby 2024-08-18T22:45:21.804 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:45:21 smithi121 ceph-mon[81053]: osdmap e56: 6 total, 5 up, 6 in 2024-08-18T22:45:21.804 INFO:journalctl@ceph.osd.1.smithi121.stdout:Aug 18 22:45:21 smithi121 podman[94142]: 2024-08-18 22:45:21.5263844 +0000 UTC m=+1.099967892 container cleanup ef5fadfd753f454ad08af3d66a83b33aff9243fd93fc4713473d80e0741aa05d (image=quay.ceph.io/ceph-ci/ceph@sha256:bf20fb88c15fff689cf84383793d3756b4df7aceb11592a28c78dd893a0b3e7d, name=ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-1, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.36.0, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, RELEASE=quincy-df62bdc, ceph=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0) 2024-08-18T22:45:21.804 INFO:journalctl@ceph.osd.1.smithi121.stdout:Aug 18 22:45:21 smithi121 bash[94142]: ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-1 2024-08-18T22:45:21.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:45:21 smithi195 ceph-mon[68841]: pgmap v59: 65 pgs: 65 active+clean; 2.0 GiB data, 7.3 GiB used, 529 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-08-18T22:45:21.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:45:21 smithi195 ceph-mon[68841]: Health check failed: 1 osds down (OSD_DOWN) 2024-08-18T22:45:21.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:45:21 smithi195 ceph-mon[68841]: fsmap cephfs:2 {0=cephfs.smithi121.gbickb=up:active,1=cephfs.smithi195.buqvbr=up:active} 2 up:standby 2024-08-18T22:45:21.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:45:21 smithi195 ceph-mon[68841]: osdmap e56: 6 total, 5 up, 6 in 2024-08-18T22:45:22.083 INFO:journalctl@ceph.osd.1.smithi121.stdout:Aug 18 22:45:21 smithi121 podman[94160]: 2024-08-18 22:45:21.803647799 +0000 UTC m=+0.688859458 container remove ef5fadfd753f454ad08af3d66a83b33aff9243fd93fc4713473d80e0741aa05d (image=quay.ceph.io/ceph-ci/ceph@sha256:bf20fb88c15fff689cf84383793d3756b4df7aceb11592a28c78dd893a0b3e7d, name=ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-1, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, RELEASE=quincy-df62bdc, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.vendor=CentOS, ceph=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, io.buildah.version=1.36.0) 2024-08-18T22:45:22.433 INFO:journalctl@ceph.osd.1.smithi121.stdout:Aug 18 22:45:22 smithi121 podman[94247]: 2024-08-18 22:45:22.061549191 +0000 UTC m=+0.017116201 image pull ea7a5189f30bad3aca9524788e2965d2368d7ce786df09d4edcd8c3edf9cefba quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9 2024-08-18T22:45:22.433 INFO:journalctl@ceph.osd.1.smithi121.stdout:Aug 18 22:45:22 smithi121 podman[94247]: 2024-08-18 22:45:22.187946894 +0000 UTC m=+0.143513904 container create d8d62b685ebe121bbea259b8af5dfd274894b396fb568551df8ee4ec2697e977 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-1-deactivate, ceph=True, org.label-schema.build-date=20240731, RELEASE=squid-de09dd0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.36.0, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD) 2024-08-18T22:45:22.834 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:45:22 smithi121 ceph-mon[81053]: osdmap e57: 6 total, 5 up, 6 in 2024-08-18T22:45:22.834 INFO:journalctl@ceph.osd.1.smithi121.stdout:Aug 18 22:45:22 smithi121 podman[94247]: 2024-08-18 22:45:22.432473755 +0000 UTC m=+0.388040775 container init d8d62b685ebe121bbea259b8af5dfd274894b396fb568551df8ee4ec2697e977 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-1-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.36.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-de09dd0, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux ) 2024-08-18T22:45:22.834 INFO:journalctl@ceph.osd.1.smithi121.stdout:Aug 18 22:45:22 smithi121 podman[94247]: 2024-08-18 22:45:22.437273155 +0000 UTC m=+0.392840178 container start d8d62b685ebe121bbea259b8af5dfd274894b396fb568551df8ee4ec2697e977 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-1-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.36.0, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, RELEASE=squid-de09dd0) 2024-08-18T22:45:22.834 INFO:journalctl@ceph.osd.1.smithi121.stdout:Aug 18 22:45:22 smithi121 podman[94247]: 2024-08-18 22:45:22.515470322 +0000 UTC m=+0.471037347 container attach d8d62b685ebe121bbea259b8af5dfd274894b396fb568551df8ee4ec2697e977 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-1-deactivate, org.label-schema.schema-version=1.0, RELEASE=squid-de09dd0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, io.buildah.version=1.36.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2) 2024-08-18T22:45:22.834 INFO:journalctl@ceph.osd.1.smithi121.stdout:Aug 18 22:45:22 smithi121 podman[94247]: 2024-08-18 22:45:22.625978637 +0000 UTC m=+0.581545648 container died d8d62b685ebe121bbea259b8af5dfd274894b396fb568551df8ee4ec2697e977 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-1-deactivate, io.buildah.version=1.36.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, RELEASE=squid-de09dd0, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2) 2024-08-18T22:45:22.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:45:22 smithi195 ceph-mon[68841]: osdmap e57: 6 total, 5 up, 6 in 2024-08-18T22:45:23.507 INFO:journalctl@ceph.osd.1.smithi121.stdout:Aug 18 22:45:23 smithi121 podman[94270]: 2024-08-18 22:45:23.177595712 +0000 UTC m=+0.539770087 container remove d8d62b685ebe121bbea259b8af5dfd274894b396fb568551df8ee4ec2697e977 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-1-deactivate, RELEASE=squid-de09dd0, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, io.buildah.version=1.36.0, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731) 2024-08-18T22:45:23.508 INFO:journalctl@ceph.osd.1.smithi121.stdout:Aug 18 22:45:23 smithi121 systemd[1]: ceph-b003123a-5db1-11ef-bccf-c7b262605968@osd.1.service: Deactivated successfully. 2024-08-18T22:45:23.508 INFO:journalctl@ceph.osd.1.smithi121.stdout:Aug 18 22:45:23 smithi121 systemd[1]: Stopped Ceph osd.1 for b003123a-5db1-11ef-bccf-c7b262605968. 2024-08-18T22:45:23.508 INFO:journalctl@ceph.osd.1.smithi121.stdout:Aug 18 22:45:23 smithi121 systemd[1]: ceph-b003123a-5db1-11ef-bccf-c7b262605968@osd.1.service: Consumed 51.005s CPU time. 2024-08-18T22:45:23.508 INFO:journalctl@ceph.osd.1.smithi121.stdout:Aug 18 22:45:23 smithi121 systemd[1]: Starting Ceph osd.1 for b003123a-5db1-11ef-bccf-c7b262605968... 2024-08-18T22:45:23.834 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:45:23 smithi121 ceph-mon[81053]: pgmap v62: 65 pgs: 5 peering, 9 stale+active+clean, 51 active+clean; 2.0 GiB data, 7.3 GiB used, 529 GiB / 536 GiB avail 2024-08-18T22:45:23.834 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:45:23 smithi121 ceph-mon[81053]: Health check failed: Reduced data availability: 3 pgs peering (PG_AVAILABILITY) 2024-08-18T22:45:23.834 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:45:23 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:45:23.834 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:45:23 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-18T22:45:23.834 INFO:journalctl@ceph.osd.1.smithi121.stdout:Aug 18 22:45:23 smithi121 podman[94373]: 2024-08-18 22:45:23.522611549 +0000 UTC m=+0.018003537 image pull ea7a5189f30bad3aca9524788e2965d2368d7ce786df09d4edcd8c3edf9cefba quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9 2024-08-18T22:45:23.835 INFO:journalctl@ceph.osd.1.smithi121.stdout:Aug 18 22:45:23 smithi121 podman[94373]: 2024-08-18 22:45:23.620559344 +0000 UTC m=+0.115951308 container create ed22f7ffd954b8ac8d6fab0e954c2ec3b47a383c65a91812b87c611517262fda (image=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-1-activate, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.36.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, RELEASE=squid-de09dd0, maintainer=Guillaume Abrioux ) 2024-08-18T22:45:23.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:45:23 smithi195 ceph-mon[68841]: pgmap v62: 65 pgs: 5 peering, 9 stale+active+clean, 51 active+clean; 2.0 GiB data, 7.3 GiB used, 529 GiB / 536 GiB avail 2024-08-18T22:45:23.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:45:23 smithi195 ceph-mon[68841]: Health check failed: Reduced data availability: 3 pgs peering (PG_AVAILABILITY) 2024-08-18T22:45:23.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:45:23 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:45:23.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:45:23 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-18T22:45:24.113 INFO:journalctl@ceph.osd.1.smithi121.stdout:Aug 18 22:45:23 smithi121 podman[94373]: 2024-08-18 22:45:23.857827938 +0000 UTC m=+0.353219916 container init ed22f7ffd954b8ac8d6fab0e954c2ec3b47a383c65a91812b87c611517262fda (image=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-1-activate, org.label-schema.build-date=20240731, ceph=True, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, RELEASE=squid-de09dd0, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.36.0) 2024-08-18T22:45:24.113 INFO:journalctl@ceph.osd.1.smithi121.stdout:Aug 18 22:45:23 smithi121 podman[94373]: 2024-08-18 22:45:23.861111985 +0000 UTC m=+0.356503957 container start ed22f7ffd954b8ac8d6fab0e954c2ec3b47a383c65a91812b87c611517262fda (image=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-1-activate, RELEASE=squid-de09dd0, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, io.buildah.version=1.36.0, CEPH_POINT_RELEASE=, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux ) 2024-08-18T22:45:24.113 INFO:journalctl@ceph.osd.1.smithi121.stdout:Aug 18 22:45:23 smithi121 podman[94373]: 2024-08-18 22:45:23.939744246 +0000 UTC m=+0.435136216 container attach ed22f7ffd954b8ac8d6fab0e954c2ec3b47a383c65a91812b87c611517262fda (image=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-1-activate, RELEASE=squid-de09dd0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, io.buildah.version=1.36.0, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True) 2024-08-18T22:45:24.113 INFO:journalctl@ceph.osd.1.smithi121.stdout:Aug 18 22:45:23 smithi121 ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-1-activate[94387]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-08-18T22:45:24.113 INFO:journalctl@ceph.osd.1.smithi121.stdout:Aug 18 22:45:23 smithi121 bash[94373]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-08-18T22:45:24.114 INFO:journalctl@ceph.osd.1.smithi121.stdout:Aug 18 22:45:24 smithi121 ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-1-activate[94387]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-08-18T22:45:24.114 INFO:journalctl@ceph.osd.1.smithi121.stdout:Aug 18 22:45:24 smithi121 bash[94373]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-08-18T22:45:24.114 INFO:journalctl@ceph.osd.1.smithi121.stdout:Aug 18 22:45:24 smithi121 ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-1-activate[94387]: --> Failed to activate via raw: activate() takes 1 positional argument but 5 were given 2024-08-18T22:45:24.114 INFO:journalctl@ceph.osd.1.smithi121.stdout:Aug 18 22:45:24 smithi121 bash[94373]: --> Failed to activate via raw: activate() takes 1 positional argument but 5 were given 2024-08-18T22:45:24.114 INFO:journalctl@ceph.osd.1.smithi121.stdout:Aug 18 22:45:24 smithi121 ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-1-activate[94387]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-08-18T22:45:24.114 INFO:journalctl@ceph.osd.1.smithi121.stdout:Aug 18 22:45:24 smithi121 bash[94373]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-08-18T22:45:24.114 INFO:journalctl@ceph.osd.1.smithi121.stdout:Aug 18 22:45:24 smithi121 ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-1-activate[94387]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-08-18T22:45:24.114 INFO:journalctl@ceph.osd.1.smithi121.stdout:Aug 18 22:45:24 smithi121 bash[94373]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-08-18T22:45:24.114 INFO:journalctl@ceph.osd.1.smithi121.stdout:Aug 18 22:45:24 smithi121 ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-1-activate[94387]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-08-18T22:45:24.114 INFO:journalctl@ceph.osd.1.smithi121.stdout:Aug 18 22:45:24 smithi121 bash[94373]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-08-18T22:45:24.114 INFO:journalctl@ceph.osd.1.smithi121.stdout:Aug 18 22:45:24 smithi121 ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-1-activate[94387]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_3 --path /var/lib/ceph/osd/ceph-1 --no-mon-config 2024-08-18T22:45:24.114 INFO:journalctl@ceph.osd.1.smithi121.stdout:Aug 18 22:45:24 smithi121 bash[94373]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_3 --path /var/lib/ceph/osd/ceph-1 --no-mon-config 2024-08-18T22:45:24.115 INFO:journalctl@ceph.osd.1.smithi121.stdout:Aug 18 22:45:24 smithi121 ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-1-activate[94387]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-1/block 2024-08-18T22:45:24.115 INFO:journalctl@ceph.osd.1.smithi121.stdout:Aug 18 22:45:24 smithi121 bash[94373]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-1/block 2024-08-18T22:45:24.411 INFO:journalctl@ceph.osd.1.smithi121.stdout:Aug 18 22:45:24 smithi121 ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-1-activate[94387]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-1/block 2024-08-18T22:45:24.411 INFO:journalctl@ceph.osd.1.smithi121.stdout:Aug 18 22:45:24 smithi121 bash[94373]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-1/block 2024-08-18T22:45:24.411 INFO:journalctl@ceph.osd.1.smithi121.stdout:Aug 18 22:45:24 smithi121 ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-1-activate[94387]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-08-18T22:45:24.411 INFO:journalctl@ceph.osd.1.smithi121.stdout:Aug 18 22:45:24 smithi121 bash[94373]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-08-18T22:45:24.411 INFO:journalctl@ceph.osd.1.smithi121.stdout:Aug 18 22:45:24 smithi121 ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-1-activate[94387]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-08-18T22:45:24.411 INFO:journalctl@ceph.osd.1.smithi121.stdout:Aug 18 22:45:24 smithi121 bash[94373]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-08-18T22:45:24.411 INFO:journalctl@ceph.osd.1.smithi121.stdout:Aug 18 22:45:24 smithi121 ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-1-activate[94387]: --> ceph-volume lvm activate successful for osd ID: 1 2024-08-18T22:45:24.412 INFO:journalctl@ceph.osd.1.smithi121.stdout:Aug 18 22:45:24 smithi121 bash[94373]: --> ceph-volume lvm activate successful for osd ID: 1 2024-08-18T22:45:24.412 INFO:journalctl@ceph.osd.1.smithi121.stdout:Aug 18 22:45:24 smithi121 podman[94373]: 2024-08-18 22:45:24.139417312 +0000 UTC m=+0.634809276 container died ed22f7ffd954b8ac8d6fab0e954c2ec3b47a383c65a91812b87c611517262fda (image=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-1-activate, org.label-schema.schema-version=1.0, io.buildah.version=1.36.0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, ceph=True, RELEASE=squid-de09dd0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True) 2024-08-18T22:45:24.920 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:45:24 smithi121 ceph-mon[81053]: Health check failed: Degraded data redundancy: 5301/34143 objects degraded (15.526%), 29 pgs degraded (PG_DEGRADED) 2024-08-18T22:45:24.920 INFO:journalctl@ceph.osd.1.smithi121.stdout:Aug 18 22:45:24 smithi121 podman[94512]: 2024-08-18 22:45:24.710893919 +0000 UTC m=+0.561151713 container remove ed22f7ffd954b8ac8d6fab0e954c2ec3b47a383c65a91812b87c611517262fda (image=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-1-activate, ceph=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-de09dd0, io.buildah.version=1.36.0) 2024-08-18T22:45:25.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:45:24 smithi195 ceph-mon[68841]: Health check failed: Degraded data redundancy: 5301/34143 objects degraded (15.526%), 29 pgs degraded (PG_DEGRADED) 2024-08-18T22:45:25.172 INFO:journalctl@ceph.osd.1.smithi121.stdout:Aug 18 22:45:24 smithi121 podman[94570]: 2024-08-18 22:45:24.919982352 +0000 UTC m=+0.111818784 container create 0f9e03de53827aa3ba70e71ce1bad36fb0f976881abf54494db9d8e5dde715be (image=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-1, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, io.buildah.version=1.36.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, RELEASE=squid-de09dd0, ceph=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-08-18T22:45:25.172 INFO:journalctl@ceph.osd.1.smithi121.stdout:Aug 18 22:45:24 smithi121 podman[94570]: 2024-08-18 22:45:24.825206833 +0000 UTC m=+0.017043279 image pull ea7a5189f30bad3aca9524788e2965d2368d7ce786df09d4edcd8c3edf9cefba quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9 2024-08-18T22:45:25.172 INFO:journalctl@ceph.osd.1.smithi121.stdout:Aug 18 22:45:25 smithi121 podman[94570]: 2024-08-18 22:45:25.147726976 +0000 UTC m=+0.339563426 container init 0f9e03de53827aa3ba70e71ce1bad36fb0f976881abf54494db9d8e5dde715be (image=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-1, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, io.buildah.version=1.36.0, CEPH_POINT_RELEASE=, RELEASE=squid-de09dd0, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2) 2024-08-18T22:45:25.173 INFO:journalctl@ceph.osd.1.smithi121.stdout:Aug 18 22:45:25 smithi121 podman[94570]: 2024-08-18 22:45:25.151101836 +0000 UTC m=+0.342938269 container start 0f9e03de53827aa3ba70e71ce1bad36fb0f976881abf54494db9d8e5dde715be (image=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-1, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, RELEASE=squid-de09dd0, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, io.buildah.version=1.36.0) 2024-08-18T22:45:25.173 INFO:journalctl@ceph.osd.1.smithi121.stdout:Aug 18 22:45:25 smithi121 ceph-osd[94588]: -- 172.21.15.121:0/2093377098 <== mon.0 v2:172.21.15.121:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x564ef9c3e1e0 con 0x564ef9bd2000 2024-08-18T22:45:25.583 INFO:journalctl@ceph.osd.1.smithi121.stdout:Aug 18 22:45:25 smithi121 bash[94570]: 0f9e03de53827aa3ba70e71ce1bad36fb0f976881abf54494db9d8e5dde715be 2024-08-18T22:45:25.583 INFO:journalctl@ceph.osd.1.smithi121.stdout:Aug 18 22:45:25 smithi121 systemd[1]: Started Ceph osd.1 for b003123a-5db1-11ef-bccf-c7b262605968. 2024-08-18T22:45:25.782 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:25.778+0000 7fcc3eaa1640 1 -- 172.21.15.121:0/2582305936 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcc3806fde0 msgr2=0x7fcc38070250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:45:25.782 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:25.778+0000 7fcc3eaa1640 1 --2- 172.21.15.121:0/2582305936 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcc3806fde0 0x7fcc38070250 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fcc240048d0 tx=0x7fcc24009da0 comp rx=0 tx=0).stop 2024-08-18T22:45:25.782 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:25.778+0000 7fcc3eaa1640 1 -- 172.21.15.121:0/2582305936 shutdown_connections 2024-08-18T22:45:25.782 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:25.778+0000 7fcc3eaa1640 1 --2- 172.21.15.121:0/2582305936 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcc3806fde0 0x7fcc38070250 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:45:25.783 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:25.778+0000 7fcc3eaa1640 1 --2- 172.21.15.121:0/2582305936 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcc38071370 0x7fcc3806f8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:45:25.783 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:25.778+0000 7fcc3eaa1640 1 -- 172.21.15.121:0/2582305936 >> 172.21.15.121:0/2582305936 conn(0x7fcc380f7ad0 msgr2=0x7fcc380f9f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:45:25.783 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:25.778+0000 7fcc3eaa1640 1 -- 172.21.15.121:0/2582305936 shutdown_connections 2024-08-18T22:45:25.783 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:25.778+0000 7fcc3eaa1640 1 -- 172.21.15.121:0/2582305936 wait complete. 2024-08-18T22:45:25.783 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:25.779+0000 7fcc3eaa1640 1 Processor -- start 2024-08-18T22:45:25.783 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:25.779+0000 7fcc3eaa1640 1 -- start start 2024-08-18T22:45:25.783 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:25.779+0000 7fcc3eaa1640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcc3806fde0 0x7fcc38113430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:45:25.783 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:25.779+0000 7fcc3eaa1640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcc38071370 0x7fcc38113970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:45:25.783 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:25.779+0000 7fcc3eaa1640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc38113fc0 con 0x7fcc3806fde0 2024-08-18T22:45:25.783 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:25.779+0000 7fcc3eaa1640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc381147e0 con 0x7fcc38071370 2024-08-18T22:45:25.783 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:25.779+0000 7fcc3c83d640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcc3806fde0 0x7fcc38113430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:45:25.783 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:25.779+0000 7fcc3c83d640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcc3806fde0 0x7fcc38113430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:46124/0 (socket says 172.21.15.121:46124) 2024-08-18T22:45:25.783 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:25.779+0000 7fcc3c83d640 1 -- 172.21.15.121:0/3898383429 learned_addr learned my addr 172.21.15.121:0/3898383429 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-18T22:45:25.784 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:25.780+0000 7fcc37fff640 1 --2- 172.21.15.121:0/3898383429 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcc38071370 0x7fcc38113970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:45:25.784 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:25.780+0000 7fcc3c83d640 1 -- 172.21.15.121:0/3898383429 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcc38071370 msgr2=0x7fcc38113970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:45:25.784 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:25.780+0000 7fcc3c83d640 1 --2- 172.21.15.121:0/3898383429 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcc38071370 0x7fcc38113970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:45:25.784 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:25.780+0000 7fcc3c83d640 1 -- 172.21.15.121:0/3898383429 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc24005040 con 0x7fcc3806fde0 2024-08-18T22:45:25.784 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:25.780+0000 7fcc37fff640 1 --2- 172.21.15.121:0/3898383429 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcc38071370 0x7fcc38113970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:45:25.784 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:25.780+0000 7fcc3c83d640 1 --2- 172.21.15.121:0/3898383429 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcc3806fde0 0x7fcc38113430 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fcc2c00c7e0 tx=0x7fcc2c0043c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:45:25.784 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:25.780+0000 7fcc357fa640 1 -- 172.21.15.121:0/3898383429 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcc2c00a820 con 0x7fcc3806fde0 2024-08-18T22:45:25.785 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:25.780+0000 7fcc3eaa1640 1 -- 172.21.15.121:0/3898383429 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc38114a70 con 0x7fcc3806fde0 2024-08-18T22:45:25.785 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:25.780+0000 7fcc357fa640 1 -- 172.21.15.121:0/3898383429 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fcc2c00ae20 con 0x7fcc3806fde0 2024-08-18T22:45:25.785 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:25.780+0000 7fcc357fa640 1 -- 172.21.15.121:0/3898383429 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcc2c0113a0 con 0x7fcc3806fde0 2024-08-18T22:45:25.785 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:25.780+0000 7fcc3eaa1640 1 -- 172.21.15.121:0/3898383429 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc38115010 con 0x7fcc3806fde0 2024-08-18T22:45:25.785 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:25.781+0000 7fcc3eaa1640 1 -- 172.21.15.121:0/3898383429 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc380fb770 con 0x7fcc3806fde0 2024-08-18T22:45:25.786 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:25.782+0000 7fcc357fa640 1 -- 172.21.15.121:0/3898383429 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 37) v1 ==== 92205+0+0 (secure 0 0 0) 0x7fcc2c012400 con 0x7fcc3806fde0 2024-08-18T22:45:25.786 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:25.782+0000 7fcc357fa640 1 --2- 172.21.15.121:0/3898383429 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7fcc2806e0b0 0x7fcc28070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:45:25.786 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:25.782+0000 7fcc357fa640 1 -- 172.21.15.121:0/3898383429 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6496+0+0 (secure 0 0 0) 0x7fcc2c08dd40 con 0x7fcc3806fde0 2024-08-18T22:45:25.786 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:25.782+0000 7fcc37fff640 1 --2- 172.21.15.121:0/3898383429 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7fcc2806e0b0 0x7fcc28070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:45:25.786 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:25.783+0000 7fcc37fff640 1 --2- 172.21.15.121:0/3898383429 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7fcc2806e0b0 0x7fcc28070560 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fcc2400b020 tx=0x7fcc24009da0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:45:25.788 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:25.787+0000 7fcc357fa640 1 -- 172.21.15.121:0/3898383429 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7fcc2c091030 con 0x7fcc3806fde0 2024-08-18T22:45:25.975 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:45:25 smithi121 ceph-mon[81053]: pgmap v63: 65 pgs: 5 peering, 29 active+undersized+degraded, 31 active+clean; 2.0 GiB data, 7.3 GiB used, 529 GiB / 536 GiB avail; 5301/34143 objects degraded (15.526%) 2024-08-18T22:45:25.975 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:45:25 smithi121 ceph-mon[81053]: 3 slow requests, 0 included below; oldest blocked for > 236.867883 secs 2024-08-18T22:45:25.975 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:45:25 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:45:25.975 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:45:25 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:45:25.975 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:45:25 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-18T22:45:25.975 INFO:journalctl@ceph.osd.1.smithi121.stdout:Aug 18 22:45:25 smithi121 ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-1[94584]: 2024-08-18T22:45:25.691+0000 7f800b04a640 -1 Falling back to public interface 2024-08-18T22:45:25.976 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:25.973+0000 7fcc3eaa1640 1 -- 172.21.15.121:0/3898383429 --> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fcc38115400 con 0x7fcc2806e0b0 2024-08-18T22:45:25.976 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:25.975+0000 7fcc357fa640 1 -- 172.21.15.121:0/3898383429 <== mgr.34102 v2:172.21.15.121:6800/3037387239 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7fcc38115400 con 0x7fcc2806e0b0 2024-08-18T22:45:25.979 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:25.978+0000 7fcc3eaa1640 1 -- 172.21.15.121:0/3898383429 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7fcc2806e0b0 msgr2=0x7fcc28070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:45:25.979 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:25.978+0000 7fcc3eaa1640 1 --2- 172.21.15.121:0/3898383429 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7fcc2806e0b0 0x7fcc28070560 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fcc2400b020 tx=0x7fcc24009da0 comp rx=0 tx=0).stop 2024-08-18T22:45:25.980 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:25.978+0000 7fcc3eaa1640 1 -- 172.21.15.121:0/3898383429 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcc3806fde0 msgr2=0x7fcc38113430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:45:25.980 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:25.978+0000 7fcc3eaa1640 1 --2- 172.21.15.121:0/3898383429 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcc3806fde0 0x7fcc38113430 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fcc2c00c7e0 tx=0x7fcc2c0043c0 comp rx=0 tx=0).stop 2024-08-18T22:45:25.980 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:25.978+0000 7fcc3eaa1640 1 -- 172.21.15.121:0/3898383429 shutdown_connections 2024-08-18T22:45:25.980 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:25.978+0000 7fcc3eaa1640 1 --2- 172.21.15.121:0/3898383429 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7fcc2806e0b0 0x7fcc28070560 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:45:25.980 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:25.978+0000 7fcc3eaa1640 1 --2- 172.21.15.121:0/3898383429 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcc38071370 0x7fcc38113970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:45:25.980 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:25.978+0000 7fcc3eaa1640 1 --2- 172.21.15.121:0/3898383429 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcc3806fde0 0x7fcc38113430 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:45:25.980 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:25.978+0000 7fcc3eaa1640 1 -- 172.21.15.121:0/3898383429 >> 172.21.15.121:0/3898383429 conn(0x7fcc380f7ad0 msgr2=0x7fcc380f92c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:45:25.980 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:25.979+0000 7fcc3eaa1640 1 -- 172.21.15.121:0/3898383429 shutdown_connections 2024-08-18T22:45:25.980 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:25.979+0000 7fcc3eaa1640 1 -- 172.21.15.121:0/3898383429 wait complete. 2024-08-18T22:45:25.990 INFO:teuthology.orchestra.run.smithi121.stdout:true 2024-08-18T22:45:26.063 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:26.062+0000 7ffa53ee6640 1 -- 172.21.15.121:0/3443409894 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ffa4c0fb1d0 msgr2=0x7ffa4c0fb5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:45:26.063 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:26.062+0000 7ffa53ee6640 1 --2- 172.21.15.121:0/3443409894 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ffa4c0fb1d0 0x7ffa4c0fb5e0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7ffa480048d0 tx=0x7ffa48009da0 comp rx=0 tx=0).stop 2024-08-18T22:45:26.063 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:26.062+0000 7ffa53ee6640 1 -- 172.21.15.121:0/3443409894 shutdown_connections 2024-08-18T22:45:26.063 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:26.062+0000 7ffa53ee6640 1 --2- 172.21.15.121:0/3443409894 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ffa4c0fc4a0 0x7ffa4c0fc910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:45:26.063 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:26.062+0000 7ffa53ee6640 1 --2- 172.21.15.121:0/3443409894 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ffa4c0fb1d0 0x7ffa4c0fb5e0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:45:26.063 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:26.062+0000 7ffa53ee6640 1 -- 172.21.15.121:0/3443409894 >> 172.21.15.121:0/3443409894 conn(0x7ffa4c0f69b0 msgr2=0x7ffa4c0f8dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:45:26.063 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:26.062+0000 7ffa53ee6640 1 -- 172.21.15.121:0/3443409894 shutdown_connections 2024-08-18T22:45:26.064 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:26.062+0000 7ffa53ee6640 1 -- 172.21.15.121:0/3443409894 wait complete. 2024-08-18T22:45:26.065 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:26.062+0000 7ffa53ee6640 1 Processor -- start 2024-08-18T22:45:26.065 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:26.063+0000 7ffa53ee6640 1 -- start start 2024-08-18T22:45:26.065 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:26.063+0000 7ffa53ee6640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ffa4c0fb1d0 0x7ffa4c10bd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:45:26.065 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:26.063+0000 7ffa53ee6640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ffa4c0fc4a0 0x7ffa4c10c2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:45:26.065 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:26.063+0000 7ffa53ee6640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa4c10c920 con 0x7ffa4c0fc4a0 2024-08-18T22:45:26.065 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:26.063+0000 7ffa53ee6640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa4c10d060 con 0x7ffa4c0fb1d0 2024-08-18T22:45:26.066 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:26.063+0000 7ffa51481640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ffa4c0fc4a0 0x7ffa4c10c2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:45:26.066 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:26.063+0000 7ffa51481640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ffa4c0fc4a0 0x7ffa4c10c2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:46142/0 (socket says 172.21.15.121:46142) 2024-08-18T22:45:26.066 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:26.063+0000 7ffa51481640 1 -- 172.21.15.121:0/2300718172 learned_addr learned my addr 172.21.15.121:0/2300718172 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-18T22:45:26.066 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:26.063+0000 7ffa51c82640 1 --2- 172.21.15.121:0/2300718172 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ffa4c0fb1d0 0x7ffa4c10bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:45:26.066 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:26.063+0000 7ffa51481640 1 -- 172.21.15.121:0/2300718172 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ffa4c0fb1d0 msgr2=0x7ffa4c10bd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:45:26.066 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:26.063+0000 7ffa51481640 1 --2- 172.21.15.121:0/2300718172 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ffa4c0fb1d0 0x7ffa4c10bd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:45:26.066 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:26.063+0000 7ffa51481640 1 -- 172.21.15.121:0/2300718172 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa48005040 con 0x7ffa4c0fc4a0 2024-08-18T22:45:26.066 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:26.063+0000 7ffa51481640 1 --2- 172.21.15.121:0/2300718172 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ffa4c0fc4a0 0x7ffa4c10c2d0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7ffa3c00fce0 tx=0x7ffa3c004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:45:26.066 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:26.063+0000 7ffa427fc640 1 -- 172.21.15.121:0/2300718172 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffa3c00de30 con 0x7ffa4c0fc4a0 2024-08-18T22:45:26.066 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:26.064+0000 7ffa427fc640 1 -- 172.21.15.121:0/2300718172 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7ffa3c0090d0 con 0x7ffa4c0fc4a0 2024-08-18T22:45:26.066 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:26.064+0000 7ffa53ee6640 1 -- 172.21.15.121:0/2300718172 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa4c10d2f0 con 0x7ffa4c0fc4a0 2024-08-18T22:45:26.066 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:26.064+0000 7ffa427fc640 1 -- 172.21.15.121:0/2300718172 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffa3c0126a0 con 0x7ffa4c0fc4a0 2024-08-18T22:45:26.067 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:26.064+0000 7ffa53ee6640 1 -- 172.21.15.121:0/2300718172 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa4c10d890 con 0x7ffa4c0fc4a0 2024-08-18T22:45:26.067 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:26.065+0000 7ffa53ee6640 1 -- 172.21.15.121:0/2300718172 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa4c0fa630 con 0x7ffa4c0fc4a0 2024-08-18T22:45:26.067 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:26.065+0000 7ffa427fc640 1 -- 172.21.15.121:0/2300718172 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 37) v1 ==== 92205+0+0 (secure 0 0 0) 0x7ffa3c009240 con 0x7ffa4c0fc4a0 2024-08-18T22:45:26.068 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:26.066+0000 7ffa427fc640 1 --2- 172.21.15.121:0/2300718172 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7ffa3806e0b0 0x7ffa38070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:45:26.068 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:26.066+0000 7ffa427fc640 1 -- 172.21.15.121:0/2300718172 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6496+0+0 (secure 0 0 0) 0x7ffa3c090000 con 0x7ffa4c0fc4a0 2024-08-18T22:45:26.068 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:26.066+0000 7ffa51c82640 1 --2- 172.21.15.121:0/2300718172 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7ffa3806e0b0 0x7ffa38070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:45:26.068 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:26.066+0000 7ffa51c82640 1 --2- 172.21.15.121:0/2300718172 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7ffa3806e0b0 0x7ffa38070560 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7ffa48000c00 tx=0x7ffa48035040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:45:26.071 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:26.070+0000 7ffa427fc640 1 -- 172.21.15.121:0/2300718172 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7ffa3c059460 con 0x7ffa4c0fc4a0 2024-08-18T22:45:26.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:45:25 smithi195 ceph-mon[68841]: pgmap v63: 65 pgs: 5 peering, 29 active+undersized+degraded, 31 active+clean; 2.0 GiB data, 7.3 GiB used, 529 GiB / 536 GiB avail; 5301/34143 objects degraded (15.526%) 2024-08-18T22:45:26.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:45:25 smithi195 ceph-mon[68841]: 3 slow requests, 0 included below; oldest blocked for > 236.867883 secs 2024-08-18T22:45:26.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:45:25 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:45:26.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:45:25 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:45:26.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:45:25 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-18T22:45:26.258 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:26.257+0000 7ffa53ee6640 1 -- 172.21.15.121:0/2300718172 --> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ffa4c10dcb0 con 0x7ffa3806e0b0 2024-08-18T22:45:26.259 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:26.258+0000 7ffa427fc640 1 -- 172.21.15.121:0/2300718172 <== mgr.34102 v2:172.21.15.121:6800/3037387239 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7ffa4c10dcb0 con 0x7ffa3806e0b0 2024-08-18T22:45:26.262 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:26.260+0000 7ffa53ee6640 1 -- 172.21.15.121:0/2300718172 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7ffa3806e0b0 msgr2=0x7ffa38070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:45:26.262 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:26.260+0000 7ffa53ee6640 1 --2- 172.21.15.121:0/2300718172 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7ffa3806e0b0 0x7ffa38070560 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7ffa48000c00 tx=0x7ffa48035040 comp rx=0 tx=0).stop 2024-08-18T22:45:26.262 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:26.260+0000 7ffa53ee6640 1 -- 172.21.15.121:0/2300718172 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ffa4c0fc4a0 msgr2=0x7ffa4c10c2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:45:26.262 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:26.260+0000 7ffa53ee6640 1 --2- 172.21.15.121:0/2300718172 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ffa4c0fc4a0 0x7ffa4c10c2d0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7ffa3c00fce0 tx=0x7ffa3c004600 comp rx=0 tx=0).stop 2024-08-18T22:45:26.262 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:26.260+0000 7ffa53ee6640 1 -- 172.21.15.121:0/2300718172 shutdown_connections 2024-08-18T22:45:26.262 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:26.260+0000 7ffa53ee6640 1 --2- 172.21.15.121:0/2300718172 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7ffa3806e0b0 0x7ffa38070560 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:45:26.262 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:26.260+0000 7ffa53ee6640 1 --2- 172.21.15.121:0/2300718172 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ffa4c0fc4a0 0x7ffa4c10c2d0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:45:26.262 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:26.260+0000 7ffa53ee6640 1 --2- 172.21.15.121:0/2300718172 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ffa4c0fb1d0 0x7ffa4c10bd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:45:26.262 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:26.260+0000 7ffa53ee6640 1 -- 172.21.15.121:0/2300718172 >> 172.21.15.121:0/2300718172 conn(0x7ffa4c0f69b0 msgr2=0x7ffa4c0f8180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:45:26.262 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:26.261+0000 7ffa53ee6640 1 -- 172.21.15.121:0/2300718172 shutdown_connections 2024-08-18T22:45:26.262 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:26.261+0000 7ffa53ee6640 1 -- 172.21.15.121:0/2300718172 wait complete. 2024-08-18T22:45:26.342 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:26.340+0000 7fe4acb18640 1 -- 172.21.15.121:0/3914986719 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe4a80fc4f0 msgr2=0x7fe4a80fc960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:45:26.343 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:26.340+0000 7fe4acb18640 1 --2- 172.21.15.121:0/3914986719 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe4a80fc4f0 0x7fe4a80fc960 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fe4900048d0 tx=0x7fe490009da0 comp rx=0 tx=0).stop 2024-08-18T22:45:26.343 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:26.340+0000 7fe4acb18640 1 -- 172.21.15.121:0/3914986719 shutdown_connections 2024-08-18T22:45:26.343 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:26.340+0000 7fe4acb18640 1 --2- 172.21.15.121:0/3914986719 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe4a80fc4f0 0x7fe4a80fc960 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:45:26.343 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:26.340+0000 7fe4acb18640 1 --2- 172.21.15.121:0/3914986719 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe4a80fb220 0x7fe4a80fb630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:45:26.343 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:26.340+0000 7fe4acb18640 1 -- 172.21.15.121:0/3914986719 >> 172.21.15.121:0/3914986719 conn(0x7fe4a80f69e0 msgr2=0x7fe4a80f8e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:45:26.343 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:26.340+0000 7fe4acb18640 1 -- 172.21.15.121:0/3914986719 shutdown_connections 2024-08-18T22:45:26.343 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:26.340+0000 7fe4acb18640 1 -- 172.21.15.121:0/3914986719 wait complete. 2024-08-18T22:45:26.343 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:26.340+0000 7fe4acb18640 1 Processor -- start 2024-08-18T22:45:26.343 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:26.341+0000 7fe4acb18640 1 -- start start 2024-08-18T22:45:26.343 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:26.341+0000 7fe4acb18640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe4a80fb220 0x7fe4a80ff340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:45:26.343 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:26.341+0000 7fe4acb18640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe4a80fc4f0 0x7fe4a80fd830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:45:26.343 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:26.341+0000 7fe4acb18640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4a80fddc0 con 0x7fe4a80fc4f0 2024-08-18T22:45:26.344 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:26.341+0000 7fe4acb18640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4a80fdf00 con 0x7fe4a80fb220 2024-08-18T22:45:26.344 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:26.341+0000 7fe49ffff640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe4a80fc4f0 0x7fe4a80fd830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:45:26.344 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:26.341+0000 7fe49ffff640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe4a80fc4f0 0x7fe4a80fd830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:46156/0 (socket says 172.21.15.121:46156) 2024-08-18T22:45:26.344 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:26.341+0000 7fe49ffff640 1 -- 172.21.15.121:0/4149915625 learned_addr learned my addr 172.21.15.121:0/4149915625 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-18T22:45:26.344 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:26.341+0000 7fe4a659c640 1 --2- 172.21.15.121:0/4149915625 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe4a80fb220 0x7fe4a80ff340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:45:26.344 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:26.341+0000 7fe49ffff640 1 -- 172.21.15.121:0/4149915625 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe4a80fb220 msgr2=0x7fe4a80ff340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:45:26.344 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:26.341+0000 7fe49ffff640 1 --2- 172.21.15.121:0/4149915625 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe4a80fb220 0x7fe4a80ff340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:45:26.344 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:26.341+0000 7fe49ffff640 1 -- 172.21.15.121:0/4149915625 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe490005040 con 0x7fe4a80fc4f0 2024-08-18T22:45:26.344 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:26.341+0000 7fe4a659c640 1 --2- 172.21.15.121:0/4149915625 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe4a80fb220 0x7fe4a80ff340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:45:26.344 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:26.341+0000 7fe49ffff640 1 --2- 172.21.15.121:0/4149915625 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe4a80fc4f0 0x7fe4a80fd830 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fe490000c00 tx=0x7fe490009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:45:26.344 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:26.341+0000 7fe49effd640 1 -- 172.21.15.121:0/4149915625 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe490038070 con 0x7fe4a80fc4f0 2024-08-18T22:45:26.344 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:26.341+0000 7fe4acb18640 1 -- 172.21.15.121:0/4149915625 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4a80fe180 con 0x7fe4a80fc4f0 2024-08-18T22:45:26.345 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:26.341+0000 7fe49effd640 1 -- 172.21.15.121:0/4149915625 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fe49002ae90 con 0x7fe4a80fc4f0 2024-08-18T22:45:26.345 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:26.341+0000 7fe49effd640 1 -- 172.21.15.121:0/4149915625 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe49003d420 con 0x7fe4a80fc4f0 2024-08-18T22:45:26.346 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:26.341+0000 7fe4acb18640 1 -- 172.21.15.121:0/4149915625 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4a8114ed0 con 0x7fe4a80fc4f0 2024-08-18T22:45:26.346 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:26.343+0000 7fe4acb18640 1 -- 172.21.15.121:0/4149915625 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4a80fa680 con 0x7fe4a80fc4f0 2024-08-18T22:45:26.346 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:26.343+0000 7fe49effd640 1 -- 172.21.15.121:0/4149915625 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 37) v1 ==== 92205+0+0 (secure 0 0 0) 0x7fe490030020 con 0x7fe4a80fc4f0 2024-08-18T22:45:26.346 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:26.343+0000 7fe49effd640 1 --2- 172.21.15.121:0/4149915625 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7fe49406e0b0 0x7fe494070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:45:26.347 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:26.343+0000 7fe49effd640 1 -- 172.21.15.121:0/4149915625 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6496+0+0 (secure 0 0 0) 0x7fe4900ae350 con 0x7fe4a80fc4f0 2024-08-18T22:45:26.347 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:26.344+0000 7fe4a659c640 1 --2- 172.21.15.121:0/4149915625 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7fe49406e0b0 0x7fe494070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:45:26.347 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:26.344+0000 7fe4a659c640 1 --2- 172.21.15.121:0/4149915625 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7fe49406e0b0 0x7fe494070560 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fe4980041d0 tx=0x7fe498009040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:45:26.349 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:26.348+0000 7fe49effd640 1 -- 172.21.15.121:0/4149915625 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7fe490077680 con 0x7fe4a80fc4f0 2024-08-18T22:45:26.576 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:26.575+0000 7fe4acb18640 1 -- 172.21.15.121:0/4149915625 --> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fe4a8065f00 con 0x7fe49406e0b0 2024-08-18T22:45:26.584 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:26.584+0000 7fe49effd640 1 -- 172.21.15.121:0/4149915625 <== mgr.34102 v2:172.21.15.121:6800/3037387239 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7fe4a8065f00 con 0x7fe49406e0b0 2024-08-18T22:45:26.585 INFO:teuthology.orchestra.run.smithi121.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-08-18T22:45:26.585 INFO:teuthology.orchestra.run.smithi121.stdout:alertmanager.smithi121 smithi121 *:9093,9094 running (3m) 29s ago 11m 15.7M - 0.25.0 c8568f914cd2 c421c5e6a02b 2024-08-18T22:45:26.585 INFO:teuthology.orchestra.run.smithi121.stdout:crash.smithi121 smithi121 running (59s) 29s ago 11m 6903k - 19.1.0-1382-gde09dd01 ea7a5189f30b 3cf5c666a0e6 2024-08-18T22:45:26.585 INFO:teuthology.orchestra.run.smithi121.stdout:crash.smithi195 smithi195 running (54s) 51s ago 10m 6895k - 19.1.0-1382-gde09dd01 ea7a5189f30b fbb586fb9834 2024-08-18T22:45:26.585 INFO:teuthology.orchestra.run.smithi121.stdout:grafana.smithi121 smithi121 *:3000 running (3m) 29s ago 11m 79.4M - 9.4.7 954c08fa6188 091a5fd17e8a 2024-08-18T22:45:26.585 INFO:teuthology.orchestra.run.smithi121.stdout:mds.cephfs.smithi121.gbickb smithi121 running (6m) 29s ago 6m 156M - 17.2.7-1406-gdf62bdcc 774894bef55f 484da0bc2c95 2024-08-18T22:45:26.585 INFO:teuthology.orchestra.run.smithi121.stdout:mds.cephfs.smithi121.xuzsdg smithi121 running (6m) 29s ago 6m 13.3M - 17.2.7-1406-gdf62bdcc 774894bef55f 6976b708cdcd 2024-08-18T22:45:26.585 INFO:teuthology.orchestra.run.smithi121.stdout:mds.cephfs.smithi195.buqvbr smithi195 running (6m) 51s ago 6m 115M - 17.2.7-1406-gdf62bdcc 774894bef55f 11a3703b4276 2024-08-18T22:45:26.585 INFO:teuthology.orchestra.run.smithi121.stdout:mds.cephfs.smithi195.nptgyc smithi195 running (6m) 51s ago 6m 17.6M - 17.2.7-1406-gdf62bdcc 774894bef55f b9f8043ea83e 2024-08-18T22:45:26.585 INFO:teuthology.orchestra.run.smithi121.stdout:mgr.smithi121.lopxqc smithi121 *:8443,9283,8765 running (2m) 29s ago 12m 494M - 19.1.0-1382-gde09dd01 ea7a5189f30b 9079701e6516 2024-08-18T22:45:26.585 INFO:teuthology.orchestra.run.smithi121.stdout:mgr.smithi195.acttsj smithi195 *:8443,9283,8765 running (2m) 51s ago 10m 439M - 19.1.0-1382-gde09dd01 ea7a5189f30b 7b4027a33daa 2024-08-18T22:45:26.586 INFO:teuthology.orchestra.run.smithi121.stdout:mon.smithi121 smithi121 running (114s) 29s ago 12m 45.1M 2048M 19.1.0-1382-gde09dd01 ea7a5189f30b d71695a4fb56 2024-08-18T22:45:26.586 INFO:teuthology.orchestra.run.smithi121.stdout:mon.smithi195 smithi195 running (95s) 51s ago 10m 35.1M 2048M 19.1.0-1382-gde09dd01 ea7a5189f30b a9bb94ba3b56 2024-08-18T22:45:26.586 INFO:teuthology.orchestra.run.smithi121.stdout:node-exporter.smithi121 smithi121 *:9100 running (3m) 29s ago 11m 13.9M - 1.5.0 0da6a335fe13 bc4b5355a507 2024-08-18T22:45:26.586 INFO:teuthology.orchestra.run.smithi121.stdout:node-exporter.smithi195 smithi195 *:9100 running (2m) 51s ago 10m 16.4M - 1.5.0 0da6a335fe13 146efcb79663 2024-08-18T22:45:26.586 INFO:teuthology.orchestra.run.smithi121.stdout:osd.0 smithi121 running (35s) 29s ago 9m 11.2M 1557M 19.1.0-1382-gde09dd01 ea7a5189f30b d378dd46eeb6 2024-08-18T22:45:26.586 INFO:teuthology.orchestra.run.smithi121.stdout:osd.1 smithi121 starting - - - 1557M 2024-08-18T22:45:26.586 INFO:teuthology.orchestra.run.smithi121.stdout:osd.2 smithi121 running (8m) 29s ago 8m 181M 1557M 17.2.7-1406-gdf62bdcc 774894bef55f 3fa061e41f99 2024-08-18T22:45:26.586 INFO:teuthology.orchestra.run.smithi121.stdout:osd.3 smithi195 running (8m) 51s ago 8m 239M 2581M 17.2.7-1406-gdf62bdcc 774894bef55f 15d30b1b459e 2024-08-18T22:45:26.586 INFO:teuthology.orchestra.run.smithi121.stdout:osd.4 smithi195 running (8m) 51s ago 8m 207M 2581M 17.2.7-1406-gdf62bdcc 774894bef55f 99ed156dfd36 2024-08-18T22:45:26.586 INFO:teuthology.orchestra.run.smithi121.stdout:osd.5 smithi195 running (7m) 51s ago 7m 213M 2581M 17.2.7-1406-gdf62bdcc 774894bef55f e7eff7bdb752 2024-08-18T22:45:26.586 INFO:teuthology.orchestra.run.smithi121.stdout:prometheus.smithi121 smithi121 *:9095 running (2m) 29s ago 10m 49.4M - 2.43.0 a07b618ecd1d 00c4f776d23a 2024-08-18T22:45:26.587 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:26.586+0000 7fe4acb18640 1 -- 172.21.15.121:0/4149915625 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7fe49406e0b0 msgr2=0x7fe494070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:45:26.587 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:26.586+0000 7fe4acb18640 1 --2- 172.21.15.121:0/4149915625 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7fe49406e0b0 0x7fe494070560 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fe4980041d0 tx=0x7fe498009040 comp rx=0 tx=0).stop 2024-08-18T22:45:26.587 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:26.586+0000 7fe4acb18640 1 -- 172.21.15.121:0/4149915625 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe4a80fc4f0 msgr2=0x7fe4a80fd830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:45:26.587 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:26.586+0000 7fe4acb18640 1 --2- 172.21.15.121:0/4149915625 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe4a80fc4f0 0x7fe4a80fd830 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fe490000c00 tx=0x7fe490009da0 comp rx=0 tx=0).stop 2024-08-18T22:45:26.587 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:26.586+0000 7fe4acb18640 1 -- 172.21.15.121:0/4149915625 shutdown_connections 2024-08-18T22:45:26.587 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:26.586+0000 7fe4acb18640 1 --2- 172.21.15.121:0/4149915625 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7fe49406e0b0 0x7fe494070560 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:45:26.588 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:26.586+0000 7fe4acb18640 1 --2- 172.21.15.121:0/4149915625 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe4a80fc4f0 0x7fe4a80fd830 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:45:26.588 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:26.586+0000 7fe4acb18640 1 --2- 172.21.15.121:0/4149915625 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe4a80fb220 0x7fe4a80ff340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:45:26.588 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:26.586+0000 7fe4acb18640 1 -- 172.21.15.121:0/4149915625 >> 172.21.15.121:0/4149915625 conn(0x7fe4a80f69e0 msgr2=0x7fe4a80657f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:45:26.588 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:26.586+0000 7fe4acb18640 1 -- 172.21.15.121:0/4149915625 shutdown_connections 2024-08-18T22:45:26.588 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:26.586+0000 7fe4acb18640 1 -- 172.21.15.121:0/4149915625 wait complete. 2024-08-18T22:45:26.666 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:26.663+0000 7f487f515640 1 -- 172.21.15.121:0/1807544969 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f48780fc2f0 msgr2=0x7f48780fc700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:45:26.666 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:26.663+0000 7f487f515640 1 --2- 172.21.15.121:0/1807544969 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f48780fc2f0 0x7f48780fc700 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f48740048d0 tx=0x7f4874009da0 comp rx=0 tx=0).stop 2024-08-18T22:45:26.666 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:26.663+0000 7f487f515640 1 -- 172.21.15.121:0/1807544969 shutdown_connections 2024-08-18T22:45:26.666 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:26.663+0000 7f487f515640 1 --2- 172.21.15.121:0/1807544969 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f48780fd5c0 0x7f48780fda30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:45:26.666 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:26.663+0000 7f487f515640 1 --2- 172.21.15.121:0/1807544969 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f48780fc2f0 0x7f48780fc700 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:45:26.666 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:26.663+0000 7f487f515640 1 -- 172.21.15.121:0/1807544969 >> 172.21.15.121:0/1807544969 conn(0x7f48780f7ad0 msgr2=0x7f48780f9ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:45:26.666 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:26.663+0000 7f487f515640 1 -- 172.21.15.121:0/1807544969 shutdown_connections 2024-08-18T22:45:26.666 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:26.663+0000 7f487f515640 1 -- 172.21.15.121:0/1807544969 wait complete. 2024-08-18T22:45:26.666 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:26.664+0000 7f487f515640 1 Processor -- start 2024-08-18T22:45:26.667 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:26.664+0000 7f487f515640 1 -- start start 2024-08-18T22:45:26.667 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:26.664+0000 7f487f515640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f48780fc2f0 0x7f487810ce90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:45:26.667 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:26.664+0000 7f487f515640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f48780fd5c0 0x7f487810d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:45:26.667 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:26.664+0000 7f487f515640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f487810da20 con 0x7f48780fd5c0 2024-08-18T22:45:26.667 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:26.664+0000 7f487f515640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f487810e160 con 0x7f48780fc2f0 2024-08-18T22:45:26.667 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:26.664+0000 7f487cab0640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f48780fd5c0 0x7f487810d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:45:26.667 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:26.664+0000 7f487cab0640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f48780fd5c0 0x7f487810d3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:46182/0 (socket says 172.21.15.121:46182) 2024-08-18T22:45:26.667 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:26.664+0000 7f487cab0640 1 -- 172.21.15.121:0/2468799631 learned_addr learned my addr 172.21.15.121:0/2468799631 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-18T22:45:26.667 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:26.664+0000 7f487d2b1640 1 --2- 172.21.15.121:0/2468799631 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f48780fc2f0 0x7f487810ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:45:26.667 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:26.664+0000 7f487cab0640 1 -- 172.21.15.121:0/2468799631 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f48780fc2f0 msgr2=0x7f487810ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:45:26.667 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:26.664+0000 7f487cab0640 1 --2- 172.21.15.121:0/2468799631 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f48780fc2f0 0x7f487810ce90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:45:26.667 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:26.664+0000 7f487cab0640 1 -- 172.21.15.121:0/2468799631 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4874005040 con 0x7f48780fd5c0 2024-08-18T22:45:26.667 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:26.664+0000 7f487cab0640 1 --2- 172.21.15.121:0/2468799631 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f48780fd5c0 0x7f487810d3d0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f486800c810 tx=0x7f48680043c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:45:26.668 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:26.665+0000 7f486dffb640 1 -- 172.21.15.121:0/2468799631 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f486800a7a0 con 0x7f48780fd5c0 2024-08-18T22:45:26.668 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:26.665+0000 7f486dffb640 1 -- 172.21.15.121:0/2468799631 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f486800ada0 con 0x7f48780fd5c0 2024-08-18T22:45:26.668 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:26.665+0000 7f487f515640 1 -- 172.21.15.121:0/2468799631 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f487810e3f0 con 0x7f48780fd5c0 2024-08-18T22:45:26.668 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:26.665+0000 7f486dffb640 1 -- 172.21.15.121:0/2468799631 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4868011380 con 0x7f48780fd5c0 2024-08-18T22:45:26.668 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:26.665+0000 7f487f515640 1 -- 172.21.15.121:0/2468799631 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f487810e990 con 0x7f48780fd5c0 2024-08-18T22:45:26.669 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:26.666+0000 7f487f515640 1 -- 172.21.15.121:0/2468799631 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48780fb750 con 0x7f48780fd5c0 2024-08-18T22:45:26.669 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:26.666+0000 7f486dffb640 1 -- 172.21.15.121:0/2468799631 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 37) v1 ==== 92205+0+0 (secure 0 0 0) 0x7f48680127d0 con 0x7f48780fd5c0 2024-08-18T22:45:26.669 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:26.667+0000 7f486dffb640 1 --2- 172.21.15.121:0/2468799631 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f486406e0b0 0x7f4864070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:45:26.669 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:26.667+0000 7f486dffb640 1 -- 172.21.15.121:0/2468799631 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f486808e000 con 0x7f48780fd5c0 2024-08-18T22:45:26.669 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:26.667+0000 7f487d2b1640 1 --2- 172.21.15.121:0/2468799631 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f486406e0b0 0x7f4864070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:45:26.669 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:26.667+0000 7f487d2b1640 1 --2- 172.21.15.121:0/2468799631 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f486406e0b0 0x7f4864070560 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f4874000c00 tx=0x7f4874035040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:45:26.672 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:26.671+0000 7f486dffb640 1 -- 172.21.15.121:0/2468799631 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f486805aee0 con 0x7f48780fd5c0 2024-08-18T22:45:26.911 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:26.909+0000 7f487f515640 1 -- 172.21.15.121:0/2468799631 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f4878104cf0 con 0x7f48780fd5c0 2024-08-18T22:45:26.911 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:26.910+0000 7f486dffb640 1 -- 172.21.15.121:0/2468799631 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+838 (secure 0 0 0) 0x7f486805aa70 con 0x7f48780fd5c0 2024-08-18T22:45:26.911 INFO:teuthology.orchestra.run.smithi121.stdout:{ 2024-08-18T22:45:26.912 INFO:teuthology.orchestra.run.smithi121.stdout: "mon": { 2024-08-18T22:45:26.912 INFO:teuthology.orchestra.run.smithi121.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 2 2024-08-18T22:45:26.912 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-18T22:45:26.912 INFO:teuthology.orchestra.run.smithi121.stdout: "mgr": { 2024-08-18T22:45:26.912 INFO:teuthology.orchestra.run.smithi121.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 2 2024-08-18T22:45:26.912 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-18T22:45:26.912 INFO:teuthology.orchestra.run.smithi121.stdout: "osd": { 2024-08-18T22:45:26.912 INFO:teuthology.orchestra.run.smithi121.stdout: "ceph version 17.2.7-1406-gdf62bdcc (df62bdccd9a13bf566b27a250eddfdd89be3072d) quincy (stable)": 4, 2024-08-18T22:45:26.912 INFO:teuthology.orchestra.run.smithi121.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 1 2024-08-18T22:45:26.912 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-18T22:45:26.912 INFO:teuthology.orchestra.run.smithi121.stdout: "mds": { 2024-08-18T22:45:26.912 INFO:teuthology.orchestra.run.smithi121.stdout: "ceph version 17.2.7-1406-gdf62bdcc (df62bdccd9a13bf566b27a250eddfdd89be3072d) quincy (stable)": 4 2024-08-18T22:45:26.912 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-18T22:45:26.912 INFO:teuthology.orchestra.run.smithi121.stdout: "overall": { 2024-08-18T22:45:26.913 INFO:teuthology.orchestra.run.smithi121.stdout: "ceph version 17.2.7-1406-gdf62bdcc (df62bdccd9a13bf566b27a250eddfdd89be3072d) quincy (stable)": 8, 2024-08-18T22:45:26.913 INFO:teuthology.orchestra.run.smithi121.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 5 2024-08-18T22:45:26.913 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-08-18T22:45:26.913 INFO:teuthology.orchestra.run.smithi121.stdout:} 2024-08-18T22:45:26.913 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:26.912+0000 7f487f515640 1 -- 172.21.15.121:0/2468799631 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f486406e0b0 msgr2=0x7f4864070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:45:26.914 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:26.912+0000 7f487f515640 1 --2- 172.21.15.121:0/2468799631 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f486406e0b0 0x7f4864070560 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f4874000c00 tx=0x7f4874035040 comp rx=0 tx=0).stop 2024-08-18T22:45:26.914 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:26.912+0000 7f487f515640 1 -- 172.21.15.121:0/2468799631 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f48780fd5c0 msgr2=0x7f487810d3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:45:26.914 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:26.912+0000 7f487f515640 1 --2- 172.21.15.121:0/2468799631 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f48780fd5c0 0x7f487810d3d0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f486800c810 tx=0x7f48680043c0 comp rx=0 tx=0).stop 2024-08-18T22:45:26.914 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:26.912+0000 7f487f515640 1 -- 172.21.15.121:0/2468799631 shutdown_connections 2024-08-18T22:45:26.914 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:26.912+0000 7f487f515640 1 --2- 172.21.15.121:0/2468799631 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f486406e0b0 0x7f4864070560 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:45:26.914 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:26.912+0000 7f487f515640 1 --2- 172.21.15.121:0/2468799631 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f48780fd5c0 0x7f487810d3d0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:45:26.914 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:26.912+0000 7f487f515640 1 --2- 172.21.15.121:0/2468799631 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f48780fc2f0 0x7f487810ce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:45:26.915 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:26.912+0000 7f487f515640 1 -- 172.21.15.121:0/2468799631 >> 172.21.15.121:0/2468799631 conn(0x7f48780f7ad0 msgr2=0x7f48780f92a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:45:26.915 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:26.912+0000 7f487f515640 1 -- 172.21.15.121:0/2468799631 shutdown_connections 2024-08-18T22:45:26.916 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:26.912+0000 7f487f515640 1 -- 172.21.15.121:0/2468799631 wait complete. 2024-08-18T22:45:27.000 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:26.996+0000 7f51025de640 1 -- 172.21.15.121:0/2437212632 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f50fc0fc2e0 msgr2=0x7f50fc0fc6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:45:27.000 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:26.996+0000 7f51025de640 1 --2- 172.21.15.121:0/2437212632 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f50fc0fc2e0 0x7f50fc0fc6f0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f50ec0048d0 tx=0x7f50ec009da0 comp rx=0 tx=0).stop 2024-08-18T22:45:27.001 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:26.996+0000 7f51025de640 1 -- 172.21.15.121:0/2437212632 shutdown_connections 2024-08-18T22:45:27.001 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:26.996+0000 7f51025de640 1 --2- 172.21.15.121:0/2437212632 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f50fc0fd5b0 0x7f50fc0fda20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:45:27.001 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:26.996+0000 7f51025de640 1 --2- 172.21.15.121:0/2437212632 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f50fc0fc2e0 0x7f50fc0fc6f0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:45:27.001 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:26.996+0000 7f51025de640 1 -- 172.21.15.121:0/2437212632 >> 172.21.15.121:0/2437212632 conn(0x7f50fc0f7a80 msgr2=0x7f50fc0f9ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:45:27.001 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:26.996+0000 7f51025de640 1 -- 172.21.15.121:0/2437212632 shutdown_connections 2024-08-18T22:45:27.001 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:26.997+0000 7f51025de640 1 -- 172.21.15.121:0/2437212632 wait complete. 2024-08-18T22:45:27.001 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:26.997+0000 7f51025de640 1 Processor -- start 2024-08-18T22:45:27.001 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:26.997+0000 7f51025de640 1 -- start start 2024-08-18T22:45:27.001 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:26.997+0000 7f51025de640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f50fc0fc2e0 0x7f50fc10cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:45:27.001 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:26.997+0000 7f51025de640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f50fc0fd5b0 0x7f50fc10d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:45:27.002 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:26.997+0000 7f51025de640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50fc10e1d0 con 0x7f50fc0fd5b0 2024-08-18T22:45:27.002 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:26.997+0000 7f51025de640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50fc10e340 con 0x7f50fc0fc2e0 2024-08-18T22:45:27.002 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:26.998+0000 7f50fb7fe640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f50fc0fd5b0 0x7f50fc10d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:45:27.002 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:26.998+0000 7f50fb7fe640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f50fc0fd5b0 0x7f50fc10d440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:57056/0 (socket says 172.21.15.121:57056) 2024-08-18T22:45:27.002 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:26.998+0000 7f50fb7fe640 1 -- 172.21.15.121:0/3230055343 learned_addr learned my addr 172.21.15.121:0/3230055343 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-18T22:45:27.002 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:26.998+0000 7f50fbfff640 1 --2- 172.21.15.121:0/3230055343 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f50fc0fc2e0 0x7f50fc10cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:45:27.002 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:26.998+0000 7f50fb7fe640 1 -- 172.21.15.121:0/3230055343 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f50fc0fc2e0 msgr2=0x7f50fc10cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:45:27.002 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:26.998+0000 7f50fb7fe640 1 --2- 172.21.15.121:0/3230055343 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f50fc0fc2e0 0x7f50fc10cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:45:27.002 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:26.998+0000 7f50fb7fe640 1 -- 172.21.15.121:0/3230055343 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50ec005040 con 0x7f50fc0fd5b0 2024-08-18T22:45:27.002 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:26.998+0000 7f50fb7fe640 1 --2- 172.21.15.121:0/3230055343 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f50fc0fd5b0 0x7f50fc10d440 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f50f000b790 tx=0x7f50f00091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:45:27.002 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:26.998+0000 7f50f8ff9640 1 -- 172.21.15.121:0/3230055343 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f50f000c700 con 0x7f50fc0fd5b0 2024-08-18T22:45:27.003 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:26.998+0000 7f50f8ff9640 1 -- 172.21.15.121:0/3230055343 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f50f000cd00 con 0x7f50fc0fd5b0 2024-08-18T22:45:27.003 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:26.998+0000 7f51025de640 1 -- 172.21.15.121:0/3230055343 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50fc10e620 con 0x7f50fc0fd5b0 2024-08-18T22:45:27.003 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:26.998+0000 7f50f8ff9640 1 -- 172.21.15.121:0/3230055343 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f50f0015e80 con 0x7f50fc0fd5b0 2024-08-18T22:45:27.003 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:26.998+0000 7f51025de640 1 -- 172.21.15.121:0/3230055343 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50fc10eb40 con 0x7f50fc0fd5b0 2024-08-18T22:45:27.003 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:26.999+0000 7f51025de640 1 -- 172.21.15.121:0/3230055343 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50fc0fb740 con 0x7f50fc0fd5b0 2024-08-18T22:45:27.004 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:27.000+0000 7f50f8ff9640 1 -- 172.21.15.121:0/3230055343 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 37) v1 ==== 92205+0+0 (secure 0 0 0) 0x7f50f0012070 con 0x7f50fc0fd5b0 2024-08-18T22:45:27.004 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:27.000+0000 7f50f8ff9640 1 --2- 172.21.15.121:0/3230055343 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f50e406e0b0 0x7f50e4070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:45:27.004 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:27.001+0000 7f50f8ff9640 1 -- 172.21.15.121:0/3230055343 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f50f008d4b0 con 0x7f50fc0fd5b0 2024-08-18T22:45:27.004 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:27.001+0000 7f50fbfff640 1 --2- 172.21.15.121:0/3230055343 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f50e406e0b0 0x7f50e4070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:45:27.004 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:27.001+0000 7f50fbfff640 1 --2- 172.21.15.121:0/3230055343 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f50e406e0b0 0x7f50e4070560 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f50ec000c00 tx=0x7f50ec035040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:45:27.005 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:27.005+0000 7f50f8ff9640 1 -- 172.21.15.121:0/3230055343 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f50f00567e0 con 0x7f50fc0fd5b0 2024-08-18T22:45:27.208 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:27.207+0000 7f51025de640 1 -- 172.21.15.121:0/3230055343 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f50fc10e7b0 con 0x7f50fc0fd5b0 2024-08-18T22:45:27.208 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:27.207+0000 7f50f8ff9640 1 -- 172.21.15.121:0/3230055343 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 21 v21) v1 ==== 76+0+1959 (secure 0 0 0) 0x7f50fc10e7b0 con 0x7f50fc0fd5b0 2024-08-18T22:45:27.209 INFO:teuthology.orchestra.run.smithi121.stdout:e21 2024-08-18T22:45:27.209 INFO:teuthology.orchestra.run.smithi121.stdout:btime 2024-08-18T22:45:20:594604+0000 2024-08-18T22:45:27.209 INFO:teuthology.orchestra.run.smithi121.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-08-18T22:45:27.209 INFO:teuthology.orchestra.run.smithi121.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-08-18T22:45:27.209 INFO:teuthology.orchestra.run.smithi121.stdout:legacy client fscid: 1 2024-08-18T22:45:27.209 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-08-18T22:45:27.209 INFO:teuthology.orchestra.run.smithi121.stdout:Filesystem 'cephfs' (1) 2024-08-18T22:45:27.209 INFO:teuthology.orchestra.run.smithi121.stdout:fs_name cephfs 2024-08-18T22:45:27.209 INFO:teuthology.orchestra.run.smithi121.stdout:epoch 21 2024-08-18T22:45:27.209 INFO:teuthology.orchestra.run.smithi121.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-08-18T22:45:27.210 INFO:teuthology.orchestra.run.smithi121.stdout:created 2024-08-18T22:39:04.054074+0000 2024-08-18T22:45:27.210 INFO:teuthology.orchestra.run.smithi121.stdout:modified 2024-08-18T22:45:20.287451+0000 2024-08-18T22:45:27.210 INFO:teuthology.orchestra.run.smithi121.stdout:tableserver 0 2024-08-18T22:45:27.210 INFO:teuthology.orchestra.run.smithi121.stdout:root 0 2024-08-18T22:45:27.210 INFO:teuthology.orchestra.run.smithi121.stdout:session_timeout 60 2024-08-18T22:45:27.210 INFO:teuthology.orchestra.run.smithi121.stdout:session_autoclose 300 2024-08-18T22:45:27.210 INFO:teuthology.orchestra.run.smithi121.stdout:max_file_size 1099511627776 2024-08-18T22:45:27.210 INFO:teuthology.orchestra.run.smithi121.stdout:max_xattr_size 65536 2024-08-18T22:45:27.210 INFO:teuthology.orchestra.run.smithi121.stdout:required_client_features {} 2024-08-18T22:45:27.210 INFO:teuthology.orchestra.run.smithi121.stdout:last_failure 0 2024-08-18T22:45:27.210 INFO:teuthology.orchestra.run.smithi121.stdout:last_failure_osd_epoch 47 2024-08-18T22:45:27.210 INFO:teuthology.orchestra.run.smithi121.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-08-18T22:45:27.210 INFO:teuthology.orchestra.run.smithi121.stdout:max_mds 2 2024-08-18T22:45:27.211 INFO:teuthology.orchestra.run.smithi121.stdout:in 0,1 2024-08-18T22:45:27.211 INFO:teuthology.orchestra.run.smithi121.stdout:up {0=14474,1=24249} 2024-08-18T22:45:27.211 INFO:teuthology.orchestra.run.smithi121.stdout:failed 2024-08-18T22:45:27.211 INFO:teuthology.orchestra.run.smithi121.stdout:damaged 2024-08-18T22:45:27.211 INFO:teuthology.orchestra.run.smithi121.stdout:stopped 2024-08-18T22:45:27.211 INFO:teuthology.orchestra.run.smithi121.stdout:data_pools [3] 2024-08-18T22:45:27.211 INFO:teuthology.orchestra.run.smithi121.stdout:metadata_pool 2 2024-08-18T22:45:27.211 INFO:teuthology.orchestra.run.smithi121.stdout:inline_data disabled 2024-08-18T22:45:27.211 INFO:teuthology.orchestra.run.smithi121.stdout:balancer 2024-08-18T22:45:27.211 INFO:teuthology.orchestra.run.smithi121.stdout:bal_rank_mask -1 2024-08-18T22:45:27.211 INFO:teuthology.orchestra.run.smithi121.stdout:standby_count_wanted 1 2024-08-18T22:45:27.211 INFO:teuthology.orchestra.run.smithi121.stdout:qdb_cluster leader: 14474 members: 24249,14474 2024-08-18T22:45:27.211 INFO:teuthology.orchestra.run.smithi121.stdout:[mds.cephfs.smithi121.gbickb{0:14474} state up:active seq 83 join_fscid=1 addr [v2:172.21.15.121:6828/2277706406,v1:172.21.15.121:6829/2277706406] compat {c=[1],r=[1],i=[7ff]}] 2024-08-18T22:45:27.211 INFO:teuthology.orchestra.run.smithi121.stdout:[mds.cephfs.smithi195.buqvbr{1:24249} state up:active seq 4 export targets 0 join_fscid=1 addr [v2:172.21.15.195:6824/2414511859,v1:172.21.15.195:6825/2414511859] compat {c=[1],r=[1],i=[7ff]}] 2024-08-18T22:45:27.212 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-08-18T22:45:27.212 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-08-18T22:45:27.212 INFO:teuthology.orchestra.run.smithi121.stdout:Standby daemons: 2024-08-18T22:45:27.212 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-08-18T22:45:27.212 INFO:teuthology.orchestra.run.smithi121.stdout:[mds.cephfs.smithi121.xuzsdg{-1:14490} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.121:6826/91588128,v1:172.21.15.121:6827/91588128] compat {c=[1],r=[1],i=[7ff]}] 2024-08-18T22:45:27.212 INFO:teuthology.orchestra.run.smithi121.stdout:[mds.cephfs.smithi195.nptgyc{-1:24259} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.195:6826/238549847,v1:172.21.15.195:6827/238549847] compat {c=[1],r=[1],i=[7ff]}] 2024-08-18T22:45:27.212 INFO:teuthology.orchestra.run.smithi121.stderr:dumped fsmap epoch 21 2024-08-18T22:45:27.213 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:27.209+0000 7f51025de640 1 -- 172.21.15.121:0/3230055343 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f50e406e0b0 msgr2=0x7f50e4070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:45:27.213 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:27.209+0000 7f51025de640 1 --2- 172.21.15.121:0/3230055343 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f50e406e0b0 0x7f50e4070560 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f50ec000c00 tx=0x7f50ec035040 comp rx=0 tx=0).stop 2024-08-18T22:45:27.213 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:27.209+0000 7f51025de640 1 -- 172.21.15.121:0/3230055343 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f50fc0fd5b0 msgr2=0x7f50fc10d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:45:27.213 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:27.209+0000 7f51025de640 1 --2- 172.21.15.121:0/3230055343 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f50fc0fd5b0 0x7f50fc10d440 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f50f000b790 tx=0x7f50f00091d0 comp rx=0 tx=0).stop 2024-08-18T22:45:27.213 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:27.209+0000 7f51025de640 1 -- 172.21.15.121:0/3230055343 shutdown_connections 2024-08-18T22:45:27.213 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:27.209+0000 7f51025de640 1 --2- 172.21.15.121:0/3230055343 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f50e406e0b0 0x7f50e4070560 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:45:27.213 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:27.209+0000 7f51025de640 1 --2- 172.21.15.121:0/3230055343 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f50fc0fd5b0 0x7f50fc10d440 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:45:27.213 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:27.209+0000 7f51025de640 1 --2- 172.21.15.121:0/3230055343 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f50fc0fc2e0 0x7f50fc10cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:45:27.213 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:27.209+0000 7f51025de640 1 -- 172.21.15.121:0/3230055343 >> 172.21.15.121:0/3230055343 conn(0x7f50fc0f7a80 msgr2=0x7f50fc0f92a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:45:27.213 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:27.210+0000 7f51025de640 1 -- 172.21.15.121:0/3230055343 shutdown_connections 2024-08-18T22:45:27.213 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:27.210+0000 7f51025de640 1 -- 172.21.15.121:0/3230055343 wait complete. 2024-08-18T22:45:27.292 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:27.289+0000 7f46bbb63640 1 -- 172.21.15.121:0/2905136591 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f46b40fb1d0 msgr2=0x7f46b40fb5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:45:27.292 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:27.289+0000 7f46bbb63640 1 --2- 172.21.15.121:0/2905136591 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f46b40fb1d0 0x7f46b40fb5e0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f46a80048d0 tx=0x7f46a8009da0 comp rx=0 tx=0).stop 2024-08-18T22:45:27.292 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:27.289+0000 7f46bbb63640 1 -- 172.21.15.121:0/2905136591 shutdown_connections 2024-08-18T22:45:27.293 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:27.289+0000 7f46bbb63640 1 --2- 172.21.15.121:0/2905136591 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f46b40fc4a0 0x7f46b40fc910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:45:27.293 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:27.289+0000 7f46bbb63640 1 --2- 172.21.15.121:0/2905136591 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f46b40fb1d0 0x7f46b40fb5e0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:45:27.293 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:27.289+0000 7f46bbb63640 1 -- 172.21.15.121:0/2905136591 >> 172.21.15.121:0/2905136591 conn(0x7f46b40f69b0 msgr2=0x7f46b40f8dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:45:27.293 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:27.290+0000 7f46bbb63640 1 -- 172.21.15.121:0/2905136591 shutdown_connections 2024-08-18T22:45:27.293 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:27.290+0000 7f46bbb63640 1 -- 172.21.15.121:0/2905136591 wait complete. 2024-08-18T22:45:27.293 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:27.290+0000 7f46bbb63640 1 Processor -- start 2024-08-18T22:45:27.293 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:27.290+0000 7f46bbb63640 1 -- start start 2024-08-18T22:45:27.293 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:27.290+0000 7f46bbb63640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f46b40fb1d0 0x7f46b410fae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:45:27.293 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:27.290+0000 7f46bbb63640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f46b40fc4a0 0x7f46b4112030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:45:27.293 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:27.290+0000 7f46bbb63640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46b4065a60 con 0x7f46b40fc4a0 2024-08-18T22:45:27.293 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:27.290+0000 7f46bbb63640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46b4065bd0 con 0x7f46b40fb1d0 2024-08-18T22:45:27.294 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:27.290+0000 7f46b90fe640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f46b40fc4a0 0x7f46b4112030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:45:27.294 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:27.290+0000 7f46b90fe640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f46b40fc4a0 0x7f46b4112030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:57060/0 (socket says 172.21.15.121:57060) 2024-08-18T22:45:27.294 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:27.290+0000 7f46b90fe640 1 -- 172.21.15.121:0/1280586382 learned_addr learned my addr 172.21.15.121:0/1280586382 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-18T22:45:27.294 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:27.291+0000 7f46b98ff640 1 --2- 172.21.15.121:0/1280586382 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f46b40fb1d0 0x7f46b410fae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:45:27.294 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:27.291+0000 7f46b90fe640 1 -- 172.21.15.121:0/1280586382 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f46b40fb1d0 msgr2=0x7f46b410fae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:45:27.294 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:27.291+0000 7f46b90fe640 1 --2- 172.21.15.121:0/1280586382 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f46b40fb1d0 0x7f46b410fae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:45:27.294 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:27.291+0000 7f46b90fe640 1 -- 172.21.15.121:0/1280586382 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46a8005040 con 0x7f46b40fc4a0 2024-08-18T22:45:27.294 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:27.291+0000 7f46b90fe640 1 --2- 172.21.15.121:0/1280586382 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f46b40fc4a0 0x7f46b4112030 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f46b000c810 tx=0x7f46b00043c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:45:27.294 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:27.291+0000 7f46a67fc640 1 -- 172.21.15.121:0/1280586382 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f46b000a820 con 0x7f46b40fc4a0 2024-08-18T22:45:27.294 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:27.291+0000 7f46a67fc640 1 -- 172.21.15.121:0/1280586382 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f46b000ae20 con 0x7f46b40fc4a0 2024-08-18T22:45:27.294 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:27.291+0000 7f46a67fc640 1 -- 172.21.15.121:0/1280586382 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f46b00115c0 con 0x7f46b40fc4a0 2024-08-18T22:45:27.295 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:27.291+0000 7f46bbb63640 1 -- 172.21.15.121:0/1280586382 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46b4112630 con 0x7f46b40fc4a0 2024-08-18T22:45:27.295 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:27.291+0000 7f46bbb63640 1 -- 172.21.15.121:0/1280586382 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46b4112ba0 con 0x7f46b40fc4a0 2024-08-18T22:45:27.296 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:27.292+0000 7f46bbb63640 1 -- 172.21.15.121:0/1280586382 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46b40fa630 con 0x7f46b40fc4a0 2024-08-18T22:45:27.296 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:27.293+0000 7f46a67fc640 1 -- 172.21.15.121:0/1280586382 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 37) v1 ==== 92205+0+0 (secure 0 0 0) 0x7f46b0012840 con 0x7f46b40fc4a0 2024-08-18T22:45:27.296 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:27.293+0000 7f46a67fc640 1 --2- 172.21.15.121:0/1280586382 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f46a006e0b0 0x7f46a0070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:45:27.296 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:27.293+0000 7f46b98ff640 1 --2- 172.21.15.121:0/1280586382 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f46a006e0b0 0x7f46a0070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:45:27.296 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:27.293+0000 7f46a67fc640 1 -- 172.21.15.121:0/1280586382 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f46b008e140 con 0x7f46b40fc4a0 2024-08-18T22:45:27.296 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:27.294+0000 7f46b98ff640 1 --2- 172.21.15.121:0/1280586382 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f46a006e0b0 0x7f46a0070560 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f46a8007ac0 tx=0x7f46a8035040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:45:27.299 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:27.298+0000 7f46a67fc640 1 -- 172.21.15.121:0/1280586382 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f46b005afa0 con 0x7f46b40fc4a0 2024-08-18T22:45:27.507 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:27.506+0000 7f46bbb63640 1 -- 172.21.15.121:0/1280586382 --> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f46b4100900 con 0x7f46a006e0b0 2024-08-18T22:45:27.508 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:27.507+0000 7f46a67fc640 1 -- 172.21.15.121:0/1280586382 <== mgr.34102 v2:172.21.15.121:6800/3037387239 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f46b4100900 con 0x7f46a006e0b0 2024-08-18T22:45:27.508 INFO:teuthology.orchestra.run.smithi121.stdout:{ 2024-08-18T22:45:27.508 INFO:teuthology.orchestra.run.smithi121.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9", 2024-08-18T22:45:27.509 INFO:teuthology.orchestra.run.smithi121.stdout: "in_progress": true, 2024-08-18T22:45:27.509 INFO:teuthology.orchestra.run.smithi121.stdout: "which": "Upgrading all daemon types on all hosts", 2024-08-18T22:45:27.509 INFO:teuthology.orchestra.run.smithi121.stdout: "services_complete": [ 2024-08-18T22:45:27.509 INFO:teuthology.orchestra.run.smithi121.stdout: "mgr", 2024-08-18T22:45:27.509 INFO:teuthology.orchestra.run.smithi121.stdout: "mon", 2024-08-18T22:45:27.509 INFO:teuthology.orchestra.run.smithi121.stdout: "crash" 2024-08-18T22:45:27.509 INFO:teuthology.orchestra.run.smithi121.stdout: ], 2024-08-18T22:45:27.509 INFO:teuthology.orchestra.run.smithi121.stdout: "progress": "7/21 daemons upgraded", 2024-08-18T22:45:27.509 INFO:teuthology.orchestra.run.smithi121.stdout: "message": "Currently upgrading osd daemons", 2024-08-18T22:45:27.510 INFO:teuthology.orchestra.run.smithi121.stdout: "is_paused": false 2024-08-18T22:45:27.510 INFO:teuthology.orchestra.run.smithi121.stdout:} 2024-08-18T22:45:27.511 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:27.509+0000 7f46bbb63640 1 -- 172.21.15.121:0/1280586382 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f46a006e0b0 msgr2=0x7f46a0070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:45:27.512 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:27.509+0000 7f46bbb63640 1 --2- 172.21.15.121:0/1280586382 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f46a006e0b0 0x7f46a0070560 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f46a8007ac0 tx=0x7f46a8035040 comp rx=0 tx=0).stop 2024-08-18T22:45:27.512 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:27.509+0000 7f46bbb63640 1 -- 172.21.15.121:0/1280586382 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f46b40fc4a0 msgr2=0x7f46b4112030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:45:27.512 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:27.509+0000 7f46bbb63640 1 --2- 172.21.15.121:0/1280586382 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f46b40fc4a0 0x7f46b4112030 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f46b000c810 tx=0x7f46b00043c0 comp rx=0 tx=0).stop 2024-08-18T22:45:27.512 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:27.509+0000 7f46bbb63640 1 -- 172.21.15.121:0/1280586382 shutdown_connections 2024-08-18T22:45:27.512 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:27.509+0000 7f46bbb63640 1 --2- 172.21.15.121:0/1280586382 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f46a006e0b0 0x7f46a0070560 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:45:27.512 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:27.509+0000 7f46bbb63640 1 --2- 172.21.15.121:0/1280586382 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f46b40fc4a0 0x7f46b4112030 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:45:27.512 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:27.509+0000 7f46bbb63640 1 --2- 172.21.15.121:0/1280586382 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f46b40fb1d0 0x7f46b410fae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:45:27.512 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:27.509+0000 7f46bbb63640 1 -- 172.21.15.121:0/1280586382 >> 172.21.15.121:0/1280586382 conn(0x7f46b40f69b0 msgr2=0x7f46b40f8180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:45:27.512 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:27.510+0000 7f46bbb63640 1 -- 172.21.15.121:0/1280586382 shutdown_connections 2024-08-18T22:45:27.512 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:27.510+0000 7f46bbb63640 1 -- 172.21.15.121:0/1280586382 wait complete. 2024-08-18T22:45:27.590 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:27.588+0000 7f3abb97f640 1 -- 172.21.15.121:0/1626598662 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3ab40fc490 msgr2=0x7f3ab40fc900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:45:27.590 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:27.588+0000 7f3abb97f640 1 --2- 172.21.15.121:0/1626598662 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3ab40fc490 0x7f3ab40fc900 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f3aa40048d0 tx=0x7f3aa4009da0 comp rx=0 tx=0).stop 2024-08-18T22:45:27.590 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:27.588+0000 7f3abb97f640 1 -- 172.21.15.121:0/1626598662 shutdown_connections 2024-08-18T22:45:27.590 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:27.588+0000 7f3abb97f640 1 --2- 172.21.15.121:0/1626598662 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3ab40fc490 0x7f3ab40fc900 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:45:27.590 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:27.588+0000 7f3abb97f640 1 --2- 172.21.15.121:0/1626598662 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3ab40fb1c0 0x7f3ab40fb5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:45:27.590 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:27.589+0000 7f3abb97f640 1 -- 172.21.15.121:0/1626598662 >> 172.21.15.121:0/1626598662 conn(0x7f3ab40f69a0 msgr2=0x7f3ab40f8db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:45:27.590 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:27.589+0000 7f3abb97f640 1 -- 172.21.15.121:0/1626598662 shutdown_connections 2024-08-18T22:45:27.590 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:27.589+0000 7f3abb97f640 1 -- 172.21.15.121:0/1626598662 wait complete. 2024-08-18T22:45:27.592 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:27.589+0000 7f3abb97f640 1 Processor -- start 2024-08-18T22:45:27.592 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:27.589+0000 7f3abb97f640 1 -- start start 2024-08-18T22:45:27.592 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:27.589+0000 7f3abb97f640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3ab40fb1c0 0x7f3ab410bd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:45:27.592 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:27.589+0000 7f3abb97f640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3ab40fc490 0x7f3ab410c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:45:27.592 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:27.589+0000 7f3abb97f640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ab410c910 con 0x7f3ab40fb1c0 2024-08-18T22:45:27.592 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:27.589+0000 7f3abb97f640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ab410d050 con 0x7f3ab40fc490 2024-08-18T22:45:27.592 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:27.590+0000 7f3ab971b640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3ab40fb1c0 0x7f3ab410bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:45:27.592 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:27.590+0000 7f3ab971b640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3ab40fb1c0 0x7f3ab410bd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:57084/0 (socket says 172.21.15.121:57084) 2024-08-18T22:45:27.593 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:27.590+0000 7f3ab971b640 1 -- 172.21.15.121:0/3802895926 learned_addr learned my addr 172.21.15.121:0/3802895926 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-18T22:45:27.593 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:27.590+0000 7f3ab8f1a640 1 --2- 172.21.15.121:0/3802895926 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3ab40fc490 0x7f3ab410c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:45:27.593 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:27.590+0000 7f3ab971b640 1 -- 172.21.15.121:0/3802895926 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3ab40fc490 msgr2=0x7f3ab410c2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:45:27.593 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:27.590+0000 7f3ab971b640 1 --2- 172.21.15.121:0/3802895926 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3ab40fc490 0x7f3ab410c2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:45:27.593 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:27.590+0000 7f3ab971b640 1 -- 172.21.15.121:0/3802895926 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3aa4005040 con 0x7f3ab40fb1c0 2024-08-18T22:45:27.593 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:27.590+0000 7f3ab971b640 1 --2- 172.21.15.121:0/3802895926 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3ab40fb1c0 0x7f3ab410bd80 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f3ab000fce0 tx=0x7f3ab0004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:45:27.593 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:27.590+0000 7f3aa9ffb640 1 -- 172.21.15.121:0/3802895926 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3ab0007a20 con 0x7f3ab40fb1c0 2024-08-18T22:45:27.593 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:27.590+0000 7f3abb97f640 1 -- 172.21.15.121:0/3802895926 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ab410d2e0 con 0x7f3ab40fb1c0 2024-08-18T22:45:27.593 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:27.590+0000 7f3aa9ffb640 1 -- 172.21.15.121:0/3802895926 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f3ab0007b80 con 0x7f3ab40fb1c0 2024-08-18T22:45:27.593 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:27.590+0000 7f3aa9ffb640 1 -- 172.21.15.121:0/3802895926 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3ab00126a0 con 0x7f3ab40fb1c0 2024-08-18T22:45:27.593 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:27.590+0000 7f3abb97f640 1 -- 172.21.15.121:0/3802895926 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ab410d880 con 0x7f3ab40fb1c0 2024-08-18T22:45:27.594 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:27.591+0000 7f3abb97f640 1 -- 172.21.15.121:0/3802895926 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ab40fa620 con 0x7f3ab40fb1c0 2024-08-18T22:45:27.594 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:27.592+0000 7f3aa9ffb640 1 -- 172.21.15.121:0/3802895926 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 37) v1 ==== 92205+0+0 (secure 0 0 0) 0x7f3ab0007cf0 con 0x7f3ab40fb1c0 2024-08-18T22:45:27.594 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:27.592+0000 7f3aa9ffb640 1 --2- 172.21.15.121:0/3802895926 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f3aa006e0b0 0x7f3aa0070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:45:27.595 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:27.592+0000 7f3aa9ffb640 1 -- 172.21.15.121:0/3802895926 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f3ab00901b0 con 0x7f3ab40fb1c0 2024-08-18T22:45:27.595 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:27.593+0000 7f3ab8f1a640 1 --2- 172.21.15.121:0/3802895926 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f3aa006e0b0 0x7f3aa0070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:45:27.595 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:27.593+0000 7f3ab8f1a640 1 --2- 172.21.15.121:0/3802895926 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f3aa006e0b0 0x7f3aa0070560 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f3aa4007ac0 tx=0x7f3aa4035040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:45:27.598 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:27.597+0000 7f3aa9ffb640 1 -- 172.21.15.121:0/3802895926 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f3ab00594e0 con 0x7f3ab40fb1c0 2024-08-18T22:45:27.790 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:45:27 smithi121 ceph-mon[81053]: from='client.34222 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-18T22:45:27.790 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:45:27 smithi121 ceph-mon[81053]: from='client.34226 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-18T22:45:27.790 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:45:27 smithi121 ceph-mon[81053]: pgmap v64: 65 pgs: 5 peering, 29 active+undersized+degraded, 31 active+clean; 2.0 GiB data, 7.3 GiB used, 529 GiB / 536 GiB avail; 5301/34143 objects degraded (15.526%) 2024-08-18T22:45:27.790 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:45:27 smithi121 ceph-mon[81053]: from='client.34230 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-18T22:45:27.790 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:45:27 smithi121 ceph-mon[81053]: from='client.? 172.21.15.121:0/2468799631' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-08-18T22:45:27.790 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:45:27 smithi121 ceph-mon[81053]: from='client.? 172.21.15.121:0/3230055343' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-08-18T22:45:27.845 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:27.844+0000 7f3abb97f640 1 -- 172.21.15.121:0/3802895926 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f3ab404b4c0 con 0x7f3ab40fb1c0 2024-08-18T22:45:27.845 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:27.844+0000 7f3aa9ffb640 1 -- 172.21.15.121:0/3802895926 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+2388 (secure 0 0 0) 0x7f3ab005cba0 con 0x7f3ab40fb1c0 2024-08-18T22:45:27.845 INFO:teuthology.orchestra.run.smithi121.stdout:HEALTH_WARN 1 MDSs report slow requests; 1 osds down; Reduced data availability: 3 pgs peering; Degraded data redundancy: 5301/34143 objects degraded (15.526%), 29 pgs degraded 2024-08-18T22:45:27.846 INFO:teuthology.orchestra.run.smithi121.stdout:[WRN] MDS_SLOW_REQUEST: 1 MDSs report slow requests 2024-08-18T22:45:27.846 INFO:teuthology.orchestra.run.smithi121.stdout: mds.cephfs.smithi121.gbickb(mds.0): 3 slow requests are blocked > 180 secs 2024-08-18T22:45:27.846 INFO:teuthology.orchestra.run.smithi121.stdout:[WRN] OSD_DOWN: 1 osds down 2024-08-18T22:45:27.846 INFO:teuthology.orchestra.run.smithi121.stdout: osd.1 (root=default,host=smithi121) is down 2024-08-18T22:45:27.846 INFO:teuthology.orchestra.run.smithi121.stdout:[WRN] PG_AVAILABILITY: Reduced data availability: 3 pgs peering 2024-08-18T22:45:27.846 INFO:teuthology.orchestra.run.smithi121.stdout: pg 2.4 is stuck peering for 2m, current state peering, last acting [0,4] 2024-08-18T22:45:27.846 INFO:teuthology.orchestra.run.smithi121.stdout: pg 2.1b is stuck peering for 4m, current state peering, last acting [0,5] 2024-08-18T22:45:27.846 INFO:teuthology.orchestra.run.smithi121.stdout: pg 3.b is stuck peering for 2m, current state peering, last acting [0,4] 2024-08-18T22:45:27.846 INFO:teuthology.orchestra.run.smithi121.stdout:[WRN] PG_DEGRADED: Degraded data redundancy: 5301/34143 objects degraded (15.526%), 29 pgs degraded 2024-08-18T22:45:27.846 INFO:teuthology.orchestra.run.smithi121.stdout: pg 1.0 is active+undersized+degraded, acting [3,0] 2024-08-18T22:45:27.846 INFO:teuthology.orchestra.run.smithi121.stdout: pg 2.0 is active+undersized+degraded, acting [3,0] 2024-08-18T22:45:27.846 INFO:teuthology.orchestra.run.smithi121.stdout: pg 2.1 is active+undersized+degraded, acting [2,0] 2024-08-18T22:45:27.847 INFO:teuthology.orchestra.run.smithi121.stdout: pg 2.2 is active+undersized+degraded, acting [5,0] 2024-08-18T22:45:27.847 INFO:teuthology.orchestra.run.smithi121.stdout: pg 2.3 is active+undersized+degraded, acting [5,2] 2024-08-18T22:45:27.847 INFO:teuthology.orchestra.run.smithi121.stdout: pg 2.6 is active+undersized+degraded, acting [3,4] 2024-08-18T22:45:27.847 INFO:teuthology.orchestra.run.smithi121.stdout: pg 2.9 is active+undersized+degraded, acting [4,0] 2024-08-18T22:45:27.847 INFO:teuthology.orchestra.run.smithi121.stdout: pg 2.a is active+undersized+degraded, acting [4,3] 2024-08-18T22:45:27.847 INFO:teuthology.orchestra.run.smithi121.stdout: pg 2.d is active+undersized+degraded, acting [3,2] 2024-08-18T22:45:27.847 INFO:teuthology.orchestra.run.smithi121.stdout: pg 2.10 is active+undersized+degraded, acting [2,0] 2024-08-18T22:45:27.847 INFO:teuthology.orchestra.run.smithi121.stdout: pg 2.11 is active+undersized+degraded, acting [4,3] 2024-08-18T22:45:27.847 INFO:teuthology.orchestra.run.smithi121.stdout: pg 2.12 is active+undersized+degraded, acting [3,0] 2024-08-18T22:45:27.847 INFO:teuthology.orchestra.run.smithi121.stdout: pg 2.15 is active+undersized+degraded, acting [3,0] 2024-08-18T22:45:27.847 INFO:teuthology.orchestra.run.smithi121.stdout: pg 2.17 is active+undersized+degraded, acting [5,2] 2024-08-18T22:45:27.847 INFO:teuthology.orchestra.run.smithi121.stdout: pg 3.0 is active+undersized+degraded, acting [2,4] 2024-08-18T22:45:27.847 INFO:teuthology.orchestra.run.smithi121.stdout: pg 3.2 is active+undersized+degraded, acting [5,3] 2024-08-18T22:45:27.847 INFO:teuthology.orchestra.run.smithi121.stdout: pg 3.4 is active+undersized+degraded, acting [2,3] 2024-08-18T22:45:27.848 INFO:teuthology.orchestra.run.smithi121.stdout: pg 3.7 is active+undersized+degraded, acting [2,4] 2024-08-18T22:45:27.848 INFO:teuthology.orchestra.run.smithi121.stdout: pg 3.8 is active+undersized+degraded, acting [2,5] 2024-08-18T22:45:27.848 INFO:teuthology.orchestra.run.smithi121.stdout: pg 3.a is active+undersized+degraded, acting [3,4] 2024-08-18T22:45:27.848 INFO:teuthology.orchestra.run.smithi121.stdout: pg 3.e is active+undersized+degraded, acting [5,4] 2024-08-18T22:45:27.848 INFO:teuthology.orchestra.run.smithi121.stdout: pg 3.10 is active+undersized+degraded, acting [5,0] 2024-08-18T22:45:27.848 INFO:teuthology.orchestra.run.smithi121.stdout: pg 3.16 is active+undersized+degraded, acting [5,3] 2024-08-18T22:45:27.848 INFO:teuthology.orchestra.run.smithi121.stdout: pg 3.18 is active+undersized+degraded, acting [2,0] 2024-08-18T22:45:27.848 INFO:teuthology.orchestra.run.smithi121.stdout: pg 3.19 is active+undersized+degraded, acting [4,3] 2024-08-18T22:45:27.848 INFO:teuthology.orchestra.run.smithi121.stdout: pg 3.1a is active+undersized+degraded, acting [4,2] 2024-08-18T22:45:27.848 INFO:teuthology.orchestra.run.smithi121.stdout: pg 3.1c is active+undersized+degraded, acting [5,4] 2024-08-18T22:45:27.848 INFO:teuthology.orchestra.run.smithi121.stdout: pg 3.1d is active+undersized+degraded, acting [5,4] 2024-08-18T22:45:27.848 INFO:teuthology.orchestra.run.smithi121.stdout: pg 3.1e is active+undersized+degraded, acting [2,3] 2024-08-18T22:45:27.849 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:27.846+0000 7f3abb97f640 1 -- 172.21.15.121:0/3802895926 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f3aa006e0b0 msgr2=0x7f3aa0070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:45:27.849 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:27.846+0000 7f3abb97f640 1 --2- 172.21.15.121:0/3802895926 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f3aa006e0b0 0x7f3aa0070560 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f3aa4007ac0 tx=0x7f3aa4035040 comp rx=0 tx=0).stop 2024-08-18T22:45:27.849 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:27.846+0000 7f3abb97f640 1 -- 172.21.15.121:0/3802895926 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3ab40fb1c0 msgr2=0x7f3ab410bd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:45:27.849 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:27.846+0000 7f3abb97f640 1 --2- 172.21.15.121:0/3802895926 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3ab40fb1c0 0x7f3ab410bd80 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f3ab000fce0 tx=0x7f3ab0004600 comp rx=0 tx=0).stop 2024-08-18T22:45:27.849 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:27.846+0000 7f3abb97f640 1 -- 172.21.15.121:0/3802895926 shutdown_connections 2024-08-18T22:45:27.850 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:27.846+0000 7f3abb97f640 1 --2- 172.21.15.121:0/3802895926 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f3aa006e0b0 0x7f3aa0070560 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:45:27.850 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:27.846+0000 7f3abb97f640 1 --2- 172.21.15.121:0/3802895926 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3ab40fc490 0x7f3ab410c2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:45:27.850 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:27.846+0000 7f3abb97f640 1 --2- 172.21.15.121:0/3802895926 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3ab40fb1c0 0x7f3ab410bd80 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:45:27.850 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:27.846+0000 7f3abb97f640 1 -- 172.21.15.121:0/3802895926 >> 172.21.15.121:0/3802895926 conn(0x7f3ab40f69a0 msgr2=0x7f3ab40f8150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:45:27.850 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:27.846+0000 7f3abb97f640 1 -- 172.21.15.121:0/3802895926 shutdown_connections 2024-08-18T22:45:27.850 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:27.846+0000 7f3abb97f640 1 -- 172.21.15.121:0/3802895926 wait complete. 2024-08-18T22:45:28.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:45:27 smithi195 ceph-mon[68841]: from='client.34222 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-18T22:45:28.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:45:27 smithi195 ceph-mon[68841]: from='client.34226 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-18T22:45:28.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:45:27 smithi195 ceph-mon[68841]: pgmap v64: 65 pgs: 5 peering, 29 active+undersized+degraded, 31 active+clean; 2.0 GiB data, 7.3 GiB used, 529 GiB / 536 GiB avail; 5301/34143 objects degraded (15.526%) 2024-08-18T22:45:28.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:45:27 smithi195 ceph-mon[68841]: from='client.34230 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-18T22:45:28.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:45:27 smithi195 ceph-mon[68841]: from='client.? 172.21.15.121:0/2468799631' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-08-18T22:45:28.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:45:27 smithi195 ceph-mon[68841]: from='client.? 172.21.15.121:0/3230055343' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-08-18T22:45:29.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:45:28 smithi121 ceph-mon[81053]: from='client.34242 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-18T22:45:29.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:45:28 smithi121 ceph-mon[81053]: from='client.? 172.21.15.121:0/3802895926' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-08-18T22:45:29.162 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:45:28 smithi195 ceph-mon[68841]: from='client.34242 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-18T22:45:29.162 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:45:28 smithi195 ceph-mon[68841]: from='client.? 172.21.15.121:0/3802895926' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-08-18T22:45:30.066 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:45:29 smithi121 ceph-mon[81053]: pgmap v65: 65 pgs: 34 active+undersized+degraded, 31 active+clean; 2.0 GiB data, 7.3 GiB used, 529 GiB / 536 GiB avail; 6377/34143 objects degraded (18.677%) 2024-08-18T22:45:30.066 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:45:29 smithi121 ceph-mon[81053]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 3 pgs peering) 2024-08-18T22:45:30.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:45:29 smithi195 ceph-mon[68841]: pgmap v65: 65 pgs: 34 active+undersized+degraded, 31 active+clean; 2.0 GiB data, 7.3 GiB used, 529 GiB / 536 GiB avail; 6377/34143 objects degraded (18.677%) 2024-08-18T22:45:30.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:45:29 smithi195 ceph-mon[68841]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 3 pgs peering) 2024-08-18T22:45:30.681 INFO:journalctl@ceph.osd.1.smithi121.stdout:Aug 18 22:45:30 smithi121 ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-1[94584]: 2024-08-18T22:45:30.399+0000 7f800b04a640 -1 osd.1 55 log_to_monitors true 2024-08-18T22:45:31.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:45:30 smithi121 ceph-mon[81053]: 3 slow requests, 0 included below; oldest blocked for > 241.867974 secs 2024-08-18T22:45:31.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:45:30 smithi121 ceph-mon[81053]: from='osd.1 [v2:172.21.15.121:6810/2788153413,v1:172.21.15.121:6811/2788153413]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-08-18T22:45:31.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:45:30 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:45:31.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:45:30 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:45:31.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:45:30 smithi195 ceph-mon[68841]: 3 slow requests, 0 included below; oldest blocked for > 241.867974 secs 2024-08-18T22:45:31.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:45:30 smithi195 ceph-mon[68841]: from='osd.1 [v2:172.21.15.121:6810/2788153413,v1:172.21.15.121:6811/2788153413]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-08-18T22:45:31.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:45:30 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:45:31.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:45:30 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:45:31.686 INFO:journalctl@ceph.osd.1.smithi121.stdout:Aug 18 22:45:31 smithi121 ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-1[94584]: 2024-08-18T22:45:31.495+0000 7f7ffeddc640 -1 osd.1 55 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-18T22:45:32.001 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:45:31 smithi121 ceph-mon[81053]: pgmap v66: 65 pgs: 34 active+undersized+degraded, 31 active+clean; 2.0 GiB data, 7.3 GiB used, 529 GiB / 536 GiB avail; 6377/34143 objects degraded (18.677%) 2024-08-18T22:45:32.001 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:45:31 smithi121 ceph-mon[81053]: from='osd.1 [v2:172.21.15.121:6810/2788153413,v1:172.21.15.121:6811/2788153413]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-08-18T22:45:32.001 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:45:31 smithi121 ceph-mon[81053]: osdmap e58: 6 total, 5 up, 6 in 2024-08-18T22:45:32.001 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:45:31 smithi121 ceph-mon[81053]: from='osd.1 [v2:172.21.15.121:6810/2788153413,v1:172.21.15.121:6811/2788153413]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi121", "root=default"]}]: dispatch 2024-08-18T22:45:32.001 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:45:31 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:45:32.001 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:45:31 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:45:32.001 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:45:31 smithi121 ceph-mon[81053]: from='osd.1 [v2:172.21.15.121:6810/2788153413,v1:172.21.15.121:6811/2788153413]' entity='osd.1' 2024-08-18T22:45:32.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:45:31 smithi195 ceph-mon[68841]: pgmap v66: 65 pgs: 34 active+undersized+degraded, 31 active+clean; 2.0 GiB data, 7.3 GiB used, 529 GiB / 536 GiB avail; 6377/34143 objects degraded (18.677%) 2024-08-18T22:45:32.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:45:31 smithi195 ceph-mon[68841]: from='osd.1 [v2:172.21.15.121:6810/2788153413,v1:172.21.15.121:6811/2788153413]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-08-18T22:45:32.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:45:31 smithi195 ceph-mon[68841]: osdmap e58: 6 total, 5 up, 6 in 2024-08-18T22:45:32.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:45:31 smithi195 ceph-mon[68841]: from='osd.1 [v2:172.21.15.121:6810/2788153413,v1:172.21.15.121:6811/2788153413]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi121", "root=default"]}]: dispatch 2024-08-18T22:45:32.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:45:31 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:45:32.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:45:31 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:45:32.160 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:45:31 smithi195 ceph-mon[68841]: from='osd.1 [v2:172.21.15.121:6810/2788153413,v1:172.21.15.121:6811/2788153413]' entity='osd.1' 2024-08-18T22:45:33.508 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:45:33 smithi121 ceph-mon[81053]: fsmap cephfs:2 {0=cephfs.smithi121.gbickb=up:active,1=cephfs.smithi195.buqvbr=up:active} 2 up:standby 2024-08-18T22:45:33.508 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:45:33 smithi121 ceph-mon[81053]: Health check update: Degraded data redundancy: 6377/34143 objects degraded (18.677%), 34 pgs degraded (PG_DEGRADED) 2024-08-18T22:45:33.508 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:45:33 smithi121 ceph-mon[81053]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-08-18T22:45:33.509 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:45:33 smithi121 ceph-mon[81053]: osd.1 [v2:172.21.15.121:6810/2788153413,v1:172.21.15.121:6811/2788153413] boot 2024-08-18T22:45:33.509 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:45:33 smithi121 ceph-mon[81053]: osdmap e59: 6 total, 6 up, 6 in 2024-08-18T22:45:33.509 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:45:33 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-08-18T22:45:33.509 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:45:33 smithi121 ceph-mon[81053]: pgmap v69: 65 pgs: 34 active+undersized+degraded, 31 active+clean; 2.0 GiB data, 7.1 GiB used, 529 GiB / 536 GiB avail; 6377/34143 objects degraded (18.677%) 2024-08-18T22:45:33.659 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:45:33 smithi195 ceph-mon[68841]: fsmap cephfs:2 {0=cephfs.smithi121.gbickb=up:active,1=cephfs.smithi195.buqvbr=up:active} 2 up:standby 2024-08-18T22:45:33.659 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:45:33 smithi195 ceph-mon[68841]: Health check update: Degraded data redundancy: 6377/34143 objects degraded (18.677%), 34 pgs degraded (PG_DEGRADED) 2024-08-18T22:45:33.659 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:45:33 smithi195 ceph-mon[68841]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-08-18T22:45:33.659 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:45:33 smithi195 ceph-mon[68841]: osd.1 [v2:172.21.15.121:6810/2788153413,v1:172.21.15.121:6811/2788153413] boot 2024-08-18T22:45:33.659 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:45:33 smithi195 ceph-mon[68841]: osdmap e59: 6 total, 6 up, 6 in 2024-08-18T22:45:33.659 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:45:33 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-08-18T22:45:33.659 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:45:33 smithi195 ceph-mon[68841]: pgmap v69: 65 pgs: 34 active+undersized+degraded, 31 active+clean; 2.0 GiB data, 7.1 GiB used, 529 GiB / 536 GiB avail; 6377/34143 objects degraded (18.677%) 2024-08-18T22:45:34.833 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:45:34 smithi121 ceph-mon[81053]: osdmap e60: 6 total, 6 up, 6 in 2024-08-18T22:45:34.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:45:34 smithi195 ceph-mon[68841]: osdmap e60: 6 total, 6 up, 6 in 2024-08-18T22:45:35.833 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:45:35 smithi121 ceph-mon[81053]: pgmap v71: 65 pgs: 14 active+undersized+degraded, 51 active+clean; 2.0 GiB data, 7.1 GiB used, 529 GiB / 536 GiB avail; 2474/34143 objects degraded (7.246%) 2024-08-18T22:45:35.833 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:45:35 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:45:35.834 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:45:35 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:45:35.834 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:45:35 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:45:35.834 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:45:35 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-18T22:45:35.834 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:45:35 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:45:35.834 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:45:35 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-18T22:45:35.834 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:45:35 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "versions"}]: dispatch 2024-08-18T22:45:35.834 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:45:35 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "versions"}]: dispatch 2024-08-18T22:45:35.834 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:45:35 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "versions"}]: dispatch 2024-08-18T22:45:35.834 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:45:35 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-08-18T22:45:35.835 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:45:35 smithi121 ceph-mon[81053]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-08-18T22:45:35.835 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:45:35 smithi121 ceph-mon[81053]: Upgrade: unsafe to stop osd(s) at this time (3 PGs are or would become offline) 2024-08-18T22:45:35.835 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:45:35 smithi121 ceph-mon[81053]: 3 slow requests, 0 included below; oldest blocked for > 246.868101 secs 2024-08-18T22:45:35.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:45:35 smithi195 ceph-mon[68841]: pgmap v71: 65 pgs: 14 active+undersized+degraded, 51 active+clean; 2.0 GiB data, 7.1 GiB used, 529 GiB / 536 GiB avail; 2474/34143 objects degraded (7.246%) 2024-08-18T22:45:35.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:45:35 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:45:35.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:45:35 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:45:35.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:45:35 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:45:35.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:45:35 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-18T22:45:35.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:45:35 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:45:35.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:45:35 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-18T22:45:35.910 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:45:35 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "versions"}]: dispatch 2024-08-18T22:45:35.910 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:45:35 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "versions"}]: dispatch 2024-08-18T22:45:35.910 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:45:35 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "versions"}]: dispatch 2024-08-18T22:45:35.910 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:45:35 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-08-18T22:45:35.910 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:45:35 smithi195 ceph-mon[68841]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-08-18T22:45:35.910 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:45:35 smithi195 ceph-mon[68841]: Upgrade: unsafe to stop osd(s) at this time (3 PGs are or would become offline) 2024-08-18T22:45:35.910 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:45:35 smithi195 ceph-mon[68841]: 3 slow requests, 0 included below; oldest blocked for > 246.868101 secs 2024-08-18T22:45:37.833 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:45:37 smithi121 ceph-mon[81053]: pgmap v72: 65 pgs: 2 active+undersized+degraded, 63 active+clean; 2.0 GiB data, 7.1 GiB used, 529 GiB / 536 GiB avail; 701/34143 objects degraded (2.053%) 2024-08-18T22:45:37.833 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:45:37 smithi121 ceph-mon[81053]: Health check update: Degraded data redundancy: 701/34143 objects degraded (2.053%), 2 pgs degraded (PG_DEGRADED) 2024-08-18T22:45:37.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:45:37 smithi195 ceph-mon[68841]: pgmap v72: 65 pgs: 2 active+undersized+degraded, 63 active+clean; 2.0 GiB data, 7.1 GiB used, 529 GiB / 536 GiB avail; 701/34143 objects degraded (2.053%) 2024-08-18T22:45:37.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:45:37 smithi195 ceph-mon[68841]: Health check update: Degraded data redundancy: 701/34143 objects degraded (2.053%), 2 pgs degraded (PG_DEGRADED) 2024-08-18T22:45:38.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:45:38 smithi195 ceph-mon[68841]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 701/34143 objects degraded (2.053%), 2 pgs degraded) 2024-08-18T22:45:38.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:45:38 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:45:38.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:45:38 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-18T22:45:39.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:45:38 smithi121 ceph-mon[81053]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 701/34143 objects degraded (2.053%), 2 pgs degraded) 2024-08-18T22:45:39.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:45:38 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:45:39.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:45:38 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-18T22:45:39.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:45:39 smithi195 ceph-mon[68841]: pgmap v73: 65 pgs: 65 active+clean; 2.0 GiB data, 7.1 GiB used, 529 GiB / 536 GiB avail 2024-08-18T22:45:39.985 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:45:39 smithi121 ceph-mon[81053]: pgmap v73: 65 pgs: 65 active+clean; 2.0 GiB data, 7.1 GiB used, 529 GiB / 536 GiB avail 2024-08-18T22:45:40.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:45:40 smithi195 ceph-mon[68841]: 3 slow requests, 0 included below; oldest blocked for > 251.868220 secs 2024-08-18T22:45:41.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:45:40 smithi121 ceph-mon[81053]: 3 slow requests, 0 included below; oldest blocked for > 251.868220 secs 2024-08-18T22:45:41.833 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:45:41 smithi121 ceph-mon[81053]: pgmap v74: 65 pgs: 65 active+clean; 2.0 GiB data, 7.1 GiB used, 529 GiB / 536 GiB avail 2024-08-18T22:45:41.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:45:41 smithi195 ceph-mon[68841]: pgmap v74: 65 pgs: 65 active+clean; 2.0 GiB data, 7.1 GiB used, 529 GiB / 536 GiB avail 2024-08-18T22:45:43.833 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:45:43 smithi121 ceph-mon[81053]: pgmap v75: 65 pgs: 65 active+clean; 2.0 GiB data, 7.1 GiB used, 529 GiB / 536 GiB avail 2024-08-18T22:45:43.833 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:45:43 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:45:43.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:45:43 smithi195 ceph-mon[68841]: pgmap v75: 65 pgs: 65 active+clean; 2.0 GiB data, 7.1 GiB used, 529 GiB / 536 GiB avail 2024-08-18T22:45:43.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:45:43 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:45:45.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:45:45 smithi195 ceph-mon[68841]: pgmap v76: 65 pgs: 65 active+clean; 2.0 GiB data, 7.1 GiB used, 529 GiB / 536 GiB avail 2024-08-18T22:45:45.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:45:45 smithi195 ceph-mon[68841]: 3 slow requests, 0 included below; oldest blocked for > 256.868359 secs 2024-08-18T22:45:46.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:45:45 smithi121 ceph-mon[81053]: pgmap v76: 65 pgs: 65 active+clean; 2.0 GiB data, 7.1 GiB used, 529 GiB / 536 GiB avail 2024-08-18T22:45:46.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:45:45 smithi121 ceph-mon[81053]: 3 slow requests, 0 included below; oldest blocked for > 256.868359 secs 2024-08-18T22:45:47.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:45:47 smithi195 ceph-mon[68841]: pgmap v77: 65 pgs: 65 active+clean; 2.0 GiB data, 7.1 GiB used, 529 GiB / 536 GiB avail 2024-08-18T22:45:48.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:45:47 smithi121 ceph-mon[81053]: pgmap v77: 65 pgs: 65 active+clean; 2.0 GiB data, 7.1 GiB used, 529 GiB / 536 GiB avail 2024-08-18T22:45:49.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:45:49 smithi195 ceph-mon[68841]: pgmap v78: 65 pgs: 65 active+clean; 2.0 GiB data, 7.1 GiB used, 529 GiB / 536 GiB avail 2024-08-18T22:45:50.025 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:45:49 smithi121 ceph-mon[81053]: pgmap v78: 65 pgs: 65 active+clean; 2.0 GiB data, 7.1 GiB used, 529 GiB / 536 GiB avail 2024-08-18T22:45:50.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:45:50 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-08-18T22:45:50.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:45:50 smithi195 ceph-mon[68841]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-08-18T22:45:50.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:45:50 smithi195 ceph-mon[68841]: Upgrade: osd.2 is safe to restart 2024-08-18T22:45:50.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:45:50 smithi195 ceph-mon[68841]: 3 slow requests, 0 included below; oldest blocked for > 261.868474 secs 2024-08-18T22:45:50.937 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:45:50 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-08-18T22:45:50.937 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:45:50 smithi121 ceph-mon[81053]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-08-18T22:45:50.937 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:45:50 smithi121 ceph-mon[81053]: Upgrade: osd.2 is safe to restart 2024-08-18T22:45:50.937 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:45:50 smithi121 ceph-mon[81053]: 3 slow requests, 0 included below; oldest blocked for > 261.868474 secs 2024-08-18T22:45:51.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:45:51 smithi195 ceph-mon[68841]: pgmap v79: 65 pgs: 65 active+clean; 2.0 GiB data, 7.1 GiB used, 529 GiB / 536 GiB avail 2024-08-18T22:45:51.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:45:51 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:45:51.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:45:51 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-08-18T22:45:51.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:45:51 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:45:52.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:45:51 smithi121 ceph-mon[81053]: pgmap v79: 65 pgs: 65 active+clean; 2.0 GiB data, 7.1 GiB used, 529 GiB / 536 GiB avail 2024-08-18T22:45:52.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:45:51 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:45:52.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:45:51 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-08-18T22:45:52.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:45:51 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:45:52.854 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:45:52 smithi121 ceph-mon[81053]: Upgrade: Updating osd.2 2024-08-18T22:45:52.854 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:45:52 smithi121 ceph-mon[81053]: Deploying daemon osd.2 on smithi121 2024-08-18T22:45:52.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:45:52 smithi195 ceph-mon[68841]: Upgrade: Updating osd.2 2024-08-18T22:45:52.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:45:52 smithi195 ceph-mon[68841]: Deploying daemon osd.2 on smithi121 2024-08-18T22:45:53.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:45:53 smithi195 ceph-mon[68841]: pgmap v80: 65 pgs: 65 active+clean; 2.0 GiB data, 7.1 GiB used, 529 GiB / 536 GiB avail 2024-08-18T22:45:53.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:45:53 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-18T22:45:54.057 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:45:53 smithi121 ceph-mon[81053]: pgmap v80: 65 pgs: 65 active+clean; 2.0 GiB data, 7.1 GiB used, 529 GiB / 536 GiB avail 2024-08-18T22:45:54.057 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:45:53 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-18T22:45:54.057 INFO:journalctl@ceph.osd.2.smithi121.stdout:Aug 18 22:45:53 smithi121 systemd[1]: Stopping Ceph osd.2 for b003123a-5db1-11ef-bccf-c7b262605968... 2024-08-18T22:45:54.334 INFO:journalctl@ceph.osd.2.smithi121.stdout:Aug 18 22:45:54 smithi121 ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-2[50525]: 2024-08-18T22:45:54.055+0000 7f41fcc42640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-18T22:45:54.334 INFO:journalctl@ceph.osd.2.smithi121.stdout:Aug 18 22:45:54 smithi121 ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-2[50525]: 2024-08-18T22:45:54.055+0000 7f41fcc42640 -1 osd.2 60 *** Got signal Terminated *** 2024-08-18T22:45:54.334 INFO:journalctl@ceph.osd.2.smithi121.stdout:Aug 18 22:45:54 smithi121 ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-2[50525]: 2024-08-18T22:45:54.055+0000 7f41fcc42640 -1 osd.2 60 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-08-18T22:45:54.833 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:45:54 smithi121 ceph-mon[81053]: osd.2 marked itself down and dead 2024-08-18T22:45:54.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:45:54 smithi195 ceph-mon[68841]: osd.2 marked itself down and dead 2024-08-18T22:45:55.249 INFO:journalctl@ceph.osd.2.smithi121.stdout:Aug 18 22:45:54 smithi121 podman[99921]: 2024-08-18 22:45:54.986442905 +0000 UTC m=+1.022873776 container died 3fa061e41f99ef88c0783a0ccf2d9e89bb5aa269ca7012b74a23a4d29bf121cf (image=quay.ceph.io/ceph-ci/ceph@sha256:bf20fb88c15fff689cf84383793d3756b4df7aceb11592a28c78dd893a0b3e7d, name=ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-2, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, io.buildah.version=1.36.0, ceph=True, GIT_CLEAN=True, org.label-schema.build-date=20240731, RELEASE=quincy-df62bdc, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS) 2024-08-18T22:45:55.583 INFO:journalctl@ceph.osd.2.smithi121.stdout:Aug 18 22:45:55 smithi121 podman[99921]: 2024-08-18 22:45:55.347086921 +0000 UTC m=+1.383517799 container cleanup 3fa061e41f99ef88c0783a0ccf2d9e89bb5aa269ca7012b74a23a4d29bf121cf (image=quay.ceph.io/ceph-ci/ceph@sha256:bf20fb88c15fff689cf84383793d3756b4df7aceb11592a28c78dd893a0b3e7d, name=ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-2, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, ceph=True, GIT_CLEAN=True, io.buildah.version=1.36.0, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, RELEASE=quincy-df62bdc, org.label-schema.vendor=CentOS) 2024-08-18T22:45:55.583 INFO:journalctl@ceph.osd.2.smithi121.stdout:Aug 18 22:45:55 smithi121 bash[99921]: ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-2 2024-08-18T22:45:55.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:45:55 smithi195 ceph-mon[68841]: pgmap v81: 65 pgs: 65 active+clean; 2.0 GiB data, 7.1 GiB used, 529 GiB / 536 GiB avail 2024-08-18T22:45:55.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:45:55 smithi195 ceph-mon[68841]: Health check failed: 1 osds down (OSD_DOWN) 2024-08-18T22:45:55.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:45:55 smithi195 ceph-mon[68841]: osdmap e61: 6 total, 5 up, 6 in 2024-08-18T22:45:55.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:45:55 smithi195 ceph-mon[68841]: 3 slow requests, 0 included below; oldest blocked for > 266.868592 secs 2024-08-18T22:45:55.933 INFO:journalctl@ceph.osd.2.smithi121.stdout:Aug 18 22:45:55 smithi121 podman[99939]: 2024-08-18 22:45:55.606780342 +0000 UTC m=+0.617471367 container remove 3fa061e41f99ef88c0783a0ccf2d9e89bb5aa269ca7012b74a23a4d29bf121cf (image=quay.ceph.io/ceph-ci/ceph@sha256:bf20fb88c15fff689cf84383793d3756b4df7aceb11592a28c78dd893a0b3e7d, name=ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=quincy-df62bdc, io.buildah.version=1.36.0) 2024-08-18T22:45:55.933 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:45:55 smithi121 ceph-mon[81053]: pgmap v81: 65 pgs: 65 active+clean; 2.0 GiB data, 7.1 GiB used, 529 GiB / 536 GiB avail 2024-08-18T22:45:55.933 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:45:55 smithi121 ceph-mon[81053]: Health check failed: 1 osds down (OSD_DOWN) 2024-08-18T22:45:55.933 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:45:55 smithi121 ceph-mon[81053]: osdmap e61: 6 total, 5 up, 6 in 2024-08-18T22:45:55.933 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:45:55 smithi121 ceph-mon[81053]: 3 slow requests, 0 included below; oldest blocked for > 266.868592 secs 2024-08-18T22:45:56.194 INFO:journalctl@ceph.osd.2.smithi121.stdout:Aug 18 22:45:55 smithi121 podman[100023]: 2024-08-18 22:45:55.933068614 +0000 UTC m=+0.098916324 container create a34ae73d839fee7371ae680eae75ca3596371abf0f72b4b68024372fa4ce0e50 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-2-deactivate, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, io.buildah.version=1.36.0, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, RELEASE=squid-de09dd0) 2024-08-18T22:45:56.194 INFO:journalctl@ceph.osd.2.smithi121.stdout:Aug 18 22:45:55 smithi121 podman[100023]: 2024-08-18 22:45:55.851496075 +0000 UTC m=+0.017343797 image pull ea7a5189f30bad3aca9524788e2965d2368d7ce786df09d4edcd8c3edf9cefba quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9 2024-08-18T22:45:56.194 INFO:journalctl@ceph.osd.2.smithi121.stdout:Aug 18 22:45:56 smithi121 podman[100023]: 2024-08-18 22:45:56.193850066 +0000 UTC m=+0.359697786 container init a34ae73d839fee7371ae680eae75ca3596371abf0f72b4b68024372fa4ce0e50 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-2-deactivate, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, io.buildah.version=1.36.0, RELEASE=squid-de09dd0, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-08-18T22:45:56.583 INFO:journalctl@ceph.osd.2.smithi121.stdout:Aug 18 22:45:56 smithi121 podman[100023]: 2024-08-18 22:45:56.197247875 +0000 UTC m=+0.363095585 container start a34ae73d839fee7371ae680eae75ca3596371abf0f72b4b68024372fa4ce0e50 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-2-deactivate, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-de09dd0, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, io.buildah.version=1.36.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-08-18T22:45:56.584 INFO:journalctl@ceph.osd.2.smithi121.stdout:Aug 18 22:45:56 smithi121 podman[100023]: 2024-08-18 22:45:56.268920268 +0000 UTC m=+0.434767978 container attach a34ae73d839fee7371ae680eae75ca3596371abf0f72b4b68024372fa4ce0e50 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-2-deactivate, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, RELEASE=squid-de09dd0, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.36.0, ceph=True) 2024-08-18T22:45:56.584 INFO:journalctl@ceph.osd.2.smithi121.stdout:Aug 18 22:45:56 smithi121 podman[100023]: 2024-08-18 22:45:56.381527827 +0000 UTC m=+0.547375540 container died a34ae73d839fee7371ae680eae75ca3596371abf0f72b4b68024372fa4ce0e50 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-2-deactivate, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-de09dd0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, io.buildah.version=1.36.0, GIT_CLEAN=True, org.label-schema.vendor=CentOS) 2024-08-18T22:45:56.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:45:56 smithi195 ceph-mon[68841]: osdmap e62: 6 total, 5 up, 6 in 2024-08-18T22:45:56.973 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:45:56 smithi121 ceph-mon[81053]: osdmap e62: 6 total, 5 up, 6 in 2024-08-18T22:45:57.334 INFO:journalctl@ceph.osd.2.smithi121.stdout:Aug 18 22:45:56 smithi121 podman[100047]: 2024-08-18 22:45:56.97268694 +0000 UTC m=+0.585061640 container remove a34ae73d839fee7371ae680eae75ca3596371abf0f72b4b68024372fa4ce0e50 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-2-deactivate, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=squid-de09dd0, org.label-schema.vendor=CentOS, io.buildah.version=1.36.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, ceph=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-08-18T22:45:57.334 INFO:journalctl@ceph.osd.2.smithi121.stdout:Aug 18 22:45:56 smithi121 systemd[1]: ceph-b003123a-5db1-11ef-bccf-c7b262605968@osd.2.service: Deactivated successfully. 2024-08-18T22:45:57.334 INFO:journalctl@ceph.osd.2.smithi121.stdout:Aug 18 22:45:56 smithi121 systemd[1]: Stopped Ceph osd.2 for b003123a-5db1-11ef-bccf-c7b262605968. 2024-08-18T22:45:57.334 INFO:journalctl@ceph.osd.2.smithi121.stdout:Aug 18 22:45:56 smithi121 systemd[1]: ceph-b003123a-5db1-11ef-bccf-c7b262605968@osd.2.service: Consumed 40.550s CPU time. 2024-08-18T22:45:57.334 INFO:journalctl@ceph.osd.2.smithi121.stdout:Aug 18 22:45:57 smithi121 systemd[1]: Starting Ceph osd.2 for b003123a-5db1-11ef-bccf-c7b262605968... 2024-08-18T22:45:57.702 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:45:57 smithi121 ceph-mon[81053]: pgmap v84: 65 pgs: 5 stale+active+clean, 7 active+undersized+degraded, 53 active+clean; 2.0 GiB data, 7.1 GiB used, 529 GiB / 536 GiB avail; 1434/34143 objects degraded (4.200%) 2024-08-18T22:45:57.703 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:45:57 smithi121 ceph-mon[81053]: Health check failed: Degraded data redundancy: 1434/34143 objects degraded (4.200%), 7 pgs degraded (PG_DEGRADED) 2024-08-18T22:45:57.703 INFO:journalctl@ceph.osd.2.smithi121.stdout:Aug 18 22:45:57 smithi121 podman[100146]: 2024-08-18 22:45:57.320327629 +0000 UTC m=+0.016750765 image pull ea7a5189f30bad3aca9524788e2965d2368d7ce786df09d4edcd8c3edf9cefba quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9 2024-08-18T22:45:57.703 INFO:journalctl@ceph.osd.2.smithi121.stdout:Aug 18 22:45:57 smithi121 podman[100146]: 2024-08-18 22:45:57.440734561 +0000 UTC m=+0.137157687 container create 15ac7f93b15ce8a026b97edf6eb8ebec762faae813402bd92f01e9db04707c4a (image=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-2-activate, ceph=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, RELEASE=squid-de09dd0, io.buildah.version=1.36.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2) 2024-08-18T22:45:57.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:45:57 smithi195 ceph-mon[68841]: pgmap v84: 65 pgs: 5 stale+active+clean, 7 active+undersized+degraded, 53 active+clean; 2.0 GiB data, 7.1 GiB used, 529 GiB / 536 GiB avail; 1434/34143 objects degraded (4.200%) 2024-08-18T22:45:57.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:45:57 smithi195 ceph-mon[68841]: Health check failed: Degraded data redundancy: 1434/34143 objects degraded (4.200%), 7 pgs degraded (PG_DEGRADED) 2024-08-18T22:45:57.935 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:57.931+0000 7f8e515be640 1 -- 172.21.15.121:0/3559022283 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8e4c0fc4a0 msgr2=0x7f8e4c0fc910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:45:57.935 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:57.931+0000 7f8e515be640 1 --2- 172.21.15.121:0/3559022283 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8e4c0fc4a0 0x7f8e4c0fc910 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f8e400048d0 tx=0x7f8e40009da0 comp rx=0 tx=0).stop 2024-08-18T22:45:57.936 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:57.931+0000 7f8e515be640 1 -- 172.21.15.121:0/3559022283 shutdown_connections 2024-08-18T22:45:57.936 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:57.931+0000 7f8e515be640 1 --2- 172.21.15.121:0/3559022283 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8e4c0fc4a0 0x7f8e4c0fc910 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:45:57.936 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:57.931+0000 7f8e515be640 1 --2- 172.21.15.121:0/3559022283 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8e4c0fb1d0 0x7f8e4c0fb5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:45:57.936 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:57.931+0000 7f8e515be640 1 -- 172.21.15.121:0/3559022283 >> 172.21.15.121:0/3559022283 conn(0x7f8e4c0f69b0 msgr2=0x7f8e4c0f8dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:45:57.936 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:57.931+0000 7f8e515be640 1 -- 172.21.15.121:0/3559022283 shutdown_connections 2024-08-18T22:45:57.936 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:57.931+0000 7f8e515be640 1 -- 172.21.15.121:0/3559022283 wait complete. 2024-08-18T22:45:57.937 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:57.932+0000 7f8e515be640 1 Processor -- start 2024-08-18T22:45:57.937 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:57.932+0000 7f8e515be640 1 -- start start 2024-08-18T22:45:57.937 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:57.932+0000 7f8e515be640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8e4c0fb1d0 0x7f8e4c10fb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:45:57.937 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:57.932+0000 7f8e515be640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8e4c0fc4a0 0x7f8e4c1120b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:45:57.937 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:57.932+0000 7f8e515be640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e4c065af0 con 0x7f8e4c0fc4a0 2024-08-18T22:45:57.938 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:57.932+0000 7f8e515be640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e4c065c60 con 0x7f8e4c0fb1d0 2024-08-18T22:45:57.938 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:57.932+0000 7f8e4a7fc640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8e4c0fc4a0 0x7f8e4c1120b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:45:57.938 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:57.932+0000 7f8e4a7fc640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8e4c0fc4a0 0x7f8e4c1120b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:39024/0 (socket says 172.21.15.121:39024) 2024-08-18T22:45:57.938 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:57.932+0000 7f8e4a7fc640 1 -- 172.21.15.121:0/1098304529 learned_addr learned my addr 172.21.15.121:0/1098304529 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-18T22:45:57.938 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:57.932+0000 7f8e4affd640 1 --2- 172.21.15.121:0/1098304529 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8e4c0fb1d0 0x7f8e4c10fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:45:57.939 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:57.932+0000 7f8e4a7fc640 1 -- 172.21.15.121:0/1098304529 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8e4c0fb1d0 msgr2=0x7f8e4c10fb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:45:57.939 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:57.932+0000 7f8e4a7fc640 1 --2- 172.21.15.121:0/1098304529 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8e4c0fb1d0 0x7f8e4c10fb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:45:57.939 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:57.932+0000 7f8e4a7fc640 1 -- 172.21.15.121:0/1098304529 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e40005040 con 0x7f8e4c0fc4a0 2024-08-18T22:45:57.939 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:57.932+0000 7f8e4affd640 1 --2- 172.21.15.121:0/1098304529 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8e4c0fb1d0 0x7f8e4c10fb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:45:57.939 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:57.933+0000 7f8e4a7fc640 1 --2- 172.21.15.121:0/1098304529 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8e4c0fc4a0 0x7f8e4c1120b0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f8e400048a0 tx=0x7f8e40009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:45:57.940 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:57.933+0000 7f8e337fe640 1 -- 172.21.15.121:0/1098304529 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8e40038070 con 0x7f8e4c0fc4a0 2024-08-18T22:45:57.940 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:57.933+0000 7f8e337fe640 1 -- 172.21.15.121:0/1098304529 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f8e4002abd0 con 0x7f8e4c0fc4a0 2024-08-18T22:45:57.940 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:57.933+0000 7f8e515be640 1 -- 172.21.15.121:0/1098304529 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e4c1126b0 con 0x7f8e4c0fc4a0 2024-08-18T22:45:57.940 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:57.933+0000 7f8e337fe640 1 -- 172.21.15.121:0/1098304529 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8e4003e660 con 0x7f8e4c0fc4a0 2024-08-18T22:45:57.940 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:57.933+0000 7f8e515be640 1 -- 172.21.15.121:0/1098304529 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e4c112b70 con 0x7f8e4c0fc4a0 2024-08-18T22:45:57.940 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:57.934+0000 7f8e515be640 1 -- 172.21.15.121:0/1098304529 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e4c1055e0 con 0x7f8e4c0fc4a0 2024-08-18T22:45:57.941 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:57.934+0000 7f8e337fe640 1 -- 172.21.15.121:0/1098304529 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 37) v1 ==== 92205+0+0 (secure 0 0 0) 0x7f8e4003b020 con 0x7f8e4c0fc4a0 2024-08-18T22:45:57.942 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:57.935+0000 7f8e337fe640 1 --2- 172.21.15.121:0/1098304529 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f8e3406e0b0 0x7f8e34070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:45:57.942 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:57.935+0000 7f8e337fe640 1 -- 172.21.15.121:0/1098304529 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f8e400adca0 con 0x7f8e4c0fc4a0 2024-08-18T22:45:57.942 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:57.935+0000 7f8e4affd640 1 --2- 172.21.15.121:0/1098304529 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f8e3406e0b0 0x7f8e34070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:45:57.942 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:57.935+0000 7f8e4affd640 1 --2- 172.21.15.121:0/1098304529 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f8e3406e0b0 0x7f8e34070560 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f8e4c065750 tx=0x7f8e3c008040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:45:57.943 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:57.939+0000 7f8e337fe640 1 -- 172.21.15.121:0/1098304529 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f8e40077050 con 0x7f8e4c0fc4a0 2024-08-18T22:45:57.971 INFO:journalctl@ceph.osd.2.smithi121.stdout:Aug 18 22:45:57 smithi121 podman[100146]: 2024-08-18 22:45:57.702417066 +0000 UTC m=+0.398840200 container init 15ac7f93b15ce8a026b97edf6eb8ebec762faae813402bd92f01e9db04707c4a (image=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-2-activate, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, io.buildah.version=1.36.0, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-de09dd0) 2024-08-18T22:45:57.971 INFO:journalctl@ceph.osd.2.smithi121.stdout:Aug 18 22:45:57 smithi121 podman[100146]: 2024-08-18 22:45:57.706034809 +0000 UTC m=+0.402457940 container start 15ac7f93b15ce8a026b97edf6eb8ebec762faae813402bd92f01e9db04707c4a (image=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-2-activate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.36.0, RELEASE=squid-de09dd0) 2024-08-18T22:45:57.971 INFO:journalctl@ceph.osd.2.smithi121.stdout:Aug 18 22:45:57 smithi121 podman[100146]: 2024-08-18 22:45:57.801925794 +0000 UTC m=+0.498348925 container attach 15ac7f93b15ce8a026b97edf6eb8ebec762faae813402bd92f01e9db04707c4a (image=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-2-activate, maintainer=Guillaume Abrioux , RELEASE=squid-de09dd0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, ceph=True, io.buildah.version=1.36.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True) 2024-08-18T22:45:57.971 INFO:journalctl@ceph.osd.2.smithi121.stdout:Aug 18 22:45:57 smithi121 ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-2-activate[100161]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-08-18T22:45:57.971 INFO:journalctl@ceph.osd.2.smithi121.stdout:Aug 18 22:45:57 smithi121 bash[100146]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-08-18T22:45:57.971 INFO:journalctl@ceph.osd.2.smithi121.stdout:Aug 18 22:45:57 smithi121 ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-2-activate[100161]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-08-18T22:45:57.971 INFO:journalctl@ceph.osd.2.smithi121.stdout:Aug 18 22:45:57 smithi121 bash[100146]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-08-18T22:45:57.971 INFO:journalctl@ceph.osd.2.smithi121.stdout:Aug 18 22:45:57 smithi121 ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-2-activate[100161]: --> Failed to activate via raw: activate() takes 1 positional argument but 5 were given 2024-08-18T22:45:57.971 INFO:journalctl@ceph.osd.2.smithi121.stdout:Aug 18 22:45:57 smithi121 bash[100146]: --> Failed to activate via raw: activate() takes 1 positional argument but 5 were given 2024-08-18T22:45:57.971 INFO:journalctl@ceph.osd.2.smithi121.stdout:Aug 18 22:45:57 smithi121 ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-2-activate[100161]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-08-18T22:45:57.971 INFO:journalctl@ceph.osd.2.smithi121.stdout:Aug 18 22:45:57 smithi121 bash[100146]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-08-18T22:45:57.972 INFO:journalctl@ceph.osd.2.smithi121.stdout:Aug 18 22:45:57 smithi121 ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-2-activate[100161]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-08-18T22:45:57.972 INFO:journalctl@ceph.osd.2.smithi121.stdout:Aug 18 22:45:57 smithi121 bash[100146]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-08-18T22:45:57.972 INFO:journalctl@ceph.osd.2.smithi121.stdout:Aug 18 22:45:57 smithi121 ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-2-activate[100161]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-08-18T22:45:57.972 INFO:journalctl@ceph.osd.2.smithi121.stdout:Aug 18 22:45:57 smithi121 bash[100146]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-08-18T22:45:57.972 INFO:journalctl@ceph.osd.2.smithi121.stdout:Aug 18 22:45:57 smithi121 ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-2-activate[100161]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_2 --path /var/lib/ceph/osd/ceph-2 --no-mon-config 2024-08-18T22:45:57.972 INFO:journalctl@ceph.osd.2.smithi121.stdout:Aug 18 22:45:57 smithi121 bash[100146]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_2 --path /var/lib/ceph/osd/ceph-2 --no-mon-config 2024-08-18T22:45:57.972 INFO:journalctl@ceph.osd.2.smithi121.stdout:Aug 18 22:45:57 smithi121 ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-2-activate[100161]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-2/block 2024-08-18T22:45:57.972 INFO:journalctl@ceph.osd.2.smithi121.stdout:Aug 18 22:45:57 smithi121 bash[100146]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-2/block 2024-08-18T22:45:58.131 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:58.129+0000 7f8e515be640 1 -- 172.21.15.121:0/1098304529 --> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f8e4c100ed0 con 0x7f8e3406e0b0 2024-08-18T22:45:58.131 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:58.131+0000 7f8e337fe640 1 -- 172.21.15.121:0/1098304529 <== mgr.34102 v2:172.21.15.121:6800/3037387239 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f8e4c100ed0 con 0x7f8e3406e0b0 2024-08-18T22:45:58.134 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:58.133+0000 7f8e515be640 1 -- 172.21.15.121:0/1098304529 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f8e3406e0b0 msgr2=0x7f8e34070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:45:58.134 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:58.133+0000 7f8e515be640 1 --2- 172.21.15.121:0/1098304529 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f8e3406e0b0 0x7f8e34070560 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f8e4c065750 tx=0x7f8e3c008040 comp rx=0 tx=0).stop 2024-08-18T22:45:58.134 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:58.133+0000 7f8e515be640 1 -- 172.21.15.121:0/1098304529 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8e4c0fc4a0 msgr2=0x7f8e4c1120b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:45:58.134 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:58.133+0000 7f8e515be640 1 --2- 172.21.15.121:0/1098304529 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8e4c0fc4a0 0x7f8e4c1120b0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f8e400048a0 tx=0x7f8e40009da0 comp rx=0 tx=0).stop 2024-08-18T22:45:58.134 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:58.133+0000 7f8e515be640 1 -- 172.21.15.121:0/1098304529 shutdown_connections 2024-08-18T22:45:58.134 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:58.133+0000 7f8e515be640 1 --2- 172.21.15.121:0/1098304529 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f8e3406e0b0 0x7f8e34070560 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:45:58.134 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:58.133+0000 7f8e515be640 1 --2- 172.21.15.121:0/1098304529 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8e4c0fc4a0 0x7f8e4c1120b0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:45:58.134 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:58.133+0000 7f8e515be640 1 --2- 172.21.15.121:0/1098304529 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8e4c0fb1d0 0x7f8e4c10fb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:45:58.134 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:58.133+0000 7f8e515be640 1 -- 172.21.15.121:0/1098304529 >> 172.21.15.121:0/1098304529 conn(0x7f8e4c0f69b0 msgr2=0x7f8e4c0ff7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:45:58.135 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:58.133+0000 7f8e515be640 1 -- 172.21.15.121:0/1098304529 shutdown_connections 2024-08-18T22:45:58.135 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:58.133+0000 7f8e515be640 1 -- 172.21.15.121:0/1098304529 wait complete. 2024-08-18T22:45:58.142 INFO:teuthology.orchestra.run.smithi121.stdout:true 2024-08-18T22:45:58.217 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:58.216+0000 7fd0a12e9640 1 -- 172.21.15.121:0/1254559130 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd09c0fc490 msgr2=0x7fd09c0fc900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:45:58.217 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:58.216+0000 7fd0a12e9640 1 --2- 172.21.15.121:0/1254559130 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd09c0fc490 0x7fd09c0fc900 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fd0840048d0 tx=0x7fd084009da0 comp rx=0 tx=0).stop 2024-08-18T22:45:58.217 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:58.216+0000 7fd0a12e9640 1 -- 172.21.15.121:0/1254559130 shutdown_connections 2024-08-18T22:45:58.217 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:58.216+0000 7fd0a12e9640 1 --2- 172.21.15.121:0/1254559130 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd09c0fc490 0x7fd09c0fc900 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:45:58.218 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:58.216+0000 7fd0a12e9640 1 --2- 172.21.15.121:0/1254559130 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd09c0fb1c0 0x7fd09c0fb5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:45:58.218 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:58.216+0000 7fd0a12e9640 1 -- 172.21.15.121:0/1254559130 >> 172.21.15.121:0/1254559130 conn(0x7fd09c0f69a0 msgr2=0x7fd09c0f8db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:45:58.218 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:58.216+0000 7fd0a12e9640 1 -- 172.21.15.121:0/1254559130 shutdown_connections 2024-08-18T22:45:58.218 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:58.216+0000 7fd0a12e9640 1 -- 172.21.15.121:0/1254559130 wait complete. 2024-08-18T22:45:58.218 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:58.216+0000 7fd0a12e9640 1 Processor -- start 2024-08-18T22:45:58.218 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:58.216+0000 7fd0a12e9640 1 -- start start 2024-08-18T22:45:58.218 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:58.217+0000 7fd0a12e9640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd09c0fb1c0 0x7fd09c10f090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:45:58.218 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:58.217+0000 7fd0a12e9640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd09c0fc490 0x7fd09c10f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:45:58.218 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:58.217+0000 7fd0a12e9640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd09c10fc20 con 0x7fd09c0fc490 2024-08-18T22:45:58.218 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:58.217+0000 7fd0a12e9640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd09c1103f0 con 0x7fd09c0fb1c0 2024-08-18T22:45:58.219 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:58.217+0000 7fd09a7fc640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd09c0fc490 0x7fd09c10f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:45:58.219 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:58.217+0000 7fd09a7fc640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd09c0fc490 0x7fd09c10f5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:39042/0 (socket says 172.21.15.121:39042) 2024-08-18T22:45:58.220 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:58.217+0000 7fd09a7fc640 1 -- 172.21.15.121:0/172480218 learned_addr learned my addr 172.21.15.121:0/172480218 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-18T22:45:58.220 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:58.217+0000 7fd09affd640 1 --2- 172.21.15.121:0/172480218 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd09c0fb1c0 0x7fd09c10f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:45:58.220 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:58.217+0000 7fd09a7fc640 1 -- 172.21.15.121:0/172480218 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd09c0fb1c0 msgr2=0x7fd09c10f090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:45:58.220 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:58.217+0000 7fd09a7fc640 1 --2- 172.21.15.121:0/172480218 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd09c0fb1c0 0x7fd09c10f090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:45:58.220 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:58.217+0000 7fd09a7fc640 1 -- 172.21.15.121:0/172480218 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd084005040 con 0x7fd09c0fc490 2024-08-18T22:45:58.220 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:58.217+0000 7fd09a7fc640 1 --2- 172.21.15.121:0/172480218 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd09c0fc490 0x7fd09c10f5d0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fd084003080 tx=0x7fd084009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:45:58.220 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:58.217+0000 7fd0937fe640 1 -- 172.21.15.121:0/172480218 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd084038070 con 0x7fd09c0fc490 2024-08-18T22:45:58.220 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:58.217+0000 7fd0937fe640 1 -- 172.21.15.121:0/172480218 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fd08402abd0 con 0x7fd09c0fc490 2024-08-18T22:45:58.220 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:58.217+0000 7fd0937fe640 1 -- 172.21.15.121:0/172480218 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd08403e670 con 0x7fd09c0fc490 2024-08-18T22:45:58.220 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:58.217+0000 7fd0a12e9640 1 -- 172.21.15.121:0/172480218 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd09c110620 con 0x7fd09c0fc490 2024-08-18T22:45:58.220 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:58.218+0000 7fd0a12e9640 1 -- 172.21.15.121:0/172480218 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd09c110bc0 con 0x7fd09c0fc490 2024-08-18T22:45:58.221 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:58.218+0000 7fd0a12e9640 1 -- 172.21.15.121:0/172480218 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd09c0fa620 con 0x7fd09c0fc490 2024-08-18T22:45:58.221 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:58.219+0000 7fd0937fe640 1 -- 172.21.15.121:0/172480218 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 37) v1 ==== 92205+0+0 (secure 0 0 0) 0x7fd084030020 con 0x7fd09c0fc490 2024-08-18T22:45:58.221 INFO:journalctl@ceph.osd.2.smithi121.stdout:Aug 18 22:45:57 smithi121 ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-2-activate[100161]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-2/block 2024-08-18T22:45:58.221 INFO:journalctl@ceph.osd.2.smithi121.stdout:Aug 18 22:45:57 smithi121 bash[100146]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-2/block 2024-08-18T22:45:58.221 INFO:journalctl@ceph.osd.2.smithi121.stdout:Aug 18 22:45:57 smithi121 ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-2-activate[100161]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-08-18T22:45:58.222 INFO:journalctl@ceph.osd.2.smithi121.stdout:Aug 18 22:45:57 smithi121 bash[100146]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-08-18T22:45:58.222 INFO:journalctl@ceph.osd.2.smithi121.stdout:Aug 18 22:45:57 smithi121 ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-2-activate[100161]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-08-18T22:45:58.222 INFO:journalctl@ceph.osd.2.smithi121.stdout:Aug 18 22:45:57 smithi121 bash[100146]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-08-18T22:45:58.222 INFO:journalctl@ceph.osd.2.smithi121.stdout:Aug 18 22:45:57 smithi121 ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-2-activate[100161]: --> ceph-volume lvm activate successful for osd ID: 2 2024-08-18T22:45:58.222 INFO:journalctl@ceph.osd.2.smithi121.stdout:Aug 18 22:45:57 smithi121 bash[100146]: --> ceph-volume lvm activate successful for osd ID: 2 2024-08-18T22:45:58.222 INFO:journalctl@ceph.osd.2.smithi121.stdout:Aug 18 22:45:57 smithi121 podman[100146]: 2024-08-18 22:45:57.99795095 +0000 UTC m=+0.694374073 container died 15ac7f93b15ce8a026b97edf6eb8ebec762faae813402bd92f01e9db04707c4a (image=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-2-activate, CEPH_POINT_RELEASE=, RELEASE=squid-de09dd0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, io.buildah.version=1.36.0, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_CLEAN=True, ceph=True) 2024-08-18T22:45:58.224 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:58.220+0000 7fd0937fe640 1 --2- 172.21.15.121:0/172480218 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7fd08806e0b0 0x7fd088070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:45:58.224 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:58.220+0000 7fd0937fe640 1 -- 172.21.15.121:0/172480218 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6496+0+0 (secure 0 0 0) 0x7fd0840ade90 con 0x7fd09c0fc490 2024-08-18T22:45:58.224 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:58.220+0000 7fd09affd640 1 --2- 172.21.15.121:0/172480218 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7fd08806e0b0 0x7fd088070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:45:58.224 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:58.220+0000 7fd09affd640 1 --2- 172.21.15.121:0/172480218 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7fd08806e0b0 0x7fd088070560 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fd094007fd0 tx=0x7fd094009040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:45:58.225 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:58.224+0000 7fd0937fe640 1 -- 172.21.15.121:0/172480218 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7fd0840772f0 con 0x7fd09c0fc490 2024-08-18T22:45:58.410 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:58.409+0000 7fd0a12e9640 1 -- 172.21.15.121:0/172480218 --> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fd09c103cd0 con 0x7fd08806e0b0 2024-08-18T22:45:58.443 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:58.410+0000 7fd0937fe640 1 -- 172.21.15.121:0/172480218 <== mgr.34102 v2:172.21.15.121:6800/3037387239 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7fd09c103cd0 con 0x7fd08806e0b0 2024-08-18T22:45:58.443 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:58.412+0000 7fd0a12e9640 1 -- 172.21.15.121:0/172480218 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7fd08806e0b0 msgr2=0x7fd088070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:45:58.443 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:58.412+0000 7fd0a12e9640 1 --2- 172.21.15.121:0/172480218 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7fd08806e0b0 0x7fd088070560 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fd094007fd0 tx=0x7fd094009040 comp rx=0 tx=0).stop 2024-08-18T22:45:58.443 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:58.412+0000 7fd0a12e9640 1 -- 172.21.15.121:0/172480218 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd09c0fc490 msgr2=0x7fd09c10f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:45:58.444 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:58.412+0000 7fd0a12e9640 1 --2- 172.21.15.121:0/172480218 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd09c0fc490 0x7fd09c10f5d0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fd084003080 tx=0x7fd084009da0 comp rx=0 tx=0).stop 2024-08-18T22:45:58.444 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:58.412+0000 7fd0a12e9640 1 -- 172.21.15.121:0/172480218 shutdown_connections 2024-08-18T22:45:58.444 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:58.412+0000 7fd0a12e9640 1 --2- 172.21.15.121:0/172480218 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7fd08806e0b0 0x7fd088070560 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:45:58.444 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:58.412+0000 7fd0a12e9640 1 --2- 172.21.15.121:0/172480218 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd09c0fc490 0x7fd09c10f5d0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:45:58.444 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:58.412+0000 7fd0a12e9640 1 --2- 172.21.15.121:0/172480218 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd09c0fb1c0 0x7fd09c10f090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:45:58.444 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:58.413+0000 7fd0a12e9640 1 -- 172.21.15.121:0/172480218 >> 172.21.15.121:0/172480218 conn(0x7fd09c0f69a0 msgr2=0x7fd09c065c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:45:58.444 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:58.413+0000 7fd0a12e9640 1 -- 172.21.15.121:0/172480218 shutdown_connections 2024-08-18T22:45:58.444 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:58.413+0000 7fd0a12e9640 1 -- 172.21.15.121:0/172480218 wait complete. 2024-08-18T22:45:58.499 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:58.496+0000 7f4b34a30640 1 -- 172.21.15.121:0/1284212530 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4b300fb1f0 msgr2=0x7f4b300fb600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:45:58.499 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:58.496+0000 7f4b34a30640 1 --2- 172.21.15.121:0/1284212530 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4b300fb1f0 0x7f4b300fb600 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f4b200048d0 tx=0x7f4b20009da0 comp rx=0 tx=0).stop 2024-08-18T22:45:58.499 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:58.496+0000 7f4b34a30640 1 -- 172.21.15.121:0/1284212530 shutdown_connections 2024-08-18T22:45:58.499 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:58.496+0000 7f4b34a30640 1 --2- 172.21.15.121:0/1284212530 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4b300fc4c0 0x7f4b300fc930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:45:58.499 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:58.496+0000 7f4b34a30640 1 --2- 172.21.15.121:0/1284212530 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4b300fb1f0 0x7f4b300fb600 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:45:58.500 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:58.497+0000 7f4b34a30640 1 -- 172.21.15.121:0/1284212530 >> 172.21.15.121:0/1284212530 conn(0x7f4b300f69b0 msgr2=0x7f4b300f8de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:45:58.500 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:58.497+0000 7f4b34a30640 1 -- 172.21.15.121:0/1284212530 shutdown_connections 2024-08-18T22:45:58.500 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:58.497+0000 7f4b34a30640 1 -- 172.21.15.121:0/1284212530 wait complete. 2024-08-18T22:45:58.500 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:58.497+0000 7f4b34a30640 1 Processor -- start 2024-08-18T22:45:58.500 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:58.497+0000 7f4b34a30640 1 -- start start 2024-08-18T22:45:58.500 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:58.497+0000 7f4b34a30640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4b300fb1f0 0x7f4b3010fbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:45:58.500 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:58.497+0000 7f4b34a30640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4b300fc4c0 0x7f4b30112100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:45:58.500 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:58.497+0000 7f4b34a30640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b300664f0 con 0x7f4b300fb1f0 2024-08-18T22:45:58.500 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:58.497+0000 7f4b34a30640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b30066660 con 0x7f4b300fc4c0 2024-08-18T22:45:58.500 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:58.497+0000 7f4b2e59c640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4b300fb1f0 0x7f4b3010fbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:45:58.500 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:58.497+0000 7f4b2e59c640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4b300fb1f0 0x7f4b3010fbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:39062/0 (socket says 172.21.15.121:39062) 2024-08-18T22:45:58.500 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:58.497+0000 7f4b2e59c640 1 -- 172.21.15.121:0/1497012734 learned_addr learned my addr 172.21.15.121:0/1497012734 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-18T22:45:58.501 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:58.498+0000 7f4b2dd9b640 1 --2- 172.21.15.121:0/1497012734 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4b300fc4c0 0x7f4b30112100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:45:58.501 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:58.498+0000 7f4b2e59c640 1 -- 172.21.15.121:0/1497012734 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4b300fc4c0 msgr2=0x7f4b30112100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:45:58.501 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:58.498+0000 7f4b2e59c640 1 --2- 172.21.15.121:0/1497012734 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4b300fc4c0 0x7f4b30112100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:45:58.501 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:58.498+0000 7f4b2e59c640 1 -- 172.21.15.121:0/1497012734 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b20005040 con 0x7f4b300fb1f0 2024-08-18T22:45:58.501 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:58.498+0000 7f4b2e59c640 1 --2- 172.21.15.121:0/1497012734 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4b300fb1f0 0x7f4b3010fbb0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f4b20003080 tx=0x7f4b20009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:45:58.501 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:58.498+0000 7f4b1effd640 1 -- 172.21.15.121:0/1497012734 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4b20038070 con 0x7f4b300fb1f0 2024-08-18T22:45:58.501 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:58.498+0000 7f4b1effd640 1 -- 172.21.15.121:0/1497012734 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f4b2002ae90 con 0x7f4b300fb1f0 2024-08-18T22:45:58.501 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:58.498+0000 7f4b34a30640 1 -- 172.21.15.121:0/1497012734 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b30112640 con 0x7f4b300fb1f0 2024-08-18T22:45:58.501 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:58.498+0000 7f4b1effd640 1 -- 172.21.15.121:0/1497012734 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4b20033660 con 0x7f4b300fb1f0 2024-08-18T22:45:58.501 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:58.498+0000 7f4b34a30640 1 -- 172.21.15.121:0/1497012734 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b30112bb0 con 0x7f4b300fb1f0 2024-08-18T22:45:58.502 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:58.499+0000 7f4b34a30640 1 -- 172.21.15.121:0/1497012734 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b300fa650 con 0x7f4b300fb1f0 2024-08-18T22:45:58.502 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:58.500+0000 7f4b1effd640 1 -- 172.21.15.121:0/1497012734 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 37) v1 ==== 92205+0+0 (secure 0 0 0) 0x7f4b20030020 con 0x7f4b300fb1f0 2024-08-18T22:45:58.502 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:58.500+0000 7f4b1effd640 1 --2- 172.21.15.121:0/1497012734 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f4b1806e0b0 0x7f4b18070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:45:58.502 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:58.500+0000 7f4b1effd640 1 -- 172.21.15.121:0/1497012734 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f4b200adcb0 con 0x7f4b300fb1f0 2024-08-18T22:45:58.502 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:58.500+0000 7f4b2dd9b640 1 --2- 172.21.15.121:0/1497012734 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f4b1806e0b0 0x7f4b18070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:45:58.503 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:58.501+0000 7f4b2dd9b640 1 --2- 172.21.15.121:0/1497012734 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f4b1806e0b0 0x7f4b18070560 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f4b24007fd0 tx=0x7f4b24009e90 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:45:58.505 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:58.505+0000 7f4b1effd640 1 -- 172.21.15.121:0/1497012734 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f4b20077060 con 0x7f4b300fb1f0 2024-08-18T22:45:58.692 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:58.690+0000 7f4b34a30640 1 -- 172.21.15.121:0/1497012734 --> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f4b30100920 con 0x7f4b1806e0b0 2024-08-18T22:45:58.702 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:58.701+0000 7f4b1effd640 1 -- 172.21.15.121:0/1497012734 <== mgr.34102 v2:172.21.15.121:6800/3037387239 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f4b30100920 con 0x7f4b1806e0b0 2024-08-18T22:45:58.702 INFO:teuthology.orchestra.run.smithi121.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-08-18T22:45:58.702 INFO:teuthology.orchestra.run.smithi121.stdout:alertmanager.smithi121 smithi121 *:9093,9094 running (3m) 28s ago 11m 22.8M - 0.25.0 c8568f914cd2 c421c5e6a02b 2024-08-18T22:45:58.702 INFO:teuthology.orchestra.run.smithi121.stdout:crash.smithi121 smithi121 running (91s) 28s ago 12m 6903k - 19.1.0-1382-gde09dd01 ea7a5189f30b 3cf5c666a0e6 2024-08-18T22:45:58.702 INFO:teuthology.orchestra.run.smithi121.stdout:crash.smithi195 smithi195 running (86s) 83s ago 11m 6895k - 19.1.0-1382-gde09dd01 ea7a5189f30b fbb586fb9834 2024-08-18T22:45:58.702 INFO:teuthology.orchestra.run.smithi121.stdout:grafana.smithi121 smithi121 *:3000 running (3m) 28s ago 11m 79.4M - 9.4.7 954c08fa6188 091a5fd17e8a 2024-08-18T22:45:58.702 INFO:teuthology.orchestra.run.smithi121.stdout:mds.cephfs.smithi121.gbickb smithi121 running (6m) 28s ago 6m 156M - 17.2.7-1406-gdf62bdcc 774894bef55f 484da0bc2c95 2024-08-18T22:45:58.702 INFO:teuthology.orchestra.run.smithi121.stdout:mds.cephfs.smithi121.xuzsdg smithi121 running (6m) 28s ago 6m 13.5M - 17.2.7-1406-gdf62bdcc 774894bef55f 6976b708cdcd 2024-08-18T22:45:58.703 INFO:teuthology.orchestra.run.smithi121.stdout:mds.cephfs.smithi195.buqvbr smithi195 running (6m) 83s ago 6m 115M - 17.2.7-1406-gdf62bdcc 774894bef55f 11a3703b4276 2024-08-18T22:45:58.703 INFO:teuthology.orchestra.run.smithi121.stdout:mds.cephfs.smithi195.nptgyc smithi195 running (6m) 83s ago 6m 17.6M - 17.2.7-1406-gdf62bdcc 774894bef55f b9f8043ea83e 2024-08-18T22:45:58.703 INFO:teuthology.orchestra.run.smithi121.stdout:mgr.smithi121.lopxqc smithi121 *:8443,9283,8765 running (3m) 28s ago 13m 496M - 19.1.0-1382-gde09dd01 ea7a5189f30b 9079701e6516 2024-08-18T22:45:58.703 INFO:teuthology.orchestra.run.smithi121.stdout:mgr.smithi195.acttsj smithi195 *:8443,9283,8765 running (2m) 83s ago 11m 439M - 19.1.0-1382-gde09dd01 ea7a5189f30b 7b4027a33daa 2024-08-18T22:45:58.703 INFO:teuthology.orchestra.run.smithi121.stdout:mon.smithi121 smithi121 running (2m) 28s ago 13m 47.2M 2048M 19.1.0-1382-gde09dd01 ea7a5189f30b d71695a4fb56 2024-08-18T22:45:58.703 INFO:teuthology.orchestra.run.smithi121.stdout:mon.smithi195 smithi195 running (2m) 83s ago 10m 35.1M 2048M 19.1.0-1382-gde09dd01 ea7a5189f30b a9bb94ba3b56 2024-08-18T22:45:58.703 INFO:teuthology.orchestra.run.smithi121.stdout:node-exporter.smithi121 smithi121 *:9100 running (3m) 28s ago 11m 14.8M - 1.5.0 0da6a335fe13 bc4b5355a507 2024-08-18T22:45:58.703 INFO:teuthology.orchestra.run.smithi121.stdout:node-exporter.smithi195 smithi195 *:9100 running (3m) 83s ago 11m 16.4M - 1.5.0 0da6a335fe13 146efcb79663 2024-08-18T22:45:58.703 INFO:teuthology.orchestra.run.smithi121.stdout:osd.0 smithi121 running (67s) 28s ago 10m 98.0M 1557M 19.1.0-1382-gde09dd01 ea7a5189f30b d378dd46eeb6 2024-08-18T22:45:58.703 INFO:teuthology.orchestra.run.smithi121.stdout:osd.1 smithi121 running (33s) 28s ago 9m 14.5M 1557M 19.1.0-1382-gde09dd01 ea7a5189f30b 0f9e03de5382 2024-08-18T22:45:58.703 INFO:teuthology.orchestra.run.smithi121.stdout:osd.2 smithi121 running (9m) 28s ago 9m 182M 1557M 17.2.7-1406-gdf62bdcc 774894bef55f 3fa061e41f99 2024-08-18T22:45:58.703 INFO:teuthology.orchestra.run.smithi121.stdout:osd.3 smithi195 running (9m) 83s ago 9m 239M 2581M 17.2.7-1406-gdf62bdcc 774894bef55f 15d30b1b459e 2024-08-18T22:45:58.703 INFO:teuthology.orchestra.run.smithi121.stdout:osd.4 smithi195 running (8m) 83s ago 8m 207M 2581M 17.2.7-1406-gdf62bdcc 774894bef55f 99ed156dfd36 2024-08-18T22:45:58.703 INFO:teuthology.orchestra.run.smithi121.stdout:osd.5 smithi195 running (8m) 83s ago 8m 213M 2581M 17.2.7-1406-gdf62bdcc 774894bef55f e7eff7bdb752 2024-08-18T22:45:58.704 INFO:teuthology.orchestra.run.smithi121.stdout:prometheus.smithi121 smithi121 *:9095 running (2m) 28s ago 11m 53.9M - 2.43.0 a07b618ecd1d 00c4f776d23a 2024-08-18T22:45:58.704 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:58.703+0000 7f4b34a30640 1 -- 172.21.15.121:0/1497012734 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f4b1806e0b0 msgr2=0x7f4b18070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:45:58.704 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:58.703+0000 7f4b34a30640 1 --2- 172.21.15.121:0/1497012734 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f4b1806e0b0 0x7f4b18070560 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f4b24007fd0 tx=0x7f4b24009e90 comp rx=0 tx=0).stop 2024-08-18T22:45:58.704 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:58.703+0000 7f4b34a30640 1 -- 172.21.15.121:0/1497012734 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4b300fb1f0 msgr2=0x7f4b3010fbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:45:58.704 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:58.703+0000 7f4b34a30640 1 --2- 172.21.15.121:0/1497012734 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4b300fb1f0 0x7f4b3010fbb0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f4b20003080 tx=0x7f4b20009da0 comp rx=0 tx=0).stop 2024-08-18T22:45:58.705 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:58.703+0000 7f4b34a30640 1 -- 172.21.15.121:0/1497012734 shutdown_connections 2024-08-18T22:45:58.705 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:58.703+0000 7f4b34a30640 1 --2- 172.21.15.121:0/1497012734 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f4b1806e0b0 0x7f4b18070560 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:45:58.705 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:58.703+0000 7f4b34a30640 1 --2- 172.21.15.121:0/1497012734 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4b300fc4c0 0x7f4b30112100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:45:58.705 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:58.703+0000 7f4b34a30640 1 --2- 172.21.15.121:0/1497012734 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4b300fb1f0 0x7f4b3010fbb0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:45:58.705 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:58.703+0000 7f4b34a30640 1 -- 172.21.15.121:0/1497012734 >> 172.21.15.121:0/1497012734 conn(0x7f4b300f69b0 msgr2=0x7f4b300f81e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:45:58.705 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:58.703+0000 7f4b34a30640 1 -- 172.21.15.121:0/1497012734 shutdown_connections 2024-08-18T22:45:58.705 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:58.703+0000 7f4b34a30640 1 -- 172.21.15.121:0/1497012734 wait complete. 2024-08-18T22:45:58.787 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:58.785+0000 7f789c8f4640 1 -- 172.21.15.121:0/206761975 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f78980fc2d0 msgr2=0x7f78980fc6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:45:58.787 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:58.785+0000 7f789c8f4640 1 --2- 172.21.15.121:0/206761975 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f78980fc2d0 0x7f78980fc6e0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f78880048d0 tx=0x7f7888009da0 comp rx=0 tx=0).stop 2024-08-18T22:45:58.787 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:58.786+0000 7f789c8f4640 1 -- 172.21.15.121:0/206761975 shutdown_connections 2024-08-18T22:45:58.787 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:58.786+0000 7f789c8f4640 1 --2- 172.21.15.121:0/206761975 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f78980fd5a0 0x7f78980fda10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:45:58.787 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:58.786+0000 7f789c8f4640 1 --2- 172.21.15.121:0/206761975 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f78980fc2d0 0x7f78980fc6e0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:45:58.787 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:58.786+0000 7f789c8f4640 1 -- 172.21.15.121:0/206761975 >> 172.21.15.121:0/206761975 conn(0x7f78980f7ab0 msgr2=0x7f78980f9ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:45:58.787 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:58.786+0000 7f789c8f4640 1 -- 172.21.15.121:0/206761975 shutdown_connections 2024-08-18T22:45:58.787 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:58.786+0000 7f789c8f4640 1 -- 172.21.15.121:0/206761975 wait complete. 2024-08-18T22:45:58.788 INFO:journalctl@ceph.osd.2.smithi121.stdout:Aug 18 22:45:58 smithi121 podman[100293]: 2024-08-18 22:45:58.631449222 +0000 UTC m=+0.623680556 container remove 15ac7f93b15ce8a026b97edf6eb8ebec762faae813402bd92f01e9db04707c4a (image=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-2-activate, RELEASE=squid-de09dd0, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.36.0, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True) 2024-08-18T22:45:58.790 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:58.786+0000 7f789c8f4640 1 Processor -- start 2024-08-18T22:45:58.790 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:58.786+0000 7f789c8f4640 1 -- start start 2024-08-18T22:45:58.790 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:58.787+0000 7f789c8f4640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f78980fc2d0 0x7f789810ce70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:45:58.790 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:58.787+0000 7f789c8f4640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f78980fd5a0 0x7f789810d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:45:58.790 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:58.787+0000 7f789c8f4640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f789810da00 con 0x7f78980fd5a0 2024-08-18T22:45:58.790 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:58.787+0000 7f789c8f4640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f789810e140 con 0x7f78980fc2d0 2024-08-18T22:45:58.790 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:58.787+0000 7f788ffff640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f78980fd5a0 0x7f789810d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:45:58.790 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:58.787+0000 7f788ffff640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f78980fd5a0 0x7f789810d3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:39082/0 (socket says 172.21.15.121:39082) 2024-08-18T22:45:58.790 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:58.787+0000 7f788ffff640 1 -- 172.21.15.121:0/437924470 learned_addr learned my addr 172.21.15.121:0/437924470 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-18T22:45:58.790 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:58.787+0000 7f789659c640 1 --2- 172.21.15.121:0/437924470 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f78980fc2d0 0x7f789810ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:45:58.790 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:58.787+0000 7f788ffff640 1 -- 172.21.15.121:0/437924470 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f78980fc2d0 msgr2=0x7f789810ce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:45:58.791 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:58.787+0000 7f788ffff640 1 --2- 172.21.15.121:0/437924470 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f78980fc2d0 0x7f789810ce70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:45:58.791 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:58.787+0000 7f788ffff640 1 -- 172.21.15.121:0/437924470 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7888005040 con 0x7f78980fd5a0 2024-08-18T22:45:58.791 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:58.787+0000 7f789659c640 1 --2- 172.21.15.121:0/437924470 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f78980fc2d0 0x7f789810ce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:45:58.791 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:58.787+0000 7f788ffff640 1 --2- 172.21.15.121:0/437924470 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f78980fd5a0 0x7f789810d3b0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f788000c810 tx=0x7f78800043c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:45:58.791 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:58.787+0000 7f788effd640 1 -- 172.21.15.121:0/437924470 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f788000a820 con 0x7f78980fd5a0 2024-08-18T22:45:58.791 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:58.787+0000 7f789c8f4640 1 -- 172.21.15.121:0/437924470 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f789810e3d0 con 0x7f78980fd5a0 2024-08-18T22:45:58.791 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:58.787+0000 7f789c8f4640 1 -- 172.21.15.121:0/437924470 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f789810e970 con 0x7f78980fd5a0 2024-08-18T22:45:58.791 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:58.787+0000 7f788effd640 1 -- 172.21.15.121:0/437924470 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f788000ae20 con 0x7f78980fd5a0 2024-08-18T22:45:58.791 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:58.788+0000 7f788effd640 1 -- 172.21.15.121:0/437924470 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f78800115c0 con 0x7f78980fd5a0 2024-08-18T22:45:58.791 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:58.788+0000 7f789c8f4640 1 -- 172.21.15.121:0/437924470 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78980fb730 con 0x7f78980fd5a0 2024-08-18T22:45:58.791 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:58.789+0000 7f788effd640 1 -- 172.21.15.121:0/437924470 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 37) v1 ==== 92205+0+0 (secure 0 0 0) 0x7f7880012840 con 0x7f78980fd5a0 2024-08-18T22:45:58.792 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:58.789+0000 7f788effd640 1 --2- 172.21.15.121:0/437924470 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f788406e0b0 0x7f7884070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:45:58.792 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:58.790+0000 7f788effd640 1 -- 172.21.15.121:0/437924470 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f788008e170 con 0x7f78980fd5a0 2024-08-18T22:45:58.792 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:58.790+0000 7f789659c640 1 --2- 172.21.15.121:0/437924470 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f788406e0b0 0x7f7884070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:45:58.792 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:58.790+0000 7f789659c640 1 --2- 172.21.15.121:0/437924470 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f788406e0b0 0x7f7884070560 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f7888007ac0 tx=0x7f7888035040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:45:58.795 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:58.794+0000 7f788effd640 1 -- 172.21.15.121:0/437924470 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f78800574a0 con 0x7f78980fd5a0 2024-08-18T22:45:59.038 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:59.036+0000 7f789c8f4640 1 -- 172.21.15.121:0/437924470 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f7898104cd0 con 0x7f78980fd5a0 2024-08-18T22:45:59.038 INFO:journalctl@ceph.osd.2.smithi121.stdout:Aug 18 22:45:58 smithi121 podman[100405]: 2024-08-18 22:45:58.74927872 +0000 UTC m=+0.017261882 image pull ea7a5189f30bad3aca9524788e2965d2368d7ce786df09d4edcd8c3edf9cefba quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9 2024-08-18T22:45:59.038 INFO:journalctl@ceph.osd.2.smithi121.stdout:Aug 18 22:45:58 smithi121 podman[100405]: 2024-08-18 22:45:58.874800071 +0000 UTC m=+0.142783230 container create 93270b5bed689073bfe28362e591881f556f2f2e8f46c60585fcc8c914152ded (image=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-2, org.label-schema.schema-version=1.0, RELEASE=squid-de09dd0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.36.0, GIT_CLEAN=True, ceph=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=) 2024-08-18T22:45:59.039 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:59.037+0000 7f788effd640 1 -- 172.21.15.121:0/437924470 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+838 (secure 0 0 0) 0x7f788005ab60 con 0x7f78980fd5a0 2024-08-18T22:45:59.039 INFO:teuthology.orchestra.run.smithi121.stdout:{ 2024-08-18T22:45:59.039 INFO:teuthology.orchestra.run.smithi121.stdout: "mon": { 2024-08-18T22:45:59.039 INFO:teuthology.orchestra.run.smithi121.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 2 2024-08-18T22:45:59.039 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-18T22:45:59.039 INFO:teuthology.orchestra.run.smithi121.stdout: "mgr": { 2024-08-18T22:45:59.039 INFO:teuthology.orchestra.run.smithi121.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 2 2024-08-18T22:45:59.039 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-18T22:45:59.039 INFO:teuthology.orchestra.run.smithi121.stdout: "osd": { 2024-08-18T22:45:59.040 INFO:teuthology.orchestra.run.smithi121.stdout: "ceph version 17.2.7-1406-gdf62bdcc (df62bdccd9a13bf566b27a250eddfdd89be3072d) quincy (stable)": 3, 2024-08-18T22:45:59.040 INFO:teuthology.orchestra.run.smithi121.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 2 2024-08-18T22:45:59.040 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-18T22:45:59.040 INFO:teuthology.orchestra.run.smithi121.stdout: "mds": { 2024-08-18T22:45:59.040 INFO:teuthology.orchestra.run.smithi121.stdout: "ceph version 17.2.7-1406-gdf62bdcc (df62bdccd9a13bf566b27a250eddfdd89be3072d) quincy (stable)": 4 2024-08-18T22:45:59.040 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-18T22:45:59.040 INFO:teuthology.orchestra.run.smithi121.stdout: "overall": { 2024-08-18T22:45:59.040 INFO:teuthology.orchestra.run.smithi121.stdout: "ceph version 17.2.7-1406-gdf62bdcc (df62bdccd9a13bf566b27a250eddfdd89be3072d) quincy (stable)": 7, 2024-08-18T22:45:59.040 INFO:teuthology.orchestra.run.smithi121.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 6 2024-08-18T22:45:59.040 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-08-18T22:45:59.040 INFO:teuthology.orchestra.run.smithi121.stdout:} 2024-08-18T22:45:59.041 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:59.039+0000 7f789c8f4640 1 -- 172.21.15.121:0/437924470 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f788406e0b0 msgr2=0x7f7884070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:45:59.041 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:59.039+0000 7f789c8f4640 1 --2- 172.21.15.121:0/437924470 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f788406e0b0 0x7f7884070560 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f7888007ac0 tx=0x7f7888035040 comp rx=0 tx=0).stop 2024-08-18T22:45:59.041 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:59.039+0000 7f789c8f4640 1 -- 172.21.15.121:0/437924470 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f78980fd5a0 msgr2=0x7f789810d3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:45:59.041 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:59.039+0000 7f789c8f4640 1 --2- 172.21.15.121:0/437924470 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f78980fd5a0 0x7f789810d3b0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f788000c810 tx=0x7f78800043c0 comp rx=0 tx=0).stop 2024-08-18T22:45:59.041 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:59.040+0000 7f789c8f4640 1 -- 172.21.15.121:0/437924470 shutdown_connections 2024-08-18T22:45:59.041 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:59.040+0000 7f789c8f4640 1 --2- 172.21.15.121:0/437924470 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f788406e0b0 0x7f7884070560 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:45:59.041 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:59.040+0000 7f789c8f4640 1 --2- 172.21.15.121:0/437924470 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f78980fd5a0 0x7f789810d3b0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:45:59.041 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:59.040+0000 7f789c8f4640 1 --2- 172.21.15.121:0/437924470 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f78980fc2d0 0x7f789810ce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:45:59.041 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:59.040+0000 7f789c8f4640 1 -- 172.21.15.121:0/437924470 >> 172.21.15.121:0/437924470 conn(0x7f78980f7ab0 msgr2=0x7f78980f9260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:45:59.042 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:59.040+0000 7f789c8f4640 1 -- 172.21.15.121:0/437924470 shutdown_connections 2024-08-18T22:45:59.042 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:59.040+0000 7f789c8f4640 1 -- 172.21.15.121:0/437924470 wait complete. 2024-08-18T22:45:59.120 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:59.118+0000 7f650fd38640 1 -- 172.21.15.121:0/2627241532 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f65080fc490 msgr2=0x7f65080fc900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:45:59.120 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:59.118+0000 7f650fd38640 1 --2- 172.21.15.121:0/2627241532 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f65080fc490 0x7f65080fc900 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f64f80048d0 tx=0x7f64f8009da0 comp rx=0 tx=0).stop 2024-08-18T22:45:59.120 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:59.118+0000 7f650fd38640 1 -- 172.21.15.121:0/2627241532 shutdown_connections 2024-08-18T22:45:59.121 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:59.118+0000 7f650fd38640 1 --2- 172.21.15.121:0/2627241532 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f65080fc490 0x7f65080fc900 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:45:59.121 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:59.118+0000 7f650fd38640 1 --2- 172.21.15.121:0/2627241532 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f65080fb1c0 0x7f65080fb5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:45:59.121 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:59.118+0000 7f650fd38640 1 -- 172.21.15.121:0/2627241532 >> 172.21.15.121:0/2627241532 conn(0x7f65080f69a0 msgr2=0x7f65080f8db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:45:59.121 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:59.118+0000 7f650fd38640 1 -- 172.21.15.121:0/2627241532 shutdown_connections 2024-08-18T22:45:59.121 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:59.118+0000 7f650fd38640 1 -- 172.21.15.121:0/2627241532 wait complete. 2024-08-18T22:45:59.121 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:59.118+0000 7f650fd38640 1 Processor -- start 2024-08-18T22:45:59.121 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:59.118+0000 7f650fd38640 1 -- start start 2024-08-18T22:45:59.121 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:59.118+0000 7f650fd38640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f65080fb1c0 0x7f65080ff2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:45:59.121 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:59.118+0000 7f650fd38640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f65080fc490 0x7f65080fd7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:45:59.122 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:59.118+0000 7f650fd38640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65080fddf0 con 0x7f65080fb1c0 2024-08-18T22:45:59.122 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:59.118+0000 7f650fd38640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65080fdf30 con 0x7f65080fc490 2024-08-18T22:45:59.122 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:59.119+0000 7f650dad4640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f65080fb1c0 0x7f65080ff2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:45:59.122 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:59.119+0000 7f650dad4640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f65080fb1c0 0x7f65080ff2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:39086/0 (socket says 172.21.15.121:39086) 2024-08-18T22:45:59.122 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:59.119+0000 7f650dad4640 1 -- 172.21.15.121:0/2108389661 learned_addr learned my addr 172.21.15.121:0/2108389661 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-18T22:45:59.122 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:59.119+0000 7f650d2d3640 1 --2- 172.21.15.121:0/2108389661 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f65080fc490 0x7f65080fd7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:45:59.122 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:59.119+0000 7f650dad4640 1 -- 172.21.15.121:0/2108389661 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f65080fc490 msgr2=0x7f65080fd7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:45:59.122 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:59.119+0000 7f650dad4640 1 --2- 172.21.15.121:0/2108389661 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f65080fc490 0x7f65080fd7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:45:59.122 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:59.119+0000 7f650dad4640 1 -- 172.21.15.121:0/2108389661 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64f8005040 con 0x7f65080fb1c0 2024-08-18T22:45:59.122 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:59.119+0000 7f650d2d3640 1 --2- 172.21.15.121:0/2108389661 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f65080fc490 0x7f65080fd7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:45:59.122 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:59.119+0000 7f650dad4640 1 --2- 172.21.15.121:0/2108389661 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f65080fb1c0 0x7f65080ff2e0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f650400b790 tx=0x7f65040091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:45:59.122 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:59.119+0000 7f64fe7fc640 1 -- 172.21.15.121:0/2108389661 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f650400c700 con 0x7f65080fb1c0 2024-08-18T22:45:59.123 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:59.119+0000 7f64fe7fc640 1 -- 172.21.15.121:0/2108389661 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f650400cd00 con 0x7f65080fb1c0 2024-08-18T22:45:59.123 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:59.119+0000 7f64fe7fc640 1 -- 172.21.15.121:0/2108389661 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6504015e70 con 0x7f65080fb1c0 2024-08-18T22:45:59.123 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:59.119+0000 7f650fd38640 1 -- 172.21.15.121:0/2108389661 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65080fe210 con 0x7f65080fb1c0 2024-08-18T22:45:59.123 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:59.119+0000 7f650fd38640 1 -- 172.21.15.121:0/2108389661 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6508114ea0 con 0x7f65080fb1c0 2024-08-18T22:45:59.124 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:59.120+0000 7f650fd38640 1 -- 172.21.15.121:0/2108389661 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65080fa620 con 0x7f65080fb1c0 2024-08-18T22:45:59.124 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:59.121+0000 7f64fe7fc640 1 -- 172.21.15.121:0/2108389661 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 37) v1 ==== 92205+0+0 (secure 0 0 0) 0x7f6504012070 con 0x7f65080fb1c0 2024-08-18T22:45:59.124 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:59.121+0000 7f64fe7fc640 1 --2- 172.21.15.121:0/2108389661 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f64f406e0b0 0x7f64f4070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:45:59.124 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:59.121+0000 7f64fe7fc640 1 -- 172.21.15.121:0/2108389661 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f650408d710 con 0x7f65080fb1c0 2024-08-18T22:45:59.124 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:59.122+0000 7f650d2d3640 1 --2- 172.21.15.121:0/2108389661 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f64f406e0b0 0x7f64f4070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:45:59.124 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:59.122+0000 7f650d2d3640 1 --2- 172.21.15.121:0/2108389661 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f64f406e0b0 0x7f64f4070560 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f64f800b020 tx=0x7f64f8009da0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:45:59.127 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:59.126+0000 7f64fe7fc640 1 -- 172.21.15.121:0/2108389661 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f6504056a40 con 0x7f65080fb1c0 2024-08-18T22:45:59.333 INFO:journalctl@ceph.osd.2.smithi121.stdout:Aug 18 22:45:59 smithi121 podman[100405]: 2024-08-18 22:45:59.110387731 +0000 UTC m=+0.378370893 container init 93270b5bed689073bfe28362e591881f556f2f2e8f46c60585fcc8c914152ded (image=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, RELEASE=squid-de09dd0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, ceph=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , io.buildah.version=1.36.0, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image) 2024-08-18T22:45:59.334 INFO:journalctl@ceph.osd.2.smithi121.stdout:Aug 18 22:45:59 smithi121 podman[100405]: 2024-08-18 22:45:59.11474767 +0000 UTC m=+0.382730828 container start 93270b5bed689073bfe28362e591881f556f2f2e8f46c60585fcc8c914152ded (image=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, RELEASE=squid-de09dd0, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.36.0) 2024-08-18T22:45:59.334 INFO:journalctl@ceph.osd.2.smithi121.stdout:Aug 18 22:45:59 smithi121 ceph-osd[100448]: -- 172.21.15.121:0/1521150961 <== mon.0 v2:172.21.15.121:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55a86c4b21e0 con 0x55a86b665c00 2024-08-18T22:45:59.334 INFO:journalctl@ceph.osd.2.smithi121.stdout:Aug 18 22:45:59 smithi121 bash[100405]: 93270b5bed689073bfe28362e591881f556f2f2e8f46c60585fcc8c914152ded 2024-08-18T22:45:59.334 INFO:journalctl@ceph.osd.2.smithi121.stdout:Aug 18 22:45:59 smithi121 systemd[1]: Started Ceph osd.2 for b003123a-5db1-11ef-bccf-c7b262605968. 2024-08-18T22:45:59.339 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:59.338+0000 7f650fd38640 1 -- 172.21.15.121:0/2108389661 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f6508103c40 con 0x7f65080fb1c0 2024-08-18T22:45:59.340 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:59.339+0000 7f64fe7fc640 1 -- 172.21.15.121:0/2108389661 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 22 v22) v1 ==== 76+0+1942 (secure 0 0 0) 0x7f650405a100 con 0x7f65080fb1c0 2024-08-18T22:45:59.340 INFO:teuthology.orchestra.run.smithi121.stdout:e22 2024-08-18T22:45:59.340 INFO:teuthology.orchestra.run.smithi121.stdout:btime 2024-08-18T22:45:32:233419+0000 2024-08-18T22:45:59.340 INFO:teuthology.orchestra.run.smithi121.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-08-18T22:45:59.340 INFO:teuthology.orchestra.run.smithi121.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-08-18T22:45:59.340 INFO:teuthology.orchestra.run.smithi121.stdout:legacy client fscid: 1 2024-08-18T22:45:59.340 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-08-18T22:45:59.340 INFO:teuthology.orchestra.run.smithi121.stdout:Filesystem 'cephfs' (1) 2024-08-18T22:45:59.341 INFO:teuthology.orchestra.run.smithi121.stdout:fs_name cephfs 2024-08-18T22:45:59.341 INFO:teuthology.orchestra.run.smithi121.stdout:epoch 22 2024-08-18T22:45:59.341 INFO:teuthology.orchestra.run.smithi121.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-08-18T22:45:59.341 INFO:teuthology.orchestra.run.smithi121.stdout:created 2024-08-18T22:39:04.054074+0000 2024-08-18T22:45:59.341 INFO:teuthology.orchestra.run.smithi121.stdout:modified 2024-08-18T22:45:31.247467+0000 2024-08-18T22:45:59.341 INFO:teuthology.orchestra.run.smithi121.stdout:tableserver 0 2024-08-18T22:45:59.341 INFO:teuthology.orchestra.run.smithi121.stdout:root 0 2024-08-18T22:45:59.341 INFO:teuthology.orchestra.run.smithi121.stdout:session_timeout 60 2024-08-18T22:45:59.341 INFO:teuthology.orchestra.run.smithi121.stdout:session_autoclose 300 2024-08-18T22:45:59.341 INFO:teuthology.orchestra.run.smithi121.stdout:max_file_size 1099511627776 2024-08-18T22:45:59.341 INFO:teuthology.orchestra.run.smithi121.stdout:max_xattr_size 65536 2024-08-18T22:45:59.341 INFO:teuthology.orchestra.run.smithi121.stdout:required_client_features {} 2024-08-18T22:45:59.341 INFO:teuthology.orchestra.run.smithi121.stdout:last_failure 0 2024-08-18T22:45:59.341 INFO:teuthology.orchestra.run.smithi121.stdout:last_failure_osd_epoch 47 2024-08-18T22:45:59.342 INFO:teuthology.orchestra.run.smithi121.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-08-18T22:45:59.342 INFO:teuthology.orchestra.run.smithi121.stdout:max_mds 2 2024-08-18T22:45:59.342 INFO:teuthology.orchestra.run.smithi121.stdout:in 0,1 2024-08-18T22:45:59.342 INFO:teuthology.orchestra.run.smithi121.stdout:up {0=14474,1=24249} 2024-08-18T22:45:59.342 INFO:teuthology.orchestra.run.smithi121.stdout:failed 2024-08-18T22:45:59.342 INFO:teuthology.orchestra.run.smithi121.stdout:damaged 2024-08-18T22:45:59.342 INFO:teuthology.orchestra.run.smithi121.stdout:stopped 2024-08-18T22:45:59.342 INFO:teuthology.orchestra.run.smithi121.stdout:data_pools [3] 2024-08-18T22:45:59.342 INFO:teuthology.orchestra.run.smithi121.stdout:metadata_pool 2 2024-08-18T22:45:59.342 INFO:teuthology.orchestra.run.smithi121.stdout:inline_data disabled 2024-08-18T22:45:59.342 INFO:teuthology.orchestra.run.smithi121.stdout:balancer 2024-08-18T22:45:59.342 INFO:teuthology.orchestra.run.smithi121.stdout:bal_rank_mask -1 2024-08-18T22:45:59.342 INFO:teuthology.orchestra.run.smithi121.stdout:standby_count_wanted 1 2024-08-18T22:45:59.343 INFO:teuthology.orchestra.run.smithi121.stdout:qdb_cluster leader: 14474 members: 14474,24249 2024-08-18T22:45:59.343 INFO:teuthology.orchestra.run.smithi121.stdout:[mds.cephfs.smithi121.gbickb{0:14474} state up:active seq 83 join_fscid=1 addr [v2:172.21.15.121:6828/2277706406,v1:172.21.15.121:6829/2277706406] compat {c=[1],r=[1],i=[7ff]}] 2024-08-18T22:45:59.343 INFO:teuthology.orchestra.run.smithi121.stdout:[mds.cephfs.smithi195.buqvbr{1:24249} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.195:6824/2414511859,v1:172.21.15.195:6825/2414511859] compat {c=[1],r=[1],i=[7ff]}] 2024-08-18T22:45:59.343 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-08-18T22:45:59.343 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-08-18T22:45:59.343 INFO:teuthology.orchestra.run.smithi121.stdout:Standby daemons: 2024-08-18T22:45:59.343 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-08-18T22:45:59.343 INFO:teuthology.orchestra.run.smithi121.stdout:[mds.cephfs.smithi121.xuzsdg{-1:14490} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.121:6826/91588128,v1:172.21.15.121:6827/91588128] compat {c=[1],r=[1],i=[7ff]}] 2024-08-18T22:45:59.343 INFO:teuthology.orchestra.run.smithi121.stdout:[mds.cephfs.smithi195.nptgyc{-1:24259} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.195:6826/238549847,v1:172.21.15.195:6827/238549847] compat {c=[1],r=[1],i=[7ff]}] 2024-08-18T22:45:59.344 INFO:teuthology.orchestra.run.smithi121.stderr:dumped fsmap epoch 22 2024-08-18T22:45:59.344 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:59.341+0000 7f650fd38640 1 -- 172.21.15.121:0/2108389661 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f64f406e0b0 msgr2=0x7f64f4070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:45:59.344 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:59.341+0000 7f650fd38640 1 --2- 172.21.15.121:0/2108389661 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f64f406e0b0 0x7f64f4070560 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f64f800b020 tx=0x7f64f8009da0 comp rx=0 tx=0).stop 2024-08-18T22:45:59.344 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:59.341+0000 7f650fd38640 1 -- 172.21.15.121:0/2108389661 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f65080fb1c0 msgr2=0x7f65080ff2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:45:59.344 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:59.341+0000 7f650fd38640 1 --2- 172.21.15.121:0/2108389661 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f65080fb1c0 0x7f65080ff2e0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f650400b790 tx=0x7f65040091d0 comp rx=0 tx=0).stop 2024-08-18T22:45:59.344 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:59.341+0000 7f650fd38640 1 -- 172.21.15.121:0/2108389661 shutdown_connections 2024-08-18T22:45:59.344 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:59.341+0000 7f650fd38640 1 --2- 172.21.15.121:0/2108389661 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f64f406e0b0 0x7f64f4070560 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:45:59.344 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:59.341+0000 7f650fd38640 1 --2- 172.21.15.121:0/2108389661 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f65080fc490 0x7f65080fd7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:45:59.344 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:59.341+0000 7f650fd38640 1 --2- 172.21.15.121:0/2108389661 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f65080fb1c0 0x7f65080ff2e0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:45:59.345 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:59.341+0000 7f650fd38640 1 -- 172.21.15.121:0/2108389661 >> 172.21.15.121:0/2108389661 conn(0x7f65080f69a0 msgr2=0x7f65080655b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:45:59.345 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:59.341+0000 7f650fd38640 1 -- 172.21.15.121:0/2108389661 shutdown_connections 2024-08-18T22:45:59.345 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:59.341+0000 7f650fd38640 1 -- 172.21.15.121:0/2108389661 wait complete. 2024-08-18T22:45:59.426 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:59.423+0000 7f3da9c98640 1 -- 172.21.15.121:0/1652981859 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3da40fd5b0 msgr2=0x7f3da40fda20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:45:59.426 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:59.423+0000 7f3da9c98640 1 --2- 172.21.15.121:0/1652981859 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3da40fd5b0 0x7f3da40fda20 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f3d980048d0 tx=0x7f3d98009da0 comp rx=0 tx=0).stop 2024-08-18T22:45:59.426 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:59.423+0000 7f3da9c98640 1 -- 172.21.15.121:0/1652981859 shutdown_connections 2024-08-18T22:45:59.426 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:59.423+0000 7f3da9c98640 1 --2- 172.21.15.121:0/1652981859 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3da40fd5b0 0x7f3da40fda20 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:45:59.426 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:59.423+0000 7f3da9c98640 1 --2- 172.21.15.121:0/1652981859 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3da40fc2e0 0x7f3da40fc6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:45:59.426 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:59.423+0000 7f3da9c98640 1 -- 172.21.15.121:0/1652981859 >> 172.21.15.121:0/1652981859 conn(0x7f3da40f7aa0 msgr2=0x7f3da40f9ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:45:59.427 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:59.423+0000 7f3da9c98640 1 -- 172.21.15.121:0/1652981859 shutdown_connections 2024-08-18T22:45:59.427 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:59.423+0000 7f3da9c98640 1 -- 172.21.15.121:0/1652981859 wait complete. 2024-08-18T22:45:59.427 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:59.423+0000 7f3da9c98640 1 Processor -- start 2024-08-18T22:45:59.427 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:59.424+0000 7f3da9c98640 1 -- start start 2024-08-18T22:45:59.427 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:59.424+0000 7f3da9c98640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3da40fc2e0 0x7f3da410ce90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:45:59.427 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:59.424+0000 7f3da9c98640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3da40fd5b0 0x7f3da410d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:45:59.427 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:59.424+0000 7f3da9c98640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3da410da20 con 0x7f3da40fd5b0 2024-08-18T22:45:59.427 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:59.424+0000 7f3da9c98640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3da410e110 con 0x7f3da40fc2e0 2024-08-18T22:45:59.427 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:59.424+0000 7f3da2ffd640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3da40fd5b0 0x7f3da410d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:45:59.427 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:59.424+0000 7f3da2ffd640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3da40fd5b0 0x7f3da410d3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:39110/0 (socket says 172.21.15.121:39110) 2024-08-18T22:45:59.427 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:59.424+0000 7f3da2ffd640 1 -- 172.21.15.121:0/851766461 learned_addr learned my addr 172.21.15.121:0/851766461 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-18T22:45:59.427 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:59.424+0000 7f3da37fe640 1 --2- 172.21.15.121:0/851766461 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3da40fc2e0 0x7f3da410ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:45:59.428 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:59.424+0000 7f3da37fe640 1 -- 172.21.15.121:0/851766461 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3da40fd5b0 msgr2=0x7f3da410d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:45:59.428 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:59.424+0000 7f3da37fe640 1 --2- 172.21.15.121:0/851766461 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3da40fd5b0 0x7f3da410d3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:45:59.428 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:59.424+0000 7f3da37fe640 1 -- 172.21.15.121:0/851766461 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d98005040 con 0x7f3da40fc2e0 2024-08-18T22:45:59.428 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:59.424+0000 7f3da2ffd640 1 --2- 172.21.15.121:0/851766461 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3da40fd5b0 0x7f3da410d3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:45:59.428 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:59.424+0000 7f3da37fe640 1 --2- 172.21.15.121:0/851766461 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3da40fc2e0 0x7f3da410ce90 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f3d9400e910 tx=0x7f3d9400b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:45:59.428 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:59.425+0000 7f3d8bfff640 1 -- 172.21.15.121:0/851766461 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3d9400eea0 con 0x7f3da40fc2e0 2024-08-18T22:45:59.428 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:59.425+0000 7f3da9c98640 1 -- 172.21.15.121:0/851766461 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3da410e340 con 0x7f3da40fc2e0 2024-08-18T22:45:59.428 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:59.425+0000 7f3d8bfff640 1 -- 172.21.15.121:0/851766461 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f3d9400f040 con 0x7f3da40fc2e0 2024-08-18T22:45:59.428 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:59.425+0000 7f3d8bfff640 1 -- 172.21.15.121:0/851766461 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3d94009410 con 0x7f3da40fc2e0 2024-08-18T22:45:59.428 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:59.425+0000 7f3da9c98640 1 -- 172.21.15.121:0/851766461 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3da410e8e0 con 0x7f3da40fc2e0 2024-08-18T22:45:59.429 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:59.426+0000 7f3da9c98640 1 -- 172.21.15.121:0/851766461 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3da40fb740 con 0x7f3da40fc2e0 2024-08-18T22:45:59.429 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:59.426+0000 7f3d8bfff640 1 -- 172.21.15.121:0/851766461 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 37) v1 ==== 92205+0+0 (secure 0 0 0) 0x7f3d94007c30 con 0x7f3da40fc2e0 2024-08-18T22:45:59.429 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:59.427+0000 7f3d8bfff640 1 --2- 172.21.15.121:0/851766461 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f3d8c06e0b0 0x7f3d8c070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:45:59.429 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:59.427+0000 7f3d8bfff640 1 -- 172.21.15.121:0/851766461 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f3d9408d680 con 0x7f3da40fc2e0 2024-08-18T22:45:59.429 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:59.427+0000 7f3da2ffd640 1 --2- 172.21.15.121:0/851766461 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f3d8c06e0b0 0x7f3d8c070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:45:59.429 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:59.427+0000 7f3da2ffd640 1 --2- 172.21.15.121:0/851766461 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f3d8c06e0b0 0x7f3d8c070560 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f3d98000c00 tx=0x7f3d98035040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:45:59.432 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:59.431+0000 7f3d8bfff640 1 -- 172.21.15.121:0/851766461 <== mon.1 v2:172.21.15.195:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f3d94056a60 con 0x7f3da40fc2e0 2024-08-18T22:45:59.655 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:59.654+0000 7f3da9c98640 1 -- 172.21.15.121:0/851766461 --> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f3da410ec90 con 0x7f3d8c06e0b0 2024-08-18T22:45:59.662 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:59.661+0000 7f3d8bfff640 1 -- 172.21.15.121:0/851766461 <== mgr.34102 v2:172.21.15.121:6800/3037387239 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f3da410ec90 con 0x7f3d8c06e0b0 2024-08-18T22:45:59.663 INFO:teuthology.orchestra.run.smithi121.stdout:{ 2024-08-18T22:45:59.663 INFO:teuthology.orchestra.run.smithi121.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9", 2024-08-18T22:45:59.663 INFO:teuthology.orchestra.run.smithi121.stdout: "in_progress": true, 2024-08-18T22:45:59.663 INFO:teuthology.orchestra.run.smithi121.stdout: "which": "Upgrading all daemon types on all hosts", 2024-08-18T22:45:59.663 INFO:teuthology.orchestra.run.smithi121.stdout: "services_complete": [ 2024-08-18T22:45:59.664 INFO:teuthology.orchestra.run.smithi121.stdout: "mgr", 2024-08-18T22:45:59.664 INFO:teuthology.orchestra.run.smithi121.stdout: "mon", 2024-08-18T22:45:59.664 INFO:teuthology.orchestra.run.smithi121.stdout: "crash" 2024-08-18T22:45:59.664 INFO:teuthology.orchestra.run.smithi121.stdout: ], 2024-08-18T22:45:59.664 INFO:teuthology.orchestra.run.smithi121.stdout: "progress": "8/21 daemons upgraded", 2024-08-18T22:45:59.664 INFO:teuthology.orchestra.run.smithi121.stdout: "message": "Currently upgrading osd daemons", 2024-08-18T22:45:59.664 INFO:teuthology.orchestra.run.smithi121.stdout: "is_paused": false 2024-08-18T22:45:59.664 INFO:teuthology.orchestra.run.smithi121.stdout:} 2024-08-18T22:45:59.667 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:59.665+0000 7f3da9c98640 1 -- 172.21.15.121:0/851766461 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f3d8c06e0b0 msgr2=0x7f3d8c070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:45:59.667 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:59.665+0000 7f3da9c98640 1 --2- 172.21.15.121:0/851766461 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f3d8c06e0b0 0x7f3d8c070560 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f3d98000c00 tx=0x7f3d98035040 comp rx=0 tx=0).stop 2024-08-18T22:45:59.667 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:59.666+0000 7f3da9c98640 1 -- 172.21.15.121:0/851766461 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3da40fc2e0 msgr2=0x7f3da410ce90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:45:59.667 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:59.666+0000 7f3da9c98640 1 --2- 172.21.15.121:0/851766461 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3da40fc2e0 0x7f3da410ce90 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f3d9400e910 tx=0x7f3d9400b040 comp rx=0 tx=0).stop 2024-08-18T22:45:59.667 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:59.666+0000 7f3da9c98640 1 -- 172.21.15.121:0/851766461 shutdown_connections 2024-08-18T22:45:59.667 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:59.666+0000 7f3da9c98640 1 --2- 172.21.15.121:0/851766461 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f3d8c06e0b0 0x7f3d8c070560 secure :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f3d98000c00 tx=0x7f3d98035040 comp rx=0 tx=0).stop 2024-08-18T22:45:59.667 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:59.666+0000 7f3da9c98640 1 --2- 172.21.15.121:0/851766461 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3da40fd5b0 0x7f3da410d3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:45:59.667 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:59.666+0000 7f3da9c98640 1 --2- 172.21.15.121:0/851766461 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3da40fc2e0 0x7f3da410ce90 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:45:59.667 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:59.666+0000 7f3da9c98640 1 -- 172.21.15.121:0/851766461 >> 172.21.15.121:0/851766461 conn(0x7f3da40f7aa0 msgr2=0x7f3da40f9230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:45:59.667 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:59.666+0000 7f3da9c98640 1 -- 172.21.15.121:0/851766461 shutdown_connections 2024-08-18T22:45:59.668 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:59.666+0000 7f3da9c98640 1 -- 172.21.15.121:0/851766461 wait complete. 2024-08-18T22:45:59.751 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:59.747+0000 7fdcf4eac640 1 -- 172.21.15.121:0/3213654198 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdcf00fd5c0 msgr2=0x7fdcf00fda30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:45:59.751 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:59.747+0000 7fdcf4eac640 1 --2- 172.21.15.121:0/3213654198 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdcf00fd5c0 0x7fdcf00fda30 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fdce40048d0 tx=0x7fdce4009da0 comp rx=0 tx=0).stop 2024-08-18T22:45:59.751 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:59.747+0000 7fdcf4eac640 1 -- 172.21.15.121:0/3213654198 shutdown_connections 2024-08-18T22:45:59.751 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:59.747+0000 7fdcf4eac640 1 --2- 172.21.15.121:0/3213654198 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdcf00fd5c0 0x7fdcf00fda30 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:45:59.751 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:59.747+0000 7fdcf4eac640 1 --2- 172.21.15.121:0/3213654198 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdcf00fc2f0 0x7fdcf00fc700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:45:59.751 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:59.747+0000 7fdcf4eac640 1 -- 172.21.15.121:0/3213654198 >> 172.21.15.121:0/3213654198 conn(0x7fdcf00f7ad0 msgr2=0x7fdcf00f9ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:45:59.752 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:59.747+0000 7fdcf4eac640 1 -- 172.21.15.121:0/3213654198 shutdown_connections 2024-08-18T22:45:59.752 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:59.747+0000 7fdcf4eac640 1 -- 172.21.15.121:0/3213654198 wait complete. 2024-08-18T22:45:59.752 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:59.748+0000 7fdcf4eac640 1 Processor -- start 2024-08-18T22:45:59.752 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:59.748+0000 7fdcf4eac640 1 -- start start 2024-08-18T22:45:59.752 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:59.748+0000 7fdcf4eac640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdcf00fc2f0 0x7fdcf010ce60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:45:59.752 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:59.748+0000 7fdcf4eac640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdcf00fd5c0 0x7fdcf010d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:45:59.752 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:59.748+0000 7fdcf4eac640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcf010d9f0 con 0x7fdcf00fc2f0 2024-08-18T22:45:59.752 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:59.748+0000 7fdcf4eac640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcf010e130 con 0x7fdcf00fd5c0 2024-08-18T22:45:59.752 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:59.748+0000 7fdcee59c640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdcf00fc2f0 0x7fdcf010ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:45:59.752 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:59.748+0000 7fdcee59c640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdcf00fc2f0 0x7fdcf010ce60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:39128/0 (socket says 172.21.15.121:39128) 2024-08-18T22:45:59.752 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:59.748+0000 7fdcee59c640 1 -- 172.21.15.121:0/2940187026 learned_addr learned my addr 172.21.15.121:0/2940187026 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-18T22:45:59.752 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:59.749+0000 7fdcedd9b640 1 --2- 172.21.15.121:0/2940187026 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdcf00fd5c0 0x7fdcf010d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:45:59.752 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:59.749+0000 7fdcee59c640 1 -- 172.21.15.121:0/2940187026 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdcf00fd5c0 msgr2=0x7fdcf010d3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:45:59.752 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:59.749+0000 7fdcee59c640 1 --2- 172.21.15.121:0/2940187026 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdcf00fd5c0 0x7fdcf010d3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:45:59.753 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:59.749+0000 7fdcee59c640 1 -- 172.21.15.121:0/2940187026 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdce4005040 con 0x7fdcf00fc2f0 2024-08-18T22:45:59.753 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:59.749+0000 7fdcee59c640 1 --2- 172.21.15.121:0/2940187026 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdcf00fc2f0 0x7fdcf010ce60 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fdce000cae0 tx=0x7fdce0007e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:45:59.753 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:59.749+0000 7fdcdeffd640 1 -- 172.21.15.121:0/2940187026 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdce000aa80 con 0x7fdcf00fc2f0 2024-08-18T22:45:59.753 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:59.749+0000 7fdcdeffd640 1 -- 172.21.15.121:0/2940187026 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fdce000abe0 con 0x7fdcf00fc2f0 2024-08-18T22:45:59.753 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:59.749+0000 7fdcdeffd640 1 -- 172.21.15.121:0/2940187026 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdce00115e0 con 0x7fdcf00fc2f0 2024-08-18T22:45:59.753 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:59.749+0000 7fdcf4eac640 1 -- 172.21.15.121:0/2940187026 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdcf010e3c0 con 0x7fdcf00fc2f0 2024-08-18T22:45:59.753 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:59.749+0000 7fdcf4eac640 1 -- 172.21.15.121:0/2940187026 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdcf010e960 con 0x7fdcf00fc2f0 2024-08-18T22:45:59.753 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:59.750+0000 7fdcf4eac640 1 -- 172.21.15.121:0/2940187026 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdcf00fb750 con 0x7fdcf00fc2f0 2024-08-18T22:45:59.754 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:59.751+0000 7fdcdeffd640 1 -- 172.21.15.121:0/2940187026 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 37) v1 ==== 92205+0+0 (secure 0 0 0) 0x7fdce000ad50 con 0x7fdcf00fc2f0 2024-08-18T22:45:59.754 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:59.751+0000 7fdcdeffd640 1 --2- 172.21.15.121:0/2940187026 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7fdcd806e0b0 0x7fdcd8070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:45:59.754 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:59.751+0000 7fdcdeffd640 1 -- 172.21.15.121:0/2940187026 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6496+0+0 (secure 0 0 0) 0x7fdce008e290 con 0x7fdcf00fc2f0 2024-08-18T22:45:59.754 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:59.751+0000 7fdcedd9b640 1 --2- 172.21.15.121:0/2940187026 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7fdcd806e0b0 0x7fdcd8070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:45:59.754 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:59.752+0000 7fdcedd9b640 1 --2- 172.21.15.121:0/2940187026 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7fdcd806e0b0 0x7fdcd8070560 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fdce4000c00 tx=0x7fdce4035040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:45:59.756 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:45:59.756+0000 7fdcdeffd640 1 -- 172.21.15.121:0/2940187026 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7fdce0057640 con 0x7fdcf00fc2f0 2024-08-18T22:45:59.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:45:59 smithi195 ceph-mon[68841]: from='client.34252 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-18T22:45:59.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:45:59 smithi195 ceph-mon[68841]: from='client.34256 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-18T22:45:59.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:45:59 smithi195 ceph-mon[68841]: pgmap v85: 65 pgs: 2 stale+active+clean, 15 active+undersized+degraded, 48 active+clean; 2.0 GiB data, 7.1 GiB used, 529 GiB / 536 GiB avail; 2829/34143 objects degraded (8.286%) 2024-08-18T22:45:59.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:45:59 smithi195 ceph-mon[68841]: from='client.34260 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-18T22:45:59.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:45:59 smithi195 ceph-mon[68841]: from='client.? 172.21.15.121:0/437924470' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-08-18T22:45:59.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:45:59 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:45:59.910 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:45:59 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:45:59.910 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:45:59 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-18T22:45:59.910 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:45:59 smithi195 ceph-mon[68841]: from='client.? 172.21.15.121:0/2108389661' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-08-18T22:46:00.008 INFO:journalctl@ceph.osd.2.smithi121.stdout:Aug 18 22:45:59 smithi121 ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-2[100439]: 2024-08-18T22:45:59.657+0000 7fb147ddc640 -1 Falling back to public interface 2024-08-18T22:46:00.008 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:00.007+0000 7fdcf4eac640 1 -- 172.21.15.121:0/2940187026 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fdcf004b4c0 con 0x7fdcf00fc2f0 2024-08-18T22:46:00.008 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:45:59 smithi121 ceph-mon[81053]: from='client.34252 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-18T22:46:00.009 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:45:59 smithi121 ceph-mon[81053]: from='client.34256 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-18T22:46:00.009 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:45:59 smithi121 ceph-mon[81053]: pgmap v85: 65 pgs: 2 stale+active+clean, 15 active+undersized+degraded, 48 active+clean; 2.0 GiB data, 7.1 GiB used, 529 GiB / 536 GiB avail; 2829/34143 objects degraded (8.286%) 2024-08-18T22:46:00.009 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:45:59 smithi121 ceph-mon[81053]: from='client.34260 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-18T22:46:00.009 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:45:59 smithi121 ceph-mon[81053]: from='client.? 172.21.15.121:0/437924470' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-08-18T22:46:00.009 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:45:59 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:46:00.009 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:45:59 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:46:00.009 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:45:59 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-18T22:46:00.009 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:45:59 smithi121 ceph-mon[81053]: from='client.? 172.21.15.121:0/2108389661' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-08-18T22:46:00.009 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:00.007+0000 7fdcdeffd640 1 -- 172.21.15.121:0/2940187026 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+1272 (secure 0 0 0) 0x7fdce005ad00 con 0x7fdcf00fc2f0 2024-08-18T22:46:00.010 INFO:teuthology.orchestra.run.smithi121.stdout:HEALTH_WARN 1 MDSs report slow requests; 1 osds down; Degraded data redundancy: 2829/34143 objects degraded (8.286%), 15 pgs degraded 2024-08-18T22:46:00.010 INFO:teuthology.orchestra.run.smithi121.stdout:[WRN] MDS_SLOW_REQUEST: 1 MDSs report slow requests 2024-08-18T22:46:00.010 INFO:teuthology.orchestra.run.smithi121.stdout: mds.cephfs.smithi121.gbickb(mds.0): 3 slow requests are blocked > 180 secs 2024-08-18T22:46:00.010 INFO:teuthology.orchestra.run.smithi121.stdout:[WRN] OSD_DOWN: 1 osds down 2024-08-18T22:46:00.010 INFO:teuthology.orchestra.run.smithi121.stdout: osd.2 (root=default,host=smithi121) is down 2024-08-18T22:46:00.010 INFO:teuthology.orchestra.run.smithi121.stdout:[WRN] PG_DEGRADED: Degraded data redundancy: 2829/34143 objects degraded (8.286%), 15 pgs degraded 2024-08-18T22:46:00.010 INFO:teuthology.orchestra.run.smithi121.stdout: pg 2.1 is active+undersized+degraded, acting [1,0] 2024-08-18T22:46:00.010 INFO:teuthology.orchestra.run.smithi121.stdout: pg 2.d is active+undersized+degraded, acting [1,3] 2024-08-18T22:46:00.010 INFO:teuthology.orchestra.run.smithi121.stdout: pg 2.e is active+undersized+degraded, acting [0,3] 2024-08-18T22:46:00.010 INFO:teuthology.orchestra.run.smithi121.stdout: pg 2.10 is active+undersized+degraded, acting [1,0] 2024-08-18T22:46:00.010 INFO:teuthology.orchestra.run.smithi121.stdout: pg 2.13 is active+undersized+degraded, acting [0,4] 2024-08-18T22:46:00.010 INFO:teuthology.orchestra.run.smithi121.stdout: pg 2.19 is active+undersized+degraded, acting [0,4] 2024-08-18T22:46:00.011 INFO:teuthology.orchestra.run.smithi121.stdout: pg 2.1e is active+undersized+degraded, acting [0,5] 2024-08-18T22:46:00.011 INFO:teuthology.orchestra.run.smithi121.stdout: pg 3.0 is active+undersized+degraded, acting [1,4] 2024-08-18T22:46:00.011 INFO:teuthology.orchestra.run.smithi121.stdout: pg 3.1 is active+undersized+degraded, acting [0,4] 2024-08-18T22:46:00.011 INFO:teuthology.orchestra.run.smithi121.stdout: pg 3.4 is active+undersized+degraded, acting [1,3] 2024-08-18T22:46:00.011 INFO:teuthology.orchestra.run.smithi121.stdout: pg 3.7 is active+undersized+degraded, acting [1,4] 2024-08-18T22:46:00.011 INFO:teuthology.orchestra.run.smithi121.stdout: pg 3.8 is active+undersized+degraded, acting [1,5] 2024-08-18T22:46:00.011 INFO:teuthology.orchestra.run.smithi121.stdout: pg 3.17 is active+undersized+degraded, acting [0,5] 2024-08-18T22:46:00.011 INFO:teuthology.orchestra.run.smithi121.stdout: pg 3.18 is active+undersized+degraded, acting [0,1] 2024-08-18T22:46:00.011 INFO:teuthology.orchestra.run.smithi121.stdout: pg 3.1f is active+undersized+degraded, acting [0,3] 2024-08-18T22:46:00.012 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:00.010+0000 7fdcf4eac640 1 -- 172.21.15.121:0/2940187026 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7fdcd806e0b0 msgr2=0x7fdcd8070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:46:00.012 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:00.010+0000 7fdcf4eac640 1 --2- 172.21.15.121:0/2940187026 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7fdcd806e0b0 0x7fdcd8070560 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fdce4000c00 tx=0x7fdce4035040 comp rx=0 tx=0).stop 2024-08-18T22:46:00.012 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:00.010+0000 7fdcf4eac640 1 -- 172.21.15.121:0/2940187026 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdcf00fc2f0 msgr2=0x7fdcf010ce60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:46:00.012 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:00.010+0000 7fdcf4eac640 1 --2- 172.21.15.121:0/2940187026 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdcf00fc2f0 0x7fdcf010ce60 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fdce000cae0 tx=0x7fdce0007e50 comp rx=0 tx=0).stop 2024-08-18T22:46:00.012 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:00.010+0000 7fdcf4eac640 1 -- 172.21.15.121:0/2940187026 shutdown_connections 2024-08-18T22:46:00.012 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:00.010+0000 7fdcf4eac640 1 --2- 172.21.15.121:0/2940187026 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7fdcd806e0b0 0x7fdcd8070560 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:46:00.012 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:00.010+0000 7fdcf4eac640 1 --2- 172.21.15.121:0/2940187026 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdcf00fd5c0 0x7fdcf010d3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:46:00.012 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:00.010+0000 7fdcf4eac640 1 --2- 172.21.15.121:0/2940187026 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdcf00fc2f0 0x7fdcf010ce60 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:46:00.012 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:00.010+0000 7fdcf4eac640 1 -- 172.21.15.121:0/2940187026 >> 172.21.15.121:0/2940187026 conn(0x7fdcf00f7ad0 msgr2=0x7fdcf00f9250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:46:00.012 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:00.010+0000 7fdcf4eac640 1 -- 172.21.15.121:0/2940187026 shutdown_connections 2024-08-18T22:46:00.012 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:00.010+0000 7fdcf4eac640 1 -- 172.21.15.121:0/2940187026 wait complete. 2024-08-18T22:46:00.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:46:00 smithi195 ceph-mon[68841]: from='client.44165 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-18T22:46:00.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:46:00 smithi195 ceph-mon[68841]: from='client.? 172.21.15.121:0/2940187026' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-08-18T22:46:00.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:46:00 smithi195 ceph-mon[68841]: 3 slow requests, 0 included below; oldest blocked for > 271.868739 secs 2024-08-18T22:46:00.926 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:46:00 smithi121 ceph-mon[81053]: from='client.44165 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-18T22:46:00.926 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:46:00 smithi121 ceph-mon[81053]: from='client.? 172.21.15.121:0/2940187026' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-08-18T22:46:00.926 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:46:00 smithi121 ceph-mon[81053]: 3 slow requests, 0 included below; oldest blocked for > 271.868739 secs 2024-08-18T22:46:01.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:46:01 smithi195 ceph-mon[68841]: pgmap v86: 65 pgs: 1 active+undersized, 26 active+undersized+degraded, 38 active+clean; 2.0 GiB data, 7.1 GiB used, 529 GiB / 536 GiB avail; 4935/34143 objects degraded (14.454%) 2024-08-18T22:46:02.074 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:46:01 smithi121 ceph-mon[81053]: pgmap v86: 65 pgs: 1 active+undersized, 26 active+undersized+degraded, 38 active+clean; 2.0 GiB data, 7.1 GiB used, 529 GiB / 536 GiB avail; 4935/34143 objects degraded (14.454%) 2024-08-18T22:46:02.987 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:46:02 smithi121 ceph-mon[81053]: Health check update: Degraded data redundancy: 4935/34143 objects degraded (14.454%), 26 pgs degraded (PG_DEGRADED) 2024-08-18T22:46:03.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:46:02 smithi195 ceph-mon[68841]: Health check update: Degraded data redundancy: 4935/34143 objects degraded (14.454%), 26 pgs degraded (PG_DEGRADED) 2024-08-18T22:46:03.808 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:46:03 smithi121 ceph-mon[81053]: pgmap v87: 65 pgs: 1 active+undersized, 26 active+undersized+degraded, 38 active+clean; 2.0 GiB data, 7.1 GiB used, 529 GiB / 536 GiB avail; 4935/34143 objects degraded (14.454%) 2024-08-18T22:46:04.083 INFO:journalctl@ceph.osd.2.smithi121.stdout:Aug 18 22:46:03 smithi121 ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-2[100439]: 2024-08-18T22:46:03.898+0000 7fb147ddc640 -1 osd.2 60 log_to_monitors true 2024-08-18T22:46:04.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:46:03 smithi195 ceph-mon[68841]: pgmap v87: 65 pgs: 1 active+undersized, 26 active+undersized+degraded, 38 active+clean; 2.0 GiB data, 7.1 GiB used, 529 GiB / 536 GiB avail; 4935/34143 objects degraded (14.454%) 2024-08-18T22:46:04.833 INFO:journalctl@ceph.osd.2.smithi121.stdout:Aug 18 22:46:04 smithi121 ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-2[100439]: 2024-08-18T22:46:04.684+0000 7fb13fb76640 -1 osd.2 60 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-18T22:46:04.834 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:46:04 smithi121 ceph-mon[81053]: from='osd.2 [v2:172.21.15.121:6818/1512799516,v1:172.21.15.121:6819/1512799516]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-08-18T22:46:04.834 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:46:04 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:46:04.834 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:46:04 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:46:05.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:46:04 smithi195 ceph-mon[68841]: from='osd.2 [v2:172.21.15.121:6818/1512799516,v1:172.21.15.121:6819/1512799516]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-08-18T22:46:05.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:46:04 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:46:05.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:46:04 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:46:05.833 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:46:05 smithi121 ceph-mon[81053]: pgmap v88: 65 pgs: 1 active+undersized, 26 active+undersized+degraded, 38 active+clean; 2.0 GiB data, 7.1 GiB used, 529 GiB / 536 GiB avail; 4935/34143 objects degraded (14.454%) 2024-08-18T22:46:05.834 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:46:05 smithi121 ceph-mon[81053]: from='osd.2 [v2:172.21.15.121:6818/1512799516,v1:172.21.15.121:6819/1512799516]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-08-18T22:46:05.834 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:46:05 smithi121 ceph-mon[81053]: osdmap e63: 6 total, 5 up, 6 in 2024-08-18T22:46:05.834 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:46:05 smithi121 ceph-mon[81053]: from='osd.2 [v2:172.21.15.121:6818/1512799516,v1:172.21.15.121:6819/1512799516]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi121", "root=default"]}]: dispatch 2024-08-18T22:46:05.834 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:46:05 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:46:05.834 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:46:05 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:46:05.834 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:46:05 smithi121 ceph-mon[81053]: 3 slow requests, 0 included below; oldest blocked for > 276.868812 secs 2024-08-18T22:46:06.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:46:05 smithi195 ceph-mon[68841]: pgmap v88: 65 pgs: 1 active+undersized, 26 active+undersized+degraded, 38 active+clean; 2.0 GiB data, 7.1 GiB used, 529 GiB / 536 GiB avail; 4935/34143 objects degraded (14.454%) 2024-08-18T22:46:06.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:46:05 smithi195 ceph-mon[68841]: from='osd.2 [v2:172.21.15.121:6818/1512799516,v1:172.21.15.121:6819/1512799516]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-08-18T22:46:06.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:46:05 smithi195 ceph-mon[68841]: osdmap e63: 6 total, 5 up, 6 in 2024-08-18T22:46:06.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:46:05 smithi195 ceph-mon[68841]: from='osd.2 [v2:172.21.15.121:6818/1512799516,v1:172.21.15.121:6819/1512799516]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi121", "root=default"]}]: dispatch 2024-08-18T22:46:06.160 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:46:05 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:46:06.160 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:46:05 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:46:06.160 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:46:05 smithi195 ceph-mon[68841]: 3 slow requests, 0 included below; oldest blocked for > 276.868812 secs 2024-08-18T22:46:06.793 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:46:06 smithi121 ceph-mon[81053]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-08-18T22:46:06.794 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:46:06 smithi121 ceph-mon[81053]: osd.2 [v2:172.21.15.121:6818/1512799516,v1:172.21.15.121:6819/1512799516] boot 2024-08-18T22:46:06.794 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:46:06 smithi121 ceph-mon[81053]: osdmap e64: 6 total, 6 up, 6 in 2024-08-18T22:46:06.794 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:46:06 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-08-18T22:46:06.794 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:46:06 smithi121 ceph-mon[81053]: osdmap e65: 6 total, 6 up, 6 in 2024-08-18T22:46:07.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:46:06 smithi195 ceph-mon[68841]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-08-18T22:46:07.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:46:06 smithi195 ceph-mon[68841]: osd.2 [v2:172.21.15.121:6818/1512799516,v1:172.21.15.121:6819/1512799516] boot 2024-08-18T22:46:07.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:46:06 smithi195 ceph-mon[68841]: osdmap e64: 6 total, 6 up, 6 in 2024-08-18T22:46:07.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:46:06 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-08-18T22:46:07.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:46:06 smithi195 ceph-mon[68841]: osdmap e65: 6 total, 6 up, 6 in 2024-08-18T22:46:07.834 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:46:07 smithi121 ceph-mon[81053]: pgmap v91: 65 pgs: 3 peering, 1 active+undersized, 23 active+undersized+degraded, 38 active+clean; 2.0 GiB data, 6.8 GiB used, 530 GiB / 536 GiB avail; 4204/34143 objects degraded (12.313%) 2024-08-18T22:46:07.834 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:46:07 smithi121 ceph-mon[81053]: Health check update: Degraded data redundancy: 4204/34143 objects degraded (12.313%), 23 pgs degraded (PG_DEGRADED) 2024-08-18T22:46:08.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:46:07 smithi195 ceph-mon[68841]: pgmap v91: 65 pgs: 3 peering, 1 active+undersized, 23 active+undersized+degraded, 38 active+clean; 2.0 GiB data, 6.8 GiB used, 530 GiB / 536 GiB avail; 4204/34143 objects degraded (12.313%) 2024-08-18T22:46:08.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:46:07 smithi195 ceph-mon[68841]: Health check update: Degraded data redundancy: 4204/34143 objects degraded (12.313%), 23 pgs degraded (PG_DEGRADED) 2024-08-18T22:46:09.334 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:46:08 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:46:09.334 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:46:08 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:46:09.334 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:46:08 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:46:09.334 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:46:08 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-18T22:46:09.334 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:46:08 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:46:09.334 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:46:08 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-18T22:46:09.334 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:46:08 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "versions"}]: dispatch 2024-08-18T22:46:09.334 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:46:08 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "versions"}]: dispatch 2024-08-18T22:46:09.334 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:46:08 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "versions"}]: dispatch 2024-08-18T22:46:09.334 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:46:08 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-08-18T22:46:09.335 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:46:08 smithi121 ceph-mon[81053]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-08-18T22:46:09.335 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:46:08 smithi121 ceph-mon[81053]: Upgrade: unsafe to stop osd(s) at this time (11 PGs are or would become offline) 2024-08-18T22:46:09.335 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:46:08 smithi121 ceph-mon[81053]: pgmap v93: 65 pgs: 8 peering, 1 active+undersized, 18 active+undersized+degraded, 38 active+clean; 2.0 GiB data, 6.8 GiB used, 530 GiB / 536 GiB avail; 3173/34143 objects degraded (9.293%) 2024-08-18T22:46:09.335 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:46:08 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:46:09.335 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:46:08 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-18T22:46:09.409 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:46:08 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:46:09.409 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:46:08 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:46:09.409 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:46:08 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:46:09.409 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:46:08 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-18T22:46:09.409 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:46:08 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:46:09.410 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:46:08 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-18T22:46:09.410 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:46:08 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "versions"}]: dispatch 2024-08-18T22:46:09.410 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:46:08 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "versions"}]: dispatch 2024-08-18T22:46:09.410 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:46:08 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "versions"}]: dispatch 2024-08-18T22:46:09.410 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:46:08 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-08-18T22:46:09.410 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:46:08 smithi195 ceph-mon[68841]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-08-18T22:46:09.410 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:46:08 smithi195 ceph-mon[68841]: Upgrade: unsafe to stop osd(s) at this time (11 PGs are or would become offline) 2024-08-18T22:46:09.410 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:46:08 smithi195 ceph-mon[68841]: pgmap v93: 65 pgs: 8 peering, 1 active+undersized, 18 active+undersized+degraded, 38 active+clean; 2.0 GiB data, 6.8 GiB used, 530 GiB / 536 GiB avail; 3173/34143 objects degraded (9.293%) 2024-08-18T22:46:09.410 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:46:08 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:46:09.410 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:46:08 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-18T22:46:10.833 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:46:10 smithi121 ceph-mon[81053]: 3 slow requests, 0 included below; oldest blocked for > 281.868877 secs 2024-08-18T22:46:10.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:46:10 smithi195 ceph-mon[68841]: 3 slow requests, 0 included below; oldest blocked for > 281.868877 secs 2024-08-18T22:46:11.833 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:46:11 smithi121 ceph-mon[81053]: pgmap v94: 65 pgs: 8 peering, 57 active+clean; 2.0 GiB data, 6.8 GiB used, 530 GiB / 536 GiB avail 2024-08-18T22:46:11.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:46:11 smithi195 ceph-mon[68841]: pgmap v94: 65 pgs: 8 peering, 57 active+clean; 2.0 GiB data, 6.8 GiB used, 530 GiB / 536 GiB avail 2024-08-18T22:46:12.583 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:46:12 smithi121 ceph-mon[81053]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 3173/34143 objects degraded (9.293%), 18 pgs degraded) 2024-08-18T22:46:12.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:46:12 smithi195 ceph-mon[68841]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 3173/34143 objects degraded (9.293%), 18 pgs degraded) 2024-08-18T22:46:13.833 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:46:13 smithi121 ceph-mon[81053]: pgmap v95: 65 pgs: 65 active+clean; 2.0 GiB data, 6.8 GiB used, 530 GiB / 536 GiB avail 2024-08-18T22:46:13.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:46:13 smithi195 ceph-mon[68841]: pgmap v95: 65 pgs: 65 active+clean; 2.0 GiB data, 6.8 GiB used, 530 GiB / 536 GiB avail 2024-08-18T22:46:15.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:46:15 smithi195 ceph-mon[68841]: pgmap v96: 65 pgs: 65 active+clean; 2.0 GiB data, 6.8 GiB used, 530 GiB / 536 GiB avail 2024-08-18T22:46:15.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:46:15 smithi195 ceph-mon[68841]: 3 slow requests, 0 included below; oldest blocked for > 286.868968 secs 2024-08-18T22:46:16.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:46:15 smithi121 ceph-mon[81053]: pgmap v96: 65 pgs: 65 active+clean; 2.0 GiB data, 6.8 GiB used, 530 GiB / 536 GiB avail 2024-08-18T22:46:16.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:46:15 smithi121 ceph-mon[81053]: 3 slow requests, 0 included below; oldest blocked for > 286.868968 secs 2024-08-18T22:46:17.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:46:17 smithi195 ceph-mon[68841]: pgmap v97: 65 pgs: 65 active+clean; 2.0 GiB data, 6.8 GiB used, 530 GiB / 536 GiB avail 2024-08-18T22:46:18.012 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:46:17 smithi121 ceph-mon[81053]: pgmap v97: 65 pgs: 65 active+clean; 2.0 GiB data, 6.8 GiB used, 530 GiB / 536 GiB avail 2024-08-18T22:46:19.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:46:19 smithi195 ceph-mon[68841]: pgmap v98: 65 pgs: 65 active+clean; 2.0 GiB data, 6.8 GiB used, 530 GiB / 536 GiB avail 2024-08-18T22:46:19.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:46:19 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:46:20.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:46:19 smithi121 ceph-mon[81053]: pgmap v98: 65 pgs: 65 active+clean; 2.0 GiB data, 6.8 GiB used, 530 GiB / 536 GiB avail 2024-08-18T22:46:20.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:46:19 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:46:20.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:46:20 smithi195 ceph-mon[68841]: 3 slow requests, 0 included below; oldest blocked for > 291.869085 secs 2024-08-18T22:46:21.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:46:20 smithi121 ceph-mon[81053]: 3 slow requests, 0 included below; oldest blocked for > 291.869085 secs 2024-08-18T22:46:21.833 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:46:21 smithi121 ceph-mon[81053]: pgmap v99: 65 pgs: 65 active+clean; 2.0 GiB data, 6.8 GiB used, 530 GiB / 536 GiB avail 2024-08-18T22:46:21.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:46:21 smithi195 ceph-mon[68841]: pgmap v99: 65 pgs: 65 active+clean; 2.0 GiB data, 6.8 GiB used, 530 GiB / 536 GiB avail 2024-08-18T22:46:23.819 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:46:23 smithi195 ceph-mon[68841]: pgmap v100: 65 pgs: 65 active+clean; 2.0 GiB data, 6.8 GiB used, 530 GiB / 536 GiB avail 2024-08-18T22:46:23.819 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:46:23 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-08-18T22:46:23.819 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:46:23 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:46:23.819 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:46:23 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-18T22:46:23.833 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:46:23 smithi121 ceph-mon[81053]: pgmap v100: 65 pgs: 65 active+clean; 2.0 GiB data, 6.8 GiB used, 530 GiB / 536 GiB avail 2024-08-18T22:46:23.834 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:46:23 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-08-18T22:46:23.834 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:46:23 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:46:23.834 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:46:23 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-18T22:46:24.659 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:46:24 smithi195 ceph-mon[68841]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-08-18T22:46:24.659 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:46:24 smithi195 ceph-mon[68841]: Upgrade: osd.3 is safe to restart 2024-08-18T22:46:24.659 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:46:24 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:46:24.659 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:46:24 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-08-18T22:46:24.659 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:46:24 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:46:24.833 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:46:24 smithi121 ceph-mon[81053]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-08-18T22:46:24.834 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:46:24 smithi121 ceph-mon[81053]: Upgrade: osd.3 is safe to restart 2024-08-18T22:46:24.834 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:46:24 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:46:24.834 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:46:24 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-08-18T22:46:24.834 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:46:24 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:46:25.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:46:25 smithi195 ceph-mon[68841]: Upgrade: Updating osd.3 2024-08-18T22:46:25.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:46:25 smithi195 ceph-mon[68841]: Deploying daemon osd.3 on smithi195 2024-08-18T22:46:25.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:46:25 smithi195 ceph-mon[68841]: pgmap v101: 65 pgs: 65 active+clean; 2.0 GiB data, 6.8 GiB used, 530 GiB / 536 GiB avail 2024-08-18T22:46:25.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:46:25 smithi195 ceph-mon[68841]: 3 slow requests, 0 included below; oldest blocked for > 296.869230 secs 2024-08-18T22:46:26.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:46:25 smithi121 ceph-mon[81053]: Upgrade: Updating osd.3 2024-08-18T22:46:26.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:46:25 smithi121 ceph-mon[81053]: Deploying daemon osd.3 on smithi195 2024-08-18T22:46:26.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:46:25 smithi121 ceph-mon[81053]: pgmap v101: 65 pgs: 65 active+clean; 2.0 GiB data, 6.8 GiB used, 530 GiB / 536 GiB avail 2024-08-18T22:46:26.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:46:25 smithi121 ceph-mon[81053]: 3 slow requests, 0 included below; oldest blocked for > 296.869230 secs 2024-08-18T22:46:27.616 INFO:journalctl@ceph.osd.3.smithi195.stdout:Aug 18 22:46:27 smithi195 systemd[1]: Stopping Ceph osd.3 for b003123a-5db1-11ef-bccf-c7b262605968... 2024-08-18T22:46:27.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:46:27 smithi195 ceph-mon[68841]: pgmap v102: 65 pgs: 65 active+clean; 2.0 GiB data, 6.8 GiB used, 530 GiB / 536 GiB avail 2024-08-18T22:46:27.909 INFO:journalctl@ceph.osd.3.smithi195.stdout:Aug 18 22:46:27 smithi195 ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-3[28860]: 2024-08-18T22:46:27.717+0000 7f0444059640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-18T22:46:27.909 INFO:journalctl@ceph.osd.3.smithi195.stdout:Aug 18 22:46:27 smithi195 ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-3[28860]: 2024-08-18T22:46:27.717+0000 7f0444059640 -1 osd.3 65 *** Got signal Terminated *** 2024-08-18T22:46:27.909 INFO:journalctl@ceph.osd.3.smithi195.stdout:Aug 18 22:46:27 smithi195 ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-3[28860]: 2024-08-18T22:46:27.717+0000 7f0444059640 -1 osd.3 65 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-08-18T22:46:28.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:46:27 smithi121 ceph-mon[81053]: pgmap v102: 65 pgs: 65 active+clean; 2.0 GiB data, 6.8 GiB used, 530 GiB / 536 GiB avail 2024-08-18T22:46:28.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:46:28 smithi195 ceph-mon[68841]: osd.3 marked itself down and dead 2024-08-18T22:46:29.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:46:28 smithi121 ceph-mon[81053]: osd.3 marked itself down and dead 2024-08-18T22:46:29.367 INFO:journalctl@ceph.osd.3.smithi195.stdout:Aug 18 22:46:29 smithi195 podman[77514]: 2024-08-18 22:46:29.051738118 +0000 UTC m=+1.457700450 container died 15d30b1b459e7f64642af9f3e9c155e1b597d1aab11aa738130a256d59cddf0e (image=quay.ceph.io/ceph-ci/ceph@sha256:bf20fb88c15fff689cf84383793d3756b4df7aceb11592a28c78dd893a0b3e7d, name=ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-3, CEPH_POINT_RELEASE=, io.buildah.version=1.36.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, ceph=True, RELEASE=quincy-df62bdc) 2024-08-18T22:46:29.368 INFO:journalctl@ceph.osd.3.smithi195.stdout:Aug 18 22:46:29 smithi195 podman[77514]: 2024-08-18 22:46:29.367479625 +0000 UTC m=+1.773441957 container cleanup 15d30b1b459e7f64642af9f3e9c155e1b597d1aab11aa738130a256d59cddf0e (image=quay.ceph.io/ceph-ci/ceph@sha256:bf20fb88c15fff689cf84383793d3756b4df7aceb11592a28c78dd893a0b3e7d, name=ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-3, GIT_CLEAN=True, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, RELEASE=quincy-df62bdc, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.36.0, GIT_BRANCH=HEAD) 2024-08-18T22:46:29.622 INFO:journalctl@ceph.osd.3.smithi195.stdout:Aug 18 22:46:29 smithi195 bash[77514]: ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-3 2024-08-18T22:46:29.622 INFO:journalctl@ceph.osd.3.smithi195.stdout:Aug 18 22:46:29 smithi195 podman[77541]: 2024-08-18 22:46:29.568808567 +0000 UTC m=+0.511816966 container remove 15d30b1b459e7f64642af9f3e9c155e1b597d1aab11aa738130a256d59cddf0e (image=quay.ceph.io/ceph-ci/ceph@sha256:bf20fb88c15fff689cf84383793d3756b4df7aceb11592a28c78dd893a0b3e7d, name=ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-3, GIT_CLEAN=True, RELEASE=quincy-df62bdc, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.36.0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2) 2024-08-18T22:46:29.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:46:29 smithi195 ceph-mon[68841]: pgmap v103: 65 pgs: 65 active+clean; 2.0 GiB data, 6.8 GiB used, 530 GiB / 536 GiB avail 2024-08-18T22:46:29.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:46:29 smithi195 ceph-mon[68841]: Health check failed: 1 osds down (OSD_DOWN) 2024-08-18T22:46:29.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:46:29 smithi195 ceph-mon[68841]: osdmap e66: 6 total, 5 up, 6 in 2024-08-18T22:46:30.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:46:29 smithi121 ceph-mon[81053]: pgmap v103: 65 pgs: 65 active+clean; 2.0 GiB data, 6.8 GiB used, 530 GiB / 536 GiB avail 2024-08-18T22:46:30.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:46:29 smithi121 ceph-mon[81053]: Health check failed: 1 osds down (OSD_DOWN) 2024-08-18T22:46:30.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:46:29 smithi121 ceph-mon[81053]: osdmap e66: 6 total, 5 up, 6 in 2024-08-18T22:46:30.106 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:30.103+0000 7f74812b7640 1 -- 172.21.15.121:0/2892101926 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f747c0ff460 msgr2=0x7f747c101840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:46:30.106 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:30.103+0000 7f74812b7640 1 --2- 172.21.15.121:0/2892101926 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f747c0ff460 0x7f747c101840 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f74700048d0 tx=0x7f7470009da0 comp rx=0 tx=0).stop 2024-08-18T22:46:30.107 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:30.103+0000 7f74812b7640 1 -- 172.21.15.121:0/2892101926 shutdown_connections 2024-08-18T22:46:30.107 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:30.103+0000 7f74812b7640 1 --2- 172.21.15.121:0/2892101926 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f747c0ff460 0x7f747c101840 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:46:30.107 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:30.103+0000 7f74812b7640 1 --2- 172.21.15.121:0/2892101926 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f747c0664b0 0x7f747c0fef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:46:30.107 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:30.103+0000 7f74812b7640 1 -- 172.21.15.121:0/2892101926 >> 172.21.15.121:0/2892101926 conn(0x7f747c0f69b0 msgr2=0x7f747c0f8e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:46:30.107 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:30.103+0000 7f74812b7640 1 -- 172.21.15.121:0/2892101926 shutdown_connections 2024-08-18T22:46:30.107 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:30.103+0000 7f74812b7640 1 -- 172.21.15.121:0/2892101926 wait complete. 2024-08-18T22:46:30.107 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:30.104+0000 7f74812b7640 1 Processor -- start 2024-08-18T22:46:30.107 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:30.104+0000 7f74812b7640 1 -- start start 2024-08-18T22:46:30.107 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:30.104+0000 7f74812b7640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f747c0664b0 0x7f747c10cef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:46:30.107 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:30.104+0000 7f74812b7640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f747c0ff460 0x7f747c10d430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:46:30.107 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:30.104+0000 7f74812b7640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f747c10e160 con 0x7f747c0664b0 2024-08-18T22:46:30.107 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:30.104+0000 7f74812b7640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f747c10e2d0 con 0x7f747c0ff460 2024-08-18T22:46:30.108 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:30.104+0000 7f747affd640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f747c0664b0 0x7f747c10cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:46:30.108 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:30.104+0000 7f747affd640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f747c0664b0 0x7f747c10cef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:40240/0 (socket says 172.21.15.121:40240) 2024-08-18T22:46:30.108 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:30.104+0000 7f747affd640 1 -- 172.21.15.121:0/3834308918 learned_addr learned my addr 172.21.15.121:0/3834308918 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-18T22:46:30.108 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:30.105+0000 7f747affd640 1 -- 172.21.15.121:0/3834308918 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f747c0ff460 msgr2=0x7f747c10d430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:46:30.108 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:30.105+0000 7f747affd640 1 --2- 172.21.15.121:0/3834308918 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f747c0ff460 0x7f747c10d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:46:30.108 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:30.105+0000 7f747affd640 1 -- 172.21.15.121:0/3834308918 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7470005040 con 0x7f747c0664b0 2024-08-18T22:46:30.108 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:30.105+0000 7f747affd640 1 --2- 172.21.15.121:0/3834308918 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f747c0664b0 0x7f747c10cef0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f746c00eb70 tx=0x7f746c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:46:30.108 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:30.105+0000 7f74637fe640 1 -- 172.21.15.121:0/3834308918 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f746c007c30 con 0x7f747c0664b0 2024-08-18T22:46:30.108 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:30.105+0000 7f74812b7640 1 -- 172.21.15.121:0/3834308918 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f747c10e5b0 con 0x7f747c0664b0 2024-08-18T22:46:30.108 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:30.105+0000 7f74637fe640 1 -- 172.21.15.121:0/3834308918 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f746c00f040 con 0x7f747c0664b0 2024-08-18T22:46:30.108 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:30.105+0000 7f74637fe640 1 -- 172.21.15.121:0/3834308918 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f746c00cb20 con 0x7f747c0664b0 2024-08-18T22:46:30.108 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:30.105+0000 7f74812b7640 1 -- 172.21.15.121:0/3834308918 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f747c10eb50 con 0x7f747c0664b0 2024-08-18T22:46:30.109 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:30.106+0000 7f74812b7640 1 -- 172.21.15.121:0/3834308918 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f747c0fa670 con 0x7f747c0664b0 2024-08-18T22:46:30.109 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:30.107+0000 7f74637fe640 1 -- 172.21.15.121:0/3834308918 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 37) v1 ==== 92205+0+0 (secure 0 0 0) 0x7f746c009110 con 0x7f747c0664b0 2024-08-18T22:46:30.109 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:30.107+0000 7f74637fe640 1 --2- 172.21.15.121:0/3834308918 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f746406e0b0 0x7f7464070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:46:30.110 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:30.107+0000 7f74637fe640 1 -- 172.21.15.121:0/3834308918 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f746c08df50 con 0x7f747c0664b0 2024-08-18T22:46:30.110 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:30.107+0000 7f747a7fc640 1 --2- 172.21.15.121:0/3834308918 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f746406e0b0 0x7f7464070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:46:30.110 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:30.108+0000 7f747a7fc640 1 --2- 172.21.15.121:0/3834308918 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f746406e0b0 0x7f7464070560 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f747002a530 tx=0x7f7470009da0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:46:30.113 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:30.112+0000 7f74637fe640 1 -- 172.21.15.121:0/3834308918 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f746c057280 con 0x7f747c0664b0 2024-08-18T22:46:30.296 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:30.295+0000 7f74812b7640 1 -- 172.21.15.121:0/3834308918 --> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f747c10ee20 con 0x7f746406e0b0 2024-08-18T22:46:30.297 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:30.296+0000 7f74637fe640 1 -- 172.21.15.121:0/3834308918 <== mgr.34102 v2:172.21.15.121:6800/3037387239 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f747c10ee20 con 0x7f746406e0b0 2024-08-18T22:46:30.302 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:30.298+0000 7f74812b7640 1 -- 172.21.15.121:0/3834308918 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f746406e0b0 msgr2=0x7f7464070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:46:30.302 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:30.298+0000 7f74812b7640 1 --2- 172.21.15.121:0/3834308918 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f746406e0b0 0x7f7464070560 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f747002a530 tx=0x7f7470009da0 comp rx=0 tx=0).stop 2024-08-18T22:46:30.302 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:30.298+0000 7f74812b7640 1 -- 172.21.15.121:0/3834308918 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f747c0664b0 msgr2=0x7f747c10cef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:46:30.303 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:30.298+0000 7f74812b7640 1 --2- 172.21.15.121:0/3834308918 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f747c0664b0 0x7f747c10cef0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f746c00eb70 tx=0x7f746c00b040 comp rx=0 tx=0).stop 2024-08-18T22:46:30.303 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:30.298+0000 7f74812b7640 1 -- 172.21.15.121:0/3834308918 shutdown_connections 2024-08-18T22:46:30.303 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:30.298+0000 7f74812b7640 1 --2- 172.21.15.121:0/3834308918 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f746406e0b0 0x7f7464070560 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:46:30.303 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:30.298+0000 7f74812b7640 1 --2- 172.21.15.121:0/3834308918 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f747c0ff460 0x7f747c10d430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:46:30.303 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:30.298+0000 7f74812b7640 1 --2- 172.21.15.121:0/3834308918 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f747c0664b0 0x7f747c10cef0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:46:30.303 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:30.298+0000 7f74812b7640 1 -- 172.21.15.121:0/3834308918 >> 172.21.15.121:0/3834308918 conn(0x7f747c0f69b0 msgr2=0x7f747c0f6df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:46:30.303 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:30.298+0000 7f74812b7640 1 -- 172.21.15.121:0/3834308918 shutdown_connections 2024-08-18T22:46:30.303 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:30.298+0000 7f74812b7640 1 -- 172.21.15.121:0/3834308918 wait complete. 2024-08-18T22:46:30.308 INFO:teuthology.orchestra.run.smithi121.stdout:true 2024-08-18T22:46:30.373 INFO:journalctl@ceph.osd.3.smithi195.stdout:Aug 18 22:46:30 smithi195 podman[77630]: 2024-08-18 22:46:30.003349062 +0000 UTC m=+0.105854107 container create e93c4805b493fc75ceeab053111739ed60096595cb2c91b36bd1a6f0f5164873 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-3-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_CLEAN=True, CEPH_POINT_RELEASE=, RELEASE=squid-de09dd0, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.36.0) 2024-08-18T22:46:30.373 INFO:journalctl@ceph.osd.3.smithi195.stdout:Aug 18 22:46:30 smithi195 podman[77630]: 2024-08-18 22:46:29.914740704 +0000 UTC m=+0.017245766 image pull ea7a5189f30bad3aca9524788e2965d2368d7ce786df09d4edcd8c3edf9cefba quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9 2024-08-18T22:46:30.373 INFO:journalctl@ceph.osd.3.smithi195.stdout:Aug 18 22:46:30 smithi195 podman[77630]: 2024-08-18 22:46:30.18084145 +0000 UTC m=+0.283346495 container init e93c4805b493fc75ceeab053111739ed60096595cb2c91b36bd1a6f0f5164873 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-3-deactivate, org.label-schema.build-date=20240731, RELEASE=squid-de09dd0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, io.buildah.version=1.36.0, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0) 2024-08-18T22:46:30.373 INFO:journalctl@ceph.osd.3.smithi195.stdout:Aug 18 22:46:30 smithi195 podman[77630]: 2024-08-18 22:46:30.184133349 +0000 UTC m=+0.286638401 container start e93c4805b493fc75ceeab053111739ed60096595cb2c91b36bd1a6f0f5164873 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-3-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_CLEAN=True, io.buildah.version=1.36.0, org.label-schema.vendor=CentOS, RELEASE=squid-de09dd0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0) 2024-08-18T22:46:30.373 INFO:journalctl@ceph.osd.3.smithi195.stdout:Aug 18 22:46:30 smithi195 podman[77630]: 2024-08-18 22:46:30.247265931 +0000 UTC m=+0.349770976 container attach e93c4805b493fc75ceeab053111739ed60096595cb2c91b36bd1a6f0f5164873 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-3-deactivate, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , io.buildah.version=1.36.0, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-de09dd0, org.label-schema.build-date=20240731) 2024-08-18T22:46:30.378 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:30.377+0000 7f506359c640 1 -- 172.21.15.121:0/3379341964 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f505c0fc4d0 msgr2=0x7f505c0fc940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:46:30.379 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:30.377+0000 7f506359c640 1 --2- 172.21.15.121:0/3379341964 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f505c0fc4d0 0x7f505c0fc940 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f50580048d0 tx=0x7f5058009da0 comp rx=0 tx=0).stop 2024-08-18T22:46:30.379 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:30.377+0000 7f506359c640 1 -- 172.21.15.121:0/3379341964 shutdown_connections 2024-08-18T22:46:30.379 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:30.377+0000 7f506359c640 1 --2- 172.21.15.121:0/3379341964 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f505c0fc4d0 0x7f505c0fc940 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:46:30.379 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:30.377+0000 7f506359c640 1 --2- 172.21.15.121:0/3379341964 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f505c0fb200 0x7f505c0fb610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:46:30.379 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:30.378+0000 7f506359c640 1 -- 172.21.15.121:0/3379341964 >> 172.21.15.121:0/3379341964 conn(0x7f505c0f69e0 msgr2=0x7f505c0f8df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:46:30.379 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:30.378+0000 7f506359c640 1 -- 172.21.15.121:0/3379341964 shutdown_connections 2024-08-18T22:46:30.379 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:30.378+0000 7f506359c640 1 -- 172.21.15.121:0/3379341964 wait complete. 2024-08-18T22:46:30.381 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:30.378+0000 7f506359c640 1 Processor -- start 2024-08-18T22:46:30.381 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:30.378+0000 7f506359c640 1 -- start start 2024-08-18T22:46:30.381 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:30.379+0000 7f506359c640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f505c0fb200 0x7f505c10bda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:46:30.381 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:30.379+0000 7f506359c640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f505c0fc4d0 0x7f505c10c2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:46:30.381 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:30.379+0000 7f506359c640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f505c10c930 con 0x7f505c0fc4d0 2024-08-18T22:46:30.381 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:30.379+0000 7f506359c640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f505c10d070 con 0x7f505c0fb200 2024-08-18T22:46:30.381 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:30.379+0000 7f5060b37640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f505c0fc4d0 0x7f505c10c2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:46:30.381 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:30.379+0000 7f5060b37640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f505c0fc4d0 0x7f505c10c2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:40252/0 (socket says 172.21.15.121:40252) 2024-08-18T22:46:30.381 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:30.379+0000 7f5061338640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f505c0fb200 0x7f505c10bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:46:30.381 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:30.379+0000 7f5060b37640 1 -- 172.21.15.121:0/962400191 learned_addr learned my addr 172.21.15.121:0/962400191 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-18T22:46:30.382 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:30.379+0000 7f5060b37640 1 -- 172.21.15.121:0/962400191 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f505c0fb200 msgr2=0x7f505c10bda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:46:30.382 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:30.379+0000 7f5060b37640 1 --2- 172.21.15.121:0/962400191 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f505c0fb200 0x7f505c10bda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:46:30.382 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:30.379+0000 7f5060b37640 1 -- 172.21.15.121:0/962400191 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5058005040 con 0x7f505c0fc4d0 2024-08-18T22:46:30.382 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:30.379+0000 7f5060b37640 1 --2- 172.21.15.121:0/962400191 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f505c0fc4d0 0x7f505c10c2e0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f50580048a0 tx=0x7f5058009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:46:30.382 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:30.379+0000 7f504dffb640 1 -- 172.21.15.121:0/962400191 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5058038070 con 0x7f505c0fc4d0 2024-08-18T22:46:30.382 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:30.379+0000 7f504dffb640 1 -- 172.21.15.121:0/962400191 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f5058004290 con 0x7f505c0fc4d0 2024-08-18T22:46:30.382 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:30.379+0000 7f504dffb640 1 -- 172.21.15.121:0/962400191 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5058033660 con 0x7f505c0fc4d0 2024-08-18T22:46:30.382 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:30.379+0000 7f506359c640 1 -- 172.21.15.121:0/962400191 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f505c10d2a0 con 0x7f505c0fc4d0 2024-08-18T22:46:30.382 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:30.380+0000 7f506359c640 1 -- 172.21.15.121:0/962400191 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f505c10d780 con 0x7f505c0fc4d0 2024-08-18T22:46:30.383 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:30.381+0000 7f506359c640 1 -- 172.21.15.121:0/962400191 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f505c0fa660 con 0x7f505c0fc4d0 2024-08-18T22:46:30.383 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:30.381+0000 7f504dffb640 1 -- 172.21.15.121:0/962400191 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 37) v1 ==== 92205+0+0 (secure 0 0 0) 0x7f5058030020 con 0x7f505c0fc4d0 2024-08-18T22:46:30.383 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:30.382+0000 7f504dffb640 1 --2- 172.21.15.121:0/962400191 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f504806e0b0 0x7f5048070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:46:30.383 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:30.382+0000 7f504dffb640 1 -- 172.21.15.121:0/962400191 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f50580adc20 con 0x7f505c0fc4d0 2024-08-18T22:46:30.383 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:30.382+0000 7f5061338640 1 --2- 172.21.15.121:0/962400191 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f504806e0b0 0x7f5048070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:46:30.384 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:30.382+0000 7f5061338640 1 --2- 172.21.15.121:0/962400191 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f504806e0b0 0x7f5048070560 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f505c10bb30 tx=0x7f505000b040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:46:30.387 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:30.386+0000 7f504dffb640 1 -- 172.21.15.121:0/962400191 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f5058077080 con 0x7f505c0fc4d0 2024-08-18T22:46:30.569 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:30.568+0000 7f506359c640 1 -- 172.21.15.121:0/962400191 --> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f505c10dbc0 con 0x7f504806e0b0 2024-08-18T22:46:30.569 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:30.569+0000 7f504dffb640 1 -- 172.21.15.121:0/962400191 <== mgr.34102 v2:172.21.15.121:6800/3037387239 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f505c10dbc0 con 0x7f504806e0b0 2024-08-18T22:46:30.572 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:30.571+0000 7f506359c640 1 -- 172.21.15.121:0/962400191 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f504806e0b0 msgr2=0x7f5048070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:46:30.573 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:30.571+0000 7f506359c640 1 --2- 172.21.15.121:0/962400191 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f504806e0b0 0x7f5048070560 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f505c10bb30 tx=0x7f505000b040 comp rx=0 tx=0).stop 2024-08-18T22:46:30.573 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:30.571+0000 7f506359c640 1 -- 172.21.15.121:0/962400191 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f505c0fc4d0 msgr2=0x7f505c10c2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:46:30.573 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:30.571+0000 7f506359c640 1 --2- 172.21.15.121:0/962400191 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f505c0fc4d0 0x7f505c10c2e0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f50580048a0 tx=0x7f5058009da0 comp rx=0 tx=0).stop 2024-08-18T22:46:30.573 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:30.571+0000 7f506359c640 1 -- 172.21.15.121:0/962400191 shutdown_connections 2024-08-18T22:46:30.573 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:30.571+0000 7f506359c640 1 --2- 172.21.15.121:0/962400191 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f504806e0b0 0x7f5048070560 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:46:30.573 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:30.571+0000 7f506359c640 1 --2- 172.21.15.121:0/962400191 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f505c0fc4d0 0x7f505c10c2e0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:46:30.573 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:30.571+0000 7f506359c640 1 --2- 172.21.15.121:0/962400191 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f505c0fb200 0x7f505c10bda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:46:30.573 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:30.571+0000 7f506359c640 1 -- 172.21.15.121:0/962400191 >> 172.21.15.121:0/962400191 conn(0x7f505c0f69e0 msgr2=0x7f505c0f8170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:46:30.573 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:30.571+0000 7f506359c640 1 -- 172.21.15.121:0/962400191 shutdown_connections 2024-08-18T22:46:30.573 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:30.571+0000 7f506359c640 1 -- 172.21.15.121:0/962400191 wait complete. 2024-08-18T22:46:30.630 INFO:journalctl@ceph.osd.3.smithi195.stdout:Aug 18 22:46:30 smithi195 podman[77630]: 2024-08-18 22:46:30.372927915 +0000 UTC m=+0.475432971 container died e93c4805b493fc75ceeab053111739ed60096595cb2c91b36bd1a6f0f5164873 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-3-deactivate, GIT_CLEAN=True, io.buildah.version=1.36.0, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-de09dd0, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.build-date=20240731) 2024-08-18T22:46:30.652 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:30.650+0000 7fd403d5e640 1 -- 172.21.15.121:0/1752435166 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd3fc0fc490 msgr2=0x7fd3fc0fc900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:46:30.652 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:30.650+0000 7fd403d5e640 1 --2- 172.21.15.121:0/1752435166 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd3fc0fc490 0x7fd3fc0fc900 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fd3f80048d0 tx=0x7fd3f8009da0 comp rx=0 tx=0).stop 2024-08-18T22:46:30.653 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:30.650+0000 7fd403d5e640 1 -- 172.21.15.121:0/1752435166 shutdown_connections 2024-08-18T22:46:30.653 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:30.650+0000 7fd403d5e640 1 --2- 172.21.15.121:0/1752435166 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd3fc0fc490 0x7fd3fc0fc900 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:46:30.653 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:30.650+0000 7fd403d5e640 1 --2- 172.21.15.121:0/1752435166 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd3fc0fb1c0 0x7fd3fc0fb5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:46:30.653 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:30.650+0000 7fd403d5e640 1 -- 172.21.15.121:0/1752435166 >> 172.21.15.121:0/1752435166 conn(0x7fd3fc0f69a0 msgr2=0x7fd3fc0f8db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:46:30.653 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:30.650+0000 7fd403d5e640 1 -- 172.21.15.121:0/1752435166 shutdown_connections 2024-08-18T22:46:30.653 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:30.650+0000 7fd403d5e640 1 -- 172.21.15.121:0/1752435166 wait complete. 2024-08-18T22:46:30.653 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:30.650+0000 7fd403d5e640 1 Processor -- start 2024-08-18T22:46:30.653 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:30.651+0000 7fd403d5e640 1 -- start start 2024-08-18T22:46:30.653 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:30.651+0000 7fd403d5e640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd3fc0fb1c0 0x7fd3fc10fb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:46:30.653 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:30.651+0000 7fd403d5e640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd3fc0fc490 0x7fd3fc1120a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:46:30.653 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:30.651+0000 7fd403d5e640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3fc066290 con 0x7fd3fc0fb1c0 2024-08-18T22:46:30.653 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:30.651+0000 7fd403d5e640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3fc066400 con 0x7fd3fc0fc490 2024-08-18T22:46:30.653 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:30.651+0000 7fd401afa640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd3fc0fb1c0 0x7fd3fc10fb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:46:30.654 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:30.651+0000 7fd401afa640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd3fc0fb1c0 0x7fd3fc10fb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:40266/0 (socket says 172.21.15.121:40266) 2024-08-18T22:46:30.654 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:30.651+0000 7fd401afa640 1 -- 172.21.15.121:0/2505285909 learned_addr learned my addr 172.21.15.121:0/2505285909 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-18T22:46:30.654 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:30.651+0000 7fd4012f9640 1 --2- 172.21.15.121:0/2505285909 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd3fc0fc490 0x7fd3fc1120a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:46:30.654 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:30.651+0000 7fd401afa640 1 -- 172.21.15.121:0/2505285909 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd3fc0fc490 msgr2=0x7fd3fc1120a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:46:30.654 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:30.651+0000 7fd401afa640 1 --2- 172.21.15.121:0/2505285909 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd3fc0fc490 0x7fd3fc1120a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:46:30.654 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:30.651+0000 7fd401afa640 1 -- 172.21.15.121:0/2505285909 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3f8005040 con 0x7fd3fc0fb1c0 2024-08-18T22:46:30.654 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:30.651+0000 7fd401afa640 1 --2- 172.21.15.121:0/2505285909 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd3fc0fb1c0 0x7fd3fc10fb50 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fd3ec002a50 tx=0x7fd3ec004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:46:30.654 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:30.651+0000 7fd3f27fc640 1 -- 172.21.15.121:0/2505285909 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd3ec007c30 con 0x7fd3fc0fb1c0 2024-08-18T22:46:30.654 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:30.651+0000 7fd3f27fc640 1 -- 172.21.15.121:0/2505285909 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fd3ec00f040 con 0x7fd3fc0fb1c0 2024-08-18T22:46:30.654 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:30.651+0000 7fd403d5e640 1 -- 172.21.15.121:0/2505285909 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3fc112640 con 0x7fd3fc0fb1c0 2024-08-18T22:46:30.654 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:30.651+0000 7fd3f27fc640 1 -- 172.21.15.121:0/2505285909 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd3ec00da10 con 0x7fd3fc0fb1c0 2024-08-18T22:46:30.654 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:30.652+0000 7fd403d5e640 1 -- 172.21.15.121:0/2505285909 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3fc112bb0 con 0x7fd3fc0fb1c0 2024-08-18T22:46:30.655 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:30.652+0000 7fd403d5e640 1 -- 172.21.15.121:0/2505285909 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3fc0fa620 con 0x7fd3fc0fb1c0 2024-08-18T22:46:30.655 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:30.653+0000 7fd3f27fc640 1 -- 172.21.15.121:0/2505285909 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 37) v1 ==== 92205+0+0 (secure 0 0 0) 0x7fd3ec00dbb0 con 0x7fd3fc0fb1c0 2024-08-18T22:46:30.656 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:30.653+0000 7fd3f27fc640 1 --2- 172.21.15.121:0/2505285909 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7fd3e806e0b0 0x7fd3e8070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:46:30.656 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:30.653+0000 7fd3f27fc640 1 -- 172.21.15.121:0/2505285909 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6496+0+0 (secure 0 0 0) 0x7fd3ec08d290 con 0x7fd3fc0fb1c0 2024-08-18T22:46:30.656 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:30.654+0000 7fd4012f9640 1 --2- 172.21.15.121:0/2505285909 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7fd3e806e0b0 0x7fd3e8070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:46:30.656 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:30.654+0000 7fd4012f9640 1 --2- 172.21.15.121:0/2505285909 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7fd3e806e0b0 0x7fd3e8070560 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fd3f800b020 tx=0x7fd3f8035040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:46:30.658 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:30.658+0000 7fd3f27fc640 1 -- 172.21.15.121:0/2505285909 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7fd3ec0566f0 con 0x7fd3fc0fb1c0 2024-08-18T22:46:30.837 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:30.835+0000 7fd403d5e640 1 -- 172.21.15.121:0/2505285909 --> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fd3fc1008b0 con 0x7fd3e806e0b0 2024-08-18T22:46:30.845 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:30.844+0000 7fd3f27fc640 1 -- 172.21.15.121:0/2505285909 <== mgr.34102 v2:172.21.15.121:6800/3037387239 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7fd3fc1008b0 con 0x7fd3e806e0b0 2024-08-18T22:46:30.845 INFO:teuthology.orchestra.run.smithi121.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-08-18T22:46:30.845 INFO:teuthology.orchestra.run.smithi121.stdout:alertmanager.smithi121 smithi121 *:9093,9094 running (4m) 26s ago 12m 24.9M - 0.25.0 c8568f914cd2 c421c5e6a02b 2024-08-18T22:46:30.845 INFO:teuthology.orchestra.run.smithi121.stdout:crash.smithi121 smithi121 running (2m) 26s ago 12m 6903k - 19.1.0-1382-gde09dd01 ea7a5189f30b 3cf5c666a0e6 2024-08-18T22:46:30.845 INFO:teuthology.orchestra.run.smithi121.stdout:crash.smithi195 smithi195 running (118s) 115s ago 11m 6895k - 19.1.0-1382-gde09dd01 ea7a5189f30b fbb586fb9834 2024-08-18T22:46:30.846 INFO:teuthology.orchestra.run.smithi121.stdout:grafana.smithi121 smithi121 *:3000 running (4m) 26s ago 12m 78.4M - 9.4.7 954c08fa6188 091a5fd17e8a 2024-08-18T22:46:30.846 INFO:teuthology.orchestra.run.smithi121.stdout:mds.cephfs.smithi121.gbickb smithi121 running (7m) 26s ago 7m 156M - 17.2.7-1406-gdf62bdcc 774894bef55f 484da0bc2c95 2024-08-18T22:46:30.846 INFO:teuthology.orchestra.run.smithi121.stdout:mds.cephfs.smithi121.xuzsdg smithi121 running (7m) 26s ago 7m 13.6M - 17.2.7-1406-gdf62bdcc 774894bef55f 6976b708cdcd 2024-08-18T22:46:30.846 INFO:teuthology.orchestra.run.smithi121.stdout:mds.cephfs.smithi195.buqvbr smithi195 running (7m) 115s ago 7m 115M - 17.2.7-1406-gdf62bdcc 774894bef55f 11a3703b4276 2024-08-18T22:46:30.846 INFO:teuthology.orchestra.run.smithi121.stdout:mds.cephfs.smithi195.nptgyc smithi195 running (7m) 115s ago 7m 17.6M - 17.2.7-1406-gdf62bdcc 774894bef55f b9f8043ea83e 2024-08-18T22:46:30.846 INFO:teuthology.orchestra.run.smithi121.stdout:mgr.smithi121.lopxqc smithi121 *:8443,9283,8765 running (3m) 26s ago 13m 498M - 19.1.0-1382-gde09dd01 ea7a5189f30b 9079701e6516 2024-08-18T22:46:30.846 INFO:teuthology.orchestra.run.smithi121.stdout:mgr.smithi195.acttsj smithi195 *:8443,9283,8765 running (3m) 115s ago 11m 439M - 19.1.0-1382-gde09dd01 ea7a5189f30b 7b4027a33daa 2024-08-18T22:46:30.846 INFO:teuthology.orchestra.run.smithi121.stdout:mon.smithi121 smithi121 running (2m) 26s ago 13m 49.3M 2048M 19.1.0-1382-gde09dd01 ea7a5189f30b d71695a4fb56 2024-08-18T22:46:30.846 INFO:teuthology.orchestra.run.smithi121.stdout:mon.smithi195 smithi195 running (2m) 115s ago 11m 35.1M 2048M 19.1.0-1382-gde09dd01 ea7a5189f30b a9bb94ba3b56 2024-08-18T22:46:30.846 INFO:teuthology.orchestra.run.smithi121.stdout:node-exporter.smithi121 smithi121 *:9100 running (4m) 26s ago 12m 15.2M - 1.5.0 0da6a335fe13 bc4b5355a507 2024-08-18T22:46:30.846 INFO:teuthology.orchestra.run.smithi121.stdout:node-exporter.smithi195 smithi195 *:9100 running (3m) 115s ago 11m 16.4M - 1.5.0 0da6a335fe13 146efcb79663 2024-08-18T22:46:30.846 INFO:teuthology.orchestra.run.smithi121.stdout:osd.0 smithi121 running (99s) 26s ago 10m 99.3M 1557M 19.1.0-1382-gde09dd01 ea7a5189f30b d378dd46eeb6 2024-08-18T22:46:30.846 INFO:teuthology.orchestra.run.smithi121.stdout:osd.1 smithi121 running (66s) 26s ago 10m 117M 1557M 19.1.0-1382-gde09dd01 ea7a5189f30b 0f9e03de5382 2024-08-18T22:46:30.847 INFO:teuthology.orchestra.run.smithi121.stdout:osd.2 smithi121 running (32s) 26s ago 9m 11.7M 1557M 19.1.0-1382-gde09dd01 ea7a5189f30b 93270b5bed68 2024-08-18T22:46:30.847 INFO:teuthology.orchestra.run.smithi121.stdout:osd.3 smithi195 running (9m) 115s ago 9m 239M 2581M 17.2.7-1406-gdf62bdcc 774894bef55f 15d30b1b459e 2024-08-18T22:46:30.847 INFO:teuthology.orchestra.run.smithi121.stdout:osd.4 smithi195 running (9m) 115s ago 9m 207M 2581M 17.2.7-1406-gdf62bdcc 774894bef55f 99ed156dfd36 2024-08-18T22:46:30.847 INFO:teuthology.orchestra.run.smithi121.stdout:osd.5 smithi195 running (8m) 115s ago 8m 213M 2581M 17.2.7-1406-gdf62bdcc 774894bef55f e7eff7bdb752 2024-08-18T22:46:30.847 INFO:teuthology.orchestra.run.smithi121.stdout:prometheus.smithi121 smithi121 *:9095 running (3m) 26s ago 11m 54.0M - 2.43.0 a07b618ecd1d 00c4f776d23a 2024-08-18T22:46:30.848 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:30.846+0000 7fd403d5e640 1 -- 172.21.15.121:0/2505285909 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7fd3e806e0b0 msgr2=0x7fd3e8070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:46:30.848 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:30.846+0000 7fd403d5e640 1 --2- 172.21.15.121:0/2505285909 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7fd3e806e0b0 0x7fd3e8070560 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fd3f800b020 tx=0x7fd3f8035040 comp rx=0 tx=0).stop 2024-08-18T22:46:30.848 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:30.846+0000 7fd403d5e640 1 -- 172.21.15.121:0/2505285909 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd3fc0fb1c0 msgr2=0x7fd3fc10fb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:46:30.848 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:30.846+0000 7fd403d5e640 1 --2- 172.21.15.121:0/2505285909 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd3fc0fb1c0 0x7fd3fc10fb50 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fd3ec002a50 tx=0x7fd3ec004600 comp rx=0 tx=0).stop 2024-08-18T22:46:30.848 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:30.846+0000 7fd403d5e640 1 -- 172.21.15.121:0/2505285909 shutdown_connections 2024-08-18T22:46:30.848 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:30.846+0000 7fd403d5e640 1 --2- 172.21.15.121:0/2505285909 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7fd3e806e0b0 0x7fd3e8070560 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:46:30.848 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:30.846+0000 7fd403d5e640 1 --2- 172.21.15.121:0/2505285909 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd3fc0fc490 0x7fd3fc1120a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:46:30.848 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:30.846+0000 7fd403d5e640 1 --2- 172.21.15.121:0/2505285909 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd3fc0fb1c0 0x7fd3fc10fb50 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:46:30.848 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:30.846+0000 7fd403d5e640 1 -- 172.21.15.121:0/2505285909 >> 172.21.15.121:0/2505285909 conn(0x7fd3fc0f69a0 msgr2=0x7fd3fc0f8150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:46:30.848 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:30.846+0000 7fd403d5e640 1 -- 172.21.15.121:0/2505285909 shutdown_connections 2024-08-18T22:46:30.848 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:30.846+0000 7fd403d5e640 1 -- 172.21.15.121:0/2505285909 wait complete. 2024-08-18T22:46:30.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:46:30 smithi195 ceph-mon[68841]: osdmap e67: 6 total, 5 up, 6 in 2024-08-18T22:46:30.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:46:30 smithi195 ceph-mon[68841]: 3 slow requests, 0 included below; oldest blocked for > 301.869312 secs 2024-08-18T22:46:30.924 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:30.923+0000 7fb83a29a640 1 -- 172.21.15.121:0/3169170812 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb8340fd5a0 msgr2=0x7fb8340fda10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:46:30.924 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:30.923+0000 7fb83a29a640 1 --2- 172.21.15.121:0/3169170812 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb8340fd5a0 0x7fb8340fda10 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fb8280048d0 tx=0x7fb828009da0 comp rx=0 tx=0).stop 2024-08-18T22:46:30.924 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:30.923+0000 7fb83a29a640 1 -- 172.21.15.121:0/3169170812 shutdown_connections 2024-08-18T22:46:30.924 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:46:30 smithi121 ceph-mon[81053]: osdmap e67: 6 total, 5 up, 6 in 2024-08-18T22:46:30.925 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:46:30 smithi121 ceph-mon[81053]: 3 slow requests, 0 included below; oldest blocked for > 301.869312 secs 2024-08-18T22:46:30.926 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:30.923+0000 7fb83a29a640 1 --2- 172.21.15.121:0/3169170812 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb8340fd5a0 0x7fb8340fda10 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:46:30.926 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:30.923+0000 7fb83a29a640 1 --2- 172.21.15.121:0/3169170812 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb8340fc2d0 0x7fb8340fc6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:46:30.926 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:30.923+0000 7fb83a29a640 1 -- 172.21.15.121:0/3169170812 >> 172.21.15.121:0/3169170812 conn(0x7fb8340f7ab0 msgr2=0x7fb8340f9ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:46:30.926 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:30.923+0000 7fb83a29a640 1 -- 172.21.15.121:0/3169170812 shutdown_connections 2024-08-18T22:46:30.926 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:30.923+0000 7fb83a29a640 1 -- 172.21.15.121:0/3169170812 wait complete. 2024-08-18T22:46:30.926 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:30.924+0000 7fb83a29a640 1 Processor -- start 2024-08-18T22:46:30.926 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:30.924+0000 7fb83a29a640 1 -- start start 2024-08-18T22:46:30.926 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:30.924+0000 7fb83a29a640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb8340fc2d0 0x7fb83410ced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:46:30.927 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:30.924+0000 7fb83a29a640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb8340fd5a0 0x7fb83410d410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:46:30.927 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:30.924+0000 7fb83a29a640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb83410e140 con 0x7fb8340fd5a0 2024-08-18T22:46:30.927 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:30.924+0000 7fb83a29a640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb83410e2b0 con 0x7fb8340fc2d0 2024-08-18T22:46:30.927 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:30.924+0000 7fb8337fe640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb8340fd5a0 0x7fb83410d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:46:30.927 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:30.924+0000 7fb8337fe640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb8340fd5a0 0x7fb83410d410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:40282/0 (socket says 172.21.15.121:40282) 2024-08-18T22:46:30.927 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:30.924+0000 7fb833fff640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb8340fc2d0 0x7fb83410ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:46:30.927 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:30.924+0000 7fb8337fe640 1 -- 172.21.15.121:0/912876429 learned_addr learned my addr 172.21.15.121:0/912876429 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-18T22:46:30.927 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:30.925+0000 7fb8337fe640 1 -- 172.21.15.121:0/912876429 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb8340fc2d0 msgr2=0x7fb83410ced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:46:30.927 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:30.925+0000 7fb8337fe640 1 --2- 172.21.15.121:0/912876429 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb8340fc2d0 0x7fb83410ced0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:46:30.927 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:30.925+0000 7fb8337fe640 1 -- 172.21.15.121:0/912876429 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb828005040 con 0x7fb8340fd5a0 2024-08-18T22:46:30.927 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:30.925+0000 7fb833fff640 1 --2- 172.21.15.121:0/912876429 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb8340fc2d0 0x7fb83410ced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:46:30.927 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:30.925+0000 7fb8337fe640 1 --2- 172.21.15.121:0/912876429 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb8340fd5a0 0x7fb83410d410 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fb8280043d0 tx=0x7fb828009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:46:30.927 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:30.925+0000 7fb830ff9640 1 -- 172.21.15.121:0/912876429 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb828038070 con 0x7fb8340fd5a0 2024-08-18T22:46:30.927 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:30.925+0000 7fb83a29a640 1 -- 172.21.15.121:0/912876429 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb83410e530 con 0x7fb8340fd5a0 2024-08-18T22:46:30.928 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:30.925+0000 7fb830ff9640 1 -- 172.21.15.121:0/912876429 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fb82802ae90 con 0x7fb8340fd5a0 2024-08-18T22:46:30.928 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:30.925+0000 7fb830ff9640 1 -- 172.21.15.121:0/912876429 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb82803e670 con 0x7fb8340fd5a0 2024-08-18T22:46:30.928 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:30.925+0000 7fb83a29a640 1 -- 172.21.15.121:0/912876429 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb83410ead0 con 0x7fb8340fd5a0 2024-08-18T22:46:30.928 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:30.926+0000 7fb83a29a640 1 -- 172.21.15.121:0/912876429 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8340fb730 con 0x7fb8340fd5a0 2024-08-18T22:46:30.928 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:30.927+0000 7fb830ff9640 1 -- 172.21.15.121:0/912876429 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 37) v1 ==== 92205+0+0 (secure 0 0 0) 0x7fb828030020 con 0x7fb8340fd5a0 2024-08-18T22:46:30.928 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:30.928+0000 7fb830ff9640 1 --2- 172.21.15.121:0/912876429 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7fb81c06e0b0 0x7fb81c070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:46:30.929 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:30.928+0000 7fb830ff9640 1 -- 172.21.15.121:0/912876429 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6496+0+0 (secure 0 0 0) 0x7fb8280add80 con 0x7fb8340fd5a0 2024-08-18T22:46:30.929 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:30.928+0000 7fb833fff640 1 --2- 172.21.15.121:0/912876429 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7fb81c06e0b0 0x7fb81c070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:46:30.929 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:30.928+0000 7fb833fff640 1 --2- 172.21.15.121:0/912876429 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7fb81c06e0b0 0x7fb81c070560 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fb824004fd0 tx=0x7fb82400b040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:46:30.933 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:30.932+0000 7fb830ff9640 1 -- 172.21.15.121:0/912876429 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7fb828077160 con 0x7fb8340fd5a0 2024-08-18T22:46:31.165 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:31.164+0000 7fb83a29a640 1 -- 172.21.15.121:0/912876429 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fb83404b4c0 con 0x7fb8340fd5a0 2024-08-18T22:46:31.165 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:31.164+0000 7fb830ff9640 1 -- 172.21.15.121:0/912876429 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+838 (secure 0 0 0) 0x7fb82807a820 con 0x7fb8340fd5a0 2024-08-18T22:46:31.166 INFO:teuthology.orchestra.run.smithi121.stdout:{ 2024-08-18T22:46:31.166 INFO:teuthology.orchestra.run.smithi121.stdout: "mon": { 2024-08-18T22:46:31.166 INFO:teuthology.orchestra.run.smithi121.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 2 2024-08-18T22:46:31.166 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-18T22:46:31.166 INFO:teuthology.orchestra.run.smithi121.stdout: "mgr": { 2024-08-18T22:46:31.166 INFO:teuthology.orchestra.run.smithi121.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 2 2024-08-18T22:46:31.166 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-18T22:46:31.166 INFO:teuthology.orchestra.run.smithi121.stdout: "osd": { 2024-08-18T22:46:31.166 INFO:teuthology.orchestra.run.smithi121.stdout: "ceph version 17.2.7-1406-gdf62bdcc (df62bdccd9a13bf566b27a250eddfdd89be3072d) quincy (stable)": 2, 2024-08-18T22:46:31.166 INFO:teuthology.orchestra.run.smithi121.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 3 2024-08-18T22:46:31.167 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-18T22:46:31.167 INFO:teuthology.orchestra.run.smithi121.stdout: "mds": { 2024-08-18T22:46:31.167 INFO:teuthology.orchestra.run.smithi121.stdout: "ceph version 17.2.7-1406-gdf62bdcc (df62bdccd9a13bf566b27a250eddfdd89be3072d) quincy (stable)": 4 2024-08-18T22:46:31.167 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-18T22:46:31.167 INFO:teuthology.orchestra.run.smithi121.stdout: "overall": { 2024-08-18T22:46:31.167 INFO:teuthology.orchestra.run.smithi121.stdout: "ceph version 17.2.7-1406-gdf62bdcc (df62bdccd9a13bf566b27a250eddfdd89be3072d) quincy (stable)": 6, 2024-08-18T22:46:31.167 INFO:teuthology.orchestra.run.smithi121.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 7 2024-08-18T22:46:31.167 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-08-18T22:46:31.167 INFO:teuthology.orchestra.run.smithi121.stdout:} 2024-08-18T22:46:31.168 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:31.167+0000 7fb83a29a640 1 -- 172.21.15.121:0/912876429 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7fb81c06e0b0 msgr2=0x7fb81c070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:46:31.168 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:31.167+0000 7fb83a29a640 1 --2- 172.21.15.121:0/912876429 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7fb81c06e0b0 0x7fb81c070560 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fb824004fd0 tx=0x7fb82400b040 comp rx=0 tx=0).stop 2024-08-18T22:46:31.168 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:31.167+0000 7fb83a29a640 1 -- 172.21.15.121:0/912876429 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb8340fd5a0 msgr2=0x7fb83410d410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:46:31.168 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:31.167+0000 7fb83a29a640 1 --2- 172.21.15.121:0/912876429 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb8340fd5a0 0x7fb83410d410 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fb8280043d0 tx=0x7fb828009da0 comp rx=0 tx=0).stop 2024-08-18T22:46:31.168 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:31.167+0000 7fb83a29a640 1 -- 172.21.15.121:0/912876429 shutdown_connections 2024-08-18T22:46:31.168 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:31.167+0000 7fb83a29a640 1 --2- 172.21.15.121:0/912876429 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7fb81c06e0b0 0x7fb81c070560 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:46:31.168 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:31.167+0000 7fb83a29a640 1 --2- 172.21.15.121:0/912876429 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb8340fd5a0 0x7fb83410d410 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:46:31.168 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:31.167+0000 7fb83a29a640 1 --2- 172.21.15.121:0/912876429 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb8340fc2d0 0x7fb83410ced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:46:31.168 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:31.167+0000 7fb83a29a640 1 -- 172.21.15.121:0/912876429 >> 172.21.15.121:0/912876429 conn(0x7fb8340f7ab0 msgr2=0x7fb8340f9270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:46:31.168 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:31.167+0000 7fb83a29a640 1 -- 172.21.15.121:0/912876429 shutdown_connections 2024-08-18T22:46:31.169 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:31.167+0000 7fb83a29a640 1 -- 172.21.15.121:0/912876429 wait complete. 2024-08-18T22:46:31.248 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:31.245+0000 7f630e591640 1 -- 172.21.15.121:0/2210013723 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f63080fa730 msgr2=0x7f63080fab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:46:31.248 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:31.245+0000 7f630e591640 1 --2- 172.21.15.121:0/2210013723 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f63080fa730 0x7f63080fab60 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f62f80048d0 tx=0x7f62f8009da0 comp rx=0 tx=0).stop 2024-08-18T22:46:31.248 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:31.245+0000 7f630e591640 1 -- 172.21.15.121:0/2210013723 shutdown_connections 2024-08-18T22:46:31.248 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:31.245+0000 7f630e591640 1 --2- 172.21.15.121:0/2210013723 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f63080fb0a0 0x7f63081018d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:46:31.248 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:31.245+0000 7f630e591640 1 --2- 172.21.15.121:0/2210013723 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f63080fa730 0x7f63080fab60 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:46:31.249 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:31.245+0000 7f630e591640 1 -- 172.21.15.121:0/2210013723 >> 172.21.15.121:0/2210013723 conn(0x7f63080f6150 msgr2=0x7f63080f8580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:46:31.249 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:31.245+0000 7f630e591640 1 -- 172.21.15.121:0/2210013723 shutdown_connections 2024-08-18T22:46:31.249 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:31.245+0000 7f630e591640 1 -- 172.21.15.121:0/2210013723 wait complete. 2024-08-18T22:46:31.249 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:31.245+0000 7f630e591640 1 Processor -- start 2024-08-18T22:46:31.249 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:31.246+0000 7f630e591640 1 -- start start 2024-08-18T22:46:31.249 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:31.246+0000 7f630e591640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f63080fa730 0x7f630810ced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:46:31.249 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:31.246+0000 7f630e591640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f63080fb0a0 0x7f630810d410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:46:31.249 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:31.246+0000 7f630e591640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f630810e140 con 0x7f63080fb0a0 2024-08-18T22:46:31.249 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:31.246+0000 7f630e591640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f630810e2b0 con 0x7f63080fa730 2024-08-18T22:46:31.249 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:31.246+0000 7f63077fe640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f63080fb0a0 0x7f630810d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:46:31.250 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:31.246+0000 7f63077fe640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f63080fb0a0 0x7f630810d410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:40300/0 (socket says 172.21.15.121:40300) 2024-08-18T22:46:31.250 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:31.246+0000 7f6307fff640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f63080fa730 0x7f630810ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:46:31.250 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:31.246+0000 7f63077fe640 1 -- 172.21.15.121:0/2529772978 learned_addr learned my addr 172.21.15.121:0/2529772978 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-18T22:46:31.250 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:31.246+0000 7f63077fe640 1 -- 172.21.15.121:0/2529772978 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f63080fa730 msgr2=0x7f630810ced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:46:31.250 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:31.246+0000 7f63077fe640 1 --2- 172.21.15.121:0/2529772978 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f63080fa730 0x7f630810ced0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:46:31.250 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:31.246+0000 7f63077fe640 1 -- 172.21.15.121:0/2529772978 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62f8005040 con 0x7f63080fb0a0 2024-08-18T22:46:31.250 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:31.246+0000 7f6307fff640 1 --2- 172.21.15.121:0/2529772978 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f63080fa730 0x7f630810ced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:46:31.250 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:31.247+0000 7f63077fe640 1 --2- 172.21.15.121:0/2529772978 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f63080fb0a0 0x7f630810d410 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f62fc002840 tx=0x7f62fc004570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:46:31.250 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:31.247+0000 7f6304ff9640 1 -- 172.21.15.121:0/2529772978 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f62fc007c30 con 0x7f63080fb0a0 2024-08-18T22:46:31.250 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:31.247+0000 7f630e591640 1 -- 172.21.15.121:0/2529772978 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f630810e590 con 0x7f63080fb0a0 2024-08-18T22:46:31.250 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:31.247+0000 7f6304ff9640 1 -- 172.21.15.121:0/2529772978 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f62fc00f040 con 0x7f63080fb0a0 2024-08-18T22:46:31.251 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:31.247+0000 7f6304ff9640 1 -- 172.21.15.121:0/2529772978 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f62fc0093e0 con 0x7f63080fb0a0 2024-08-18T22:46:31.251 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:31.247+0000 7f630e591640 1 -- 172.21.15.121:0/2529772978 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f630810eb30 con 0x7f63080fb0a0 2024-08-18T22:46:31.251 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:31.248+0000 7f630e591640 1 -- 172.21.15.121:0/2529772978 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63080f9df0 con 0x7f63080fb0a0 2024-08-18T22:46:31.252 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:31.248+0000 7f6304ff9640 1 -- 172.21.15.121:0/2529772978 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 37) v1 ==== 92205+0+0 (secure 0 0 0) 0x7f62fc009650 con 0x7f63080fb0a0 2024-08-18T22:46:31.252 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:31.249+0000 7f6304ff9640 1 --2- 172.21.15.121:0/2529772978 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f62f006e0b0 0x7f62f0070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:46:31.252 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:31.249+0000 7f6304ff9640 1 -- 172.21.15.121:0/2529772978 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f62fc08da20 con 0x7f63080fb0a0 2024-08-18T22:46:31.252 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:31.249+0000 7f6307fff640 1 --2- 172.21.15.121:0/2529772978 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f62f006e0b0 0x7f62f0070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:46:31.252 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:31.249+0000 7f6307fff640 1 --2- 172.21.15.121:0/2529772978 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f62f006e0b0 0x7f62f0070560 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f62f8000c00 tx=0x7f62f8035040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:46:31.254 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:31.253+0000 7f6304ff9640 1 -- 172.21.15.121:0/2529772978 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f62fc056d50 con 0x7f63080fb0a0 2024-08-18T22:46:31.409 INFO:journalctl@ceph.osd.3.smithi195.stdout:Aug 18 22:46:31 smithi195 podman[77653]: 2024-08-18 22:46:31.025908759 +0000 UTC m=+0.646218996 container remove e93c4805b493fc75ceeab053111739ed60096595cb2c91b36bd1a6f0f5164873 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-3-deactivate, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, ceph=True, RELEASE=squid-de09dd0, io.buildah.version=1.36.0, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731) 2024-08-18T22:46:31.409 INFO:journalctl@ceph.osd.3.smithi195.stdout:Aug 18 22:46:31 smithi195 systemd[1]: ceph-b003123a-5db1-11ef-bccf-c7b262605968@osd.3.service: Deactivated successfully. 2024-08-18T22:46:31.409 INFO:journalctl@ceph.osd.3.smithi195.stdout:Aug 18 22:46:31 smithi195 systemd[1]: Stopped Ceph osd.3 for b003123a-5db1-11ef-bccf-c7b262605968. 2024-08-18T22:46:31.410 INFO:journalctl@ceph.osd.3.smithi195.stdout:Aug 18 22:46:31 smithi195 systemd[1]: ceph-b003123a-5db1-11ef-bccf-c7b262605968@osd.3.service: Consumed 55.231s CPU time. 2024-08-18T22:46:31.410 INFO:journalctl@ceph.osd.3.smithi195.stdout:Aug 18 22:46:31 smithi195 systemd[1]: Starting Ceph osd.3 for b003123a-5db1-11ef-bccf-c7b262605968... 2024-08-18T22:46:31.457 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:31.457+0000 7f630e591640 1 -- 172.21.15.121:0/2529772978 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f630804b4c0 con 0x7f63080fb0a0 2024-08-18T22:46:31.458 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:31.457+0000 7f6304ff9640 1 -- 172.21.15.121:0/2529772978 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 22 v22) v1 ==== 76+0+1942 (secure 0 0 0) 0x7f62fc05a410 con 0x7f63080fb0a0 2024-08-18T22:46:31.458 INFO:teuthology.orchestra.run.smithi121.stdout:e22 2024-08-18T22:46:31.458 INFO:teuthology.orchestra.run.smithi121.stdout:btime 2024-08-18T22:45:32:233419+0000 2024-08-18T22:46:31.459 INFO:teuthology.orchestra.run.smithi121.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-08-18T22:46:31.459 INFO:teuthology.orchestra.run.smithi121.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-08-18T22:46:31.459 INFO:teuthology.orchestra.run.smithi121.stdout:legacy client fscid: 1 2024-08-18T22:46:31.459 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-08-18T22:46:31.459 INFO:teuthology.orchestra.run.smithi121.stdout:Filesystem 'cephfs' (1) 2024-08-18T22:46:31.459 INFO:teuthology.orchestra.run.smithi121.stdout:fs_name cephfs 2024-08-18T22:46:31.459 INFO:teuthology.orchestra.run.smithi121.stdout:epoch 22 2024-08-18T22:46:31.459 INFO:teuthology.orchestra.run.smithi121.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-08-18T22:46:31.459 INFO:teuthology.orchestra.run.smithi121.stdout:created 2024-08-18T22:39:04.054074+0000 2024-08-18T22:46:31.459 INFO:teuthology.orchestra.run.smithi121.stdout:modified 2024-08-18T22:45:31.247467+0000 2024-08-18T22:46:31.459 INFO:teuthology.orchestra.run.smithi121.stdout:tableserver 0 2024-08-18T22:46:31.459 INFO:teuthology.orchestra.run.smithi121.stdout:root 0 2024-08-18T22:46:31.460 INFO:teuthology.orchestra.run.smithi121.stdout:session_timeout 60 2024-08-18T22:46:31.460 INFO:teuthology.orchestra.run.smithi121.stdout:session_autoclose 300 2024-08-18T22:46:31.460 INFO:teuthology.orchestra.run.smithi121.stdout:max_file_size 1099511627776 2024-08-18T22:46:31.460 INFO:teuthology.orchestra.run.smithi121.stdout:max_xattr_size 65536 2024-08-18T22:46:31.460 INFO:teuthology.orchestra.run.smithi121.stdout:required_client_features {} 2024-08-18T22:46:31.460 INFO:teuthology.orchestra.run.smithi121.stdout:last_failure 0 2024-08-18T22:46:31.460 INFO:teuthology.orchestra.run.smithi121.stdout:last_failure_osd_epoch 47 2024-08-18T22:46:31.460 INFO:teuthology.orchestra.run.smithi121.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-08-18T22:46:31.460 INFO:teuthology.orchestra.run.smithi121.stdout:max_mds 2 2024-08-18T22:46:31.460 INFO:teuthology.orchestra.run.smithi121.stdout:in 0,1 2024-08-18T22:46:31.460 INFO:teuthology.orchestra.run.smithi121.stdout:up {0=14474,1=24249} 2024-08-18T22:46:31.460 INFO:teuthology.orchestra.run.smithi121.stdout:failed 2024-08-18T22:46:31.460 INFO:teuthology.orchestra.run.smithi121.stdout:damaged 2024-08-18T22:46:31.460 INFO:teuthology.orchestra.run.smithi121.stdout:stopped 2024-08-18T22:46:31.460 INFO:teuthology.orchestra.run.smithi121.stdout:data_pools [3] 2024-08-18T22:46:31.461 INFO:teuthology.orchestra.run.smithi121.stdout:metadata_pool 2 2024-08-18T22:46:31.461 INFO:teuthology.orchestra.run.smithi121.stdout:inline_data disabled 2024-08-18T22:46:31.461 INFO:teuthology.orchestra.run.smithi121.stdout:balancer 2024-08-18T22:46:31.461 INFO:teuthology.orchestra.run.smithi121.stdout:bal_rank_mask -1 2024-08-18T22:46:31.461 INFO:teuthology.orchestra.run.smithi121.stdout:standby_count_wanted 1 2024-08-18T22:46:31.461 INFO:teuthology.orchestra.run.smithi121.stdout:qdb_cluster leader: 14474 members: 14474,24249 2024-08-18T22:46:31.461 INFO:teuthology.orchestra.run.smithi121.stdout:[mds.cephfs.smithi121.gbickb{0:14474} state up:active seq 83 join_fscid=1 addr [v2:172.21.15.121:6828/2277706406,v1:172.21.15.121:6829/2277706406] compat {c=[1],r=[1],i=[7ff]}] 2024-08-18T22:46:31.461 INFO:teuthology.orchestra.run.smithi121.stdout:[mds.cephfs.smithi195.buqvbr{1:24249} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.195:6824/2414511859,v1:172.21.15.195:6825/2414511859] compat {c=[1],r=[1],i=[7ff]}] 2024-08-18T22:46:31.461 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-08-18T22:46:31.461 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-08-18T22:46:31.461 INFO:teuthology.orchestra.run.smithi121.stdout:Standby daemons: 2024-08-18T22:46:31.461 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-08-18T22:46:31.461 INFO:teuthology.orchestra.run.smithi121.stdout:[mds.cephfs.smithi121.xuzsdg{-1:14490} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.121:6826/91588128,v1:172.21.15.121:6827/91588128] compat {c=[1],r=[1],i=[7ff]}] 2024-08-18T22:46:31.461 INFO:teuthology.orchestra.run.smithi121.stdout:[mds.cephfs.smithi195.nptgyc{-1:24259} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.195:6826/238549847,v1:172.21.15.195:6827/238549847] compat {c=[1],r=[1],i=[7ff]}] 2024-08-18T22:46:31.462 INFO:teuthology.orchestra.run.smithi121.stderr:dumped fsmap epoch 22 2024-08-18T22:46:31.462 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:31.459+0000 7f630e591640 1 -- 172.21.15.121:0/2529772978 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f62f006e0b0 msgr2=0x7f62f0070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:46:31.462 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:31.459+0000 7f630e591640 1 --2- 172.21.15.121:0/2529772978 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f62f006e0b0 0x7f62f0070560 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f62f8000c00 tx=0x7f62f8035040 comp rx=0 tx=0).stop 2024-08-18T22:46:31.462 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:31.459+0000 7f630e591640 1 -- 172.21.15.121:0/2529772978 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f63080fb0a0 msgr2=0x7f630810d410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:46:31.462 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:31.459+0000 7f630e591640 1 --2- 172.21.15.121:0/2529772978 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f63080fb0a0 0x7f630810d410 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f62fc002840 tx=0x7f62fc004570 comp rx=0 tx=0).stop 2024-08-18T22:46:31.462 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:31.459+0000 7f630e591640 1 -- 172.21.15.121:0/2529772978 shutdown_connections 2024-08-18T22:46:31.463 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:31.459+0000 7f630e591640 1 --2- 172.21.15.121:0/2529772978 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f62f006e0b0 0x7f62f0070560 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:46:31.463 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:31.459+0000 7f630e591640 1 --2- 172.21.15.121:0/2529772978 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f63080fb0a0 0x7f630810d410 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:46:31.463 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:31.459+0000 7f630e591640 1 --2- 172.21.15.121:0/2529772978 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f63080fa730 0x7f630810ced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:46:31.463 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:31.459+0000 7f630e591640 1 -- 172.21.15.121:0/2529772978 >> 172.21.15.121:0/2529772978 conn(0x7f63080f6150 msgr2=0x7f63080ffa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:46:31.463 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:31.459+0000 7f630e591640 1 -- 172.21.15.121:0/2529772978 shutdown_connections 2024-08-18T22:46:31.463 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:31.459+0000 7f630e591640 1 -- 172.21.15.121:0/2529772978 wait complete. 2024-08-18T22:46:31.540 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:31.538+0000 7fef5ff7d640 1 -- 172.21.15.121:0/3701444453 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fef580fd940 msgr2=0x7fef580fdd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:46:31.541 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:31.538+0000 7fef5ff7d640 1 --2- 172.21.15.121:0/3701444453 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fef580fd940 0x7fef580fdd50 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fef540048d0 tx=0x7fef54009da0 comp rx=0 tx=0).stop 2024-08-18T22:46:31.541 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:31.538+0000 7fef5ff7d640 1 -- 172.21.15.121:0/3701444453 shutdown_connections 2024-08-18T22:46:31.541 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:31.538+0000 7fef5ff7d640 1 --2- 172.21.15.121:0/3701444453 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fef580fe290 0x7fef580fa3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:46:31.541 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:31.538+0000 7fef5ff7d640 1 --2- 172.21.15.121:0/3701444453 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fef580fd940 0x7fef580fdd50 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:46:31.541 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:31.538+0000 7fef5ff7d640 1 -- 172.21.15.121:0/3701444453 >> 172.21.15.121:0/3701444453 conn(0x7fef580f6140 msgr2=0x7fef580f8570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:46:31.541 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:31.539+0000 7fef5ff7d640 1 -- 172.21.15.121:0/3701444453 shutdown_connections 2024-08-18T22:46:31.541 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:31.539+0000 7fef5ff7d640 1 -- 172.21.15.121:0/3701444453 wait complete. 2024-08-18T22:46:31.541 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:31.539+0000 7fef5ff7d640 1 Processor -- start 2024-08-18T22:46:31.541 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:31.539+0000 7fef5ff7d640 1 -- start start 2024-08-18T22:46:31.541 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:31.539+0000 7fef5ff7d640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fef580fd940 0x7fef5810ce80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:46:31.541 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:31.539+0000 7fef5ff7d640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fef580fe290 0x7fef5810d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:46:31.541 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:31.539+0000 7fef5ff7d640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef5810da10 con 0x7fef580fd940 2024-08-18T22:46:31.541 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:31.539+0000 7fef5ff7d640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef5810e150 con 0x7fef580fe290 2024-08-18T22:46:31.542 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:31.539+0000 7fef5dd19640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fef580fd940 0x7fef5810ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:46:31.542 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:31.539+0000 7fef5dd19640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fef580fd940 0x7fef5810ce80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:40310/0 (socket says 172.21.15.121:40310) 2024-08-18T22:46:31.542 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:31.539+0000 7fef5dd19640 1 -- 172.21.15.121:0/2018699714 learned_addr learned my addr 172.21.15.121:0/2018699714 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-18T22:46:31.542 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:31.539+0000 7fef5d518640 1 --2- 172.21.15.121:0/2018699714 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fef580fe290 0x7fef5810d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:46:31.542 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:31.540+0000 7fef5dd19640 1 -- 172.21.15.121:0/2018699714 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fef580fe290 msgr2=0x7fef5810d3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:46:31.542 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:31.540+0000 7fef5dd19640 1 --2- 172.21.15.121:0/2018699714 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fef580fe290 0x7fef5810d3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:46:31.542 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:31.540+0000 7fef5dd19640 1 -- 172.21.15.121:0/2018699714 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef54005040 con 0x7fef580fd940 2024-08-18T22:46:31.543 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:31.540+0000 7fef5dd19640 1 --2- 172.21.15.121:0/2018699714 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fef580fd940 0x7fef5810ce80 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fef54003080 tx=0x7fef54009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:46:31.543 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:31.540+0000 7fef4e7fc640 1 -- 172.21.15.121:0/2018699714 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fef54038070 con 0x7fef580fd940 2024-08-18T22:46:31.543 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:31.540+0000 7fef4e7fc640 1 -- 172.21.15.121:0/2018699714 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fef54009800 con 0x7fef580fd940 2024-08-18T22:46:31.543 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:31.540+0000 7fef5ff7d640 1 -- 172.21.15.121:0/2018699714 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef5810e380 con 0x7fef580fd940 2024-08-18T22:46:31.543 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:31.540+0000 7fef5ff7d640 1 -- 172.21.15.121:0/2018699714 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef5810e8c0 con 0x7fef580fd940 2024-08-18T22:46:31.543 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:31.540+0000 7fef4e7fc640 1 -- 172.21.15.121:0/2018699714 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fef54033660 con 0x7fef580fd940 2024-08-18T22:46:31.544 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:31.541+0000 7fef5ff7d640 1 -- 172.21.15.121:0/2018699714 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef3c005240 con 0x7fef580fd940 2024-08-18T22:46:31.544 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:31.542+0000 7fef4e7fc640 1 -- 172.21.15.121:0/2018699714 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 37) v1 ==== 92205+0+0 (secure 0 0 0) 0x7fef54030020 con 0x7fef580fd940 2024-08-18T22:46:31.544 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:31.542+0000 7fef4e7fc640 1 --2- 172.21.15.121:0/2018699714 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7fef4406e0b0 0x7fef44070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:46:31.544 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:31.542+0000 7fef4e7fc640 1 -- 172.21.15.121:0/2018699714 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6496+0+0 (secure 0 0 0) 0x7fef540adc40 con 0x7fef580fd940 2024-08-18T22:46:31.544 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:31.542+0000 7fef5d518640 1 --2- 172.21.15.121:0/2018699714 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7fef4406e0b0 0x7fef44070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:46:31.544 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:31.543+0000 7fef5d518640 1 --2- 172.21.15.121:0/2018699714 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7fef4406e0b0 0x7fef44070560 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fef48007fd0 tx=0x7fef48009040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:46:31.548 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:31.547+0000 7fef4e7fc640 1 -- 172.21.15.121:0/2018699714 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7fef540b3020 con 0x7fef580fd940 2024-08-18T22:46:31.732 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:31.731+0000 7fef5ff7d640 1 -- 172.21.15.121:0/2018699714 --> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fef3c000bf0 con 0x7fef4406e0b0 2024-08-18T22:46:31.733 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:31.732+0000 7fef4e7fc640 1 -- 172.21.15.121:0/2018699714 <== mgr.34102 v2:172.21.15.121:6800/3037387239 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7fef3c000bf0 con 0x7fef4406e0b0 2024-08-18T22:46:31.733 INFO:teuthology.orchestra.run.smithi121.stdout:{ 2024-08-18T22:46:31.733 INFO:teuthology.orchestra.run.smithi121.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9", 2024-08-18T22:46:31.734 INFO:teuthology.orchestra.run.smithi121.stdout: "in_progress": true, 2024-08-18T22:46:31.734 INFO:teuthology.orchestra.run.smithi121.stdout: "which": "Upgrading all daemon types on all hosts", 2024-08-18T22:46:31.734 INFO:teuthology.orchestra.run.smithi121.stdout: "services_complete": [ 2024-08-18T22:46:31.734 INFO:teuthology.orchestra.run.smithi121.stdout: "mgr", 2024-08-18T22:46:31.734 INFO:teuthology.orchestra.run.smithi121.stdout: "mon", 2024-08-18T22:46:31.734 INFO:teuthology.orchestra.run.smithi121.stdout: "crash" 2024-08-18T22:46:31.734 INFO:teuthology.orchestra.run.smithi121.stdout: ], 2024-08-18T22:46:31.734 INFO:teuthology.orchestra.run.smithi121.stdout: "progress": "9/21 daemons upgraded", 2024-08-18T22:46:31.734 INFO:teuthology.orchestra.run.smithi121.stdout: "message": "Currently upgrading osd daemons", 2024-08-18T22:46:31.734 INFO:teuthology.orchestra.run.smithi121.stdout: "is_paused": false 2024-08-18T22:46:31.734 INFO:teuthology.orchestra.run.smithi121.stdout:} 2024-08-18T22:46:31.735 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:31.734+0000 7fef5ff7d640 1 -- 172.21.15.121:0/2018699714 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7fef4406e0b0 msgr2=0x7fef44070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:46:31.735 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:31.734+0000 7fef5ff7d640 1 --2- 172.21.15.121:0/2018699714 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7fef4406e0b0 0x7fef44070560 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fef48007fd0 tx=0x7fef48009040 comp rx=0 tx=0).stop 2024-08-18T22:46:31.735 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:31.734+0000 7fef5ff7d640 1 -- 172.21.15.121:0/2018699714 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fef580fd940 msgr2=0x7fef5810ce80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:46:31.736 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:31.734+0000 7fef5ff7d640 1 --2- 172.21.15.121:0/2018699714 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fef580fd940 0x7fef5810ce80 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fef54003080 tx=0x7fef54009da0 comp rx=0 tx=0).stop 2024-08-18T22:46:31.736 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:31.734+0000 7fef5ff7d640 1 -- 172.21.15.121:0/2018699714 shutdown_connections 2024-08-18T22:46:31.736 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:31.734+0000 7fef5ff7d640 1 --2- 172.21.15.121:0/2018699714 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7fef4406e0b0 0x7fef44070560 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:46:31.736 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:31.734+0000 7fef5ff7d640 1 --2- 172.21.15.121:0/2018699714 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fef580fe290 0x7fef5810d3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:46:31.736 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:31.734+0000 7fef5ff7d640 1 --2- 172.21.15.121:0/2018699714 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fef580fd940 0x7fef5810ce80 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:46:31.736 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:31.734+0000 7fef5ff7d640 1 -- 172.21.15.121:0/2018699714 >> 172.21.15.121:0/2018699714 conn(0x7fef580f6140 msgr2=0x7fef580f78e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:46:31.736 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:31.734+0000 7fef5ff7d640 1 -- 172.21.15.121:0/2018699714 shutdown_connections 2024-08-18T22:46:31.736 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:31.735+0000 7fef5ff7d640 1 -- 172.21.15.121:0/2018699714 wait complete. 2024-08-18T22:46:31.747 INFO:journalctl@ceph.osd.3.smithi195.stdout:Aug 18 22:46:31 smithi195 podman[77753]: 2024-08-18 22:46:31.379825379 +0000 UTC m=+0.017681580 image pull ea7a5189f30bad3aca9524788e2965d2368d7ce786df09d4edcd8c3edf9cefba quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9 2024-08-18T22:46:31.747 INFO:journalctl@ceph.osd.3.smithi195.stdout:Aug 18 22:46:31 smithi195 podman[77753]: 2024-08-18 22:46:31.493802198 +0000 UTC m=+0.131658437 container create eceedc0c2e3595485ba3ccb3fc1b864c63eda4a30d37d0f19d8497329cd21167 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-3-activate, RELEASE=squid-de09dd0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.license=GPLv2, io.buildah.version=1.36.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-08-18T22:46:31.747 INFO:journalctl@ceph.osd.3.smithi195.stdout:Aug 18 22:46:31 smithi195 podman[77753]: 2024-08-18 22:46:31.746775678 +0000 UTC m=+0.384631883 container init eceedc0c2e3595485ba3ccb3fc1b864c63eda4a30d37d0f19d8497329cd21167 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-3-activate, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, RELEASE=squid-de09dd0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.36.0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2) 2024-08-18T22:46:31.747 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:46:31 smithi195 ceph-mon[68841]: from='client.34284 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-18T22:46:31.747 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:46:31 smithi195 ceph-mon[68841]: pgmap v106: 65 pgs: 1 active+undersized, 18 peering, 5 stale+active+clean, 3 active+undersized+degraded, 38 active+clean; 2.0 GiB data, 6.8 GiB used, 530 GiB / 536 GiB avail; 681/34143 objects degraded (1.995%) 2024-08-18T22:46:31.747 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:46:31 smithi195 ceph-mon[68841]: from='client.34288 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-18T22:46:31.747 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:46:31 smithi195 ceph-mon[68841]: Health check failed: Reduced data availability: 10 pgs peering (PG_AVAILABILITY) 2024-08-18T22:46:31.747 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:46:31 smithi195 ceph-mon[68841]: Health check failed: Degraded data redundancy: 681/34143 objects degraded (1.995%), 3 pgs degraded (PG_DEGRADED) 2024-08-18T22:46:31.747 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:46:31 smithi195 ceph-mon[68841]: from='client.? 172.21.15.121:0/912876429' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-08-18T22:46:31.747 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:46:31 smithi195 ceph-mon[68841]: from='client.? 172.21.15.121:0/2529772978' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-08-18T22:46:31.814 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:31.813+0000 7fc175a25640 1 -- 172.21.15.121:0/1157883606 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc1700fd590 msgr2=0x7fc1700fda00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:46:31.814 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:31.813+0000 7fc175a25640 1 --2- 172.21.15.121:0/1157883606 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc1700fd590 0x7fc1700fda00 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fc1600048d0 tx=0x7fc160009da0 comp rx=0 tx=0).stop 2024-08-18T22:46:31.814 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:31.813+0000 7fc175a25640 1 -- 172.21.15.121:0/1157883606 shutdown_connections 2024-08-18T22:46:31.814 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:31.813+0000 7fc175a25640 1 --2- 172.21.15.121:0/1157883606 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc1700fd590 0x7fc1700fda00 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:46:31.814 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:31.813+0000 7fc175a25640 1 --2- 172.21.15.121:0/1157883606 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc1700fc2c0 0x7fc1700fc6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:46:31.815 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:31.813+0000 7fc175a25640 1 -- 172.21.15.121:0/1157883606 >> 172.21.15.121:0/1157883606 conn(0x7fc1700f7a80 msgr2=0x7fc1700f9eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:46:31.815 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:31.813+0000 7fc175a25640 1 -- 172.21.15.121:0/1157883606 shutdown_connections 2024-08-18T22:46:31.815 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:46:31 smithi121 ceph-mon[81053]: from='client.34284 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-18T22:46:31.815 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:46:31 smithi121 ceph-mon[81053]: pgmap v106: 65 pgs: 1 active+undersized, 18 peering, 5 stale+active+clean, 3 active+undersized+degraded, 38 active+clean; 2.0 GiB data, 6.8 GiB used, 530 GiB / 536 GiB avail; 681/34143 objects degraded (1.995%) 2024-08-18T22:46:31.815 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:46:31 smithi121 ceph-mon[81053]: from='client.34288 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-18T22:46:31.815 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:46:31 smithi121 ceph-mon[81053]: Health check failed: Reduced data availability: 10 pgs peering (PG_AVAILABILITY) 2024-08-18T22:46:31.815 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:46:31 smithi121 ceph-mon[81053]: Health check failed: Degraded data redundancy: 681/34143 objects degraded (1.995%), 3 pgs degraded (PG_DEGRADED) 2024-08-18T22:46:31.815 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:46:31 smithi121 ceph-mon[81053]: from='client.? 172.21.15.121:0/912876429' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-08-18T22:46:31.815 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:46:31 smithi121 ceph-mon[81053]: from='client.? 172.21.15.121:0/2529772978' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-08-18T22:46:31.817 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:31.813+0000 7fc175a25640 1 -- 172.21.15.121:0/1157883606 wait complete. 2024-08-18T22:46:31.817 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:31.814+0000 7fc175a25640 1 Processor -- start 2024-08-18T22:46:31.817 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:31.814+0000 7fc175a25640 1 -- start start 2024-08-18T22:46:31.817 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:31.814+0000 7fc175a25640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc1700fc2c0 0x7fc17010ce60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:46:31.817 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:31.814+0000 7fc175a25640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc1700fd590 0x7fc17010d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:46:31.817 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:31.814+0000 7fc175a25640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc17010d9f0 con 0x7fc1700fc2c0 2024-08-18T22:46:31.817 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:31.814+0000 7fc175a25640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc17010e130 con 0x7fc1700fd590 2024-08-18T22:46:31.817 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:31.814+0000 7fc16effd640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc1700fc2c0 0x7fc17010ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:46:31.817 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:31.814+0000 7fc16effd640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc1700fc2c0 0x7fc17010ce60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:40334/0 (socket says 172.21.15.121:40334) 2024-08-18T22:46:31.818 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:31.814+0000 7fc16e7fc640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc1700fd590 0x7fc17010d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:46:31.818 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:31.814+0000 7fc16effd640 1 -- 172.21.15.121:0/1904258915 learned_addr learned my addr 172.21.15.121:0/1904258915 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-18T22:46:31.818 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:31.815+0000 7fc16e7fc640 1 -- 172.21.15.121:0/1904258915 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc1700fc2c0 msgr2=0x7fc17010ce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:46:31.818 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:31.815+0000 7fc16e7fc640 1 --2- 172.21.15.121:0/1904258915 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc1700fc2c0 0x7fc17010ce60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:46:31.818 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:31.815+0000 7fc16e7fc640 1 -- 172.21.15.121:0/1904258915 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc160005040 con 0x7fc1700fd590 2024-08-18T22:46:31.818 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:31.815+0000 7fc16e7fc640 1 --2- 172.21.15.121:0/1904258915 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc1700fd590 0x7fc17010d3a0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fc1600043d0 tx=0x7fc160009da0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:46:31.818 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:31.815+0000 7fc1577fe640 1 -- 172.21.15.121:0/1904258915 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc160038070 con 0x7fc1700fd590 2024-08-18T22:46:31.818 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:31.815+0000 7fc1577fe640 1 -- 172.21.15.121:0/1904258915 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fc16002ae90 con 0x7fc1700fd590 2024-08-18T22:46:31.818 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:31.815+0000 7fc175a25640 1 -- 172.21.15.121:0/1904258915 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc17010e360 con 0x7fc1700fd590 2024-08-18T22:46:31.818 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:31.815+0000 7fc1577fe640 1 -- 172.21.15.121:0/1904258915 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc160033660 con 0x7fc1700fd590 2024-08-18T22:46:31.818 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:31.815+0000 7fc175a25640 1 -- 172.21.15.121:0/1904258915 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc17010e880 con 0x7fc1700fd590 2024-08-18T22:46:31.819 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:31.817+0000 7fc175a25640 1 -- 172.21.15.121:0/1904258915 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1700fb720 con 0x7fc1700fd590 2024-08-18T22:46:31.819 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:31.817+0000 7fc1577fe640 1 -- 172.21.15.121:0/1904258915 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 37) v1 ==== 92205+0+0 (secure 0 0 0) 0x7fc160030020 con 0x7fc1700fd590 2024-08-18T22:46:31.819 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:31.817+0000 7fc1577fe640 1 --2- 172.21.15.121:0/1904258915 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7fc1580724c0 0x7fc158074970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:46:31.819 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:31.817+0000 7fc1577fe640 1 -- 172.21.15.121:0/1904258915 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6496+0+0 (secure 0 0 0) 0x7fc1600adc30 con 0x7fc1700fd590 2024-08-18T22:46:31.819 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:31.817+0000 7fc16effd640 1 --2- 172.21.15.121:0/1904258915 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7fc1580724c0 0x7fc158074970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:46:31.819 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:31.818+0000 7fc16effd640 1 --2- 172.21.15.121:0/1904258915 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7fc1580724c0 0x7fc158074970 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fc17010cbf0 tx=0x7fc16400b040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:46:31.822 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:31.822+0000 7fc1577fe640 1 -- 172.21.15.121:0/1904258915 <== mon.1 v2:172.21.15.195:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7fc160077090 con 0x7fc1700fd590 2024-08-18T22:46:32.015 INFO:journalctl@ceph.osd.3.smithi195.stdout:Aug 18 22:46:31 smithi195 podman[77753]: 2024-08-18 22:46:31.750650099 +0000 UTC m=+0.388506297 container start eceedc0c2e3595485ba3ccb3fc1b864c63eda4a30d37d0f19d8497329cd21167 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-3-activate, GIT_CLEAN=True, org.label-schema.license=GPLv2, RELEASE=squid-de09dd0, io.buildah.version=1.36.0, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0) 2024-08-18T22:46:32.016 INFO:journalctl@ceph.osd.3.smithi195.stdout:Aug 18 22:46:31 smithi195 podman[77753]: 2024-08-18 22:46:31.829873543 +0000 UTC m=+0.467729759 container attach eceedc0c2e3595485ba3ccb3fc1b864c63eda4a30d37d0f19d8497329cd21167 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-3-activate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, ceph=True, org.label-schema.vendor=CentOS, io.buildah.version=1.36.0, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-de09dd0, GIT_CLEAN=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux ) 2024-08-18T22:46:32.016 INFO:journalctl@ceph.osd.3.smithi195.stdout:Aug 18 22:46:31 smithi195 ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-3-activate[77768]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-08-18T22:46:32.016 INFO:journalctl@ceph.osd.3.smithi195.stdout:Aug 18 22:46:31 smithi195 bash[77753]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-08-18T22:46:32.016 INFO:journalctl@ceph.osd.3.smithi195.stdout:Aug 18 22:46:31 smithi195 ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-3-activate[77768]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-08-18T22:46:32.016 INFO:journalctl@ceph.osd.3.smithi195.stdout:Aug 18 22:46:31 smithi195 bash[77753]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-08-18T22:46:32.016 INFO:journalctl@ceph.osd.3.smithi195.stdout:Aug 18 22:46:31 smithi195 ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-3-activate[77768]: --> Failed to activate via raw: activate() takes 1 positional argument but 5 were given 2024-08-18T22:46:32.016 INFO:journalctl@ceph.osd.3.smithi195.stdout:Aug 18 22:46:31 smithi195 bash[77753]: --> Failed to activate via raw: activate() takes 1 positional argument but 5 were given 2024-08-18T22:46:32.016 INFO:journalctl@ceph.osd.3.smithi195.stdout:Aug 18 22:46:31 smithi195 ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-3-activate[77768]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-08-18T22:46:32.016 INFO:journalctl@ceph.osd.3.smithi195.stdout:Aug 18 22:46:31 smithi195 bash[77753]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-08-18T22:46:32.016 INFO:journalctl@ceph.osd.3.smithi195.stdout:Aug 18 22:46:31 smithi195 ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-3-activate[77768]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-08-18T22:46:32.016 INFO:journalctl@ceph.osd.3.smithi195.stdout:Aug 18 22:46:31 smithi195 bash[77753]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-08-18T22:46:32.016 INFO:journalctl@ceph.osd.3.smithi195.stdout:Aug 18 22:46:31 smithi195 ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-3-activate[77768]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-08-18T22:46:32.017 INFO:journalctl@ceph.osd.3.smithi195.stdout:Aug 18 22:46:31 smithi195 bash[77753]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-08-18T22:46:32.017 INFO:journalctl@ceph.osd.3.smithi195.stdout:Aug 18 22:46:31 smithi195 ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-3-activate[77768]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_4 --path /var/lib/ceph/osd/ceph-3 --no-mon-config 2024-08-18T22:46:32.017 INFO:journalctl@ceph.osd.3.smithi195.stdout:Aug 18 22:46:31 smithi195 bash[77753]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_4 --path /var/lib/ceph/osd/ceph-3 --no-mon-config 2024-08-18T22:46:32.017 INFO:journalctl@ceph.osd.3.smithi195.stdout:Aug 18 22:46:32 smithi195 ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-3-activate[77768]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3/block 2024-08-18T22:46:32.017 INFO:journalctl@ceph.osd.3.smithi195.stdout:Aug 18 22:46:32 smithi195 bash[77753]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3/block 2024-08-18T22:46:32.051 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:32.050+0000 7fc175a25640 1 -- 172.21.15.121:0/1904258915 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fc17004b4c0 con 0x7fc1700fd590 2024-08-18T22:46:32.052 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:32.051+0000 7fc1577fe640 1 -- 172.21.15.121:0/1904258915 <== mon.1 v2:172.21.15.195:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+1488 (secure 0 0 0) 0x7fc16007a750 con 0x7fc1700fd590 2024-08-18T22:46:32.052 INFO:teuthology.orchestra.run.smithi121.stdout:HEALTH_WARN 1 MDSs report slow requests; 1 osds down; Reduced data availability: 10 pgs peering; Degraded data redundancy: 681/34143 objects degraded (1.995%), 3 pgs degraded 2024-08-18T22:46:32.052 INFO:teuthology.orchestra.run.smithi121.stdout:[WRN] MDS_SLOW_REQUEST: 1 MDSs report slow requests 2024-08-18T22:46:32.052 INFO:teuthology.orchestra.run.smithi121.stdout: mds.cephfs.smithi121.gbickb(mds.0): 3 slow requests are blocked > 180 secs 2024-08-18T22:46:32.052 INFO:teuthology.orchestra.run.smithi121.stdout:[WRN] OSD_DOWN: 1 osds down 2024-08-18T22:46:32.052 INFO:teuthology.orchestra.run.smithi121.stdout: osd.3 (root=default,host=smithi195) is down 2024-08-18T22:46:32.052 INFO:teuthology.orchestra.run.smithi121.stdout:[WRN] PG_AVAILABILITY: Reduced data availability: 10 pgs peering 2024-08-18T22:46:32.052 INFO:teuthology.orchestra.run.smithi121.stdout: pg 2.7 is stuck peering for 7m, current state peering, last acting [4,2] 2024-08-18T22:46:32.053 INFO:teuthology.orchestra.run.smithi121.stdout: pg 2.8 is stuck peering for 4m, current state peering, last acting [5,0] 2024-08-18T22:46:32.053 INFO:teuthology.orchestra.run.smithi121.stdout: pg 2.b is stuck peering for 81s, current state peering, last acting [4,5] 2024-08-18T22:46:32.053 INFO:teuthology.orchestra.run.smithi121.stdout: pg 2.14 is stuck peering for 91s, current state peering, last acting [4,5] 2024-08-18T22:46:32.053 INFO:teuthology.orchestra.run.smithi121.stdout: pg 2.1a is stuck peering for 3m, current state peering, last acting [4,5] 2024-08-18T22:46:32.053 INFO:teuthology.orchestra.run.smithi121.stdout: pg 2.1d is stuck peering for 3m, current state peering, last acting [5,0] 2024-08-18T22:46:32.053 INFO:teuthology.orchestra.run.smithi121.stdout: pg 3.a is stuck peering for 3m, current state peering, last acting [4,1] 2024-08-18T22:46:32.053 INFO:teuthology.orchestra.run.smithi121.stdout: pg 3.11 is stuck peering for 3m, current state peering, last acting [4,0] 2024-08-18T22:46:32.053 INFO:teuthology.orchestra.run.smithi121.stdout: pg 3.13 is stuck peering for 3m, current state peering, last acting [5,2] 2024-08-18T22:46:32.053 INFO:teuthology.orchestra.run.smithi121.stdout: pg 3.14 is stuck peering for 3m, current state peering, last acting [4,5] 2024-08-18T22:46:32.053 INFO:teuthology.orchestra.run.smithi121.stdout:[WRN] PG_DEGRADED: Degraded data redundancy: 681/34143 objects degraded (1.995%), 3 pgs degraded 2024-08-18T22:46:32.053 INFO:teuthology.orchestra.run.smithi121.stdout: pg 2.e is active+undersized+degraded, acting [2,0] 2024-08-18T22:46:32.054 INFO:teuthology.orchestra.run.smithi121.stdout: pg 3.d is active+undersized+degraded, acting [2,4] 2024-08-18T22:46:32.054 INFO:teuthology.orchestra.run.smithi121.stdout: pg 3.1e is active+undersized+degraded, acting [2,1] 2024-08-18T22:46:32.054 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:32.053+0000 7fc175a25640 1 -- 172.21.15.121:0/1904258915 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7fc1580724c0 msgr2=0x7fc158074970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:46:32.054 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:32.053+0000 7fc175a25640 1 --2- 172.21.15.121:0/1904258915 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7fc1580724c0 0x7fc158074970 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fc17010cbf0 tx=0x7fc16400b040 comp rx=0 tx=0).stop 2024-08-18T22:46:32.054 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:32.053+0000 7fc175a25640 1 -- 172.21.15.121:0/1904258915 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc1700fd590 msgr2=0x7fc17010d3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:46:32.054 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:32.053+0000 7fc175a25640 1 --2- 172.21.15.121:0/1904258915 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc1700fd590 0x7fc17010d3a0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fc1600043d0 tx=0x7fc160009da0 comp rx=0 tx=0).stop 2024-08-18T22:46:32.054 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:32.053+0000 7fc175a25640 1 -- 172.21.15.121:0/1904258915 shutdown_connections 2024-08-18T22:46:32.055 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:32.053+0000 7fc175a25640 1 --2- 172.21.15.121:0/1904258915 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7fc1580724c0 0x7fc158074970 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:46:32.055 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:32.053+0000 7fc175a25640 1 --2- 172.21.15.121:0/1904258915 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc1700fd590 0x7fc17010d3a0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:46:32.055 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:32.053+0000 7fc175a25640 1 --2- 172.21.15.121:0/1904258915 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc1700fc2c0 0x7fc17010ce60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:46:32.055 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:32.053+0000 7fc175a25640 1 -- 172.21.15.121:0/1904258915 >> 172.21.15.121:0/1904258915 conn(0x7fc1700f7a80 msgr2=0x7fc1700f9250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:46:32.055 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:32.053+0000 7fc175a25640 1 -- 172.21.15.121:0/1904258915 shutdown_connections 2024-08-18T22:46:32.055 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:46:32.053+0000 7fc175a25640 1 -- 172.21.15.121:0/1904258915 wait complete. 2024-08-18T22:46:32.325 INFO:journalctl@ceph.osd.3.smithi195.stdout:Aug 18 22:46:32 smithi195 ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-3-activate[77768]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-3/block 2024-08-18T22:46:32.325 INFO:journalctl@ceph.osd.3.smithi195.stdout:Aug 18 22:46:32 smithi195 bash[77753]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-3/block 2024-08-18T22:46:32.326 INFO:journalctl@ceph.osd.3.smithi195.stdout:Aug 18 22:46:32 smithi195 ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-3-activate[77768]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-08-18T22:46:32.326 INFO:journalctl@ceph.osd.3.smithi195.stdout:Aug 18 22:46:32 smithi195 bash[77753]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-08-18T22:46:32.326 INFO:journalctl@ceph.osd.3.smithi195.stdout:Aug 18 22:46:32 smithi195 ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-3-activate[77768]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-08-18T22:46:32.326 INFO:journalctl@ceph.osd.3.smithi195.stdout:Aug 18 22:46:32 smithi195 bash[77753]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-08-18T22:46:32.326 INFO:journalctl@ceph.osd.3.smithi195.stdout:Aug 18 22:46:32 smithi195 ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-3-activate[77768]: --> ceph-volume lvm activate successful for osd ID: 3 2024-08-18T22:46:32.327 INFO:journalctl@ceph.osd.3.smithi195.stdout:Aug 18 22:46:32 smithi195 bash[77753]: --> ceph-volume lvm activate successful for osd ID: 3 2024-08-18T22:46:32.327 INFO:journalctl@ceph.osd.3.smithi195.stdout:Aug 18 22:46:32 smithi195 podman[77753]: 2024-08-18 22:46:32.042008001 +0000 UTC m=+0.679864199 container died eceedc0c2e3595485ba3ccb3fc1b864c63eda4a30d37d0f19d8497329cd21167 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-3-activate, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.license=GPLv2, RELEASE=squid-de09dd0, org.label-schema.vendor=CentOS, io.buildah.version=1.36.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image) 2024-08-18T22:46:32.635 INFO:journalctl@ceph.osd.3.smithi195.stdout:Aug 18 22:46:32 smithi195 podman[77874]: 2024-08-18 22:46:32.558494469 +0000 UTC m=+0.506702618 container remove eceedc0c2e3595485ba3ccb3fc1b864c63eda4a30d37d0f19d8497329cd21167 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-3-activate, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.36.0, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240731, RELEASE=squid-de09dd0) 2024-08-18T22:46:32.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:46:32 smithi195 ceph-mon[68841]: from='client.34292 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-18T22:46:32.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:46:32 smithi195 ceph-mon[68841]: from='client.34304 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-18T22:46:32.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:46:32 smithi195 ceph-mon[68841]: from='client.? 172.21.15.121:0/1904258915' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-08-18T22:46:32.909 INFO:journalctl@ceph.osd.3.smithi195.stdout:Aug 18 22:46:32 smithi195 podman[77935]: 2024-08-18 22:46:32.67697681 +0000 UTC m=+0.017542171 image pull ea7a5189f30bad3aca9524788e2965d2368d7ce786df09d4edcd8c3edf9cefba quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9 2024-08-18T22:46:32.909 INFO:journalctl@ceph.osd.3.smithi195.stdout:Aug 18 22:46:32 smithi195 podman[77935]: 2024-08-18 22:46:32.7929309 +0000 UTC m=+0.133496305 container create 72c2860c0e9f84f06c39629eeb7b304d2170938fdc53a044b43dbb7b3ba20f4c (image=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-3, RELEASE=squid-de09dd0, io.buildah.version=1.36.0, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_BRANCH=HEAD) 2024-08-18T22:46:33.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:46:32 smithi121 ceph-mon[81053]: from='client.34292 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-18T22:46:33.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:46:32 smithi121 ceph-mon[81053]: from='client.34304 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-18T22:46:33.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:46:32 smithi121 ceph-mon[81053]: from='client.? 172.21.15.121:0/1904258915' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-08-18T22:46:33.409 INFO:journalctl@ceph.osd.3.smithi195.stdout:Aug 18 22:46:33 smithi195 podman[77935]: 2024-08-18 22:46:33.011916604 +0000 UTC m=+0.352481979 container init 72c2860c0e9f84f06c39629eeb7b304d2170938fdc53a044b43dbb7b3ba20f4c (image=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-3, ceph=True, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=squid-de09dd0, org.label-schema.license=GPLv2, io.buildah.version=1.36.0, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-08-18T22:46:33.409 INFO:journalctl@ceph.osd.3.smithi195.stdout:Aug 18 22:46:33 smithi195 podman[77935]: 2024-08-18 22:46:33.01507187 +0000 UTC m=+0.355637229 container start 72c2860c0e9f84f06c39629eeb7b304d2170938fdc53a044b43dbb7b3ba20f4c (image=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-3, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.36.0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_CLEAN=True, RELEASE=squid-de09dd0, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.build-date=20240731) 2024-08-18T22:46:33.409 INFO:journalctl@ceph.osd.3.smithi195.stdout:Aug 18 22:46:33 smithi195 ceph-osd[77953]: -- 172.21.15.195:0/178460076 <== mon.1 v2:172.21.15.195:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x56368943c1e0 con 0x563689426000 2024-08-18T22:46:33.409 INFO:journalctl@ceph.osd.3.smithi195.stdout:Aug 18 22:46:33 smithi195 bash[77935]: 72c2860c0e9f84f06c39629eeb7b304d2170938fdc53a044b43dbb7b3ba20f4c 2024-08-18T22:46:33.409 INFO:journalctl@ceph.osd.3.smithi195.stdout:Aug 18 22:46:33 smithi195 systemd[1]: Started Ceph osd.3 for b003123a-5db1-11ef-bccf-c7b262605968. 2024-08-18T22:46:33.834 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:46:33 smithi121 ceph-mon[81053]: pgmap v107: 65 pgs: 1 active+undersized, 18 peering, 19 active+undersized+degraded, 27 active+clean; 2.0 GiB data, 6.8 GiB used, 530 GiB / 536 GiB avail; 3072/34143 objects degraded (8.997%) 2024-08-18T22:46:33.834 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:46:33 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:46:33.834 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:46:33 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:46:33.834 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:46:33 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-18T22:46:33.888 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:46:33 smithi195 ceph-mon[68841]: pgmap v107: 65 pgs: 1 active+undersized, 18 peering, 19 active+undersized+degraded, 27 active+clean; 2.0 GiB data, 6.8 GiB used, 530 GiB / 536 GiB avail; 3072/34143 objects degraded (8.997%) 2024-08-18T22:46:33.888 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:46:33 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:46:33.889 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:46:33 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:46:33.889 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:46:33 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-18T22:46:33.889 INFO:journalctl@ceph.osd.3.smithi195.stdout:Aug 18 22:46:33 smithi195 ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-3[77949]: 2024-08-18T22:46:33.563+0000 7f77e4c37640 -1 Falling back to public interface 2024-08-18T22:46:34.833 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:46:34 smithi121 ceph-mon[81053]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 10 pgs peering) 2024-08-18T22:46:34.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:46:34 smithi195 ceph-mon[68841]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 10 pgs peering) 2024-08-18T22:46:36.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:46:35 smithi121 ceph-mon[81053]: pgmap v108: 65 pgs: 1 active+undersized, 37 active+undersized+degraded, 27 active+clean; 2.0 GiB data, 6.8 GiB used, 530 GiB / 536 GiB avail; 6364/34143 objects degraded (18.639%) 2024-08-18T22:46:36.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:46:35 smithi121 ceph-mon[81053]: 3 slow requests, 0 included below; oldest blocked for > 306.869430 secs 2024-08-18T22:46:36.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:46:35 smithi195 ceph-mon[68841]: pgmap v108: 65 pgs: 1 active+undersized, 37 active+undersized+degraded, 27 active+clean; 2.0 GiB data, 6.8 GiB used, 530 GiB / 536 GiB avail; 6364/34143 objects degraded (18.639%) 2024-08-18T22:46:36.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:46:35 smithi195 ceph-mon[68841]: 3 slow requests, 0 included below; oldest blocked for > 306.869430 secs 2024-08-18T22:46:37.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:46:36 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:46:37.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:46:36 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:46:37.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:46:36 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:46:37.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:46:36 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:46:37.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:46:36 smithi121 ceph-mon[81053]: pgmap v109: 65 pgs: 1 active+undersized, 37 active+undersized+degraded, 27 active+clean; 2.0 GiB data, 6.8 GiB used, 530 GiB / 536 GiB avail; 6364/34143 objects degraded (18.639%) 2024-08-18T22:46:37.085 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:46:36 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:46:37.085 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:46:36 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:46:37.085 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:46:36 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:46:37.085 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:46:36 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:46:37.086 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:46:36 smithi195 ceph-mon[68841]: pgmap v109: 65 pgs: 1 active+undersized, 37 active+undersized+degraded, 27 active+clean; 2.0 GiB data, 6.8 GiB used, 530 GiB / 536 GiB avail; 6364/34143 objects degraded (18.639%) 2024-08-18T22:46:38.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:46:37 smithi121 ceph-mon[81053]: Health check update: Degraded data redundancy: 6364/34143 objects degraded (18.639%), 37 pgs degraded (PG_DEGRADED) 2024-08-18T22:46:38.100 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:46:37 smithi195 ceph-mon[68841]: Health check update: Degraded data redundancy: 6364/34143 objects degraded (18.639%), 37 pgs degraded (PG_DEGRADED) 2024-08-18T22:46:38.655 INFO:journalctl@ceph.osd.3.smithi195.stdout:Aug 18 22:46:38 smithi195 ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-3[77949]: 2024-08-18T22:46:38.538+0000 7f77e4c37640 -1 osd.3 65 log_to_monitors true 2024-08-18T22:46:38.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:46:38 smithi195 ceph-mon[68841]: from='osd.3 [v2:172.21.15.195:6800/3464645521,v1:172.21.15.195:6801/3464645521]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-08-18T22:46:38.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:46:38 smithi195 ceph-mon[68841]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-08-18T22:46:38.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:46:38 smithi195 ceph-mon[68841]: pgmap v110: 65 pgs: 1 active+undersized, 37 active+undersized+degraded, 27 active+clean; 2.0 GiB data, 6.8 GiB used, 530 GiB / 536 GiB avail; 6364/34143 objects degraded (18.639%) 2024-08-18T22:46:38.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:46:38 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:46:38.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:46:38 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-18T22:46:39.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:46:38 smithi121 ceph-mon[81053]: from='osd.3 [v2:172.21.15.195:6800/3464645521,v1:172.21.15.195:6801/3464645521]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-08-18T22:46:39.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:46:38 smithi121 ceph-mon[81053]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-08-18T22:46:39.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:46:38 smithi121 ceph-mon[81053]: pgmap v110: 65 pgs: 1 active+undersized, 37 active+undersized+degraded, 27 active+clean; 2.0 GiB data, 6.8 GiB used, 530 GiB / 536 GiB avail; 6364/34143 objects degraded (18.639%) 2024-08-18T22:46:39.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:46:38 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:46:39.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:46:38 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-18T22:46:39.713 INFO:journalctl@ceph.osd.3.smithi195.stdout:Aug 18 22:46:39 smithi195 ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-3[77949]: 2024-08-18T22:46:39.475+0000 7f77d89c9640 -1 osd.3 65 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-18T22:46:40.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:46:39 smithi121 ceph-mon[81053]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-08-18T22:46:40.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:46:39 smithi121 ceph-mon[81053]: from='osd.3 [v2:172.21.15.195:6800/3464645521,v1:172.21.15.195:6801/3464645521]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]: dispatch 2024-08-18T22:46:40.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:46:39 smithi121 ceph-mon[81053]: osdmap e68: 6 total, 5 up, 6 in 2024-08-18T22:46:40.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:46:39 smithi121 ceph-mon[81053]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]: dispatch 2024-08-18T22:46:40.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:46:39 smithi121 ceph-mon[81053]: from='osd.3 ' entity='osd.3' 2024-08-18T22:46:40.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:46:39 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:46:40.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:46:39 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:46:40.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:46:39 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:46:40.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:46:39 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-18T22:46:40.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:46:39 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:46:40.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:46:39 smithi195 ceph-mon[68841]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-08-18T22:46:40.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:46:39 smithi195 ceph-mon[68841]: from='osd.3 [v2:172.21.15.195:6800/3464645521,v1:172.21.15.195:6801/3464645521]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]: dispatch 2024-08-18T22:46:40.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:46:39 smithi195 ceph-mon[68841]: osdmap e68: 6 total, 5 up, 6 in 2024-08-18T22:46:40.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:46:39 smithi195 ceph-mon[68841]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]: dispatch 2024-08-18T22:46:40.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:46:39 smithi195 ceph-mon[68841]: from='osd.3 ' entity='osd.3' 2024-08-18T22:46:40.160 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:46:39 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:46:40.160 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:46:39 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:46:40.160 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:46:39 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:46:40.160 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:46:39 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-18T22:46:40.160 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:46:39 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:46:41.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:46:40 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-18T22:46:41.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:46:40 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "versions"}]: dispatch 2024-08-18T22:46:41.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:46:40 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "versions"}]: dispatch 2024-08-18T22:46:41.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:46:40 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "versions"}]: dispatch 2024-08-18T22:46:41.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:46:40 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-08-18T22:46:41.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:46:40 smithi121 ceph-mon[81053]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-08-18T22:46:41.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:46:40 smithi121 ceph-mon[81053]: Upgrade: unsafe to stop osd(s) at this time (18 PGs are or would become offline) 2024-08-18T22:46:41.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:46:40 smithi121 ceph-mon[81053]: 3 slow requests, 0 included below; oldest blocked for > 311.869522 secs 2024-08-18T22:46:41.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:46:40 smithi121 ceph-mon[81053]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-08-18T22:46:41.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:46:40 smithi121 ceph-mon[81053]: osd.3 [v2:172.21.15.195:6800/3464645521,v1:172.21.15.195:6801/3464645521] boot 2024-08-18T22:46:41.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:46:40 smithi121 ceph-mon[81053]: osdmap e69: 6 total, 6 up, 6 in 2024-08-18T22:46:41.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:46:40 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-08-18T22:46:41.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:46:40 smithi121 ceph-mon[81053]: pgmap v113: 65 pgs: 1 active+undersized, 37 active+undersized+degraded, 27 active+clean; 2.0 GiB data, 6.5 GiB used, 530 GiB / 536 GiB avail; 6364/34143 objects degraded (18.639%) 2024-08-18T22:46:41.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:46:40 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-18T22:46:41.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:46:40 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "versions"}]: dispatch 2024-08-18T22:46:41.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:46:40 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "versions"}]: dispatch 2024-08-18T22:46:41.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:46:40 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "versions"}]: dispatch 2024-08-18T22:46:41.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:46:40 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-08-18T22:46:41.160 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:46:40 smithi195 ceph-mon[68841]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-08-18T22:46:41.160 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:46:40 smithi195 ceph-mon[68841]: Upgrade: unsafe to stop osd(s) at this time (18 PGs are or would become offline) 2024-08-18T22:46:41.160 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:46:40 smithi195 ceph-mon[68841]: 3 slow requests, 0 included below; oldest blocked for > 311.869522 secs 2024-08-18T22:46:41.160 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:46:40 smithi195 ceph-mon[68841]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-08-18T22:46:41.160 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:46:40 smithi195 ceph-mon[68841]: osd.3 [v2:172.21.15.195:6800/3464645521,v1:172.21.15.195:6801/3464645521] boot 2024-08-18T22:46:41.160 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:46:40 smithi195 ceph-mon[68841]: osdmap e69: 6 total, 6 up, 6 in 2024-08-18T22:46:41.160 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:46:40 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-08-18T22:46:41.160 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:46:40 smithi195 ceph-mon[68841]: pgmap v113: 65 pgs: 1 active+undersized, 37 active+undersized+degraded, 27 active+clean; 2.0 GiB data, 6.5 GiB used, 530 GiB / 536 GiB avail; 6364/34143 objects degraded (18.639%) 2024-08-18T22:46:42.583 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:46:42 smithi121 ceph-mon[81053]: osdmap e70: 6 total, 6 up, 6 in 2024-08-18T22:46:42.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:46:42 smithi195 ceph-mon[68841]: osdmap e70: 6 total, 6 up, 6 in 2024-08-18T22:46:43.833 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:46:43 smithi121 ceph-mon[81053]: pgmap v115: 65 pgs: 7 peering, 1 active+undersized, 26 active+undersized+degraded, 31 active+clean; 2.0 GiB data, 6.5 GiB used, 530 GiB / 536 GiB avail; 4304/34143 objects degraded (12.606%) 2024-08-18T22:46:43.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:46:43 smithi195 ceph-mon[68841]: pgmap v115: 65 pgs: 7 peering, 1 active+undersized, 26 active+undersized+degraded, 31 active+clean; 2.0 GiB data, 6.5 GiB used, 530 GiB / 536 GiB avail; 4304/34143 objects degraded (12.606%) 2024-08-18T22:46:44.833 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:46:44 smithi121 ceph-mon[81053]: Health check update: Degraded data redundancy: 4304/34143 objects degraded (12.606%), 26 pgs degraded (PG_DEGRADED) 2024-08-18T22:46:44.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:46:44 smithi195 ceph-mon[68841]: Health check update: Degraded data redundancy: 4304/34143 objects degraded (12.606%), 26 pgs degraded (PG_DEGRADED) 2024-08-18T22:46:45.833 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:46:45 smithi121 ceph-mon[81053]: pgmap v116: 65 pgs: 7 peering, 1 active+undersized, 2 active+undersized+degraded, 55 active+clean; 2.0 GiB data, 6.6 GiB used, 530 GiB / 536 GiB avail; 348/34143 objects degraded (1.019%) 2024-08-18T22:46:45.833 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:46:45 smithi121 ceph-mon[81053]: 3 slow requests, 0 included below; oldest blocked for > 316.869664 secs 2024-08-18T22:46:45.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:46:45 smithi195 ceph-mon[68841]: pgmap v116: 65 pgs: 7 peering, 1 active+undersized, 2 active+undersized+degraded, 55 active+clean; 2.0 GiB data, 6.6 GiB used, 530 GiB / 536 GiB avail; 348/34143 objects degraded (1.019%) 2024-08-18T22:46:45.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:46:45 smithi195 ceph-mon[68841]: 3 slow requests, 0 included below; oldest blocked for > 316.869664 secs 2024-08-18T22:46:47.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:46:46 smithi121 ceph-mon[81053]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 348/34143 objects degraded (1.019%), 2 pgs degraded) 2024-08-18T22:46:47.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:46:46 smithi195 ceph-mon[68841]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 348/34143 objects degraded (1.019%), 2 pgs degraded) 2024-08-18T22:46:48.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:46:47 smithi121 ceph-mon[81053]: pgmap v117: 65 pgs: 65 active+clean; 2.0 GiB data, 6.6 GiB used, 530 GiB / 536 GiB avail 2024-08-18T22:46:48.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:46:47 smithi195 ceph-mon[68841]: pgmap v117: 65 pgs: 65 active+clean; 2.0 GiB data, 6.6 GiB used, 530 GiB / 536 GiB avail 2024-08-18T22:46:49.961 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:46:49 smithi195 ceph-mon[68841]: pgmap v118: 65 pgs: 65 active+clean; 2.0 GiB data, 6.6 GiB used, 530 GiB / 536 GiB avail 2024-08-18T22:46:50.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:46:49 smithi121 ceph-mon[81053]: pgmap v118: 65 pgs: 65 active+clean; 2.0 GiB data, 6.6 GiB used, 530 GiB / 536 GiB avail 2024-08-18T22:46:51.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:46:50 smithi121 ceph-mon[81053]: 3 slow requests, 0 included below; oldest blocked for > 321.869827 secs 2024-08-18T22:46:51.123 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:46:50 smithi195 ceph-mon[68841]: 3 slow requests, 0 included below; oldest blocked for > 321.869827 secs 2024-08-18T22:46:52.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:46:51 smithi121 ceph-mon[81053]: pgmap v119: 65 pgs: 65 active+clean; 2.0 GiB data, 6.6 GiB used, 530 GiB / 536 GiB avail 2024-08-18T22:46:52.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:46:51 smithi195 ceph-mon[68841]: pgmap v119: 65 pgs: 65 active+clean; 2.0 GiB data, 6.6 GiB used, 530 GiB / 536 GiB avail 2024-08-18T22:46:53.833 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:46:53 smithi121 ceph-mon[81053]: pgmap v120: 65 pgs: 65 active+clean; 2.0 GiB data, 6.6 GiB used, 530 GiB / 536 GiB avail 2024-08-18T22:46:53.834 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:46:53 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:46:53.834 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:46:53 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-18T22:46:53.834 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:46:53 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:46:54.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:46:53 smithi195 ceph-mon[68841]: pgmap v120: 65 pgs: 65 active+clean; 2.0 GiB data, 6.6 GiB used, 530 GiB / 536 GiB avail 2024-08-18T22:46:54.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:46:53 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:46:54.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:46:53 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-18T22:46:54.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:46:53 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:46:55.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:46:55 smithi195 ceph-mon[68841]: pgmap v121: 65 pgs: 65 active+clean; 2.0 GiB data, 6.6 GiB used, 530 GiB / 536 GiB avail 2024-08-18T22:46:55.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:46:55 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-08-18T22:46:55.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:46:55 smithi195 ceph-mon[68841]: 3 slow requests, 0 included below; oldest blocked for > 326.869876 secs 2024-08-18T22:46:56.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:46:55 smithi121 ceph-mon[81053]: pgmap v121: 65 pgs: 65 active+clean; 2.0 GiB data, 6.6 GiB used, 530 GiB / 536 GiB avail 2024-08-18T22:46:56.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:46:55 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-08-18T22:46:56.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:46:55 smithi121 ceph-mon[81053]: 3 slow requests, 0 included below; oldest blocked for > 326.869876 secs 2024-08-18T22:46:56.863 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:46:56 smithi195 ceph-mon[68841]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-08-18T22:46:56.864 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:46:56 smithi195 ceph-mon[68841]: Upgrade: osd.4 is safe to restart 2024-08-18T22:46:56.864 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:46:56 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:46:56.864 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:46:56 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-08-18T22:46:56.864 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:46:56 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:46:57.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:46:56 smithi121 ceph-mon[81053]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-08-18T22:46:57.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:46:56 smithi121 ceph-mon[81053]: Upgrade: osd.4 is safe to restart 2024-08-18T22:46:57.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:46:56 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:46:57.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:46:56 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-08-18T22:46:57.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:46:56 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:46:58.019 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:46:57 smithi195 ceph-mon[68841]: Upgrade: Updating osd.4 2024-08-18T22:46:58.019 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:46:57 smithi195 ceph-mon[68841]: Deploying daemon osd.4 on smithi195 2024-08-18T22:46:58.020 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:46:57 smithi195 ceph-mon[68841]: pgmap v122: 65 pgs: 65 active+clean; 2.0 GiB data, 6.6 GiB used, 530 GiB / 536 GiB avail 2024-08-18T22:46:58.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:46:57 smithi121 ceph-mon[81053]: Upgrade: Updating osd.4 2024-08-18T22:46:58.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:46:57 smithi121 ceph-mon[81053]: Deploying daemon osd.4 on smithi195 2024-08-18T22:46:58.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:46:57 smithi121 ceph-mon[81053]: pgmap v122: 65 pgs: 65 active+clean; 2.0 GiB data, 6.6 GiB used, 530 GiB / 536 GiB avail 2024-08-18T22:46:59.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:46:59 smithi195 ceph-mon[68841]: pgmap v123: 65 pgs: 65 active+clean; 2.0 GiB data, 6.6 GiB used, 530 GiB / 536 GiB avail 2024-08-18T22:46:59.909 INFO:journalctl@ceph.osd.4.smithi195.stdout:Aug 18 22:46:59 smithi195 systemd[1]: Stopping Ceph osd.4 for b003123a-5db1-11ef-bccf-c7b262605968... 2024-08-18T22:46:59.909 INFO:journalctl@ceph.osd.4.smithi195.stdout:Aug 18 22:46:59 smithi195 ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-4[35703]: 2024-08-18T22:46:59.720+0000 7f0105f7b640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-18T22:46:59.910 INFO:journalctl@ceph.osd.4.smithi195.stdout:Aug 18 22:46:59 smithi195 ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-4[35703]: 2024-08-18T22:46:59.720+0000 7f0105f7b640 -1 osd.4 70 *** Got signal Terminated *** 2024-08-18T22:46:59.910 INFO:journalctl@ceph.osd.4.smithi195.stdout:Aug 18 22:46:59 smithi195 ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-4[35703]: 2024-08-18T22:46:59.720+0000 7f0105f7b640 -1 osd.4 70 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-08-18T22:47:00.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:46:59 smithi121 ceph-mon[81053]: pgmap v123: 65 pgs: 65 active+clean; 2.0 GiB data, 6.6 GiB used, 530 GiB / 536 GiB avail 2024-08-18T22:47:01.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:47:00 smithi121 ceph-mon[81053]: osd.4 marked itself down and dead 2024-08-18T22:47:01.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:47:00 smithi121 ceph-mon[81053]: 3 slow requests, 0 included below; oldest blocked for > 331.869960 secs 2024-08-18T22:47:01.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:47:00 smithi195 ceph-mon[68841]: osd.4 marked itself down and dead 2024-08-18T22:47:01.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:47:00 smithi195 ceph-mon[68841]: 3 slow requests, 0 included below; oldest blocked for > 331.869960 secs 2024-08-18T22:47:01.488 INFO:journalctl@ceph.osd.4.smithi195.stdout:Aug 18 22:47:01 smithi195 podman[82755]: 2024-08-18 22:47:01.224252319 +0000 UTC m=+1.595511233 container died 99ed156dfd36202a477aa2f47754597a27b4d367e529d4d940e3f5fd6bb6eacd (image=quay.ceph.io/ceph-ci/ceph@sha256:bf20fb88c15fff689cf84383793d3756b4df7aceb11592a28c78dd893a0b3e7d, name=ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-4, maintainer=Guillaume Abrioux , ceph=True, io.buildah.version=1.36.0, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.build-date=20240731, RELEASE=quincy-df62bdc, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-08-18T22:47:01.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:47:01 smithi195 ceph-mon[68841]: pgmap v124: 65 pgs: 65 active+clean; 2.0 GiB data, 6.6 GiB used, 530 GiB / 536 GiB avail 2024-08-18T22:47:01.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:47:01 smithi195 ceph-mon[68841]: Health check failed: 1 osds down (OSD_DOWN) 2024-08-18T22:47:01.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:47:01 smithi195 ceph-mon[68841]: osdmap e71: 6 total, 5 up, 6 in 2024-08-18T22:47:01.909 INFO:journalctl@ceph.osd.4.smithi195.stdout:Aug 18 22:47:01 smithi195 podman[82755]: 2024-08-18 22:47:01.68695188 +0000 UTC m=+2.058210793 container cleanup 99ed156dfd36202a477aa2f47754597a27b4d367e529d4d940e3f5fd6bb6eacd (image=quay.ceph.io/ceph-ci/ceph@sha256:bf20fb88c15fff689cf84383793d3756b4df7aceb11592a28c78dd893a0b3e7d, name=ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-4, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.36.0, org.label-schema.build-date=20240731, RELEASE=quincy-df62bdc, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD) 2024-08-18T22:47:01.910 INFO:journalctl@ceph.osd.4.smithi195.stdout:Aug 18 22:47:01 smithi195 bash[82755]: ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-4 2024-08-18T22:47:02.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:47:01 smithi121 ceph-mon[81053]: pgmap v124: 65 pgs: 65 active+clean; 2.0 GiB data, 6.6 GiB used, 530 GiB / 536 GiB avail 2024-08-18T22:47:02.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:47:01 smithi121 ceph-mon[81053]: Health check failed: 1 osds down (OSD_DOWN) 2024-08-18T22:47:02.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:47:01 smithi121 ceph-mon[81053]: osdmap e71: 6 total, 5 up, 6 in 2024-08-18T22:47:02.145 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:02.143+0000 7f76ec1fa640 1 -- 172.21.15.121:0/2425459695 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f76e4101820 msgr2=0x7f76e4103c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:47:02.146 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:02.143+0000 7f76ec1fa640 1 --2- 172.21.15.121:0/2425459695 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f76e4101820 0x7f76e4103c00 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f76d80048d0 tx=0x7f76d8009da0 comp rx=0 tx=0).stop 2024-08-18T22:47:02.146 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:02.143+0000 7f76ec1fa640 1 -- 172.21.15.121:0/2425459695 shutdown_connections 2024-08-18T22:47:02.146 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:02.143+0000 7f76ec1fa640 1 --2- 172.21.15.121:0/2425459695 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f76e4101820 0x7f76e4103c00 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:47:02.146 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:02.143+0000 7f76ec1fa640 1 --2- 172.21.15.121:0/2425459695 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f76e40659e0 0x7f76e41012e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:47:02.146 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:02.143+0000 7f76ec1fa640 1 -- 172.21.15.121:0/2425459695 >> 172.21.15.121:0/2425459695 conn(0x7f76e40f69b0 msgr2=0x7f76e40f8dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:47:02.146 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:02.143+0000 7f76ec1fa640 1 -- 172.21.15.121:0/2425459695 shutdown_connections 2024-08-18T22:47:02.146 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:02.143+0000 7f76ec1fa640 1 -- 172.21.15.121:0/2425459695 wait complete. 2024-08-18T22:47:02.146 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:02.144+0000 7f76ec1fa640 1 Processor -- start 2024-08-18T22:47:02.146 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:02.144+0000 7f76ec1fa640 1 -- start start 2024-08-18T22:47:02.146 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:02.144+0000 7f76ec1fa640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f76e40659e0 0x7f76e410f050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:47:02.147 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:02.144+0000 7f76ec1fa640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f76e4101820 0x7f76e410f590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:47:02.147 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:02.144+0000 7f76ec1fa640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76e410fbe0 con 0x7f76e40659e0 2024-08-18T22:47:02.147 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:02.144+0000 7f76ec1fa640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76e41103b0 con 0x7f76e4101820 2024-08-18T22:47:02.147 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:02.144+0000 7f76e9f96640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f76e40659e0 0x7f76e410f050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:47:02.147 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:02.144+0000 7f76e9f96640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f76e40659e0 0x7f76e410f050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:57214/0 (socket says 172.21.15.121:57214) 2024-08-18T22:47:02.147 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:02.144+0000 7f76e9f96640 1 -- 172.21.15.121:0/759877923 learned_addr learned my addr 172.21.15.121:0/759877923 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-18T22:47:02.147 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:02.144+0000 7f76e9795640 1 --2- 172.21.15.121:0/759877923 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f76e4101820 0x7f76e410f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:47:02.147 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:02.144+0000 7f76e9f96640 1 -- 172.21.15.121:0/759877923 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f76e4101820 msgr2=0x7f76e410f590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:47:02.147 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:02.144+0000 7f76e9f96640 1 --2- 172.21.15.121:0/759877923 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f76e4101820 0x7f76e410f590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:47:02.147 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:02.144+0000 7f76e9f96640 1 -- 172.21.15.121:0/759877923 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76d8005040 con 0x7f76e40659e0 2024-08-18T22:47:02.147 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:02.144+0000 7f76e9f96640 1 --2- 172.21.15.121:0/759877923 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f76e40659e0 0x7f76e410f050 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f76d400dae0 tx=0x7f76d4004f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:47:02.147 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:02.145+0000 7f76e27fc640 1 -- 172.21.15.121:0/759877923 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f76d400b890 con 0x7f76e40659e0 2024-08-18T22:47:02.147 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:02.145+0000 7f76e27fc640 1 -- 172.21.15.121:0/759877923 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f76d400f040 con 0x7f76e40659e0 2024-08-18T22:47:02.148 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:02.145+0000 7f76ec1fa640 1 -- 172.21.15.121:0/759877923 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76e4110640 con 0x7f76e40659e0 2024-08-18T22:47:02.148 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:02.145+0000 7f76e27fc640 1 -- 172.21.15.121:0/759877923 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f76d4012390 con 0x7f76e40659e0 2024-08-18T22:47:02.148 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:02.145+0000 7f76ec1fa640 1 -- 172.21.15.121:0/759877923 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76e4110b60 con 0x7f76e40659e0 2024-08-18T22:47:02.148 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:02.146+0000 7f76ec1fa640 1 -- 172.21.15.121:0/759877923 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76e40fa630 con 0x7f76e40659e0 2024-08-18T22:47:02.148 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:02.146+0000 7f76e27fc640 1 -- 172.21.15.121:0/759877923 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 37) v1 ==== 92205+0+0 (secure 0 0 0) 0x7f76d40136c0 con 0x7f76e40659e0 2024-08-18T22:47:02.149 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:02.147+0000 7f76e27fc640 1 --2- 172.21.15.121:0/759877923 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f76cc06e0b0 0x7f76cc070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:47:02.149 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:02.147+0000 7f76e27fc640 1 -- 172.21.15.121:0/759877923 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f76d408e050 con 0x7f76e40659e0 2024-08-18T22:47:02.149 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:02.147+0000 7f76e9795640 1 --2- 172.21.15.121:0/759877923 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f76cc06e0b0 0x7f76cc070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:47:02.149 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:02.147+0000 7f76e9795640 1 --2- 172.21.15.121:0/759877923 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f76cc06e0b0 0x7f76cc070560 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f76e410ee00 tx=0x7f76d8035040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:47:02.152 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:02.151+0000 7f76e27fc640 1 -- 172.21.15.121:0/759877923 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f76d4057380 con 0x7f76e40659e0 2024-08-18T22:47:02.327 INFO:journalctl@ceph.osd.4.smithi195.stdout:Aug 18 22:47:01 smithi195 podman[82769]: 2024-08-18 22:47:01.980112342 +0000 UTC m=+0.753301998 container remove 99ed156dfd36202a477aa2f47754597a27b4d367e529d4d940e3f5fd6bb6eacd (image=quay.ceph.io/ceph-ci/ceph@sha256:bf20fb88c15fff689cf84383793d3756b4df7aceb11592a28c78dd893a0b3e7d, name=ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-4, org.label-schema.schema-version=1.0, RELEASE=quincy-df62bdc, org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.36.0, org.label-schema.license=GPLv2, ceph=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image) 2024-08-18T22:47:02.335 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:02.334+0000 7f76ec1fa640 1 -- 172.21.15.121:0/759877923 --> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f76e4110ef0 con 0x7f76cc06e0b0 2024-08-18T22:47:02.336 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:02.335+0000 7f76e27fc640 1 -- 172.21.15.121:0/759877923 <== mgr.34102 v2:172.21.15.121:6800/3037387239 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f76e4110ef0 con 0x7f76cc06e0b0 2024-08-18T22:47:02.339 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:02.337+0000 7f76ec1fa640 1 -- 172.21.15.121:0/759877923 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f76cc06e0b0 msgr2=0x7f76cc070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:47:02.339 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:02.337+0000 7f76ec1fa640 1 --2- 172.21.15.121:0/759877923 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f76cc06e0b0 0x7f76cc070560 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f76e410ee00 tx=0x7f76d8035040 comp rx=0 tx=0).stop 2024-08-18T22:47:02.339 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:02.338+0000 7f76ec1fa640 1 -- 172.21.15.121:0/759877923 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f76e40659e0 msgr2=0x7f76e410f050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:47:02.339 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:02.338+0000 7f76ec1fa640 1 --2- 172.21.15.121:0/759877923 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f76e40659e0 0x7f76e410f050 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f76d400dae0 tx=0x7f76d4004f00 comp rx=0 tx=0).stop 2024-08-18T22:47:02.339 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:02.338+0000 7f76ec1fa640 1 -- 172.21.15.121:0/759877923 shutdown_connections 2024-08-18T22:47:02.339 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:02.338+0000 7f76ec1fa640 1 --2- 172.21.15.121:0/759877923 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f76cc06e0b0 0x7f76cc070560 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:47:02.339 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:02.338+0000 7f76ec1fa640 1 --2- 172.21.15.121:0/759877923 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f76e4101820 0x7f76e410f590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:47:02.340 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:02.338+0000 7f76ec1fa640 1 --2- 172.21.15.121:0/759877923 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f76e40659e0 0x7f76e410f050 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:47:02.340 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:02.338+0000 7f76ec1fa640 1 -- 172.21.15.121:0/759877923 >> 172.21.15.121:0/759877923 conn(0x7f76e40f69b0 msgr2=0x7f76e40f6d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:47:02.340 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:02.338+0000 7f76ec1fa640 1 -- 172.21.15.121:0/759877923 shutdown_connections 2024-08-18T22:47:02.340 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:02.338+0000 7f76ec1fa640 1 -- 172.21.15.121:0/759877923 wait complete. 2024-08-18T22:47:02.347 INFO:teuthology.orchestra.run.smithi121.stdout:true 2024-08-18T22:47:02.419 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:02.417+0000 7fab4da44640 1 -- 172.21.15.121:0/1433321164 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fab480fb1f0 msgr2=0x7fab480fb600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:47:02.419 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:02.417+0000 7fab4da44640 1 --2- 172.21.15.121:0/1433321164 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fab480fb1f0 0x7fab480fb600 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fab380048d0 tx=0x7fab38009da0 comp rx=0 tx=0).stop 2024-08-18T22:47:02.419 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:02.417+0000 7fab4da44640 1 -- 172.21.15.121:0/1433321164 shutdown_connections 2024-08-18T22:47:02.419 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:02.417+0000 7fab4da44640 1 --2- 172.21.15.121:0/1433321164 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fab480fc4c0 0x7fab480fc930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:47:02.419 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:02.417+0000 7fab4da44640 1 --2- 172.21.15.121:0/1433321164 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fab480fb1f0 0x7fab480fb600 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:47:02.419 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:02.417+0000 7fab4da44640 1 -- 172.21.15.121:0/1433321164 >> 172.21.15.121:0/1433321164 conn(0x7fab480f69b0 msgr2=0x7fab480f8de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:47:02.420 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:02.417+0000 7fab4da44640 1 -- 172.21.15.121:0/1433321164 shutdown_connections 2024-08-18T22:47:02.420 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:02.417+0000 7fab4da44640 1 -- 172.21.15.121:0/1433321164 wait complete. 2024-08-18T22:47:02.420 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:02.417+0000 7fab4da44640 1 Processor -- start 2024-08-18T22:47:02.420 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:02.417+0000 7fab4da44640 1 -- start start 2024-08-18T22:47:02.420 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:02.418+0000 7fab4da44640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fab480fb1f0 0x7fab4810bed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:47:02.420 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:02.418+0000 7fab4da44640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fab480fc4c0 0x7fab4810c410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:47:02.420 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:02.418+0000 7fab4da44640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab4810d150 con 0x7fab480fb1f0 2024-08-18T22:47:02.420 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:02.418+0000 7fab4da44640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab4810d2c0 con 0x7fab480fc4c0 2024-08-18T22:47:02.420 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:02.418+0000 7fab46ffd640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fab480fb1f0 0x7fab4810bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:47:02.420 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:02.418+0000 7fab46ffd640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fab480fb1f0 0x7fab4810bed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:57228/0 (socket says 172.21.15.121:57228) 2024-08-18T22:47:02.420 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:02.418+0000 7fab46ffd640 1 -- 172.21.15.121:0/906172430 learned_addr learned my addr 172.21.15.121:0/906172430 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-18T22:47:02.420 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:02.418+0000 7fab3e7fc640 1 --2- 172.21.15.121:0/906172430 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fab480fc4c0 0x7fab4810c410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:47:02.421 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:02.418+0000 7fab46ffd640 1 -- 172.21.15.121:0/906172430 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fab480fc4c0 msgr2=0x7fab4810c410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:47:02.421 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:02.418+0000 7fab46ffd640 1 --2- 172.21.15.121:0/906172430 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fab480fc4c0 0x7fab4810c410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:47:02.421 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:02.418+0000 7fab46ffd640 1 -- 172.21.15.121:0/906172430 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab38005040 con 0x7fab480fb1f0 2024-08-18T22:47:02.421 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:02.418+0000 7fab46ffd640 1 --2- 172.21.15.121:0/906172430 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fab480fb1f0 0x7fab4810bed0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fab38000c00 tx=0x7fab38009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:47:02.422 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:02.419+0000 7fab3ffff640 1 -- 172.21.15.121:0/906172430 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fab38038070 con 0x7fab480fb1f0 2024-08-18T22:47:02.422 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:02.419+0000 7fab4da44640 1 -- 172.21.15.121:0/906172430 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab4810d540 con 0x7fab480fb1f0 2024-08-18T22:47:02.422 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:02.419+0000 7fab4da44640 1 -- 172.21.15.121:0/906172430 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab4810da00 con 0x7fab480fb1f0 2024-08-18T22:47:02.422 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:02.419+0000 7fab3ffff640 1 -- 172.21.15.121:0/906172430 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fab3802ae90 con 0x7fab480fb1f0 2024-08-18T22:47:02.422 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:02.419+0000 7fab3ffff640 1 -- 172.21.15.121:0/906172430 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fab3802c850 con 0x7fab480fb1f0 2024-08-18T22:47:02.422 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:02.420+0000 7fab4da44640 1 -- 172.21.15.121:0/906172430 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab28005240 con 0x7fab480fb1f0 2024-08-18T22:47:02.422 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:02.420+0000 7fab3ffff640 1 -- 172.21.15.121:0/906172430 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 37) v1 ==== 92205+0+0 (secure 0 0 0) 0x7fab38030020 con 0x7fab480fb1f0 2024-08-18T22:47:02.423 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:02.421+0000 7fab3ffff640 1 --2- 172.21.15.121:0/906172430 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7fab3406e0b0 0x7fab34070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:47:02.423 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:02.421+0000 7fab3ffff640 1 -- 172.21.15.121:0/906172430 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6496+0+0 (secure 0 0 0) 0x7fab380ade90 con 0x7fab480fb1f0 2024-08-18T22:47:02.423 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:02.421+0000 7fab3e7fc640 1 --2- 172.21.15.121:0/906172430 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7fab3406e0b0 0x7fab34070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:47:02.423 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:02.421+0000 7fab3e7fc640 1 --2- 172.21.15.121:0/906172430 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7fab3406e0b0 0x7fab34070560 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fab30009b50 tx=0x7fab30009120 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:47:02.426 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:02.425+0000 7fab3ffff640 1 -- 172.21.15.121:0/906172430 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7fab38077240 con 0x7fab480fb1f0 2024-08-18T22:47:02.608 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:02.607+0000 7fab4da44640 1 -- 172.21.15.121:0/906172430 --> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fab28000bf0 con 0x7fab3406e0b0 2024-08-18T22:47:02.609 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:02.608+0000 7fab3ffff640 1 -- 172.21.15.121:0/906172430 <== mgr.34102 v2:172.21.15.121:6800/3037387239 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7fab28000bf0 con 0x7fab3406e0b0 2024-08-18T22:47:02.611 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:02.610+0000 7fab4da44640 1 -- 172.21.15.121:0/906172430 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7fab3406e0b0 msgr2=0x7fab34070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:47:02.611 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:02.610+0000 7fab4da44640 1 --2- 172.21.15.121:0/906172430 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7fab3406e0b0 0x7fab34070560 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fab30009b50 tx=0x7fab30009120 comp rx=0 tx=0).stop 2024-08-18T22:47:02.611 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:02.610+0000 7fab4da44640 1 -- 172.21.15.121:0/906172430 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fab480fb1f0 msgr2=0x7fab4810bed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:47:02.611 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:02.610+0000 7fab4da44640 1 --2- 172.21.15.121:0/906172430 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fab480fb1f0 0x7fab4810bed0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fab38000c00 tx=0x7fab38009da0 comp rx=0 tx=0).stop 2024-08-18T22:47:02.611 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:02.610+0000 7fab4da44640 1 -- 172.21.15.121:0/906172430 shutdown_connections 2024-08-18T22:47:02.611 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:02.610+0000 7fab4da44640 1 --2- 172.21.15.121:0/906172430 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7fab3406e0b0 0x7fab34070560 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:47:02.611 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:02.610+0000 7fab4da44640 1 --2- 172.21.15.121:0/906172430 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fab480fc4c0 0x7fab4810c410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:47:02.612 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:02.610+0000 7fab4da44640 1 --2- 172.21.15.121:0/906172430 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fab480fb1f0 0x7fab4810bed0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:47:02.612 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:02.610+0000 7fab4da44640 1 -- 172.21.15.121:0/906172430 >> 172.21.15.121:0/906172430 conn(0x7fab480f69b0 msgr2=0x7fab480ff830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:47:02.612 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:02.610+0000 7fab4da44640 1 -- 172.21.15.121:0/906172430 shutdown_connections 2024-08-18T22:47:02.612 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:02.610+0000 7fab4da44640 1 -- 172.21.15.121:0/906172430 wait complete. 2024-08-18T22:47:02.659 INFO:journalctl@ceph.osd.4.smithi195.stdout:Aug 18 22:47:02 smithi195 podman[82864]: 2024-08-18 22:47:02.229505045 +0000 UTC m=+0.017145387 image pull ea7a5189f30bad3aca9524788e2965d2368d7ce786df09d4edcd8c3edf9cefba quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9 2024-08-18T22:47:02.659 INFO:journalctl@ceph.osd.4.smithi195.stdout:Aug 18 22:47:02 smithi195 podman[82864]: 2024-08-18 22:47:02.347610176 +0000 UTC m=+0.135250559 container create 7d43fdb61107712fe0df70d2e55d75c3cf4236cc9061d40a20eae480d1b8df55 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-4-deactivate, ceph=True, org.label-schema.build-date=20240731, RELEASE=squid-de09dd0, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.36.0, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2) 2024-08-18T22:47:02.659 INFO:journalctl@ceph.osd.4.smithi195.stdout:Aug 18 22:47:02 smithi195 podman[82864]: 2024-08-18 22:47:02.566636016 +0000 UTC m=+0.354276368 container init 7d43fdb61107712fe0df70d2e55d75c3cf4236cc9061d40a20eae480d1b8df55 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-4-deactivate, GIT_CLEAN=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, RELEASE=squid-de09dd0, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, io.buildah.version=1.36.0, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , ceph=True) 2024-08-18T22:47:02.659 INFO:journalctl@ceph.osd.4.smithi195.stdout:Aug 18 22:47:02 smithi195 podman[82864]: 2024-08-18 22:47:02.570418488 +0000 UTC m=+0.358058830 container start 7d43fdb61107712fe0df70d2e55d75c3cf4236cc9061d40a20eae480d1b8df55 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-4-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-de09dd0, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_CLEAN=True, io.buildah.version=1.36.0, org.label-schema.schema-version=1.0) 2024-08-18T22:47:02.659 INFO:journalctl@ceph.osd.4.smithi195.stdout:Aug 18 22:47:02 smithi195 podman[82864]: 2024-08-18 22:47:02.658568261 +0000 UTC m=+0.446208602 container attach 7d43fdb61107712fe0df70d2e55d75c3cf4236cc9061d40a20eae480d1b8df55 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-4-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, io.buildah.version=1.36.0, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.build-date=20240731, RELEASE=squid-de09dd0, GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-08-18T22:47:02.689 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:02.688+0000 7f4a74532640 1 -- 172.21.15.121:0/463273002 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4a6c0fc4c0 msgr2=0x7f4a6c0fc930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:47:02.689 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:02.688+0000 7f4a74532640 1 --2- 172.21.15.121:0/463273002 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4a6c0fc4c0 0x7f4a6c0fc930 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f4a680048d0 tx=0x7f4a68009da0 comp rx=0 tx=0).stop 2024-08-18T22:47:02.689 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:02.688+0000 7f4a74532640 1 -- 172.21.15.121:0/463273002 shutdown_connections 2024-08-18T22:47:02.689 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:02.688+0000 7f4a74532640 1 --2- 172.21.15.121:0/463273002 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4a6c0fc4c0 0x7f4a6c0fc930 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:47:02.689 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:02.688+0000 7f4a74532640 1 --2- 172.21.15.121:0/463273002 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4a6c0fb1f0 0x7f4a6c0fb600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:47:02.689 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:02.688+0000 7f4a74532640 1 -- 172.21.15.121:0/463273002 >> 172.21.15.121:0/463273002 conn(0x7f4a6c0f69b0 msgr2=0x7f4a6c0f8de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:47:02.690 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:02.688+0000 7f4a74532640 1 -- 172.21.15.121:0/463273002 shutdown_connections 2024-08-18T22:47:02.690 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:02.688+0000 7f4a74532640 1 -- 172.21.15.121:0/463273002 wait complete. 2024-08-18T22:47:02.691 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:02.689+0000 7f4a74532640 1 Processor -- start 2024-08-18T22:47:02.691 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:02.689+0000 7f4a74532640 1 -- start start 2024-08-18T22:47:02.691 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:02.689+0000 7f4a74532640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4a6c0fb1f0 0x7f4a6c10cef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:47:02.691 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:02.689+0000 7f4a74532640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4a6c0fc4c0 0x7f4a6c10d430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:47:02.691 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:02.689+0000 7f4a74532640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a6c10e160 con 0x7f4a6c0fb1f0 2024-08-18T22:47:02.691 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:02.689+0000 7f4a74532640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a6c10e2d0 con 0x7f4a6c0fc4c0 2024-08-18T22:47:02.692 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:02.689+0000 7f4a722ce640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4a6c0fb1f0 0x7f4a6c10cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:47:02.692 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:02.689+0000 7f4a722ce640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4a6c0fb1f0 0x7f4a6c10cef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:57238/0 (socket says 172.21.15.121:57238) 2024-08-18T22:47:02.692 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:02.689+0000 7f4a722ce640 1 -- 172.21.15.121:0/921828045 learned_addr learned my addr 172.21.15.121:0/921828045 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-18T22:47:02.692 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:02.689+0000 7f4a71acd640 1 --2- 172.21.15.121:0/921828045 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4a6c0fc4c0 0x7f4a6c10d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:47:02.692 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:02.690+0000 7f4a722ce640 1 -- 172.21.15.121:0/921828045 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4a6c0fc4c0 msgr2=0x7f4a6c10d430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:47:02.692 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:02.690+0000 7f4a722ce640 1 --2- 172.21.15.121:0/921828045 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4a6c0fc4c0 0x7f4a6c10d430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:47:02.692 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:02.690+0000 7f4a722ce640 1 -- 172.21.15.121:0/921828045 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a68005040 con 0x7f4a6c0fb1f0 2024-08-18T22:47:02.692 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:02.690+0000 7f4a722ce640 1 --2- 172.21.15.121:0/921828045 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4a6c0fb1f0 0x7f4a6c10cef0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f4a5c00eb70 tx=0x7f4a5c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:47:02.692 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:02.690+0000 7f4a62ffd640 1 -- 172.21.15.121:0/921828045 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4a5c007c30 con 0x7f4a6c0fb1f0 2024-08-18T22:47:02.692 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:02.690+0000 7f4a62ffd640 1 -- 172.21.15.121:0/921828045 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f4a5c00f040 con 0x7f4a6c0fb1f0 2024-08-18T22:47:02.692 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:02.690+0000 7f4a74532640 1 -- 172.21.15.121:0/921828045 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a6c10e550 con 0x7f4a6c0fb1f0 2024-08-18T22:47:02.692 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:02.690+0000 7f4a62ffd640 1 -- 172.21.15.121:0/921828045 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4a5c00ca60 con 0x7f4a6c0fb1f0 2024-08-18T22:47:02.692 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:02.690+0000 7f4a74532640 1 -- 172.21.15.121:0/921828045 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a6c10eaf0 con 0x7f4a6c0fb1f0 2024-08-18T22:47:02.693 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:02.691+0000 7f4a74532640 1 -- 172.21.15.121:0/921828045 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a6c104420 con 0x7f4a6c0fb1f0 2024-08-18T22:47:02.693 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:02.692+0000 7f4a62ffd640 1 -- 172.21.15.121:0/921828045 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 37) v1 ==== 92205+0+0 (secure 0 0 0) 0x7f4a5c00cbc0 con 0x7f4a6c0fb1f0 2024-08-18T22:47:02.693 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:02.692+0000 7f4a62ffd640 1 --2- 172.21.15.121:0/921828045 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f4a5806e0b0 0x7f4a58070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:47:02.693 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:02.692+0000 7f4a62ffd640 1 -- 172.21.15.121:0/921828045 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f4a5c08d720 con 0x7f4a6c0fb1f0 2024-08-18T22:47:02.693 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:02.692+0000 7f4a71acd640 1 --2- 172.21.15.121:0/921828045 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f4a5806e0b0 0x7f4a58070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:47:02.694 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:02.693+0000 7f4a71acd640 1 --2- 172.21.15.121:0/921828045 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f4a5806e0b0 0x7f4a58070560 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f4a6c10cca0 tx=0x7f4a68035040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:47:02.697 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:02.697+0000 7f4a62ffd640 1 -- 172.21.15.121:0/921828045 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f4a5c056b80 con 0x7f4a6c0fb1f0 2024-08-18T22:47:02.875 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:02.874+0000 7f4a74532640 1 -- 172.21.15.121:0/921828045 --> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f4a6c103c10 con 0x7f4a5806e0b0 2024-08-18T22:47:02.884 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:02.883+0000 7f4a62ffd640 1 -- 172.21.15.121:0/921828045 <== mgr.34102 v2:172.21.15.121:6800/3037387239 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f4a6c103c10 con 0x7f4a5806e0b0 2024-08-18T22:47:02.884 INFO:teuthology.orchestra.run.smithi121.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-08-18T22:47:02.885 INFO:teuthology.orchestra.run.smithi121.stdout:alertmanager.smithi121 smithi121 *:9093,9094 running (4m) 58s ago 12m 24.9M - 0.25.0 c8568f914cd2 c421c5e6a02b 2024-08-18T22:47:02.885 INFO:teuthology.orchestra.run.smithi121.stdout:crash.smithi121 smithi121 running (2m) 58s ago 13m 6903k - 19.1.0-1382-gde09dd01 ea7a5189f30b 3cf5c666a0e6 2024-08-18T22:47:02.885 INFO:teuthology.orchestra.run.smithi121.stdout:crash.smithi195 smithi195 running (2m) 27s ago 12m 6895k - 19.1.0-1382-gde09dd01 ea7a5189f30b fbb586fb9834 2024-08-18T22:47:02.885 INFO:teuthology.orchestra.run.smithi121.stdout:grafana.smithi121 smithi121 *:3000 running (4m) 58s ago 12m 78.4M - 9.4.7 954c08fa6188 091a5fd17e8a 2024-08-18T22:47:02.885 INFO:teuthology.orchestra.run.smithi121.stdout:mds.cephfs.smithi121.gbickb smithi121 running (7m) 58s ago 7m 156M - 17.2.7-1406-gdf62bdcc 774894bef55f 484da0bc2c95 2024-08-18T22:47:02.885 INFO:teuthology.orchestra.run.smithi121.stdout:mds.cephfs.smithi121.xuzsdg smithi121 running (7m) 58s ago 7m 13.6M - 17.2.7-1406-gdf62bdcc 774894bef55f 6976b708cdcd 2024-08-18T22:47:02.885 INFO:teuthology.orchestra.run.smithi121.stdout:mds.cephfs.smithi195.buqvbr smithi195 running (7m) 27s ago 7m 116M - 17.2.7-1406-gdf62bdcc 774894bef55f 11a3703b4276 2024-08-18T22:47:02.885 INFO:teuthology.orchestra.run.smithi121.stdout:mds.cephfs.smithi195.nptgyc smithi195 running (7m) 27s ago 7m 18.1M - 17.2.7-1406-gdf62bdcc 774894bef55f b9f8043ea83e 2024-08-18T22:47:02.885 INFO:teuthology.orchestra.run.smithi121.stdout:mgr.smithi121.lopxqc smithi121 *:8443,9283,8765 running (4m) 58s ago 14m 498M - 19.1.0-1382-gde09dd01 ea7a5189f30b 9079701e6516 2024-08-18T22:47:02.885 INFO:teuthology.orchestra.run.smithi121.stdout:mgr.smithi195.acttsj smithi195 *:8443,9283,8765 running (3m) 27s ago 12m 440M - 19.1.0-1382-gde09dd01 ea7a5189f30b 7b4027a33daa 2024-08-18T22:47:02.885 INFO:teuthology.orchestra.run.smithi121.stdout:mon.smithi121 smithi121 running (3m) 58s ago 14m 49.3M 2048M 19.1.0-1382-gde09dd01 ea7a5189f30b d71695a4fb56 2024-08-18T22:47:02.885 INFO:teuthology.orchestra.run.smithi121.stdout:mon.smithi195 smithi195 running (3m) 27s ago 12m 39.0M 2048M 19.1.0-1382-gde09dd01 ea7a5189f30b a9bb94ba3b56 2024-08-18T22:47:02.885 INFO:teuthology.orchestra.run.smithi121.stdout:node-exporter.smithi121 smithi121 *:9100 running (4m) 58s ago 13m 15.2M - 1.5.0 0da6a335fe13 bc4b5355a507 2024-08-18T22:47:02.886 INFO:teuthology.orchestra.run.smithi121.stdout:node-exporter.smithi195 smithi195 *:9100 running (4m) 27s ago 12m 16.7M - 1.5.0 0da6a335fe13 146efcb79663 2024-08-18T22:47:02.886 INFO:teuthology.orchestra.run.smithi121.stdout:osd.0 smithi121 running (2m) 58s ago 11m 99.3M 1557M 19.1.0-1382-gde09dd01 ea7a5189f30b d378dd46eeb6 2024-08-18T22:47:02.886 INFO:teuthology.orchestra.run.smithi121.stdout:osd.1 smithi121 running (98s) 58s ago 10m 117M 1557M 19.1.0-1382-gde09dd01 ea7a5189f30b 0f9e03de5382 2024-08-18T22:47:02.886 INFO:teuthology.orchestra.run.smithi121.stdout:osd.2 smithi121 running (64s) 58s ago 10m 11.7M 1557M 19.1.0-1382-gde09dd01 ea7a5189f30b 93270b5bed68 2024-08-18T22:47:02.886 INFO:teuthology.orchestra.run.smithi121.stdout:osd.3 smithi195 running (30s) 27s ago 10m 11.8M 2581M 19.1.0-1382-gde09dd01 ea7a5189f30b 72c2860c0e9f 2024-08-18T22:47:02.886 INFO:teuthology.orchestra.run.smithi121.stdout:osd.4 smithi195 running (9m) 27s ago 9m 211M 2581M 17.2.7-1406-gdf62bdcc 774894bef55f 99ed156dfd36 2024-08-18T22:47:02.886 INFO:teuthology.orchestra.run.smithi121.stdout:osd.5 smithi195 running (9m) 27s ago 9m 212M 2581M 17.2.7-1406-gdf62bdcc 774894bef55f e7eff7bdb752 2024-08-18T22:47:02.886 INFO:teuthology.orchestra.run.smithi121.stdout:prometheus.smithi121 smithi121 *:9095 running (3m) 58s ago 12m 54.0M - 2.43.0 a07b618ecd1d 00c4f776d23a 2024-08-18T22:47:02.887 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:02.886+0000 7f4a74532640 1 -- 172.21.15.121:0/921828045 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f4a5806e0b0 msgr2=0x7f4a58070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:47:02.887 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:02.886+0000 7f4a74532640 1 --2- 172.21.15.121:0/921828045 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f4a5806e0b0 0x7f4a58070560 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f4a6c10cca0 tx=0x7f4a68035040 comp rx=0 tx=0).stop 2024-08-18T22:47:02.887 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:02.886+0000 7f4a74532640 1 -- 172.21.15.121:0/921828045 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4a6c0fb1f0 msgr2=0x7f4a6c10cef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:47:02.887 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:02.886+0000 7f4a74532640 1 --2- 172.21.15.121:0/921828045 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4a6c0fb1f0 0x7f4a6c10cef0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f4a5c00eb70 tx=0x7f4a5c00b040 comp rx=0 tx=0).stop 2024-08-18T22:47:02.887 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:02.886+0000 7f4a74532640 1 -- 172.21.15.121:0/921828045 shutdown_connections 2024-08-18T22:47:02.887 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:02.886+0000 7f4a74532640 1 --2- 172.21.15.121:0/921828045 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f4a5806e0b0 0x7f4a58070560 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:47:02.887 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:02.886+0000 7f4a74532640 1 --2- 172.21.15.121:0/921828045 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4a6c0fc4c0 0x7f4a6c10d430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:47:02.887 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:02.886+0000 7f4a74532640 1 --2- 172.21.15.121:0/921828045 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4a6c0fb1f0 0x7f4a6c10cef0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:47:02.887 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:02.886+0000 7f4a74532640 1 -- 172.21.15.121:0/921828045 >> 172.21.15.121:0/921828045 conn(0x7f4a6c0f69b0 msgr2=0x7f4a6c065eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:47:02.887 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:02.886+0000 7f4a74532640 1 -- 172.21.15.121:0/921828045 shutdown_connections 2024-08-18T22:47:02.888 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:02.886+0000 7f4a74532640 1 -- 172.21.15.121:0/921828045 wait complete. 2024-08-18T22:47:02.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:47:02 smithi195 ceph-mon[68841]: osdmap e72: 6 total, 5 up, 6 in 2024-08-18T22:47:02.909 INFO:journalctl@ceph.osd.4.smithi195.stdout:Aug 18 22:47:02 smithi195 podman[82864]: 2024-08-18 22:47:02.766983034 +0000 UTC m=+0.554623376 container died 7d43fdb61107712fe0df70d2e55d75c3cf4236cc9061d40a20eae480d1b8df55 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-4-deactivate, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , RELEASE=squid-de09dd0, io.buildah.version=1.36.0, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, ceph=True, GIT_CLEAN=True) 2024-08-18T22:47:02.964 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:02.963+0000 7f7ba5c85640 1 -- 172.21.15.121:0/851727322 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7ba00fda00 msgr2=0x7f7ba00fde10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:47:02.964 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:02.963+0000 7f7ba5c85640 1 --2- 172.21.15.121:0/851727322 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7ba00fda00 0x7f7ba00fde10 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f7b900048d0 tx=0x7f7b90009da0 comp rx=0 tx=0).stop 2024-08-18T22:47:02.965 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:47:02 smithi121 ceph-mon[81053]: osdmap e72: 6 total, 5 up, 6 in 2024-08-18T22:47:02.966 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:02.963+0000 7f7ba5c85640 1 -- 172.21.15.121:0/851727322 shutdown_connections 2024-08-18T22:47:02.967 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:02.963+0000 7f7ba5c85640 1 --2- 172.21.15.121:0/851727322 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7ba00fe350 0x7f7ba00fa4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:47:02.967 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:02.963+0000 7f7ba5c85640 1 --2- 172.21.15.121:0/851727322 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7ba00fda00 0x7f7ba00fde10 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:47:02.967 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:02.963+0000 7f7ba5c85640 1 -- 172.21.15.121:0/851727322 >> 172.21.15.121:0/851727322 conn(0x7f7ba00f6140 msgr2=0x7f7ba00f8570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:47:02.967 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:02.963+0000 7f7ba5c85640 1 -- 172.21.15.121:0/851727322 shutdown_connections 2024-08-18T22:47:02.967 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:02.963+0000 7f7ba5c85640 1 -- 172.21.15.121:0/851727322 wait complete. 2024-08-18T22:47:02.967 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:02.964+0000 7f7ba5c85640 1 Processor -- start 2024-08-18T22:47:02.967 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:02.964+0000 7f7ba5c85640 1 -- start start 2024-08-18T22:47:02.967 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:02.964+0000 7f7ba5c85640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7ba00fda00 0x7f7ba010cf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:47:02.967 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:02.964+0000 7f7ba5c85640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7ba00fe350 0x7f7ba010d490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:47:02.967 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:02.964+0000 7f7ba5c85640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ba010e170 con 0x7f7ba00fda00 2024-08-18T22:47:02.967 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:02.964+0000 7f7ba5c85640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ba010e2e0 con 0x7f7ba00fe350 2024-08-18T22:47:02.968 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:02.964+0000 7f7b9f7fe640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7ba00fda00 0x7f7ba010cf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:47:02.968 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:02.964+0000 7f7b9f7fe640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7ba00fda00 0x7f7ba010cf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:57248/0 (socket says 172.21.15.121:57248) 2024-08-18T22:47:02.968 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:02.964+0000 7f7b9f7fe640 1 -- 172.21.15.121:0/1587535075 learned_addr learned my addr 172.21.15.121:0/1587535075 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-18T22:47:02.968 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:02.965+0000 7f7b9effd640 1 --2- 172.21.15.121:0/1587535075 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7ba00fe350 0x7f7ba010d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:47:02.968 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:02.965+0000 7f7b9f7fe640 1 -- 172.21.15.121:0/1587535075 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7ba00fe350 msgr2=0x7f7ba010d490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:47:02.968 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:02.965+0000 7f7b9f7fe640 1 --2- 172.21.15.121:0/1587535075 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7ba00fe350 0x7f7ba010d490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:47:02.968 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:02.965+0000 7f7b9f7fe640 1 -- 172.21.15.121:0/1587535075 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b90005040 con 0x7f7ba00fda00 2024-08-18T22:47:02.968 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:02.965+0000 7f7b9f7fe640 1 --2- 172.21.15.121:0/1587535075 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7ba00fda00 0x7f7ba010cf50 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f7b900043d0 tx=0x7f7b90009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:47:02.968 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:02.965+0000 7f7b87fff640 1 -- 172.21.15.121:0/1587535075 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7b90038070 con 0x7f7ba00fda00 2024-08-18T22:47:02.968 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:02.965+0000 7f7b87fff640 1 -- 172.21.15.121:0/1587535075 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f7b9002ae90 con 0x7f7ba00fda00 2024-08-18T22:47:02.968 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:02.965+0000 7f7ba5c85640 1 -- 172.21.15.121:0/1587535075 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ba010e560 con 0x7f7ba00fda00 2024-08-18T22:47:02.968 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:02.965+0000 7f7b87fff640 1 -- 172.21.15.121:0/1587535075 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7b9003e670 con 0x7f7ba00fda00 2024-08-18T22:47:02.968 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:02.965+0000 7f7ba5c85640 1 -- 172.21.15.121:0/1587535075 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ba010eb00 con 0x7f7ba00fda00 2024-08-18T22:47:02.969 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:02.966+0000 7f7ba5c85640 1 -- 172.21.15.121:0/1587535075 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ba0105580 con 0x7f7ba00fda00 2024-08-18T22:47:02.969 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:02.967+0000 7f7b87fff640 1 -- 172.21.15.121:0/1587535075 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 37) v1 ==== 92205+0+0 (secure 0 0 0) 0x7f7b90030020 con 0x7f7ba00fda00 2024-08-18T22:47:02.970 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:02.967+0000 7f7b87fff640 1 --2- 172.21.15.121:0/1587535075 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f7b8806e0b0 0x7f7b88070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:47:02.970 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:02.967+0000 7f7b87fff640 1 -- 172.21.15.121:0/1587535075 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f7b900add50 con 0x7f7ba00fda00 2024-08-18T22:47:02.970 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:02.968+0000 7f7b9effd640 1 --2- 172.21.15.121:0/1587535075 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f7b8806e0b0 0x7f7b88070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:47:02.970 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:02.968+0000 7f7b9effd640 1 --2- 172.21.15.121:0/1587535075 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f7b8806e0b0 0x7f7b88070560 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f7ba010cd00 tx=0x7f7b9400b040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:47:02.973 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:02.972+0000 7f7b87fff640 1 -- 172.21.15.121:0/1587535075 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f7b90077130 con 0x7f7ba00fda00 2024-08-18T22:47:03.203 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:03.202+0000 7f7ba5c85640 1 -- 172.21.15.121:0/1587535075 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f7ba0104ef0 con 0x7f7ba00fda00 2024-08-18T22:47:03.203 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:03.203+0000 7f7b87fff640 1 -- 172.21.15.121:0/1587535075 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+838 (secure 0 0 0) 0x7f7b9007a7f0 con 0x7f7ba00fda00 2024-08-18T22:47:03.204 INFO:teuthology.orchestra.run.smithi121.stdout:{ 2024-08-18T22:47:03.204 INFO:teuthology.orchestra.run.smithi121.stdout: "mon": { 2024-08-18T22:47:03.204 INFO:teuthology.orchestra.run.smithi121.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 2 2024-08-18T22:47:03.204 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-18T22:47:03.204 INFO:teuthology.orchestra.run.smithi121.stdout: "mgr": { 2024-08-18T22:47:03.204 INFO:teuthology.orchestra.run.smithi121.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 2 2024-08-18T22:47:03.204 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-18T22:47:03.204 INFO:teuthology.orchestra.run.smithi121.stdout: "osd": { 2024-08-18T22:47:03.204 INFO:teuthology.orchestra.run.smithi121.stdout: "ceph version 17.2.7-1406-gdf62bdcc (df62bdccd9a13bf566b27a250eddfdd89be3072d) quincy (stable)": 1, 2024-08-18T22:47:03.204 INFO:teuthology.orchestra.run.smithi121.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 4 2024-08-18T22:47:03.204 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-18T22:47:03.205 INFO:teuthology.orchestra.run.smithi121.stdout: "mds": { 2024-08-18T22:47:03.205 INFO:teuthology.orchestra.run.smithi121.stdout: "ceph version 17.2.7-1406-gdf62bdcc (df62bdccd9a13bf566b27a250eddfdd89be3072d) quincy (stable)": 4 2024-08-18T22:47:03.205 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-18T22:47:03.205 INFO:teuthology.orchestra.run.smithi121.stdout: "overall": { 2024-08-18T22:47:03.205 INFO:teuthology.orchestra.run.smithi121.stdout: "ceph version 17.2.7-1406-gdf62bdcc (df62bdccd9a13bf566b27a250eddfdd89be3072d) quincy (stable)": 5, 2024-08-18T22:47:03.205 INFO:teuthology.orchestra.run.smithi121.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 8 2024-08-18T22:47:03.205 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-08-18T22:47:03.205 INFO:teuthology.orchestra.run.smithi121.stdout:} 2024-08-18T22:47:03.206 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:03.204+0000 7f7ba5c85640 1 -- 172.21.15.121:0/1587535075 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f7b8806e0b0 msgr2=0x7f7b88070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:47:03.206 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:03.204+0000 7f7ba5c85640 1 --2- 172.21.15.121:0/1587535075 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f7b8806e0b0 0x7f7b88070560 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f7ba010cd00 tx=0x7f7b9400b040 comp rx=0 tx=0).stop 2024-08-18T22:47:03.206 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:03.205+0000 7f7ba5c85640 1 -- 172.21.15.121:0/1587535075 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7ba00fda00 msgr2=0x7f7ba010cf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:47:03.206 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:03.205+0000 7f7ba5c85640 1 --2- 172.21.15.121:0/1587535075 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7ba00fda00 0x7f7ba010cf50 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f7b900043d0 tx=0x7f7b90009da0 comp rx=0 tx=0).stop 2024-08-18T22:47:03.206 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:03.205+0000 7f7ba5c85640 1 -- 172.21.15.121:0/1587535075 shutdown_connections 2024-08-18T22:47:03.206 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:03.205+0000 7f7ba5c85640 1 --2- 172.21.15.121:0/1587535075 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f7b8806e0b0 0x7f7b88070560 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:47:03.206 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:03.205+0000 7f7ba5c85640 1 --2- 172.21.15.121:0/1587535075 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7ba00fe350 0x7f7ba010d490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:47:03.206 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:03.205+0000 7f7ba5c85640 1 --2- 172.21.15.121:0/1587535075 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7ba00fda00 0x7f7ba010cf50 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:47:03.207 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:03.205+0000 7f7ba5c85640 1 -- 172.21.15.121:0/1587535075 >> 172.21.15.121:0/1587535075 conn(0x7f7ba00f6140 msgr2=0x7f7ba00f7910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:47:03.207 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:03.205+0000 7f7ba5c85640 1 -- 172.21.15.121:0/1587535075 shutdown_connections 2024-08-18T22:47:03.207 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:03.205+0000 7f7ba5c85640 1 -- 172.21.15.121:0/1587535075 wait complete. 2024-08-18T22:47:03.284 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:03.283+0000 7f616afc4640 1 -- 172.21.15.121:0/3929760837 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f61640fd5a0 msgr2=0x7f61640fda10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:47:03.284 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:03.283+0000 7f616afc4640 1 --2- 172.21.15.121:0/3929760837 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f61640fd5a0 0x7f61640fda10 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f61500048d0 tx=0x7f6150009da0 comp rx=0 tx=0).stop 2024-08-18T22:47:03.284 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:03.283+0000 7f616afc4640 1 -- 172.21.15.121:0/3929760837 shutdown_connections 2024-08-18T22:47:03.284 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:03.283+0000 7f616afc4640 1 --2- 172.21.15.121:0/3929760837 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f61640fd5a0 0x7f61640fda10 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:47:03.285 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:03.283+0000 7f616afc4640 1 --2- 172.21.15.121:0/3929760837 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f61640fc2d0 0x7f61640fc6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:47:03.285 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:03.283+0000 7f616afc4640 1 -- 172.21.15.121:0/3929760837 >> 172.21.15.121:0/3929760837 conn(0x7f61640f7ab0 msgr2=0x7f61640f9ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:47:03.285 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:03.283+0000 7f616afc4640 1 -- 172.21.15.121:0/3929760837 shutdown_connections 2024-08-18T22:47:03.285 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:03.283+0000 7f616afc4640 1 -- 172.21.15.121:0/3929760837 wait complete. 2024-08-18T22:47:03.285 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:03.283+0000 7f616afc4640 1 Processor -- start 2024-08-18T22:47:03.285 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:03.283+0000 7f616afc4640 1 -- start start 2024-08-18T22:47:03.287 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:03.284+0000 7f616afc4640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f61640fc2d0 0x7f616410ced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:47:03.287 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:03.284+0000 7f616afc4640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f61640fd5a0 0x7f616410d410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:47:03.287 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:03.284+0000 7f616afc4640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f616410e140 con 0x7f61640fc2d0 2024-08-18T22:47:03.287 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:03.284+0000 7f616afc4640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f616410e2b0 con 0x7f61640fd5a0 2024-08-18T22:47:03.287 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:03.284+0000 7f6168d60640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f61640fc2d0 0x7f616410ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:47:03.287 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:03.284+0000 7f6168d60640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f61640fc2d0 0x7f616410ced0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:57264/0 (socket says 172.21.15.121:57264) 2024-08-18T22:47:03.287 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:03.284+0000 7f6168d60640 1 -- 172.21.15.121:0/694806717 learned_addr learned my addr 172.21.15.121:0/694806717 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-18T22:47:03.287 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:03.284+0000 7f6163fff640 1 --2- 172.21.15.121:0/694806717 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f61640fd5a0 0x7f616410d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:47:03.287 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:03.284+0000 7f6168d60640 1 -- 172.21.15.121:0/694806717 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f61640fd5a0 msgr2=0x7f616410d410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:47:03.287 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:03.284+0000 7f6168d60640 1 --2- 172.21.15.121:0/694806717 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f61640fd5a0 0x7f616410d410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:47:03.288 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:03.284+0000 7f6168d60640 1 -- 172.21.15.121:0/694806717 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6150005040 con 0x7f61640fc2d0 2024-08-18T22:47:03.288 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:03.284+0000 7f6168d60640 1 --2- 172.21.15.121:0/694806717 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f61640fc2d0 0x7f616410ced0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f6158002a50 tx=0x7f6158004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:47:03.288 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:03.284+0000 7f61617fa640 1 -- 172.21.15.121:0/694806717 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6158007c30 con 0x7f61640fc2d0 2024-08-18T22:47:03.288 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:03.285+0000 7f616afc4640 1 -- 172.21.15.121:0/694806717 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f616410e590 con 0x7f61640fc2d0 2024-08-18T22:47:03.288 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:03.285+0000 7f61617fa640 1 -- 172.21.15.121:0/694806717 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f615800f040 con 0x7f61640fc2d0 2024-08-18T22:47:03.288 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:03.285+0000 7f61617fa640 1 -- 172.21.15.121:0/694806717 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f615800da10 con 0x7f61640fc2d0 2024-08-18T22:47:03.288 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:03.285+0000 7f616afc4640 1 -- 172.21.15.121:0/694806717 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f616410eb30 con 0x7f61640fc2d0 2024-08-18T22:47:03.288 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:03.286+0000 7f616afc4640 1 -- 172.21.15.121:0/694806717 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6164105500 con 0x7f61640fc2d0 2024-08-18T22:47:03.289 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:03.287+0000 7f61617fa640 1 -- 172.21.15.121:0/694806717 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 37) v1 ==== 92205+0+0 (secure 0 0 0) 0x7f615800dc50 con 0x7f61640fc2d0 2024-08-18T22:47:03.289 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:03.287+0000 7f61617fa640 1 --2- 172.21.15.121:0/694806717 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f615406e0b0 0x7f6154070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:47:03.289 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:03.287+0000 7f61617fa640 1 -- 172.21.15.121:0/694806717 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f615808d2a0 con 0x7f61640fc2d0 2024-08-18T22:47:03.289 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:03.287+0000 7f6163fff640 1 --2- 172.21.15.121:0/694806717 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f615406e0b0 0x7f6154070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:47:03.289 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:03.288+0000 7f6163fff640 1 --2- 172.21.15.121:0/694806717 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f615406e0b0 0x7f6154070560 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f616410cc80 tx=0x7f6150035040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:47:03.293 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:03.292+0000 7f61617fa640 1 -- 172.21.15.121:0/694806717 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f6158056700 con 0x7f61640fc2d0 2024-08-18T22:47:03.494 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:03.492+0000 7f616afc4640 1 -- 172.21.15.121:0/694806717 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f61640fb730 con 0x7f61640fc2d0 2024-08-18T22:47:03.494 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:03.493+0000 7f61617fa640 1 -- 172.21.15.121:0/694806717 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 22 v22) v1 ==== 76+0+1942 (secure 0 0 0) 0x7f6158059dc0 con 0x7f61640fc2d0 2024-08-18T22:47:03.494 INFO:teuthology.orchestra.run.smithi121.stdout:e22 2024-08-18T22:47:03.494 INFO:teuthology.orchestra.run.smithi121.stdout:btime 2024-08-18T22:45:32:233419+0000 2024-08-18T22:47:03.494 INFO:teuthology.orchestra.run.smithi121.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-08-18T22:47:03.494 INFO:teuthology.orchestra.run.smithi121.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-08-18T22:47:03.495 INFO:teuthology.orchestra.run.smithi121.stdout:legacy client fscid: 1 2024-08-18T22:47:03.495 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-08-18T22:47:03.495 INFO:teuthology.orchestra.run.smithi121.stdout:Filesystem 'cephfs' (1) 2024-08-18T22:47:03.495 INFO:teuthology.orchestra.run.smithi121.stdout:fs_name cephfs 2024-08-18T22:47:03.495 INFO:teuthology.orchestra.run.smithi121.stdout:epoch 22 2024-08-18T22:47:03.495 INFO:teuthology.orchestra.run.smithi121.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-08-18T22:47:03.495 INFO:teuthology.orchestra.run.smithi121.stdout:created 2024-08-18T22:39:04.054074+0000 2024-08-18T22:47:03.495 INFO:teuthology.orchestra.run.smithi121.stdout:modified 2024-08-18T22:45:31.247467+0000 2024-08-18T22:47:03.495 INFO:teuthology.orchestra.run.smithi121.stdout:tableserver 0 2024-08-18T22:47:03.495 INFO:teuthology.orchestra.run.smithi121.stdout:root 0 2024-08-18T22:47:03.495 INFO:teuthology.orchestra.run.smithi121.stdout:session_timeout 60 2024-08-18T22:47:03.495 INFO:teuthology.orchestra.run.smithi121.stdout:session_autoclose 300 2024-08-18T22:47:03.495 INFO:teuthology.orchestra.run.smithi121.stdout:max_file_size 1099511627776 2024-08-18T22:47:03.495 INFO:teuthology.orchestra.run.smithi121.stdout:max_xattr_size 65536 2024-08-18T22:47:03.495 INFO:teuthology.orchestra.run.smithi121.stdout:required_client_features {} 2024-08-18T22:47:03.496 INFO:teuthology.orchestra.run.smithi121.stdout:last_failure 0 2024-08-18T22:47:03.496 INFO:teuthology.orchestra.run.smithi121.stdout:last_failure_osd_epoch 47 2024-08-18T22:47:03.496 INFO:teuthology.orchestra.run.smithi121.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-08-18T22:47:03.496 INFO:teuthology.orchestra.run.smithi121.stdout:max_mds 2 2024-08-18T22:47:03.496 INFO:teuthology.orchestra.run.smithi121.stdout:in 0,1 2024-08-18T22:47:03.496 INFO:teuthology.orchestra.run.smithi121.stdout:up {0=14474,1=24249} 2024-08-18T22:47:03.496 INFO:teuthology.orchestra.run.smithi121.stdout:failed 2024-08-18T22:47:03.496 INFO:teuthology.orchestra.run.smithi121.stdout:damaged 2024-08-18T22:47:03.496 INFO:teuthology.orchestra.run.smithi121.stdout:stopped 2024-08-18T22:47:03.496 INFO:teuthology.orchestra.run.smithi121.stdout:data_pools [3] 2024-08-18T22:47:03.496 INFO:teuthology.orchestra.run.smithi121.stdout:metadata_pool 2 2024-08-18T22:47:03.496 INFO:teuthology.orchestra.run.smithi121.stdout:inline_data disabled 2024-08-18T22:47:03.496 INFO:teuthology.orchestra.run.smithi121.stdout:balancer 2024-08-18T22:47:03.496 INFO:teuthology.orchestra.run.smithi121.stdout:bal_rank_mask -1 2024-08-18T22:47:03.496 INFO:teuthology.orchestra.run.smithi121.stdout:standby_count_wanted 1 2024-08-18T22:47:03.496 INFO:teuthology.orchestra.run.smithi121.stdout:qdb_cluster leader: 14474 members: 14474,24249 2024-08-18T22:47:03.497 INFO:teuthology.orchestra.run.smithi121.stdout:[mds.cephfs.smithi121.gbickb{0:14474} state up:active seq 83 join_fscid=1 addr [v2:172.21.15.121:6828/2277706406,v1:172.21.15.121:6829/2277706406] compat {c=[1],r=[1],i=[7ff]}] 2024-08-18T22:47:03.497 INFO:teuthology.orchestra.run.smithi121.stdout:[mds.cephfs.smithi195.buqvbr{1:24249} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.195:6824/2414511859,v1:172.21.15.195:6825/2414511859] compat {c=[1],r=[1],i=[7ff]}] 2024-08-18T22:47:03.497 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-08-18T22:47:03.497 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-08-18T22:47:03.497 INFO:teuthology.orchestra.run.smithi121.stdout:Standby daemons: 2024-08-18T22:47:03.497 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-08-18T22:47:03.497 INFO:teuthology.orchestra.run.smithi121.stdout:[mds.cephfs.smithi121.xuzsdg{-1:14490} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.121:6826/91588128,v1:172.21.15.121:6827/91588128] compat {c=[1],r=[1],i=[7ff]}] 2024-08-18T22:47:03.497 INFO:teuthology.orchestra.run.smithi121.stdout:[mds.cephfs.smithi195.nptgyc{-1:24259} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.195:6826/238549847,v1:172.21.15.195:6827/238549847] compat {c=[1],r=[1],i=[7ff]}] 2024-08-18T22:47:03.498 INFO:teuthology.orchestra.run.smithi121.stderr:dumped fsmap epoch 22 2024-08-18T22:47:03.498 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:03.495+0000 7f616afc4640 1 -- 172.21.15.121:0/694806717 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f615406e0b0 msgr2=0x7f6154070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:47:03.498 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:03.495+0000 7f616afc4640 1 --2- 172.21.15.121:0/694806717 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f615406e0b0 0x7f6154070560 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f616410cc80 tx=0x7f6150035040 comp rx=0 tx=0).stop 2024-08-18T22:47:03.498 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:03.495+0000 7f616afc4640 1 -- 172.21.15.121:0/694806717 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f61640fc2d0 msgr2=0x7f616410ced0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:47:03.498 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:03.495+0000 7f616afc4640 1 --2- 172.21.15.121:0/694806717 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f61640fc2d0 0x7f616410ced0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f6158002a50 tx=0x7f6158004600 comp rx=0 tx=0).stop 2024-08-18T22:47:03.498 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:03.495+0000 7f616afc4640 1 -- 172.21.15.121:0/694806717 shutdown_connections 2024-08-18T22:47:03.498 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:03.495+0000 7f616afc4640 1 --2- 172.21.15.121:0/694806717 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f615406e0b0 0x7f6154070560 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:47:03.498 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:03.495+0000 7f616afc4640 1 --2- 172.21.15.121:0/694806717 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f61640fd5a0 0x7f616410d410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:47:03.498 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:03.495+0000 7f616afc4640 1 --2- 172.21.15.121:0/694806717 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f61640fc2d0 0x7f616410ced0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:47:03.499 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:03.495+0000 7f616afc4640 1 -- 172.21.15.121:0/694806717 >> 172.21.15.121:0/694806717 conn(0x7f61640f7ab0 msgr2=0x7f61640f9270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:47:03.499 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:03.495+0000 7f616afc4640 1 -- 172.21.15.121:0/694806717 shutdown_connections 2024-08-18T22:47:03.499 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:03.495+0000 7f616afc4640 1 -- 172.21.15.121:0/694806717 wait complete. 2024-08-18T22:47:03.576 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:03.574+0000 7ff834e99640 1 -- 172.21.15.121:0/4238023199 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff830064f80 msgr2=0x7ff8300fa9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:47:03.576 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:03.574+0000 7ff834e99640 1 --2- 172.21.15.121:0/4238023199 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff830064f80 0x7ff8300fa9a0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7ff8200048d0 tx=0x7ff820009da0 comp rx=0 tx=0).stop 2024-08-18T22:47:03.576 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:03.574+0000 7ff834e99640 1 -- 172.21.15.121:0/4238023199 shutdown_connections 2024-08-18T22:47:03.576 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:03.574+0000 7ff834e99640 1 --2- 172.21.15.121:0/4238023199 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff830065390 0x7ff8300faee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:47:03.577 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:03.574+0000 7ff834e99640 1 --2- 172.21.15.121:0/4238023199 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff830064f80 0x7ff8300fa9a0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:47:03.577 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:03.574+0000 7ff834e99640 1 -- 172.21.15.121:0/4238023199 >> 172.21.15.121:0/4238023199 conn(0x7ff8300f6160 msgr2=0x7ff8300f8590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:47:03.577 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:03.574+0000 7ff834e99640 1 -- 172.21.15.121:0/4238023199 shutdown_connections 2024-08-18T22:47:03.577 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:03.574+0000 7ff834e99640 1 -- 172.21.15.121:0/4238023199 wait complete. 2024-08-18T22:47:03.577 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:03.575+0000 7ff834e99640 1 Processor -- start 2024-08-18T22:47:03.577 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:03.575+0000 7ff834e99640 1 -- start start 2024-08-18T22:47:03.577 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:03.575+0000 7ff834e99640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff830064f80 0x7ff83010cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:47:03.577 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:03.575+0000 7ff834e99640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff830065390 0x7ff83010d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:47:03.577 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:03.575+0000 7ff834e99640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff83010da90 con 0x7ff830064f80 2024-08-18T22:47:03.577 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:03.575+0000 7ff834e99640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff83010e2b0 con 0x7ff830065390 2024-08-18T22:47:03.577 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:03.575+0000 7ff82e59c640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff830064f80 0x7ff83010cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:47:03.577 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:03.575+0000 7ff82e59c640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff830064f80 0x7ff83010cf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:57288/0 (socket says 172.21.15.121:57288) 2024-08-18T22:47:03.577 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:03.575+0000 7ff82e59c640 1 -- 172.21.15.121:0/3710849883 learned_addr learned my addr 172.21.15.121:0/3710849883 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-18T22:47:03.578 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:03.575+0000 7ff82dd9b640 1 --2- 172.21.15.121:0/3710849883 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff830065390 0x7ff83010d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:47:03.578 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:03.575+0000 7ff82e59c640 1 -- 172.21.15.121:0/3710849883 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff830065390 msgr2=0x7ff83010d440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:47:03.578 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:03.575+0000 7ff82e59c640 1 --2- 172.21.15.121:0/3710849883 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff830065390 0x7ff83010d440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:47:03.578 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:03.575+0000 7ff82e59c640 1 -- 172.21.15.121:0/3710849883 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff820005040 con 0x7ff830064f80 2024-08-18T22:47:03.578 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:03.576+0000 7ff82e59c640 1 --2- 172.21.15.121:0/3710849883 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff830064f80 0x7ff83010cf00 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7ff820000c00 tx=0x7ff820009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:47:03.579 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:03.576+0000 7ff81effd640 1 -- 172.21.15.121:0/3710849883 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff820038070 con 0x7ff830064f80 2024-08-18T22:47:03.579 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:03.576+0000 7ff81effd640 1 -- 172.21.15.121:0/3710849883 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7ff82002ae90 con 0x7ff830064f80 2024-08-18T22:47:03.579 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:03.576+0000 7ff834e99640 1 -- 172.21.15.121:0/3710849883 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff83010e4e0 con 0x7ff830064f80 2024-08-18T22:47:03.579 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:03.576+0000 7ff81effd640 1 -- 172.21.15.121:0/3710849883 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff82003d420 con 0x7ff830064f80 2024-08-18T22:47:03.579 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:03.576+0000 7ff834e99640 1 -- 172.21.15.121:0/3710849883 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff83010ea20 con 0x7ff830064f80 2024-08-18T22:47:03.579 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:03.577+0000 7ff834e99640 1 -- 172.21.15.121:0/3710849883 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8300f9e00 con 0x7ff830064f80 2024-08-18T22:47:03.579 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:03.577+0000 7ff81effd640 1 -- 172.21.15.121:0/3710849883 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 37) v1 ==== 92205+0+0 (secure 0 0 0) 0x7ff820030020 con 0x7ff830064f80 2024-08-18T22:47:03.579 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:03.578+0000 7ff81effd640 1 --2- 172.21.15.121:0/3710849883 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7ff81806e0b0 0x7ff818070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:47:03.579 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:03.578+0000 7ff81effd640 1 -- 172.21.15.121:0/3710849883 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6496+0+0 (secure 0 0 0) 0x7ff8200ae2a0 con 0x7ff830064f80 2024-08-18T22:47:03.579 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:03.578+0000 7ff82dd9b640 1 --2- 172.21.15.121:0/3710849883 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7ff81806e0b0 0x7ff818070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:47:03.580 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:03.578+0000 7ff82dd9b640 1 --2- 172.21.15.121:0/3710849883 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7ff81806e0b0 0x7ff818070560 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7ff83010ccb0 tx=0x7ff824009040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:47:03.583 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:03.582+0000 7ff81effd640 1 -- 172.21.15.121:0/3710849883 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7ff8200775d0 con 0x7ff830064f80 2024-08-18T22:47:03.659 INFO:journalctl@ceph.osd.4.smithi195.stdout:Aug 18 22:47:03 smithi195 podman[82887]: 2024-08-18 22:47:03.393637026 +0000 UTC m=+0.617002160 container remove 7d43fdb61107712fe0df70d2e55d75c3cf4236cc9061d40a20eae480d1b8df55 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-4-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, RELEASE=squid-de09dd0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, ceph=True, io.buildah.version=1.36.0, org.label-schema.schema-version=1.0) 2024-08-18T22:47:03.659 INFO:journalctl@ceph.osd.4.smithi195.stdout:Aug 18 22:47:03 smithi195 systemd[1]: ceph-b003123a-5db1-11ef-bccf-c7b262605968@osd.4.service: Deactivated successfully. 2024-08-18T22:47:03.659 INFO:journalctl@ceph.osd.4.smithi195.stdout:Aug 18 22:47:03 smithi195 systemd[1]: Stopped Ceph osd.4 for b003123a-5db1-11ef-bccf-c7b262605968. 2024-08-18T22:47:03.659 INFO:journalctl@ceph.osd.4.smithi195.stdout:Aug 18 22:47:03 smithi195 systemd[1]: ceph-b003123a-5db1-11ef-bccf-c7b262605968@osd.4.service: Consumed 47.762s CPU time. 2024-08-18T22:47:03.659 INFO:journalctl@ceph.osd.4.smithi195.stdout:Aug 18 22:47:03 smithi195 systemd[1]: Starting Ceph osd.4 for b003123a-5db1-11ef-bccf-c7b262605968... 2024-08-18T22:47:03.767 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:03.766+0000 7ff834e99640 1 -- 172.21.15.121:0/3710849883 --> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ff83010ed50 con 0x7ff81806e0b0 2024-08-18T22:47:03.768 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:03.767+0000 7ff81effd640 1 -- 172.21.15.121:0/3710849883 <== mgr.34102 v2:172.21.15.121:6800/3037387239 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7ff83010ed50 con 0x7ff81806e0b0 2024-08-18T22:47:03.768 INFO:teuthology.orchestra.run.smithi121.stdout:{ 2024-08-18T22:47:03.768 INFO:teuthology.orchestra.run.smithi121.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9", 2024-08-18T22:47:03.768 INFO:teuthology.orchestra.run.smithi121.stdout: "in_progress": true, 2024-08-18T22:47:03.768 INFO:teuthology.orchestra.run.smithi121.stdout: "which": "Upgrading all daemon types on all hosts", 2024-08-18T22:47:03.768 INFO:teuthology.orchestra.run.smithi121.stdout: "services_complete": [ 2024-08-18T22:47:03.768 INFO:teuthology.orchestra.run.smithi121.stdout: "mgr", 2024-08-18T22:47:03.768 INFO:teuthology.orchestra.run.smithi121.stdout: "mon", 2024-08-18T22:47:03.768 INFO:teuthology.orchestra.run.smithi121.stdout: "crash" 2024-08-18T22:47:03.769 INFO:teuthology.orchestra.run.smithi121.stdout: ], 2024-08-18T22:47:03.769 INFO:teuthology.orchestra.run.smithi121.stdout: "progress": "10/21 daemons upgraded", 2024-08-18T22:47:03.769 INFO:teuthology.orchestra.run.smithi121.stdout: "message": "Currently upgrading osd daemons", 2024-08-18T22:47:03.769 INFO:teuthology.orchestra.run.smithi121.stdout: "is_paused": false 2024-08-18T22:47:03.769 INFO:teuthology.orchestra.run.smithi121.stdout:} 2024-08-18T22:47:03.770 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:03.769+0000 7ff834e99640 1 -- 172.21.15.121:0/3710849883 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7ff81806e0b0 msgr2=0x7ff818070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:47:03.770 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:03.769+0000 7ff834e99640 1 --2- 172.21.15.121:0/3710849883 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7ff81806e0b0 0x7ff818070560 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7ff83010ccb0 tx=0x7ff824009040 comp rx=0 tx=0).stop 2024-08-18T22:47:03.770 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:03.769+0000 7ff834e99640 1 -- 172.21.15.121:0/3710849883 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff830064f80 msgr2=0x7ff83010cf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:47:03.770 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:03.769+0000 7ff834e99640 1 --2- 172.21.15.121:0/3710849883 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff830064f80 0x7ff83010cf00 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7ff820000c00 tx=0x7ff820009da0 comp rx=0 tx=0).stop 2024-08-18T22:47:03.770 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:03.769+0000 7ff834e99640 1 -- 172.21.15.121:0/3710849883 shutdown_connections 2024-08-18T22:47:03.770 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:03.769+0000 7ff834e99640 1 --2- 172.21.15.121:0/3710849883 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7ff81806e0b0 0x7ff818070560 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:47:03.771 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:03.769+0000 7ff834e99640 1 --2- 172.21.15.121:0/3710849883 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff830065390 0x7ff83010d440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:47:03.771 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:03.769+0000 7ff834e99640 1 --2- 172.21.15.121:0/3710849883 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff830064f80 0x7ff83010cf00 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:47:03.771 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:03.769+0000 7ff834e99640 1 -- 172.21.15.121:0/3710849883 >> 172.21.15.121:0/3710849883 conn(0x7ff8300f6160 msgr2=0x7ff8300fce90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:47:03.771 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:03.769+0000 7ff834e99640 1 -- 172.21.15.121:0/3710849883 shutdown_connections 2024-08-18T22:47:03.771 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:03.769+0000 7ff834e99640 1 -- 172.21.15.121:0/3710849883 wait complete. 2024-08-18T22:47:03.833 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:47:03 smithi121 ceph-mon[81053]: from='client.34312 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-18T22:47:03.833 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:47:03 smithi121 ceph-mon[81053]: pgmap v127: 65 pgs: 16 peering, 3 stale+active+clean, 46 active+clean; 2.0 GiB data, 6.6 GiB used, 530 GiB / 536 GiB avail 2024-08-18T22:47:03.834 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:47:03 smithi121 ceph-mon[81053]: from='client.34316 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-18T22:47:03.834 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:47:03 smithi121 ceph-mon[81053]: Health check failed: Reduced data availability: 3 pgs peering (PG_AVAILABILITY) 2024-08-18T22:47:03.834 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:47:03 smithi121 ceph-mon[81053]: from='client.? 172.21.15.121:0/1587535075' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-08-18T22:47:03.834 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:47:03 smithi121 ceph-mon[81053]: from='client.? 172.21.15.121:0/694806717' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-08-18T22:47:03.848 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:03.847+0000 7f8a2bf32640 1 -- 172.21.15.121:0/58127528 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8a240fb1d0 msgr2=0x7f8a240fb5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:47:03.849 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:03.847+0000 7f8a2bf32640 1 --2- 172.21.15.121:0/58127528 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8a240fb1d0 0x7f8a240fb5e0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f8a1c009c50 tx=0x7f8a1c004d10 comp rx=0 tx=0).stop 2024-08-18T22:47:03.849 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:03.847+0000 7f8a2bf32640 1 -- 172.21.15.121:0/58127528 shutdown_connections 2024-08-18T22:47:03.849 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:03.847+0000 7f8a2bf32640 1 --2- 172.21.15.121:0/58127528 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8a240fc4a0 0x7f8a240fc910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:47:03.849 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:03.847+0000 7f8a2bf32640 1 --2- 172.21.15.121:0/58127528 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8a240fb1d0 0x7f8a240fb5e0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:47:03.849 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:03.847+0000 7f8a2bf32640 1 -- 172.21.15.121:0/58127528 >> 172.21.15.121:0/58127528 conn(0x7f8a240f69b0 msgr2=0x7f8a240f8dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:47:03.849 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:03.848+0000 7f8a2bf32640 1 -- 172.21.15.121:0/58127528 shutdown_connections 2024-08-18T22:47:03.849 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:03.848+0000 7f8a2bf32640 1 -- 172.21.15.121:0/58127528 wait complete. 2024-08-18T22:47:03.851 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:03.848+0000 7f8a2bf32640 1 Processor -- start 2024-08-18T22:47:03.851 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:03.848+0000 7f8a2bf32640 1 -- start start 2024-08-18T22:47:03.851 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:03.848+0000 7f8a2bf32640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8a240fb1d0 0x7f8a2410f010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:47:03.851 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:03.848+0000 7f8a2bf32640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8a240fc4a0 0x7f8a2410f550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:47:03.851 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:03.848+0000 7f8a2bf32640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a2410fba0 con 0x7f8a240fb1d0 2024-08-18T22:47:03.851 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:03.848+0000 7f8a2bf32640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a241103c0 con 0x7f8a240fc4a0 2024-08-18T22:47:03.851 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:03.848+0000 7f8a29cce640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8a240fb1d0 0x7f8a2410f010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:47:03.851 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:03.848+0000 7f8a29cce640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8a240fb1d0 0x7f8a2410f010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:57302/0 (socket says 172.21.15.121:57302) 2024-08-18T22:47:03.851 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:03.848+0000 7f8a29cce640 1 -- 172.21.15.121:0/1503177625 learned_addr learned my addr 172.21.15.121:0/1503177625 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-18T22:47:03.852 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:03.849+0000 7f8a29cce640 1 -- 172.21.15.121:0/1503177625 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8a240fc4a0 msgr2=0x7f8a2410f550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:47:03.852 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:03.849+0000 7f8a29cce640 1 --2- 172.21.15.121:0/1503177625 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8a240fc4a0 0x7f8a2410f550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:47:03.852 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:03.849+0000 7f8a29cce640 1 -- 172.21.15.121:0/1503177625 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a1c0098b0 con 0x7f8a240fb1d0 2024-08-18T22:47:03.852 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:03.849+0000 7f8a29cce640 1 --2- 172.21.15.121:0/1503177625 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8a240fb1d0 0x7f8a2410f010 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f8a1c004a30 tx=0x7f8a1c004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:47:03.852 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:03.849+0000 7f8a227fc640 1 -- 172.21.15.121:0/1503177625 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8a1c009710 con 0x7f8a240fb1d0 2024-08-18T22:47:03.852 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:03.849+0000 7f8a227fc640 1 -- 172.21.15.121:0/1503177625 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f8a1c032b10 con 0x7f8a240fb1d0 2024-08-18T22:47:03.852 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:03.849+0000 7f8a2bf32640 1 -- 172.21.15.121:0/1503177625 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a241105f0 con 0x7f8a240fb1d0 2024-08-18T22:47:03.852 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:03.849+0000 7f8a227fc640 1 -- 172.21.15.121:0/1503177625 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8a1c03db10 con 0x7f8a240fb1d0 2024-08-18T22:47:03.852 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:03.849+0000 7f8a2bf32640 1 -- 172.21.15.121:0/1503177625 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a24110b10 con 0x7f8a240fb1d0 2024-08-18T22:47:03.852 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:03.850+0000 7f8a2bf32640 1 -- 172.21.15.121:0/1503177625 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a240fa630 con 0x7f8a240fb1d0 2024-08-18T22:47:03.853 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:03.851+0000 7f8a227fc640 1 -- 172.21.15.121:0/1503177625 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 37) v1 ==== 92205+0+0 (secure 0 0 0) 0x7f8a1c02f030 con 0x7f8a240fb1d0 2024-08-18T22:47:03.853 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:03.851+0000 7f8a227fc640 1 --2- 172.21.15.121:0/1503177625 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f8a0c06e0b0 0x7f8a0c070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:47:03.853 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:03.851+0000 7f8a227fc640 1 -- 172.21.15.121:0/1503177625 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f8a1c0af1f0 con 0x7f8a240fb1d0 2024-08-18T22:47:03.853 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:03.851+0000 7f8a294cd640 1 --2- 172.21.15.121:0/1503177625 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f8a0c06e0b0 0x7f8a0c070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:47:03.853 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:03.852+0000 7f8a294cd640 1 --2- 172.21.15.121:0/1503177625 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f8a0c06e0b0 0x7f8a0c070560 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f8a18009af0 tx=0x7f8a18009cd0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:47:03.856 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:03.855+0000 7f8a227fc640 1 -- 172.21.15.121:0/1503177625 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f8a1c0785a0 con 0x7f8a240fb1d0 2024-08-18T22:47:03.979 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:47:03 smithi195 ceph-mon[68841]: from='client.34312 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-18T22:47:03.979 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:47:03 smithi195 ceph-mon[68841]: pgmap v127: 65 pgs: 16 peering, 3 stale+active+clean, 46 active+clean; 2.0 GiB data, 6.6 GiB used, 530 GiB / 536 GiB avail 2024-08-18T22:47:03.979 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:47:03 smithi195 ceph-mon[68841]: from='client.34316 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-18T22:47:03.979 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:47:03 smithi195 ceph-mon[68841]: Health check failed: Reduced data availability: 3 pgs peering (PG_AVAILABILITY) 2024-08-18T22:47:03.979 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:47:03 smithi195 ceph-mon[68841]: from='client.? 172.21.15.121:0/1587535075' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-08-18T22:47:03.979 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:47:03 smithi195 ceph-mon[68841]: from='client.? 172.21.15.121:0/694806717' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-08-18T22:47:03.980 INFO:journalctl@ceph.osd.4.smithi195.stdout:Aug 18 22:47:03 smithi195 podman[82988]: 2024-08-18 22:47:03.746160118 +0000 UTC m=+0.017689910 image pull ea7a5189f30bad3aca9524788e2965d2368d7ce786df09d4edcd8c3edf9cefba quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9 2024-08-18T22:47:03.980 INFO:journalctl@ceph.osd.4.smithi195.stdout:Aug 18 22:47:03 smithi195 podman[82988]: 2024-08-18 22:47:03.863058858 +0000 UTC m=+0.134588654 container create 790e48a4ef91a1c2209c29786d6aca58f151bed7e23e1b3602e25c969882c33b (image=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-4-activate, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, io.buildah.version=1.36.0, org.label-schema.build-date=20240731, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-de09dd0, org.label-schema.vendor=CentOS) 2024-08-18T22:47:04.087 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:04.085+0000 7f8a2bf32640 1 -- 172.21.15.121:0/1503177625 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f8a2404b4c0 con 0x7f8a240fb1d0 2024-08-18T22:47:04.087 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:04.086+0000 7f8a227fc640 1 -- 172.21.15.121:0/1503177625 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+598 (secure 0 0 0) 0x7f8a1c07bc60 con 0x7f8a240fb1d0 2024-08-18T22:47:04.087 INFO:teuthology.orchestra.run.smithi121.stdout:HEALTH_WARN 1 MDSs report slow requests; 1 osds down; Reduced data availability: 3 pgs peering 2024-08-18T22:47:04.087 INFO:teuthology.orchestra.run.smithi121.stdout:[WRN] MDS_SLOW_REQUEST: 1 MDSs report slow requests 2024-08-18T22:47:04.087 INFO:teuthology.orchestra.run.smithi121.stdout: mds.cephfs.smithi121.gbickb(mds.0): 3 slow requests are blocked > 180 secs 2024-08-18T22:47:04.087 INFO:teuthology.orchestra.run.smithi121.stdout:[WRN] OSD_DOWN: 1 osds down 2024-08-18T22:47:04.087 INFO:teuthology.orchestra.run.smithi121.stdout: osd.4 (root=default,host=smithi195) is down 2024-08-18T22:47:04.087 INFO:teuthology.orchestra.run.smithi121.stdout:[WRN] PG_AVAILABILITY: Reduced data availability: 3 pgs peering 2024-08-18T22:47:04.087 INFO:teuthology.orchestra.run.smithi121.stdout: pg 2.f is stuck peering for 4m, current state peering, last acting [0,5] 2024-08-18T22:47:04.087 INFO:teuthology.orchestra.run.smithi121.stdout: pg 3.3 is stuck peering for 4m, current state peering, last acting [0,3] 2024-08-18T22:47:04.088 INFO:teuthology.orchestra.run.smithi121.stdout: pg 3.1a is stuck peering for 4m, current state peering, last acting [1,2] 2024-08-18T22:47:04.089 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:04.088+0000 7f8a2bf32640 1 -- 172.21.15.121:0/1503177625 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f8a0c06e0b0 msgr2=0x7f8a0c070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:47:04.089 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:04.088+0000 7f8a2bf32640 1 --2- 172.21.15.121:0/1503177625 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f8a0c06e0b0 0x7f8a0c070560 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f8a18009af0 tx=0x7f8a18009cd0 comp rx=0 tx=0).stop 2024-08-18T22:47:04.089 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:04.088+0000 7f8a2bf32640 1 -- 172.21.15.121:0/1503177625 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8a240fb1d0 msgr2=0x7f8a2410f010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:47:04.089 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:04.088+0000 7f8a2bf32640 1 --2- 172.21.15.121:0/1503177625 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8a240fb1d0 0x7f8a2410f010 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f8a1c004a30 tx=0x7f8a1c004d10 comp rx=0 tx=0).stop 2024-08-18T22:47:04.089 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:04.088+0000 7f8a2bf32640 1 -- 172.21.15.121:0/1503177625 shutdown_connections 2024-08-18T22:47:04.089 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:04.088+0000 7f8a2bf32640 1 --2- 172.21.15.121:0/1503177625 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f8a0c06e0b0 0x7f8a0c070560 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:47:04.089 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:04.088+0000 7f8a2bf32640 1 --2- 172.21.15.121:0/1503177625 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8a240fc4a0 0x7f8a2410f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:47:04.089 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:04.088+0000 7f8a2bf32640 1 --2- 172.21.15.121:0/1503177625 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8a240fb1d0 0x7f8a2410f010 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:47:04.089 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:04.088+0000 7f8a2bf32640 1 -- 172.21.15.121:0/1503177625 >> 172.21.15.121:0/1503177625 conn(0x7f8a240f69b0 msgr2=0x7f8a24065390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:47:04.089 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:04.088+0000 7f8a2bf32640 1 -- 172.21.15.121:0/1503177625 shutdown_connections 2024-08-18T22:47:04.089 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:04.088+0000 7f8a2bf32640 1 -- 172.21.15.121:0/1503177625 wait complete. 2024-08-18T22:47:04.229 INFO:journalctl@ceph.osd.4.smithi195.stdout:Aug 18 22:47:04 smithi195 podman[82988]: 2024-08-18 22:47:04.098840127 +0000 UTC m=+0.370369926 container init 790e48a4ef91a1c2209c29786d6aca58f151bed7e23e1b3602e25c969882c33b (image=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-4-activate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, io.buildah.version=1.36.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, RELEASE=squid-de09dd0, ceph=True, GIT_CLEAN=True) 2024-08-18T22:47:04.229 INFO:journalctl@ceph.osd.4.smithi195.stdout:Aug 18 22:47:04 smithi195 podman[82988]: 2024-08-18 22:47:04.102108912 +0000 UTC m=+0.373638707 container start 790e48a4ef91a1c2209c29786d6aca58f151bed7e23e1b3602e25c969882c33b (image=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-4-activate, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , RELEASE=squid-de09dd0, ceph=True, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, io.buildah.version=1.36.0) 2024-08-18T22:47:04.229 INFO:journalctl@ceph.osd.4.smithi195.stdout:Aug 18 22:47:04 smithi195 podman[82988]: 2024-08-18 22:47:04.157071397 +0000 UTC m=+0.428601190 container attach 790e48a4ef91a1c2209c29786d6aca58f151bed7e23e1b3602e25c969882c33b (image=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-4-activate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, io.buildah.version=1.36.0, RELEASE=squid-de09dd0, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0) 2024-08-18T22:47:04.229 INFO:journalctl@ceph.osd.4.smithi195.stdout:Aug 18 22:47:04 smithi195 ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-4-activate[83003]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-08-18T22:47:04.229 INFO:journalctl@ceph.osd.4.smithi195.stdout:Aug 18 22:47:04 smithi195 bash[82988]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-08-18T22:47:04.654 INFO:journalctl@ceph.osd.4.smithi195.stdout:Aug 18 22:47:04 smithi195 ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-4-activate[83003]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-08-18T22:47:04.654 INFO:journalctl@ceph.osd.4.smithi195.stdout:Aug 18 22:47:04 smithi195 bash[82988]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-08-18T22:47:04.654 INFO:journalctl@ceph.osd.4.smithi195.stdout:Aug 18 22:47:04 smithi195 ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-4-activate[83003]: --> Failed to activate via raw: activate() takes 1 positional argument but 5 were given 2024-08-18T22:47:04.654 INFO:journalctl@ceph.osd.4.smithi195.stdout:Aug 18 22:47:04 smithi195 bash[82988]: --> Failed to activate via raw: activate() takes 1 positional argument but 5 were given 2024-08-18T22:47:04.654 INFO:journalctl@ceph.osd.4.smithi195.stdout:Aug 18 22:47:04 smithi195 ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-4-activate[83003]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-08-18T22:47:04.655 INFO:journalctl@ceph.osd.4.smithi195.stdout:Aug 18 22:47:04 smithi195 bash[82988]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-08-18T22:47:04.655 INFO:journalctl@ceph.osd.4.smithi195.stdout:Aug 18 22:47:04 smithi195 ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-4-activate[83003]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-08-18T22:47:04.655 INFO:journalctl@ceph.osd.4.smithi195.stdout:Aug 18 22:47:04 smithi195 bash[82988]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-08-18T22:47:04.655 INFO:journalctl@ceph.osd.4.smithi195.stdout:Aug 18 22:47:04 smithi195 ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-4-activate[83003]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-08-18T22:47:04.655 INFO:journalctl@ceph.osd.4.smithi195.stdout:Aug 18 22:47:04 smithi195 bash[82988]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-08-18T22:47:04.655 INFO:journalctl@ceph.osd.4.smithi195.stdout:Aug 18 22:47:04 smithi195 ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-4-activate[83003]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_3 --path /var/lib/ceph/osd/ceph-4 --no-mon-config 2024-08-18T22:47:04.655 INFO:journalctl@ceph.osd.4.smithi195.stdout:Aug 18 22:47:04 smithi195 bash[82988]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_3 --path /var/lib/ceph/osd/ceph-4 --no-mon-config 2024-08-18T22:47:04.655 INFO:journalctl@ceph.osd.4.smithi195.stdout:Aug 18 22:47:04 smithi195 ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-4-activate[83003]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-4/block 2024-08-18T22:47:04.655 INFO:journalctl@ceph.osd.4.smithi195.stdout:Aug 18 22:47:04 smithi195 bash[82988]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-4/block 2024-08-18T22:47:04.655 INFO:journalctl@ceph.osd.4.smithi195.stdout:Aug 18 22:47:04 smithi195 ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-4-activate[83003]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-4/block 2024-08-18T22:47:04.655 INFO:journalctl@ceph.osd.4.smithi195.stdout:Aug 18 22:47:04 smithi195 bash[82988]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-4/block 2024-08-18T22:47:04.655 INFO:journalctl@ceph.osd.4.smithi195.stdout:Aug 18 22:47:04 smithi195 ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-4-activate[83003]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-08-18T22:47:04.655 INFO:journalctl@ceph.osd.4.smithi195.stdout:Aug 18 22:47:04 smithi195 bash[82988]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-08-18T22:47:04.655 INFO:journalctl@ceph.osd.4.smithi195.stdout:Aug 18 22:47:04 smithi195 ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-4-activate[83003]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-08-18T22:47:04.656 INFO:journalctl@ceph.osd.4.smithi195.stdout:Aug 18 22:47:04 smithi195 bash[82988]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-08-18T22:47:04.656 INFO:journalctl@ceph.osd.4.smithi195.stdout:Aug 18 22:47:04 smithi195 ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-4-activate[83003]: --> ceph-volume lvm activate successful for osd ID: 4 2024-08-18T22:47:04.656 INFO:journalctl@ceph.osd.4.smithi195.stdout:Aug 18 22:47:04 smithi195 bash[82988]: --> ceph-volume lvm activate successful for osd ID: 4 2024-08-18T22:47:04.656 INFO:journalctl@ceph.osd.4.smithi195.stdout:Aug 18 22:47:04 smithi195 podman[82988]: 2024-08-18 22:47:04.385353589 +0000 UTC m=+0.656883380 container died 790e48a4ef91a1c2209c29786d6aca58f151bed7e23e1b3602e25c969882c33b (image=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-4-activate, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, ceph=True, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, RELEASE=squid-de09dd0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, io.buildah.version=1.36.0, org.label-schema.name=CentOS Stream 9 Base Image) 2024-08-18T22:47:04.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:47:04 smithi195 ceph-mon[68841]: from='client.34320 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-18T22:47:04.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:47:04 smithi195 ceph-mon[68841]: from='client.34332 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-18T22:47:04.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:47:04 smithi195 ceph-mon[68841]: from='client.? 172.21.15.121:0/1503177625' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-08-18T22:47:05.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:47:04 smithi121 ceph-mon[81053]: from='client.34320 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-18T22:47:05.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:47:04 smithi121 ceph-mon[81053]: from='client.34332 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-18T22:47:05.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:47:04 smithi121 ceph-mon[81053]: from='client.? 172.21.15.121:0/1503177625' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-08-18T22:47:05.271 INFO:journalctl@ceph.osd.4.smithi195.stdout:Aug 18 22:47:04 smithi195 podman[83113]: 2024-08-18 22:47:04.928013292 +0000 UTC m=+0.536686644 container remove 790e48a4ef91a1c2209c29786d6aca58f151bed7e23e1b3602e25c969882c33b (image=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-4-activate, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-de09dd0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, io.buildah.version=1.36.0, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-08-18T22:47:05.271 INFO:journalctl@ceph.osd.4.smithi195.stdout:Aug 18 22:47:05 smithi195 podman[83173]: 2024-08-18 22:47:05.044532317 +0000 UTC m=+0.017475372 image pull ea7a5189f30bad3aca9524788e2965d2368d7ce786df09d4edcd8c3edf9cefba quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9 2024-08-18T22:47:05.271 INFO:journalctl@ceph.osd.4.smithi195.stdout:Aug 18 22:47:05 smithi195 podman[83173]: 2024-08-18 22:47:05.153759956 +0000 UTC m=+0.126702997 container create d88a83c9724731b5dc60aa4b46cc9bea6fafc35f907ed8bf04d380ad8b040bf3 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-4, io.buildah.version=1.36.0, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, RELEASE=squid-de09dd0, ceph=True, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD) 2024-08-18T22:47:05.659 INFO:journalctl@ceph.osd.4.smithi195.stdout:Aug 18 22:47:05 smithi195 podman[83173]: 2024-08-18 22:47:05.397833261 +0000 UTC m=+0.370776319 container init d88a83c9724731b5dc60aa4b46cc9bea6fafc35f907ed8bf04d380ad8b040bf3 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-4, org.label-schema.schema-version=1.0, GIT_CLEAN=True, RELEASE=squid-de09dd0, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, io.buildah.version=1.36.0) 2024-08-18T22:47:05.659 INFO:journalctl@ceph.osd.4.smithi195.stdout:Aug 18 22:47:05 smithi195 podman[83173]: 2024-08-18 22:47:05.400946496 +0000 UTC m=+0.373889537 container start d88a83c9724731b5dc60aa4b46cc9bea6fafc35f907ed8bf04d380ad8b040bf3 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-4, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-de09dd0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, io.buildah.version=1.36.0, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , ceph=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0) 2024-08-18T22:47:05.659 INFO:journalctl@ceph.osd.4.smithi195.stdout:Aug 18 22:47:05 smithi195 ceph-osd[83193]: -- 172.21.15.195:0/1540733922 <== mon.1 v2:172.21.15.195:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5583ed98a1e0 con 0x5583ed922000 2024-08-18T22:47:05.659 INFO:journalctl@ceph.osd.4.smithi195.stdout:Aug 18 22:47:05 smithi195 bash[83173]: d88a83c9724731b5dc60aa4b46cc9bea6fafc35f907ed8bf04d380ad8b040bf3 2024-08-18T22:47:05.659 INFO:journalctl@ceph.osd.4.smithi195.stdout:Aug 18 22:47:05 smithi195 systemd[1]: Started Ceph osd.4 for b003123a-5db1-11ef-bccf-c7b262605968. 2024-08-18T22:47:06.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:47:05 smithi121 ceph-mon[81053]: pgmap v128: 65 pgs: 16 peering, 1 stale+active+clean, 16 active+undersized+degraded, 32 active+clean; 2.0 GiB data, 6.6 GiB used, 530 GiB / 536 GiB avail; 2831/34143 objects degraded (8.292%) 2024-08-18T22:47:06.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:47:05 smithi121 ceph-mon[81053]: Health check failed: Degraded data redundancy: 2831/34143 objects degraded (8.292%), 16 pgs degraded (PG_DEGRADED) 2024-08-18T22:47:06.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:47:05 smithi121 ceph-mon[81053]: 3 slow requests, 0 included below; oldest blocked for > 336.870042 secs 2024-08-18T22:47:06.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:47:05 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:47:06.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:47:05 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:47:06.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:47:05 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-18T22:47:06.146 INFO:journalctl@ceph.osd.4.smithi195.stdout:Aug 18 22:47:05 smithi195 ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-4[83189]: 2024-08-18T22:47:05.946+0000 7f3cade06640 -1 Falling back to public interface 2024-08-18T22:47:06.146 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:47:05 smithi195 ceph-mon[68841]: pgmap v128: 65 pgs: 16 peering, 1 stale+active+clean, 16 active+undersized+degraded, 32 active+clean; 2.0 GiB data, 6.6 GiB used, 530 GiB / 536 GiB avail; 2831/34143 objects degraded (8.292%) 2024-08-18T22:47:06.146 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:47:05 smithi195 ceph-mon[68841]: Health check failed: Degraded data redundancy: 2831/34143 objects degraded (8.292%), 16 pgs degraded (PG_DEGRADED) 2024-08-18T22:47:06.146 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:47:05 smithi195 ceph-mon[68841]: 3 slow requests, 0 included below; oldest blocked for > 336.870042 secs 2024-08-18T22:47:06.146 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:47:05 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:47:06.146 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:47:05 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:47:06.146 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:47:05 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-18T22:47:08.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:47:07 smithi121 ceph-mon[81053]: pgmap v129: 65 pgs: 8 peering, 26 active+undersized+degraded, 31 active+clean; 2.0 GiB data, 6.6 GiB used, 530 GiB / 536 GiB avail; 4902/34143 objects degraded (14.357%) 2024-08-18T22:47:08.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:47:07 smithi195 ceph-mon[68841]: pgmap v129: 65 pgs: 8 peering, 26 active+undersized+degraded, 31 active+clean; 2.0 GiB data, 6.6 GiB used, 530 GiB / 536 GiB avail; 4902/34143 objects degraded (14.357%) 2024-08-18T22:47:09.575 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:47:09 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:47:09.575 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:47:09 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:47:09.576 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:47:09 smithi195 ceph-mon[68841]: pgmap v130: 65 pgs: 34 active+undersized+degraded, 31 active+clean; 2.0 GiB data, 6.6 GiB used, 530 GiB / 536 GiB avail; 6361/34143 objects degraded (18.630%) 2024-08-18T22:47:09.576 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:47:09 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:47:09.576 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:47:09 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-18T22:47:09.576 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:47:09 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:47:09.576 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:47:09 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:47:09.583 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:47:09 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:47:09.583 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:47:09 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:47:09.583 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:47:09 smithi121 ceph-mon[81053]: pgmap v130: 65 pgs: 34 active+undersized+degraded, 31 active+clean; 2.0 GiB data, 6.6 GiB used, 530 GiB / 536 GiB avail; 6361/34143 objects degraded (18.630%) 2024-08-18T22:47:09.583 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:47:09 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:47:09.584 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:47:09 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-18T22:47:09.584 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:47:09 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:47:09.584 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:47:09 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:47:10.563 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:47:10 smithi195 ceph-mon[68841]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 2 pgs peering) 2024-08-18T22:47:10.583 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:47:10 smithi121 ceph-mon[81053]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 2 pgs peering) 2024-08-18T22:47:11.159 INFO:journalctl@ceph.osd.4.smithi195.stdout:Aug 18 22:47:10 smithi195 ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-4[83189]: 2024-08-18T22:47:10.893+0000 7f3cade06640 -1 osd.4 70 log_to_monitors true 2024-08-18T22:47:11.583 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:47:11 smithi121 ceph-mon[81053]: 3 slow requests, 0 included below; oldest blocked for > 341.870155 secs 2024-08-18T22:47:11.584 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:47:11 smithi121 ceph-mon[81053]: pgmap v131: 65 pgs: 34 active+undersized+degraded, 31 active+clean; 2.0 GiB data, 6.6 GiB used, 530 GiB / 536 GiB avail; 6361/34143 objects degraded (18.630%) 2024-08-18T22:47:11.584 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:47:11 smithi121 ceph-mon[81053]: from='osd.4 [v2:172.21.15.195:6808/4281167509,v1:172.21.15.195:6809/4281167509]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-08-18T22:47:11.584 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:47:11 smithi121 ceph-mon[81053]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-08-18T22:47:11.659 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:47:11 smithi195 ceph-mon[68841]: 3 slow requests, 0 included below; oldest blocked for > 341.870155 secs 2024-08-18T22:47:11.659 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:47:11 smithi195 ceph-mon[68841]: pgmap v131: 65 pgs: 34 active+undersized+degraded, 31 active+clean; 2.0 GiB data, 6.6 GiB used, 530 GiB / 536 GiB avail; 6361/34143 objects degraded (18.630%) 2024-08-18T22:47:11.659 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:47:11 smithi195 ceph-mon[68841]: from='osd.4 [v2:172.21.15.195:6808/4281167509,v1:172.21.15.195:6809/4281167509]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-08-18T22:47:11.659 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:47:11 smithi195 ceph-mon[68841]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-08-18T22:47:11.660 INFO:journalctl@ceph.osd.4.smithi195.stdout:Aug 18 22:47:11 smithi195 ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-4[83189]: 2024-08-18T22:47:11.331+0000 7f3ca5ba0640 -1 osd.4 70 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-18T22:47:12.317 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:47:12 smithi195 ceph-mon[68841]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-08-18T22:47:12.317 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:47:12 smithi195 ceph-mon[68841]: osdmap e73: 6 total, 5 up, 6 in 2024-08-18T22:47:12.583 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:47:12 smithi121 ceph-mon[81053]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-08-18T22:47:12.584 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:47:12 smithi121 ceph-mon[81053]: osdmap e73: 6 total, 5 up, 6 in 2024-08-18T22:47:12.584 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:47:12 smithi121 ceph-mon[81053]: from='osd.4 [v2:172.21.15.195:6808/4281167509,v1:172.21.15.195:6809/4281167509]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]: dispatch 2024-08-18T22:47:12.584 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:47:12 smithi121 ceph-mon[81053]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]: dispatch 2024-08-18T22:47:12.584 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:47:12 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:47:12.584 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:47:12 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:47:12.584 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:47:12 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:47:12.584 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:47:12 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-18T22:47:12.584 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:47:12 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:47:12.584 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:47:12 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-18T22:47:12.584 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:47:12 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "versions"}]: dispatch 2024-08-18T22:47:12.585 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:47:12 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "versions"}]: dispatch 2024-08-18T22:47:12.585 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:47:12 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "versions"}]: dispatch 2024-08-18T22:47:12.585 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:47:12 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-08-18T22:47:12.585 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:47:12 smithi121 ceph-mon[81053]: Health check update: Degraded data redundancy: 6361/34143 objects degraded (18.630%), 34 pgs degraded (PG_DEGRADED) 2024-08-18T22:47:12.659 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:47:12 smithi195 ceph-mon[68841]: from='osd.4 [v2:172.21.15.195:6808/4281167509,v1:172.21.15.195:6809/4281167509]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]: dispatch 2024-08-18T22:47:12.659 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:47:12 smithi195 ceph-mon[68841]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]: dispatch 2024-08-18T22:47:12.659 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:47:12 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:47:12.659 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:47:12 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:47:12.659 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:47:12 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:47:12.659 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:47:12 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-18T22:47:12.660 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:47:12 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:47:12.660 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:47:12 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-18T22:47:12.660 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:47:12 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "versions"}]: dispatch 2024-08-18T22:47:12.660 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:47:12 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "versions"}]: dispatch 2024-08-18T22:47:12.660 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:47:12 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "versions"}]: dispatch 2024-08-18T22:47:12.660 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:47:12 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-08-18T22:47:12.660 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:47:12 smithi195 ceph-mon[68841]: Health check update: Degraded data redundancy: 6361/34143 objects degraded (18.630%), 34 pgs degraded (PG_DEGRADED) 2024-08-18T22:47:13.584 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:47:13 smithi121 ceph-mon[81053]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-08-18T22:47:13.584 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:47:13 smithi121 ceph-mon[81053]: Upgrade: unsafe to stop osd(s) at this time (11 PGs are or would become offline) 2024-08-18T22:47:13.584 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:47:13 smithi121 ceph-mon[81053]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-08-18T22:47:13.584 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:47:13 smithi121 ceph-mon[81053]: osd.4 [v2:172.21.15.195:6808/4281167509,v1:172.21.15.195:6809/4281167509] boot 2024-08-18T22:47:13.584 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:47:13 smithi121 ceph-mon[81053]: osdmap e74: 6 total, 6 up, 6 in 2024-08-18T22:47:13.584 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:47:13 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-08-18T22:47:13.584 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:47:13 smithi121 ceph-mon[81053]: pgmap v134: 65 pgs: 34 active+undersized+degraded, 31 active+clean; 2.0 GiB data, 6.3 GiB used, 530 GiB / 536 GiB avail; 6361/34143 objects degraded (18.630%) 2024-08-18T22:47:13.584 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:47:13 smithi121 ceph-mon[81053]: osdmap e75: 6 total, 6 up, 6 in 2024-08-18T22:47:13.659 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:47:13 smithi195 ceph-mon[68841]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-08-18T22:47:13.659 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:47:13 smithi195 ceph-mon[68841]: Upgrade: unsafe to stop osd(s) at this time (11 PGs are or would become offline) 2024-08-18T22:47:13.659 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:47:13 smithi195 ceph-mon[68841]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-08-18T22:47:13.659 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:47:13 smithi195 ceph-mon[68841]: osd.4 [v2:172.21.15.195:6808/4281167509,v1:172.21.15.195:6809/4281167509] boot 2024-08-18T22:47:13.659 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:47:13 smithi195 ceph-mon[68841]: osdmap e74: 6 total, 6 up, 6 in 2024-08-18T22:47:13.659 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:47:13 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-08-18T22:47:13.659 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:47:13 smithi195 ceph-mon[68841]: pgmap v134: 65 pgs: 34 active+undersized+degraded, 31 active+clean; 2.0 GiB data, 6.3 GiB used, 530 GiB / 536 GiB avail; 6361/34143 objects degraded (18.630%) 2024-08-18T22:47:13.660 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:47:13 smithi195 ceph-mon[68841]: osdmap e75: 6 total, 6 up, 6 in 2024-08-18T22:47:15.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:47:15 smithi195 ceph-mon[68841]: pgmap v136: 65 pgs: 20 active+undersized+degraded, 45 active+clean; 2.0 GiB data, 6.3 GiB used, 530 GiB / 536 GiB avail; 3534/34143 objects degraded (10.351%) 2024-08-18T22:47:15.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:47:15 smithi195 ceph-mon[68841]: 3 slow requests, 0 included below; oldest blocked for > 346.870294 secs 2024-08-18T22:47:16.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:47:15 smithi121 ceph-mon[81053]: pgmap v136: 65 pgs: 20 active+undersized+degraded, 45 active+clean; 2.0 GiB data, 6.3 GiB used, 530 GiB / 536 GiB avail; 3534/34143 objects degraded (10.351%) 2024-08-18T22:47:16.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:47:15 smithi121 ceph-mon[81053]: 3 slow requests, 0 included below; oldest blocked for > 346.870294 secs 2024-08-18T22:47:17.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:47:17 smithi195 ceph-mon[68841]: pgmap v137: 65 pgs: 6 active+undersized+degraded, 59 active+clean; 2.0 GiB data, 6.3 GiB used, 530 GiB / 536 GiB avail; 1111/34143 objects degraded (3.254%) 2024-08-18T22:47:17.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:47:17 smithi195 ceph-mon[68841]: Health check update: Degraded data redundancy: 1111/34143 objects degraded (3.254%), 6 pgs degraded (PG_DEGRADED) 2024-08-18T22:47:18.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:47:17 smithi121 ceph-mon[81053]: pgmap v137: 65 pgs: 6 active+undersized+degraded, 59 active+clean; 2.0 GiB data, 6.3 GiB used, 530 GiB / 536 GiB avail; 1111/34143 objects degraded (3.254%) 2024-08-18T22:47:18.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:47:17 smithi121 ceph-mon[81053]: Health check update: Degraded data redundancy: 1111/34143 objects degraded (3.254%), 6 pgs degraded (PG_DEGRADED) 2024-08-18T22:47:19.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:47:18 smithi121 ceph-mon[81053]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 1111/34143 objects degraded (3.254%), 6 pgs degraded) 2024-08-18T22:47:19.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:47:18 smithi195 ceph-mon[68841]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 1111/34143 objects degraded (3.254%), 6 pgs degraded) 2024-08-18T22:47:20.060 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:47:19 smithi195 ceph-mon[68841]: pgmap v138: 65 pgs: 65 active+clean; 2.0 GiB data, 6.3 GiB used, 530 GiB / 536 GiB avail 2024-08-18T22:47:20.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:47:19 smithi121 ceph-mon[81053]: pgmap v138: 65 pgs: 65 active+clean; 2.0 GiB data, 6.3 GiB used, 530 GiB / 536 GiB avail 2024-08-18T22:47:21.076 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:47:20 smithi195 ceph-mon[68841]: 3 slow requests, 0 included below; oldest blocked for > 351.870431 secs 2024-08-18T22:47:21.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:47:20 smithi121 ceph-mon[81053]: 3 slow requests, 0 included below; oldest blocked for > 351.870431 secs 2024-08-18T22:47:22.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:47:21 smithi121 ceph-mon[81053]: pgmap v139: 65 pgs: 65 active+clean; 2.0 GiB data, 6.3 GiB used, 530 GiB / 536 GiB avail 2024-08-18T22:47:22.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:47:21 smithi195 ceph-mon[68841]: pgmap v139: 65 pgs: 65 active+clean; 2.0 GiB data, 6.3 GiB used, 530 GiB / 536 GiB avail 2024-08-18T22:47:24.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:47:23 smithi121 ceph-mon[81053]: pgmap v140: 65 pgs: 65 active+clean; 2.0 GiB data, 6.3 GiB used, 530 GiB / 536 GiB avail 2024-08-18T22:47:24.085 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:47:23 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:47:24.085 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:47:23 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-18T22:47:24.085 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:47:23 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:47:24.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:47:23 smithi195 ceph-mon[68841]: pgmap v140: 65 pgs: 65 active+clean; 2.0 GiB data, 6.3 GiB used, 530 GiB / 536 GiB avail 2024-08-18T22:47:24.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:47:23 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:47:24.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:47:23 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-18T22:47:24.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:47:23 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:47:26.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:47:25 smithi121 ceph-mon[81053]: pgmap v141: 65 pgs: 65 active+clean; 2.0 GiB data, 6.3 GiB used, 530 GiB / 536 GiB avail 2024-08-18T22:47:26.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:47:25 smithi121 ceph-mon[81053]: 3 slow requests, 0 included below; oldest blocked for > 356.870564 secs 2024-08-18T22:47:26.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:47:25 smithi195 ceph-mon[68841]: pgmap v141: 65 pgs: 65 active+clean; 2.0 GiB data, 6.3 GiB used, 530 GiB / 536 GiB avail 2024-08-18T22:47:26.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:47:25 smithi195 ceph-mon[68841]: 3 slow requests, 0 included below; oldest blocked for > 356.870564 secs 2024-08-18T22:47:27.902 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:47:27 smithi195 ceph-mon[68841]: pgmap v142: 65 pgs: 65 active+clean; 2.0 GiB data, 6.3 GiB used, 530 GiB / 536 GiB avail 2024-08-18T22:47:27.903 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:47:27 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-08-18T22:47:28.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:47:27 smithi121 ceph-mon[81053]: pgmap v142: 65 pgs: 65 active+clean; 2.0 GiB data, 6.3 GiB used, 530 GiB / 536 GiB avail 2024-08-18T22:47:28.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:47:27 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-08-18T22:47:28.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:47:28 smithi195 ceph-mon[68841]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-08-18T22:47:28.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:47:28 smithi195 ceph-mon[68841]: Upgrade: osd.5 is safe to restart 2024-08-18T22:47:29.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:47:28 smithi121 ceph-mon[81053]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-08-18T22:47:29.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:47:28 smithi121 ceph-mon[81053]: Upgrade: osd.5 is safe to restart 2024-08-18T22:47:29.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:47:29 smithi195 ceph-mon[68841]: pgmap v143: 65 pgs: 65 active+clean; 2.0 GiB data, 6.3 GiB used, 530 GiB / 536 GiB avail 2024-08-18T22:47:29.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:47:29 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:47:29.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:47:29 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-08-18T22:47:29.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:47:29 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:47:30.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:47:29 smithi121 ceph-mon[81053]: pgmap v143: 65 pgs: 65 active+clean; 2.0 GiB data, 6.3 GiB used, 530 GiB / 536 GiB avail 2024-08-18T22:47:30.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:47:29 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:47:30.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:47:29 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-08-18T22:47:30.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:47:29 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:47:30.792 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:47:30 smithi195 ceph-mon[68841]: Upgrade: Updating osd.5 2024-08-18T22:47:30.793 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:47:30 smithi195 ceph-mon[68841]: Deploying daemon osd.5 on smithi195 2024-08-18T22:47:30.793 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:47:30 smithi195 ceph-mon[68841]: 3 slow requests, 3 included below; oldest blocked for > 361.870677 secs 2024-08-18T22:47:30.793 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:47:30 smithi195 ceph-mon[68841]: slow request 361.870677 seconds old, received at 2024-08-18T22:41:28.419036+0000: client_request(client.14514:12135 unlink #0x1000000463d/f3 2024-08-18T22:41:28.418931+0000 caller_uid=1000, caller_gid=1333{6,36,1000,1333,}) currently failed to xlock, waiting 2024-08-18T22:47:30.793 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:47:30 smithi195 ceph-mon[68841]: slow request 361.868761 seconds old, received at 2024-08-18T22:41:28.420952+0000: client_request(mds.0:6 rename #0x1000000463d/f3 #0x603/1000000466a caller_uid=0, caller_gid=0{}) currently acquired locks 2024-08-18T22:47:30.793 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:47:30 smithi195 ceph-mon[68841]: slow request 361.850981 seconds old, received at 2024-08-18T22:41:28.438732+0000: client_request(mds.0:7 rename #0x1000000463d/f3 #0x603/1000000466a caller_uid=0, caller_gid=0{}) currently acquired locks 2024-08-18T22:47:31.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:47:30 smithi121 ceph-mon[81053]: Upgrade: Updating osd.5 2024-08-18T22:47:31.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:47:30 smithi121 ceph-mon[81053]: Deploying daemon osd.5 on smithi195 2024-08-18T22:47:31.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:47:30 smithi121 ceph-mon[81053]: 3 slow requests, 3 included below; oldest blocked for > 361.870677 secs 2024-08-18T22:47:31.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:47:30 smithi121 ceph-mon[81053]: slow request 361.870677 seconds old, received at 2024-08-18T22:41:28.419036+0000: client_request(client.14514:12135 unlink #0x1000000463d/f3 2024-08-18T22:41:28.418931+0000 caller_uid=1000, caller_gid=1333{6,36,1000,1333,}) currently failed to xlock, waiting 2024-08-18T22:47:31.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:47:30 smithi121 ceph-mon[81053]: slow request 361.868761 seconds old, received at 2024-08-18T22:41:28.420952+0000: client_request(mds.0:6 rename #0x1000000463d/f3 #0x603/1000000466a caller_uid=0, caller_gid=0{}) currently acquired locks 2024-08-18T22:47:31.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:47:30 smithi121 ceph-mon[81053]: slow request 361.850981 seconds old, received at 2024-08-18T22:41:28.438732+0000: client_request(mds.0:7 rename #0x1000000463d/f3 #0x603/1000000466a caller_uid=0, caller_gid=0{}) currently acquired locks 2024-08-18T22:47:31.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:47:31 smithi195 ceph-mon[68841]: pgmap v144: 65 pgs: 65 active+clean; 2.0 GiB data, 6.3 GiB used, 530 GiB / 536 GiB avail 2024-08-18T22:47:32.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:47:31 smithi121 ceph-mon[81053]: pgmap v144: 65 pgs: 65 active+clean; 2.0 GiB data, 6.3 GiB used, 530 GiB / 536 GiB avail 2024-08-18T22:47:32.226 INFO:journalctl@ceph.osd.5.smithi195.stdout:Aug 18 22:47:31 smithi195 systemd[1]: Stopping Ceph osd.5 for b003123a-5db1-11ef-bccf-c7b262605968... 2024-08-18T22:47:32.659 INFO:journalctl@ceph.osd.5.smithi195.stdout:Aug 18 22:47:32 smithi195 ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-5[42571]: 2024-08-18T22:47:32.224+0000 7fad560fb640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-18T22:47:32.659 INFO:journalctl@ceph.osd.5.smithi195.stdout:Aug 18 22:47:32 smithi195 ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-5[42571]: 2024-08-18T22:47:32.224+0000 7fad560fb640 -1 osd.5 75 *** Got signal Terminated *** 2024-08-18T22:47:32.659 INFO:journalctl@ceph.osd.5.smithi195.stdout:Aug 18 22:47:32 smithi195 ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-5[42571]: 2024-08-18T22:47:32.224+0000 7fad560fb640 -1 osd.5 75 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-08-18T22:47:33.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:47:32 smithi121 ceph-mon[81053]: osd.5 marked itself down and dead 2024-08-18T22:47:33.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:47:32 smithi195 ceph-mon[68841]: osd.5 marked itself down and dead 2024-08-18T22:47:33.525 INFO:journalctl@ceph.osd.5.smithi195.stdout:Aug 18 22:47:33 smithi195 podman[88002]: 2024-08-18 22:47:33.26474108 +0000 UTC m=+1.155634197 container died e7eff7bdb75257d21deefbcc2152d59b0d6239bed3728d1c91fc3920a08e893e (image=quay.ceph.io/ceph-ci/ceph@sha256:bf20fb88c15fff689cf84383793d3756b4df7aceb11592a28c78dd893a0b3e7d, name=ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-5, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.build-date=20240731, io.buildah.version=1.36.0, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=quincy-df62bdc, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-08-18T22:47:33.801 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:47:33 smithi195 ceph-mon[68841]: pgmap v145: 65 pgs: 65 active+clean; 2.0 GiB data, 6.3 GiB used, 530 GiB / 536 GiB avail 2024-08-18T22:47:33.801 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:47:33 smithi195 ceph-mon[68841]: Health check failed: 1 osds down (OSD_DOWN) 2024-08-18T22:47:33.802 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:47:33 smithi195 ceph-mon[68841]: Health check failed: all OSDs are running squid or later but require_osd_release < squid (OSD_UPGRADE_FINISHED) 2024-08-18T22:47:33.802 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:47:33 smithi195 ceph-mon[68841]: osdmap e76: 6 total, 5 up, 6 in 2024-08-18T22:47:33.802 INFO:journalctl@ceph.osd.5.smithi195.stdout:Aug 18 22:47:33 smithi195 podman[88002]: 2024-08-18 22:47:33.608067623 +0000 UTC m=+1.498960798 container cleanup e7eff7bdb75257d21deefbcc2152d59b0d6239bed3728d1c91fc3920a08e893e (image=quay.ceph.io/ceph-ci/ceph@sha256:bf20fb88c15fff689cf84383793d3756b4df7aceb11592a28c78dd893a0b3e7d, name=ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, io.buildah.version=1.36.0, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, RELEASE=quincy-df62bdc, ceph=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=) 2024-08-18T22:47:33.802 INFO:journalctl@ceph.osd.5.smithi195.stdout:Aug 18 22:47:33 smithi195 bash[88002]: ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-5 2024-08-18T22:47:34.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:47:33 smithi121 ceph-mon[81053]: pgmap v145: 65 pgs: 65 active+clean; 2.0 GiB data, 6.3 GiB used, 530 GiB / 536 GiB avail 2024-08-18T22:47:34.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:47:33 smithi121 ceph-mon[81053]: Health check failed: 1 osds down (OSD_DOWN) 2024-08-18T22:47:34.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:47:33 smithi121 ceph-mon[81053]: Health check failed: all OSDs are running squid or later but require_osd_release < squid (OSD_UPGRADE_FINISHED) 2024-08-18T22:47:34.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:47:33 smithi121 ceph-mon[81053]: osdmap e76: 6 total, 5 up, 6 in 2024-08-18T22:47:34.159 INFO:journalctl@ceph.osd.5.smithi195.stdout:Aug 18 22:47:33 smithi195 podman[88022]: 2024-08-18 22:47:33.80105028 +0000 UTC m=+0.535863946 container remove e7eff7bdb75257d21deefbcc2152d59b0d6239bed3728d1c91fc3920a08e893e (image=quay.ceph.io/ceph-ci/ceph@sha256:bf20fb88c15fff689cf84383793d3756b4df7aceb11592a28c78dd893a0b3e7d, name=ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-5, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=quincy-df62bdc, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, io.buildah.version=1.36.0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD) 2024-08-18T22:47:34.181 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:34.178+0000 7f5319552640 1 -- 172.21.15.121:0/2887785888 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f53140fe290 msgr2=0x7f53140fa3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:47:34.182 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:34.178+0000 7f5319552640 1 --2- 172.21.15.121:0/2887785888 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f53140fe290 0x7f53140fa3f0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f52fc0048d0 tx=0x7f52fc009da0 comp rx=0 tx=0).stop 2024-08-18T22:47:34.182 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:34.178+0000 7f5319552640 1 -- 172.21.15.121:0/2887785888 shutdown_connections 2024-08-18T22:47:34.182 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:34.178+0000 7f5319552640 1 --2- 172.21.15.121:0/2887785888 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f53140fe290 0x7f53140fa3f0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:47:34.182 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:34.178+0000 7f5319552640 1 --2- 172.21.15.121:0/2887785888 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f53140fd940 0x7f53140fdd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:47:34.182 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:34.178+0000 7f5319552640 1 -- 172.21.15.121:0/2887785888 >> 172.21.15.121:0/2887785888 conn(0x7f53140f6140 msgr2=0x7f53140f8570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:47:34.182 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:34.178+0000 7f5319552640 1 -- 172.21.15.121:0/2887785888 shutdown_connections 2024-08-18T22:47:34.182 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:34.178+0000 7f5319552640 1 -- 172.21.15.121:0/2887785888 wait complete. 2024-08-18T22:47:34.182 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:34.179+0000 7f5319552640 1 Processor -- start 2024-08-18T22:47:34.182 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:34.179+0000 7f5319552640 1 -- start start 2024-08-18T22:47:34.182 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:34.179+0000 7f5319552640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f53140fd940 0x7f531410ce80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:47:34.182 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:34.179+0000 7f5319552640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f53140fe290 0x7f531410d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:47:34.182 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:34.179+0000 7f5319552640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f531410da10 con 0x7f53140fe290 2024-08-18T22:47:34.183 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:34.179+0000 7f5319552640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f531410e150 con 0x7f53140fd940 2024-08-18T22:47:34.183 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:34.180+0000 7f530a7fc640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f53140fe290 0x7f531410d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:47:34.183 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:34.180+0000 7f530a7fc640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f53140fe290 0x7f531410d3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:57586/0 (socket says 172.21.15.121:57586) 2024-08-18T22:47:34.183 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:34.180+0000 7f530a7fc640 1 -- 172.21.15.121:0/1269172484 learned_addr learned my addr 172.21.15.121:0/1269172484 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-18T22:47:34.183 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:34.180+0000 7f5312ffd640 1 --2- 172.21.15.121:0/1269172484 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f53140fd940 0x7f531410ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:47:34.183 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:34.180+0000 7f530a7fc640 1 -- 172.21.15.121:0/1269172484 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f53140fd940 msgr2=0x7f531410ce80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:47:34.183 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:34.180+0000 7f530a7fc640 1 --2- 172.21.15.121:0/1269172484 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f53140fd940 0x7f531410ce80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:47:34.183 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:34.180+0000 7f530a7fc640 1 -- 172.21.15.121:0/1269172484 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52fc005040 con 0x7f53140fe290 2024-08-18T22:47:34.183 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:34.180+0000 7f5312ffd640 1 --2- 172.21.15.121:0/1269172484 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f53140fd940 0x7f531410ce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:47:34.183 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:34.180+0000 7f530a7fc640 1 --2- 172.21.15.121:0/1269172484 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f53140fe290 0x7f531410d3c0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f52fc0043d0 tx=0x7f52fc009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:47:34.183 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:34.180+0000 7f530bfff640 1 -- 172.21.15.121:0/1269172484 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f52fc038070 con 0x7f53140fe290 2024-08-18T22:47:34.183 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:34.180+0000 7f530bfff640 1 -- 172.21.15.121:0/1269172484 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f52fc02ae90 con 0x7f53140fe290 2024-08-18T22:47:34.183 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:34.180+0000 7f5319552640 1 -- 172.21.15.121:0/1269172484 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f531410e380 con 0x7f53140fe290 2024-08-18T22:47:34.184 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:34.180+0000 7f530bfff640 1 -- 172.21.15.121:0/1269172484 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f52fc03e670 con 0x7f53140fe290 2024-08-18T22:47:34.184 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:34.180+0000 7f5319552640 1 -- 172.21.15.121:0/1269172484 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f531410e920 con 0x7f53140fe290 2024-08-18T22:47:34.184 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:34.182+0000 7f5319552640 1 -- 172.21.15.121:0/1269172484 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53140f9de0 con 0x7f53140fe290 2024-08-18T22:47:34.184 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:34.182+0000 7f530bfff640 1 -- 172.21.15.121:0/1269172484 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 37) v1 ==== 92205+0+0 (secure 0 0 0) 0x7f52fc030020 con 0x7f53140fe290 2024-08-18T22:47:34.184 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:34.182+0000 7f530bfff640 1 --2- 172.21.15.121:0/1269172484 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f530006e0b0 0x7f5300070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:47:34.185 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:34.183+0000 7f530bfff640 1 -- 172.21.15.121:0/1269172484 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f52fc0add60 con 0x7f53140fe290 2024-08-18T22:47:34.185 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:34.183+0000 7f5312ffd640 1 --2- 172.21.15.121:0/1269172484 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f530006e0b0 0x7f5300070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:47:34.185 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:34.183+0000 7f5312ffd640 1 --2- 172.21.15.121:0/1269172484 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f530006e0b0 0x7f5300070560 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f531410cc10 tx=0x7f530400b040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:47:34.188 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:34.187+0000 7f530bfff640 1 -- 172.21.15.121:0/1269172484 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f52fc077090 con 0x7f53140fe290 2024-08-18T22:47:34.369 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:34.368+0000 7f5319552640 1 -- 172.21.15.121:0/1269172484 --> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f531410ecf0 con 0x7f530006e0b0 2024-08-18T22:47:34.370 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:34.370+0000 7f530bfff640 1 -- 172.21.15.121:0/1269172484 <== mgr.34102 v2:172.21.15.121:6800/3037387239 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f531410ecf0 con 0x7f530006e0b0 2024-08-18T22:47:34.373 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:34.372+0000 7f5319552640 1 -- 172.21.15.121:0/1269172484 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f530006e0b0 msgr2=0x7f5300070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:47:34.373 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:34.372+0000 7f5319552640 1 --2- 172.21.15.121:0/1269172484 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f530006e0b0 0x7f5300070560 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f531410cc10 tx=0x7f530400b040 comp rx=0 tx=0).stop 2024-08-18T22:47:34.373 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:34.372+0000 7f5319552640 1 -- 172.21.15.121:0/1269172484 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f53140fe290 msgr2=0x7f531410d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:47:34.373 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:34.372+0000 7f5319552640 1 --2- 172.21.15.121:0/1269172484 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f53140fe290 0x7f531410d3c0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f52fc0043d0 tx=0x7f52fc009da0 comp rx=0 tx=0).stop 2024-08-18T22:47:34.373 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:34.372+0000 7f5319552640 1 -- 172.21.15.121:0/1269172484 shutdown_connections 2024-08-18T22:47:34.373 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:34.372+0000 7f5319552640 1 --2- 172.21.15.121:0/1269172484 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f530006e0b0 0x7f5300070560 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:47:34.373 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:34.372+0000 7f5319552640 1 --2- 172.21.15.121:0/1269172484 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f53140fe290 0x7f531410d3c0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:47:34.373 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:34.372+0000 7f5319552640 1 --2- 172.21.15.121:0/1269172484 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f53140fd940 0x7f531410ce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:47:34.374 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:34.372+0000 7f5319552640 1 -- 172.21.15.121:0/1269172484 >> 172.21.15.121:0/1269172484 conn(0x7f53140f6140 msgr2=0x7f53140f78a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:47:34.374 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:34.372+0000 7f5319552640 1 -- 172.21.15.121:0/1269172484 shutdown_connections 2024-08-18T22:47:34.374 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:34.372+0000 7f5319552640 1 -- 172.21.15.121:0/1269172484 wait complete. 2024-08-18T22:47:34.382 INFO:teuthology.orchestra.run.smithi121.stdout:true 2024-08-18T22:47:34.453 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:34.452+0000 7fcd35fc6640 1 -- 172.21.15.121:0/3356826091 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcd300fa700 msgr2=0x7fcd300fab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:47:34.453 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:34.452+0000 7fcd35fc6640 1 --2- 172.21.15.121:0/3356826091 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcd300fa700 0x7fcd300fab10 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fcd200048d0 tx=0x7fcd20009da0 comp rx=0 tx=0).stop 2024-08-18T22:47:34.453 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:34.452+0000 7fcd35fc6640 1 -- 172.21.15.121:0/3356826091 shutdown_connections 2024-08-18T22:47:34.453 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:34.452+0000 7fcd35fc6640 1 --2- 172.21.15.121:0/3356826091 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcd300fb050 0x7fcd300fd8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:47:34.454 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:34.452+0000 7fcd35fc6640 1 --2- 172.21.15.121:0/3356826091 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcd300fa700 0x7fcd300fab10 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:47:34.454 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:34.452+0000 7fcd35fc6640 1 -- 172.21.15.121:0/3356826091 >> 172.21.15.121:0/3356826091 conn(0x7fcd300f6140 msgr2=0x7fcd300f8570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:47:34.454 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:34.452+0000 7fcd35fc6640 1 -- 172.21.15.121:0/3356826091 shutdown_connections 2024-08-18T22:47:34.454 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:34.452+0000 7fcd35fc6640 1 -- 172.21.15.121:0/3356826091 wait complete. 2024-08-18T22:47:34.455 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:34.453+0000 7fcd35fc6640 1 Processor -- start 2024-08-18T22:47:34.455 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:34.453+0000 7fcd35fc6640 1 -- start start 2024-08-18T22:47:34.456 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:34.453+0000 7fcd35fc6640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcd300fa700 0x7fcd3010d080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:47:34.456 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:34.453+0000 7fcd35fc6640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcd300fb050 0x7fcd3010d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:47:34.456 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:34.453+0000 7fcd35fc6640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd3010dc10 con 0x7fcd300fa700 2024-08-18T22:47:34.456 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:34.453+0000 7fcd35fc6640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd3010e430 con 0x7fcd300fb050 2024-08-18T22:47:34.456 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:34.453+0000 7fcd2f7fe640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcd300fa700 0x7fcd3010d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:47:34.456 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:34.453+0000 7fcd2f7fe640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcd300fa700 0x7fcd3010d080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:57602/0 (socket says 172.21.15.121:57602) 2024-08-18T22:47:34.456 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:34.453+0000 7fcd2f7fe640 1 -- 172.21.15.121:0/3765637652 learned_addr learned my addr 172.21.15.121:0/3765637652 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-18T22:47:34.456 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:34.453+0000 7fcd2effd640 1 --2- 172.21.15.121:0/3765637652 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcd300fb050 0x7fcd3010d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:47:34.456 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:34.454+0000 7fcd2f7fe640 1 -- 172.21.15.121:0/3765637652 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcd300fb050 msgr2=0x7fcd3010d5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:47:34.456 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:34.454+0000 7fcd2f7fe640 1 --2- 172.21.15.121:0/3765637652 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcd300fb050 0x7fcd3010d5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:47:34.456 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:34.454+0000 7fcd2f7fe640 1 -- 172.21.15.121:0/3765637652 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd20005040 con 0x7fcd300fa700 2024-08-18T22:47:34.457 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:34.454+0000 7fcd2f7fe640 1 --2- 172.21.15.121:0/3765637652 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcd300fa700 0x7fcd3010d080 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fcd200043d0 tx=0x7fcd20009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:47:34.457 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:34.454+0000 7fcd17fff640 1 -- 172.21.15.121:0/3765637652 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcd20038070 con 0x7fcd300fa700 2024-08-18T22:47:34.457 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:34.454+0000 7fcd17fff640 1 -- 172.21.15.121:0/3765637652 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fcd20009800 con 0x7fcd300fa700 2024-08-18T22:47:34.457 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:34.454+0000 7fcd35fc6640 1 -- 172.21.15.121:0/3765637652 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd3010e660 con 0x7fcd300fa700 2024-08-18T22:47:34.457 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:34.454+0000 7fcd17fff640 1 -- 172.21.15.121:0/3765637652 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcd2003e670 con 0x7fcd300fa700 2024-08-18T22:47:34.457 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:34.454+0000 7fcd35fc6640 1 -- 172.21.15.121:0/3765637652 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd3010eb80 con 0x7fcd300fa700 2024-08-18T22:47:34.458 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:34.455+0000 7fcd35fc6640 1 -- 172.21.15.121:0/3765637652 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd300f9de0 con 0x7fcd300fa700 2024-08-18T22:47:34.458 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:34.456+0000 7fcd17fff640 1 -- 172.21.15.121:0/3765637652 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 37) v1 ==== 92205+0+0 (secure 0 0 0) 0x7fcd20030020 con 0x7fcd300fa700 2024-08-18T22:47:34.458 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:34.456+0000 7fcd17fff640 1 --2- 172.21.15.121:0/3765637652 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7fcd1806e0b0 0x7fcd18070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:47:34.458 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:34.456+0000 7fcd17fff640 1 -- 172.21.15.121:0/3765637652 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6496+0+0 (secure 0 0 0) 0x7fcd200addc0 con 0x7fcd300fa700 2024-08-18T22:47:34.458 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:34.456+0000 7fcd2effd640 1 --2- 172.21.15.121:0/3765637652 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7fcd1806e0b0 0x7fcd18070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:47:34.458 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:34.457+0000 7fcd2effd640 1 --2- 172.21.15.121:0/3765637652 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7fcd1806e0b0 0x7fcd18070560 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fcd3010ce30 tx=0x7fcd2400b040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:47:34.461 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:34.461+0000 7fcd17fff640 1 -- 172.21.15.121:0/3765637652 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7fcd200771a0 con 0x7fcd300fa700 2024-08-18T22:47:34.563 INFO:journalctl@ceph.osd.5.smithi195.stdout:Aug 18 22:47:34 smithi195 podman[88110]: 2024-08-18 22:47:34.218764909 +0000 UTC m=+0.102333139 container create dc7644691ff30332339dd80e2c949463e303c0e465a1309dbd128d952fcfff99 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-5-deactivate, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, io.buildah.version=1.36.0, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_CLEAN=True, RELEASE=squid-de09dd0, org.label-schema.schema-version=1.0) 2024-08-18T22:47:34.563 INFO:journalctl@ceph.osd.5.smithi195.stdout:Aug 18 22:47:34 smithi195 podman[88110]: 2024-08-18 22:47:34.133629667 +0000 UTC m=+0.017197846 image pull ea7a5189f30bad3aca9524788e2965d2368d7ce786df09d4edcd8c3edf9cefba quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9 2024-08-18T22:47:34.563 INFO:journalctl@ceph.osd.5.smithi195.stdout:Aug 18 22:47:34 smithi195 podman[88110]: 2024-08-18 22:47:34.421131383 +0000 UTC m=+0.304699574 container init dc7644691ff30332339dd80e2c949463e303c0e465a1309dbd128d952fcfff99 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-5-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, RELEASE=squid-de09dd0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_CLEAN=True, ceph=True, GIT_BRANCH=HEAD, io.buildah.version=1.36.0, org.label-schema.vendor=CentOS) 2024-08-18T22:47:34.563 INFO:journalctl@ceph.osd.5.smithi195.stdout:Aug 18 22:47:34 smithi195 podman[88110]: 2024-08-18 22:47:34.424419888 +0000 UTC m=+0.307988075 container start dc7644691ff30332339dd80e2c949463e303c0e465a1309dbd128d952fcfff99 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-5-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.36.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , RELEASE=squid-de09dd0, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, ceph=True, org.label-schema.license=GPLv2) 2024-08-18T22:47:34.563 INFO:journalctl@ceph.osd.5.smithi195.stdout:Aug 18 22:47:34 smithi195 podman[88110]: 2024-08-18 22:47:34.562916157 +0000 UTC m=+0.446484335 container attach dc7644691ff30332339dd80e2c949463e303c0e465a1309dbd128d952fcfff99 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-5-deactivate, org.label-schema.license=GPLv2, RELEASE=squid-de09dd0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.36.0, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=) 2024-08-18T22:47:34.647 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:34.644+0000 7fcd35fc6640 1 -- 172.21.15.121:0/3765637652 --> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fcd301050b0 con 0x7fcd1806e0b0 2024-08-18T22:47:34.647 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:34.646+0000 7fcd17fff640 1 -- 172.21.15.121:0/3765637652 <== mgr.34102 v2:172.21.15.121:6800/3037387239 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7fcd301050b0 con 0x7fcd1806e0b0 2024-08-18T22:47:34.650 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:34.648+0000 7fcd35fc6640 1 -- 172.21.15.121:0/3765637652 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7fcd1806e0b0 msgr2=0x7fcd18070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:47:34.650 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:34.648+0000 7fcd35fc6640 1 --2- 172.21.15.121:0/3765637652 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7fcd1806e0b0 0x7fcd18070560 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fcd3010ce30 tx=0x7fcd2400b040 comp rx=0 tx=0).stop 2024-08-18T22:47:34.650 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:34.648+0000 7fcd35fc6640 1 -- 172.21.15.121:0/3765637652 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcd300fa700 msgr2=0x7fcd3010d080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:47:34.650 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:34.648+0000 7fcd35fc6640 1 --2- 172.21.15.121:0/3765637652 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcd300fa700 0x7fcd3010d080 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fcd200043d0 tx=0x7fcd20009da0 comp rx=0 tx=0).stop 2024-08-18T22:47:34.650 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:34.648+0000 7fcd35fc6640 1 -- 172.21.15.121:0/3765637652 shutdown_connections 2024-08-18T22:47:34.650 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:34.648+0000 7fcd35fc6640 1 --2- 172.21.15.121:0/3765637652 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7fcd1806e0b0 0x7fcd18070560 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:47:34.650 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:34.648+0000 7fcd35fc6640 1 --2- 172.21.15.121:0/3765637652 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcd300fb050 0x7fcd3010d5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:47:34.650 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:34.648+0000 7fcd35fc6640 1 --2- 172.21.15.121:0/3765637652 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcd300fa700 0x7fcd3010d080 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:47:34.651 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:34.648+0000 7fcd35fc6640 1 -- 172.21.15.121:0/3765637652 >> 172.21.15.121:0/3765637652 conn(0x7fcd300f6140 msgr2=0x7fcd300f7930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:47:34.651 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:34.648+0000 7fcd35fc6640 1 -- 172.21.15.121:0/3765637652 shutdown_connections 2024-08-18T22:47:34.651 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:34.648+0000 7fcd35fc6640 1 -- 172.21.15.121:0/3765637652 wait complete. 2024-08-18T22:47:34.733 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:34.729+0000 7f9e475be640 1 -- 172.21.15.121:0/1421624285 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9e400fb1d0 msgr2=0x7f9e400fb5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:47:34.733 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:34.729+0000 7f9e475be640 1 --2- 172.21.15.121:0/1421624285 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9e400fb1d0 0x7f9e400fb5e0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f9e3c0048d0 tx=0x7f9e3c009da0 comp rx=0 tx=0).stop 2024-08-18T22:47:34.733 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:34.729+0000 7f9e475be640 1 -- 172.21.15.121:0/1421624285 shutdown_connections 2024-08-18T22:47:34.733 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:34.729+0000 7f9e475be640 1 --2- 172.21.15.121:0/1421624285 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9e400fc4a0 0x7f9e400fc910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:47:34.733 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:34.729+0000 7f9e475be640 1 --2- 172.21.15.121:0/1421624285 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9e400fb1d0 0x7f9e400fb5e0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:47:34.734 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:34.729+0000 7f9e475be640 1 -- 172.21.15.121:0/1421624285 >> 172.21.15.121:0/1421624285 conn(0x7f9e400f69b0 msgr2=0x7f9e400f8dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:47:34.734 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:34.729+0000 7f9e475be640 1 -- 172.21.15.121:0/1421624285 shutdown_connections 2024-08-18T22:47:34.734 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:34.729+0000 7f9e475be640 1 -- 172.21.15.121:0/1421624285 wait complete. 2024-08-18T22:47:34.734 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:34.730+0000 7f9e475be640 1 Processor -- start 2024-08-18T22:47:34.734 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:34.730+0000 7f9e475be640 1 -- start start 2024-08-18T22:47:34.734 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:34.730+0000 7f9e475be640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9e400fb1d0 0x7f9e4010fb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:47:34.734 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:34.730+0000 7f9e475be640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9e400fc4a0 0x7f9e40112090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:47:34.734 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:34.730+0000 7f9e475be640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e40065a00 con 0x7f9e400fb1d0 2024-08-18T22:47:34.734 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:34.730+0000 7f9e475be640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e40065b70 con 0x7f9e400fc4a0 2024-08-18T22:47:34.734 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:34.730+0000 7f9e4535a640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9e400fb1d0 0x7f9e4010fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:47:34.734 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:34.730+0000 7f9e4535a640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9e400fb1d0 0x7f9e4010fb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:57626/0 (socket says 172.21.15.121:57626) 2024-08-18T22:47:34.735 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:34.730+0000 7f9e4535a640 1 -- 172.21.15.121:0/2474123256 learned_addr learned my addr 172.21.15.121:0/2474123256 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-18T22:47:34.735 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:34.730+0000 7f9e44b59640 1 --2- 172.21.15.121:0/2474123256 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9e400fc4a0 0x7f9e40112090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:47:34.735 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:34.730+0000 7f9e4535a640 1 -- 172.21.15.121:0/2474123256 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9e400fc4a0 msgr2=0x7f9e40112090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:47:34.735 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:34.730+0000 7f9e4535a640 1 --2- 172.21.15.121:0/2474123256 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9e400fc4a0 0x7f9e40112090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:47:34.735 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:34.730+0000 7f9e4535a640 1 -- 172.21.15.121:0/2474123256 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e3c005040 con 0x7f9e400fb1d0 2024-08-18T22:47:34.735 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:34.730+0000 7f9e4535a640 1 --2- 172.21.15.121:0/2474123256 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9e400fb1d0 0x7f9e4010fb40 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f9e3c0043d0 tx=0x7f9e3c009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:47:34.735 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:34.731+0000 7f9e35ffb640 1 -- 172.21.15.121:0/2474123256 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9e3c038070 con 0x7f9e400fb1d0 2024-08-18T22:47:34.735 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:34.731+0000 7f9e35ffb640 1 -- 172.21.15.121:0/2474123256 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f9e3c02ae90 con 0x7f9e400fb1d0 2024-08-18T22:47:34.735 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:34.731+0000 7f9e475be640 1 -- 172.21.15.121:0/2474123256 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e401125d0 con 0x7f9e400fb1d0 2024-08-18T22:47:34.735 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:34.731+0000 7f9e35ffb640 1 -- 172.21.15.121:0/2474123256 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9e3c03e670 con 0x7f9e400fb1d0 2024-08-18T22:47:34.735 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:34.731+0000 7f9e475be640 1 -- 172.21.15.121:0/2474123256 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e40112ac0 con 0x7f9e400fb1d0 2024-08-18T22:47:34.736 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:34.732+0000 7f9e475be640 1 -- 172.21.15.121:0/2474123256 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e400fa630 con 0x7f9e400fb1d0 2024-08-18T22:47:34.736 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:34.732+0000 7f9e35ffb640 1 -- 172.21.15.121:0/2474123256 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 37) v1 ==== 92205+0+0 (secure 0 0 0) 0x7f9e3c030020 con 0x7f9e400fb1d0 2024-08-18T22:47:34.736 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:34.733+0000 7f9e35ffb640 1 --2- 172.21.15.121:0/2474123256 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f9e2c06e0b0 0x7f9e2c070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:47:34.737 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:34.733+0000 7f9e35ffb640 1 -- 172.21.15.121:0/2474123256 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f9e3c0add30 con 0x7f9e400fb1d0 2024-08-18T22:47:34.737 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:34.733+0000 7f9e44b59640 1 --2- 172.21.15.121:0/2474123256 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f9e2c06e0b0 0x7f9e2c070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:47:34.737 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:34.733+0000 7f9e44b59640 1 --2- 172.21.15.121:0/2474123256 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f9e2c06e0b0 0x7f9e2c070560 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f9e30009fd0 tx=0x7f9e3000b040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:47:34.739 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:34.737+0000 7f9e35ffb640 1 -- 172.21.15.121:0/2474123256 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f9e3c077110 con 0x7f9e400fb1d0 2024-08-18T22:47:34.901 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:47:34 smithi195 ceph-mon[68841]: osdmap e77: 6 total, 5 up, 6 in 2024-08-18T22:47:34.901 INFO:journalctl@ceph.osd.5.smithi195.stdout:Aug 18 22:47:34 smithi195 podman[88110]: 2024-08-18 22:47:34.620272737 +0000 UTC m=+0.503840928 container died dc7644691ff30332339dd80e2c949463e303c0e465a1309dbd128d952fcfff99 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-5-deactivate, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, ceph=True, org.label-schema.license=GPLv2, io.buildah.version=1.36.0, maintainer=Guillaume Abrioux , RELEASE=squid-de09dd0) 2024-08-18T22:47:34.915 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:34.913+0000 7f9e475be640 1 -- 172.21.15.121:0/2474123256 --> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f9e40100900 con 0x7f9e2c06e0b0 2024-08-18T22:47:34.924 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:34.922+0000 7f9e35ffb640 1 -- 172.21.15.121:0/2474123256 <== mgr.34102 v2:172.21.15.121:6800/3037387239 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f9e40100900 con 0x7f9e2c06e0b0 2024-08-18T22:47:34.924 INFO:teuthology.orchestra.run.smithi121.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-08-18T22:47:34.924 INFO:teuthology.orchestra.run.smithi121.stdout:alertmanager.smithi121 smithi121 *:9093,9094 running (5m) 90s ago 13m 24.9M - 0.25.0 c8568f914cd2 c421c5e6a02b 2024-08-18T22:47:34.924 INFO:teuthology.orchestra.run.smithi121.stdout:crash.smithi121 smithi121 running (3m) 90s ago 13m 6903k - 19.1.0-1382-gde09dd01 ea7a5189f30b 3cf5c666a0e6 2024-08-18T22:47:34.924 INFO:teuthology.orchestra.run.smithi121.stdout:crash.smithi195 smithi195 running (3m) 26s ago 12m 6895k - 19.1.0-1382-gde09dd01 ea7a5189f30b fbb586fb9834 2024-08-18T22:47:34.924 INFO:teuthology.orchestra.run.smithi121.stdout:grafana.smithi121 smithi121 *:3000 running (5m) 90s ago 13m 78.4M - 9.4.7 954c08fa6188 091a5fd17e8a 2024-08-18T22:47:34.925 INFO:teuthology.orchestra.run.smithi121.stdout:mds.cephfs.smithi121.gbickb smithi121 running (8m) 90s ago 8m 156M - 17.2.7-1406-gdf62bdcc 774894bef55f 484da0bc2c95 2024-08-18T22:47:34.925 INFO:teuthology.orchestra.run.smithi121.stdout:mds.cephfs.smithi121.xuzsdg smithi121 running (8m) 90s ago 8m 13.6M - 17.2.7-1406-gdf62bdcc 774894bef55f 6976b708cdcd 2024-08-18T22:47:34.925 INFO:teuthology.orchestra.run.smithi121.stdout:mds.cephfs.smithi195.buqvbr smithi195 running (8m) 26s ago 8m 116M - 17.2.7-1406-gdf62bdcc 774894bef55f 11a3703b4276 2024-08-18T22:47:34.925 INFO:teuthology.orchestra.run.smithi121.stdout:mds.cephfs.smithi195.nptgyc smithi195 running (8m) 26s ago 8m 18.2M - 17.2.7-1406-gdf62bdcc 774894bef55f b9f8043ea83e 2024-08-18T22:47:34.925 INFO:teuthology.orchestra.run.smithi121.stdout:mgr.smithi121.lopxqc smithi121 *:8443,9283,8765 running (4m) 90s ago 14m 498M - 19.1.0-1382-gde09dd01 ea7a5189f30b 9079701e6516 2024-08-18T22:47:34.925 INFO:teuthology.orchestra.run.smithi121.stdout:mgr.smithi195.acttsj smithi195 *:8443,9283,8765 running (4m) 26s ago 12m 440M - 19.1.0-1382-gde09dd01 ea7a5189f30b 7b4027a33daa 2024-08-18T22:47:34.925 INFO:teuthology.orchestra.run.smithi121.stdout:mon.smithi121 smithi121 running (4m) 90s ago 14m 49.3M 2048M 19.1.0-1382-gde09dd01 ea7a5189f30b d71695a4fb56 2024-08-18T22:47:34.925 INFO:teuthology.orchestra.run.smithi121.stdout:mon.smithi195 smithi195 running (3m) 26s ago 12m 39.4M 2048M 19.1.0-1382-gde09dd01 ea7a5189f30b a9bb94ba3b56 2024-08-18T22:47:34.925 INFO:teuthology.orchestra.run.smithi121.stdout:node-exporter.smithi121 smithi121 *:9100 running (5m) 90s ago 13m 15.2M - 1.5.0 0da6a335fe13 bc4b5355a507 2024-08-18T22:47:34.925 INFO:teuthology.orchestra.run.smithi121.stdout:node-exporter.smithi195 smithi195 *:9100 running (5m) 26s ago 12m 16.6M - 1.5.0 0da6a335fe13 146efcb79663 2024-08-18T22:47:34.925 INFO:teuthology.orchestra.run.smithi121.stdout:osd.0 smithi121 running (2m) 90s ago 11m 99.3M 1557M 19.1.0-1382-gde09dd01 ea7a5189f30b d378dd46eeb6 2024-08-18T22:47:34.925 INFO:teuthology.orchestra.run.smithi121.stdout:osd.1 smithi121 running (2m) 90s ago 11m 117M 1557M 19.1.0-1382-gde09dd01 ea7a5189f30b 0f9e03de5382 2024-08-18T22:47:34.925 INFO:teuthology.orchestra.run.smithi121.stdout:osd.2 smithi121 running (96s) 90s ago 11m 11.7M 1557M 19.1.0-1382-gde09dd01 ea7a5189f30b 93270b5bed68 2024-08-18T22:47:34.926 INFO:teuthology.orchestra.run.smithi121.stdout:osd.3 smithi195 running (62s) 26s ago 10m 119M 2581M 19.1.0-1382-gde09dd01 ea7a5189f30b 72c2860c0e9f 2024-08-18T22:47:34.926 INFO:teuthology.orchestra.run.smithi121.stdout:osd.4 smithi195 running (29s) 26s ago 10m 12.1M 2581M 19.1.0-1382-gde09dd01 ea7a5189f30b d88a83c97247 2024-08-18T22:47:34.926 INFO:teuthology.orchestra.run.smithi121.stdout:osd.5 smithi195 running (9m) 26s ago 9m 212M 2581M 17.2.7-1406-gdf62bdcc 774894bef55f e7eff7bdb752 2024-08-18T22:47:34.926 INFO:teuthology.orchestra.run.smithi121.stdout:prometheus.smithi121 smithi121 *:9095 running (4m) 90s ago 13m 54.0M - 2.43.0 a07b618ecd1d 00c4f776d23a 2024-08-18T22:47:34.927 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:34.924+0000 7f9e475be640 1 -- 172.21.15.121:0/2474123256 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f9e2c06e0b0 msgr2=0x7f9e2c070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:47:34.927 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:34.924+0000 7f9e475be640 1 --2- 172.21.15.121:0/2474123256 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f9e2c06e0b0 0x7f9e2c070560 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f9e30009fd0 tx=0x7f9e3000b040 comp rx=0 tx=0).stop 2024-08-18T22:47:34.927 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:34.924+0000 7f9e475be640 1 -- 172.21.15.121:0/2474123256 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9e400fb1d0 msgr2=0x7f9e4010fb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:47:34.927 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:34.924+0000 7f9e475be640 1 --2- 172.21.15.121:0/2474123256 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9e400fb1d0 0x7f9e4010fb40 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f9e3c0043d0 tx=0x7f9e3c009da0 comp rx=0 tx=0).stop 2024-08-18T22:47:34.927 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:34.924+0000 7f9e475be640 1 -- 172.21.15.121:0/2474123256 shutdown_connections 2024-08-18T22:47:34.927 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:34.924+0000 7f9e475be640 1 --2- 172.21.15.121:0/2474123256 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f9e2c06e0b0 0x7f9e2c070560 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:47:34.927 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:34.924+0000 7f9e475be640 1 --2- 172.21.15.121:0/2474123256 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9e400fc4a0 0x7f9e40112090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:47:34.927 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:34.924+0000 7f9e475be640 1 --2- 172.21.15.121:0/2474123256 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9e400fb1d0 0x7f9e4010fb40 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:47:34.927 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:34.924+0000 7f9e475be640 1 -- 172.21.15.121:0/2474123256 >> 172.21.15.121:0/2474123256 conn(0x7f9e400f69b0 msgr2=0x7f9e400f8180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:47:34.927 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:34.924+0000 7f9e475be640 1 -- 172.21.15.121:0/2474123256 shutdown_connections 2024-08-18T22:47:34.927 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:34.924+0000 7f9e475be640 1 -- 172.21.15.121:0/2474123256 wait complete. 2024-08-18T22:47:35.004 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:35.002+0000 7fee07ec0640 1 -- 172.21.15.121:0/1763046262 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fee000fd5c0 msgr2=0x7fee000fda30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:47:35.004 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:35.002+0000 7fee07ec0640 1 --2- 172.21.15.121:0/1763046262 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fee000fd5c0 0x7fee000fda30 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fedf00048d0 tx=0x7fedf0009da0 comp rx=0 tx=0).stop 2024-08-18T22:47:35.004 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:35.002+0000 7fee07ec0640 1 -- 172.21.15.121:0/1763046262 shutdown_connections 2024-08-18T22:47:35.004 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:35.002+0000 7fee07ec0640 1 --2- 172.21.15.121:0/1763046262 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fee000fd5c0 0x7fee000fda30 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:47:35.005 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:47:34 smithi121 ceph-mon[81053]: osdmap e77: 6 total, 5 up, 6 in 2024-08-18T22:47:35.007 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:35.002+0000 7fee07ec0640 1 --2- 172.21.15.121:0/1763046262 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fee000fc2f0 0x7fee000fc700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:47:35.007 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:35.002+0000 7fee07ec0640 1 -- 172.21.15.121:0/1763046262 >> 172.21.15.121:0/1763046262 conn(0x7fee000f7ad0 msgr2=0x7fee000f9ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:47:35.007 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:35.002+0000 7fee07ec0640 1 -- 172.21.15.121:0/1763046262 shutdown_connections 2024-08-18T22:47:35.007 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:35.002+0000 7fee07ec0640 1 -- 172.21.15.121:0/1763046262 wait complete. 2024-08-18T22:47:35.007 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:35.003+0000 7fee07ec0640 1 Processor -- start 2024-08-18T22:47:35.007 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:35.003+0000 7fee07ec0640 1 -- start start 2024-08-18T22:47:35.007 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:35.003+0000 7fee07ec0640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fee000fc2f0 0x7fee0010cef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:47:35.007 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:35.003+0000 7fee07ec0640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fee000fd5c0 0x7fee0010d430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:47:35.007 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:35.003+0000 7fee07ec0640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee0010e1c0 con 0x7fee000fd5c0 2024-08-18T22:47:35.007 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:35.003+0000 7fee07ec0640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee0010e330 con 0x7fee000fc2f0 2024-08-18T22:47:35.007 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:35.003+0000 7fee0545b640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fee000fd5c0 0x7fee0010d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:47:35.007 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:35.003+0000 7fee0545b640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fee000fd5c0 0x7fee0010d430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:57634/0 (socket says 172.21.15.121:57634) 2024-08-18T22:47:35.007 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:35.003+0000 7fee0545b640 1 -- 172.21.15.121:0/713068348 learned_addr learned my addr 172.21.15.121:0/713068348 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-18T22:47:35.008 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:35.003+0000 7fee05c5c640 1 --2- 172.21.15.121:0/713068348 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fee000fc2f0 0x7fee0010cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:47:35.008 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:35.003+0000 7fee0545b640 1 -- 172.21.15.121:0/713068348 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fee000fc2f0 msgr2=0x7fee0010cef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:47:35.008 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:35.003+0000 7fee0545b640 1 --2- 172.21.15.121:0/713068348 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fee000fc2f0 0x7fee0010cef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:47:35.008 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:35.003+0000 7fee0545b640 1 -- 172.21.15.121:0/713068348 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedf0005040 con 0x7fee000fd5c0 2024-08-18T22:47:35.008 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:35.004+0000 7fee0545b640 1 --2- 172.21.15.121:0/713068348 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fee000fd5c0 0x7fee0010d430 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fedf0003080 tx=0x7fedf0009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:47:35.008 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:35.004+0000 7fedf67fc640 1 -- 172.21.15.121:0/713068348 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fedf0038070 con 0x7fee000fd5c0 2024-08-18T22:47:35.008 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:35.004+0000 7fedf67fc640 1 -- 172.21.15.121:0/713068348 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fedf002abd0 con 0x7fee000fd5c0 2024-08-18T22:47:35.008 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:35.004+0000 7fedf67fc640 1 -- 172.21.15.121:0/713068348 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fedf003e670 con 0x7fee000fd5c0 2024-08-18T22:47:35.008 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:35.004+0000 7fee07ec0640 1 -- 172.21.15.121:0/713068348 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee0010e5b0 con 0x7fee000fd5c0 2024-08-18T22:47:35.008 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:35.005+0000 7fee07ec0640 1 -- 172.21.15.121:0/713068348 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee0010ea80 con 0x7fee000fd5c0 2024-08-18T22:47:35.009 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:35.005+0000 7fee07ec0640 1 -- 172.21.15.121:0/713068348 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee000fb750 con 0x7fee000fd5c0 2024-08-18T22:47:35.009 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:35.006+0000 7fedf67fc640 1 -- 172.21.15.121:0/713068348 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 37) v1 ==== 92205+0+0 (secure 0 0 0) 0x7fedf0030020 con 0x7fee000fd5c0 2024-08-18T22:47:35.009 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:35.006+0000 7fedf67fc640 1 --2- 172.21.15.121:0/713068348 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7fedec06e0b0 0x7fedec070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:47:35.009 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:35.006+0000 7fedf67fc640 1 -- 172.21.15.121:0/713068348 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6496+0+0 (secure 0 0 0) 0x7fedf00ad8c0 con 0x7fee000fd5c0 2024-08-18T22:47:35.009 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:35.007+0000 7fee05c5c640 1 --2- 172.21.15.121:0/713068348 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7fedec06e0b0 0x7fedec070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:47:35.010 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:35.007+0000 7fee05c5c640 1 --2- 172.21.15.121:0/713068348 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7fedec06e0b0 0x7fedec070560 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fee0010cc80 tx=0x7fedfc009120 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:47:35.013 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:35.011+0000 7fedf67fc640 1 -- 172.21.15.121:0/713068348 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7fedf0076ca0 con 0x7fee000fd5c0 2024-08-18T22:47:35.244 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:35.242+0000 7fee07ec0640 1 -- 172.21.15.121:0/713068348 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fee0010ecc0 con 0x7fee000fd5c0 2024-08-18T22:47:35.244 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:35.242+0000 7fedf67fc640 1 -- 172.21.15.121:0/713068348 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+730 (secure 0 0 0) 0x7fedf007a360 con 0x7fee000fd5c0 2024-08-18T22:47:35.244 INFO:teuthology.orchestra.run.smithi121.stdout:{ 2024-08-18T22:47:35.245 INFO:teuthology.orchestra.run.smithi121.stdout: "mon": { 2024-08-18T22:47:35.245 INFO:teuthology.orchestra.run.smithi121.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 2 2024-08-18T22:47:35.245 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-18T22:47:35.245 INFO:teuthology.orchestra.run.smithi121.stdout: "mgr": { 2024-08-18T22:47:35.245 INFO:teuthology.orchestra.run.smithi121.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 2 2024-08-18T22:47:35.245 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-18T22:47:35.245 INFO:teuthology.orchestra.run.smithi121.stdout: "osd": { 2024-08-18T22:47:35.245 INFO:teuthology.orchestra.run.smithi121.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 5 2024-08-18T22:47:35.245 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-18T22:47:35.246 INFO:teuthology.orchestra.run.smithi121.stdout: "mds": { 2024-08-18T22:47:35.246 INFO:teuthology.orchestra.run.smithi121.stdout: "ceph version 17.2.7-1406-gdf62bdcc (df62bdccd9a13bf566b27a250eddfdd89be3072d) quincy (stable)": 4 2024-08-18T22:47:35.246 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-18T22:47:35.246 INFO:teuthology.orchestra.run.smithi121.stdout: "overall": { 2024-08-18T22:47:35.246 INFO:teuthology.orchestra.run.smithi121.stdout: "ceph version 17.2.7-1406-gdf62bdcc (df62bdccd9a13bf566b27a250eddfdd89be3072d) quincy (stable)": 4, 2024-08-18T22:47:35.246 INFO:teuthology.orchestra.run.smithi121.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 9 2024-08-18T22:47:35.246 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-08-18T22:47:35.246 INFO:teuthology.orchestra.run.smithi121.stdout:} 2024-08-18T22:47:35.247 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:35.245+0000 7fee07ec0640 1 -- 172.21.15.121:0/713068348 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7fedec06e0b0 msgr2=0x7fedec070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:47:35.247 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:35.245+0000 7fee07ec0640 1 --2- 172.21.15.121:0/713068348 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7fedec06e0b0 0x7fedec070560 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fee0010cc80 tx=0x7fedfc009120 comp rx=0 tx=0).stop 2024-08-18T22:47:35.247 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:35.245+0000 7fee07ec0640 1 -- 172.21.15.121:0/713068348 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fee000fd5c0 msgr2=0x7fee0010d430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:47:35.247 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:35.245+0000 7fee07ec0640 1 --2- 172.21.15.121:0/713068348 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fee000fd5c0 0x7fee0010d430 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fedf0003080 tx=0x7fedf0009da0 comp rx=0 tx=0).stop 2024-08-18T22:47:35.247 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:35.245+0000 7fee07ec0640 1 -- 172.21.15.121:0/713068348 shutdown_connections 2024-08-18T22:47:35.247 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:35.245+0000 7fee07ec0640 1 --2- 172.21.15.121:0/713068348 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7fedec06e0b0 0x7fedec070560 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:47:35.247 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:35.245+0000 7fee07ec0640 1 --2- 172.21.15.121:0/713068348 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fee000fd5c0 0x7fee0010d430 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:47:35.248 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:35.245+0000 7fee07ec0640 1 --2- 172.21.15.121:0/713068348 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fee000fc2f0 0x7fee0010cef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:47:35.248 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:35.245+0000 7fee07ec0640 1 -- 172.21.15.121:0/713068348 >> 172.21.15.121:0/713068348 conn(0x7fee000f7ad0 msgr2=0x7fee000f9260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:47:35.248 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:35.245+0000 7fee07ec0640 1 -- 172.21.15.121:0/713068348 shutdown_connections 2024-08-18T22:47:35.248 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:35.245+0000 7fee07ec0640 1 -- 172.21.15.121:0/713068348 wait complete. 2024-08-18T22:47:35.325 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:35.322+0000 7f974ed38640 1 -- 172.21.15.121:0/2935119340 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9748065980 msgr2=0x7f97480fef40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:47:35.325 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:35.322+0000 7f974ed38640 1 --2- 172.21.15.121:0/2935119340 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9748065980 0x7f97480fef40 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f97440048d0 tx=0x7f9744009da0 comp rx=0 tx=0).stop 2024-08-18T22:47:35.325 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:35.322+0000 7f974ed38640 1 -- 172.21.15.121:0/2935119340 shutdown_connections 2024-08-18T22:47:35.325 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:35.322+0000 7f974ed38640 1 --2- 172.21.15.121:0/2935119340 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f97480ff480 0x7f9748101860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:47:35.325 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:35.322+0000 7f974ed38640 1 --2- 172.21.15.121:0/2935119340 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9748065980 0x7f97480fef40 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:47:35.325 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:35.322+0000 7f974ed38640 1 -- 172.21.15.121:0/2935119340 >> 172.21.15.121:0/2935119340 conn(0x7f97480f69b0 msgr2=0x7f97480f8dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:47:35.325 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:35.322+0000 7f974ed38640 1 -- 172.21.15.121:0/2935119340 shutdown_connections 2024-08-18T22:47:35.325 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:35.323+0000 7f974ed38640 1 -- 172.21.15.121:0/2935119340 wait complete. 2024-08-18T22:47:35.325 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:35.323+0000 7f974ed38640 1 Processor -- start 2024-08-18T22:47:35.326 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:35.323+0000 7f974ed38640 1 -- start start 2024-08-18T22:47:35.327 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:35.323+0000 7f974ed38640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9748065980 0x7f974810cf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:47:35.327 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:35.323+0000 7f974ed38640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f97480ff480 0x7f974810d470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:47:35.327 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:35.323+0000 7f974ed38640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f974810dac0 con 0x7f97480ff480 2024-08-18T22:47:35.327 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:35.323+0000 7f974ed38640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f974810e1b0 con 0x7f9748065980 2024-08-18T22:47:35.327 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:35.323+0000 7f973ffff640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f97480ff480 0x7f974810d470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:47:35.327 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:35.324+0000 7f973ffff640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f97480ff480 0x7f974810d470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:57646/0 (socket says 172.21.15.121:57646) 2024-08-18T22:47:35.328 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:35.324+0000 7f973ffff640 1 -- 172.21.15.121:0/6654560 learned_addr learned my addr 172.21.15.121:0/6654560 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-18T22:47:35.328 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:35.324+0000 7f974cad4640 1 --2- 172.21.15.121:0/6654560 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9748065980 0x7f974810cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:47:35.328 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:35.324+0000 7f973ffff640 1 -- 172.21.15.121:0/6654560 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9748065980 msgr2=0x7f974810cf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:47:35.328 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:35.324+0000 7f973ffff640 1 --2- 172.21.15.121:0/6654560 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9748065980 0x7f974810cf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:47:35.328 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:35.324+0000 7f973ffff640 1 -- 172.21.15.121:0/6654560 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9744005040 con 0x7f97480ff480 2024-08-18T22:47:35.328 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:35.324+0000 7f973ffff640 1 --2- 172.21.15.121:0/6654560 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f97480ff480 0x7f974810d470 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f9738002a50 tx=0x7f9738004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:47:35.328 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:35.324+0000 7f973d7fa640 1 -- 172.21.15.121:0/6654560 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9738007c30 con 0x7f97480ff480 2024-08-18T22:47:35.328 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:35.324+0000 7f973d7fa640 1 -- 172.21.15.121:0/6654560 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f973800f040 con 0x7f97480ff480 2024-08-18T22:47:35.328 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:35.324+0000 7f974ed38640 1 -- 172.21.15.121:0/6654560 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f974810e440 con 0x7f97480ff480 2024-08-18T22:47:35.328 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:35.324+0000 7f973d7fa640 1 -- 172.21.15.121:0/6654560 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f973800da10 con 0x7f97480ff480 2024-08-18T22:47:35.328 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:35.324+0000 7f974ed38640 1 -- 172.21.15.121:0/6654560 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f974810e9b0 con 0x7f97480ff480 2024-08-18T22:47:35.328 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:35.325+0000 7f974ed38640 1 -- 172.21.15.121:0/6654560 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97480fa630 con 0x7f97480ff480 2024-08-18T22:47:35.329 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:35.326+0000 7f973d7fa640 1 -- 172.21.15.121:0/6654560 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 37) v1 ==== 92205+0+0 (secure 0 0 0) 0x7f973800dca0 con 0x7f97480ff480 2024-08-18T22:47:35.329 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:35.326+0000 7f973d7fa640 1 --2- 172.21.15.121:0/6654560 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f973006e0b0 0x7f9730070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:47:35.329 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:35.326+0000 7f973d7fa640 1 -- 172.21.15.121:0/6654560 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f973808d350 con 0x7f97480ff480 2024-08-18T22:47:35.330 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:35.326+0000 7f974cad4640 1 --2- 172.21.15.121:0/6654560 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f973006e0b0 0x7f9730070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:47:35.330 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:35.327+0000 7f974cad4640 1 --2- 172.21.15.121:0/6654560 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f973006e0b0 0x7f9730070560 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f97440048a0 tx=0x7f9744035040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:47:35.332 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:35.331+0000 7f973d7fa640 1 -- 172.21.15.121:0/6654560 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f9738056730 con 0x7f97480ff480 2024-08-18T22:47:35.534 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:35.531+0000 7f974ed38640 1 -- 172.21.15.121:0/6654560 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f974810ed00 con 0x7f97480ff480 2024-08-18T22:47:35.534 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:35.532+0000 7f973d7fa640 1 -- 172.21.15.121:0/6654560 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 22 v22) v1 ==== 76+0+1942 (secure 0 0 0) 0x7f9738059df0 con 0x7f97480ff480 2024-08-18T22:47:35.534 INFO:teuthology.orchestra.run.smithi121.stdout:e22 2024-08-18T22:47:35.534 INFO:teuthology.orchestra.run.smithi121.stdout:btime 2024-08-18T22:45:32:233419+0000 2024-08-18T22:47:35.534 INFO:teuthology.orchestra.run.smithi121.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-08-18T22:47:35.534 INFO:teuthology.orchestra.run.smithi121.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-08-18T22:47:35.535 INFO:teuthology.orchestra.run.smithi121.stdout:legacy client fscid: 1 2024-08-18T22:47:35.535 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-08-18T22:47:35.535 INFO:teuthology.orchestra.run.smithi121.stdout:Filesystem 'cephfs' (1) 2024-08-18T22:47:35.535 INFO:teuthology.orchestra.run.smithi121.stdout:fs_name cephfs 2024-08-18T22:47:35.535 INFO:teuthology.orchestra.run.smithi121.stdout:epoch 22 2024-08-18T22:47:35.535 INFO:teuthology.orchestra.run.smithi121.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-08-18T22:47:35.535 INFO:teuthology.orchestra.run.smithi121.stdout:created 2024-08-18T22:39:04.054074+0000 2024-08-18T22:47:35.535 INFO:teuthology.orchestra.run.smithi121.stdout:modified 2024-08-18T22:45:31.247467+0000 2024-08-18T22:47:35.535 INFO:teuthology.orchestra.run.smithi121.stdout:tableserver 0 2024-08-18T22:47:35.535 INFO:teuthology.orchestra.run.smithi121.stdout:root 0 2024-08-18T22:47:35.535 INFO:teuthology.orchestra.run.smithi121.stdout:session_timeout 60 2024-08-18T22:47:35.535 INFO:teuthology.orchestra.run.smithi121.stdout:session_autoclose 300 2024-08-18T22:47:35.535 INFO:teuthology.orchestra.run.smithi121.stdout:max_file_size 1099511627776 2024-08-18T22:47:35.535 INFO:teuthology.orchestra.run.smithi121.stdout:max_xattr_size 65536 2024-08-18T22:47:35.536 INFO:teuthology.orchestra.run.smithi121.stdout:required_client_features {} 2024-08-18T22:47:35.536 INFO:teuthology.orchestra.run.smithi121.stdout:last_failure 0 2024-08-18T22:47:35.536 INFO:teuthology.orchestra.run.smithi121.stdout:last_failure_osd_epoch 47 2024-08-18T22:47:35.536 INFO:teuthology.orchestra.run.smithi121.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-08-18T22:47:35.536 INFO:teuthology.orchestra.run.smithi121.stdout:max_mds 2 2024-08-18T22:47:35.536 INFO:teuthology.orchestra.run.smithi121.stdout:in 0,1 2024-08-18T22:47:35.536 INFO:teuthology.orchestra.run.smithi121.stdout:up {0=14474,1=24249} 2024-08-18T22:47:35.536 INFO:teuthology.orchestra.run.smithi121.stdout:failed 2024-08-18T22:47:35.536 INFO:teuthology.orchestra.run.smithi121.stdout:damaged 2024-08-18T22:47:35.536 INFO:teuthology.orchestra.run.smithi121.stdout:stopped 2024-08-18T22:47:35.536 INFO:teuthology.orchestra.run.smithi121.stdout:data_pools [3] 2024-08-18T22:47:35.536 INFO:teuthology.orchestra.run.smithi121.stdout:metadata_pool 2 2024-08-18T22:47:35.536 INFO:teuthology.orchestra.run.smithi121.stdout:inline_data disabled 2024-08-18T22:47:35.536 INFO:teuthology.orchestra.run.smithi121.stdout:balancer 2024-08-18T22:47:35.537 INFO:teuthology.orchestra.run.smithi121.stdout:bal_rank_mask -1 2024-08-18T22:47:35.537 INFO:teuthology.orchestra.run.smithi121.stdout:standby_count_wanted 1 2024-08-18T22:47:35.537 INFO:teuthology.orchestra.run.smithi121.stdout:qdb_cluster leader: 14474 members: 14474,24249 2024-08-18T22:47:35.537 INFO:teuthology.orchestra.run.smithi121.stdout:[mds.cephfs.smithi121.gbickb{0:14474} state up:active seq 83 join_fscid=1 addr [v2:172.21.15.121:6828/2277706406,v1:172.21.15.121:6829/2277706406] compat {c=[1],r=[1],i=[7ff]}] 2024-08-18T22:47:35.537 INFO:teuthology.orchestra.run.smithi121.stdout:[mds.cephfs.smithi195.buqvbr{1:24249} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.195:6824/2414511859,v1:172.21.15.195:6825/2414511859] compat {c=[1],r=[1],i=[7ff]}] 2024-08-18T22:47:35.537 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-08-18T22:47:35.537 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-08-18T22:47:35.537 INFO:teuthology.orchestra.run.smithi121.stdout:Standby daemons: 2024-08-18T22:47:35.537 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-08-18T22:47:35.537 INFO:teuthology.orchestra.run.smithi121.stdout:[mds.cephfs.smithi121.xuzsdg{-1:14490} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.121:6826/91588128,v1:172.21.15.121:6827/91588128] compat {c=[1],r=[1],i=[7ff]}] 2024-08-18T22:47:35.537 INFO:teuthology.orchestra.run.smithi121.stdout:[mds.cephfs.smithi195.nptgyc{-1:24259} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.195:6826/238549847,v1:172.21.15.195:6827/238549847] compat {c=[1],r=[1],i=[7ff]}] 2024-08-18T22:47:35.538 INFO:teuthology.orchestra.run.smithi121.stderr:dumped fsmap epoch 22 2024-08-18T22:47:35.538 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:35.534+0000 7f974ed38640 1 -- 172.21.15.121:0/6654560 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f973006e0b0 msgr2=0x7f9730070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:47:35.538 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:35.534+0000 7f974ed38640 1 --2- 172.21.15.121:0/6654560 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f973006e0b0 0x7f9730070560 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f97440048a0 tx=0x7f9744035040 comp rx=0 tx=0).stop 2024-08-18T22:47:35.538 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:35.534+0000 7f974ed38640 1 -- 172.21.15.121:0/6654560 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f97480ff480 msgr2=0x7f974810d470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:47:35.538 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:35.534+0000 7f974ed38640 1 --2- 172.21.15.121:0/6654560 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f97480ff480 0x7f974810d470 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f9738002a50 tx=0x7f9738004600 comp rx=0 tx=0).stop 2024-08-18T22:47:35.539 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:35.534+0000 7f974ed38640 1 -- 172.21.15.121:0/6654560 shutdown_connections 2024-08-18T22:47:35.539 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:35.534+0000 7f974ed38640 1 --2- 172.21.15.121:0/6654560 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f973006e0b0 0x7f9730070560 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:47:35.539 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:35.534+0000 7f974ed38640 1 --2- 172.21.15.121:0/6654560 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f97480ff480 0x7f974810d470 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:47:35.539 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:35.534+0000 7f974ed38640 1 --2- 172.21.15.121:0/6654560 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9748065980 0x7f974810cf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:47:35.539 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:35.534+0000 7f974ed38640 1 -- 172.21.15.121:0/6654560 >> 172.21.15.121:0/6654560 conn(0x7f97480f69b0 msgr2=0x7f97480f6d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:47:35.539 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:35.534+0000 7f974ed38640 1 -- 172.21.15.121:0/6654560 shutdown_connections 2024-08-18T22:47:35.539 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:35.534+0000 7f974ed38640 1 -- 172.21.15.121:0/6654560 wait complete. 2024-08-18T22:47:35.617 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:35.613+0000 7f50cf441640 1 -- 172.21.15.121:0/3450170299 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f50c80fd230 msgr2=0x7f50c80ff6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:47:35.617 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:35.613+0000 7f50cf441640 1 --2- 172.21.15.121:0/3450170299 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f50c80fd230 0x7f50c80ff6b0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f50b80048d0 tx=0x7f50b8009da0 comp rx=0 tx=0).stop 2024-08-18T22:47:35.617 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:35.613+0000 7f50cf441640 1 -- 172.21.15.121:0/3450170299 shutdown_connections 2024-08-18T22:47:35.617 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:35.613+0000 7f50cf441640 1 --2- 172.21.15.121:0/3450170299 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f50c80fd230 0x7f50c80ff6b0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:47:35.617 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:35.613+0000 7f50cf441640 1 --2- 172.21.15.121:0/3450170299 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f50c80664b0 0x7f50c80fccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:47:35.617 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:35.613+0000 7f50cf441640 1 -- 172.21.15.121:0/3450170299 >> 172.21.15.121:0/3450170299 conn(0x7f50c80f69b0 msgr2=0x7f50c80f8de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:47:35.618 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:35.614+0000 7f50cf441640 1 -- 172.21.15.121:0/3450170299 shutdown_connections 2024-08-18T22:47:35.618 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:35.614+0000 7f50cf441640 1 -- 172.21.15.121:0/3450170299 wait complete. 2024-08-18T22:47:35.618 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:35.614+0000 7f50cf441640 1 Processor -- start 2024-08-18T22:47:35.618 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:35.614+0000 7f50cf441640 1 -- start start 2024-08-18T22:47:35.618 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:35.614+0000 7f50cf441640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f50c80664b0 0x7f50c8113540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:47:35.618 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:35.614+0000 7f50cf441640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f50c80fd230 0x7f50c8113a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:47:35.618 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:35.614+0000 7f50cf441640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50c81148f0 con 0x7f50c80664b0 2024-08-18T22:47:35.618 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:35.614+0000 7f50cf441640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50c8114a60 con 0x7f50c80fd230 2024-08-18T22:47:35.618 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:35.614+0000 7f50cd1dd640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f50c80664b0 0x7f50c8113540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:47:35.618 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:35.614+0000 7f50cd1dd640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f50c80664b0 0x7f50c8113540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:57656/0 (socket says 172.21.15.121:57656) 2024-08-18T22:47:35.618 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:35.614+0000 7f50cd1dd640 1 -- 172.21.15.121:0/2298617548 learned_addr learned my addr 172.21.15.121:0/2298617548 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-18T22:47:35.619 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:35.614+0000 7f50cc9dc640 1 --2- 172.21.15.121:0/2298617548 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f50c80fd230 0x7f50c8113a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:47:35.619 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:35.615+0000 7f50cd1dd640 1 -- 172.21.15.121:0/2298617548 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f50c80fd230 msgr2=0x7f50c8113a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:47:35.619 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:35.615+0000 7f50cd1dd640 1 --2- 172.21.15.121:0/2298617548 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f50c80fd230 0x7f50c8113a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:47:35.619 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:35.615+0000 7f50cd1dd640 1 -- 172.21.15.121:0/2298617548 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50b8005040 con 0x7f50c80664b0 2024-08-18T22:47:35.619 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:35.615+0000 7f50cd1dd640 1 --2- 172.21.15.121:0/2298617548 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f50c80664b0 0x7f50c8113540 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f50c400b580 tx=0x7f50c40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:47:35.619 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:35.615+0000 7f50bdffb640 1 -- 172.21.15.121:0/2298617548 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f50c400f6f0 con 0x7f50c80664b0 2024-08-18T22:47:35.619 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:35.615+0000 7f50cf441640 1 -- 172.21.15.121:0/2298617548 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50c8114d40 con 0x7f50c80664b0 2024-08-18T22:47:35.619 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:35.615+0000 7f50bdffb640 1 -- 172.21.15.121:0/2298617548 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f50c400fcf0 con 0x7f50c80664b0 2024-08-18T22:47:35.619 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:35.615+0000 7f50bdffb640 1 -- 172.21.15.121:0/2298617548 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f50c40103a0 con 0x7f50c80664b0 2024-08-18T22:47:35.619 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:35.615+0000 7f50cf441640 1 -- 172.21.15.121:0/2298617548 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50c8115260 con 0x7f50c80664b0 2024-08-18T22:47:35.620 INFO:journalctl@ceph.osd.5.smithi195.stdout:Aug 18 22:47:35 smithi195 podman[88132]: 2024-08-18 22:47:35.183418733 +0000 UTC m=+0.557674909 container remove dc7644691ff30332339dd80e2c949463e303c0e465a1309dbd128d952fcfff99 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-5-deactivate, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, io.buildah.version=1.36.0, maintainer=Guillaume Abrioux , RELEASE=squid-de09dd0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-08-18T22:47:35.620 INFO:journalctl@ceph.osd.5.smithi195.stdout:Aug 18 22:47:35 smithi195 systemd[1]: ceph-b003123a-5db1-11ef-bccf-c7b262605968@osd.5.service: Deactivated successfully. 2024-08-18T22:47:35.620 INFO:journalctl@ceph.osd.5.smithi195.stdout:Aug 18 22:47:35 smithi195 systemd[1]: Stopped Ceph osd.5 for b003123a-5db1-11ef-bccf-c7b262605968. 2024-08-18T22:47:35.620 INFO:journalctl@ceph.osd.5.smithi195.stdout:Aug 18 22:47:35 smithi195 systemd[1]: ceph-b003123a-5db1-11ef-bccf-c7b262605968@osd.5.service: Consumed 49.097s CPU time. 2024-08-18T22:47:35.620 INFO:journalctl@ceph.osd.5.smithi195.stdout:Aug 18 22:47:35 smithi195 systemd[1]: Starting Ceph osd.5 for b003123a-5db1-11ef-bccf-c7b262605968... 2024-08-18T22:47:35.621 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:35.616+0000 7f50cf441640 1 -- 172.21.15.121:0/2298617548 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50c810bba0 con 0x7f50c80664b0 2024-08-18T22:47:35.621 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:35.617+0000 7f50bdffb640 1 -- 172.21.15.121:0/2298617548 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 37) v1 ==== 92205+0+0 (secure 0 0 0) 0x7f50c40116b0 con 0x7f50c80664b0 2024-08-18T22:47:35.621 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:35.617+0000 7f50bdffb640 1 --2- 172.21.15.121:0/2298617548 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f50b406e0b0 0x7f50b4070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:47:35.621 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:35.617+0000 7f50bdffb640 1 -- 172.21.15.121:0/2298617548 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f50c408da60 con 0x7f50c80664b0 2024-08-18T22:47:35.621 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:35.617+0000 7f50cc9dc640 1 --2- 172.21.15.121:0/2298617548 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f50b406e0b0 0x7f50b4070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:47:35.621 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:35.618+0000 7f50cc9dc640 1 --2- 172.21.15.121:0/2298617548 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f50b406e0b0 0x7f50b4070560 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f50c81132f0 tx=0x7f50b8035040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:47:35.623 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:35.621+0000 7f50bdffb640 1 -- 172.21.15.121:0/2298617548 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f50c4056e10 con 0x7f50c80664b0 2024-08-18T22:47:35.803 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:35.801+0000 7f50cf441640 1 -- 172.21.15.121:0/2298617548 --> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f50c81154e0 con 0x7f50b406e0b0 2024-08-18T22:47:35.804 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:35.802+0000 7f50bdffb640 1 -- 172.21.15.121:0/2298617548 <== mgr.34102 v2:172.21.15.121:6800/3037387239 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f50c81154e0 con 0x7f50b406e0b0 2024-08-18T22:47:35.804 INFO:teuthology.orchestra.run.smithi121.stdout:{ 2024-08-18T22:47:35.804 INFO:teuthology.orchestra.run.smithi121.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9", 2024-08-18T22:47:35.804 INFO:teuthology.orchestra.run.smithi121.stdout: "in_progress": true, 2024-08-18T22:47:35.804 INFO:teuthology.orchestra.run.smithi121.stdout: "which": "Upgrading all daemon types on all hosts", 2024-08-18T22:47:35.804 INFO:teuthology.orchestra.run.smithi121.stdout: "services_complete": [ 2024-08-18T22:47:35.805 INFO:teuthology.orchestra.run.smithi121.stdout: "mgr", 2024-08-18T22:47:35.805 INFO:teuthology.orchestra.run.smithi121.stdout: "mon", 2024-08-18T22:47:35.805 INFO:teuthology.orchestra.run.smithi121.stdout: "crash" 2024-08-18T22:47:35.805 INFO:teuthology.orchestra.run.smithi121.stdout: ], 2024-08-18T22:47:35.805 INFO:teuthology.orchestra.run.smithi121.stdout: "progress": "11/21 daemons upgraded", 2024-08-18T22:47:35.805 INFO:teuthology.orchestra.run.smithi121.stdout: "message": "Currently upgrading osd daemons", 2024-08-18T22:47:35.805 INFO:teuthology.orchestra.run.smithi121.stdout: "is_paused": false 2024-08-18T22:47:35.805 INFO:teuthology.orchestra.run.smithi121.stdout:} 2024-08-18T22:47:35.806 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:35.804+0000 7f50cf441640 1 -- 172.21.15.121:0/2298617548 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f50b406e0b0 msgr2=0x7f50b4070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:47:35.806 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:35.804+0000 7f50cf441640 1 --2- 172.21.15.121:0/2298617548 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f50b406e0b0 0x7f50b4070560 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f50c81132f0 tx=0x7f50b8035040 comp rx=0 tx=0).stop 2024-08-18T22:47:35.807 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:35.804+0000 7f50cf441640 1 -- 172.21.15.121:0/2298617548 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f50c80664b0 msgr2=0x7f50c8113540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:47:35.807 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:35.804+0000 7f50cf441640 1 --2- 172.21.15.121:0/2298617548 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f50c80664b0 0x7f50c8113540 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f50c400b580 tx=0x7f50c40091a0 comp rx=0 tx=0).stop 2024-08-18T22:47:35.807 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:35.804+0000 7f50cf441640 1 -- 172.21.15.121:0/2298617548 shutdown_connections 2024-08-18T22:47:35.807 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:35.804+0000 7f50cf441640 1 --2- 172.21.15.121:0/2298617548 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f50b406e0b0 0x7f50b4070560 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:47:35.807 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:35.804+0000 7f50cf441640 1 --2- 172.21.15.121:0/2298617548 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f50c80fd230 0x7f50c8113a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:47:35.807 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:35.804+0000 7f50cf441640 1 --2- 172.21.15.121:0/2298617548 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f50c80664b0 0x7f50c8113540 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:47:35.807 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:35.804+0000 7f50cf441640 1 -- 172.21.15.121:0/2298617548 >> 172.21.15.121:0/2298617548 conn(0x7f50c80f69b0 msgr2=0x7f50c80f6dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:47:35.807 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:35.804+0000 7f50cf441640 1 -- 172.21.15.121:0/2298617548 shutdown_connections 2024-08-18T22:47:35.807 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:35.804+0000 7f50cf441640 1 -- 172.21.15.121:0/2298617548 wait complete. 2024-08-18T22:47:35.884 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:35.882+0000 7fc771375640 1 -- 172.21.15.121:0/2607733549 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc76c066530 msgr2=0x7fc76c0fef00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:47:35.884 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:35.882+0000 7fc771375640 1 --2- 172.21.15.121:0/2607733549 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc76c066530 0x7fc76c0fef00 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fc7540048d0 tx=0x7fc754009da0 comp rx=0 tx=0).stop 2024-08-18T22:47:35.884 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:35.882+0000 7fc771375640 1 -- 172.21.15.121:0/2607733549 shutdown_connections 2024-08-18T22:47:35.885 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:35.882+0000 7fc771375640 1 --2- 172.21.15.121:0/2607733549 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc76c0ff440 0x7fc76c101820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:47:35.885 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:35.882+0000 7fc771375640 1 --2- 172.21.15.121:0/2607733549 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc76c066530 0x7fc76c0fef00 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:47:35.885 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:35.882+0000 7fc771375640 1 -- 172.21.15.121:0/2607733549 >> 172.21.15.121:0/2607733549 conn(0x7fc76c0f69b0 msgr2=0x7fc76c0f8de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:47:35.885 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:47:35 smithi121 ceph-mon[81053]: from='client.34344 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-18T22:47:35.885 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:47:35 smithi121 ceph-mon[81053]: pgmap v148: 65 pgs: 10 stale+active+clean, 10 active+undersized+degraded, 45 active+clean; 2.0 GiB data, 6.3 GiB used, 530 GiB / 536 GiB avail; 1406/34143 objects degraded (4.118%) 2024-08-18T22:47:35.885 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:47:35 smithi121 ceph-mon[81053]: from='client.34348 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-18T22:47:35.885 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:47:35 smithi121 ceph-mon[81053]: Health check failed: Degraded data redundancy: 1406/34143 objects degraded (4.118%), 10 pgs degraded (PG_DEGRADED) 2024-08-18T22:47:35.885 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:47:35 smithi121 ceph-mon[81053]: from='client.? 172.21.15.121:0/713068348' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-08-18T22:47:35.885 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:47:35 smithi121 ceph-mon[81053]: 3 slow requests, 0 included below; oldest blocked for > 366.870744 secs 2024-08-18T22:47:35.885 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:47:35 smithi121 ceph-mon[81053]: from='client.? 172.21.15.121:0/6654560' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-08-18T22:47:35.887 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:35.882+0000 7fc771375640 1 -- 172.21.15.121:0/2607733549 shutdown_connections 2024-08-18T22:47:35.887 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:35.882+0000 7fc771375640 1 -- 172.21.15.121:0/2607733549 wait complete. 2024-08-18T22:47:35.887 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:35.882+0000 7fc771375640 1 Processor -- start 2024-08-18T22:47:35.887 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:35.883+0000 7fc771375640 1 -- start start 2024-08-18T22:47:35.887 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:35.883+0000 7fc771375640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc76c066530 0x7fc76c10cef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:47:35.888 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:35.883+0000 7fc771375640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc76c0ff440 0x7fc76c10d430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:47:35.888 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:35.883+0000 7fc771375640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc76c10e160 con 0x7fc76c066530 2024-08-18T22:47:35.888 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:35.883+0000 7fc771375640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc76c10e2d0 con 0x7fc76c0ff440 2024-08-18T22:47:35.888 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:35.883+0000 7fc76affd640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc76c066530 0x7fc76c10cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:47:35.888 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:35.883+0000 7fc76a7fc640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc76c0ff440 0x7fc76c10d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:47:35.888 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:35.883+0000 7fc76affd640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc76c066530 0x7fc76c10cef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:57674/0 (socket says 172.21.15.121:57674) 2024-08-18T22:47:35.888 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:35.883+0000 7fc76affd640 1 -- 172.21.15.121:0/2628791657 learned_addr learned my addr 172.21.15.121:0/2628791657 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-18T22:47:35.888 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:35.883+0000 7fc76a7fc640 1 -- 172.21.15.121:0/2628791657 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc76c066530 msgr2=0x7fc76c10cef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:47:35.888 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:35.883+0000 7fc76a7fc640 1 --2- 172.21.15.121:0/2628791657 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc76c066530 0x7fc76c10cef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:47:35.888 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:35.883+0000 7fc76a7fc640 1 -- 172.21.15.121:0/2628791657 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc754005040 con 0x7fc76c0ff440 2024-08-18T22:47:35.888 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:35.883+0000 7fc76affd640 1 --2- 172.21.15.121:0/2628791657 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc76c066530 0x7fc76c10cef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:47:35.888 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:35.883+0000 7fc76a7fc640 1 --2- 172.21.15.121:0/2628791657 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc76c0ff440 0x7fc76c10d430 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fc75c0027a0 tx=0x7fc75c009f30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:47:35.888 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:35.884+0000 7fc7637fe640 1 -- 172.21.15.121:0/2628791657 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc75c002d30 con 0x7fc76c0ff440 2024-08-18T22:47:35.889 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:35.884+0000 7fc771375640 1 -- 172.21.15.121:0/2628791657 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc76c10e5b0 con 0x7fc76c0ff440 2024-08-18T22:47:35.889 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:35.884+0000 7fc771375640 1 -- 172.21.15.121:0/2628791657 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc76c10eb50 con 0x7fc76c0ff440 2024-08-18T22:47:35.889 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:35.884+0000 7fc7637fe640 1 -- 172.21.15.121:0/2628791657 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fc75c00f040 con 0x7fc76c0ff440 2024-08-18T22:47:35.889 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:35.884+0000 7fc7637fe640 1 -- 172.21.15.121:0/2628791657 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc75c009430 con 0x7fc76c0ff440 2024-08-18T22:47:35.889 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:35.885+0000 7fc771375640 1 -- 172.21.15.121:0/2628791657 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc74c005240 con 0x7fc76c0ff440 2024-08-18T22:47:35.890 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:35.886+0000 7fc7637fe640 1 -- 172.21.15.121:0/2628791657 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 37) v1 ==== 92205+0+0 (secure 0 0 0) 0x7fc75c007c30 con 0x7fc76c0ff440 2024-08-18T22:47:35.890 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:35.886+0000 7fc7637fe640 1 --2- 172.21.15.121:0/2628791657 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7fc75806e0b0 0x7fc758070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:47:35.890 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:35.886+0000 7fc7637fe640 1 -- 172.21.15.121:0/2628791657 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6496+0+0 (secure 0 0 0) 0x7fc75c08d7c0 con 0x7fc76c0ff440 2024-08-18T22:47:35.890 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:35.886+0000 7fc76affd640 1 --2- 172.21.15.121:0/2628791657 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7fc75806e0b0 0x7fc758070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:47:35.890 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:35.887+0000 7fc76affd640 1 --2- 172.21.15.121:0/2628791657 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7fc75806e0b0 0x7fc758070560 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fc754000c00 tx=0x7fc754035040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:47:35.893 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:35.891+0000 7fc7637fe640 1 -- 172.21.15.121:0/2628791657 <== mon.1 v2:172.21.15.195:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7fc75c056b70 con 0x7fc76c0ff440 2024-08-18T22:47:35.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:47:35 smithi195 ceph-mon[68841]: from='client.34344 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-18T22:47:35.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:47:35 smithi195 ceph-mon[68841]: pgmap v148: 65 pgs: 10 stale+active+clean, 10 active+undersized+degraded, 45 active+clean; 2.0 GiB data, 6.3 GiB used, 530 GiB / 536 GiB avail; 1406/34143 objects degraded (4.118%) 2024-08-18T22:47:35.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:47:35 smithi195 ceph-mon[68841]: from='client.34348 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-18T22:47:35.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:47:35 smithi195 ceph-mon[68841]: Health check failed: Degraded data redundancy: 1406/34143 objects degraded (4.118%), 10 pgs degraded (PG_DEGRADED) 2024-08-18T22:47:35.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:47:35 smithi195 ceph-mon[68841]: from='client.? 172.21.15.121:0/713068348' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-08-18T22:47:35.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:47:35 smithi195 ceph-mon[68841]: 3 slow requests, 0 included below; oldest blocked for > 366.870744 secs 2024-08-18T22:47:35.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:47:35 smithi195 ceph-mon[68841]: from='client.? 172.21.15.121:0/6654560' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-08-18T22:47:35.910 INFO:journalctl@ceph.osd.5.smithi195.stdout:Aug 18 22:47:35 smithi195 podman[88234]: 2024-08-18 22:47:35.517672607 +0000 UTC m=+0.017459784 image pull ea7a5189f30bad3aca9524788e2965d2368d7ce786df09d4edcd8c3edf9cefba quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9 2024-08-18T22:47:35.910 INFO:journalctl@ceph.osd.5.smithi195.stdout:Aug 18 22:47:35 smithi195 podman[88234]: 2024-08-18 22:47:35.617485782 +0000 UTC m=+0.117272948 container create 62686cfc419f294cd81f1c9d827f4fce72f0a4e2fb238fd49ef7edcd1261a66d (image=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-5-activate, maintainer=Guillaume Abrioux , ceph=True, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, io.buildah.version=1.36.0, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, RELEASE=squid-de09dd0, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD) 2024-08-18T22:47:35.910 INFO:journalctl@ceph.osd.5.smithi195.stdout:Aug 18 22:47:35 smithi195 podman[88234]: 2024-08-18 22:47:35.845450227 +0000 UTC m=+0.345237393 container init 62686cfc419f294cd81f1c9d827f4fce72f0a4e2fb238fd49ef7edcd1261a66d (image=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-5-activate, RELEASE=squid-de09dd0, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.36.0, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD) 2024-08-18T22:47:35.910 INFO:journalctl@ceph.osd.5.smithi195.stdout:Aug 18 22:47:35 smithi195 podman[88234]: 2024-08-18 22:47:35.848878341 +0000 UTC m=+0.348665516 container start 62686cfc419f294cd81f1c9d827f4fce72f0a4e2fb238fd49ef7edcd1261a66d (image=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-5-activate, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, io.buildah.version=1.36.0, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-de09dd0) 2024-08-18T22:47:36.122 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:36.120+0000 7fc771375640 1 -- 172.21.15.121:0/2628791657 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fc74c0054f0 con 0x7fc76c0ff440 2024-08-18T22:47:36.123 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:36.121+0000 7fc7637fe640 1 -- 172.21.15.121:0/2628791657 <== mon.1 v2:172.21.15.195:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+1234 (secure 0 0 0) 0x7fc75c05a230 con 0x7fc76c0ff440 2024-08-18T22:47:36.123 INFO:teuthology.orchestra.run.smithi121.stdout:HEALTH_WARN 1 MDSs report slow requests; 1 osds down; all OSDs are running squid or later but require_osd_release < squid; Degraded data redundancy: 1406/34143 objects degraded (4.118%), 10 pgs degraded 2024-08-18T22:47:36.123 INFO:teuthology.orchestra.run.smithi121.stdout:[WRN] MDS_SLOW_REQUEST: 1 MDSs report slow requests 2024-08-18T22:47:36.123 INFO:teuthology.orchestra.run.smithi121.stdout: mds.cephfs.smithi121.gbickb(mds.0): 3 slow requests are blocked > 180 secs 2024-08-18T22:47:36.123 INFO:teuthology.orchestra.run.smithi121.stdout:[WRN] OSD_DOWN: 1 osds down 2024-08-18T22:47:36.123 INFO:teuthology.orchestra.run.smithi121.stdout: osd.5 (root=default,host=smithi195) is down 2024-08-18T22:47:36.123 INFO:teuthology.orchestra.run.smithi121.stdout:[WRN] OSD_UPGRADE_FINISHED: all OSDs are running squid or later but require_osd_release < squid 2024-08-18T22:47:36.123 INFO:teuthology.orchestra.run.smithi121.stdout: all OSDs are running squid or later but require_osd_release < squid 2024-08-18T22:47:36.124 INFO:teuthology.orchestra.run.smithi121.stdout:[WRN] PG_DEGRADED: Degraded data redundancy: 1406/34143 objects degraded (4.118%), 10 pgs degraded 2024-08-18T22:47:36.124 INFO:teuthology.orchestra.run.smithi121.stdout: pg 2.8 is active+undersized+degraded, acting [3,0] 2024-08-18T22:47:36.124 INFO:teuthology.orchestra.run.smithi121.stdout: pg 2.b is active+undersized+degraded, acting [3,4] 2024-08-18T22:47:36.124 INFO:teuthology.orchestra.run.smithi121.stdout: pg 2.14 is active+undersized+degraded, acting [3,4] 2024-08-18T22:47:36.124 INFO:teuthology.orchestra.run.smithi121.stdout: pg 2.16 is active+undersized+degraded, acting [3,2] 2024-08-18T22:47:36.124 INFO:teuthology.orchestra.run.smithi121.stdout: pg 2.1a is active+undersized+degraded, acting [3,4] 2024-08-18T22:47:36.124 INFO:teuthology.orchestra.run.smithi121.stdout: pg 2.1d is active+undersized+degraded, acting [3,0] 2024-08-18T22:47:36.124 INFO:teuthology.orchestra.run.smithi121.stdout: pg 3.f is active+undersized+degraded, acting [3,0] 2024-08-18T22:47:36.124 INFO:teuthology.orchestra.run.smithi121.stdout: pg 3.13 is active+undersized+degraded, acting [3,2] 2024-08-18T22:47:36.124 INFO:teuthology.orchestra.run.smithi121.stdout: pg 3.14 is active+undersized+degraded, acting [3,4] 2024-08-18T22:47:36.124 INFO:teuthology.orchestra.run.smithi121.stdout: pg 3.16 is active+undersized+degraded, acting [3,1] 2024-08-18T22:47:36.125 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:36.123+0000 7fc771375640 1 -- 172.21.15.121:0/2628791657 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7fc75806e0b0 msgr2=0x7fc758070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:47:36.125 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:36.123+0000 7fc771375640 1 --2- 172.21.15.121:0/2628791657 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7fc75806e0b0 0x7fc758070560 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fc754000c00 tx=0x7fc754035040 comp rx=0 tx=0).stop 2024-08-18T22:47:36.125 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:36.123+0000 7fc771375640 1 -- 172.21.15.121:0/2628791657 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc76c0ff440 msgr2=0x7fc76c10d430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:47:36.125 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:36.123+0000 7fc771375640 1 --2- 172.21.15.121:0/2628791657 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc76c0ff440 0x7fc76c10d430 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fc75c0027a0 tx=0x7fc75c009f30 comp rx=0 tx=0).stop 2024-08-18T22:47:36.125 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:36.123+0000 7fc771375640 1 -- 172.21.15.121:0/2628791657 shutdown_connections 2024-08-18T22:47:36.125 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:36.123+0000 7fc771375640 1 --2- 172.21.15.121:0/2628791657 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7fc75806e0b0 0x7fc758070560 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:47:36.125 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:36.123+0000 7fc771375640 1 --2- 172.21.15.121:0/2628791657 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc76c0ff440 0x7fc76c10d430 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:47:36.125 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:36.123+0000 7fc771375640 1 --2- 172.21.15.121:0/2628791657 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc76c066530 0x7fc76c10cef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:47:36.126 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:36.123+0000 7fc771375640 1 -- 172.21.15.121:0/2628791657 >> 172.21.15.121:0/2628791657 conn(0x7fc76c0f69b0 msgr2=0x7fc76c0f6dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:47:36.126 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:36.123+0000 7fc771375640 1 -- 172.21.15.121:0/2628791657 shutdown_connections 2024-08-18T22:47:36.126 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:47:36.123+0000 7fc771375640 1 -- 172.21.15.121:0/2628791657 wait complete. 2024-08-18T22:47:36.410 INFO:journalctl@ceph.osd.5.smithi195.stdout:Aug 18 22:47:35 smithi195 podman[88234]: 2024-08-18 22:47:35.945395893 +0000 UTC m=+0.445183063 container attach 62686cfc419f294cd81f1c9d827f4fce72f0a4e2fb238fd49ef7edcd1261a66d (image=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-5-activate, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, ceph=True, org.label-schema.schema-version=1.0, RELEASE=squid-de09dd0, GIT_BRANCH=HEAD, GIT_CLEAN=True, io.buildah.version=1.36.0, org.label-schema.vendor=CentOS) 2024-08-18T22:47:36.410 INFO:journalctl@ceph.osd.5.smithi195.stdout:Aug 18 22:47:35 smithi195 ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-5-activate[88248]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-08-18T22:47:36.410 INFO:journalctl@ceph.osd.5.smithi195.stdout:Aug 18 22:47:35 smithi195 bash[88234]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-08-18T22:47:36.410 INFO:journalctl@ceph.osd.5.smithi195.stdout:Aug 18 22:47:35 smithi195 ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-5-activate[88248]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-08-18T22:47:36.410 INFO:journalctl@ceph.osd.5.smithi195.stdout:Aug 18 22:47:35 smithi195 bash[88234]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-08-18T22:47:36.410 INFO:journalctl@ceph.osd.5.smithi195.stdout:Aug 18 22:47:36 smithi195 ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-5-activate[88248]: --> Failed to activate via raw: activate() takes 1 positional argument but 5 were given 2024-08-18T22:47:36.410 INFO:journalctl@ceph.osd.5.smithi195.stdout:Aug 18 22:47:36 smithi195 bash[88234]: --> Failed to activate via raw: activate() takes 1 positional argument but 5 were given 2024-08-18T22:47:36.410 INFO:journalctl@ceph.osd.5.smithi195.stdout:Aug 18 22:47:36 smithi195 ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-5-activate[88248]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-08-18T22:47:36.410 INFO:journalctl@ceph.osd.5.smithi195.stdout:Aug 18 22:47:36 smithi195 bash[88234]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-08-18T22:47:36.411 INFO:journalctl@ceph.osd.5.smithi195.stdout:Aug 18 22:47:36 smithi195 ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-5-activate[88248]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-08-18T22:47:36.411 INFO:journalctl@ceph.osd.5.smithi195.stdout:Aug 18 22:47:36 smithi195 bash[88234]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-08-18T22:47:36.411 INFO:journalctl@ceph.osd.5.smithi195.stdout:Aug 18 22:47:36 smithi195 ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-5-activate[88248]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-08-18T22:47:36.411 INFO:journalctl@ceph.osd.5.smithi195.stdout:Aug 18 22:47:36 smithi195 bash[88234]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-08-18T22:47:36.411 INFO:journalctl@ceph.osd.5.smithi195.stdout:Aug 18 22:47:36 smithi195 ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-5-activate[88248]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_2 --path /var/lib/ceph/osd/ceph-5 --no-mon-config 2024-08-18T22:47:36.411 INFO:journalctl@ceph.osd.5.smithi195.stdout:Aug 18 22:47:36 smithi195 bash[88234]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_2 --path /var/lib/ceph/osd/ceph-5 --no-mon-config 2024-08-18T22:47:36.411 INFO:journalctl@ceph.osd.5.smithi195.stdout:Aug 18 22:47:36 smithi195 ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-5-activate[88248]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5/block 2024-08-18T22:47:36.411 INFO:journalctl@ceph.osd.5.smithi195.stdout:Aug 18 22:47:36 smithi195 bash[88234]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5/block 2024-08-18T22:47:36.411 INFO:journalctl@ceph.osd.5.smithi195.stdout:Aug 18 22:47:36 smithi195 ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-5-activate[88248]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-5/block 2024-08-18T22:47:36.411 INFO:journalctl@ceph.osd.5.smithi195.stdout:Aug 18 22:47:36 smithi195 bash[88234]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-5/block 2024-08-18T22:47:36.411 INFO:journalctl@ceph.osd.5.smithi195.stdout:Aug 18 22:47:36 smithi195 ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-5-activate[88248]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-08-18T22:47:36.411 INFO:journalctl@ceph.osd.5.smithi195.stdout:Aug 18 22:47:36 smithi195 bash[88234]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-08-18T22:47:36.412 INFO:journalctl@ceph.osd.5.smithi195.stdout:Aug 18 22:47:36 smithi195 ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-5-activate[88248]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-08-18T22:47:36.412 INFO:journalctl@ceph.osd.5.smithi195.stdout:Aug 18 22:47:36 smithi195 bash[88234]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-08-18T22:47:36.412 INFO:journalctl@ceph.osd.5.smithi195.stdout:Aug 18 22:47:36 smithi195 ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-5-activate[88248]: --> ceph-volume lvm activate successful for osd ID: 5 2024-08-18T22:47:36.412 INFO:journalctl@ceph.osd.5.smithi195.stdout:Aug 18 22:47:36 smithi195 bash[88234]: --> ceph-volume lvm activate successful for osd ID: 5 2024-08-18T22:47:36.412 INFO:journalctl@ceph.osd.5.smithi195.stdout:Aug 18 22:47:36 smithi195 podman[88234]: 2024-08-18 22:47:36.131702144 +0000 UTC m=+0.631489321 container died 62686cfc419f294cd81f1c9d827f4fce72f0a4e2fb238fd49ef7edcd1261a66d (image=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-5-activate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, RELEASE=squid-de09dd0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, io.buildah.version=1.36.0) 2024-08-18T22:47:37.055 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:47:36 smithi195 ceph-mon[68841]: from='client.34352 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-18T22:47:37.055 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:47:36 smithi195 ceph-mon[68841]: from='client.? 172.21.15.121:0/2628791657' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-08-18T22:47:37.055 INFO:journalctl@ceph.osd.5.smithi195.stdout:Aug 18 22:47:36 smithi195 podman[88369]: 2024-08-18 22:47:36.707890326 +0000 UTC m=+0.566155244 container remove 62686cfc419f294cd81f1c9d827f4fce72f0a4e2fb238fd49ef7edcd1261a66d (image=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-5-activate, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.36.0, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=squid-de09dd0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-08-18T22:47:37.055 INFO:journalctl@ceph.osd.5.smithi195.stdout:Aug 18 22:47:36 smithi195 podman[88427]: 2024-08-18 22:47:36.82579786 +0000 UTC m=+0.017378358 image pull ea7a5189f30bad3aca9524788e2965d2368d7ce786df09d4edcd8c3edf9cefba quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9 2024-08-18T22:47:37.055 INFO:journalctl@ceph.osd.5.smithi195.stdout:Aug 18 22:47:36 smithi195 podman[88427]: 2024-08-18 22:47:36.942268771 +0000 UTC m=+0.133849268 container create 5af2d6de9afecf8db3ca644c53ec70f5a0dd06cc0dcb54ae9dcdd3a69bb855ee (image=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-5, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, RELEASE=squid-de09dd0, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.36.0, GIT_BRANCH=HEAD) 2024-08-18T22:47:37.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:47:36 smithi121 ceph-mon[81053]: from='client.34352 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-18T22:47:37.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:47:36 smithi121 ceph-mon[81053]: from='client.? 172.21.15.121:0/2628791657' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-08-18T22:47:37.409 INFO:journalctl@ceph.osd.5.smithi195.stdout:Aug 18 22:47:37 smithi195 podman[88427]: 2024-08-18 22:47:37.169705314 +0000 UTC m=+0.361285818 container init 5af2d6de9afecf8db3ca644c53ec70f5a0dd06cc0dcb54ae9dcdd3a69bb855ee (image=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-5, io.buildah.version=1.36.0, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-de09dd0, ceph=True, GIT_BRANCH=HEAD) 2024-08-18T22:47:37.409 INFO:journalctl@ceph.osd.5.smithi195.stdout:Aug 18 22:47:37 smithi195 podman[88427]: 2024-08-18 22:47:37.173078795 +0000 UTC m=+0.364659295 container start 5af2d6de9afecf8db3ca644c53ec70f5a0dd06cc0dcb54ae9dcdd3a69bb855ee (image=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-5, GIT_CLEAN=True, io.buildah.version=1.36.0, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, RELEASE=squid-de09dd0, ceph=True, org.label-schema.vendor=CentOS) 2024-08-18T22:47:37.409 INFO:journalctl@ceph.osd.5.smithi195.stdout:Aug 18 22:47:37 smithi195 ceph-osd[88446]: -- 172.21.15.195:0/3941692650 <== mon.1 v2:172.21.15.195:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x558c38ac21e0 con 0x558c37cc7c00 2024-08-18T22:47:37.409 INFO:journalctl@ceph.osd.5.smithi195.stdout:Aug 18 22:47:37 smithi195 bash[88427]: 5af2d6de9afecf8db3ca644c53ec70f5a0dd06cc0dcb54ae9dcdd3a69bb855ee 2024-08-18T22:47:37.409 INFO:journalctl@ceph.osd.5.smithi195.stdout:Aug 18 22:47:37 smithi195 systemd[1]: Started Ceph osd.5 for b003123a-5db1-11ef-bccf-c7b262605968. 2024-08-18T22:47:38.074 INFO:journalctl@ceph.osd.5.smithi195.stdout:Aug 18 22:47:37 smithi195 ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-5[88441]: 2024-08-18T22:47:37.717+0000 7f4118f69640 -1 Falling back to public interface 2024-08-18T22:47:38.075 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:47:37 smithi195 ceph-mon[68841]: from='client.34364 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-18T22:47:38.075 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:47:37 smithi195 ceph-mon[68841]: pgmap v149: 65 pgs: 2 stale+active+clean, 25 active+undersized+degraded, 38 active+clean; 2.0 GiB data, 6.3 GiB used, 530 GiB / 536 GiB avail; 3933/34143 objects degraded (11.519%) 2024-08-18T22:47:38.075 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:47:37 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:47:38.075 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:47:37 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:47:38.075 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:47:37 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-18T22:47:38.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:47:37 smithi121 ceph-mon[81053]: from='client.34364 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-18T22:47:38.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:47:37 smithi121 ceph-mon[81053]: pgmap v149: 65 pgs: 2 stale+active+clean, 25 active+undersized+degraded, 38 active+clean; 2.0 GiB data, 6.3 GiB used, 530 GiB / 536 GiB avail; 3933/34143 objects degraded (11.519%) 2024-08-18T22:47:38.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:47:37 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:47:38.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:47:37 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:47:38.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:47:37 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-18T22:47:39.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:47:39 smithi195 ceph-mon[68841]: pgmap v150: 65 pgs: 28 active+undersized+degraded, 37 active+clean; 2.0 GiB data, 6.3 GiB used, 530 GiB / 536 GiB avail; 5042/34143 objects degraded (14.767%) 2024-08-18T22:47:39.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:47:39 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:47:39.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:47:39 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-18T22:47:40.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:47:39 smithi121 ceph-mon[81053]: pgmap v150: 65 pgs: 28 active+undersized+degraded, 37 active+clean; 2.0 GiB data, 6.3 GiB used, 530 GiB / 536 GiB avail; 5042/34143 objects degraded (14.767%) 2024-08-18T22:47:40.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:47:39 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:47:40.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:47:39 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-18T22:47:41.333 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:47:41 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:47:41.334 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:47:41 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:47:41.334 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:47:41 smithi121 ceph-mon[81053]: 3 slow requests, 0 included below; oldest blocked for > 371.870889 secs 2024-08-18T22:47:41.334 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:47:41 smithi121 ceph-mon[81053]: pgmap v151: 65 pgs: 28 active+undersized+degraded, 37 active+clean; 2.0 GiB data, 6.3 GiB used, 530 GiB / 536 GiB avail; 5042/34143 objects degraded (14.767%) 2024-08-18T22:47:41.334 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:47:41 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:47:41.334 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:47:41 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:47:41.351 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:47:41 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:47:41.351 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:47:41 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:47:41.351 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:47:41 smithi195 ceph-mon[68841]: 3 slow requests, 0 included below; oldest blocked for > 371.870889 secs 2024-08-18T22:47:41.351 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:47:41 smithi195 ceph-mon[68841]: pgmap v151: 65 pgs: 28 active+undersized+degraded, 37 active+clean; 2.0 GiB data, 6.3 GiB used, 530 GiB / 536 GiB avail; 5042/34143 objects degraded (14.767%) 2024-08-18T22:47:41.352 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:47:41 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:47:41.352 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:47:41 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:47:42.314 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:47:42 smithi195 ceph-mon[68841]: from='osd.5 [v2:172.21.15.195:6816/3793599283,v1:172.21.15.195:6817/3793599283]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-08-18T22:47:42.314 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:47:42 smithi195 ceph-mon[68841]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-08-18T22:47:42.315 INFO:journalctl@ceph.osd.5.smithi195.stdout:Aug 18 22:47:42 smithi195 ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-5[88441]: 2024-08-18T22:47:42.047+0000 7f4118f69640 -1 osd.5 75 log_to_monitors true 2024-08-18T22:47:42.315 INFO:journalctl@ceph.osd.5.smithi195.stdout:Aug 18 22:47:42 smithi195 ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-5[88441]: 2024-08-18T22:47:42.119+0000 7f4110d03640 -1 osd.5 75 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-18T22:47:42.583 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:47:42 smithi121 ceph-mon[81053]: from='osd.5 [v2:172.21.15.195:6816/3793599283,v1:172.21.15.195:6817/3793599283]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-08-18T22:47:42.583 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:47:42 smithi121 ceph-mon[81053]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-08-18T22:47:43.409 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:47:43 smithi195 ceph-mon[68841]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-08-18T22:47:43.409 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:47:43 smithi195 ceph-mon[68841]: from='osd.5 [v2:172.21.15.195:6816/3793599283,v1:172.21.15.195:6817/3793599283]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]: dispatch 2024-08-18T22:47:43.410 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:47:43 smithi195 ceph-mon[68841]: osdmap e78: 6 total, 5 up, 6 in 2024-08-18T22:47:43.410 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:47:43 smithi195 ceph-mon[68841]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]: dispatch 2024-08-18T22:47:43.410 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:47:43 smithi195 ceph-mon[68841]: Health check update: Degraded data redundancy: 5042/34143 objects degraded (14.767%), 28 pgs degraded (PG_DEGRADED) 2024-08-18T22:47:43.410 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:47:43 smithi195 ceph-mon[68841]: pgmap v153: 65 pgs: 28 active+undersized+degraded, 37 active+clean; 2.0 GiB data, 6.0 GiB used, 530 GiB / 536 GiB avail; 5042/34143 objects degraded (14.767%) 2024-08-18T22:47:43.584 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:47:43 smithi121 ceph-mon[81053]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-08-18T22:47:43.584 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:47:43 smithi121 ceph-mon[81053]: from='osd.5 [v2:172.21.15.195:6816/3793599283,v1:172.21.15.195:6817/3793599283]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]: dispatch 2024-08-18T22:47:43.584 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:47:43 smithi121 ceph-mon[81053]: osdmap e78: 6 total, 5 up, 6 in 2024-08-18T22:47:43.584 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:47:43 smithi121 ceph-mon[81053]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]: dispatch 2024-08-18T22:47:43.584 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:47:43 smithi121 ceph-mon[81053]: Health check update: Degraded data redundancy: 5042/34143 objects degraded (14.767%), 28 pgs degraded (PG_DEGRADED) 2024-08-18T22:47:43.584 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:47:43 smithi121 ceph-mon[81053]: pgmap v153: 65 pgs: 28 active+undersized+degraded, 37 active+clean; 2.0 GiB data, 6.0 GiB used, 530 GiB / 536 GiB avail; 5042/34143 objects degraded (14.767%) 2024-08-18T22:47:44.409 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:47:44 smithi195 ceph-mon[68841]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-08-18T22:47:44.409 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:47:44 smithi195 ceph-mon[68841]: osd.5 [v2:172.21.15.195:6816/3793599283,v1:172.21.15.195:6817/3793599283] boot 2024-08-18T22:47:44.409 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:47:44 smithi195 ceph-mon[68841]: osdmap e79: 6 total, 6 up, 6 in 2024-08-18T22:47:44.410 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:47:44 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-08-18T22:47:44.410 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:47:44 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:47:44.410 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:47:44 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:47:44.410 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:47:44 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:47:44.410 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:47:44 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-18T22:47:44.410 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:47:44 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:47:44.410 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:47:44 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-18T22:47:44.410 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:47:44 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "versions"}]: dispatch 2024-08-18T22:47:44.410 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:47:44 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "versions"}]: dispatch 2024-08-18T22:47:44.410 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:47:44 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "versions"}]: dispatch 2024-08-18T22:47:44.410 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:47:44 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "versions"}]: dispatch 2024-08-18T22:47:44.410 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:47:44 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:47:44.410 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:47:44 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]: dispatch 2024-08-18T22:47:44.411 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:47:44 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]': finished 2024-08-18T22:47:44.411 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:47:44 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]: dispatch 2024-08-18T22:47:44.411 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:47:44 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]': finished 2024-08-18T22:47:44.411 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:47:44 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]: dispatch 2024-08-18T22:47:44.411 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:47:44 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]': finished 2024-08-18T22:47:44.411 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:47:44 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]: dispatch 2024-08-18T22:47:44.411 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:47:44 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]': finished 2024-08-18T22:47:44.411 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:47:44 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]: dispatch 2024-08-18T22:47:44.411 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:47:44 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]': finished 2024-08-18T22:47:44.411 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:47:44 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]: dispatch 2024-08-18T22:47:44.411 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:47:44 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]': finished 2024-08-18T22:47:44.411 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:47:44 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd require-osd-release", "release": "squid"}]: dispatch 2024-08-18T22:47:44.411 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:47:44 smithi195 ceph-mon[68841]: Health check cleared: OSD_UPGRADE_FINISHED (was: all OSDs are running squid or later but require_osd_release < squid) 2024-08-18T22:47:44.411 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:47:44 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd='[{"prefix": "osd require-osd-release", "release": "squid"}]': finished 2024-08-18T22:47:44.412 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:47:44 smithi195 ceph-mon[68841]: osdmap e80: 6 total, 6 up, 6 in 2024-08-18T22:47:44.584 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:47:44 smithi121 ceph-mon[81053]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-08-18T22:47:44.584 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:47:44 smithi121 ceph-mon[81053]: osd.5 [v2:172.21.15.195:6816/3793599283,v1:172.21.15.195:6817/3793599283] boot 2024-08-18T22:47:44.584 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:47:44 smithi121 ceph-mon[81053]: osdmap e79: 6 total, 6 up, 6 in 2024-08-18T22:47:44.584 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:47:44 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-08-18T22:47:44.584 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:47:44 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:47:44.584 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:47:44 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:47:44.584 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:47:44 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:47:44.584 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:47:44 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-18T22:47:44.584 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:47:44 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:47:44.584 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:47:44 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-18T22:47:44.585 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:47:44 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "versions"}]: dispatch 2024-08-18T22:47:44.585 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:47:44 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "versions"}]: dispatch 2024-08-18T22:47:44.585 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:47:44 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "versions"}]: dispatch 2024-08-18T22:47:44.585 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:47:44 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "versions"}]: dispatch 2024-08-18T22:47:44.585 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:47:44 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:47:44.585 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:47:44 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]: dispatch 2024-08-18T22:47:44.585 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:47:44 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]': finished 2024-08-18T22:47:44.585 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:47:44 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]: dispatch 2024-08-18T22:47:44.585 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:47:44 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]': finished 2024-08-18T22:47:44.585 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:47:44 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]: dispatch 2024-08-18T22:47:44.585 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:47:44 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]': finished 2024-08-18T22:47:44.585 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:47:44 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]: dispatch 2024-08-18T22:47:44.585 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:47:44 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]': finished 2024-08-18T22:47:44.586 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:47:44 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]: dispatch 2024-08-18T22:47:44.586 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:47:44 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]': finished 2024-08-18T22:47:44.586 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:47:44 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]: dispatch 2024-08-18T22:47:44.586 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:47:44 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]': finished 2024-08-18T22:47:44.586 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:47:44 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd require-osd-release", "release": "squid"}]: dispatch 2024-08-18T22:47:44.586 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:47:44 smithi121 ceph-mon[81053]: Health check cleared: OSD_UPGRADE_FINISHED (was: all OSDs are running squid or later but require_osd_release < squid) 2024-08-18T22:47:44.586 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:47:44 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd='[{"prefix": "osd require-osd-release", "release": "squid"}]': finished 2024-08-18T22:47:44.586 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:47:44 smithi121 ceph-mon[81053]: osdmap e80: 6 total, 6 up, 6 in 2024-08-18T22:47:45.410 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:47:45 smithi195 ceph-mon[68841]: Upgrade: Setting container_image for all osd 2024-08-18T22:47:45.411 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:47:45 smithi195 ceph-mon[68841]: Upgrade: Setting require_osd_release to 19 squid 2024-08-18T22:47:45.411 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:47:45 smithi195 ceph-mon[68841]: Upgrade: Scaling down filesystem cephfs 2024-08-18T22:47:45.411 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:47:45 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:47:45.411 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:47:45 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]: dispatch 2024-08-18T22:47:45.411 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:47:45 smithi195 ceph-mon[68841]: pgmap v156: 65 pgs: 7 peering, 21 active+undersized+degraded, 37 active+clean; 2.0 GiB data, 6.0 GiB used, 530 GiB / 536 GiB avail; 4328/34143 objects degraded (12.676%) 2024-08-18T22:47:45.583 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:47:45 smithi121 ceph-mon[81053]: Upgrade: Setting container_image for all osd 2024-08-18T22:47:45.583 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:47:45 smithi121 ceph-mon[81053]: Upgrade: Setting require_osd_release to 19 squid 2024-08-18T22:47:45.584 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:47:45 smithi121 ceph-mon[81053]: Upgrade: Scaling down filesystem cephfs 2024-08-18T22:47:45.584 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:47:45 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:47:45.584 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:47:45 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]: dispatch 2024-08-18T22:47:45.584 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:47:45 smithi121 ceph-mon[81053]: pgmap v156: 65 pgs: 7 peering, 21 active+undersized+degraded, 37 active+clean; 2.0 GiB data, 6.0 GiB used, 530 GiB / 536 GiB avail; 4328/34143 objects degraded (12.676%) 2024-08-18T22:47:46.409 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:47:46 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]': finished 2024-08-18T22:47:46.409 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:47:46 smithi195 ceph-mon[68841]: stopping daemon mds.cephfs.smithi195.buqvbr 2024-08-18T22:47:46.409 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:47:46 smithi195 ceph-mon[68841]: fsmap cephfs:2 {0=cephfs.smithi121.gbickb=up:active,1=cephfs.smithi195.buqvbr=up:active} 2 up:standby 2024-08-18T22:47:46.409 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:47:46 smithi195 ceph-mon[68841]: fsmap cephfs:2 {0=cephfs.smithi121.gbickb=up:active,1=cephfs.smithi195.buqvbr=up:stopping} 2 up:standby 2024-08-18T22:47:46.410 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:47:46 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-18T22:47:46.410 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:47:46 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:47:46.410 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:47:46 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-18T22:47:46.410 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:47:46 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:47:46.410 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:47:46 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-18T22:47:46.410 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:47:46 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "versions"}]: dispatch 2024-08-18T22:47:46.410 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:47:46 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "versions"}]: dispatch 2024-08-18T22:47:46.410 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:47:46 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "versions"}]: dispatch 2024-08-18T22:47:46.410 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:47:46 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "versions"}]: dispatch 2024-08-18T22:47:46.410 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:47:46 smithi195 ceph-mon[68841]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2024-08-18T22:47:46.410 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:47:46 smithi195 ceph-mon[68841]: 3 slow requests, 0 included below; oldest blocked for > 376.870953 secs 2024-08-18T22:47:46.584 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:47:46 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]': finished 2024-08-18T22:47:46.584 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:47:46 smithi121 ceph-mon[81053]: stopping daemon mds.cephfs.smithi195.buqvbr 2024-08-18T22:47:46.584 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:47:46 smithi121 ceph-mon[81053]: fsmap cephfs:2 {0=cephfs.smithi121.gbickb=up:active,1=cephfs.smithi195.buqvbr=up:active} 2 up:standby 2024-08-18T22:47:46.584 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:47:46 smithi121 ceph-mon[81053]: fsmap cephfs:2 {0=cephfs.smithi121.gbickb=up:active,1=cephfs.smithi195.buqvbr=up:stopping} 2 up:standby 2024-08-18T22:47:46.584 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:47:46 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-18T22:47:46.584 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:47:46 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:47:46.584 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:47:46 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-18T22:47:46.584 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:47:46 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:47:46.584 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:47:46 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-18T22:47:46.584 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:47:46 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "versions"}]: dispatch 2024-08-18T22:47:46.584 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:47:46 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "versions"}]: dispatch 2024-08-18T22:47:46.585 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:47:46 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "versions"}]: dispatch 2024-08-18T22:47:46.585 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:47:46 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "versions"}]: dispatch 2024-08-18T22:47:46.585 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:47:46 smithi121 ceph-mon[81053]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2024-08-18T22:47:46.585 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:47:46 smithi121 ceph-mon[81053]: 3 slow requests, 0 included below; oldest blocked for > 376.870953 secs 2024-08-18T22:47:47.409 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:47:47 smithi195 ceph-mon[68841]: pgmap v157: 65 pgs: 7 peering, 14 active+undersized+degraded, 44 active+clean; 2.0 GiB data, 6.0 GiB used, 530 GiB / 536 GiB avail; 3247/34143 objects degraded (9.510%) 2024-08-18T22:47:47.583 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:47:47 smithi121 ceph-mon[81053]: pgmap v157: 65 pgs: 7 peering, 14 active+undersized+degraded, 44 active+clean; 2.0 GiB data, 6.0 GiB used, 530 GiB / 536 GiB avail; 3247/34143 objects degraded (9.510%) 2024-08-18T22:47:48.409 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:47:48 smithi195 ceph-mon[68841]: Health check update: Degraded data redundancy: 3247/34143 objects degraded (9.510%), 14 pgs degraded (PG_DEGRADED) 2024-08-18T22:47:48.583 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:47:48 smithi121 ceph-mon[81053]: Health check update: Degraded data redundancy: 3247/34143 objects degraded (9.510%), 14 pgs degraded (PG_DEGRADED) 2024-08-18T22:47:49.409 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:47:49 smithi195 ceph-mon[68841]: pgmap v158: 65 pgs: 7 peering, 58 active+clean; 2.0 GiB data, 6.0 GiB used, 530 GiB / 536 GiB avail; 158 B/s wr, 0 op/s 2024-08-18T22:47:49.583 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:47:49 smithi121 ceph-mon[81053]: pgmap v158: 65 pgs: 7 peering, 58 active+clean; 2.0 GiB data, 6.0 GiB used, 530 GiB / 536 GiB avail; 158 B/s wr, 0 op/s 2024-08-18T22:47:50.409 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:47:50 smithi195 ceph-mon[68841]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 3247/34143 objects degraded (9.510%), 14 pgs degraded) 2024-08-18T22:47:50.583 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:47:50 smithi121 ceph-mon[81053]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 3247/34143 objects degraded (9.510%), 14 pgs degraded) 2024-08-18T22:47:51.415 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:47:51 smithi121 ceph-mon[81053]: 3 slow requests, 0 included below; oldest blocked for > 381.871076 secs 2024-08-18T22:47:51.415 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:47:51 smithi121 ceph-mon[81053]: pgmap v159: 65 pgs: 65 active+clean; 2.0 GiB data, 6.0 GiB used, 530 GiB / 536 GiB avail; 895 B/s wr, 0 op/s 2024-08-18T22:47:51.477 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:47:51 smithi195 ceph-mon[68841]: 3 slow requests, 0 included below; oldest blocked for > 381.871076 secs 2024-08-18T22:47:51.477 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:47:51 smithi195 ceph-mon[68841]: pgmap v159: 65 pgs: 65 active+clean; 2.0 GiB data, 6.0 GiB used, 530 GiB / 536 GiB avail; 895 B/s wr, 0 op/s 2024-08-18T22:47:53.583 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:47:53 smithi121 ceph-mon[81053]: fsmap cephfs:2 {0=cephfs.smithi121.gbickb=up:active,1=cephfs.smithi195.buqvbr=up:stopping} 2 up:standby 2024-08-18T22:47:53.583 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:47:53 smithi121 ceph-mon[81053]: pgmap v160: 65 pgs: 65 active+clean; 2.0 GiB data, 6.0 GiB used, 530 GiB / 536 GiB avail; 1.9 KiB/s wr, 0 op/s 2024-08-18T22:47:53.659 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:47:53 smithi195 ceph-mon[68841]: fsmap cephfs:2 {0=cephfs.smithi121.gbickb=up:active,1=cephfs.smithi195.buqvbr=up:stopping} 2 up:standby 2024-08-18T22:47:53.659 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:47:53 smithi195 ceph-mon[68841]: pgmap v160: 65 pgs: 65 active+clean; 2.0 GiB data, 6.0 GiB used, 530 GiB / 536 GiB avail; 1.9 KiB/s wr, 0 op/s 2024-08-18T22:47:54.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:47:54 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:47:54.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:47:54 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-18T22:47:55.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:47:54 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:47:55.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:47:54 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-18T22:47:55.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:47:55 smithi195 ceph-mon[68841]: pgmap v161: 65 pgs: 65 active+clean; 2.0 GiB data, 6.0 GiB used, 530 GiB / 536 GiB avail; 2.0 KiB/s wr, 1 op/s 2024-08-18T22:47:55.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:47:55 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-18T22:47:55.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:47:55 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:47:55.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:47:55 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-18T22:47:55.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:47:55 smithi195 ceph-mon[68841]: 3 slow requests, 0 included below; oldest blocked for > 386.871144 secs 2024-08-18T22:47:55.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:47:55 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:47:55.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:47:55 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-18T22:47:55.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:47:55 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "versions"}]: dispatch 2024-08-18T22:47:55.910 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:47:55 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "versions"}]: dispatch 2024-08-18T22:47:55.910 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:47:55 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "versions"}]: dispatch 2024-08-18T22:47:55.910 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:47:55 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "versions"}]: dispatch 2024-08-18T22:47:56.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:47:55 smithi121 ceph-mon[81053]: pgmap v161: 65 pgs: 65 active+clean; 2.0 GiB data, 6.0 GiB used, 530 GiB / 536 GiB avail; 2.0 KiB/s wr, 1 op/s 2024-08-18T22:47:56.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:47:55 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-18T22:47:56.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:47:55 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:47:56.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:47:55 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-18T22:47:56.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:47:55 smithi121 ceph-mon[81053]: 3 slow requests, 0 included below; oldest blocked for > 386.871144 secs 2024-08-18T22:47:56.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:47:55 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:47:56.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:47:55 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-18T22:47:56.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:47:55 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "versions"}]: dispatch 2024-08-18T22:47:56.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:47:55 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "versions"}]: dispatch 2024-08-18T22:47:56.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:47:55 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "versions"}]: dispatch 2024-08-18T22:47:56.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:47:55 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "versions"}]: dispatch 2024-08-18T22:47:56.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:47:56 smithi195 ceph-mon[68841]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2024-08-18T22:47:57.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:47:56 smithi121 ceph-mon[81053]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2024-08-18T22:47:57.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:47:57 smithi195 ceph-mon[68841]: pgmap v162: 65 pgs: 65 active+clean; 2.0 GiB data, 6.0 GiB used, 530 GiB / 536 GiB avail; 85 B/s rd, 2.4 KiB/s wr, 1 op/s 2024-08-18T22:47:58.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:47:57 smithi121 ceph-mon[81053]: pgmap v162: 65 pgs: 65 active+clean; 2.0 GiB data, 6.0 GiB used, 530 GiB / 536 GiB avail; 85 B/s rd, 2.4 KiB/s wr, 1 op/s 2024-08-18T22:48:00.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:47:59 smithi121 ceph-mon[81053]: pgmap v163: 65 pgs: 65 active+clean; 2.0 GiB data, 6.0 GiB used, 530 GiB / 536 GiB avail; 85 B/s rd, 2.4 KiB/s wr, 1 op/s 2024-08-18T22:48:00.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:47:59 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:48:00.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:47:59 smithi195 ceph-mon[68841]: pgmap v163: 65 pgs: 65 active+clean; 2.0 GiB data, 6.0 GiB used, 530 GiB / 536 GiB avail; 85 B/s rd, 2.4 KiB/s wr, 1 op/s 2024-08-18T22:48:00.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:47:59 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:48:00.993 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:48:00 smithi195 ceph-mon[68841]: 3 slow requests, 0 included below; oldest blocked for > 391.871242 secs 2024-08-18T22:48:01.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:48:00 smithi121 ceph-mon[81053]: 3 slow requests, 0 included below; oldest blocked for > 391.871242 secs 2024-08-18T22:48:01.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:48:01 smithi195 ceph-mon[68841]: pgmap v164: 65 pgs: 65 active+clean; 2.0 GiB data, 6.0 GiB used, 530 GiB / 536 GiB avail; 85 B/s rd, 2.6 KiB/s wr, 1 op/s 2024-08-18T22:48:02.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:48:01 smithi121 ceph-mon[81053]: pgmap v164: 65 pgs: 65 active+clean; 2.0 GiB data, 6.0 GiB used, 530 GiB / 536 GiB avail; 85 B/s rd, 2.6 KiB/s wr, 1 op/s 2024-08-18T22:48:04.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:48:03 smithi121 ceph-mon[81053]: pgmap v165: 65 pgs: 65 active+clean; 2.0 GiB data, 6.0 GiB used, 530 GiB / 536 GiB avail; 85 B/s rd, 3.0 KiB/s wr, 3 op/s 2024-08-18T22:48:04.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:48:03 smithi195 ceph-mon[68841]: pgmap v165: 65 pgs: 65 active+clean; 2.0 GiB data, 6.0 GiB used, 530 GiB / 536 GiB avail; 85 B/s rd, 3.0 KiB/s wr, 3 op/s 2024-08-18T22:48:06.086 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:48:05 smithi121 ceph-mon[81053]: pgmap v166: 65 pgs: 65 active+clean; 2.0 GiB data, 6.0 GiB used, 530 GiB / 536 GiB avail; 85 B/s rd, 2.1 KiB/s wr, 5 op/s 2024-08-18T22:48:06.087 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:48:05 smithi121 ceph-mon[81053]: 3 slow requests, 0 included below; oldest blocked for > 396.871318 secs 2024-08-18T22:48:06.087 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:48:05 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-18T22:48:06.087 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:48:05 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:48:06.087 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:48:05 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-18T22:48:06.087 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:48:05 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:48:06.087 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:48:05 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-18T22:48:06.087 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:48:05 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "versions"}]: dispatch 2024-08-18T22:48:06.087 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:48:05 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "versions"}]: dispatch 2024-08-18T22:48:06.087 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:48:05 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "versions"}]: dispatch 2024-08-18T22:48:06.088 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:48:05 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "versions"}]: dispatch 2024-08-18T22:48:06.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:48:05 smithi195 ceph-mon[68841]: pgmap v166: 65 pgs: 65 active+clean; 2.0 GiB data, 6.0 GiB used, 530 GiB / 536 GiB avail; 85 B/s rd, 2.1 KiB/s wr, 5 op/s 2024-08-18T22:48:06.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:48:05 smithi195 ceph-mon[68841]: 3 slow requests, 0 included below; oldest blocked for > 396.871318 secs 2024-08-18T22:48:06.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:48:05 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-18T22:48:06.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:48:05 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:48:06.160 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:48:05 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-18T22:48:06.160 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:48:05 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:48:06.160 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:48:05 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-18T22:48:06.160 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:48:05 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "versions"}]: dispatch 2024-08-18T22:48:06.160 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:48:05 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "versions"}]: dispatch 2024-08-18T22:48:06.160 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:48:05 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "versions"}]: dispatch 2024-08-18T22:48:06.160 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:48:05 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "versions"}]: dispatch 2024-08-18T22:48:06.219 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:06.215+0000 7f8275efa640 1 -- 172.21.15.121:0/3017853679 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f82700fe290 msgr2=0x7f82700fa3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:48:06.219 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:06.215+0000 7f8275efa640 1 --2- 172.21.15.121:0/3017853679 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f82700fe290 0x7f82700fa3f0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f82640048d0 tx=0x7f8264009da0 comp rx=0 tx=0).stop 2024-08-18T22:48:06.219 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:06.215+0000 7f8275efa640 1 -- 172.21.15.121:0/3017853679 shutdown_connections 2024-08-18T22:48:06.219 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:06.215+0000 7f8275efa640 1 --2- 172.21.15.121:0/3017853679 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f82700fe290 0x7f82700fa3f0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:48:06.219 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:06.215+0000 7f8275efa640 1 --2- 172.21.15.121:0/3017853679 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f82700fd940 0x7f82700fdd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:48:06.219 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:06.215+0000 7f8275efa640 1 -- 172.21.15.121:0/3017853679 >> 172.21.15.121:0/3017853679 conn(0x7f82700f6140 msgr2=0x7f82700f8570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:48:06.219 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:06.215+0000 7f8275efa640 1 -- 172.21.15.121:0/3017853679 shutdown_connections 2024-08-18T22:48:06.219 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:06.215+0000 7f8275efa640 1 -- 172.21.15.121:0/3017853679 wait complete. 2024-08-18T22:48:06.219 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:06.216+0000 7f8275efa640 1 Processor -- start 2024-08-18T22:48:06.220 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:06.216+0000 7f8275efa640 1 -- start start 2024-08-18T22:48:06.220 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:06.216+0000 7f8275efa640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f82700fd940 0x7f827010ce80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:48:06.220 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:06.216+0000 7f8275efa640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f82700fe290 0x7f827010d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:48:06.220 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:06.216+0000 7f8275efa640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f827010da10 con 0x7f82700fd940 2024-08-18T22:48:06.220 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:06.216+0000 7f8275efa640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f827010e150 con 0x7f82700fe290 2024-08-18T22:48:06.220 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:06.216+0000 7f826f7fe640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f82700fd940 0x7f827010ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:48:06.220 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:06.216+0000 7f826f7fe640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f82700fd940 0x7f827010ce80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:48674/0 (socket says 172.21.15.121:48674) 2024-08-18T22:48:06.220 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:06.217+0000 7f826f7fe640 1 -- 172.21.15.121:0/314827198 learned_addr learned my addr 172.21.15.121:0/314827198 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-18T22:48:06.220 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:06.217+0000 7f826effd640 1 --2- 172.21.15.121:0/314827198 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f82700fe290 0x7f827010d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:48:06.220 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:06.217+0000 7f826f7fe640 1 -- 172.21.15.121:0/314827198 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f82700fe290 msgr2=0x7f827010d3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:48:06.220 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:06.217+0000 7f826f7fe640 1 --2- 172.21.15.121:0/314827198 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f82700fe290 0x7f827010d3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:48:06.221 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:06.217+0000 7f826f7fe640 1 -- 172.21.15.121:0/314827198 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8264005040 con 0x7f82700fd940 2024-08-18T22:48:06.221 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:06.217+0000 7f826f7fe640 1 --2- 172.21.15.121:0/314827198 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f82700fd940 0x7f827010ce80 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f8260002a50 tx=0x7f8260004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:48:06.221 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:06.217+0000 7f8257fff640 1 -- 172.21.15.121:0/314827198 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8260007c30 con 0x7f82700fd940 2024-08-18T22:48:06.221 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:06.217+0000 7f8257fff640 1 -- 172.21.15.121:0/314827198 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f826000f040 con 0x7f82700fd940 2024-08-18T22:48:06.221 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:06.217+0000 7f8275efa640 1 -- 172.21.15.121:0/314827198 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f827010e3e0 con 0x7f82700fd940 2024-08-18T22:48:06.221 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:06.217+0000 7f8257fff640 1 -- 172.21.15.121:0/314827198 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f826000da90 con 0x7f82700fd940 2024-08-18T22:48:06.221 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:06.217+0000 7f8275efa640 1 -- 172.21.15.121:0/314827198 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f827010e980 con 0x7f82700fd940 2024-08-18T22:48:06.222 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:06.218+0000 7f8275efa640 1 -- 172.21.15.121:0/314827198 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82700f9de0 con 0x7f82700fd940 2024-08-18T22:48:06.222 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:06.219+0000 7f8257fff640 1 -- 172.21.15.121:0/314827198 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 37) v1 ==== 92205+0+0 (secure 0 0 0) 0x7f826000dc30 con 0x7f82700fd940 2024-08-18T22:48:06.223 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:06.219+0000 7f8257fff640 1 --2- 172.21.15.121:0/314827198 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f825806e0b0 0x7f8258070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:48:06.223 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:06.219+0000 7f8257fff640 1 -- 172.21.15.121:0/314827198 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f826008d3e0 con 0x7f82700fd940 2024-08-18T22:48:06.223 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:06.219+0000 7f826effd640 1 --2- 172.21.15.121:0/314827198 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f825806e0b0 0x7f8258070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:48:06.223 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:06.220+0000 7f826effd640 1 --2- 172.21.15.121:0/314827198 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f825806e0b0 0x7f8258070560 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f8264007ac0 tx=0x7f8264035040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:48:06.225 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:06.224+0000 7f8257fff640 1 -- 172.21.15.121:0/314827198 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f8260056790 con 0x7f82700fd940 2024-08-18T22:48:06.426 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:06.425+0000 7f8275efa640 1 -- 172.21.15.121:0/314827198 --> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f827010ed60 con 0x7f825806e0b0 2024-08-18T22:48:06.427 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:06.426+0000 7f8257fff640 1 -- 172.21.15.121:0/314827198 <== mgr.34102 v2:172.21.15.121:6800/3037387239 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f827010ed60 con 0x7f825806e0b0 2024-08-18T22:48:06.429 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:06.428+0000 7f8275efa640 1 -- 172.21.15.121:0/314827198 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f825806e0b0 msgr2=0x7f8258070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:48:06.429 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:06.428+0000 7f8275efa640 1 --2- 172.21.15.121:0/314827198 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f825806e0b0 0x7f8258070560 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f8264007ac0 tx=0x7f8264035040 comp rx=0 tx=0).stop 2024-08-18T22:48:06.429 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:06.428+0000 7f8275efa640 1 -- 172.21.15.121:0/314827198 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f82700fd940 msgr2=0x7f827010ce80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:48:06.430 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:06.428+0000 7f8275efa640 1 --2- 172.21.15.121:0/314827198 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f82700fd940 0x7f827010ce80 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f8260002a50 tx=0x7f8260004600 comp rx=0 tx=0).stop 2024-08-18T22:48:06.430 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:06.428+0000 7f8275efa640 1 -- 172.21.15.121:0/314827198 shutdown_connections 2024-08-18T22:48:06.430 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:06.428+0000 7f8275efa640 1 --2- 172.21.15.121:0/314827198 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f825806e0b0 0x7f8258070560 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:48:06.430 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:06.428+0000 7f8275efa640 1 --2- 172.21.15.121:0/314827198 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f82700fe290 0x7f827010d3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:48:06.430 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:06.428+0000 7f8275efa640 1 --2- 172.21.15.121:0/314827198 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f82700fd940 0x7f827010ce80 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:48:06.430 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:06.428+0000 7f8275efa640 1 -- 172.21.15.121:0/314827198 >> 172.21.15.121:0/314827198 conn(0x7f82700f6140 msgr2=0x7f82700f78a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:48:06.430 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:06.428+0000 7f8275efa640 1 -- 172.21.15.121:0/314827198 shutdown_connections 2024-08-18T22:48:06.430 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:06.428+0000 7f8275efa640 1 -- 172.21.15.121:0/314827198 wait complete. 2024-08-18T22:48:06.438 INFO:teuthology.orchestra.run.smithi121.stdout:true 2024-08-18T22:48:06.512 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:06.509+0000 7f534f0a7640 1 -- 172.21.15.121:0/718743856 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f53480ff4a0 msgr2=0x7f5348101880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:48:06.512 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:06.509+0000 7f534f0a7640 1 --2- 172.21.15.121:0/718743856 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f53480ff4a0 0x7f5348101880 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f53340048d0 tx=0x7f5334009da0 comp rx=0 tx=0).stop 2024-08-18T22:48:06.512 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:06.509+0000 7f534f0a7640 1 -- 172.21.15.121:0/718743856 shutdown_connections 2024-08-18T22:48:06.512 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:06.509+0000 7f534f0a7640 1 --2- 172.21.15.121:0/718743856 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f53480ff4a0 0x7f5348101880 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:48:06.512 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:06.509+0000 7f534f0a7640 1 --2- 172.21.15.121:0/718743856 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5348065960 0x7f53480fef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:48:06.513 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:06.509+0000 7f534f0a7640 1 -- 172.21.15.121:0/718743856 >> 172.21.15.121:0/718743856 conn(0x7f53480f69b0 msgr2=0x7f53480f8dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:48:06.513 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:06.509+0000 7f534f0a7640 1 -- 172.21.15.121:0/718743856 shutdown_connections 2024-08-18T22:48:06.513 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:06.509+0000 7f534f0a7640 1 -- 172.21.15.121:0/718743856 wait complete. 2024-08-18T22:48:06.513 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:06.510+0000 7f534f0a7640 1 Processor -- start 2024-08-18T22:48:06.513 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:06.510+0000 7f534f0a7640 1 -- start start 2024-08-18T22:48:06.513 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:06.510+0000 7f534f0a7640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5348065960 0x7f534810ce90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:48:06.513 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:06.510+0000 7f534f0a7640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f53480ff4a0 0x7f534810d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:48:06.513 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:06.510+0000 7f534f0a7640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f534810da20 con 0x7f53480ff4a0 2024-08-18T22:48:06.514 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:06.510+0000 7f534f0a7640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f534810e160 con 0x7f5348065960 2024-08-18T22:48:06.514 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:06.510+0000 7f5347fff640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f53480ff4a0 0x7f534810d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:48:06.514 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:06.510+0000 7f5347fff640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f53480ff4a0 0x7f534810d3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:48698/0 (socket says 172.21.15.121:48698) 2024-08-18T22:48:06.514 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:06.510+0000 7f5347fff640 1 -- 172.21.15.121:0/2957879396 learned_addr learned my addr 172.21.15.121:0/2957879396 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-18T22:48:06.514 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:06.510+0000 7f534ce43640 1 --2- 172.21.15.121:0/2957879396 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5348065960 0x7f534810ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:48:06.514 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:06.511+0000 7f5347fff640 1 -- 172.21.15.121:0/2957879396 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5348065960 msgr2=0x7f534810ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:48:06.514 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:06.511+0000 7f5347fff640 1 --2- 172.21.15.121:0/2957879396 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5348065960 0x7f534810ce90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:48:06.514 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:06.511+0000 7f5347fff640 1 -- 172.21.15.121:0/2957879396 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5334005040 con 0x7f53480ff4a0 2024-08-18T22:48:06.514 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:06.511+0000 7f5347fff640 1 --2- 172.21.15.121:0/2957879396 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f53480ff4a0 0x7f534810d3d0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f53340048a0 tx=0x7f5334009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:48:06.514 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:06.511+0000 7f53457fa640 1 -- 172.21.15.121:0/2957879396 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5334038070 con 0x7f53480ff4a0 2024-08-18T22:48:06.515 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:06.511+0000 7f53457fa640 1 -- 172.21.15.121:0/2957879396 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f533402abd0 con 0x7f53480ff4a0 2024-08-18T22:48:06.515 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:06.511+0000 7f534f0a7640 1 -- 172.21.15.121:0/2957879396 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f534810e390 con 0x7f53480ff4a0 2024-08-18T22:48:06.515 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:06.511+0000 7f534f0a7640 1 -- 172.21.15.121:0/2957879396 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f534810e930 con 0x7f53480ff4a0 2024-08-18T22:48:06.515 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:06.511+0000 7f53457fa640 1 -- 172.21.15.121:0/2957879396 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5334033640 con 0x7f53480ff4a0 2024-08-18T22:48:06.516 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:06.512+0000 7f534f0a7640 1 -- 172.21.15.121:0/2957879396 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53480fa630 con 0x7f53480ff4a0 2024-08-18T22:48:06.516 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:06.513+0000 7f53457fa640 1 -- 172.21.15.121:0/2957879396 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 37) v1 ==== 92205+0+0 (secure 0 0 0) 0x7f5334030020 con 0x7f53480ff4a0 2024-08-18T22:48:06.516 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:06.514+0000 7f53457fa640 1 --2- 172.21.15.121:0/2957879396 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f533806e0b0 0x7f5338070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:48:06.516 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:06.514+0000 7f53457fa640 1 -- 172.21.15.121:0/2957879396 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f53340ade90 con 0x7f53480ff4a0 2024-08-18T22:48:06.516 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:06.514+0000 7f534ce43640 1 --2- 172.21.15.121:0/2957879396 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f533806e0b0 0x7f5338070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:48:06.517 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:06.515+0000 7f534ce43640 1 --2- 172.21.15.121:0/2957879396 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f533806e0b0 0x7f5338070560 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f534810cc20 tx=0x7f533c009040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:48:06.519 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:06.518+0000 7f53457fa640 1 -- 172.21.15.121:0/2957879396 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f5334077270 con 0x7f53480ff4a0 2024-08-18T22:48:06.714 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:06.713+0000 7f534f0a7640 1 -- 172.21.15.121:0/2957879396 --> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f534810ec60 con 0x7f533806e0b0 2024-08-18T22:48:06.715 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:06.714+0000 7f53457fa640 1 -- 172.21.15.121:0/2957879396 <== mgr.34102 v2:172.21.15.121:6800/3037387239 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f534810ec60 con 0x7f533806e0b0 2024-08-18T22:48:06.717 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:06.716+0000 7f534f0a7640 1 -- 172.21.15.121:0/2957879396 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f533806e0b0 msgr2=0x7f5338070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:48:06.717 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:06.716+0000 7f534f0a7640 1 --2- 172.21.15.121:0/2957879396 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f533806e0b0 0x7f5338070560 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f534810cc20 tx=0x7f533c009040 comp rx=0 tx=0).stop 2024-08-18T22:48:06.717 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:06.716+0000 7f534f0a7640 1 -- 172.21.15.121:0/2957879396 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f53480ff4a0 msgr2=0x7f534810d3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:48:06.717 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:06.716+0000 7f534f0a7640 1 --2- 172.21.15.121:0/2957879396 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f53480ff4a0 0x7f534810d3d0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f53340048a0 tx=0x7f5334009da0 comp rx=0 tx=0).stop 2024-08-18T22:48:06.717 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:06.716+0000 7f534f0a7640 1 -- 172.21.15.121:0/2957879396 shutdown_connections 2024-08-18T22:48:06.717 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:06.716+0000 7f534f0a7640 1 --2- 172.21.15.121:0/2957879396 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f533806e0b0 0x7f5338070560 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:48:06.717 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:06.716+0000 7f534f0a7640 1 --2- 172.21.15.121:0/2957879396 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f53480ff4a0 0x7f534810d3d0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:48:06.717 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:06.716+0000 7f534f0a7640 1 --2- 172.21.15.121:0/2957879396 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5348065960 0x7f534810ce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:48:06.717 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:06.716+0000 7f534f0a7640 1 -- 172.21.15.121:0/2957879396 >> 172.21.15.121:0/2957879396 conn(0x7f53480f69b0 msgr2=0x7f53480f6d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:48:06.718 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:06.716+0000 7f534f0a7640 1 -- 172.21.15.121:0/2957879396 shutdown_connections 2024-08-18T22:48:06.718 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:06.716+0000 7f534f0a7640 1 -- 172.21.15.121:0/2957879396 wait complete. 2024-08-18T22:48:06.795 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:06.794+0000 7ffb14d53640 1 -- 172.21.15.121:0/4289148897 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ffb100fb1d0 msgr2=0x7ffb100fb5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:48:06.796 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:06.794+0000 7ffb14d53640 1 --2- 172.21.15.121:0/4289148897 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ffb100fb1d0 0x7ffb100fb5e0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7ffb00009c50 tx=0x7ffb00004d10 comp rx=0 tx=0).stop 2024-08-18T22:48:06.796 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:48:06 smithi121 ceph-mon[81053]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2024-08-18T22:48:06.798 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:06.794+0000 7ffb14d53640 1 -- 172.21.15.121:0/4289148897 shutdown_connections 2024-08-18T22:48:06.798 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:06.794+0000 7ffb14d53640 1 --2- 172.21.15.121:0/4289148897 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ffb100fc4a0 0x7ffb100fc910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:48:06.798 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:06.794+0000 7ffb14d53640 1 --2- 172.21.15.121:0/4289148897 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ffb100fb1d0 0x7ffb100fb5e0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:48:06.798 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:06.794+0000 7ffb14d53640 1 -- 172.21.15.121:0/4289148897 >> 172.21.15.121:0/4289148897 conn(0x7ffb100f69b0 msgr2=0x7ffb100f8dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:48:06.798 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:06.794+0000 7ffb14d53640 1 -- 172.21.15.121:0/4289148897 shutdown_connections 2024-08-18T22:48:06.799 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:06.795+0000 7ffb14d53640 1 -- 172.21.15.121:0/4289148897 wait complete. 2024-08-18T22:48:06.799 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:06.795+0000 7ffb14d53640 1 Processor -- start 2024-08-18T22:48:06.799 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:06.795+0000 7ffb14d53640 1 -- start start 2024-08-18T22:48:06.799 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:06.795+0000 7ffb14d53640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ffb100fb1d0 0x7ffb1010fb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:48:06.799 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:06.795+0000 7ffb14d53640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ffb100fc4a0 0x7ffb101120b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:48:06.799 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:06.795+0000 7ffb14d53640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb10065a00 con 0x7ffb100fb1d0 2024-08-18T22:48:06.799 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:06.795+0000 7ffb14d53640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb10065b70 con 0x7ffb100fc4a0 2024-08-18T22:48:06.799 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:06.795+0000 7ffb0e59c640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ffb100fb1d0 0x7ffb1010fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:48:06.799 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:06.795+0000 7ffb0e59c640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ffb100fb1d0 0x7ffb1010fb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:45766/0 (socket says 172.21.15.121:45766) 2024-08-18T22:48:06.799 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:06.795+0000 7ffb0e59c640 1 -- 172.21.15.121:0/510532242 learned_addr learned my addr 172.21.15.121:0/510532242 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-18T22:48:06.799 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:06.796+0000 7ffb0dd9b640 1 --2- 172.21.15.121:0/510532242 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ffb100fc4a0 0x7ffb101120b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:48:06.800 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:06.796+0000 7ffb0e59c640 1 -- 172.21.15.121:0/510532242 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ffb100fc4a0 msgr2=0x7ffb101120b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:48:06.800 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:06.796+0000 7ffb0e59c640 1 --2- 172.21.15.121:0/510532242 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ffb100fc4a0 0x7ffb101120b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:48:06.800 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:06.796+0000 7ffb0e59c640 1 -- 172.21.15.121:0/510532242 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb000098b0 con 0x7ffb100fb1d0 2024-08-18T22:48:06.800 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:06.796+0000 7ffb0dd9b640 1 --2- 172.21.15.121:0/510532242 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ffb100fc4a0 0x7ffb101120b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:48:06.800 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:06.796+0000 7ffb0e59c640 1 --2- 172.21.15.121:0/510532242 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ffb100fb1d0 0x7ffb1010fb60 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7ffb00004a30 tx=0x7ffb00004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:48:06.800 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:06.796+0000 7ffafeffd640 1 -- 172.21.15.121:0/510532242 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffb00009710 con 0x7ffb100fb1d0 2024-08-18T22:48:06.800 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:06.796+0000 7ffafeffd640 1 -- 172.21.15.121:0/510532242 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7ffb00032b10 con 0x7ffb100fb1d0 2024-08-18T22:48:06.800 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:06.796+0000 7ffb14d53640 1 -- 172.21.15.121:0/510532242 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb101125f0 con 0x7ffb100fb1d0 2024-08-18T22:48:06.800 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:06.796+0000 7ffafeffd640 1 -- 172.21.15.121:0/510532242 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffb0003db10 con 0x7ffb100fb1d0 2024-08-18T22:48:06.800 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:06.796+0000 7ffb14d53640 1 -- 172.21.15.121:0/510532242 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb10112b60 con 0x7ffb100fb1d0 2024-08-18T22:48:06.800 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:06.797+0000 7ffb14d53640 1 -- 172.21.15.121:0/510532242 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb100fa630 con 0x7ffb100fb1d0 2024-08-18T22:48:06.801 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:06.798+0000 7ffafeffd640 1 -- 172.21.15.121:0/510532242 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 37) v1 ==== 92205+0+0 (secure 0 0 0) 0x7ffb0002f030 con 0x7ffb100fb1d0 2024-08-18T22:48:06.801 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:06.798+0000 7ffafeffd640 1 --2- 172.21.15.121:0/510532242 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7ffaf806e0b0 0x7ffaf8070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:48:06.802 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:06.798+0000 7ffafeffd640 1 -- 172.21.15.121:0/510532242 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6496+0+0 (secure 0 0 0) 0x7ffb000af1e0 con 0x7ffb100fb1d0 2024-08-18T22:48:06.802 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:06.798+0000 7ffb0dd9b640 1 --2- 172.21.15.121:0/510532242 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7ffaf806e0b0 0x7ffaf8070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:48:06.802 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:06.799+0000 7ffb0dd9b640 1 --2- 172.21.15.121:0/510532242 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7ffaf806e0b0 0x7ffaf8070560 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7ffb04004d80 tx=0x7ffb0400b040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:48:06.803 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:06.803+0000 7ffafeffd640 1 -- 172.21.15.121:0/510532242 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7ffb00078590 con 0x7ffb100fb1d0 2024-08-18T22:48:06.977 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:06.976+0000 7ffb14d53640 1 -- 172.21.15.121:0/510532242 --> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7ffb10100900 con 0x7ffaf806e0b0 2024-08-18T22:48:06.986 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:06.985+0000 7ffafeffd640 1 -- 172.21.15.121:0/510532242 <== mgr.34102 v2:172.21.15.121:6800/3037387239 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7ffb10100900 con 0x7ffaf806e0b0 2024-08-18T22:48:06.986 INFO:teuthology.orchestra.run.smithi121.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-08-18T22:48:06.986 INFO:teuthology.orchestra.run.smithi121.stdout:alertmanager.smithi121 smithi121 *:9093,9094 running (5m) 2m ago 13m 24.9M - 0.25.0 c8568f914cd2 c421c5e6a02b 2024-08-18T22:48:06.986 INFO:teuthology.orchestra.run.smithi121.stdout:crash.smithi121 smithi121 running (3m) 2m ago 14m 6903k - 19.1.0-1382-gde09dd01 ea7a5189f30b 3cf5c666a0e6 2024-08-18T22:48:06.987 INFO:teuthology.orchestra.run.smithi121.stdout:crash.smithi195 smithi195 running (3m) 26s ago 13m 6895k - 19.1.0-1382-gde09dd01 ea7a5189f30b fbb586fb9834 2024-08-18T22:48:06.987 INFO:teuthology.orchestra.run.smithi121.stdout:grafana.smithi121 smithi121 *:3000 running (5m) 2m ago 13m 78.4M - 9.4.7 954c08fa6188 091a5fd17e8a 2024-08-18T22:48:06.987 INFO:teuthology.orchestra.run.smithi121.stdout:mds.cephfs.smithi121.gbickb smithi121 running (8m) 2m ago 8m 156M - 17.2.7-1406-gdf62bdcc 774894bef55f 484da0bc2c95 2024-08-18T22:48:06.987 INFO:teuthology.orchestra.run.smithi121.stdout:mds.cephfs.smithi121.xuzsdg smithi121 running (8m) 2m ago 8m 13.6M - 17.2.7-1406-gdf62bdcc 774894bef55f 6976b708cdcd 2024-08-18T22:48:06.987 INFO:teuthology.orchestra.run.smithi121.stdout:mds.cephfs.smithi195.buqvbr smithi195 running (8m) 26s ago 8m 116M - 17.2.7-1406-gdf62bdcc 774894bef55f 11a3703b4276 2024-08-18T22:48:06.987 INFO:teuthology.orchestra.run.smithi121.stdout:mds.cephfs.smithi195.nptgyc smithi195 running (8m) 26s ago 8m 18.4M - 17.2.7-1406-gdf62bdcc 774894bef55f b9f8043ea83e 2024-08-18T22:48:06.987 INFO:teuthology.orchestra.run.smithi121.stdout:mgr.smithi121.lopxqc smithi121 *:8443,9283,8765 running (5m) 2m ago 15m 498M - 19.1.0-1382-gde09dd01 ea7a5189f30b 9079701e6516 2024-08-18T22:48:06.987 INFO:teuthology.orchestra.run.smithi121.stdout:mgr.smithi195.acttsj smithi195 *:8443,9283,8765 running (4m) 26s ago 13m 441M - 19.1.0-1382-gde09dd01 ea7a5189f30b 7b4027a33daa 2024-08-18T22:48:06.987 INFO:teuthology.orchestra.run.smithi121.stdout:mon.smithi121 smithi121 running (4m) 2m ago 15m 49.3M 2048M 19.1.0-1382-gde09dd01 ea7a5189f30b d71695a4fb56 2024-08-18T22:48:06.987 INFO:teuthology.orchestra.run.smithi121.stdout:mon.smithi195 smithi195 running (4m) 26s ago 13m 40.7M 2048M 19.1.0-1382-gde09dd01 ea7a5189f30b a9bb94ba3b56 2024-08-18T22:48:06.987 INFO:teuthology.orchestra.run.smithi121.stdout:node-exporter.smithi121 smithi121 *:9100 running (5m) 2m ago 14m 15.2M - 1.5.0 0da6a335fe13 bc4b5355a507 2024-08-18T22:48:06.987 INFO:teuthology.orchestra.run.smithi121.stdout:node-exporter.smithi195 smithi195 *:9100 running (5m) 26s ago 13m 17.2M - 1.5.0 0da6a335fe13 146efcb79663 2024-08-18T22:48:06.987 INFO:teuthology.orchestra.run.smithi121.stdout:osd.0 smithi121 running (3m) 2m ago 12m 99.3M 1557M 19.1.0-1382-gde09dd01 ea7a5189f30b d378dd46eeb6 2024-08-18T22:48:06.988 INFO:teuthology.orchestra.run.smithi121.stdout:osd.1 smithi121 running (2m) 2m ago 11m 117M 1557M 19.1.0-1382-gde09dd01 ea7a5189f30b 0f9e03de5382 2024-08-18T22:48:06.988 INFO:teuthology.orchestra.run.smithi121.stdout:osd.2 smithi121 running (2m) 2m ago 11m 11.7M 1557M 19.1.0-1382-gde09dd01 ea7a5189f30b 93270b5bed68 2024-08-18T22:48:06.988 INFO:teuthology.orchestra.run.smithi121.stdout:osd.3 smithi195 running (94s) 26s ago 11m 120M 2581M 19.1.0-1382-gde09dd01 ea7a5189f30b 72c2860c0e9f 2024-08-18T22:48:06.988 INFO:teuthology.orchestra.run.smithi121.stdout:osd.4 smithi195 running (61s) 26s ago 10m 102M 2581M 19.1.0-1382-gde09dd01 ea7a5189f30b d88a83c97247 2024-08-18T22:48:06.988 INFO:teuthology.orchestra.run.smithi121.stdout:osd.5 smithi195 running (30s) 26s ago 10m 11.3M 2581M 19.1.0-1382-gde09dd01 ea7a5189f30b 5af2d6de9afe 2024-08-18T22:48:06.988 INFO:teuthology.orchestra.run.smithi121.stdout:prometheus.smithi121 smithi121 *:9095 running (4m) 2m ago 13m 54.0M - 2.43.0 a07b618ecd1d 00c4f776d23a 2024-08-18T22:48:06.989 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:06.987+0000 7ffb14d53640 1 -- 172.21.15.121:0/510532242 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7ffaf806e0b0 msgr2=0x7ffaf8070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:48:06.989 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:06.987+0000 7ffb14d53640 1 --2- 172.21.15.121:0/510532242 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7ffaf806e0b0 0x7ffaf8070560 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7ffb04004d80 tx=0x7ffb0400b040 comp rx=0 tx=0).stop 2024-08-18T22:48:06.989 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:06.987+0000 7ffb14d53640 1 -- 172.21.15.121:0/510532242 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ffb100fb1d0 msgr2=0x7ffb1010fb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:48:06.989 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:06.987+0000 7ffb14d53640 1 --2- 172.21.15.121:0/510532242 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ffb100fb1d0 0x7ffb1010fb60 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7ffb00004a30 tx=0x7ffb00004d10 comp rx=0 tx=0).stop 2024-08-18T22:48:06.989 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:06.987+0000 7ffb14d53640 1 -- 172.21.15.121:0/510532242 shutdown_connections 2024-08-18T22:48:06.989 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:06.987+0000 7ffb14d53640 1 --2- 172.21.15.121:0/510532242 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7ffaf806e0b0 0x7ffaf8070560 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:48:06.989 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:06.987+0000 7ffb14d53640 1 --2- 172.21.15.121:0/510532242 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ffb100fc4a0 0x7ffb101120b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:48:06.989 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:06.987+0000 7ffb14d53640 1 --2- 172.21.15.121:0/510532242 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ffb100fb1d0 0x7ffb1010fb60 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:48:06.989 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:06.987+0000 7ffb14d53640 1 -- 172.21.15.121:0/510532242 >> 172.21.15.121:0/510532242 conn(0x7ffb100f69b0 msgr2=0x7ffb100f8180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:48:06.989 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:06.987+0000 7ffb14d53640 1 -- 172.21.15.121:0/510532242 shutdown_connections 2024-08-18T22:48:06.989 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:06.987+0000 7ffb14d53640 1 -- 172.21.15.121:0/510532242 wait complete. 2024-08-18T22:48:07.065 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:07.064+0000 7ff63a217640 1 -- 172.21.15.121:0/880960103 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff6340fc310 msgr2=0x7ff6340fc720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:48:07.066 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:07.064+0000 7ff63a217640 1 --2- 172.21.15.121:0/880960103 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff6340fc310 0x7ff6340fc720 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7ff6240048d0 tx=0x7ff624009da0 comp rx=0 tx=0).stop 2024-08-18T22:48:07.066 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:07.064+0000 7ff63a217640 1 -- 172.21.15.121:0/880960103 shutdown_connections 2024-08-18T22:48:07.066 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:07.064+0000 7ff63a217640 1 --2- 172.21.15.121:0/880960103 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff6340fd5e0 0x7ff6340fda50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:48:07.066 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:07.064+0000 7ff63a217640 1 --2- 172.21.15.121:0/880960103 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff6340fc310 0x7ff6340fc720 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:48:07.066 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:07.064+0000 7ff63a217640 1 -- 172.21.15.121:0/880960103 >> 172.21.15.121:0/880960103 conn(0x7ff6340f7ad0 msgr2=0x7ff6340f9f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:48:07.067 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:07.064+0000 7ff63a217640 1 -- 172.21.15.121:0/880960103 shutdown_connections 2024-08-18T22:48:07.067 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:07.064+0000 7ff63a217640 1 -- 172.21.15.121:0/880960103 wait complete. 2024-08-18T22:48:07.067 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:07.065+0000 7ff63a217640 1 Processor -- start 2024-08-18T22:48:07.068 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:07.065+0000 7ff63a217640 1 -- start start 2024-08-18T22:48:07.068 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:07.065+0000 7ff63a217640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff6340fc310 0x7ff634071310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:48:07.069 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:07.065+0000 7ff63a217640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff6340fd5e0 0x7ff63406f800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:48:07.069 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:07.065+0000 7ff63a217640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff63406fe20 con 0x7ff6340fd5e0 2024-08-18T22:48:07.069 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:07.065+0000 7ff63a217640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff63406ff60 con 0x7ff6340fc310 2024-08-18T22:48:07.069 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:07.065+0000 7ff632ffd640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff6340fd5e0 0x7ff63406f800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:48:07.069 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:07.065+0000 7ff632ffd640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff6340fd5e0 0x7ff63406f800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:45778/0 (socket says 172.21.15.121:45778) 2024-08-18T22:48:07.069 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:07.065+0000 7ff632ffd640 1 -- 172.21.15.121:0/4106485754 learned_addr learned my addr 172.21.15.121:0/4106485754 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-18T22:48:07.069 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:07.066+0000 7ff6337fe640 1 --2- 172.21.15.121:0/4106485754 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff6340fc310 0x7ff634071310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:48:07.069 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:07.066+0000 7ff632ffd640 1 -- 172.21.15.121:0/4106485754 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff6340fc310 msgr2=0x7ff634071310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:48:07.069 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:07.066+0000 7ff632ffd640 1 --2- 172.21.15.121:0/4106485754 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff6340fc310 0x7ff634071310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:48:07.069 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:07.066+0000 7ff632ffd640 1 -- 172.21.15.121:0/4106485754 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff624005040 con 0x7ff6340fd5e0 2024-08-18T22:48:07.070 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:07.066+0000 7ff6337fe640 1 --2- 172.21.15.121:0/4106485754 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff6340fc310 0x7ff634071310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:48:07.070 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:07.066+0000 7ff632ffd640 1 --2- 172.21.15.121:0/4106485754 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff6340fd5e0 0x7ff63406f800 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7ff62800b790 tx=0x7ff6280091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:48:07.070 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:07.066+0000 7ff61bfff640 1 -- 172.21.15.121:0/4106485754 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff62800c700 con 0x7ff6340fd5e0 2024-08-18T22:48:07.070 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:07.066+0000 7ff61bfff640 1 -- 172.21.15.121:0/4106485754 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7ff62800cd00 con 0x7ff6340fd5e0 2024-08-18T22:48:07.070 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:07.066+0000 7ff63a217640 1 -- 172.21.15.121:0/4106485754 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff634070240 con 0x7ff6340fd5e0 2024-08-18T22:48:07.070 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:07.066+0000 7ff61bfff640 1 -- 172.21.15.121:0/4106485754 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff628015e70 con 0x7ff6340fd5e0 2024-08-18T22:48:07.070 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:07.066+0000 7ff63a217640 1 -- 172.21.15.121:0/4106485754 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff634114ec0 con 0x7ff6340fd5e0 2024-08-18T22:48:07.070 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:07.067+0000 7ff63a217640 1 -- 172.21.15.121:0/4106485754 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6340fb770 con 0x7ff6340fd5e0 2024-08-18T22:48:07.071 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:07.068+0000 7ff61bfff640 1 -- 172.21.15.121:0/4106485754 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 37) v1 ==== 92205+0+0 (secure 0 0 0) 0x7ff628012070 con 0x7ff6340fd5e0 2024-08-18T22:48:07.071 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:07.068+0000 7ff61bfff640 1 --2- 172.21.15.121:0/4106485754 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7ff61c06e0b0 0x7ff61c070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:48:07.071 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:07.068+0000 7ff61bfff640 1 -- 172.21.15.121:0/4106485754 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6496+0+0 (secure 0 0 0) 0x7ff62808d4a0 con 0x7ff6340fd5e0 2024-08-18T22:48:07.071 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:07.069+0000 7ff6337fe640 1 --2- 172.21.15.121:0/4106485754 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7ff61c06e0b0 0x7ff61c070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:48:07.071 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:07.069+0000 7ff6337fe640 1 --2- 172.21.15.121:0/4106485754 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7ff61c06e0b0 0x7ff61c070560 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7ff624007ac0 tx=0x7ff624035040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:48:07.073 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:07.073+0000 7ff61bfff640 1 -- 172.21.15.121:0/4106485754 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7ff628056850 con 0x7ff6340fd5e0 2024-08-18T22:48:07.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:48:06 smithi195 ceph-mon[68841]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2024-08-18T22:48:07.305 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:07.304+0000 7ff63a217640 1 -- 172.21.15.121:0/4106485754 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7ff634104d90 con 0x7ff6340fd5e0 2024-08-18T22:48:07.305 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:07.304+0000 7ff61bfff640 1 -- 172.21.15.121:0/4106485754 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+731 (secure 0 0 0) 0x7ff628059f10 con 0x7ff6340fd5e0 2024-08-18T22:48:07.306 INFO:teuthology.orchestra.run.smithi121.stdout:{ 2024-08-18T22:48:07.306 INFO:teuthology.orchestra.run.smithi121.stdout: "mon": { 2024-08-18T22:48:07.306 INFO:teuthology.orchestra.run.smithi121.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 2 2024-08-18T22:48:07.306 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-18T22:48:07.306 INFO:teuthology.orchestra.run.smithi121.stdout: "mgr": { 2024-08-18T22:48:07.306 INFO:teuthology.orchestra.run.smithi121.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 2 2024-08-18T22:48:07.306 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-18T22:48:07.306 INFO:teuthology.orchestra.run.smithi121.stdout: "osd": { 2024-08-18T22:48:07.306 INFO:teuthology.orchestra.run.smithi121.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 6 2024-08-18T22:48:07.306 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-18T22:48:07.307 INFO:teuthology.orchestra.run.smithi121.stdout: "mds": { 2024-08-18T22:48:07.307 INFO:teuthology.orchestra.run.smithi121.stdout: "ceph version 17.2.7-1406-gdf62bdcc (df62bdccd9a13bf566b27a250eddfdd89be3072d) quincy (stable)": 4 2024-08-18T22:48:07.307 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-18T22:48:07.307 INFO:teuthology.orchestra.run.smithi121.stdout: "overall": { 2024-08-18T22:48:07.307 INFO:teuthology.orchestra.run.smithi121.stdout: "ceph version 17.2.7-1406-gdf62bdcc (df62bdccd9a13bf566b27a250eddfdd89be3072d) quincy (stable)": 4, 2024-08-18T22:48:07.307 INFO:teuthology.orchestra.run.smithi121.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 10 2024-08-18T22:48:07.307 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-08-18T22:48:07.307 INFO:teuthology.orchestra.run.smithi121.stdout:} 2024-08-18T22:48:07.308 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:07.307+0000 7ff63a217640 1 -- 172.21.15.121:0/4106485754 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7ff61c06e0b0 msgr2=0x7ff61c070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:48:07.308 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:07.307+0000 7ff63a217640 1 --2- 172.21.15.121:0/4106485754 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7ff61c06e0b0 0x7ff61c070560 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7ff624007ac0 tx=0x7ff624035040 comp rx=0 tx=0).stop 2024-08-18T22:48:07.308 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:07.307+0000 7ff63a217640 1 -- 172.21.15.121:0/4106485754 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff6340fd5e0 msgr2=0x7ff63406f800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:48:07.308 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:07.307+0000 7ff63a217640 1 --2- 172.21.15.121:0/4106485754 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff6340fd5e0 0x7ff63406f800 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7ff62800b790 tx=0x7ff6280091d0 comp rx=0 tx=0).stop 2024-08-18T22:48:07.308 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:07.307+0000 7ff63a217640 1 -- 172.21.15.121:0/4106485754 shutdown_connections 2024-08-18T22:48:07.308 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:07.307+0000 7ff63a217640 1 --2- 172.21.15.121:0/4106485754 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7ff61c06e0b0 0x7ff61c070560 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:48:07.308 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:07.307+0000 7ff63a217640 1 --2- 172.21.15.121:0/4106485754 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff6340fd5e0 0x7ff63406f800 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:48:07.308 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:07.307+0000 7ff63a217640 1 --2- 172.21.15.121:0/4106485754 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff6340fc310 0x7ff634071310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:48:07.309 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:07.307+0000 7ff63a217640 1 -- 172.21.15.121:0/4106485754 >> 172.21.15.121:0/4106485754 conn(0x7ff6340f7ad0 msgr2=0x7ff6340f9200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:48:07.309 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:07.307+0000 7ff63a217640 1 -- 172.21.15.121:0/4106485754 shutdown_connections 2024-08-18T22:48:07.309 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:07.307+0000 7ff63a217640 1 -- 172.21.15.121:0/4106485754 wait complete. 2024-08-18T22:48:07.388 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:07.385+0000 7f014cfe1640 1 -- 172.21.15.121:0/2423931629 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f01480fb1f0 msgr2=0x7f01480fb600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:48:07.388 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:07.385+0000 7f014cfe1640 1 --2- 172.21.15.121:0/2423931629 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f01480fb1f0 0x7f01480fb600 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f01380048d0 tx=0x7f0138009da0 comp rx=0 tx=0).stop 2024-08-18T22:48:07.388 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:07.385+0000 7f014cfe1640 1 -- 172.21.15.121:0/2423931629 shutdown_connections 2024-08-18T22:48:07.388 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:07.385+0000 7f014cfe1640 1 --2- 172.21.15.121:0/2423931629 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f01480fc4c0 0x7f01480fc930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:48:07.388 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:07.385+0000 7f014cfe1640 1 --2- 172.21.15.121:0/2423931629 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f01480fb1f0 0x7f01480fb600 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:48:07.389 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:07.385+0000 7f014cfe1640 1 -- 172.21.15.121:0/2423931629 >> 172.21.15.121:0/2423931629 conn(0x7f01480f69b0 msgr2=0x7f01480f8de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:48:07.389 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:07.386+0000 7f014cfe1640 1 -- 172.21.15.121:0/2423931629 shutdown_connections 2024-08-18T22:48:07.389 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:07.386+0000 7f014cfe1640 1 -- 172.21.15.121:0/2423931629 wait complete. 2024-08-18T22:48:07.389 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:07.386+0000 7f014cfe1640 1 Processor -- start 2024-08-18T22:48:07.389 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:07.386+0000 7f014cfe1640 1 -- start start 2024-08-18T22:48:07.389 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:07.386+0000 7f014cfe1640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f01480fb1f0 0x7f014810ceb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:48:07.389 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:07.386+0000 7f014cfe1640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f01480fc4c0 0x7f014810d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:48:07.389 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:07.386+0000 7f014cfe1640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f014810e260 con 0x7f01480fb1f0 2024-08-18T22:48:07.389 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:07.386+0000 7f014cfe1640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f014810e3d0 con 0x7f01480fc4c0 2024-08-18T22:48:07.389 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:07.386+0000 7f014659c640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f01480fb1f0 0x7f014810ceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:48:07.389 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:07.386+0000 7f014659c640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f01480fb1f0 0x7f014810ceb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:45788/0 (socket says 172.21.15.121:45788) 2024-08-18T22:48:07.389 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:07.386+0000 7f014659c640 1 -- 172.21.15.121:0/2276348501 learned_addr learned my addr 172.21.15.121:0/2276348501 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-18T22:48:07.389 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:07.387+0000 7f0145d9b640 1 --2- 172.21.15.121:0/2276348501 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f01480fc4c0 0x7f014810d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:48:07.390 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:07.387+0000 7f014659c640 1 -- 172.21.15.121:0/2276348501 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f01480fc4c0 msgr2=0x7f014810d3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:48:07.390 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:07.387+0000 7f014659c640 1 --2- 172.21.15.121:0/2276348501 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f01480fc4c0 0x7f014810d3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:48:07.390 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:07.387+0000 7f014659c640 1 -- 172.21.15.121:0/2276348501 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0138005040 con 0x7f01480fb1f0 2024-08-18T22:48:07.390 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:07.387+0000 7f014659c640 1 --2- 172.21.15.121:0/2276348501 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f01480fb1f0 0x7f014810ceb0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f0138003080 tx=0x7f0138009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:48:07.390 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:07.387+0000 7f0136ffd640 1 -- 172.21.15.121:0/2276348501 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0138038070 con 0x7f01480fb1f0 2024-08-18T22:48:07.390 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:07.387+0000 7f0136ffd640 1 -- 172.21.15.121:0/2276348501 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f0138009800 con 0x7f01480fb1f0 2024-08-18T22:48:07.390 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:07.387+0000 7f0136ffd640 1 -- 172.21.15.121:0/2276348501 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0138033660 con 0x7f01480fb1f0 2024-08-18T22:48:07.390 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:07.387+0000 7f014cfe1640 1 -- 172.21.15.121:0/2276348501 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f014810e650 con 0x7f01480fb1f0 2024-08-18T22:48:07.390 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:07.387+0000 7f014cfe1640 1 -- 172.21.15.121:0/2276348501 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f014810eac0 con 0x7f01480fb1f0 2024-08-18T22:48:07.391 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:07.388+0000 7f014cfe1640 1 -- 172.21.15.121:0/2276348501 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0148104480 con 0x7f01480fb1f0 2024-08-18T22:48:07.391 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:07.388+0000 7f0136ffd640 1 -- 172.21.15.121:0/2276348501 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 37) v1 ==== 92205+0+0 (secure 0 0 0) 0x7f0138030020 con 0x7f01480fb1f0 2024-08-18T22:48:07.391 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:07.389+0000 7f0136ffd640 1 --2- 172.21.15.121:0/2276348501 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f013006e0b0 0x7f0130070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:48:07.391 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:07.389+0000 7f0136ffd640 1 -- 172.21.15.121:0/2276348501 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f01380add10 con 0x7f01480fb1f0 2024-08-18T22:48:07.392 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:07.389+0000 7f0145d9b640 1 --2- 172.21.15.121:0/2276348501 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f013006e0b0 0x7f0130070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:48:07.392 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:07.389+0000 7f0145d9b640 1 --2- 172.21.15.121:0/2276348501 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f013006e0b0 0x7f0130070560 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f013c006fd0 tx=0x7f013c008040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:48:07.394 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:07.393+0000 7f0136ffd640 1 -- 172.21.15.121:0/2276348501 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f0138077040 con 0x7f01480fb1f0 2024-08-18T22:48:07.598 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:07.597+0000 7f014cfe1640 1 -- 172.21.15.121:0/2276348501 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f01480fa650 con 0x7f01480fb1f0 2024-08-18T22:48:07.599 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:07.598+0000 7f0136ffd640 1 -- 172.21.15.121:0/2276348501 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 25 v25) v1 ==== 76+0+1955 (secure 0 0 0) 0x7f013807a700 con 0x7f01480fb1f0 2024-08-18T22:48:07.599 INFO:teuthology.orchestra.run.smithi121.stdout:e25 2024-08-18T22:48:07.599 INFO:teuthology.orchestra.run.smithi121.stdout:btime 2024-08-18T22:47:52:160518+0000 2024-08-18T22:48:07.599 INFO:teuthology.orchestra.run.smithi121.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-08-18T22:48:07.599 INFO:teuthology.orchestra.run.smithi121.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-08-18T22:48:07.599 INFO:teuthology.orchestra.run.smithi121.stdout:legacy client fscid: 1 2024-08-18T22:48:07.599 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-08-18T22:48:07.599 INFO:teuthology.orchestra.run.smithi121.stdout:Filesystem 'cephfs' (1) 2024-08-18T22:48:07.600 INFO:teuthology.orchestra.run.smithi121.stdout:fs_name cephfs 2024-08-18T22:48:07.600 INFO:teuthology.orchestra.run.smithi121.stdout:epoch 25 2024-08-18T22:48:07.600 INFO:teuthology.orchestra.run.smithi121.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-08-18T22:48:07.600 INFO:teuthology.orchestra.run.smithi121.stdout:created 2024-08-18T22:39:04.054074+0000 2024-08-18T22:48:07.600 INFO:teuthology.orchestra.run.smithi121.stdout:modified 2024-08-18T22:47:51.250426+0000 2024-08-18T22:48:07.600 INFO:teuthology.orchestra.run.smithi121.stdout:tableserver 0 2024-08-18T22:48:07.600 INFO:teuthology.orchestra.run.smithi121.stdout:root 0 2024-08-18T22:48:07.600 INFO:teuthology.orchestra.run.smithi121.stdout:session_timeout 60 2024-08-18T22:48:07.600 INFO:teuthology.orchestra.run.smithi121.stdout:session_autoclose 300 2024-08-18T22:48:07.600 INFO:teuthology.orchestra.run.smithi121.stdout:max_file_size 1099511627776 2024-08-18T22:48:07.600 INFO:teuthology.orchestra.run.smithi121.stdout:max_xattr_size 65536 2024-08-18T22:48:07.600 INFO:teuthology.orchestra.run.smithi121.stdout:required_client_features {} 2024-08-18T22:48:07.600 INFO:teuthology.orchestra.run.smithi121.stdout:last_failure 0 2024-08-18T22:48:07.601 INFO:teuthology.orchestra.run.smithi121.stdout:last_failure_osd_epoch 47 2024-08-18T22:48:07.601 INFO:teuthology.orchestra.run.smithi121.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-08-18T22:48:07.601 INFO:teuthology.orchestra.run.smithi121.stdout:max_mds 1 2024-08-18T22:48:07.601 INFO:teuthology.orchestra.run.smithi121.stdout:in 0,1 2024-08-18T22:48:07.601 INFO:teuthology.orchestra.run.smithi121.stdout:up {0=14474,1=24249} 2024-08-18T22:48:07.601 INFO:teuthology.orchestra.run.smithi121.stdout:failed 2024-08-18T22:48:07.601 INFO:teuthology.orchestra.run.smithi121.stdout:damaged 2024-08-18T22:48:07.601 INFO:teuthology.orchestra.run.smithi121.stdout:stopped 2024-08-18T22:48:07.601 INFO:teuthology.orchestra.run.smithi121.stdout:data_pools [3] 2024-08-18T22:48:07.601 INFO:teuthology.orchestra.run.smithi121.stdout:metadata_pool 2 2024-08-18T22:48:07.601 INFO:teuthology.orchestra.run.smithi121.stdout:inline_data disabled 2024-08-18T22:48:07.601 INFO:teuthology.orchestra.run.smithi121.stdout:balancer 2024-08-18T22:48:07.601 INFO:teuthology.orchestra.run.smithi121.stdout:bal_rank_mask -1 2024-08-18T22:48:07.601 INFO:teuthology.orchestra.run.smithi121.stdout:standby_count_wanted 1 2024-08-18T22:48:07.602 INFO:teuthology.orchestra.run.smithi121.stdout:qdb_cluster leader: 14474 members: 14474 2024-08-18T22:48:07.602 INFO:teuthology.orchestra.run.smithi121.stdout:[mds.cephfs.smithi121.gbickb{0:14474} state up:active seq 83 join_fscid=1 addr [v2:172.21.15.121:6828/2277706406,v1:172.21.15.121:6829/2277706406] compat {c=[1],r=[1],i=[7ff]}] 2024-08-18T22:48:07.602 INFO:teuthology.orchestra.run.smithi121.stdout:[mds.cephfs.smithi195.buqvbr{1:24249} state up:stopping seq 4 export targets 0 join_fscid=1 addr [v2:172.21.15.195:6824/2414511859,v1:172.21.15.195:6825/2414511859] compat {c=[1],r=[1],i=[7ff]}] 2024-08-18T22:48:07.602 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-08-18T22:48:07.602 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-08-18T22:48:07.602 INFO:teuthology.orchestra.run.smithi121.stdout:Standby daemons: 2024-08-18T22:48:07.602 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-08-18T22:48:07.602 INFO:teuthology.orchestra.run.smithi121.stdout:[mds.cephfs.smithi121.xuzsdg{-1:14490} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.121:6826/91588128,v1:172.21.15.121:6827/91588128] compat {c=[1],r=[1],i=[7ff]}] 2024-08-18T22:48:07.602 INFO:teuthology.orchestra.run.smithi121.stdout:[mds.cephfs.smithi195.nptgyc{-1:24259} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.195:6826/238549847,v1:172.21.15.195:6827/238549847] compat {c=[1],r=[1],i=[7ff]}] 2024-08-18T22:48:07.603 INFO:teuthology.orchestra.run.smithi121.stderr:dumped fsmap epoch 25 2024-08-18T22:48:07.603 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:07.599+0000 7f014cfe1640 1 -- 172.21.15.121:0/2276348501 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f013006e0b0 msgr2=0x7f0130070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:48:07.603 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:07.599+0000 7f014cfe1640 1 --2- 172.21.15.121:0/2276348501 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f013006e0b0 0x7f0130070560 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f013c006fd0 tx=0x7f013c008040 comp rx=0 tx=0).stop 2024-08-18T22:48:07.603 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:07.599+0000 7f014cfe1640 1 -- 172.21.15.121:0/2276348501 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f01480fb1f0 msgr2=0x7f014810ceb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:48:07.603 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:07.600+0000 7f014cfe1640 1 --2- 172.21.15.121:0/2276348501 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f01480fb1f0 0x7f014810ceb0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f0138003080 tx=0x7f0138009da0 comp rx=0 tx=0).stop 2024-08-18T22:48:07.603 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:07.600+0000 7f014cfe1640 1 -- 172.21.15.121:0/2276348501 shutdown_connections 2024-08-18T22:48:07.603 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:07.600+0000 7f014cfe1640 1 --2- 172.21.15.121:0/2276348501 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f013006e0b0 0x7f0130070560 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:48:07.603 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:07.600+0000 7f014cfe1640 1 --2- 172.21.15.121:0/2276348501 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f01480fc4c0 0x7f014810d3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:48:07.603 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:07.600+0000 7f014cfe1640 1 --2- 172.21.15.121:0/2276348501 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f01480fb1f0 0x7f014810ceb0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:48:07.604 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:07.600+0000 7f014cfe1640 1 -- 172.21.15.121:0/2276348501 >> 172.21.15.121:0/2276348501 conn(0x7f01480f69b0 msgr2=0x7f0148065810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:48:07.604 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:07.600+0000 7f014cfe1640 1 -- 172.21.15.121:0/2276348501 shutdown_connections 2024-08-18T22:48:07.604 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:07.600+0000 7f014cfe1640 1 -- 172.21.15.121:0/2276348501 wait complete. 2024-08-18T22:48:07.682 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:07.679+0000 7f991ba83640 1 -- 172.21.15.121:0/672513739 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f99140fc2f0 msgr2=0x7f99140fc700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:48:07.682 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:07.679+0000 7f991ba83640 1 --2- 172.21.15.121:0/672513739 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f99140fc2f0 0x7f99140fc700 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f99080048d0 tx=0x7f9908009da0 comp rx=0 tx=0).stop 2024-08-18T22:48:07.683 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:07.679+0000 7f991ba83640 1 -- 172.21.15.121:0/672513739 shutdown_connections 2024-08-18T22:48:07.683 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:07.679+0000 7f991ba83640 1 --2- 172.21.15.121:0/672513739 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f99140fd5c0 0x7f99140fda30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:48:07.683 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:07.679+0000 7f991ba83640 1 --2- 172.21.15.121:0/672513739 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f99140fc2f0 0x7f99140fc700 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:48:07.683 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:07.679+0000 7f991ba83640 1 -- 172.21.15.121:0/672513739 >> 172.21.15.121:0/672513739 conn(0x7f99140f7ad0 msgr2=0x7f99140f9ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:48:07.683 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:07.679+0000 7f991ba83640 1 -- 172.21.15.121:0/672513739 shutdown_connections 2024-08-18T22:48:07.683 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:07.679+0000 7f991ba83640 1 -- 172.21.15.121:0/672513739 wait complete. 2024-08-18T22:48:07.683 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:07.679+0000 7f991ba83640 1 Processor -- start 2024-08-18T22:48:07.683 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:07.680+0000 7f991ba83640 1 -- start start 2024-08-18T22:48:07.683 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:07.680+0000 7f991ba83640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f99140fc2f0 0x7f991410ced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:48:07.683 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:07.680+0000 7f991ba83640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f99140fd5c0 0x7f991410d410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:48:07.683 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:07.680+0000 7f991ba83640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f991410e280 con 0x7f99140fc2f0 2024-08-18T22:48:07.684 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:07.680+0000 7f991ba83640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f991410e3f0 con 0x7f99140fd5c0 2024-08-18T22:48:07.684 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:07.680+0000 7f991981f640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f99140fc2f0 0x7f991410ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:48:07.684 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:07.680+0000 7f991981f640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f99140fc2f0 0x7f991410ced0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:45818/0 (socket says 172.21.15.121:45818) 2024-08-18T22:48:07.684 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:07.680+0000 7f991981f640 1 -- 172.21.15.121:0/4040765936 learned_addr learned my addr 172.21.15.121:0/4040765936 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-18T22:48:07.684 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:07.680+0000 7f991901e640 1 --2- 172.21.15.121:0/4040765936 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f99140fd5c0 0x7f991410d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:48:07.684 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:07.680+0000 7f991981f640 1 -- 172.21.15.121:0/4040765936 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f99140fd5c0 msgr2=0x7f991410d410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:48:07.684 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:07.680+0000 7f991981f640 1 --2- 172.21.15.121:0/4040765936 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f99140fd5c0 0x7f991410d410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:48:07.684 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:07.680+0000 7f991981f640 1 -- 172.21.15.121:0/4040765936 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9908005040 con 0x7f99140fc2f0 2024-08-18T22:48:07.684 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:07.680+0000 7f991981f640 1 --2- 172.21.15.121:0/4040765936 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f99140fc2f0 0x7f991410ced0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f9908003080 tx=0x7f9908009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:48:07.684 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:07.681+0000 7f99067fc640 1 -- 172.21.15.121:0/4040765936 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9908038070 con 0x7f99140fc2f0 2024-08-18T22:48:07.684 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:07.681+0000 7f99067fc640 1 -- 172.21.15.121:0/4040765936 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f9908009800 con 0x7f99140fc2f0 2024-08-18T22:48:07.684 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:07.681+0000 7f991ba83640 1 -- 172.21.15.121:0/4040765936 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f991410e670 con 0x7f99140fc2f0 2024-08-18T22:48:07.684 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:07.681+0000 7f991ba83640 1 -- 172.21.15.121:0/4040765936 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f991410eb30 con 0x7f99140fc2f0 2024-08-18T22:48:07.685 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:07.681+0000 7f99067fc640 1 -- 172.21.15.121:0/4040765936 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9908033660 con 0x7f99140fc2f0 2024-08-18T22:48:07.685 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:07.682+0000 7f991ba83640 1 -- 172.21.15.121:0/4040765936 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9914105580 con 0x7f99140fc2f0 2024-08-18T22:48:07.686 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:07.685+0000 7f99067fc640 1 -- 172.21.15.121:0/4040765936 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 37) v1 ==== 92205+0+0 (secure 0 0 0) 0x7f9908030020 con 0x7f99140fc2f0 2024-08-18T22:48:07.686 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:07.685+0000 7f99067fc640 1 --2- 172.21.15.121:0/4040765936 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f990006e0b0 0x7f9900070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:48:07.687 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:07.686+0000 7f99067fc640 1 -- 172.21.15.121:0/4040765936 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f99080adcc0 con 0x7f99140fc2f0 2024-08-18T22:48:07.687 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:07.686+0000 7f991901e640 1 --2- 172.21.15.121:0/4040765936 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f990006e0b0 0x7f9900070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:48:07.687 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:07.686+0000 7f991901e640 1 --2- 172.21.15.121:0/4040765936 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f990006e0b0 0x7f9900070560 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f991410cc80 tx=0x7f9910008040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:48:07.690 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:07.689+0000 7f99067fc640 1 -- 172.21.15.121:0/4040765936 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f99080770b0 con 0x7f99140fc2f0 2024-08-18T22:48:07.873 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:07.872+0000 7f991ba83640 1 -- 172.21.15.121:0/4040765936 --> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f991410eda0 con 0x7f990006e0b0 2024-08-18T22:48:07.874 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:07.873+0000 7f99067fc640 1 -- 172.21.15.121:0/4040765936 <== mgr.34102 v2:172.21.15.121:6800/3037387239 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f991410eda0 con 0x7f990006e0b0 2024-08-18T22:48:07.874 INFO:teuthology.orchestra.run.smithi121.stdout:{ 2024-08-18T22:48:07.874 INFO:teuthology.orchestra.run.smithi121.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9", 2024-08-18T22:48:07.875 INFO:teuthology.orchestra.run.smithi121.stdout: "in_progress": true, 2024-08-18T22:48:07.875 INFO:teuthology.orchestra.run.smithi121.stdout: "which": "Upgrading all daemon types on all hosts", 2024-08-18T22:48:07.875 INFO:teuthology.orchestra.run.smithi121.stdout: "services_complete": [ 2024-08-18T22:48:07.875 INFO:teuthology.orchestra.run.smithi121.stdout: "mgr", 2024-08-18T22:48:07.875 INFO:teuthology.orchestra.run.smithi121.stdout: "mon", 2024-08-18T22:48:07.875 INFO:teuthology.orchestra.run.smithi121.stdout: "crash", 2024-08-18T22:48:07.875 INFO:teuthology.orchestra.run.smithi121.stdout: "osd" 2024-08-18T22:48:07.875 INFO:teuthology.orchestra.run.smithi121.stdout: ], 2024-08-18T22:48:07.875 INFO:teuthology.orchestra.run.smithi121.stdout: "progress": "12/21 daemons upgraded", 2024-08-18T22:48:07.875 INFO:teuthology.orchestra.run.smithi121.stdout: "message": "Currently upgrading osd daemons", 2024-08-18T22:48:07.876 INFO:teuthology.orchestra.run.smithi121.stdout: "is_paused": false 2024-08-18T22:48:07.876 INFO:teuthology.orchestra.run.smithi121.stdout:} 2024-08-18T22:48:07.877 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:07.875+0000 7f991ba83640 1 -- 172.21.15.121:0/4040765936 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f990006e0b0 msgr2=0x7f9900070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:48:07.877 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:07.875+0000 7f991ba83640 1 --2- 172.21.15.121:0/4040765936 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f990006e0b0 0x7f9900070560 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f991410cc80 tx=0x7f9910008040 comp rx=0 tx=0).stop 2024-08-18T22:48:07.877 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:07.875+0000 7f991ba83640 1 -- 172.21.15.121:0/4040765936 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f99140fc2f0 msgr2=0x7f991410ced0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:48:07.877 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:07.875+0000 7f991ba83640 1 --2- 172.21.15.121:0/4040765936 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f99140fc2f0 0x7f991410ced0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f9908003080 tx=0x7f9908009da0 comp rx=0 tx=0).stop 2024-08-18T22:48:07.877 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:07.875+0000 7f991ba83640 1 -- 172.21.15.121:0/4040765936 shutdown_connections 2024-08-18T22:48:07.877 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:07.875+0000 7f991ba83640 1 --2- 172.21.15.121:0/4040765936 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f990006e0b0 0x7f9900070560 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:48:07.877 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:07.875+0000 7f991ba83640 1 --2- 172.21.15.121:0/4040765936 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f99140fd5c0 0x7f991410d410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:48:07.877 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:07.875+0000 7f991ba83640 1 --2- 172.21.15.121:0/4040765936 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f99140fc2f0 0x7f991410ced0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:48:07.878 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:07.875+0000 7f991ba83640 1 -- 172.21.15.121:0/4040765936 >> 172.21.15.121:0/4040765936 conn(0x7f99140f7ad0 msgr2=0x7f99140f92d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:48:07.878 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:07.875+0000 7f991ba83640 1 -- 172.21.15.121:0/4040765936 shutdown_connections 2024-08-18T22:48:07.878 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:07.876+0000 7f991ba83640 1 -- 172.21.15.121:0/4040765936 wait complete. 2024-08-18T22:48:07.954 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:07.953+0000 7f9454876640 1 -- 172.21.15.121:0/2890449065 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f94500fd5e0 msgr2=0x7f94500fda50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:48:07.954 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:07.953+0000 7f9454876640 1 --2- 172.21.15.121:0/2890449065 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f94500fd5e0 0x7f94500fda50 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f94380048d0 tx=0x7f9438009da0 comp rx=0 tx=0).stop 2024-08-18T22:48:07.954 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:07.953+0000 7f9454876640 1 -- 172.21.15.121:0/2890449065 shutdown_connections 2024-08-18T22:48:07.954 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:07.953+0000 7f9454876640 1 --2- 172.21.15.121:0/2890449065 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f94500fd5e0 0x7f94500fda50 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:48:07.954 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:07.953+0000 7f9454876640 1 --2- 172.21.15.121:0/2890449065 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f94500fc310 0x7f94500fc720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:48:07.955 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:07.953+0000 7f9454876640 1 -- 172.21.15.121:0/2890449065 >> 172.21.15.121:0/2890449065 conn(0x7f94500f7ad0 msgr2=0x7f94500f9f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:48:07.955 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:07.953+0000 7f9454876640 1 -- 172.21.15.121:0/2890449065 shutdown_connections 2024-08-18T22:48:07.955 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:07.953+0000 7f9454876640 1 -- 172.21.15.121:0/2890449065 wait complete. 2024-08-18T22:48:07.955 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:48:07 smithi121 ceph-mon[81053]: from='client.34374 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-18T22:48:07.955 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:48:07 smithi121 ceph-mon[81053]: pgmap v167: 65 pgs: 65 active+clean; 2.0 GiB data, 6.0 GiB used, 530 GiB / 536 GiB avail; 85 B/s rd, 2.0 KiB/s wr, 6 op/s 2024-08-18T22:48:07.955 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:48:07 smithi121 ceph-mon[81053]: from='client.34378 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-18T22:48:07.955 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:48:07 smithi121 ceph-mon[81053]: from='client.? 172.21.15.121:0/4106485754' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-08-18T22:48:07.955 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:48:07 smithi121 ceph-mon[81053]: from='client.? 172.21.15.121:0/2276348501' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-08-18T22:48:07.958 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:07.953+0000 7f9454876640 1 Processor -- start 2024-08-18T22:48:07.958 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:07.953+0000 7f9454876640 1 -- start start 2024-08-18T22:48:07.958 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:07.954+0000 7f9454876640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f94500fc310 0x7f9450071310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:48:07.958 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:07.954+0000 7f9454876640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f94500fd5e0 0x7f945006f800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:48:07.958 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:07.954+0000 7f9454876640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f945006fd90 con 0x7f94500fc310 2024-08-18T22:48:07.958 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:07.954+0000 7f9454876640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f945006fed0 con 0x7f94500fd5e0 2024-08-18T22:48:07.958 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:07.954+0000 7f944e59c640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f94500fc310 0x7f9450071310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:48:07.958 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:07.954+0000 7f944e59c640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f94500fc310 0x7f9450071310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:45848/0 (socket says 172.21.15.121:45848) 2024-08-18T22:48:07.958 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:07.954+0000 7f944e59c640 1 -- 172.21.15.121:0/1580545809 learned_addr learned my addr 172.21.15.121:0/1580545809 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-18T22:48:07.958 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:07.954+0000 7f9447fff640 1 --2- 172.21.15.121:0/1580545809 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f94500fd5e0 0x7f945006f800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:48:07.959 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:07.954+0000 7f944e59c640 1 -- 172.21.15.121:0/1580545809 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f94500fd5e0 msgr2=0x7f945006f800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:48:07.959 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:07.954+0000 7f944e59c640 1 --2- 172.21.15.121:0/1580545809 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f94500fd5e0 0x7f945006f800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:48:07.959 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:07.954+0000 7f944e59c640 1 -- 172.21.15.121:0/1580545809 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9438005040 con 0x7f94500fc310 2024-08-18T22:48:07.959 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:07.954+0000 7f9447fff640 1 --2- 172.21.15.121:0/1580545809 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f94500fd5e0 0x7f945006f800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:48:07.959 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:07.954+0000 7f944e59c640 1 --2- 172.21.15.121:0/1580545809 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f94500fc310 0x7f9450071310 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f944000eb70 tx=0x7f944000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:48:07.959 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:07.954+0000 7f9446ffd640 1 -- 172.21.15.121:0/1580545809 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9440007c30 con 0x7f94500fc310 2024-08-18T22:48:07.959 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:07.954+0000 7f9446ffd640 1 -- 172.21.15.121:0/1580545809 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f944000f040 con 0x7f94500fc310 2024-08-18T22:48:07.959 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:07.954+0000 7f9454876640 1 -- 172.21.15.121:0/1580545809 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9450070150 con 0x7f94500fc310 2024-08-18T22:48:07.959 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:07.954+0000 7f9446ffd640 1 -- 172.21.15.121:0/1580545809 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f94400094e0 con 0x7f94500fc310 2024-08-18T22:48:07.959 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:07.954+0000 7f9454876640 1 -- 172.21.15.121:0/1580545809 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9450114e60 con 0x7f94500fc310 2024-08-18T22:48:07.959 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:07.955+0000 7f9454876640 1 -- 172.21.15.121:0/1580545809 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f945004b4c0 con 0x7f94500fc310 2024-08-18T22:48:07.959 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:07.956+0000 7f9446ffd640 1 -- 172.21.15.121:0/1580545809 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 37) v1 ==== 92205+0+0 (secure 0 0 0) 0x7f9440009640 con 0x7f94500fc310 2024-08-18T22:48:07.960 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:07.957+0000 7f9446ffd640 1 --2- 172.21.15.121:0/1580545809 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f943c06e0b0 0x7f943c070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:48:07.960 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:07.957+0000 7f9446ffd640 1 -- 172.21.15.121:0/1580545809 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f944008d830 con 0x7f94500fc310 2024-08-18T22:48:07.960 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:07.957+0000 7f9447fff640 1 --2- 172.21.15.121:0/1580545809 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f943c06e0b0 0x7f943c070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:48:07.960 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:07.957+0000 7f9447fff640 1 --2- 172.21.15.121:0/1580545809 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f943c06e0b0 0x7f943c070560 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f943800b020 tx=0x7f9438009da0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:48:07.961 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:07.961+0000 7f9446ffd640 1 -- 172.21.15.121:0/1580545809 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f9440056be0 con 0x7f94500fc310 2024-08-18T22:48:08.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:48:07 smithi195 ceph-mon[68841]: from='client.34374 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-18T22:48:08.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:48:07 smithi195 ceph-mon[68841]: pgmap v167: 65 pgs: 65 active+clean; 2.0 GiB data, 6.0 GiB used, 530 GiB / 536 GiB avail; 85 B/s rd, 2.0 KiB/s wr, 6 op/s 2024-08-18T22:48:08.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:48:07 smithi195 ceph-mon[68841]: from='client.34378 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-18T22:48:08.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:48:07 smithi195 ceph-mon[68841]: from='client.? 172.21.15.121:0/4106485754' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-08-18T22:48:08.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:48:07 smithi195 ceph-mon[68841]: from='client.? 172.21.15.121:0/2276348501' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-08-18T22:48:08.196 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:08.194+0000 7f9454876640 1 -- 172.21.15.121:0/1580545809 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f9450104d30 con 0x7f94500fc310 2024-08-18T22:48:08.196 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:08.195+0000 7f9446ffd640 1 -- 172.21.15.121:0/1580545809 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+171 (secure 0 0 0) 0x7f944008be60 con 0x7f94500fc310 2024-08-18T22:48:08.196 INFO:teuthology.orchestra.run.smithi121.stdout:HEALTH_WARN 1 MDSs report slow requests 2024-08-18T22:48:08.196 INFO:teuthology.orchestra.run.smithi121.stdout:[WRN] MDS_SLOW_REQUEST: 1 MDSs report slow requests 2024-08-18T22:48:08.196 INFO:teuthology.orchestra.run.smithi121.stdout: mds.cephfs.smithi121.gbickb(mds.0): 3 slow requests are blocked > 180 secs 2024-08-18T22:48:08.199 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:08.197+0000 7f9454876640 1 -- 172.21.15.121:0/1580545809 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f943c06e0b0 msgr2=0x7f943c070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:48:08.199 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:08.197+0000 7f9454876640 1 --2- 172.21.15.121:0/1580545809 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f943c06e0b0 0x7f943c070560 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f943800b020 tx=0x7f9438009da0 comp rx=0 tx=0).stop 2024-08-18T22:48:08.199 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:08.197+0000 7f9454876640 1 -- 172.21.15.121:0/1580545809 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f94500fc310 msgr2=0x7f9450071310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:48:08.199 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:08.197+0000 7f9454876640 1 --2- 172.21.15.121:0/1580545809 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f94500fc310 0x7f9450071310 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f944000eb70 tx=0x7f944000b040 comp rx=0 tx=0).stop 2024-08-18T22:48:08.199 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:08.197+0000 7f9454876640 1 -- 172.21.15.121:0/1580545809 shutdown_connections 2024-08-18T22:48:08.199 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:08.197+0000 7f9454876640 1 --2- 172.21.15.121:0/1580545809 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f943c06e0b0 0x7f943c070560 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:48:08.199 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:08.197+0000 7f9454876640 1 --2- 172.21.15.121:0/1580545809 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f94500fd5e0 0x7f945006f800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:48:08.199 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:08.197+0000 7f9454876640 1 --2- 172.21.15.121:0/1580545809 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f94500fc310 0x7f9450071310 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:48:08.199 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:08.197+0000 7f9454876640 1 -- 172.21.15.121:0/1580545809 >> 172.21.15.121:0/1580545809 conn(0x7f94500f7ad0 msgr2=0x7f94500f9210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:48:08.199 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:08.197+0000 7f9454876640 1 -- 172.21.15.121:0/1580545809 shutdown_connections 2024-08-18T22:48:08.199 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:08.197+0000 7f9454876640 1 -- 172.21.15.121:0/1580545809 wait complete. 2024-08-18T22:48:09.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:48:08 smithi121 ceph-mon[81053]: from='client.34382 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-18T22:48:09.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:48:08 smithi121 ceph-mon[81053]: from='client.? 172.21.15.121:0/1580545809' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-08-18T22:48:09.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:48:08 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-18T22:48:09.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:48:08 smithi195 ceph-mon[68841]: from='client.34382 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-18T22:48:09.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:48:08 smithi195 ceph-mon[68841]: from='client.? 172.21.15.121:0/1580545809' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-08-18T22:48:09.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:48:08 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-18T22:48:10.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:48:09 smithi121 ceph-mon[81053]: from='client.34394 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-18T22:48:10.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:48:09 smithi121 ceph-mon[81053]: pgmap v168: 65 pgs: 65 active+clean; 2.0 GiB data, 5.9 GiB used, 530 GiB / 536 GiB avail; 0 B/s rd, 1.4 KiB/s wr, 6 op/s 2024-08-18T22:48:10.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:48:09 smithi195 ceph-mon[68841]: from='client.34394 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-18T22:48:10.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:48:09 smithi195 ceph-mon[68841]: pgmap v168: 65 pgs: 65 active+clean; 2.0 GiB data, 5.9 GiB used, 530 GiB / 536 GiB avail; 0 B/s rd, 1.4 KiB/s wr, 6 op/s 2024-08-18T22:48:11.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:48:10 smithi121 ceph-mon[81053]: 3 slow requests, 0 included below; oldest blocked for > 401.871406 secs 2024-08-18T22:48:11.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:48:10 smithi195 ceph-mon[68841]: 3 slow requests, 0 included below; oldest blocked for > 401.871406 secs 2024-08-18T22:48:12.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:48:11 smithi121 ceph-mon[81053]: pgmap v169: 65 pgs: 65 active+clean; 2.0 GiB data, 5.9 GiB used, 531 GiB / 536 GiB avail; 0 B/s rd, 1.4 KiB/s wr, 7 op/s 2024-08-18T22:48:12.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:48:11 smithi195 ceph-mon[68841]: pgmap v169: 65 pgs: 65 active+clean; 2.0 GiB data, 5.9 GiB used, 531 GiB / 536 GiB avail; 0 B/s rd, 1.4 KiB/s wr, 7 op/s 2024-08-18T22:48:14.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:48:13 smithi121 ceph-mon[81053]: pgmap v170: 65 pgs: 65 active+clean; 1.9 GiB data, 5.8 GiB used, 531 GiB / 536 GiB avail; 0 B/s rd, 1.5 KiB/s wr, 7 op/s 2024-08-18T22:48:14.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:48:13 smithi195 ceph-mon[68841]: pgmap v170: 65 pgs: 65 active+clean; 1.9 GiB data, 5.8 GiB used, 531 GiB / 536 GiB avail; 0 B/s rd, 1.5 KiB/s wr, 7 op/s 2024-08-18T22:48:16.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:48:15 smithi121 ceph-mon[81053]: pgmap v171: 65 pgs: 65 active+clean; 1.9 GiB data, 5.8 GiB used, 531 GiB / 536 GiB avail; 0 B/s rd, 597 B/s wr, 5 op/s 2024-08-18T22:48:16.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:48:15 smithi121 ceph-mon[81053]: 3 slow requests, 0 included below; oldest blocked for > 406.871561 secs 2024-08-18T22:48:16.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:48:15 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-18T22:48:16.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:48:15 smithi195 ceph-mon[68841]: pgmap v171: 65 pgs: 65 active+clean; 1.9 GiB data, 5.8 GiB used, 531 GiB / 536 GiB avail; 0 B/s rd, 597 B/s wr, 5 op/s 2024-08-18T22:48:16.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:48:15 smithi195 ceph-mon[68841]: 3 slow requests, 0 included below; oldest blocked for > 406.871561 secs 2024-08-18T22:48:16.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:48:15 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-18T22:48:17.008 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:48:16 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:48:17.008 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:48:16 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-18T22:48:17.008 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:48:16 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:48:17.008 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:48:16 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-18T22:48:17.008 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:48:16 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "versions"}]: dispatch 2024-08-18T22:48:17.008 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:48:16 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "versions"}]: dispatch 2024-08-18T22:48:17.008 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:48:16 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "versions"}]: dispatch 2024-08-18T22:48:17.008 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:48:16 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "versions"}]: dispatch 2024-08-18T22:48:17.009 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:48:16 smithi195 ceph-mon[68841]: daemon mds.cephfs.smithi195.buqvbr finished stopping rank 1 in filesystem cephfs (now has 1 ranks) 2024-08-18T22:48:17.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:48:16 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:48:17.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:48:16 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-18T22:48:17.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:48:16 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:48:17.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:48:16 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-18T22:48:17.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:48:16 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "versions"}]: dispatch 2024-08-18T22:48:17.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:48:16 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "versions"}]: dispatch 2024-08-18T22:48:17.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:48:16 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "versions"}]: dispatch 2024-08-18T22:48:17.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:48:16 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "versions"}]: dispatch 2024-08-18T22:48:17.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:48:16 smithi121 ceph-mon[81053]: daemon mds.cephfs.smithi195.buqvbr finished stopping rank 1 in filesystem cephfs (now has 1 ranks) 2024-08-18T22:48:18.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:48:17 smithi121 ceph-mon[81053]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2024-08-18T22:48:18.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:48:17 smithi121 ceph-mon[81053]: pgmap v172: 65 pgs: 65 active+clean; 1.9 GiB data, 5.8 GiB used, 531 GiB / 536 GiB avail; 0 B/s rd, 597 B/s wr, 3 op/s 2024-08-18T22:48:18.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:48:17 smithi121 ceph-mon[81053]: mds.1 [v2:172.21.15.195:6824/2414511859,v1:172.21.15.195:6825/2414511859] down:stopped 2024-08-18T22:48:18.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:48:17 smithi121 ceph-mon[81053]: fsmap cephfs:1 {0=cephfs.smithi121.gbickb=up:active} 2 up:standby 2024-08-18T22:48:18.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:48:17 smithi195 ceph-mon[68841]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2024-08-18T22:48:18.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:48:17 smithi195 ceph-mon[68841]: pgmap v172: 65 pgs: 65 active+clean; 1.9 GiB data, 5.8 GiB used, 531 GiB / 536 GiB avail; 0 B/s rd, 597 B/s wr, 3 op/s 2024-08-18T22:48:18.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:48:17 smithi195 ceph-mon[68841]: mds.1 [v2:172.21.15.195:6824/2414511859,v1:172.21.15.195:6825/2414511859] down:stopped 2024-08-18T22:48:18.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:48:17 smithi195 ceph-mon[68841]: fsmap cephfs:1 {0=cephfs.smithi121.gbickb=up:active} 2 up:standby 2024-08-18T22:48:19.333 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:48:18 smithi121 ceph-mon[81053]: mds.? [v2:172.21.15.195:6824/110644516,v1:172.21.15.195:6825/110644516] up:boot 2024-08-18T22:48:19.334 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:48:18 smithi121 ceph-mon[81053]: fsmap cephfs:1 {0=cephfs.smithi121.gbickb=up:active} 3 up:standby 2024-08-18T22:48:19.334 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:48:18 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi195.buqvbr"}]: dispatch 2024-08-18T22:48:19.334 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:48:18 smithi121 ceph-mon[81053]: pgmap v173: 65 pgs: 65 active+clean; 1.9 GiB data, 5.8 GiB used, 531 GiB / 536 GiB avail; 0 B/s rd, 426 B/s wr, 1 op/s 2024-08-18T22:48:19.409 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:48:18 smithi195 ceph-mon[68841]: mds.? [v2:172.21.15.195:6824/110644516,v1:172.21.15.195:6825/110644516] up:boot 2024-08-18T22:48:19.409 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:48:18 smithi195 ceph-mon[68841]: fsmap cephfs:1 {0=cephfs.smithi121.gbickb=up:active} 3 up:standby 2024-08-18T22:48:19.409 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:48:18 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi195.buqvbr"}]: dispatch 2024-08-18T22:48:19.409 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:48:18 smithi195 ceph-mon[68841]: pgmap v173: 65 pgs: 65 active+clean; 1.9 GiB data, 5.8 GiB used, 531 GiB / 536 GiB avail; 0 B/s rd, 426 B/s wr, 1 op/s 2024-08-18T22:48:20.833 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:48:20 smithi121 ceph-mon[81053]: 3 slow requests, 0 included below; oldest blocked for > 411.871682 secs 2024-08-18T22:48:20.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:48:20 smithi195 ceph-mon[68841]: 3 slow requests, 0 included below; oldest blocked for > 411.871682 secs 2024-08-18T22:48:21.833 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:48:21 smithi121 ceph-mon[81053]: pgmap v174: 65 pgs: 65 active+clean; 1.9 GiB data, 5.8 GiB used, 531 GiB / 536 GiB avail; 0 B/s rd, 341 B/s wr, 1 op/s 2024-08-18T22:48:21.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:48:21 smithi195 ceph-mon[68841]: pgmap v174: 65 pgs: 65 active+clean; 1.9 GiB data, 5.8 GiB used, 531 GiB / 536 GiB avail; 0 B/s rd, 341 B/s wr, 1 op/s 2024-08-18T22:48:23.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:48:23 smithi195 ceph-mon[68841]: pgmap v175: 65 pgs: 65 active+clean; 1.9 GiB data, 5.8 GiB used, 531 GiB / 536 GiB avail; 341 B/s wr, 0 op/s 2024-08-18T22:48:24.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:48:23 smithi121 ceph-mon[81053]: pgmap v175: 65 pgs: 65 active+clean; 1.9 GiB data, 5.8 GiB used, 531 GiB / 536 GiB avail; 341 B/s wr, 0 op/s 2024-08-18T22:48:24.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:48:24 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-18T22:48:25.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:48:24 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-18T22:48:25.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:48:25 smithi195 ceph-mon[68841]: pgmap v176: 65 pgs: 65 active+clean; 1.9 GiB data, 5.8 GiB used, 531 GiB / 536 GiB avail 2024-08-18T22:48:25.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:48:25 smithi195 ceph-mon[68841]: 3 slow requests, 0 included below; oldest blocked for > 416.871816 secs 2024-08-18T22:48:26.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:48:25 smithi121 ceph-mon[81053]: pgmap v176: 65 pgs: 65 active+clean; 1.9 GiB data, 5.8 GiB used, 531 GiB / 536 GiB avail 2024-08-18T22:48:26.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:48:25 smithi121 ceph-mon[81053]: 3 slow requests, 0 included below; oldest blocked for > 416.871816 secs 2024-08-18T22:48:26.907 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:48:26 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-18T22:48:26.907 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:48:26 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:48:26.907 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:48:26 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-18T22:48:26.907 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:48:26 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:48:26.907 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:48:26 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-18T22:48:26.907 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:48:26 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "versions"}]: dispatch 2024-08-18T22:48:26.908 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:48:26 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "versions"}]: dispatch 2024-08-18T22:48:26.908 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:48:26 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "versions"}]: dispatch 2024-08-18T22:48:26.908 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:48:26 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "versions"}]: dispatch 2024-08-18T22:48:26.908 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:48:26 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi121.xuzsdg"]}]: dispatch 2024-08-18T22:48:26.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:48:26 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-18T22:48:26.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:48:26 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:48:26.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:48:26 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-18T22:48:26.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:48:26 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:48:26.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:48:26 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-18T22:48:26.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:48:26 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "versions"}]: dispatch 2024-08-18T22:48:26.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:48:26 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "versions"}]: dispatch 2024-08-18T22:48:26.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:48:26 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "versions"}]: dispatch 2024-08-18T22:48:26.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:48:26 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "versions"}]: dispatch 2024-08-18T22:48:26.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:48:26 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi121.xuzsdg"]}]: dispatch 2024-08-18T22:48:27.833 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:48:27 smithi121 ceph-mon[81053]: Upgrade: It appears safe to stop mds.cephfs.smithi121.xuzsdg 2024-08-18T22:48:27.833 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:48:27 smithi121 ceph-mon[81053]: pgmap v177: 65 pgs: 65 active+clean; 1.9 GiB data, 5.8 GiB used, 531 GiB / 536 GiB avail 2024-08-18T22:48:27.833 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:48:27 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:48:27.834 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:48:27 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi121.xuzsdg", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-08-18T22:48:27.834 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:48:27 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:48:27.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:48:27 smithi195 ceph-mon[68841]: Upgrade: It appears safe to stop mds.cephfs.smithi121.xuzsdg 2024-08-18T22:48:27.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:48:27 smithi195 ceph-mon[68841]: pgmap v177: 65 pgs: 65 active+clean; 1.9 GiB data, 5.8 GiB used, 531 GiB / 536 GiB avail 2024-08-18T22:48:27.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:48:27 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:48:27.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:48:27 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi121.xuzsdg", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-08-18T22:48:27.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:48:27 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:48:28.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:48:28 smithi195 ceph-mon[68841]: Upgrade: Updating mds.cephfs.smithi121.xuzsdg 2024-08-18T22:48:28.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:48:28 smithi195 ceph-mon[68841]: Deploying daemon mds.cephfs.smithi121.xuzsdg on smithi121 2024-08-18T22:48:28.947 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:48:28 smithi121 ceph-mon[81053]: Upgrade: Updating mds.cephfs.smithi121.xuzsdg 2024-08-18T22:48:28.947 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:48:28 smithi121 ceph-mon[81053]: Deploying daemon mds.cephfs.smithi121.xuzsdg on smithi121 2024-08-18T22:48:30.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:48:29 smithi121 ceph-mon[81053]: pgmap v178: 65 pgs: 65 active+clean; 1.9 GiB data, 5.8 GiB used, 531 GiB / 536 GiB avail 2024-08-18T22:48:30.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:48:29 smithi195 ceph-mon[68841]: pgmap v178: 65 pgs: 65 active+clean; 1.9 GiB data, 5.8 GiB used, 531 GiB / 536 GiB avail 2024-08-18T22:48:31.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:48:30 smithi121 ceph-mon[81053]: osdmap e81: 6 total, 6 up, 6 in 2024-08-18T22:48:31.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:48:30 smithi121 ceph-mon[81053]: fsmap cephfs:1 {0=cephfs.smithi121.gbickb=up:active} 2 up:standby 2024-08-18T22:48:31.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:48:30 smithi121 ceph-mon[81053]: 3 slow requests, 0 included below; oldest blocked for > 421.871887 secs 2024-08-18T22:48:31.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:48:30 smithi195 ceph-mon[68841]: osdmap e81: 6 total, 6 up, 6 in 2024-08-18T22:48:31.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:48:30 smithi195 ceph-mon[68841]: fsmap cephfs:1 {0=cephfs.smithi121.gbickb=up:active} 2 up:standby 2024-08-18T22:48:31.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:48:30 smithi195 ceph-mon[68841]: 3 slow requests, 0 included below; oldest blocked for > 421.871887 secs 2024-08-18T22:48:32.000 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:48:31 smithi121 ceph-mon[81053]: pgmap v180: 65 pgs: 65 active+clean; 1.9 GiB data, 5.8 GiB used, 531 GiB / 536 GiB avail 2024-08-18T22:48:32.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:48:31 smithi195 ceph-mon[68841]: pgmap v180: 65 pgs: 65 active+clean; 1.9 GiB data, 5.8 GiB used, 531 GiB / 536 GiB avail 2024-08-18T22:48:34.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:48:33 smithi121 ceph-mon[81053]: pgmap v181: 65 pgs: 65 active+clean; 1.9 GiB data, 5.8 GiB used, 531 GiB / 536 GiB avail 2024-08-18T22:48:34.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:48:33 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:48:34.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:48:33 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:48:34.162 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:48:33 smithi195 ceph-mon[68841]: pgmap v181: 65 pgs: 65 active+clean; 1.9 GiB data, 5.8 GiB used, 531 GiB / 536 GiB avail 2024-08-18T22:48:34.162 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:48:33 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:48:34.162 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:48:33 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:48:34.994 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:48:34 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-18T22:48:34.994 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:48:34 smithi121 ceph-mon[81053]: mds.? [v2:172.21.15.121:6826/4267588865,v1:172.21.15.121:6827/4267588865] up:boot 2024-08-18T22:48:34.994 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:48:34 smithi121 ceph-mon[81053]: fsmap cephfs:1 {0=cephfs.smithi121.gbickb=up:active} 3 up:standby 2024-08-18T22:48:34.995 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:48:34 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi121.xuzsdg"}]: dispatch 2024-08-18T22:48:35.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:48:34 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-18T22:48:35.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:48:34 smithi195 ceph-mon[68841]: mds.? [v2:172.21.15.121:6826/4267588865,v1:172.21.15.121:6827/4267588865] up:boot 2024-08-18T22:48:35.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:48:34 smithi195 ceph-mon[68841]: fsmap cephfs:1 {0=cephfs.smithi121.gbickb=up:active} 3 up:standby 2024-08-18T22:48:35.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:48:34 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi121.xuzsdg"}]: dispatch 2024-08-18T22:48:35.977 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:48:35 smithi121 ceph-mon[81053]: pgmap v182: 65 pgs: 65 active+clean; 1.9 GiB data, 5.8 GiB used, 531 GiB / 536 GiB avail 2024-08-18T22:48:35.977 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:48:35 smithi121 ceph-mon[81053]: 3 slow requests, 0 included below; oldest blocked for > 426.872038 secs 2024-08-18T22:48:36.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:48:35 smithi195 ceph-mon[68841]: pgmap v182: 65 pgs: 65 active+clean; 1.9 GiB data, 5.8 GiB used, 531 GiB / 536 GiB avail 2024-08-18T22:48:36.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:48:35 smithi195 ceph-mon[68841]: 3 slow requests, 0 included below; oldest blocked for > 426.872038 secs 2024-08-18T22:48:38.042 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:48:37 smithi121 ceph-mon[81053]: pgmap v183: 65 pgs: 65 active+clean; 1.9 GiB data, 5.8 GiB used, 531 GiB / 536 GiB avail 2024-08-18T22:48:38.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:48:37 smithi195 ceph-mon[68841]: pgmap v183: 65 pgs: 65 active+clean; 1.9 GiB data, 5.8 GiB used, 531 GiB / 536 GiB avail 2024-08-18T22:48:38.281 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:38.279+0000 7fa22c02f640 1 -- 172.21.15.121:0/2476157876 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa2240fb1f0 msgr2=0x7fa2240fb600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:48:38.282 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:38.279+0000 7fa22c02f640 1 --2- 172.21.15.121:0/2476157876 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa2240fb1f0 0x7fa2240fb600 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fa2200048d0 tx=0x7fa220009da0 comp rx=0 tx=0).stop 2024-08-18T22:48:38.282 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:38.279+0000 7fa22c02f640 1 -- 172.21.15.121:0/2476157876 shutdown_connections 2024-08-18T22:48:38.282 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:38.279+0000 7fa22c02f640 1 --2- 172.21.15.121:0/2476157876 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa2240fc4c0 0x7fa2240fc930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:48:38.282 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:38.279+0000 7fa22c02f640 1 --2- 172.21.15.121:0/2476157876 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa2240fb1f0 0x7fa2240fb600 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:48:38.282 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:38.279+0000 7fa22c02f640 1 -- 172.21.15.121:0/2476157876 >> 172.21.15.121:0/2476157876 conn(0x7fa2240f69b0 msgr2=0x7fa2240f8de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:48:38.282 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:38.279+0000 7fa22c02f640 1 -- 172.21.15.121:0/2476157876 shutdown_connections 2024-08-18T22:48:38.282 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:38.279+0000 7fa22c02f640 1 -- 172.21.15.121:0/2476157876 wait complete. 2024-08-18T22:48:38.282 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:38.279+0000 7fa22c02f640 1 Processor -- start 2024-08-18T22:48:38.282 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:38.280+0000 7fa22c02f640 1 -- start start 2024-08-18T22:48:38.282 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:38.280+0000 7fa22c02f640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa2240fb1f0 0x7fa22410ce90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:48:38.282 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:38.280+0000 7fa22c02f640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa2240fc4c0 0x7fa22410d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:48:38.283 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:38.280+0000 7fa22c02f640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa22410da20 con 0x7fa2240fc4c0 2024-08-18T22:48:38.283 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:38.280+0000 7fa22c02f640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa22410e160 con 0x7fa2240fb1f0 2024-08-18T22:48:38.283 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:38.280+0000 7fa2295ca640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa2240fc4c0 0x7fa22410d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:48:38.283 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:38.280+0000 7fa2295ca640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa2240fc4c0 0x7fa22410d3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:39922/0 (socket says 172.21.15.121:39922) 2024-08-18T22:48:38.283 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:38.280+0000 7fa2295ca640 1 -- 172.21.15.121:0/883715031 learned_addr learned my addr 172.21.15.121:0/883715031 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-18T22:48:38.283 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:38.280+0000 7fa229dcb640 1 --2- 172.21.15.121:0/883715031 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa2240fb1f0 0x7fa22410ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:48:38.283 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:38.280+0000 7fa2295ca640 1 -- 172.21.15.121:0/883715031 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa2240fb1f0 msgr2=0x7fa22410ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:48:38.283 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:38.280+0000 7fa2295ca640 1 --2- 172.21.15.121:0/883715031 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa2240fb1f0 0x7fa22410ce90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:48:38.283 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:38.280+0000 7fa2295ca640 1 -- 172.21.15.121:0/883715031 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa220005040 con 0x7fa2240fc4c0 2024-08-18T22:48:38.283 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:38.281+0000 7fa2295ca640 1 --2- 172.21.15.121:0/883715031 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa2240fc4c0 0x7fa22410d3d0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fa21400c810 tx=0x7fa2140043c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:48:38.283 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:38.281+0000 7fa21a7fc640 1 -- 172.21.15.121:0/883715031 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa21400a7a0 con 0x7fa2240fc4c0 2024-08-18T22:48:38.283 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:38.281+0000 7fa22c02f640 1 -- 172.21.15.121:0/883715031 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa22410e3f0 con 0x7fa2240fc4c0 2024-08-18T22:48:38.283 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:38.281+0000 7fa21a7fc640 1 -- 172.21.15.121:0/883715031 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fa21400ada0 con 0x7fa2240fc4c0 2024-08-18T22:48:38.284 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:38.281+0000 7fa21a7fc640 1 -- 172.21.15.121:0/883715031 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa214011380 con 0x7fa2240fc4c0 2024-08-18T22:48:38.284 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:38.281+0000 7fa22c02f640 1 -- 172.21.15.121:0/883715031 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa22410e990 con 0x7fa2240fc4c0 2024-08-18T22:48:38.284 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:38.282+0000 7fa22c02f640 1 -- 172.21.15.121:0/883715031 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2240fa650 con 0x7fa2240fc4c0 2024-08-18T22:48:38.284 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:38.282+0000 7fa21a7fc640 1 -- 172.21.15.121:0/883715031 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 37) v1 ==== 92205+0+0 (secure 0 0 0) 0x7fa2140127d0 con 0x7fa2240fc4c0 2024-08-18T22:48:38.285 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:38.283+0000 7fa21a7fc640 1 --2- 172.21.15.121:0/883715031 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7fa21006e0b0 0x7fa210070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:48:38.285 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:38.283+0000 7fa21a7fc640 1 -- 172.21.15.121:0/883715031 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6496+0+0 (secure 0 0 0) 0x7fa21408e190 con 0x7fa2240fc4c0 2024-08-18T22:48:38.285 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:38.283+0000 7fa229dcb640 1 --2- 172.21.15.121:0/883715031 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7fa21006e0b0 0x7fa210070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:48:38.285 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:38.283+0000 7fa229dcb640 1 --2- 172.21.15.121:0/883715031 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7fa21006e0b0 0x7fa210070560 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fa220007ac0 tx=0x7fa220035040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:48:38.288 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:38.287+0000 7fa21a7fc640 1 -- 172.21.15.121:0/883715031 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7fa21405aff0 con 0x7fa2240fc4c0 2024-08-18T22:48:38.505 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:38.504+0000 7fa22c02f640 1 -- 172.21.15.121:0/883715031 --> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fa22410ec10 con 0x7fa21006e0b0 2024-08-18T22:48:38.506 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:38.505+0000 7fa21a7fc640 1 -- 172.21.15.121:0/883715031 <== mgr.34102 v2:172.21.15.121:6800/3037387239 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fa22410ec10 con 0x7fa21006e0b0 2024-08-18T22:48:38.508 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:38.507+0000 7fa22c02f640 1 -- 172.21.15.121:0/883715031 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7fa21006e0b0 msgr2=0x7fa210070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:48:38.509 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:38.507+0000 7fa22c02f640 1 --2- 172.21.15.121:0/883715031 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7fa21006e0b0 0x7fa210070560 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fa220007ac0 tx=0x7fa220035040 comp rx=0 tx=0).stop 2024-08-18T22:48:38.509 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:38.507+0000 7fa22c02f640 1 -- 172.21.15.121:0/883715031 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa2240fc4c0 msgr2=0x7fa22410d3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:48:38.509 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:38.507+0000 7fa22c02f640 1 --2- 172.21.15.121:0/883715031 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa2240fc4c0 0x7fa22410d3d0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fa21400c810 tx=0x7fa2140043c0 comp rx=0 tx=0).stop 2024-08-18T22:48:38.509 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:38.507+0000 7fa22c02f640 1 -- 172.21.15.121:0/883715031 shutdown_connections 2024-08-18T22:48:38.509 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:38.507+0000 7fa22c02f640 1 --2- 172.21.15.121:0/883715031 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7fa21006e0b0 0x7fa210070560 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:48:38.509 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:38.507+0000 7fa22c02f640 1 --2- 172.21.15.121:0/883715031 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa2240fc4c0 0x7fa22410d3d0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:48:38.509 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:38.507+0000 7fa22c02f640 1 --2- 172.21.15.121:0/883715031 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa2240fb1f0 0x7fa22410ce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:48:38.509 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:38.508+0000 7fa22c02f640 1 -- 172.21.15.121:0/883715031 >> 172.21.15.121:0/883715031 conn(0x7fa2240f69b0 msgr2=0x7fa224065f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:48:38.509 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:38.508+0000 7fa22c02f640 1 -- 172.21.15.121:0/883715031 shutdown_connections 2024-08-18T22:48:38.509 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:38.508+0000 7fa22c02f640 1 -- 172.21.15.121:0/883715031 wait complete. 2024-08-18T22:48:38.517 INFO:teuthology.orchestra.run.smithi121.stdout:true 2024-08-18T22:48:38.594 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:38.592+0000 7f3040e9f640 1 -- 172.21.15.121:0/1447917191 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f303c0fc490 msgr2=0x7f303c0fc900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:48:38.594 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:38.592+0000 7f3040e9f640 1 --2- 172.21.15.121:0/1447917191 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f303c0fc490 0x7f303c0fc900 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f30300048d0 tx=0x7f3030009da0 comp rx=0 tx=0).stop 2024-08-18T22:48:38.594 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:38.592+0000 7f3040e9f640 1 -- 172.21.15.121:0/1447917191 shutdown_connections 2024-08-18T22:48:38.594 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:38.592+0000 7f3040e9f640 1 --2- 172.21.15.121:0/1447917191 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f303c0fc490 0x7f303c0fc900 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:48:38.594 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:38.592+0000 7f3040e9f640 1 --2- 172.21.15.121:0/1447917191 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f303c0fb1c0 0x7f303c0fb5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:48:38.594 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:38.592+0000 7f3040e9f640 1 -- 172.21.15.121:0/1447917191 >> 172.21.15.121:0/1447917191 conn(0x7f303c0f69a0 msgr2=0x7f303c0f8db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:48:38.594 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:38.592+0000 7f3040e9f640 1 -- 172.21.15.121:0/1447917191 shutdown_connections 2024-08-18T22:48:38.594 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:38.592+0000 7f3040e9f640 1 -- 172.21.15.121:0/1447917191 wait complete. 2024-08-18T22:48:38.595 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:38.593+0000 7f3040e9f640 1 Processor -- start 2024-08-18T22:48:38.595 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:38.593+0000 7f3040e9f640 1 -- start start 2024-08-18T22:48:38.595 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:38.593+0000 7f3040e9f640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f303c0fb1c0 0x7f303c066180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:48:38.595 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:38.593+0000 7f3040e9f640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f303c0fc490 0x7f303c114000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:48:38.595 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:38.593+0000 7f3040e9f640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f303c114540 con 0x7f303c0fb1c0 2024-08-18T22:48:38.595 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:38.593+0000 7f3040e9f640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f303c114680 con 0x7f303c0fc490 2024-08-18T22:48:38.596 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:38.593+0000 7f303a59c640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f303c0fb1c0 0x7f303c066180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:48:38.596 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:38.593+0000 7f303a59c640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f303c0fb1c0 0x7f303c066180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:39938/0 (socket says 172.21.15.121:39938) 2024-08-18T22:48:38.596 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:38.593+0000 7f303a59c640 1 -- 172.21.15.121:0/2375271156 learned_addr learned my addr 172.21.15.121:0/2375271156 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-18T22:48:38.596 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:38.593+0000 7f3039d9b640 1 --2- 172.21.15.121:0/2375271156 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f303c0fc490 0x7f303c114000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:48:38.596 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:38.593+0000 7f303a59c640 1 -- 172.21.15.121:0/2375271156 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f303c0fc490 msgr2=0x7f303c114000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:48:38.596 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:38.593+0000 7f303a59c640 1 --2- 172.21.15.121:0/2375271156 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f303c0fc490 0x7f303c114000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:48:38.596 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:38.593+0000 7f303a59c640 1 -- 172.21.15.121:0/2375271156 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3030005040 con 0x7f303c0fb1c0 2024-08-18T22:48:38.597 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:38.593+0000 7f3039d9b640 1 --2- 172.21.15.121:0/2375271156 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f303c0fc490 0x7f303c114000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:48:38.597 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:38.593+0000 7f303a59c640 1 --2- 172.21.15.121:0/2375271156 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f303c0fb1c0 0x7f303c066180 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f302c009ed0 tx=0x7f302c0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:48:38.597 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:38.594+0000 7f302affd640 1 -- 172.21.15.121:0/2375271156 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f302c01d470 con 0x7f303c0fb1c0 2024-08-18T22:48:38.597 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:38.594+0000 7f3040e9f640 1 -- 172.21.15.121:0/2375271156 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f303c10dc40 con 0x7f303c0fb1c0 2024-08-18T22:48:38.597 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:38.594+0000 7f302affd640 1 -- 172.21.15.121:0/2375271156 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f302c01da70 con 0x7f303c0fb1c0 2024-08-18T22:48:38.597 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:38.594+0000 7f302affd640 1 -- 172.21.15.121:0/2375271156 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f302c01b9b0 con 0x7f303c0fb1c0 2024-08-18T22:48:38.597 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:38.594+0000 7f3040e9f640 1 -- 172.21.15.121:0/2375271156 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f303c10e160 con 0x7f303c0fb1c0 2024-08-18T22:48:38.597 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:38.595+0000 7f3040e9f640 1 -- 172.21.15.121:0/2375271156 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f303c1055d0 con 0x7f303c0fb1c0 2024-08-18T22:48:38.598 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:38.595+0000 7f302affd640 1 -- 172.21.15.121:0/2375271156 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 37) v1 ==== 92205+0+0 (secure 0 0 0) 0x7f302c01a070 con 0x7f303c0fb1c0 2024-08-18T22:48:38.598 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:38.596+0000 7f302affd640 1 --2- 172.21.15.121:0/2375271156 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f302406e0b0 0x7f3024070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:48:38.598 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:38.596+0000 7f302affd640 1 -- 172.21.15.121:0/2375271156 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f302c095c60 con 0x7f303c0fb1c0 2024-08-18T22:48:38.598 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:38.596+0000 7f3039d9b640 1 --2- 172.21.15.121:0/2375271156 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f302406e0b0 0x7f3024070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:48:38.598 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:38.597+0000 7f3039d9b640 1 --2- 172.21.15.121:0/2375271156 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f302406e0b0 0x7f3024070560 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f3030004540 tx=0x7f3030035040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:48:38.602 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:38.601+0000 7f302affd640 1 -- 172.21.15.121:0/2375271156 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f302c05f0b0 con 0x7f303c0fb1c0 2024-08-18T22:48:38.795 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:38.794+0000 7f3040e9f640 1 -- 172.21.15.121:0/2375271156 --> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f303c100ec0 con 0x7f302406e0b0 2024-08-18T22:48:38.796 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:38.796+0000 7f302affd640 1 -- 172.21.15.121:0/2375271156 <== mgr.34102 v2:172.21.15.121:6800/3037387239 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f303c100ec0 con 0x7f302406e0b0 2024-08-18T22:48:38.800 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:38.799+0000 7f3040e9f640 1 -- 172.21.15.121:0/2375271156 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f302406e0b0 msgr2=0x7f3024070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:48:38.800 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:38.799+0000 7f3040e9f640 1 --2- 172.21.15.121:0/2375271156 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f302406e0b0 0x7f3024070560 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f3030004540 tx=0x7f3030035040 comp rx=0 tx=0).stop 2024-08-18T22:48:38.800 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:38.799+0000 7f3040e9f640 1 -- 172.21.15.121:0/2375271156 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f303c0fb1c0 msgr2=0x7f303c066180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:48:38.800 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:38.799+0000 7f3040e9f640 1 --2- 172.21.15.121:0/2375271156 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f303c0fb1c0 0x7f303c066180 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f302c009ed0 tx=0x7f302c0091d0 comp rx=0 tx=0).stop 2024-08-18T22:48:38.800 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:38.799+0000 7f3040e9f640 1 -- 172.21.15.121:0/2375271156 shutdown_connections 2024-08-18T22:48:38.800 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:38.799+0000 7f3040e9f640 1 --2- 172.21.15.121:0/2375271156 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f302406e0b0 0x7f3024070560 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:48:38.800 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:38.799+0000 7f3040e9f640 1 --2- 172.21.15.121:0/2375271156 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f303c0fc490 0x7f303c114000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:48:38.800 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:38.799+0000 7f3040e9f640 1 --2- 172.21.15.121:0/2375271156 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f303c0fb1c0 0x7f303c066180 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:48:38.800 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:38.799+0000 7f3040e9f640 1 -- 172.21.15.121:0/2375271156 >> 172.21.15.121:0/2375271156 conn(0x7f303c0f69a0 msgr2=0x7f303c0ff7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:48:38.800 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:38.799+0000 7f3040e9f640 1 -- 172.21.15.121:0/2375271156 shutdown_connections 2024-08-18T22:48:38.801 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:38.799+0000 7f3040e9f640 1 -- 172.21.15.121:0/2375271156 wait complete. 2024-08-18T22:48:38.881 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:38.879+0000 7f2ededfd640 1 -- 172.21.15.121:0/2992719268 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2ed80fd910 msgr2=0x7f2ed80fdd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:48:38.881 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:38.879+0000 7f2ededfd640 1 --2- 172.21.15.121:0/2992719268 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2ed80fd910 0x7f2ed80fdd20 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f2ecc0048d0 tx=0x7f2ecc009da0 comp rx=0 tx=0).stop 2024-08-18T22:48:38.882 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:38.879+0000 7f2ededfd640 1 -- 172.21.15.121:0/2992719268 shutdown_connections 2024-08-18T22:48:38.882 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:38.879+0000 7f2ededfd640 1 --2- 172.21.15.121:0/2992719268 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2ed80fe260 0x7f2ed80fa3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:48:38.882 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:38.879+0000 7f2ededfd640 1 --2- 172.21.15.121:0/2992719268 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2ed80fd910 0x7f2ed80fdd20 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:48:38.882 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:38.879+0000 7f2ededfd640 1 -- 172.21.15.121:0/2992719268 >> 172.21.15.121:0/2992719268 conn(0x7f2ed80f6130 msgr2=0x7f2ed80f8540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:48:38.882 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:38.879+0000 7f2ededfd640 1 -- 172.21.15.121:0/2992719268 shutdown_connections 2024-08-18T22:48:38.882 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:38.879+0000 7f2ededfd640 1 -- 172.21.15.121:0/2992719268 wait complete. 2024-08-18T22:48:38.883 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:38.880+0000 7f2ededfd640 1 Processor -- start 2024-08-18T22:48:38.883 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:38.880+0000 7f2ededfd640 1 -- start start 2024-08-18T22:48:38.885 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:38.880+0000 7f2ededfd640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2ed80fd910 0x7f2ed810ced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:48:38.885 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:38.880+0000 7f2ededfd640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2ed80fe260 0x7f2ed810d410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:48:38.885 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:38.880+0000 7f2ededfd640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ed810e140 con 0x7f2ed80fd910 2024-08-18T22:48:38.885 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:38.880+0000 7f2ededfd640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ed810e2b0 con 0x7f2ed80fe260 2024-08-18T22:48:38.885 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:38.880+0000 7f2edcb99640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2ed80fd910 0x7f2ed810ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:48:38.885 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:38.880+0000 7f2edcb99640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2ed80fd910 0x7f2ed810ced0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:39956/0 (socket says 172.21.15.121:39956) 2024-08-18T22:48:38.885 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:38.880+0000 7f2edcb99640 1 -- 172.21.15.121:0/1492691427 learned_addr learned my addr 172.21.15.121:0/1492691427 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-18T22:48:38.885 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:38.881+0000 7f2ed7fff640 1 --2- 172.21.15.121:0/1492691427 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2ed80fe260 0x7f2ed810d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:48:38.885 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:38.881+0000 7f2edcb99640 1 -- 172.21.15.121:0/1492691427 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2ed80fe260 msgr2=0x7f2ed810d410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:48:38.885 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:38.881+0000 7f2edcb99640 1 --2- 172.21.15.121:0/1492691427 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2ed80fe260 0x7f2ed810d410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:48:38.886 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:38.881+0000 7f2edcb99640 1 -- 172.21.15.121:0/1492691427 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ecc005040 con 0x7f2ed80fd910 2024-08-18T22:48:38.886 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:38.881+0000 7f2edcb99640 1 --2- 172.21.15.121:0/1492691427 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2ed80fd910 0x7f2ed810ced0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f2ecc0043d0 tx=0x7f2ecc009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:48:38.886 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:38.881+0000 7f2ed57fa640 1 -- 172.21.15.121:0/1492691427 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2ecc038070 con 0x7f2ed80fd910 2024-08-18T22:48:38.886 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:38.881+0000 7f2ed57fa640 1 -- 172.21.15.121:0/1492691427 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f2ecc02ae90 con 0x7f2ed80fd910 2024-08-18T22:48:38.886 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:38.881+0000 7f2ededfd640 1 -- 172.21.15.121:0/1492691427 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ed810e530 con 0x7f2ed80fd910 2024-08-18T22:48:38.886 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:38.881+0000 7f2ed57fa640 1 -- 172.21.15.121:0/1492691427 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2ecc03e670 con 0x7f2ed80fd910 2024-08-18T22:48:38.886 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:38.881+0000 7f2ededfd640 1 -- 172.21.15.121:0/1492691427 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ed810ead0 con 0x7f2ed80fd910 2024-08-18T22:48:38.886 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:38.882+0000 7f2ededfd640 1 -- 172.21.15.121:0/1492691427 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ed8105530 con 0x7f2ed80fd910 2024-08-18T22:48:38.886 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:38.883+0000 7f2ed57fa640 1 -- 172.21.15.121:0/1492691427 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 37) v1 ==== 92205+0+0 (secure 0 0 0) 0x7f2ecc030020 con 0x7f2ed80fd910 2024-08-18T22:48:38.886 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:38.883+0000 7f2ed57fa640 1 --2- 172.21.15.121:0/1492691427 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f2ec806e0b0 0x7f2ec8070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:48:38.886 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:38.883+0000 7f2ed57fa640 1 -- 172.21.15.121:0/1492691427 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f2ecc0ade10 con 0x7f2ed80fd910 2024-08-18T22:48:38.886 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:38.883+0000 7f2ed7fff640 1 --2- 172.21.15.121:0/1492691427 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f2ec806e0b0 0x7f2ec8070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:48:38.887 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:38.884+0000 7f2ed7fff640 1 --2- 172.21.15.121:0/1492691427 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f2ec806e0b0 0x7f2ec8070560 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f2ec4007fd0 tx=0x7f2ec4009e90 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:48:38.888 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:38.888+0000 7f2ed57fa640 1 -- 172.21.15.121:0/1492691427 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f2ecc0771b0 con 0x7f2ed80fd910 2024-08-18T22:48:39.077 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:39.075+0000 7f2ededfd640 1 -- 172.21.15.121:0/1492691427 --> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f2ed810edb0 con 0x7f2ec806e0b0 2024-08-18T22:48:39.086 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:39.085+0000 7f2ed57fa640 1 -- 172.21.15.121:0/1492691427 <== mgr.34102 v2:172.21.15.121:6800/3037387239 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f2ed810edb0 con 0x7f2ec806e0b0 2024-08-18T22:48:39.086 INFO:teuthology.orchestra.run.smithi121.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-08-18T22:48:39.086 INFO:teuthology.orchestra.run.smithi121.stdout:alertmanager.smithi121 smithi121 *:9093,9094 running (6m) 0s ago 14m 23.4M - 0.25.0 c8568f914cd2 c421c5e6a02b 2024-08-18T22:48:39.086 INFO:teuthology.orchestra.run.smithi121.stdout:crash.smithi121 smithi121 running (4m) 0s ago 14m 6903k - 19.1.0-1382-gde09dd01 ea7a5189f30b 3cf5c666a0e6 2024-08-18T22:48:39.086 INFO:teuthology.orchestra.run.smithi121.stdout:crash.smithi195 smithi195 running (4m) 59s ago 13m 6895k - 19.1.0-1382-gde09dd01 ea7a5189f30b fbb586fb9834 2024-08-18T22:48:39.087 INFO:teuthology.orchestra.run.smithi121.stdout:grafana.smithi121 smithi121 *:3000 running (6m) 0s ago 14m 84.5M - 9.4.7 954c08fa6188 091a5fd17e8a 2024-08-18T22:48:39.087 INFO:teuthology.orchestra.run.smithi121.stdout:mds.cephfs.smithi121.gbickb smithi121 running (9m) 0s ago 9m 156M - 17.2.7-1406-gdf62bdcc 774894bef55f 484da0bc2c95 2024-08-18T22:48:39.087 INFO:teuthology.orchestra.run.smithi121.stdout:mds.cephfs.smithi121.xuzsdg smithi121 running (5s) 0s ago 9m 13.0M - 19.1.0-1382-gde09dd01 ea7a5189f30b 4eec4d0a895e 2024-08-18T22:48:39.087 INFO:teuthology.orchestra.run.smithi121.stdout:mds.cephfs.smithi195.buqvbr smithi195 running (9m) 59s ago 9m 116M - 17.2.7-1406-gdf62bdcc 774894bef55f 11a3703b4276 2024-08-18T22:48:39.087 INFO:teuthology.orchestra.run.smithi121.stdout:mds.cephfs.smithi195.nptgyc smithi195 running (9m) 59s ago 9m 18.4M - 17.2.7-1406-gdf62bdcc 774894bef55f b9f8043ea83e 2024-08-18T22:48:39.087 INFO:teuthology.orchestra.run.smithi121.stdout:mgr.smithi121.lopxqc smithi121 *:8443,9283,8765 running (5m) 0s ago 15m 504M - 19.1.0-1382-gde09dd01 ea7a5189f30b 9079701e6516 2024-08-18T22:48:39.087 INFO:teuthology.orchestra.run.smithi121.stdout:mgr.smithi195.acttsj smithi195 *:8443,9283,8765 running (5m) 59s ago 13m 441M - 19.1.0-1382-gde09dd01 ea7a5189f30b 7b4027a33daa 2024-08-18T22:48:39.087 INFO:teuthology.orchestra.run.smithi121.stdout:mon.smithi121 smithi121 running (5m) 0s ago 15m 59.8M 2048M 19.1.0-1382-gde09dd01 ea7a5189f30b d71695a4fb56 2024-08-18T22:48:39.087 INFO:teuthology.orchestra.run.smithi121.stdout:mon.smithi195 smithi195 running (4m) 59s ago 13m 40.7M 2048M 19.1.0-1382-gde09dd01 ea7a5189f30b a9bb94ba3b56 2024-08-18T22:48:39.087 INFO:teuthology.orchestra.run.smithi121.stdout:node-exporter.smithi121 smithi121 *:9100 running (6m) 0s ago 14m 14.9M - 1.5.0 0da6a335fe13 bc4b5355a507 2024-08-18T22:48:39.087 INFO:teuthology.orchestra.run.smithi121.stdout:node-exporter.smithi195 smithi195 *:9100 running (6m) 59s ago 13m 17.2M - 1.5.0 0da6a335fe13 146efcb79663 2024-08-18T22:48:39.087 INFO:teuthology.orchestra.run.smithi121.stdout:osd.0 smithi121 running (3m) 0s ago 12m 105M 1557M 19.1.0-1382-gde09dd01 ea7a5189f30b d378dd46eeb6 2024-08-18T22:48:39.088 INFO:teuthology.orchestra.run.smithi121.stdout:osd.1 smithi121 running (3m) 0s ago 12m 124M 1557M 19.1.0-1382-gde09dd01 ea7a5189f30b 0f9e03de5382 2024-08-18T22:48:39.088 INFO:teuthology.orchestra.run.smithi121.stdout:osd.2 smithi121 running (2m) 0s ago 12m 90.5M 1557M 19.1.0-1382-gde09dd01 ea7a5189f30b 93270b5bed68 2024-08-18T22:48:39.088 INFO:teuthology.orchestra.run.smithi121.stdout:osd.3 smithi195 running (2m) 59s ago 11m 120M 2581M 19.1.0-1382-gde09dd01 ea7a5189f30b 72c2860c0e9f 2024-08-18T22:48:39.088 INFO:teuthology.orchestra.run.smithi121.stdout:osd.4 smithi195 running (94s) 59s ago 11m 102M 2581M 19.1.0-1382-gde09dd01 ea7a5189f30b d88a83c97247 2024-08-18T22:48:39.088 INFO:teuthology.orchestra.run.smithi121.stdout:osd.5 smithi195 running (62s) 59s ago 10m 11.3M 2581M 19.1.0-1382-gde09dd01 ea7a5189f30b 5af2d6de9afe 2024-08-18T22:48:39.088 INFO:teuthology.orchestra.run.smithi121.stdout:prometheus.smithi121 smithi121 *:9095 running (5m) 0s ago 14m 61.7M - 2.43.0 a07b618ecd1d 00c4f776d23a 2024-08-18T22:48:39.089 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:39.087+0000 7f2ededfd640 1 -- 172.21.15.121:0/1492691427 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f2ec806e0b0 msgr2=0x7f2ec8070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:48:39.089 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:39.087+0000 7f2ededfd640 1 --2- 172.21.15.121:0/1492691427 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f2ec806e0b0 0x7f2ec8070560 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f2ec4007fd0 tx=0x7f2ec4009e90 comp rx=0 tx=0).stop 2024-08-18T22:48:39.089 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:39.087+0000 7f2ededfd640 1 -- 172.21.15.121:0/1492691427 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2ed80fd910 msgr2=0x7f2ed810ced0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:48:39.089 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:39.087+0000 7f2ededfd640 1 --2- 172.21.15.121:0/1492691427 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2ed80fd910 0x7f2ed810ced0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f2ecc0043d0 tx=0x7f2ecc009da0 comp rx=0 tx=0).stop 2024-08-18T22:48:39.089 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:39.087+0000 7f2ededfd640 1 -- 172.21.15.121:0/1492691427 shutdown_connections 2024-08-18T22:48:39.089 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:39.087+0000 7f2ededfd640 1 --2- 172.21.15.121:0/1492691427 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f2ec806e0b0 0x7f2ec8070560 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:48:39.089 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:39.087+0000 7f2ededfd640 1 --2- 172.21.15.121:0/1492691427 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2ed80fe260 0x7f2ed810d410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:48:39.089 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:39.087+0000 7f2ededfd640 1 --2- 172.21.15.121:0/1492691427 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2ed80fd910 0x7f2ed810ced0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:48:39.089 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:39.087+0000 7f2ededfd640 1 -- 172.21.15.121:0/1492691427 >> 172.21.15.121:0/1492691427 conn(0x7f2ed80f6130 msgr2=0x7f2ed80f78c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:48:39.089 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:39.087+0000 7f2ededfd640 1 -- 172.21.15.121:0/1492691427 shutdown_connections 2024-08-18T22:48:39.089 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:39.087+0000 7f2ededfd640 1 -- 172.21.15.121:0/1492691427 wait complete. 2024-08-18T22:48:39.167 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:39.166+0000 7f766596c640 1 -- 172.21.15.121:0/118342143 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f76600fb060 msgr2=0x7f76601018b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:48:39.168 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:39.166+0000 7f766596c640 1 --2- 172.21.15.121:0/118342143 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f76600fb060 0x7f76601018b0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f76500048d0 tx=0x7f7650009da0 comp rx=0 tx=0).stop 2024-08-18T22:48:39.168 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:39.166+0000 7f766596c640 1 -- 172.21.15.121:0/118342143 shutdown_connections 2024-08-18T22:48:39.168 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:39.166+0000 7f766596c640 1 --2- 172.21.15.121:0/118342143 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f76600fb060 0x7f76601018b0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:48:39.168 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:39.166+0000 7f766596c640 1 --2- 172.21.15.121:0/118342143 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f76600fa710 0x7f76600fab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:48:39.168 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:39.166+0000 7f766596c640 1 -- 172.21.15.121:0/118342143 >> 172.21.15.121:0/118342143 conn(0x7f76600f6130 msgr2=0x7f76600f8540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:48:39.168 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:39.167+0000 7f766596c640 1 -- 172.21.15.121:0/118342143 shutdown_connections 2024-08-18T22:48:39.168 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:39.167+0000 7f766596c640 1 -- 172.21.15.121:0/118342143 wait complete. 2024-08-18T22:48:39.170 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:39.167+0000 7f766596c640 1 Processor -- start 2024-08-18T22:48:39.170 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:39.167+0000 7f766596c640 1 -- start start 2024-08-18T22:48:39.170 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:39.167+0000 7f766596c640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f76600fa710 0x7f766010f050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:48:39.170 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:39.167+0000 7f766596c640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f76600fb060 0x7f766010f590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:48:39.170 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:39.167+0000 7f766596c640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f766010fbe0 con 0x7f76600fa710 2024-08-18T22:48:39.171 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:39.167+0000 7f766596c640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7660110400 con 0x7f76600fb060 2024-08-18T22:48:39.171 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:39.168+0000 7f765effd640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f76600fa710 0x7f766010f050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:48:39.171 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:39.168+0000 7f765effd640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f76600fa710 0x7f766010f050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:39976/0 (socket says 172.21.15.121:39976) 2024-08-18T22:48:39.171 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:39.168+0000 7f765effd640 1 -- 172.21.15.121:0/719751425 learned_addr learned my addr 172.21.15.121:0/719751425 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-18T22:48:39.171 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:39.168+0000 7f765e7fc640 1 --2- 172.21.15.121:0/719751425 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f76600fb060 0x7f766010f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:48:39.171 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:39.168+0000 7f765effd640 1 -- 172.21.15.121:0/719751425 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f76600fb060 msgr2=0x7f766010f590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:48:39.171 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:39.168+0000 7f765effd640 1 --2- 172.21.15.121:0/719751425 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f76600fb060 0x7f766010f590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:48:39.171 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:39.168+0000 7f765effd640 1 -- 172.21.15.121:0/719751425 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7650005040 con 0x7f76600fa710 2024-08-18T22:48:39.171 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:39.168+0000 7f765e7fc640 1 --2- 172.21.15.121:0/719751425 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f76600fb060 0x7f766010f590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:48:39.171 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:39.168+0000 7f765effd640 1 --2- 172.21.15.121:0/719751425 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f76600fa710 0x7f766010f050 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f764800c790 tx=0x7f76480043c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:48:39.171 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:39.168+0000 7f76577fe640 1 -- 172.21.15.121:0/719751425 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f764800a820 con 0x7f76600fa710 2024-08-18T22:48:39.171 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:39.168+0000 7f766596c640 1 -- 172.21.15.121:0/719751425 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7660110690 con 0x7f76600fa710 2024-08-18T22:48:39.171 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:39.168+0000 7f76577fe640 1 -- 172.21.15.121:0/719751425 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f764800ae20 con 0x7f76600fa710 2024-08-18T22:48:39.172 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:39.168+0000 7f76577fe640 1 -- 172.21.15.121:0/719751425 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f76480113a0 con 0x7f76600fa710 2024-08-18T22:48:39.172 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:39.168+0000 7f766596c640 1 -- 172.21.15.121:0/719751425 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7660110c30 con 0x7f76600fa710 2024-08-18T22:48:39.172 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:39.169+0000 7f766596c640 1 -- 172.21.15.121:0/719751425 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76600f9db0 con 0x7f76600fa710 2024-08-18T22:48:39.172 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:39.170+0000 7f76577fe640 1 -- 172.21.15.121:0/719751425 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 37) v1 ==== 92205+0+0 (secure 0 0 0) 0x7f7648012400 con 0x7f76600fa710 2024-08-18T22:48:39.172 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:39.170+0000 7f76577fe640 1 --2- 172.21.15.121:0/719751425 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f764c06e0b0 0x7f764c070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:48:39.173 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:39.171+0000 7f76577fe640 1 -- 172.21.15.121:0/719751425 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f764808dd50 con 0x7f76600fa710 2024-08-18T22:48:39.173 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:39.171+0000 7f765e7fc640 1 --2- 172.21.15.121:0/719751425 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f764c06e0b0 0x7f764c070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:48:39.173 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:39.171+0000 7f765e7fc640 1 --2- 172.21.15.121:0/719751425 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f764c06e0b0 0x7f764c070560 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f765000b020 tx=0x7f7650009da0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:48:39.176 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:39.175+0000 7f76577fe640 1 -- 172.21.15.121:0/719751425 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f7648057100 con 0x7f76600fa710 2024-08-18T22:48:39.429 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:39.427+0000 7f766596c640 1 -- 172.21.15.121:0/719751425 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f7660104e50 con 0x7f76600fa710 2024-08-18T22:48:39.429 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:39.428+0000 7f76577fe640 1 -- 172.21.15.121:0/719751425 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+834 (secure 0 0 0) 0x7f764805a7c0 con 0x7f76600fa710 2024-08-18T22:48:39.429 INFO:teuthology.orchestra.run.smithi121.stdout:{ 2024-08-18T22:48:39.429 INFO:teuthology.orchestra.run.smithi121.stdout: "mon": { 2024-08-18T22:48:39.429 INFO:teuthology.orchestra.run.smithi121.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 2 2024-08-18T22:48:39.429 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-18T22:48:39.429 INFO:teuthology.orchestra.run.smithi121.stdout: "mgr": { 2024-08-18T22:48:39.429 INFO:teuthology.orchestra.run.smithi121.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 2 2024-08-18T22:48:39.429 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-18T22:48:39.430 INFO:teuthology.orchestra.run.smithi121.stdout: "osd": { 2024-08-18T22:48:39.430 INFO:teuthology.orchestra.run.smithi121.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 6 2024-08-18T22:48:39.430 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-18T22:48:39.430 INFO:teuthology.orchestra.run.smithi121.stdout: "mds": { 2024-08-18T22:48:39.430 INFO:teuthology.orchestra.run.smithi121.stdout: "ceph version 17.2.7-1406-gdf62bdcc (df62bdccd9a13bf566b27a250eddfdd89be3072d) quincy (stable)": 3, 2024-08-18T22:48:39.430 INFO:teuthology.orchestra.run.smithi121.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 1 2024-08-18T22:48:39.430 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-18T22:48:39.430 INFO:teuthology.orchestra.run.smithi121.stdout: "overall": { 2024-08-18T22:48:39.430 INFO:teuthology.orchestra.run.smithi121.stdout: "ceph version 17.2.7-1406-gdf62bdcc (df62bdccd9a13bf566b27a250eddfdd89be3072d) quincy (stable)": 3, 2024-08-18T22:48:39.430 INFO:teuthology.orchestra.run.smithi121.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 11 2024-08-18T22:48:39.430 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-08-18T22:48:39.430 INFO:teuthology.orchestra.run.smithi121.stdout:} 2024-08-18T22:48:39.431 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:39.430+0000 7f766596c640 1 -- 172.21.15.121:0/719751425 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f764c06e0b0 msgr2=0x7f764c070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:48:39.431 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:39.430+0000 7f766596c640 1 --2- 172.21.15.121:0/719751425 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f764c06e0b0 0x7f764c070560 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f765000b020 tx=0x7f7650009da0 comp rx=0 tx=0).stop 2024-08-18T22:48:39.431 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:39.430+0000 7f766596c640 1 -- 172.21.15.121:0/719751425 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f76600fa710 msgr2=0x7f766010f050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:48:39.431 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:39.430+0000 7f766596c640 1 --2- 172.21.15.121:0/719751425 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f76600fa710 0x7f766010f050 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f764800c790 tx=0x7f76480043c0 comp rx=0 tx=0).stop 2024-08-18T22:48:39.432 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:39.430+0000 7f766596c640 1 -- 172.21.15.121:0/719751425 shutdown_connections 2024-08-18T22:48:39.432 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:39.430+0000 7f766596c640 1 --2- 172.21.15.121:0/719751425 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f764c06e0b0 0x7f764c070560 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:48:39.432 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:39.430+0000 7f766596c640 1 --2- 172.21.15.121:0/719751425 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f76600fb060 0x7f766010f590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:48:39.432 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:39.430+0000 7f766596c640 1 --2- 172.21.15.121:0/719751425 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f76600fa710 0x7f766010f050 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:48:39.432 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:39.430+0000 7f766596c640 1 -- 172.21.15.121:0/719751425 >> 172.21.15.121:0/719751425 conn(0x7f76600f6130 msgr2=0x7f76601060d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:48:39.432 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:39.430+0000 7f766596c640 1 -- 172.21.15.121:0/719751425 shutdown_connections 2024-08-18T22:48:39.432 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:39.430+0000 7f766596c640 1 -- 172.21.15.121:0/719751425 wait complete. 2024-08-18T22:48:39.512 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:39.509+0000 7f070c885640 1 -- 172.21.15.121:0/2188156702 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f07080fb210 msgr2=0x7f07080fb620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:48:39.512 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:39.509+0000 7f070c885640 1 --2- 172.21.15.121:0/2188156702 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f07080fb210 0x7f07080fb620 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f07000048d0 tx=0x7f0700009da0 comp rx=0 tx=0).stop 2024-08-18T22:48:39.512 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:39.510+0000 7f070c885640 1 -- 172.21.15.121:0/2188156702 shutdown_connections 2024-08-18T22:48:39.513 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:39.510+0000 7f070c885640 1 --2- 172.21.15.121:0/2188156702 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f07080fc4e0 0x7f07080fc950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:48:39.513 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:39.510+0000 7f070c885640 1 --2- 172.21.15.121:0/2188156702 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f07080fb210 0x7f07080fb620 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:48:39.513 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:39.510+0000 7f070c885640 1 -- 172.21.15.121:0/2188156702 >> 172.21.15.121:0/2188156702 conn(0x7f07080f69d0 msgr2=0x7f07080f8e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:48:39.513 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:39.510+0000 7f070c885640 1 -- 172.21.15.121:0/2188156702 shutdown_connections 2024-08-18T22:48:39.513 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:39.510+0000 7f070c885640 1 -- 172.21.15.121:0/2188156702 wait complete. 2024-08-18T22:48:39.513 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:39.510+0000 7f070c885640 1 Processor -- start 2024-08-18T22:48:39.513 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:39.510+0000 7f070c885640 1 -- start start 2024-08-18T22:48:39.513 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:39.510+0000 7f070c885640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f07080fb210 0x7f070810fb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:48:39.513 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:39.510+0000 7f070c885640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f07080fc4e0 0x7f07081120d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:48:39.513 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:39.510+0000 7f070c885640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0708066510 con 0x7f07080fc4e0 2024-08-18T22:48:39.513 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:39.510+0000 7f070c885640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0708066680 con 0x7f07080fb210 2024-08-18T22:48:39.513 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:39.510+0000 7f0705d9b640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f07080fc4e0 0x7f07081120d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:48:39.513 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:39.511+0000 7f0705d9b640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f07080fc4e0 0x7f07081120d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:40000/0 (socket says 172.21.15.121:40000) 2024-08-18T22:48:39.514 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:39.511+0000 7f0705d9b640 1 -- 172.21.15.121:0/680152446 learned_addr learned my addr 172.21.15.121:0/680152446 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-18T22:48:39.514 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:39.511+0000 7f070659c640 1 --2- 172.21.15.121:0/680152446 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f07080fb210 0x7f070810fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:48:39.514 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:39.511+0000 7f0705d9b640 1 -- 172.21.15.121:0/680152446 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f07080fb210 msgr2=0x7f070810fb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:48:39.514 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:39.511+0000 7f0705d9b640 1 --2- 172.21.15.121:0/680152446 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f07080fb210 0x7f070810fb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:48:39.514 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:39.511+0000 7f0705d9b640 1 -- 172.21.15.121:0/680152446 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0700005040 con 0x7f07080fc4e0 2024-08-18T22:48:39.514 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:39.511+0000 7f0705d9b640 1 --2- 172.21.15.121:0/680152446 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f07080fc4e0 0x7f07081120d0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f06f0002a50 tx=0x7f06f0004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:48:39.514 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:39.511+0000 7f06feffd640 1 -- 172.21.15.121:0/680152446 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f06f0007c30 con 0x7f07080fc4e0 2024-08-18T22:48:39.514 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:39.511+0000 7f06feffd640 1 -- 172.21.15.121:0/680152446 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f06f000f040 con 0x7f07080fc4e0 2024-08-18T22:48:39.514 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:39.511+0000 7f070c885640 1 -- 172.21.15.121:0/680152446 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0708112670 con 0x7f07080fc4e0 2024-08-18T22:48:39.514 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:39.511+0000 7f06feffd640 1 -- 172.21.15.121:0/680152446 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f06f000da90 con 0x7f07080fc4e0 2024-08-18T22:48:39.514 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:39.511+0000 7f070c885640 1 -- 172.21.15.121:0/680152446 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0708112c10 con 0x7f07080fc4e0 2024-08-18T22:48:39.515 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:39.512+0000 7f070c885640 1 -- 172.21.15.121:0/680152446 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07080fa670 con 0x7f07080fc4e0 2024-08-18T22:48:39.515 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:39.513+0000 7f06feffd640 1 -- 172.21.15.121:0/680152446 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 37) v1 ==== 92205+0+0 (secure 0 0 0) 0x7f06f000dcd0 con 0x7f07080fc4e0 2024-08-18T22:48:39.515 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:39.513+0000 7f06feffd640 1 --2- 172.21.15.121:0/680152446 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f06f406e0b0 0x7f06f4070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:48:39.515 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:39.513+0000 7f06feffd640 1 -- 172.21.15.121:0/680152446 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f06f008d3b0 con 0x7f07080fc4e0 2024-08-18T22:48:39.515 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:39.513+0000 7f070659c640 1 --2- 172.21.15.121:0/680152446 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f06f406e0b0 0x7f06f4070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:48:39.516 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:39.514+0000 7f070659c640 1 --2- 172.21.15.121:0/680152446 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f06f406e0b0 0x7f06f4070560 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f0700007ac0 tx=0x7f0700035040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:48:39.518 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:39.517+0000 7f06feffd640 1 -- 172.21.15.121:0/680152446 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f06f0056760 con 0x7f07080fc4e0 2024-08-18T22:48:39.606 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:48:39 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:48:39.606 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:48:39 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:48:39.606 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:48:39 smithi121 ceph-mon[81053]: from='client.34408 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-18T22:48:39.606 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:48:39 smithi121 ceph-mon[81053]: pgmap v184: 65 pgs: 65 active+clean; 1.9 GiB data, 5.8 GiB used, 531 GiB / 536 GiB avail 2024-08-18T22:48:39.606 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:48:39 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-18T22:48:39.606 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:48:39 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:48:39.606 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:48:39 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:48:39.659 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:48:39 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:48:39.659 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:48:39 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:48:39.659 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:48:39 smithi195 ceph-mon[68841]: from='client.34408 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-18T22:48:39.659 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:48:39 smithi195 ceph-mon[68841]: pgmap v184: 65 pgs: 65 active+clean; 1.9 GiB data, 5.8 GiB used, 531 GiB / 536 GiB avail 2024-08-18T22:48:39.659 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:48:39 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-18T22:48:39.659 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:48:39 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:48:39.659 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:48:39 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:48:39.727 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:39.725+0000 7f070c885640 1 -- 172.21.15.121:0/680152446 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f0708112f80 con 0x7f07080fc4e0 2024-08-18T22:48:39.727 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:39.726+0000 7f06feffd640 1 -- 172.21.15.121:0/680152446 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 29 v29) v1 ==== 76+0+1932 (secure 0 0 0) 0x7f06f0059e20 con 0x7f07080fc4e0 2024-08-18T22:48:39.727 INFO:teuthology.orchestra.run.smithi121.stdout:e29 2024-08-18T22:48:39.727 INFO:teuthology.orchestra.run.smithi121.stdout:btime 2024-08-18T22:48:33:668477+0000 2024-08-18T22:48:39.727 INFO:teuthology.orchestra.run.smithi121.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-08-18T22:48:39.727 INFO:teuthology.orchestra.run.smithi121.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-08-18T22:48:39.728 INFO:teuthology.orchestra.run.smithi121.stdout:legacy client fscid: 1 2024-08-18T22:48:39.728 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-08-18T22:48:39.728 INFO:teuthology.orchestra.run.smithi121.stdout:Filesystem 'cephfs' (1) 2024-08-18T22:48:39.728 INFO:teuthology.orchestra.run.smithi121.stdout:fs_name cephfs 2024-08-18T22:48:39.728 INFO:teuthology.orchestra.run.smithi121.stdout:epoch 26 2024-08-18T22:48:39.728 INFO:teuthology.orchestra.run.smithi121.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-08-18T22:48:39.728 INFO:teuthology.orchestra.run.smithi121.stdout:created 2024-08-18T22:39:04.054074+0000 2024-08-18T22:48:39.728 INFO:teuthology.orchestra.run.smithi121.stdout:modified 2024-08-18T22:48:16.251573+0000 2024-08-18T22:48:39.728 INFO:teuthology.orchestra.run.smithi121.stdout:tableserver 0 2024-08-18T22:48:39.728 INFO:teuthology.orchestra.run.smithi121.stdout:root 0 2024-08-18T22:48:39.728 INFO:teuthology.orchestra.run.smithi121.stdout:session_timeout 60 2024-08-18T22:48:39.728 INFO:teuthology.orchestra.run.smithi121.stdout:session_autoclose 300 2024-08-18T22:48:39.728 INFO:teuthology.orchestra.run.smithi121.stdout:max_file_size 1099511627776 2024-08-18T22:48:39.729 INFO:teuthology.orchestra.run.smithi121.stdout:max_xattr_size 65536 2024-08-18T22:48:39.729 INFO:teuthology.orchestra.run.smithi121.stdout:required_client_features {} 2024-08-18T22:48:39.729 INFO:teuthology.orchestra.run.smithi121.stdout:last_failure 0 2024-08-18T22:48:39.729 INFO:teuthology.orchestra.run.smithi121.stdout:last_failure_osd_epoch 47 2024-08-18T22:48:39.729 INFO:teuthology.orchestra.run.smithi121.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-08-18T22:48:39.729 INFO:teuthology.orchestra.run.smithi121.stdout:max_mds 1 2024-08-18T22:48:39.729 INFO:teuthology.orchestra.run.smithi121.stdout:in 0 2024-08-18T22:48:39.729 INFO:teuthology.orchestra.run.smithi121.stdout:up {0=14474} 2024-08-18T22:48:39.729 INFO:teuthology.orchestra.run.smithi121.stdout:failed 2024-08-18T22:48:39.729 INFO:teuthology.orchestra.run.smithi121.stdout:damaged 2024-08-18T22:48:39.729 INFO:teuthology.orchestra.run.smithi121.stdout:stopped 1 2024-08-18T22:48:39.729 INFO:teuthology.orchestra.run.smithi121.stdout:data_pools [3] 2024-08-18T22:48:39.729 INFO:teuthology.orchestra.run.smithi121.stdout:metadata_pool 2 2024-08-18T22:48:39.730 INFO:teuthology.orchestra.run.smithi121.stdout:inline_data disabled 2024-08-18T22:48:39.730 INFO:teuthology.orchestra.run.smithi121.stdout:balancer 2024-08-18T22:48:39.730 INFO:teuthology.orchestra.run.smithi121.stdout:bal_rank_mask -1 2024-08-18T22:48:39.730 INFO:teuthology.orchestra.run.smithi121.stdout:standby_count_wanted 1 2024-08-18T22:48:39.730 INFO:teuthology.orchestra.run.smithi121.stdout:qdb_cluster leader: 14474 members: 14474 2024-08-18T22:48:39.730 INFO:teuthology.orchestra.run.smithi121.stdout:[mds.cephfs.smithi121.gbickb{0:14474} state up:active seq 83 join_fscid=1 addr [v2:172.21.15.121:6828/2277706406,v1:172.21.15.121:6829/2277706406] compat {c=[1],r=[1],i=[7ff]}] 2024-08-18T22:48:39.730 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-08-18T22:48:39.730 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-08-18T22:48:39.730 INFO:teuthology.orchestra.run.smithi121.stdout:Standby daemons: 2024-08-18T22:48:39.730 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-08-18T22:48:39.730 INFO:teuthology.orchestra.run.smithi121.stdout:[mds.cephfs.smithi195.nptgyc{-1:24259} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.195:6826/238549847,v1:172.21.15.195:6827/238549847] compat {c=[1],r=[1],i=[7ff]}] 2024-08-18T22:48:39.730 INFO:teuthology.orchestra.run.smithi121.stdout:[mds.cephfs.smithi121.xuzsdg{-1:34404} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.121:6826/4267588865,v1:172.21.15.121:6827/4267588865] compat {c=[1],r=[1],i=[1fff]}] 2024-08-18T22:48:39.730 INFO:teuthology.orchestra.run.smithi121.stdout:[mds.cephfs.smithi195.buqvbr{-1:44267} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.195:6824/110644516,v1:172.21.15.195:6825/110644516] compat {c=[1],r=[1],i=[7ff]}] 2024-08-18T22:48:39.731 INFO:teuthology.orchestra.run.smithi121.stderr:dumped fsmap epoch 29 2024-08-18T22:48:39.731 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:39.728+0000 7f070c885640 1 -- 172.21.15.121:0/680152446 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f06f406e0b0 msgr2=0x7f06f4070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:48:39.731 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:39.728+0000 7f070c885640 1 --2- 172.21.15.121:0/680152446 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f06f406e0b0 0x7f06f4070560 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f0700007ac0 tx=0x7f0700035040 comp rx=0 tx=0).stop 2024-08-18T22:48:39.732 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:39.728+0000 7f070c885640 1 -- 172.21.15.121:0/680152446 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f07080fc4e0 msgr2=0x7f07081120d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:48:39.732 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:39.728+0000 7f070c885640 1 --2- 172.21.15.121:0/680152446 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f07080fc4e0 0x7f07081120d0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f06f0002a50 tx=0x7f06f0004600 comp rx=0 tx=0).stop 2024-08-18T22:48:39.732 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:39.728+0000 7f070c885640 1 -- 172.21.15.121:0/680152446 shutdown_connections 2024-08-18T22:48:39.732 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:39.728+0000 7f070c885640 1 --2- 172.21.15.121:0/680152446 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f06f406e0b0 0x7f06f4070560 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:48:39.732 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:39.728+0000 7f070c885640 1 --2- 172.21.15.121:0/680152446 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f07080fc4e0 0x7f07081120d0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:48:39.732 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:39.728+0000 7f070c885640 1 --2- 172.21.15.121:0/680152446 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f07080fb210 0x7f070810fb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:48:39.732 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:39.728+0000 7f070c885640 1 -- 172.21.15.121:0/680152446 >> 172.21.15.121:0/680152446 conn(0x7f07080f69d0 msgr2=0x7f07080f81a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:48:39.732 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:39.728+0000 7f070c885640 1 -- 172.21.15.121:0/680152446 shutdown_connections 2024-08-18T22:48:39.732 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:39.728+0000 7f070c885640 1 -- 172.21.15.121:0/680152446 wait complete. 2024-08-18T22:48:39.810 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:39.808+0000 7f9391b7e640 1 -- 172.21.15.121:0/1774883383 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f938c0fbc50 msgr2=0x7f938c0fc0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:48:39.811 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:39.808+0000 7f9391b7e640 1 --2- 172.21.15.121:0/1774883383 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f938c0fbc50 0x7f938c0fc0c0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f93800048d0 tx=0x7f9380009da0 comp rx=0 tx=0).stop 2024-08-18T22:48:39.811 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:39.808+0000 7f9391b7e640 1 -- 172.21.15.121:0/1774883383 shutdown_connections 2024-08-18T22:48:39.811 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:39.808+0000 7f9391b7e640 1 --2- 172.21.15.121:0/1774883383 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f938c0fbc50 0x7f938c0fc0c0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:48:39.811 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:39.808+0000 7f9391b7e640 1 --2- 172.21.15.121:0/1774883383 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f938c0fa980 0x7f938c0fad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:48:39.811 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:39.808+0000 7f9391b7e640 1 -- 172.21.15.121:0/1774883383 >> 172.21.15.121:0/1774883383 conn(0x7f938c0f6140 msgr2=0x7f938c0f8570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:48:39.811 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:39.808+0000 7f9391b7e640 1 -- 172.21.15.121:0/1774883383 shutdown_connections 2024-08-18T22:48:39.811 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:39.808+0000 7f9391b7e640 1 -- 172.21.15.121:0/1774883383 wait complete. 2024-08-18T22:48:39.811 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:39.808+0000 7f9391b7e640 1 Processor -- start 2024-08-18T22:48:39.811 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:39.808+0000 7f9391b7e640 1 -- start start 2024-08-18T22:48:39.811 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:39.809+0000 7f9391b7e640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f938c0fa980 0x7f938c10fb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:48:39.811 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:39.809+0000 7f9391b7e640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f938c0fbc50 0x7f938c112080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:48:39.811 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:39.809+0000 7f9391b7e640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f938c0fdb50 con 0x7f938c0fbc50 2024-08-18T22:48:39.811 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:39.809+0000 7f9391b7e640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f938c0fdcc0 con 0x7f938c0fa980 2024-08-18T22:48:39.812 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:39.809+0000 7f938affd640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f938c0fbc50 0x7f938c112080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:48:39.812 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:39.809+0000 7f938affd640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f938c0fbc50 0x7f938c112080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:40010/0 (socket says 172.21.15.121:40010) 2024-08-18T22:48:39.812 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:39.809+0000 7f938affd640 1 -- 172.21.15.121:0/777394887 learned_addr learned my addr 172.21.15.121:0/777394887 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-18T22:48:39.812 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:39.809+0000 7f938b7fe640 1 --2- 172.21.15.121:0/777394887 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f938c0fa980 0x7f938c10fb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:48:39.812 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:39.809+0000 7f938affd640 1 -- 172.21.15.121:0/777394887 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f938c0fa980 msgr2=0x7f938c10fb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:48:39.812 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:39.809+0000 7f938affd640 1 --2- 172.21.15.121:0/777394887 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f938c0fa980 0x7f938c10fb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:48:39.812 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:39.809+0000 7f938affd640 1 -- 172.21.15.121:0/777394887 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9380005040 con 0x7f938c0fbc50 2024-08-18T22:48:39.812 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:39.809+0000 7f938affd640 1 --2- 172.21.15.121:0/777394887 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f938c0fbc50 0x7f938c112080 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f93800043d0 tx=0x7f9380009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:48:39.812 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:39.809+0000 7f9373fff640 1 -- 172.21.15.121:0/777394887 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9380038070 con 0x7f938c0fbc50 2024-08-18T22:48:39.812 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:39.809+0000 7f9373fff640 1 -- 172.21.15.121:0/777394887 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f938002ae90 con 0x7f938c0fbc50 2024-08-18T22:48:39.812 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:39.809+0000 7f9391b7e640 1 -- 172.21.15.121:0/777394887 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f938c1125c0 con 0x7f938c0fbc50 2024-08-18T22:48:39.812 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:39.809+0000 7f9373fff640 1 -- 172.21.15.121:0/777394887 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f938003e670 con 0x7f938c0fbc50 2024-08-18T22:48:39.812 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:39.809+0000 7f9391b7e640 1 -- 172.21.15.121:0/777394887 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f938c112b30 con 0x7f938c0fbc50 2024-08-18T22:48:39.813 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:39.810+0000 7f9391b7e640 1 -- 172.21.15.121:0/777394887 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f938c0f9de0 con 0x7f938c0fbc50 2024-08-18T22:48:39.813 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:39.811+0000 7f9373fff640 1 -- 172.21.15.121:0/777394887 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 37) v1 ==== 92205+0+0 (secure 0 0 0) 0x7f9380030020 con 0x7f938c0fbc50 2024-08-18T22:48:39.813 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:39.811+0000 7f9373fff640 1 --2- 172.21.15.121:0/777394887 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f937406e0b0 0x7f9374070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:48:39.814 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:39.811+0000 7f9373fff640 1 -- 172.21.15.121:0/777394887 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f93800add20 con 0x7f938c0fbc50 2024-08-18T22:48:39.814 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:39.811+0000 7f938b7fe640 1 --2- 172.21.15.121:0/777394887 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f937406e0b0 0x7f9374070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:48:39.814 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:39.812+0000 7f938b7fe640 1 --2- 172.21.15.121:0/777394887 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f937406e0b0 0x7f9374070560 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f937c009fd0 tx=0x7f937c009e90 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:48:39.816 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:39.816+0000 7f9373fff640 1 -- 172.21.15.121:0/777394887 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f93800770d0 con 0x7f938c0fbc50 2024-08-18T22:48:40.001 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:39.999+0000 7f9391b7e640 1 -- 172.21.15.121:0/777394887 --> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f938c1006a0 con 0x7f937406e0b0 2024-08-18T22:48:40.002 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:40.001+0000 7f9373fff640 1 -- 172.21.15.121:0/777394887 <== mgr.34102 v2:172.21.15.121:6800/3037387239 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f938c1006a0 con 0x7f937406e0b0 2024-08-18T22:48:40.002 INFO:teuthology.orchestra.run.smithi121.stdout:{ 2024-08-18T22:48:40.002 INFO:teuthology.orchestra.run.smithi121.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9", 2024-08-18T22:48:40.002 INFO:teuthology.orchestra.run.smithi121.stdout: "in_progress": true, 2024-08-18T22:48:40.002 INFO:teuthology.orchestra.run.smithi121.stdout: "which": "Upgrading all daemon types on all hosts", 2024-08-18T22:48:40.002 INFO:teuthology.orchestra.run.smithi121.stdout: "services_complete": [ 2024-08-18T22:48:40.002 INFO:teuthology.orchestra.run.smithi121.stdout: "mgr", 2024-08-18T22:48:40.003 INFO:teuthology.orchestra.run.smithi121.stdout: "mon", 2024-08-18T22:48:40.003 INFO:teuthology.orchestra.run.smithi121.stdout: "crash", 2024-08-18T22:48:40.003 INFO:teuthology.orchestra.run.smithi121.stdout: "osd" 2024-08-18T22:48:40.003 INFO:teuthology.orchestra.run.smithi121.stdout: ], 2024-08-18T22:48:40.003 INFO:teuthology.orchestra.run.smithi121.stdout: "progress": "13/21 daemons upgraded", 2024-08-18T22:48:40.003 INFO:teuthology.orchestra.run.smithi121.stdout: "message": "Currently upgrading mds daemons", 2024-08-18T22:48:40.003 INFO:teuthology.orchestra.run.smithi121.stdout: "is_paused": false 2024-08-18T22:48:40.003 INFO:teuthology.orchestra.run.smithi121.stdout:} 2024-08-18T22:48:40.004 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:40.003+0000 7f9391b7e640 1 -- 172.21.15.121:0/777394887 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f937406e0b0 msgr2=0x7f9374070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:48:40.005 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:40.003+0000 7f9391b7e640 1 --2- 172.21.15.121:0/777394887 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f937406e0b0 0x7f9374070560 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f937c009fd0 tx=0x7f937c009e90 comp rx=0 tx=0).stop 2024-08-18T22:48:40.005 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:40.003+0000 7f9391b7e640 1 -- 172.21.15.121:0/777394887 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f938c0fbc50 msgr2=0x7f938c112080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:48:40.005 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:40.003+0000 7f9391b7e640 1 --2- 172.21.15.121:0/777394887 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f938c0fbc50 0x7f938c112080 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f93800043d0 tx=0x7f9380009da0 comp rx=0 tx=0).stop 2024-08-18T22:48:40.005 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:40.003+0000 7f9391b7e640 1 -- 172.21.15.121:0/777394887 shutdown_connections 2024-08-18T22:48:40.005 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:40.003+0000 7f9391b7e640 1 --2- 172.21.15.121:0/777394887 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f937406e0b0 0x7f9374070560 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:48:40.005 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:40.003+0000 7f9391b7e640 1 --2- 172.21.15.121:0/777394887 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f938c0fbc50 0x7f938c112080 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:48:40.005 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:40.003+0000 7f9391b7e640 1 --2- 172.21.15.121:0/777394887 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f938c0fa980 0x7f938c10fb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:48:40.005 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:40.003+0000 7f9391b7e640 1 -- 172.21.15.121:0/777394887 >> 172.21.15.121:0/777394887 conn(0x7f938c0f6140 msgr2=0x7f938c0fff90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:48:40.005 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:40.004+0000 7f9391b7e640 1 -- 172.21.15.121:0/777394887 shutdown_connections 2024-08-18T22:48:40.005 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:40.004+0000 7f9391b7e640 1 -- 172.21.15.121:0/777394887 wait complete. 2024-08-18T22:48:40.084 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:40.082+0000 7fefa0f53640 1 -- 172.21.15.121:0/4274168640 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fef9c0fc2c0 msgr2=0x7fef9c0fc6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:48:40.084 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:40.082+0000 7fefa0f53640 1 --2- 172.21.15.121:0/4274168640 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fef9c0fc2c0 0x7fef9c0fc6d0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fef8c0048d0 tx=0x7fef8c009da0 comp rx=0 tx=0).stop 2024-08-18T22:48:40.084 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:40.082+0000 7fefa0f53640 1 -- 172.21.15.121:0/4274168640 shutdown_connections 2024-08-18T22:48:40.084 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:40.082+0000 7fefa0f53640 1 --2- 172.21.15.121:0/4274168640 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fef9c0fd590 0x7fef9c0fda00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:48:40.084 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:40.082+0000 7fefa0f53640 1 --2- 172.21.15.121:0/4274168640 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fef9c0fc2c0 0x7fef9c0fc6d0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:48:40.084 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:40.082+0000 7fefa0f53640 1 -- 172.21.15.121:0/4274168640 >> 172.21.15.121:0/4274168640 conn(0x7fef9c0f7a80 msgr2=0x7fef9c0f9eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:48:40.084 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:40.082+0000 7fefa0f53640 1 -- 172.21.15.121:0/4274168640 shutdown_connections 2024-08-18T22:48:40.084 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:40.082+0000 7fefa0f53640 1 -- 172.21.15.121:0/4274168640 wait complete. 2024-08-18T22:48:40.085 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:40.083+0000 7fefa0f53640 1 Processor -- start 2024-08-18T22:48:40.085 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:40.083+0000 7fefa0f53640 1 -- start start 2024-08-18T22:48:40.086 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:40.083+0000 7fefa0f53640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fef9c0fc2c0 0x7fef9c10ce60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:48:40.086 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:40.083+0000 7fefa0f53640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fef9c0fd590 0x7fef9c10d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:48:40.086 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:40.083+0000 7fefa0f53640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef9c10d9f0 con 0x7fef9c0fc2c0 2024-08-18T22:48:40.086 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:40.083+0000 7fefa0f53640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef9c10e130 con 0x7fef9c0fd590 2024-08-18T22:48:40.086 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:40.084+0000 7fef9a59c640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fef9c0fc2c0 0x7fef9c10ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:48:40.086 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:40.084+0000 7fef9a59c640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fef9c0fc2c0 0x7fef9c10ce60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:40042/0 (socket says 172.21.15.121:40042) 2024-08-18T22:48:40.086 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:40.084+0000 7fef9a59c640 1 -- 172.21.15.121:0/2238220507 learned_addr learned my addr 172.21.15.121:0/2238220507 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-18T22:48:40.086 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:40.084+0000 7fef93fff640 1 --2- 172.21.15.121:0/2238220507 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fef9c0fd590 0x7fef9c10d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:48:40.086 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:40.084+0000 7fef9a59c640 1 -- 172.21.15.121:0/2238220507 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fef9c0fd590 msgr2=0x7fef9c10d3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:48:40.087 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:40.084+0000 7fef9a59c640 1 --2- 172.21.15.121:0/2238220507 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fef9c0fd590 0x7fef9c10d3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:48:40.087 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:40.084+0000 7fef9a59c640 1 -- 172.21.15.121:0/2238220507 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef8c005040 con 0x7fef9c0fc2c0 2024-08-18T22:48:40.087 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:40.084+0000 7fef9a59c640 1 --2- 172.21.15.121:0/2238220507 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fef9c0fc2c0 0x7fef9c10ce60 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fef8c0043d0 tx=0x7fef8c009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:48:40.087 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:40.084+0000 7fef92ffd640 1 -- 172.21.15.121:0/2238220507 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fef8c038070 con 0x7fef9c0fc2c0 2024-08-18T22:48:40.087 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:40.084+0000 7fefa0f53640 1 -- 172.21.15.121:0/2238220507 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef9c10e360 con 0x7fef9c0fc2c0 2024-08-18T22:48:40.087 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:40.084+0000 7fef92ffd640 1 -- 172.21.15.121:0/2238220507 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fef8c02ae90 con 0x7fef9c0fc2c0 2024-08-18T22:48:40.087 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:40.085+0000 7fefa0f53640 1 -- 172.21.15.121:0/2238220507 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef9c10e900 con 0x7fef9c0fc2c0 2024-08-18T22:48:40.087 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:40.085+0000 7fef92ffd640 1 -- 172.21.15.121:0/2238220507 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fef8c03e670 con 0x7fef9c0fc2c0 2024-08-18T22:48:40.088 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:40.086+0000 7fefa0f53640 1 -- 172.21.15.121:0/2238220507 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef7c005240 con 0x7fef9c0fc2c0 2024-08-18T22:48:40.088 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:40.087+0000 7fef92ffd640 1 -- 172.21.15.121:0/2238220507 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 37) v1 ==== 92205+0+0 (secure 0 0 0) 0x7fef8c030020 con 0x7fef9c0fc2c0 2024-08-18T22:48:40.088 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:40.087+0000 7fef92ffd640 1 --2- 172.21.15.121:0/2238220507 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7fef8806e100 0x7fef880705b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:48:40.088 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:40.087+0000 7fef92ffd640 1 -- 172.21.15.121:0/2238220507 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6496+0+0 (secure 0 0 0) 0x7fef8c0add30 con 0x7fef9c0fc2c0 2024-08-18T22:48:40.088 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:40.088+0000 7fef93fff640 1 --2- 172.21.15.121:0/2238220507 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7fef8806e100 0x7fef880705b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:48:40.089 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:40.088+0000 7fef93fff640 1 --2- 172.21.15.121:0/2238220507 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7fef8806e100 0x7fef880705b0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fef84004ed0 tx=0x7fef8400b040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:48:40.092 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:40.092+0000 7fef92ffd640 1 -- 172.21.15.121:0/2238220507 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7fef8c077100 con 0x7fef9c0fc2c0 2024-08-18T22:48:40.328 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:40.327+0000 7fefa0f53640 1 -- 172.21.15.121:0/2238220507 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fef7c0054f0 con 0x7fef9c0fc2c0 2024-08-18T22:48:40.328 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:40.327+0000 7fef92ffd640 1 -- 172.21.15.121:0/2238220507 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+171 (secure 0 0 0) 0x7fef8c07a7c0 con 0x7fef9c0fc2c0 2024-08-18T22:48:40.328 INFO:teuthology.orchestra.run.smithi121.stdout:HEALTH_WARN 1 MDSs report slow requests 2024-08-18T22:48:40.329 INFO:teuthology.orchestra.run.smithi121.stdout:[WRN] MDS_SLOW_REQUEST: 1 MDSs report slow requests 2024-08-18T22:48:40.329 INFO:teuthology.orchestra.run.smithi121.stdout: mds.cephfs.smithi121.gbickb(mds.0): 3 slow requests are blocked > 180 secs 2024-08-18T22:48:40.331 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:40.330+0000 7fefa0f53640 1 -- 172.21.15.121:0/2238220507 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7fef8806e100 msgr2=0x7fef880705b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:48:40.331 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:40.330+0000 7fefa0f53640 1 --2- 172.21.15.121:0/2238220507 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7fef8806e100 0x7fef880705b0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fef84004ed0 tx=0x7fef8400b040 comp rx=0 tx=0).stop 2024-08-18T22:48:40.331 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:40.330+0000 7fefa0f53640 1 -- 172.21.15.121:0/2238220507 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fef9c0fc2c0 msgr2=0x7fef9c10ce60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:48:40.331 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:40.330+0000 7fefa0f53640 1 --2- 172.21.15.121:0/2238220507 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fef9c0fc2c0 0x7fef9c10ce60 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fef8c0043d0 tx=0x7fef8c009da0 comp rx=0 tx=0).stop 2024-08-18T22:48:40.331 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:40.330+0000 7fefa0f53640 1 -- 172.21.15.121:0/2238220507 shutdown_connections 2024-08-18T22:48:40.331 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:40.330+0000 7fefa0f53640 1 --2- 172.21.15.121:0/2238220507 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7fef8806e100 0x7fef880705b0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:48:40.331 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:40.330+0000 7fefa0f53640 1 --2- 172.21.15.121:0/2238220507 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fef9c0fd590 0x7fef9c10d3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:48:40.331 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:40.330+0000 7fefa0f53640 1 --2- 172.21.15.121:0/2238220507 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fef9c0fc2c0 0x7fef9c10ce60 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:48:40.331 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:40.330+0000 7fefa0f53640 1 -- 172.21.15.121:0/2238220507 >> 172.21.15.121:0/2238220507 conn(0x7fef9c0f7a80 msgr2=0x7fef9c0f9230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:48:40.331 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:40.330+0000 7fefa0f53640 1 -- 172.21.15.121:0/2238220507 shutdown_connections 2024-08-18T22:48:40.331 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:48:40.330+0000 7fefa0f53640 1 -- 172.21.15.121:0/2238220507 wait complete. 2024-08-18T22:48:40.583 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:48:40 smithi121 ceph-mon[81053]: from='client.34412 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-18T22:48:40.583 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:48:40 smithi121 ceph-mon[81053]: from='client.34416 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-18T22:48:40.584 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:48:40 smithi121 ceph-mon[81053]: from='client.? 172.21.15.121:0/719751425' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-08-18T22:48:40.584 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:48:40 smithi121 ceph-mon[81053]: from='client.? 172.21.15.121:0/680152446' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-08-18T22:48:40.584 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:48:40 smithi121 ceph-mon[81053]: from='client.? 172.21.15.121:0/2238220507' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-08-18T22:48:40.659 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:48:40 smithi195 ceph-mon[68841]: from='client.34412 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-18T22:48:40.659 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:48:40 smithi195 ceph-mon[68841]: from='client.34416 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-18T22:48:40.659 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:48:40 smithi195 ceph-mon[68841]: from='client.? 172.21.15.121:0/719751425' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-08-18T22:48:40.659 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:48:40 smithi195 ceph-mon[68841]: from='client.? 172.21.15.121:0/680152446' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-08-18T22:48:40.659 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:48:40 smithi195 ceph-mon[68841]: from='client.? 172.21.15.121:0/2238220507' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-08-18T22:48:41.659 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:48:41 smithi195 ceph-mon[68841]: from='client.34428 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-18T22:48:41.659 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:48:41 smithi195 ceph-mon[68841]: 3 slow requests, 0 included below; oldest blocked for > 431.872100 secs 2024-08-18T22:48:41.659 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:48:41 smithi195 ceph-mon[68841]: pgmap v185: 65 pgs: 65 active+clean; 1.9 GiB data, 5.8 GiB used, 531 GiB / 536 GiB avail 2024-08-18T22:48:41.834 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:48:41 smithi121 ceph-mon[81053]: from='client.34428 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-18T22:48:41.834 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:48:41 smithi121 ceph-mon[81053]: 3 slow requests, 0 included below; oldest blocked for > 431.872100 secs 2024-08-18T22:48:41.834 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:48:41 smithi121 ceph-mon[81053]: pgmap v185: 65 pgs: 65 active+clean; 1.9 GiB data, 5.8 GiB used, 531 GiB / 536 GiB avail 2024-08-18T22:48:43.509 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:48:43 smithi121 ceph-mon[81053]: Detected new or changed devices on smithi121 2024-08-18T22:48:43.509 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:48:43 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:48:43.509 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:48:43 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:48:43.509 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:48:43 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:48:43.509 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:48:43 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-18T22:48:43.509 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:48:43 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:48:43.509 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:48:43 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-18T22:48:43.509 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:48:43 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "versions"}]: dispatch 2024-08-18T22:48:43.509 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:48:43 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "versions"}]: dispatch 2024-08-18T22:48:43.510 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:48:43 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "versions"}]: dispatch 2024-08-18T22:48:43.510 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:48:43 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "versions"}]: dispatch 2024-08-18T22:48:43.510 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:48:43 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi121.gbickb"]}]: dispatch 2024-08-18T22:48:43.510 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:48:43 smithi121 ceph-mon[81053]: Upgrade: It appears safe to stop mds.cephfs.smithi121.gbickb 2024-08-18T22:48:43.510 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:48:43 smithi121 ceph-mon[81053]: pgmap v186: 65 pgs: 65 active+clean; 1.9 GiB data, 5.8 GiB used, 531 GiB / 536 GiB avail 2024-08-18T22:48:43.659 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:48:43 smithi195 ceph-mon[68841]: Detected new or changed devices on smithi121 2024-08-18T22:48:43.659 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:48:43 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:48:43.659 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:48:43 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:48:43.659 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:48:43 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:48:43.659 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:48:43 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-18T22:48:43.659 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:48:43 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:48:43.659 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:48:43 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-18T22:48:43.659 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:48:43 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "versions"}]: dispatch 2024-08-18T22:48:43.659 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:48:43 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "versions"}]: dispatch 2024-08-18T22:48:43.660 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:48:43 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "versions"}]: dispatch 2024-08-18T22:48:43.660 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:48:43 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "versions"}]: dispatch 2024-08-18T22:48:43.660 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:48:43 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi121.gbickb"]}]: dispatch 2024-08-18T22:48:43.660 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:48:43 smithi195 ceph-mon[68841]: Upgrade: It appears safe to stop mds.cephfs.smithi121.gbickb 2024-08-18T22:48:43.660 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:48:43 smithi195 ceph-mon[68841]: pgmap v186: 65 pgs: 65 active+clean; 1.9 GiB data, 5.8 GiB used, 531 GiB / 536 GiB avail 2024-08-18T22:48:44.834 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:48:44 smithi121 ceph-mon[81053]: Upgrade: Updating mds.cephfs.smithi121.gbickb 2024-08-18T22:48:44.834 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:48:44 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:48:44.834 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:48:44 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi121.gbickb", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-08-18T22:48:44.834 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:48:44 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:48:44.834 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:48:44 smithi121 ceph-mon[81053]: Deploying daemon mds.cephfs.smithi121.gbickb on smithi121 2024-08-18T22:48:44.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:48:44 smithi195 ceph-mon[68841]: Upgrade: Updating mds.cephfs.smithi121.gbickb 2024-08-18T22:48:44.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:48:44 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:48:44.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:48:44 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi121.gbickb", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-08-18T22:48:44.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:48:44 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:48:44.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:48:44 smithi195 ceph-mon[68841]: Deploying daemon mds.cephfs.smithi121.gbickb on smithi121 2024-08-18T22:48:45.834 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:48:45 smithi121 ceph-b003123a-5db1-11ef-bccf-c7b262605968-mon-smithi121[81049]: 2024-08-18T22:48:45.428+0000 7f7ae8f60640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-08-18T22:48:45.834 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:48:45 smithi121 ceph-mon[81053]: pgmap v187: 65 pgs: 65 active+clean; 1.9 GiB data, 5.8 GiB used, 531 GiB / 536 GiB avail 2024-08-18T22:48:45.834 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:48:45 smithi121 ceph-mon[81053]: 3 slow requests, 0 included below; oldest blocked for > 436.872192 secs 2024-08-18T22:48:45.834 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:48:45 smithi121 ceph-mon[81053]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-08-18T22:48:45.834 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:48:45 smithi121 ceph-mon[81053]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-08-18T22:48:45.834 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:48:45 smithi121 ceph-mon[81053]: Health check cleared: MDS_SLOW_REQUEST (was: 1 MDSs report slow requests) 2024-08-18T22:48:45.834 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:48:45 smithi121 ceph-mon[81053]: osdmap e82: 6 total, 6 up, 6 in 2024-08-18T22:48:45.834 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:48:45 smithi121 ceph-mon[81053]: Standby daemon mds.cephfs.smithi195.nptgyc assigned to filesystem cephfs as rank 0 2024-08-18T22:48:45.835 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:48:45 smithi121 ceph-mon[81053]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-08-18T22:48:45.835 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:48:45 smithi121 ceph-mon[81053]: fsmap cephfs:0/1 3 up:standby, 1 failed 2024-08-18T22:48:45.835 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:48:45 smithi121 ceph-mon[81053]: fsmap cephfs:1/1 {0=cephfs.smithi195.nptgyc=up:replay} 2 up:standby 2024-08-18T22:48:45.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:48:45 smithi195 ceph-mon[68841]: pgmap v187: 65 pgs: 65 active+clean; 1.9 GiB data, 5.8 GiB used, 531 GiB / 536 GiB avail 2024-08-18T22:48:45.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:48:45 smithi195 ceph-mon[68841]: 3 slow requests, 0 included below; oldest blocked for > 436.872192 secs 2024-08-18T22:48:45.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:48:45 smithi195 ceph-mon[68841]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-08-18T22:48:45.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:48:45 smithi195 ceph-mon[68841]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-08-18T22:48:45.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:48:45 smithi195 ceph-mon[68841]: Health check cleared: MDS_SLOW_REQUEST (was: 1 MDSs report slow requests) 2024-08-18T22:48:45.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:48:45 smithi195 ceph-mon[68841]: osdmap e82: 6 total, 6 up, 6 in 2024-08-18T22:48:45.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:48:45 smithi195 ceph-mon[68841]: Standby daemon mds.cephfs.smithi195.nptgyc assigned to filesystem cephfs as rank 0 2024-08-18T22:48:45.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:48:45 smithi195 ceph-mon[68841]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-08-18T22:48:45.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:48:45 smithi195 ceph-mon[68841]: fsmap cephfs:0/1 3 up:standby, 1 failed 2024-08-18T22:48:45.910 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:48:45 smithi195 ceph-mon[68841]: fsmap cephfs:1/1 {0=cephfs.smithi195.nptgyc=up:replay} 2 up:standby 2024-08-18T22:48:47.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:48:47 smithi195 ceph-mon[68841]: pgmap v189: 65 pgs: 65 active+clean; 1.9 GiB data, 5.8 GiB used, 531 GiB / 536 GiB avail; 421 KiB/s rd, 0 op/s 2024-08-18T22:48:48.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:48:47 smithi121 ceph-mon[81053]: pgmap v189: 65 pgs: 65 active+clean; 1.9 GiB data, 5.8 GiB used, 531 GiB / 536 GiB avail; 421 KiB/s rd, 0 op/s 2024-08-18T22:48:49.833 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:48:49 smithi121 ceph-mon[81053]: pgmap v190: 65 pgs: 65 active+clean; 1.9 GiB data, 5.8 GiB used, 531 GiB / 536 GiB avail; 3.2 MiB/s rd, 1 op/s 2024-08-18T22:48:49.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:48:49 smithi195 ceph-mon[68841]: pgmap v190: 65 pgs: 65 active+clean; 1.9 GiB data, 5.8 GiB used, 531 GiB / 536 GiB avail; 3.2 MiB/s rd, 1 op/s 2024-08-18T22:48:50.833 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:48:50 smithi121 ceph-mon[81053]: reconnect by client.24293 192.168.0.1:0/1761984941 after 0.000999981 2024-08-18T22:48:50.833 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:48:50 smithi121 ceph-mon[81053]: mds.? [v2:172.21.15.195:6826/238549847,v1:172.21.15.195:6827/238549847] up:reconnect 2024-08-18T22:48:50.833 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:48:50 smithi121 ceph-mon[81053]: fsmap cephfs:1/1 {0=cephfs.smithi195.nptgyc=up:reconnect} 2 up:standby 2024-08-18T22:48:50.833 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:48:50 smithi121 ceph-mon[81053]: reconnect by client.14514 192.168.0.1:0/1090582303 after 0.0399992 2024-08-18T22:48:50.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:48:50 smithi195 ceph-mon[68841]: reconnect by client.24293 192.168.0.1:0/1761984941 after 0.000999981 2024-08-18T22:48:50.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:48:50 smithi195 ceph-mon[68841]: mds.? [v2:172.21.15.195:6826/238549847,v1:172.21.15.195:6827/238549847] up:reconnect 2024-08-18T22:48:50.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:48:50 smithi195 ceph-mon[68841]: fsmap cephfs:1/1 {0=cephfs.smithi195.nptgyc=up:reconnect} 2 up:standby 2024-08-18T22:48:50.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:48:50 smithi195 ceph-mon[68841]: reconnect by client.14514 192.168.0.1:0/1090582303 after 0.0399992 2024-08-18T22:48:51.852 INFO:tasks.workunit.client.0.smithi121.stdout:6/14: unlink f3 0 2024-08-18T22:48:51.858 INFO:tasks.workunit.client.0.smithi121.stdout:6/15: symlink l4 0 2024-08-18T22:48:51.859 INFO:tasks.workunit.client.0.smithi121.stdout:6/16: write - no filename 2024-08-18T22:48:51.859 INFO:tasks.workunit.client.0.smithi121.stdout:6/17: dwrite - no filename 2024-08-18T22:48:51.859 INFO:tasks.workunit.client.0.smithi121.stdout:6/18: read - no filename 2024-08-18T22:48:51.859 INFO:tasks.workunit.client.0.smithi121.stdout:6/19: write - no filename 2024-08-18T22:48:51.859 INFO:tasks.workunit.client.0.smithi121.stdout:6/20: write - no filename 2024-08-18T22:48:51.859 INFO:tasks.workunit.client.0.smithi121.stdout:6/21: write - no filename 2024-08-18T22:48:51.859 INFO:tasks.workunit.client.0.smithi121.stdout:6/22: dread - no filename 2024-08-18T22:48:51.859 INFO:tasks.workunit.client.0.smithi121.stdout:6/23: read - no filename 2024-08-18T22:48:51.861 INFO:tasks.workunit.client.0.smithi121.stdout:6/24: creat f5 x:0 0 0 2024-08-18T22:48:51.862 INFO:tasks.workunit.client.0.smithi121.stdout:6/25: write f5 [931520,105532] 0 2024-08-18T22:48:51.864 INFO:tasks.workunit.client.0.smithi121.stdout:6/26: creat f6 x:0 0 0 2024-08-18T22:48:51.864 INFO:tasks.workunit.client.0.smithi121.stdout:6/27: truncate f6 536937 0 2024-08-18T22:48:51.866 INFO:tasks.workunit.client.0.smithi121.stdout:6/28: unlink f5 0 2024-08-18T22:48:51.871 INFO:tasks.workunit.client.0.smithi121.stdout:6/29: dwrite f6 [0,4194304] 0 2024-08-18T22:48:51.872 INFO:tasks.workunit.client.0.smithi121.stdout:6/30: write f6 [2522882,45002] 0 2024-08-18T22:48:51.875 INFO:tasks.workunit.client.0.smithi121.stdout:6/31: symlink l7 0 2024-08-18T22:48:51.876 INFO:tasks.workunit.client.0.smithi121.stdout:6/32: mkdir d8 0 2024-08-18T22:48:51.878 INFO:tasks.workunit.client.0.smithi121.stdout:6/33: mkdir d8/d9 0 2024-08-18T22:48:51.880 INFO:tasks.workunit.client.0.smithi121.stdout:6/34: creat d8/fa x:0 0 0 2024-08-18T22:48:51.892 INFO:tasks.workunit.client.0.smithi121.stdout:6/35: fdatasync f6 0 2024-08-18T22:48:51.893 INFO:tasks.workunit.client.0.smithi121.stdout:6/36: creat d8/fb x:0 0 0 2024-08-18T22:48:51.897 INFO:tasks.workunit.client.0.smithi121.stdout:6/37: rmdir d8 39 2024-08-18T22:48:51.898 INFO:tasks.workunit.client.0.smithi121.stdout:6/38: unlink l4 0 2024-08-18T22:48:51.899 INFO:tasks.workunit.client.0.smithi121.stdout:6/39: write d8/fb [103559,61608] 0 2024-08-18T22:48:51.902 INFO:tasks.workunit.client.0.smithi121.stdout:6/40: rename f6 to d8/d9/fc 0 2024-08-18T22:48:51.903 INFO:tasks.workunit.client.0.smithi121.stdout:6/41: readlink l7 0 2024-08-18T22:48:51.903 INFO:tasks.workunit.client.0.smithi121.stdout:6/42: fdatasync d8/fb 0 2024-08-18T22:48:51.904 INFO:tasks.workunit.client.0.smithi121.stdout:6/43: symlink d8/d9/ld 0 2024-08-18T22:48:51.905 INFO:tasks.workunit.client.0.smithi121.stdout:6/44: symlink d8/le 0 2024-08-18T22:48:51.910 INFO:tasks.workunit.client.0.smithi121.stdout:6/45: dwrite d8/fa [0,4194304] 0 2024-08-18T22:48:51.915 INFO:tasks.workunit.client.0.smithi121.stdout:6/46: truncate d8/fa 386716 0 2024-08-18T22:48:51.922 INFO:tasks.workunit.client.0.smithi121.stdout:6/47: dwrite d8/fb [0,4194304] 0 2024-08-18T22:48:51.925 INFO:tasks.workunit.client.0.smithi121.stdout:6/48: rename d8/d9/ld to d8/d9/lf 0 2024-08-18T22:48:51.927 INFO:tasks.workunit.client.0.smithi121.stdout:6/49: unlink d8/fa 0 2024-08-18T22:48:51.936 INFO:tasks.workunit.client.0.smithi121.stdout:6/50: truncate d8/d9/fc 1502236 0 2024-08-18T22:48:51.937 INFO:tasks.workunit.client.0.smithi121.stdout:6/51: creat d8/f10 x:0 0 0 2024-08-18T22:48:51.938 INFO:tasks.workunit.client.0.smithi121.stdout:6/52: symlink d8/d9/l11 0 2024-08-18T22:48:51.939 INFO:tasks.workunit.client.0.smithi121.stdout:6/53: dread - d8/f10 zero size 2024-08-18T22:48:51.943 INFO:tasks.workunit.client.0.smithi121.stdout:6/54: getdents d8 0 2024-08-18T22:48:51.944 INFO:tasks.workunit.client.0.smithi121.stdout:6/55: fdatasync d8/fb 0 2024-08-18T22:48:51.944 INFO:tasks.workunit.client.0.smithi121.stdout:6/56: fdatasync d8/f10 0 2024-08-18T22:48:51.947 INFO:tasks.workunit.client.0.smithi121.stdout:6/57: rename d8/fb to d8/f12 0 2024-08-18T22:48:51.947 INFO:tasks.workunit.client.0.smithi121.stdout:6/58: dread - d8/f10 zero size 2024-08-18T22:48:51.951 INFO:tasks.workunit.client.0.smithi121.stdout:6/59: rename d8/f12 to d8/d9/f13 0 2024-08-18T22:48:51.952 INFO:tasks.workunit.client.0.smithi121.stdout:6/60: rmdir d8/d9 39 2024-08-18T22:48:51.954 INFO:tasks.workunit.client.0.smithi121.stdout:6/61: chown d8/d9/l11 24918 1 2024-08-18T22:48:51.955 INFO:tasks.workunit.client.0.smithi121.stdout:6/62: mkdir d8/d9/d14 0 2024-08-18T22:48:51.958 INFO:tasks.workunit.client.0.smithi121.stdout:6/63: creat d8/f15 x:0 0 0 2024-08-18T22:48:51.958 INFO:tasks.workunit.client.0.smithi121.stdout:6/64: dread - d8/f15 zero size 2024-08-18T22:48:51.959 INFO:tasks.workunit.client.0.smithi121.stdout:6/65: chown d8/d9/f13 47641 1 2024-08-18T22:48:51.961 INFO:tasks.workunit.client.0.smithi121.stdout:6/66: mkdir d8/d9/d14/d16 0 2024-08-18T22:48:51.961 INFO:tasks.workunit.client.0.smithi121.stdout:6/67: dread - d8/f15 zero size 2024-08-18T22:48:51.961 INFO:tasks.workunit.client.0.smithi121.stdout:6/68: fdatasync d8/f15 0 2024-08-18T22:48:51.962 INFO:tasks.workunit.client.0.smithi121.stdout:6/69: write d8/f15 [143704,102073] 0 2024-08-18T22:48:51.964 INFO:tasks.workunit.client.0.smithi121.stdout:6/70: symlink d8/l17 0 2024-08-18T22:48:51.968 INFO:tasks.workunit.client.0.smithi121.stdout:6/71: rmdir d8 39 2024-08-18T22:48:51.969 INFO:tasks.workunit.client.0.smithi121.stdout:6/72: write d8/f15 [302219,50009] 0 2024-08-18T22:48:51.971 INFO:tasks.workunit.client.0.smithi121.stdout:6/73: symlink d8/d9/d14/l18 0 2024-08-18T22:48:51.975 INFO:tasks.workunit.client.0.smithi121.stdout:6/74: dwrite d8/f10 [0,4194304] 0 2024-08-18T22:48:51.978 INFO:tasks.workunit.client.0.smithi121.stdout:6/75: creat d8/f19 x:0 0 0 2024-08-18T22:48:51.979 INFO:tasks.workunit.client.0.smithi121.stdout:6/76: write d8/f15 [52968,27859] 0 2024-08-18T22:48:52.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:48:51 smithi121 ceph-mon[81053]: pgmap v191: 65 pgs: 65 active+clean; 1.9 GiB data, 5.8 GiB used, 531 GiB / 536 GiB avail; 8.3 MiB/s rd, 3 op/s 2024-08-18T22:48:52.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:48:51 smithi121 ceph-mon[81053]: mds.? [v2:172.21.15.195:6826/238549847,v1:172.21.15.195:6827/238549847] up:rejoin 2024-08-18T22:48:52.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:48:51 smithi121 ceph-mon[81053]: fsmap cephfs:1/1 {0=cephfs.smithi195.nptgyc=up:rejoin} 2 up:standby 2024-08-18T22:48:52.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:48:51 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:48:52.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:48:51 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:48:52.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:48:51 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-18T22:48:52.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:48:51 smithi121 ceph-mon[81053]: daemon mds.cephfs.smithi195.nptgyc is now active in filesystem cephfs as rank 0 2024-08-18T22:48:52.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:48:51 smithi195 ceph-mon[68841]: pgmap v191: 65 pgs: 65 active+clean; 1.9 GiB data, 5.8 GiB used, 531 GiB / 536 GiB avail; 8.3 MiB/s rd, 3 op/s 2024-08-18T22:48:52.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:48:51 smithi195 ceph-mon[68841]: mds.? [v2:172.21.15.195:6826/238549847,v1:172.21.15.195:6827/238549847] up:rejoin 2024-08-18T22:48:52.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:48:51 smithi195 ceph-mon[68841]: fsmap cephfs:1/1 {0=cephfs.smithi195.nptgyc=up:rejoin} 2 up:standby 2024-08-18T22:48:52.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:48:51 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:48:52.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:48:51 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:48:52.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:48:51 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-18T22:48:52.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:48:51 smithi195 ceph-mon[68841]: daemon mds.cephfs.smithi195.nptgyc is now active in filesystem cephfs as rank 0 2024-08-18T22:48:52.729 INFO:tasks.workunit.client.0.smithi121.stdout:6/77: sync 2024-08-18T22:48:52.731 INFO:tasks.workunit.client.0.smithi121.stdout:6/78: mknod d8/c1a 0 2024-08-18T22:48:52.733 INFO:tasks.workunit.client.0.smithi121.stdout:6/79: rename l7 to d8/d9/l1b 0 2024-08-18T22:48:52.735 INFO:tasks.workunit.client.0.smithi121.stdout:6/80: symlink d8/l1c 0 2024-08-18T22:48:52.743 INFO:tasks.workunit.client.0.smithi121.stdout:6/81: dwrite d8/d9/f13 [0,4194304] 0 2024-08-18T22:48:52.745 INFO:tasks.workunit.client.0.smithi121.stdout:6/82: symlink d8/d9/l1d 0 2024-08-18T22:48:52.747 INFO:tasks.workunit.client.0.smithi121.stdout:6/83: mkdir d8/d9/d14/d16/d1e 0 2024-08-18T22:48:52.748 INFO:tasks.workunit.client.0.smithi121.stdout:6/84: write d8/f19 [561332,127450] 0 2024-08-18T22:48:52.749 INFO:tasks.workunit.client.0.smithi121.stdout:6/85: write d8/f15 [470811,64098] 0 2024-08-18T22:48:52.758 INFO:tasks.workunit.client.0.smithi121.stdout:6/86: dwrite d8/f15 [0,4194304] 0 2024-08-18T22:48:52.762 INFO:tasks.workunit.client.0.smithi121.stdout:6/87: fsync d8/f19 0 2024-08-18T22:48:52.765 INFO:tasks.workunit.client.0.smithi121.stdout:6/88: mkdir d8/d9/d14/d16/d1f 0 2024-08-18T22:48:52.766 INFO:tasks.workunit.client.0.smithi121.stdout:6/89: chown d8/l1c 9324 1 2024-08-18T22:48:52.767 INFO:tasks.workunit.client.0.smithi121.stdout:6/90: rename d8/d9 to d8/d9/d14/d16/d1f/d20 22 2024-08-18T22:48:52.769 INFO:tasks.workunit.client.0.smithi121.stdout:6/91: getdents d8/d9/d14/d16/d1f 0 2024-08-18T22:48:52.770 INFO:tasks.workunit.client.0.smithi121.stdout:6/92: write d8/f10 [352927,79756] 0 2024-08-18T22:48:52.771 INFO:tasks.workunit.client.0.smithi121.stdout:6/93: chown d8/d9/d14/d16 356 1 2024-08-18T22:48:52.774 INFO:tasks.workunit.client.0.smithi121.stdout:6/94: creat d8/f21 x:0 0 0 2024-08-18T22:48:52.775 INFO:tasks.workunit.client.0.smithi121.stdout:6/95: symlink d8/d9/d14/l22 0 2024-08-18T22:48:52.777 INFO:tasks.workunit.client.0.smithi121.stdout:6/96: creat d8/d9/d14/d16/d1e/f23 x:0 0 0 2024-08-18T22:48:52.780 INFO:tasks.workunit.client.0.smithi121.stdout:6/97: dread d8/f10 [0,4194304] 0 2024-08-18T22:48:52.781 INFO:tasks.workunit.client.0.smithi121.stdout:6/98: rmdir d8/d9/d14 39 2024-08-18T22:48:52.783 INFO:tasks.workunit.client.0.smithi121.stdout:6/99: getdents d8/d9/d14/d16/d1f 0 2024-08-18T22:48:52.785 INFO:tasks.workunit.client.0.smithi121.stdout:6/100: mkdir d8/d9/d24 0 2024-08-18T22:48:52.789 INFO:tasks.workunit.client.0.smithi121.stdout:6/101: rmdir d8 39 2024-08-18T22:48:52.791 INFO:tasks.workunit.client.0.smithi121.stdout:6/102: dread d8/d9/fc [0,4194304] 0 2024-08-18T22:48:52.795 INFO:tasks.workunit.client.0.smithi121.stdout:6/103: truncate d8/d9/f13 2414963 0 2024-08-18T22:48:52.798 INFO:tasks.workunit.client.0.smithi121.stdout:6/104: dread d8/f15 [0,4194304] 0 2024-08-18T22:48:52.909 INFO:tasks.workunit.client.0.smithi121.stdout:6/105: write d8/f10 [4553729,11516] 0 2024-08-18T22:48:52.913 INFO:tasks.workunit.client.0.smithi121.stdout:6/106: mkdir d8/d9/d24/d25 0 2024-08-18T22:48:52.916 INFO:tasks.workunit.client.0.smithi121.stdout:6/107: creat d8/d9/d14/f26 x:0 0 0 2024-08-18T22:48:52.916 INFO:tasks.workunit.client.0.smithi121.stdout:6/108: chown d8/f21 564363900 1 2024-08-18T22:48:52.920 INFO:tasks.workunit.client.0.smithi121.stdout:6/109: mkdir d8/d9/d27 0 2024-08-18T22:48:52.920 INFO:tasks.workunit.client.0.smithi121.stdout:6/110: chown d8 3 1 2024-08-18T22:48:52.985 INFO:tasks.workunit.client.0.smithi121.stdout:6/111: rmdir d8/d9/d14/d16/d1f 0 2024-08-18T22:48:52.985 INFO:tasks.workunit.client.0.smithi121.stdout:6/112: readlink d8/d9/l11 0 2024-08-18T22:48:52.986 INFO:tasks.workunit.client.0.smithi121.stdout:6/113: chown d8/le 1102459 1 2024-08-18T22:48:52.987 INFO:tasks.workunit.client.0.smithi121.stdout:6/114: write d8/f15 [4030407,10971] 0 2024-08-18T22:48:52.991 INFO:tasks.workunit.client.0.smithi121.stdout:6/115: mkdir d8/d9/d24/d25/d28 0 2024-08-18T22:48:52.996 INFO:tasks.workunit.client.0.smithi121.stdout:6/116: dwrite d8/d9/d14/d16/d1e/f23 [0,4194304] 0 2024-08-18T22:48:53.002 INFO:tasks.workunit.client.0.smithi121.stdout:6/117: dwrite d8/d9/d14/d16/d1e/f23 [0,4194304] 0 2024-08-18T22:48:53.004 INFO:tasks.workunit.client.0.smithi121.stdout:6/118: truncate d8/d9/d14/f26 409455 0 2024-08-18T22:48:53.014 INFO:tasks.workunit.client.0.smithi121.stdout:6/119: rename d8/d9/lf to d8/l29 0 2024-08-18T22:48:53.019 INFO:tasks.workunit.client.0.smithi121.stdout:6/120: dwrite d8/f21 [0,4194304] 0 2024-08-18T22:48:53.020 INFO:tasks.workunit.client.0.smithi121.stdout:6/121: write d8/f15 [88101,104230] 0 2024-08-18T22:48:53.025 INFO:tasks.workunit.client.0.smithi121.stdout:6/122: creat d8/d9/f2a x:0 0 0 2024-08-18T22:48:53.031 INFO:tasks.workunit.client.0.smithi121.stdout:6/123: dwrite d8/d9/d14/f26 [0,4194304] 0 2024-08-18T22:48:53.035 INFO:tasks.workunit.client.0.smithi121.stdout:6/124: mkdir d8/d9/d27/d2b 0 2024-08-18T22:48:53.036 INFO:tasks.workunit.client.0.smithi121.stdout:6/125: readlink d8/d9/d14/l18 0 2024-08-18T22:48:53.041 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:48:52 smithi121 ceph-mon[81053]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-08-18T22:48:53.041 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:48:52 smithi121 ceph-mon[81053]: Cluster is now healthy 2024-08-18T22:48:53.041 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:48:52 smithi121 ceph-mon[81053]: mds.? [v2:172.21.15.121:6828/2915303436,v1:172.21.15.121:6829/2915303436] up:boot 2024-08-18T22:48:53.041 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:48:52 smithi121 ceph-mon[81053]: mds.? [v2:172.21.15.195:6826/238549847,v1:172.21.15.195:6827/238549847] up:active 2024-08-18T22:48:53.041 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:48:52 smithi121 ceph-mon[81053]: fsmap cephfs:1 {0=cephfs.smithi195.nptgyc=up:active} 3 up:standby 2024-08-18T22:48:53.041 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:48:52 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi121.gbickb"}]: dispatch 2024-08-18T22:48:53.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:48:52 smithi195 ceph-mon[68841]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-08-18T22:48:53.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:48:52 smithi195 ceph-mon[68841]: Cluster is now healthy 2024-08-18T22:48:53.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:48:52 smithi195 ceph-mon[68841]: mds.? [v2:172.21.15.121:6828/2915303436,v1:172.21.15.121:6829/2915303436] up:boot 2024-08-18T22:48:53.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:48:52 smithi195 ceph-mon[68841]: mds.? [v2:172.21.15.195:6826/238549847,v1:172.21.15.195:6827/238549847] up:active 2024-08-18T22:48:53.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:48:52 smithi195 ceph-mon[68841]: fsmap cephfs:1 {0=cephfs.smithi195.nptgyc=up:active} 3 up:standby 2024-08-18T22:48:53.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:48:52 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi121.gbickb"}]: dispatch 2024-08-18T22:48:53.254 INFO:tasks.workunit.client.0.smithi121.stdout:6/126: dwrite d8/d9/fc [0,4194304] 0 2024-08-18T22:48:53.256 INFO:tasks.workunit.client.0.smithi121.stdout:6/127: mkdir d8/d9/d27/d2c 0 2024-08-18T22:48:53.257 INFO:tasks.workunit.client.0.smithi121.stdout:6/128: chown d8/d9/d14/d16/d1e 7744 1 2024-08-18T22:48:53.260 INFO:tasks.workunit.client.0.smithi121.stdout:6/129: mknod d8/d9/c2d 0 2024-08-18T22:48:53.260 INFO:tasks.workunit.client.0.smithi121.stdout:6/130: dread - d8/d9/f2a zero size 2024-08-18T22:48:53.260 INFO:tasks.workunit.client.0.smithi121.stdout:6/131: stat d8 0 2024-08-18T22:48:53.262 INFO:tasks.workunit.client.0.smithi121.stdout:6/132: symlink d8/d9/d27/d2b/l2e 0 2024-08-18T22:48:53.265 INFO:tasks.workunit.client.0.smithi121.stdout:6/133: rename d8/d9/d27/d2b/l2e to d8/d9/d27/l2f 0 2024-08-18T22:48:53.270 INFO:tasks.workunit.client.0.smithi121.stdout:6/134: dwrite d8/d9/d14/f26 [4194304,4194304] 0 2024-08-18T22:48:53.294 INFO:tasks.workunit.client.0.smithi121.stdout:6/135: read d8/d9/f13 [1093664,56202] 0 2024-08-18T22:48:53.295 INFO:tasks.workunit.client.0.smithi121.stdout:6/136: write d8/d9/d14/f26 [2603851,46976] 0 2024-08-18T22:48:53.296 INFO:tasks.workunit.client.0.smithi121.stdout:6/137: write d8/f15 [977081,71154] 0 2024-08-18T22:48:53.300 INFO:tasks.workunit.client.0.smithi121.stdout:6/138: creat d8/d9/f30 x:0 0 0 2024-08-18T22:48:53.300 INFO:tasks.workunit.client.0.smithi121.stdout:6/139: chown d8/d9/d27/d2c 7177 1 2024-08-18T22:48:53.302 INFO:tasks.workunit.client.0.smithi121.stdout:6/140: mknod d8/d9/d14/d16/d1e/c31 0 2024-08-18T22:48:53.304 INFO:tasks.workunit.client.0.smithi121.stdout:6/141: creat d8/d9/d24/d25/d28/f32 x:0 0 0 2024-08-18T22:48:53.306 INFO:tasks.workunit.client.0.smithi121.stdout:6/142: mknod d8/d9/d27/d2b/c33 0 2024-08-18T22:48:53.308 INFO:tasks.workunit.client.0.smithi121.stdout:6/143: symlink d8/d9/d14/d16/l34 0 2024-08-18T22:48:53.312 INFO:tasks.workunit.client.0.smithi121.stdout:6/144: dwrite d8/f21 [0,4194304] 0 2024-08-18T22:48:53.314 INFO:tasks.workunit.client.0.smithi121.stdout:6/145: mknod d8/d9/d27/c35 0 2024-08-18T22:48:53.317 INFO:tasks.workunit.client.0.smithi121.stdout:6/146: symlink d8/d9/d24/d25/l36 0 2024-08-18T22:48:53.318 INFO:tasks.workunit.client.0.smithi121.stdout:6/147: chown d8/d9/l11 492531 1 2024-08-18T22:48:53.324 INFO:tasks.workunit.client.0.smithi121.stdout:6/148: dwrite d8/f21 [0,4194304] 0 2024-08-18T22:48:53.327 INFO:tasks.workunit.client.0.smithi121.stdout:6/149: truncate d8/d9/d14/d16/d1e/f23 5035779 0 2024-08-18T22:48:53.331 INFO:tasks.workunit.client.0.smithi121.stdout:6/150: mkdir d8/d9/d37 0 2024-08-18T22:48:53.334 INFO:tasks.workunit.client.0.smithi121.stdout:6/151: creat d8/d9/f38 x:0 0 0 2024-08-18T22:48:53.334 INFO:tasks.workunit.client.0.smithi121.stdout:6/152: dread - d8/d9/f38 zero size 2024-08-18T22:48:53.338 INFO:tasks.workunit.client.0.smithi121.stdout:6/153: dread d8/d9/fc [0,4194304] 0 2024-08-18T22:48:53.344 INFO:tasks.workunit.client.0.smithi121.stdout:6/154: dwrite d8/f21 [4194304,4194304] 0 2024-08-18T22:48:53.351 INFO:tasks.workunit.client.0.smithi121.stdout:6/155: dwrite d8/f15 [4194304,4194304] 0 2024-08-18T22:48:53.357 INFO:tasks.workunit.client.0.smithi121.stdout:6/156: truncate d8/f10 809694 0 2024-08-18T22:48:53.359 INFO:tasks.workunit.client.0.smithi121.stdout:6/157: dread d8/d9/d14/d16/d1e/f23 [4194304,4194304] 0 2024-08-18T22:48:53.360 INFO:tasks.workunit.client.0.smithi121.stdout:6/158: chown d8/d9/d14/d16/d1e/f23 20590 1 2024-08-18T22:48:53.529 INFO:tasks.workunit.client.0.smithi121.stdout:6/159: sync 2024-08-18T22:48:53.662 INFO:tasks.workunit.client.0.smithi121.stdout:6/160: sync 2024-08-18T22:48:53.665 INFO:tasks.workunit.client.0.smithi121.stdout:6/161: dread d8/f21 [0,4194304] 0 2024-08-18T22:48:53.666 INFO:tasks.workunit.client.0.smithi121.stdout:6/162: write d8/f15 [4499582,37105] 0 2024-08-18T22:48:53.669 INFO:tasks.workunit.client.0.smithi121.stdout:6/163: creat d8/d9/d24/d25/d28/f39 x:0 0 0 2024-08-18T22:48:53.669 INFO:tasks.workunit.client.0.smithi121.stdout:6/164: chown d8/l1c 2 1 2024-08-18T22:48:53.670 INFO:tasks.workunit.client.0.smithi121.stdout:6/165: fdatasync d8/d9/d14/f26 0 2024-08-18T22:48:53.671 INFO:tasks.workunit.client.0.smithi121.stdout:6/166: write d8/d9/f30 [637540,45191] 0 2024-08-18T22:48:53.673 INFO:tasks.workunit.client.0.smithi121.stdout:6/167: mkdir d8/d9/d24/d3a 0 2024-08-18T22:48:53.678 INFO:tasks.workunit.client.0.smithi121.stdout:6/168: write d8/f10 [1632974,123559] 0 2024-08-18T22:48:53.680 INFO:tasks.workunit.client.0.smithi121.stdout:6/169: mknod d8/d9/d24/d25/c3b 0 2024-08-18T22:48:53.680 INFO:tasks.workunit.client.0.smithi121.stdout:6/170: readlink d8/d9/d24/d25/l36 0 2024-08-18T22:48:53.683 INFO:tasks.workunit.client.0.smithi121.stdout:6/171: getdents d8/d9/d14/d16/d1e 0 2024-08-18T22:48:53.686 INFO:tasks.workunit.client.0.smithi121.stdout:6/172: truncate d8/d9/f30 486126 0 2024-08-18T22:48:53.691 INFO:tasks.workunit.client.0.smithi121.stdout:6/173: dwrite d8/f15 [4194304,4194304] 0 2024-08-18T22:48:53.692 INFO:tasks.workunit.client.0.smithi121.stdout:6/174: write d8/d9/d14/f26 [9093186,114581] 0 2024-08-18T22:48:53.693 INFO:tasks.workunit.client.0.smithi121.stdout:6/175: chown d8/d9/d24/d25/l36 621048 1 2024-08-18T22:48:53.823 INFO:tasks.workunit.client.0.smithi121.stdout:6/176: sync 2024-08-18T22:48:53.823 INFO:tasks.workunit.client.0.smithi121.stdout:6/177: write d8/d9/d14/f26 [8694784,43439] 0 2024-08-18T22:48:53.825 INFO:tasks.workunit.client.0.smithi121.stdout:6/178: write d8/f21 [807565,94200] 0 2024-08-18T22:48:53.978 INFO:tasks.workunit.client.0.smithi121.stdout:6/179: sync 2024-08-18T22:48:53.981 INFO:tasks.workunit.client.0.smithi121.stdout:6/180: dread d8/f21 [4194304,4194304] 0 2024-08-18T22:48:53.982 INFO:tasks.workunit.client.0.smithi121.stdout:6/181: write d8/f15 [3632895,76153] 0 2024-08-18T22:48:53.984 INFO:tasks.workunit.client.0.smithi121.stdout:6/182: mkdir d8/d9/d24/d3c 0 2024-08-18T22:48:53.986 INFO:tasks.workunit.client.0.smithi121.stdout:6/183: mknod d8/d9/d24/d25/d28/c3d 0 2024-08-18T22:48:54.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:48:53 smithi121 ceph-mon[81053]: pgmap v192: 65 pgs: 65 active+clean; 1.9 GiB data, 5.8 GiB used, 531 GiB / 536 GiB avail; 9.9 MiB/s rd, 4 op/s 2024-08-18T22:48:54.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:48:53 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:48:54.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:48:53 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-18T22:48:54.091 INFO:tasks.workunit.client.0.smithi121.stdout:6/184: sync 2024-08-18T22:48:54.092 INFO:tasks.workunit.client.0.smithi121.stdout:6/185: dread - d8/d9/f38 zero size 2024-08-18T22:48:54.092 INFO:tasks.workunit.client.0.smithi121.stdout:6/186: dread - d8/d9/f2a zero size 2024-08-18T22:48:54.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:48:53 smithi195 ceph-mon[68841]: pgmap v192: 65 pgs: 65 active+clean; 1.9 GiB data, 5.8 GiB used, 531 GiB / 536 GiB avail; 9.9 MiB/s rd, 4 op/s 2024-08-18T22:48:54.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:48:53 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:48:54.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:48:53 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-18T22:48:54.190 INFO:tasks.workunit.client.0.smithi121.stdout:6/187: sync 2024-08-18T22:48:54.192 INFO:tasks.workunit.client.0.smithi121.stdout:6/188: unlink d8/d9/d24/d25/l36 0 2024-08-18T22:48:54.194 INFO:tasks.workunit.client.0.smithi121.stdout:6/189: rename d8/d9/f38 to d8/d9/d24/d3c/f3e 0 2024-08-18T22:48:54.196 INFO:tasks.workunit.client.0.smithi121.stdout:6/190: mkdir d8/d9/d14/d16/d3f 0 2024-08-18T22:48:54.198 INFO:tasks.workunit.client.0.smithi121.stdout:6/191: creat d8/d9/d27/f40 x:0 0 0 2024-08-18T22:48:54.204 INFO:tasks.workunit.client.0.smithi121.stdout:6/192: dwrite d8/d9/fc [0,4194304] 0 2024-08-18T22:48:54.205 INFO:tasks.workunit.client.0.smithi121.stdout:6/193: fdatasync d8/d9/d24/d3c/f3e 0 2024-08-18T22:48:54.209 INFO:tasks.workunit.client.0.smithi121.stdout:6/194: dread d8/d9/fc [0,4194304] 0 2024-08-18T22:48:54.209 INFO:tasks.workunit.client.0.smithi121.stdout:6/195: chown d8/c1a 5521771 1 2024-08-18T22:48:54.212 INFO:tasks.workunit.client.0.smithi121.stdout:6/196: rename d8/l1c to d8/d9/d24/d3c/l41 0 2024-08-18T22:48:54.213 INFO:tasks.workunit.client.0.smithi121.stdout:6/197: readlink d8/l17 0 2024-08-18T22:48:54.214 INFO:tasks.workunit.client.0.smithi121.stdout:6/198: creat d8/d9/d27/d2c/f42 x:0 0 0 2024-08-18T22:48:54.216 INFO:tasks.workunit.client.0.smithi121.stdout:6/199: creat d8/d9/d24/f43 x:0 0 0 2024-08-18T22:48:54.219 INFO:tasks.workunit.client.0.smithi121.stdout:6/200: dread d8/f15 [4194304,4194304] 0 2024-08-18T22:48:54.220 INFO:tasks.workunit.client.0.smithi121.stdout:6/201: write d8/f10 [2534616,35844] 0 2024-08-18T22:48:54.222 INFO:tasks.workunit.client.0.smithi121.stdout:6/202: creat d8/d9/d37/f44 x:0 0 0 2024-08-18T22:48:54.224 INFO:tasks.workunit.client.0.smithi121.stdout:6/203: creat d8/d9/d24/d25/f45 x:0 0 0 2024-08-18T22:48:54.224 INFO:tasks.workunit.client.0.smithi121.stdout:6/204: read - d8/d9/d24/d25/d28/f32 zero size 2024-08-18T22:48:54.230 INFO:tasks.workunit.client.0.smithi121.stdout:6/205: dwrite d8/d9/fc [0,4194304] 0 2024-08-18T22:48:54.232 INFO:tasks.workunit.client.0.smithi121.stdout:6/206: mkdir d8/d9/d27/d46 0 2024-08-18T22:48:54.234 INFO:tasks.workunit.client.0.smithi121.stdout:6/207: rename d8/d9/f2a to d8/d9/d24/f47 0 2024-08-18T22:48:54.235 INFO:tasks.workunit.client.0.smithi121.stdout:6/208: readlink d8/d9/d14/d16/l34 0 2024-08-18T22:48:54.237 INFO:tasks.workunit.client.0.smithi121.stdout:6/209: rmdir d8/d9/d14/d16 39 2024-08-18T22:48:54.237 INFO:tasks.workunit.client.0.smithi121.stdout:6/210: write d8/d9/d14/f26 [2517228,76504] 0 2024-08-18T22:48:54.240 INFO:tasks.workunit.client.0.smithi121.stdout:6/211: mkdir d8/d9/d37/d48 0 2024-08-18T22:48:54.241 INFO:tasks.workunit.client.0.smithi121.stdout:6/212: write d8/d9/d14/f26 [8237047,89700] 0 2024-08-18T22:48:54.242 INFO:tasks.workunit.client.0.smithi121.stdout:6/213: write d8/f15 [6841703,114611] 0 2024-08-18T22:48:54.244 INFO:tasks.workunit.client.0.smithi121.stdout:6/214: rmdir d8 39 2024-08-18T22:48:54.250 INFO:tasks.workunit.client.0.smithi121.stdout:6/215: dwrite d8/d9/d24/f47 [0,4194304] 0 2024-08-18T22:48:54.254 INFO:tasks.workunit.client.0.smithi121.stdout:6/216: mkdir d8/d9/d14/d16/d49 0 2024-08-18T22:48:54.256 INFO:tasks.workunit.client.0.smithi121.stdout:6/217: symlink d8/d9/d14/d16/d1e/l4a 0 2024-08-18T22:48:54.259 INFO:tasks.workunit.client.0.smithi121.stdout:6/218: dread d8/d9/f13 [0,4194304] 0 2024-08-18T22:48:54.260 INFO:tasks.workunit.client.0.smithi121.stdout:6/219: write d8/d9/d24/d25/d28/f32 [319626,96805] 0 2024-08-18T22:48:54.264 INFO:tasks.workunit.client.0.smithi121.stdout:6/220: link d8/l17 d8/d9/d14/d16/d49/l4b 0 2024-08-18T22:48:54.265 INFO:tasks.workunit.client.0.smithi121.stdout:6/221: chown d8/d9/f13 1 1 2024-08-18T22:48:54.266 INFO:tasks.workunit.client.0.smithi121.stdout:6/222: truncate d8/d9/d24/f43 3657 0 2024-08-18T22:48:54.267 INFO:tasks.workunit.client.0.smithi121.stdout:6/223: mknod d8/d9/d27/d2c/c4c 0 2024-08-18T22:48:54.268 INFO:tasks.workunit.client.0.smithi121.stdout:6/224: symlink d8/d9/d27/d46/l4d 0 2024-08-18T22:48:54.269 INFO:tasks.workunit.client.0.smithi121.stdout:6/225: write d8/f19 [1014110,65470] 0 2024-08-18T22:48:54.272 INFO:tasks.workunit.client.0.smithi121.stdout:6/226: dread d8/d9/d14/d16/d1e/f23 [0,4194304] 0 2024-08-18T22:48:54.273 INFO:tasks.workunit.client.0.smithi121.stdout:6/227: write d8/d9/d14/f26 [2092272,17852] 0 2024-08-18T22:48:54.278 INFO:tasks.workunit.client.0.smithi121.stdout:6/228: truncate d8/f21 3329447 0 2024-08-18T22:48:54.280 INFO:tasks.workunit.client.0.smithi121.stdout:6/229: creat d8/d9/d27/d2b/f4e x:0 0 0 2024-08-18T22:48:54.284 INFO:tasks.workunit.client.0.smithi121.stdout:6/230: dread d8/f19 [0,4194304] 0 2024-08-18T22:48:54.287 INFO:tasks.workunit.client.0.smithi121.stdout:6/231: rename d8/d9/d27/l2f to d8/d9/d24/d25/d28/l4f 0 2024-08-18T22:48:54.290 INFO:tasks.workunit.client.0.smithi121.stdout:6/232: link d8/d9/d24/f43 d8/d9/d27/d2c/f50 0 2024-08-18T22:48:54.291 INFO:tasks.workunit.client.0.smithi121.stdout:6/233: creat d8/d9/d14/d16/f51 x:0 0 0 2024-08-18T22:48:54.292 INFO:tasks.workunit.client.0.smithi121.stdout:6/234: write d8/d9/d14/d16/f51 [464853,49356] 0 2024-08-18T22:48:54.293 INFO:tasks.workunit.client.0.smithi121.stdout:6/235: readlink d8/d9/l1d 0 2024-08-18T22:48:54.293 INFO:tasks.workunit.client.0.smithi121.stdout:6/236: fsync d8/d9/d24/f47 0 2024-08-18T22:48:54.294 INFO:tasks.workunit.client.0.smithi121.stdout:6/237: chown d8/d9/d27/d2c 18410 1 2024-08-18T22:48:54.298 INFO:tasks.workunit.client.0.smithi121.stdout:6/238: unlink d8/d9/d24/d3c/l41 0 2024-08-18T22:48:54.300 INFO:tasks.workunit.client.0.smithi121.stdout:6/239: rmdir d8/d9/d27/d2c 39 2024-08-18T22:48:54.301 INFO:tasks.workunit.client.0.smithi121.stdout:6/240: read d8/d9/d24/f47 [3997631,76790] 0 2024-08-18T22:48:54.540 INFO:tasks.workunit.client.0.smithi121.stdout:6/241: sync 2024-08-18T22:48:54.542 INFO:tasks.workunit.client.0.smithi121.stdout:6/242: creat d8/d9/d24/d3a/f52 x:0 0 0 2024-08-18T22:48:54.547 INFO:tasks.workunit.client.0.smithi121.stdout:6/243: dwrite d8/d9/d24/d25/d28/f32 [0,4194304] 0 2024-08-18T22:48:54.549 INFO:tasks.workunit.client.0.smithi121.stdout:6/244: fsync d8/d9/f13 0 2024-08-18T22:48:54.550 INFO:tasks.workunit.client.0.smithi121.stdout:6/245: dread - d8/d9/d27/f40 zero size 2024-08-18T22:48:54.555 INFO:tasks.workunit.client.0.smithi121.stdout:6/246: link d8/d9/d14/d16/d49/l4b d8/d9/d37/d48/l53 0 2024-08-18T22:48:54.555 INFO:tasks.workunit.client.0.smithi121.stdout:6/247: read - d8/d9/d27/f40 zero size 2024-08-18T22:48:54.557 INFO:tasks.workunit.client.0.smithi121.stdout:6/248: creat d8/d9/d24/d25/f54 x:0 0 0 2024-08-18T22:48:54.559 INFO:tasks.workunit.client.0.smithi121.stdout:6/249: mknod d8/d9/d24/d25/d28/c55 0 2024-08-18T22:48:54.561 INFO:tasks.workunit.client.0.smithi121.stdout:6/250: creat d8/f56 x:0 0 0 2024-08-18T22:48:54.561 INFO:tasks.workunit.client.0.smithi121.stdout:6/251: fdatasync d8/d9/d14/f26 0 2024-08-18T22:48:54.565 INFO:tasks.workunit.client.0.smithi121.stdout:6/252: rename d8/d9/d14/d16/d49/l4b to d8/d9/d14/d16/l57 0 2024-08-18T22:48:54.566 INFO:tasks.workunit.client.0.smithi121.stdout:6/253: creat d8/d9/d14/d16/d3f/f58 x:0 0 0 2024-08-18T22:48:54.667 INFO:tasks.workunit.client.0.smithi121.stdout:6/254: sync 2024-08-18T22:48:54.668 INFO:tasks.workunit.client.0.smithi121.stdout:6/255: read d8/d9/d24/d25/d28/f32 [3213238,58716] 0 2024-08-18T22:48:54.673 INFO:tasks.workunit.client.0.smithi121.stdout:6/256: dwrite d8/d9/d24/d25/d28/f39 [0,4194304] 0 2024-08-18T22:48:54.810 INFO:tasks.workunit.client.0.smithi121.stdout:6/257: sync 2024-08-18T22:48:54.811 INFO:tasks.workunit.client.0.smithi121.stdout:6/258: chown d8/d9/d14/d16 6479 1 2024-08-18T22:48:54.812 INFO:tasks.workunit.client.0.smithi121.stdout:6/259: symlink d8/d9/d14/d16/d1e/l59 0 2024-08-18T22:48:54.814 INFO:tasks.workunit.client.0.smithi121.stdout:6/260: mkdir d8/d9/d27/d5a 0 2024-08-18T22:48:54.816 INFO:tasks.workunit.client.0.smithi121.stdout:6/261: symlink d8/d9/d24/l5b 0 2024-08-18T22:48:54.817 INFO:tasks.workunit.client.0.smithi121.stdout:6/262: creat d8/d9/d37/f5c x:0 0 0 2024-08-18T22:48:54.818 INFO:tasks.workunit.client.0.smithi121.stdout:6/263: mknod d8/d9/c5d 0 2024-08-18T22:48:54.821 INFO:tasks.workunit.client.0.smithi121.stdout:6/264: link d8/d9/c2d d8/d9/d14/d16/d1e/c5e 0 2024-08-18T22:48:54.934 INFO:tasks.workunit.client.0.smithi121.stdout:6/265: sync 2024-08-18T22:48:54.936 INFO:tasks.workunit.client.0.smithi121.stdout:6/266: symlink d8/d9/d27/d2b/l5f 0 2024-08-18T22:48:54.941 INFO:tasks.workunit.client.0.smithi121.stdout:6/267: truncate d8/f19 958103 0 2024-08-18T22:48:54.942 INFO:tasks.workunit.client.0.smithi121.stdout:6/268: readlink d8/d9/l1b 0 2024-08-18T22:48:54.943 INFO:tasks.workunit.client.0.smithi121.stdout:6/269: write d8/d9/d37/f5c [68137,107093] 0 2024-08-18T22:48:54.944 INFO:tasks.workunit.client.0.smithi121.stdout:6/270: creat d8/d9/d24/d3c/f60 x:0 0 0 2024-08-18T22:48:54.947 INFO:tasks.workunit.client.0.smithi121.stdout:6/271: dread d8/d9/f13 [0,4194304] 0 2024-08-18T22:48:54.949 INFO:tasks.workunit.client.0.smithi121.stdout:6/272: truncate d8/d9/d27/d2c/f50 623842 0 2024-08-18T22:48:54.951 INFO:tasks.workunit.client.0.smithi121.stdout:6/273: mkdir d8/d9/d27/d2b/d61 0 2024-08-18T22:48:54.951 INFO:tasks.workunit.client.0.smithi121.stdout:6/274: dread - d8/f56 zero size 2024-08-18T22:48:54.953 INFO:tasks.workunit.client.0.smithi121.stdout:6/275: creat d8/d9/d14/f62 x:0 0 0 2024-08-18T22:48:54.954 INFO:tasks.workunit.client.0.smithi121.stdout:6/276: truncate d8/d9/d27/d2c/f42 842372 0 2024-08-18T22:48:54.954 INFO:tasks.workunit.client.0.smithi121.stdout:6/277: chown d8/d9/d27/d2b/d61 5235 1 2024-08-18T22:48:54.956 INFO:tasks.workunit.client.0.smithi121.stdout:6/278: unlink d8/le 0 2024-08-18T22:48:54.957 INFO:tasks.workunit.client.0.smithi121.stdout:6/279: chown d8/d9/d24/d3c/f60 119 1 2024-08-18T22:48:54.962 INFO:tasks.workunit.client.0.smithi121.stdout:6/280: dwrite d8/d9/fc [0,4194304] 0 2024-08-18T22:48:54.969 INFO:tasks.workunit.client.0.smithi121.stdout:6/281: write d8/d9/d24/d25/d28/f32 [3361466,103337] 0 2024-08-18T22:48:54.970 INFO:tasks.workunit.client.0.smithi121.stdout:6/282: write d8/d9/d14/f62 [373575,117433] 0 2024-08-18T22:48:54.975 INFO:tasks.workunit.client.0.smithi121.stdout:6/283: write d8/f21 [2874392,89609] 0 2024-08-18T22:48:54.976 INFO:tasks.workunit.client.0.smithi121.stdout:6/284: stat d8/d9/d14/d16/d1e/f23 0 2024-08-18T22:48:54.977 INFO:tasks.workunit.client.0.smithi121.stdout:6/285: write d8/f21 [872845,11084] 0 2024-08-18T22:48:54.979 INFO:tasks.workunit.client.0.smithi121.stdout:6/286: link d8/d9/d27/c35 d8/d9/d24/c63 0 2024-08-18T22:48:54.981 INFO:tasks.workunit.client.0.smithi121.stdout:6/287: rmdir d8/d9/d24/d3a 39 2024-08-18T22:48:54.983 INFO:tasks.workunit.client.0.smithi121.stdout:6/288: mknod d8/d9/d27/c64 0 2024-08-18T22:48:54.984 INFO:tasks.workunit.client.0.smithi121.stdout:6/289: write d8/d9/d14/f62 [1152395,44335] 0 2024-08-18T22:48:54.989 INFO:tasks.workunit.client.0.smithi121.stdout:6/290: dwrite d8/d9/d14/f26 [4194304,4194304] 0 2024-08-18T22:48:54.994 INFO:tasks.workunit.client.0.smithi121.stdout:6/291: dwrite d8/d9/d27/d2c/f42 [0,4194304] 0 2024-08-18T22:48:55.008 INFO:tasks.workunit.client.0.smithi121.stdout:6/292: dwrite d8/f19 [0,4194304] 0 2024-08-18T22:48:55.010 INFO:tasks.workunit.client.0.smithi121.stdout:6/293: truncate d8/d9/d14/d16/d3f/f58 54594 0 2024-08-18T22:48:55.011 INFO:tasks.workunit.client.0.smithi121.stdout:6/294: readlink d8/d9/d14/d16/l34 0 2024-08-18T22:48:55.012 INFO:tasks.workunit.client.0.smithi121.stdout:6/295: mkdir d8/d9/d24/d3c/d65 0 2024-08-18T22:48:55.015 INFO:tasks.workunit.client.0.smithi121.stdout:6/296: rmdir d8/d9/d14 39 2024-08-18T22:48:55.017 INFO:tasks.workunit.client.0.smithi121.stdout:6/297: mkdir d8/d9/d27/d2c/d66 0 2024-08-18T22:48:55.022 INFO:tasks.workunit.client.0.smithi121.stdout:6/298: dwrite d8/d9/d27/d2b/f4e [0,4194304] 0 2024-08-18T22:48:55.028 INFO:tasks.workunit.client.0.smithi121.stdout:6/299: dread d8/d9/d14/f26 [4194304,4194304] 0 2024-08-18T22:48:55.031 INFO:tasks.workunit.client.0.smithi121.stdout:6/300: mknod d8/d9/c67 0 2024-08-18T22:48:55.035 INFO:tasks.workunit.client.0.smithi121.stdout:6/301: dwrite d8/f56 [0,4194304] 0 2024-08-18T22:48:55.037 INFO:tasks.workunit.client.0.smithi121.stdout:6/302: creat d8/d9/d27/d2b/f68 x:0 0 0 2024-08-18T22:48:55.111 INFO:tasks.workunit.client.0.smithi121.stdout:6/303: sync 2024-08-18T22:48:55.112 INFO:tasks.workunit.client.0.smithi121.stdout:6/304: chown d8/d9/d27/c35 4 1 2024-08-18T22:48:55.113 INFO:tasks.workunit.client.0.smithi121.stdout:6/305: write d8/d9/d24/d3c/f60 [1032829,109049] 0 2024-08-18T22:48:55.115 INFO:tasks.workunit.client.0.smithi121.stdout:6/306: symlink d8/d9/d27/d46/l69 0 2024-08-18T22:48:55.117 INFO:tasks.workunit.client.0.smithi121.stdout:6/307: link d8/f56 d8/d9/d37/f6a 0 2024-08-18T22:48:55.118 INFO:tasks.workunit.client.0.smithi121.stdout:6/308: fdatasync d8/d9/d24/d3c/f60 0 2024-08-18T22:48:55.120 INFO:tasks.workunit.client.0.smithi121.stdout:6/309: getdents d8/d9/d14/d16/d1e 0 2024-08-18T22:48:55.125 INFO:tasks.workunit.client.0.smithi121.stdout:6/310: dwrite d8/d9/d27/f40 [0,4194304] 0 2024-08-18T22:48:55.127 INFO:tasks.workunit.client.0.smithi121.stdout:6/311: creat d8/d9/d27/d2c/f6b x:0 0 0 2024-08-18T22:48:55.129 INFO:tasks.workunit.client.0.smithi121.stdout:6/312: unlink d8/d9/d14/l18 0 2024-08-18T22:48:55.129 INFO:tasks.workunit.client.0.smithi121.stdout:6/313: dread - d8/d9/d37/f44 zero size 2024-08-18T22:48:55.130 INFO:tasks.workunit.client.0.smithi121.stdout:6/314: dread - d8/d9/d27/d2c/f6b zero size 2024-08-18T22:48:55.130 INFO:tasks.workunit.client.0.smithi121.stdout:6/315: fsync d8/d9/d27/d2b/f68 0 2024-08-18T22:48:55.133 INFO:tasks.workunit.client.0.smithi121.stdout:6/316: rename d8/d9/fc to d8/d9/d27/d2b/f6c 0 2024-08-18T22:48:55.278 INFO:tasks.workunit.client.0.smithi121.stdout:6/317: sync 2024-08-18T22:48:55.287 INFO:tasks.workunit.client.0.smithi121.stdout:6/318: dwrite d8/d9/f30 [0,4194304] 0 2024-08-18T22:48:55.288 INFO:tasks.workunit.client.0.smithi121.stdout:6/319: dread - d8/d9/d24/d25/f54 zero size 2024-08-18T22:48:55.290 INFO:tasks.workunit.client.0.smithi121.stdout:6/320: creat d8/d9/d27/d2c/d66/f6d x:0 0 0 2024-08-18T22:48:55.294 INFO:tasks.workunit.client.0.smithi121.stdout:6/321: dread d8/d9/d24/d3c/f60 [0,4194304] 0 2024-08-18T22:48:55.296 INFO:tasks.workunit.client.0.smithi121.stdout:6/322: mknod d8/d9/d37/c6e 0 2024-08-18T22:48:55.301 INFO:tasks.workunit.client.0.smithi121.stdout:6/323: dwrite d8/d9/d24/d25/d28/f32 [0,4194304] 0 2024-08-18T22:48:55.303 INFO:tasks.workunit.client.0.smithi121.stdout:6/324: creat d8/d9/d37/f6f x:0 0 0 2024-08-18T22:48:55.304 INFO:tasks.workunit.client.0.smithi121.stdout:6/325: write d8/d9/d27/f40 [2787811,105542] 0 2024-08-18T22:48:55.309 INFO:tasks.workunit.client.0.smithi121.stdout:6/326: creat d8/d9/d14/f70 x:0 0 0 2024-08-18T22:48:55.311 INFO:tasks.workunit.client.0.smithi121.stdout:6/327: mknod d8/d9/d14/d16/d3f/c71 0 2024-08-18T22:48:55.313 INFO:tasks.workunit.client.0.smithi121.stdout:6/328: creat d8/d9/d27/d2b/d61/f72 x:0 0 0 2024-08-18T22:48:55.314 INFO:tasks.workunit.client.0.smithi121.stdout:6/329: symlink d8/d9/d27/d2b/l73 0 2024-08-18T22:48:55.316 INFO:tasks.workunit.client.0.smithi121.stdout:6/330: mkdir d8/d9/d24/d3c/d74 0 2024-08-18T22:48:55.317 INFO:tasks.workunit.client.0.smithi121.stdout:6/331: truncate d8/d9/d27/d2b/f4e 4312292 0 2024-08-18T22:48:55.319 INFO:tasks.workunit.client.0.smithi121.stdout:6/332: rename d8/d9/d24/d3c/f3e to d8/d9/d37/f75 0 2024-08-18T22:48:55.322 INFO:tasks.workunit.client.0.smithi121.stdout:6/333: dread d8/f15 [0,4194304] 0 2024-08-18T22:48:55.322 INFO:tasks.workunit.client.0.smithi121.stdout:6/334: chown d8/d9/d37/f75 24230570 1 2024-08-18T22:48:55.325 INFO:tasks.workunit.client.0.smithi121.stdout:6/335: getdents d8/d9/d14/d16 0 2024-08-18T22:48:55.326 INFO:tasks.workunit.client.0.smithi121.stdout:6/336: symlink d8/d9/d14/l76 0 2024-08-18T22:48:55.335 INFO:tasks.workunit.client.0.smithi121.stdout:6/337: dwrite d8/d9/d24/f43 [0,4194304] 0 2024-08-18T22:48:55.336 INFO:tasks.workunit.client.0.smithi121.stdout:6/338: chown d8/d9/d14/d16/d1e 6384828 1 2024-08-18T22:48:55.342 INFO:tasks.workunit.client.0.smithi121.stdout:6/339: dwrite d8/d9/f13 [0,4194304] 0 2024-08-18T22:48:55.343 INFO:tasks.workunit.client.0.smithi121.stdout:6/340: read d8/d9/f13 [2051949,47426] 0 2024-08-18T22:48:55.345 INFO:tasks.workunit.client.0.smithi121.stdout:6/341: symlink d8/d9/d24/d25/l77 0 2024-08-18T22:48:55.347 INFO:tasks.workunit.client.0.smithi121.stdout:6/342: mknod d8/d9/d27/d2c/d66/c78 0 2024-08-18T22:48:55.351 INFO:tasks.workunit.client.0.smithi121.stdout:6/343: rmdir d8/d9/d27/d5a 0 2024-08-18T22:48:55.355 INFO:tasks.workunit.client.0.smithi121.stdout:6/344: link d8/d9/d24/c63 d8/d9/d24/d3a/c79 0 2024-08-18T22:48:55.356 INFO:tasks.workunit.client.0.smithi121.stdout:6/345: write d8/d9/d14/f26 [6411732,7356] 0 2024-08-18T22:48:55.361 INFO:tasks.workunit.client.0.smithi121.stdout:6/346: dwrite d8/d9/d27/d2c/f6b [0,4194304] 0 2024-08-18T22:48:55.363 INFO:tasks.workunit.client.0.smithi121.stdout:6/347: truncate d8/d9/d14/f70 195760 0 2024-08-18T22:48:55.364 INFO:tasks.workunit.client.0.smithi121.stdout:6/348: write d8/d9/d24/d25/d28/f39 [5123228,76816] 0 2024-08-18T22:48:55.366 INFO:tasks.workunit.client.0.smithi121.stdout:6/349: truncate d8/d9/d27/d2b/f68 583967 0 2024-08-18T22:48:55.366 INFO:tasks.workunit.client.0.smithi121.stdout:6/350: chown d8/d9/d27/d2c/f50 8992510 1 2024-08-18T22:48:55.369 INFO:tasks.workunit.client.0.smithi121.stdout:6/351: dread d8/f15 [4194304,4194304] 0 2024-08-18T22:48:55.372 INFO:tasks.workunit.client.0.smithi121.stdout:6/352: link d8/d9/d27/d2b/l5f d8/d9/d24/d3a/l7a 0 2024-08-18T22:48:55.373 INFO:tasks.workunit.client.0.smithi121.stdout:6/353: chown d8/d9/d24/d25/f45 86967 1 2024-08-18T22:48:55.377 INFO:tasks.workunit.client.0.smithi121.stdout:6/354: dwrite d8/d9/d37/f6f [0,4194304] 0 2024-08-18T22:48:55.379 INFO:tasks.workunit.client.0.smithi121.stdout:6/355: write d8/d9/d14/d16/f51 [743176,130322] 0 2024-08-18T22:48:55.382 INFO:tasks.workunit.client.0.smithi121.stdout:6/356: creat d8/d9/d14/d16/d1e/f7b x:0 0 0 2024-08-18T22:48:55.383 INFO:tasks.workunit.client.0.smithi121.stdout:6/357: truncate d8/d9/d37/f5c 1043664 0 2024-08-18T22:48:55.384 INFO:tasks.workunit.client.0.smithi121.stdout:6/358: truncate d8/d9/d27/d2b/f4e 4515323 0 2024-08-18T22:48:55.386 INFO:tasks.workunit.client.0.smithi121.stdout:6/359: mkdir d8/d9/d14/d16/d3f/d7c 0 2024-08-18T22:48:55.388 INFO:tasks.workunit.client.0.smithi121.stdout:6/360: creat d8/d9/d24/d3c/d74/f7d x:0 0 0 2024-08-18T22:48:55.389 INFO:tasks.workunit.client.0.smithi121.stdout:6/361: write d8/d9/f13 [5104200,29061] 0 2024-08-18T22:48:55.391 INFO:tasks.workunit.client.0.smithi121.stdout:6/362: symlink d8/d9/d27/d2b/l7e 0 2024-08-18T22:48:55.392 INFO:tasks.workunit.client.0.smithi121.stdout:6/363: readlink d8/d9/d24/d3a/l7a 0 2024-08-18T22:48:55.397 INFO:tasks.workunit.client.0.smithi121.stdout:6/364: truncate d8/d9/d14/d16/f51 194245 0 2024-08-18T22:48:55.398 INFO:tasks.workunit.client.0.smithi121.stdout:6/365: mknod d8/d9/d24/d25/d28/c7f 0 2024-08-18T22:48:55.399 INFO:tasks.workunit.client.0.smithi121.stdout:6/366: chown d8/d9/d24/d3a/l7a 4095104 1 2024-08-18T22:48:55.400 INFO:tasks.workunit.client.0.smithi121.stdout:6/367: write d8/d9/d14/d16/d1e/f7b [461645,56959] 0 2024-08-18T22:48:55.401 INFO:tasks.workunit.client.0.smithi121.stdout:6/368: truncate d8/d9/d24/d3a/f52 852968 0 2024-08-18T22:48:55.404 INFO:tasks.workunit.client.0.smithi121.stdout:6/369: link d8/d9/d14/f26 d8/d9/d14/d16/d1e/f80 0 2024-08-18T22:48:55.407 INFO:tasks.workunit.client.0.smithi121.stdout:6/370: dread d8/f56 [0,4194304] 0 2024-08-18T22:48:55.412 INFO:tasks.workunit.client.0.smithi121.stdout:6/371: dwrite d8/d9/d24/f47 [4194304,4194304] 0 2024-08-18T22:48:55.414 INFO:tasks.workunit.client.0.smithi121.stdout:6/372: mkdir d8/d9/d24/d3a/d81 0 2024-08-18T22:48:55.415 INFO:tasks.workunit.client.0.smithi121.stdout:6/373: write d8/d9/d27/d2c/f6b [1840098,681] 0 2024-08-18T22:48:55.420 INFO:tasks.workunit.client.0.smithi121.stdout:6/374: dwrite d8/d9/d24/d25/d28/f39 [0,4194304] 0 2024-08-18T22:48:55.423 INFO:tasks.workunit.client.0.smithi121.stdout:6/375: creat d8/d9/d24/d25/f82 x:0 0 0 2024-08-18T22:48:55.425 INFO:tasks.workunit.client.0.smithi121.stdout:6/376: mkdir d8/d9/d14/d16/d3f/d7c/d83 0 2024-08-18T22:48:55.427 INFO:tasks.workunit.client.0.smithi121.stdout:6/377: mknod d8/d9/d37/c84 0 2024-08-18T22:48:55.430 INFO:tasks.workunit.client.0.smithi121.stdout:6/378: rename d8/d9/d27/d2c/c4c to d8/d9/d37/c85 0 2024-08-18T22:48:55.432 INFO:tasks.workunit.client.0.smithi121.stdout:6/379: unlink d8/d9/d37/d48/l53 0 2024-08-18T22:48:55.433 INFO:tasks.workunit.client.0.smithi121.stdout:6/380: symlink d8/d9/d37/d48/l86 0 2024-08-18T22:48:55.435 INFO:tasks.workunit.client.0.smithi121.stdout:6/381: creat d8/d9/d27/d2b/d61/f87 x:0 0 0 2024-08-18T22:48:55.436 INFO:tasks.workunit.client.0.smithi121.stdout:6/382: write d8/d9/d24/f47 [7447273,11763] 0 2024-08-18T22:48:55.438 INFO:tasks.workunit.client.0.smithi121.stdout:6/383: creat d8/d9/d27/d46/f88 x:0 0 0 2024-08-18T22:48:55.439 INFO:tasks.workunit.client.0.smithi121.stdout:6/384: creat d8/d9/d24/d25/d28/f89 x:0 0 0 2024-08-18T22:48:55.441 INFO:tasks.workunit.client.0.smithi121.stdout:6/385: mknod d8/d9/c8a 0 2024-08-18T22:48:55.445 INFO:tasks.workunit.client.0.smithi121.stdout:6/386: dwrite d8/d9/f13 [0,4194304] 0 2024-08-18T22:48:55.447 INFO:tasks.workunit.client.0.smithi121.stdout:6/387: mkdir d8/d9/d14/d16/d8b 0 2024-08-18T22:48:55.449 INFO:tasks.workunit.client.0.smithi121.stdout:6/388: mkdir d8/d9/d27/d8c 0 2024-08-18T22:48:55.451 INFO:tasks.workunit.client.0.smithi121.stdout:6/389: creat d8/f8d x:0 0 0 2024-08-18T22:48:55.453 INFO:tasks.workunit.client.0.smithi121.stdout:6/390: creat d8/d9/d27/d2c/d66/f8e x:0 0 0 2024-08-18T22:48:55.454 INFO:tasks.workunit.client.0.smithi121.stdout:6/391: chown d8/l29 39395046 1 2024-08-18T22:48:55.455 INFO:tasks.workunit.client.0.smithi121.stdout:6/392: symlink d8/d9/d37/l8f 0 2024-08-18T22:48:55.456 INFO:tasks.workunit.client.0.smithi121.stdout:6/393: fsync d8/d9/d27/d2c/f6b 0 2024-08-18T22:48:55.457 INFO:tasks.workunit.client.0.smithi121.stdout:6/394: write d8/d9/d27/f40 [663494,72028] 0 2024-08-18T22:48:55.457 INFO:tasks.workunit.client.0.smithi121.stdout:6/395: stat d8/d9/f13 0 2024-08-18T22:48:55.459 INFO:tasks.workunit.client.0.smithi121.stdout:6/396: symlink d8/d9/d24/d3a/d81/l90 0 2024-08-18T22:48:55.460 INFO:tasks.workunit.client.0.smithi121.stdout:6/397: write d8/d9/d37/f6f [3123488,20639] 0 2024-08-18T22:48:55.463 INFO:tasks.workunit.client.0.smithi121.stdout:6/398: unlink d8/d9/d27/d2b/f4e 0 2024-08-18T22:48:55.466 INFO:tasks.workunit.client.0.smithi121.stdout:6/399: unlink d8/d9/d24/d3a/d81/l90 0 2024-08-18T22:48:55.469 INFO:tasks.workunit.client.0.smithi121.stdout:6/400: mknod d8/d9/d27/d46/c91 0 2024-08-18T22:48:55.471 INFO:tasks.workunit.client.0.smithi121.stdout:6/401: symlink d8/d9/d27/d2b/l92 0 2024-08-18T22:48:55.477 INFO:tasks.workunit.client.0.smithi121.stdout:6/402: dwrite d8/d9/d27/d2c/d66/f8e [0,4194304] 0 2024-08-18T22:48:55.479 INFO:tasks.workunit.client.0.smithi121.stdout:6/403: symlink d8/d9/d24/d3c/l93 0 2024-08-18T22:48:55.486 INFO:tasks.workunit.client.0.smithi121.stdout:6/404: dwrite d8/d9/d27/d2c/f6b [0,4194304] 0 2024-08-18T22:48:55.488 INFO:tasks.workunit.client.0.smithi121.stdout:6/405: creat d8/d9/d27/d46/f94 x:0 0 0 2024-08-18T22:48:55.494 INFO:tasks.workunit.client.0.smithi121.stdout:6/406: write d8/f56 [829295,23393] 0 2024-08-18T22:48:55.571 INFO:tasks.workunit.client.0.smithi121.stdout:6/407: sync 2024-08-18T22:48:55.573 INFO:tasks.workunit.client.0.smithi121.stdout:6/408: creat d8/d9/d14/d16/d8b/f95 x:0 0 0 2024-08-18T22:48:55.573 INFO:tasks.workunit.client.0.smithi121.stdout:6/409: dread - d8/f8d zero size 2024-08-18T22:48:55.576 INFO:tasks.workunit.client.0.smithi121.stdout:6/410: link d8/d9/d27/d2c/f42 d8/d9/d14/d16/d3f/d7c/d83/f96 0 2024-08-18T22:48:55.578 INFO:tasks.workunit.client.0.smithi121.stdout:6/411: symlink d8/d9/d24/d3a/l97 0 2024-08-18T22:48:55.578 INFO:tasks.workunit.client.0.smithi121.stdout:6/412: dread - d8/d9/d24/d25/f45 zero size 2024-08-18T22:48:55.578 INFO:tasks.workunit.client.0.smithi121.stdout:6/413: chown d8/d9/f13 2879 1 2024-08-18T22:48:55.579 INFO:tasks.workunit.client.0.smithi121.stdout:6/414: readlink d8/d9/d14/d16/l34 0 2024-08-18T22:48:55.579 INFO:tasks.workunit.client.0.smithi121.stdout:6/415: chown d8/d9/d27/d2b/l73 584673735 1 2024-08-18T22:48:55.582 INFO:tasks.workunit.client.0.smithi121.stdout:6/416: dread d8/f21 [0,4194304] 0 2024-08-18T22:48:55.583 INFO:tasks.workunit.client.0.smithi121.stdout:6/417: chown d8/d9/d14/d16/d1e/c5e 0 1 2024-08-18T22:48:55.588 INFO:tasks.workunit.client.0.smithi121.stdout:6/418: dwrite d8/d9/d27/d2b/d61/f87 [0,4194304] 0 2024-08-18T22:48:55.589 INFO:tasks.workunit.client.0.smithi121.stdout:6/419: chown d8/d9/d14/l76 2383 1 2024-08-18T22:48:55.591 INFO:tasks.workunit.client.0.smithi121.stdout:6/420: creat d8/d9/d14/d16/d8b/f98 x:0 0 0 2024-08-18T22:48:55.592 INFO:tasks.workunit.client.0.smithi121.stdout:6/421: mknod d8/d9/d24/d25/d28/c99 0 2024-08-18T22:48:55.594 INFO:tasks.workunit.client.0.smithi121.stdout:6/422: unlink d8/d9/d24/l5b 0 2024-08-18T22:48:55.597 INFO:tasks.workunit.client.0.smithi121.stdout:6/423: mkdir d8/d9/d14/d16/d1e/d9a 0 2024-08-18T22:48:55.601 INFO:tasks.workunit.client.0.smithi121.stdout:6/424: dread d8/d9/d14/f62 [0,4194304] 0 2024-08-18T22:48:55.602 INFO:tasks.workunit.client.0.smithi121.stdout:6/425: creat d8/d9/d27/d46/f9b x:0 0 0 2024-08-18T22:48:55.603 INFO:tasks.workunit.client.0.smithi121.stdout:6/426: read d8/f56 [714342,121620] 0 2024-08-18T22:48:55.604 INFO:tasks.workunit.client.0.smithi121.stdout:6/427: stat d8/d9/d14/d16/d3f 0 2024-08-18T22:48:55.605 INFO:tasks.workunit.client.0.smithi121.stdout:6/428: mkdir d8/d9/d27/d2b/d61/d9c 0 2024-08-18T22:48:55.606 INFO:tasks.workunit.client.0.smithi121.stdout:6/429: fdatasync d8/d9/d14/d16/d8b/f98 0 2024-08-18T22:48:55.607 INFO:tasks.workunit.client.0.smithi121.stdout:6/430: creat d8/d9/d27/d2b/d61/f9d x:0 0 0 2024-08-18T22:48:55.609 INFO:tasks.workunit.client.0.smithi121.stdout:6/431: creat d8/d9/d14/d16/d3f/f9e x:0 0 0 2024-08-18T22:48:55.610 INFO:tasks.workunit.client.0.smithi121.stdout:6/432: creat d8/d9/d24/d3a/f9f x:0 0 0 2024-08-18T22:48:55.611 INFO:tasks.workunit.client.0.smithi121.stdout:6/433: creat d8/d9/d24/d25/fa0 x:0 0 0 2024-08-18T22:48:55.620 INFO:tasks.workunit.client.0.smithi121.stdout:6/434: dwrite d8/d9/d27/d2c/f42 [4194304,4194304] 0 2024-08-18T22:48:55.623 INFO:tasks.workunit.client.0.smithi121.stdout:6/435: mkdir d8/d9/d24/d3c/da1 0 2024-08-18T22:48:55.623 INFO:tasks.workunit.client.0.smithi121.stdout:6/436: dread - d8/d9/d24/d25/d28/f89 zero size 2024-08-18T22:48:55.625 INFO:tasks.workunit.client.0.smithi121.stdout:6/437: read - d8/f8d zero size 2024-08-18T22:48:55.626 INFO:tasks.workunit.client.0.smithi121.stdout:6/438: mkdir d8/d9/d24/d25/da2 0 2024-08-18T22:48:55.632 INFO:tasks.workunit.client.0.smithi121.stdout:6/439: dwrite d8/d9/d24/d25/f54 [0,4194304] 0 2024-08-18T22:48:55.634 INFO:tasks.workunit.client.0.smithi121.stdout:6/440: rename d8/d9/d27/c64 to d8/d9/d37/ca3 0 2024-08-18T22:48:55.636 INFO:tasks.workunit.client.0.smithi121.stdout:6/441: chown d8/d9/d24/d3c/d74/f7d 494 1 2024-08-18T22:48:55.640 INFO:tasks.workunit.client.0.smithi121.stdout:6/442: dread d8/d9/d27/d2c/d66/f8e [0,4194304] 0 2024-08-18T22:48:55.642 INFO:tasks.workunit.client.0.smithi121.stdout:6/443: symlink d8/d9/d27/d2c/d66/la4 0 2024-08-18T22:48:55.643 INFO:tasks.workunit.client.0.smithi121.stdout:6/444: creat d8/d9/d24/d25/fa5 x:0 0 0 2024-08-18T22:48:55.646 INFO:tasks.workunit.client.0.smithi121.stdout:6/445: rename d8/d9/d14/d16/d3f/d7c/d83/f96 to d8/d9/d24/d25/da2/fa6 0 2024-08-18T22:48:55.648 INFO:tasks.workunit.client.0.smithi121.stdout:6/446: unlink d8/d9/d14/d16/d1e/f7b 0 2024-08-18T22:48:55.650 INFO:tasks.workunit.client.0.smithi121.stdout:6/447: mkdir d8/d9/d24/d3a/da7 0 2024-08-18T22:48:55.650 INFO:tasks.workunit.client.0.smithi121.stdout:6/448: readlink d8/d9/d24/d3c/l93 0 2024-08-18T22:48:55.652 INFO:tasks.workunit.client.0.smithi121.stdout:6/449: creat d8/d9/d27/d2b/d61/d9c/fa8 x:0 0 0 2024-08-18T22:48:55.652 INFO:tasks.workunit.client.0.smithi121.stdout:6/450: dread - d8/d9/d14/d16/d8b/f95 zero size 2024-08-18T22:48:55.655 INFO:tasks.workunit.client.0.smithi121.stdout:6/451: truncate d8/d9/d14/d16/f51 348527 0 2024-08-18T22:48:55.658 INFO:tasks.workunit.client.0.smithi121.stdout:6/452: rename d8/d9/d14/d16/l57 to d8/la9 0 2024-08-18T22:48:55.659 INFO:tasks.workunit.client.0.smithi121.stdout:6/453: mknod d8/d9/d27/d2c/d66/caa 0 2024-08-18T22:48:55.661 INFO:tasks.workunit.client.0.smithi121.stdout:6/454: mkdir d8/d9/d24/dab 0 2024-08-18T22:48:55.662 INFO:tasks.workunit.client.0.smithi121.stdout:6/455: mknod d8/d9/d24/d25/cac 0 2024-08-18T22:48:55.663 INFO:tasks.workunit.client.0.smithi121.stdout:6/456: fsync d8/d9/d27/d2c/f50 0 2024-08-18T22:48:55.664 INFO:tasks.workunit.client.0.smithi121.stdout:6/457: write d8/d9/d24/d25/f45 [1017666,117063] 0 2024-08-18T22:48:55.664 INFO:tasks.workunit.client.0.smithi121.stdout:6/458: chown d8/d9/d37/f5c 219 1 2024-08-18T22:48:55.665 INFO:tasks.workunit.client.0.smithi121.stdout:6/459: write d8/d9/d27/d46/f88 [897261,37074] 0 2024-08-18T22:48:55.666 INFO:tasks.workunit.client.0.smithi121.stdout:6/460: write d8/d9/d24/d25/f54 [167351,10985] 0 2024-08-18T22:48:55.672 INFO:tasks.workunit.client.0.smithi121.stdout:6/461: dwrite d8/d9/d24/d25/f82 [0,4194304] 0 2024-08-18T22:48:55.675 INFO:tasks.workunit.client.0.smithi121.stdout:6/462: getdents d8/d9 0 2024-08-18T22:48:55.677 INFO:tasks.workunit.client.0.smithi121.stdout:6/463: creat d8/d9/d24/d3a/fad x:0 0 0 2024-08-18T22:48:55.681 INFO:tasks.workunit.client.0.smithi121.stdout:6/464: getdents d8/d9/d24/d3a/d81 0 2024-08-18T22:48:55.682 INFO:tasks.workunit.client.0.smithi121.stdout:6/465: fsync d8/d9/d14/d16/d3f/f9e 0 2024-08-18T22:48:55.804 INFO:tasks.workunit.client.0.smithi121.stdout:6/466: sync 2024-08-18T22:48:55.806 INFO:tasks.workunit.client.0.smithi121.stdout:6/467: symlink d8/d9/d24/d25/d28/lae 0 2024-08-18T22:48:55.808 INFO:tasks.workunit.client.0.smithi121.stdout:6/468: rmdir d8/d9/d27/d8c 0 2024-08-18T22:48:55.810 INFO:tasks.workunit.client.0.smithi121.stdout:6/469: mkdir d8/d9/d24/d25/daf 0 2024-08-18T22:48:55.811 INFO:tasks.workunit.client.0.smithi121.stdout:6/470: symlink d8/d9/d24/d3c/da1/lb0 0 2024-08-18T22:48:55.816 INFO:tasks.workunit.client.0.smithi121.stdout:6/471: dwrite d8/d9/d24/d25/d28/f32 [0,4194304] 0 2024-08-18T22:48:55.820 INFO:tasks.workunit.client.0.smithi121.stdout:6/472: rename d8/d9/d14/d16/d8b/f98 to d8/d9/d24/d25/daf/fb1 0 2024-08-18T22:48:55.829 INFO:tasks.workunit.client.0.smithi121.stdout:6/473: dwrite d8/f56 [0,4194304] 0 2024-08-18T22:48:55.835 INFO:tasks.workunit.client.0.smithi121.stdout:6/474: dwrite d8/d9/d24/f47 [4194304,4194304] 0 2024-08-18T22:48:55.841 INFO:tasks.workunit.client.0.smithi121.stdout:6/475: dwrite d8/d9/d24/d25/f82 [0,4194304] 0 2024-08-18T22:48:55.844 INFO:tasks.workunit.client.0.smithi121.stdout:6/476: unlink d8/d9/d24/f47 0 2024-08-18T22:48:55.848 INFO:tasks.workunit.client.0.smithi121.stdout:6/477: dread d8/d9/d14/d16/d3f/f58 [0,4194304] 0 2024-08-18T22:48:55.852 INFO:tasks.workunit.client.0.smithi121.stdout:6/478: rename d8/d9/d14/d16/d8b/f95 to d8/d9/d24/d3c/d74/fb2 0 2024-08-18T22:48:55.853 INFO:tasks.workunit.client.0.smithi121.stdout:6/479: mknod d8/d9/d24/d25/d28/cb3 0 2024-08-18T22:48:55.857 INFO:tasks.workunit.client.0.smithi121.stdout:6/480: dread d8/d9/d14/f26 [0,4194304] 0 2024-08-18T22:48:55.859 INFO:tasks.workunit.client.0.smithi121.stdout:6/481: creat d8/d9/d14/d16/fb4 x:0 0 0 2024-08-18T22:48:55.862 INFO:tasks.workunit.client.0.smithi121.stdout:6/482: creat d8/d9/d24/d25/da2/fb5 x:0 0 0 2024-08-18T22:48:55.863 INFO:tasks.workunit.client.0.smithi121.stdout:6/483: write d8/d9/d27/d2b/f68 [1065723,121139] 0 2024-08-18T22:48:55.865 INFO:tasks.workunit.client.0.smithi121.stdout:6/484: creat d8/d9/d24/d3a/d81/fb6 x:0 0 0 2024-08-18T22:48:55.866 INFO:tasks.workunit.client.0.smithi121.stdout:6/485: read - d8/d9/d24/d3c/d74/f7d zero size 2024-08-18T22:48:55.868 INFO:tasks.workunit.client.0.smithi121.stdout:6/486: symlink d8/d9/d24/d3a/lb7 0 2024-08-18T22:48:55.870 INFO:tasks.workunit.client.0.smithi121.stdout:6/487: rename d8/d9/d27/d46/c91 to d8/d9/d24/d3c/d65/cb8 0 2024-08-18T22:48:55.874 INFO:tasks.workunit.client.0.smithi121.stdout:6/488: dwrite d8/d9/d24/d25/f82 [0,4194304] 0 2024-08-18T22:48:55.878 INFO:tasks.workunit.client.0.smithi121.stdout:6/489: creat d8/d9/d14/fb9 x:0 0 0 2024-08-18T22:48:55.879 INFO:tasks.workunit.client.0.smithi121.stdout:6/490: write d8/d9/d24/d25/d28/f89 [437081,93089] 0 2024-08-18T22:48:55.884 INFO:tasks.workunit.client.0.smithi121.stdout:6/491: rename d8/f56 to d8/d9/d24/fba 0 2024-08-18T22:48:55.886 INFO:tasks.workunit.client.0.smithi121.stdout:6/492: mkdir d8/d9/d24/d3c/d65/dbb 0 2024-08-18T22:48:55.888 INFO:tasks.workunit.client.0.smithi121.stdout:6/493: mkdir d8/d9/d24/d25/dbc 0 2024-08-18T22:48:55.894 INFO:tasks.workunit.client.0.smithi121.stdout:6/494: rename d8/d9/d14/d16 to d8/d9/d27/d46/dbd 0 2024-08-18T22:48:55.898 INFO:tasks.workunit.client.0.smithi121.stdout:6/495: write d8/d9/d14/f26 [5859499,124778] 0 2024-08-18T22:48:55.899 INFO:tasks.workunit.client.0.smithi121.stdout:6/496: dread - d8/d9/d24/d3a/fad zero size 2024-08-18T22:48:55.901 INFO:tasks.workunit.client.0.smithi121.stdout:6/497: mknod d8/d9/d24/d3c/cbe 0 2024-08-18T22:48:55.904 INFO:tasks.workunit.client.0.smithi121.stdout:6/498: dread d8/d9/d14/f26 [0,4194304] 0 2024-08-18T22:48:55.904 INFO:tasks.workunit.client.0.smithi121.stdout:6/499: fsync d8/d9/d24/d25/d28/f39 0 2024-08-18T22:48:55.905 INFO:tasks.workunit.client.0.smithi121.stdout:6/500: getdents d8/d9/d24/d3a/da7 0 2024-08-18T22:48:55.908 INFO:tasks.workunit.client.0.smithi121.stdout:6/501: getdents d8/d9/d27/d2b/d61 0 2024-08-18T22:48:55.909 INFO:tasks.workunit.client.0.smithi121.stdout:6/502: mknod d8/d9/d14/cbf 0 2024-08-18T22:48:55.913 INFO:tasks.workunit.client.0.smithi121.stdout:6/503: truncate d8/f19 2323407 0 2024-08-18T22:48:55.914 INFO:tasks.workunit.client.0.smithi121.stdout:6/504: dread - d8/d9/d24/d25/fa5 zero size 2024-08-18T22:48:55.916 INFO:tasks.workunit.client.0.smithi121.stdout:6/505: rename d8/d9/d27/f40 to d8/d9/d24/d3c/d65/fc0 0 2024-08-18T22:48:55.917 INFO:tasks.workunit.client.0.smithi121.stdout:6/506: readlink d8/d9/d27/d46/dbd/l34 0 2024-08-18T22:48:55.922 INFO:tasks.workunit.client.0.smithi121.stdout:6/507: dwrite d8/d9/d27/d46/f9b [0,4194304] 0 2024-08-18T22:48:55.926 INFO:tasks.workunit.client.0.smithi121.stdout:6/508: creat d8/d9/d24/d3a/da7/fc1 x:0 0 0 2024-08-18T22:48:55.927 INFO:tasks.workunit.client.0.smithi121.stdout:6/509: creat d8/d9/d24/d3a/d81/fc2 x:0 0 0 2024-08-18T22:48:55.931 INFO:tasks.workunit.client.0.smithi121.stdout:6/510: rename d8/d9/d24/d3c/d65/dbb to d8/d9/d24/dab/dc3 0 2024-08-18T22:48:56.023 INFO:tasks.workunit.client.0.smithi121.stdout:6/511: sync 2024-08-18T22:48:56.025 INFO:tasks.workunit.client.0.smithi121.stdout:6/512: creat d8/d9/d27/d2c/fc4 x:0 0 0 2024-08-18T22:48:56.027 INFO:tasks.workunit.client.0.smithi121.stdout:6/513: getdents d8/d9/d27/d46/dbd/d3f/d7c/d83 0 2024-08-18T22:48:56.030 INFO:tasks.workunit.client.0.smithi121.stdout:6/514: dread d8/d9/f30 [0,4194304] 0 2024-08-18T22:48:56.036 INFO:tasks.workunit.client.0.smithi121.stdout:6/515: dwrite d8/d9/d24/d25/fa0 [0,4194304] 0 2024-08-18T22:48:56.045 INFO:tasks.workunit.client.0.smithi121.stdout:6/516: dwrite d8/f19 [0,4194304] 0 2024-08-18T22:48:56.050 INFO:tasks.workunit.client.0.smithi121.stdout:6/517: dwrite d8/d9/d24/d3c/f60 [0,4194304] 0 2024-08-18T22:48:56.051 INFO:tasks.workunit.client.0.smithi121.stdout:6/518: stat d8/c1a 0 2024-08-18T22:48:56.052 INFO:tasks.workunit.client.0.smithi121.stdout:6/519: fdatasync d8/d9/d37/f6a 0 2024-08-18T22:48:56.054 INFO:tasks.workunit.client.0.smithi121.stdout:6/520: rmdir d8/d9/d24/d3c/d65 39 2024-08-18T22:48:56.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:48:55 smithi121 ceph-mon[81053]: pgmap v193: 65 pgs: 65 active+clean; 2.0 GiB data, 5.8 GiB used, 531 GiB / 536 GiB avail; 9.9 MiB/s rd, 2.6 MiB/s wr, 70 op/s 2024-08-18T22:48:56.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:48:55 smithi195 ceph-mon[68841]: pgmap v193: 65 pgs: 65 active+clean; 2.0 GiB data, 5.8 GiB used, 531 GiB / 536 GiB avail; 9.9 MiB/s rd, 2.6 MiB/s wr, 70 op/s 2024-08-18T22:48:56.161 INFO:tasks.workunit.client.0.smithi121.stdout:6/521: sync 2024-08-18T22:48:56.162 INFO:tasks.workunit.client.0.smithi121.stdout:6/522: write d8/d9/d27/d2c/f6b [1905971,33531] 0 2024-08-18T22:48:56.166 INFO:tasks.workunit.client.0.smithi121.stdout:6/523: dread d8/d9/d27/d2c/f42 [0,4194304] 0 2024-08-18T22:48:56.168 INFO:tasks.workunit.client.0.smithi121.stdout:6/524: mkdir d8/d9/d24/d25/daf/dc5 0 2024-08-18T22:48:56.173 INFO:tasks.workunit.client.0.smithi121.stdout:6/525: dwrite d8/d9/d14/f26 [8388608,4194304] 0 2024-08-18T22:48:56.174 INFO:tasks.workunit.client.0.smithi121.stdout:6/526: dread - d8/d9/d27/d2b/d61/d9c/fa8 zero size 2024-08-18T22:48:56.177 INFO:tasks.workunit.client.0.smithi121.stdout:6/527: rename d8/d9/d27/d46/dbd/l34 to d8/d9/d24/d25/lc6 0 2024-08-18T22:48:56.179 INFO:tasks.workunit.client.0.smithi121.stdout:6/528: fdatasync d8/d9/d27/d2b/d61/f9d 0 2024-08-18T22:48:56.182 INFO:tasks.workunit.client.0.smithi121.stdout:6/529: link d8/d9/d24/d25/d28/f32 d8/d9/d27/d2c/d66/fc7 0 2024-08-18T22:48:56.183 INFO:tasks.workunit.client.0.smithi121.stdout:6/530: creat d8/d9/d27/d46/dbd/d8b/fc8 x:0 0 0 2024-08-18T22:48:56.187 INFO:tasks.workunit.client.0.smithi121.stdout:6/531: dread d8/d9/d24/d25/da2/fa6 [0,4194304] 0 2024-08-18T22:48:56.189 INFO:tasks.workunit.client.0.smithi121.stdout:6/532: write d8/d9/d24/d25/da2/fa6 [4973315,9366] 0 2024-08-18T22:48:56.191 INFO:tasks.workunit.client.0.smithi121.stdout:6/533: mkdir d8/d9/d27/d2c/d66/dc9 0 2024-08-18T22:48:56.192 INFO:tasks.workunit.client.0.smithi121.stdout:6/534: fdatasync d8/f21 0 2024-08-18T22:48:56.194 INFO:tasks.workunit.client.0.smithi121.stdout:6/535: symlink d8/d9/d24/lca 0 2024-08-18T22:48:56.194 INFO:tasks.workunit.client.0.smithi121.stdout:6/536: chown d8/d9/d27/d46/f88 743 1 2024-08-18T22:48:56.195 INFO:tasks.workunit.client.0.smithi121.stdout:6/537: readlink d8/d9/d24/d3c/da1/lb0 0 2024-08-18T22:48:56.197 INFO:tasks.workunit.client.0.smithi121.stdout:6/538: link d8/d9/d27/d46/dbd/d1e/c5e d8/d9/ccb 0 2024-08-18T22:48:56.204 INFO:tasks.workunit.client.0.smithi121.stdout:6/539: write d8/d9/d27/d46/f9b [4073314,100605] 0 2024-08-18T22:48:56.205 INFO:tasks.workunit.client.0.smithi121.stdout:6/540: stat d8/d9/l1b 0 2024-08-18T22:48:56.205 INFO:tasks.workunit.client.0.smithi121.stdout:6/541: stat d8/d9/d27/d2c/f42 0 2024-08-18T22:48:56.406 INFO:tasks.workunit.client.0.smithi121.stdout:6/542: sync 2024-08-18T22:48:56.408 INFO:tasks.workunit.client.0.smithi121.stdout:6/543: fdatasync d8/d9/d24/d25/f82 0 2024-08-18T22:48:56.414 INFO:tasks.workunit.client.0.smithi121.stdout:6/544: dwrite d8/d9/d27/d2c/d66/f8e [0,4194304] 0 2024-08-18T22:48:56.415 INFO:tasks.workunit.client.0.smithi121.stdout:6/545: chown d8/d9/d27/d2b/l92 3126056 1 2024-08-18T22:48:56.423 INFO:tasks.workunit.client.0.smithi121.stdout:6/546: dwrite d8/d9/d27/d2c/fc4 [0,4194304] 0 2024-08-18T22:48:56.427 INFO:tasks.workunit.client.0.smithi121.stdout:6/547: unlink d8/d9/d24/d3c/d74/f7d 0 2024-08-18T22:48:56.428 INFO:tasks.workunit.client.0.smithi121.stdout:6/548: stat d8/d9/d24/d3c/d74/fb2 0 2024-08-18T22:48:56.431 INFO:tasks.workunit.client.0.smithi121.stdout:6/549: mkdir d8/d9/d24/dab/dc3/dcc 0 2024-08-18T22:48:56.432 INFO:tasks.workunit.client.0.smithi121.stdout:6/550: truncate d8/d9/f13 5429539 0 2024-08-18T22:48:56.434 INFO:tasks.workunit.client.0.smithi121.stdout:6/551: mkdir d8/d9/d24/dab/dc3/dcc/dcd 0 2024-08-18T22:48:56.435 INFO:tasks.workunit.client.0.smithi121.stdout:6/552: mknod d8/cce 0 2024-08-18T22:48:56.440 INFO:tasks.workunit.client.0.smithi121.stdout:6/553: getdents d8/d9/d24/dab/dc3/dcc 0 2024-08-18T22:48:56.441 INFO:tasks.workunit.client.0.smithi121.stdout:6/554: truncate d8/d9/d24/d3c/f60 4919742 0 2024-08-18T22:48:56.445 INFO:tasks.workunit.client.0.smithi121.stdout:6/555: dread d8/d9/d37/f5c [0,4194304] 0 2024-08-18T22:48:56.447 INFO:tasks.workunit.client.0.smithi121.stdout:6/556: rmdir d8/d9/d24/d3c/d65 39 2024-08-18T22:48:56.449 INFO:tasks.workunit.client.0.smithi121.stdout:6/557: truncate d8/d9/d24/f43 1214670 0 2024-08-18T22:48:56.455 INFO:tasks.workunit.client.0.smithi121.stdout:6/558: truncate d8/d9/d37/f6f 877531 0 2024-08-18T22:48:56.459 INFO:tasks.workunit.client.0.smithi121.stdout:6/559: dwrite d8/d9/d24/d25/f45 [0,4194304] 0 2024-08-18T22:48:56.461 INFO:tasks.workunit.client.0.smithi121.stdout:6/560: write d8/d9/d37/f75 [568734,76865] 0 2024-08-18T22:48:56.462 INFO:tasks.workunit.client.0.smithi121.stdout:6/561: stat d8/d9/d24/dab/dc3/dcc 0 2024-08-18T22:48:56.464 INFO:tasks.workunit.client.0.smithi121.stdout:6/562: creat d8/d9/d24/d25/fcf x:0 0 0 2024-08-18T22:48:56.466 INFO:tasks.workunit.client.0.smithi121.stdout:6/563: creat d8/d9/d27/d2c/fd0 x:0 0 0 2024-08-18T22:48:56.469 INFO:tasks.workunit.client.0.smithi121.stdout:6/564: creat d8/d9/d27/d2b/fd1 x:0 0 0 2024-08-18T22:48:56.470 INFO:tasks.workunit.client.0.smithi121.stdout:6/565: fdatasync d8/d9/d27/d2b/fd1 0 2024-08-18T22:48:56.470 INFO:tasks.workunit.client.0.smithi121.stdout:6/566: fsync d8/f19 0 2024-08-18T22:48:56.478 INFO:tasks.workunit.client.0.smithi121.stdout:6/567: truncate d8/d9/d24/d25/f45 1862728 0 2024-08-18T22:48:56.480 INFO:tasks.workunit.client.0.smithi121.stdout:6/568: link d8/d9/d27/d2b/d61/f72 d8/fd2 0 2024-08-18T22:48:56.483 INFO:tasks.workunit.client.0.smithi121.stdout:6/569: getdents d8/d9/d24/d3a/da7 0 2024-08-18T22:48:56.486 INFO:tasks.workunit.client.0.smithi121.stdout:6/570: creat d8/d9/d14/fd3 x:0 0 0 2024-08-18T22:48:56.488 INFO:tasks.workunit.client.0.smithi121.stdout:6/571: dread d8/d9/d14/f62 [0,4194304] 0 2024-08-18T22:48:56.489 INFO:tasks.workunit.client.0.smithi121.stdout:6/572: mknod d8/d9/d24/dab/cd4 0 2024-08-18T22:48:56.490 INFO:tasks.workunit.client.0.smithi121.stdout:6/573: stat d8/d9/d24/d25/d28/f89 0 2024-08-18T22:48:56.492 INFO:tasks.workunit.client.0.smithi121.stdout:6/574: unlink d8/d9/d24/fba 0 2024-08-18T22:48:56.492 INFO:tasks.workunit.client.0.smithi121.stdout:6/575: dread - d8/d9/d24/d3a/d81/fb6 zero size 2024-08-18T22:48:56.495 INFO:tasks.workunit.client.0.smithi121.stdout:6/576: truncate d8/d9/d24/d25/f82 782260 0 2024-08-18T22:48:56.497 INFO:tasks.workunit.client.0.smithi121.stdout:6/577: rename d8/d9/d24/d3c/l93 to d8/d9/d24/d3a/ld5 0 2024-08-18T22:48:56.501 INFO:tasks.workunit.client.0.smithi121.stdout:6/578: dread d8/d9/f13 [4194304,4194304] 0 2024-08-18T22:48:56.504 INFO:tasks.workunit.client.0.smithi121.stdout:6/579: chown d8/d9/d27/d46/dbd/d1e/c5e 883690 1 2024-08-18T22:48:56.508 INFO:tasks.workunit.client.0.smithi121.stdout:6/580: getdents d8/d9/d24/d3c/d74 0 2024-08-18T22:48:56.510 INFO:tasks.workunit.client.0.smithi121.stdout:6/581: symlink d8/d9/d24/d3a/ld6 0 2024-08-18T22:48:56.512 INFO:tasks.workunit.client.0.smithi121.stdout:6/582: rename d8/d9/f13 to d8/d9/fd7 0 2024-08-18T22:48:56.516 INFO:tasks.workunit.client.0.smithi121.stdout:6/583: chown d8/d9/d24/d3a/da7 3 1 2024-08-18T22:48:56.518 INFO:tasks.workunit.client.0.smithi121.stdout:6/584: symlink d8/d9/d27/d2b/d61/ld8 0 2024-08-18T22:48:56.519 INFO:tasks.workunit.client.0.smithi121.stdout:6/585: read d8/d9/d14/f70 [117741,66390] 0 2024-08-18T22:48:56.520 INFO:tasks.workunit.client.0.smithi121.stdout:6/586: readlink d8/d9/d27/d2c/d66/la4 0 2024-08-18T22:48:56.525 INFO:tasks.workunit.client.0.smithi121.stdout:6/587: dwrite d8/d9/d24/d3c/d74/fb2 [0,4194304] 0 2024-08-18T22:48:56.527 INFO:tasks.workunit.client.0.smithi121.stdout:6/588: rmdir d8/d9/d24/d25/daf 39 2024-08-18T22:48:56.528 INFO:tasks.workunit.client.0.smithi121.stdout:6/589: symlink d8/d9/d24/dab/dc3/dcc/dcd/ld9 0 2024-08-18T22:48:56.531 INFO:tasks.workunit.client.0.smithi121.stdout:6/590: write d8/d9/d27/d2b/d61/d9c/fa8 [1002696,82121] 0 2024-08-18T22:48:56.532 INFO:tasks.workunit.client.0.smithi121.stdout:6/591: chown d8/d9/d24/d3c/d65 2 1 2024-08-18T22:48:56.534 INFO:tasks.workunit.client.0.smithi121.stdout:6/592: symlink d8/d9/d27/d46/dbd/lda 0 2024-08-18T22:48:56.539 INFO:tasks.workunit.client.0.smithi121.stdout:6/593: write d8/d9/d37/f5c [1702235,55437] 0 2024-08-18T22:48:56.541 INFO:tasks.workunit.client.0.smithi121.stdout:6/594: unlink d8/d9/d14/fb9 0 2024-08-18T22:48:56.542 INFO:tasks.workunit.client.0.smithi121.stdout:6/595: fsync d8/d9/d27/d2c/d66/f8e 0 2024-08-18T22:48:56.543 INFO:tasks.workunit.client.0.smithi121.stdout:6/596: symlink d8/d9/d24/d3a/da7/ldb 0 2024-08-18T22:48:56.544 INFO:tasks.workunit.client.0.smithi121.stdout:6/597: dread - d8/d9/d24/d25/da2/fb5 zero size 2024-08-18T22:48:56.546 INFO:tasks.workunit.client.0.smithi121.stdout:6/598: mkdir d8/d9/ddc 0 2024-08-18T22:48:56.547 INFO:tasks.workunit.client.0.smithi121.stdout:6/599: write d8/d9/d27/d2c/f6b [753244,117621] 0 2024-08-18T22:48:56.549 INFO:tasks.workunit.client.0.smithi121.stdout:6/600: symlink d8/d9/d27/d46/dbd/d1e/ldd 0 2024-08-18T22:48:56.550 INFO:tasks.workunit.client.0.smithi121.stdout:6/601: mknod d8/d9/ddc/cde 0 2024-08-18T22:48:56.552 INFO:tasks.workunit.client.0.smithi121.stdout:6/602: chown d8/d9/d24/d3c/d65/cb8 913189 1 2024-08-18T22:48:56.554 INFO:tasks.workunit.client.0.smithi121.stdout:6/603: mknod d8/d9/d27/d46/dbd/d8b/cdf 0 2024-08-18T22:48:56.556 INFO:tasks.workunit.client.0.smithi121.stdout:6/604: mknod d8/d9/d27/d46/dbd/d1e/d9a/ce0 0 2024-08-18T22:48:56.556 INFO:tasks.workunit.client.0.smithi121.stdout:6/605: rmdir d8/d9/d24/d3c/da1 39 2024-08-18T22:48:56.558 INFO:tasks.workunit.client.0.smithi121.stdout:6/606: dread - d8/d9/d14/fd3 zero size 2024-08-18T22:48:56.561 INFO:tasks.workunit.client.0.smithi121.stdout:6/607: link d8/d9/d27/d2c/fc4 d8/d9/d27/d46/dbd/d1e/fe1 0 2024-08-18T22:48:56.562 INFO:tasks.workunit.client.0.smithi121.stdout:6/608: write d8/d9/d24/d3c/d65/fc0 [3748034,4130] 0 2024-08-18T22:48:56.564 INFO:tasks.workunit.client.0.smithi121.stdout:6/609: mknod d8/d9/d24/d3a/d81/ce2 0 2024-08-18T22:48:56.566 INFO:tasks.workunit.client.0.smithi121.stdout:6/610: fdatasync d8/d9/d27/d46/dbd/d1e/fe1 0 2024-08-18T22:48:56.569 INFO:tasks.workunit.client.0.smithi121.stdout:6/611: rename d8/d9/d27/d2b/d61/f87 to d8/d9/d27/d46/dbd/d1e/d9a/fe3 0 2024-08-18T22:48:56.574 INFO:tasks.workunit.client.0.smithi121.stdout:6/612: rename d8/d9/d27/d2b/l92 to d8/d9/d24/dab/dc3/dcc/dcd/le4 0 2024-08-18T22:48:56.578 INFO:tasks.workunit.client.0.smithi121.stdout:6/613: dwrite d8/d9/d27/d46/dbd/d1e/f80 [4194304,4194304] 0 2024-08-18T22:48:56.583 INFO:tasks.workunit.client.0.smithi121.stdout:6/614: link d8/d9/d27/d46/dbd/d1e/f23 d8/d9/d24/d25/daf/fe5 0 2024-08-18T22:48:56.584 INFO:tasks.workunit.client.0.smithi121.stdout:6/615: truncate d8/d9/d27/d2c/f42 8419332 0 2024-08-18T22:48:56.585 INFO:tasks.workunit.client.0.smithi121.stdout:6/616: stat d8/d9/d27/d2b/f6c 0 2024-08-18T22:48:56.586 INFO:tasks.workunit.client.0.smithi121.stdout:6/617: fsync d8/d9/d24/d25/fa0 0 2024-08-18T22:48:56.592 INFO:tasks.workunit.client.0.smithi121.stdout:6/618: dwrite d8/d9/d37/f5c [0,4194304] 0 2024-08-18T22:48:56.593 INFO:tasks.workunit.client.0.smithi121.stdout:6/619: fdatasync d8/f10 0 2024-08-18T22:48:56.597 INFO:tasks.workunit.client.0.smithi121.stdout:6/620: rename d8/d9/d27/d2c/fc4 to d8/d9/d24/fe6 0 2024-08-18T22:48:56.599 INFO:tasks.workunit.client.0.smithi121.stdout:6/621: fsync d8/fd2 0 2024-08-18T22:48:56.599 INFO:tasks.workunit.client.0.smithi121.stdout:6/622: chown d8/d9/d24/d3c/d74 7429 1 2024-08-18T22:48:56.603 INFO:tasks.workunit.client.0.smithi121.stdout:6/623: dread d8/d9/d27/d2c/f42 [0,4194304] 0 2024-08-18T22:48:56.605 INFO:tasks.workunit.client.0.smithi121.stdout:6/624: mknod d8/d9/d27/d2b/d61/d9c/ce7 0 2024-08-18T22:48:56.606 INFO:tasks.workunit.client.0.smithi121.stdout:6/625: creat d8/d9/d24/d25/daf/fe8 x:0 0 0 2024-08-18T22:48:56.608 INFO:tasks.workunit.client.0.smithi121.stdout:6/626: creat d8/d9/d24/dab/dc3/dcc/fe9 x:0 0 0 2024-08-18T22:48:56.609 INFO:tasks.workunit.client.0.smithi121.stdout:6/627: readlink d8/d9/d27/d46/dbd/d1e/ldd 0 2024-08-18T22:48:56.611 INFO:tasks.workunit.client.0.smithi121.stdout:6/628: creat d8/d9/d14/fea x:0 0 0 2024-08-18T22:48:56.616 INFO:tasks.workunit.client.0.smithi121.stdout:6/629: truncate d8/d9/d24/d3c/f60 4163420 0 2024-08-18T22:48:56.619 INFO:tasks.workunit.client.0.smithi121.stdout:6/630: dread d8/d9/d24/d25/f54 [0,4194304] 0 2024-08-18T22:48:56.625 INFO:tasks.workunit.client.0.smithi121.stdout:6/631: write d8/d9/d24/f43 [966125,9762] 0 2024-08-18T22:48:56.627 INFO:tasks.workunit.client.0.smithi121.stdout:6/632: mkdir d8/d9/d24/d25/daf/deb 0 2024-08-18T22:48:56.627 INFO:tasks.workunit.client.0.smithi121.stdout:6/633: dread - d8/d9/d27/d2b/fd1 zero size 2024-08-18T22:48:56.629 INFO:tasks.workunit.client.0.smithi121.stdout:6/634: mknod d8/d9/d24/d3c/d74/cec 0 2024-08-18T22:48:56.634 INFO:tasks.workunit.client.0.smithi121.stdout:6/635: dwrite d8/d9/d27/d2b/d61/d9c/fa8 [0,4194304] 0 2024-08-18T22:48:56.636 INFO:tasks.workunit.client.0.smithi121.stdout:6/636: creat d8/d9/d24/d3c/d65/fed x:0 0 0 2024-08-18T22:48:56.638 INFO:tasks.workunit.client.0.smithi121.stdout:6/637: rename d8/d9/d27/d2c/d66 to d8/d9/d27/d2c/d66/dee 22 2024-08-18T22:48:56.643 INFO:tasks.workunit.client.0.smithi121.stdout:6/638: dwrite d8/d9/d14/fd3 [0,4194304] 0 2024-08-18T22:48:56.646 INFO:tasks.workunit.client.0.smithi121.stdout:6/639: creat d8/d9/d24/d25/daf/dc5/fef x:0 0 0 2024-08-18T22:48:56.648 INFO:tasks.workunit.client.0.smithi121.stdout:6/640: mkdir d8/d9/d27/d46/df0 0 2024-08-18T22:48:56.651 INFO:tasks.workunit.client.0.smithi121.stdout:6/641: getdents d8/d9/d24/d25/da2 0 2024-08-18T22:48:56.653 INFO:tasks.workunit.client.0.smithi121.stdout:6/642: read d8/d9/d27/d2b/f68 [459608,14181] 0 2024-08-18T22:48:56.654 INFO:tasks.workunit.client.0.smithi121.stdout:6/643: mkdir d8/d9/d24/d3a/d81/df1 0 2024-08-18T22:48:56.654 INFO:tasks.workunit.client.0.smithi121.stdout:6/644: readlink d8/d9/d27/d2b/l7e 0 2024-08-18T22:48:56.655 INFO:tasks.workunit.client.0.smithi121.stdout:6/645: dread - d8/d9/d24/d25/daf/fb1 zero size 2024-08-18T22:48:56.656 INFO:tasks.workunit.client.0.smithi121.stdout:6/646: write d8/d9/d27/d2b/d61/f9d [558349,25327] 0 2024-08-18T22:48:56.657 INFO:tasks.workunit.client.0.smithi121.stdout:6/647: stat d8/d9/d27/d2c/f42 0 2024-08-18T22:48:56.659 INFO:tasks.workunit.client.0.smithi121.stdout:6/648: creat d8/d9/d24/dab/ff2 x:0 0 0 2024-08-18T22:48:56.660 INFO:tasks.workunit.client.0.smithi121.stdout:6/649: fsync d8/d9/d27/d46/dbd/d1e/d9a/fe3 0 2024-08-18T22:48:56.662 INFO:tasks.workunit.client.0.smithi121.stdout:6/650: mknod d8/d9/d27/d46/dbd/d8b/cf3 0 2024-08-18T22:48:56.663 INFO:tasks.workunit.client.0.smithi121.stdout:6/651: write d8/d9/d37/f5c [3627611,17230] 0 2024-08-18T22:48:56.664 INFO:tasks.workunit.client.0.smithi121.stdout:6/652: truncate d8/d9/d14/fd3 5038769 0 2024-08-18T22:48:56.664 INFO:tasks.workunit.client.0.smithi121.stdout:6/653: chown d8/d9/d24/d3a/f52 5184021 1 2024-08-18T22:48:56.668 INFO:tasks.workunit.client.0.smithi121.stdout:6/654: rename d8/d9/d24/d3c/f60 to d8/d9/d27/d46/df0/ff4 0 2024-08-18T22:48:56.673 INFO:tasks.workunit.client.0.smithi121.stdout:6/655: truncate d8/d9/d27/d2b/f68 334889 0 2024-08-18T22:48:56.674 INFO:tasks.workunit.client.0.smithi121.stdout:6/656: chown d8/d9/d37/l8f 47499985 1 2024-08-18T22:48:56.679 INFO:tasks.workunit.client.0.smithi121.stdout:6/657: dwrite d8/d9/d27/d46/f88 [0,4194304] 0 2024-08-18T22:48:56.681 INFO:tasks.workunit.client.0.smithi121.stdout:6/658: stat d8/d9/d24/d3c/da1/lb0 0 2024-08-18T22:48:56.687 INFO:tasks.workunit.client.0.smithi121.stdout:6/659: write d8/d9/d24/d25/da2/fa6 [5358631,56809] 0 2024-08-18T22:48:56.691 INFO:tasks.workunit.client.0.smithi121.stdout:6/660: rename d8/d9/d24/dab/cd4 to d8/d9/d24/d3c/d65/cf5 0 2024-08-18T22:48:56.693 INFO:tasks.workunit.client.0.smithi121.stdout:6/661: unlink d8/d9/d27/d46/dbd/d1e/d9a/fe3 0 2024-08-18T22:48:56.694 INFO:tasks.workunit.client.0.smithi121.stdout:6/662: mknod d8/d9/d24/d25/daf/cf6 0 2024-08-18T22:48:56.699 INFO:tasks.workunit.client.0.smithi121.stdout:6/663: dwrite d8/f21 [0,4194304] 0 2024-08-18T22:48:56.700 INFO:tasks.workunit.client.0.smithi121.stdout:6/664: stat d8/d9/d27/d2c/d66/la4 0 2024-08-18T22:48:56.707 INFO:tasks.workunit.client.0.smithi121.stdout:6/665: dwrite d8/d9/d27/d46/dbd/d1e/f80 [0,4194304] 0 2024-08-18T22:48:56.710 INFO:tasks.workunit.client.0.smithi121.stdout:6/666: read d8/d9/d27/d46/dbd/f51 [168893,38417] 0 2024-08-18T22:48:56.712 INFO:tasks.workunit.client.0.smithi121.stdout:6/667: unlink d8/f10 0 2024-08-18T22:48:56.714 INFO:tasks.workunit.client.0.smithi121.stdout:6/668: creat d8/d9/d24/d3a/da7/ff7 x:0 0 0 2024-08-18T22:48:56.716 INFO:tasks.workunit.client.0.smithi121.stdout:6/669: creat d8/d9/d24/d3a/ff8 x:0 0 0 2024-08-18T22:48:56.719 INFO:tasks.workunit.client.0.smithi121.stdout:6/670: rmdir d8/d9/d24/d25/dbc 0 2024-08-18T22:48:56.719 INFO:tasks.workunit.client.0.smithi121.stdout:6/671: chown d8/d9/d27/d2c 11860 1 2024-08-18T22:48:56.725 INFO:tasks.workunit.client.0.smithi121.stdout:6/672: dwrite d8/d9/d24/d25/d28/f89 [0,4194304] 0 2024-08-18T22:48:56.725 INFO:tasks.workunit.client.0.smithi121.stdout:6/673: stat d8/d9/d27/d2b/fd1 0 2024-08-18T22:48:56.726 INFO:tasks.workunit.client.0.smithi121.stdout:6/674: chown d8/d9/d27/d2b/l5f 7118 1 2024-08-18T22:48:56.729 INFO:tasks.workunit.client.0.smithi121.stdout:6/675: unlink d8/d9/d24/d25/da2/fa6 0 2024-08-18T22:48:56.731 INFO:tasks.workunit.client.0.smithi121.stdout:6/676: mknod d8/d9/d24/cf9 0 2024-08-18T22:48:56.735 INFO:tasks.workunit.client.0.smithi121.stdout:6/677: link d8/la9 d8/d9/d24/d3c/lfa 0 2024-08-18T22:48:56.736 INFO:tasks.workunit.client.0.smithi121.stdout:6/678: readlink d8/d9/d24/dab/dc3/dcc/dcd/ld9 0 2024-08-18T22:48:56.738 INFO:tasks.workunit.client.0.smithi121.stdout:6/679: mkdir d8/d9/dfb 0 2024-08-18T22:48:56.743 INFO:tasks.workunit.client.0.smithi121.stdout:6/680: dwrite d8/d9/d24/d3a/f9f [0,4194304] 0 2024-08-18T22:48:56.747 INFO:tasks.workunit.client.0.smithi121.stdout:6/681: chown d8/d9/d24/d3c/lfa 29 1 2024-08-18T22:48:56.750 INFO:tasks.workunit.client.0.smithi121.stdout:6/682: symlink d8/d9/d24/d25/lfc 0 2024-08-18T22:48:56.752 INFO:tasks.workunit.client.0.smithi121.stdout:6/683: symlink d8/d9/d27/d2b/d61/lfd 0 2024-08-18T22:48:56.753 INFO:tasks.workunit.client.0.smithi121.stdout:6/684: truncate d8/d9/d27/d46/dbd/d8b/fc8 544478 0 2024-08-18T22:48:56.755 INFO:tasks.workunit.client.0.smithi121.stdout:6/685: creat d8/d9/d27/d46/dbd/d49/ffe x:0 0 0 2024-08-18T22:48:56.756 INFO:tasks.workunit.client.0.smithi121.stdout:6/686: write d8/d9/d14/fea [1012279,52927] 0 2024-08-18T22:48:56.759 INFO:tasks.workunit.client.0.smithi121.stdout:6/687: getdents d8/d9/d27/d46/dbd/d8b 0 2024-08-18T22:48:56.761 INFO:tasks.workunit.client.0.smithi121.stdout:6/688: creat d8/d9/d24/d3a/d81/df1/fff x:0 0 0 2024-08-18T22:48:56.765 INFO:tasks.workunit.client.0.smithi121.stdout:6/689: truncate d8/d9/d24/d25/f45 472004 0 2024-08-18T22:48:56.766 INFO:tasks.workunit.client.0.smithi121.stdout:6/690: truncate d8/d9/d24/d25/d28/f89 5137362 0 2024-08-18T22:48:56.767 INFO:tasks.workunit.client.0.smithi121.stdout:6/691: fdatasync d8/d9/d24/d25/daf/fb1 0 2024-08-18T22:48:56.769 INFO:tasks.workunit.client.0.smithi121.stdout:6/692: symlink d8/d9/d27/d2c/d66/l100 0 2024-08-18T22:48:56.770 INFO:tasks.workunit.client.0.smithi121.stdout:6/693: mkdir d8/d9/d24/d25/daf/deb/d101 0 2024-08-18T22:48:56.771 INFO:tasks.workunit.client.0.smithi121.stdout:6/694: chown d8/f8d 17836 1 2024-08-18T22:48:56.771 INFO:tasks.workunit.client.0.smithi121.stdout:6/695: stat d8/d9/d37/c84 0 2024-08-18T22:48:56.774 INFO:tasks.workunit.client.0.smithi121.stdout:6/696: truncate d8/d9/d27/d46/df0/ff4 3738976 0 2024-08-18T22:48:56.777 INFO:tasks.workunit.client.0.smithi121.stdout:6/697: link d8/d9/c2d d8/d9/d24/d3a/c102 0 2024-08-18T22:48:56.778 INFO:tasks.workunit.client.0.smithi121.stdout:6/698: write d8/d9/d24/d25/da2/fb5 [904095,124420] 0 2024-08-18T22:48:56.778 INFO:tasks.workunit.client.0.smithi121.stdout:6/699: fsync d8/d9/d24/d25/daf/dc5/fef 0 2024-08-18T22:48:56.786 INFO:tasks.workunit.client.0.smithi121.stdout:6/700: truncate d8/d9/f30 3054388 0 2024-08-18T22:48:56.788 INFO:tasks.workunit.client.0.smithi121.stdout:6/701: truncate d8/d9/d24/d3a/da7/ff7 570243 0 2024-08-18T22:48:56.793 INFO:tasks.workunit.client.0.smithi121.stdout:6/702: dread d8/d9/f30 [0,4194304] 0 2024-08-18T22:48:56.795 INFO:tasks.workunit.client.0.smithi121.stdout:6/703: rmdir d8/d9/d27 39 2024-08-18T22:48:56.798 INFO:tasks.workunit.client.0.smithi121.stdout:6/704: rename d8/d9/d24/d3a/ld5 to d8/d9/d24/d3a/d81/df1/l103 0 2024-08-18T22:48:56.801 INFO:tasks.workunit.client.0.smithi121.stdout:6/705: symlink d8/d9/d27/d46/dbd/d49/l104 0 2024-08-18T22:48:56.802 INFO:tasks.workunit.client.0.smithi121.stdout:6/706: write d8/d9/d14/f26 [995915,57078] 0 2024-08-18T22:48:56.804 INFO:tasks.workunit.client.0.smithi121.stdout:6/707: creat d8/d9/d24/f105 x:0 0 0 2024-08-18T22:48:56.805 INFO:tasks.workunit.client.0.smithi121.stdout:6/708: fdatasync d8/d9/d24/d25/da2/fb5 0 2024-08-18T22:48:56.808 INFO:tasks.workunit.client.0.smithi121.stdout:6/709: fdatasync d8/d9/d24/d25/daf/fe5 0 2024-08-18T22:48:56.809 INFO:tasks.workunit.client.0.smithi121.stdout:6/710: write d8/d9/d24/d3a/d81/df1/fff [59490,57623] 0 2024-08-18T22:48:56.812 INFO:tasks.workunit.client.0.smithi121.stdout:6/711: rename d8/d9/d24/d25/l77 to d8/d9/d24/d25/daf/l106 0 2024-08-18T22:48:56.813 INFO:tasks.workunit.client.0.smithi121.stdout:6/712: mknod d8/d9/d27/d46/dbd/d3f/d7c/d83/c107 0 2024-08-18T22:48:56.818 INFO:tasks.workunit.client.0.smithi121.stdout:6/713: dread d8/d9/fd7 [0,4194304] 0 2024-08-18T22:48:56.820 INFO:tasks.workunit.client.0.smithi121.stdout:6/714: getdents d8/d9/d24/d3a/da7 0 2024-08-18T22:48:56.821 INFO:tasks.workunit.client.0.smithi121.stdout:6/715: readlink d8/d9/d24/d3a/l97 0 2024-08-18T22:48:56.822 INFO:tasks.workunit.client.0.smithi121.stdout:6/716: creat d8/d9/d24/dab/f108 x:0 0 0 2024-08-18T22:48:56.823 INFO:tasks.workunit.client.0.smithi121.stdout:6/717: readlink d8/d9/l1d 0 2024-08-18T22:48:56.826 INFO:tasks.workunit.client.0.smithi121.stdout:6/718: creat d8/d9/d37/f109 x:0 0 0 2024-08-18T22:48:56.828 INFO:tasks.workunit.client.0.smithi121.stdout:6/719: getdents d8 0 2024-08-18T22:48:56.833 INFO:tasks.workunit.client.0.smithi121.stdout:6/720: truncate d8/d9/d27/d46/dbd/d1e/f80 10169235 0 2024-08-18T22:48:56.833 INFO:tasks.workunit.client.0.smithi121.stdout:6/721: read - d8/d9/d27/d2c/fd0 zero size 2024-08-18T22:48:56.835 INFO:tasks.workunit.client.0.smithi121.stdout:6/722: truncate d8/d9/fd7 5311552 0 2024-08-18T22:48:56.836 INFO:tasks.workunit.client.0.smithi121.stdout:6/723: fdatasync d8/d9/d27/d2c/d66/fc7 0 2024-08-18T22:48:56.838 INFO:tasks.workunit.client.0.smithi121.stdout:6/724: symlink d8/d9/d27/d2b/l10a 0 2024-08-18T22:48:56.843 INFO:tasks.workunit.client.0.smithi121.stdout:6/725: dwrite d8/f21 [0,4194304] 0 2024-08-18T22:48:56.845 INFO:tasks.workunit.client.0.smithi121.stdout:6/726: symlink d8/d9/d27/d46/dbd/d8b/l10b 0 2024-08-18T22:48:56.848 INFO:tasks.workunit.client.0.smithi121.stdout:6/727: unlink d8/d9/d24/d25/d28/f39 0 2024-08-18T22:48:56.850 INFO:tasks.workunit.client.0.smithi121.stdout:6/728: write d8/d9/d27/d2b/d61/d9c/fa8 [2127815,54525] 0 2024-08-18T22:48:56.852 INFO:tasks.workunit.client.0.smithi121.stdout:6/729: fsync d8/d9/d24/d25/f54 0 2024-08-18T22:48:56.852 INFO:tasks.workunit.client.0.smithi121.stdout:6/730: chown d8/d9/d27/d46/f94 3 1 2024-08-18T22:48:56.854 INFO:tasks.workunit.client.0.smithi121.stdout:6/731: symlink d8/d9/d24/d3c/da1/l10c 0 2024-08-18T22:48:56.857 INFO:tasks.workunit.client.0.smithi121.stdout:6/732: rename d8/d9/d27/d46/f9b to d8/d9/d24/dab/f10d 0 2024-08-18T22:48:56.858 INFO:tasks.workunit.client.0.smithi121.stdout:6/733: truncate d8/d9/d24/dab/ff2 344937 0 2024-08-18T22:48:56.860 INFO:tasks.workunit.client.0.smithi121.stdout:6/734: write d8/d9/d37/f75 [632674,65800] 0 2024-08-18T22:48:56.861 INFO:tasks.workunit.client.0.smithi121.stdout:6/735: creat d8/d9/d24/dab/dc3/dcc/f10e x:0 0 0 2024-08-18T22:48:56.864 INFO:tasks.workunit.client.0.smithi121.stdout:6/736: rename d8/d9/d27/d46/dbd/d1e/d9a/ce0 to d8/d9/d27/d2c/d66/c10f 0 2024-08-18T22:48:56.865 INFO:tasks.workunit.client.0.smithi121.stdout:6/737: mknod d8/d9/d27/d46/dbd/d1e/c110 0 2024-08-18T22:48:56.872 INFO:tasks.workunit.client.0.smithi121.stdout:6/738: truncate d8/d9/d27/d46/dbd/d1e/fe1 753451 0 2024-08-18T22:48:56.876 INFO:tasks.workunit.client.0.smithi121.stdout:6/739: dread d8/d9/d27/d46/dbd/d1e/f23 [0,4194304] 0 2024-08-18T22:48:56.876 INFO:tasks.workunit.client.0.smithi121.stdout:6/740: chown d8/d9/d27/d46/dbd 27816598 1 2024-08-18T22:48:56.878 INFO:tasks.workunit.client.0.smithi121.stdout:6/741: symlink d8/d9/d24/dab/dc3/dcc/l111 0 2024-08-18T22:48:56.884 INFO:tasks.workunit.client.0.smithi121.stdout:6/742: dwrite d8/d9/d37/f5c [0,4194304] 0 2024-08-18T22:48:56.888 INFO:tasks.workunit.client.0.smithi121.stdout:6/743: link d8/d9/d27/d46/f88 d8/d9/d24/d3c/da1/f112 0 2024-08-18T22:48:56.890 INFO:tasks.workunit.client.0.smithi121.stdout:6/744: mknod d8/d9/d27/d2b/c113 0 2024-08-18T22:48:56.891 INFO:tasks.workunit.client.0.smithi121.stdout:6/745: chown d8/d9/d24/d25/daf/fe8 6822 1 2024-08-18T22:48:56.893 INFO:tasks.workunit.client.0.smithi121.stdout:6/746: dread d8/d9/d27/d46/dbd/d3f/f58 [0,4194304] 0 2024-08-18T22:48:56.895 INFO:tasks.workunit.client.0.smithi121.stdout:6/747: chown d8/d9/d27/d2c/f42 126461997 1 2024-08-18T22:48:56.897 INFO:tasks.workunit.client.0.smithi121.stdout:6/748: creat d8/d9/d27/d46/dbd/d3f/d7c/f114 x:0 0 0 2024-08-18T22:48:56.900 INFO:tasks.workunit.client.0.smithi121.stdout:6/749: rename d8/d9/d27/d2c/d66/dc9 to d8/d9/d115 0 2024-08-18T22:48:56.901 INFO:tasks.workunit.client.0.smithi121.stdout:6/750: fsync d8/d9/d24/d25/daf/fb1 0 2024-08-18T22:48:56.901 INFO:tasks.workunit.client.0.smithi121.stdout:6/751: dread - d8/d9/d24/d3c/d65/fed zero size 2024-08-18T22:48:56.902 INFO:tasks.workunit.client.0.smithi121.stdout:6/752: dread - d8/d9/d24/d25/daf/dc5/fef zero size 2024-08-18T22:48:56.904 INFO:tasks.workunit.client.0.smithi121.stdout:6/753: symlink d8/d9/d24/d3c/d74/l116 0 2024-08-18T22:48:56.911 INFO:tasks.workunit.client.0.smithi121.stdout:6/754: write d8/d9/d27/d2b/f68 [100208,8263] 0 2024-08-18T22:48:56.912 INFO:tasks.workunit.client.0.smithi121.stdout:6/755: chown d8/d9/d24/d3c/d65/cf5 252264213 1 2024-08-18T22:48:56.913 INFO:tasks.workunit.client.0.smithi121.stdout:6/756: mknod d8/c117 0 2024-08-18T22:48:56.919 INFO:tasks.workunit.client.0.smithi121.stdout:6/757: write d8/d9/d37/f6a [2008964,22188] 0 2024-08-18T22:48:56.920 INFO:tasks.workunit.client.0.smithi121.stdout:6/758: readlink d8/d9/d24/lca 0 2024-08-18T22:48:57.144 INFO:tasks.workunit.client.0.smithi121.stdout:6/759: sync 2024-08-18T22:48:57.144 INFO:tasks.workunit.client.0.smithi121.stdout:6/760: chown d8/d9/d24/d3c/d74 2486 1 2024-08-18T22:48:57.148 INFO:tasks.workunit.client.0.smithi121.stdout:6/761: rename d8/d9/d24/d25/d28/c99 to d8/d9/d24/d25/c118 0 2024-08-18T22:48:57.154 INFO:tasks.workunit.client.0.smithi121.stdout:6/762: dwrite d8/d9/d37/f5c [4194304,4194304] 0 2024-08-18T22:48:57.158 INFO:tasks.workunit.client.0.smithi121.stdout:6/763: dread d8/d9/d24/d3c/d74/fb2 [0,4194304] 0 2024-08-18T22:48:57.159 INFO:tasks.workunit.client.0.smithi121.stdout:6/764: stat d8/d9/d24/lca 0 2024-08-18T22:48:57.295 INFO:tasks.workunit.client.0.smithi121.stdout:6/765: sync 2024-08-18T22:48:57.295 INFO:tasks.workunit.client.0.smithi121.stdout:6/766: chown d8/d9/d24/d3c/da1 1065 1 2024-08-18T22:48:57.300 INFO:tasks.workunit.client.0.smithi121.stdout:6/767: dwrite d8/d9/d24/d3a/f9f [0,4194304] 0 2024-08-18T22:48:57.303 INFO:tasks.workunit.client.0.smithi121.stdout:6/768: dread d8/d9/d27/d46/dbd/d1e/fe1 [0,4194304] 0 2024-08-18T22:48:57.305 INFO:tasks.workunit.client.0.smithi121.stdout:6/769: write d8/d9/d27/d46/dbd/d49/ffe [4192,118473] 0 2024-08-18T22:48:57.308 INFO:tasks.workunit.client.0.smithi121.stdout:6/770: fdatasync d8/d9/d14/f70 0 2024-08-18T22:48:57.310 INFO:tasks.workunit.client.0.smithi121.stdout:6/771: symlink d8/d9/dfb/l119 0 2024-08-18T22:48:57.316 INFO:tasks.workunit.client.0.smithi121.stdout:6/772: write d8/d9/d24/d25/f82 [86955,94292] 0 2024-08-18T22:48:57.319 INFO:tasks.workunit.client.0.smithi121.stdout:6/773: mkdir d8/d9/d24/d3a/da7/d11a 0 2024-08-18T22:48:57.320 INFO:tasks.workunit.client.0.smithi121.stdout:6/774: write d8/d9/d24/dab/dc3/dcc/f10e [981564,126466] 0 2024-08-18T22:48:57.322 INFO:tasks.workunit.client.0.smithi121.stdout:6/775: rmdir d8/d9/d24/d3a/d81 39 2024-08-18T22:48:57.325 INFO:tasks.workunit.client.0.smithi121.stdout:6/776: write d8/d9/d24/d3a/d81/fc2 [407545,128907] 0 2024-08-18T22:48:57.327 INFO:tasks.workunit.client.0.smithi121.stdout:6/777: creat d8/d9/d27/d46/dbd/d3f/d7c/d83/f11b x:0 0 0 2024-08-18T22:48:57.329 INFO:tasks.workunit.client.0.smithi121.stdout:6/778: fdatasync d8/d9/d27/d46/dbd/d1e/fe1 0 2024-08-18T22:48:57.427 INFO:tasks.workunit.client.0.smithi121.stdout:6/779: sync 2024-08-18T22:48:57.535 INFO:tasks.workunit.client.0.smithi121.stdout:6/780: sync 2024-08-18T22:48:57.537 INFO:tasks.workunit.client.0.smithi121.stdout:6/781: dread d8/d9/d14/f70 [0,4194304] 0 2024-08-18T22:48:57.539 INFO:tasks.workunit.client.0.smithi121.stdout:6/782: mkdir d8/d9/d24/d3a/da7/d11c 0 2024-08-18T22:48:57.541 INFO:tasks.workunit.client.0.smithi121.stdout:6/783: mknod d8/d9/d24/c11d 0 2024-08-18T22:48:57.644 INFO:tasks.workunit.client.0.smithi121.stdout:6/784: sync 2024-08-18T22:48:57.653 INFO:tasks.workunit.client.0.smithi121.stdout:6/785: dwrite d8/d9/d24/d25/d28/f89 [4194304,4194304] 0 2024-08-18T22:48:57.658 INFO:tasks.workunit.client.0.smithi121.stdout:6/786: write d8/d9/d24/d25/f45 [550341,102286] 0 2024-08-18T22:48:57.665 INFO:tasks.workunit.client.0.smithi121.stdout:6/787: dwrite d8/d9/d27/d46/dbd/d3f/f9e [0,4194304] 0 2024-08-18T22:48:57.666 INFO:tasks.workunit.client.0.smithi121.stdout:6/788: chown d8/d9/d27/d2c/fd0 432 1 2024-08-18T22:48:57.667 INFO:tasks.workunit.client.0.smithi121.stdout:6/789: write d8/d9/d24/d3a/d81/fb6 [816571,31623] 0 2024-08-18T22:48:57.668 INFO:tasks.workunit.client.0.smithi121.stdout:6/790: stat d8/d9/d27/d46/f94 0 2024-08-18T22:48:57.679 INFO:tasks.workunit.client.0.smithi121.stdout:6/791: dwrite d8/d9/d27/d46/df0/ff4 [0,4194304] 0 2024-08-18T22:48:57.681 INFO:tasks.workunit.client.0.smithi121.stdout:6/792: mkdir d8/d9/d24/d25/daf/dc5/d11e 0 2024-08-18T22:48:57.683 INFO:tasks.workunit.client.0.smithi121.stdout:6/793: creat d8/d9/d24/dab/dc3/dcc/f11f x:0 0 0 2024-08-18T22:48:57.686 INFO:tasks.workunit.client.0.smithi121.stdout:6/794: mknod d8/d9/d24/d25/c120 0 2024-08-18T22:48:57.687 INFO:tasks.workunit.client.0.smithi121.stdout:6/795: write d8/d9/d24/d25/da2/fb5 [1941251,58600] 0 2024-08-18T22:48:57.690 INFO:tasks.workunit.client.0.smithi121.stdout:6/796: mkdir d8/d9/d24/dab/dc3/d121 0 2024-08-18T22:48:57.691 INFO:tasks.workunit.client.0.smithi121.stdout:6/797: mkdir d8/d9/d27/d46/dbd/d3f/d7c/d122 0 2024-08-18T22:48:57.693 INFO:tasks.workunit.client.0.smithi121.stdout:6/798: symlink d8/d9/d27/d46/l123 0 2024-08-18T22:48:57.698 INFO:tasks.workunit.client.0.smithi121.stdout:6/799: dwrite d8/d9/d14/fea [0,4194304] 0 2024-08-18T22:48:57.703 INFO:tasks.workunit.client.0.smithi121.stdout:6/800: dread d8/d9/d24/d3a/d81/fb6 [0,4194304] 0 2024-08-18T22:48:57.706 INFO:tasks.workunit.client.0.smithi121.stdout:6/801: rename d8/d9/d24/d3c/d74/cec to d8/d9/d24/dab/dc3/c124 0 2024-08-18T22:48:57.709 INFO:tasks.workunit.client.0.smithi121.stdout:6/802: creat d8/d9/d24/d25/daf/f125 x:0 0 0 2024-08-18T22:48:57.717 INFO:tasks.workunit.client.0.smithi121.stdout:6/803: truncate d8/d9/d27/d2b/d61/d9c/fa8 2910403 0 2024-08-18T22:48:57.718 INFO:tasks.workunit.client.0.smithi121.stdout:6/804: truncate d8/d9/d24/d3a/da7/fc1 442809 0 2024-08-18T22:48:57.721 INFO:tasks.workunit.client.0.smithi121.stdout:6/805: truncate d8/d9/d24/d25/d28/f32 1982743 0 2024-08-18T22:48:57.727 INFO:tasks.workunit.client.0.smithi121.stdout:6/806: dwrite d8/d9/d24/d3a/da7/fc1 [0,4194304] 0 2024-08-18T22:48:57.729 INFO:tasks.workunit.client.0.smithi121.stdout:6/807: dread d8/d9/d24/f43 [0,4194304] 0 2024-08-18T22:48:57.737 INFO:tasks.workunit.client.0.smithi121.stdout:6/808: dwrite d8/f8d [0,4194304] 0 2024-08-18T22:48:57.745 INFO:tasks.workunit.client.0.smithi121.stdout:6/809: dwrite d8/d9/d24/f105 [0,4194304] 0 2024-08-18T22:48:57.750 INFO:tasks.workunit.client.0.smithi121.stdout:6/810: rename d8/d9/d27/d46/dbd/d1e/d9a to d8/d9/d27/d46/dbd/d8b/d126 0 2024-08-18T22:48:57.754 INFO:tasks.workunit.client.0.smithi121.stdout:6/811: dread d8/d9/d24/d25/d28/f32 [0,4194304] 0 2024-08-18T22:48:57.756 INFO:tasks.workunit.client.0.smithi121.stdout:6/812: mknod d8/d9/d27/d46/dbd/d3f/d7c/d83/c127 0 2024-08-18T22:48:57.761 INFO:tasks.workunit.client.0.smithi121.stdout:6/813: getdents d8/d9/d27/d46/dbd/d8b 0 2024-08-18T22:48:57.762 INFO:tasks.workunit.client.0.smithi121.stdout:6/814: read d8/d9/d37/f75 [106486,58933] 0 2024-08-18T22:48:57.763 INFO:tasks.workunit.client.0.smithi121.stdout:6/815: chown d8/d9/d24/d25 3272388 1 2024-08-18T22:48:57.765 INFO:tasks.workunit.client.0.smithi121.stdout:6/816: creat d8/d9/f128 x:0 0 0 2024-08-18T22:48:57.765 INFO:tasks.workunit.client.0.smithi121.stdout:6/817: write d8/d9/d37/f109 [10745,85328] 0 2024-08-18T22:48:57.766 INFO:tasks.workunit.client.0.smithi121.stdout:6/818: write d8/d9/f128 [930171,46775] 0 2024-08-18T22:48:57.767 INFO:tasks.workunit.client.0.smithi121.stdout:6/819: chown d8/d9/d24/d3a/da7/ff7 0 1 2024-08-18T22:48:57.769 INFO:tasks.workunit.client.0.smithi121.stdout:6/820: write d8/d9/d24/d3c/d74/fb2 [723273,24969] 0 2024-08-18T22:48:57.769 INFO:tasks.workunit.client.0.smithi121.stdout:6/821: chown d8/d9/d27/d46/dbd/d3f/d7c 8758859 1 2024-08-18T22:48:57.772 INFO:tasks.workunit.client.0.smithi121.stdout:6/822: getdents d8/d9/d27/d2c/d66 0 2024-08-18T22:48:57.775 INFO:tasks.workunit.client.0.smithi121.stdout:6/823: link d8/d9/d27/d46/l4d d8/d9/d37/d48/l129 0 2024-08-18T22:48:57.777 INFO:tasks.workunit.client.0.smithi121.stdout:6/824: mkdir d8/d9/d27/d46/dbd/d3f/d12a 0 2024-08-18T22:48:57.780 INFO:tasks.workunit.client.0.smithi121.stdout:6/825: dread d8/d9/d24/d25/f54 [0,4194304] 0 2024-08-18T22:48:57.782 INFO:tasks.workunit.client.0.smithi121.stdout:6/826: mkdir d8/d9/d27/d46/dbd/d3f/d7c/d83/d12b 0 2024-08-18T22:48:57.782 INFO:tasks.workunit.client.0.smithi121.stdout:6/827: dread - d8/d9/d27/d2b/fd1 zero size 2024-08-18T22:48:57.784 INFO:tasks.workunit.client.0.smithi121.stdout:6/828: mknod d8/d9/d27/d46/dbd/d8b/d126/c12c 0 2024-08-18T22:48:57.784 INFO:tasks.workunit.client.0.smithi121.stdout:6/829: write d8/d9/d24/d3a/f52 [1150683,66231] 0 2024-08-18T22:48:57.785 INFO:tasks.workunit.client.0.smithi121.stdout:6/830: readlink d8/d9/d27/d2b/d61/ld8 0 2024-08-18T22:48:57.788 INFO:tasks.workunit.client.0.smithi121.stdout:6/831: rename d8/d9/d27/d46/dbd/d8b/cdf to d8/d9/d24/d25/da2/c12d 0 2024-08-18T22:48:57.790 INFO:tasks.workunit.client.0.smithi121.stdout:6/832: unlink d8/d9/d24/d3a/c79 0 2024-08-18T22:48:57.793 INFO:tasks.workunit.client.0.smithi121.stdout:6/833: dread d8/d9/d24/dab/f10d [0,4194304] 0 2024-08-18T22:48:57.794 INFO:tasks.workunit.client.0.smithi121.stdout:6/834: write d8/d9/d27/d2b/f6c [2395028,80826] 0 2024-08-18T22:48:57.797 INFO:tasks.workunit.client.0.smithi121.stdout:6/835: mkdir d8/d9/d24/d12e 0 2024-08-18T22:48:57.955 INFO:tasks.workunit.client.0.smithi121.stdout:6/836: sync 2024-08-18T22:48:57.956 INFO:tasks.workunit.client.0.smithi121.stdout:6/837: rmdir d8/d9/d24/d25/daf/deb 39 2024-08-18T22:48:57.959 INFO:tasks.workunit.client.0.smithi121.stdout:6/838: rmdir d8/d9/d24/d12e 0 2024-08-18T22:48:57.962 INFO:tasks.workunit.client.0.smithi121.stdout:6/839: creat d8/d9/d24/d25/daf/f12f x:0 0 0 2024-08-18T22:48:57.964 INFO:tasks.workunit.client.0.smithi121.stdout:6/840: creat d8/d9/d24/d3a/d81/df1/f130 x:0 0 0 2024-08-18T22:48:57.967 INFO:tasks.workunit.client.0.smithi121.stdout:6/841: dread d8/d9/d14/fea [0,4194304] 0 2024-08-18T22:48:57.968 INFO:tasks.workunit.client.0.smithi121.stdout:6/842: truncate d8/d9/d24/dab/f108 1029437 0 2024-08-18T22:48:57.969 INFO:tasks.workunit.client.0.smithi121.stdout:6/843: write d8/d9/d24/dab/dc3/dcc/f11f [917428,34080] 0 2024-08-18T22:48:57.972 INFO:tasks.workunit.client.0.smithi121.stdout:6/844: unlink d8/d9/d24/d3a/l97 0 2024-08-18T22:48:57.974 INFO:tasks.workunit.client.0.smithi121.stdout:6/845: creat d8/d9/d27/d46/dbd/d1e/f131 x:0 0 0 2024-08-18T22:48:57.976 INFO:tasks.workunit.client.0.smithi121.stdout:6/846: mknod d8/d9/d24/d25/c132 0 2024-08-18T22:48:57.978 INFO:tasks.workunit.client.0.smithi121.stdout:6/847: read d8/d9/d27/d2b/d61/d9c/fa8 [8002,102414] 0 2024-08-18T22:48:57.980 INFO:tasks.workunit.client.0.smithi121.stdout:6/848: creat d8/d9/d27/d46/dbd/f133 x:0 0 0 2024-08-18T22:48:57.982 INFO:tasks.workunit.client.0.smithi121.stdout:6/849: dread d8/d9/d24/d25/f82 [0,4194304] 0 2024-08-18T22:48:57.984 INFO:tasks.workunit.client.0.smithi121.stdout:6/850: creat d8/d9/d27/d46/dbd/d49/f134 x:0 0 0 2024-08-18T22:48:57.987 INFO:tasks.workunit.client.0.smithi121.stdout:6/851: rename d8/d9/d27/d46/dbd/d1e/ldd to d8/d9/d14/l135 0 2024-08-18T22:48:57.990 INFO:tasks.workunit.client.0.smithi121.stdout:6/852: creat d8/d9/d24/dab/dc3/f136 x:0 0 0 2024-08-18T22:48:57.992 INFO:tasks.workunit.client.0.smithi121.stdout:6/853: fdatasync d8/d9/d27/d46/dbd/d1e/f23 0 2024-08-18T22:48:57.997 INFO:tasks.workunit.client.0.smithi121.stdout:6/854: dwrite d8/d9/f30 [0,4194304] 0 2024-08-18T22:48:57.999 INFO:tasks.workunit.client.0.smithi121.stdout:6/855: symlink d8/d9/d24/d3c/d65/l137 0 2024-08-18T22:48:58.005 INFO:tasks.workunit.client.0.smithi121.stdout:6/856: dwrite d8/d9/d24/d3a/da7/ff7 [0,4194304] 0 2024-08-18T22:48:58.011 INFO:tasks.workunit.client.0.smithi121.stdout:6/857: dwrite d8/d9/d27/d2b/d61/f9d [0,4194304] 0 2024-08-18T22:48:58.014 INFO:tasks.workunit.client.0.smithi121.stdout:6/858: creat d8/d9/d27/d2c/f138 x:0 0 0 2024-08-18T22:48:58.018 INFO:tasks.workunit.client.0.smithi121.stdout:6/859: unlink d8/d9/f30 0 2024-08-18T22:48:58.019 INFO:tasks.workunit.client.0.smithi121.stdout:6/860: readlink d8/d9/d24/d3c/da1/l10c 0 2024-08-18T22:48:58.026 INFO:tasks.workunit.client.0.smithi121.stdout:6/861: write d8/d9/d27/d46/dbd/d1e/fe1 [1154751,41184] 0 2024-08-18T22:48:58.028 INFO:tasks.workunit.client.0.smithi121.stdout:6/862: mknod d8/d9/d24/d25/da2/c139 0 2024-08-18T22:48:58.031 INFO:tasks.workunit.client.0.smithi121.stdout:6/863: dread d8/d9/d24/d25/f45 [0,4194304] 0 2024-08-18T22:48:58.035 INFO:tasks.workunit.client.0.smithi121.stdout:6/864: dwrite d8/d9/d24/d3a/f9f [4194304,4194304] 0 2024-08-18T22:48:58.036 INFO:tasks.workunit.client.0.smithi121.stdout:6/865: stat d8/cce 0 2024-08-18T22:48:58.040 INFO:tasks.workunit.client.0.smithi121.stdout:6/866: getdents d8/d9 0 2024-08-18T22:48:58.042 INFO:tasks.workunit.client.0.smithi121.stdout:6/867: creat d8/d9/d24/d25/daf/dc5/f13a x:0 0 0 2024-08-18T22:48:58.042 INFO:tasks.workunit.client.0.smithi121.stdout:6/868: stat d8/d9/d27/d2b/f6c 0 2024-08-18T22:48:58.045 INFO:tasks.workunit.client.0.smithi121.stdout:6/869: rename d8/d9/d24/d25/da2/fb5 to d8/d9/d27/d46/dbd/f13b 0 2024-08-18T22:48:58.046 INFO:tasks.workunit.client.0.smithi121.stdout:6/870: dread - d8/d9/d24/dab/dc3/dcc/fe9 zero size 2024-08-18T22:48:58.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:48:57 smithi121 ceph-mon[81053]: pgmap v194: 65 pgs: 65 active+clean; 2.0 GiB data, 5.9 GiB used, 531 GiB / 536 GiB avail; 9.1 MiB/s rd, 6.7 MiB/s wr, 71 op/s 2024-08-18T22:48:58.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:48:57 smithi195 ceph-mon[68841]: pgmap v194: 65 pgs: 65 active+clean; 2.0 GiB data, 5.9 GiB used, 531 GiB / 536 GiB avail; 9.1 MiB/s rd, 6.7 MiB/s wr, 71 op/s 2024-08-18T22:48:58.223 INFO:tasks.workunit.client.0.smithi121.stdout:6/871: sync 2024-08-18T22:48:58.223 INFO:tasks.workunit.client.0.smithi121.stdout:6/872: stat d8/d9/d24/dab/dc3/dcc/f10e 0 2024-08-18T22:48:58.226 INFO:tasks.workunit.client.0.smithi121.stdout:6/873: unlink d8/d9/d27/d46/dbd/d3f/d7c/d83/c107 0 2024-08-18T22:48:58.228 INFO:tasks.workunit.client.0.smithi121.stdout:6/874: truncate d8/d9/d14/f70 192338 0 2024-08-18T22:48:58.234 INFO:tasks.workunit.client.0.smithi121.stdout:6/875: write d8/d9/d24/d25/daf/fe5 [3615417,38029] 0 2024-08-18T22:48:58.239 INFO:tasks.workunit.client.0.smithi121.stdout:6/876: dwrite d8/d9/d27/d46/df0/ff4 [0,4194304] 0 2024-08-18T22:48:58.241 INFO:tasks.workunit.client.0.smithi121.stdout:6/877: mkdir d8/d9/dfb/d13c 0 2024-08-18T22:48:58.250 INFO:tasks.workunit.client.0.smithi121.stdout:6/878: dwrite d8/d9/d27/d46/dbd/d3f/f58 [0,4194304] 0 2024-08-18T22:48:58.253 INFO:tasks.workunit.client.0.smithi121.stdout:6/879: creat d8/d9/d27/d2b/d61/f13d x:0 0 0 2024-08-18T22:48:58.255 INFO:tasks.workunit.client.0.smithi121.stdout:6/880: write d8/d9/d24/d3a/d81/df1/f130 [341048,86866] 0 2024-08-18T22:48:58.256 INFO:tasks.workunit.client.0.smithi121.stdout:6/881: write d8/d9/d14/fea [3538602,65438] 0 2024-08-18T22:48:58.260 INFO:tasks.workunit.client.0.smithi121.stdout:6/882: rename d8/d9/d27/d2b/f6c to d8/d9/d37/d48/f13e 0 2024-08-18T22:48:58.262 INFO:tasks.workunit.client.0.smithi121.stdout:6/883: symlink d8/d9/d27/l13f 0 2024-08-18T22:48:58.263 INFO:tasks.workunit.client.0.smithi121.stdout:6/884: write d8/d9/d24/f43 [634106,126520] 0 2024-08-18T22:48:58.266 INFO:tasks.workunit.client.0.smithi121.stdout:6/885: creat d8/d9/d27/d2b/f140 x:0 0 0 2024-08-18T22:48:58.267 INFO:tasks.workunit.client.0.smithi121.stdout:6/886: rmdir d8/d9/d24/d3c/d65 39 2024-08-18T22:48:58.272 INFO:tasks.workunit.client.0.smithi121.stdout:6/887: write d8/d9/d24/d25/d28/f32 [1400133,84416] 0 2024-08-18T22:48:58.275 INFO:tasks.workunit.client.0.smithi121.stdout:6/888: truncate d8/d9/d27/d46/dbd/d1e/f80 3603757 0 2024-08-18T22:48:58.276 INFO:tasks.workunit.client.0.smithi121.stdout:6/889: fsync d8/d9/d24/f43 0 2024-08-18T22:48:58.278 INFO:tasks.workunit.client.0.smithi121.stdout:6/890: creat d8/d9/d27/d46/dbd/d49/f141 x:0 0 0 2024-08-18T22:48:58.278 INFO:tasks.workunit.client.0.smithi121.stdout:6/891: dread - d8/d9/d27/d2b/fd1 zero size 2024-08-18T22:48:58.280 INFO:tasks.workunit.client.0.smithi121.stdout:6/892: dread d8/d9/d37/f6f [0,4194304] 0 2024-08-18T22:48:58.282 INFO:tasks.workunit.client.0.smithi121.stdout:6/893: fsync d8/d9/d37/f75 0 2024-08-18T22:48:58.282 INFO:tasks.workunit.client.0.smithi121.stdout:6/894: fdatasync d8/d9/d24/d25/daf/dc5/fef 0 2024-08-18T22:48:58.285 INFO:tasks.workunit.client.0.smithi121.stdout:6/895: rename d8/d9/l11 to d8/d9/d27/d2b/d61/l142 0 2024-08-18T22:48:58.292 INFO:tasks.workunit.client.0.smithi121.stdout:6/896: truncate d8/d9/d27/d2b/f68 551428 0 2024-08-18T22:48:58.297 INFO:tasks.workunit.client.0.smithi121.stdout:6/897: dwrite d8/d9/d24/dab/dc3/dcc/fe9 [0,4194304] 0 2024-08-18T22:48:58.298 INFO:tasks.workunit.client.0.smithi121.stdout:6/898: readlink d8/d9/d24/dab/dc3/dcc/dcd/ld9 0 2024-08-18T22:48:58.448 INFO:tasks.workunit.client.0.smithi121.stdout:6/899: sync 2024-08-18T22:48:58.449 INFO:tasks.workunit.client.0.smithi121.stdout:6/900: chown d8/d9/d24/d3a/ff8 14 1 2024-08-18T22:48:58.452 INFO:tasks.workunit.client.0.smithi121.stdout:6/901: link d8/d9/d24/dab/dc3/dcc/l111 d8/d9/d24/d3a/da7/l143 0 2024-08-18T22:48:58.454 INFO:tasks.workunit.client.0.smithi121.stdout:6/902: creat d8/d9/d24/d3c/da1/f144 x:0 0 0 2024-08-18T22:48:58.566 INFO:tasks.workunit.client.0.smithi121.stdout:6/903: sync 2024-08-18T22:48:58.569 INFO:tasks.workunit.client.0.smithi121.stdout:6/904: mkdir d8/d9/d24/d25/d145 0 2024-08-18T22:48:58.569 INFO:tasks.workunit.client.0.smithi121.stdout:6/905: read d8/d9/d24/d3c/da1/f112 [1157777,116022] 0 2024-08-18T22:48:58.571 INFO:tasks.workunit.client.0.smithi121.stdout:6/906: chown d8/d9/d14/fd3 247454 1 2024-08-18T22:48:58.709 INFO:tasks.workunit.client.0.smithi121.stdout:6/907: sync 2024-08-18T22:48:58.712 INFO:tasks.workunit.client.0.smithi121.stdout:6/908: unlink d8/d9/d24/d3a/da7/ff7 0 2024-08-18T22:48:58.717 INFO:tasks.workunit.client.0.smithi121.stdout:6/909: dwrite d8/d9/d27/d2c/d66/fc7 [0,4194304] 0 2024-08-18T22:48:58.719 INFO:tasks.workunit.client.0.smithi121.stdout:6/910: write d8/d9/d37/f75 [733887,49047] 0 2024-08-18T22:48:58.722 INFO:tasks.workunit.client.0.smithi121.stdout:6/911: rmdir d8/d9/d24/d25/daf 39 2024-08-18T22:48:58.728 INFO:tasks.workunit.client.0.smithi121.stdout:6/912: rmdir d8/d9/dfb/d13c 0 2024-08-18T22:48:58.731 INFO:tasks.workunit.client.0.smithi121.stdout:6/913: creat d8/d9/d24/d3c/d65/f146 x:0 0 0 2024-08-18T22:48:58.732 INFO:tasks.workunit.client.0.smithi121.stdout:6/914: write d8/d9/d24/d25/fcf [797474,27867] 0 2024-08-18T22:48:58.733 INFO:tasks.workunit.client.0.smithi121.stdout:6/915: dread - d8/d9/d27/d46/f94 zero size 2024-08-18T22:48:58.736 INFO:tasks.workunit.client.0.smithi121.stdout:6/916: rename d8/d9/d27/d46/dbd/d8b/fc8 to d8/d9/d24/d3c/da1/f147 0 2024-08-18T22:48:58.738 INFO:tasks.workunit.client.0.smithi121.stdout:6/917: symlink d8/d9/d27/d46/dbd/d8b/d126/l148 0 2024-08-18T22:48:58.743 INFO:tasks.workunit.client.0.smithi121.stdout:6/918: dwrite d8/d9/d27/d46/dbd/d49/f134 [0,4194304] 0 2024-08-18T22:48:58.743 INFO:tasks.workunit.client.0.smithi121.stdout:6/919: chown d8/d9/d24/d25/d28 2066621 1 2024-08-18T22:48:58.745 INFO:tasks.workunit.client.0.smithi121.stdout:6/920: chown d8/d9/l1b 1634415659 1 2024-08-18T22:48:58.747 INFO:tasks.workunit.client.0.smithi121.stdout:6/921: dread - d8/d9/d24/d25/daf/dc5/fef zero size 2024-08-18T22:48:58.751 INFO:tasks.workunit.client.0.smithi121.stdout:6/922: dread d8/d9/d24/d25/d28/f32 [0,4194304] 0 2024-08-18T22:48:58.754 INFO:tasks.workunit.client.0.smithi121.stdout:6/923: rename d8/d9/d27/d46/dbd/fb4 to d8/d9/d27/d46/dbd/d3f/d12a/f149 0 2024-08-18T22:48:58.755 INFO:tasks.workunit.client.0.smithi121.stdout:6/924: readlink d8/d9/d27/d2c/d66/l100 0 2024-08-18T22:48:58.758 INFO:tasks.workunit.client.0.smithi121.stdout:6/925: dread d8/d9/d24/dab/dc3/dcc/fe9 [0,4194304] 0 2024-08-18T22:48:58.760 INFO:tasks.workunit.client.0.smithi121.stdout:6/926: creat d8/d9/d24/d25/da2/f14a x:0 0 0 2024-08-18T22:48:58.763 INFO:tasks.workunit.client.0.smithi121.stdout:6/927: link d8/d9/d37/d48/l86 d8/d9/d24/d25/daf/deb/l14b 0 2024-08-18T22:48:58.765 INFO:tasks.workunit.client.0.smithi121.stdout:6/928: creat d8/d9/d14/f14c x:0 0 0 2024-08-18T22:48:58.767 INFO:tasks.workunit.client.0.smithi121.stdout:6/929: creat d8/d9/d27/d46/dbd/d8b/f14d x:0 0 0 2024-08-18T22:48:58.767 INFO:tasks.workunit.client.0.smithi121.stdout:6/930: write d8/f8d [3105322,66890] 0 2024-08-18T22:48:58.770 INFO:tasks.workunit.client.0.smithi121.stdout:6/931: mknod d8/d9/d115/c14e 0 2024-08-18T22:48:58.772 INFO:tasks.workunit.client.0.smithi121.stdout:6/932: creat d8/d9/d24/d3a/d81/f14f x:0 0 0 2024-08-18T22:48:58.772 INFO:tasks.workunit.client.0.smithi121.stdout:6/933: write d8/d9/d37/f75 [160505,4663] 0 2024-08-18T22:48:58.775 INFO:tasks.workunit.client.0.smithi121.stdout:6/934: write d8/f15 [4719205,123131] 0 2024-08-18T22:48:58.778 INFO:tasks.workunit.client.0.smithi121.stdout:6/935: dread d8/d9/d24/d3a/d81/df1/f130 [0,4194304] 0 2024-08-18T22:48:58.778 INFO:tasks.workunit.client.0.smithi121.stdout:6/936: fdatasync d8/d9/d27/d2c/f50 0 2024-08-18T22:48:58.779 INFO:tasks.workunit.client.0.smithi121.stdout:6/937: fdatasync d8/d9/d24/d25/f45 0 2024-08-18T22:48:58.781 INFO:tasks.workunit.client.0.smithi121.stdout:6/938: unlink d8/d9/d27/d46/dbd/d3f/f9e 0 2024-08-18T22:48:58.783 INFO:tasks.workunit.client.0.smithi121.stdout:6/939: mkdir d8/d9/d24/d25/daf/dc5/d11e/d150 0 2024-08-18T22:48:58.785 INFO:tasks.workunit.client.0.smithi121.stdout:6/940: creat d8/d9/d24/d25/daf/deb/f151 x:0 0 0 2024-08-18T22:48:58.785 INFO:tasks.workunit.client.0.smithi121.stdout:6/941: fdatasync d8/d9/d27/d2b/d61/f13d 0 2024-08-18T22:48:58.786 INFO:tasks.workunit.client.0.smithi121.stdout:6/942: chown d8/d9/d27/d2b/d61/ld8 2899146 1 2024-08-18T22:48:58.858 INFO:tasks.workunit.client.0.smithi121.stdout:6/943: sync 2024-08-18T22:48:58.859 INFO:tasks.workunit.client.0.smithi121.stdout:6/944: rmdir d8/d9/d27/d46/dbd/d1e 39 2024-08-18T22:48:58.860 INFO:tasks.workunit.client.0.smithi121.stdout:6/945: stat d8/d9/d37 0 2024-08-18T22:48:58.866 INFO:tasks.workunit.client.0.smithi121.stdout:6/946: dwrite d8/d9/d24/d25/daf/fe5 [4194304,4194304] 0 2024-08-18T22:48:58.868 INFO:tasks.workunit.client.0.smithi121.stdout:6/947: symlink d8/d9/d27/d46/dbd/d3f/d12a/l152 0 2024-08-18T22:48:58.874 INFO:tasks.workunit.client.0.smithi121.stdout:6/948: getdents d8/d9/d24/d25/daf 0 2024-08-18T22:48:58.877 INFO:tasks.workunit.client.0.smithi121.stdout:6/949: mkdir d8/d9/d27/d2c/d66/d153 0 2024-08-18T22:48:58.880 INFO:tasks.workunit.client.0.smithi121.stdout:6/950: dread d8/d9/d37/f5c [0,4194304] 0 2024-08-18T22:48:58.881 INFO:tasks.workunit.client.0.smithi121.stdout:6/951: readlink d8/l17 0 2024-08-18T22:48:58.883 INFO:tasks.workunit.client.0.smithi121.stdout:6/952: creat d8/d9/d24/d3c/d65/f154 x:0 0 0 2024-08-18T22:48:58.885 INFO:tasks.workunit.client.0.smithi121.stdout:6/953: write d8/d9/d14/f62 [1851191,30794] 0 2024-08-18T22:48:58.887 INFO:tasks.workunit.client.0.smithi121.stdout:6/954: creat d8/d9/d27/d46/dbd/d49/f155 x:0 0 0 2024-08-18T22:48:58.888 INFO:tasks.workunit.client.0.smithi121.stdout:6/955: creat d8/d9/d115/f156 x:0 0 0 2024-08-18T22:48:58.894 INFO:tasks.workunit.client.0.smithi121.stdout:6/956: dwrite d8/d9/d14/f14c [0,4194304] 0 2024-08-18T22:48:58.901 INFO:tasks.workunit.client.0.smithi121.stdout:6/957: dwrite d8/d9/d14/fea [4194304,4194304] 0 2024-08-18T22:48:58.902 INFO:tasks.workunit.client.0.smithi121.stdout:6/958: dread - d8/d9/d27/d46/dbd/d3f/d12a/f149 zero size 2024-08-18T22:48:58.903 INFO:tasks.workunit.client.0.smithi121.stdout:6/959: chown d8/d9/d24/d3c/d65/cf5 0 1 2024-08-18T22:48:58.905 INFO:tasks.workunit.client.0.smithi121.stdout:6/960: mknod d8/d9/d27/d46/dbd/d8b/d126/c157 0 2024-08-18T22:48:58.909 INFO:tasks.workunit.client.0.smithi121.stdout:6/961: creat d8/d9/d24/d3a/da7/d11c/f158 x:0 0 0 2024-08-18T22:48:58.912 INFO:tasks.workunit.client.0.smithi121.stdout:6/962: creat d8/d9/ddc/f159 x:0 0 0 2024-08-18T22:48:58.915 INFO:tasks.workunit.client.0.smithi121.stdout:6/963: dread d8/d9/d37/f75 [0,4194304] 0 2024-08-18T22:48:58.920 INFO:tasks.workunit.client.0.smithi121.stdout:6/964: write d8/d9/d24/d3c/da1/f112 [3193968,84425] 0 2024-08-18T22:48:58.922 INFO:tasks.workunit.client.0.smithi121.stdout:6/965: mkdir d8/d9/d24/dab/d15a 0 2024-08-18T22:48:58.923 INFO:tasks.workunit.client.0.smithi121.stdout:6/966: write d8/f19 [3653692,9907] 0 2024-08-18T22:48:58.924 INFO:tasks.workunit.client.0.smithi121.stdout:6/967: write d8/d9/d24/d3c/d65/fed [645893,5591] 0 2024-08-18T22:48:58.925 INFO:tasks.workunit.client.0.smithi121.stdout:6/968: readlink d8/d9/d24/d3c/lfa 0 2024-08-18T22:48:58.926 INFO:tasks.workunit.client.0.smithi121.stdout:6/969: stat d8/d9/d24/d25/d28/f89 0 2024-08-18T22:48:58.927 INFO:tasks.workunit.client.0.smithi121.stdout:6/970: mknod d8/d9/ddc/c15b 0 2024-08-18T22:48:58.933 INFO:tasks.workunit.client.0.smithi121.stdout:6/971: dwrite d8/d9/d27/d46/dbd/f13b [0,4194304] 0 2024-08-18T22:48:58.938 INFO:tasks.workunit.client.0.smithi121.stdout:6/972: dread d8/d9/d27/d46/f88 [0,4194304] 0 2024-08-18T22:48:58.939 INFO:tasks.workunit.client.0.smithi121.stdout:6/973: dread - d8/d9/d24/d25/daf/fe8 zero size 2024-08-18T22:48:58.941 INFO:tasks.workunit.client.0.smithi121.stdout:6/974: mknod d8/d9/d24/dab/dc3/d121/c15c 0 2024-08-18T22:48:58.944 INFO:tasks.workunit.client.0.smithi121.stdout:6/975: link d8/d9/d24/d3a/da7/d11c/f158 d8/d9/f15d 0 2024-08-18T22:48:58.949 INFO:tasks.workunit.client.0.smithi121.stdout:6/976: rename d8/d9/d24/d25/d28/l4f to d8/d9/d27/d2c/d66/l15e 0 2024-08-18T22:48:58.950 INFO:tasks.workunit.client.0.smithi121.stdout:6/977: read d8/d9/d24/d25/fa0 [920966,81052] 0 2024-08-18T22:48:58.955 INFO:tasks.workunit.client.0.smithi121.stdout:6/978: dwrite d8/d9/d24/d25/f82 [0,4194304] 0 2024-08-18T22:48:58.963 INFO:tasks.workunit.client.0.smithi121.stdout:6/979: dwrite d8/d9/d37/d48/f13e [0,4194304] 0 2024-08-18T22:48:58.966 INFO:tasks.workunit.client.0.smithi121.stdout:6/980: unlink d8/d9/d27/d2c/f42 0 2024-08-18T22:48:58.972 INFO:tasks.workunit.client.0.smithi121.stdout:6/981: rename d8/d9/d27/d2b/f68 to d8/d9/d27/d46/dbd/d1e/f15f 0 2024-08-18T22:48:58.974 INFO:tasks.workunit.client.0.smithi121.stdout:6/982: mkdir d8/d9/d27/d2c/d160 0 2024-08-18T22:48:58.976 INFO:tasks.workunit.client.0.smithi121.stdout:6/983: creat d8/d9/d24/d25/d28/f161 x:0 0 0 2024-08-18T22:48:58.976 INFO:tasks.workunit.client.0.smithi121.stdout:6/984: chown d8/d9/d24/d25/daf/fe5 13 1 2024-08-18T22:48:58.978 INFO:tasks.workunit.client.0.smithi121.stdout:6/985: write d8/d9/d24/dab/dc3/dcc/fe9 [3351466,118116] 0 2024-08-18T22:48:58.982 INFO:tasks.workunit.client.0.smithi121.stdout:6/986: dread d8/d9/d24/dab/f10d [0,4194304] 0 2024-08-18T22:48:58.983 INFO:tasks.workunit.client.0.smithi121.stdout:6/987: dread - d8/d9/d24/d3a/ff8 zero size 2024-08-18T22:48:58.984 INFO:tasks.workunit.client.0.smithi121.stdout:6/988: dread - d8/d9/d115/f156 zero size 2024-08-18T22:48:58.987 INFO:tasks.workunit.client.0.smithi121.stdout:6/989: creat d8/d9/d24/dab/dc3/d121/f162 x:0 0 0 2024-08-18T22:48:58.993 INFO:tasks.workunit.client.0.smithi121.stdout:6/990: dwrite d8/d9/d24/d3c/d65/f146 [0,4194304] 0 2024-08-18T22:48:58.995 INFO:tasks.workunit.client.0.smithi121.stdout:6/991: read d8/d9/d27/d2b/d61/d9c/fa8 [1859678,96182] 0 2024-08-18T22:48:58.996 INFO:tasks.workunit.client.0.smithi121.stdout:6/992: mknod d8/d9/d24/d3a/d81/c163 0 2024-08-18T22:48:58.997 INFO:tasks.workunit.client.0.smithi121.stdout:6/993: chown d8/d9/d27/d46/dbd/f133 250663821 1 2024-08-18T22:48:58.998 INFO:tasks.workunit.client.0.smithi121.stdout:6/994: chown d8/d9/d37/d48/f13e 423 1 2024-08-18T22:48:59.000 INFO:tasks.workunit.client.0.smithi121.stdout:6/995: creat d8/d9/d37/d48/f164 x:0 0 0 2024-08-18T22:48:59.001 INFO:tasks.workunit.client.0.smithi121.stdout:6/996: write d8/d9/d24/d25/d28/f89 [3201113,127030] 0 2024-08-18T22:48:59.003 INFO:tasks.workunit.client.0.smithi121.stdout:6/997: dread - d8/d9/f15d zero size 2024-08-18T22:48:59.006 INFO:tasks.workunit.client.0.smithi121.stdout:6/998: creat d8/d9/f165 x:0 0 0 2024-08-18T22:48:59.006 INFO:tasks.workunit.client.0.smithi121.stdout:6/999: stat d8/d9/d24/d25/daf 0 2024-08-18T22:48:59.011 INFO:tasks.workunit.client.0.smithi121.stderr:+ rm -rf -- ./tmp.pFCfUp6iZz 2024-08-18T22:49:00.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:48:59 smithi121 ceph-mon[81053]: pgmap v195: 65 pgs: 65 active+clean; 2.0 GiB data, 6.0 GiB used, 530 GiB / 536 GiB avail; 8.2 MiB/s rd, 13 MiB/s wr, 72 op/s 2024-08-18T22:49:00.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:48:59 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:49:00.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:48:59 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:49:00.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:48:59 smithi195 ceph-mon[68841]: pgmap v195: 65 pgs: 65 active+clean; 2.0 GiB data, 6.0 GiB used, 530 GiB / 536 GiB avail; 8.2 MiB/s rd, 13 MiB/s wr, 72 op/s 2024-08-18T22:49:00.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:48:59 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:49:00.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:48:59 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:49:01.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:49:00 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:49:01.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:49:00 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:49:01.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:49:00 smithi121 ceph-mon[81053]: pgmap v196: 65 pgs: 65 active+clean; 2.1 GiB data, 6.1 GiB used, 530 GiB / 536 GiB avail; 6.0 MiB/s rd, 22 MiB/s wr, 99 op/s 2024-08-18T22:49:01.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:49:00 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:49:01.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:49:00 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:49:01.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:49:00 smithi195 ceph-mon[68841]: pgmap v196: 65 pgs: 65 active+clean; 2.1 GiB data, 6.1 GiB used, 530 GiB / 536 GiB avail; 6.0 MiB/s rd, 22 MiB/s wr, 99 op/s 2024-08-18T22:49:03.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:49:03 smithi195 ceph-mon[68841]: pgmap v197: 65 pgs: 65 active+clean; 2.0 GiB data, 6.1 GiB used, 530 GiB / 536 GiB avail; 1.8 MiB/s rd, 32 MiB/s wr, 114 op/s 2024-08-18T22:49:03.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:49:03 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:49:03.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:49:03 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:49:03.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:49:03 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:49:03.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:49:03 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-18T22:49:03.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:49:03 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:49:03.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:49:03 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-18T22:49:03.910 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:49:03 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "versions"}]: dispatch 2024-08-18T22:49:03.910 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:49:03 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "versions"}]: dispatch 2024-08-18T22:49:03.910 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:49:03 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "versions"}]: dispatch 2024-08-18T22:49:03.910 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:49:03 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "versions"}]: dispatch 2024-08-18T22:49:03.910 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:49:03 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi195.buqvbr"]}]: dispatch 2024-08-18T22:49:04.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:49:03 smithi121 ceph-mon[81053]: pgmap v197: 65 pgs: 65 active+clean; 2.0 GiB data, 6.1 GiB used, 530 GiB / 536 GiB avail; 1.8 MiB/s rd, 32 MiB/s wr, 114 op/s 2024-08-18T22:49:04.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:49:03 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:49:04.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:49:03 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:49:04.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:49:03 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:49:04.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:49:03 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-18T22:49:04.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:49:03 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:49:04.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:49:03 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-18T22:49:04.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:49:03 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "versions"}]: dispatch 2024-08-18T22:49:04.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:49:03 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "versions"}]: dispatch 2024-08-18T22:49:04.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:49:03 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "versions"}]: dispatch 2024-08-18T22:49:04.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:49:03 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "versions"}]: dispatch 2024-08-18T22:49:04.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:49:03 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi195.buqvbr"]}]: dispatch 2024-08-18T22:49:04.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:49:04 smithi195 ceph-mon[68841]: Upgrade: It appears safe to stop mds.cephfs.smithi195.buqvbr 2024-08-18T22:49:05.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:49:04 smithi121 ceph-mon[81053]: Upgrade: It appears safe to stop mds.cephfs.smithi195.buqvbr 2024-08-18T22:49:05.842 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:49:05 smithi195 ceph-mon[68841]: pgmap v198: 65 pgs: 65 active+clean; 1.8 GiB data, 5.8 GiB used, 531 GiB / 536 GiB avail; 532 KiB/s rd, 32 MiB/s wr, 131 op/s 2024-08-18T22:49:05.842 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:49:05 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:49:05.842 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:49:05 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi195.buqvbr", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-08-18T22:49:05.842 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:49:05 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:49:06.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:49:05 smithi121 ceph-mon[81053]: pgmap v198: 65 pgs: 65 active+clean; 1.8 GiB data, 5.8 GiB used, 531 GiB / 536 GiB avail; 532 KiB/s rd, 32 MiB/s wr, 131 op/s 2024-08-18T22:49:06.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:49:05 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:49:06.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:49:05 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi195.buqvbr", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-08-18T22:49:06.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:49:05 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:49:06.872 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:49:06 smithi195 ceph-mon[68841]: Upgrade: Updating mds.cephfs.smithi195.buqvbr 2024-08-18T22:49:06.872 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:49:06 smithi195 ceph-mon[68841]: Deploying daemon mds.cephfs.smithi195.buqvbr on smithi195 2024-08-18T22:49:07.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:49:06 smithi121 ceph-mon[81053]: Upgrade: Updating mds.cephfs.smithi195.buqvbr 2024-08-18T22:49:07.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:49:06 smithi121 ceph-mon[81053]: Deploying daemon mds.cephfs.smithi195.buqvbr on smithi195 2024-08-18T22:49:08.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:49:07 smithi121 ceph-mon[81053]: pgmap v199: 65 pgs: 65 active+clean; 1.5 GiB data, 4.7 GiB used, 532 GiB / 536 GiB avail; 541 KiB/s rd, 30 MiB/s wr, 91 op/s 2024-08-18T22:49:08.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:49:07 smithi195 ceph-mon[68841]: pgmap v199: 65 pgs: 65 active+clean; 1.5 GiB data, 4.7 GiB used, 532 GiB / 536 GiB avail; 541 KiB/s rd, 30 MiB/s wr, 91 op/s 2024-08-18T22:49:08.839 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-08-18T22:49:08.839 DEBUG:teuthology.orchestra.run.smithi121:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-08-18T22:49:09.025 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:49:08 smithi195 ceph-mon[68841]: osdmap e83: 6 total, 6 up, 6 in 2024-08-18T22:49:09.025 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:49:08 smithi195 ceph-mon[68841]: fsmap cephfs:1 {0=cephfs.smithi195.nptgyc=up:active} 2 up:standby 2024-08-18T22:49:09.025 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:49:08 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi195.buqvbr"}]: dispatch 2024-08-18T22:49:09.025 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:49:08 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-18T22:49:09.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:49:08 smithi121 ceph-mon[81053]: osdmap e83: 6 total, 6 up, 6 in 2024-08-18T22:49:09.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:49:08 smithi121 ceph-mon[81053]: fsmap cephfs:1 {0=cephfs.smithi195.nptgyc=up:active} 2 up:standby 2024-08-18T22:49:09.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:49:08 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi195.buqvbr"}]: dispatch 2024-08-18T22:49:09.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:49:08 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-18T22:49:09.984 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:49:09 smithi121 ceph-mon[81053]: pgmap v201: 65 pgs: 65 active+clean; 1.1 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail; 281 KiB/s rd, 24 MiB/s wr, 154 op/s 2024-08-18T22:49:10.068 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:49:09 smithi195 ceph-mon[68841]: pgmap v201: 65 pgs: 65 active+clean; 1.1 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail; 281 KiB/s rd, 24 MiB/s wr, 154 op/s 2024-08-18T22:49:10.422 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:10.420+0000 7f4dafa66640 1 -- 172.21.15.121:0/3907786828 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4da80fc4a0 msgr2=0x7f4da80fc910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:49:10.422 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:10.420+0000 7f4dafa66640 1 --2- 172.21.15.121:0/3907786828 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4da80fc4a0 0x7f4da80fc910 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f4d980048d0 tx=0x7f4d98009da0 comp rx=0 tx=0).stop 2024-08-18T22:49:10.422 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:10.420+0000 7f4dafa66640 1 -- 172.21.15.121:0/3907786828 shutdown_connections 2024-08-18T22:49:10.422 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:10.420+0000 7f4dafa66640 1 --2- 172.21.15.121:0/3907786828 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4da80fc4a0 0x7f4da80fc910 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:49:10.422 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:10.420+0000 7f4dafa66640 1 --2- 172.21.15.121:0/3907786828 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4da80fb1d0 0x7f4da80fb5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:49:10.422 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:10.420+0000 7f4dafa66640 1 -- 172.21.15.121:0/3907786828 >> 172.21.15.121:0/3907786828 conn(0x7f4da80f69b0 msgr2=0x7f4da80f8dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:49:10.423 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:10.421+0000 7f4dafa66640 1 -- 172.21.15.121:0/3907786828 shutdown_connections 2024-08-18T22:49:10.423 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:10.421+0000 7f4dafa66640 1 -- 172.21.15.121:0/3907786828 wait complete. 2024-08-18T22:49:10.423 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:10.421+0000 7f4dafa66640 1 Processor -- start 2024-08-18T22:49:10.423 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:10.421+0000 7f4dafa66640 1 -- start start 2024-08-18T22:49:10.424 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:10.421+0000 7f4dafa66640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4da80fb1d0 0x7f4da80ff2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:49:10.424 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:10.421+0000 7f4dafa66640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4da80fc4a0 0x7f4da80fd7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:49:10.424 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:10.421+0000 7f4dafa66640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4da80fdd70 con 0x7f4da80fb1d0 2024-08-18T22:49:10.424 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:10.421+0000 7f4dafa66640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4da80fdeb0 con 0x7f4da80fc4a0 2024-08-18T22:49:10.424 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:10.422+0000 7f4dad802640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4da80fb1d0 0x7f4da80ff2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:49:10.424 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:10.422+0000 7f4dad802640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4da80fb1d0 0x7f4da80ff2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:50706/0 (socket says 172.21.15.121:50706) 2024-08-18T22:49:10.424 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:10.422+0000 7f4dad001640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4da80fc4a0 0x7f4da80fd7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:49:10.424 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:10.422+0000 7f4dad802640 1 -- 172.21.15.121:0/2519391378 learned_addr learned my addr 172.21.15.121:0/2519391378 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-18T22:49:10.424 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:10.422+0000 7f4dad001640 1 -- 172.21.15.121:0/2519391378 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4da80fb1d0 msgr2=0x7f4da80ff2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:49:10.424 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:10.422+0000 7f4dad001640 1 --2- 172.21.15.121:0/2519391378 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4da80fb1d0 0x7f4da80ff2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:49:10.425 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:10.422+0000 7f4dad001640 1 -- 172.21.15.121:0/2519391378 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d98005040 con 0x7f4da80fc4a0 2024-08-18T22:49:10.425 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:10.422+0000 7f4dad802640 1 --2- 172.21.15.121:0/2519391378 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4da80fb1d0 0x7f4da80ff2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:49:10.425 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:10.422+0000 7f4dad001640 1 --2- 172.21.15.121:0/2519391378 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4da80fc4a0 0x7f4da80fd7e0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f4d9802a530 tx=0x7f4d98009da0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:49:10.425 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:10.422+0000 7f4d9e7fc640 1 -- 172.21.15.121:0/2519391378 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4d98038070 con 0x7f4da80fc4a0 2024-08-18T22:49:10.425 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:10.422+0000 7f4dafa66640 1 -- 172.21.15.121:0/2519391378 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4da80fe130 con 0x7f4da80fc4a0 2024-08-18T22:49:10.425 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:10.422+0000 7f4d9e7fc640 1 -- 172.21.15.121:0/2519391378 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f4d9802ae90 con 0x7f4da80fc4a0 2024-08-18T22:49:10.425 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:10.422+0000 7f4d9e7fc640 1 -- 172.21.15.121:0/2519391378 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4d9803e670 con 0x7f4da80fc4a0 2024-08-18T22:49:10.425 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:10.422+0000 7f4dafa66640 1 -- 172.21.15.121:0/2519391378 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4da8114e80 con 0x7f4da80fc4a0 2024-08-18T22:49:10.426 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:10.424+0000 7f4dafa66640 1 -- 172.21.15.121:0/2519391378 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4da80fa630 con 0x7f4da80fc4a0 2024-08-18T22:49:10.426 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:10.424+0000 7f4d9e7fc640 1 -- 172.21.15.121:0/2519391378 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 37) v1 ==== 92205+0+0 (secure 0 0 0) 0x7f4d98030020 con 0x7f4da80fc4a0 2024-08-18T22:49:10.426 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:10.424+0000 7f4d9e7fc640 1 --2- 172.21.15.121:0/2519391378 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f4d9406e0b0 0x7f4d94070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:49:10.426 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:10.425+0000 7f4d9e7fc640 1 -- 172.21.15.121:0/2519391378 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6582+0+0 (secure 0 0 0) 0x7f4d980adc80 con 0x7f4da80fc4a0 2024-08-18T22:49:10.426 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:10.425+0000 7f4dad802640 1 --2- 172.21.15.121:0/2519391378 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f4d9406e0b0 0x7f4d94070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:49:10.427 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:10.425+0000 7f4dad802640 1 --2- 172.21.15.121:0/2519391378 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f4d9406e0b0 0x7f4d94070560 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f4da80ff0a0 tx=0x7f4da400b040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:49:10.432 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:10.431+0000 7f4d9e7fc640 1 -- 172.21.15.121:0/2519391378 <== mon.1 v2:172.21.15.195:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f4d98077010 con 0x7f4da80fc4a0 2024-08-18T22:49:10.684 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:10.683+0000 7f4dafa66640 1 -- 172.21.15.121:0/2519391378 --> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f4da8103d00 con 0x7f4d9406e0b0 2024-08-18T22:49:10.685 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:10.684+0000 7f4d9e7fc640 1 -- 172.21.15.121:0/2519391378 <== mgr.34102 v2:172.21.15.121:6800/3037387239 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f4da8103d00 con 0x7f4d9406e0b0 2024-08-18T22:49:10.687 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:10.686+0000 7f4dafa66640 1 -- 172.21.15.121:0/2519391378 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f4d9406e0b0 msgr2=0x7f4d94070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:49:10.687 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:10.686+0000 7f4dafa66640 1 --2- 172.21.15.121:0/2519391378 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f4d9406e0b0 0x7f4d94070560 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f4da80ff0a0 tx=0x7f4da400b040 comp rx=0 tx=0).stop 2024-08-18T22:49:10.687 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:10.686+0000 7f4dafa66640 1 -- 172.21.15.121:0/2519391378 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4da80fc4a0 msgr2=0x7f4da80fd7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:49:10.688 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:10.686+0000 7f4dafa66640 1 --2- 172.21.15.121:0/2519391378 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4da80fc4a0 0x7f4da80fd7e0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f4d9802a530 tx=0x7f4d98009da0 comp rx=0 tx=0).stop 2024-08-18T22:49:10.688 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:10.686+0000 7f4dafa66640 1 -- 172.21.15.121:0/2519391378 shutdown_connections 2024-08-18T22:49:10.688 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:10.686+0000 7f4dafa66640 1 --2- 172.21.15.121:0/2519391378 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f4d9406e0b0 0x7f4d94070560 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:49:10.688 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:10.686+0000 7f4dafa66640 1 --2- 172.21.15.121:0/2519391378 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4da80fc4a0 0x7f4da80fd7e0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:49:10.688 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:10.686+0000 7f4dafa66640 1 --2- 172.21.15.121:0/2519391378 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4da80fb1d0 0x7f4da80ff2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:49:10.688 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:10.686+0000 7f4dafa66640 1 -- 172.21.15.121:0/2519391378 >> 172.21.15.121:0/2519391378 conn(0x7f4da80f69b0 msgr2=0x7f4da8065350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:49:10.688 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:10.687+0000 7f4dafa66640 1 -- 172.21.15.121:0/2519391378 shutdown_connections 2024-08-18T22:49:10.688 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:10.687+0000 7f4dafa66640 1 -- 172.21.15.121:0/2519391378 wait complete. 2024-08-18T22:49:10.696 INFO:teuthology.orchestra.run.smithi121.stdout:true 2024-08-18T22:49:10.771 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:10.770+0000 7fe6507fb640 1 -- 172.21.15.121:0/4008437768 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe6480fc4a0 msgr2=0x7fe6480fc910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:49:10.771 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:10.770+0000 7fe6507fb640 1 --2- 172.21.15.121:0/4008437768 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe6480fc4a0 0x7fe6480fc910 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fe6380048d0 tx=0x7fe638009da0 comp rx=0 tx=0).stop 2024-08-18T22:49:10.771 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:10.770+0000 7fe6507fb640 1 -- 172.21.15.121:0/4008437768 shutdown_connections 2024-08-18T22:49:10.771 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:10.770+0000 7fe6507fb640 1 --2- 172.21.15.121:0/4008437768 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe6480fc4a0 0x7fe6480fc910 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:49:10.772 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:10.770+0000 7fe6507fb640 1 --2- 172.21.15.121:0/4008437768 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe6480fb1d0 0x7fe6480fb5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:49:10.772 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:10.770+0000 7fe6507fb640 1 -- 172.21.15.121:0/4008437768 >> 172.21.15.121:0/4008437768 conn(0x7fe6480f69b0 msgr2=0x7fe6480f8dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:49:10.772 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:10.770+0000 7fe6507fb640 1 -- 172.21.15.121:0/4008437768 shutdown_connections 2024-08-18T22:49:10.772 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:10.770+0000 7fe6507fb640 1 -- 172.21.15.121:0/4008437768 wait complete. 2024-08-18T22:49:10.773 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:10.771+0000 7fe6507fb640 1 Processor -- start 2024-08-18T22:49:10.773 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:10.771+0000 7fe6507fb640 1 -- start start 2024-08-18T22:49:10.773 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:10.771+0000 7fe6507fb640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe6480fb1d0 0x7fe64810ced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:49:10.773 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:10.771+0000 7fe6507fb640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe6480fc4a0 0x7fe64810d410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:49:10.774 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:10.771+0000 7fe6507fb640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe64810e140 con 0x7fe6480fc4a0 2024-08-18T22:49:10.774 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:10.771+0000 7fe6507fb640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe64810e2b0 con 0x7fe6480fb1d0 2024-08-18T22:49:10.774 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:10.771+0000 7fe64dd96640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe6480fc4a0 0x7fe64810d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:49:10.774 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:10.771+0000 7fe64dd96640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe6480fc4a0 0x7fe64810d410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:50734/0 (socket says 172.21.15.121:50734) 2024-08-18T22:49:10.774 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:10.771+0000 7fe64dd96640 1 -- 172.21.15.121:0/308243956 learned_addr learned my addr 172.21.15.121:0/308243956 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-18T22:49:10.774 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:10.771+0000 7fe64e597640 1 --2- 172.21.15.121:0/308243956 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe6480fb1d0 0x7fe64810ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:49:10.774 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:10.771+0000 7fe64dd96640 1 -- 172.21.15.121:0/308243956 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe6480fb1d0 msgr2=0x7fe64810ced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:49:10.774 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:10.771+0000 7fe64dd96640 1 --2- 172.21.15.121:0/308243956 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe6480fb1d0 0x7fe64810ced0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:49:10.774 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:10.771+0000 7fe64dd96640 1 -- 172.21.15.121:0/308243956 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe638005040 con 0x7fe6480fc4a0 2024-08-18T22:49:10.774 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:10.772+0000 7fe64dd96640 1 --2- 172.21.15.121:0/308243956 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe6480fc4a0 0x7fe64810d410 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fe6380048a0 tx=0x7fe638009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:49:10.774 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:10.772+0000 7fe63effd640 1 -- 172.21.15.121:0/308243956 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe638038070 con 0x7fe6480fc4a0 2024-08-18T22:49:10.774 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:10.772+0000 7fe63effd640 1 -- 172.21.15.121:0/308243956 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fe638004290 con 0x7fe6480fc4a0 2024-08-18T22:49:10.775 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:10.772+0000 7fe6507fb640 1 -- 172.21.15.121:0/308243956 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe64810e530 con 0x7fe6480fc4a0 2024-08-18T22:49:10.775 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:10.772+0000 7fe63effd640 1 -- 172.21.15.121:0/308243956 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe638033660 con 0x7fe6480fc4a0 2024-08-18T22:49:10.775 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:10.772+0000 7fe6507fb640 1 -- 172.21.15.121:0/308243956 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe64810ead0 con 0x7fe6480fc4a0 2024-08-18T22:49:10.776 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:10.773+0000 7fe6507fb640 1 -- 172.21.15.121:0/308243956 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6480fa630 con 0x7fe6480fc4a0 2024-08-18T22:49:10.776 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:10.773+0000 7fe63effd640 1 -- 172.21.15.121:0/308243956 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 37) v1 ==== 92205+0+0 (secure 0 0 0) 0x7fe638030020 con 0x7fe6480fc4a0 2024-08-18T22:49:10.776 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:10.774+0000 7fe63effd640 1 --2- 172.21.15.121:0/308243956 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7fe63406e0b0 0x7fe634070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:49:10.776 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:10.774+0000 7fe63effd640 1 -- 172.21.15.121:0/308243956 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6582+0+0 (secure 0 0 0) 0x7fe6380add30 con 0x7fe6480fc4a0 2024-08-18T22:49:10.776 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:10.774+0000 7fe64e597640 1 --2- 172.21.15.121:0/308243956 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7fe63406e0b0 0x7fe634070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:49:10.776 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:10.774+0000 7fe64e597640 1 --2- 172.21.15.121:0/308243956 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7fe63406e0b0 0x7fe634070560 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fe644009af0 tx=0x7fe64400b040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:49:10.779 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:10.779+0000 7fe63effd640 1 -- 172.21.15.121:0/308243956 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7fe6380770b0 con 0x7fe6480fc4a0 2024-08-18T22:49:10.986 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:10.982+0000 7fe6507fb640 1 -- 172.21.15.121:0/308243956 --> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fe648103bf0 con 0x7fe63406e0b0 2024-08-18T22:49:10.986 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:10.983+0000 7fe63effd640 1 -- 172.21.15.121:0/308243956 <== mgr.34102 v2:172.21.15.121:6800/3037387239 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fe648103bf0 con 0x7fe63406e0b0 2024-08-18T22:49:10.987 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:10.986+0000 7fe6507fb640 1 -- 172.21.15.121:0/308243956 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7fe63406e0b0 msgr2=0x7fe634070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:49:10.987 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:10.986+0000 7fe6507fb640 1 --2- 172.21.15.121:0/308243956 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7fe63406e0b0 0x7fe634070560 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fe644009af0 tx=0x7fe64400b040 comp rx=0 tx=0).stop 2024-08-18T22:49:10.987 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:10.986+0000 7fe6507fb640 1 -- 172.21.15.121:0/308243956 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe6480fc4a0 msgr2=0x7fe64810d410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:49:10.987 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:10.986+0000 7fe6507fb640 1 --2- 172.21.15.121:0/308243956 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe6480fc4a0 0x7fe64810d410 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fe6380048a0 tx=0x7fe638009da0 comp rx=0 tx=0).stop 2024-08-18T22:49:10.987 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:10.986+0000 7fe6507fb640 1 -- 172.21.15.121:0/308243956 shutdown_connections 2024-08-18T22:49:10.987 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:10.986+0000 7fe6507fb640 1 --2- 172.21.15.121:0/308243956 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7fe63406e0b0 0x7fe634070560 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:49:10.987 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:10.986+0000 7fe6507fb640 1 --2- 172.21.15.121:0/308243956 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe6480fc4a0 0x7fe64810d410 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:49:10.987 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:10.986+0000 7fe6507fb640 1 --2- 172.21.15.121:0/308243956 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe6480fb1d0 0x7fe64810ced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:49:10.988 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:10.986+0000 7fe6507fb640 1 -- 172.21.15.121:0/308243956 >> 172.21.15.121:0/308243956 conn(0x7fe6480f69b0 msgr2=0x7fe648065350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:49:10.988 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:10.986+0000 7fe6507fb640 1 -- 172.21.15.121:0/308243956 shutdown_connections 2024-08-18T22:49:10.988 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:10.986+0000 7fe6507fb640 1 -- 172.21.15.121:0/308243956 wait complete. 2024-08-18T22:49:11.071 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:11.069+0000 7fb07b893640 1 -- 172.21.15.121:0/847391481 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb0740ff480 msgr2=0x7fb074101860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:49:11.071 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:11.069+0000 7fb07b893640 1 --2- 172.21.15.121:0/847391481 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb0740ff480 0x7fb074101860 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fb0640048d0 tx=0x7fb064009da0 comp rx=0 tx=0).stop 2024-08-18T22:49:11.072 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:11.069+0000 7fb07b893640 1 -- 172.21.15.121:0/847391481 shutdown_connections 2024-08-18T22:49:11.072 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:11.069+0000 7fb07b893640 1 --2- 172.21.15.121:0/847391481 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb0740ff480 0x7fb074101860 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:49:11.072 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:11.069+0000 7fb07b893640 1 --2- 172.21.15.121:0/847391481 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb074065980 0x7fb0740fef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:49:11.072 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:11.069+0000 7fb07b893640 1 -- 172.21.15.121:0/847391481 >> 172.21.15.121:0/847391481 conn(0x7fb0740f69b0 msgr2=0x7fb0740f8dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:49:11.072 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:11.069+0000 7fb07b893640 1 -- 172.21.15.121:0/847391481 shutdown_connections 2024-08-18T22:49:11.072 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:11.069+0000 7fb07b893640 1 -- 172.21.15.121:0/847391481 wait complete. 2024-08-18T22:49:11.072 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:11.069+0000 7fb07b893640 1 Processor -- start 2024-08-18T22:49:11.072 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:11.069+0000 7fb07b893640 1 -- start start 2024-08-18T22:49:11.072 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:11.070+0000 7fb07b893640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb074065980 0x7fb07410ce60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:49:11.072 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:11.070+0000 7fb07b893640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb0740ff480 0x7fb07410d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:49:11.072 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:11.070+0000 7fb07b893640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb07410d9f0 con 0x7fb0740ff480 2024-08-18T22:49:11.072 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:11.070+0000 7fb07b893640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb07410e130 con 0x7fb074065980 2024-08-18T22:49:11.072 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:11.070+0000 7fb078e2e640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb0740ff480 0x7fb07410d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:49:11.073 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:11.070+0000 7fb078e2e640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb0740ff480 0x7fb07410d3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:50756/0 (socket says 172.21.15.121:50756) 2024-08-18T22:49:11.073 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:11.070+0000 7fb078e2e640 1 -- 172.21.15.121:0/1058064006 learned_addr learned my addr 172.21.15.121:0/1058064006 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-18T22:49:11.073 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:11.070+0000 7fb07962f640 1 --2- 172.21.15.121:0/1058064006 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb074065980 0x7fb07410ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:49:11.073 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:11.070+0000 7fb078e2e640 1 -- 172.21.15.121:0/1058064006 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb074065980 msgr2=0x7fb07410ce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:49:11.073 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:11.070+0000 7fb078e2e640 1 --2- 172.21.15.121:0/1058064006 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb074065980 0x7fb07410ce60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:49:11.073 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:11.070+0000 7fb078e2e640 1 -- 172.21.15.121:0/1058064006 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb064005040 con 0x7fb0740ff480 2024-08-18T22:49:11.073 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:11.070+0000 7fb07962f640 1 --2- 172.21.15.121:0/1058064006 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb074065980 0x7fb07410ce60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:49:11.073 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:11.070+0000 7fb078e2e640 1 --2- 172.21.15.121:0/1058064006 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb0740ff480 0x7fb07410d3a0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fb0640048a0 tx=0x7fb064009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:49:11.073 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:11.070+0000 7fb069ffb640 1 -- 172.21.15.121:0/1058064006 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb064038070 con 0x7fb0740ff480 2024-08-18T22:49:11.073 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:11.070+0000 7fb07b893640 1 -- 172.21.15.121:0/1058064006 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb07410e360 con 0x7fb0740ff480 2024-08-18T22:49:11.073 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:11.070+0000 7fb069ffb640 1 -- 172.21.15.121:0/1058064006 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fb064032d30 con 0x7fb0740ff480 2024-08-18T22:49:11.073 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:11.070+0000 7fb069ffb640 1 -- 172.21.15.121:0/1058064006 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb064033ac0 con 0x7fb0740ff480 2024-08-18T22:49:11.073 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:11.071+0000 7fb07b893640 1 -- 172.21.15.121:0/1058064006 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb07410e900 con 0x7fb0740ff480 2024-08-18T22:49:11.074 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:11.072+0000 7fb07b893640 1 -- 172.21.15.121:0/1058064006 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0740fa630 con 0x7fb0740ff480 2024-08-18T22:49:11.074 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:11.072+0000 7fb069ffb640 1 -- 172.21.15.121:0/1058064006 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 37) v1 ==== 92205+0+0 (secure 0 0 0) 0x7fb064030020 con 0x7fb0740ff480 2024-08-18T22:49:11.075 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:11.073+0000 7fb069ffb640 1 --2- 172.21.15.121:0/1058064006 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7fb06006e0b0 0x7fb060070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:49:11.075 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:11.073+0000 7fb069ffb640 1 -- 172.21.15.121:0/1058064006 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6582+0+0 (secure 0 0 0) 0x7fb0640ae0a0 con 0x7fb0740ff480 2024-08-18T22:49:11.075 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:11.073+0000 7fb07962f640 1 --2- 172.21.15.121:0/1058064006 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7fb06006e0b0 0x7fb060070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:49:11.075 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:11.073+0000 7fb07962f640 1 --2- 172.21.15.121:0/1058064006 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7fb06006e0b0 0x7fb060070560 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fb07410cbf0 tx=0x7fb07000b040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:49:11.083 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:11.082+0000 7fb069ffb640 1 -- 172.21.15.121:0/1058064006 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7fb0640773f0 con 0x7fb0740ff480 2024-08-18T22:49:11.292 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:11.291+0000 7fb07b893640 1 -- 172.21.15.121:0/1058064006 --> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fb07410ed40 con 0x7fb06006e0b0 2024-08-18T22:49:11.304 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:11.303+0000 7fb069ffb640 1 -- 172.21.15.121:0/1058064006 <== mgr.34102 v2:172.21.15.121:6800/3037387239 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7fb07410ed40 con 0x7fb06006e0b0 2024-08-18T22:49:11.304 INFO:teuthology.orchestra.run.smithi121.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-08-18T22:49:11.304 INFO:teuthology.orchestra.run.smithi121.stdout:alertmanager.smithi121 smithi121 *:9093,9094 running (6m) 12s ago 15m 23.4M - 0.25.0 c8568f914cd2 c421c5e6a02b 2024-08-18T22:49:11.304 INFO:teuthology.orchestra.run.smithi121.stdout:crash.smithi121 smithi121 running (4m) 12s ago 15m 6903k - 19.1.0-1382-gde09dd01 ea7a5189f30b 3cf5c666a0e6 2024-08-18T22:49:11.305 INFO:teuthology.orchestra.run.smithi121.stdout:crash.smithi195 smithi195 running (4m) 91s ago 14m 6895k - 19.1.0-1382-gde09dd01 ea7a5189f30b fbb586fb9834 2024-08-18T22:49:11.305 INFO:teuthology.orchestra.run.smithi121.stdout:grafana.smithi121 smithi121 *:3000 running (6m) 12s ago 14m 87.0M - 9.4.7 954c08fa6188 091a5fd17e8a 2024-08-18T22:49:11.305 INFO:teuthology.orchestra.run.smithi121.stdout:mds.cephfs.smithi121.gbickb smithi121 running (20s) 12s ago 9m 13.2M - 19.1.0-1382-gde09dd01 ea7a5189f30b 3d6dc5c5f472 2024-08-18T22:49:11.305 INFO:teuthology.orchestra.run.smithi121.stdout:mds.cephfs.smithi121.xuzsdg smithi121 running (38s) 12s ago 10m 13.1M - 19.1.0-1382-gde09dd01 ea7a5189f30b 4eec4d0a895e 2024-08-18T22:49:11.305 INFO:teuthology.orchestra.run.smithi121.stdout:mds.cephfs.smithi195.buqvbr smithi195 starting - - - - 2024-08-18T22:49:11.305 INFO:teuthology.orchestra.run.smithi121.stdout:mds.cephfs.smithi195.nptgyc smithi195 running (9m) 91s ago 9m 18.4M - 17.2.7-1406-gdf62bdcc 774894bef55f b9f8043ea83e 2024-08-18T22:49:11.305 INFO:teuthology.orchestra.run.smithi121.stdout:mgr.smithi121.lopxqc smithi121 *:8443,9283,8765 running (6m) 12s ago 16m 505M - 19.1.0-1382-gde09dd01 ea7a5189f30b 9079701e6516 2024-08-18T22:49:11.305 INFO:teuthology.orchestra.run.smithi121.stdout:mgr.smithi195.acttsj smithi195 *:8443,9283,8765 running (5m) 91s ago 14m 441M - 19.1.0-1382-gde09dd01 ea7a5189f30b 7b4027a33daa 2024-08-18T22:49:11.305 INFO:teuthology.orchestra.run.smithi121.stdout:mon.smithi121 smithi121 running (5m) 12s ago 16m 54.4M 2048M 19.1.0-1382-gde09dd01 ea7a5189f30b d71695a4fb56 2024-08-18T22:49:11.305 INFO:teuthology.orchestra.run.smithi121.stdout:mon.smithi195 smithi195 running (5m) 91s ago 14m 40.7M 2048M 19.1.0-1382-gde09dd01 ea7a5189f30b a9bb94ba3b56 2024-08-18T22:49:11.305 INFO:teuthology.orchestra.run.smithi121.stdout:node-exporter.smithi121 smithi121 *:9100 running (7m) 12s ago 15m 15.2M - 1.5.0 0da6a335fe13 bc4b5355a507 2024-08-18T22:49:11.305 INFO:teuthology.orchestra.run.smithi121.stdout:node-exporter.smithi195 smithi195 *:9100 running (6m) 91s ago 14m 17.2M - 1.5.0 0da6a335fe13 146efcb79663 2024-08-18T22:49:11.305 INFO:teuthology.orchestra.run.smithi121.stdout:osd.0 smithi121 running (4m) 12s ago 13m 107M 1557M 19.1.0-1382-gde09dd01 ea7a5189f30b d378dd46eeb6 2024-08-18T22:49:11.305 INFO:teuthology.orchestra.run.smithi121.stdout:osd.1 smithi121 running (3m) 12s ago 13m 129M 1557M 19.1.0-1382-gde09dd01 ea7a5189f30b 0f9e03de5382 2024-08-18T22:49:11.306 INFO:teuthology.orchestra.run.smithi121.stdout:osd.2 smithi121 running (3m) 12s ago 12m 93.3M 1557M 19.1.0-1382-gde09dd01 ea7a5189f30b 93270b5bed68 2024-08-18T22:49:11.306 INFO:teuthology.orchestra.run.smithi121.stdout:osd.3 smithi195 running (2m) 91s ago 12m 120M 2581M 19.1.0-1382-gde09dd01 ea7a5189f30b 72c2860c0e9f 2024-08-18T22:49:11.306 INFO:teuthology.orchestra.run.smithi121.stdout:osd.4 smithi195 running (2m) 91s ago 11m 102M 2581M 19.1.0-1382-gde09dd01 ea7a5189f30b d88a83c97247 2024-08-18T22:49:11.306 INFO:teuthology.orchestra.run.smithi121.stdout:osd.5 smithi195 running (94s) 91s ago 11m 11.3M 2581M 19.1.0-1382-gde09dd01 ea7a5189f30b 5af2d6de9afe 2024-08-18T22:49:11.306 INFO:teuthology.orchestra.run.smithi121.stdout:prometheus.smithi121 smithi121 *:9095 running (5m) 12s ago 14m 61.7M - 2.43.0 a07b618ecd1d 00c4f776d23a 2024-08-18T22:49:11.306 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:11.305+0000 7fb07b893640 1 -- 172.21.15.121:0/1058064006 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7fb06006e0b0 msgr2=0x7fb060070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:49:11.306 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:11.305+0000 7fb07b893640 1 --2- 172.21.15.121:0/1058064006 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7fb06006e0b0 0x7fb060070560 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fb07410cbf0 tx=0x7fb07000b040 comp rx=0 tx=0).stop 2024-08-18T22:49:11.307 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:11.305+0000 7fb07b893640 1 -- 172.21.15.121:0/1058064006 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb0740ff480 msgr2=0x7fb07410d3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:49:11.307 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:11.305+0000 7fb07b893640 1 --2- 172.21.15.121:0/1058064006 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb0740ff480 0x7fb07410d3a0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fb0640048a0 tx=0x7fb064009da0 comp rx=0 tx=0).stop 2024-08-18T22:49:11.307 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:11.305+0000 7fb07b893640 1 -- 172.21.15.121:0/1058064006 shutdown_connections 2024-08-18T22:49:11.307 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:11.305+0000 7fb07b893640 1 --2- 172.21.15.121:0/1058064006 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7fb06006e0b0 0x7fb060070560 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:49:11.307 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:11.305+0000 7fb07b893640 1 --2- 172.21.15.121:0/1058064006 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb0740ff480 0x7fb07410d3a0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:49:11.307 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:11.306+0000 7fb07b893640 1 --2- 172.21.15.121:0/1058064006 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb074065980 0x7fb07410ce60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:49:11.307 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:11.306+0000 7fb07b893640 1 -- 172.21.15.121:0/1058064006 >> 172.21.15.121:0/1058064006 conn(0x7fb0740f69b0 msgr2=0x7fb0740f6d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:49:11.307 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:11.306+0000 7fb07b893640 1 -- 172.21.15.121:0/1058064006 shutdown_connections 2024-08-18T22:49:11.307 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:11.306+0000 7fb07b893640 1 -- 172.21.15.121:0/1058064006 wait complete. 2024-08-18T22:49:11.397 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:11.396+0000 7fed90526640 1 -- 172.21.15.121:0/793955403 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fed880ff480 msgr2=0x7fed88101860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:49:11.397 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:11.396+0000 7fed90526640 1 --2- 172.21.15.121:0/793955403 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fed880ff480 0x7fed88101860 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fed780048d0 tx=0x7fed78009da0 comp rx=0 tx=0).stop 2024-08-18T22:49:11.397 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:11.396+0000 7fed90526640 1 -- 172.21.15.121:0/793955403 shutdown_connections 2024-08-18T22:49:11.397 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:11.396+0000 7fed90526640 1 --2- 172.21.15.121:0/793955403 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fed880ff480 0x7fed88101860 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:49:11.397 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:11.396+0000 7fed90526640 1 --2- 172.21.15.121:0/793955403 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fed88065980 0x7fed880fef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:49:11.398 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:11.396+0000 7fed90526640 1 -- 172.21.15.121:0/793955403 >> 172.21.15.121:0/793955403 conn(0x7fed880f69b0 msgr2=0x7fed880f8dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:49:11.398 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:11.396+0000 7fed90526640 1 -- 172.21.15.121:0/793955403 shutdown_connections 2024-08-18T22:49:11.398 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:11.396+0000 7fed90526640 1 -- 172.21.15.121:0/793955403 wait complete. 2024-08-18T22:49:11.399 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:11.397+0000 7fed90526640 1 Processor -- start 2024-08-18T22:49:11.399 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:11.397+0000 7fed90526640 1 -- start start 2024-08-18T22:49:11.399 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:11.397+0000 7fed90526640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fed88065980 0x7fed8810ce60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:49:11.399 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:11.397+0000 7fed90526640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fed880ff480 0x7fed8810d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:49:11.400 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:11.397+0000 7fed90526640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed8810d9f0 con 0x7fed88065980 2024-08-18T22:49:11.400 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:11.397+0000 7fed90526640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed8810e130 con 0x7fed880ff480 2024-08-18T22:49:11.400 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:11.397+0000 7fed8e2c2640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fed88065980 0x7fed8810ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:49:11.400 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:11.397+0000 7fed8e2c2640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fed88065980 0x7fed8810ce60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:50778/0 (socket says 172.21.15.121:50778) 2024-08-18T22:49:11.400 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:11.397+0000 7fed8e2c2640 1 -- 172.21.15.121:0/1724569388 learned_addr learned my addr 172.21.15.121:0/1724569388 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-18T22:49:11.400 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:11.397+0000 7fed8dac1640 1 --2- 172.21.15.121:0/1724569388 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fed880ff480 0x7fed8810d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:49:11.400 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:11.398+0000 7fed8e2c2640 1 -- 172.21.15.121:0/1724569388 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fed880ff480 msgr2=0x7fed8810d3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:49:11.400 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:11.398+0000 7fed8e2c2640 1 --2- 172.21.15.121:0/1724569388 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fed880ff480 0x7fed8810d3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:49:11.400 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:11.398+0000 7fed8e2c2640 1 -- 172.21.15.121:0/1724569388 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed78005040 con 0x7fed88065980 2024-08-18T22:49:11.400 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:11.398+0000 7fed8dac1640 1 --2- 172.21.15.121:0/1724569388 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fed880ff480 0x7fed8810d3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:49:11.400 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:11.398+0000 7fed8e2c2640 1 --2- 172.21.15.121:0/1724569388 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fed88065980 0x7fed8810ce60 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fed8400eb70 tx=0x7fed8400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:49:11.400 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:11.398+0000 7fed7effd640 1 -- 172.21.15.121:0/1724569388 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fed84007c30 con 0x7fed88065980 2024-08-18T22:49:11.400 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:11.398+0000 7fed7effd640 1 -- 172.21.15.121:0/1724569388 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fed8400f040 con 0x7fed88065980 2024-08-18T22:49:11.400 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:11.398+0000 7fed90526640 1 -- 172.21.15.121:0/1724569388 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed8810e3c0 con 0x7fed88065980 2024-08-18T22:49:11.401 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:11.398+0000 7fed7effd640 1 -- 172.21.15.121:0/1724569388 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fed8400cb00 con 0x7fed88065980 2024-08-18T22:49:11.401 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:11.398+0000 7fed90526640 1 -- 172.21.15.121:0/1724569388 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed8810e960 con 0x7fed88065980 2024-08-18T22:49:11.401 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:11.399+0000 7fed90526640 1 -- 172.21.15.121:0/1724569388 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed880fa630 con 0x7fed88065980 2024-08-18T22:49:11.401 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:11.400+0000 7fed7effd640 1 -- 172.21.15.121:0/1724569388 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 37) v1 ==== 92205+0+0 (secure 0 0 0) 0x7fed8400cc80 con 0x7fed88065980 2024-08-18T22:49:11.402 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:11.401+0000 7fed7effd640 1 --2- 172.21.15.121:0/1724569388 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7fed7406e0b0 0x7fed74070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:49:11.402 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:11.401+0000 7fed7effd640 1 -- 172.21.15.121:0/1724569388 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6582+0+0 (secure 0 0 0) 0x7fed8408ddd0 con 0x7fed88065980 2024-08-18T22:49:11.402 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:11.401+0000 7fed8dac1640 1 --2- 172.21.15.121:0/1724569388 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7fed7406e0b0 0x7fed74070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:49:11.403 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:11.402+0000 7fed8dac1640 1 --2- 172.21.15.121:0/1724569388 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7fed7406e0b0 0x7fed74070560 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fed78009ac0 tx=0x7fed78035040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:49:11.407 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:11.406+0000 7fed7effd640 1 -- 172.21.15.121:0/1724569388 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7fed84057120 con 0x7fed88065980 2024-08-18T22:49:11.735 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:11.733+0000 7fed90526640 1 -- 172.21.15.121:0/1724569388 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fed8810edb0 con 0x7fed88065980 2024-08-18T22:49:11.735 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:11.734+0000 7fed7effd640 1 -- 172.21.15.121:0/1724569388 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+834 (secure 0 0 0) 0x7fed8405a7e0 con 0x7fed88065980 2024-08-18T22:49:11.735 INFO:teuthology.orchestra.run.smithi121.stdout:{ 2024-08-18T22:49:11.735 INFO:teuthology.orchestra.run.smithi121.stdout: "mon": { 2024-08-18T22:49:11.735 INFO:teuthology.orchestra.run.smithi121.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 2 2024-08-18T22:49:11.735 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-18T22:49:11.735 INFO:teuthology.orchestra.run.smithi121.stdout: "mgr": { 2024-08-18T22:49:11.735 INFO:teuthology.orchestra.run.smithi121.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 2 2024-08-18T22:49:11.736 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-18T22:49:11.736 INFO:teuthology.orchestra.run.smithi121.stdout: "osd": { 2024-08-18T22:49:11.736 INFO:teuthology.orchestra.run.smithi121.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 6 2024-08-18T22:49:11.736 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-18T22:49:11.736 INFO:teuthology.orchestra.run.smithi121.stdout: "mds": { 2024-08-18T22:49:11.736 INFO:teuthology.orchestra.run.smithi121.stdout: "ceph version 17.2.7-1406-gdf62bdcc (df62bdccd9a13bf566b27a250eddfdd89be3072d) quincy (stable)": 1, 2024-08-18T22:49:11.736 INFO:teuthology.orchestra.run.smithi121.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 3 2024-08-18T22:49:11.736 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-18T22:49:11.736 INFO:teuthology.orchestra.run.smithi121.stdout: "overall": { 2024-08-18T22:49:11.736 INFO:teuthology.orchestra.run.smithi121.stdout: "ceph version 17.2.7-1406-gdf62bdcc (df62bdccd9a13bf566b27a250eddfdd89be3072d) quincy (stable)": 1, 2024-08-18T22:49:11.736 INFO:teuthology.orchestra.run.smithi121.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 13 2024-08-18T22:49:11.736 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-08-18T22:49:11.736 INFO:teuthology.orchestra.run.smithi121.stdout:} 2024-08-18T22:49:11.737 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:11.736+0000 7fed90526640 1 -- 172.21.15.121:0/1724569388 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7fed7406e0b0 msgr2=0x7fed74070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:49:11.737 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:11.736+0000 7fed90526640 1 --2- 172.21.15.121:0/1724569388 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7fed7406e0b0 0x7fed74070560 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fed78009ac0 tx=0x7fed78035040 comp rx=0 tx=0).stop 2024-08-18T22:49:11.737 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:11.736+0000 7fed90526640 1 -- 172.21.15.121:0/1724569388 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fed88065980 msgr2=0x7fed8810ce60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:49:11.737 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:11.736+0000 7fed90526640 1 --2- 172.21.15.121:0/1724569388 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fed88065980 0x7fed8810ce60 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fed8400eb70 tx=0x7fed8400b040 comp rx=0 tx=0).stop 2024-08-18T22:49:11.737 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:11.736+0000 7fed90526640 1 -- 172.21.15.121:0/1724569388 shutdown_connections 2024-08-18T22:49:11.737 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:11.736+0000 7fed90526640 1 --2- 172.21.15.121:0/1724569388 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7fed7406e0b0 0x7fed74070560 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:49:11.738 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:11.736+0000 7fed90526640 1 --2- 172.21.15.121:0/1724569388 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fed880ff480 0x7fed8810d3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:49:11.738 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:11.736+0000 7fed90526640 1 --2- 172.21.15.121:0/1724569388 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fed88065980 0x7fed8810ce60 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:49:11.738 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:11.736+0000 7fed90526640 1 -- 172.21.15.121:0/1724569388 >> 172.21.15.121:0/1724569388 conn(0x7fed880f69b0 msgr2=0x7fed880f6d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:49:11.738 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:11.736+0000 7fed90526640 1 -- 172.21.15.121:0/1724569388 shutdown_connections 2024-08-18T22:49:11.738 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:11.736+0000 7fed90526640 1 -- 172.21.15.121:0/1724569388 wait complete. 2024-08-18T22:49:11.821 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:11.820+0000 7ff098c6a640 1 -- 172.21.15.121:0/2968518420 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff094065940 msgr2=0x7ff0940fef80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:49:11.821 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:11.820+0000 7ff098c6a640 1 --2- 172.21.15.121:0/2968518420 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff094065940 0x7ff0940fef80 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7ff0840048d0 tx=0x7ff084009da0 comp rx=0 tx=0).stop 2024-08-18T22:49:11.822 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:11.820+0000 7ff098c6a640 1 -- 172.21.15.121:0/2968518420 shutdown_connections 2024-08-18T22:49:11.822 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:11.820+0000 7ff098c6a640 1 --2- 172.21.15.121:0/2968518420 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff0940ff4c0 0x7ff0941018a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:49:11.822 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:11.820+0000 7ff098c6a640 1 --2- 172.21.15.121:0/2968518420 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff094065940 0x7ff0940fef80 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:49:11.822 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:11.820+0000 7ff098c6a640 1 -- 172.21.15.121:0/2968518420 >> 172.21.15.121:0/2968518420 conn(0x7ff0940f69b0 msgr2=0x7ff0940f8dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:49:11.822 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:11.820+0000 7ff098c6a640 1 -- 172.21.15.121:0/2968518420 shutdown_connections 2024-08-18T22:49:11.822 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:11.820+0000 7ff098c6a640 1 -- 172.21.15.121:0/2968518420 wait complete. 2024-08-18T22:49:11.823 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:11.821+0000 7ff098c6a640 1 Processor -- start 2024-08-18T22:49:11.823 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:11.821+0000 7ff098c6a640 1 -- start start 2024-08-18T22:49:11.823 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:11.822+0000 7ff098c6a640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff094065940 0x7ff09410e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:49:11.824 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:11.822+0000 7ff098c6a640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff0940ff4c0 0x7ff09410ea00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:49:11.824 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:11.822+0000 7ff098c6a640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff09410f050 con 0x7ff094065940 2024-08-18T22:49:11.824 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:11.822+0000 7ff09259c640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff094065940 0x7ff09410e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:49:11.824 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:11.822+0000 7ff09259c640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff094065940 0x7ff09410e4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:50800/0 (socket says 172.21.15.121:50800) 2024-08-18T22:49:11.824 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:11.822+0000 7ff09259c640 1 -- 172.21.15.121:0/1400930373 learned_addr learned my addr 172.21.15.121:0/1400930373 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-18T22:49:11.824 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:11.822+0000 7ff091d9b640 1 --2- 172.21.15.121:0/1400930373 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff0940ff4c0 0x7ff09410ea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:49:11.824 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:11.822+0000 7ff098c6a640 1 -- 172.21.15.121:0/1400930373 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff09410cc20 con 0x7ff0940ff4c0 2024-08-18T22:49:11.824 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:11.822+0000 7ff09259c640 1 -- 172.21.15.121:0/1400930373 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff0940ff4c0 msgr2=0x7ff09410ea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:49:11.824 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:11.822+0000 7ff09259c640 1 --2- 172.21.15.121:0/1400930373 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff0940ff4c0 0x7ff09410ea00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:49:11.824 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:11.822+0000 7ff09259c640 1 -- 172.21.15.121:0/1400930373 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff084005040 con 0x7ff094065940 2024-08-18T22:49:11.824 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:11.822+0000 7ff09259c640 1 --2- 172.21.15.121:0/1400930373 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff094065940 0x7ff09410e4c0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7ff0840048a0 tx=0x7ff084009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:49:11.824 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:11.822+0000 7ff082ffd640 1 -- 172.21.15.121:0/1400930373 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff084038070 con 0x7ff094065940 2024-08-18T22:49:11.824 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:11.823+0000 7ff082ffd640 1 -- 172.21.15.121:0/1400930373 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7ff084004290 con 0x7ff094065940 2024-08-18T22:49:11.824 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:11.823+0000 7ff098c6a640 1 -- 172.21.15.121:0/1400930373 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff09410ce40 con 0x7ff094065940 2024-08-18T22:49:11.825 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:11.823+0000 7ff082ffd640 1 -- 172.21.15.121:0/1400930373 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff08403e650 con 0x7ff094065940 2024-08-18T22:49:11.825 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:11.823+0000 7ff098c6a640 1 -- 172.21.15.121:0/1400930373 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff09410d3e0 con 0x7ff094065940 2024-08-18T22:49:11.825 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:11.824+0000 7ff098c6a640 1 -- 172.21.15.121:0/1400930373 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff09404b4c0 con 0x7ff094065940 2024-08-18T22:49:11.825 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:11.825+0000 7ff082ffd640 1 -- 172.21.15.121:0/1400930373 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 37) v1 ==== 92205+0+0 (secure 0 0 0) 0x7ff084030020 con 0x7ff094065940 2024-08-18T22:49:11.826 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:11.825+0000 7ff082ffd640 1 --2- 172.21.15.121:0/1400930373 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7ff07c06e0b0 0x7ff07c070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:49:11.826 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:11.825+0000 7ff082ffd640 1 -- 172.21.15.121:0/1400930373 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6582+0+0 (secure 0 0 0) 0x7ff0840add10 con 0x7ff094065940 2024-08-18T22:49:11.826 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:11.825+0000 7ff091d9b640 1 --2- 172.21.15.121:0/1400930373 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7ff07c06e0b0 0x7ff07c070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:49:11.827 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:11.826+0000 7ff091d9b640 1 --2- 172.21.15.121:0/1400930373 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7ff07c06e0b0 0x7ff07c070560 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7ff09410dde0 tx=0x7ff08800b040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:49:11.831 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:11.830+0000 7ff082ffd640 1 -- 172.21.15.121:0/1400930373 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7ff084077090 con 0x7ff094065940 2024-08-18T22:49:11.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:49:11 smithi195 ceph-mon[68841]: pgmap v202: 65 pgs: 65 active+clean; 778 MiB data, 2.9 GiB used, 534 GiB / 536 GiB avail; 118 KiB/s rd, 13 MiB/s wr, 141 op/s 2024-08-18T22:49:11.910 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:49:11 smithi195 ceph-mon[68841]: from='client.44295 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-18T22:49:11.910 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:49:11 smithi195 ceph-mon[68841]: mds.? [v2:172.21.15.195:6824/1574620912,v1:172.21.15.195:6825/1574620912] up:boot 2024-08-18T22:49:11.910 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:49:11 smithi195 ceph-mon[68841]: fsmap cephfs:1 {0=cephfs.smithi195.nptgyc=up:active} 3 up:standby 2024-08-18T22:49:11.910 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:49:11 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi195.buqvbr"}]: dispatch 2024-08-18T22:49:11.910 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:49:11 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:49:11.910 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:49:11 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:49:11.910 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:49:11 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-18T22:49:12.066 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:12.065+0000 7ff098c6a640 1 -- 172.21.15.121:0/1400930373 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7ff094104d20 con 0x7ff094065940 2024-08-18T22:49:12.066 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:49:11 smithi121 ceph-mon[81053]: pgmap v202: 65 pgs: 65 active+clean; 778 MiB data, 2.9 GiB used, 534 GiB / 536 GiB avail; 118 KiB/s rd, 13 MiB/s wr, 141 op/s 2024-08-18T22:49:12.066 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:49:11 smithi121 ceph-mon[81053]: from='client.44295 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-18T22:49:12.066 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:49:11 smithi121 ceph-mon[81053]: mds.? [v2:172.21.15.195:6824/1574620912,v1:172.21.15.195:6825/1574620912] up:boot 2024-08-18T22:49:12.066 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:49:11 smithi121 ceph-mon[81053]: fsmap cephfs:1 {0=cephfs.smithi195.nptgyc=up:active} 3 up:standby 2024-08-18T22:49:12.066 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:49:11 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi195.buqvbr"}]: dispatch 2024-08-18T22:49:12.067 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:49:11 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:49:12.067 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:49:11 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:49:12.067 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:49:11 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-18T22:49:12.067 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:12.065+0000 7ff082ffd640 1 -- 172.21.15.121:0/1400930373 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 36 v36) v1 ==== 76+0+1937 (secure 0 0 0) 0x7ff08407a750 con 0x7ff094065940 2024-08-18T22:49:12.067 INFO:teuthology.orchestra.run.smithi121.stdout:e36 2024-08-18T22:49:12.067 INFO:teuthology.orchestra.run.smithi121.stdout:btime 2024-08-18T22:49:10:675867+0000 2024-08-18T22:49:12.067 INFO:teuthology.orchestra.run.smithi121.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-08-18T22:49:12.068 INFO:teuthology.orchestra.run.smithi121.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-08-18T22:49:12.068 INFO:teuthology.orchestra.run.smithi121.stdout:legacy client fscid: 1 2024-08-18T22:49:12.068 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-08-18T22:49:12.068 INFO:teuthology.orchestra.run.smithi121.stdout:Filesystem 'cephfs' (1) 2024-08-18T22:49:12.068 INFO:teuthology.orchestra.run.smithi121.stdout:fs_name cephfs 2024-08-18T22:49:12.068 INFO:teuthology.orchestra.run.smithi121.stdout:epoch 34 2024-08-18T22:49:12.068 INFO:teuthology.orchestra.run.smithi121.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-08-18T22:49:12.068 INFO:teuthology.orchestra.run.smithi121.stdout:created 2024-08-18T22:39:04.054074+0000 2024-08-18T22:49:12.068 INFO:teuthology.orchestra.run.smithi121.stdout:modified 2024-08-18T22:48:51.656624+0000 2024-08-18T22:49:12.068 INFO:teuthology.orchestra.run.smithi121.stdout:tableserver 0 2024-08-18T22:49:12.068 INFO:teuthology.orchestra.run.smithi121.stdout:root 0 2024-08-18T22:49:12.068 INFO:teuthology.orchestra.run.smithi121.stdout:session_timeout 60 2024-08-18T22:49:12.068 INFO:teuthology.orchestra.run.smithi121.stdout:session_autoclose 300 2024-08-18T22:49:12.068 INFO:teuthology.orchestra.run.smithi121.stdout:max_file_size 1099511627776 2024-08-18T22:49:12.069 INFO:teuthology.orchestra.run.smithi121.stdout:max_xattr_size 65536 2024-08-18T22:49:12.069 INFO:teuthology.orchestra.run.smithi121.stdout:required_client_features {} 2024-08-18T22:49:12.069 INFO:teuthology.orchestra.run.smithi121.stdout:last_failure 0 2024-08-18T22:49:12.069 INFO:teuthology.orchestra.run.smithi121.stdout:last_failure_osd_epoch 82 2024-08-18T22:49:12.069 INFO:teuthology.orchestra.run.smithi121.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-08-18T22:49:12.069 INFO:teuthology.orchestra.run.smithi121.stdout:max_mds 1 2024-08-18T22:49:12.069 INFO:teuthology.orchestra.run.smithi121.stdout:in 0 2024-08-18T22:49:12.069 INFO:teuthology.orchestra.run.smithi121.stdout:up {0=24259} 2024-08-18T22:49:12.069 INFO:teuthology.orchestra.run.smithi121.stdout:failed 2024-08-18T22:49:12.069 INFO:teuthology.orchestra.run.smithi121.stdout:damaged 2024-08-18T22:49:12.069 INFO:teuthology.orchestra.run.smithi121.stdout:stopped 1 2024-08-18T22:49:12.070 INFO:teuthology.orchestra.run.smithi121.stdout:data_pools [3] 2024-08-18T22:49:12.070 INFO:teuthology.orchestra.run.smithi121.stdout:metadata_pool 2 2024-08-18T22:49:12.070 INFO:teuthology.orchestra.run.smithi121.stdout:inline_data disabled 2024-08-18T22:49:12.070 INFO:teuthology.orchestra.run.smithi121.stdout:balancer 2024-08-18T22:49:12.070 INFO:teuthology.orchestra.run.smithi121.stdout:bal_rank_mask -1 2024-08-18T22:49:12.070 INFO:teuthology.orchestra.run.smithi121.stdout:standby_count_wanted 1 2024-08-18T22:49:12.070 INFO:teuthology.orchestra.run.smithi121.stdout:qdb_cluster leader: 24259 members: 24259 2024-08-18T22:49:12.070 INFO:teuthology.orchestra.run.smithi121.stdout:[mds.cephfs.smithi195.nptgyc{0:24259} state up:active seq 146 join_fscid=1 addr [v2:172.21.15.195:6826/238549847,v1:172.21.15.195:6827/238549847] compat {c=[1],r=[1],i=[7ff]}] 2024-08-18T22:49:12.070 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-08-18T22:49:12.070 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-08-18T22:49:12.070 INFO:teuthology.orchestra.run.smithi121.stdout:Standby daemons: 2024-08-18T22:49:12.071 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-08-18T22:49:12.071 INFO:teuthology.orchestra.run.smithi121.stdout:[mds.cephfs.smithi121.xuzsdg{-1:34404} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.121:6826/4267588865,v1:172.21.15.121:6827/4267588865] compat {c=[1],r=[1],i=[1fff]}] 2024-08-18T22:49:12.071 INFO:teuthology.orchestra.run.smithi121.stdout:[mds.cephfs.smithi121.gbickb{-1:34436} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.121:6828/2915303436,v1:172.21.15.121:6829/2915303436] compat {c=[1],r=[1],i=[1fff]}] 2024-08-18T22:49:12.071 INFO:teuthology.orchestra.run.smithi121.stdout:[mds.cephfs.smithi195.buqvbr{-1:44299} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.195:6824/1574620912,v1:172.21.15.195:6825/1574620912] compat {c=[1],r=[1],i=[1fff]}] 2024-08-18T22:49:12.071 INFO:teuthology.orchestra.run.smithi121.stderr:dumped fsmap epoch 36 2024-08-18T22:49:12.071 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:12.068+0000 7ff098c6a640 1 -- 172.21.15.121:0/1400930373 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7ff07c06e0b0 msgr2=0x7ff07c070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:49:12.071 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:12.068+0000 7ff098c6a640 1 --2- 172.21.15.121:0/1400930373 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7ff07c06e0b0 0x7ff07c070560 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7ff09410dde0 tx=0x7ff08800b040 comp rx=0 tx=0).stop 2024-08-18T22:49:12.072 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:12.068+0000 7ff098c6a640 1 -- 172.21.15.121:0/1400930373 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff094065940 msgr2=0x7ff09410e4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:49:12.072 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:12.068+0000 7ff098c6a640 1 --2- 172.21.15.121:0/1400930373 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff094065940 0x7ff09410e4c0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7ff0840048a0 tx=0x7ff084009da0 comp rx=0 tx=0).stop 2024-08-18T22:49:12.072 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:12.068+0000 7ff098c6a640 1 -- 172.21.15.121:0/1400930373 shutdown_connections 2024-08-18T22:49:12.072 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:12.068+0000 7ff098c6a640 1 --2- 172.21.15.121:0/1400930373 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7ff07c06e0b0 0x7ff07c070560 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:49:12.073 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:12.068+0000 7ff098c6a640 1 --2- 172.21.15.121:0/1400930373 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff0940ff4c0 0x7ff09410ea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:49:12.073 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:12.068+0000 7ff098c6a640 1 --2- 172.21.15.121:0/1400930373 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff094065940 0x7ff09410e4c0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:49:12.073 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:12.068+0000 7ff098c6a640 1 -- 172.21.15.121:0/1400930373 >> 172.21.15.121:0/1400930373 conn(0x7ff0940f69b0 msgr2=0x7ff0940f6d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:49:12.073 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:12.068+0000 7ff098c6a640 1 -- 172.21.15.121:0/1400930373 shutdown_connections 2024-08-18T22:49:12.073 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:12.068+0000 7ff098c6a640 1 -- 172.21.15.121:0/1400930373 wait complete. 2024-08-18T22:49:12.157 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:12.156+0000 7fe70db55640 1 -- 172.21.15.121:0/2703462861 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe7080fb1d0 msgr2=0x7fe7080fb5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:49:12.157 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:12.156+0000 7fe70db55640 1 --2- 172.21.15.121:0/2703462861 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe7080fb1d0 0x7fe7080fb5e0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fe6f80048d0 tx=0x7fe6f8009da0 comp rx=0 tx=0).stop 2024-08-18T22:49:12.157 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:12.156+0000 7fe70db55640 1 -- 172.21.15.121:0/2703462861 shutdown_connections 2024-08-18T22:49:12.158 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:12.156+0000 7fe70db55640 1 --2- 172.21.15.121:0/2703462861 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe7080fc4a0 0x7fe7080fc910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:49:12.158 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:12.156+0000 7fe70db55640 1 --2- 172.21.15.121:0/2703462861 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe7080fb1d0 0x7fe7080fb5e0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:49:12.158 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:12.156+0000 7fe70db55640 1 -- 172.21.15.121:0/2703462861 >> 172.21.15.121:0/2703462861 conn(0x7fe7080f69b0 msgr2=0x7fe7080f8dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:49:12.158 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:12.156+0000 7fe70db55640 1 -- 172.21.15.121:0/2703462861 shutdown_connections 2024-08-18T22:49:12.158 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:12.156+0000 7fe70db55640 1 -- 172.21.15.121:0/2703462861 wait complete. 2024-08-18T22:49:12.158 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:12.157+0000 7fe70db55640 1 Processor -- start 2024-08-18T22:49:12.159 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:12.157+0000 7fe70db55640 1 -- start start 2024-08-18T22:49:12.159 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:12.157+0000 7fe70db55640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe7080fb1d0 0x7fe70810bd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:49:12.160 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:12.157+0000 7fe70db55640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe7080fc4a0 0x7fe70810c2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:49:12.160 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:12.157+0000 7fe70db55640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe70810c900 con 0x7fe7080fb1d0 2024-08-18T22:49:12.160 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:12.157+0000 7fe70db55640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe70810d040 con 0x7fe7080fc4a0 2024-08-18T22:49:12.160 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:12.157+0000 7fe7077fe640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe7080fb1d0 0x7fe70810bd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:49:12.160 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:12.157+0000 7fe7077fe640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe7080fb1d0 0x7fe70810bd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:50810/0 (socket says 172.21.15.121:50810) 2024-08-18T22:49:12.160 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:12.157+0000 7fe7077fe640 1 -- 172.21.15.121:0/2374666037 learned_addr learned my addr 172.21.15.121:0/2374666037 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-18T22:49:12.160 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:12.157+0000 7fe706ffd640 1 --2- 172.21.15.121:0/2374666037 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe7080fc4a0 0x7fe70810c2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:49:12.160 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:12.158+0000 7fe7077fe640 1 -- 172.21.15.121:0/2374666037 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe7080fc4a0 msgr2=0x7fe70810c2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:49:12.160 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:12.158+0000 7fe7077fe640 1 --2- 172.21.15.121:0/2374666037 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe7080fc4a0 0x7fe70810c2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:49:12.160 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:12.158+0000 7fe7077fe640 1 -- 172.21.15.121:0/2374666037 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6fc005040 con 0x7fe7080fb1d0 2024-08-18T22:49:12.160 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:12.158+0000 7fe7077fe640 1 --2- 172.21.15.121:0/2374666037 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe7080fb1d0 0x7fe70810bd70 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fe6f8004930 tx=0x7fe6f8009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:49:12.160 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:12.158+0000 7fe6effff640 1 -- 172.21.15.121:0/2374666037 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe6f803a070 con 0x7fe7080fb1d0 2024-08-18T22:49:12.160 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:12.158+0000 7fe70db55640 1 -- 172.21.15.121:0/2374666037 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6f8005040 con 0x7fe7080fb1d0 2024-08-18T22:49:12.161 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:12.158+0000 7fe6effff640 1 -- 172.21.15.121:0/2374666037 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fe6f80338c0 con 0x7fe7080fb1d0 2024-08-18T22:49:12.161 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:12.158+0000 7fe6effff640 1 -- 172.21.15.121:0/2374666037 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe6f803e8e0 con 0x7fe7080fb1d0 2024-08-18T22:49:12.161 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:12.158+0000 7fe70db55640 1 -- 172.21.15.121:0/2374666037 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe70810d620 con 0x7fe7080fb1d0 2024-08-18T22:49:12.161 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:12.159+0000 7fe70db55640 1 -- 172.21.15.121:0/2374666037 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7080fa630 con 0x7fe7080fb1d0 2024-08-18T22:49:12.161 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:12.160+0000 7fe6effff640 1 -- 172.21.15.121:0/2374666037 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 37) v1 ==== 92205+0+0 (secure 0 0 0) 0x7fe6f8030020 con 0x7fe7080fb1d0 2024-08-18T22:49:12.162 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:12.160+0000 7fe6effff640 1 --2- 172.21.15.121:0/2374666037 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7fe6f006e0b0 0x7fe6f0070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:49:12.162 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:12.161+0000 7fe6effff640 1 -- 172.21.15.121:0/2374666037 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6582+0+0 (secure 0 0 0) 0x7fe6f80afac0 con 0x7fe7080fb1d0 2024-08-18T22:49:12.162 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:12.161+0000 7fe706ffd640 1 --2- 172.21.15.121:0/2374666037 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7fe6f006e0b0 0x7fe6f0070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:49:12.162 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:12.161+0000 7fe706ffd640 1 --2- 172.21.15.121:0/2374666037 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7fe6f006e0b0 0x7fe6f0070560 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fe6fc004a50 tx=0x7fe6fc00b040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:49:12.166 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:12.166+0000 7fe6effff640 1 -- 172.21.15.121:0/2374666037 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7fe6f8078ec0 con 0x7fe7080fb1d0 2024-08-18T22:49:12.378 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:12.377+0000 7fe70db55640 1 -- 172.21.15.121:0/2374666037 --> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fe70810da00 con 0x7fe6f006e0b0 2024-08-18T22:49:12.379 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:12.379+0000 7fe6effff640 1 -- 172.21.15.121:0/2374666037 <== mgr.34102 v2:172.21.15.121:6800/3037387239 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fe70810da00 con 0x7fe6f006e0b0 2024-08-18T22:49:12.380 INFO:teuthology.orchestra.run.smithi121.stdout:{ 2024-08-18T22:49:12.380 INFO:teuthology.orchestra.run.smithi121.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9", 2024-08-18T22:49:12.380 INFO:teuthology.orchestra.run.smithi121.stdout: "in_progress": true, 2024-08-18T22:49:12.380 INFO:teuthology.orchestra.run.smithi121.stdout: "which": "Upgrading all daemon types on all hosts", 2024-08-18T22:49:12.380 INFO:teuthology.orchestra.run.smithi121.stdout: "services_complete": [ 2024-08-18T22:49:12.380 INFO:teuthology.orchestra.run.smithi121.stdout: "mgr", 2024-08-18T22:49:12.380 INFO:teuthology.orchestra.run.smithi121.stdout: "mon", 2024-08-18T22:49:12.380 INFO:teuthology.orchestra.run.smithi121.stdout: "crash", 2024-08-18T22:49:12.380 INFO:teuthology.orchestra.run.smithi121.stdout: "osd" 2024-08-18T22:49:12.380 INFO:teuthology.orchestra.run.smithi121.stdout: ], 2024-08-18T22:49:12.380 INFO:teuthology.orchestra.run.smithi121.stdout: "progress": "14/21 daemons upgraded", 2024-08-18T22:49:12.381 INFO:teuthology.orchestra.run.smithi121.stdout: "message": "Currently upgrading mds daemons", 2024-08-18T22:49:12.381 INFO:teuthology.orchestra.run.smithi121.stdout: "is_paused": false 2024-08-18T22:49:12.381 INFO:teuthology.orchestra.run.smithi121.stdout:} 2024-08-18T22:49:12.382 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:12.381+0000 7fe70db55640 1 -- 172.21.15.121:0/2374666037 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7fe6f006e0b0 msgr2=0x7fe6f0070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:49:12.383 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:12.381+0000 7fe70db55640 1 --2- 172.21.15.121:0/2374666037 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7fe6f006e0b0 0x7fe6f0070560 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fe6fc004a50 tx=0x7fe6fc00b040 comp rx=0 tx=0).stop 2024-08-18T22:49:12.383 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:12.381+0000 7fe70db55640 1 -- 172.21.15.121:0/2374666037 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe7080fb1d0 msgr2=0x7fe70810bd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:49:12.383 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:12.381+0000 7fe70db55640 1 --2- 172.21.15.121:0/2374666037 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe7080fb1d0 0x7fe70810bd70 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fe6f8004930 tx=0x7fe6f8009da0 comp rx=0 tx=0).stop 2024-08-18T22:49:12.383 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:12.381+0000 7fe70db55640 1 -- 172.21.15.121:0/2374666037 shutdown_connections 2024-08-18T22:49:12.383 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:12.381+0000 7fe70db55640 1 --2- 172.21.15.121:0/2374666037 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7fe6f006e0b0 0x7fe6f0070560 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:49:12.383 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:12.381+0000 7fe70db55640 1 --2- 172.21.15.121:0/2374666037 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe7080fc4a0 0x7fe70810c2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:49:12.383 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:12.381+0000 7fe70db55640 1 --2- 172.21.15.121:0/2374666037 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe7080fb1d0 0x7fe70810bd70 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:49:12.383 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:12.381+0000 7fe70db55640 1 -- 172.21.15.121:0/2374666037 >> 172.21.15.121:0/2374666037 conn(0x7fe7080f69b0 msgr2=0x7fe7080f8180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:49:12.383 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:12.381+0000 7fe70db55640 1 -- 172.21.15.121:0/2374666037 shutdown_connections 2024-08-18T22:49:12.383 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:12.381+0000 7fe70db55640 1 -- 172.21.15.121:0/2374666037 wait complete. 2024-08-18T22:49:12.466 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:12.464+0000 7fc6c7d4a640 1 -- 172.21.15.121:0/629615389 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc6c00ff420 msgr2=0x7fc6c0101800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:49:12.467 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:12.464+0000 7fc6c7d4a640 1 --2- 172.21.15.121:0/629615389 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc6c00ff420 0x7fc6c0101800 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fc6b00048d0 tx=0x7fc6b0009da0 comp rx=0 tx=0).stop 2024-08-18T22:49:12.467 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:12.464+0000 7fc6c7d4a640 1 -- 172.21.15.121:0/629615389 shutdown_connections 2024-08-18T22:49:12.467 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:12.464+0000 7fc6c7d4a640 1 --2- 172.21.15.121:0/629615389 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc6c00ff420 0x7fc6c0101800 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:49:12.467 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:12.464+0000 7fc6c7d4a640 1 --2- 172.21.15.121:0/629615389 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc6c00659e0 0x7fc6c00feee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:49:12.467 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:12.464+0000 7fc6c7d4a640 1 -- 172.21.15.121:0/629615389 >> 172.21.15.121:0/629615389 conn(0x7fc6c00f69b0 msgr2=0x7fc6c00f8dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:49:12.467 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:12.464+0000 7fc6c7d4a640 1 -- 172.21.15.121:0/629615389 shutdown_connections 2024-08-18T22:49:12.467 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:12.464+0000 7fc6c7d4a640 1 -- 172.21.15.121:0/629615389 wait complete. 2024-08-18T22:49:12.467 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:12.465+0000 7fc6c7d4a640 1 Processor -- start 2024-08-18T22:49:12.467 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:12.465+0000 7fc6c7d4a640 1 -- start start 2024-08-18T22:49:12.467 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:12.465+0000 7fc6c7d4a640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc6c00659e0 0x7fc6c00fc850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:49:12.467 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:12.465+0000 7fc6c7d4a640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc6c00ff420 0x7fc6c00fade0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:49:12.467 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:12.465+0000 7fc6c7d4a640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6c00fb320 con 0x7fc6c00ff420 2024-08-18T22:49:12.468 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:12.465+0000 7fc6c7d4a640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6c00fb490 con 0x7fc6c00659e0 2024-08-18T22:49:12.468 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:12.465+0000 7fc6c52e5640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc6c00ff420 0x7fc6c00fade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:49:12.468 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:12.465+0000 7fc6c52e5640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc6c00ff420 0x7fc6c00fade0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:50832/0 (socket says 172.21.15.121:50832) 2024-08-18T22:49:12.468 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:12.465+0000 7fc6c52e5640 1 -- 172.21.15.121:0/2809430360 learned_addr learned my addr 172.21.15.121:0/2809430360 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-18T22:49:12.468 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:12.465+0000 7fc6c5ae6640 1 --2- 172.21.15.121:0/2809430360 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc6c00659e0 0x7fc6c00fc850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:49:12.468 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:12.465+0000 7fc6c52e5640 1 -- 172.21.15.121:0/2809430360 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc6c00659e0 msgr2=0x7fc6c00fc850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:49:12.468 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:12.465+0000 7fc6c52e5640 1 --2- 172.21.15.121:0/2809430360 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc6c00659e0 0x7fc6c00fc850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:49:12.468 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:12.465+0000 7fc6c52e5640 1 -- 172.21.15.121:0/2809430360 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6b0005040 con 0x7fc6c00ff420 2024-08-18T22:49:12.468 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:12.465+0000 7fc6c52e5640 1 --2- 172.21.15.121:0/2809430360 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc6c00ff420 0x7fc6c00fade0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fc6b00048a0 tx=0x7fc6b0009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:49:12.469 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:12.466+0000 7fc6b67fc640 1 -- 172.21.15.121:0/2809430360 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc6b0038070 con 0x7fc6c00ff420 2024-08-18T22:49:12.469 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:12.466+0000 7fc6b67fc640 1 -- 172.21.15.121:0/2809430360 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fc6b0004290 con 0x7fc6c00ff420 2024-08-18T22:49:12.469 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:12.466+0000 7fc6b67fc640 1 -- 172.21.15.121:0/2809430360 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc6b0033660 con 0x7fc6c00ff420 2024-08-18T22:49:12.469 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:12.466+0000 7fc6c7d4a640 1 -- 172.21.15.121:0/2809430360 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6c00fb710 con 0x7fc6c00ff420 2024-08-18T22:49:12.469 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:12.466+0000 7fc6c7d4a640 1 -- 172.21.15.121:0/2809430360 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6c00fbc30 con 0x7fc6c00ff420 2024-08-18T22:49:12.470 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:12.467+0000 7fc6c7d4a640 1 -- 172.21.15.121:0/2809430360 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6c00fa630 con 0x7fc6c00ff420 2024-08-18T22:49:12.470 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:12.467+0000 7fc6b67fc640 1 -- 172.21.15.121:0/2809430360 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 37) v1 ==== 92205+0+0 (secure 0 0 0) 0x7fc6b0030020 con 0x7fc6c00ff420 2024-08-18T22:49:12.470 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:12.468+0000 7fc6b67fc640 1 --2- 172.21.15.121:0/2809430360 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7fc6ac06e0b0 0x7fc6ac070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:49:12.471 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:12.468+0000 7fc6b67fc640 1 -- 172.21.15.121:0/2809430360 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6582+0+0 (secure 0 0 0) 0x7fc6b00adc80 con 0x7fc6c00ff420 2024-08-18T22:49:12.471 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:12.468+0000 7fc6c5ae6640 1 --2- 172.21.15.121:0/2809430360 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7fc6ac06e0b0 0x7fc6ac070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:49:12.471 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:12.468+0000 7fc6c5ae6640 1 --2- 172.21.15.121:0/2809430360 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7fc6ac06e0b0 0x7fc6ac070560 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fc6c00fc600 tx=0x7fc6bc00b040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:49:12.473 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:12.473+0000 7fc6b67fc640 1 -- 172.21.15.121:0/2809430360 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7fc6b0077080 con 0x7fc6c00ff420 2024-08-18T22:49:12.798 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:12.797+0000 7fc6c7d4a640 1 -- 172.21.15.121:0/2809430360 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fc6c0104cf0 con 0x7fc6c00ff420 2024-08-18T22:49:12.798 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:12.797+0000 7fc6b67fc640 1 -- 172.21.15.121:0/2809430360 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7fc6b002c870 con 0x7fc6c00ff420 2024-08-18T22:49:12.798 INFO:teuthology.orchestra.run.smithi121.stdout:HEALTH_OK 2024-08-18T22:49:12.801 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:12.799+0000 7fc6c7d4a640 1 -- 172.21.15.121:0/2809430360 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7fc6ac06e0b0 msgr2=0x7fc6ac070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:49:12.801 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:12.799+0000 7fc6c7d4a640 1 --2- 172.21.15.121:0/2809430360 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7fc6ac06e0b0 0x7fc6ac070560 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fc6c00fc600 tx=0x7fc6bc00b040 comp rx=0 tx=0).stop 2024-08-18T22:49:12.801 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:12.799+0000 7fc6c7d4a640 1 -- 172.21.15.121:0/2809430360 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc6c00ff420 msgr2=0x7fc6c00fade0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:49:12.801 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:12.799+0000 7fc6c7d4a640 1 --2- 172.21.15.121:0/2809430360 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc6c00ff420 0x7fc6c00fade0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fc6b00048a0 tx=0x7fc6b0009da0 comp rx=0 tx=0).stop 2024-08-18T22:49:12.801 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:12.799+0000 7fc6c7d4a640 1 -- 172.21.15.121:0/2809430360 shutdown_connections 2024-08-18T22:49:12.801 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:12.799+0000 7fc6c7d4a640 1 --2- 172.21.15.121:0/2809430360 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7fc6ac06e0b0 0x7fc6ac070560 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:49:12.801 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:12.799+0000 7fc6c7d4a640 1 --2- 172.21.15.121:0/2809430360 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc6c00ff420 0x7fc6c00fade0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:49:12.801 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:12.799+0000 7fc6c7d4a640 1 --2- 172.21.15.121:0/2809430360 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc6c00659e0 0x7fc6c00fc850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:49:12.801 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:12.799+0000 7fc6c7d4a640 1 -- 172.21.15.121:0/2809430360 >> 172.21.15.121:0/2809430360 conn(0x7fc6c00f69b0 msgr2=0x7fc6c00f6d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:49:12.801 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:12.799+0000 7fc6c7d4a640 1 -- 172.21.15.121:0/2809430360 shutdown_connections 2024-08-18T22:49:12.801 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:12.799+0000 7fc6c7d4a640 1 -- 172.21.15.121:0/2809430360 wait complete. 2024-08-18T22:49:13.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:49:12 smithi121 ceph-mon[81053]: from='client.34446 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-18T22:49:13.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:49:12 smithi121 ceph-mon[81053]: from='client.34450 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-18T22:49:13.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:49:12 smithi121 ceph-mon[81053]: from='client.? 172.21.15.121:0/1724569388' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-08-18T22:49:13.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:49:12 smithi121 ceph-mon[81053]: from='client.? 172.21.15.121:0/1400930373' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-08-18T22:49:13.141 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:49:12 smithi195 ceph-mon[68841]: from='client.34446 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-18T22:49:13.141 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:49:12 smithi195 ceph-mon[68841]: from='client.34450 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-18T22:49:13.141 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:49:12 smithi195 ceph-mon[68841]: from='client.? 172.21.15.121:0/1724569388' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-08-18T22:49:13.141 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:49:12 smithi195 ceph-mon[68841]: from='client.? 172.21.15.121:0/1400930373' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-08-18T22:49:13.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:49:13 smithi195 ceph-mon[68841]: from='client.34462 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-18T22:49:13.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:49:13 smithi195 ceph-mon[68841]: pgmap v203: 65 pgs: 65 active+clean; 238 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 77 KiB/s rd, 1.9 MiB/s wr, 164 op/s 2024-08-18T22:49:13.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:49:13 smithi195 ceph-mon[68841]: from='client.? 172.21.15.121:0/2809430360' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-08-18T22:49:14.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:49:13 smithi121 ceph-mon[81053]: from='client.34462 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-18T22:49:14.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:49:13 smithi121 ceph-mon[81053]: pgmap v203: 65 pgs: 65 active+clean; 238 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 77 KiB/s rd, 1.9 MiB/s wr, 164 op/s 2024-08-18T22:49:14.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:49:13 smithi121 ceph-mon[81053]: from='client.? 172.21.15.121:0/2809430360' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-08-18T22:49:15.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:49:14 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:49:15.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:49:14 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:49:15.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:49:14 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:49:15.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:49:14 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:49:15.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:49:14 smithi121 ceph-mon[81053]: pgmap v204: 65 pgs: 65 active+clean; 190 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 24 KiB/s rd, 1.5 MiB/s wr, 181 op/s 2024-08-18T22:49:15.112 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:49:14 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:49:15.112 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:49:14 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:49:15.112 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:49:14 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:49:15.112 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:49:14 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:49:15.112 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:49:14 smithi195 ceph-mon[68841]: pgmap v204: 65 pgs: 65 active+clean; 190 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 24 KiB/s rd, 1.5 MiB/s wr, 181 op/s 2024-08-18T22:49:17.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:49:17 smithi195 ceph-mon[68841]: pgmap v205: 65 pgs: 65 active+clean; 175 MiB data, 872 MiB used, 536 GiB / 536 GiB avail; 28 KiB/s rd, 1.5 MiB/s wr, 217 op/s 2024-08-18T22:49:18.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:49:17 smithi121 ceph-mon[81053]: pgmap v205: 65 pgs: 65 active+clean; 175 MiB data, 872 MiB used, 536 GiB / 536 GiB avail; 28 KiB/s rd, 1.5 MiB/s wr, 217 op/s 2024-08-18T22:49:19.409 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:49:19 smithi195 ceph-mon[68841]: Detected new or changed devices on smithi195 2024-08-18T22:49:19.409 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:49:19 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:49:19.409 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:49:19 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:49:19.409 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:49:19 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:49:19.410 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:49:19 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-18T22:49:19.410 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:49:19 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:49:19.410 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:49:19 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-18T22:49:19.410 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:49:19 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "versions"}]: dispatch 2024-08-18T22:49:19.410 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:49:19 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "versions"}]: dispatch 2024-08-18T22:49:19.410 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:49:19 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "versions"}]: dispatch 2024-08-18T22:49:19.410 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:49:19 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "versions"}]: dispatch 2024-08-18T22:49:19.410 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:49:19 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi195.nptgyc"]}]: dispatch 2024-08-18T22:49:19.410 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:49:19 smithi195 ceph-mon[68841]: Upgrade: It appears safe to stop mds.cephfs.smithi195.nptgyc 2024-08-18T22:49:19.410 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:49:19 smithi195 ceph-mon[68841]: pgmap v206: 65 pgs: 65 active+clean; 174 MiB data, 864 MiB used, 536 GiB / 536 GiB avail; 26 KiB/s rd, 751 KiB/s wr, 197 op/s 2024-08-18T22:49:19.583 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:49:19 smithi121 ceph-mon[81053]: Detected new or changed devices on smithi195 2024-08-18T22:49:19.583 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:49:19 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:49:19.584 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:49:19 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:49:19.584 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:49:19 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:49:19.584 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:49:19 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-18T22:49:19.584 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:49:19 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:49:19.584 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:49:19 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-18T22:49:19.584 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:49:19 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "versions"}]: dispatch 2024-08-18T22:49:19.584 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:49:19 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "versions"}]: dispatch 2024-08-18T22:49:19.584 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:49:19 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "versions"}]: dispatch 2024-08-18T22:49:19.584 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:49:19 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "versions"}]: dispatch 2024-08-18T22:49:19.584 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:49:19 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi195.nptgyc"]}]: dispatch 2024-08-18T22:49:19.584 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:49:19 smithi121 ceph-mon[81053]: Upgrade: It appears safe to stop mds.cephfs.smithi195.nptgyc 2024-08-18T22:49:19.584 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:49:19 smithi121 ceph-mon[81053]: pgmap v206: 65 pgs: 65 active+clean; 174 MiB data, 864 MiB used, 536 GiB / 536 GiB avail; 26 KiB/s rd, 751 KiB/s wr, 197 op/s 2024-08-18T22:49:21.583 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:49:21 smithi121 ceph-mon[81053]: Upgrade: Updating mds.cephfs.smithi195.nptgyc 2024-08-18T22:49:21.583 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:49:21 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:49:21.584 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:49:21 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi195.nptgyc", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-08-18T22:49:21.584 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:49:21 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:49:21.584 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:49:21 smithi121 ceph-mon[81053]: Deploying daemon mds.cephfs.smithi195.nptgyc on smithi195 2024-08-18T22:49:21.584 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:49:21 smithi121 ceph-mon[81053]: pgmap v207: 65 pgs: 65 active+clean; 181 MiB data, 873 MiB used, 536 GiB / 536 GiB avail; 38 KiB/s rd, 1.3 MiB/s wr, 228 op/s 2024-08-18T22:49:21.659 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:49:21 smithi195 ceph-mon[68841]: Upgrade: Updating mds.cephfs.smithi195.nptgyc 2024-08-18T22:49:21.659 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:49:21 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:49:21.659 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:49:21 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi195.nptgyc", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-08-18T22:49:21.659 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:49:21 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:49:21.659 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:49:21 smithi195 ceph-mon[68841]: Deploying daemon mds.cephfs.smithi195.nptgyc on smithi195 2024-08-18T22:49:21.659 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:49:21 smithi195 ceph-mon[68841]: pgmap v207: 65 pgs: 65 active+clean; 181 MiB data, 873 MiB used, 536 GiB / 536 GiB avail; 38 KiB/s rd, 1.3 MiB/s wr, 228 op/s 2024-08-18T22:49:22.583 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:49:22 smithi121 ceph-b003123a-5db1-11ef-bccf-c7b262605968-mon-smithi121[81049]: 2024-08-18T22:49:22.411+0000 7f7ae8f60640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-08-18T22:49:22.583 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:49:22 smithi121 ceph-mon[81053]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-08-18T22:49:22.584 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:49:22 smithi121 ceph-mon[81053]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-08-18T22:49:22.584 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:49:22 smithi121 ceph-mon[81053]: osdmap e84: 6 total, 6 up, 6 in 2024-08-18T22:49:22.584 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:49:22 smithi121 ceph-mon[81053]: Standby daemon mds.cephfs.smithi121.xuzsdg assigned to filesystem cephfs as rank 0 2024-08-18T22:49:22.584 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:49:22 smithi121 ceph-mon[81053]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-08-18T22:49:22.584 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:49:22 smithi121 ceph-mon[81053]: fsmap cephfs:0/1 3 up:standby, 1 failed 2024-08-18T22:49:22.584 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:49:22 smithi121 ceph-mon[81053]: fsmap cephfs:1/1 {0=cephfs.smithi121.xuzsdg=up:replay} 2 up:standby 2024-08-18T22:49:22.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:49:22 smithi195 ceph-mon[68841]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-08-18T22:49:22.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:49:22 smithi195 ceph-mon[68841]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-08-18T22:49:22.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:49:22 smithi195 ceph-mon[68841]: osdmap e84: 6 total, 6 up, 6 in 2024-08-18T22:49:22.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:49:22 smithi195 ceph-mon[68841]: Standby daemon mds.cephfs.smithi121.xuzsdg assigned to filesystem cephfs as rank 0 2024-08-18T22:49:22.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:49:22 smithi195 ceph-mon[68841]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-08-18T22:49:22.910 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:49:22 smithi195 ceph-mon[68841]: fsmap cephfs:0/1 3 up:standby, 1 failed 2024-08-18T22:49:22.910 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:49:22 smithi195 ceph-mon[68841]: fsmap cephfs:1/1 {0=cephfs.smithi121.xuzsdg=up:replay} 2 up:standby 2024-08-18T22:49:23.833 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:49:23 smithi121 ceph-mon[81053]: pgmap v209: 65 pgs: 65 active+clean; 178 MiB data, 850 MiB used, 536 GiB / 536 GiB avail; 33 KiB/s rd, 1.3 MiB/s wr, 316 op/s 2024-08-18T22:49:23.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:49:23 smithi195 ceph-mon[68841]: pgmap v209: 65 pgs: 65 active+clean; 178 MiB data, 850 MiB used, 536 GiB / 536 GiB avail; 33 KiB/s rd, 1.3 MiB/s wr, 316 op/s 2024-08-18T22:49:24.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:49:24 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:49:24.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:49:24 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-18T22:49:24.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:49:24 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi195.nptgyc"}]: dispatch 2024-08-18T22:49:25.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:49:24 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:49:25.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:49:24 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-18T22:49:25.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:49:24 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi195.nptgyc"}]: dispatch 2024-08-18T22:49:25.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:49:25 smithi195 ceph-mon[68841]: pgmap v210: 65 pgs: 65 active+clean; 178 MiB data, 848 MiB used, 536 GiB / 536 GiB avail; 3.6 MiB/s rd, 783 KiB/s wr, 300 op/s 2024-08-18T22:49:26.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:49:25 smithi121 ceph-mon[81053]: pgmap v210: 65 pgs: 65 active+clean; 178 MiB data, 848 MiB used, 536 GiB / 536 GiB avail; 3.6 MiB/s rd, 783 KiB/s wr, 300 op/s 2024-08-18T22:49:27.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:49:27 smithi195 ceph-mon[68841]: pgmap v211: 65 pgs: 65 active+clean; 181 MiB data, 849 MiB used, 536 GiB / 536 GiB avail; 6.5 MiB/s rd, 1.1 MiB/s wr, 280 op/s 2024-08-18T22:49:28.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:49:27 smithi121 ceph-mon[81053]: pgmap v211: 65 pgs: 65 active+clean; 181 MiB data, 849 MiB used, 536 GiB / 536 GiB avail; 6.5 MiB/s rd, 1.1 MiB/s wr, 280 op/s 2024-08-18T22:49:29.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:49:28 smithi121 ceph-mon[81053]: reconnect by client.24293 192.168.0.1:0/1761984941 after 0.000999987 2024-08-18T22:49:29.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:49:28 smithi121 ceph-mon[81053]: reconnect by client.14514 192.168.0.1:0/1090582303 after 0.000999987 2024-08-18T22:49:29.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:49:28 smithi121 ceph-mon[81053]: mds.? [v2:172.21.15.121:6826/4267588865,v1:172.21.15.121:6827/4267588865] up:reconnect 2024-08-18T22:49:29.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:49:28 smithi121 ceph-mon[81053]: fsmap cephfs:1/1 {0=cephfs.smithi121.xuzsdg=up:reconnect} 2 up:standby 2024-08-18T22:49:29.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:49:28 smithi195 ceph-mon[68841]: reconnect by client.24293 192.168.0.1:0/1761984941 after 0.000999987 2024-08-18T22:49:29.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:49:28 smithi195 ceph-mon[68841]: reconnect by client.14514 192.168.0.1:0/1090582303 after 0.000999987 2024-08-18T22:49:29.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:49:28 smithi195 ceph-mon[68841]: mds.? [v2:172.21.15.121:6826/4267588865,v1:172.21.15.121:6827/4267588865] up:reconnect 2024-08-18T22:49:29.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:49:28 smithi195 ceph-mon[68841]: fsmap cephfs:1/1 {0=cephfs.smithi121.xuzsdg=up:reconnect} 2 up:standby 2024-08-18T22:49:30.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:49:29 smithi121 ceph-mon[81053]: pgmap v212: 65 pgs: 65 active+clean; 181 MiB data, 850 MiB used, 536 GiB / 536 GiB avail; 10 MiB/s rd, 1.1 MiB/s wr, 223 op/s 2024-08-18T22:49:30.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:49:29 smithi121 ceph-mon[81053]: mds.? [v2:172.21.15.121:6826/4267588865,v1:172.21.15.121:6827/4267588865] up:rejoin 2024-08-18T22:49:30.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:49:29 smithi121 ceph-mon[81053]: fsmap cephfs:1/1 {0=cephfs.smithi121.xuzsdg=up:rejoin} 2 up:standby 2024-08-18T22:49:30.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:49:29 smithi195 ceph-mon[68841]: pgmap v212: 65 pgs: 65 active+clean; 181 MiB data, 850 MiB used, 536 GiB / 536 GiB avail; 10 MiB/s rd, 1.1 MiB/s wr, 223 op/s 2024-08-18T22:49:30.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:49:29 smithi195 ceph-mon[68841]: mds.? [v2:172.21.15.121:6826/4267588865,v1:172.21.15.121:6827/4267588865] up:rejoin 2024-08-18T22:49:30.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:49:29 smithi195 ceph-mon[68841]: fsmap cephfs:1/1 {0=cephfs.smithi121.xuzsdg=up:rejoin} 2 up:standby 2024-08-18T22:49:31.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:49:30 smithi121 ceph-mon[81053]: mds.? [v2:172.21.15.121:6826/4267588865,v1:172.21.15.121:6827/4267588865] up:clientreplay 2024-08-18T22:49:31.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:49:30 smithi121 ceph-mon[81053]: fsmap cephfs:1/1 {0=cephfs.smithi121.xuzsdg=up:clientreplay} 2 up:standby 2024-08-18T22:49:31.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:49:30 smithi121 ceph-mon[81053]: daemon mds.cephfs.smithi121.xuzsdg is now active in filesystem cephfs as rank 0 2024-08-18T22:49:31.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:49:30 smithi195 ceph-mon[68841]: mds.? [v2:172.21.15.121:6826/4267588865,v1:172.21.15.121:6827/4267588865] up:clientreplay 2024-08-18T22:49:31.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:49:30 smithi195 ceph-mon[68841]: fsmap cephfs:1/1 {0=cephfs.smithi121.xuzsdg=up:clientreplay} 2 up:standby 2024-08-18T22:49:31.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:49:30 smithi195 ceph-mon[68841]: daemon mds.cephfs.smithi121.xuzsdg is now active in filesystem cephfs as rank 0 2024-08-18T22:49:31.953 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:49:31 smithi195 ceph-mon[68841]: pgmap v213: 65 pgs: 65 active+clean; 181 MiB data, 850 MiB used, 536 GiB / 536 GiB avail; 13 MiB/s rd, 345 KiB/s wr, 167 op/s 2024-08-18T22:49:31.953 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:49:31 smithi195 ceph-mon[68841]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-08-18T22:49:31.953 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:49:31 smithi195 ceph-mon[68841]: Cluster is now healthy 2024-08-18T22:49:31.954 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:49:31 smithi195 ceph-mon[68841]: mds.? [v2:172.21.15.121:6826/4267588865,v1:172.21.15.121:6827/4267588865] up:active 2024-08-18T22:49:31.954 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:49:31 smithi195 ceph-mon[68841]: fsmap cephfs:1 {0=cephfs.smithi121.xuzsdg=up:active} 2 up:standby 2024-08-18T22:49:32.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:49:31 smithi121 ceph-mon[81053]: pgmap v213: 65 pgs: 65 active+clean; 181 MiB data, 850 MiB used, 536 GiB / 536 GiB avail; 13 MiB/s rd, 345 KiB/s wr, 167 op/s 2024-08-18T22:49:32.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:49:31 smithi121 ceph-mon[81053]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-08-18T22:49:32.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:49:31 smithi121 ceph-mon[81053]: Cluster is now healthy 2024-08-18T22:49:32.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:49:31 smithi121 ceph-mon[81053]: mds.? [v2:172.21.15.121:6826/4267588865,v1:172.21.15.121:6827/4267588865] up:active 2024-08-18T22:49:32.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:49:31 smithi121 ceph-mon[81053]: fsmap cephfs:1 {0=cephfs.smithi121.xuzsdg=up:active} 2 up:standby 2024-08-18T22:49:33.906 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:49:33 smithi195 ceph-mon[68841]: pgmap v214: 65 pgs: 65 active+clean; 176 MiB data, 843 MiB used, 536 GiB / 536 GiB avail; 13 MiB/s rd, 383 KiB/s wr, 103 op/s 2024-08-18T22:49:34.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:49:33 smithi121 ceph-mon[81053]: pgmap v214: 65 pgs: 65 active+clean; 176 MiB data, 843 MiB used, 536 GiB / 536 GiB avail; 13 MiB/s rd, 383 KiB/s wr, 103 op/s 2024-08-18T22:49:36.014 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:49:35 smithi195 ceph-mon[68841]: pgmap v215: 65 pgs: 65 active+clean; 174 MiB data, 840 MiB used, 536 GiB / 536 GiB avail; 11 MiB/s rd, 325 KiB/s wr, 105 op/s 2024-08-18T22:49:36.014 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:49:35 smithi195 ceph-mon[68841]: mds.? [v2:172.21.15.195:6826/4050783124,v1:172.21.15.195:6827/4050783124] up:boot 2024-08-18T22:49:36.014 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:49:35 smithi195 ceph-mon[68841]: fsmap cephfs:1 {0=cephfs.smithi121.xuzsdg=up:active} 3 up:standby 2024-08-18T22:49:36.014 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:49:35 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi195.nptgyc"}]: dispatch 2024-08-18T22:49:36.014 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:49:35 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:49:36.015 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:49:35 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:49:36.015 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:49:35 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-18T22:49:36.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:49:35 smithi121 ceph-mon[81053]: pgmap v215: 65 pgs: 65 active+clean; 174 MiB data, 840 MiB used, 536 GiB / 536 GiB avail; 11 MiB/s rd, 325 KiB/s wr, 105 op/s 2024-08-18T22:49:36.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:49:35 smithi121 ceph-mon[81053]: mds.? [v2:172.21.15.195:6826/4050783124,v1:172.21.15.195:6827/4050783124] up:boot 2024-08-18T22:49:36.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:49:35 smithi121 ceph-mon[81053]: fsmap cephfs:1 {0=cephfs.smithi121.xuzsdg=up:active} 3 up:standby 2024-08-18T22:49:36.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:49:35 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi195.nptgyc"}]: dispatch 2024-08-18T22:49:36.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:49:35 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:49:36.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:49:35 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:49:36.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:49:35 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-18T22:49:37.994 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:49:37 smithi195 ceph-mon[68841]: pgmap v216: 65 pgs: 65 active+clean; 177 MiB data, 840 MiB used, 536 GiB / 536 GiB avail; 7.8 MiB/s rd, 806 KiB/s wr, 138 op/s 2024-08-18T22:49:37.995 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:49:37 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:49:37.995 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:49:37 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:49:37.995 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:49:37 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:49:37.995 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:49:37 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:49:38.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:49:37 smithi121 ceph-mon[81053]: pgmap v216: 65 pgs: 65 active+clean; 177 MiB data, 840 MiB used, 536 GiB / 536 GiB avail; 7.8 MiB/s rd, 806 KiB/s wr, 138 op/s 2024-08-18T22:49:38.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:49:37 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:49:38.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:49:37 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:49:38.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:49:37 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:49:38.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:49:37 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:49:39.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:49:39 smithi195 ceph-mon[68841]: pgmap v217: 65 pgs: 65 active+clean; 171 MiB data, 819 MiB used, 536 GiB / 536 GiB avail; 5.3 MiB/s rd, 520 KiB/s wr, 159 op/s 2024-08-18T22:49:39.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:49:39 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:49:39.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:49:39 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-18T22:49:40.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:49:39 smithi121 ceph-mon[81053]: pgmap v217: 65 pgs: 65 active+clean; 171 MiB data, 819 MiB used, 536 GiB / 536 GiB avail; 5.3 MiB/s rd, 520 KiB/s wr, 159 op/s 2024-08-18T22:49:40.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:49:39 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:49:40.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:49:39 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-18T22:49:41.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:49:41 smithi195 ceph-mon[68841]: pgmap v218: 65 pgs: 65 active+clean; 169 MiB data, 794 MiB used, 536 GiB / 536 GiB avail; 2.4 MiB/s rd, 652 KiB/s wr, 207 op/s 2024-08-18T22:49:41.910 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:49:41 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:49:41.910 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:49:41 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:49:41.910 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:49:41 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:49:41.910 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:49:41 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-18T22:49:41.910 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:49:41 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:49:41.910 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:49:41 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-18T22:49:41.910 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:49:41 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "versions"}]: dispatch 2024-08-18T22:49:41.910 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:49:41 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "versions"}]: dispatch 2024-08-18T22:49:41.910 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:49:41 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "versions"}]: dispatch 2024-08-18T22:49:41.910 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:49:41 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "versions"}]: dispatch 2024-08-18T22:49:41.910 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:49:41 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "versions"}]: dispatch 2024-08-18T22:49:41.910 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:49:41 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:49:41.911 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:49:41 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi121.gbickb"}]: dispatch 2024-08-18T22:49:41.911 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:49:41 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi121.gbickb"}]': finished 2024-08-18T22:49:41.911 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:49:41 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi121.xuzsdg"}]: dispatch 2024-08-18T22:49:41.911 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:49:41 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi121.xuzsdg"}]': finished 2024-08-18T22:49:41.911 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:49:41 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi195.buqvbr"}]: dispatch 2024-08-18T22:49:41.911 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:49:41 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi195.buqvbr"}]': finished 2024-08-18T22:49:41.911 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:49:41 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi195.nptgyc"}]: dispatch 2024-08-18T22:49:41.911 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:49:41 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi195.nptgyc"}]': finished 2024-08-18T22:49:41.911 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:49:41 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]: dispatch 2024-08-18T22:49:42.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:49:41 smithi121 ceph-mon[81053]: pgmap v218: 65 pgs: 65 active+clean; 169 MiB data, 794 MiB used, 536 GiB / 536 GiB avail; 2.4 MiB/s rd, 652 KiB/s wr, 207 op/s 2024-08-18T22:49:42.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:49:41 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:49:42.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:49:41 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:49:42.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:49:41 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:49:42.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:49:41 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-18T22:49:42.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:49:41 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:49:42.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:49:41 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-18T22:49:42.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:49:41 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "versions"}]: dispatch 2024-08-18T22:49:42.085 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:49:41 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "versions"}]: dispatch 2024-08-18T22:49:42.085 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:49:41 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "versions"}]: dispatch 2024-08-18T22:49:42.085 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:49:41 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "versions"}]: dispatch 2024-08-18T22:49:42.085 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:49:41 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "versions"}]: dispatch 2024-08-18T22:49:42.085 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:49:41 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:49:42.085 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:49:41 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi121.gbickb"}]: dispatch 2024-08-18T22:49:42.085 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:49:41 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi121.gbickb"}]': finished 2024-08-18T22:49:42.085 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:49:41 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi121.xuzsdg"}]: dispatch 2024-08-18T22:49:42.085 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:49:41 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi121.xuzsdg"}]': finished 2024-08-18T22:49:42.085 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:49:41 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi195.buqvbr"}]: dispatch 2024-08-18T22:49:42.085 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:49:41 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi195.buqvbr"}]': finished 2024-08-18T22:49:42.085 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:49:41 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi195.nptgyc"}]: dispatch 2024-08-18T22:49:42.085 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:49:41 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi195.nptgyc"}]': finished 2024-08-18T22:49:42.085 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:49:41 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]: dispatch 2024-08-18T22:49:42.892 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:42.889+0000 7fcb54d12640 1 -- 172.21.15.121:0/283864745 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcb500659e0 msgr2=0x7fcb500feee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:49:42.892 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:42.889+0000 7fcb54d12640 1 --2- 172.21.15.121:0/283864745 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcb500659e0 0x7fcb500feee0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fcb400048d0 tx=0x7fcb40009da0 comp rx=0 tx=0).stop 2024-08-18T22:49:42.892 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:42.889+0000 7fcb54d12640 1 -- 172.21.15.121:0/283864745 shutdown_connections 2024-08-18T22:49:42.892 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:42.889+0000 7fcb54d12640 1 --2- 172.21.15.121:0/283864745 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcb500ff420 0x7fcb50101800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:49:42.892 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:42.889+0000 7fcb54d12640 1 --2- 172.21.15.121:0/283864745 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcb500659e0 0x7fcb500feee0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:49:42.892 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:42.889+0000 7fcb54d12640 1 -- 172.21.15.121:0/283864745 >> 172.21.15.121:0/283864745 conn(0x7fcb500f69b0 msgr2=0x7fcb500f8dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:49:42.892 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:42.889+0000 7fcb54d12640 1 -- 172.21.15.121:0/283864745 shutdown_connections 2024-08-18T22:49:42.892 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:42.889+0000 7fcb54d12640 1 -- 172.21.15.121:0/283864745 wait complete. 2024-08-18T22:49:42.893 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:42.890+0000 7fcb54d12640 1 Processor -- start 2024-08-18T22:49:42.893 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:42.890+0000 7fcb54d12640 1 -- start start 2024-08-18T22:49:42.893 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:42.890+0000 7fcb54d12640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcb500659e0 0x7fcb5010cf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:49:42.893 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:42.890+0000 7fcb54d12640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcb500ff420 0x7fcb5010d490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:49:42.893 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:42.890+0000 7fcb54d12640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb5010e170 con 0x7fcb500ff420 2024-08-18T22:49:42.893 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:42.890+0000 7fcb54d12640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb5010e2e0 con 0x7fcb500659e0 2024-08-18T22:49:42.893 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:42.890+0000 7fcb47fff640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcb500ff420 0x7fcb5010d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:49:42.893 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:42.890+0000 7fcb47fff640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcb500ff420 0x7fcb5010d490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:36006/0 (socket says 172.21.15.121:36006) 2024-08-18T22:49:42.893 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:42.890+0000 7fcb47fff640 1 -- 172.21.15.121:0/1180005172 learned_addr learned my addr 172.21.15.121:0/1180005172 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-18T22:49:42.893 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:42.890+0000 7fcb4e59c640 1 --2- 172.21.15.121:0/1180005172 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcb500659e0 0x7fcb5010cf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:49:42.893 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:42.890+0000 7fcb47fff640 1 -- 172.21.15.121:0/1180005172 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcb500659e0 msgr2=0x7fcb5010cf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:49:42.893 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:42.890+0000 7fcb47fff640 1 --2- 172.21.15.121:0/1180005172 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcb500659e0 0x7fcb5010cf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:49:42.894 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:42.890+0000 7fcb47fff640 1 -- 172.21.15.121:0/1180005172 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb40005040 con 0x7fcb500ff420 2024-08-18T22:49:42.894 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:42.890+0000 7fcb4e59c640 1 --2- 172.21.15.121:0/1180005172 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcb500659e0 0x7fcb5010cf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:49:42.894 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:42.891+0000 7fcb47fff640 1 --2- 172.21.15.121:0/1180005172 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcb500ff420 0x7fcb5010d490 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fcb3800eb70 tx=0x7fcb3800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:49:42.894 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:42.891+0000 7fcb46ffd640 1 -- 172.21.15.121:0/1180005172 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcb38007c30 con 0x7fcb500ff420 2024-08-18T22:49:42.894 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:42.891+0000 7fcb46ffd640 1 -- 172.21.15.121:0/1180005172 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fcb3800f040 con 0x7fcb500ff420 2024-08-18T22:49:42.894 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:42.891+0000 7fcb46ffd640 1 -- 172.21.15.121:0/1180005172 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcb38009470 con 0x7fcb500ff420 2024-08-18T22:49:42.894 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:42.891+0000 7fcb54d12640 1 -- 172.21.15.121:0/1180005172 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb5010e560 con 0x7fcb500ff420 2024-08-18T22:49:42.894 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:42.891+0000 7fcb54d12640 1 -- 172.21.15.121:0/1180005172 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb5010eab0 con 0x7fcb500ff420 2024-08-18T22:49:42.895 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:42.892+0000 7fcb54d12640 1 -- 172.21.15.121:0/1180005172 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb500fa630 con 0x7fcb500ff420 2024-08-18T22:49:42.895 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:42.893+0000 7fcb46ffd640 1 -- 172.21.15.121:0/1180005172 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 37) v1 ==== 92205+0+0 (secure 0 0 0) 0x7fcb380096e0 con 0x7fcb500ff420 2024-08-18T22:49:42.895 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:42.894+0000 7fcb46ffd640 1 --2- 172.21.15.121:0/1180005172 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7fcb3c06e0b0 0x7fcb3c070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:49:42.895 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:42.894+0000 7fcb46ffd640 1 -- 172.21.15.121:0/1180005172 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6668+0+0 (secure 0 0 0) 0x7fcb3808d8b0 con 0x7fcb500ff420 2024-08-18T22:49:42.895 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:42.894+0000 7fcb4e59c640 1 --2- 172.21.15.121:0/1180005172 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7fcb3c06e0b0 0x7fcb3c070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:49:42.895 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:42.894+0000 7fcb4e59c640 1 --2- 172.21.15.121:0/1180005172 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7fcb3c06e0b0 0x7fcb3c070560 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fcb40000c00 tx=0x7fcb4003b040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:49:42.899 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:42.898+0000 7fcb46ffd640 1 -- 172.21.15.121:0/1180005172 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7fcb38056be0 con 0x7fcb500ff420 2024-08-18T22:49:42.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:49:42 smithi195 ceph-mon[68841]: Upgrade: Setting container_image for all mds 2024-08-18T22:49:42.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:49:42 smithi195 ceph-mon[68841]: Upgrade: Scaling up filesystem cephfs max_mds to 2 2024-08-18T22:49:42.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:49:42 smithi195 ceph-mon[68841]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-08-18T22:49:42.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:49:42 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]': finished 2024-08-18T22:49:42.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:49:42 smithi195 ceph-mon[68841]: daemon mds.cephfs.smithi121.gbickb assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-08-18T22:49:42.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:49:42 smithi195 ceph-mon[68841]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-08-18T22:49:42.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:49:42 smithi195 ceph-mon[68841]: Cluster is now healthy 2024-08-18T22:49:42.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:49:42 smithi195 ceph-mon[68841]: fsmap cephfs:1 {0=cephfs.smithi121.xuzsdg=up:active} 3 up:standby 2024-08-18T22:49:42.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:49:42 smithi195 ceph-mon[68841]: fsmap cephfs:2 {0=cephfs.smithi121.xuzsdg=up:active,1=cephfs.smithi121.gbickb=up:starting} 2 up:standby 2024-08-18T22:49:42.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:49:42 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:49:42.910 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:49:42 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "versions"}]: dispatch 2024-08-18T22:49:42.910 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:49:42 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:49:42.910 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:49:42 smithi195 ceph-mon[68841]: daemon mds.cephfs.smithi121.gbickb is now active in filesystem cephfs as rank 1 2024-08-18T22:49:42.910 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:49:42 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "versions"}]: dispatch 2024-08-18T22:49:42.910 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:49:42 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:49:42.910 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:49:42 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "versions"}]: dispatch 2024-08-18T22:49:42.910 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:49:42 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "versions"}]: dispatch 2024-08-18T22:49:42.910 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:49:42 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:49:42.910 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:49:42 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "versions"}]: dispatch 2024-08-18T22:49:42.910 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:49:42 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:49:42.910 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:49:42 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "versions"}]: dispatch 2024-08-18T22:49:42.910 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:49:42 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:49:42.911 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:49:42 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "versions"}]: dispatch 2024-08-18T22:49:42.911 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:49:42 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:49:43.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:49:42 smithi121 ceph-mon[81053]: Upgrade: Setting container_image for all mds 2024-08-18T22:49:43.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:49:42 smithi121 ceph-mon[81053]: Upgrade: Scaling up filesystem cephfs max_mds to 2 2024-08-18T22:49:43.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:49:42 smithi121 ceph-mon[81053]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-08-18T22:49:43.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:49:42 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]': finished 2024-08-18T22:49:43.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:49:42 smithi121 ceph-mon[81053]: daemon mds.cephfs.smithi121.gbickb assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-08-18T22:49:43.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:49:42 smithi121 ceph-mon[81053]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-08-18T22:49:43.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:49:42 smithi121 ceph-mon[81053]: Cluster is now healthy 2024-08-18T22:49:43.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:49:42 smithi121 ceph-mon[81053]: fsmap cephfs:1 {0=cephfs.smithi121.xuzsdg=up:active} 3 up:standby 2024-08-18T22:49:43.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:49:42 smithi121 ceph-mon[81053]: fsmap cephfs:2 {0=cephfs.smithi121.xuzsdg=up:active,1=cephfs.smithi121.gbickb=up:starting} 2 up:standby 2024-08-18T22:49:43.085 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:49:42 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:49:43.085 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:49:42 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "versions"}]: dispatch 2024-08-18T22:49:43.085 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:49:42 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:49:43.085 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:49:42 smithi121 ceph-mon[81053]: daemon mds.cephfs.smithi121.gbickb is now active in filesystem cephfs as rank 1 2024-08-18T22:49:43.085 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:49:42 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "versions"}]: dispatch 2024-08-18T22:49:43.085 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:49:42 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:49:43.085 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:49:42 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "versions"}]: dispatch 2024-08-18T22:49:43.085 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:49:42 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "versions"}]: dispatch 2024-08-18T22:49:43.085 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:49:42 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:49:43.085 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:49:42 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "versions"}]: dispatch 2024-08-18T22:49:43.085 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:49:42 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:49:43.085 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:49:42 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "versions"}]: dispatch 2024-08-18T22:49:43.085 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:49:42 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:49:43.085 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:49:42 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "versions"}]: dispatch 2024-08-18T22:49:43.086 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:49:42 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:49:43.118 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:43.117+0000 7fcb54d12640 1 -- 172.21.15.121:0/1180005172 --> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fcb5010ed20 con 0x7fcb3c06e0b0 2024-08-18T22:49:43.119 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:43.118+0000 7fcb46ffd640 1 -- 172.21.15.121:0/1180005172 <== mgr.34102 v2:172.21.15.121:6800/3037387239 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+441 (secure 0 0 0) 0x7fcb5010ed20 con 0x7fcb3c06e0b0 2024-08-18T22:49:43.121 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:43.120+0000 7fcb54d12640 1 -- 172.21.15.121:0/1180005172 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7fcb3c06e0b0 msgr2=0x7fcb3c070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:49:43.121 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:43.120+0000 7fcb54d12640 1 --2- 172.21.15.121:0/1180005172 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7fcb3c06e0b0 0x7fcb3c070560 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fcb40000c00 tx=0x7fcb4003b040 comp rx=0 tx=0).stop 2024-08-18T22:49:43.121 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:43.120+0000 7fcb54d12640 1 -- 172.21.15.121:0/1180005172 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcb500ff420 msgr2=0x7fcb5010d490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:49:43.121 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:43.120+0000 7fcb54d12640 1 --2- 172.21.15.121:0/1180005172 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcb500ff420 0x7fcb5010d490 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fcb3800eb70 tx=0x7fcb3800b040 comp rx=0 tx=0).stop 2024-08-18T22:49:43.121 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:43.120+0000 7fcb54d12640 1 -- 172.21.15.121:0/1180005172 shutdown_connections 2024-08-18T22:49:43.121 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:43.120+0000 7fcb54d12640 1 --2- 172.21.15.121:0/1180005172 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7fcb3c06e0b0 0x7fcb3c070560 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:49:43.121 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:43.120+0000 7fcb54d12640 1 --2- 172.21.15.121:0/1180005172 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcb500ff420 0x7fcb5010d490 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:49:43.122 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:43.120+0000 7fcb54d12640 1 --2- 172.21.15.121:0/1180005172 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcb500659e0 0x7fcb5010cf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:49:43.122 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:43.120+0000 7fcb54d12640 1 -- 172.21.15.121:0/1180005172 >> 172.21.15.121:0/1180005172 conn(0x7fcb500f69b0 msgr2=0x7fcb500f6d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:49:43.122 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:43.120+0000 7fcb54d12640 1 -- 172.21.15.121:0/1180005172 shutdown_connections 2024-08-18T22:49:43.122 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:43.120+0000 7fcb54d12640 1 -- 172.21.15.121:0/1180005172 wait complete. 2024-08-18T22:49:43.129 INFO:teuthology.orchestra.run.smithi121.stdout:true 2024-08-18T22:49:43.211 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:43.210+0000 7f85b28bf640 1 -- 172.21.15.121:0/3491568828 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f85ac0fd5e0 msgr2=0x7f85ac0fda50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:49:43.212 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:43.210+0000 7f85b28bf640 1 --2- 172.21.15.121:0/3491568828 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f85ac0fd5e0 0x7f85ac0fda50 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f85a00048d0 tx=0x7f85a0009da0 comp rx=0 tx=0).stop 2024-08-18T22:49:43.212 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:43.210+0000 7f85b28bf640 1 -- 172.21.15.121:0/3491568828 shutdown_connections 2024-08-18T22:49:43.212 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:43.210+0000 7f85b28bf640 1 --2- 172.21.15.121:0/3491568828 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f85ac0fd5e0 0x7f85ac0fda50 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:49:43.212 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:43.210+0000 7f85b28bf640 1 --2- 172.21.15.121:0/3491568828 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f85ac0fc310 0x7f85ac0fc720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:49:43.212 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:43.210+0000 7f85b28bf640 1 -- 172.21.15.121:0/3491568828 >> 172.21.15.121:0/3491568828 conn(0x7f85ac0f7ad0 msgr2=0x7f85ac0f9f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:49:43.212 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:43.210+0000 7f85b28bf640 1 -- 172.21.15.121:0/3491568828 shutdown_connections 2024-08-18T22:49:43.212 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:43.210+0000 7f85b28bf640 1 -- 172.21.15.121:0/3491568828 wait complete. 2024-08-18T22:49:43.212 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:43.211+0000 7f85b28bf640 1 Processor -- start 2024-08-18T22:49:43.214 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:43.211+0000 7f85b28bf640 1 -- start start 2024-08-18T22:49:43.215 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:43.211+0000 7f85b28bf640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f85ac0fc310 0x7f85ac10cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:49:43.215 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:43.211+0000 7f85b28bf640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f85ac0fd5e0 0x7f85ac10d120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:49:43.215 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:43.211+0000 7f85b28bf640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85ac10d770 con 0x7f85ac0fc310 2024-08-18T22:49:43.215 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:43.211+0000 7f85b28bf640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85ac10df90 con 0x7f85ac0fd5e0 2024-08-18T22:49:43.215 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:43.212+0000 7f85abfff640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f85ac0fc310 0x7f85ac10cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:49:43.215 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:43.212+0000 7f85abfff640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f85ac0fc310 0x7f85ac10cbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:36018/0 (socket says 172.21.15.121:36018) 2024-08-18T22:49:43.215 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:43.212+0000 7f85abfff640 1 -- 172.21.15.121:0/1435807670 learned_addr learned my addr 172.21.15.121:0/1435807670 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-18T22:49:43.215 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:43.212+0000 7f85ab7fe640 1 --2- 172.21.15.121:0/1435807670 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f85ac0fd5e0 0x7f85ac10d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:49:43.216 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:43.212+0000 7f85abfff640 1 -- 172.21.15.121:0/1435807670 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f85ac0fd5e0 msgr2=0x7f85ac10d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:49:43.216 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:43.212+0000 7f85abfff640 1 --2- 172.21.15.121:0/1435807670 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f85ac0fd5e0 0x7f85ac10d120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:49:43.216 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:43.212+0000 7f85abfff640 1 -- 172.21.15.121:0/1435807670 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85a0005040 con 0x7f85ac0fc310 2024-08-18T22:49:43.216 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:43.212+0000 7f85abfff640 1 --2- 172.21.15.121:0/1435807670 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f85ac0fc310 0x7f85ac10cbe0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f859c00eb70 tx=0x7f859c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:49:43.216 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:43.212+0000 7f85a8ff9640 1 -- 172.21.15.121:0/1435807670 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f859c007bd0 con 0x7f85ac0fc310 2024-08-18T22:49:43.216 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:43.212+0000 7f85a8ff9640 1 -- 172.21.15.121:0/1435807670 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f859c00f040 con 0x7f85ac0fc310 2024-08-18T22:49:43.216 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:43.212+0000 7f85b28bf640 1 -- 172.21.15.121:0/1435807670 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85ac10e1c0 con 0x7f85ac0fc310 2024-08-18T22:49:43.216 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:43.212+0000 7f85b28bf640 1 -- 172.21.15.121:0/1435807670 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85ac10e680 con 0x7f85ac0fc310 2024-08-18T22:49:43.216 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:43.213+0000 7f85a8ff9640 1 -- 172.21.15.121:0/1435807670 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f859c00cb40 con 0x7f85ac0fc310 2024-08-18T22:49:43.216 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:43.214+0000 7f85b28bf640 1 -- 172.21.15.121:0/1435807670 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8598005240 con 0x7f85ac0fc310 2024-08-18T22:49:43.217 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:43.214+0000 7f85a8ff9640 1 -- 172.21.15.121:0/1435807670 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 37) v1 ==== 92205+0+0 (secure 0 0 0) 0x7f859c00cca0 con 0x7f85ac0fc310 2024-08-18T22:49:43.217 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:43.215+0000 7f85a8ff9640 1 --2- 172.21.15.121:0/1435807670 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f859406e0b0 0x7f8594070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:49:43.217 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:43.215+0000 7f85a8ff9640 1 -- 172.21.15.121:0/1435807670 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6668+0+0 (secure 0 0 0) 0x7f859c08d760 con 0x7f85ac0fc310 2024-08-18T22:49:43.217 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:43.215+0000 7f85ab7fe640 1 --2- 172.21.15.121:0/1435807670 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f859406e0b0 0x7f8594070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:49:43.218 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:43.216+0000 7f85ab7fe640 1 --2- 172.21.15.121:0/1435807670 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f859406e0b0 0x7f8594070560 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f85ac10c990 tx=0x7f85a0035040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:49:43.221 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:43.220+0000 7f85a8ff9640 1 -- 172.21.15.121:0/1435807670 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f859c056b10 con 0x7f85ac0fc310 2024-08-18T22:49:43.427 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:43.426+0000 7f85b28bf640 1 -- 172.21.15.121:0/1435807670 --> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f8598000bf0 con 0x7f859406e0b0 2024-08-18T22:49:43.428 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:43.427+0000 7f85a8ff9640 1 -- 172.21.15.121:0/1435807670 <== mgr.34102 v2:172.21.15.121:6800/3037387239 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+441 (secure 0 0 0) 0x7f8598000bf0 con 0x7f859406e0b0 2024-08-18T22:49:43.430 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:43.429+0000 7f85b28bf640 1 -- 172.21.15.121:0/1435807670 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f859406e0b0 msgr2=0x7f8594070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:49:43.430 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:43.429+0000 7f85b28bf640 1 --2- 172.21.15.121:0/1435807670 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f859406e0b0 0x7f8594070560 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f85ac10c990 tx=0x7f85a0035040 comp rx=0 tx=0).stop 2024-08-18T22:49:43.431 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:43.429+0000 7f85b28bf640 1 -- 172.21.15.121:0/1435807670 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f85ac0fc310 msgr2=0x7f85ac10cbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:49:43.431 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:43.429+0000 7f85b28bf640 1 --2- 172.21.15.121:0/1435807670 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f85ac0fc310 0x7f85ac10cbe0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f859c00eb70 tx=0x7f859c00b040 comp rx=0 tx=0).stop 2024-08-18T22:49:43.431 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:43.429+0000 7f85b28bf640 1 -- 172.21.15.121:0/1435807670 shutdown_connections 2024-08-18T22:49:43.431 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:43.429+0000 7f85b28bf640 1 --2- 172.21.15.121:0/1435807670 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f859406e0b0 0x7f8594070560 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:49:43.431 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:43.429+0000 7f85b28bf640 1 --2- 172.21.15.121:0/1435807670 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f85ac0fd5e0 0x7f85ac10d120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:49:43.431 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:43.429+0000 7f85b28bf640 1 --2- 172.21.15.121:0/1435807670 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f85ac0fc310 0x7f85ac10cbe0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:49:43.431 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:43.429+0000 7f85b28bf640 1 -- 172.21.15.121:0/1435807670 >> 172.21.15.121:0/1435807670 conn(0x7f85ac0f7ad0 msgr2=0x7f85ac0f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:49:43.431 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:43.430+0000 7f85b28bf640 1 -- 172.21.15.121:0/1435807670 shutdown_connections 2024-08-18T22:49:43.431 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:43.430+0000 7f85b28bf640 1 -- 172.21.15.121:0/1435807670 wait complete. 2024-08-18T22:49:43.525 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:43.523+0000 7f7f0a5c4640 1 -- 172.21.15.121:0/4108173162 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7f0406fd80 msgr2=0x7f7f040701f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:49:43.525 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:43.524+0000 7f7f0a5c4640 1 --2- 172.21.15.121:0/4108173162 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7f0406fd80 0x7f7f040701f0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f7ef80048d0 tx=0x7f7ef8009da0 comp rx=0 tx=0).stop 2024-08-18T22:49:43.525 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:43.524+0000 7f7f0a5c4640 1 -- 172.21.15.121:0/4108173162 shutdown_connections 2024-08-18T22:49:43.526 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:43.524+0000 7f7f0a5c4640 1 --2- 172.21.15.121:0/4108173162 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7f0406fd80 0x7f7f040701f0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:49:43.526 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:43.524+0000 7f7f0a5c4640 1 --2- 172.21.15.121:0/4108173162 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7f04071310 0x7f7f0406f840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:49:43.526 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:43.524+0000 7f7f0a5c4640 1 -- 172.21.15.121:0/4108173162 >> 172.21.15.121:0/4108173162 conn(0x7f7f040f7a80 msgr2=0x7f7f040f9eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:49:43.526 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:43.524+0000 7f7f0a5c4640 1 -- 172.21.15.121:0/4108173162 shutdown_connections 2024-08-18T22:49:43.526 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:43.524+0000 7f7f0a5c4640 1 -- 172.21.15.121:0/4108173162 wait complete. 2024-08-18T22:49:43.526 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:43.524+0000 7f7f0a5c4640 1 Processor -- start 2024-08-18T22:49:43.526 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:43.524+0000 7f7f0a5c4640 1 -- start start 2024-08-18T22:49:43.528 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:43.525+0000 7f7f0a5c4640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7f0406fd80 0x7f7f0410f070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:49:43.528 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:43.525+0000 7f7f0a5c4640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7f04071310 0x7f7f0410f5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:49:43.528 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:43.525+0000 7f7f0a5c4640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f04110420 con 0x7f7f0406fd80 2024-08-18T22:49:43.528 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:43.525+0000 7f7f0a5c4640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f04110590 con 0x7f7f04071310 2024-08-18T22:49:43.528 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:43.525+0000 7f7f03fff640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7f0406fd80 0x7f7f0410f070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:49:43.528 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:43.525+0000 7f7f03fff640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7f0406fd80 0x7f7f0410f070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:36040/0 (socket says 172.21.15.121:36040) 2024-08-18T22:49:43.528 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:43.525+0000 7f7f03fff640 1 -- 172.21.15.121:0/3090620819 learned_addr learned my addr 172.21.15.121:0/3090620819 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-18T22:49:43.528 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:43.525+0000 7f7f037fe640 1 --2- 172.21.15.121:0/3090620819 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7f04071310 0x7f7f0410f5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:49:43.528 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:43.525+0000 7f7f03fff640 1 -- 172.21.15.121:0/3090620819 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7f04071310 msgr2=0x7f7f0410f5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:49:43.528 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:43.525+0000 7f7f03fff640 1 --2- 172.21.15.121:0/3090620819 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7f04071310 0x7f7f0410f5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:49:43.529 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:43.525+0000 7f7f03fff640 1 -- 172.21.15.121:0/3090620819 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ef8005040 con 0x7f7f0406fd80 2024-08-18T22:49:43.529 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:43.526+0000 7f7f03fff640 1 --2- 172.21.15.121:0/3090620819 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7f0406fd80 0x7f7f0410f070 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f7ef400b580 tx=0x7f7ef40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:49:43.529 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:43.526+0000 7f7f00ff9640 1 -- 172.21.15.121:0/3090620819 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7ef400f6f0 con 0x7f7f0406fd80 2024-08-18T22:49:43.529 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:43.526+0000 7f7f0a5c4640 1 -- 172.21.15.121:0/3090620819 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f04110870 con 0x7f7f0406fd80 2024-08-18T22:49:43.529 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:43.526+0000 7f7f00ff9640 1 -- 172.21.15.121:0/3090620819 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f7ef400fcf0 con 0x7f7f0406fd80 2024-08-18T22:49:43.529 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:43.526+0000 7f7f00ff9640 1 -- 172.21.15.121:0/3090620819 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7ef40103a0 con 0x7f7f0406fd80 2024-08-18T22:49:43.529 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:43.526+0000 7f7f0a5c4640 1 -- 172.21.15.121:0/3090620819 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f04110d40 con 0x7f7f0406fd80 2024-08-18T22:49:43.529 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:43.527+0000 7f7f0a5c4640 1 -- 172.21.15.121:0/3090620819 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f04107780 con 0x7f7f0406fd80 2024-08-18T22:49:43.530 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:43.528+0000 7f7f00ff9640 1 -- 172.21.15.121:0/3090620819 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 37) v1 ==== 92205+0+0 (secure 0 0 0) 0x7f7ef40116b0 con 0x7f7f0406fd80 2024-08-18T22:49:43.530 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:43.528+0000 7f7f00ff9640 1 --2- 172.21.15.121:0/3090620819 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f7eec06e0b0 0x7f7eec070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:49:43.530 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:43.528+0000 7f7f00ff9640 1 -- 172.21.15.121:0/3090620819 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6668+0+0 (secure 0 0 0) 0x7f7ef408db10 con 0x7f7f0406fd80 2024-08-18T22:49:43.530 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:43.528+0000 7f7f037fe640 1 --2- 172.21.15.121:0/3090620819 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f7eec06e0b0 0x7f7eec070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:49:43.530 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:43.529+0000 7f7f037fe640 1 --2- 172.21.15.121:0/3090620819 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f7eec06e0b0 0x7f7eec070560 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f7f0410ee20 tx=0x7f7ef8035040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:49:43.533 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:43.532+0000 7f7f00ff9640 1 -- 172.21.15.121:0/3090620819 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f7ef4056e10 con 0x7f7f0406fd80 2024-08-18T22:49:43.680 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:49:43 smithi121 ceph-mon[81053]: Upgrade: Setting container_image for all rgw 2024-08-18T22:49:43.680 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:49:43 smithi121 ceph-mon[81053]: Upgrade: Setting container_image for all rbd-mirror 2024-08-18T22:49:43.680 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:49:43 smithi121 ceph-mon[81053]: Upgrade: Setting container_image for all ceph-exporter 2024-08-18T22:49:43.680 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:49:43 smithi121 ceph-mon[81053]: Upgrade: Setting container_image for all iscsi 2024-08-18T22:49:43.681 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:49:43 smithi121 ceph-mon[81053]: Upgrade: Setting container_image for all nfs 2024-08-18T22:49:43.681 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:49:43 smithi121 ceph-mon[81053]: Upgrade: Setting container_image for all nvmeof 2024-08-18T22:49:43.681 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:49:43 smithi121 ceph-mon[81053]: pgmap v219: 65 pgs: 65 active+clean; 169 MiB data, 803 MiB used, 536 GiB / 536 GiB avail; 30 KiB/s rd, 983 KiB/s wr, 309 op/s 2024-08-18T22:49:43.681 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:49:43 smithi121 ceph-mon[81053]: mds.? [v2:172.21.15.121:6828/2915303436,v1:172.21.15.121:6829/2915303436] up:active 2024-08-18T22:49:43.681 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:49:43 smithi121 ceph-mon[81053]: fsmap cephfs:2 {0=cephfs.smithi121.xuzsdg=up:active,1=cephfs.smithi121.gbickb=up:active} 2 up:standby 2024-08-18T22:49:43.827 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:43.826+0000 7f7f0a5c4640 1 -- 172.21.15.121:0/3090620819 --> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f7f04111010 con 0x7f7eec06e0b0 2024-08-18T22:49:43.837 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:43.836+0000 7f7f00ff9640 1 -- 172.21.15.121:0/3090620819 <== mgr.34102 v2:172.21.15.121:6800/3037387239 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f7f04111010 con 0x7f7eec06e0b0 2024-08-18T22:49:43.838 INFO:teuthology.orchestra.run.smithi121.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-08-18T22:49:43.838 INFO:teuthology.orchestra.run.smithi121.stdout:alertmanager.smithi121 smithi121 *:9093,9094 running (7m) 44s ago 15m 23.4M - 0.25.0 c8568f914cd2 c421c5e6a02b 2024-08-18T22:49:43.838 INFO:teuthology.orchestra.run.smithi121.stdout:crash.smithi121 smithi121 running (5m) 44s ago 15m 6903k - 19.1.0-1382-gde09dd01 ea7a5189f30b 3cf5c666a0e6 2024-08-18T22:49:43.838 INFO:teuthology.orchestra.run.smithi121.stdout:crash.smithi195 smithi195 running (5m) 6s ago 14m 6895k - 19.1.0-1382-gde09dd01 ea7a5189f30b fbb586fb9834 2024-08-18T22:49:43.838 INFO:teuthology.orchestra.run.smithi121.stdout:grafana.smithi121 smithi121 *:3000 running (7m) 44s ago 15m 87.0M - 9.4.7 954c08fa6188 091a5fd17e8a 2024-08-18T22:49:43.838 INFO:teuthology.orchestra.run.smithi121.stdout:mds.cephfs.smithi121.gbickb smithi121 running (53s) 44s ago 10m 13.2M - 19.1.0-1382-gde09dd01 ea7a5189f30b 3d6dc5c5f472 2024-08-18T22:49:43.838 INFO:teuthology.orchestra.run.smithi121.stdout:mds.cephfs.smithi121.xuzsdg smithi121 running (70s) 44s ago 10m 13.1M - 19.1.0-1382-gde09dd01 ea7a5189f30b 4eec4d0a895e 2024-08-18T22:49:43.838 INFO:teuthology.orchestra.run.smithi121.stdout:mds.cephfs.smithi195.buqvbr smithi195 running (33s) 6s ago 10m 12.3M - 19.1.0-1382-gde09dd01 ea7a5189f30b dca538294bee 2024-08-18T22:49:43.838 INFO:teuthology.orchestra.run.smithi121.stdout:mds.cephfs.smithi195.nptgyc smithi195 running (9s) 6s ago 10m 13.0M - 19.1.0-1382-gde09dd01 ea7a5189f30b 42528b070f11 2024-08-18T22:49:43.839 INFO:teuthology.orchestra.run.smithi121.stdout:mgr.smithi121.lopxqc smithi121 *:8443,9283,8765 running (7m) 44s ago 16m 505M - 19.1.0-1382-gde09dd01 ea7a5189f30b 9079701e6516 2024-08-18T22:49:43.839 INFO:teuthology.orchestra.run.smithi121.stdout:mgr.smithi195.acttsj smithi195 *:8443,9283,8765 running (6m) 6s ago 14m 442M - 19.1.0-1382-gde09dd01 ea7a5189f30b 7b4027a33daa 2024-08-18T22:49:43.839 INFO:teuthology.orchestra.run.smithi121.stdout:mon.smithi121 smithi121 running (6m) 44s ago 17m 54.4M 2048M 19.1.0-1382-gde09dd01 ea7a5189f30b d71695a4fb56 2024-08-18T22:49:43.839 INFO:teuthology.orchestra.run.smithi121.stdout:mon.smithi195 smithi195 running (5m) 6s ago 14m 39.3M 2048M 19.1.0-1382-gde09dd01 ea7a5189f30b a9bb94ba3b56 2024-08-18T22:49:43.839 INFO:teuthology.orchestra.run.smithi121.stdout:node-exporter.smithi121 smithi121 *:9100 running (7m) 44s ago 15m 15.2M - 1.5.0 0da6a335fe13 bc4b5355a507 2024-08-18T22:49:43.839 INFO:teuthology.orchestra.run.smithi121.stdout:node-exporter.smithi195 smithi195 *:9100 running (7m) 6s ago 14m 16.9M - 1.5.0 0da6a335fe13 146efcb79663 2024-08-18T22:49:43.839 INFO:teuthology.orchestra.run.smithi121.stdout:osd.0 smithi121 running (4m) 44s ago 14m 107M 1557M 19.1.0-1382-gde09dd01 ea7a5189f30b d378dd46eeb6 2024-08-18T22:49:43.839 INFO:teuthology.orchestra.run.smithi121.stdout:osd.1 smithi121 running (4m) 44s ago 13m 129M 1557M 19.1.0-1382-gde09dd01 ea7a5189f30b 0f9e03de5382 2024-08-18T22:49:43.839 INFO:teuthology.orchestra.run.smithi121.stdout:osd.2 smithi121 running (3m) 44s ago 13m 93.3M 1557M 19.1.0-1382-gde09dd01 ea7a5189f30b 93270b5bed68 2024-08-18T22:49:43.839 INFO:teuthology.orchestra.run.smithi121.stdout:osd.3 smithi195 running (3m) 6s ago 12m 170M 2581M 19.1.0-1382-gde09dd01 ea7a5189f30b 72c2860c0e9f 2024-08-18T22:49:43.839 INFO:teuthology.orchestra.run.smithi121.stdout:osd.4 smithi195 running (2m) 6s ago 12m 153M 2581M 19.1.0-1382-gde09dd01 ea7a5189f30b d88a83c97247 2024-08-18T22:49:43.839 INFO:teuthology.orchestra.run.smithi121.stdout:osd.5 smithi195 running (2m) 6s ago 11m 143M 2581M 19.1.0-1382-gde09dd01 ea7a5189f30b 5af2d6de9afe 2024-08-18T22:49:43.840 INFO:teuthology.orchestra.run.smithi121.stdout:prometheus.smithi121 smithi121 *:9095 running (6m) 44s ago 15m 61.7M - 2.43.0 a07b618ecd1d 00c4f776d23a 2024-08-18T22:49:43.840 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:43.839+0000 7f7f0a5c4640 1 -- 172.21.15.121:0/3090620819 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f7eec06e0b0 msgr2=0x7f7eec070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:49:43.840 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:43.839+0000 7f7f0a5c4640 1 --2- 172.21.15.121:0/3090620819 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f7eec06e0b0 0x7f7eec070560 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f7f0410ee20 tx=0x7f7ef8035040 comp rx=0 tx=0).stop 2024-08-18T22:49:43.840 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:43.839+0000 7f7f0a5c4640 1 -- 172.21.15.121:0/3090620819 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7f0406fd80 msgr2=0x7f7f0410f070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:49:43.840 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:43.839+0000 7f7f0a5c4640 1 --2- 172.21.15.121:0/3090620819 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7f0406fd80 0x7f7f0410f070 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f7ef400b580 tx=0x7f7ef40091a0 comp rx=0 tx=0).stop 2024-08-18T22:49:43.841 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:43.839+0000 7f7f0a5c4640 1 -- 172.21.15.121:0/3090620819 shutdown_connections 2024-08-18T22:49:43.841 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:43.839+0000 7f7f0a5c4640 1 --2- 172.21.15.121:0/3090620819 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f7eec06e0b0 0x7f7eec070560 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:49:43.841 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:43.839+0000 7f7f0a5c4640 1 --2- 172.21.15.121:0/3090620819 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7f04071310 0x7f7f0410f5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:49:43.841 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:43.839+0000 7f7f0a5c4640 1 --2- 172.21.15.121:0/3090620819 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7f0406fd80 0x7f7f0410f070 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:49:43.841 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:43.839+0000 7f7f0a5c4640 1 -- 172.21.15.121:0/3090620819 >> 172.21.15.121:0/3090620819 conn(0x7f7f040f7a80 msgr2=0x7f7f040f91d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:49:43.841 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:43.839+0000 7f7f0a5c4640 1 -- 172.21.15.121:0/3090620819 shutdown_connections 2024-08-18T22:49:43.841 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:43.839+0000 7f7f0a5c4640 1 -- 172.21.15.121:0/3090620819 wait complete. 2024-08-18T22:49:43.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:49:43 smithi195 ceph-mon[68841]: Upgrade: Setting container_image for all rgw 2024-08-18T22:49:43.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:49:43 smithi195 ceph-mon[68841]: Upgrade: Setting container_image for all rbd-mirror 2024-08-18T22:49:43.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:49:43 smithi195 ceph-mon[68841]: Upgrade: Setting container_image for all ceph-exporter 2024-08-18T22:49:43.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:49:43 smithi195 ceph-mon[68841]: Upgrade: Setting container_image for all iscsi 2024-08-18T22:49:43.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:49:43 smithi195 ceph-mon[68841]: Upgrade: Setting container_image for all nfs 2024-08-18T22:49:43.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:49:43 smithi195 ceph-mon[68841]: Upgrade: Setting container_image for all nvmeof 2024-08-18T22:49:43.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:49:43 smithi195 ceph-mon[68841]: pgmap v219: 65 pgs: 65 active+clean; 169 MiB data, 803 MiB used, 536 GiB / 536 GiB avail; 30 KiB/s rd, 983 KiB/s wr, 309 op/s 2024-08-18T22:49:43.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:49:43 smithi195 ceph-mon[68841]: mds.? [v2:172.21.15.121:6828/2915303436,v1:172.21.15.121:6829/2915303436] up:active 2024-08-18T22:49:43.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:49:43 smithi195 ceph-mon[68841]: fsmap cephfs:2 {0=cephfs.smithi121.xuzsdg=up:active,1=cephfs.smithi121.gbickb=up:active} 2 up:standby 2024-08-18T22:49:43.936 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:43.934+0000 7f42621d3640 1 -- 172.21.15.121:0/455524748 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f425c0fb1d0 msgr2=0x7f425c0fb5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:49:43.936 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:43.934+0000 7f42621d3640 1 --2- 172.21.15.121:0/455524748 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f425c0fb1d0 0x7f425c0fb5e0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f424c0048d0 tx=0x7f424c009da0 comp rx=0 tx=0).stop 2024-08-18T22:49:43.936 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:43.935+0000 7f42621d3640 1 -- 172.21.15.121:0/455524748 shutdown_connections 2024-08-18T22:49:43.936 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:43.935+0000 7f42621d3640 1 --2- 172.21.15.121:0/455524748 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f425c0fc4a0 0x7f425c0fc910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:49:43.936 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:43.935+0000 7f42621d3640 1 --2- 172.21.15.121:0/455524748 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f425c0fb1d0 0x7f425c0fb5e0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:49:43.936 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:43.935+0000 7f42621d3640 1 -- 172.21.15.121:0/455524748 >> 172.21.15.121:0/455524748 conn(0x7f425c0f69b0 msgr2=0x7f425c0f8dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:49:43.936 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:43.935+0000 7f42621d3640 1 -- 172.21.15.121:0/455524748 shutdown_connections 2024-08-18T22:49:43.937 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:43.935+0000 7f42621d3640 1 -- 172.21.15.121:0/455524748 wait complete. 2024-08-18T22:49:43.937 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:43.935+0000 7f42621d3640 1 Processor -- start 2024-08-18T22:49:43.938 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:43.936+0000 7f42621d3640 1 -- start start 2024-08-18T22:49:43.938 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:43.936+0000 7f42621d3640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f425c0fb1d0 0x7f425c10bd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:49:43.938 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:43.936+0000 7f42621d3640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f425c0fc4a0 0x7f425c10c2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:49:43.938 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:43.936+0000 7f42621d3640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f425c10c920 con 0x7f425c0fb1d0 2024-08-18T22:49:43.938 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:43.936+0000 7f42621d3640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f425c10d060 con 0x7f425c0fc4a0 2024-08-18T22:49:43.938 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:43.936+0000 7f425b7fe640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f425c0fb1d0 0x7f425c10bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:49:43.938 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:43.936+0000 7f425b7fe640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f425c0fb1d0 0x7f425c10bd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:36048/0 (socket says 172.21.15.121:36048) 2024-08-18T22:49:43.939 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:43.936+0000 7f425b7fe640 1 -- 172.21.15.121:0/1425054720 learned_addr learned my addr 172.21.15.121:0/1425054720 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-18T22:49:43.939 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:43.936+0000 7f425affd640 1 --2- 172.21.15.121:0/1425054720 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f425c0fc4a0 0x7f425c10c2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:49:43.939 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:43.936+0000 7f425b7fe640 1 -- 172.21.15.121:0/1425054720 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f425c0fc4a0 msgr2=0x7f425c10c2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:49:43.939 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:43.936+0000 7f425b7fe640 1 --2- 172.21.15.121:0/1425054720 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f425c0fc4a0 0x7f425c10c2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:49:43.939 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:43.936+0000 7f425b7fe640 1 -- 172.21.15.121:0/1425054720 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f424c005040 con 0x7f425c0fb1d0 2024-08-18T22:49:43.939 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:43.937+0000 7f425b7fe640 1 --2- 172.21.15.121:0/1425054720 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f425c0fb1d0 0x7f425c10bd90 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f424c003080 tx=0x7f424c009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:49:43.939 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:43.937+0000 7f4243fff640 1 -- 172.21.15.121:0/1425054720 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f424c038070 con 0x7f425c0fb1d0 2024-08-18T22:49:43.939 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:43.937+0000 7f4243fff640 1 -- 172.21.15.121:0/1425054720 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f424c02abd0 con 0x7f425c0fb1d0 2024-08-18T22:49:43.939 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:43.937+0000 7f42621d3640 1 -- 172.21.15.121:0/1425054720 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f425c10d290 con 0x7f425c0fb1d0 2024-08-18T22:49:43.940 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:43.937+0000 7f4243fff640 1 -- 172.21.15.121:0/1425054720 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f424c03e670 con 0x7f425c0fb1d0 2024-08-18T22:49:43.940 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:43.937+0000 7f42621d3640 1 -- 172.21.15.121:0/1425054720 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f425c10d830 con 0x7f425c0fb1d0 2024-08-18T22:49:43.940 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:43.938+0000 7f42621d3640 1 -- 172.21.15.121:0/1425054720 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f425c0fa630 con 0x7f425c0fb1d0 2024-08-18T22:49:43.940 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:43.939+0000 7f4243fff640 1 -- 172.21.15.121:0/1425054720 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 37) v1 ==== 92205+0+0 (secure 0 0 0) 0x7f424c030020 con 0x7f425c0fb1d0 2024-08-18T22:49:43.941 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:43.939+0000 7f4243fff640 1 --2- 172.21.15.121:0/1425054720 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f424406e0b0 0x7f4244070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:49:43.941 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:43.939+0000 7f4243fff640 1 -- 172.21.15.121:0/1425054720 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6668+0+0 (secure 0 0 0) 0x7f424c0adeb0 con 0x7f425c0fb1d0 2024-08-18T22:49:43.941 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:43.940+0000 7f425affd640 1 --2- 172.21.15.121:0/1425054720 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f424406e0b0 0x7f4244070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:49:43.941 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:43.940+0000 7f425affd640 1 --2- 172.21.15.121:0/1425054720 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f424406e0b0 0x7f4244070560 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f42500041d0 tx=0x7f42500043c0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:49:43.946 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:43.945+0000 7f4243fff640 1 -- 172.21.15.121:0/1425054720 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f424c077260 con 0x7f425c0fb1d0 2024-08-18T22:49:44.288 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:44.287+0000 7f42621d3640 1 -- 172.21.15.121:0/1425054720 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f425c04b4c0 con 0x7f425c0fb1d0 2024-08-18T22:49:44.288 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:44.287+0000 7f4243fff640 1 -- 172.21.15.121:0/1425054720 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+618 (secure 0 0 0) 0x7f424c07a920 con 0x7f425c0fb1d0 2024-08-18T22:49:44.289 INFO:teuthology.orchestra.run.smithi121.stdout:{ 2024-08-18T22:49:44.289 INFO:teuthology.orchestra.run.smithi121.stdout: "mon": { 2024-08-18T22:49:44.289 INFO:teuthology.orchestra.run.smithi121.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 2 2024-08-18T22:49:44.289 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-18T22:49:44.289 INFO:teuthology.orchestra.run.smithi121.stdout: "mgr": { 2024-08-18T22:49:44.289 INFO:teuthology.orchestra.run.smithi121.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 2 2024-08-18T22:49:44.289 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-18T22:49:44.289 INFO:teuthology.orchestra.run.smithi121.stdout: "osd": { 2024-08-18T22:49:44.289 INFO:teuthology.orchestra.run.smithi121.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 6 2024-08-18T22:49:44.289 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-18T22:49:44.289 INFO:teuthology.orchestra.run.smithi121.stdout: "mds": { 2024-08-18T22:49:44.289 INFO:teuthology.orchestra.run.smithi121.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 4 2024-08-18T22:49:44.289 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-18T22:49:44.290 INFO:teuthology.orchestra.run.smithi121.stdout: "overall": { 2024-08-18T22:49:44.290 INFO:teuthology.orchestra.run.smithi121.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 14 2024-08-18T22:49:44.290 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-08-18T22:49:44.290 INFO:teuthology.orchestra.run.smithi121.stdout:} 2024-08-18T22:49:44.291 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:44.290+0000 7f42621d3640 1 -- 172.21.15.121:0/1425054720 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f424406e0b0 msgr2=0x7f4244070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:49:44.291 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:44.290+0000 7f42621d3640 1 --2- 172.21.15.121:0/1425054720 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f424406e0b0 0x7f4244070560 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f42500041d0 tx=0x7f42500043c0 comp rx=0 tx=0).stop 2024-08-18T22:49:44.291 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:44.290+0000 7f42621d3640 1 -- 172.21.15.121:0/1425054720 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f425c0fb1d0 msgr2=0x7f425c10bd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:49:44.291 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:44.290+0000 7f42621d3640 1 --2- 172.21.15.121:0/1425054720 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f425c0fb1d0 0x7f425c10bd90 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f424c003080 tx=0x7f424c009da0 comp rx=0 tx=0).stop 2024-08-18T22:49:44.291 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:44.290+0000 7f42621d3640 1 -- 172.21.15.121:0/1425054720 shutdown_connections 2024-08-18T22:49:44.291 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:44.290+0000 7f42621d3640 1 --2- 172.21.15.121:0/1425054720 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f424406e0b0 0x7f4244070560 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:49:44.291 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:44.290+0000 7f42621d3640 1 --2- 172.21.15.121:0/1425054720 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f425c0fc4a0 0x7f425c10c2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:49:44.291 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:44.290+0000 7f42621d3640 1 --2- 172.21.15.121:0/1425054720 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f425c0fb1d0 0x7f425c10bd90 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:49:44.291 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:44.290+0000 7f42621d3640 1 -- 172.21.15.121:0/1425054720 >> 172.21.15.121:0/1425054720 conn(0x7f425c0f69b0 msgr2=0x7f425c0f8180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:49:44.292 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:44.290+0000 7f42621d3640 1 -- 172.21.15.121:0/1425054720 shutdown_connections 2024-08-18T22:49:44.292 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:44.290+0000 7f42621d3640 1 -- 172.21.15.121:0/1425054720 wait complete. 2024-08-18T22:49:44.381 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:44.377+0000 7fa41d1ed640 1 -- 172.21.15.121:0/1603990908 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa4180ff420 msgr2=0x7fa418101800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:49:44.381 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:44.377+0000 7fa41d1ed640 1 --2- 172.21.15.121:0/1603990908 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa4180ff420 0x7fa418101800 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fa4000048d0 tx=0x7fa400009da0 comp rx=0 tx=0).stop 2024-08-18T22:49:44.381 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:44.377+0000 7fa41d1ed640 1 -- 172.21.15.121:0/1603990908 shutdown_connections 2024-08-18T22:49:44.381 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:44.377+0000 7fa41d1ed640 1 --2- 172.21.15.121:0/1603990908 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa4180ff420 0x7fa418101800 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:49:44.381 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:44.377+0000 7fa41d1ed640 1 --2- 172.21.15.121:0/1603990908 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa4180659e0 0x7fa4180feee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:49:44.381 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:44.377+0000 7fa41d1ed640 1 -- 172.21.15.121:0/1603990908 >> 172.21.15.121:0/1603990908 conn(0x7fa4180f69b0 msgr2=0x7fa4180f8dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:49:44.381 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:44.378+0000 7fa41d1ed640 1 -- 172.21.15.121:0/1603990908 shutdown_connections 2024-08-18T22:49:44.381 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:44.378+0000 7fa41d1ed640 1 -- 172.21.15.121:0/1603990908 wait complete. 2024-08-18T22:49:44.381 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:44.378+0000 7fa41d1ed640 1 Processor -- start 2024-08-18T22:49:44.381 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:44.378+0000 7fa41d1ed640 1 -- start start 2024-08-18T22:49:44.381 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:44.378+0000 7fa41d1ed640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa4180659e0 0x7fa4180fc850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:49:44.382 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:44.378+0000 7fa41d1ed640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa4180ff420 0x7fa4180fade0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:49:44.382 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:44.378+0000 7fa41d1ed640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4180fb320 con 0x7fa4180ff420 2024-08-18T22:49:44.382 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:44.378+0000 7fa41d1ed640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4180fb490 con 0x7fa4180659e0 2024-08-18T22:49:44.382 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:44.378+0000 7fa40ffff640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa4180ff420 0x7fa4180fade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:49:44.382 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:44.379+0000 7fa416d9d640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa4180659e0 0x7fa4180fc850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:49:44.382 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:44.379+0000 7fa40ffff640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa4180ff420 0x7fa4180fade0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:36060/0 (socket says 172.21.15.121:36060) 2024-08-18T22:49:44.382 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:44.379+0000 7fa40ffff640 1 -- 172.21.15.121:0/951683251 learned_addr learned my addr 172.21.15.121:0/951683251 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-18T22:49:44.382 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:44.379+0000 7fa40ffff640 1 -- 172.21.15.121:0/951683251 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa4180659e0 msgr2=0x7fa4180fc850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:49:44.382 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:44.379+0000 7fa40ffff640 1 --2- 172.21.15.121:0/951683251 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa4180659e0 0x7fa4180fc850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:49:44.382 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:44.379+0000 7fa40ffff640 1 -- 172.21.15.121:0/951683251 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa400005040 con 0x7fa4180ff420 2024-08-18T22:49:44.382 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:44.379+0000 7fa416d9d640 1 --2- 172.21.15.121:0/951683251 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa4180659e0 0x7fa4180fc850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:49:44.382 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:44.379+0000 7fa40ffff640 1 --2- 172.21.15.121:0/951683251 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa4180ff420 0x7fa4180fade0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fa4000048a0 tx=0x7fa400009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:49:44.382 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:44.379+0000 7fa40f7fe640 1 -- 172.21.15.121:0/951683251 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa400038070 con 0x7fa4180ff420 2024-08-18T22:49:44.383 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:44.379+0000 7fa40f7fe640 1 -- 172.21.15.121:0/951683251 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fa400004290 con 0x7fa4180ff420 2024-08-18T22:49:44.383 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:44.379+0000 7fa41d1ed640 1 -- 172.21.15.121:0/951683251 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4180fb710 con 0x7fa4180ff420 2024-08-18T22:49:44.383 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:44.379+0000 7fa40f7fe640 1 -- 172.21.15.121:0/951683251 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa400033660 con 0x7fa4180ff420 2024-08-18T22:49:44.383 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:44.380+0000 7fa41d1ed640 1 -- 172.21.15.121:0/951683251 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4180fbc30 con 0x7fa4180ff420 2024-08-18T22:49:44.384 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:44.381+0000 7fa41d1ed640 1 -- 172.21.15.121:0/951683251 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4180fa630 con 0x7fa4180ff420 2024-08-18T22:49:44.384 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:44.381+0000 7fa40f7fe640 1 -- 172.21.15.121:0/951683251 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 37) v1 ==== 92205+0+0 (secure 0 0 0) 0x7fa400030020 con 0x7fa4180ff420 2024-08-18T22:49:44.384 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:44.382+0000 7fa40f7fe640 1 --2- 172.21.15.121:0/951683251 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7fa40406e0b0 0x7fa404070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:49:44.384 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:44.382+0000 7fa40f7fe640 1 -- 172.21.15.121:0/951683251 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6668+0+0 (secure 0 0 0) 0x7fa4000adcd0 con 0x7fa4180ff420 2024-08-18T22:49:44.384 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:44.382+0000 7fa416d9d640 1 --2- 172.21.15.121:0/951683251 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7fa40406e0b0 0x7fa404070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:49:44.384 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:44.382+0000 7fa416d9d640 1 --2- 172.21.15.121:0/951683251 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7fa40406e0b0 0x7fa404070560 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fa4180fc600 tx=0x7fa40800b040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:49:44.387 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:44.387+0000 7fa40f7fe640 1 -- 172.21.15.121:0/951683251 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7fa400077080 con 0x7fa4180ff420 2024-08-18T22:49:44.657 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:44.656+0000 7fa41d1ed640 1 -- 172.21.15.121:0/951683251 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fa41804b4c0 con 0x7fa4180ff420 2024-08-18T22:49:44.659 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:44.658+0000 7fa40f7fe640 1 -- 172.21.15.121:0/951683251 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 46 v46) v1 ==== 76+0+1997 (secure 0 0 0) 0x7fa40002c870 con 0x7fa4180ff420 2024-08-18T22:49:44.659 INFO:teuthology.orchestra.run.smithi121.stdout:e46 2024-08-18T22:49:44.660 INFO:teuthology.orchestra.run.smithi121.stdout:btime 2024-08-18T22:49:43:280875+0000 2024-08-18T22:49:44.660 INFO:teuthology.orchestra.run.smithi121.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-08-18T22:49:44.660 INFO:teuthology.orchestra.run.smithi121.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-08-18T22:49:44.660 INFO:teuthology.orchestra.run.smithi121.stdout:legacy client fscid: 1 2024-08-18T22:49:44.660 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-08-18T22:49:44.660 INFO:teuthology.orchestra.run.smithi121.stdout:Filesystem 'cephfs' (1) 2024-08-18T22:49:44.661 INFO:teuthology.orchestra.run.smithi121.stdout:fs_name cephfs 2024-08-18T22:49:44.661 INFO:teuthology.orchestra.run.smithi121.stdout:epoch 46 2024-08-18T22:49:44.661 INFO:teuthology.orchestra.run.smithi121.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-08-18T22:49:44.661 INFO:teuthology.orchestra.run.smithi121.stdout:created 2024-08-18T22:39:04.054074+0000 2024-08-18T22:49:44.661 INFO:teuthology.orchestra.run.smithi121.stdout:modified 2024-08-18T22:49:43.280872+0000 2024-08-18T22:49:44.662 INFO:teuthology.orchestra.run.smithi121.stdout:tableserver 0 2024-08-18T22:49:44.662 INFO:teuthology.orchestra.run.smithi121.stdout:root 0 2024-08-18T22:49:44.662 INFO:teuthology.orchestra.run.smithi121.stdout:session_timeout 60 2024-08-18T22:49:44.662 INFO:teuthology.orchestra.run.smithi121.stdout:session_autoclose 300 2024-08-18T22:49:44.662 INFO:teuthology.orchestra.run.smithi121.stdout:max_file_size 1099511627776 2024-08-18T22:49:44.662 INFO:teuthology.orchestra.run.smithi121.stdout:max_xattr_size 65536 2024-08-18T22:49:44.662 INFO:teuthology.orchestra.run.smithi121.stdout:required_client_features {} 2024-08-18T22:49:44.663 INFO:teuthology.orchestra.run.smithi121.stdout:last_failure 0 2024-08-18T22:49:44.663 INFO:teuthology.orchestra.run.smithi121.stdout:last_failure_osd_epoch 84 2024-08-18T22:49:44.663 INFO:teuthology.orchestra.run.smithi121.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-08-18T22:49:44.663 INFO:teuthology.orchestra.run.smithi121.stdout:max_mds 2 2024-08-18T22:49:44.663 INFO:teuthology.orchestra.run.smithi121.stdout:in 0,1 2024-08-18T22:49:44.663 INFO:teuthology.orchestra.run.smithi121.stdout:up {0=34404,1=34436} 2024-08-18T22:49:44.663 INFO:teuthology.orchestra.run.smithi121.stdout:failed 2024-08-18T22:49:44.663 INFO:teuthology.orchestra.run.smithi121.stdout:damaged 2024-08-18T22:49:44.663 INFO:teuthology.orchestra.run.smithi121.stdout:stopped 2024-08-18T22:49:44.663 INFO:teuthology.orchestra.run.smithi121.stdout:data_pools [3] 2024-08-18T22:49:44.663 INFO:teuthology.orchestra.run.smithi121.stdout:metadata_pool 2 2024-08-18T22:49:44.663 INFO:teuthology.orchestra.run.smithi121.stdout:inline_data disabled 2024-08-18T22:49:44.664 INFO:teuthology.orchestra.run.smithi121.stdout:balancer 2024-08-18T22:49:44.664 INFO:teuthology.orchestra.run.smithi121.stdout:bal_rank_mask -1 2024-08-18T22:49:44.664 INFO:teuthology.orchestra.run.smithi121.stdout:standby_count_wanted 1 2024-08-18T22:49:44.664 INFO:teuthology.orchestra.run.smithi121.stdout:qdb_cluster leader: 34404 members: 34404,34436 2024-08-18T22:49:44.664 INFO:teuthology.orchestra.run.smithi121.stdout:[mds.cephfs.smithi121.xuzsdg{0:34404} state up:active seq 18 join_fscid=1 addr [v2:172.21.15.121:6826/4267588865,v1:172.21.15.121:6827/4267588865] compat {c=[1],r=[1],i=[1fff]}] 2024-08-18T22:49:44.664 INFO:teuthology.orchestra.run.smithi121.stdout:[mds.cephfs.smithi121.gbickb{1:34436} state up:active seq 14 join_fscid=1 addr [v2:172.21.15.121:6828/2915303436,v1:172.21.15.121:6829/2915303436] compat {c=[1],r=[1],i=[1fff]}] 2024-08-18T22:49:44.664 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-08-18T22:49:44.664 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-08-18T22:49:44.664 INFO:teuthology.orchestra.run.smithi121.stdout:Standby daemons: 2024-08-18T22:49:44.664 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-08-18T22:49:44.664 INFO:teuthology.orchestra.run.smithi121.stdout:[mds.cephfs.smithi195.buqvbr{-1:44299} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.195:6824/1574620912,v1:172.21.15.195:6825/1574620912] compat {c=[1],r=[1],i=[1fff]}] 2024-08-18T22:49:44.664 INFO:teuthology.orchestra.run.smithi121.stdout:[mds.cephfs.smithi195.nptgyc{-1:44327} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.195:6826/4050783124,v1:172.21.15.195:6827/4050783124] compat {c=[1],r=[1],i=[1fff]}] 2024-08-18T22:49:44.665 INFO:teuthology.orchestra.run.smithi121.stderr:dumped fsmap epoch 46 2024-08-18T22:49:44.665 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:44.661+0000 7fa41d1ed640 1 -- 172.21.15.121:0/951683251 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7fa40406e0b0 msgr2=0x7fa404070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:49:44.665 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:44.661+0000 7fa41d1ed640 1 --2- 172.21.15.121:0/951683251 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7fa40406e0b0 0x7fa404070560 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fa4180fc600 tx=0x7fa40800b040 comp rx=0 tx=0).stop 2024-08-18T22:49:44.665 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:44.661+0000 7fa41d1ed640 1 -- 172.21.15.121:0/951683251 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa4180ff420 msgr2=0x7fa4180fade0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:49:44.665 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:44.661+0000 7fa41d1ed640 1 --2- 172.21.15.121:0/951683251 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa4180ff420 0x7fa4180fade0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fa4000048a0 tx=0x7fa400009da0 comp rx=0 tx=0).stop 2024-08-18T22:49:44.665 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:44.661+0000 7fa41d1ed640 1 -- 172.21.15.121:0/951683251 shutdown_connections 2024-08-18T22:49:44.666 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:44.661+0000 7fa41d1ed640 1 --2- 172.21.15.121:0/951683251 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7fa40406e0b0 0x7fa404070560 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:49:44.666 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:44.661+0000 7fa41d1ed640 1 --2- 172.21.15.121:0/951683251 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa4180ff420 0x7fa4180fade0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:49:44.666 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:44.662+0000 7fa41d1ed640 1 --2- 172.21.15.121:0/951683251 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa4180659e0 0x7fa4180fc850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:49:44.666 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:44.662+0000 7fa41d1ed640 1 -- 172.21.15.121:0/951683251 >> 172.21.15.121:0/951683251 conn(0x7fa4180f69b0 msgr2=0x7fa4180f6d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:49:44.666 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:44.662+0000 7fa41d1ed640 1 -- 172.21.15.121:0/951683251 shutdown_connections 2024-08-18T22:49:44.666 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:44.662+0000 7fa41d1ed640 1 -- 172.21.15.121:0/951683251 wait complete. 2024-08-18T22:49:44.794 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:44.793+0000 7fe17ef37640 1 -- 172.21.15.121:0/2190186985 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe1780fb1d0 msgr2=0x7fe1780fb5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:49:44.794 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:44.793+0000 7fe17ef37640 1 --2- 172.21.15.121:0/2190186985 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe1780fb1d0 0x7fe1780fb5e0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fe16c0048d0 tx=0x7fe16c009da0 comp rx=0 tx=0).stop 2024-08-18T22:49:44.794 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:44.793+0000 7fe17ef37640 1 -- 172.21.15.121:0/2190186985 shutdown_connections 2024-08-18T22:49:44.795 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:44.793+0000 7fe17ef37640 1 --2- 172.21.15.121:0/2190186985 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe1780fc4a0 0x7fe1780fc910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:49:44.795 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:44.793+0000 7fe17ef37640 1 --2- 172.21.15.121:0/2190186985 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe1780fb1d0 0x7fe1780fb5e0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:49:44.795 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:44.793+0000 7fe17ef37640 1 -- 172.21.15.121:0/2190186985 >> 172.21.15.121:0/2190186985 conn(0x7fe1780f69b0 msgr2=0x7fe1780f8dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:49:44.795 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:44.793+0000 7fe17ef37640 1 -- 172.21.15.121:0/2190186985 shutdown_connections 2024-08-18T22:49:44.795 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:44.793+0000 7fe17ef37640 1 -- 172.21.15.121:0/2190186985 wait complete. 2024-08-18T22:49:44.795 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:44.794+0000 7fe17ef37640 1 Processor -- start 2024-08-18T22:49:44.795 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:44.794+0000 7fe17ef37640 1 -- start start 2024-08-18T22:49:44.796 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:44.795+0000 7fe17ef37640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe1780fb1d0 0x7fe178113400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:49:44.796 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:44.795+0000 7fe17ef37640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe1780fc4a0 0x7fe178113940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:49:44.796 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:44.795+0000 7fe17ccd3640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe1780fb1d0 0x7fe178113400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:49:44.797 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:44.795+0000 7fe17ccd3640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe1780fb1d0 0x7fe178113400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.121:46610/0 (socket says 172.21.15.121:46610) 2024-08-18T22:49:44.797 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:44.795+0000 7fe177fff640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe1780fc4a0 0x7fe178113940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:49:44.797 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:44.795+0000 7fe177fff640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe1780fc4a0 0x7fe178113940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:36086/0 (socket says 172.21.15.121:36086) 2024-08-18T22:49:44.797 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:44.795+0000 7fe17ccd3640 1 -- 172.21.15.121:0/2580153163 learned_addr learned my addr 172.21.15.121:0/2580153163 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-18T22:49:44.797 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:44.795+0000 7fe17ef37640 1 -- 172.21.15.121:0/2580153163 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe178113f90 con 0x7fe1780fc4a0 2024-08-18T22:49:44.797 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:44.795+0000 7fe17ef37640 1 -- 172.21.15.121:0/2580153163 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1781147b0 con 0x7fe1780fb1d0 2024-08-18T22:49:44.798 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:44.796+0000 7fe17ccd3640 1 -- 172.21.15.121:0/2580153163 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe1780fc4a0 msgr2=0x7fe178113940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:49:44.798 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:44.796+0000 7fe17ccd3640 1 --2- 172.21.15.121:0/2580153163 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe1780fc4a0 0x7fe178113940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:49:44.798 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:44.796+0000 7fe17ccd3640 1 -- 172.21.15.121:0/2580153163 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe16c005040 con 0x7fe1780fb1d0 2024-08-18T22:49:44.798 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:44.796+0000 7fe17ccd3640 1 --2- 172.21.15.121:0/2580153163 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe1780fb1d0 0x7fe178113400 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fe16c0043d0 tx=0x7fe16c009da0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:49:44.798 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:44.796+0000 7fe1757fa640 1 -- 172.21.15.121:0/2580153163 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe16c038070 con 0x7fe1780fb1d0 2024-08-18T22:49:44.798 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:44.797+0000 7fe1757fa640 1 -- 172.21.15.121:0/2580153163 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fe16c02ae90 con 0x7fe1780fb1d0 2024-08-18T22:49:44.798 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:44.797+0000 7fe1757fa640 1 -- 172.21.15.121:0/2580153163 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe16c03e670 con 0x7fe1780fb1d0 2024-08-18T22:49:44.798 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:44.797+0000 7fe17ef37640 1 -- 172.21.15.121:0/2580153163 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1781149e0 con 0x7fe1780fb1d0 2024-08-18T22:49:44.798 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:44.797+0000 7fe17ef37640 1 -- 172.21.15.121:0/2580153163 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe178114f80 con 0x7fe1780fb1d0 2024-08-18T22:49:44.800 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:44.799+0000 7fe17ef37640 1 -- 172.21.15.121:0/2580153163 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1780fa630 con 0x7fe1780fb1d0 2024-08-18T22:49:44.800 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:44.799+0000 7fe1757fa640 1 -- 172.21.15.121:0/2580153163 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 37) v1 ==== 92205+0+0 (secure 0 0 0) 0x7fe16c030020 con 0x7fe1780fb1d0 2024-08-18T22:49:44.801 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:44.800+0000 7fe1757fa640 1 --2- 172.21.15.121:0/2580153163 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7fe16006e1c0 0x7fe160070670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:49:44.801 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:44.800+0000 7fe1757fa640 1 -- 172.21.15.121:0/2580153163 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6668+0+0 (secure 0 0 0) 0x7fe16c0add70 con 0x7fe1780fb1d0 2024-08-18T22:49:44.802 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:44.801+0000 7fe177fff640 1 --2- 172.21.15.121:0/2580153163 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7fe16006e1c0 0x7fe160070670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:49:44.802 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:44.801+0000 7fe177fff640 1 --2- 172.21.15.121:0/2580153163 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7fe16006e1c0 0x7fe160070670 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fe1781131b0 tx=0x7fe16800b040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:49:44.809 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:44.808+0000 7fe1757fa640 1 -- 172.21.15.121:0/2580153163 <== mon.1 v2:172.21.15.195:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7fe16c0b2070 con 0x7fe1780fb1d0 2024-08-18T22:49:45.034 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:45.033+0000 7fe17ef37640 1 -- 172.21.15.121:0/2580153163 --> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fe178115300 con 0x7fe16006e1c0 2024-08-18T22:49:45.035 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:49:44 smithi121 ceph-mon[81053]: from='client.34474 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-18T22:49:45.035 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:49:44 smithi121 ceph-mon[81053]: from='client.34478 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-18T22:49:45.035 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:49:44 smithi121 ceph-mon[81053]: from='client.? 172.21.15.121:0/1425054720' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-08-18T22:49:45.036 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:45.035+0000 7fe1757fa640 1 -- 172.21.15.121:0/2580153163 <== mgr.34102 v2:172.21.15.121:6800/3037387239 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+441 (secure 0 0 0) 0x7fe178115300 con 0x7fe16006e1c0 2024-08-18T22:49:45.036 INFO:teuthology.orchestra.run.smithi121.stdout:{ 2024-08-18T22:49:45.036 INFO:teuthology.orchestra.run.smithi121.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9", 2024-08-18T22:49:45.036 INFO:teuthology.orchestra.run.smithi121.stdout: "in_progress": true, 2024-08-18T22:49:45.036 INFO:teuthology.orchestra.run.smithi121.stdout: "which": "Upgrading all daemon types on all hosts", 2024-08-18T22:49:45.037 INFO:teuthology.orchestra.run.smithi121.stdout: "services_complete": [ 2024-08-18T22:49:45.037 INFO:teuthology.orchestra.run.smithi121.stdout: "mon", 2024-08-18T22:49:45.037 INFO:teuthology.orchestra.run.smithi121.stdout: "osd", 2024-08-18T22:49:45.037 INFO:teuthology.orchestra.run.smithi121.stdout: "mgr", 2024-08-18T22:49:45.037 INFO:teuthology.orchestra.run.smithi121.stdout: "crash", 2024-08-18T22:49:45.037 INFO:teuthology.orchestra.run.smithi121.stdout: "mds" 2024-08-18T22:49:45.037 INFO:teuthology.orchestra.run.smithi121.stdout: ], 2024-08-18T22:49:45.037 INFO:teuthology.orchestra.run.smithi121.stdout: "progress": "16/21 daemons upgraded", 2024-08-18T22:49:45.037 INFO:teuthology.orchestra.run.smithi121.stdout: "message": "Currently upgrading node-exporter daemons", 2024-08-18T22:49:45.037 INFO:teuthology.orchestra.run.smithi121.stdout: "is_paused": false 2024-08-18T22:49:45.037 INFO:teuthology.orchestra.run.smithi121.stdout:} 2024-08-18T22:49:45.038 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:45.037+0000 7fe17ef37640 1 -- 172.21.15.121:0/2580153163 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7fe16006e1c0 msgr2=0x7fe160070670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:49:45.039 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:45.037+0000 7fe17ef37640 1 --2- 172.21.15.121:0/2580153163 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7fe16006e1c0 0x7fe160070670 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fe1781131b0 tx=0x7fe16800b040 comp rx=0 tx=0).stop 2024-08-18T22:49:45.039 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:45.037+0000 7fe17ef37640 1 -- 172.21.15.121:0/2580153163 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe1780fb1d0 msgr2=0x7fe178113400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:49:45.039 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:45.037+0000 7fe17ef37640 1 --2- 172.21.15.121:0/2580153163 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe1780fb1d0 0x7fe178113400 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fe16c0043d0 tx=0x7fe16c009da0 comp rx=0 tx=0).stop 2024-08-18T22:49:45.039 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:45.038+0000 7fe17ef37640 1 -- 172.21.15.121:0/2580153163 shutdown_connections 2024-08-18T22:49:45.039 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:45.038+0000 7fe17ef37640 1 --2- 172.21.15.121:0/2580153163 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7fe16006e1c0 0x7fe160070670 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:49:45.039 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:45.038+0000 7fe17ef37640 1 --2- 172.21.15.121:0/2580153163 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe1780fc4a0 0x7fe178113940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:49:45.039 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:45.038+0000 7fe17ef37640 1 --2- 172.21.15.121:0/2580153163 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe1780fb1d0 0x7fe178113400 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:49:45.039 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:45.038+0000 7fe17ef37640 1 -- 172.21.15.121:0/2580153163 >> 172.21.15.121:0/2580153163 conn(0x7fe1780f69b0 msgr2=0x7fe1780f8180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:49:45.039 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:45.038+0000 7fe17ef37640 1 -- 172.21.15.121:0/2580153163 shutdown_connections 2024-08-18T22:49:45.039 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:45.038+0000 7fe17ef37640 1 -- 172.21.15.121:0/2580153163 wait complete. 2024-08-18T22:49:45.131 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:45.129+0000 7f23263f0640 1 -- 172.21.15.121:0/3659000424 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f23200ff480 msgr2=0x7f2320101860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:49:45.131 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:45.129+0000 7f23263f0640 1 --2- 172.21.15.121:0/3659000424 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f23200ff480 0x7f2320101860 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f23140048d0 tx=0x7f2314009da0 comp rx=0 tx=0).stop 2024-08-18T22:49:45.131 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:45.129+0000 7f23263f0640 1 -- 172.21.15.121:0/3659000424 shutdown_connections 2024-08-18T22:49:45.131 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:45.129+0000 7f23263f0640 1 --2- 172.21.15.121:0/3659000424 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f23200ff480 0x7f2320101860 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:49:45.131 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:45.129+0000 7f23263f0640 1 --2- 172.21.15.121:0/3659000424 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2320065980 0x7f23200fef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:49:45.131 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:45.129+0000 7f23263f0640 1 -- 172.21.15.121:0/3659000424 >> 172.21.15.121:0/3659000424 conn(0x7f23200f69b0 msgr2=0x7f23200f8dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:49:45.131 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:45.130+0000 7f23263f0640 1 -- 172.21.15.121:0/3659000424 shutdown_connections 2024-08-18T22:49:45.132 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:45.130+0000 7f23263f0640 1 -- 172.21.15.121:0/3659000424 wait complete. 2024-08-18T22:49:45.132 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:45.130+0000 7f23263f0640 1 Processor -- start 2024-08-18T22:49:45.133 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:45.130+0000 7f23263f0640 1 -- start start 2024-08-18T22:49:45.133 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:45.131+0000 7f23263f0640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2320065980 0x7f23200fc950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:49:45.133 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:45.131+0000 7f23263f0640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f23200ff480 0x7f23200fae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:49:45.133 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:45.131+0000 7f23263f0640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23200fb3d0 con 0x7f2320065980 2024-08-18T22:49:45.133 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:45.131+0000 7f23263f0640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23200fb510 con 0x7f23200ff480 2024-08-18T22:49:45.134 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:45.131+0000 7f231ffff640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2320065980 0x7f23200fc950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:49:45.134 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:45.131+0000 7f231ffff640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2320065980 0x7f23200fc950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:36098/0 (socket says 172.21.15.121:36098) 2024-08-18T22:49:45.134 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:45.131+0000 7f231ffff640 1 -- 172.21.15.121:0/1620601244 learned_addr learned my addr 172.21.15.121:0/1620601244 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-18T22:49:45.134 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:45.131+0000 7f231f7fe640 1 --2- 172.21.15.121:0/1620601244 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f23200ff480 0x7f23200fae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:49:45.134 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:45.131+0000 7f231ffff640 1 -- 172.21.15.121:0/1620601244 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f23200ff480 msgr2=0x7f23200fae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:49:45.134 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:45.131+0000 7f231ffff640 1 --2- 172.21.15.121:0/1620601244 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f23200ff480 0x7f23200fae40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:49:45.134 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:45.131+0000 7f231ffff640 1 -- 172.21.15.121:0/1620601244 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2314005040 con 0x7f2320065980 2024-08-18T22:49:45.134 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:45.131+0000 7f231ffff640 1 --2- 172.21.15.121:0/1620601244 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2320065980 0x7f23200fc950 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f231000eb70 tx=0x7f231000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:49:45.134 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:45.131+0000 7f231cff9640 1 -- 172.21.15.121:0/1620601244 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2310007c30 con 0x7f2320065980 2024-08-18T22:49:45.134 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:45.131+0000 7f231cff9640 1 -- 172.21.15.121:0/1620601244 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f231000f040 con 0x7f2320065980 2024-08-18T22:49:45.134 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:45.131+0000 7f23263f0640 1 -- 172.21.15.121:0/1620601244 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23200fb7f0 con 0x7f2320065980 2024-08-18T22:49:45.134 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:45.132+0000 7f231cff9640 1 -- 172.21.15.121:0/1620601244 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f231000caa0 con 0x7f2320065980 2024-08-18T22:49:45.134 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:45.132+0000 7f23263f0640 1 -- 172.21.15.121:0/1620601244 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2320114e40 con 0x7f2320065980 2024-08-18T22:49:45.135 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:45.133+0000 7f23263f0640 1 -- 172.21.15.121:0/1620601244 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23200fa630 con 0x7f2320065980 2024-08-18T22:49:45.135 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:45.133+0000 7f231cff9640 1 -- 172.21.15.121:0/1620601244 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 37) v1 ==== 92205+0+0 (secure 0 0 0) 0x7f2310009110 con 0x7f2320065980 2024-08-18T22:49:45.135 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:45.134+0000 7f231cff9640 1 --2- 172.21.15.121:0/1620601244 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f230806e0b0 0x7f2308070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:49:45.136 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:45.134+0000 7f231cff9640 1 -- 172.21.15.121:0/1620601244 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6668+0+0 (secure 0 0 0) 0x7f231008df10 con 0x7f2320065980 2024-08-18T22:49:45.136 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:45.134+0000 7f231f7fe640 1 --2- 172.21.15.121:0/1620601244 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f230806e0b0 0x7f2308070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:49:45.136 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:45.134+0000 7f231f7fe640 1 --2- 172.21.15.121:0/1620601244 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f230806e0b0 0x7f2308070560 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f2314009ac0 tx=0x7f2314035040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:49:45.139 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:45.138+0000 7f231cff9640 1 -- 172.21.15.121:0/1620601244 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f2310057190 con 0x7f2320065980 2024-08-18T22:49:45.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:49:44 smithi195 ceph-mon[68841]: from='client.34474 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-18T22:49:45.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:49:44 smithi195 ceph-mon[68841]: from='client.34478 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-18T22:49:45.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:49:44 smithi195 ceph-mon[68841]: from='client.? 172.21.15.121:0/1425054720' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-08-18T22:49:45.427 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:45.426+0000 7f23263f0640 1 -- 172.21.15.121:0/1620601244 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f232004b4c0 con 0x7f2320065980 2024-08-18T22:49:45.427 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:45.427+0000 7f231cff9640 1 -- 172.21.15.121:0/1620601244 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f231005a850 con 0x7f2320065980 2024-08-18T22:49:45.428 INFO:teuthology.orchestra.run.smithi121.stdout:HEALTH_OK 2024-08-18T22:49:45.430 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:45.429+0000 7f23263f0640 1 -- 172.21.15.121:0/1620601244 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f230806e0b0 msgr2=0x7f2308070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:49:45.430 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:45.429+0000 7f23263f0640 1 --2- 172.21.15.121:0/1620601244 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f230806e0b0 0x7f2308070560 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f2314009ac0 tx=0x7f2314035040 comp rx=0 tx=0).stop 2024-08-18T22:49:45.430 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:45.429+0000 7f23263f0640 1 -- 172.21.15.121:0/1620601244 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2320065980 msgr2=0x7f23200fc950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:49:45.431 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:45.429+0000 7f23263f0640 1 --2- 172.21.15.121:0/1620601244 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2320065980 0x7f23200fc950 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f231000eb70 tx=0x7f231000b040 comp rx=0 tx=0).stop 2024-08-18T22:49:45.431 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:45.429+0000 7f23263f0640 1 -- 172.21.15.121:0/1620601244 shutdown_connections 2024-08-18T22:49:45.431 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:45.429+0000 7f23263f0640 1 --2- 172.21.15.121:0/1620601244 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f230806e0b0 0x7f2308070560 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:49:45.431 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:45.429+0000 7f23263f0640 1 --2- 172.21.15.121:0/1620601244 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f23200ff480 0x7f23200fae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:49:45.431 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:45.429+0000 7f23263f0640 1 --2- 172.21.15.121:0/1620601244 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2320065980 0x7f23200fc950 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:49:45.431 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:45.429+0000 7f23263f0640 1 -- 172.21.15.121:0/1620601244 >> 172.21.15.121:0/1620601244 conn(0x7f23200f69b0 msgr2=0x7f23200f6d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:49:45.431 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:45.429+0000 7f23263f0640 1 -- 172.21.15.121:0/1620601244 shutdown_connections 2024-08-18T22:49:45.431 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:49:45.429+0000 7f23263f0640 1 -- 172.21.15.121:0/1620601244 wait complete. 2024-08-18T22:49:45.833 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:49:45 smithi121 ceph-mon[81053]: from='client.34482 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-18T22:49:45.833 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:49:45 smithi121 ceph-mon[81053]: pgmap v220: 65 pgs: 65 active+clean; 173 MiB data, 809 MiB used, 536 GiB / 536 GiB avail; 32 KiB/s rd, 1.4 MiB/s wr, 313 op/s 2024-08-18T22:49:45.833 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:49:45 smithi121 ceph-mon[81053]: from='client.? 172.21.15.121:0/951683251' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-08-18T22:49:45.833 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:49:45 smithi121 ceph-mon[81053]: from='client.? 172.21.15.121:0/1620601244' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-08-18T22:49:46.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:49:45 smithi195 ceph-mon[68841]: from='client.34482 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-18T22:49:46.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:49:45 smithi195 ceph-mon[68841]: pgmap v220: 65 pgs: 65 active+clean; 173 MiB data, 809 MiB used, 536 GiB / 536 GiB avail; 32 KiB/s rd, 1.4 MiB/s wr, 313 op/s 2024-08-18T22:49:46.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:49:45 smithi195 ceph-mon[68841]: from='client.? 172.21.15.121:0/951683251' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-08-18T22:49:46.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:49:45 smithi195 ceph-mon[68841]: from='client.? 172.21.15.121:0/1620601244' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-08-18T22:49:47.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:49:46 smithi121 ceph-mon[81053]: from='client.44347 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-18T22:49:47.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:49:46 smithi195 ceph-mon[68841]: from='client.44347 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-18T22:49:48.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:49:47 smithi121 ceph-mon[81053]: pgmap v221: 65 pgs: 65 active+clean; 172 MiB data, 816 MiB used, 536 GiB / 536 GiB avail; 45 KiB/s rd, 1.4 MiB/s wr, 336 op/s 2024-08-18T22:49:48.158 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:49:47 smithi195 ceph-mon[68841]: pgmap v221: 65 pgs: 65 active+clean; 172 MiB data, 816 MiB used, 536 GiB / 536 GiB avail; 45 KiB/s rd, 1.4 MiB/s wr, 336 op/s 2024-08-18T22:49:50.077 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:49:49 smithi121 ceph-mon[81053]: pgmap v222: 65 pgs: 65 active+clean; 170 MiB data, 817 MiB used, 536 GiB / 536 GiB avail; 34 KiB/s rd, 923 KiB/s wr, 329 op/s 2024-08-18T22:49:50.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:49:49 smithi195 ceph-mon[68841]: pgmap v222: 65 pgs: 65 active+clean; 170 MiB data, 817 MiB used, 536 GiB / 536 GiB avail; 34 KiB/s rd, 923 KiB/s wr, 329 op/s 2024-08-18T22:49:50.833 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:49:50 smithi121 ceph-mon[81053]: Upgrade: Updating node-exporter.smithi121 (1/2) 2024-08-18T22:49:50.833 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:49:50 smithi121 ceph-mon[81053]: Deploying daemon node-exporter.smithi121 on smithi121 2024-08-18T22:49:51.060 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:49:50 smithi195 ceph-mon[68841]: Upgrade: Updating node-exporter.smithi121 (1/2) 2024-08-18T22:49:51.060 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:49:50 smithi195 ceph-mon[68841]: Deploying daemon node-exporter.smithi121 on smithi121 2024-08-18T22:49:51.833 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:49:51 smithi121 ceph-mon[81053]: pgmap v223: 65 pgs: 65 active+clean; 171 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 45 KiB/s rd, 1.2 MiB/s wr, 321 op/s 2024-08-18T22:49:52.113 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:49:51 smithi195 ceph-mon[68841]: pgmap v223: 65 pgs: 65 active+clean; 171 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 45 KiB/s rd, 1.2 MiB/s wr, 321 op/s 2024-08-18T22:49:53.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:49:52 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:49:53.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:49:52 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:49:53.154 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:49:52 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:49:53.154 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:49:52 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:49:53.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:49:53 smithi195 ceph-mon[68841]: pgmap v224: 65 pgs: 65 active+clean; 172 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 31 KiB/s rd, 1.5 MiB/s wr, 362 op/s 2024-08-18T22:49:53.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:49:53 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-18T22:49:54.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:49:53 smithi121 ceph-mon[81053]: pgmap v224: 65 pgs: 65 active+clean; 172 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 31 KiB/s rd, 1.5 MiB/s wr, 362 op/s 2024-08-18T22:49:54.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:49:53 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-18T22:49:54.980 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:49:54 smithi195 ceph-mon[68841]: Upgrade: Updating node-exporter.smithi195 (2/2) 2024-08-18T22:49:54.980 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:49:54 smithi195 ceph-mon[68841]: Deploying daemon node-exporter.smithi195 on smithi195 2024-08-18T22:49:55.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:49:54 smithi121 ceph-mon[81053]: Upgrade: Updating node-exporter.smithi195 (2/2) 2024-08-18T22:49:55.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:49:54 smithi121 ceph-mon[81053]: Deploying daemon node-exporter.smithi195 on smithi195 2024-08-18T22:49:55.397 INFO:tasks.workunit:Stopping ['suites/fsstress.sh'] on client.0... 2024-08-18T22:49:55.398 DEBUG:teuthology.orchestra.run.smithi121:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-08-18T22:49:55.775 DEBUG:teuthology.parallel:result is None 2024-08-18T22:49:55.775 DEBUG:teuthology.orchestra.run.smithi121:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-08-18T22:49:55.814 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-08-18T22:49:55.814 DEBUG:teuthology.orchestra.run.smithi195:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.1/client.1 2024-08-18T22:49:55.849 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.1/client.1 2024-08-18T22:49:55.849 DEBUG:teuthology.parallel:result is None 2024-08-18T22:49:55.967 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:49:55 smithi195 ceph-mon[68841]: pgmap v225: 65 pgs: 65 active+clean; 170 MiB data, 839 MiB used, 536 GiB / 536 GiB avail; 31 KiB/s rd, 1.2 MiB/s wr, 277 op/s 2024-08-18T22:49:56.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:49:55 smithi121 ceph-mon[81053]: pgmap v225: 65 pgs: 65 active+clean; 170 MiB data, 839 MiB used, 536 GiB / 536 GiB avail; 31 KiB/s rd, 1.2 MiB/s wr, 277 op/s 2024-08-18T22:49:57.333 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:49:57 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:49:57.333 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:49:57 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:49:57.333 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:49:57 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-18T22:49:57.334 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:49:57 smithi121 ceph-mon[81053]: pgmap v226: 65 pgs: 65 active+clean; 168 MiB data, 809 MiB used, 536 GiB / 536 GiB avail; 40 KiB/s rd, 898 KiB/s wr, 275 op/s 2024-08-18T22:49:57.409 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:49:57 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:49:57.409 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:49:57 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:49:57.409 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:49:57 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-18T22:49:57.409 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:49:57 smithi195 ceph-mon[68841]: pgmap v226: 65 pgs: 65 active+clean; 168 MiB data, 809 MiB used, 536 GiB / 536 GiB avail; 40 KiB/s rd, 898 KiB/s wr, 275 op/s 2024-08-18T22:49:59.545 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:49:59 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:49:59.545 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:49:59 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:49:59.545 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:49:59 smithi195 ceph-mon[68841]: pgmap v227: 65 pgs: 65 active+clean; 167 MiB data, 792 MiB used, 536 GiB / 536 GiB avail; 26 KiB/s rd, 1.1 MiB/s wr, 288 op/s 2024-08-18T22:49:59.546 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:49:59 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:49:59.546 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:49:59 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:49:59.584 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:49:59 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:49:59.584 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:49:59 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:49:59.584 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:49:59 smithi121 ceph-mon[81053]: pgmap v227: 65 pgs: 65 active+clean; 167 MiB data, 792 MiB used, 536 GiB / 536 GiB avail; 26 KiB/s rd, 1.1 MiB/s wr, 288 op/s 2024-08-18T22:49:59.584 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:49:59 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:49:59.584 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:49:59 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:50:00.409 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:50:00 smithi195 ceph-mon[68841]: overall HEALTH_OK 2024-08-18T22:50:00.583 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:50:00 smithi121 ceph-mon[81053]: overall HEALTH_OK 2024-08-18T22:50:01.409 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:50:01 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:50:01.409 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:50:01 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:50:01.409 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:50:01 smithi195 ceph-mon[68841]: pgmap v228: 65 pgs: 65 active+clean; 164 MiB data, 789 MiB used, 536 GiB / 536 GiB avail; 32 KiB/s rd, 1.1 MiB/s wr, 270 op/s 2024-08-18T22:50:01.409 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:50:01 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:50:01.409 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:50:01 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:50:01.619 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:50:01 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:50:01.619 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:50:01 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:50:01.619 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:50:01 smithi121 ceph-mon[81053]: pgmap v228: 65 pgs: 65 active+clean; 164 MiB data, 789 MiB used, 536 GiB / 536 GiB avail; 32 KiB/s rd, 1.1 MiB/s wr, 270 op/s 2024-08-18T22:50:01.619 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:50:01 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:50:01.619 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:50:01 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:50:03.053 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:50:02 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:50:03.053 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:50:02 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:50:03.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:50:02 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:50:03.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:50:02 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:50:03.884 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:50:03 smithi121 ceph-mon[81053]: pgmap v229: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail; 20 KiB/s rd, 883 KiB/s wr, 258 op/s 2024-08-18T22:50:04.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:50:03 smithi195 ceph-mon[68841]: pgmap v229: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail; 20 KiB/s rd, 883 KiB/s wr, 258 op/s 2024-08-18T22:50:06.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:50:05 smithi121 ceph-mon[81053]: pgmap v230: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail; 20 KiB/s rd, 393 KiB/s wr, 164 op/s 2024-08-18T22:50:06.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:50:05 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:50:06.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:50:05 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:50:06.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:50:05 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:50:06.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:50:05 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-18T22:50:06.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:50:05 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:50:06.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:50:05 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-18T22:50:06.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:50:05 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "versions"}]: dispatch 2024-08-18T22:50:06.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:50:05 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "versions"}]: dispatch 2024-08-18T22:50:06.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:50:05 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "versions"}]: dispatch 2024-08-18T22:50:06.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:50:05 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "versions"}]: dispatch 2024-08-18T22:50:06.085 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:50:05 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "versions"}]: dispatch 2024-08-18T22:50:06.085 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:50:05 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "versions"}]: dispatch 2024-08-18T22:50:06.085 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:50:05 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "versions"}]: dispatch 2024-08-18T22:50:06.085 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:50:05 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "versions"}]: dispatch 2024-08-18T22:50:06.085 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:50:05 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "versions"}]: dispatch 2024-08-18T22:50:06.085 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:50:05 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "versions"}]: dispatch 2024-08-18T22:50:06.085 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:50:05 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "versions"}]: dispatch 2024-08-18T22:50:06.085 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:50:05 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "versions"}]: dispatch 2024-08-18T22:50:06.085 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:50:05 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "versions"}]: dispatch 2024-08-18T22:50:06.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:50:05 smithi195 ceph-mon[68841]: pgmap v230: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail; 20 KiB/s rd, 393 KiB/s wr, 164 op/s 2024-08-18T22:50:06.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:50:05 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:50:06.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:50:05 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:50:06.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:50:05 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:50:06.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:50:05 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-18T22:50:06.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:50:05 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:50:06.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:50:05 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-18T22:50:06.160 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:50:05 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "versions"}]: dispatch 2024-08-18T22:50:06.160 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:50:05 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "versions"}]: dispatch 2024-08-18T22:50:06.160 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:50:05 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "versions"}]: dispatch 2024-08-18T22:50:06.160 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:50:05 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "versions"}]: dispatch 2024-08-18T22:50:06.160 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:50:05 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "versions"}]: dispatch 2024-08-18T22:50:06.160 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:50:05 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "versions"}]: dispatch 2024-08-18T22:50:06.160 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:50:05 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "versions"}]: dispatch 2024-08-18T22:50:06.160 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:50:05 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "versions"}]: dispatch 2024-08-18T22:50:06.160 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:50:05 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "versions"}]: dispatch 2024-08-18T22:50:06.160 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:50:05 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "versions"}]: dispatch 2024-08-18T22:50:06.160 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:50:05 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "versions"}]: dispatch 2024-08-18T22:50:06.160 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:50:05 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "versions"}]: dispatch 2024-08-18T22:50:06.160 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:50:05 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "versions"}]: dispatch 2024-08-18T22:50:07.833 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:50:07 smithi121 ceph-mon[81053]: Upgrade: Updating prometheus.smithi121 2024-08-18T22:50:07.834 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:50:07 smithi121 ceph-mon[81053]: Deploying daemon prometheus.smithi121 on smithi121 2024-08-18T22:50:07.834 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:50:07 smithi121 ceph-mon[81053]: pgmap v231: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail; 20 KiB/s rd, 394 KiB/s wr, 148 op/s 2024-08-18T22:50:08.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:50:07 smithi195 ceph-mon[68841]: Upgrade: Updating prometheus.smithi121 2024-08-18T22:50:08.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:50:07 smithi195 ceph-mon[68841]: Deploying daemon prometheus.smithi121 on smithi121 2024-08-18T22:50:08.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:50:07 smithi195 ceph-mon[68841]: pgmap v231: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail; 20 KiB/s rd, 394 KiB/s wr, 148 op/s 2024-08-18T22:50:09.032 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:50:08 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-18T22:50:09.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:50:08 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-18T22:50:09.982 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:50:09 smithi121 ceph-mon[81053]: pgmap v232: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail; 7.9 KiB/s rd, 263 KiB/s wr, 108 op/s 2024-08-18T22:50:10.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:50:09 smithi195 ceph-mon[68841]: pgmap v232: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail; 7.9 KiB/s rd, 263 KiB/s wr, 108 op/s 2024-08-18T22:50:12.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:50:11 smithi121 ceph-mon[81053]: pgmap v233: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail; 7.9 KiB/s rd, 53 KiB/s wr, 56 op/s 2024-08-18T22:50:12.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:50:11 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:50:12.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:50:11 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:50:12.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:50:11 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-18T22:50:12.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:50:11 smithi195 ceph-mon[68841]: pgmap v233: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail; 7.9 KiB/s rd, 53 KiB/s wr, 56 op/s 2024-08-18T22:50:12.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:50:11 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:50:12.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:50:11 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:50:12.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:50:11 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-18T22:50:13.833 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:50:13 smithi121 ceph-mon[81053]: pgmap v234: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail; 170 B/s rd, 45 KiB/s wr, 28 op/s 2024-08-18T22:50:14.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:50:13 smithi195 ceph-mon[68841]: pgmap v234: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail; 170 B/s rd, 45 KiB/s wr, 28 op/s 2024-08-18T22:50:15.527 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:15.522+0000 7fbbed538640 1 -- 172.21.15.121:0/1159671606 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbbe80fc2e0 msgr2=0x7fbbe80fc6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:50:15.527 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:15.522+0000 7fbbed538640 1 --2- 172.21.15.121:0/1159671606 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbbe80fc2e0 0x7fbbe80fc6f0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fbbd80048d0 tx=0x7fbbd8009da0 comp rx=0 tx=0).stop 2024-08-18T22:50:15.527 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:15.522+0000 7fbbed538640 1 -- 172.21.15.121:0/1159671606 shutdown_connections 2024-08-18T22:50:15.527 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:15.522+0000 7fbbed538640 1 --2- 172.21.15.121:0/1159671606 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbbe80fd5b0 0x7fbbe80fda20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:50:15.527 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:15.522+0000 7fbbed538640 1 --2- 172.21.15.121:0/1159671606 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbbe80fc2e0 0x7fbbe80fc6f0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:50:15.527 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:15.522+0000 7fbbed538640 1 -- 172.21.15.121:0/1159671606 >> 172.21.15.121:0/1159671606 conn(0x7fbbe80f7aa0 msgr2=0x7fbbe80f9ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:50:15.527 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:15.522+0000 7fbbed538640 1 -- 172.21.15.121:0/1159671606 shutdown_connections 2024-08-18T22:50:15.528 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:15.522+0000 7fbbed538640 1 -- 172.21.15.121:0/1159671606 wait complete. 2024-08-18T22:50:15.528 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:15.523+0000 7fbbed538640 1 Processor -- start 2024-08-18T22:50:15.528 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:15.523+0000 7fbbed538640 1 -- start start 2024-08-18T22:50:15.528 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:15.523+0000 7fbbed538640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbbe80fc2e0 0x7fbbe8071310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:50:15.528 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:15.523+0000 7fbbed538640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbbe80fd5b0 0x7fbbe806f800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:50:15.528 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:15.523+0000 7fbbed538640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbe806fd90 con 0x7fbbe80fc2e0 2024-08-18T22:50:15.528 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:15.523+0000 7fbbed538640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbe806fed0 con 0x7fbbe80fd5b0 2024-08-18T22:50:15.528 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:15.523+0000 7fbbe6ffd640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbbe80fc2e0 0x7fbbe8071310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:50:15.528 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:15.523+0000 7fbbe6ffd640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbbe80fc2e0 0x7fbbe8071310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:60732/0 (socket says 172.21.15.121:60732) 2024-08-18T22:50:15.528 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:15.523+0000 7fbbe6ffd640 1 -- 172.21.15.121:0/2106361453 learned_addr learned my addr 172.21.15.121:0/2106361453 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-18T22:50:15.528 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:15.524+0000 7fbbe67fc640 1 --2- 172.21.15.121:0/2106361453 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbbe80fd5b0 0x7fbbe806f800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:50:15.528 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:15.524+0000 7fbbe6ffd640 1 -- 172.21.15.121:0/2106361453 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbbe80fd5b0 msgr2=0x7fbbe806f800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:50:15.528 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:15.524+0000 7fbbe6ffd640 1 --2- 172.21.15.121:0/2106361453 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbbe80fd5b0 0x7fbbe806f800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:50:15.528 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:15.524+0000 7fbbe6ffd640 1 -- 172.21.15.121:0/2106361453 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbd8005040 con 0x7fbbe80fc2e0 2024-08-18T22:50:15.529 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:15.524+0000 7fbbe6ffd640 1 --2- 172.21.15.121:0/2106361453 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbbe80fc2e0 0x7fbbe8071310 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fbbd8003080 tx=0x7fbbd8009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:50:15.529 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:15.524+0000 7fbbcf7fe640 1 -- 172.21.15.121:0/2106361453 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbbd8038070 con 0x7fbbe80fc2e0 2024-08-18T22:50:15.529 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:15.524+0000 7fbbcf7fe640 1 -- 172.21.15.121:0/2106361453 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fbbd802abd0 con 0x7fbbe80fc2e0 2024-08-18T22:50:15.529 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:15.524+0000 7fbbed538640 1 -- 172.21.15.121:0/2106361453 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbbe8070150 con 0x7fbbe80fc2e0 2024-08-18T22:50:15.529 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:15.524+0000 7fbbcf7fe640 1 -- 172.21.15.121:0/2106361453 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbbd803e670 con 0x7fbbe80fc2e0 2024-08-18T22:50:15.529 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:15.524+0000 7fbbed538640 1 -- 172.21.15.121:0/2106361453 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbbe8114e50 con 0x7fbbe80fc2e0 2024-08-18T22:50:15.530 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:15.525+0000 7fbbed538640 1 -- 172.21.15.121:0/2106361453 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbbe80fb740 con 0x7fbbe80fc2e0 2024-08-18T22:50:15.530 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:15.526+0000 7fbbcf7fe640 1 -- 172.21.15.121:0/2106361453 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 37) v1 ==== 92205+0+0 (secure 0 0 0) 0x7fbbd8030020 con 0x7fbbe80fc2e0 2024-08-18T22:50:15.530 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:15.526+0000 7fbbcf7fe640 1 --2- 172.21.15.121:0/2106361453 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7fbbd006e0b0 0x7fbbd0070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:50:15.530 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:15.527+0000 7fbbe67fc640 1 --2- 172.21.15.121:0/2106361453 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7fbbd006e0b0 0x7fbbd0070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:50:15.530 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:15.527+0000 7fbbcf7fe640 1 -- 172.21.15.121:0/2106361453 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6668+0+0 (secure 0 0 0) 0x7fbbd80adfd0 con 0x7fbbe80fc2e0 2024-08-18T22:50:15.530 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:15.527+0000 7fbbe67fc640 1 --2- 172.21.15.121:0/2106361453 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7fbbd006e0b0 0x7fbbd0070560 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fbbdc0041d0 tx=0x7fbbdc009040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:50:15.533 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:15.531+0000 7fbbcf7fe640 1 -- 172.21.15.121:0/2106361453 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7fbbd80e2df0 con 0x7fbbe80fc2e0 2024-08-18T22:50:15.751 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:15.749+0000 7fbbed538640 1 -- 172.21.15.121:0/2106361453 --> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fbbe8101950 con 0x7fbbd006e0b0 2024-08-18T22:50:15.752 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:15.750+0000 7fbbcf7fe640 1 -- 172.21.15.121:0/2106361453 <== mgr.34102 v2:172.21.15.121:6800/3037387239 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+438 (secure 0 0 0) 0x7fbbe8101950 con 0x7fbbd006e0b0 2024-08-18T22:50:15.754 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:15.752+0000 7fbbed538640 1 -- 172.21.15.121:0/2106361453 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7fbbd006e0b0 msgr2=0x7fbbd0070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:50:15.754 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:15.752+0000 7fbbed538640 1 --2- 172.21.15.121:0/2106361453 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7fbbd006e0b0 0x7fbbd0070560 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fbbdc0041d0 tx=0x7fbbdc009040 comp rx=0 tx=0).stop 2024-08-18T22:50:15.754 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:15.752+0000 7fbbed538640 1 -- 172.21.15.121:0/2106361453 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbbe80fc2e0 msgr2=0x7fbbe8071310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:50:15.755 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:15.752+0000 7fbbed538640 1 --2- 172.21.15.121:0/2106361453 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbbe80fc2e0 0x7fbbe8071310 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fbbd8003080 tx=0x7fbbd8009da0 comp rx=0 tx=0).stop 2024-08-18T22:50:15.755 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:15.752+0000 7fbbed538640 1 -- 172.21.15.121:0/2106361453 shutdown_connections 2024-08-18T22:50:15.755 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:15.752+0000 7fbbed538640 1 --2- 172.21.15.121:0/2106361453 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7fbbd006e0b0 0x7fbbd0070560 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:50:15.755 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:15.752+0000 7fbbed538640 1 --2- 172.21.15.121:0/2106361453 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbbe80fd5b0 0x7fbbe806f800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:50:15.755 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:15.752+0000 7fbbed538640 1 --2- 172.21.15.121:0/2106361453 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbbe80fc2e0 0x7fbbe8071310 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:50:15.755 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:15.752+0000 7fbbed538640 1 -- 172.21.15.121:0/2106361453 >> 172.21.15.121:0/2106361453 conn(0x7fbbe80f7aa0 msgr2=0x7fbbe80f9240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:50:15.755 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:15.752+0000 7fbbed538640 1 -- 172.21.15.121:0/2106361453 shutdown_connections 2024-08-18T22:50:15.755 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:15.752+0000 7fbbed538640 1 -- 172.21.15.121:0/2106361453 wait complete. 2024-08-18T22:50:15.764 INFO:teuthology.orchestra.run.smithi121.stdout:true 2024-08-18T22:50:15.833 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:50:15 smithi121 ceph-mon[81053]: pgmap v235: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail; 170 B/s rd, 1.1 KiB/s wr, 0 op/s 2024-08-18T22:50:15.833 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:50:15 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:50:15.833 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:50:15 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:50:15.838 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:15.835+0000 7fddfbcf5640 1 -- 172.21.15.121:0/735315480 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fddf4065980 msgr2=0x7fddf40fef40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:50:15.838 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:15.835+0000 7fddfbcf5640 1 --2- 172.21.15.121:0/735315480 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fddf4065980 0x7fddf40fef40 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fddf00048d0 tx=0x7fddf0009da0 comp rx=0 tx=0).stop 2024-08-18T22:50:15.838 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:15.835+0000 7fddfbcf5640 1 -- 172.21.15.121:0/735315480 shutdown_connections 2024-08-18T22:50:15.839 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:15.835+0000 7fddfbcf5640 1 --2- 172.21.15.121:0/735315480 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fddf40ff480 0x7fddf4101860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:50:15.839 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:15.835+0000 7fddfbcf5640 1 --2- 172.21.15.121:0/735315480 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fddf4065980 0x7fddf40fef40 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:50:15.839 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:15.835+0000 7fddfbcf5640 1 -- 172.21.15.121:0/735315480 >> 172.21.15.121:0/735315480 conn(0x7fddf40f69b0 msgr2=0x7fddf40f8dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:50:15.839 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:15.835+0000 7fddfbcf5640 1 -- 172.21.15.121:0/735315480 shutdown_connections 2024-08-18T22:50:15.839 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:15.835+0000 7fddfbcf5640 1 -- 172.21.15.121:0/735315480 wait complete. 2024-08-18T22:50:15.839 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:15.835+0000 7fddfbcf5640 1 Processor -- start 2024-08-18T22:50:15.839 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:15.836+0000 7fddfbcf5640 1 -- start start 2024-08-18T22:50:15.839 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:15.836+0000 7fddfbcf5640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fddf4065980 0x7fddf410f100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:50:15.839 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:15.836+0000 7fddfbcf5640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fddf40ff480 0x7fddf410f640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:50:15.839 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:15.836+0000 7fddfbcf5640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddf41104b0 con 0x7fddf40ff480 2024-08-18T22:50:15.839 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:15.836+0000 7fddfbcf5640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddf4110620 con 0x7fddf4065980 2024-08-18T22:50:15.839 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:15.836+0000 7fddf9290640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fddf40ff480 0x7fddf410f640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:50:15.839 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:15.836+0000 7fddf9290640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fddf40ff480 0x7fddf410f640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:60738/0 (socket says 172.21.15.121:60738) 2024-08-18T22:50:15.839 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:15.836+0000 7fddf9290640 1 -- 172.21.15.121:0/4013082080 learned_addr learned my addr 172.21.15.121:0/4013082080 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-18T22:50:15.840 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:15.836+0000 7fddf9a91640 1 --2- 172.21.15.121:0/4013082080 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fddf4065980 0x7fddf410f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:50:15.840 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:15.836+0000 7fddf9290640 1 -- 172.21.15.121:0/4013082080 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fddf4065980 msgr2=0x7fddf410f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:50:15.840 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:15.836+0000 7fddf9290640 1 --2- 172.21.15.121:0/4013082080 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fddf4065980 0x7fddf410f100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:50:15.840 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:15.836+0000 7fddf9290640 1 -- 172.21.15.121:0/4013082080 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddf0005040 con 0x7fddf40ff480 2024-08-18T22:50:15.840 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:15.836+0000 7fddf9290640 1 --2- 172.21.15.121:0/4013082080 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fddf40ff480 0x7fddf410f640 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fdde400b790 tx=0x7fdde40091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:50:15.840 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:15.836+0000 7fddea7fc640 1 -- 172.21.15.121:0/4013082080 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdde400c700 con 0x7fddf40ff480 2024-08-18T22:50:15.840 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:15.836+0000 7fddea7fc640 1 -- 172.21.15.121:0/4013082080 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fdde400cd00 con 0x7fddf40ff480 2024-08-18T22:50:15.840 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:15.836+0000 7fddfbcf5640 1 -- 172.21.15.121:0/4013082080 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fddf4110900 con 0x7fddf40ff480 2024-08-18T22:50:15.840 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:15.837+0000 7fddfbcf5640 1 -- 172.21.15.121:0/4013082080 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fddf4110e20 con 0x7fddf40ff480 2024-08-18T22:50:15.840 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:15.837+0000 7fddea7fc640 1 -- 172.21.15.121:0/4013082080 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdde4015e80 con 0x7fddf40ff480 2024-08-18T22:50:15.841 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:15.838+0000 7fddfbcf5640 1 -- 172.21.15.121:0/4013082080 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fddf40fa630 con 0x7fddf40ff480 2024-08-18T22:50:15.841 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:15.838+0000 7fddea7fc640 1 -- 172.21.15.121:0/4013082080 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 37) v1 ==== 92205+0+0 (secure 0 0 0) 0x7fdde4012070 con 0x7fddf40ff480 2024-08-18T22:50:15.841 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:15.838+0000 7fddea7fc640 1 --2- 172.21.15.121:0/4013082080 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7fdde006e0b0 0x7fdde0070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:50:15.841 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:15.839+0000 7fddea7fc640 1 -- 172.21.15.121:0/4013082080 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6668+0+0 (secure 0 0 0) 0x7fdde408d5f0 con 0x7fddf40ff480 2024-08-18T22:50:15.841 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:15.839+0000 7fddf9a91640 1 --2- 172.21.15.121:0/4013082080 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7fdde006e0b0 0x7fdde0070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:50:15.841 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:15.839+0000 7fddf9a91640 1 --2- 172.21.15.121:0/4013082080 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7fdde006e0b0 0x7fdde0070560 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fddf00048a0 tx=0x7fddf0009da0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:50:15.845 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:15.843+0000 7fddea7fc640 1 -- 172.21.15.121:0/4013082080 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7fdde4056870 con 0x7fddf40ff480 2024-08-18T22:50:16.034 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:16.032+0000 7fddfbcf5640 1 -- 172.21.15.121:0/4013082080 --> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fddf4104d60 con 0x7fdde006e0b0 2024-08-18T22:50:16.035 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:16.033+0000 7fddea7fc640 1 -- 172.21.15.121:0/4013082080 <== mgr.34102 v2:172.21.15.121:6800/3037387239 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+438 (secure 0 0 0) 0x7fddf4104d60 con 0x7fdde006e0b0 2024-08-18T22:50:16.037 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:16.035+0000 7fddfbcf5640 1 -- 172.21.15.121:0/4013082080 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7fdde006e0b0 msgr2=0x7fdde0070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:50:16.038 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:16.035+0000 7fddfbcf5640 1 --2- 172.21.15.121:0/4013082080 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7fdde006e0b0 0x7fdde0070560 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fddf00048a0 tx=0x7fddf0009da0 comp rx=0 tx=0).stop 2024-08-18T22:50:16.038 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:16.035+0000 7fddfbcf5640 1 -- 172.21.15.121:0/4013082080 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fddf40ff480 msgr2=0x7fddf410f640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:50:16.038 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:16.035+0000 7fddfbcf5640 1 --2- 172.21.15.121:0/4013082080 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fddf40ff480 0x7fddf410f640 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fdde400b790 tx=0x7fdde40091d0 comp rx=0 tx=0).stop 2024-08-18T22:50:16.038 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:16.035+0000 7fddfbcf5640 1 -- 172.21.15.121:0/4013082080 shutdown_connections 2024-08-18T22:50:16.038 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:16.035+0000 7fddfbcf5640 1 --2- 172.21.15.121:0/4013082080 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7fdde006e0b0 0x7fdde0070560 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:50:16.038 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:16.035+0000 7fddfbcf5640 1 --2- 172.21.15.121:0/4013082080 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fddf40ff480 0x7fddf410f640 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:50:16.038 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:16.035+0000 7fddfbcf5640 1 --2- 172.21.15.121:0/4013082080 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fddf4065980 0x7fddf410f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:50:16.038 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:16.035+0000 7fddfbcf5640 1 -- 172.21.15.121:0/4013082080 >> 172.21.15.121:0/4013082080 conn(0x7fddf40f69b0 msgr2=0x7fddf40fb0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:50:16.038 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:16.035+0000 7fddfbcf5640 1 -- 172.21.15.121:0/4013082080 shutdown_connections 2024-08-18T22:50:16.038 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:16.035+0000 7fddfbcf5640 1 -- 172.21.15.121:0/4013082080 wait complete. 2024-08-18T22:50:16.119 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:16.117+0000 7ff236ff6640 1 -- 172.21.15.121:0/3168039634 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff2300659e0 msgr2=0x7ff2300feee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:50:16.119 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:16.117+0000 7ff236ff6640 1 --2- 172.21.15.121:0/3168039634 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff2300659e0 0x7ff2300feee0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7ff2240048d0 tx=0x7ff224009da0 comp rx=0 tx=0).stop 2024-08-18T22:50:16.119 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:16.117+0000 7ff236ff6640 1 -- 172.21.15.121:0/3168039634 shutdown_connections 2024-08-18T22:50:16.119 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:16.117+0000 7ff236ff6640 1 --2- 172.21.15.121:0/3168039634 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff2300ff420 0x7ff230101800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:50:16.119 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:16.117+0000 7ff236ff6640 1 --2- 172.21.15.121:0/3168039634 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff2300659e0 0x7ff2300feee0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:50:16.119 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:16.117+0000 7ff236ff6640 1 -- 172.21.15.121:0/3168039634 >> 172.21.15.121:0/3168039634 conn(0x7ff2300f69b0 msgr2=0x7ff2300f8dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:50:16.119 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:16.117+0000 7ff236ff6640 1 -- 172.21.15.121:0/3168039634 shutdown_connections 2024-08-18T22:50:16.120 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:16.117+0000 7ff236ff6640 1 -- 172.21.15.121:0/3168039634 wait complete. 2024-08-18T22:50:16.121 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:16.118+0000 7ff236ff6640 1 Processor -- start 2024-08-18T22:50:16.121 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:16.118+0000 7ff236ff6640 1 -- start start 2024-08-18T22:50:16.121 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:16.118+0000 7ff236ff6640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff2300659e0 0x7ff23010cf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:50:16.121 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:16.118+0000 7ff236ff6640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff2300ff420 0x7ff23010d480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:50:16.121 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:16.118+0000 7ff236ff6640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff23010e1c0 con 0x7ff2300ff420 2024-08-18T22:50:16.121 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:16.118+0000 7ff236ff6640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff23010e330 con 0x7ff2300659e0 2024-08-18T22:50:16.122 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:16.118+0000 7ff22ffff640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff2300ff420 0x7ff23010d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:50:16.122 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:16.118+0000 7ff22ffff640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff2300ff420 0x7ff23010d480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:60750/0 (socket says 172.21.15.121:60750) 2024-08-18T22:50:16.122 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:16.118+0000 7ff22ffff640 1 -- 172.21.15.121:0/2856931854 learned_addr learned my addr 172.21.15.121:0/2856931854 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-18T22:50:16.122 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:16.118+0000 7ff234d92640 1 --2- 172.21.15.121:0/2856931854 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff2300659e0 0x7ff23010cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:50:16.122 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:16.119+0000 7ff22ffff640 1 -- 172.21.15.121:0/2856931854 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff2300659e0 msgr2=0x7ff23010cf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:50:16.122 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:16.119+0000 7ff22ffff640 1 --2- 172.21.15.121:0/2856931854 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff2300659e0 0x7ff23010cf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:50:16.123 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:16.119+0000 7ff22ffff640 1 -- 172.21.15.121:0/2856931854 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff224005040 con 0x7ff2300ff420 2024-08-18T22:50:16.123 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:16.119+0000 7ff22ffff640 1 --2- 172.21.15.121:0/2856931854 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff2300ff420 0x7ff23010d480 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7ff21c00b790 tx=0x7ff21c0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:50:16.123 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:16.119+0000 7ff22d7fa640 1 -- 172.21.15.121:0/2856931854 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff21c00c700 con 0x7ff2300ff420 2024-08-18T22:50:16.123 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:16.119+0000 7ff236ff6640 1 -- 172.21.15.121:0/2856931854 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff23010e610 con 0x7ff2300ff420 2024-08-18T22:50:16.123 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:16.119+0000 7ff22d7fa640 1 -- 172.21.15.121:0/2856931854 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7ff21c00cd00 con 0x7ff2300ff420 2024-08-18T22:50:16.123 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:16.119+0000 7ff22d7fa640 1 -- 172.21.15.121:0/2856931854 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff21c015e80 con 0x7ff2300ff420 2024-08-18T22:50:16.123 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:16.119+0000 7ff236ff6640 1 -- 172.21.15.121:0/2856931854 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff23010eb30 con 0x7ff2300ff420 2024-08-18T22:50:16.124 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:16.121+0000 7ff236ff6640 1 -- 172.21.15.121:0/2856931854 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff214005240 con 0x7ff2300ff420 2024-08-18T22:50:16.124 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:16.121+0000 7ff22d7fa640 1 -- 172.21.15.121:0/2856931854 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 37) v1 ==== 92205+0+0 (secure 0 0 0) 0x7ff21c012070 con 0x7ff2300ff420 2024-08-18T22:50:16.124 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:16.122+0000 7ff22d7fa640 1 --2- 172.21.15.121:0/2856931854 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7ff22006e0b0 0x7ff220070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:50:16.124 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:16.122+0000 7ff22d7fa640 1 -- 172.21.15.121:0/2856931854 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6668+0+0 (secure 0 0 0) 0x7ff21c08d430 con 0x7ff2300ff420 2024-08-18T22:50:16.124 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:16.122+0000 7ff234d92640 1 --2- 172.21.15.121:0/2856931854 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7ff22006e0b0 0x7ff220070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:50:16.125 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:16.123+0000 7ff234d92640 1 --2- 172.21.15.121:0/2856931854 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7ff22006e0b0 0x7ff220070560 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7ff23010ccd0 tx=0x7ff224035040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:50:16.129 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:16.127+0000 7ff22d7fa640 1 -- 172.21.15.121:0/2856931854 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7ff21c056690 con 0x7ff2300ff420 2024-08-18T22:50:16.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:50:15 smithi195 ceph-mon[68841]: pgmap v235: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail; 170 B/s rd, 1.1 KiB/s wr, 0 op/s 2024-08-18T22:50:16.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:50:15 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:50:16.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:50:15 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:50:16.311 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:16.309+0000 7ff236ff6640 1 -- 172.21.15.121:0/2856931854 --> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7ff214000bf0 con 0x7ff22006e0b0 2024-08-18T22:50:16.322 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:16.320+0000 7ff22d7fa640 1 -- 172.21.15.121:0/2856931854 <== mgr.34102 v2:172.21.15.121:6800/3037387239 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7ff214000bf0 con 0x7ff22006e0b0 2024-08-18T22:50:16.323 INFO:teuthology.orchestra.run.smithi121.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-08-18T22:50:16.323 INFO:teuthology.orchestra.run.smithi121.stdout:alertmanager.smithi121 smithi121 *:9093,9094 running (8m) 0s ago 16m 23.4M - 0.25.0 c8568f914cd2 c421c5e6a02b 2024-08-18T22:50:16.323 INFO:teuthology.orchestra.run.smithi121.stdout:crash.smithi121 smithi121 running (5m) 0s ago 16m 6903k - 19.1.0-1382-gde09dd01 ea7a5189f30b 3cf5c666a0e6 2024-08-18T22:50:16.323 INFO:teuthology.orchestra.run.smithi121.stdout:crash.smithi195 smithi195 running (5m) 18s ago 15m 6895k - 19.1.0-1382-gde09dd01 ea7a5189f30b fbb586fb9834 2024-08-18T22:50:16.323 INFO:teuthology.orchestra.run.smithi121.stdout:grafana.smithi121 smithi121 *:3000 running (7m) 0s ago 15m 86.6M - 9.4.7 954c08fa6188 091a5fd17e8a 2024-08-18T22:50:16.323 INFO:teuthology.orchestra.run.smithi121.stdout:mds.cephfs.smithi121.gbickb smithi121 running (85s) 0s ago 11m 17.8M - 19.1.0-1382-gde09dd01 ea7a5189f30b 3d6dc5c5f472 2024-08-18T22:50:16.323 INFO:teuthology.orchestra.run.smithi121.stdout:mds.cephfs.smithi121.xuzsdg smithi121 running (103s) 0s ago 11m 76.2M - 19.1.0-1382-gde09dd01 ea7a5189f30b 4eec4d0a895e 2024-08-18T22:50:16.323 INFO:teuthology.orchestra.run.smithi121.stdout:mds.cephfs.smithi195.buqvbr smithi195 running (66s) 18s ago 11m 12.4M - 19.1.0-1382-gde09dd01 ea7a5189f30b dca538294bee 2024-08-18T22:50:16.323 INFO:teuthology.orchestra.run.smithi121.stdout:mds.cephfs.smithi195.nptgyc smithi195 running (42s) 18s ago 10m 13.2M - 19.1.0-1382-gde09dd01 ea7a5189f30b 42528b070f11 2024-08-18T22:50:16.323 INFO:teuthology.orchestra.run.smithi121.stdout:mgr.smithi121.lopxqc smithi121 *:8443,9283,8765 running (7m) 0s ago 17m 509M - 19.1.0-1382-gde09dd01 ea7a5189f30b 9079701e6516 2024-08-18T22:50:16.323 INFO:teuthology.orchestra.run.smithi121.stdout:mgr.smithi195.acttsj smithi195 *:8443,9283,8765 running (6m) 18s ago 15m 442M - 19.1.0-1382-gde09dd01 ea7a5189f30b 7b4027a33daa 2024-08-18T22:50:16.323 INFO:teuthology.orchestra.run.smithi121.stdout:mon.smithi121 smithi121 running (6m) 0s ago 17m 57.1M 2048M 19.1.0-1382-gde09dd01 ea7a5189f30b d71695a4fb56 2024-08-18T22:50:16.323 INFO:teuthology.orchestra.run.smithi121.stdout:mon.smithi195 smithi195 running (6m) 18s ago 15m 40.9M 2048M 19.1.0-1382-gde09dd01 ea7a5189f30b a9bb94ba3b56 2024-08-18T22:50:16.324 INFO:teuthology.orchestra.run.smithi121.stdout:node-exporter.smithi121 smithi121 *:9100 running (25s) 0s ago 16m 10.2M - 1.5.0 0da6a335fe13 5c8d00b736b0 2024-08-18T22:50:16.324 INFO:teuthology.orchestra.run.smithi121.stdout:node-exporter.smithi195 smithi195 *:9100 running (20s) 18s ago 15m 3602k - 1.5.0 0da6a335fe13 55fe298190b2 2024-08-18T22:50:16.324 INFO:teuthology.orchestra.run.smithi121.stdout:osd.0 smithi121 running (5m) 0s ago 14m 143M 1557M 19.1.0-1382-gde09dd01 ea7a5189f30b d378dd46eeb6 2024-08-18T22:50:16.324 INFO:teuthology.orchestra.run.smithi121.stdout:osd.1 smithi121 running (4m) 0s ago 14m 166M 1557M 19.1.0-1382-gde09dd01 ea7a5189f30b 0f9e03de5382 2024-08-18T22:50:16.324 INFO:teuthology.orchestra.run.smithi121.stdout:osd.2 smithi121 running (4m) 0s ago 13m 131M 1557M 19.1.0-1382-gde09dd01 ea7a5189f30b 93270b5bed68 2024-08-18T22:50:16.324 INFO:teuthology.orchestra.run.smithi121.stdout:osd.3 smithi195 running (3m) 18s ago 13m 188M 2581M 19.1.0-1382-gde09dd01 ea7a5189f30b 72c2860c0e9f 2024-08-18T22:50:16.324 INFO:teuthology.orchestra.run.smithi121.stdout:osd.4 smithi195 running (3m) 18s ago 12m 169M 2581M 19.1.0-1382-gde09dd01 ea7a5189f30b d88a83c97247 2024-08-18T22:50:16.324 INFO:teuthology.orchestra.run.smithi121.stdout:osd.5 smithi195 running (2m) 18s ago 12m 150M 2581M 19.1.0-1382-gde09dd01 ea7a5189f30b 5af2d6de9afe 2024-08-18T22:50:16.324 INFO:teuthology.orchestra.run.smithi121.stdout:prometheus.smithi121 smithi121 *:9095 running (5s) 0s ago 15m 40.0M - 2.43.0 a07b618ecd1d ad25302956e5 2024-08-18T22:50:16.325 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:16.322+0000 7ff236ff6640 1 -- 172.21.15.121:0/2856931854 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7ff22006e0b0 msgr2=0x7ff220070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:50:16.325 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:16.322+0000 7ff236ff6640 1 --2- 172.21.15.121:0/2856931854 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7ff22006e0b0 0x7ff220070560 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7ff23010ccd0 tx=0x7ff224035040 comp rx=0 tx=0).stop 2024-08-18T22:50:16.325 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:16.322+0000 7ff236ff6640 1 -- 172.21.15.121:0/2856931854 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff2300ff420 msgr2=0x7ff23010d480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:50:16.325 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:16.322+0000 7ff236ff6640 1 --2- 172.21.15.121:0/2856931854 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff2300ff420 0x7ff23010d480 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7ff21c00b790 tx=0x7ff21c0091d0 comp rx=0 tx=0).stop 2024-08-18T22:50:16.325 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:16.322+0000 7ff236ff6640 1 -- 172.21.15.121:0/2856931854 shutdown_connections 2024-08-18T22:50:16.325 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:16.322+0000 7ff236ff6640 1 --2- 172.21.15.121:0/2856931854 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7ff22006e0b0 0x7ff220070560 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:50:16.325 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:16.322+0000 7ff236ff6640 1 --2- 172.21.15.121:0/2856931854 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff2300ff420 0x7ff23010d480 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:50:16.325 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:16.322+0000 7ff236ff6640 1 --2- 172.21.15.121:0/2856931854 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff2300659e0 0x7ff23010cf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:50:16.325 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:16.322+0000 7ff236ff6640 1 -- 172.21.15.121:0/2856931854 >> 172.21.15.121:0/2856931854 conn(0x7ff2300f69b0 msgr2=0x7ff2300f6d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:50:16.325 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:16.323+0000 7ff236ff6640 1 -- 172.21.15.121:0/2856931854 shutdown_connections 2024-08-18T22:50:16.325 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:16.323+0000 7ff236ff6640 1 -- 172.21.15.121:0/2856931854 wait complete. 2024-08-18T22:50:16.408 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:16.406+0000 7feab8ef5640 1 -- 172.21.15.121:0/1269311987 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7feab40fc4a0 msgr2=0x7feab40fc910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:50:16.408 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:16.406+0000 7feab8ef5640 1 --2- 172.21.15.121:0/1269311987 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7feab40fc4a0 0x7feab40fc910 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fea9c0048d0 tx=0x7fea9c009da0 comp rx=0 tx=0).stop 2024-08-18T22:50:16.408 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:16.406+0000 7feab8ef5640 1 -- 172.21.15.121:0/1269311987 shutdown_connections 2024-08-18T22:50:16.408 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:16.406+0000 7feab8ef5640 1 --2- 172.21.15.121:0/1269311987 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7feab40fc4a0 0x7feab40fc910 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:50:16.408 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:16.406+0000 7feab8ef5640 1 --2- 172.21.15.121:0/1269311987 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7feab40fb1d0 0x7feab40fb5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:50:16.408 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:16.406+0000 7feab8ef5640 1 -- 172.21.15.121:0/1269311987 >> 172.21.15.121:0/1269311987 conn(0x7feab40f69b0 msgr2=0x7feab40f8dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:50:16.408 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:16.406+0000 7feab8ef5640 1 -- 172.21.15.121:0/1269311987 shutdown_connections 2024-08-18T22:50:16.409 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:16.406+0000 7feab8ef5640 1 -- 172.21.15.121:0/1269311987 wait complete. 2024-08-18T22:50:16.410 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:16.407+0000 7feab8ef5640 1 Processor -- start 2024-08-18T22:50:16.410 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:16.407+0000 7feab8ef5640 1 -- start start 2024-08-18T22:50:16.410 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:16.407+0000 7feab8ef5640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7feab40fb1d0 0x7feab410cee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:50:16.410 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:16.407+0000 7feab8ef5640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7feab40fc4a0 0x7feab410d420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:50:16.410 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:16.407+0000 7feab8ef5640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feab410e1b0 con 0x7feab40fb1d0 2024-08-18T22:50:16.410 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:16.407+0000 7feab8ef5640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feab410e320 con 0x7feab40fc4a0 2024-08-18T22:50:16.410 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:16.407+0000 7feab259c640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7feab40fb1d0 0x7feab410cee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:50:16.411 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:16.407+0000 7feab259c640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7feab40fb1d0 0x7feab410cee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:60774/0 (socket says 172.21.15.121:60774) 2024-08-18T22:50:16.411 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:16.407+0000 7feab259c640 1 -- 172.21.15.121:0/553936047 learned_addr learned my addr 172.21.15.121:0/553936047 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-18T22:50:16.411 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:16.407+0000 7feaabfff640 1 --2- 172.21.15.121:0/553936047 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7feab40fc4a0 0x7feab410d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:50:16.411 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:16.408+0000 7feab259c640 1 -- 172.21.15.121:0/553936047 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7feab40fc4a0 msgr2=0x7feab410d420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:50:16.411 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:16.408+0000 7feab259c640 1 --2- 172.21.15.121:0/553936047 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7feab40fc4a0 0x7feab410d420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:50:16.411 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:16.408+0000 7feab259c640 1 -- 172.21.15.121:0/553936047 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea9c005040 con 0x7feab40fb1d0 2024-08-18T22:50:16.411 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:16.408+0000 7feaabfff640 1 --2- 172.21.15.121:0/553936047 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7feab40fc4a0 0x7feab410d420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:50:16.411 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:16.408+0000 7feab259c640 1 --2- 172.21.15.121:0/553936047 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7feab40fb1d0 0x7feab410cee0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7feaa400b790 tx=0x7feaa40091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:50:16.411 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:16.408+0000 7feaaaffd640 1 -- 172.21.15.121:0/553936047 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7feaa400c700 con 0x7feab40fb1d0 2024-08-18T22:50:16.411 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:16.408+0000 7feab8ef5640 1 -- 172.21.15.121:0/553936047 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feab410e600 con 0x7feab40fb1d0 2024-08-18T22:50:16.412 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:16.408+0000 7feaaaffd640 1 -- 172.21.15.121:0/553936047 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7feaa400cd00 con 0x7feab40fb1d0 2024-08-18T22:50:16.412 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:16.408+0000 7feab8ef5640 1 -- 172.21.15.121:0/553936047 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feab410eac0 con 0x7feab40fb1d0 2024-08-18T22:50:16.412 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:16.408+0000 7feaaaffd640 1 -- 172.21.15.121:0/553936047 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7feaa4015e70 con 0x7feab40fb1d0 2024-08-18T22:50:16.412 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:16.409+0000 7feab8ef5640 1 -- 172.21.15.121:0/553936047 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feab4104460 con 0x7feab40fb1d0 2024-08-18T22:50:16.412 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:16.410+0000 7feaaaffd640 1 -- 172.21.15.121:0/553936047 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 37) v1 ==== 92205+0+0 (secure 0 0 0) 0x7feaa4012070 con 0x7feab40fb1d0 2024-08-18T22:50:16.413 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:16.411+0000 7feaaaffd640 1 --2- 172.21.15.121:0/553936047 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7feaa006e0b0 0x7feaa0070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:50:16.413 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:16.411+0000 7feaaaffd640 1 -- 172.21.15.121:0/553936047 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6668+0+0 (secure 0 0 0) 0x7feaa408d730 con 0x7feab40fb1d0 2024-08-18T22:50:16.413 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:16.411+0000 7feaabfff640 1 --2- 172.21.15.121:0/553936047 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7feaa006e0b0 0x7feaa0070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:50:16.413 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:16.411+0000 7feaabfff640 1 --2- 172.21.15.121:0/553936047 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7feaa006e0b0 0x7feaa0070560 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fea9c004540 tx=0x7fea9c035040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:50:16.417 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:16.415+0000 7feaaaffd640 1 -- 172.21.15.121:0/553936047 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7feaa4056a30 con 0x7feab40fb1d0 2024-08-18T22:50:16.665 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:16.663+0000 7feab8ef5640 1 -- 172.21.15.121:0/553936047 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7feab410ee90 con 0x7feab40fb1d0 2024-08-18T22:50:16.666 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:16.664+0000 7feaaaffd640 1 -- 172.21.15.121:0/553936047 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+618 (secure 0 0 0) 0x7feaa405a0f0 con 0x7feab40fb1d0 2024-08-18T22:50:16.666 INFO:teuthology.orchestra.run.smithi121.stdout:{ 2024-08-18T22:50:16.666 INFO:teuthology.orchestra.run.smithi121.stdout: "mon": { 2024-08-18T22:50:16.666 INFO:teuthology.orchestra.run.smithi121.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 2 2024-08-18T22:50:16.666 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-18T22:50:16.666 INFO:teuthology.orchestra.run.smithi121.stdout: "mgr": { 2024-08-18T22:50:16.666 INFO:teuthology.orchestra.run.smithi121.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 2 2024-08-18T22:50:16.666 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-18T22:50:16.666 INFO:teuthology.orchestra.run.smithi121.stdout: "osd": { 2024-08-18T22:50:16.666 INFO:teuthology.orchestra.run.smithi121.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 6 2024-08-18T22:50:16.667 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-18T22:50:16.667 INFO:teuthology.orchestra.run.smithi121.stdout: "mds": { 2024-08-18T22:50:16.667 INFO:teuthology.orchestra.run.smithi121.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 4 2024-08-18T22:50:16.667 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-18T22:50:16.667 INFO:teuthology.orchestra.run.smithi121.stdout: "overall": { 2024-08-18T22:50:16.667 INFO:teuthology.orchestra.run.smithi121.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 14 2024-08-18T22:50:16.667 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-08-18T22:50:16.667 INFO:teuthology.orchestra.run.smithi121.stdout:} 2024-08-18T22:50:16.668 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:16.666+0000 7feab8ef5640 1 -- 172.21.15.121:0/553936047 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7feaa006e0b0 msgr2=0x7feaa0070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:50:16.668 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:16.666+0000 7feab8ef5640 1 --2- 172.21.15.121:0/553936047 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7feaa006e0b0 0x7feaa0070560 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fea9c004540 tx=0x7fea9c035040 comp rx=0 tx=0).stop 2024-08-18T22:50:16.668 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:16.666+0000 7feab8ef5640 1 -- 172.21.15.121:0/553936047 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7feab40fb1d0 msgr2=0x7feab410cee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:50:16.668 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:16.666+0000 7feab8ef5640 1 --2- 172.21.15.121:0/553936047 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7feab40fb1d0 0x7feab410cee0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7feaa400b790 tx=0x7feaa40091d0 comp rx=0 tx=0).stop 2024-08-18T22:50:16.668 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:16.666+0000 7feab8ef5640 1 -- 172.21.15.121:0/553936047 shutdown_connections 2024-08-18T22:50:16.668 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:16.666+0000 7feab8ef5640 1 --2- 172.21.15.121:0/553936047 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7feaa006e0b0 0x7feaa0070560 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:50:16.668 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:16.666+0000 7feab8ef5640 1 --2- 172.21.15.121:0/553936047 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7feab40fc4a0 0x7feab410d420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:50:16.669 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:16.666+0000 7feab8ef5640 1 --2- 172.21.15.121:0/553936047 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7feab40fb1d0 0x7feab410cee0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:50:16.669 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:16.666+0000 7feab8ef5640 1 -- 172.21.15.121:0/553936047 >> 172.21.15.121:0/553936047 conn(0x7feab40f69b0 msgr2=0x7feab4064d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:50:16.669 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:16.666+0000 7feab8ef5640 1 -- 172.21.15.121:0/553936047 shutdown_connections 2024-08-18T22:50:16.669 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:16.666+0000 7feab8ef5640 1 -- 172.21.15.121:0/553936047 wait complete. 2024-08-18T22:50:16.751 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:16.746+0000 7f6eaaf29640 1 -- 172.21.15.121:0/582298773 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6ea40fb1d0 msgr2=0x7f6ea40fb5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:50:16.751 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:16.746+0000 7f6eaaf29640 1 --2- 172.21.15.121:0/582298773 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6ea40fb1d0 0x7f6ea40fb5e0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f6e9c0048d0 tx=0x7f6e9c009da0 comp rx=0 tx=0).stop 2024-08-18T22:50:16.751 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:16.746+0000 7f6eaaf29640 1 -- 172.21.15.121:0/582298773 shutdown_connections 2024-08-18T22:50:16.752 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:16.746+0000 7f6eaaf29640 1 --2- 172.21.15.121:0/582298773 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6ea40fc4a0 0x7f6ea40fc910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:50:16.752 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:16.747+0000 7f6eaaf29640 1 --2- 172.21.15.121:0/582298773 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6ea40fb1d0 0x7f6ea40fb5e0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:50:16.752 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:16.747+0000 7f6eaaf29640 1 -- 172.21.15.121:0/582298773 >> 172.21.15.121:0/582298773 conn(0x7f6ea40f69b0 msgr2=0x7f6ea40f8dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:50:16.752 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:16.747+0000 7f6eaaf29640 1 -- 172.21.15.121:0/582298773 shutdown_connections 2024-08-18T22:50:16.752 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:16.747+0000 7f6eaaf29640 1 -- 172.21.15.121:0/582298773 wait complete. 2024-08-18T22:50:16.752 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:16.747+0000 7f6eaaf29640 1 Processor -- start 2024-08-18T22:50:16.752 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:16.747+0000 7f6eaaf29640 1 -- start start 2024-08-18T22:50:16.752 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:16.748+0000 7f6eaaf29640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6ea40fb1d0 0x7f6ea4111f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:50:16.752 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:16.748+0000 7f6eaaf29640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6ea40fc4a0 0x7f6ea4114490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:50:16.752 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:16.748+0000 7f6eaaf29640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ea410d9f0 con 0x7f6ea40fb1d0 2024-08-18T22:50:16.752 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:16.748+0000 7f6eaaf29640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ea4065970 con 0x7f6ea40fc4a0 2024-08-18T22:50:16.752 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:16.748+0000 7f6ea8cc5640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6ea40fb1d0 0x7f6ea4111f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:50:16.752 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:16.748+0000 7f6ea8cc5640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6ea40fb1d0 0x7f6ea4111f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:41796/0 (socket says 172.21.15.121:41796) 2024-08-18T22:50:16.752 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:16.748+0000 7f6ea8cc5640 1 -- 172.21.15.121:0/972392583 learned_addr learned my addr 172.21.15.121:0/972392583 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-18T22:50:16.753 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:16.748+0000 7f6ea3fff640 1 --2- 172.21.15.121:0/972392583 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6ea40fc4a0 0x7f6ea4114490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:50:16.753 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:16.748+0000 7f6ea8cc5640 1 -- 172.21.15.121:0/972392583 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6ea40fc4a0 msgr2=0x7f6ea4114490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:50:16.753 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:16.748+0000 7f6ea8cc5640 1 --2- 172.21.15.121:0/972392583 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6ea40fc4a0 0x7f6ea4114490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:50:16.753 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:16.748+0000 7f6ea8cc5640 1 -- 172.21.15.121:0/972392583 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e9c005040 con 0x7f6ea40fb1d0 2024-08-18T22:50:16.753 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:16.748+0000 7f6ea8cc5640 1 --2- 172.21.15.121:0/972392583 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6ea40fb1d0 0x7f6ea4111f40 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f6e9c003080 tx=0x7f6e9c009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:50:16.753 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:16.748+0000 7f6ea17fa640 1 -- 172.21.15.121:0/972392583 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6e9c038070 con 0x7f6ea40fb1d0 2024-08-18T22:50:16.753 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:16.748+0000 7f6eaaf29640 1 -- 172.21.15.121:0/972392583 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ea4065bf0 con 0x7f6ea40fb1d0 2024-08-18T22:50:16.753 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:16.748+0000 7f6ea17fa640 1 -- 172.21.15.121:0/972392583 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f6e9c02abd0 con 0x7f6ea40fb1d0 2024-08-18T22:50:16.753 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:16.748+0000 7f6ea17fa640 1 -- 172.21.15.121:0/972392583 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6e9c03e670 con 0x7f6ea40fb1d0 2024-08-18T22:50:16.753 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:16.749+0000 7f6eaaf29640 1 -- 172.21.15.121:0/972392583 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ea4114d30 con 0x7f6ea40fb1d0 2024-08-18T22:50:16.753 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:16.749+0000 7f6eaaf29640 1 -- 172.21.15.121:0/972392583 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ea40fa630 con 0x7f6ea40fb1d0 2024-08-18T22:50:16.754 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:16.750+0000 7f6ea17fa640 1 -- 172.21.15.121:0/972392583 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 37) v1 ==== 92205+0+0 (secure 0 0 0) 0x7f6e9c030020 con 0x7f6ea40fb1d0 2024-08-18T22:50:16.754 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:16.750+0000 7f6ea17fa640 1 --2- 172.21.15.121:0/972392583 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f6e9006e0b0 0x7f6e90070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:50:16.754 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:16.751+0000 7f6ea17fa640 1 -- 172.21.15.121:0/972392583 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6668+0+0 (secure 0 0 0) 0x7f6e9c0adfd0 con 0x7f6ea40fb1d0 2024-08-18T22:50:16.754 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:16.751+0000 7f6ea3fff640 1 --2- 172.21.15.121:0/972392583 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f6e9006e0b0 0x7f6e90070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:50:16.755 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:16.751+0000 7f6ea3fff640 1 --2- 172.21.15.121:0/972392583 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f6e9006e0b0 0x7f6e90070560 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f6e8c007fd0 tx=0x7f6e8c009040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:50:16.756 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:16.755+0000 7f6ea17fa640 1 -- 172.21.15.121:0/972392583 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f6e9c077300 con 0x7f6ea40fb1d0 2024-08-18T22:50:16.972 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:16.969+0000 7f6eaaf29640 1 -- 172.21.15.121:0/972392583 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f6ea4115080 con 0x7f6ea40fb1d0 2024-08-18T22:50:16.972 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:50:16 smithi121 ceph-mon[81053]: from='client.34502 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-18T22:50:16.972 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:50:16 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:50:16.972 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:50:16 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:50:16.972 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:50:16 smithi121 ceph-mon[81053]: from='client.? 172.21.15.121:0/553936047' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-08-18T22:50:16.973 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:16.970+0000 7f6ea17fa640 1 -- 172.21.15.121:0/972392583 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 46 v46) v1 ==== 76+0+1997 (secure 0 0 0) 0x7f6e9c07a9c0 con 0x7f6ea40fb1d0 2024-08-18T22:50:16.973 INFO:teuthology.orchestra.run.smithi121.stdout:e46 2024-08-18T22:50:16.973 INFO:teuthology.orchestra.run.smithi121.stdout:btime 2024-08-18T22:49:43:280875+0000 2024-08-18T22:50:16.973 INFO:teuthology.orchestra.run.smithi121.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-08-18T22:50:16.973 INFO:teuthology.orchestra.run.smithi121.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-08-18T22:50:16.973 INFO:teuthology.orchestra.run.smithi121.stdout:legacy client fscid: 1 2024-08-18T22:50:16.973 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-08-18T22:50:16.973 INFO:teuthology.orchestra.run.smithi121.stdout:Filesystem 'cephfs' (1) 2024-08-18T22:50:16.974 INFO:teuthology.orchestra.run.smithi121.stdout:fs_name cephfs 2024-08-18T22:50:16.974 INFO:teuthology.orchestra.run.smithi121.stdout:epoch 46 2024-08-18T22:50:16.974 INFO:teuthology.orchestra.run.smithi121.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-08-18T22:50:16.974 INFO:teuthology.orchestra.run.smithi121.stdout:created 2024-08-18T22:39:04.054074+0000 2024-08-18T22:50:16.974 INFO:teuthology.orchestra.run.smithi121.stdout:modified 2024-08-18T22:49:43.280872+0000 2024-08-18T22:50:16.974 INFO:teuthology.orchestra.run.smithi121.stdout:tableserver 0 2024-08-18T22:50:16.974 INFO:teuthology.orchestra.run.smithi121.stdout:root 0 2024-08-18T22:50:16.974 INFO:teuthology.orchestra.run.smithi121.stdout:session_timeout 60 2024-08-18T22:50:16.974 INFO:teuthology.orchestra.run.smithi121.stdout:session_autoclose 300 2024-08-18T22:50:16.974 INFO:teuthology.orchestra.run.smithi121.stdout:max_file_size 1099511627776 2024-08-18T22:50:16.974 INFO:teuthology.orchestra.run.smithi121.stdout:max_xattr_size 65536 2024-08-18T22:50:16.974 INFO:teuthology.orchestra.run.smithi121.stdout:required_client_features {} 2024-08-18T22:50:16.974 INFO:teuthology.orchestra.run.smithi121.stdout:last_failure 0 2024-08-18T22:50:16.975 INFO:teuthology.orchestra.run.smithi121.stdout:last_failure_osd_epoch 84 2024-08-18T22:50:16.975 INFO:teuthology.orchestra.run.smithi121.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-08-18T22:50:16.975 INFO:teuthology.orchestra.run.smithi121.stdout:max_mds 2 2024-08-18T22:50:16.975 INFO:teuthology.orchestra.run.smithi121.stdout:in 0,1 2024-08-18T22:50:16.975 INFO:teuthology.orchestra.run.smithi121.stdout:up {0=34404,1=34436} 2024-08-18T22:50:16.975 INFO:teuthology.orchestra.run.smithi121.stdout:failed 2024-08-18T22:50:16.975 INFO:teuthology.orchestra.run.smithi121.stdout:damaged 2024-08-18T22:50:16.975 INFO:teuthology.orchestra.run.smithi121.stdout:stopped 2024-08-18T22:50:16.975 INFO:teuthology.orchestra.run.smithi121.stdout:data_pools [3] 2024-08-18T22:50:16.975 INFO:teuthology.orchestra.run.smithi121.stdout:metadata_pool 2 2024-08-18T22:50:16.975 INFO:teuthology.orchestra.run.smithi121.stdout:inline_data disabled 2024-08-18T22:50:16.975 INFO:teuthology.orchestra.run.smithi121.stdout:balancer 2024-08-18T22:50:16.975 INFO:teuthology.orchestra.run.smithi121.stdout:bal_rank_mask -1 2024-08-18T22:50:16.975 INFO:teuthology.orchestra.run.smithi121.stdout:standby_count_wanted 1 2024-08-18T22:50:16.976 INFO:teuthology.orchestra.run.smithi121.stdout:qdb_cluster leader: 34404 members: 34404,34436 2024-08-18T22:50:16.976 INFO:teuthology.orchestra.run.smithi121.stdout:[mds.cephfs.smithi121.xuzsdg{0:34404} state up:active seq 18 join_fscid=1 addr [v2:172.21.15.121:6826/4267588865,v1:172.21.15.121:6827/4267588865] compat {c=[1],r=[1],i=[1fff]}] 2024-08-18T22:50:16.976 INFO:teuthology.orchestra.run.smithi121.stdout:[mds.cephfs.smithi121.gbickb{1:34436} state up:active seq 14 join_fscid=1 addr [v2:172.21.15.121:6828/2915303436,v1:172.21.15.121:6829/2915303436] compat {c=[1],r=[1],i=[1fff]}] 2024-08-18T22:50:16.976 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-08-18T22:50:16.976 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-08-18T22:50:16.976 INFO:teuthology.orchestra.run.smithi121.stdout:Standby daemons: 2024-08-18T22:50:16.976 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-08-18T22:50:16.976 INFO:teuthology.orchestra.run.smithi121.stdout:[mds.cephfs.smithi195.buqvbr{-1:44299} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.195:6824/1574620912,v1:172.21.15.195:6825/1574620912] compat {c=[1],r=[1],i=[1fff]}] 2024-08-18T22:50:16.976 INFO:teuthology.orchestra.run.smithi121.stdout:[mds.cephfs.smithi195.nptgyc{-1:44327} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.195:6826/4050783124,v1:172.21.15.195:6827/4050783124] compat {c=[1],r=[1],i=[1fff]}] 2024-08-18T22:50:16.977 INFO:teuthology.orchestra.run.smithi121.stderr:dumped fsmap epoch 46 2024-08-18T22:50:16.977 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:16.972+0000 7f6eaaf29640 1 -- 172.21.15.121:0/972392583 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f6e9006e0b0 msgr2=0x7f6e90070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:50:16.977 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:16.972+0000 7f6eaaf29640 1 --2- 172.21.15.121:0/972392583 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f6e9006e0b0 0x7f6e90070560 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f6e8c007fd0 tx=0x7f6e8c009040 comp rx=0 tx=0).stop 2024-08-18T22:50:16.977 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:16.972+0000 7f6eaaf29640 1 -- 172.21.15.121:0/972392583 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6ea40fb1d0 msgr2=0x7f6ea4111f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:50:16.977 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:16.972+0000 7f6eaaf29640 1 --2- 172.21.15.121:0/972392583 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6ea40fb1d0 0x7f6ea4111f40 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f6e9c003080 tx=0x7f6e9c009da0 comp rx=0 tx=0).stop 2024-08-18T22:50:16.978 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:16.972+0000 7f6eaaf29640 1 -- 172.21.15.121:0/972392583 shutdown_connections 2024-08-18T22:50:16.978 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:16.972+0000 7f6eaaf29640 1 --2- 172.21.15.121:0/972392583 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f6e9006e0b0 0x7f6e90070560 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:50:16.978 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:16.972+0000 7f6eaaf29640 1 --2- 172.21.15.121:0/972392583 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6ea40fc4a0 0x7f6ea4114490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:50:16.978 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:16.972+0000 7f6eaaf29640 1 --2- 172.21.15.121:0/972392583 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6ea40fb1d0 0x7f6ea4111f40 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:50:16.978 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:16.972+0000 7f6eaaf29640 1 -- 172.21.15.121:0/972392583 >> 172.21.15.121:0/972392583 conn(0x7f6ea40f69b0 msgr2=0x7f6ea40f8180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:50:16.978 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:16.972+0000 7f6eaaf29640 1 -- 172.21.15.121:0/972392583 shutdown_connections 2024-08-18T22:50:16.978 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:16.972+0000 7f6eaaf29640 1 -- 172.21.15.121:0/972392583 wait complete. 2024-08-18T22:50:17.058 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:17.055+0000 7fe835965640 1 -- 172.21.15.121:0/972940860 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe8300659e0 msgr2=0x7fe8300feee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:50:17.059 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:17.055+0000 7fe835965640 1 --2- 172.21.15.121:0/972940860 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe8300659e0 0x7fe8300feee0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fe8200048d0 tx=0x7fe820009da0 comp rx=0 tx=0).stop 2024-08-18T22:50:17.059 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:17.055+0000 7fe835965640 1 -- 172.21.15.121:0/972940860 shutdown_connections 2024-08-18T22:50:17.059 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:17.055+0000 7fe835965640 1 --2- 172.21.15.121:0/972940860 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe8300ff420 0x7fe830101800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:50:17.059 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:17.055+0000 7fe835965640 1 --2- 172.21.15.121:0/972940860 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe8300659e0 0x7fe8300feee0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:50:17.059 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:17.055+0000 7fe835965640 1 -- 172.21.15.121:0/972940860 >> 172.21.15.121:0/972940860 conn(0x7fe8300f69b0 msgr2=0x7fe8300f8dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:50:17.059 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:17.055+0000 7fe835965640 1 -- 172.21.15.121:0/972940860 shutdown_connections 2024-08-18T22:50:17.059 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:17.055+0000 7fe835965640 1 -- 172.21.15.121:0/972940860 wait complete. 2024-08-18T22:50:17.059 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:17.056+0000 7fe835965640 1 Processor -- start 2024-08-18T22:50:17.059 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:17.056+0000 7fe835965640 1 -- start start 2024-08-18T22:50:17.059 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:17.056+0000 7fe835965640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe8300659e0 0x7fe83010cf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:50:17.059 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:17.056+0000 7fe835965640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe8300ff420 0x7fe83010d480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:50:17.060 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:17.056+0000 7fe835965640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe83010e1c0 con 0x7fe8300659e0 2024-08-18T22:50:17.060 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:17.056+0000 7fe835965640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe83010e330 con 0x7fe8300ff420 2024-08-18T22:50:17.060 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:17.056+0000 7fe82effd640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe8300659e0 0x7fe83010cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:50:17.060 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:17.056+0000 7fe82effd640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe8300659e0 0x7fe83010cf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:41812/0 (socket says 172.21.15.121:41812) 2024-08-18T22:50:17.060 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:17.056+0000 7fe82effd640 1 -- 172.21.15.121:0/1043252019 learned_addr learned my addr 172.21.15.121:0/1043252019 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-18T22:50:17.060 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:17.056+0000 7fe82e7fc640 1 --2- 172.21.15.121:0/1043252019 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe8300ff420 0x7fe83010d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:50:17.060 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:17.056+0000 7fe82effd640 1 -- 172.21.15.121:0/1043252019 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe8300ff420 msgr2=0x7fe83010d480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:50:17.060 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:17.056+0000 7fe82effd640 1 --2- 172.21.15.121:0/1043252019 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe8300ff420 0x7fe83010d480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:50:17.060 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:17.056+0000 7fe82effd640 1 -- 172.21.15.121:0/1043252019 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe820005040 con 0x7fe8300659e0 2024-08-18T22:50:17.060 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:17.056+0000 7fe82effd640 1 --2- 172.21.15.121:0/1043252019 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe8300659e0 0x7fe83010cf40 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fe8200048a0 tx=0x7fe820009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:50:17.060 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:17.056+0000 7fe8177fe640 1 -- 172.21.15.121:0/1043252019 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe820038070 con 0x7fe8300659e0 2024-08-18T22:50:17.060 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:17.057+0000 7fe8177fe640 1 -- 172.21.15.121:0/1043252019 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fe82002abd0 con 0x7fe8300659e0 2024-08-18T22:50:17.060 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:17.057+0000 7fe8177fe640 1 -- 172.21.15.121:0/1043252019 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe820033640 con 0x7fe8300659e0 2024-08-18T22:50:17.060 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:17.057+0000 7fe835965640 1 -- 172.21.15.121:0/1043252019 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe83010e5b0 con 0x7fe8300659e0 2024-08-18T22:50:17.061 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:17.057+0000 7fe835965640 1 -- 172.21.15.121:0/1043252019 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe83010ead0 con 0x7fe8300659e0 2024-08-18T22:50:17.061 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:17.058+0000 7fe835965640 1 -- 172.21.15.121:0/1043252019 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe830105560 con 0x7fe8300659e0 2024-08-18T22:50:17.062 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:17.058+0000 7fe8177fe640 1 -- 172.21.15.121:0/1043252019 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 37) v1 ==== 92205+0+0 (secure 0 0 0) 0x7fe820030020 con 0x7fe8300659e0 2024-08-18T22:50:17.062 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:17.059+0000 7fe8177fe640 1 --2- 172.21.15.121:0/1043252019 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7fe81806e0b0 0x7fe818070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:50:17.062 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:17.059+0000 7fe8177fe640 1 -- 172.21.15.121:0/1043252019 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6668+0+0 (secure 0 0 0) 0x7fe8200adf30 con 0x7fe8300659e0 2024-08-18T22:50:17.062 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:17.059+0000 7fe82e7fc640 1 --2- 172.21.15.121:0/1043252019 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7fe81806e0b0 0x7fe818070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:50:17.062 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:17.059+0000 7fe82e7fc640 1 --2- 172.21.15.121:0/1043252019 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7fe81806e0b0 0x7fe818070560 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fe824006fd0 tx=0x7fe824008040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:50:17.065 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:17.063+0000 7fe8177fe640 1 -- 172.21.15.121:0/1043252019 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7fe8200e2df0 con 0x7fe8300659e0 2024-08-18T22:50:17.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:50:16 smithi195 ceph-mon[68841]: from='client.34502 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-18T22:50:17.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:50:16 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:50:17.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:50:16 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:50:17.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:50:16 smithi195 ceph-mon[68841]: from='client.? 172.21.15.121:0/553936047' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-08-18T22:50:17.250 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:17.248+0000 7fe835965640 1 -- 172.21.15.121:0/1043252019 --> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fe83010ecf0 con 0x7fe81806e0b0 2024-08-18T22:50:17.251 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:17.249+0000 7fe8177fe640 1 -- 172.21.15.121:0/1043252019 <== mgr.34102 v2:172.21.15.121:6800/3037387239 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+438 (secure 0 0 0) 0x7fe83010ecf0 con 0x7fe81806e0b0 2024-08-18T22:50:17.251 INFO:teuthology.orchestra.run.smithi121.stdout:{ 2024-08-18T22:50:17.251 INFO:teuthology.orchestra.run.smithi121.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9", 2024-08-18T22:50:17.251 INFO:teuthology.orchestra.run.smithi121.stdout: "in_progress": true, 2024-08-18T22:50:17.251 INFO:teuthology.orchestra.run.smithi121.stdout: "which": "Upgrading all daemon types on all hosts", 2024-08-18T22:50:17.251 INFO:teuthology.orchestra.run.smithi121.stdout: "services_complete": [ 2024-08-18T22:50:17.251 INFO:teuthology.orchestra.run.smithi121.stdout: "mon", 2024-08-18T22:50:17.252 INFO:teuthology.orchestra.run.smithi121.stdout: "osd", 2024-08-18T22:50:17.252 INFO:teuthology.orchestra.run.smithi121.stdout: "mgr", 2024-08-18T22:50:17.252 INFO:teuthology.orchestra.run.smithi121.stdout: "crash", 2024-08-18T22:50:17.252 INFO:teuthology.orchestra.run.smithi121.stdout: "mds" 2024-08-18T22:50:17.252 INFO:teuthology.orchestra.run.smithi121.stdout: ], 2024-08-18T22:50:17.252 INFO:teuthology.orchestra.run.smithi121.stdout: "progress": "16/21 daemons upgraded", 2024-08-18T22:50:17.252 INFO:teuthology.orchestra.run.smithi121.stdout: "message": "Currently upgrading prometheus daemons", 2024-08-18T22:50:17.252 INFO:teuthology.orchestra.run.smithi121.stdout: "is_paused": false 2024-08-18T22:50:17.252 INFO:teuthology.orchestra.run.smithi121.stdout:} 2024-08-18T22:50:17.253 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:17.251+0000 7fe835965640 1 -- 172.21.15.121:0/1043252019 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7fe81806e0b0 msgr2=0x7fe818070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:50:17.253 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:17.251+0000 7fe835965640 1 --2- 172.21.15.121:0/1043252019 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7fe81806e0b0 0x7fe818070560 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fe824006fd0 tx=0x7fe824008040 comp rx=0 tx=0).stop 2024-08-18T22:50:17.253 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:17.251+0000 7fe835965640 1 -- 172.21.15.121:0/1043252019 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe8300659e0 msgr2=0x7fe83010cf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:50:17.253 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:17.251+0000 7fe835965640 1 --2- 172.21.15.121:0/1043252019 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe8300659e0 0x7fe83010cf40 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fe8200048a0 tx=0x7fe820009da0 comp rx=0 tx=0).stop 2024-08-18T22:50:17.253 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:17.251+0000 7fe835965640 1 -- 172.21.15.121:0/1043252019 shutdown_connections 2024-08-18T22:50:17.253 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:17.251+0000 7fe835965640 1 --2- 172.21.15.121:0/1043252019 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7fe81806e0b0 0x7fe818070560 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:50:17.254 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:17.251+0000 7fe835965640 1 --2- 172.21.15.121:0/1043252019 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe8300ff420 0x7fe83010d480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:50:17.254 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:17.251+0000 7fe835965640 1 --2- 172.21.15.121:0/1043252019 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe8300659e0 0x7fe83010cf40 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:50:17.254 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:17.251+0000 7fe835965640 1 -- 172.21.15.121:0/1043252019 >> 172.21.15.121:0/1043252019 conn(0x7fe8300f69b0 msgr2=0x7fe8300f6d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:50:17.254 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:17.251+0000 7fe835965640 1 -- 172.21.15.121:0/1043252019 shutdown_connections 2024-08-18T22:50:17.254 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:17.251+0000 7fe835965640 1 -- 172.21.15.121:0/1043252019 wait complete. 2024-08-18T22:50:17.334 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:17.332+0000 7f650bb7a640 1 -- 172.21.15.121:0/1038012295 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f65040fd590 msgr2=0x7f65040fda00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:50:17.334 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:17.332+0000 7f650bb7a640 1 --2- 172.21.15.121:0/1038012295 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f65040fd590 0x7f65040fda00 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f64f40048d0 tx=0x7f64f4009da0 comp rx=0 tx=0).stop 2024-08-18T22:50:17.334 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:17.332+0000 7f650bb7a640 1 -- 172.21.15.121:0/1038012295 shutdown_connections 2024-08-18T22:50:17.335 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:17.332+0000 7f650bb7a640 1 --2- 172.21.15.121:0/1038012295 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f65040fd590 0x7f65040fda00 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:50:17.335 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:17.332+0000 7f650bb7a640 1 --2- 172.21.15.121:0/1038012295 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f65040fc2c0 0x7f65040fc6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:50:17.335 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:17.332+0000 7f650bb7a640 1 -- 172.21.15.121:0/1038012295 >> 172.21.15.121:0/1038012295 conn(0x7f65040f7a80 msgr2=0x7f65040f9eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:50:17.335 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:17.332+0000 7f650bb7a640 1 -- 172.21.15.121:0/1038012295 shutdown_connections 2024-08-18T22:50:17.335 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:17.332+0000 7f650bb7a640 1 -- 172.21.15.121:0/1038012295 wait complete. 2024-08-18T22:50:17.337 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:17.333+0000 7f650bb7a640 1 Processor -- start 2024-08-18T22:50:17.337 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:17.333+0000 7f650bb7a640 1 -- start start 2024-08-18T22:50:17.337 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:17.333+0000 7f650bb7a640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f65040fc2c0 0x7f650410f040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:50:17.337 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:17.333+0000 7f650bb7a640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f65040fd590 0x7f650410f580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:50:17.337 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:17.333+0000 7f650bb7a640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f650410fbd0 con 0x7f65040fc2c0 2024-08-18T22:50:17.337 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:17.333+0000 7f650bb7a640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65041103f0 con 0x7f65040fd590 2024-08-18T22:50:17.337 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:17.333+0000 7f6509916640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f65040fc2c0 0x7f650410f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:50:17.337 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:17.333+0000 7f6509916640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f65040fc2c0 0x7f650410f040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:41832/0 (socket says 172.21.15.121:41832) 2024-08-18T22:50:17.337 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:17.333+0000 7f6509916640 1 -- 172.21.15.121:0/203302791 learned_addr learned my addr 172.21.15.121:0/203302791 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-18T22:50:17.337 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:17.333+0000 7f6509115640 1 --2- 172.21.15.121:0/203302791 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f65040fd590 0x7f650410f580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:50:17.337 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:17.334+0000 7f6509916640 1 -- 172.21.15.121:0/203302791 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f65040fd590 msgr2=0x7f650410f580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:50:17.338 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:17.334+0000 7f6509916640 1 --2- 172.21.15.121:0/203302791 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f65040fd590 0x7f650410f580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:50:17.338 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:17.334+0000 7f6509916640 1 -- 172.21.15.121:0/203302791 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64f4005040 con 0x7f65040fc2c0 2024-08-18T22:50:17.338 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:17.334+0000 7f6509916640 1 --2- 172.21.15.121:0/203302791 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f65040fc2c0 0x7f650410f040 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f650000eb70 tx=0x7f650000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:50:17.338 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:17.334+0000 7f64fa7fc640 1 -- 172.21.15.121:0/203302791 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6500007c30 con 0x7f65040fc2c0 2024-08-18T22:50:17.338 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:17.334+0000 7f64fa7fc640 1 -- 172.21.15.121:0/203302791 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f650000f040 con 0x7f65040fc2c0 2024-08-18T22:50:17.338 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:17.334+0000 7f650bb7a640 1 -- 172.21.15.121:0/203302791 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6504110620 con 0x7f65040fc2c0 2024-08-18T22:50:17.338 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:17.334+0000 7f64fa7fc640 1 -- 172.21.15.121:0/203302791 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f650000ca60 con 0x7f65040fc2c0 2024-08-18T22:50:17.338 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:17.334+0000 7f650bb7a640 1 -- 172.21.15.121:0/203302791 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6504110b70 con 0x7f65040fc2c0 2024-08-18T22:50:17.339 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:17.335+0000 7f650bb7a640 1 -- 172.21.15.121:0/203302791 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65040fb720 con 0x7f65040fc2c0 2024-08-18T22:50:17.339 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:17.336+0000 7f64fa7fc640 1 -- 172.21.15.121:0/203302791 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 37) v1 ==== 92205+0+0 (secure 0 0 0) 0x7f650000cbc0 con 0x7f65040fc2c0 2024-08-18T22:50:17.339 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:17.336+0000 7f64fa7fc640 1 --2- 172.21.15.121:0/203302791 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f64f006e0b0 0x7f64f0070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:50:17.339 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:17.337+0000 7f64fa7fc640 1 -- 172.21.15.121:0/203302791 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6668+0+0 (secure 0 0 0) 0x7f650008d8f0 con 0x7f65040fc2c0 2024-08-18T22:50:17.339 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:17.337+0000 7f6509115640 1 --2- 172.21.15.121:0/203302791 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f64f006e0b0 0x7f64f0070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:50:17.339 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:17.337+0000 7f6509115640 1 --2- 172.21.15.121:0/203302791 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f64f006e0b0 0x7f64f0070560 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f650410edf0 tx=0x7f64f4035040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:50:17.343 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:17.341+0000 7f64fa7fc640 1 -- 172.21.15.121:0/203302791 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f6500056b80 con 0x7f65040fc2c0 2024-08-18T22:50:17.586 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:17.584+0000 7f650bb7a640 1 -- 172.21.15.121:0/203302791 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f650404b4c0 con 0x7f65040fc2c0 2024-08-18T22:50:17.586 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:17.584+0000 7f64fa7fc640 1 -- 172.21.15.121:0/203302791 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f650005a240 con 0x7f65040fc2c0 2024-08-18T22:50:17.586 INFO:teuthology.orchestra.run.smithi121.stdout:HEALTH_OK 2024-08-18T22:50:17.588 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:17.586+0000 7f650bb7a640 1 -- 172.21.15.121:0/203302791 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f64f006e0b0 msgr2=0x7f64f0070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:50:17.588 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:17.586+0000 7f650bb7a640 1 --2- 172.21.15.121:0/203302791 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f64f006e0b0 0x7f64f0070560 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f650410edf0 tx=0x7f64f4035040 comp rx=0 tx=0).stop 2024-08-18T22:50:17.588 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:17.586+0000 7f650bb7a640 1 -- 172.21.15.121:0/203302791 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f65040fc2c0 msgr2=0x7f650410f040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:50:17.588 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:17.586+0000 7f650bb7a640 1 --2- 172.21.15.121:0/203302791 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f65040fc2c0 0x7f650410f040 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f650000eb70 tx=0x7f650000b040 comp rx=0 tx=0).stop 2024-08-18T22:50:17.588 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:17.586+0000 7f650bb7a640 1 -- 172.21.15.121:0/203302791 shutdown_connections 2024-08-18T22:50:17.588 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:17.586+0000 7f650bb7a640 1 --2- 172.21.15.121:0/203302791 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f64f006e0b0 0x7f64f0070560 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:50:17.589 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:17.586+0000 7f650bb7a640 1 --2- 172.21.15.121:0/203302791 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f65040fd590 0x7f650410f580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:50:17.589 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:17.586+0000 7f650bb7a640 1 --2- 172.21.15.121:0/203302791 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f65040fc2c0 0x7f650410f040 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:50:17.589 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:17.586+0000 7f650bb7a640 1 -- 172.21.15.121:0/203302791 >> 172.21.15.121:0/203302791 conn(0x7f65040f7a80 msgr2=0x7f65040f91c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:50:17.589 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:17.586+0000 7f650bb7a640 1 -- 172.21.15.121:0/203302791 shutdown_connections 2024-08-18T22:50:17.589 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:17.586+0000 7f650bb7a640 1 -- 172.21.15.121:0/203302791 wait complete. 2024-08-18T22:50:17.852 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:50:17 smithi121 ceph-mon[81053]: from='client.34506 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-18T22:50:17.853 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:50:17 smithi121 ceph-mon[81053]: from='client.34510 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-18T22:50:17.853 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:50:17 smithi121 ceph-mon[81053]: pgmap v236: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail; 170 B/s rd, 1023 B/s wr, 0 op/s 2024-08-18T22:50:17.853 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:50:17 smithi121 ceph-mon[81053]: from='client.? 172.21.15.121:0/972392583' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-08-18T22:50:17.853 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:50:17 smithi121 ceph-mon[81053]: from='client.? 172.21.15.121:0/203302791' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-08-18T22:50:18.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:50:17 smithi195 ceph-mon[68841]: from='client.34506 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-18T22:50:18.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:50:17 smithi195 ceph-mon[68841]: from='client.34510 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-18T22:50:18.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:50:17 smithi195 ceph-mon[68841]: pgmap v236: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail; 170 B/s rd, 1023 B/s wr, 0 op/s 2024-08-18T22:50:18.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:50:17 smithi195 ceph-mon[68841]: from='client.? 172.21.15.121:0/972392583' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-08-18T22:50:18.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:50:17 smithi195 ceph-mon[68841]: from='client.? 172.21.15.121:0/203302791' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-08-18T22:50:19.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:50:18 smithi121 ceph-mon[81053]: from='client.34522 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-18T22:50:19.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:50:18 smithi195 ceph-mon[68841]: from='client.34522 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-18T22:50:20.021 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:50:19 smithi121 ceph-mon[81053]: pgmap v237: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:50:20.021 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:50:19 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:50:20.021 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:50:19 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:50:20.021 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:50:19 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:50:20.021 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:50:19 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-18T22:50:20.021 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:50:19 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:50:20.021 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:50:19 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-08-18T22:50:20.021 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:50:19 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-18T22:50:20.021 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:50:19 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "versions"}]: dispatch 2024-08-18T22:50:20.021 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:50:19 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "versions"}]: dispatch 2024-08-18T22:50:20.021 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:50:19 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "versions"}]: dispatch 2024-08-18T22:50:20.022 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:50:19 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "versions"}]: dispatch 2024-08-18T22:50:20.022 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:50:19 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "versions"}]: dispatch 2024-08-18T22:50:20.022 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:50:19 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "versions"}]: dispatch 2024-08-18T22:50:20.022 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:50:19 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "versions"}]: dispatch 2024-08-18T22:50:20.022 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:50:19 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "versions"}]: dispatch 2024-08-18T22:50:20.022 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:50:19 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "versions"}]: dispatch 2024-08-18T22:50:20.022 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:50:19 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "versions"}]: dispatch 2024-08-18T22:50:20.022 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:50:19 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "versions"}]: dispatch 2024-08-18T22:50:20.022 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:50:19 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "versions"}]: dispatch 2024-08-18T22:50:20.022 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:50:19 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "versions"}]: dispatch 2024-08-18T22:50:20.022 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:50:19 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "versions"}]: dispatch 2024-08-18T22:50:20.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:50:19 smithi195 ceph-mon[68841]: pgmap v237: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:50:20.160 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:50:19 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:50:20.160 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:50:19 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:50:20.160 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:50:19 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:50:20.160 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:50:19 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-18T22:50:20.160 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:50:19 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:50:20.160 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:50:19 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-08-18T22:50:20.160 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:50:19 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-18T22:50:20.160 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:50:19 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "versions"}]: dispatch 2024-08-18T22:50:20.160 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:50:19 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "versions"}]: dispatch 2024-08-18T22:50:20.160 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:50:19 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "versions"}]: dispatch 2024-08-18T22:50:20.161 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:50:19 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "versions"}]: dispatch 2024-08-18T22:50:20.161 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:50:19 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "versions"}]: dispatch 2024-08-18T22:50:20.161 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:50:19 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "versions"}]: dispatch 2024-08-18T22:50:20.161 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:50:19 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "versions"}]: dispatch 2024-08-18T22:50:20.161 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:50:19 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "versions"}]: dispatch 2024-08-18T22:50:20.161 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:50:19 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "versions"}]: dispatch 2024-08-18T22:50:20.161 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:50:19 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "versions"}]: dispatch 2024-08-18T22:50:20.161 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:50:19 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "versions"}]: dispatch 2024-08-18T22:50:20.161 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:50:19 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "versions"}]: dispatch 2024-08-18T22:50:20.161 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:50:19 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "versions"}]: dispatch 2024-08-18T22:50:20.161 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:50:19 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "versions"}]: dispatch 2024-08-18T22:50:21.060 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:50:20 smithi195 ceph-mon[68841]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-08-18T22:50:21.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:50:20 smithi121 ceph-mon[81053]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-08-18T22:50:22.072 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:50:21 smithi195 ceph-mon[68841]: pgmap v238: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:50:22.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:50:21 smithi121 ceph-mon[81053]: pgmap v238: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:50:22.833 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:50:22 smithi121 ceph-mon[81053]: Upgrade: Updating alertmanager.smithi121 2024-08-18T22:50:22.833 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:50:22 smithi121 ceph-mon[81053]: Deploying daemon alertmanager.smithi121 on smithi121 2024-08-18T22:50:23.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:50:22 smithi195 ceph-mon[68841]: Upgrade: Updating alertmanager.smithi121 2024-08-18T22:50:23.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:50:22 smithi195 ceph-mon[68841]: Deploying daemon alertmanager.smithi121 on smithi121 2024-08-18T22:50:23.961 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:50:23 smithi121 ceph-mon[81053]: pgmap v239: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:50:23.962 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:50:23 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-18T22:50:24.158 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:50:23 smithi195 ceph-mon[68841]: pgmap v239: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:50:24.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:50:23 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-18T22:50:26.020 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:50:25 smithi121 ceph-mon[81053]: pgmap v240: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:50:26.158 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:50:25 smithi195 ceph-mon[68841]: pgmap v240: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:50:27.872 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:50:27 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:50:27.872 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:50:27 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:50:27.873 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:50:27 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-18T22:50:27.873 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:50:27 smithi121 ceph-mon[81053]: pgmap v241: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:50:27.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:50:27 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:50:27.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:50:27 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:50:27.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:50:27 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-18T22:50:27.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:50:27 smithi195 ceph-mon[68841]: pgmap v241: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:50:29.925 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:50:29 smithi121 ceph-mon[81053]: pgmap v242: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:50:30.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:50:29 smithi195 ceph-mon[68841]: pgmap v242: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:50:31.764 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:50:31 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:50:31.764 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:50:31 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:50:31.764 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:50:31 smithi121 ceph-mon[81053]: pgmap v243: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:50:31.764 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:50:31 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:50:31.764 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:50:31 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:50:31.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:50:31 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:50:31.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:50:31 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:50:31.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:50:31 smithi195 ceph-mon[68841]: pgmap v243: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:50:31.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:50:31 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:50:31.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:50:31 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:50:34.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:50:33 smithi121 ceph-mon[81053]: pgmap v244: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:50:34.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:50:33 smithi195 ceph-mon[68841]: pgmap v244: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:50:35.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:50:35 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:50:35.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:50:35 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:50:35.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:50:35 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:50:35.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:50:35 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-18T22:50:35.910 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:50:35 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:50:35.910 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:50:35 smithi195 ceph-mon[68841]: pgmap v245: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:50:35.910 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:50:35 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-08-18T22:50:35.910 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:50:35 smithi195 ceph-mon[68841]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-08-18T22:50:35.910 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:50:35 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi121:9093"}]: dispatch 2024-08-18T22:50:35.910 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:50:35 smithi195 ceph-mon[68841]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi121:9093"}]: dispatch 2024-08-18T22:50:35.910 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:50:35 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:50:35.910 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:50:35 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-18T22:50:35.910 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:50:35 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "versions"}]: dispatch 2024-08-18T22:50:35.910 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:50:35 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "versions"}]: dispatch 2024-08-18T22:50:35.910 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:50:35 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "versions"}]: dispatch 2024-08-18T22:50:35.910 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:50:35 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "versions"}]: dispatch 2024-08-18T22:50:35.911 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:50:35 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "versions"}]: dispatch 2024-08-18T22:50:35.911 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:50:35 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "versions"}]: dispatch 2024-08-18T22:50:35.911 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:50:35 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "versions"}]: dispatch 2024-08-18T22:50:35.911 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:50:35 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "versions"}]: dispatch 2024-08-18T22:50:35.911 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:50:35 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "versions"}]: dispatch 2024-08-18T22:50:35.911 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:50:35 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "versions"}]: dispatch 2024-08-18T22:50:35.911 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:50:35 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "versions"}]: dispatch 2024-08-18T22:50:35.911 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:50:35 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "versions"}]: dispatch 2024-08-18T22:50:35.911 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:50:35 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "versions"}]: dispatch 2024-08-18T22:50:35.911 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:50:35 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "versions"}]: dispatch 2024-08-18T22:50:35.911 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:50:35 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "versions"}]: dispatch 2024-08-18T22:50:35.967 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:50:35 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:50:35.967 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:50:35 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:50:35.967 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:50:35 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:50:35.967 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:50:35 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-18T22:50:35.967 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:50:35 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:50:35.967 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:50:35 smithi121 ceph-mon[81053]: pgmap v245: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:50:35.967 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:50:35 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-08-18T22:50:35.967 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:50:35 smithi121 ceph-mon[81053]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-08-18T22:50:35.968 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:50:35 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi121:9093"}]: dispatch 2024-08-18T22:50:35.968 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:50:35 smithi121 ceph-mon[81053]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi121:9093"}]: dispatch 2024-08-18T22:50:35.968 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:50:35 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:50:35.968 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:50:35 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-18T22:50:35.968 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:50:35 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "versions"}]: dispatch 2024-08-18T22:50:35.968 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:50:35 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "versions"}]: dispatch 2024-08-18T22:50:35.968 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:50:35 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "versions"}]: dispatch 2024-08-18T22:50:35.968 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:50:35 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "versions"}]: dispatch 2024-08-18T22:50:35.968 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:50:35 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "versions"}]: dispatch 2024-08-18T22:50:35.968 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:50:35 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "versions"}]: dispatch 2024-08-18T22:50:35.968 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:50:35 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "versions"}]: dispatch 2024-08-18T22:50:35.968 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:50:35 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "versions"}]: dispatch 2024-08-18T22:50:35.968 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:50:35 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "versions"}]: dispatch 2024-08-18T22:50:35.968 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:50:35 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "versions"}]: dispatch 2024-08-18T22:50:35.968 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:50:35 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "versions"}]: dispatch 2024-08-18T22:50:35.969 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:50:35 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "versions"}]: dispatch 2024-08-18T22:50:35.969 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:50:35 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "versions"}]: dispatch 2024-08-18T22:50:35.969 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:50:35 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "versions"}]: dispatch 2024-08-18T22:50:35.969 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:50:35 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "versions"}]: dispatch 2024-08-18T22:50:38.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:50:37 smithi121 ceph-mon[81053]: Upgrade: Updating grafana.smithi121 2024-08-18T22:50:38.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:50:37 smithi121 ceph-mon[81053]: Deploying daemon grafana.smithi121 on smithi121 2024-08-18T22:50:38.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:50:37 smithi121 ceph-mon[81053]: pgmap v246: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:50:38.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:50:37 smithi195 ceph-mon[68841]: Upgrade: Updating grafana.smithi121 2024-08-18T22:50:38.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:50:37 smithi195 ceph-mon[68841]: Deploying daemon grafana.smithi121 on smithi121 2024-08-18T22:50:38.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:50:37 smithi195 ceph-mon[68841]: pgmap v246: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:50:38.937 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:50:38 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-18T22:50:39.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:50:38 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-18T22:50:40.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:50:39 smithi121 ceph-mon[81053]: pgmap v247: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:50:40.158 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:50:39 smithi195 ceph-mon[68841]: pgmap v247: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:50:42.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:50:41 smithi121 ceph-mon[81053]: pgmap v248: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:50:42.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:50:41 smithi195 ceph-mon[68841]: pgmap v248: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:50:43.833 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:50:43 smithi121 ceph-mon[81053]: pgmap v249: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:50:44.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:50:43 smithi195 ceph-mon[68841]: pgmap v249: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:50:45.833 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:50:45 smithi121 ceph-mon[81053]: pgmap v250: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:50:46.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:50:45 smithi195 ceph-mon[68841]: pgmap v250: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:50:47.691 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:47.687+0000 7efd39724640 1 -- 172.21.15.121:0/4133201607 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efd340ff450 msgr2=0x7efd34101830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:50:47.691 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:47.687+0000 7efd39724640 1 --2- 172.21.15.121:0/4133201607 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efd340ff450 0x7efd34101830 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7efd280048d0 tx=0x7efd28009da0 comp rx=0 tx=0).stop 2024-08-18T22:50:47.691 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:47.687+0000 7efd39724640 1 -- 172.21.15.121:0/4133201607 shutdown_connections 2024-08-18T22:50:47.691 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:47.687+0000 7efd39724640 1 --2- 172.21.15.121:0/4133201607 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efd340ff450 0x7efd34101830 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:50:47.691 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:47.687+0000 7efd39724640 1 --2- 172.21.15.121:0/4133201607 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7efd34066450 0x7efd340fef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:50:47.691 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:47.687+0000 7efd39724640 1 -- 172.21.15.121:0/4133201607 >> 172.21.15.121:0/4133201607 conn(0x7efd340f69e0 msgr2=0x7efd340f8df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:50:47.691 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:47.687+0000 7efd39724640 1 -- 172.21.15.121:0/4133201607 shutdown_connections 2024-08-18T22:50:47.692 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:47.687+0000 7efd39724640 1 -- 172.21.15.121:0/4133201607 wait complete. 2024-08-18T22:50:47.692 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:47.688+0000 7efd39724640 1 Processor -- start 2024-08-18T22:50:47.692 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:47.688+0000 7efd39724640 1 -- start start 2024-08-18T22:50:47.692 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:47.689+0000 7efd39724640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efd34066450 0x7efd340fc920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:50:47.692 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:47.689+0000 7efd39724640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7efd340ff450 0x7efd340fae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:50:47.692 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:47.689+0000 7efd39724640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd34110ab0 con 0x7efd34066450 2024-08-18T22:50:47.692 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:47.689+0000 7efd39724640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd34110bf0 con 0x7efd340ff450 2024-08-18T22:50:47.692 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:47.689+0000 7efd32ffd640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efd34066450 0x7efd340fc920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:50:47.692 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:47.689+0000 7efd32ffd640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efd34066450 0x7efd340fc920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:53822/0 (socket says 172.21.15.121:53822) 2024-08-18T22:50:47.692 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:47.689+0000 7efd32ffd640 1 -- 172.21.15.121:0/1952967859 learned_addr learned my addr 172.21.15.121:0/1952967859 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-18T22:50:47.692 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:47.689+0000 7efd327fc640 1 --2- 172.21.15.121:0/1952967859 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7efd340ff450 0x7efd340fae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:50:47.692 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:47.689+0000 7efd32ffd640 1 -- 172.21.15.121:0/1952967859 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7efd340ff450 msgr2=0x7efd340fae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:50:47.692 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:47.689+0000 7efd32ffd640 1 --2- 172.21.15.121:0/1952967859 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7efd340ff450 0x7efd340fae10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:50:47.693 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:47.689+0000 7efd32ffd640 1 -- 172.21.15.121:0/1952967859 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd28005040 con 0x7efd34066450 2024-08-18T22:50:47.693 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:47.689+0000 7efd327fc640 1 --2- 172.21.15.121:0/1952967859 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7efd340ff450 0x7efd340fae10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T22:50:47.693 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:47.690+0000 7efd32ffd640 1 --2- 172.21.15.121:0/1952967859 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efd34066450 0x7efd340fc920 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7efd2400eb70 tx=0x7efd2400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:50:47.693 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:47.690+0000 7efd1b7fe640 1 -- 172.21.15.121:0/1952967859 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efd24007c30 con 0x7efd34066450 2024-08-18T22:50:47.693 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:47.690+0000 7efd39724640 1 -- 172.21.15.121:0/1952967859 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd34110ed0 con 0x7efd34066450 2024-08-18T22:50:47.693 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:47.690+0000 7efd1b7fe640 1 -- 172.21.15.121:0/1952967859 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7efd2400f040 con 0x7efd34066450 2024-08-18T22:50:47.693 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:47.690+0000 7efd1b7fe640 1 -- 172.21.15.121:0/1952967859 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efd2400cb00 con 0x7efd34066450 2024-08-18T22:50:47.693 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:47.690+0000 7efd39724640 1 -- 172.21.15.121:0/1952967859 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd34111470 con 0x7efd34066450 2024-08-18T22:50:47.694 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:47.691+0000 7efd39724640 1 -- 172.21.15.121:0/1952967859 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd340fa660 con 0x7efd34066450 2024-08-18T22:50:47.694 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:47.692+0000 7efd1b7fe640 1 -- 172.21.15.121:0/1952967859 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 37) v1 ==== 92205+0+0 (secure 0 0 0) 0x7efd24009110 con 0x7efd34066450 2024-08-18T22:50:47.694 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:47.692+0000 7efd1b7fe640 1 --2- 172.21.15.121:0/1952967859 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7efd1c06e0b0 0x7efd1c070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:50:47.694 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:47.692+0000 7efd1b7fe640 1 -- 172.21.15.121:0/1952967859 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6668+0+0 (secure 0 0 0) 0x7efd2408ded0 con 0x7efd34066450 2024-08-18T22:50:47.694 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:47.692+0000 7efd327fc640 1 --2- 172.21.15.121:0/1952967859 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7efd1c06e0b0 0x7efd1c070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:50:47.694 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:47.693+0000 7efd327fc640 1 --2- 172.21.15.121:0/1952967859 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7efd1c06e0b0 0x7efd1c070560 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7efd28000c00 tx=0x7efd28035040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:50:47.701 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:47.700+0000 7efd1b7fe640 1 -- 172.21.15.121:0/1952967859 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7efd24057150 con 0x7efd34066450 2024-08-18T22:50:47.924 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:47.923+0000 7efd39724640 1 -- 172.21.15.121:0/1952967859 --> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7efd340f84d0 con 0x7efd1c06e0b0 2024-08-18T22:50:47.925 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:47.924+0000 7efd1b7fe640 1 -- 172.21.15.121:0/1952967859 <== mgr.34102 v2:172.21.15.121:6800/3037387239 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+435 (secure 0 0 0) 0x7efd340f84d0 con 0x7efd1c06e0b0 2024-08-18T22:50:47.927 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:47.926+0000 7efd39724640 1 -- 172.21.15.121:0/1952967859 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7efd1c06e0b0 msgr2=0x7efd1c070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:50:47.927 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:47.926+0000 7efd39724640 1 --2- 172.21.15.121:0/1952967859 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7efd1c06e0b0 0x7efd1c070560 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7efd28000c00 tx=0x7efd28035040 comp rx=0 tx=0).stop 2024-08-18T22:50:47.928 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:47.926+0000 7efd39724640 1 -- 172.21.15.121:0/1952967859 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efd34066450 msgr2=0x7efd340fc920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:50:47.928 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:47.926+0000 7efd39724640 1 --2- 172.21.15.121:0/1952967859 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efd34066450 0x7efd340fc920 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7efd2400eb70 tx=0x7efd2400b040 comp rx=0 tx=0).stop 2024-08-18T22:50:47.928 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:47.926+0000 7efd39724640 1 -- 172.21.15.121:0/1952967859 shutdown_connections 2024-08-18T22:50:47.928 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:47.926+0000 7efd39724640 1 --2- 172.21.15.121:0/1952967859 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7efd1c06e0b0 0x7efd1c070560 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:50:47.928 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:47.926+0000 7efd39724640 1 --2- 172.21.15.121:0/1952967859 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7efd340ff450 0x7efd340fae10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:50:47.928 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:47.926+0000 7efd39724640 1 --2- 172.21.15.121:0/1952967859 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efd34066450 0x7efd340fc920 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:50:47.928 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:47.926+0000 7efd39724640 1 -- 172.21.15.121:0/1952967859 >> 172.21.15.121:0/1952967859 conn(0x7efd340f69e0 msgr2=0x7efd340f6db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:50:47.928 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:47.927+0000 7efd39724640 1 -- 172.21.15.121:0/1952967859 shutdown_connections 2024-08-18T22:50:47.928 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:47.927+0000 7efd39724640 1 -- 172.21.15.121:0/1952967859 wait complete. 2024-08-18T22:50:47.936 INFO:teuthology.orchestra.run.smithi121.stdout:true 2024-08-18T22:50:47.937 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:50:47 smithi121 ceph-mon[81053]: pgmap v251: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:50:47.937 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:50:47 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:50:47.937 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:50:47 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:50:47.937 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:50:47 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-18T22:50:48.012 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:48.010+0000 7f6b183a0640 1 -- 172.21.15.121:0/1979194269 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6b100fc4a0 msgr2=0x7f6b100fc910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:50:48.012 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:48.010+0000 7f6b183a0640 1 --2- 172.21.15.121:0/1979194269 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6b100fc4a0 0x7f6b100fc910 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f6b000048d0 tx=0x7f6b00009da0 comp rx=0 tx=0).stop 2024-08-18T22:50:48.012 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:48.010+0000 7f6b183a0640 1 -- 172.21.15.121:0/1979194269 shutdown_connections 2024-08-18T22:50:48.012 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:48.010+0000 7f6b183a0640 1 --2- 172.21.15.121:0/1979194269 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6b100fc4a0 0x7f6b100fc910 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:50:48.012 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:48.010+0000 7f6b183a0640 1 --2- 172.21.15.121:0/1979194269 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6b100fb1d0 0x7f6b100fb5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:50:48.012 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:48.010+0000 7f6b183a0640 1 -- 172.21.15.121:0/1979194269 >> 172.21.15.121:0/1979194269 conn(0x7f6b100f69b0 msgr2=0x7f6b100f8dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:50:48.012 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:48.010+0000 7f6b183a0640 1 -- 172.21.15.121:0/1979194269 shutdown_connections 2024-08-18T22:50:48.012 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:48.010+0000 7f6b183a0640 1 -- 172.21.15.121:0/1979194269 wait complete. 2024-08-18T22:50:48.012 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:48.010+0000 7f6b183a0640 1 Processor -- start 2024-08-18T22:50:48.013 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:48.010+0000 7f6b183a0640 1 -- start start 2024-08-18T22:50:48.013 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:48.010+0000 7f6b183a0640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6b100fb1d0 0x7f6b1010cee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:50:48.013 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:48.010+0000 7f6b183a0640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6b100fc4a0 0x7f6b1010d420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:50:48.013 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:48.010+0000 7f6b183a0640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b1010e140 con 0x7f6b100fc4a0 2024-08-18T22:50:48.013 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:48.010+0000 7f6b183a0640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b1010e2b0 con 0x7f6b100fb1d0 2024-08-18T22:50:48.013 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:48.011+0000 7f6b1593b640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6b100fc4a0 0x7f6b1010d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:50:48.013 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:48.011+0000 7f6b1593b640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6b100fc4a0 0x7f6b1010d420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:53846/0 (socket says 172.21.15.121:53846) 2024-08-18T22:50:48.013 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:48.011+0000 7f6b1593b640 1 -- 172.21.15.121:0/101988937 learned_addr learned my addr 172.21.15.121:0/101988937 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-18T22:50:48.013 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:48.011+0000 7f6b1613c640 1 --2- 172.21.15.121:0/101988937 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6b100fb1d0 0x7f6b1010cee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:50:48.013 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:48.011+0000 7f6b1593b640 1 -- 172.21.15.121:0/101988937 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6b100fb1d0 msgr2=0x7f6b1010cee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:50:48.013 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:48.011+0000 7f6b1593b640 1 --2- 172.21.15.121:0/101988937 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6b100fb1d0 0x7f6b1010cee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:50:48.013 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:48.011+0000 7f6b1593b640 1 -- 172.21.15.121:0/101988937 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b00005040 con 0x7f6b100fc4a0 2024-08-18T22:50:48.014 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:48.011+0000 7f6b1593b640 1 --2- 172.21.15.121:0/101988937 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6b100fc4a0 0x7f6b1010d420 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f6b00003080 tx=0x7f6b00009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:50:48.015 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:48.011+0000 7f6b06ffd640 1 -- 172.21.15.121:0/101988937 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6b00038070 con 0x7f6b100fc4a0 2024-08-18T22:50:48.015 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:48.011+0000 7f6b06ffd640 1 -- 172.21.15.121:0/101988937 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f6b0002abd0 con 0x7f6b100fc4a0 2024-08-18T22:50:48.015 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:48.011+0000 7f6b183a0640 1 -- 172.21.15.121:0/101988937 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b1010e530 con 0x7f6b100fc4a0 2024-08-18T22:50:48.015 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:48.011+0000 7f6b06ffd640 1 -- 172.21.15.121:0/101988937 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6b0003e670 con 0x7f6b100fc4a0 2024-08-18T22:50:48.015 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:48.011+0000 7f6b183a0640 1 -- 172.21.15.121:0/101988937 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b1010ea50 con 0x7f6b100fc4a0 2024-08-18T22:50:48.015 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:48.013+0000 7f6b183a0640 1 -- 172.21.15.121:0/101988937 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b100fa630 con 0x7f6b100fc4a0 2024-08-18T22:50:48.015 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:48.013+0000 7f6b06ffd640 1 -- 172.21.15.121:0/101988937 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 37) v1 ==== 92205+0+0 (secure 0 0 0) 0x7f6b00030020 con 0x7f6b100fc4a0 2024-08-18T22:50:48.015 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:48.013+0000 7f6b06ffd640 1 --2- 172.21.15.121:0/101988937 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f6afc06e0b0 0x7f6afc070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:50:48.015 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:48.013+0000 7f6b1613c640 1 --2- 172.21.15.121:0/101988937 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f6afc06e0b0 0x7f6afc070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:50:48.015 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:48.013+0000 7f6b06ffd640 1 -- 172.21.15.121:0/101988937 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6668+0+0 (secure 0 0 0) 0x7f6b000adf80 con 0x7f6b100fc4a0 2024-08-18T22:50:48.015 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:48.014+0000 7f6b1613c640 1 --2- 172.21.15.121:0/101988937 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f6afc06e0b0 0x7f6afc070560 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f6b1010cc70 tx=0x7f6b0c009120 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:50:48.023 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:48.022+0000 7f6b06ffd640 1 -- 172.21.15.121:0/101988937 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f6b000772b0 con 0x7f6b100fc4a0 2024-08-18T22:50:48.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:50:47 smithi195 ceph-mon[68841]: pgmap v251: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:50:48.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:50:47 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:50:48.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:50:47 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:50:48.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:50:47 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-18T22:50:48.234 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:48.232+0000 7f6b183a0640 1 -- 172.21.15.121:0/101988937 --> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f6b1010ed30 con 0x7f6afc06e0b0 2024-08-18T22:50:48.235 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:48.234+0000 7f6b06ffd640 1 -- 172.21.15.121:0/101988937 <== mgr.34102 v2:172.21.15.121:6800/3037387239 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+435 (secure 0 0 0) 0x7f6b1010ed30 con 0x7f6afc06e0b0 2024-08-18T22:50:48.240 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:48.239+0000 7f6b183a0640 1 -- 172.21.15.121:0/101988937 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f6afc06e0b0 msgr2=0x7f6afc070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:50:48.241 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:48.239+0000 7f6b183a0640 1 --2- 172.21.15.121:0/101988937 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f6afc06e0b0 0x7f6afc070560 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f6b1010cc70 tx=0x7f6b0c009120 comp rx=0 tx=0).stop 2024-08-18T22:50:48.241 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:48.239+0000 7f6b183a0640 1 -- 172.21.15.121:0/101988937 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6b100fc4a0 msgr2=0x7f6b1010d420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:50:48.241 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:48.239+0000 7f6b183a0640 1 --2- 172.21.15.121:0/101988937 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6b100fc4a0 0x7f6b1010d420 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f6b00003080 tx=0x7f6b00009da0 comp rx=0 tx=0).stop 2024-08-18T22:50:48.241 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:48.239+0000 7f6b183a0640 1 -- 172.21.15.121:0/101988937 shutdown_connections 2024-08-18T22:50:48.241 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:48.239+0000 7f6b183a0640 1 --2- 172.21.15.121:0/101988937 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f6afc06e0b0 0x7f6afc070560 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:50:48.241 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:48.239+0000 7f6b183a0640 1 --2- 172.21.15.121:0/101988937 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6b100fc4a0 0x7f6b1010d420 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:50:48.241 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:48.239+0000 7f6b183a0640 1 --2- 172.21.15.121:0/101988937 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6b100fb1d0 0x7f6b1010cee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:50:48.241 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:48.239+0000 7f6b183a0640 1 -- 172.21.15.121:0/101988937 >> 172.21.15.121:0/101988937 conn(0x7f6b100f69b0 msgr2=0x7f6b10064d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:50:48.241 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:48.239+0000 7f6b183a0640 1 -- 172.21.15.121:0/101988937 shutdown_connections 2024-08-18T22:50:48.241 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:48.239+0000 7f6b183a0640 1 -- 172.21.15.121:0/101988937 wait complete. 2024-08-18T22:50:48.322 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:48.320+0000 7f7f8de62640 1 -- 172.21.15.121:0/3573158360 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7f88106cd0 msgr2=0x7f7f881070e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:50:48.323 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:48.320+0000 7f7f8de62640 1 --2- 172.21.15.121:0/3573158360 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7f88106cd0 0x7f7f881070e0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f7f780048d0 tx=0x7f7f78009da0 comp rx=0 tx=0).stop 2024-08-18T22:50:48.323 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:48.320+0000 7f7f8de62640 1 -- 172.21.15.121:0/3573158360 shutdown_connections 2024-08-18T22:50:48.323 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:48.320+0000 7f7f8de62640 1 --2- 172.21.15.121:0/3573158360 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7f88107fa0 0x7f7f88108410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:50:48.323 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:48.320+0000 7f7f8de62640 1 --2- 172.21.15.121:0/3573158360 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7f88106cd0 0x7f7f881070e0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:50:48.323 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:48.320+0000 7f7f8de62640 1 -- 172.21.15.121:0/3573158360 >> 172.21.15.121:0/3573158360 conn(0x7f7f88066b80 msgr2=0x7f7f88066f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:50:48.323 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:48.320+0000 7f7f8de62640 1 -- 172.21.15.121:0/3573158360 shutdown_connections 2024-08-18T22:50:48.323 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:48.320+0000 7f7f8de62640 1 -- 172.21.15.121:0/3573158360 wait complete. 2024-08-18T22:50:48.323 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:48.320+0000 7f7f8de62640 1 Processor -- start 2024-08-18T22:50:48.323 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:48.320+0000 7f7f8de62640 1 -- start start 2024-08-18T22:50:48.323 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:48.321+0000 7f7f8de62640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7f88106cd0 0x7f7f88117830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:50:48.324 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:48.321+0000 7f7f8de62640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7f88107fa0 0x7f7f88117d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:50:48.324 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:48.321+0000 7f7f8de62640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f881183c0 con 0x7f7f88107fa0 2024-08-18T22:50:48.324 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:48.321+0000 7f7f8de62640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f88118be0 con 0x7f7f88106cd0 2024-08-18T22:50:48.324 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:48.321+0000 7f7f86ffd640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7f88107fa0 0x7f7f88117d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:50:48.324 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:48.321+0000 7f7f86ffd640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7f88107fa0 0x7f7f88117d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:53874/0 (socket says 172.21.15.121:53874) 2024-08-18T22:50:48.324 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:48.321+0000 7f7f86ffd640 1 -- 172.21.15.121:0/3280488929 learned_addr learned my addr 172.21.15.121:0/3280488929 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-18T22:50:48.324 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:48.321+0000 7f7f877fe640 1 --2- 172.21.15.121:0/3280488929 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7f88106cd0 0x7f7f88117830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:50:48.324 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:48.321+0000 7f7f86ffd640 1 -- 172.21.15.121:0/3280488929 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7f88106cd0 msgr2=0x7f7f88117830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:50:48.324 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:48.321+0000 7f7f86ffd640 1 --2- 172.21.15.121:0/3280488929 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7f88106cd0 0x7f7f88117830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:50:48.324 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:48.321+0000 7f7f86ffd640 1 -- 172.21.15.121:0/3280488929 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f78005040 con 0x7f7f88107fa0 2024-08-18T22:50:48.324 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:48.321+0000 7f7f86ffd640 1 --2- 172.21.15.121:0/3280488929 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7f88107fa0 0x7f7f88117d70 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f7f7c00c830 tx=0x7f7f7c004430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:50:48.324 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:48.321+0000 7f7f6ffff640 1 -- 172.21.15.121:0/3280488929 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7f7c00a850 con 0x7f7f88107fa0 2024-08-18T22:50:48.324 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:48.321+0000 7f7f6ffff640 1 -- 172.21.15.121:0/3280488929 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f7f7c00ae50 con 0x7f7f88107fa0 2024-08-18T22:50:48.325 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:48.321+0000 7f7f8de62640 1 -- 172.21.15.121:0/3280488929 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f88118e70 con 0x7f7f88107fa0 2024-08-18T22:50:48.325 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:48.321+0000 7f7f6ffff640 1 -- 172.21.15.121:0/3280488929 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7f7c0113a0 con 0x7f7f88107fa0 2024-08-18T22:50:48.325 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:48.321+0000 7f7f8de62640 1 -- 172.21.15.121:0/3280488929 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f88119410 con 0x7f7f88107fa0 2024-08-18T22:50:48.325 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:48.322+0000 7f7f8de62640 1 -- 172.21.15.121:0/3280488929 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f880687a0 con 0x7f7f88107fa0 2024-08-18T22:50:48.326 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:48.323+0000 7f7f6ffff640 1 -- 172.21.15.121:0/3280488929 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 37) v1 ==== 92205+0+0 (secure 0 0 0) 0x7f7f7c012400 con 0x7f7f88107fa0 2024-08-18T22:50:48.326 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:48.324+0000 7f7f6ffff640 1 --2- 172.21.15.121:0/3280488929 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f7f7006e0b0 0x7f7f70070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:50:48.326 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:48.324+0000 7f7f877fe640 1 --2- 172.21.15.121:0/3280488929 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f7f7006e0b0 0x7f7f70070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:50:48.326 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:48.324+0000 7f7f6ffff640 1 -- 172.21.15.121:0/3280488929 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6668+0+0 (secure 0 0 0) 0x7f7f7c08dda0 con 0x7f7f88107fa0 2024-08-18T22:50:48.326 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:48.324+0000 7f7f877fe640 1 --2- 172.21.15.121:0/3280488929 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f7f7006e0b0 0x7f7f70070560 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f7f78007ac0 tx=0x7f7f78035040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:50:48.329 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:48.328+0000 7f7f6ffff640 1 -- 172.21.15.121:0/3280488929 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f7f7c057140 con 0x7f7f88107fa0 2024-08-18T22:50:48.512 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:48.511+0000 7f7f8de62640 1 -- 172.21.15.121:0/3280488929 --> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f7f881197b0 con 0x7f7f7006e0b0 2024-08-18T22:50:48.521 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:48.520+0000 7f7f6ffff640 1 -- 172.21.15.121:0/3280488929 <== mgr.34102 v2:172.21.15.121:6800/3037387239 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7f7f881197b0 con 0x7f7f7006e0b0 2024-08-18T22:50:48.521 INFO:teuthology.orchestra.run.smithi121.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-08-18T22:50:48.521 INFO:teuthology.orchestra.run.smithi121.stdout:alertmanager.smithi121 smithi121 *:9093,9094 running (22s) 17s ago 16m 17.3M - 0.25.0 c8568f914cd2 50a5a7767cfb 2024-08-18T22:50:48.521 INFO:teuthology.orchestra.run.smithi121.stdout:crash.smithi121 smithi121 running (6m) 17s ago 16m 6903k - 19.1.0-1382-gde09dd01 ea7a5189f30b 3cf5c666a0e6 2024-08-18T22:50:48.521 INFO:teuthology.orchestra.run.smithi121.stdout:crash.smithi195 smithi195 running (6m) 50s ago 15m 6895k - 19.1.0-1382-gde09dd01 ea7a5189f30b fbb586fb9834 2024-08-18T22:50:48.521 INFO:teuthology.orchestra.run.smithi121.stdout:grafana.smithi121 smithi121 *:3000 starting - - - - 2024-08-18T22:50:48.521 INFO:teuthology.orchestra.run.smithi121.stdout:mds.cephfs.smithi121.gbickb smithi121 running (118s) 17s ago 11m 18.2M - 19.1.0-1382-gde09dd01 ea7a5189f30b 3d6dc5c5f472 2024-08-18T22:50:48.521 INFO:teuthology.orchestra.run.smithi121.stdout:mds.cephfs.smithi121.xuzsdg smithi121 running (2m) 17s ago 11m 76.2M - 19.1.0-1382-gde09dd01 ea7a5189f30b 4eec4d0a895e 2024-08-18T22:50:48.521 INFO:teuthology.orchestra.run.smithi121.stdout:mds.cephfs.smithi195.buqvbr smithi195 running (98s) 50s ago 11m 12.4M - 19.1.0-1382-gde09dd01 ea7a5189f30b dca538294bee 2024-08-18T22:50:48.522 INFO:teuthology.orchestra.run.smithi121.stdout:mds.cephfs.smithi195.nptgyc smithi195 running (74s) 50s ago 11m 13.2M - 19.1.0-1382-gde09dd01 ea7a5189f30b 42528b070f11 2024-08-18T22:50:48.522 INFO:teuthology.orchestra.run.smithi121.stdout:mgr.smithi121.lopxqc smithi121 *:8443,9283,8765 running (8m) 17s ago 18m 509M - 19.1.0-1382-gde09dd01 ea7a5189f30b 9079701e6516 2024-08-18T22:50:48.522 INFO:teuthology.orchestra.run.smithi121.stdout:mgr.smithi195.acttsj smithi195 *:8443,9283,8765 running (7m) 50s ago 15m 442M - 19.1.0-1382-gde09dd01 ea7a5189f30b 7b4027a33daa 2024-08-18T22:50:48.522 INFO:teuthology.orchestra.run.smithi121.stdout:mon.smithi121 smithi121 running (7m) 17s ago 18m 56.3M 2048M 19.1.0-1382-gde09dd01 ea7a5189f30b d71695a4fb56 2024-08-18T22:50:48.522 INFO:teuthology.orchestra.run.smithi121.stdout:mon.smithi195 smithi195 running (6m) 50s ago 15m 40.9M 2048M 19.1.0-1382-gde09dd01 ea7a5189f30b a9bb94ba3b56 2024-08-18T22:50:48.522 INFO:teuthology.orchestra.run.smithi121.stdout:node-exporter.smithi121 smithi121 *:9100 running (57s) 17s ago 16m 9805k - 1.5.0 0da6a335fe13 5c8d00b736b0 2024-08-18T22:50:48.522 INFO:teuthology.orchestra.run.smithi121.stdout:node-exporter.smithi195 smithi195 *:9100 running (53s) 50s ago 15m 3602k - 1.5.0 0da6a335fe13 55fe298190b2 2024-08-18T22:50:48.522 INFO:teuthology.orchestra.run.smithi121.stdout:osd.0 smithi121 running (5m) 17s ago 15m 143M 1557M 19.1.0-1382-gde09dd01 ea7a5189f30b d378dd46eeb6 2024-08-18T22:50:48.522 INFO:teuthology.orchestra.run.smithi121.stdout:osd.1 smithi121 running (5m) 17s ago 14m 166M 1557M 19.1.0-1382-gde09dd01 ea7a5189f30b 0f9e03de5382 2024-08-18T22:50:48.522 INFO:teuthology.orchestra.run.smithi121.stdout:osd.2 smithi121 running (4m) 17s ago 14m 131M 1557M 19.1.0-1382-gde09dd01 ea7a5189f30b 93270b5bed68 2024-08-18T22:50:48.522 INFO:teuthology.orchestra.run.smithi121.stdout:osd.3 smithi195 running (4m) 50s ago 13m 188M 2581M 19.1.0-1382-gde09dd01 ea7a5189f30b 72c2860c0e9f 2024-08-18T22:50:48.522 INFO:teuthology.orchestra.run.smithi121.stdout:osd.4 smithi195 running (3m) 50s ago 13m 169M 2581M 19.1.0-1382-gde09dd01 ea7a5189f30b d88a83c97247 2024-08-18T22:50:48.523 INFO:teuthology.orchestra.run.smithi121.stdout:osd.5 smithi195 running (3m) 50s ago 13m 150M 2581M 19.1.0-1382-gde09dd01 ea7a5189f30b 5af2d6de9afe 2024-08-18T22:50:48.523 INFO:teuthology.orchestra.run.smithi121.stdout:prometheus.smithi121 smithi121 *:9095 running (37s) 17s ago 16m 52.9M - 2.43.0 a07b618ecd1d ad25302956e5 2024-08-18T22:50:48.523 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:48.522+0000 7f7f8de62640 1 -- 172.21.15.121:0/3280488929 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f7f7006e0b0 msgr2=0x7f7f70070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:50:48.523 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:48.522+0000 7f7f8de62640 1 --2- 172.21.15.121:0/3280488929 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f7f7006e0b0 0x7f7f70070560 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f7f78007ac0 tx=0x7f7f78035040 comp rx=0 tx=0).stop 2024-08-18T22:50:48.523 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:48.522+0000 7f7f8de62640 1 -- 172.21.15.121:0/3280488929 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7f88107fa0 msgr2=0x7f7f88117d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:50:48.523 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:48.522+0000 7f7f8de62640 1 --2- 172.21.15.121:0/3280488929 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7f88107fa0 0x7f7f88117d70 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f7f7c00c830 tx=0x7f7f7c004430 comp rx=0 tx=0).stop 2024-08-18T22:50:48.524 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:48.522+0000 7f7f8de62640 1 -- 172.21.15.121:0/3280488929 shutdown_connections 2024-08-18T22:50:48.524 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:48.522+0000 7f7f8de62640 1 --2- 172.21.15.121:0/3280488929 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f7f7006e0b0 0x7f7f70070560 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:50:48.524 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:48.522+0000 7f7f8de62640 1 --2- 172.21.15.121:0/3280488929 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7f88107fa0 0x7f7f88117d70 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:50:48.524 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:48.522+0000 7f7f8de62640 1 --2- 172.21.15.121:0/3280488929 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7f88106cd0 0x7f7f88117830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:50:48.524 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:48.522+0000 7f7f8de62640 1 -- 172.21.15.121:0/3280488929 >> 172.21.15.121:0/3280488929 conn(0x7f7f88066b80 msgr2=0x7f7f88105500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:50:48.524 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:48.522+0000 7f7f8de62640 1 -- 172.21.15.121:0/3280488929 shutdown_connections 2024-08-18T22:50:48.524 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:48.522+0000 7f7f8de62640 1 -- 172.21.15.121:0/3280488929 wait complete. 2024-08-18T22:50:48.602 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:48.599+0000 7fa5a75ee640 1 -- 172.21.15.121:0/2429228155 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa5a00fd5c0 msgr2=0x7fa5a00fda30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:50:48.603 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:48.600+0000 7fa5a75ee640 1 --2- 172.21.15.121:0/2429228155 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa5a00fd5c0 0x7fa5a00fda30 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fa5900048d0 tx=0x7fa590009da0 comp rx=0 tx=0).stop 2024-08-18T22:50:48.603 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:48.600+0000 7fa5a75ee640 1 -- 172.21.15.121:0/2429228155 shutdown_connections 2024-08-18T22:50:48.603 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:48.600+0000 7fa5a75ee640 1 --2- 172.21.15.121:0/2429228155 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa5a00fd5c0 0x7fa5a00fda30 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:50:48.603 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:48.600+0000 7fa5a75ee640 1 --2- 172.21.15.121:0/2429228155 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa5a00fc2f0 0x7fa5a00fc700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:50:48.603 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:48.600+0000 7fa5a75ee640 1 -- 172.21.15.121:0/2429228155 >> 172.21.15.121:0/2429228155 conn(0x7fa5a00f7ad0 msgr2=0x7fa5a00f9ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:50:48.603 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:48.600+0000 7fa5a75ee640 1 -- 172.21.15.121:0/2429228155 shutdown_connections 2024-08-18T22:50:48.603 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:48.600+0000 7fa5a75ee640 1 -- 172.21.15.121:0/2429228155 wait complete. 2024-08-18T22:50:48.603 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:48.600+0000 7fa5a75ee640 1 Processor -- start 2024-08-18T22:50:48.603 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:48.600+0000 7fa5a75ee640 1 -- start start 2024-08-18T22:50:48.603 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:48.600+0000 7fa5a75ee640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa5a00fc2f0 0x7fa5a010ce90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:50:48.603 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:48.601+0000 7fa5a75ee640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa5a00fd5c0 0x7fa5a010d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:50:48.604 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:48.601+0000 7fa5a75ee640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5a010da20 con 0x7fa5a00fd5c0 2024-08-18T22:50:48.604 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:48.601+0000 7fa5a75ee640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5a010e160 con 0x7fa5a00fc2f0 2024-08-18T22:50:48.604 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:48.601+0000 7fa5a4b89640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa5a00fd5c0 0x7fa5a010d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:50:48.604 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:48.601+0000 7fa5a4b89640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa5a00fd5c0 0x7fa5a010d3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:53902/0 (socket says 172.21.15.121:53902) 2024-08-18T22:50:48.604 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:48.601+0000 7fa5a4b89640 1 -- 172.21.15.121:0/880342205 learned_addr learned my addr 172.21.15.121:0/880342205 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-18T22:50:48.604 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:48.601+0000 7fa5a538a640 1 --2- 172.21.15.121:0/880342205 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa5a00fc2f0 0x7fa5a010ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:50:48.604 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:48.601+0000 7fa5a4b89640 1 -- 172.21.15.121:0/880342205 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa5a00fc2f0 msgr2=0x7fa5a010ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:50:48.604 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:48.601+0000 7fa5a4b89640 1 --2- 172.21.15.121:0/880342205 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa5a00fc2f0 0x7fa5a010ce90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:50:48.604 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:48.601+0000 7fa5a4b89640 1 -- 172.21.15.121:0/880342205 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa590005040 con 0x7fa5a00fd5c0 2024-08-18T22:50:48.604 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:48.601+0000 7fa5a538a640 1 --2- 172.21.15.121:0/880342205 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa5a00fc2f0 0x7fa5a010ce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:50:48.604 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:48.601+0000 7fa5a4b89640 1 --2- 172.21.15.121:0/880342205 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa5a00fd5c0 0x7fa5a010d3d0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fa5900043d0 tx=0x7fa590009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:50:48.604 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:48.601+0000 7fa595ffb640 1 -- 172.21.15.121:0/880342205 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa590038070 con 0x7fa5a00fd5c0 2024-08-18T22:50:48.604 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:48.601+0000 7fa595ffb640 1 -- 172.21.15.121:0/880342205 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fa59002ae90 con 0x7fa5a00fd5c0 2024-08-18T22:50:48.605 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:48.601+0000 7fa595ffb640 1 -- 172.21.15.121:0/880342205 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa59003e670 con 0x7fa5a00fd5c0 2024-08-18T22:50:48.605 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:48.601+0000 7fa5a75ee640 1 -- 172.21.15.121:0/880342205 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5a010e390 con 0x7fa5a00fd5c0 2024-08-18T22:50:48.605 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:48.602+0000 7fa5a75ee640 1 -- 172.21.15.121:0/880342205 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5a010e930 con 0x7fa5a00fd5c0 2024-08-18T22:50:48.606 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:48.603+0000 7fa5a75ee640 1 -- 172.21.15.121:0/880342205 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5a00fb750 con 0x7fa5a00fd5c0 2024-08-18T22:50:48.606 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:48.603+0000 7fa595ffb640 1 -- 172.21.15.121:0/880342205 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 37) v1 ==== 92205+0+0 (secure 0 0 0) 0x7fa590030020 con 0x7fa5a00fd5c0 2024-08-18T22:50:48.606 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:48.604+0000 7fa595ffb640 1 --2- 172.21.15.121:0/880342205 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7fa58c06e0b0 0x7fa58c070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:50:48.606 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:48.604+0000 7fa595ffb640 1 -- 172.21.15.121:0/880342205 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6668+0+0 (secure 0 0 0) 0x7fa5900ade70 con 0x7fa5a00fd5c0 2024-08-18T22:50:48.606 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:48.604+0000 7fa5a538a640 1 --2- 172.21.15.121:0/880342205 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7fa58c06e0b0 0x7fa58c070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:50:48.606 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:48.604+0000 7fa5a538a640 1 --2- 172.21.15.121:0/880342205 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7fa58c06e0b0 0x7fa58c070560 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fa5a010cc20 tx=0x7fa59c00b040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:50:48.609 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:48.608+0000 7fa595ffb640 1 -- 172.21.15.121:0/880342205 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7fa590077170 con 0x7fa5a00fd5c0 2024-08-18T22:50:48.855 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:48.854+0000 7fa5a75ee640 1 -- 172.21.15.121:0/880342205 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fa5a0104cf0 con 0x7fa5a00fd5c0 2024-08-18T22:50:48.855 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:48.854+0000 7fa595ffb640 1 -- 172.21.15.121:0/880342205 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+618 (secure 0 0 0) 0x7fa59007a830 con 0x7fa5a00fd5c0 2024-08-18T22:50:48.855 INFO:teuthology.orchestra.run.smithi121.stdout:{ 2024-08-18T22:50:48.856 INFO:teuthology.orchestra.run.smithi121.stdout: "mon": { 2024-08-18T22:50:48.856 INFO:teuthology.orchestra.run.smithi121.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 2 2024-08-18T22:50:48.856 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-18T22:50:48.856 INFO:teuthology.orchestra.run.smithi121.stdout: "mgr": { 2024-08-18T22:50:48.856 INFO:teuthology.orchestra.run.smithi121.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 2 2024-08-18T22:50:48.856 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-18T22:50:48.856 INFO:teuthology.orchestra.run.smithi121.stdout: "osd": { 2024-08-18T22:50:48.856 INFO:teuthology.orchestra.run.smithi121.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 6 2024-08-18T22:50:48.856 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-18T22:50:48.856 INFO:teuthology.orchestra.run.smithi121.stdout: "mds": { 2024-08-18T22:50:48.856 INFO:teuthology.orchestra.run.smithi121.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 4 2024-08-18T22:50:48.857 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-18T22:50:48.857 INFO:teuthology.orchestra.run.smithi121.stdout: "overall": { 2024-08-18T22:50:48.857 INFO:teuthology.orchestra.run.smithi121.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 14 2024-08-18T22:50:48.857 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-08-18T22:50:48.857 INFO:teuthology.orchestra.run.smithi121.stdout:} 2024-08-18T22:50:48.859 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:48.857+0000 7fa5a75ee640 1 -- 172.21.15.121:0/880342205 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7fa58c06e0b0 msgr2=0x7fa58c070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:50:48.860 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:48.857+0000 7fa5a75ee640 1 --2- 172.21.15.121:0/880342205 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7fa58c06e0b0 0x7fa58c070560 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fa5a010cc20 tx=0x7fa59c00b040 comp rx=0 tx=0).stop 2024-08-18T22:50:48.860 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:48.857+0000 7fa5a75ee640 1 -- 172.21.15.121:0/880342205 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa5a00fd5c0 msgr2=0x7fa5a010d3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:50:48.860 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:48.857+0000 7fa5a75ee640 1 --2- 172.21.15.121:0/880342205 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa5a00fd5c0 0x7fa5a010d3d0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fa5900043d0 tx=0x7fa590009da0 comp rx=0 tx=0).stop 2024-08-18T22:50:48.860 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:48.858+0000 7fa5a75ee640 1 -- 172.21.15.121:0/880342205 shutdown_connections 2024-08-18T22:50:48.860 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:48.858+0000 7fa5a75ee640 1 --2- 172.21.15.121:0/880342205 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7fa58c06e0b0 0x7fa58c070560 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:50:48.861 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:48.858+0000 7fa5a75ee640 1 --2- 172.21.15.121:0/880342205 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa5a00fd5c0 0x7fa5a010d3d0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:50:48.861 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:48.858+0000 7fa5a75ee640 1 --2- 172.21.15.121:0/880342205 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa5a00fc2f0 0x7fa5a010ce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:50:48.861 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:48.858+0000 7fa5a75ee640 1 -- 172.21.15.121:0/880342205 >> 172.21.15.121:0/880342205 conn(0x7fa5a00f7ad0 msgr2=0x7fa5a00f9230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:50:48.861 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:48.858+0000 7fa5a75ee640 1 -- 172.21.15.121:0/880342205 shutdown_connections 2024-08-18T22:50:48.861 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:48.858+0000 7fa5a75ee640 1 -- 172.21.15.121:0/880342205 wait complete. 2024-08-18T22:50:48.945 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:48.943+0000 7f59bca22640 1 -- 172.21.15.121:0/121892086 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f59b80fbfc0 msgr2=0x7f59b80fa3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:50:48.946 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:48.943+0000 7f59bca22640 1 --2- 172.21.15.121:0/121892086 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f59b80fbfc0 0x7f59b80fa3f0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f59ac0048d0 tx=0x7f59ac009da0 comp rx=0 tx=0).stop 2024-08-18T22:50:48.946 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:48.943+0000 7f59bca22640 1 -- 172.21.15.121:0/121892086 shutdown_connections 2024-08-18T22:50:48.946 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:48.943+0000 7f59bca22640 1 --2- 172.21.15.121:0/121892086 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f59b80fbfc0 0x7f59b80fa3f0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:50:48.946 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:48.943+0000 7f59bca22640 1 --2- 172.21.15.121:0/121892086 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f59b80fb670 0x7f59b80fba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:50:48.946 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:48.943+0000 7f59bca22640 1 -- 172.21.15.121:0/121892086 >> 172.21.15.121:0/121892086 conn(0x7f59b80f6140 msgr2=0x7f59b80f8570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:50:48.946 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:48.943+0000 7f59bca22640 1 -- 172.21.15.121:0/121892086 shutdown_connections 2024-08-18T22:50:48.946 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:48.943+0000 7f59bca22640 1 -- 172.21.15.121:0/121892086 wait complete. 2024-08-18T22:50:48.946 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:48.944+0000 7f59bca22640 1 Processor -- start 2024-08-18T22:50:48.946 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:48.944+0000 7f59bca22640 1 -- start start 2024-08-18T22:50:48.946 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:48.944+0000 7f59bca22640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f59b80fb670 0x7f59b8113450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:50:48.947 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:48.944+0000 7f59bca22640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f59b80fbfc0 0x7f59b8113990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:50:48.947 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:48.944+0000 7f59bca22640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59b8113fe0 con 0x7f59b80fbfc0 2024-08-18T22:50:48.947 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:48.944+0000 7f59bca22640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59b81147b0 con 0x7f59b80fb670 2024-08-18T22:50:48.947 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:48.944+0000 7f59b5d9b640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f59b80fbfc0 0x7f59b8113990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:50:48.947 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:48.944+0000 7f59b5d9b640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f59b80fbfc0 0x7f59b8113990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:53926/0 (socket says 172.21.15.121:53926) 2024-08-18T22:50:48.947 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:48.944+0000 7f59b5d9b640 1 -- 172.21.15.121:0/2513049923 learned_addr learned my addr 172.21.15.121:0/2513049923 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-18T22:50:48.947 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:48.944+0000 7f59b659c640 1 --2- 172.21.15.121:0/2513049923 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f59b80fb670 0x7f59b8113450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:50:48.947 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:48.944+0000 7f59b5d9b640 1 -- 172.21.15.121:0/2513049923 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f59b80fb670 msgr2=0x7f59b8113450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:50:48.947 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:48.944+0000 7f59b5d9b640 1 --2- 172.21.15.121:0/2513049923 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f59b80fb670 0x7f59b8113450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:50:48.947 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:48.944+0000 7f59b5d9b640 1 -- 172.21.15.121:0/2513049923 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59ac005040 con 0x7f59b80fbfc0 2024-08-18T22:50:48.947 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:48.945+0000 7f59b5d9b640 1 --2- 172.21.15.121:0/2513049923 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f59b80fbfc0 0x7f59b8113990 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f59ac0043d0 tx=0x7f59ac009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:50:48.947 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:48.945+0000 7f59a6ffd640 1 -- 172.21.15.121:0/2513049923 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f59ac038070 con 0x7f59b80fbfc0 2024-08-18T22:50:48.948 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:48.945+0000 7f59bca22640 1 -- 172.21.15.121:0/2513049923 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59b81149e0 con 0x7f59b80fbfc0 2024-08-18T22:50:48.948 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:48.945+0000 7f59a6ffd640 1 -- 172.21.15.121:0/2513049923 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f59ac02ae90 con 0x7f59b80fbfc0 2024-08-18T22:50:48.948 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:48.945+0000 7f59a6ffd640 1 -- 172.21.15.121:0/2513049923 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f59ac03e670 con 0x7f59b80fbfc0 2024-08-18T22:50:48.948 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:48.945+0000 7f59bca22640 1 -- 172.21.15.121:0/2513049923 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59b8114f80 con 0x7f59b80fbfc0 2024-08-18T22:50:48.949 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:48.946+0000 7f59bca22640 1 -- 172.21.15.121:0/2513049923 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59b80f9de0 con 0x7f59b80fbfc0 2024-08-18T22:50:48.949 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:48.946+0000 7f59a6ffd640 1 -- 172.21.15.121:0/2513049923 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 37) v1 ==== 92205+0+0 (secure 0 0 0) 0x7f59ac030020 con 0x7f59b80fbfc0 2024-08-18T22:50:48.949 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:48.947+0000 7f59a6ffd640 1 --2- 172.21.15.121:0/2513049923 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f59a006e0b0 0x7f59a0070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:50:48.949 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:48.947+0000 7f59a6ffd640 1 -- 172.21.15.121:0/2513049923 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6668+0+0 (secure 0 0 0) 0x7f59ac0addc0 con 0x7f59b80fbfc0 2024-08-18T22:50:48.949 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:48.947+0000 7f59b659c640 1 --2- 172.21.15.121:0/2513049923 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f59a006e0b0 0x7f59a0070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:50:48.950 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:48.947+0000 7f59b659c640 1 --2- 172.21.15.121:0/2513049923 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f59a006e0b0 0x7f59a0070560 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f59a8004ed0 tx=0x7f59a800b040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:50:48.952 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:48.951+0000 7f59a6ffd640 1 -- 172.21.15.121:0/2513049923 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f59ac077170 con 0x7f59b80fbfc0 2024-08-18T22:50:49.160 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:49.159+0000 7f59bca22640 1 -- 172.21.15.121:0/2513049923 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f59b8115290 con 0x7f59b80fbfc0 2024-08-18T22:50:49.160 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:49.159+0000 7f59a6ffd640 1 -- 172.21.15.121:0/2513049923 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 46 v46) v1 ==== 76+0+1997 (secure 0 0 0) 0x7f59ac07a830 con 0x7f59b80fbfc0 2024-08-18T22:50:49.161 INFO:teuthology.orchestra.run.smithi121.stdout:e46 2024-08-18T22:50:49.161 INFO:teuthology.orchestra.run.smithi121.stdout:btime 2024-08-18T22:49:43:280875+0000 2024-08-18T22:50:49.161 INFO:teuthology.orchestra.run.smithi121.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-08-18T22:50:49.161 INFO:teuthology.orchestra.run.smithi121.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-08-18T22:50:49.161 INFO:teuthology.orchestra.run.smithi121.stdout:legacy client fscid: 1 2024-08-18T22:50:49.161 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-08-18T22:50:49.161 INFO:teuthology.orchestra.run.smithi121.stdout:Filesystem 'cephfs' (1) 2024-08-18T22:50:49.162 INFO:teuthology.orchestra.run.smithi121.stdout:fs_name cephfs 2024-08-18T22:50:49.162 INFO:teuthology.orchestra.run.smithi121.stdout:epoch 46 2024-08-18T22:50:49.162 INFO:teuthology.orchestra.run.smithi121.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-08-18T22:50:49.162 INFO:teuthology.orchestra.run.smithi121.stdout:created 2024-08-18T22:39:04.054074+0000 2024-08-18T22:50:49.162 INFO:teuthology.orchestra.run.smithi121.stdout:modified 2024-08-18T22:49:43.280872+0000 2024-08-18T22:50:49.162 INFO:teuthology.orchestra.run.smithi121.stdout:tableserver 0 2024-08-18T22:50:49.162 INFO:teuthology.orchestra.run.smithi121.stdout:root 0 2024-08-18T22:50:49.162 INFO:teuthology.orchestra.run.smithi121.stdout:session_timeout 60 2024-08-18T22:50:49.162 INFO:teuthology.orchestra.run.smithi121.stdout:session_autoclose 300 2024-08-18T22:50:49.162 INFO:teuthology.orchestra.run.smithi121.stdout:max_file_size 1099511627776 2024-08-18T22:50:49.162 INFO:teuthology.orchestra.run.smithi121.stdout:max_xattr_size 65536 2024-08-18T22:50:49.162 INFO:teuthology.orchestra.run.smithi121.stdout:required_client_features {} 2024-08-18T22:50:49.163 INFO:teuthology.orchestra.run.smithi121.stdout:last_failure 0 2024-08-18T22:50:49.163 INFO:teuthology.orchestra.run.smithi121.stdout:last_failure_osd_epoch 84 2024-08-18T22:50:49.163 INFO:teuthology.orchestra.run.smithi121.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-08-18T22:50:49.163 INFO:teuthology.orchestra.run.smithi121.stdout:max_mds 2 2024-08-18T22:50:49.163 INFO:teuthology.orchestra.run.smithi121.stdout:in 0,1 2024-08-18T22:50:49.163 INFO:teuthology.orchestra.run.smithi121.stdout:up {0=34404,1=34436} 2024-08-18T22:50:49.163 INFO:teuthology.orchestra.run.smithi121.stdout:failed 2024-08-18T22:50:49.163 INFO:teuthology.orchestra.run.smithi121.stdout:damaged 2024-08-18T22:50:49.163 INFO:teuthology.orchestra.run.smithi121.stdout:stopped 2024-08-18T22:50:49.163 INFO:teuthology.orchestra.run.smithi121.stdout:data_pools [3] 2024-08-18T22:50:49.163 INFO:teuthology.orchestra.run.smithi121.stdout:metadata_pool 2 2024-08-18T22:50:49.163 INFO:teuthology.orchestra.run.smithi121.stdout:inline_data disabled 2024-08-18T22:50:49.164 INFO:teuthology.orchestra.run.smithi121.stdout:balancer 2024-08-18T22:50:49.164 INFO:teuthology.orchestra.run.smithi121.stdout:bal_rank_mask -1 2024-08-18T22:50:49.164 INFO:teuthology.orchestra.run.smithi121.stdout:standby_count_wanted 1 2024-08-18T22:50:49.164 INFO:teuthology.orchestra.run.smithi121.stdout:qdb_cluster leader: 34404 members: 34404,34436 2024-08-18T22:50:49.164 INFO:teuthology.orchestra.run.smithi121.stdout:[mds.cephfs.smithi121.xuzsdg{0:34404} state up:active seq 18 join_fscid=1 addr [v2:172.21.15.121:6826/4267588865,v1:172.21.15.121:6827/4267588865] compat {c=[1],r=[1],i=[1fff]}] 2024-08-18T22:50:49.164 INFO:teuthology.orchestra.run.smithi121.stdout:[mds.cephfs.smithi121.gbickb{1:34436} state up:active seq 14 join_fscid=1 addr [v2:172.21.15.121:6828/2915303436,v1:172.21.15.121:6829/2915303436] compat {c=[1],r=[1],i=[1fff]}] 2024-08-18T22:50:49.164 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-08-18T22:50:49.164 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-08-18T22:50:49.164 INFO:teuthology.orchestra.run.smithi121.stdout:Standby daemons: 2024-08-18T22:50:49.164 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-08-18T22:50:49.164 INFO:teuthology.orchestra.run.smithi121.stdout:[mds.cephfs.smithi195.buqvbr{-1:44299} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.195:6824/1574620912,v1:172.21.15.195:6825/1574620912] compat {c=[1],r=[1],i=[1fff]}] 2024-08-18T22:50:49.164 INFO:teuthology.orchestra.run.smithi121.stdout:[mds.cephfs.smithi195.nptgyc{-1:44327} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.195:6826/4050783124,v1:172.21.15.195:6827/4050783124] compat {c=[1],r=[1],i=[1fff]}] 2024-08-18T22:50:49.165 INFO:teuthology.orchestra.run.smithi121.stderr:dumped fsmap epoch 46 2024-08-18T22:50:49.165 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:49.162+0000 7f59bca22640 1 -- 172.21.15.121:0/2513049923 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f59a006e0b0 msgr2=0x7f59a0070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:50:49.165 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:49.162+0000 7f59bca22640 1 --2- 172.21.15.121:0/2513049923 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f59a006e0b0 0x7f59a0070560 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f59a8004ed0 tx=0x7f59a800b040 comp rx=0 tx=0).stop 2024-08-18T22:50:49.165 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:49.162+0000 7f59bca22640 1 -- 172.21.15.121:0/2513049923 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f59b80fbfc0 msgr2=0x7f59b8113990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:50:49.165 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:49.162+0000 7f59bca22640 1 --2- 172.21.15.121:0/2513049923 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f59b80fbfc0 0x7f59b8113990 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f59ac0043d0 tx=0x7f59ac009da0 comp rx=0 tx=0).stop 2024-08-18T22:50:49.165 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:49.162+0000 7f59bca22640 1 -- 172.21.15.121:0/2513049923 shutdown_connections 2024-08-18T22:50:49.166 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:49.162+0000 7f59bca22640 1 --2- 172.21.15.121:0/2513049923 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f59a006e0b0 0x7f59a0070560 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:50:49.166 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:49.162+0000 7f59bca22640 1 --2- 172.21.15.121:0/2513049923 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f59b80fbfc0 0x7f59b8113990 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:50:49.166 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:49.162+0000 7f59bca22640 1 --2- 172.21.15.121:0/2513049923 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f59b80fb670 0x7f59b8113450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:50:49.166 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:49.162+0000 7f59bca22640 1 -- 172.21.15.121:0/2513049923 >> 172.21.15.121:0/2513049923 conn(0x7f59b80f6140 msgr2=0x7f59b80f78f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:50:49.166 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:49.163+0000 7f59bca22640 1 -- 172.21.15.121:0/2513049923 shutdown_connections 2024-08-18T22:50:49.166 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:49.163+0000 7f59bca22640 1 -- 172.21.15.121:0/2513049923 wait complete. 2024-08-18T22:50:49.245 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:49.242+0000 7fbcd83aa640 1 -- 172.21.15.121:0/85860085 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbcd00fd9f0 msgr2=0x7fbcd00fde00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:50:49.245 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:49.242+0000 7fbcd83aa640 1 --2- 172.21.15.121:0/85860085 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbcd00fd9f0 0x7fbcd00fde00 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fbccc0048d0 tx=0x7fbccc009da0 comp rx=0 tx=0).stop 2024-08-18T22:50:49.245 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:49.242+0000 7fbcd83aa640 1 -- 172.21.15.121:0/85860085 shutdown_connections 2024-08-18T22:50:49.245 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:49.242+0000 7fbcd83aa640 1 --2- 172.21.15.121:0/85860085 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbcd00fe340 0x7fbcd00fa4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:50:49.245 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:49.242+0000 7fbcd83aa640 1 --2- 172.21.15.121:0/85860085 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbcd00fd9f0 0x7fbcd00fde00 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:50:49.245 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:49.242+0000 7fbcd83aa640 1 -- 172.21.15.121:0/85860085 >> 172.21.15.121:0/85860085 conn(0x7fbcd00f6150 msgr2=0x7fbcd00f8580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:50:49.245 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:49.242+0000 7fbcd83aa640 1 -- 172.21.15.121:0/85860085 shutdown_connections 2024-08-18T22:50:49.246 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:49.242+0000 7fbcd83aa640 1 -- 172.21.15.121:0/85860085 wait complete. 2024-08-18T22:50:49.246 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:49.243+0000 7fbcd83aa640 1 Processor -- start 2024-08-18T22:50:49.246 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:49.243+0000 7fbcd83aa640 1 -- start start 2024-08-18T22:50:49.246 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:49.243+0000 7fbcd83aa640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbcd00fd9f0 0x7fbcd010cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:50:49.246 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:49.243+0000 7fbcd83aa640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbcd00fe340 0x7fbcd010d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:50:49.246 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:49.243+0000 7fbcd83aa640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcd010e170 con 0x7fbcd00fd9f0 2024-08-18T22:50:49.246 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:49.243+0000 7fbcd83aa640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcd010e2e0 con 0x7fbcd00fe340 2024-08-18T22:50:49.246 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:49.243+0000 7fbcd6146640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbcd00fd9f0 0x7fbcd010cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:50:49.246 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:49.243+0000 7fbcd6146640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbcd00fd9f0 0x7fbcd010cf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:53938/0 (socket says 172.21.15.121:53938) 2024-08-18T22:50:49.246 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:49.243+0000 7fbcd6146640 1 -- 172.21.15.121:0/788660693 learned_addr learned my addr 172.21.15.121:0/788660693 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-18T22:50:49.246 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:49.243+0000 7fbcd5945640 1 --2- 172.21.15.121:0/788660693 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbcd00fe340 0x7fbcd010d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:50:49.246 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:49.244+0000 7fbcd6146640 1 -- 172.21.15.121:0/788660693 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbcd00fe340 msgr2=0x7fbcd010d440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:50:49.246 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:49.244+0000 7fbcd6146640 1 --2- 172.21.15.121:0/788660693 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbcd00fe340 0x7fbcd010d440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:50:49.247 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:49.244+0000 7fbcd6146640 1 -- 172.21.15.121:0/788660693 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbccc005040 con 0x7fbcd00fd9f0 2024-08-18T22:50:49.247 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:49.244+0000 7fbcd6146640 1 --2- 172.21.15.121:0/788660693 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbcd00fd9f0 0x7fbcd010cf00 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fbccc0048a0 tx=0x7fbccc009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:50:49.247 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:49.244+0000 7fbcc6ffd640 1 -- 172.21.15.121:0/788660693 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbccc038070 con 0x7fbcd00fd9f0 2024-08-18T22:50:49.247 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:49.244+0000 7fbcc6ffd640 1 -- 172.21.15.121:0/788660693 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fbccc004290 con 0x7fbcd00fd9f0 2024-08-18T22:50:49.247 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:49.244+0000 7fbcd83aa640 1 -- 172.21.15.121:0/788660693 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbcd010e560 con 0x7fbcd00fd9f0 2024-08-18T22:50:49.247 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:49.244+0000 7fbcc6ffd640 1 -- 172.21.15.121:0/788660693 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbccc033660 con 0x7fbcd00fd9f0 2024-08-18T22:50:49.247 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:49.244+0000 7fbcd83aa640 1 -- 172.21.15.121:0/788660693 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbcd010eb00 con 0x7fbcd00fd9f0 2024-08-18T22:50:49.248 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:49.245+0000 7fbcd83aa640 1 -- 172.21.15.121:0/788660693 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbcd0105590 con 0x7fbcd00fd9f0 2024-08-18T22:50:49.248 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:49.246+0000 7fbcc6ffd640 1 -- 172.21.15.121:0/788660693 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 37) v1 ==== 92205+0+0 (secure 0 0 0) 0x7fbccc030020 con 0x7fbcd00fd9f0 2024-08-18T22:50:49.248 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:49.246+0000 7fbcc6ffd640 1 --2- 172.21.15.121:0/788660693 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7fbcbc06e0b0 0x7fbcbc070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:50:49.248 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:49.246+0000 7fbcc6ffd640 1 -- 172.21.15.121:0/788660693 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6668+0+0 (secure 0 0 0) 0x7fbccc0adcd0 con 0x7fbcd00fd9f0 2024-08-18T22:50:49.248 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:49.246+0000 7fbcd5945640 1 --2- 172.21.15.121:0/788660693 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7fbcbc06e0b0 0x7fbcbc070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:50:49.248 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:49.246+0000 7fbcd5945640 1 --2- 172.21.15.121:0/788660693 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7fbcbc06e0b0 0x7fbcbc070560 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fbcd010ccb0 tx=0x7fbcc000b040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:50:49.254 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:49.250+0000 7fbcc6ffd640 1 -- 172.21.15.121:0/788660693 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7fbccc077080 con 0x7fbcd00fd9f0 2024-08-18T22:50:49.438 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:49.437+0000 7fbcd83aa640 1 -- 172.21.15.121:0/788660693 --> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fbcd010ed70 con 0x7fbcbc06e0b0 2024-08-18T22:50:49.439 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:49.438+0000 7fbcc6ffd640 1 -- 172.21.15.121:0/788660693 <== mgr.34102 v2:172.21.15.121:6800/3037387239 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+435 (secure 0 0 0) 0x7fbcd010ed70 con 0x7fbcbc06e0b0 2024-08-18T22:50:49.439 INFO:teuthology.orchestra.run.smithi121.stdout:{ 2024-08-18T22:50:49.439 INFO:teuthology.orchestra.run.smithi121.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9", 2024-08-18T22:50:49.439 INFO:teuthology.orchestra.run.smithi121.stdout: "in_progress": true, 2024-08-18T22:50:49.439 INFO:teuthology.orchestra.run.smithi121.stdout: "which": "Upgrading all daemon types on all hosts", 2024-08-18T22:50:49.439 INFO:teuthology.orchestra.run.smithi121.stdout: "services_complete": [ 2024-08-18T22:50:49.439 INFO:teuthology.orchestra.run.smithi121.stdout: "mon", 2024-08-18T22:50:49.439 INFO:teuthology.orchestra.run.smithi121.stdout: "osd", 2024-08-18T22:50:49.439 INFO:teuthology.orchestra.run.smithi121.stdout: "mgr", 2024-08-18T22:50:49.440 INFO:teuthology.orchestra.run.smithi121.stdout: "crash", 2024-08-18T22:50:49.440 INFO:teuthology.orchestra.run.smithi121.stdout: "mds" 2024-08-18T22:50:49.440 INFO:teuthology.orchestra.run.smithi121.stdout: ], 2024-08-18T22:50:49.440 INFO:teuthology.orchestra.run.smithi121.stdout: "progress": "16/21 daemons upgraded", 2024-08-18T22:50:49.440 INFO:teuthology.orchestra.run.smithi121.stdout: "message": "Currently upgrading grafana daemons", 2024-08-18T22:50:49.440 INFO:teuthology.orchestra.run.smithi121.stdout: "is_paused": false 2024-08-18T22:50:49.440 INFO:teuthology.orchestra.run.smithi121.stdout:} 2024-08-18T22:50:49.441 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:49.440+0000 7fbcd83aa640 1 -- 172.21.15.121:0/788660693 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7fbcbc06e0b0 msgr2=0x7fbcbc070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:50:49.441 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:49.440+0000 7fbcd83aa640 1 --2- 172.21.15.121:0/788660693 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7fbcbc06e0b0 0x7fbcbc070560 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fbcd010ccb0 tx=0x7fbcc000b040 comp rx=0 tx=0).stop 2024-08-18T22:50:49.441 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:49.440+0000 7fbcd83aa640 1 -- 172.21.15.121:0/788660693 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbcd00fd9f0 msgr2=0x7fbcd010cf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:50:49.441 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:49.440+0000 7fbcd83aa640 1 --2- 172.21.15.121:0/788660693 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbcd00fd9f0 0x7fbcd010cf00 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fbccc0048a0 tx=0x7fbccc009da0 comp rx=0 tx=0).stop 2024-08-18T22:50:49.441 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:49.440+0000 7fbcd83aa640 1 -- 172.21.15.121:0/788660693 shutdown_connections 2024-08-18T22:50:49.441 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:49.440+0000 7fbcd83aa640 1 --2- 172.21.15.121:0/788660693 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7fbcbc06e0b0 0x7fbcbc070560 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:50:49.441 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:49.440+0000 7fbcd83aa640 1 --2- 172.21.15.121:0/788660693 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbcd00fe340 0x7fbcd010d440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:50:49.441 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:49.440+0000 7fbcd83aa640 1 --2- 172.21.15.121:0/788660693 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbcd00fd9f0 0x7fbcd010cf00 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:50:49.442 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:49.440+0000 7fbcd83aa640 1 -- 172.21.15.121:0/788660693 >> 172.21.15.121:0/788660693 conn(0x7fbcd00f6150 msgr2=0x7fbcd00f78b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:50:49.442 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:49.440+0000 7fbcd83aa640 1 -- 172.21.15.121:0/788660693 shutdown_connections 2024-08-18T22:50:49.442 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:49.440+0000 7fbcd83aa640 1 -- 172.21.15.121:0/788660693 wait complete. 2024-08-18T22:50:49.521 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:49.518+0000 7ff2a23c3640 1 -- 172.21.15.121:0/3157970735 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff29c0fbc50 msgr2=0x7ff29c0fc0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:50:49.521 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:49.518+0000 7ff2a23c3640 1 --2- 172.21.15.121:0/3157970735 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff29c0fbc50 0x7ff29c0fc0c0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7ff2900048d0 tx=0x7ff290009da0 comp rx=0 tx=0).stop 2024-08-18T22:50:49.521 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:49.519+0000 7ff2a23c3640 1 -- 172.21.15.121:0/3157970735 shutdown_connections 2024-08-18T22:50:49.521 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:49.519+0000 7ff2a23c3640 1 --2- 172.21.15.121:0/3157970735 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff29c0fbc50 0x7ff29c0fc0c0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:50:49.521 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:49.519+0000 7ff2a23c3640 1 --2- 172.21.15.121:0/3157970735 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff29c0fa980 0x7ff29c0fad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:50:49.522 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:49.519+0000 7ff2a23c3640 1 -- 172.21.15.121:0/3157970735 >> 172.21.15.121:0/3157970735 conn(0x7ff29c0f6140 msgr2=0x7ff29c0f8570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:50:49.522 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:49.519+0000 7ff2a23c3640 1 -- 172.21.15.121:0/3157970735 shutdown_connections 2024-08-18T22:50:49.522 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:49.519+0000 7ff2a23c3640 1 -- 172.21.15.121:0/3157970735 wait complete. 2024-08-18T22:50:49.522 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:49.519+0000 7ff2a23c3640 1 Processor -- start 2024-08-18T22:50:49.522 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:49.519+0000 7ff2a23c3640 1 -- start start 2024-08-18T22:50:49.522 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:49.519+0000 7ff2a23c3640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff29c0fa980 0x7ff29c10cef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:50:49.522 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:49.519+0000 7ff2a23c3640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff29c0fbc50 0x7ff29c10d430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:50:49.522 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:49.519+0000 7ff2a23c3640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff29c10da80 con 0x7ff29c0fa980 2024-08-18T22:50:49.522 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:49.519+0000 7ff2a23c3640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff29c10e1c0 con 0x7ff29c0fbc50 2024-08-18T22:50:49.522 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:49.520+0000 7ff29bfff640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff29c0fa980 0x7ff29c10cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:50:49.522 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:49.520+0000 7ff29bfff640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff29c0fa980 0x7ff29c10cef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:53946/0 (socket says 172.21.15.121:53946) 2024-08-18T22:50:49.522 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:49.520+0000 7ff29bfff640 1 -- 172.21.15.121:0/3034230416 learned_addr learned my addr 172.21.15.121:0/3034230416 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-18T22:50:49.522 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:49.520+0000 7ff29b7fe640 1 --2- 172.21.15.121:0/3034230416 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff29c0fbc50 0x7ff29c10d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:50:49.523 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:49.520+0000 7ff29bfff640 1 -- 172.21.15.121:0/3034230416 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff29c0fbc50 msgr2=0x7ff29c10d430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:50:49.523 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:49.520+0000 7ff29bfff640 1 --2- 172.21.15.121:0/3034230416 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff29c0fbc50 0x7ff29c10d430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:50:49.523 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:49.520+0000 7ff29bfff640 1 -- 172.21.15.121:0/3034230416 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff290005040 con 0x7ff29c0fa980 2024-08-18T22:50:49.523 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:49.520+0000 7ff29bfff640 1 --2- 172.21.15.121:0/3034230416 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff29c0fa980 0x7ff29c10cef0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7ff28c00c790 tx=0x7ff28c0043c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:50:49.523 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:49.520+0000 7ff298ff9640 1 -- 172.21.15.121:0/3034230416 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff28c00a820 con 0x7ff29c0fa980 2024-08-18T22:50:49.523 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:49.520+0000 7ff298ff9640 1 -- 172.21.15.121:0/3034230416 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7ff28c00ae20 con 0x7ff29c0fa980 2024-08-18T22:50:49.523 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:49.520+0000 7ff2a23c3640 1 -- 172.21.15.121:0/3034230416 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff29c10e450 con 0x7ff29c0fa980 2024-08-18T22:50:49.523 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:49.520+0000 7ff298ff9640 1 -- 172.21.15.121:0/3034230416 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff28c0113a0 con 0x7ff29c0fa980 2024-08-18T22:50:49.523 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:49.520+0000 7ff2a23c3640 1 -- 172.21.15.121:0/3034230416 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff29c10e9f0 con 0x7ff29c0fa980 2024-08-18T22:50:49.524 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:49.521+0000 7ff2a23c3640 1 -- 172.21.15.121:0/3034230416 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff29c0f9de0 con 0x7ff29c0fa980 2024-08-18T22:50:49.524 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:49.522+0000 7ff298ff9640 1 -- 172.21.15.121:0/3034230416 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 37) v1 ==== 92205+0+0 (secure 0 0 0) 0x7ff28c012400 con 0x7ff29c0fa980 2024-08-18T22:50:49.524 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:49.522+0000 7ff298ff9640 1 --2- 172.21.15.121:0/3034230416 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7ff28406e0b0 0x7ff284070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:50:49.524 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:49.522+0000 7ff298ff9640 1 -- 172.21.15.121:0/3034230416 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6668+0+0 (secure 0 0 0) 0x7ff28c08ddd0 con 0x7ff29c0fa980 2024-08-18T22:50:49.524 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:49.522+0000 7ff29b7fe640 1 --2- 172.21.15.121:0/3034230416 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7ff28406e0b0 0x7ff284070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:50:49.524 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:49.523+0000 7ff29b7fe640 1 --2- 172.21.15.121:0/3034230416 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7ff28406e0b0 0x7ff284070560 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7ff290007ac0 tx=0x7ff290035040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:50:49.527 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:49.526+0000 7ff298ff9640 1 -- 172.21.15.121:0/3034230416 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7ff28c0570d0 con 0x7ff29c0fa980 2024-08-18T22:50:49.773 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:49.772+0000 7ff2a23c3640 1 -- 172.21.15.121:0/3034230416 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7ff29c04b4c0 con 0x7ff29c0fa980 2024-08-18T22:50:49.773 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:49.772+0000 7ff298ff9640 1 -- 172.21.15.121:0/3034230416 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7ff28c05a790 con 0x7ff29c0fa980 2024-08-18T22:50:49.774 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:50:49 smithi121 ceph-mon[81053]: from='client.34530 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-18T22:50:49.774 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:50:49 smithi121 ceph-mon[81053]: from='client.34534 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-18T22:50:49.774 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:50:49 smithi121 ceph-mon[81053]: from='client.34538 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-18T22:50:49.774 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:50:49 smithi121 ceph-mon[81053]: pgmap v252: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:50:49.774 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:50:49 smithi121 ceph-mon[81053]: from='client.? 172.21.15.121:0/880342205' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-08-18T22:50:49.774 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:50:49 smithi121 ceph-mon[81053]: from='client.? 172.21.15.121:0/2513049923' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-08-18T22:50:49.774 INFO:teuthology.orchestra.run.smithi121.stdout:HEALTH_OK 2024-08-18T22:50:49.776 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:49.774+0000 7ff2a23c3640 1 -- 172.21.15.121:0/3034230416 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7ff28406e0b0 msgr2=0x7ff284070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:50:49.776 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:49.774+0000 7ff2a23c3640 1 --2- 172.21.15.121:0/3034230416 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7ff28406e0b0 0x7ff284070560 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7ff290007ac0 tx=0x7ff290035040 comp rx=0 tx=0).stop 2024-08-18T22:50:49.776 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:49.775+0000 7ff2a23c3640 1 -- 172.21.15.121:0/3034230416 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff29c0fa980 msgr2=0x7ff29c10cef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:50:49.776 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:49.775+0000 7ff2a23c3640 1 --2- 172.21.15.121:0/3034230416 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff29c0fa980 0x7ff29c10cef0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7ff28c00c790 tx=0x7ff28c0043c0 comp rx=0 tx=0).stop 2024-08-18T22:50:49.776 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:49.775+0000 7ff2a23c3640 1 -- 172.21.15.121:0/3034230416 shutdown_connections 2024-08-18T22:50:49.776 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:49.775+0000 7ff2a23c3640 1 --2- 172.21.15.121:0/3034230416 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7ff28406e0b0 0x7ff284070560 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:50:49.776 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:49.775+0000 7ff2a23c3640 1 --2- 172.21.15.121:0/3034230416 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff29c0fbc50 0x7ff29c10d430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:50:49.776 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:49.775+0000 7ff2a23c3640 1 --2- 172.21.15.121:0/3034230416 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff29c0fa980 0x7ff29c10cef0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:50:49.776 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:49.775+0000 7ff2a23c3640 1 -- 172.21.15.121:0/3034230416 >> 172.21.15.121:0/3034230416 conn(0x7ff29c0f6140 msgr2=0x7ff29c0f7230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:50:49.776 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:49.775+0000 7ff2a23c3640 1 -- 172.21.15.121:0/3034230416 shutdown_connections 2024-08-18T22:50:49.776 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:50:49.775+0000 7ff2a23c3640 1 -- 172.21.15.121:0/3034230416 wait complete. 2024-08-18T22:50:50.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:50:49 smithi195 ceph-mon[68841]: from='client.34530 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-18T22:50:50.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:50:49 smithi195 ceph-mon[68841]: from='client.34534 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-18T22:50:50.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:50:49 smithi195 ceph-mon[68841]: from='client.34538 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-18T22:50:50.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:50:49 smithi195 ceph-mon[68841]: pgmap v252: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:50:50.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:50:49 smithi195 ceph-mon[68841]: from='client.? 172.21.15.121:0/880342205' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-08-18T22:50:50.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:50:49 smithi195 ceph-mon[68841]: from='client.? 172.21.15.121:0/2513049923' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-08-18T22:50:50.850 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:50:50 smithi121 ceph-mon[81053]: from='client.34550 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-18T22:50:50.850 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:50:50 smithi121 ceph-mon[81053]: from='client.? 172.21.15.121:0/3034230416' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-08-18T22:50:51.060 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:50:50 smithi195 ceph-mon[68841]: from='client.34550 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-18T22:50:51.060 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:50:50 smithi195 ceph-mon[68841]: from='client.? 172.21.15.121:0/3034230416' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-08-18T22:50:52.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:50:51 smithi121 ceph-mon[81053]: pgmap v253: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:50:52.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:50:51 smithi195 ceph-mon[68841]: pgmap v253: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:50:53.333 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:50:53 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:50:53.334 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:50:53 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:50:53.334 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:50:53 smithi121 ceph-mon[81053]: pgmap v254: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:50:53.334 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:50:53 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:50:53.334 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:50:53 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:50:53.409 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:50:53 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:50:53.409 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:50:53 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:50:53.409 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:50:53 smithi195 ceph-mon[68841]: pgmap v254: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:50:53.409 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:50:53 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:50:53.409 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:50:53 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:50:54.333 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:50:54 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-18T22:50:54.409 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:50:54 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-18T22:50:55.333 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:50:55 smithi121 ceph-mon[81053]: pgmap v255: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:50:55.409 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:50:55 smithi195 ceph-mon[68841]: pgmap v255: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:50:57.904 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:50:57 smithi121 ceph-mon[81053]: pgmap v256: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:50:58.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:50:57 smithi195 ceph-mon[68841]: pgmap v256: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:51:00.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:50:59 smithi121 ceph-mon[81053]: pgmap v257: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:51:00.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:50:59 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:51:00.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:50:59 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:51:00.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:50:59 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:51:00.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:50:59 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-18T22:51:00.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:50:59 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:51:00.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:50:59 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-08-18T22:51:00.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:50:59 smithi121 ceph-mon[81053]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-08-18T22:51:00.085 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:50:59 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi121:3000"}]: dispatch 2024-08-18T22:51:00.085 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:50:59 smithi121 ceph-mon[81053]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi121:3000"}]: dispatch 2024-08-18T22:51:00.085 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:50:59 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:51:00.085 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:50:59 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-18T22:51:00.085 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:50:59 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "versions"}]: dispatch 2024-08-18T22:51:00.085 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:50:59 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "versions"}]: dispatch 2024-08-18T22:51:00.085 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:50:59 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "versions"}]: dispatch 2024-08-18T22:51:00.085 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:50:59 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "versions"}]: dispatch 2024-08-18T22:51:00.085 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:50:59 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "versions"}]: dispatch 2024-08-18T22:51:00.085 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:50:59 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "versions"}]: dispatch 2024-08-18T22:51:00.085 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:50:59 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "versions"}]: dispatch 2024-08-18T22:51:00.085 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:50:59 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "versions"}]: dispatch 2024-08-18T22:51:00.085 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:50:59 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "versions"}]: dispatch 2024-08-18T22:51:00.086 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:50:59 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "versions"}]: dispatch 2024-08-18T22:51:00.086 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:50:59 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "versions"}]: dispatch 2024-08-18T22:51:00.086 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:50:59 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "versions"}]: dispatch 2024-08-18T22:51:00.086 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:50:59 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "versions"}]: dispatch 2024-08-18T22:51:00.086 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:50:59 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "versions"}]: dispatch 2024-08-18T22:51:00.086 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:50:59 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "versions"}]: dispatch 2024-08-18T22:51:00.086 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:50:59 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "versions"}]: dispatch 2024-08-18T22:51:00.086 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:50:59 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "versions"}]: dispatch 2024-08-18T22:51:00.086 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:50:59 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "versions"}]: dispatch 2024-08-18T22:51:00.086 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:50:59 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:51:00.086 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:50:59 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-08-18T22:51:00.086 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:50:59 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-08-18T22:51:00.086 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:50:59 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-08-18T22:51:00.086 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:50:59 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-08-18T22:51:00.087 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:50:59 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-08-18T22:51:00.087 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:50:59 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]': finished 2024-08-18T22:51:00.087 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:50:59 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-08-18T22:51:00.087 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:50:59 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd"}]': finished 2024-08-18T22:51:00.087 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:50:59 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-08-18T22:51:00.087 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:50:59 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds"}]': finished 2024-08-18T22:51:00.087 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:50:59 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-08-18T22:51:00.087 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:50:59 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]': finished 2024-08-18T22:51:00.087 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:50:59 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-08-18T22:51:00.087 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:50:59 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-08-18T22:51:00.087 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:50:59 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-08-18T22:51:00.087 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:50:59 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]: dispatch 2024-08-18T22:51:00.087 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:50:59 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]': finished 2024-08-18T22:51:00.088 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:50:59 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-08-18T22:51:00.088 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:50:59 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]': finished 2024-08-18T22:51:00.088 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:50:59 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-08-18T22:51:00.088 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:50:59 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-08-18T22:51:00.088 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:50:59 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]: dispatch 2024-08-18T22:51:00.088 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:50:59 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2024-08-18T22:51:00.088 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:50:59 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-08-18T22:51:00.088 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:50:59 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-08-18T22:51:00.088 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:50:59 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-08-18T22:51:00.088 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:50:59 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-08-18T22:51:00.088 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:50:59 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-08-18T22:51:00.088 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:50:59 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-08-18T22:51:00.088 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:50:59 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-08-18T22:51:00.088 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:50:59 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-08-18T22:51:00.089 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:50:59 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-18T22:51:00.089 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:50:59 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:51:00.089 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:50:59 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-18T22:51:00.089 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:50:59 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:51:00.089 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:50:59 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-18T22:51:00.089 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:50:59 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:51:00.089 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:50:59 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-18T22:51:00.089 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:50:59 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:51:00.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:50:59 smithi195 ceph-mon[68841]: pgmap v257: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:51:00.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:50:59 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:51:00.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:50:59 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:51:00.160 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:50:59 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:51:00.160 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:50:59 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-18T22:51:00.160 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:50:59 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:51:00.160 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:50:59 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-08-18T22:51:00.160 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:50:59 smithi195 ceph-mon[68841]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-08-18T22:51:00.160 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:50:59 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi121:3000"}]: dispatch 2024-08-18T22:51:00.160 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:50:59 smithi195 ceph-mon[68841]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi121:3000"}]: dispatch 2024-08-18T22:51:00.160 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:50:59 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:51:00.160 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:50:59 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-18T22:51:00.160 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:50:59 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "versions"}]: dispatch 2024-08-18T22:51:00.160 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:50:59 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "versions"}]: dispatch 2024-08-18T22:51:00.160 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:50:59 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "versions"}]: dispatch 2024-08-18T22:51:00.160 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:50:59 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "versions"}]: dispatch 2024-08-18T22:51:00.161 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:50:59 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "versions"}]: dispatch 2024-08-18T22:51:00.161 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:50:59 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "versions"}]: dispatch 2024-08-18T22:51:00.161 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:50:59 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "versions"}]: dispatch 2024-08-18T22:51:00.161 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:50:59 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "versions"}]: dispatch 2024-08-18T22:51:00.161 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:50:59 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "versions"}]: dispatch 2024-08-18T22:51:00.161 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:50:59 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "versions"}]: dispatch 2024-08-18T22:51:00.161 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:50:59 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "versions"}]: dispatch 2024-08-18T22:51:00.161 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:50:59 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "versions"}]: dispatch 2024-08-18T22:51:00.161 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:50:59 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "versions"}]: dispatch 2024-08-18T22:51:00.161 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:50:59 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "versions"}]: dispatch 2024-08-18T22:51:00.161 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:50:59 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "versions"}]: dispatch 2024-08-18T22:51:00.161 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:50:59 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "versions"}]: dispatch 2024-08-18T22:51:00.161 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:50:59 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "versions"}]: dispatch 2024-08-18T22:51:00.162 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:50:59 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "versions"}]: dispatch 2024-08-18T22:51:00.162 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:50:59 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:51:00.162 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:50:59 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-08-18T22:51:00.162 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:50:59 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-08-18T22:51:00.162 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:50:59 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-08-18T22:51:00.162 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:50:59 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-08-18T22:51:00.162 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:50:59 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-08-18T22:51:00.162 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:50:59 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]': finished 2024-08-18T22:51:00.162 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:50:59 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-08-18T22:51:00.162 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:50:59 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd"}]': finished 2024-08-18T22:51:00.162 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:50:59 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-08-18T22:51:00.162 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:50:59 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds"}]': finished 2024-08-18T22:51:00.162 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:50:59 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-08-18T22:51:00.163 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:50:59 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]': finished 2024-08-18T22:51:00.163 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:50:59 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-08-18T22:51:00.163 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:50:59 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-08-18T22:51:00.163 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:50:59 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-08-18T22:51:00.163 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:50:59 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]: dispatch 2024-08-18T22:51:00.163 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:50:59 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]': finished 2024-08-18T22:51:00.163 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:50:59 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-08-18T22:51:00.163 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:50:59 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]': finished 2024-08-18T22:51:00.163 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:50:59 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-08-18T22:51:00.163 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:50:59 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-08-18T22:51:00.164 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:50:59 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]: dispatch 2024-08-18T22:51:00.164 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:50:59 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2024-08-18T22:51:00.164 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:50:59 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-08-18T22:51:00.164 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:50:59 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-08-18T22:51:00.164 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:50:59 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-08-18T22:51:00.164 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:50:59 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-08-18T22:51:00.164 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:50:59 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-08-18T22:51:00.164 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:50:59 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-08-18T22:51:00.164 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:50:59 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-08-18T22:51:00.164 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:50:59 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-08-18T22:51:00.164 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:50:59 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-18T22:51:00.164 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:50:59 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:51:00.164 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:50:59 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-18T22:51:00.165 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:50:59 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:51:00.165 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:50:59 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-18T22:51:00.165 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:50:59 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:51:00.165 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:50:59 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-18T22:51:00.165 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:50:59 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:51:01.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:51:00 smithi121 ceph-mon[81053]: Upgrade: Finalizing container_image settings 2024-08-18T22:51:01.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:51:00 smithi121 ceph-mon[81053]: Upgrade: Complete! 2024-08-18T22:51:01.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:51:00 smithi195 ceph-mon[68841]: Upgrade: Finalizing container_image settings 2024-08-18T22:51:01.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:51:00 smithi195 ceph-mon[68841]: Upgrade: Complete! 2024-08-18T22:51:02.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:51:01 smithi121 ceph-mon[81053]: pgmap v258: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:51:02.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:51:01 smithi195 ceph-mon[68841]: pgmap v258: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:51:04.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:51:03 smithi121 ceph-mon[81053]: pgmap v259: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:51:04.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:51:03 smithi195 ceph-mon[68841]: pgmap v259: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:51:05.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:51:04 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:51:05.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:51:04 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:51:06.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:51:05 smithi121 ceph-mon[81053]: pgmap v260: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:51:06.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:51:05 smithi195 ceph-mon[68841]: pgmap v260: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:51:08.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:51:07 smithi121 ceph-mon[81053]: pgmap v261: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:51:08.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:51:07 smithi195 ceph-mon[68841]: pgmap v261: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:51:09.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:51:08 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-18T22:51:09.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:51:08 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-18T22:51:10.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:51:09 smithi121 ceph-mon[81053]: pgmap v262: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:51:10.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:51:09 smithi195 ceph-mon[68841]: pgmap v262: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:51:12.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:51:11 smithi121 ceph-mon[81053]: pgmap v263: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:51:12.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:51:11 smithi195 ceph-mon[68841]: pgmap v263: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:51:14.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:51:13 smithi121 ceph-mon[81053]: pgmap v264: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:51:14.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:51:13 smithi195 ceph-mon[68841]: pgmap v264: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:51:16.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:51:15 smithi121 ceph-mon[81053]: pgmap v265: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:51:16.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:51:15 smithi195 ceph-mon[68841]: pgmap v265: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:51:18.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:51:17 smithi121 ceph-mon[81053]: pgmap v266: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:51:18.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:51:17 smithi195 ceph-mon[68841]: pgmap v266: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:51:19.863 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:51:19.859+0000 7fba4ad0a640 1 -- 172.21.15.121:0/2687538333 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fba440fb1f0 msgr2=0x7fba440fb600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:51:19.863 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:51:19.859+0000 7fba4ad0a640 1 --2- 172.21.15.121:0/2687538333 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fba440fb1f0 0x7fba440fb600 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fba380048d0 tx=0x7fba38009da0 comp rx=0 tx=0).stop 2024-08-18T22:51:19.864 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:51:19.859+0000 7fba4ad0a640 1 -- 172.21.15.121:0/2687538333 shutdown_connections 2024-08-18T22:51:19.864 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:51:19.860+0000 7fba4ad0a640 1 --2- 172.21.15.121:0/2687538333 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fba440fc4c0 0x7fba440fc930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:51:19.864 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:51:19.860+0000 7fba4ad0a640 1 --2- 172.21.15.121:0/2687538333 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fba440fb1f0 0x7fba440fb600 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:51:19.864 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:51:19.860+0000 7fba4ad0a640 1 -- 172.21.15.121:0/2687538333 >> 172.21.15.121:0/2687538333 conn(0x7fba440f69b0 msgr2=0x7fba440f8de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:51:19.864 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:51:19.860+0000 7fba4ad0a640 1 -- 172.21.15.121:0/2687538333 shutdown_connections 2024-08-18T22:51:19.864 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:51:19.860+0000 7fba4ad0a640 1 -- 172.21.15.121:0/2687538333 wait complete. 2024-08-18T22:51:19.864 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:51:19.860+0000 7fba4ad0a640 1 Processor -- start 2024-08-18T22:51:19.864 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:51:19.860+0000 7fba4ad0a640 1 -- start start 2024-08-18T22:51:19.864 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:51:19.860+0000 7fba4ad0a640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fba440fb1f0 0x7fba4410ceb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:51:19.864 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:51:19.860+0000 7fba4ad0a640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fba440fc4c0 0x7fba4410d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:51:19.864 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:51:19.861+0000 7fba4ad0a640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba4410da40 con 0x7fba440fc4c0 2024-08-18T22:51:19.864 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:51:19.861+0000 7fba4ad0a640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba4410e260 con 0x7fba440fb1f0 2024-08-18T22:51:19.864 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:51:19.861+0000 7fba43fff640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fba440fc4c0 0x7fba4410d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:51:19.864 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:51:19.861+0000 7fba43fff640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fba440fc4c0 0x7fba4410d3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:55856/0 (socket says 172.21.15.121:55856) 2024-08-18T22:51:19.865 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:51:19.861+0000 7fba43fff640 1 -- 172.21.15.121:0/3616121241 learned_addr learned my addr 172.21.15.121:0/3616121241 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-18T22:51:19.865 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:51:19.861+0000 7fba48aa6640 1 --2- 172.21.15.121:0/3616121241 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fba440fb1f0 0x7fba4410ceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:51:19.865 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:51:19.861+0000 7fba43fff640 1 -- 172.21.15.121:0/3616121241 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fba440fb1f0 msgr2=0x7fba4410ceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:51:19.865 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:51:19.861+0000 7fba43fff640 1 --2- 172.21.15.121:0/3616121241 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fba440fb1f0 0x7fba4410ceb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:51:19.865 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:51:19.861+0000 7fba43fff640 1 -- 172.21.15.121:0/3616121241 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba38005040 con 0x7fba440fc4c0 2024-08-18T22:51:19.865 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:51:19.861+0000 7fba43fff640 1 --2- 172.21.15.121:0/3616121241 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fba440fc4c0 0x7fba4410d3f0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fba30002a50 tx=0x7fba30004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:51:19.865 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:51:19.861+0000 7fba417fa640 1 -- 172.21.15.121:0/3616121241 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fba30007c30 con 0x7fba440fc4c0 2024-08-18T22:51:19.865 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:51:19.861+0000 7fba417fa640 1 -- 172.21.15.121:0/3616121241 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fba3000f040 con 0x7fba440fc4c0 2024-08-18T22:51:19.865 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:51:19.861+0000 7fba4ad0a640 1 -- 172.21.15.121:0/3616121241 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba4410e4f0 con 0x7fba440fc4c0 2024-08-18T22:51:19.865 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:51:19.861+0000 7fba417fa640 1 -- 172.21.15.121:0/3616121241 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fba3000da10 con 0x7fba440fc4c0 2024-08-18T22:51:19.865 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:51:19.861+0000 7fba4ad0a640 1 -- 172.21.15.121:0/3616121241 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba4410ea90 con 0x7fba440fc4c0 2024-08-18T22:51:19.865 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:51:19.862+0000 7fba4ad0a640 1 -- 172.21.15.121:0/3616121241 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba440fa650 con 0x7fba440fc4c0 2024-08-18T22:51:19.866 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:51:19.863+0000 7fba417fa640 1 -- 172.21.15.121:0/3616121241 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 37) v1 ==== 92205+0+0 (secure 0 0 0) 0x7fba3000dbb0 con 0x7fba440fc4c0 2024-08-18T22:51:19.866 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:51:19.864+0000 7fba417fa640 1 --2- 172.21.15.121:0/3616121241 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7fba3406e0b0 0x7fba34070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:51:19.866 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:51:19.864+0000 7fba417fa640 1 -- 172.21.15.121:0/3616121241 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6668+0+0 (secure 0 0 0) 0x7fba3008d340 con 0x7fba440fc4c0 2024-08-18T22:51:19.866 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:51:19.864+0000 7fba48aa6640 1 --2- 172.21.15.121:0/3616121241 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7fba3406e0b0 0x7fba34070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:51:19.867 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:51:19.864+0000 7fba48aa6640 1 --2- 172.21.15.121:0/3616121241 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7fba3406e0b0 0x7fba34070560 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fba38007ac0 tx=0x7fba38035040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:51:19.869 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:51:19.868+0000 7fba417fa640 1 -- 172.21.15.121:0/3616121241 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7fba300566f0 con 0x7fba440fc4c0 2024-08-18T22:51:20.051 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:51:20.050+0000 7fba4ad0a640 1 -- 172.21.15.121:0/3616121241 --> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fba44103d90 con 0x7fba3406e0b0 2024-08-18T22:51:20.053 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:51:19 smithi121 ceph-mon[81053]: pgmap v267: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:51:20.053 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:51:20.051+0000 7fba417fa640 1 -- 172.21.15.121:0/3616121241 <== mgr.34102 v2:172.21.15.121:6800/3037387239 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+175 (secure 0 0 0) 0x7fba44103d90 con 0x7fba3406e0b0 2024-08-18T22:51:20.054 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:51:20.053+0000 7fba4ad0a640 1 -- 172.21.15.121:0/3616121241 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7fba3406e0b0 msgr2=0x7fba34070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:51:20.054 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:51:20.053+0000 7fba4ad0a640 1 --2- 172.21.15.121:0/3616121241 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7fba3406e0b0 0x7fba34070560 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fba38007ac0 tx=0x7fba38035040 comp rx=0 tx=0).stop 2024-08-18T22:51:20.055 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:51:20.053+0000 7fba4ad0a640 1 -- 172.21.15.121:0/3616121241 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fba440fc4c0 msgr2=0x7fba4410d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:51:20.055 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:51:20.053+0000 7fba4ad0a640 1 --2- 172.21.15.121:0/3616121241 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fba440fc4c0 0x7fba4410d3f0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fba30002a50 tx=0x7fba30004600 comp rx=0 tx=0).stop 2024-08-18T22:51:20.055 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:51:20.053+0000 7fba4ad0a640 1 -- 172.21.15.121:0/3616121241 shutdown_connections 2024-08-18T22:51:20.055 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:51:20.053+0000 7fba4ad0a640 1 --2- 172.21.15.121:0/3616121241 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7fba3406e0b0 0x7fba34070560 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:51:20.055 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:51:20.053+0000 7fba4ad0a640 1 --2- 172.21.15.121:0/3616121241 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fba440fc4c0 0x7fba4410d3f0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:51:20.055 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:51:20.053+0000 7fba4ad0a640 1 --2- 172.21.15.121:0/3616121241 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fba440fb1f0 0x7fba4410ceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:51:20.055 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:51:20.053+0000 7fba4ad0a640 1 -- 172.21.15.121:0/3616121241 >> 172.21.15.121:0/3616121241 conn(0x7fba440f69b0 msgr2=0x7fba44065e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:51:20.055 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:51:20.053+0000 7fba4ad0a640 1 -- 172.21.15.121:0/3616121241 shutdown_connections 2024-08-18T22:51:20.055 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:51:20.053+0000 7fba4ad0a640 1 -- 172.21.15.121:0/3616121241 wait complete. 2024-08-18T22:51:20.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:51:19 smithi195 ceph-mon[68841]: pgmap v267: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:51:20.769 DEBUG:teuthology.orchestra.run.smithi121:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b003123a-5db1-11ef-bccf-c7b262605968 -e sha1=de09dd018de4baddfa6ca4d43bc8fb784cf75833 -- bash -c 'ceph orch ps' 2024-08-18T22:51:21.024 INFO:teuthology.orchestra.run.smithi121.stderr:Inferring config /var/lib/ceph/b003123a-5db1-11ef-bccf-c7b262605968/mon.smithi121/config 2024-08-18T22:51:21.984 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:51:21 smithi195 ceph-mon[68841]: from='client.34558 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-18T22:51:21.984 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:51:21 smithi195 ceph-mon[68841]: pgmap v268: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:51:22.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:51:21 smithi121 ceph-mon[81053]: from='client.34558 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-18T22:51:22.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:51:21 smithi121 ceph-mon[81053]: pgmap v268: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:51:22.665 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:51:22.642+0000 7f88b67b8640 1 -- 172.21.15.121:0/851004597 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f88b0101350 msgr2=0x7f88b0101720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:51:22.665 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:51:22.642+0000 7f88b67b8640 1 --2- 172.21.15.121:0/851004597 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f88b0101350 0x7f88b0101720 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f88a00048d0 tx=0x7f88a0009da0 comp rx=0 tx=0).stop 2024-08-18T22:51:22.665 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:51:22.642+0000 7f88b67b8640 1 -- 172.21.15.121:0/851004597 shutdown_connections 2024-08-18T22:51:22.665 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:51:22.642+0000 7f88b67b8640 1 --2- 172.21.15.121:0/851004597 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f88b0101cf0 0x7f88b00fb270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:51:22.665 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:51:22.642+0000 7f88b67b8640 1 --2- 172.21.15.121:0/851004597 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f88b0101350 0x7f88b0101720 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:51:22.665 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:51:22.642+0000 7f88b67b8640 1 -- 172.21.15.121:0/851004597 >> 172.21.15.121:0/851004597 conn(0x7f88b00f6dd0 msgr2=0x7f88b00f91e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:51:22.665 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:51:22.642+0000 7f88b67b8640 1 -- 172.21.15.121:0/851004597 shutdown_connections 2024-08-18T22:51:22.665 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:51:22.642+0000 7f88b67b8640 1 -- 172.21.15.121:0/851004597 wait complete. 2024-08-18T22:51:22.666 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:51:22.643+0000 7f88b67b8640 1 Processor -- start 2024-08-18T22:51:22.666 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:51:22.643+0000 7f88b67b8640 1 -- start start 2024-08-18T22:51:22.666 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:51:22.643+0000 7f88b67b8640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f88b0101350 0x7f88b0111fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:51:22.666 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:51:22.643+0000 7f88b67b8640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f88b0101cf0 0x7f88b01124e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:51:22.666 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:51:22.643+0000 7f88b67b8640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88b0112ae0 con 0x7f88b0101cf0 2024-08-18T22:51:22.666 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:51:22.643+0000 7f88b67b8640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88b010bf20 con 0x7f88b0101350 2024-08-18T22:51:22.666 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:51:22.643+0000 7f88af7fe640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f88b0101cf0 0x7f88b01124e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:51:22.666 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:51:22.643+0000 7f88af7fe640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f88b0101cf0 0x7f88b01124e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:55884/0 (socket says 172.21.15.121:55884) 2024-08-18T22:51:22.666 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:51:22.643+0000 7f88af7fe640 1 -- 172.21.15.121:0/2516866895 learned_addr learned my addr 172.21.15.121:0/2516866895 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-18T22:51:22.666 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:51:22.643+0000 7f88affff640 1 --2- 172.21.15.121:0/2516866895 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f88b0101350 0x7f88b0111fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:51:22.666 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:51:22.643+0000 7f88af7fe640 1 -- 172.21.15.121:0/2516866895 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f88b0101350 msgr2=0x7f88b0111fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:51:22.666 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:51:22.643+0000 7f88af7fe640 1 --2- 172.21.15.121:0/2516866895 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f88b0101350 0x7f88b0111fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:51:22.666 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:51:22.643+0000 7f88af7fe640 1 -- 172.21.15.121:0/2516866895 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88a0005040 con 0x7f88b0101cf0 2024-08-18T22:51:22.667 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:51:22.644+0000 7f88af7fe640 1 --2- 172.21.15.121:0/2516866895 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f88b0101cf0 0x7f88b01124e0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f88a400eb70 tx=0x7f88a400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:51:22.667 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:51:22.644+0000 7f88acff9640 1 -- 172.21.15.121:0/2516866895 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f88a4007c30 con 0x7f88b0101cf0 2024-08-18T22:51:22.667 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:51:22.644+0000 7f88b67b8640 1 -- 172.21.15.121:0/2516866895 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88b010c1a0 con 0x7f88b0101cf0 2024-08-18T22:51:22.667 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:51:22.644+0000 7f88acff9640 1 -- 172.21.15.121:0/2516866895 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f88a400f040 con 0x7f88b0101cf0 2024-08-18T22:51:22.667 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:51:22.644+0000 7f88acff9640 1 -- 172.21.15.121:0/2516866895 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f88a40094e0 con 0x7f88b0101cf0 2024-08-18T22:51:22.667 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:51:22.644+0000 7f88b67b8640 1 -- 172.21.15.121:0/2516866895 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88b010c740 con 0x7f88b0101cf0 2024-08-18T22:51:22.667 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:51:22.645+0000 7f88b67b8640 1 -- 172.21.15.121:0/2516866895 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88b00faa30 con 0x7f88b0101cf0 2024-08-18T22:51:22.667 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:51:22.645+0000 7f88acff9640 1 -- 172.21.15.121:0/2516866895 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 37) v1 ==== 92205+0+0 (secure 0 0 0) 0x7f88a4009750 con 0x7f88b0101cf0 2024-08-18T22:51:22.667 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:51:22.646+0000 7f88acff9640 1 --2- 172.21.15.121:0/2516866895 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f889806e0b0 0x7f8898070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:51:22.667 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:51:22.646+0000 7f88acff9640 1 -- 172.21.15.121:0/2516866895 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6668+0+0 (secure 0 0 0) 0x7f88a408d8d0 con 0x7f88b0101cf0 2024-08-18T22:51:22.667 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:51:22.646+0000 7f88affff640 1 --2- 172.21.15.121:0/2516866895 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f889806e0b0 0x7f8898070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:51:22.667 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:51:22.646+0000 7f88affff640 1 --2- 172.21.15.121:0/2516866895 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f889806e0b0 0x7f8898070560 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f88a0004540 tx=0x7f88a0035040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:51:22.667 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:51:22.650+0000 7f88acff9640 1 -- 172.21.15.121:0/2516866895 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f88a4056c00 con 0x7f88b0101cf0 2024-08-18T22:51:22.826 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:51:22.825+0000 7f88b67b8640 1 -- 172.21.15.121:0/2516866895 --> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f88b004b4c0 con 0x7f889806e0b0 2024-08-18T22:51:22.835 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:51:22.834+0000 7f88acff9640 1 -- 172.21.15.121:0/2516866895 <== mgr.34102 v2:172.21.15.121:6800/3037387239 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7f88b004b4c0 con 0x7f889806e0b0 2024-08-18T22:51:22.835 INFO:teuthology.orchestra.run.smithi121.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-08-18T22:51:22.836 INFO:teuthology.orchestra.run.smithi121.stdout:alertmanager.smithi121 smithi121 *:9093,9094 running (56s) 30s ago 17m 17.4M - 0.25.0 c8568f914cd2 50a5a7767cfb 2024-08-18T22:51:22.836 INFO:teuthology.orchestra.run.smithi121.stdout:crash.smithi121 smithi121 running (6m) 30s ago 17m 6903k - 19.1.0-1382-gde09dd01 ea7a5189f30b 3cf5c666a0e6 2024-08-18T22:51:22.836 INFO:teuthology.orchestra.run.smithi121.stdout:crash.smithi195 smithi195 running (6m) 84s ago 16m 6895k - 19.1.0-1382-gde09dd01 ea7a5189f30b fbb586fb9834 2024-08-18T22:51:22.836 INFO:teuthology.orchestra.run.smithi121.stdout:grafana.smithi121 smithi121 *:3000 running (35s) 30s ago 17m 48.1M - 9.4.12 2bacad6d85d8 5a871f6fc461 2024-08-18T22:51:22.836 INFO:teuthology.orchestra.run.smithi121.stdout:mds.cephfs.smithi121.gbickb smithi121 running (2m) 30s ago 12m 18.9M - 19.1.0-1382-gde09dd01 ea7a5189f30b 3d6dc5c5f472 2024-08-18T22:51:22.836 INFO:teuthology.orchestra.run.smithi121.stdout:mds.cephfs.smithi121.xuzsdg smithi121 running (2m) 30s ago 12m 76.2M - 19.1.0-1382-gde09dd01 ea7a5189f30b 4eec4d0a895e 2024-08-18T22:51:22.837 INFO:teuthology.orchestra.run.smithi121.stdout:mds.cephfs.smithi195.buqvbr smithi195 running (2m) 84s ago 12m 12.4M - 19.1.0-1382-gde09dd01 ea7a5189f30b dca538294bee 2024-08-18T22:51:22.837 INFO:teuthology.orchestra.run.smithi121.stdout:mds.cephfs.smithi195.nptgyc smithi195 running (108s) 84s ago 12m 13.2M - 19.1.0-1382-gde09dd01 ea7a5189f30b 42528b070f11 2024-08-18T22:51:22.837 INFO:teuthology.orchestra.run.smithi121.stdout:mgr.smithi121.lopxqc smithi121 *:8443,9283,8765 running (8m) 30s ago 18m 515M - 19.1.0-1382-gde09dd01 ea7a5189f30b 9079701e6516 2024-08-18T22:51:22.837 INFO:teuthology.orchestra.run.smithi121.stdout:mgr.smithi195.acttsj smithi195 *:8443,9283,8765 running (8m) 84s ago 16m 442M - 19.1.0-1382-gde09dd01 ea7a5189f30b 7b4027a33daa 2024-08-18T22:51:22.837 INFO:teuthology.orchestra.run.smithi121.stdout:mon.smithi121 smithi121 running (7m) 30s ago 18m 58.4M 2048M 19.1.0-1382-gde09dd01 ea7a5189f30b d71695a4fb56 2024-08-18T22:51:22.838 INFO:teuthology.orchestra.run.smithi121.stdout:mon.smithi195 smithi195 running (7m) 84s ago 16m 40.9M 2048M 19.1.0-1382-gde09dd01 ea7a5189f30b a9bb94ba3b56 2024-08-18T22:51:22.838 INFO:teuthology.orchestra.run.smithi121.stdout:node-exporter.smithi121 smithi121 *:9100 running (91s) 30s ago 17m 9899k - 1.5.0 0da6a335fe13 5c8d00b736b0 2024-08-18T22:51:22.838 INFO:teuthology.orchestra.run.smithi121.stdout:node-exporter.smithi195 smithi195 *:9100 running (87s) 84s ago 16m 3602k - 1.5.0 0da6a335fe13 55fe298190b2 2024-08-18T22:51:22.838 INFO:teuthology.orchestra.run.smithi121.stdout:osd.0 smithi121 running (6m) 30s ago 15m 143M 1557M 19.1.0-1382-gde09dd01 ea7a5189f30b d378dd46eeb6 2024-08-18T22:51:22.838 INFO:teuthology.orchestra.run.smithi121.stdout:osd.1 smithi121 running (5m) 30s ago 15m 166M 1557M 19.1.0-1382-gde09dd01 ea7a5189f30b 0f9e03de5382 2024-08-18T22:51:22.839 INFO:teuthology.orchestra.run.smithi121.stdout:osd.2 smithi121 running (5m) 30s ago 14m 132M 1557M 19.1.0-1382-gde09dd01 ea7a5189f30b 93270b5bed68 2024-08-18T22:51:22.839 INFO:teuthology.orchestra.run.smithi121.stdout:osd.3 smithi195 running (4m) 84s ago 14m 188M 2581M 19.1.0-1382-gde09dd01 ea7a5189f30b 72c2860c0e9f 2024-08-18T22:51:22.839 INFO:teuthology.orchestra.run.smithi121.stdout:osd.4 smithi195 running (4m) 84s ago 14m 169M 2581M 19.1.0-1382-gde09dd01 ea7a5189f30b d88a83c97247 2024-08-18T22:51:22.839 INFO:teuthology.orchestra.run.smithi121.stdout:osd.5 smithi195 running (3m) 84s ago 13m 150M 2581M 19.1.0-1382-gde09dd01 ea7a5189f30b 5af2d6de9afe 2024-08-18T22:51:22.840 INFO:teuthology.orchestra.run.smithi121.stdout:prometheus.smithi121 smithi121 *:9095 running (71s) 30s ago 16m 53.2M - 2.43.0 a07b618ecd1d ad25302956e5 2024-08-18T22:51:22.842 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:51:22.836+0000 7f88b67b8640 1 -- 172.21.15.121:0/2516866895 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f889806e0b0 msgr2=0x7f8898070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:51:22.842 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:51:22.836+0000 7f88b67b8640 1 --2- 172.21.15.121:0/2516866895 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f889806e0b0 0x7f8898070560 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f88a0004540 tx=0x7f88a0035040 comp rx=0 tx=0).stop 2024-08-18T22:51:22.842 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:51:22.836+0000 7f88b67b8640 1 -- 172.21.15.121:0/2516866895 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f88b0101cf0 msgr2=0x7f88b01124e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:51:22.842 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:51:22.836+0000 7f88b67b8640 1 --2- 172.21.15.121:0/2516866895 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f88b0101cf0 0x7f88b01124e0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f88a400eb70 tx=0x7f88a400b040 comp rx=0 tx=0).stop 2024-08-18T22:51:22.842 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:51:22.836+0000 7f88b67b8640 1 -- 172.21.15.121:0/2516866895 shutdown_connections 2024-08-18T22:51:22.842 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:51:22.836+0000 7f88b67b8640 1 --2- 172.21.15.121:0/2516866895 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f889806e0b0 0x7f8898070560 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:51:22.842 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:51:22.836+0000 7f88b67b8640 1 --2- 172.21.15.121:0/2516866895 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f88b0101cf0 0x7f88b01124e0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:51:22.843 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:51:22.836+0000 7f88b67b8640 1 --2- 172.21.15.121:0/2516866895 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f88b0101350 0x7f88b0111fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:51:22.843 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:51:22.836+0000 7f88b67b8640 1 -- 172.21.15.121:0/2516866895 >> 172.21.15.121:0/2516866895 conn(0x7f88b00f6dd0 msgr2=0x7f88b00f7e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:51:22.843 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:51:22.836+0000 7f88b67b8640 1 -- 172.21.15.121:0/2516866895 shutdown_connections 2024-08-18T22:51:22.843 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:51:22.836+0000 7f88b67b8640 1 -- 172.21.15.121:0/2516866895 wait complete. 2024-08-18T22:51:23.408 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:51:23 smithi195 ceph-mon[68841]: pgmap v269: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:51:23.426 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:51:23 smithi121 ceph-mon[81053]: pgmap v269: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:51:23.451 DEBUG:teuthology.orchestra.run.smithi121:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b003123a-5db1-11ef-bccf-c7b262605968 -e sha1=de09dd018de4baddfa6ca4d43bc8fb784cf75833 -- bash -c 'ceph orch upgrade status' 2024-08-18T22:51:23.707 INFO:teuthology.orchestra.run.smithi121.stderr:Inferring config /var/lib/ceph/b003123a-5db1-11ef-bccf-c7b262605968/mon.smithi121/config 2024-08-18T22:51:24.659 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:51:24 smithi195 ceph-mon[68841]: from='client.34562 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-18T22:51:24.659 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:51:24 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-18T22:51:24.725 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:51:24 smithi121 ceph-mon[81053]: from='client.34562 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-18T22:51:24.726 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:51:24 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-18T22:51:25.258 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:51:25.256+0000 7f9942020640 1 -- 172.21.15.121:0/4208436928 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f993c0fb5b0 msgr2=0x7f993c0fb980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:51:25.259 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:51:25.256+0000 7f9942020640 1 --2- 172.21.15.121:0/4208436928 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f993c0fb5b0 0x7f993c0fb980 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f992c0048d0 tx=0x7f992c009da0 comp rx=0 tx=0).stop 2024-08-18T22:51:25.259 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:51:25.256+0000 7f9942020640 1 -- 172.21.15.121:0/4208436928 shutdown_connections 2024-08-18T22:51:25.259 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:51:25.256+0000 7f9942020640 1 --2- 172.21.15.121:0/4208436928 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f993c0fbec0 0x7f993c0fcdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:51:25.259 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:51:25.256+0000 7f9942020640 1 --2- 172.21.15.121:0/4208436928 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f993c0fb5b0 0x7f993c0fb980 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:51:25.259 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:51:25.256+0000 7f9942020640 1 -- 172.21.15.121:0/4208436928 >> 172.21.15.121:0/4208436928 conn(0x7f993c072150 msgr2=0x7f993c072550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:51:25.259 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:51:25.256+0000 7f9942020640 1 -- 172.21.15.121:0/4208436928 shutdown_connections 2024-08-18T22:51:25.259 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:51:25.256+0000 7f9942020640 1 -- 172.21.15.121:0/4208436928 wait complete. 2024-08-18T22:51:25.259 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:51:25.256+0000 7f9942020640 1 Processor -- start 2024-08-18T22:51:25.259 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:51:25.257+0000 7f9942020640 1 -- start start 2024-08-18T22:51:25.259 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:51:25.257+0000 7f9942020640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f993c0fb5b0 0x7f993c1151d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:51:25.259 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:51:25.257+0000 7f9942020640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f993c0fbec0 0x7f993c115710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:51:25.259 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:51:25.257+0000 7f9942020640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f993c115da0 con 0x7f993c0fb5b0 2024-08-18T22:51:25.260 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:51:25.257+0000 7f9942020640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f993c10f150 con 0x7f993c0fbec0 2024-08-18T22:51:25.260 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:51:25.257+0000 7f993b7fe640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f993c0fb5b0 0x7f993c1151d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:51:25.260 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:51:25.257+0000 7f993b7fe640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f993c0fb5b0 0x7f993c1151d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:55910/0 (socket says 172.21.15.121:55910) 2024-08-18T22:51:25.260 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:51:25.257+0000 7f993b7fe640 1 -- 172.21.15.121:0/731092226 learned_addr learned my addr 172.21.15.121:0/731092226 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-18T22:51:25.260 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:51:25.257+0000 7f993affd640 1 --2- 172.21.15.121:0/731092226 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f993c0fbec0 0x7f993c115710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:51:25.260 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:51:25.257+0000 7f993b7fe640 1 -- 172.21.15.121:0/731092226 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f993c0fbec0 msgr2=0x7f993c115710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:51:25.260 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:51:25.257+0000 7f993b7fe640 1 --2- 172.21.15.121:0/731092226 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f993c0fbec0 0x7f993c115710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:51:25.260 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:51:25.257+0000 7f993b7fe640 1 -- 172.21.15.121:0/731092226 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f992c005040 con 0x7f993c0fb5b0 2024-08-18T22:51:25.260 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:51:25.257+0000 7f993b7fe640 1 --2- 172.21.15.121:0/731092226 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f993c0fb5b0 0x7f993c1151d0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f992c003080 tx=0x7f992c009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:51:25.260 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:51:25.257+0000 7f9923fff640 1 -- 172.21.15.121:0/731092226 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f992c038070 con 0x7f993c0fb5b0 2024-08-18T22:51:25.260 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:51:25.258+0000 7f9923fff640 1 -- 172.21.15.121:0/731092226 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f992c0097e0 con 0x7f993c0fb5b0 2024-08-18T22:51:25.260 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:51:25.258+0000 7f9942020640 1 -- 172.21.15.121:0/731092226 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f993c10f3d0 con 0x7f993c0fb5b0 2024-08-18T22:51:25.260 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:51:25.258+0000 7f9923fff640 1 -- 172.21.15.121:0/731092226 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f992c03d420 con 0x7f993c0fb5b0 2024-08-18T22:51:25.261 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:51:25.258+0000 7f9942020640 1 -- 172.21.15.121:0/731092226 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f993c10f890 con 0x7f993c0fb5b0 2024-08-18T22:51:25.261 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:51:25.259+0000 7f9942020640 1 -- 172.21.15.121:0/731092226 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f993c0fc960 con 0x7f993c0fb5b0 2024-08-18T22:51:25.262 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:51:25.259+0000 7f9923fff640 1 -- 172.21.15.121:0/731092226 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 37) v1 ==== 92205+0+0 (secure 0 0 0) 0x7f992c030020 con 0x7f993c0fb5b0 2024-08-18T22:51:25.262 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:51:25.259+0000 7f9923fff640 1 --2- 172.21.15.121:0/731092226 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f992406e0b0 0x7f9924070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:51:25.262 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:51:25.260+0000 7f9923fff640 1 -- 172.21.15.121:0/731092226 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6668+0+0 (secure 0 0 0) 0x7f992c0ae1f0 con 0x7f993c0fb5b0 2024-08-18T22:51:25.262 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:51:25.260+0000 7f993affd640 1 --2- 172.21.15.121:0/731092226 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f992406e0b0 0x7f9924070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:51:25.262 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:51:25.260+0000 7f993affd640 1 --2- 172.21.15.121:0/731092226 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f992406e0b0 0x7f9924070560 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f9930006fd0 tx=0x7f9930008040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:51:25.264 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:51:25.264+0000 7f9923fff640 1 -- 172.21.15.121:0/731092226 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f992c077470 con 0x7f993c0fb5b0 2024-08-18T22:51:25.449 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:51:25.448+0000 7f9942020640 1 -- 172.21.15.121:0/731092226 --> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f993c04b4c0 con 0x7f992406e0b0 2024-08-18T22:51:25.450 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:51:25.449+0000 7f9923fff640 1 -- 172.21.15.121:0/731092226 <== mgr.34102 v2:172.21.15.121:6800/3037387239 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+175 (secure 0 0 0) 0x7f993c04b4c0 con 0x7f992406e0b0 2024-08-18T22:51:25.450 INFO:teuthology.orchestra.run.smithi121.stdout:{ 2024-08-18T22:51:25.450 INFO:teuthology.orchestra.run.smithi121.stdout: "target_image": null, 2024-08-18T22:51:25.450 INFO:teuthology.orchestra.run.smithi121.stdout: "in_progress": false, 2024-08-18T22:51:25.451 INFO:teuthology.orchestra.run.smithi121.stdout: "which": "", 2024-08-18T22:51:25.451 INFO:teuthology.orchestra.run.smithi121.stdout: "services_complete": [], 2024-08-18T22:51:25.451 INFO:teuthology.orchestra.run.smithi121.stdout: "progress": null, 2024-08-18T22:51:25.451 INFO:teuthology.orchestra.run.smithi121.stdout: "message": "", 2024-08-18T22:51:25.451 INFO:teuthology.orchestra.run.smithi121.stdout: "is_paused": false 2024-08-18T22:51:25.451 INFO:teuthology.orchestra.run.smithi121.stdout:} 2024-08-18T22:51:25.452 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:51:25.451+0000 7f9942020640 1 -- 172.21.15.121:0/731092226 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f992406e0b0 msgr2=0x7f9924070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:51:25.452 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:51:25.451+0000 7f9942020640 1 --2- 172.21.15.121:0/731092226 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f992406e0b0 0x7f9924070560 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f9930006fd0 tx=0x7f9930008040 comp rx=0 tx=0).stop 2024-08-18T22:51:25.453 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:51:25.451+0000 7f9942020640 1 -- 172.21.15.121:0/731092226 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f993c0fb5b0 msgr2=0x7f993c1151d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:51:25.453 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:51:25.451+0000 7f9942020640 1 --2- 172.21.15.121:0/731092226 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f993c0fb5b0 0x7f993c1151d0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f992c003080 tx=0x7f992c009da0 comp rx=0 tx=0).stop 2024-08-18T22:51:25.453 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:51:25.452+0000 7f9942020640 1 -- 172.21.15.121:0/731092226 shutdown_connections 2024-08-18T22:51:25.453 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:51:25.452+0000 7f9942020640 1 --2- 172.21.15.121:0/731092226 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f992406e0b0 0x7f9924070560 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:51:25.453 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:51:25.452+0000 7f9942020640 1 --2- 172.21.15.121:0/731092226 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f993c0fbec0 0x7f993c115710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:51:25.453 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:51:25.452+0000 7f9942020640 1 --2- 172.21.15.121:0/731092226 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f993c0fb5b0 0x7f993c1151d0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:51:25.453 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:51:25.452+0000 7f9942020640 1 -- 172.21.15.121:0/731092226 >> 172.21.15.121:0/731092226 conn(0x7f993c072150 msgr2=0x7f993c0fded0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:51:25.453 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:51:25.452+0000 7f9942020640 1 -- 172.21.15.121:0/731092226 shutdown_connections 2024-08-18T22:51:25.453 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:51:25.452+0000 7f9942020640 1 -- 172.21.15.121:0/731092226 wait complete. 2024-08-18T22:51:25.659 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:51:25 smithi195 ceph-mon[68841]: pgmap v270: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:51:25.831 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:51:25 smithi121 ceph-mon[81053]: pgmap v270: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:51:26.075 DEBUG:teuthology.orchestra.run.smithi121:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b003123a-5db1-11ef-bccf-c7b262605968 -e sha1=de09dd018de4baddfa6ca4d43bc8fb784cf75833 -- bash -c 'ceph health detail' 2024-08-18T22:51:26.324 INFO:teuthology.orchestra.run.smithi121.stderr:Inferring config /var/lib/ceph/b003123a-5db1-11ef-bccf-c7b262605968/mon.smithi121/config 2024-08-18T22:51:26.659 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:51:26 smithi195 ceph-mon[68841]: from='client.34566 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-18T22:51:26.712 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:51:26 smithi121 ceph-mon[81053]: from='client.34566 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-18T22:51:27.418 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:51:27 smithi121 ceph-mon[81053]: pgmap v271: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:51:27.659 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:51:27 smithi195 ceph-mon[68841]: pgmap v271: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:51:27.908 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:51:27.903+0000 7fe8774e1640 1 -- 172.21.15.121:0/3565587734 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe8700fdef0 msgr2=0x7fe8700fe320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:51:27.908 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:51:27.903+0000 7fe8774e1640 1 --2- 172.21.15.121:0/3565587734 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe8700fdef0 0x7fe8700fe320 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fe8600048d0 tx=0x7fe860009da0 comp rx=0 tx=0).stop 2024-08-18T22:51:27.908 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:51:27.903+0000 7fe8774e1640 1 -- 172.21.15.121:0/3565587734 shutdown_connections 2024-08-18T22:51:27.909 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:51:27.903+0000 7fe8774e1640 1 --2- 172.21.15.121:0/3565587734 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe8700fdef0 0x7fe8700fe320 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:51:27.909 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:51:27.903+0000 7fe8774e1640 1 --2- 172.21.15.121:0/3565587734 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe8700650e0 0x7fe8700654b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:51:27.909 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:51:27.903+0000 7fe8774e1640 1 -- 172.21.15.121:0/3565587734 >> 172.21.15.121:0/3565587734 conn(0x7fe870072150 msgr2=0x7fe870072550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:51:27.909 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:51:27.903+0000 7fe8774e1640 1 -- 172.21.15.121:0/3565587734 shutdown_connections 2024-08-18T22:51:27.909 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:51:27.903+0000 7fe8774e1640 1 -- 172.21.15.121:0/3565587734 wait complete. 2024-08-18T22:51:27.909 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:51:27.904+0000 7fe8774e1640 1 Processor -- start 2024-08-18T22:51:27.910 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:51:27.904+0000 7fe8774e1640 1 -- start start 2024-08-18T22:51:27.910 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:51:27.904+0000 7fe8774e1640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe8700650e0 0x7fe870113000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:51:27.910 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:51:27.904+0000 7fe8774e1640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe8700fdef0 0x7fe870113540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:51:27.910 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:51:27.904+0000 7fe8774e1640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe870113b40 con 0x7fe8700fdef0 2024-08-18T22:51:27.910 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:51:27.904+0000 7fe8774e1640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe87010cf80 con 0x7fe8700650e0 2024-08-18T22:51:27.910 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:51:27.904+0000 7fe874a7c640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe8700fdef0 0x7fe870113540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:51:27.910 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:51:27.904+0000 7fe874a7c640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe8700fdef0 0x7fe870113540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:43050/0 (socket says 172.21.15.121:43050) 2024-08-18T22:51:27.911 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:51:27.904+0000 7fe874a7c640 1 -- 172.21.15.121:0/1114298895 learned_addr learned my addr 172.21.15.121:0/1114298895 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-18T22:51:27.911 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:51:27.904+0000 7fe874a7c640 1 -- 172.21.15.121:0/1114298895 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe8700650e0 msgr2=0x7fe870113000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:51:27.911 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:51:27.904+0000 7fe87527d640 1 --2- 172.21.15.121:0/1114298895 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe8700650e0 0x7fe870113000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:51:27.912 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:51:27.904+0000 7fe874a7c640 1 --2- 172.21.15.121:0/1114298895 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe8700650e0 0x7fe870113000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:51:27.912 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:51:27.904+0000 7fe874a7c640 1 -- 172.21.15.121:0/1114298895 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe860005040 con 0x7fe8700fdef0 2024-08-18T22:51:27.912 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:51:27.904+0000 7fe87527d640 1 --2- 172.21.15.121:0/1114298895 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe8700650e0 0x7fe870113000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:51:27.912 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:51:27.905+0000 7fe874a7c640 1 --2- 172.21.15.121:0/1114298895 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe8700fdef0 0x7fe870113540 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fe860003080 tx=0x7fe860009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:51:27.912 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:51:27.905+0000 7fe865ffb640 1 -- 172.21.15.121:0/1114298895 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe860038070 con 0x7fe8700fdef0 2024-08-18T22:51:27.912 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:51:27.905+0000 7fe865ffb640 1 -- 172.21.15.121:0/1114298895 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fe86002ade0 con 0x7fe8700fdef0 2024-08-18T22:51:27.912 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:51:27.905+0000 7fe8774e1640 1 -- 172.21.15.121:0/1114298895 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe87010d200 con 0x7fe8700fdef0 2024-08-18T22:51:27.913 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:51:27.905+0000 7fe865ffb640 1 -- 172.21.15.121:0/1114298895 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe86002c880 con 0x7fe8700fdef0 2024-08-18T22:51:27.913 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:51:27.905+0000 7fe8774e1640 1 -- 172.21.15.121:0/1114298895 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe87010d660 con 0x7fe8700fdef0 2024-08-18T22:51:27.913 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:51:27.906+0000 7fe8774e1640 1 -- 172.21.15.121:0/1114298895 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8700fda90 con 0x7fe8700fdef0 2024-08-18T22:51:27.914 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:51:27.907+0000 7fe865ffb640 1 -- 172.21.15.121:0/1114298895 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 37) v1 ==== 92205+0+0 (secure 0 0 0) 0x7fe860030020 con 0x7fe8700fdef0 2024-08-18T22:51:27.914 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:51:27.907+0000 7fe865ffb640 1 --2- 172.21.15.121:0/1114298895 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7fe85c06e0b0 0x7fe85c070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:51:27.914 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:51:27.907+0000 7fe865ffb640 1 -- 172.21.15.121:0/1114298895 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6668+0+0 (secure 0 0 0) 0x7fe8600adcf0 con 0x7fe8700fdef0 2024-08-18T22:51:27.915 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:51:27.907+0000 7fe87527d640 1 --2- 172.21.15.121:0/1114298895 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7fe85c06e0b0 0x7fe85c070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:51:27.915 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:51:27.907+0000 7fe87527d640 1 --2- 172.21.15.121:0/1114298895 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7fe85c06e0b0 0x7fe85c070560 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fe86c0041d0 tx=0x7fe86c009040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:51:27.915 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:51:27.911+0000 7fe865ffb640 1 -- 172.21.15.121:0/1114298895 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7fe860076f70 con 0x7fe8700fdef0 2024-08-18T22:51:28.150 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:51:28.148+0000 7fe8774e1640 1 -- 172.21.15.121:0/1114298895 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fe87004b4c0 con 0x7fe8700fdef0 2024-08-18T22:51:28.151 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:51:28.149+0000 7fe865ffb640 1 -- 172.21.15.121:0/1114298895 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7fe86007a630 con 0x7fe8700fdef0 2024-08-18T22:51:28.151 INFO:teuthology.orchestra.run.smithi121.stdout:HEALTH_OK 2024-08-18T22:51:28.153 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:51:28.151+0000 7fe8774e1640 1 -- 172.21.15.121:0/1114298895 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7fe85c06e0b0 msgr2=0x7fe85c070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:51:28.153 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:51:28.151+0000 7fe8774e1640 1 --2- 172.21.15.121:0/1114298895 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7fe85c06e0b0 0x7fe85c070560 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fe86c0041d0 tx=0x7fe86c009040 comp rx=0 tx=0).stop 2024-08-18T22:51:28.153 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:51:28.151+0000 7fe8774e1640 1 -- 172.21.15.121:0/1114298895 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe8700fdef0 msgr2=0x7fe870113540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:51:28.153 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:51:28.151+0000 7fe8774e1640 1 --2- 172.21.15.121:0/1114298895 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe8700fdef0 0x7fe870113540 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fe860003080 tx=0x7fe860009da0 comp rx=0 tx=0).stop 2024-08-18T22:51:28.153 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:51:28.151+0000 7fe8774e1640 1 -- 172.21.15.121:0/1114298895 shutdown_connections 2024-08-18T22:51:28.153 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:51:28.151+0000 7fe8774e1640 1 --2- 172.21.15.121:0/1114298895 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7fe85c06e0b0 0x7fe85c070560 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:51:28.153 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:51:28.151+0000 7fe8774e1640 1 --2- 172.21.15.121:0/1114298895 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe8700fdef0 0x7fe870113540 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:51:28.153 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:51:28.151+0000 7fe8774e1640 1 --2- 172.21.15.121:0/1114298895 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe8700650e0 0x7fe870113000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:51:28.153 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:51:28.151+0000 7fe8774e1640 1 -- 172.21.15.121:0/1114298895 >> 172.21.15.121:0/1114298895 conn(0x7fe870072150 msgr2=0x7fe870101010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:51:28.153 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:51:28.151+0000 7fe8774e1640 1 -- 172.21.15.121:0/1114298895 shutdown_connections 2024-08-18T22:51:28.153 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:51:28.151+0000 7fe8774e1640 1 -- 172.21.15.121:0/1114298895 wait complete. 2024-08-18T22:51:28.659 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:51:28 smithi195 ceph-mon[68841]: from='client.? 172.21.15.121:0/1114298895' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-08-18T22:51:28.815 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:51:28 smithi121 ceph-mon[81053]: from='client.? 172.21.15.121:0/1114298895' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-08-18T22:51:28.839 DEBUG:teuthology.orchestra.run.smithi121:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b003123a-5db1-11ef-bccf-c7b262605968 -e sha1=de09dd018de4baddfa6ca4d43bc8fb784cf75833 -- bash -c 'ceph versions' 2024-08-18T22:51:29.093 INFO:teuthology.orchestra.run.smithi121.stderr:Inferring config /var/lib/ceph/b003123a-5db1-11ef-bccf-c7b262605968/mon.smithi121/config 2024-08-18T22:51:29.466 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:51:29 smithi121 ceph-mon[81053]: pgmap v272: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:51:29.659 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:51:29 smithi195 ceph-mon[68841]: pgmap v272: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:51:30.822 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:51:30.818+0000 7fee7f5e7640 1 -- 172.21.15.121:0/2835537558 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fee78070100 msgr2=0x7fee78108670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:51:30.822 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:51:30.818+0000 7fee7f5e7640 1 --2- 172.21.15.121:0/2835537558 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fee78070100 0x7fee78108670 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fee680048d0 tx=0x7fee68009da0 comp rx=0 tx=0).stop 2024-08-18T22:51:30.822 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:51:30.818+0000 7fee7f5e7640 1 -- 172.21.15.121:0/2835537558 shutdown_connections 2024-08-18T22:51:30.822 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:51:30.818+0000 7fee7f5e7640 1 --2- 172.21.15.121:0/2835537558 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fee78070100 0x7fee78108670 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:51:30.822 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:51:30.818+0000 7fee7f5e7640 1 --2- 172.21.15.121:0/2835537558 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fee7806f7f0 0x7fee7806fbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:51:30.823 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:51:30.818+0000 7fee7f5e7640 1 -- 172.21.15.121:0/2835537558 >> 172.21.15.121:0/2835537558 conn(0x7fee780f7eb0 msgr2=0x7fee780fa2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:51:30.823 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:51:30.818+0000 7fee7f5e7640 1 -- 172.21.15.121:0/2835537558 shutdown_connections 2024-08-18T22:51:30.823 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:51:30.819+0000 7fee7f5e7640 1 -- 172.21.15.121:0/2835537558 wait complete. 2024-08-18T22:51:30.823 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:51:30.819+0000 7fee7f5e7640 1 Processor -- start 2024-08-18T22:51:30.823 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:51:30.819+0000 7fee7f5e7640 1 -- start start 2024-08-18T22:51:30.823 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:51:30.819+0000 7fee7f5e7640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fee7806f7f0 0x7fee781151f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:51:30.823 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:51:30.819+0000 7fee7f5e7640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fee78070100 0x7fee78115730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:51:30.823 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:51:30.819+0000 7fee7f5e7640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee78115d30 con 0x7fee78070100 2024-08-18T22:51:30.823 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:51:30.819+0000 7fee7f5e7640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee7810f170 con 0x7fee7806f7f0 2024-08-18T22:51:30.823 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:51:30.819+0000 7fee7cb82640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fee78070100 0x7fee78115730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:51:30.823 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:51:30.819+0000 7fee7cb82640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fee78070100 0x7fee78115730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:43062/0 (socket says 172.21.15.121:43062) 2024-08-18T22:51:30.823 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:51:30.819+0000 7fee7cb82640 1 -- 172.21.15.121:0/3907283066 learned_addr learned my addr 172.21.15.121:0/3907283066 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-18T22:51:30.823 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:51:30.820+0000 7fee7d383640 1 --2- 172.21.15.121:0/3907283066 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fee7806f7f0 0x7fee781151f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:51:30.823 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:51:30.820+0000 7fee7cb82640 1 -- 172.21.15.121:0/3907283066 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fee7806f7f0 msgr2=0x7fee781151f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:51:30.824 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:51:30.820+0000 7fee7cb82640 1 --2- 172.21.15.121:0/3907283066 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fee7806f7f0 0x7fee781151f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:51:30.824 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:51:30.820+0000 7fee7cb82640 1 -- 172.21.15.121:0/3907283066 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee68005040 con 0x7fee78070100 2024-08-18T22:51:30.824 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:51:30.820+0000 7fee7cb82640 1 --2- 172.21.15.121:0/3907283066 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fee78070100 0x7fee78115730 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fee68003080 tx=0x7fee68009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:51:30.824 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:51:30.820+0000 7fee6dffb640 1 -- 172.21.15.121:0/3907283066 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fee68038070 con 0x7fee78070100 2024-08-18T22:51:30.824 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:51:30.820+0000 7fee6dffb640 1 -- 172.21.15.121:0/3907283066 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fee680097e0 con 0x7fee78070100 2024-08-18T22:51:30.824 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:51:30.820+0000 7fee7f5e7640 1 -- 172.21.15.121:0/3907283066 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee7810f3f0 con 0x7fee78070100 2024-08-18T22:51:30.824 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:51:30.820+0000 7fee6dffb640 1 -- 172.21.15.121:0/3907283066 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fee6803d420 con 0x7fee78070100 2024-08-18T22:51:30.824 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:51:30.821+0000 7fee7f5e7640 1 -- 172.21.15.121:0/3907283066 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee7810f8b0 con 0x7fee78070100 2024-08-18T22:51:30.825 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:51:30.823+0000 7fee7f5e7640 1 -- 172.21.15.121:0/3907283066 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee78070f30 con 0x7fee78070100 2024-08-18T22:51:30.825 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:51:30.823+0000 7fee6dffb640 1 -- 172.21.15.121:0/3907283066 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 37) v1 ==== 92205+0+0 (secure 0 0 0) 0x7fee68030020 con 0x7fee78070100 2024-08-18T22:51:30.826 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:51:30.823+0000 7fee6dffb640 1 --2- 172.21.15.121:0/3907283066 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7fee6406e0b0 0x7fee64070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:51:30.826 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:51:30.823+0000 7fee6dffb640 1 -- 172.21.15.121:0/3907283066 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6668+0+0 (secure 0 0 0) 0x7fee680ae2c0 con 0x7fee78070100 2024-08-18T22:51:30.826 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:51:30.823+0000 7fee7d383640 1 --2- 172.21.15.121:0/3907283066 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7fee6406e0b0 0x7fee64070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:51:30.826 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:51:30.824+0000 7fee7d383640 1 --2- 172.21.15.121:0/3907283066 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7fee6406e0b0 0x7fee64070560 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fee740041d0 tx=0x7fee74009040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:51:30.829 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:51:30.828+0000 7fee6dffb640 1 -- 172.21.15.121:0/3907283066 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7fee68077510 con 0x7fee78070100 2024-08-18T22:51:31.059 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:51:31.057+0000 7fee7f5e7640 1 -- 172.21.15.121:0/3907283066 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fee7810b4e0 con 0x7fee78070100 2024-08-18T22:51:31.060 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:51:31.058+0000 7fee6dffb640 1 -- 172.21.15.121:0/3907283066 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+618 (secure 0 0 0) 0x7fee6807abd0 con 0x7fee78070100 2024-08-18T22:51:31.060 INFO:teuthology.orchestra.run.smithi121.stdout:{ 2024-08-18T22:51:31.060 INFO:teuthology.orchestra.run.smithi121.stdout: "mon": { 2024-08-18T22:51:31.060 INFO:teuthology.orchestra.run.smithi121.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 2 2024-08-18T22:51:31.060 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-18T22:51:31.060 INFO:teuthology.orchestra.run.smithi121.stdout: "mgr": { 2024-08-18T22:51:31.060 INFO:teuthology.orchestra.run.smithi121.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 2 2024-08-18T22:51:31.060 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-18T22:51:31.060 INFO:teuthology.orchestra.run.smithi121.stdout: "osd": { 2024-08-18T22:51:31.060 INFO:teuthology.orchestra.run.smithi121.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 6 2024-08-18T22:51:31.061 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-18T22:51:31.061 INFO:teuthology.orchestra.run.smithi121.stdout: "mds": { 2024-08-18T22:51:31.061 INFO:teuthology.orchestra.run.smithi121.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 4 2024-08-18T22:51:31.061 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-18T22:51:31.061 INFO:teuthology.orchestra.run.smithi121.stdout: "overall": { 2024-08-18T22:51:31.061 INFO:teuthology.orchestra.run.smithi121.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 14 2024-08-18T22:51:31.061 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-08-18T22:51:31.061 INFO:teuthology.orchestra.run.smithi121.stdout:} 2024-08-18T22:51:31.062 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:51:31.060+0000 7fee7f5e7640 1 -- 172.21.15.121:0/3907283066 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7fee6406e0b0 msgr2=0x7fee64070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:51:31.062 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:51:31.060+0000 7fee7f5e7640 1 --2- 172.21.15.121:0/3907283066 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7fee6406e0b0 0x7fee64070560 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fee740041d0 tx=0x7fee74009040 comp rx=0 tx=0).stop 2024-08-18T22:51:31.063 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:51:31.060+0000 7fee7f5e7640 1 -- 172.21.15.121:0/3907283066 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fee78070100 msgr2=0x7fee78115730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:51:31.063 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:51:31.060+0000 7fee7f5e7640 1 --2- 172.21.15.121:0/3907283066 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fee78070100 0x7fee78115730 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fee68003080 tx=0x7fee68009da0 comp rx=0 tx=0).stop 2024-08-18T22:51:31.063 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:51:31.060+0000 7fee7f5e7640 1 -- 172.21.15.121:0/3907283066 shutdown_connections 2024-08-18T22:51:31.063 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:51:31.060+0000 7fee7f5e7640 1 --2- 172.21.15.121:0/3907283066 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7fee6406e0b0 0x7fee64070560 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:51:31.063 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:51:31.060+0000 7fee7f5e7640 1 --2- 172.21.15.121:0/3907283066 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fee78070100 0x7fee78115730 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:51:31.063 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:51:31.060+0000 7fee7f5e7640 1 --2- 172.21.15.121:0/3907283066 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fee7806f7f0 0x7fee781151f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:51:31.063 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:51:31.060+0000 7fee7f5e7640 1 -- 172.21.15.121:0/3907283066 >> 172.21.15.121:0/3907283066 conn(0x7fee780f7eb0 msgr2=0x7fee780f93e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:51:31.063 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:51:31.060+0000 7fee7f5e7640 1 -- 172.21.15.121:0/3907283066 shutdown_connections 2024-08-18T22:51:31.063 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:51:31.061+0000 7fee7f5e7640 1 -- 172.21.15.121:0/3907283066 wait complete. 2024-08-18T22:51:31.655 DEBUG:teuthology.orchestra.run.smithi121:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b003123a-5db1-11ef-bccf-c7b262605968 -e sha1=de09dd018de4baddfa6ca4d43bc8fb784cf75833 -- bash -c 'echo "wait for servicemap items w/ changing names to refresh"' 2024-08-18T22:51:31.906 INFO:teuthology.orchestra.run.smithi121.stderr:Inferring config /var/lib/ceph/b003123a-5db1-11ef-bccf-c7b262605968/mon.smithi121/config 2024-08-18T22:51:32.023 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:51:31 smithi121 ceph-mon[81053]: pgmap v273: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:51:32.023 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:51:31 smithi121 ceph-mon[81053]: from='client.? 172.21.15.121:0/3907283066' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-08-18T22:51:32.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:51:31 smithi195 ceph-mon[68841]: pgmap v273: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:51:32.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:51:31 smithi195 ceph-mon[68841]: from='client.? 172.21.15.121:0/3907283066' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-08-18T22:51:33.516 INFO:teuthology.orchestra.run.smithi121.stdout:wait for servicemap items w/ changing names to refresh 2024-08-18T22:51:34.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:51:33 smithi121 ceph-mon[81053]: pgmap v274: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:51:34.129 DEBUG:teuthology.orchestra.run.smithi121:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b003123a-5db1-11ef-bccf-c7b262605968 -e sha1=de09dd018de4baddfa6ca4d43bc8fb784cf75833 -- bash -c 'sleep 60' 2024-08-18T22:51:34.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:51:33 smithi195 ceph-mon[68841]: pgmap v274: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:51:34.379 INFO:teuthology.orchestra.run.smithi121.stderr:Inferring config /var/lib/ceph/b003123a-5db1-11ef-bccf-c7b262605968/mon.smithi121/config 2024-08-18T22:51:35.947 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:51:35 smithi121 ceph-mon[81053]: pgmap v275: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:51:36.158 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:51:35 smithi195 ceph-mon[68841]: pgmap v275: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:51:38.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:51:37 smithi121 ceph-mon[81053]: pgmap v276: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:51:38.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:51:37 smithi195 ceph-mon[68841]: pgmap v276: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:51:39.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:51:38 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-18T22:51:39.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:51:38 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-18T22:51:39.697 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:51:39 smithi121 ceph-mon[81053]: pgmap v277: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:51:40.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:51:39 smithi195 ceph-mon[68841]: pgmap v277: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:51:42.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:51:41 smithi121 ceph-mon[81053]: pgmap v278: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:51:42.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:51:41 smithi195 ceph-mon[68841]: pgmap v278: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:51:44.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:51:43 smithi121 ceph-mon[81053]: pgmap v279: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:51:44.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:51:43 smithi195 ceph-mon[68841]: pgmap v279: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:51:46.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:51:45 smithi121 ceph-mon[81053]: pgmap v280: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:51:46.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:51:45 smithi195 ceph-mon[68841]: pgmap v280: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:51:48.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:51:47 smithi121 ceph-mon[81053]: pgmap v281: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:51:48.162 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:51:47 smithi195 ceph-mon[68841]: pgmap v281: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:51:50.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:51:49 smithi121 ceph-mon[81053]: pgmap v282: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:51:50.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:51:49 smithi195 ceph-mon[68841]: pgmap v282: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:51:52.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:51:51 smithi121 ceph-mon[81053]: pgmap v283: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:51:52.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:51:51 smithi195 ceph-mon[68841]: pgmap v283: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:51:54.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:51:53 smithi121 ceph-mon[81053]: pgmap v284: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:51:54.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:51:53 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-18T22:51:54.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:51:53 smithi195 ceph-mon[68841]: pgmap v284: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:51:54.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:51:53 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-18T22:51:56.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:51:55 smithi121 ceph-mon[81053]: pgmap v285: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:51:56.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:51:55 smithi195 ceph-mon[68841]: pgmap v285: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:51:58.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:51:57 smithi121 ceph-mon[81053]: pgmap v286: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:51:58.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:51:57 smithi195 ceph-mon[68841]: pgmap v286: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:52:00.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:51:59 smithi121 ceph-mon[81053]: pgmap v287: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:52:00.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:51:59 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-18T22:52:00.158 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:51:59 smithi195 ceph-mon[68841]: pgmap v287: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:52:00.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:51:59 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-18T22:52:01.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:52:00 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:52:01.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:52:00 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-18T22:52:01.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:52:00 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:52:01.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:52:00 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:52:01.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:52:00 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-18T22:52:01.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:52:00 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:52:02.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:52:01 smithi121 ceph-mon[81053]: pgmap v288: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:52:02.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:52:01 smithi195 ceph-mon[68841]: pgmap v288: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:52:04.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:52:03 smithi121 ceph-mon[81053]: pgmap v289: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:52:04.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:52:03 smithi195 ceph-mon[68841]: pgmap v289: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:52:06.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:52:05 smithi121 ceph-mon[81053]: pgmap v290: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:52:06.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:52:05 smithi195 ceph-mon[68841]: pgmap v290: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:52:08.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:52:07 smithi121 ceph-mon[81053]: pgmap v291: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:52:08.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:52:07 smithi195 ceph-mon[68841]: pgmap v291: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:52:09.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:52:08 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-18T22:52:09.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:52:08 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-18T22:52:10.004 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:52:09 smithi121 ceph-mon[81053]: pgmap v292: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:52:10.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:52:09 smithi195 ceph-mon[68841]: pgmap v292: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:52:12.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:52:11 smithi121 ceph-mon[81053]: pgmap v293: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:52:12.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:52:11 smithi195 ceph-mon[68841]: pgmap v293: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:52:14.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:52:13 smithi121 ceph-mon[81053]: pgmap v294: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:52:14.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:52:13 smithi195 ceph-mon[68841]: pgmap v294: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:52:16.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:52:15 smithi121 ceph-mon[81053]: pgmap v295: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:52:16.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:52:15 smithi195 ceph-mon[68841]: pgmap v295: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:52:18.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:52:17 smithi121 ceph-mon[81053]: pgmap v296: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:52:18.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:52:17 smithi195 ceph-mon[68841]: pgmap v296: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:52:20.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:52:19 smithi121 ceph-mon[81053]: pgmap v297: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:52:20.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:52:19 smithi195 ceph-mon[68841]: pgmap v297: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:52:22.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:52:21 smithi121 ceph-mon[81053]: pgmap v298: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:52:22.162 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:52:21 smithi195 ceph-mon[68841]: pgmap v298: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:52:24.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:52:23 smithi121 ceph-mon[81053]: pgmap v299: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:52:24.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:52:23 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-18T22:52:24.158 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:52:23 smithi195 ceph-mon[68841]: pgmap v299: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:52:24.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:52:23 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-18T22:52:26.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:52:25 smithi121 ceph-mon[81053]: pgmap v300: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:52:26.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:52:25 smithi195 ceph-mon[68841]: pgmap v300: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:52:28.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:52:27 smithi121 ceph-mon[81053]: pgmap v301: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:52:28.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:52:27 smithi195 ceph-mon[68841]: pgmap v301: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:52:30.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:52:29 smithi121 ceph-mon[81053]: pgmap v302: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:52:30.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:52:29 smithi195 ceph-mon[68841]: pgmap v302: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:52:32.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:52:31 smithi121 ceph-mon[81053]: pgmap v303: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:52:32.158 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:52:31 smithi195 ceph-mon[68841]: pgmap v303: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:52:34.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:52:33 smithi121 ceph-mon[81053]: pgmap v304: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:52:34.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:52:33 smithi195 ceph-mon[68841]: pgmap v304: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:52:36.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:52:35 smithi121 ceph-mon[81053]: pgmap v305: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:52:36.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:52:35 smithi195 ceph-mon[68841]: pgmap v305: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:52:36.576 DEBUG:teuthology.orchestra.run.smithi121:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b003123a-5db1-11ef-bccf-c7b262605968 -e sha1=de09dd018de4baddfa6ca4d43bc8fb784cf75833 -- bash -c 'ceph orch ps' 2024-08-18T22:52:36.835 INFO:teuthology.orchestra.run.smithi121.stderr:Inferring config /var/lib/ceph/b003123a-5db1-11ef-bccf-c7b262605968/mon.smithi121/config 2024-08-18T22:52:37.960 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:52:37 smithi121 ceph-mon[81053]: pgmap v306: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:52:38.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:52:37 smithi195 ceph-mon[68841]: pgmap v306: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:52:38.458 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:38.457+0000 7fcd4206c640 1 -- 172.21.15.121:0/375982737 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcd3c101ba0 msgr2=0x7fcd3c0fb230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:52:38.459 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:38.457+0000 7fcd4206c640 1 --2- 172.21.15.121:0/375982737 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcd3c101ba0 0x7fcd3c0fb230 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fcd300048d0 tx=0x7fcd30009da0 comp rx=0 tx=0).stop 2024-08-18T22:52:38.459 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:38.457+0000 7fcd4206c640 1 -- 172.21.15.121:0/375982737 shutdown_connections 2024-08-18T22:52:38.459 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:38.457+0000 7fcd4206c640 1 --2- 172.21.15.121:0/375982737 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcd3c101ba0 0x7fcd3c0fb230 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:52:38.459 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:38.457+0000 7fcd4206c640 1 --2- 172.21.15.121:0/375982737 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcd3c101200 0x7fcd3c1015d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:52:38.459 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:38.457+0000 7fcd4206c640 1 -- 172.21.15.121:0/375982737 >> 172.21.15.121:0/375982737 conn(0x7fcd3c0f6df0 msgr2=0x7fcd3c0f9200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:52:38.459 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:38.457+0000 7fcd4206c640 1 -- 172.21.15.121:0/375982737 shutdown_connections 2024-08-18T22:52:38.459 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:38.457+0000 7fcd4206c640 1 -- 172.21.15.121:0/375982737 wait complete. 2024-08-18T22:52:38.459 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:38.458+0000 7fcd4206c640 1 Processor -- start 2024-08-18T22:52:38.459 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:38.458+0000 7fcd4206c640 1 -- start start 2024-08-18T22:52:38.461 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:38.458+0000 7fcd4206c640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcd3c101200 0x7fcd3c10df20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:52:38.461 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:38.458+0000 7fcd4206c640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcd3c101ba0 0x7fcd3c10e460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:52:38.461 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:38.458+0000 7fcd4206c640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd3c10eab0 con 0x7fcd3c101200 2024-08-18T22:52:38.461 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:38.458+0000 7fcd4206c640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd3c10ec20 con 0x7fcd3c101ba0 2024-08-18T22:52:38.461 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:38.458+0000 7fcd3b7fe640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcd3c101200 0x7fcd3c10df20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:52:38.461 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:38.458+0000 7fcd3b7fe640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcd3c101200 0x7fcd3c10df20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:52298/0 (socket says 172.21.15.121:52298) 2024-08-18T22:52:38.461 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:38.458+0000 7fcd3b7fe640 1 -- 172.21.15.121:0/805414003 learned_addr learned my addr 172.21.15.121:0/805414003 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-18T22:52:38.461 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:38.458+0000 7fcd3affd640 1 --2- 172.21.15.121:0/805414003 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcd3c101ba0 0x7fcd3c10e460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:52:38.461 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:38.458+0000 7fcd3b7fe640 1 -- 172.21.15.121:0/805414003 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcd3c101ba0 msgr2=0x7fcd3c10e460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:52:38.461 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:38.458+0000 7fcd3b7fe640 1 --2- 172.21.15.121:0/805414003 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcd3c101ba0 0x7fcd3c10e460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:52:38.461 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:38.458+0000 7fcd3b7fe640 1 -- 172.21.15.121:0/805414003 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd30005040 con 0x7fcd3c101200 2024-08-18T22:52:38.462 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:38.459+0000 7fcd3b7fe640 1 --2- 172.21.15.121:0/805414003 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcd3c101200 0x7fcd3c10df20 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fcd2c002a50 tx=0x7fcd2c004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:52:38.462 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:38.459+0000 7fcd23fff640 1 -- 172.21.15.121:0/805414003 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcd2c007c30 con 0x7fcd3c101200 2024-08-18T22:52:38.462 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:38.459+0000 7fcd23fff640 1 -- 172.21.15.121:0/805414003 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fcd2c00f040 con 0x7fcd3c101200 2024-08-18T22:52:38.462 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:38.459+0000 7fcd4206c640 1 -- 172.21.15.121:0/805414003 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd3c116f90 con 0x7fcd3c101200 2024-08-18T22:52:38.462 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:38.459+0000 7fcd23fff640 1 -- 172.21.15.121:0/805414003 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcd2c00da10 con 0x7fcd3c101200 2024-08-18T22:52:38.462 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:38.459+0000 7fcd4206c640 1 -- 172.21.15.121:0/805414003 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd3c117450 con 0x7fcd3c101200 2024-08-18T22:52:38.463 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:38.460+0000 7fcd4206c640 1 -- 172.21.15.121:0/805414003 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd3c0fc970 con 0x7fcd3c101200 2024-08-18T22:52:38.463 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:38.460+0000 7fcd23fff640 1 -- 172.21.15.121:0/805414003 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 37) v1 ==== 92205+0+0 (secure 0 0 0) 0x7fcd2c00dc80 con 0x7fcd3c101200 2024-08-18T22:52:38.463 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:38.461+0000 7fcd23fff640 1 --2- 172.21.15.121:0/805414003 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7fcd2406e0b0 0x7fcd24070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:52:38.463 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:38.461+0000 7fcd23fff640 1 -- 172.21.15.121:0/805414003 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6668+0+0 (secure 0 0 0) 0x7fcd2c08d360 con 0x7fcd3c101200 2024-08-18T22:52:38.463 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:38.461+0000 7fcd3affd640 1 --2- 172.21.15.121:0/805414003 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7fcd2406e0b0 0x7fcd24070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:52:38.463 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:38.461+0000 7fcd3affd640 1 --2- 172.21.15.121:0/805414003 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7fcd2406e0b0 0x7fcd24070560 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fcd30009ac0 tx=0x7fcd30035040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:52:38.466 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:38.465+0000 7fcd23fff640 1 -- 172.21.15.121:0/805414003 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7fcd2c056690 con 0x7fcd3c101200 2024-08-18T22:52:38.642 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:38.641+0000 7fcd4206c640 1 -- 172.21.15.121:0/805414003 --> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fcd3c065fc0 con 0x7fcd2406e0b0 2024-08-18T22:52:38.651 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:38.650+0000 7fcd23fff640 1 -- 172.21.15.121:0/805414003 <== mgr.34102 v2:172.21.15.121:6800/3037387239 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7fcd3c065fc0 con 0x7fcd2406e0b0 2024-08-18T22:52:38.651 INFO:teuthology.orchestra.run.smithi121.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-08-18T22:52:38.651 INFO:teuthology.orchestra.run.smithi121.stdout:alertmanager.smithi121 smithi121 *:9093,9094 running (2m) 106s ago 18m 17.4M - 0.25.0 c8568f914cd2 50a5a7767cfb 2024-08-18T22:52:38.651 INFO:teuthology.orchestra.run.smithi121.stdout:crash.smithi121 smithi121 running (8m) 106s ago 18m 6903k - 19.1.0-1382-gde09dd01 ea7a5189f30b 3cf5c666a0e6 2024-08-18T22:52:38.652 INFO:teuthology.orchestra.run.smithi121.stdout:crash.smithi195 smithi195 running (8m) 2m ago 17m 6895k - 19.1.0-1382-gde09dd01 ea7a5189f30b fbb586fb9834 2024-08-18T22:52:38.652 INFO:teuthology.orchestra.run.smithi121.stdout:grafana.smithi121 smithi121 *:3000 running (111s) 106s ago 18m 48.1M - 9.4.12 2bacad6d85d8 5a871f6fc461 2024-08-18T22:52:38.652 INFO:teuthology.orchestra.run.smithi121.stdout:mds.cephfs.smithi121.gbickb smithi121 running (3m) 106s ago 13m 18.9M - 19.1.0-1382-gde09dd01 ea7a5189f30b 3d6dc5c5f472 2024-08-18T22:52:38.652 INFO:teuthology.orchestra.run.smithi121.stdout:mds.cephfs.smithi121.xuzsdg smithi121 running (4m) 106s ago 13m 76.2M - 19.1.0-1382-gde09dd01 ea7a5189f30b 4eec4d0a895e 2024-08-18T22:52:38.652 INFO:teuthology.orchestra.run.smithi121.stdout:mds.cephfs.smithi195.buqvbr smithi195 running (3m) 2m ago 13m 12.4M - 19.1.0-1382-gde09dd01 ea7a5189f30b dca538294bee 2024-08-18T22:52:38.652 INFO:teuthology.orchestra.run.smithi121.stdout:mds.cephfs.smithi195.nptgyc smithi195 running (3m) 2m ago 13m 13.2M - 19.1.0-1382-gde09dd01 ea7a5189f30b 42528b070f11 2024-08-18T22:52:38.652 INFO:teuthology.orchestra.run.smithi121.stdout:mgr.smithi121.lopxqc smithi121 *:8443,9283,8765 running (9m) 106s ago 19m 515M - 19.1.0-1382-gde09dd01 ea7a5189f30b 9079701e6516 2024-08-18T22:52:38.652 INFO:teuthology.orchestra.run.smithi121.stdout:mgr.smithi195.acttsj smithi195 *:8443,9283,8765 running (9m) 2m ago 17m 442M - 19.1.0-1382-gde09dd01 ea7a5189f30b 7b4027a33daa 2024-08-18T22:52:38.652 INFO:teuthology.orchestra.run.smithi121.stdout:mon.smithi121 smithi121 running (9m) 106s ago 19m 58.4M 2048M 19.1.0-1382-gde09dd01 ea7a5189f30b d71695a4fb56 2024-08-18T22:52:38.652 INFO:teuthology.orchestra.run.smithi121.stdout:mon.smithi195 smithi195 running (8m) 2m ago 17m 40.9M 2048M 19.1.0-1382-gde09dd01 ea7a5189f30b a9bb94ba3b56 2024-08-18T22:52:38.652 INFO:teuthology.orchestra.run.smithi121.stdout:node-exporter.smithi121 smithi121 *:9100 running (2m) 106s ago 18m 9899k - 1.5.0 0da6a335fe13 5c8d00b736b0 2024-08-18T22:52:38.652 INFO:teuthology.orchestra.run.smithi121.stdout:node-exporter.smithi195 smithi195 *:9100 running (2m) 2m ago 17m 3602k - 1.5.0 0da6a335fe13 55fe298190b2 2024-08-18T22:52:38.652 INFO:teuthology.orchestra.run.smithi121.stdout:osd.0 smithi121 running (7m) 106s ago 16m 143M 1557M 19.1.0-1382-gde09dd01 ea7a5189f30b d378dd46eeb6 2024-08-18T22:52:38.652 INFO:teuthology.orchestra.run.smithi121.stdout:osd.1 smithi121 running (7m) 106s ago 16m 166M 1557M 19.1.0-1382-gde09dd01 ea7a5189f30b 0f9e03de5382 2024-08-18T22:52:38.652 INFO:teuthology.orchestra.run.smithi121.stdout:osd.2 smithi121 running (6m) 106s ago 16m 132M 1557M 19.1.0-1382-gde09dd01 ea7a5189f30b 93270b5bed68 2024-08-18T22:52:38.653 INFO:teuthology.orchestra.run.smithi121.stdout:osd.3 smithi195 running (6m) 2m ago 15m 188M 2581M 19.1.0-1382-gde09dd01 ea7a5189f30b 72c2860c0e9f 2024-08-18T22:52:38.653 INFO:teuthology.orchestra.run.smithi121.stdout:osd.4 smithi195 running (5m) 2m ago 15m 169M 2581M 19.1.0-1382-gde09dd01 ea7a5189f30b d88a83c97247 2024-08-18T22:52:38.653 INFO:teuthology.orchestra.run.smithi121.stdout:osd.5 smithi195 running (5m) 2m ago 14m 150M 2581M 19.1.0-1382-gde09dd01 ea7a5189f30b 5af2d6de9afe 2024-08-18T22:52:38.653 INFO:teuthology.orchestra.run.smithi121.stdout:prometheus.smithi121 smithi121 *:9095 running (2m) 106s ago 18m 53.2M - 2.43.0 a07b618ecd1d ad25302956e5 2024-08-18T22:52:38.653 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:38.652+0000 7fcd4206c640 1 -- 172.21.15.121:0/805414003 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7fcd2406e0b0 msgr2=0x7fcd24070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:52:38.654 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:38.652+0000 7fcd4206c640 1 --2- 172.21.15.121:0/805414003 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7fcd2406e0b0 0x7fcd24070560 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fcd30009ac0 tx=0x7fcd30035040 comp rx=0 tx=0).stop 2024-08-18T22:52:38.654 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:38.652+0000 7fcd4206c640 1 -- 172.21.15.121:0/805414003 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcd3c101200 msgr2=0x7fcd3c10df20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:52:38.654 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:38.652+0000 7fcd4206c640 1 --2- 172.21.15.121:0/805414003 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcd3c101200 0x7fcd3c10df20 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fcd2c002a50 tx=0x7fcd2c004600 comp rx=0 tx=0).stop 2024-08-18T22:52:38.654 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:38.652+0000 7fcd4206c640 1 -- 172.21.15.121:0/805414003 shutdown_connections 2024-08-18T22:52:38.654 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:38.652+0000 7fcd4206c640 1 --2- 172.21.15.121:0/805414003 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7fcd2406e0b0 0x7fcd24070560 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:52:38.654 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:38.652+0000 7fcd4206c640 1 --2- 172.21.15.121:0/805414003 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcd3c101ba0 0x7fcd3c10e460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:52:38.654 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:38.652+0000 7fcd4206c640 1 --2- 172.21.15.121:0/805414003 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcd3c101200 0x7fcd3c10df20 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:52:38.654 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:38.652+0000 7fcd4206c640 1 -- 172.21.15.121:0/805414003 >> 172.21.15.121:0/805414003 conn(0x7fcd3c0f6df0 msgr2=0x7fcd3c0f7df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:52:38.654 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:38.652+0000 7fcd4206c640 1 -- 172.21.15.121:0/805414003 shutdown_connections 2024-08-18T22:52:38.654 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:38.653+0000 7fcd4206c640 1 -- 172.21.15.121:0/805414003 wait complete. 2024-08-18T22:52:38.992 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:52:38 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-18T22:52:39.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:52:38 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-18T22:52:39.328 DEBUG:teuthology.orchestra.run.smithi121:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b003123a-5db1-11ef-bccf-c7b262605968 -e sha1=de09dd018de4baddfa6ca4d43bc8fb784cf75833 -- bash -c 'ceph versions' 2024-08-18T22:52:39.588 INFO:teuthology.orchestra.run.smithi121.stderr:Inferring config /var/lib/ceph/b003123a-5db1-11ef-bccf-c7b262605968/mon.smithi121/config 2024-08-18T22:52:39.939 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:52:39 smithi121 ceph-mon[81053]: from='client.34578 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-18T22:52:39.939 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:52:39 smithi121 ceph-mon[81053]: pgmap v307: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:52:40.158 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:52:39 smithi195 ceph-mon[68841]: from='client.34578 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-18T22:52:40.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:52:39 smithi195 ceph-mon[68841]: pgmap v307: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:52:41.149 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:41.146+0000 7f52c35c0640 1 -- 172.21.15.121:0/3825476220 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f52bc101b90 msgr2=0x7f52bc0fb220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:52:41.149 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:41.146+0000 7f52c35c0640 1 --2- 172.21.15.121:0/3825476220 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f52bc101b90 0x7f52bc0fb220 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f52b00048d0 tx=0x7f52b0009da0 comp rx=0 tx=0).stop 2024-08-18T22:52:41.149 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:41.146+0000 7f52c35c0640 1 -- 172.21.15.121:0/3825476220 shutdown_connections 2024-08-18T22:52:41.149 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:41.146+0000 7f52c35c0640 1 --2- 172.21.15.121:0/3825476220 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f52bc101b90 0x7f52bc0fb220 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:52:41.149 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:41.146+0000 7f52c35c0640 1 --2- 172.21.15.121:0/3825476220 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f52bc1011f0 0x7f52bc1015c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:52:41.149 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:41.146+0000 7f52c35c0640 1 -- 172.21.15.121:0/3825476220 >> 172.21.15.121:0/3825476220 conn(0x7f52bc0f6da0 msgr2=0x7f52bc0f91b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:52:41.149 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:41.146+0000 7f52c35c0640 1 -- 172.21.15.121:0/3825476220 shutdown_connections 2024-08-18T22:52:41.149 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:41.146+0000 7f52c35c0640 1 -- 172.21.15.121:0/3825476220 wait complete. 2024-08-18T22:52:41.149 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:41.147+0000 7f52c35c0640 1 Processor -- start 2024-08-18T22:52:41.149 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:41.147+0000 7f52c35c0640 1 -- start start 2024-08-18T22:52:41.149 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:41.147+0000 7f52c35c0640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f52bc1011f0 0x7f52bc10df30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:52:41.149 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:41.147+0000 7f52c35c0640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f52bc101b90 0x7f52bc10e470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:52:41.150 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:41.147+0000 7f52c35c0640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52bc10eac0 con 0x7f52bc1011f0 2024-08-18T22:52:41.150 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:41.147+0000 7f52c35c0640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52bc10ec30 con 0x7f52bc101b90 2024-08-18T22:52:41.150 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:41.147+0000 7f52c135c640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f52bc1011f0 0x7f52bc10df30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:52:41.150 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:41.147+0000 7f52c135c640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f52bc1011f0 0x7f52bc10df30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:52328/0 (socket says 172.21.15.121:52328) 2024-08-18T22:52:41.150 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:41.147+0000 7f52c135c640 1 -- 172.21.15.121:0/3640573080 learned_addr learned my addr 172.21.15.121:0/3640573080 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-18T22:52:41.150 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:41.147+0000 7f52c0b5b640 1 --2- 172.21.15.121:0/3640573080 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f52bc101b90 0x7f52bc10e470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:52:41.150 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:41.147+0000 7f52c135c640 1 -- 172.21.15.121:0/3640573080 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f52bc101b90 msgr2=0x7f52bc10e470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:52:41.150 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:41.147+0000 7f52c135c640 1 --2- 172.21.15.121:0/3640573080 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f52bc101b90 0x7f52bc10e470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:52:41.150 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:41.147+0000 7f52c135c640 1 -- 172.21.15.121:0/3640573080 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52b0005040 con 0x7f52bc1011f0 2024-08-18T22:52:41.150 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:41.147+0000 7f52c135c640 1 --2- 172.21.15.121:0/3640573080 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f52bc1011f0 0x7f52bc10df30 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f52b4002a50 tx=0x7f52b4004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:52:41.150 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:41.148+0000 7f52b9ffb640 1 -- 172.21.15.121:0/3640573080 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f52b4007c30 con 0x7f52bc1011f0 2024-08-18T22:52:41.150 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:41.148+0000 7f52b9ffb640 1 -- 172.21.15.121:0/3640573080 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f52b400f040 con 0x7f52bc1011f0 2024-08-18T22:52:41.150 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:41.148+0000 7f52b9ffb640 1 -- 172.21.15.121:0/3640573080 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f52b400da10 con 0x7f52bc1011f0 2024-08-18T22:52:41.151 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:41.148+0000 7f52c35c0640 1 -- 172.21.15.121:0/3640573080 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52bc116fa0 con 0x7f52bc1011f0 2024-08-18T22:52:41.151 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:41.148+0000 7f52c35c0640 1 -- 172.21.15.121:0/3640573080 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52bc117460 con 0x7f52bc1011f0 2024-08-18T22:52:41.151 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:41.149+0000 7f52c35c0640 1 -- 172.21.15.121:0/3640573080 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52bc0fc960 con 0x7f52bc1011f0 2024-08-18T22:52:41.152 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:41.149+0000 7f52b9ffb640 1 -- 172.21.15.121:0/3640573080 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 37) v1 ==== 92205+0+0 (secure 0 0 0) 0x7f52b400dbb0 con 0x7f52bc1011f0 2024-08-18T22:52:41.152 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:41.150+0000 7f52b9ffb640 1 --2- 172.21.15.121:0/3640573080 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f52a406e0b0 0x7f52a4070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:52:41.152 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:41.150+0000 7f52b9ffb640 1 -- 172.21.15.121:0/3640573080 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6668+0+0 (secure 0 0 0) 0x7f52b408d2e0 con 0x7f52bc1011f0 2024-08-18T22:52:41.152 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:41.150+0000 7f52c0b5b640 1 --2- 172.21.15.121:0/3640573080 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f52a406e0b0 0x7f52a4070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:52:41.152 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:41.150+0000 7f52c0b5b640 1 --2- 172.21.15.121:0/3640573080 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f52a406e0b0 0x7f52a4070560 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f52b0009ac0 tx=0x7f52b0035040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:52:41.155 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:41.154+0000 7f52b9ffb640 1 -- 172.21.15.121:0/3640573080 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f52b4056690 con 0x7f52bc1011f0 2024-08-18T22:52:41.391 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:41.390+0000 7f52c35c0640 1 -- 172.21.15.121:0/3640573080 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f52bc065f40 con 0x7f52bc1011f0 2024-08-18T22:52:41.391 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:41.390+0000 7f52b9ffb640 1 -- 172.21.15.121:0/3640573080 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+618 (secure 0 0 0) 0x7f52b4059d50 con 0x7f52bc1011f0 2024-08-18T22:52:41.391 INFO:teuthology.orchestra.run.smithi121.stdout:{ 2024-08-18T22:52:41.391 INFO:teuthology.orchestra.run.smithi121.stdout: "mon": { 2024-08-18T22:52:41.392 INFO:teuthology.orchestra.run.smithi121.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 2 2024-08-18T22:52:41.392 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-18T22:52:41.392 INFO:teuthology.orchestra.run.smithi121.stdout: "mgr": { 2024-08-18T22:52:41.392 INFO:teuthology.orchestra.run.smithi121.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 2 2024-08-18T22:52:41.392 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-18T22:52:41.392 INFO:teuthology.orchestra.run.smithi121.stdout: "osd": { 2024-08-18T22:52:41.392 INFO:teuthology.orchestra.run.smithi121.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 6 2024-08-18T22:52:41.392 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-18T22:52:41.392 INFO:teuthology.orchestra.run.smithi121.stdout: "mds": { 2024-08-18T22:52:41.392 INFO:teuthology.orchestra.run.smithi121.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 4 2024-08-18T22:52:41.392 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-18T22:52:41.392 INFO:teuthology.orchestra.run.smithi121.stdout: "overall": { 2024-08-18T22:52:41.392 INFO:teuthology.orchestra.run.smithi121.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 14 2024-08-18T22:52:41.392 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-08-18T22:52:41.393 INFO:teuthology.orchestra.run.smithi121.stdout:} 2024-08-18T22:52:41.393 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:41.392+0000 7f52c35c0640 1 -- 172.21.15.121:0/3640573080 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f52a406e0b0 msgr2=0x7f52a4070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:52:41.393 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:41.392+0000 7f52c35c0640 1 --2- 172.21.15.121:0/3640573080 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f52a406e0b0 0x7f52a4070560 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f52b0009ac0 tx=0x7f52b0035040 comp rx=0 tx=0).stop 2024-08-18T22:52:41.393 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:41.392+0000 7f52c35c0640 1 -- 172.21.15.121:0/3640573080 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f52bc1011f0 msgr2=0x7f52bc10df30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:52:41.393 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:41.392+0000 7f52c35c0640 1 --2- 172.21.15.121:0/3640573080 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f52bc1011f0 0x7f52bc10df30 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f52b4002a50 tx=0x7f52b4004600 comp rx=0 tx=0).stop 2024-08-18T22:52:41.394 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:41.392+0000 7f52c35c0640 1 -- 172.21.15.121:0/3640573080 shutdown_connections 2024-08-18T22:52:41.394 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:41.392+0000 7f52c35c0640 1 --2- 172.21.15.121:0/3640573080 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f52a406e0b0 0x7f52a4070560 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:52:41.394 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:41.392+0000 7f52c35c0640 1 --2- 172.21.15.121:0/3640573080 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f52bc101b90 0x7f52bc10e470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:52:41.394 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:41.392+0000 7f52c35c0640 1 --2- 172.21.15.121:0/3640573080 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f52bc1011f0 0x7f52bc10df30 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:52:41.394 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:41.392+0000 7f52c35c0640 1 -- 172.21.15.121:0/3640573080 >> 172.21.15.121:0/3640573080 conn(0x7f52bc0f6da0 msgr2=0x7f52bc0f7db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:52:41.394 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:41.392+0000 7f52c35c0640 1 -- 172.21.15.121:0/3640573080 shutdown_connections 2024-08-18T22:52:41.394 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:41.392+0000 7f52c35c0640 1 -- 172.21.15.121:0/3640573080 wait complete. 2024-08-18T22:52:41.958 DEBUG:teuthology.orchestra.run.smithi121:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b003123a-5db1-11ef-bccf-c7b262605968 -e sha1=de09dd018de4baddfa6ca4d43bc8fb784cf75833 -- bash -c 'ceph versions | jq -e '"'"'.overall | length == 1'"'"'' 2024-08-18T22:52:42.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:52:41 smithi121 ceph-mon[81053]: pgmap v308: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:52:42.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:52:41 smithi121 ceph-mon[81053]: from='client.? 172.21.15.121:0/3640573080' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-08-18T22:52:42.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:52:41 smithi195 ceph-mon[68841]: pgmap v308: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:52:42.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:52:41 smithi195 ceph-mon[68841]: from='client.? 172.21.15.121:0/3640573080' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-08-18T22:52:42.208 INFO:teuthology.orchestra.run.smithi121.stderr:Inferring config /var/lib/ceph/b003123a-5db1-11ef-bccf-c7b262605968/mon.smithi121/config 2024-08-18T22:52:43.680 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:43.677+0000 7fc79ef72640 1 -- 172.21.15.121:0/1501165515 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc798102ca0 msgr2=0x7fc7980fc330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:52:43.680 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:43.677+0000 7fc79ef72640 1 --2- 172.21.15.121:0/1501165515 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc798102ca0 0x7fc7980fc330 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fc7880048d0 tx=0x7fc788009da0 comp rx=0 tx=0).stop 2024-08-18T22:52:43.680 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:43.677+0000 7fc79ef72640 1 -- 172.21.15.121:0/1501165515 shutdown_connections 2024-08-18T22:52:43.680 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:43.677+0000 7fc79ef72640 1 --2- 172.21.15.121:0/1501165515 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc798102ca0 0x7fc7980fc330 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:52:43.680 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:43.677+0000 7fc79ef72640 1 --2- 172.21.15.121:0/1501165515 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc798102300 0x7fc7981026d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:52:43.681 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:43.677+0000 7fc79ef72640 1 -- 172.21.15.121:0/1501165515 >> 172.21.15.121:0/1501165515 conn(0x7fc7980f7e90 msgr2=0x7fc7980fa2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:52:43.681 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:43.678+0000 7fc79ef72640 1 -- 172.21.15.121:0/1501165515 shutdown_connections 2024-08-18T22:52:43.681 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:43.678+0000 7fc79ef72640 1 -- 172.21.15.121:0/1501165515 wait complete. 2024-08-18T22:52:43.681 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:43.678+0000 7fc79ef72640 1 Processor -- start 2024-08-18T22:52:43.681 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:43.678+0000 7fc79ef72640 1 -- start start 2024-08-18T22:52:43.683 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:43.679+0000 7fc79ef72640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc798102300 0x7fc7981132c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:52:43.683 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:43.679+0000 7fc79ef72640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc798102ca0 0x7fc798113800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:52:43.683 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:43.679+0000 7fc79ef72640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc798113e00 con 0x7fc798102300 2024-08-18T22:52:43.683 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:43.679+0000 7fc79ef72640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc79810d240 con 0x7fc798102ca0 2024-08-18T22:52:43.683 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:43.679+0000 7fc79cd0e640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc798102300 0x7fc7981132c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:52:43.683 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:43.679+0000 7fc79cd0e640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc798102300 0x7fc7981132c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:52348/0 (socket says 172.21.15.121:52348) 2024-08-18T22:52:43.683 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:43.679+0000 7fc79cd0e640 1 -- 172.21.15.121:0/2782211423 learned_addr learned my addr 172.21.15.121:0/2782211423 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-18T22:52:43.683 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:43.679+0000 7fc78ffff640 1 --2- 172.21.15.121:0/2782211423 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc798102ca0 0x7fc798113800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:52:43.683 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:43.679+0000 7fc79cd0e640 1 -- 172.21.15.121:0/2782211423 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc798102ca0 msgr2=0x7fc798113800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:52:43.683 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:43.679+0000 7fc79cd0e640 1 --2- 172.21.15.121:0/2782211423 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc798102ca0 0x7fc798113800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:52:43.683 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:43.679+0000 7fc79cd0e640 1 -- 172.21.15.121:0/2782211423 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc788005040 con 0x7fc798102300 2024-08-18T22:52:43.683 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:43.679+0000 7fc79cd0e640 1 --2- 172.21.15.121:0/2782211423 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc798102300 0x7fc7981132c0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fc794002a50 tx=0x7fc794004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:52:43.684 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:43.679+0000 7fc78d7fa640 1 -- 172.21.15.121:0/2782211423 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc794007c30 con 0x7fc798102300 2024-08-18T22:52:43.684 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:43.680+0000 7fc78d7fa640 1 -- 172.21.15.121:0/2782211423 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fc79400f040 con 0x7fc798102300 2024-08-18T22:52:43.684 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:43.680+0000 7fc79ef72640 1 -- 172.21.15.121:0/2782211423 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc79810d520 con 0x7fc798102300 2024-08-18T22:52:43.684 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:43.680+0000 7fc78d7fa640 1 -- 172.21.15.121:0/2782211423 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc79400da10 con 0x7fc798102300 2024-08-18T22:52:43.684 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:43.680+0000 7fc79ef72640 1 -- 172.21.15.121:0/2782211423 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc79810da90 con 0x7fc798102300 2024-08-18T22:52:43.684 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:43.681+0000 7fc79ef72640 1 -- 172.21.15.121:0/2782211423 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7980fda70 con 0x7fc798102300 2024-08-18T22:52:43.684 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:43.681+0000 7fc78d7fa640 1 -- 172.21.15.121:0/2782211423 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 37) v1 ==== 92205+0+0 (secure 0 0 0) 0x7fc79400dbb0 con 0x7fc798102300 2024-08-18T22:52:43.685 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:43.681+0000 7fc78d7fa640 1 --2- 172.21.15.121:0/2782211423 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7fc78006e0b0 0x7fc780070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:52:43.685 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:43.682+0000 7fc78d7fa640 1 -- 172.21.15.121:0/2782211423 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6668+0+0 (secure 0 0 0) 0x7fc79408d390 con 0x7fc798102300 2024-08-18T22:52:43.685 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:43.682+0000 7fc78ffff640 1 --2- 172.21.15.121:0/2782211423 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7fc78006e0b0 0x7fc780070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:52:43.685 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:43.682+0000 7fc78ffff640 1 --2- 172.21.15.121:0/2782211423 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7fc78006e0b0 0x7fc780070560 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fc788009ac0 tx=0x7fc788035040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:52:43.688 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:43.686+0000 7fc78d7fa640 1 -- 172.21.15.121:0/2782211423 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7fc794056740 con 0x7fc798102300 2024-08-18T22:52:43.922 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:43.920+0000 7fc79ef72640 1 -- 172.21.15.121:0/2782211423 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fc79804b4f0 con 0x7fc798102300 2024-08-18T22:52:43.923 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:43.921+0000 7fc78d7fa640 1 -- 172.21.15.121:0/2782211423 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+618 (secure 0 0 0) 0x7fc79400de60 con 0x7fc798102300 2024-08-18T22:52:43.925 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:43.923+0000 7fc79ef72640 1 -- 172.21.15.121:0/2782211423 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7fc78006e0b0 msgr2=0x7fc780070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:52:43.925 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:43.923+0000 7fc79ef72640 1 --2- 172.21.15.121:0/2782211423 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7fc78006e0b0 0x7fc780070560 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fc788009ac0 tx=0x7fc788035040 comp rx=0 tx=0).stop 2024-08-18T22:52:43.925 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:43.923+0000 7fc79ef72640 1 -- 172.21.15.121:0/2782211423 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc798102300 msgr2=0x7fc7981132c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:52:43.925 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:43.923+0000 7fc79ef72640 1 --2- 172.21.15.121:0/2782211423 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc798102300 0x7fc7981132c0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fc794002a50 tx=0x7fc794004600 comp rx=0 tx=0).stop 2024-08-18T22:52:43.925 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:43.923+0000 7fc79ef72640 1 -- 172.21.15.121:0/2782211423 shutdown_connections 2024-08-18T22:52:43.925 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:43.923+0000 7fc79ef72640 1 --2- 172.21.15.121:0/2782211423 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7fc78006e0b0 0x7fc780070560 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:52:43.925 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:43.923+0000 7fc79ef72640 1 --2- 172.21.15.121:0/2782211423 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc798102ca0 0x7fc798113800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:52:43.925 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:43.923+0000 7fc79ef72640 1 --2- 172.21.15.121:0/2782211423 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc798102300 0x7fc7981132c0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:52:43.925 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:43.923+0000 7fc79ef72640 1 -- 172.21.15.121:0/2782211423 >> 172.21.15.121:0/2782211423 conn(0x7fc7980f7e90 msgr2=0x7fc7980f8fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:52:43.926 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:43.923+0000 7fc79ef72640 1 -- 172.21.15.121:0/2782211423 shutdown_connections 2024-08-18T22:52:43.926 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:43.923+0000 7fc79ef72640 1 -- 172.21.15.121:0/2782211423 wait complete. 2024-08-18T22:52:43.933 INFO:teuthology.orchestra.run.smithi121.stdout:true 2024-08-18T22:52:43.934 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:52:43 smithi121 ceph-mon[81053]: pgmap v309: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:52:44.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:52:43 smithi195 ceph-mon[68841]: pgmap v309: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:52:44.590 DEBUG:teuthology.orchestra.run.smithi121:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b003123a-5db1-11ef-bccf-c7b262605968 -e sha1=de09dd018de4baddfa6ca4d43bc8fb784cf75833 -- bash -c 'ceph versions | jq -e '"'"'.overall | keys'"'"' | grep $sha1' 2024-08-18T22:52:44.833 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:52:44 smithi121 ceph-mon[81053]: from='client.? 172.21.15.121:0/2782211423' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-08-18T22:52:44.842 INFO:teuthology.orchestra.run.smithi121.stderr:Inferring config /var/lib/ceph/b003123a-5db1-11ef-bccf-c7b262605968/mon.smithi121/config 2024-08-18T22:52:45.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:52:44 smithi195 ceph-mon[68841]: from='client.? 172.21.15.121:0/2782211423' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-08-18T22:52:45.905 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:52:45 smithi121 ceph-mon[81053]: pgmap v310: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:52:46.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:52:45 smithi195 ceph-mon[68841]: pgmap v310: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:52:46.377 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:46.368+0000 7f50e6943640 1 -- 172.21.15.121:0/2251323336 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f50e00fb5b0 msgr2=0x7f50e00fb980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:52:46.377 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:46.368+0000 7f50e6943640 1 --2- 172.21.15.121:0/2251323336 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f50e00fb5b0 0x7f50e00fb980 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f50d00048d0 tx=0x7f50d0009da0 comp rx=0 tx=0).stop 2024-08-18T22:52:46.377 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:46.369+0000 7f50e6943640 1 -- 172.21.15.121:0/2251323336 shutdown_connections 2024-08-18T22:52:46.377 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:46.369+0000 7f50e6943640 1 --2- 172.21.15.121:0/2251323336 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f50e00fbec0 0x7f50e00fcdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:52:46.378 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:46.369+0000 7f50e6943640 1 --2- 172.21.15.121:0/2251323336 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f50e00fb5b0 0x7f50e00fb980 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:52:46.378 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:46.369+0000 7f50e6943640 1 -- 172.21.15.121:0/2251323336 >> 172.21.15.121:0/2251323336 conn(0x7f50e0072150 msgr2=0x7f50e0072550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:52:46.378 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:46.369+0000 7f50e6943640 1 -- 172.21.15.121:0/2251323336 shutdown_connections 2024-08-18T22:52:46.378 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:46.369+0000 7f50e6943640 1 -- 172.21.15.121:0/2251323336 wait complete. 2024-08-18T22:52:46.378 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:46.369+0000 7f50e6943640 1 Processor -- start 2024-08-18T22:52:46.378 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:46.369+0000 7f50e6943640 1 -- start start 2024-08-18T22:52:46.378 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:46.370+0000 7f50e6943640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f50e00fb5b0 0x7f50e0111ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:52:46.378 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:46.370+0000 7f50e6943640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f50e00fbec0 0x7f50e0112420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:52:46.378 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:46.370+0000 7f50e6943640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50e0112ab0 con 0x7f50e00fbec0 2024-08-18T22:52:46.378 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:46.370+0000 7f50e6943640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50e010be60 con 0x7f50e00fb5b0 2024-08-18T22:52:46.378 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:46.370+0000 7f50df7fe640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f50e00fbec0 0x7f50e0112420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:52:46.378 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:46.370+0000 7f50df7fe640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f50e00fbec0 0x7f50e0112420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:52370/0 (socket says 172.21.15.121:52370) 2024-08-18T22:52:46.378 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:46.370+0000 7f50df7fe640 1 -- 172.21.15.121:0/2474473261 learned_addr learned my addr 172.21.15.121:0/2474473261 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-18T22:52:46.379 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:46.370+0000 7f50dffff640 1 --2- 172.21.15.121:0/2474473261 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f50e00fb5b0 0x7f50e0111ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:52:46.379 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:46.370+0000 7f50df7fe640 1 -- 172.21.15.121:0/2474473261 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f50e00fb5b0 msgr2=0x7f50e0111ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:52:46.379 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:46.370+0000 7f50df7fe640 1 --2- 172.21.15.121:0/2474473261 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f50e00fb5b0 0x7f50e0111ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:52:46.379 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:46.370+0000 7f50df7fe640 1 -- 172.21.15.121:0/2474473261 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50d0005040 con 0x7f50e00fbec0 2024-08-18T22:52:46.379 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:46.370+0000 7f50dffff640 1 --2- 172.21.15.121:0/2474473261 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f50e00fb5b0 0x7f50e0111ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:52:46.379 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:46.370+0000 7f50df7fe640 1 --2- 172.21.15.121:0/2474473261 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f50e00fbec0 0x7f50e0112420 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f50d400b790 tx=0x7f50d40091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:52:46.379 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:46.370+0000 7f50dcff9640 1 -- 172.21.15.121:0/2474473261 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f50d400c700 con 0x7f50e00fbec0 2024-08-18T22:52:46.379 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:46.370+0000 7f50dcff9640 1 -- 172.21.15.121:0/2474473261 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f50d400cd00 con 0x7f50e00fbec0 2024-08-18T22:52:46.379 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:46.370+0000 7f50e6943640 1 -- 172.21.15.121:0/2474473261 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50e010c140 con 0x7f50e00fbec0 2024-08-18T22:52:46.379 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:46.370+0000 7f50dcff9640 1 -- 172.21.15.121:0/2474473261 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f50d4015e70 con 0x7f50e00fbec0 2024-08-18T22:52:46.379 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:46.370+0000 7f50e6943640 1 -- 172.21.15.121:0/2474473261 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50e010c660 con 0x7f50e00fbec0 2024-08-18T22:52:46.380 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:46.371+0000 7f50e6943640 1 -- 172.21.15.121:0/2474473261 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50e00fc960 con 0x7f50e00fbec0 2024-08-18T22:52:46.380 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:46.372+0000 7f50dcff9640 1 -- 172.21.15.121:0/2474473261 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 37) v1 ==== 92205+0+0 (secure 0 0 0) 0x7f50d4012070 con 0x7f50e00fbec0 2024-08-18T22:52:46.380 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:46.373+0000 7f50dcff9640 1 --2- 172.21.15.121:0/2474473261 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f50c806e0b0 0x7f50c8070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:52:46.380 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:46.373+0000 7f50dffff640 1 --2- 172.21.15.121:0/2474473261 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f50c806e0b0 0x7f50c8070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:52:46.380 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:46.373+0000 7f50dcff9640 1 -- 172.21.15.121:0/2474473261 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6668+0+0 (secure 0 0 0) 0x7f50d408d850 con 0x7f50e00fbec0 2024-08-18T22:52:46.380 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:46.373+0000 7f50dffff640 1 --2- 172.21.15.121:0/2474473261 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f50c806e0b0 0x7f50c8070560 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f50d000b020 tx=0x7f50d0009da0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:52:46.380 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:46.377+0000 7f50dcff9640 1 -- 172.21.15.121:0/2474473261 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f50d4056ad0 con 0x7f50e00fbec0 2024-08-18T22:52:46.612 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:46.610+0000 7f50e6943640 1 -- 172.21.15.121:0/2474473261 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f50e004b4c0 con 0x7f50e00fbec0 2024-08-18T22:52:46.612 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:46.610+0000 7f50dcff9640 1 -- 172.21.15.121:0/2474473261 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+618 (secure 0 0 0) 0x7f50d405a190 con 0x7f50e00fbec0 2024-08-18T22:52:46.614 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:46.612+0000 7f50e6943640 1 -- 172.21.15.121:0/2474473261 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f50c806e0b0 msgr2=0x7f50c8070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:52:46.615 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:46.612+0000 7f50e6943640 1 --2- 172.21.15.121:0/2474473261 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f50c806e0b0 0x7f50c8070560 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f50d000b020 tx=0x7f50d0009da0 comp rx=0 tx=0).stop 2024-08-18T22:52:46.615 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:46.612+0000 7f50e6943640 1 -- 172.21.15.121:0/2474473261 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f50e00fbec0 msgr2=0x7f50e0112420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:52:46.615 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:46.612+0000 7f50e6943640 1 --2- 172.21.15.121:0/2474473261 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f50e00fbec0 0x7f50e0112420 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f50d400b790 tx=0x7f50d40091d0 comp rx=0 tx=0).stop 2024-08-18T22:52:46.615 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:46.612+0000 7f50e6943640 1 -- 172.21.15.121:0/2474473261 shutdown_connections 2024-08-18T22:52:46.615 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:46.612+0000 7f50e6943640 1 --2- 172.21.15.121:0/2474473261 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f50c806e0b0 0x7f50c8070560 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:52:46.615 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:46.612+0000 7f50e6943640 1 --2- 172.21.15.121:0/2474473261 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f50e00fbec0 0x7f50e0112420 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:52:46.615 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:46.612+0000 7f50e6943640 1 --2- 172.21.15.121:0/2474473261 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f50e00fb5b0 0x7f50e0111ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:52:46.615 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:46.612+0000 7f50e6943640 1 -- 172.21.15.121:0/2474473261 >> 172.21.15.121:0/2474473261 conn(0x7f50e0072150 msgr2=0x7f50e00f8790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:52:46.615 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:46.613+0000 7f50e6943640 1 -- 172.21.15.121:0/2474473261 shutdown_connections 2024-08-18T22:52:46.615 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:46.613+0000 7f50e6943640 1 -- 172.21.15.121:0/2474473261 wait complete. 2024-08-18T22:52:46.623 INFO:teuthology.orchestra.run.smithi121.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)" 2024-08-18T22:52:47.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:52:46 smithi121 ceph-mon[81053]: from='client.? 172.21.15.121:0/2474473261' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-08-18T22:52:47.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:52:46 smithi195 ceph-mon[68841]: from='client.? 172.21.15.121:0/2474473261' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-08-18T22:52:47.366 DEBUG:teuthology.parallel:result is None 2024-08-18T22:52:47.366 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-08-18T22:52:47.378 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi121.front.sepia.ceph.com 2024-08-18T22:52:47.378 DEBUG:teuthology.orchestra.run.smithi121:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b003123a-5db1-11ef-bccf-c7b262605968 -- bash -c 'ceph fs dump' 2024-08-18T22:52:47.629 INFO:teuthology.orchestra.run.smithi121.stderr:Inferring config /var/lib/ceph/b003123a-5db1-11ef-bccf-c7b262605968/mon.smithi121/config 2024-08-18T22:52:48.068 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:52:47 smithi121 ceph-mon[81053]: pgmap v311: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:52:48.158 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:52:47 smithi195 ceph-mon[68841]: pgmap v311: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:52:49.254 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:49.250+0000 7fd11441c640 1 -- 172.21.15.121:0/2531527618 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd10c1022e0 msgr2=0x7fd10c1026b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:52:49.254 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:49.250+0000 7fd11441c640 1 --2- 172.21.15.121:0/2531527618 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd10c1022e0 0x7fd10c1026b0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fd1040048d0 tx=0x7fd104009da0 comp rx=0 tx=0).stop 2024-08-18T22:52:49.254 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:49.250+0000 7fd11441c640 1 -- 172.21.15.121:0/2531527618 shutdown_connections 2024-08-18T22:52:49.254 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:49.250+0000 7fd11441c640 1 --2- 172.21.15.121:0/2531527618 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd10c102c80 0x7fd10c0fc310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:52:49.254 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:49.250+0000 7fd11441c640 1 --2- 172.21.15.121:0/2531527618 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd10c1022e0 0x7fd10c1026b0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:52:49.254 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:49.250+0000 7fd11441c640 1 -- 172.21.15.121:0/2531527618 >> 172.21.15.121:0/2531527618 conn(0x7fd10c0f7eb0 msgr2=0x7fd10c0fa2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:52:49.254 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:49.250+0000 7fd11441c640 1 -- 172.21.15.121:0/2531527618 shutdown_connections 2024-08-18T22:52:49.255 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:49.250+0000 7fd11441c640 1 -- 172.21.15.121:0/2531527618 wait complete. 2024-08-18T22:52:49.255 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:49.251+0000 7fd11441c640 1 Processor -- start 2024-08-18T22:52:49.255 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:49.251+0000 7fd11441c640 1 -- start start 2024-08-18T22:52:49.255 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:49.251+0000 7fd11441c640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd10c1022e0 0x7fd10c112fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:52:49.255 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:49.251+0000 7fd11441c640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd10c102c80 0x7fd10c113520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:52:49.255 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:49.251+0000 7fd11441c640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd10c113bb0 con 0x7fd10c102c80 2024-08-18T22:52:49.255 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:49.251+0000 7fd11441c640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd10c10cf60 con 0x7fd10c1022e0 2024-08-18T22:52:49.255 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:49.251+0000 7fd1119b7640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd10c102c80 0x7fd10c113520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:52:49.255 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:49.251+0000 7fd1119b7640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd10c102c80 0x7fd10c113520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:50872/0 (socket says 172.21.15.121:50872) 2024-08-18T22:52:49.255 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:49.251+0000 7fd1119b7640 1 -- 172.21.15.121:0/4055440788 learned_addr learned my addr 172.21.15.121:0/4055440788 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-18T22:52:49.255 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:49.251+0000 7fd1121b8640 1 --2- 172.21.15.121:0/4055440788 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd10c1022e0 0x7fd10c112fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:52:49.255 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:49.251+0000 7fd1119b7640 1 -- 172.21.15.121:0/4055440788 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd10c1022e0 msgr2=0x7fd10c112fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:52:49.255 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:49.251+0000 7fd1119b7640 1 --2- 172.21.15.121:0/4055440788 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd10c1022e0 0x7fd10c112fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:52:49.256 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:49.251+0000 7fd1119b7640 1 -- 172.21.15.121:0/4055440788 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd104005040 con 0x7fd10c102c80 2024-08-18T22:52:49.256 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:49.251+0000 7fd1121b8640 1 --2- 172.21.15.121:0/4055440788 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd10c1022e0 0x7fd10c112fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:52:49.256 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:49.252+0000 7fd1119b7640 1 --2- 172.21.15.121:0/4055440788 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd10c102c80 0x7fd10c113520 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fd10000b790 tx=0x7fd1000091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:52:49.256 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:49.252+0000 7fd10affd640 1 -- 172.21.15.121:0/4055440788 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd10000c700 con 0x7fd10c102c80 2024-08-18T22:52:49.256 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:49.252+0000 7fd10affd640 1 -- 172.21.15.121:0/4055440788 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fd10000cd00 con 0x7fd10c102c80 2024-08-18T22:52:49.256 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:49.252+0000 7fd10affd640 1 -- 172.21.15.121:0/4055440788 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd100015e70 con 0x7fd10c102c80 2024-08-18T22:52:49.256 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:49.252+0000 7fd11441c640 1 -- 172.21.15.121:0/4055440788 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd10c10d240 con 0x7fd10c102c80 2024-08-18T22:52:49.256 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:49.252+0000 7fd11441c640 1 -- 172.21.15.121:0/4055440788 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd10c10d760 con 0x7fd10c102c80 2024-08-18T22:52:49.257 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:49.253+0000 7fd11441c640 1 -- 172.21.15.121:0/4055440788 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd10c0fda50 con 0x7fd10c102c80 2024-08-18T22:52:49.257 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:49.253+0000 7fd10affd640 1 -- 172.21.15.121:0/4055440788 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 37) v1 ==== 92205+0+0 (secure 0 0 0) 0x7fd100012070 con 0x7fd10c102c80 2024-08-18T22:52:49.257 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:49.254+0000 7fd10affd640 1 --2- 172.21.15.121:0/4055440788 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7fd0f406e0b0 0x7fd0f4070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:52:49.257 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:49.254+0000 7fd10affd640 1 -- 172.21.15.121:0/4055440788 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6668+0+0 (secure 0 0 0) 0x7fd10008d750 con 0x7fd10c102c80 2024-08-18T22:52:49.257 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:49.254+0000 7fd1121b8640 1 --2- 172.21.15.121:0/4055440788 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7fd0f406e0b0 0x7fd0f4070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:52:49.257 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:49.254+0000 7fd1121b8640 1 --2- 172.21.15.121:0/4055440788 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7fd0f406e0b0 0x7fd0f4070560 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fd104007ac0 tx=0x7fd104035040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:52:49.260 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:49.258+0000 7fd10affd640 1 -- 172.21.15.121:0/4055440788 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7fd100056a50 con 0x7fd10c102c80 2024-08-18T22:52:49.466 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:49.464+0000 7fd11441c640 1 -- 172.21.15.121:0/4055440788 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fd10c1093b0 con 0x7fd10c102c80 2024-08-18T22:52:49.466 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:49.464+0000 7fd10affd640 1 -- 172.21.15.121:0/4055440788 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 46 v46) v1 ==== 76+0+1997 (secure 0 0 0) 0x7fd10005a110 con 0x7fd10c102c80 2024-08-18T22:52:49.467 INFO:teuthology.orchestra.run.smithi121.stdout:e46 2024-08-18T22:52:49.467 INFO:teuthology.orchestra.run.smithi121.stdout:btime 2024-08-18T22:49:43:280875+0000 2024-08-18T22:52:49.467 INFO:teuthology.orchestra.run.smithi121.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-08-18T22:52:49.467 INFO:teuthology.orchestra.run.smithi121.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-08-18T22:52:49.467 INFO:teuthology.orchestra.run.smithi121.stdout:legacy client fscid: 1 2024-08-18T22:52:49.467 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-08-18T22:52:49.468 INFO:teuthology.orchestra.run.smithi121.stdout:Filesystem 'cephfs' (1) 2024-08-18T22:52:49.468 INFO:teuthology.orchestra.run.smithi121.stdout:fs_name cephfs 2024-08-18T22:52:49.468 INFO:teuthology.orchestra.run.smithi121.stdout:epoch 46 2024-08-18T22:52:49.468 INFO:teuthology.orchestra.run.smithi121.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-08-18T22:52:49.468 INFO:teuthology.orchestra.run.smithi121.stdout:created 2024-08-18T22:39:04.054074+0000 2024-08-18T22:52:49.468 INFO:teuthology.orchestra.run.smithi121.stdout:modified 2024-08-18T22:49:43.280872+0000 2024-08-18T22:52:49.468 INFO:teuthology.orchestra.run.smithi121.stdout:tableserver 0 2024-08-18T22:52:49.468 INFO:teuthology.orchestra.run.smithi121.stdout:root 0 2024-08-18T22:52:49.468 INFO:teuthology.orchestra.run.smithi121.stdout:session_timeout 60 2024-08-18T22:52:49.469 INFO:teuthology.orchestra.run.smithi121.stdout:session_autoclose 300 2024-08-18T22:52:49.469 INFO:teuthology.orchestra.run.smithi121.stdout:max_file_size 1099511627776 2024-08-18T22:52:49.469 INFO:teuthology.orchestra.run.smithi121.stdout:max_xattr_size 65536 2024-08-18T22:52:49.469 INFO:teuthology.orchestra.run.smithi121.stdout:required_client_features {} 2024-08-18T22:52:49.469 INFO:teuthology.orchestra.run.smithi121.stdout:last_failure 0 2024-08-18T22:52:49.469 INFO:teuthology.orchestra.run.smithi121.stdout:last_failure_osd_epoch 84 2024-08-18T22:52:49.469 INFO:teuthology.orchestra.run.smithi121.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-08-18T22:52:49.469 INFO:teuthology.orchestra.run.smithi121.stdout:max_mds 2 2024-08-18T22:52:49.469 INFO:teuthology.orchestra.run.smithi121.stdout:in 0,1 2024-08-18T22:52:49.469 INFO:teuthology.orchestra.run.smithi121.stdout:up {0=34404,1=34436} 2024-08-18T22:52:49.470 INFO:teuthology.orchestra.run.smithi121.stdout:failed 2024-08-18T22:52:49.470 INFO:teuthology.orchestra.run.smithi121.stdout:damaged 2024-08-18T22:52:49.470 INFO:teuthology.orchestra.run.smithi121.stdout:stopped 2024-08-18T22:52:49.470 INFO:teuthology.orchestra.run.smithi121.stdout:data_pools [3] 2024-08-18T22:52:49.470 INFO:teuthology.orchestra.run.smithi121.stdout:metadata_pool 2 2024-08-18T22:52:49.470 INFO:teuthology.orchestra.run.smithi121.stdout:inline_data disabled 2024-08-18T22:52:49.470 INFO:teuthology.orchestra.run.smithi121.stdout:balancer 2024-08-18T22:52:49.471 INFO:teuthology.orchestra.run.smithi121.stdout:bal_rank_mask -1 2024-08-18T22:52:49.471 INFO:teuthology.orchestra.run.smithi121.stdout:standby_count_wanted 1 2024-08-18T22:52:49.471 INFO:teuthology.orchestra.run.smithi121.stdout:qdb_cluster leader: 34404 members: 34404,34436 2024-08-18T22:52:49.471 INFO:teuthology.orchestra.run.smithi121.stdout:[mds.cephfs.smithi121.xuzsdg{0:34404} state up:active seq 18 join_fscid=1 addr [v2:172.21.15.121:6826/4267588865,v1:172.21.15.121:6827/4267588865] compat {c=[1],r=[1],i=[1fff]}] 2024-08-18T22:52:49.471 INFO:teuthology.orchestra.run.smithi121.stdout:[mds.cephfs.smithi121.gbickb{1:34436} state up:active seq 14 join_fscid=1 addr [v2:172.21.15.121:6828/2915303436,v1:172.21.15.121:6829/2915303436] compat {c=[1],r=[1],i=[1fff]}] 2024-08-18T22:52:49.471 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-08-18T22:52:49.471 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-08-18T22:52:49.471 INFO:teuthology.orchestra.run.smithi121.stdout:Standby daemons: 2024-08-18T22:52:49.471 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-08-18T22:52:49.471 INFO:teuthology.orchestra.run.smithi121.stdout:[mds.cephfs.smithi195.buqvbr{-1:44299} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.195:6824/1574620912,v1:172.21.15.195:6825/1574620912] compat {c=[1],r=[1],i=[1fff]}] 2024-08-18T22:52:49.472 INFO:teuthology.orchestra.run.smithi121.stdout:[mds.cephfs.smithi195.nptgyc{-1:44327} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.195:6826/4050783124,v1:172.21.15.195:6827/4050783124] compat {c=[1],r=[1],i=[1fff]}] 2024-08-18T22:52:49.472 INFO:teuthology.orchestra.run.smithi121.stderr:dumped fsmap epoch 46 2024-08-18T22:52:49.473 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:49.466+0000 7fd11441c640 1 -- 172.21.15.121:0/4055440788 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7fd0f406e0b0 msgr2=0x7fd0f4070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:52:49.473 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:49.466+0000 7fd11441c640 1 --2- 172.21.15.121:0/4055440788 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7fd0f406e0b0 0x7fd0f4070560 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fd104007ac0 tx=0x7fd104035040 comp rx=0 tx=0).stop 2024-08-18T22:52:49.473 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:49.466+0000 7fd11441c640 1 -- 172.21.15.121:0/4055440788 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd10c102c80 msgr2=0x7fd10c113520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:52:49.473 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:49.466+0000 7fd11441c640 1 --2- 172.21.15.121:0/4055440788 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd10c102c80 0x7fd10c113520 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fd10000b790 tx=0x7fd1000091d0 comp rx=0 tx=0).stop 2024-08-18T22:52:49.473 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:49.466+0000 7fd11441c640 1 -- 172.21.15.121:0/4055440788 shutdown_connections 2024-08-18T22:52:49.473 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:49.466+0000 7fd11441c640 1 --2- 172.21.15.121:0/4055440788 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7fd0f406e0b0 0x7fd0f4070560 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:52:49.473 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:49.466+0000 7fd11441c640 1 --2- 172.21.15.121:0/4055440788 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd10c102c80 0x7fd10c113520 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:52:49.474 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:49.466+0000 7fd11441c640 1 --2- 172.21.15.121:0/4055440788 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd10c1022e0 0x7fd10c112fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:52:49.474 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:49.466+0000 7fd11441c640 1 -- 172.21.15.121:0/4055440788 >> 172.21.15.121:0/4055440788 conn(0x7fd10c0f7eb0 msgr2=0x7fd10c0f8e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:52:49.474 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:49.467+0000 7fd11441c640 1 -- 172.21.15.121:0/4055440788 shutdown_connections 2024-08-18T22:52:49.474 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:49.467+0000 7fd11441c640 1 -- 172.21.15.121:0/4055440788 wait complete. 2024-08-18T22:52:50.071 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:52:49 smithi121 ceph-mon[81053]: pgmap v312: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:52:50.071 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:52:49 smithi121 ceph-mon[81053]: from='client.? 172.21.15.121:0/4055440788' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-08-18T22:52:50.095 INFO:teuthology.run_tasks:Running task fs.post_upgrade_checks... 2024-08-18T22:52:50.108 DEBUG:teuthology.orchestra.run.smithi121:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid b003123a-5db1-11ef-bccf-c7b262605968 -- ceph fs dump --format=json 2024-08-18T22:52:50.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:52:49 smithi195 ceph-mon[68841]: pgmap v312: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:52:50.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:52:49 smithi195 ceph-mon[68841]: from='client.? 172.21.15.121:0/4055440788' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-08-18T22:52:50.356 INFO:teuthology.orchestra.run.smithi121.stderr:Inferring config /var/lib/ceph/b003123a-5db1-11ef-bccf-c7b262605968/mon.smithi121/config 2024-08-18T22:52:51.869 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:51.866+0000 7fb86f74d640 1 -- 172.21.15.121:0/2433039311 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb868102ca0 msgr2=0x7fb8680fc330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:52:51.870 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:51.866+0000 7fb86f74d640 1 --2- 172.21.15.121:0/2433039311 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb868102ca0 0x7fb8680fc330 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fb8580048d0 tx=0x7fb858009da0 comp rx=0 tx=0).stop 2024-08-18T22:52:51.870 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:51.866+0000 7fb86f74d640 1 -- 172.21.15.121:0/2433039311 shutdown_connections 2024-08-18T22:52:51.870 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:51.866+0000 7fb86f74d640 1 --2- 172.21.15.121:0/2433039311 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb868102ca0 0x7fb8680fc330 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:52:51.870 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:51.866+0000 7fb86f74d640 1 --2- 172.21.15.121:0/2433039311 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb868102300 0x7fb8681026d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:52:51.870 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:51.866+0000 7fb86f74d640 1 -- 172.21.15.121:0/2433039311 >> 172.21.15.121:0/2433039311 conn(0x7fb8680f7e90 msgr2=0x7fb8680fa2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:52:51.870 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:51.866+0000 7fb86f74d640 1 -- 172.21.15.121:0/2433039311 shutdown_connections 2024-08-18T22:52:51.870 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:51.866+0000 7fb86f74d640 1 -- 172.21.15.121:0/2433039311 wait complete. 2024-08-18T22:52:51.870 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:51.866+0000 7fb86f74d640 1 Processor -- start 2024-08-18T22:52:51.870 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:51.866+0000 7fb86f74d640 1 -- start start 2024-08-18T22:52:51.870 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:51.866+0000 7fb86f74d640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb868102300 0x7fb8681154f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:52:51.871 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:51.866+0000 7fb86f74d640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb868102ca0 0x7fb868115a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:52:51.871 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:51.866+0000 7fb86f74d640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb868116110 con 0x7fb868102ca0 2024-08-18T22:52:51.871 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:51.866+0000 7fb86f74d640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb86810f490 con 0x7fb868102300 2024-08-18T22:52:51.871 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:51.867+0000 7fb86cce8640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb868102ca0 0x7fb868115a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:52:51.871 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:51.867+0000 7fb86cce8640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb868102ca0 0x7fb868115a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:50888/0 (socket says 172.21.15.121:50888) 2024-08-18T22:52:51.871 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:51.867+0000 7fb86cce8640 1 -- 172.21.15.121:0/4273763062 learned_addr learned my addr 172.21.15.121:0/4273763062 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-18T22:52:51.871 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:51.867+0000 7fb86d4e9640 1 --2- 172.21.15.121:0/4273763062 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb868102300 0x7fb8681154f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:52:51.871 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:51.867+0000 7fb86cce8640 1 -- 172.21.15.121:0/4273763062 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb868102300 msgr2=0x7fb8681154f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:52:51.871 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:51.867+0000 7fb86cce8640 1 --2- 172.21.15.121:0/4273763062 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb868102300 0x7fb8681154f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:52:51.871 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:51.867+0000 7fb86cce8640 1 -- 172.21.15.121:0/4273763062 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb858005040 con 0x7fb868102ca0 2024-08-18T22:52:51.871 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:51.867+0000 7fb86d4e9640 1 --2- 172.21.15.121:0/4273763062 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb868102300 0x7fb8681154f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:52:51.871 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:51.867+0000 7fb86cce8640 1 --2- 172.21.15.121:0/4273763062 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb868102ca0 0x7fb868115a30 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fb858003080 tx=0x7fb858009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:52:51.871 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:51.867+0000 7fb85dffb640 1 -- 172.21.15.121:0/4273763062 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb858038070 con 0x7fb868102ca0 2024-08-18T22:52:51.871 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:51.867+0000 7fb85dffb640 1 -- 172.21.15.121:0/4273763062 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fb8580097e0 con 0x7fb868102ca0 2024-08-18T22:52:51.872 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:51.867+0000 7fb86f74d640 1 -- 172.21.15.121:0/4273763062 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb86810f6c0 con 0x7fb868102ca0 2024-08-18T22:52:51.872 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:51.867+0000 7fb85dffb640 1 -- 172.21.15.121:0/4273763062 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb85803d420 con 0x7fb868102ca0 2024-08-18T22:52:51.872 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:51.867+0000 7fb86f74d640 1 -- 172.21.15.121:0/4273763062 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb86810fb80 con 0x7fb868102ca0 2024-08-18T22:52:51.873 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:51.868+0000 7fb86f74d640 1 -- 172.21.15.121:0/4273763062 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8680fda70 con 0x7fb868102ca0 2024-08-18T22:52:51.873 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:51.869+0000 7fb85dffb640 1 -- 172.21.15.121:0/4273763062 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 37) v1 ==== 92205+0+0 (secure 0 0 0) 0x7fb858030020 con 0x7fb868102ca0 2024-08-18T22:52:51.873 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:51.869+0000 7fb85dffb640 1 --2- 172.21.15.121:0/4273763062 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7fb85406e0b0 0x7fb854070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:52:51.873 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:51.870+0000 7fb85dffb640 1 -- 172.21.15.121:0/4273763062 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6668+0+0 (secure 0 0 0) 0x7fb8580ae1f0 con 0x7fb868102ca0 2024-08-18T22:52:51.873 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:51.870+0000 7fb86d4e9640 1 --2- 172.21.15.121:0/4273763062 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7fb85406e0b0 0x7fb854070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:52:51.873 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:51.870+0000 7fb86d4e9640 1 --2- 172.21.15.121:0/4273763062 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7fb85406e0b0 0x7fb854070560 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fb864009a80 tx=0x7fb864008040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:52:51.876 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:51.874+0000 7fb85dffb640 1 -- 172.21.15.121:0/4273763062 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7fb858077470 con 0x7fb868102ca0 2024-08-18T22:52:52.074 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:52.072+0000 7fb86f74d640 1 -- 172.21.15.121:0/4273763062 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb8680fbaf0 con 0x7fb868102ca0 2024-08-18T22:52:52.075 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:52:51 smithi121 ceph-mon[81053]: pgmap v313: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:52:52.075 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:52.073+0000 7fb85dffb640 1 -- 172.21.15.121:0/4273763062 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 46 v46) v1 ==== 94+0+5284 (secure 0 0 0) 0x7fb85807ab30 con 0x7fb868102ca0 2024-08-18T22:52:52.076 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-08-18T22:52:52.076 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":46,"btime":"2024-08-18T22:49:43:280875+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":44299,"name":"cephfs.smithi195.buqvbr","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6825/1574620912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":1574620912},{"type":"v1","addr":"172.21.15.195:6825","nonce":1574620912}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":36},{"gid":44327,"name":"cephfs.smithi195.nptgyc","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6827/4050783124","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":4050783124},{"type":"v1","addr":"172.21.15.195:6827","nonce":4050783124}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":43}],"filesystems":[{"mdsmap":{"epoch":46,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-18T22:39:04.054074+0000","modified":"2024-08-18T22:49:43.280872+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":84,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":2,"in":[0,1],"up":{"mds_0":34404,"mds_1":34436},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34404":{"gid":34404,"name":"cephfs.smithi121.xuzsdg","rank":0,"incarnation":38,"state":"up:active","state_seq":18,"addr":"172.21.15.121:6827/4267588865","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":4267588865},{"type":"v1","addr":"172.21.15.121:6827","nonce":4267588865}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34436":{"gid":34436,"name":"cephfs.smithi121.gbickb","rank":1,"incarnation":45,"state":"up:active","state_seq":14,"addr":"172.21.15.121:6829/2915303436","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6828","nonce":2915303436},{"type":"v1","addr":"172.21.15.121:6829","nonce":2915303436}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":34404,"qdb_cluster":[34404,34436]},"id":1}]} 2024-08-18T22:52:52.076 INFO:teuthology.orchestra.run.smithi121.stderr:dumped fsmap epoch 46 2024-08-18T22:52:52.077 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:52.075+0000 7fb86f74d640 1 -- 172.21.15.121:0/4273763062 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7fb85406e0b0 msgr2=0x7fb854070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:52:52.077 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:52.075+0000 7fb86f74d640 1 --2- 172.21.15.121:0/4273763062 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7fb85406e0b0 0x7fb854070560 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fb864009a80 tx=0x7fb864008040 comp rx=0 tx=0).stop 2024-08-18T22:52:52.077 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:52.075+0000 7fb86f74d640 1 -- 172.21.15.121:0/4273763062 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb868102ca0 msgr2=0x7fb868115a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:52:52.077 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:52.075+0000 7fb86f74d640 1 --2- 172.21.15.121:0/4273763062 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb868102ca0 0x7fb868115a30 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fb858003080 tx=0x7fb858009da0 comp rx=0 tx=0).stop 2024-08-18T22:52:52.078 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:52.075+0000 7fb86f74d640 1 -- 172.21.15.121:0/4273763062 shutdown_connections 2024-08-18T22:52:52.078 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:52.075+0000 7fb86f74d640 1 --2- 172.21.15.121:0/4273763062 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7fb85406e0b0 0x7fb854070560 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:52:52.078 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:52.075+0000 7fb86f74d640 1 --2- 172.21.15.121:0/4273763062 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb868102ca0 0x7fb868115a30 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:52:52.078 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:52.075+0000 7fb86f74d640 1 --2- 172.21.15.121:0/4273763062 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb868102300 0x7fb8681154f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:52:52.078 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:52.075+0000 7fb86f74d640 1 -- 172.21.15.121:0/4273763062 >> 172.21.15.121:0/4273763062 conn(0x7fb8680f7e90 msgr2=0x7fb8680f8e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:52:52.078 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:52.075+0000 7fb86f74d640 1 -- 172.21.15.121:0/4273763062 shutdown_connections 2024-08-18T22:52:52.078 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:52.075+0000 7fb86f74d640 1 -- 172.21.15.121:0/4273763062 wait complete. 2024-08-18T22:52:52.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:52:51 smithi195 ceph-mon[68841]: pgmap v313: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:52:52.719 DEBUG:tasks.fs:checking fs fscid=1,name=cephfs state = {'epoch': 17, 'max_mds': 2, 'flags': 18} 2024-08-18T22:52:52.720 DEBUG:teuthology.orchestra.run.smithi121:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid b003123a-5db1-11ef-bccf-c7b262605968 -- ceph fs dump --format=json 18 2024-08-18T22:52:52.972 INFO:teuthology.orchestra.run.smithi121.stderr:Inferring config /var/lib/ceph/b003123a-5db1-11ef-bccf-c7b262605968/mon.smithi121/config 2024-08-18T22:52:53.098 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:52:52 smithi121 ceph-mon[81053]: from='client.? 172.21.15.121:0/4273763062' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-18T22:52:53.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:52:52 smithi195 ceph-mon[68841]: from='client.? 172.21.15.121:0/4273763062' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-18T22:52:54.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:52:53 smithi121 ceph-mon[81053]: pgmap v314: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:52:54.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:52:53 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-18T22:52:54.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:52:53 smithi195 ceph-mon[68841]: pgmap v314: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:52:54.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:52:53 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-18T22:52:54.487 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:54.480+0000 7f98d7ed2640 1 -- 172.21.15.121:0/178587706 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f98d0101340 msgr2=0x7f98d00faa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:52:54.487 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:54.480+0000 7f98d7ed2640 1 --2- 172.21.15.121:0/178587706 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f98d0101340 0x7f98d00faa20 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f98cc0049c0 tx=0x7f98cc00aeb0 comp rx=0 tx=0).stop 2024-08-18T22:52:54.487 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:54.480+0000 7f98d7ed2640 1 -- 172.21.15.121:0/178587706 shutdown_connections 2024-08-18T22:52:54.487 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:54.480+0000 7f98d7ed2640 1 --2- 172.21.15.121:0/178587706 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f98d0101340 0x7f98d00faa20 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:52:54.487 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:54.480+0000 7f98d7ed2640 1 --2- 172.21.15.121:0/178587706 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f98d0100a30 0x7f98d0100e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:52:54.487 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:54.480+0000 7f98d7ed2640 1 -- 172.21.15.121:0/178587706 >> 172.21.15.121:0/178587706 conn(0x7f98d0070a80 msgr2=0x7f98d0070e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:52:54.487 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:54.480+0000 7f98d7ed2640 1 -- 172.21.15.121:0/178587706 shutdown_connections 2024-08-18T22:52:54.487 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:54.480+0000 7f98d7ed2640 1 -- 172.21.15.121:0/178587706 wait complete. 2024-08-18T22:52:54.487 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:54.480+0000 7f98d7ed2640 1 Processor -- start 2024-08-18T22:52:54.488 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:54.480+0000 7f98d7ed2640 1 -- start start 2024-08-18T22:52:54.488 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:54.480+0000 7f98d7ed2640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f98d0100a30 0x7f98d0110df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:52:54.488 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:54.480+0000 7f98d7ed2640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f98d0101340 0x7f98d0111330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:52:54.488 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:54.480+0000 7f98d7ed2640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98d0111930 con 0x7f98d0101340 2024-08-18T22:52:54.488 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:54.480+0000 7f98d7ed2640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98d010ad70 con 0x7f98d0100a30 2024-08-18T22:52:54.488 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:54.481+0000 7f98d546d640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f98d0101340 0x7f98d0111330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:52:54.488 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:54.481+0000 7f98d546d640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f98d0101340 0x7f98d0111330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:50908/0 (socket says 172.21.15.121:50908) 2024-08-18T22:52:54.488 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:54.481+0000 7f98d546d640 1 -- 172.21.15.121:0/2956218579 learned_addr learned my addr 172.21.15.121:0/2956218579 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-18T22:52:54.488 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:54.481+0000 7f98d5c6e640 1 --2- 172.21.15.121:0/2956218579 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f98d0100a30 0x7f98d0110df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:52:54.488 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:54.481+0000 7f98d546d640 1 -- 172.21.15.121:0/2956218579 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f98d0100a30 msgr2=0x7f98d0110df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:52:54.488 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:54.481+0000 7f98d546d640 1 --2- 172.21.15.121:0/2956218579 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f98d0100a30 0x7f98d0110df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:52:54.489 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:54.481+0000 7f98d546d640 1 -- 172.21.15.121:0/2956218579 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98cc005040 con 0x7f98d0101340 2024-08-18T22:52:54.489 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:54.481+0000 7f98d546d640 1 --2- 172.21.15.121:0/2956218579 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f98d0101340 0x7f98d0111330 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f98cc000c00 tx=0x7f98cc00aeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:52:54.489 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:54.481+0000 7f98c67fc640 1 -- 172.21.15.121:0/2956218579 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f98cc039070 con 0x7f98d0101340 2024-08-18T22:52:54.489 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:54.481+0000 7f98d7ed2640 1 -- 172.21.15.121:0/2956218579 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98d010aff0 con 0x7f98d0101340 2024-08-18T22:52:54.489 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:54.481+0000 7f98c67fc640 1 -- 172.21.15.121:0/2956218579 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f98cc0333d0 con 0x7f98d0101340 2024-08-18T22:52:54.489 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:54.481+0000 7f98c67fc640 1 -- 172.21.15.121:0/2956218579 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f98cc034c80 con 0x7f98d0101340 2024-08-18T22:52:54.489 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:54.481+0000 7f98d7ed2640 1 -- 172.21.15.121:0/2956218579 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98d010b590 con 0x7f98d0101340 2024-08-18T22:52:54.489 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:54.482+0000 7f98d7ed2640 1 -- 172.21.15.121:0/2956218579 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98d00fc110 con 0x7f98d0101340 2024-08-18T22:52:54.489 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:54.483+0000 7f98c67fc640 1 -- 172.21.15.121:0/2956218579 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 37) v1 ==== 92205+0+0 (secure 0 0 0) 0x7f98cc031020 con 0x7f98d0101340 2024-08-18T22:52:54.489 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:54.483+0000 7f98c67fc640 1 --2- 172.21.15.121:0/2956218579 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f98bc06e0b0 0x7f98bc070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:52:54.489 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:54.483+0000 7f98d5c6e640 1 --2- 172.21.15.121:0/2956218579 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f98bc06e0b0 0x7f98bc070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:52:54.489 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:54.483+0000 7f98c67fc640 1 -- 172.21.15.121:0/2956218579 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6668+0+0 (secure 0 0 0) 0x7f98cc0af0a0 con 0x7f98d0101340 2024-08-18T22:52:54.490 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:54.484+0000 7f98d5c6e640 1 --2- 172.21.15.121:0/2956218579 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f98bc06e0b0 0x7f98bc070560 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f98c0004ce0 tx=0x7f98c000b040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:52:54.490 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:54.488+0000 7f98c67fc640 1 -- 172.21.15.121:0/2956218579 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f98cc078320 con 0x7f98d0101340 2024-08-18T22:52:54.691 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:54.689+0000 7f98d7ed2640 1 -- 172.21.15.121:0/2956218579 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 18, "format": "json"} v 0) v1 -- 0x7f98d0107150 con 0x7f98d0101340 2024-08-18T22:52:54.691 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:54.690+0000 7f98c67fc640 1 -- 172.21.15.121:0/2956218579 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 18, "format": "json"}]=0 dumped fsmap epoch 18 v46) v1 ==== 107+0+4918 (secure 0 0 0) 0x7f98cc07b9e0 con 0x7f98d0101340 2024-08-18T22:52:54.692 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-08-18T22:52:54.692 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":18,"btime":"1970-01-01T00:00:00:000000+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14490,"name":"cephfs.smithi121.xuzsdg","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6827/91588128","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":91588128},{"type":"v1","addr":"172.21.15.121:6827","nonce":91588128}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":14},{"gid":24259,"name":"cephfs.smithi195.nptgyc","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.195:6827/238549847","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":238549847},{"type":"v1","addr":"172.21.15.195:6827","nonce":238549847}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-18T22:39:04.054074+0000","modified":"2024-08-18T22:41:01.169096+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":47,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":14474,"mds_1":24249},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14474":{"gid":14474,"name":"cephfs.smithi121.gbickb","rank":0,"incarnation":13,"state":"up:active","state_seq":6,"addr":"172.21.15.121:6829/2277706406","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6828","nonce":2277706406},{"type":"v1","addr":"172.21.15.121:6829","nonce":2277706406}]},"join_fscid":1,"export_targets":[1],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24249":{"gid":24249,"name":"cephfs.smithi195.buqvbr","rank":1,"incarnation":7,"state":"up:active","state_seq":4,"addr":"172.21.15.195:6825/2414511859","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":2414511859},{"type":"v1","addr":"172.21.15.195:6825","nonce":2414511859}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-08-18T22:52:54.692 INFO:teuthology.orchestra.run.smithi121.stderr:dumped fsmap epoch 18 2024-08-18T22:52:54.695 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:54.693+0000 7f98d7ed2640 1 -- 172.21.15.121:0/2956218579 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f98bc06e0b0 msgr2=0x7f98bc070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:52:54.695 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:54.693+0000 7f98d7ed2640 1 --2- 172.21.15.121:0/2956218579 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f98bc06e0b0 0x7f98bc070560 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f98c0004ce0 tx=0x7f98c000b040 comp rx=0 tx=0).stop 2024-08-18T22:52:54.695 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:54.693+0000 7f98d7ed2640 1 -- 172.21.15.121:0/2956218579 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f98d0101340 msgr2=0x7f98d0111330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:52:54.695 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:54.693+0000 7f98d7ed2640 1 --2- 172.21.15.121:0/2956218579 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f98d0101340 0x7f98d0111330 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f98cc000c00 tx=0x7f98cc00aeb0 comp rx=0 tx=0).stop 2024-08-18T22:52:54.695 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:54.693+0000 7f98d7ed2640 1 -- 172.21.15.121:0/2956218579 shutdown_connections 2024-08-18T22:52:54.695 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:54.693+0000 7f98d7ed2640 1 --2- 172.21.15.121:0/2956218579 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f98bc06e0b0 0x7f98bc070560 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:52:54.695 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:54.693+0000 7f98d7ed2640 1 --2- 172.21.15.121:0/2956218579 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f98d0101340 0x7f98d0111330 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:52:54.695 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:54.693+0000 7f98d7ed2640 1 --2- 172.21.15.121:0/2956218579 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f98d0100a30 0x7f98d0110df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:52:54.696 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:54.693+0000 7f98d7ed2640 1 -- 172.21.15.121:0/2956218579 >> 172.21.15.121:0/2956218579 conn(0x7f98d0070a80 msgr2=0x7f98d00f9470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:52:54.696 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:54.693+0000 7f98d7ed2640 1 -- 172.21.15.121:0/2956218579 shutdown_connections 2024-08-18T22:52:54.696 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:54.693+0000 7f98d7ed2640 1 -- 172.21.15.121:0/2956218579 wait complete. 2024-08-18T22:52:55.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:52:54 smithi121 ceph-mon[81053]: from='client.? 172.21.15.121:0/2956218579' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 18, "format": "json"}]: dispatch 2024-08-18T22:52:55.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:52:54 smithi195 ceph-mon[68841]: from='client.? 172.21.15.121:0/2956218579' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 18, "format": "json"}]: dispatch 2024-08-18T22:52:55.376 DEBUG:teuthology.orchestra.run.smithi121:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid b003123a-5db1-11ef-bccf-c7b262605968 -- ceph fs dump --format=json 19 2024-08-18T22:52:55.626 INFO:teuthology.orchestra.run.smithi121.stderr:Inferring config /var/lib/ceph/b003123a-5db1-11ef-bccf-c7b262605968/mon.smithi121/config 2024-08-18T22:52:56.061 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:52:55 smithi121 ceph-mon[81053]: pgmap v315: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:52:56.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:52:55 smithi195 ceph-mon[68841]: pgmap v315: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:52:57.033 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:52:56 smithi121 ceph-mon[81053]: pgmap v316: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:52:57.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:52:56 smithi195 ceph-mon[68841]: pgmap v316: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:52:57.231 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:57.229+0000 7f154fe64640 1 -- 172.21.15.121:0/2497543816 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1548065070 msgr2=0x7f1548065440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:52:57.232 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:57.229+0000 7f154fe64640 1 --2- 172.21.15.121:0/2497543816 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1548065070 0x7f1548065440 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f15440048d0 tx=0x7f1544009da0 comp rx=0 tx=0).stop 2024-08-18T22:52:57.232 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:57.229+0000 7f154fe64640 1 -- 172.21.15.121:0/2497543816 shutdown_connections 2024-08-18T22:52:57.232 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:57.229+0000 7f154fe64640 1 --2- 172.21.15.121:0/2497543816 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f15480fdee0 0x7f15480fe350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:52:57.232 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:57.229+0000 7f154fe64640 1 --2- 172.21.15.121:0/2497543816 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1548065070 0x7f1548065440 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:52:57.232 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:57.229+0000 7f154fe64640 1 -- 172.21.15.121:0/2497543816 >> 172.21.15.121:0/2497543816 conn(0x7f1548072150 msgr2=0x7f1548072550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:52:57.232 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:57.229+0000 7f154fe64640 1 -- 172.21.15.121:0/2497543816 shutdown_connections 2024-08-18T22:52:57.232 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:57.229+0000 7f154fe64640 1 -- 172.21.15.121:0/2497543816 wait complete. 2024-08-18T22:52:57.232 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:57.230+0000 7f154fe64640 1 Processor -- start 2024-08-18T22:52:57.232 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:57.230+0000 7f154fe64640 1 -- start start 2024-08-18T22:52:57.233 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:57.230+0000 7f154fe64640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1548065070 0x7f1548113000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:52:57.233 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:57.230+0000 7f154fe64640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f15480fdee0 0x7f1548113540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:52:57.233 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:57.230+0000 7f154fe64640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1548113bd0 con 0x7f1548065070 2024-08-18T22:52:57.233 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:57.230+0000 7f154fe64640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f154810cfd0 con 0x7f15480fdee0 2024-08-18T22:52:57.233 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:57.230+0000 7f154dc00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1548065070 0x7f1548113000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:52:57.233 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:57.230+0000 7f154dc00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1548065070 0x7f1548113000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:44318/0 (socket says 172.21.15.121:44318) 2024-08-18T22:52:57.233 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:57.230+0000 7f154dc00640 1 -- 172.21.15.121:0/3115597092 learned_addr learned my addr 172.21.15.121:0/3115597092 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-18T22:52:57.233 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:57.230+0000 7f154dc00640 1 -- 172.21.15.121:0/3115597092 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f15480fdee0 msgr2=0x7f1548113540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:52:57.233 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:57.230+0000 7f154d3ff640 1 --2- 172.21.15.121:0/3115597092 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f15480fdee0 0x7f1548113540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:52:57.233 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:57.230+0000 7f154dc00640 1 --2- 172.21.15.121:0/3115597092 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f15480fdee0 0x7f1548113540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:52:57.233 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:57.230+0000 7f154dc00640 1 -- 172.21.15.121:0/3115597092 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1544005040 con 0x7f1548065070 2024-08-18T22:52:57.233 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:57.231+0000 7f154dc00640 1 --2- 172.21.15.121:0/3115597092 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1548065070 0x7f1548113000 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f1544003080 tx=0x7f1544009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:52:57.234 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:57.231+0000 7f153e7fc640 1 -- 172.21.15.121:0/3115597092 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1544038070 con 0x7f1548065070 2024-08-18T22:52:57.234 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:57.231+0000 7f153e7fc640 1 -- 172.21.15.121:0/3115597092 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f15440097e0 con 0x7f1548065070 2024-08-18T22:52:57.234 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:57.231+0000 7f154fe64640 1 -- 172.21.15.121:0/3115597092 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f154810d250 con 0x7f1548065070 2024-08-18T22:52:57.234 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:57.231+0000 7f153e7fc640 1 -- 172.21.15.121:0/3115597092 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f154403d420 con 0x7f1548065070 2024-08-18T22:52:57.234 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:57.231+0000 7f154fe64640 1 -- 172.21.15.121:0/3115597092 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f154810d710 con 0x7f1548065070 2024-08-18T22:52:57.235 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:57.232+0000 7f154fe64640 1 -- 172.21.15.121:0/3115597092 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15480fda80 con 0x7f1548065070 2024-08-18T22:52:57.235 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:57.232+0000 7f153e7fc640 1 -- 172.21.15.121:0/3115597092 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 37) v1 ==== 92205+0+0 (secure 0 0 0) 0x7f1544030020 con 0x7f1548065070 2024-08-18T22:52:57.235 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:57.233+0000 7f153e7fc640 1 --2- 172.21.15.121:0/3115597092 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f153406e0b0 0x7f1534070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:52:57.235 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:57.233+0000 7f153e7fc640 1 -- 172.21.15.121:0/3115597092 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6668+0+0 (secure 0 0 0) 0x7f15440ae180 con 0x7f1548065070 2024-08-18T22:52:57.235 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:57.233+0000 7f154d3ff640 1 --2- 172.21.15.121:0/3115597092 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f153406e0b0 0x7f1534070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:52:57.235 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:57.233+0000 7f154d3ff640 1 --2- 172.21.15.121:0/3115597092 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f153406e0b0 0x7f1534070560 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f154810e8c0 tx=0x7f1538008040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:52:57.238 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:57.237+0000 7f153e7fc640 1 -- 172.21.15.121:0/3115597092 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f1544077400 con 0x7f1548065070 2024-08-18T22:52:57.445 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:57.444+0000 7f154fe64640 1 -- 172.21.15.121:0/3115597092 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 19, "format": "json"} v 0) v1 -- 0x7f1548072c60 con 0x7f1548065070 2024-08-18T22:52:57.446 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:57.445+0000 7f153e7fc640 1 -- 172.21.15.121:0/3115597092 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 19, "format": "json"}]=0 dumped fsmap epoch 19 v46) v1 ==== 107+0+4919 (secure 0 0 0) 0x7f154407aac0 con 0x7f1548065070 2024-08-18T22:52:57.446 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-08-18T22:52:57.446 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":19,"btime":"1970-01-01T00:00:00:000000+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14490,"name":"cephfs.smithi121.xuzsdg","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6827/91588128","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":91588128},{"type":"v1","addr":"172.21.15.121:6827","nonce":91588128}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":14},{"gid":24259,"name":"cephfs.smithi195.nptgyc","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.195:6827/238549847","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":238549847},{"type":"v1","addr":"172.21.15.195:6827","nonce":238549847}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-18T22:39:04.054074+0000","modified":"2024-08-18T22:42:16.794905+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":47,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":14474,"mds_1":24249},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14474":{"gid":14474,"name":"cephfs.smithi121.gbickb","rank":0,"incarnation":13,"state":"up:active","state_seq":6,"addr":"172.21.15.121:6829/2277706406","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6828","nonce":2277706406},{"type":"v1","addr":"172.21.15.121:6829","nonce":2277706406}]},"join_fscid":1,"export_targets":[1],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24249":{"gid":24249,"name":"cephfs.smithi195.buqvbr","rank":1,"incarnation":7,"state":"up:active","state_seq":4,"addr":"172.21.15.195:6825/2414511859","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":2414511859},{"type":"v1","addr":"172.21.15.195:6825","nonce":2414511859}]},"join_fscid":1,"export_targets":[0],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-08-18T22:52:57.446 INFO:teuthology.orchestra.run.smithi121.stderr:dumped fsmap epoch 19 2024-08-18T22:52:57.448 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:57.447+0000 7f154fe64640 1 -- 172.21.15.121:0/3115597092 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f153406e0b0 msgr2=0x7f1534070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:52:57.448 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:57.447+0000 7f154fe64640 1 --2- 172.21.15.121:0/3115597092 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f153406e0b0 0x7f1534070560 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f154810e8c0 tx=0x7f1538008040 comp rx=0 tx=0).stop 2024-08-18T22:52:57.448 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:57.447+0000 7f154fe64640 1 -- 172.21.15.121:0/3115597092 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1548065070 msgr2=0x7f1548113000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:52:57.448 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:57.447+0000 7f154fe64640 1 --2- 172.21.15.121:0/3115597092 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1548065070 0x7f1548113000 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f1544003080 tx=0x7f1544009da0 comp rx=0 tx=0).stop 2024-08-18T22:52:57.448 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:57.447+0000 7f154fe64640 1 -- 172.21.15.121:0/3115597092 shutdown_connections 2024-08-18T22:52:57.448 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:57.447+0000 7f154fe64640 1 --2- 172.21.15.121:0/3115597092 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f153406e0b0 0x7f1534070560 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:52:57.448 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:57.447+0000 7f154fe64640 1 --2- 172.21.15.121:0/3115597092 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f15480fdee0 0x7f1548113540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:52:57.448 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:57.447+0000 7f154fe64640 1 --2- 172.21.15.121:0/3115597092 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1548065070 0x7f1548113000 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:52:57.449 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:57.447+0000 7f154fe64640 1 -- 172.21.15.121:0/3115597092 >> 172.21.15.121:0/3115597092 conn(0x7f1548072150 msgr2=0x7f1548105160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:52:57.449 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:57.447+0000 7f154fe64640 1 -- 172.21.15.121:0/3115597092 shutdown_connections 2024-08-18T22:52:57.449 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:52:57.447+0000 7f154fe64640 1 -- 172.21.15.121:0/3115597092 wait complete. 2024-08-18T22:52:58.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:52:57 smithi121 ceph-mon[81053]: from='client.? 172.21.15.121:0/3115597092' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 19, "format": "json"}]: dispatch 2024-08-18T22:52:58.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:52:57 smithi195 ceph-mon[68841]: from='client.? 172.21.15.121:0/3115597092' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 19, "format": "json"}]: dispatch 2024-08-18T22:52:58.165 DEBUG:teuthology.orchestra.run.smithi121:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid b003123a-5db1-11ef-bccf-c7b262605968 -- ceph fs dump --format=json 20 2024-08-18T22:52:58.413 INFO:teuthology.orchestra.run.smithi121.stderr:Inferring config /var/lib/ceph/b003123a-5db1-11ef-bccf-c7b262605968/mon.smithi121/config 2024-08-18T22:52:59.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:52:58 smithi121 ceph-mon[81053]: pgmap v317: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:52:59.158 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:52:58 smithi195 ceph-mon[68841]: pgmap v317: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:53:00.038 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:00.035+0000 7f1214deb640 1 -- 172.21.15.121:0/1108480497 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f12100fdef0 msgr2=0x7f12100fe320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:53:00.039 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:00.035+0000 7f1214deb640 1 --2- 172.21.15.121:0/1108480497 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f12100fdef0 0x7f12100fe320 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f11f80048d0 tx=0x7f11f8009da0 comp rx=0 tx=0).stop 2024-08-18T22:53:00.039 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:00.036+0000 7f1214deb640 1 -- 172.21.15.121:0/1108480497 shutdown_connections 2024-08-18T22:53:00.039 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:00.036+0000 7f1214deb640 1 --2- 172.21.15.121:0/1108480497 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f12100fdef0 0x7f12100fe320 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:53:00.039 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:00.036+0000 7f1214deb640 1 --2- 172.21.15.121:0/1108480497 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f12100650e0 0x7f12100654b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:53:00.039 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:00.036+0000 7f1214deb640 1 -- 172.21.15.121:0/1108480497 >> 172.21.15.121:0/1108480497 conn(0x7f1210072150 msgr2=0x7f1210072550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:53:00.039 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:00.036+0000 7f1214deb640 1 -- 172.21.15.121:0/1108480497 shutdown_connections 2024-08-18T22:53:00.039 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:00.036+0000 7f1214deb640 1 -- 172.21.15.121:0/1108480497 wait complete. 2024-08-18T22:53:00.039 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:00.036+0000 7f1214deb640 1 Processor -- start 2024-08-18T22:53:00.039 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:00.036+0000 7f1214deb640 1 -- start start 2024-08-18T22:53:00.040 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:00.036+0000 7f1214deb640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f12100650e0 0x7f1210113000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:53:00.040 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:00.036+0000 7f1214deb640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f12100fdef0 0x7f1210113540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:53:00.040 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:00.036+0000 7f1214deb640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1210113b40 con 0x7f12100650e0 2024-08-18T22:53:00.040 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:00.036+0000 7f1214deb640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f121010cf80 con 0x7f12100fdef0 2024-08-18T22:53:00.040 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:00.036+0000 7f120e59c640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f12100650e0 0x7f1210113000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:53:00.040 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:00.036+0000 7f120e59c640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f12100650e0 0x7f1210113000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:44340/0 (socket says 172.21.15.121:44340) 2024-08-18T22:53:00.040 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:00.036+0000 7f120e59c640 1 -- 172.21.15.121:0/3278224727 learned_addr learned my addr 172.21.15.121:0/3278224727 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-18T22:53:00.040 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:00.037+0000 7f120dd9b640 1 --2- 172.21.15.121:0/3278224727 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f12100fdef0 0x7f1210113540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:53:00.040 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:00.037+0000 7f120e59c640 1 -- 172.21.15.121:0/3278224727 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f12100fdef0 msgr2=0x7f1210113540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:53:00.040 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:00.037+0000 7f120e59c640 1 --2- 172.21.15.121:0/3278224727 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f12100fdef0 0x7f1210113540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:53:00.040 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:00.037+0000 7f120e59c640 1 -- 172.21.15.121:0/3278224727 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11f8005040 con 0x7f12100650e0 2024-08-18T22:53:00.041 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:00.037+0000 7f120e59c640 1 --2- 172.21.15.121:0/3278224727 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f12100650e0 0x7f1210113000 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f120800db00 tx=0x7f1208004e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:53:00.041 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:00.037+0000 7f1206ffd640 1 -- 172.21.15.121:0/3278224727 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1208017070 con 0x7f12100650e0 2024-08-18T22:53:00.041 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:00.037+0000 7f1206ffd640 1 -- 172.21.15.121:0/3278224727 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f120800f040 con 0x7f12100650e0 2024-08-18T22:53:00.041 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:00.037+0000 7f1206ffd640 1 -- 172.21.15.121:0/3278224727 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1208003940 con 0x7f12100650e0 2024-08-18T22:53:00.041 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:00.037+0000 7f1214deb640 1 -- 172.21.15.121:0/3278224727 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f121010d260 con 0x7f12100650e0 2024-08-18T22:53:00.041 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:00.037+0000 7f1214deb640 1 -- 172.21.15.121:0/3278224727 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f121010d750 con 0x7f12100650e0 2024-08-18T22:53:00.042 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:00.038+0000 7f1214deb640 1 -- 172.21.15.121:0/3278224727 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12100fda90 con 0x7f12100650e0 2024-08-18T22:53:00.042 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:00.039+0000 7f1206ffd640 1 -- 172.21.15.121:0/3278224727 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 37) v1 ==== 92205+0+0 (secure 0 0 0) 0x7f1208003aa0 con 0x7f12100650e0 2024-08-18T22:53:00.042 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:00.039+0000 7f1206ffd640 1 --2- 172.21.15.121:0/3278224727 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f11fc06e0b0 0x7f11fc070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:53:00.042 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:00.039+0000 7f1206ffd640 1 -- 172.21.15.121:0/3278224727 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6668+0+0 (secure 0 0 0) 0x7f120808dca0 con 0x7f12100650e0 2024-08-18T22:53:00.042 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:00.039+0000 7f120dd9b640 1 --2- 172.21.15.121:0/3278224727 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f11fc06e0b0 0x7f11fc070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:53:00.042 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:00.040+0000 7f120dd9b640 1 --2- 172.21.15.121:0/3278224727 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f11fc06e0b0 0x7f11fc070560 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f12100f90c0 tx=0x7f11f8035040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:53:00.044 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:00.044+0000 7f1206ffd640 1 -- 172.21.15.121:0/3278224727 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f1208092070 con 0x7f12100650e0 2024-08-18T22:53:00.254 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:00.253+0000 7f1214deb640 1 -- 172.21.15.121:0/3278224727 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 20, "format": "json"} v 0) v1 -- 0x7f121004b4c0 con 0x7f12100650e0 2024-08-18T22:53:00.254 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:53:00 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-18T22:53:00.255 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:00.254+0000 7f1206ffd640 1 -- 172.21.15.121:0/3278224727 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 20, "format": "json"}]=0 dumped fsmap epoch 20 v46) v1 ==== 107+0+4935 (secure 0 0 0) 0x7f120805aad0 con 0x7f12100650e0 2024-08-18T22:53:00.255 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-08-18T22:53:00.255 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":20,"btime":"2024-08-18T22:44:31:584746+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14490,"name":"cephfs.smithi121.xuzsdg","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6827/91588128","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":91588128},{"type":"v1","addr":"172.21.15.121:6827","nonce":91588128}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":14},{"gid":24259,"name":"cephfs.smithi195.nptgyc","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.195:6827/238549847","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":238549847},{"type":"v1","addr":"172.21.15.195:6827","nonce":238549847}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15}],"filesystems":[{"mdsmap":{"epoch":20,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-18T22:39:04.054074+0000","modified":"2024-08-18T22:44:31.584739+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":47,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":14474,"mds_1":24249},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14474":{"gid":14474,"name":"cephfs.smithi121.gbickb","rank":0,"incarnation":13,"state":"up:active","state_seq":83,"addr":"172.21.15.121:6829/2277706406","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6828","nonce":2277706406},{"type":"v1","addr":"172.21.15.121:6829","nonce":2277706406}]},"join_fscid":1,"export_targets":[1],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24249":{"gid":24249,"name":"cephfs.smithi195.buqvbr","rank":1,"incarnation":7,"state":"up:active","state_seq":4,"addr":"172.21.15.195:6825/2414511859","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":2414511859},{"type":"v1","addr":"172.21.15.195:6825","nonce":2414511859}]},"join_fscid":1,"export_targets":[0],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":14474,"qdb_cluster":[14474,24249]},"id":1}]} 2024-08-18T22:53:00.255 INFO:teuthology.orchestra.run.smithi121.stderr:dumped fsmap epoch 20 2024-08-18T22:53:00.258 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:00.257+0000 7f1214deb640 1 -- 172.21.15.121:0/3278224727 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f11fc06e0b0 msgr2=0x7f11fc070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:53:00.258 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:00.257+0000 7f1214deb640 1 --2- 172.21.15.121:0/3278224727 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f11fc06e0b0 0x7f11fc070560 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f12100f90c0 tx=0x7f11f8035040 comp rx=0 tx=0).stop 2024-08-18T22:53:00.258 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:00.257+0000 7f1214deb640 1 -- 172.21.15.121:0/3278224727 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f12100650e0 msgr2=0x7f1210113000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:53:00.258 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:00.257+0000 7f1214deb640 1 --2- 172.21.15.121:0/3278224727 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f12100650e0 0x7f1210113000 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f120800db00 tx=0x7f1208004e60 comp rx=0 tx=0).stop 2024-08-18T22:53:00.258 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:00.257+0000 7f1214deb640 1 -- 172.21.15.121:0/3278224727 shutdown_connections 2024-08-18T22:53:00.258 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:00.257+0000 7f1214deb640 1 --2- 172.21.15.121:0/3278224727 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f11fc06e0b0 0x7f11fc070560 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:53:00.258 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:00.257+0000 7f1214deb640 1 --2- 172.21.15.121:0/3278224727 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f12100fdef0 0x7f1210113540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:53:00.258 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:00.257+0000 7f1214deb640 1 --2- 172.21.15.121:0/3278224727 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f12100650e0 0x7f1210113000 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:53:00.259 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:00.257+0000 7f1214deb640 1 -- 172.21.15.121:0/3278224727 >> 172.21.15.121:0/3278224727 conn(0x7f1210072150 msgr2=0x7f1210101010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:53:00.259 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:00.257+0000 7f1214deb640 1 -- 172.21.15.121:0/3278224727 shutdown_connections 2024-08-18T22:53:00.259 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:00.257+0000 7f1214deb640 1 -- 172.21.15.121:0/3278224727 wait complete. 2024-08-18T22:53:00.408 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:53:00 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-18T22:53:00.920 DEBUG:teuthology.orchestra.run.smithi121:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid b003123a-5db1-11ef-bccf-c7b262605968 -- ceph fs dump --format=json 21 2024-08-18T22:53:01.167 INFO:teuthology.orchestra.run.smithi121.stderr:Inferring config /var/lib/ceph/b003123a-5db1-11ef-bccf-c7b262605968/mon.smithi121/config 2024-08-18T22:53:01.289 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:53:01 smithi121 ceph-mon[81053]: from='client.? 172.21.15.121:0/3278224727' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 20, "format": "json"}]: dispatch 2024-08-18T22:53:01.289 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:53:01 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:53:01.289 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:53:01 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-18T22:53:01.289 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:53:01 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:53:01.289 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:53:01 smithi121 ceph-mon[81053]: pgmap v318: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:53:01.409 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:53:01 smithi195 ceph-mon[68841]: from='client.? 172.21.15.121:0/3278224727' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 20, "format": "json"}]: dispatch 2024-08-18T22:53:01.409 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:53:01 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:53:01.409 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:53:01 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-18T22:53:01.409 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:53:01 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:53:01.409 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:53:01 smithi195 ceph-mon[68841]: pgmap v318: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:53:02.785 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:02.783+0000 7fe2571d6640 1 -- 172.21.15.121:0/4050679484 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe250102300 msgr2=0x7fe2501026d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:53:02.785 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:02.783+0000 7fe2571d6640 1 --2- 172.21.15.121:0/4050679484 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe250102300 0x7fe2501026d0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fe2400048d0 tx=0x7fe240009da0 comp rx=0 tx=0).stop 2024-08-18T22:53:02.785 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:02.783+0000 7fe2571d6640 1 -- 172.21.15.121:0/4050679484 shutdown_connections 2024-08-18T22:53:02.785 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:02.783+0000 7fe2571d6640 1 --2- 172.21.15.121:0/4050679484 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe250102ca0 0x7fe2500fc330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:53:02.785 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:02.783+0000 7fe2571d6640 1 --2- 172.21.15.121:0/4050679484 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe250102300 0x7fe2501026d0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:53:02.785 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:02.783+0000 7fe2571d6640 1 -- 172.21.15.121:0/4050679484 >> 172.21.15.121:0/4050679484 conn(0x7fe2500f7e90 msgr2=0x7fe2500fa2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:53:02.785 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:02.783+0000 7fe2571d6640 1 -- 172.21.15.121:0/4050679484 shutdown_connections 2024-08-18T22:53:02.785 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:02.783+0000 7fe2571d6640 1 -- 172.21.15.121:0/4050679484 wait complete. 2024-08-18T22:53:02.785 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:02.784+0000 7fe2571d6640 1 Processor -- start 2024-08-18T22:53:02.786 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:02.784+0000 7fe2571d6640 1 -- start start 2024-08-18T22:53:02.787 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:02.784+0000 7fe2571d6640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe250102300 0x7fe250113270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:53:02.787 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:02.784+0000 7fe2571d6640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe250102ca0 0x7fe2501137b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:53:02.787 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:02.784+0000 7fe2571d6640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe250113db0 con 0x7fe250102300 2024-08-18T22:53:02.787 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:02.784+0000 7fe2571d6640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe25010d1f0 con 0x7fe250102ca0 2024-08-18T22:53:02.788 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:02.784+0000 7fe254f72640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe250102300 0x7fe250113270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:53:02.788 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:02.784+0000 7fe254f72640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe250102300 0x7fe250113270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:44348/0 (socket says 172.21.15.121:44348) 2024-08-18T22:53:02.788 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:02.784+0000 7fe254f72640 1 -- 172.21.15.121:0/2850556233 learned_addr learned my addr 172.21.15.121:0/2850556233 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-18T22:53:02.788 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:02.785+0000 7fe24ffff640 1 --2- 172.21.15.121:0/2850556233 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe250102ca0 0x7fe2501137b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:53:02.788 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:02.785+0000 7fe254f72640 1 -- 172.21.15.121:0/2850556233 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe250102ca0 msgr2=0x7fe2501137b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:53:02.788 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:02.785+0000 7fe254f72640 1 --2- 172.21.15.121:0/2850556233 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe250102ca0 0x7fe2501137b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:53:02.788 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:02.785+0000 7fe254f72640 1 -- 172.21.15.121:0/2850556233 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe240005040 con 0x7fe250102300 2024-08-18T22:53:02.788 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:02.785+0000 7fe24ffff640 1 --2- 172.21.15.121:0/2850556233 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe250102ca0 0x7fe2501137b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:53:02.788 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:02.785+0000 7fe254f72640 1 --2- 172.21.15.121:0/2850556233 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe250102300 0x7fe250113270 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fe2400043d0 tx=0x7fe240009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:53:02.788 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:02.785+0000 7fe24d7fa640 1 -- 172.21.15.121:0/2850556233 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe240038070 con 0x7fe250102300 2024-08-18T22:53:02.788 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:02.785+0000 7fe24d7fa640 1 -- 172.21.15.121:0/2850556233 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fe2400096e0 con 0x7fe250102300 2024-08-18T22:53:02.788 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:02.785+0000 7fe24d7fa640 1 -- 172.21.15.121:0/2850556233 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe24003d420 con 0x7fe250102300 2024-08-18T22:53:02.788 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:02.785+0000 7fe2571d6640 1 -- 172.21.15.121:0/2850556233 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe25010d470 con 0x7fe250102300 2024-08-18T22:53:02.789 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:02.785+0000 7fe2571d6640 1 -- 172.21.15.121:0/2850556233 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe25010da10 con 0x7fe250102300 2024-08-18T22:53:02.789 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:02.786+0000 7fe2571d6640 1 -- 172.21.15.121:0/2850556233 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2500fda70 con 0x7fe250102300 2024-08-18T22:53:02.789 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:02.787+0000 7fe24d7fa640 1 -- 172.21.15.121:0/2850556233 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 37) v1 ==== 92205+0+0 (secure 0 0 0) 0x7fe240030020 con 0x7fe250102300 2024-08-18T22:53:02.789 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:02.787+0000 7fe24d7fa640 1 --2- 172.21.15.121:0/2850556233 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7fe23c06e0b0 0x7fe23c070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:53:02.790 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:02.787+0000 7fe24d7fa640 1 -- 172.21.15.121:0/2850556233 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6668+0+0 (secure 0 0 0) 0x7fe2400ae0c0 con 0x7fe250102300 2024-08-18T22:53:02.790 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:02.787+0000 7fe24ffff640 1 --2- 172.21.15.121:0/2850556233 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7fe23c06e0b0 0x7fe23c070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:53:02.790 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:02.788+0000 7fe24ffff640 1 --2- 172.21.15.121:0/2850556233 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7fe23c06e0b0 0x7fe23c070560 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fe25010eb30 tx=0x7fe238004d00 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:53:02.792 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:02.792+0000 7fe24d7fa640 1 -- 172.21.15.121:0/2850556233 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7fe2400773c0 con 0x7fe250102300 2024-08-18T22:53:02.997 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:02.996+0000 7fe2571d6640 1 -- 172.21.15.121:0/2850556233 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 21, "format": "json"} v 0) v1 -- 0x7fe25004b4c0 con 0x7fe250102300 2024-08-18T22:53:02.997 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:02.996+0000 7fe24d7fa640 1 -- 172.21.15.121:0/2850556233 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 21, "format": "json"}]=0 dumped fsmap epoch 21 v46) v1 ==== 107+0+4934 (secure 0 0 0) 0x7fe24007aa80 con 0x7fe250102300 2024-08-18T22:53:02.998 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-08-18T22:53:02.998 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":21,"btime":"2024-08-18T22:45:20:594604+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14490,"name":"cephfs.smithi121.xuzsdg","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6827/91588128","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":91588128},{"type":"v1","addr":"172.21.15.121:6827","nonce":91588128}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":14},{"gid":24259,"name":"cephfs.smithi195.nptgyc","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.195:6827/238549847","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":238549847},{"type":"v1","addr":"172.21.15.195:6827","nonce":238549847}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15}],"filesystems":[{"mdsmap":{"epoch":21,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-18T22:39:04.054074+0000","modified":"2024-08-18T22:45:20.287451+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":47,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":14474,"mds_1":24249},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14474":{"gid":14474,"name":"cephfs.smithi121.gbickb","rank":0,"incarnation":13,"state":"up:active","state_seq":83,"addr":"172.21.15.121:6829/2277706406","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6828","nonce":2277706406},{"type":"v1","addr":"172.21.15.121:6829","nonce":2277706406}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24249":{"gid":24249,"name":"cephfs.smithi195.buqvbr","rank":1,"incarnation":7,"state":"up:active","state_seq":4,"addr":"172.21.15.195:6825/2414511859","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":2414511859},{"type":"v1","addr":"172.21.15.195:6825","nonce":2414511859}]},"join_fscid":1,"export_targets":[0],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":14474,"qdb_cluster":[24249,14474]},"id":1}]} 2024-08-18T22:53:02.998 INFO:teuthology.orchestra.run.smithi121.stderr:dumped fsmap epoch 21 2024-08-18T22:53:03.001 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:02.999+0000 7fe2571d6640 1 -- 172.21.15.121:0/2850556233 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7fe23c06e0b0 msgr2=0x7fe23c070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:53:03.001 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:02.999+0000 7fe2571d6640 1 --2- 172.21.15.121:0/2850556233 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7fe23c06e0b0 0x7fe23c070560 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fe25010eb30 tx=0x7fe238004d00 comp rx=0 tx=0).stop 2024-08-18T22:53:03.001 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:02.999+0000 7fe2571d6640 1 -- 172.21.15.121:0/2850556233 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe250102300 msgr2=0x7fe250113270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:53:03.001 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:02.999+0000 7fe2571d6640 1 --2- 172.21.15.121:0/2850556233 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe250102300 0x7fe250113270 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fe2400043d0 tx=0x7fe240009da0 comp rx=0 tx=0).stop 2024-08-18T22:53:03.001 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:03.000+0000 7fe2571d6640 1 -- 172.21.15.121:0/2850556233 shutdown_connections 2024-08-18T22:53:03.001 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:03.000+0000 7fe2571d6640 1 --2- 172.21.15.121:0/2850556233 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7fe23c06e0b0 0x7fe23c070560 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:53:03.001 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:03.000+0000 7fe2571d6640 1 --2- 172.21.15.121:0/2850556233 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe250102ca0 0x7fe2501137b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:53:03.001 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:03.000+0000 7fe2571d6640 1 --2- 172.21.15.121:0/2850556233 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe250102300 0x7fe250113270 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:53:03.001 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:03.000+0000 7fe2571d6640 1 -- 172.21.15.121:0/2850556233 >> 172.21.15.121:0/2850556233 conn(0x7fe2500f7e90 msgr2=0x7fe2500f8f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:53:03.001 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:03.000+0000 7fe2571d6640 1 -- 172.21.15.121:0/2850556233 shutdown_connections 2024-08-18T22:53:03.001 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:03.000+0000 7fe2571d6640 1 -- 172.21.15.121:0/2850556233 wait complete. 2024-08-18T22:53:03.752 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:53:03 smithi121 ceph-mon[81053]: pgmap v319: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:53:03.752 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:53:03 smithi121 ceph-mon[81053]: from='client.? 172.21.15.121:0/2850556233' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 21, "format": "json"}]: dispatch 2024-08-18T22:53:03.780 DEBUG:teuthology.orchestra.run.smithi121:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid b003123a-5db1-11ef-bccf-c7b262605968 -- ceph fs dump --format=json 22 2024-08-18T22:53:04.034 INFO:teuthology.orchestra.run.smithi121.stderr:Inferring config /var/lib/ceph/b003123a-5db1-11ef-bccf-c7b262605968/mon.smithi121/config 2024-08-18T22:53:04.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:53:03 smithi195 ceph-mon[68841]: pgmap v319: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:53:04.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:53:03 smithi195 ceph-mon[68841]: from='client.? 172.21.15.121:0/2850556233' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 21, "format": "json"}]: dispatch 2024-08-18T22:53:05.692 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:05.689+0000 7f7b6cdcb640 1 -- 172.21.15.121:0/578253319 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7b680650e0 msgr2=0x7f7b680654b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:53:05.693 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:05.689+0000 7f7b6cdcb640 1 --2- 172.21.15.121:0/578253319 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7b680650e0 0x7f7b680654b0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f7b580048d0 tx=0x7f7b58009da0 comp rx=0 tx=0).stop 2024-08-18T22:53:05.693 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:05.689+0000 7f7b6cdcb640 1 -- 172.21.15.121:0/578253319 shutdown_connections 2024-08-18T22:53:05.693 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:05.689+0000 7f7b6cdcb640 1 --2- 172.21.15.121:0/578253319 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7b680fdef0 0x7f7b680fe320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:53:05.693 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:05.689+0000 7f7b6cdcb640 1 --2- 172.21.15.121:0/578253319 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7b680650e0 0x7f7b680654b0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:53:05.693 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:05.689+0000 7f7b6cdcb640 1 -- 172.21.15.121:0/578253319 >> 172.21.15.121:0/578253319 conn(0x7f7b68072150 msgr2=0x7f7b68072550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:53:05.693 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:05.690+0000 7f7b6cdcb640 1 -- 172.21.15.121:0/578253319 shutdown_connections 2024-08-18T22:53:05.693 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:05.690+0000 7f7b6cdcb640 1 -- 172.21.15.121:0/578253319 wait complete. 2024-08-18T22:53:05.693 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:05.690+0000 7f7b6cdcb640 1 Processor -- start 2024-08-18T22:53:05.693 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:05.690+0000 7f7b6cdcb640 1 -- start start 2024-08-18T22:53:05.693 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:05.690+0000 7f7b6cdcb640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7b680650e0 0x7f7b68112f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:53:05.693 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:05.690+0000 7f7b6cdcb640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7b680fdef0 0x7f7b68113470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:53:05.693 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:05.690+0000 7f7b6cdcb640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b68113a70 con 0x7f7b680fdef0 2024-08-18T22:53:05.693 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:05.690+0000 7f7b6cdcb640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b68113be0 con 0x7f7b680650e0 2024-08-18T22:53:05.694 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:05.690+0000 7f7b5ffff640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7b680fdef0 0x7f7b68113470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:53:05.694 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:05.691+0000 7f7b5ffff640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7b680fdef0 0x7f7b68113470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:44366/0 (socket says 172.21.15.121:44366) 2024-08-18T22:53:05.694 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:05.691+0000 7f7b5ffff640 1 -- 172.21.15.121:0/218364266 learned_addr learned my addr 172.21.15.121:0/218364266 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-18T22:53:05.694 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:05.691+0000 7f7b6659c640 1 --2- 172.21.15.121:0/218364266 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7b680650e0 0x7f7b68112f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:53:05.694 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:05.691+0000 7f7b5ffff640 1 -- 172.21.15.121:0/218364266 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7b680650e0 msgr2=0x7f7b68112f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:53:05.694 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:05.691+0000 7f7b5ffff640 1 --2- 172.21.15.121:0/218364266 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7b680650e0 0x7f7b68112f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:53:05.694 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:05.691+0000 7f7b5ffff640 1 -- 172.21.15.121:0/218364266 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b58005040 con 0x7f7b680fdef0 2024-08-18T22:53:05.694 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:05.691+0000 7f7b6659c640 1 --2- 172.21.15.121:0/218364266 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7b680650e0 0x7f7b68112f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:53:05.694 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:05.691+0000 7f7b5ffff640 1 --2- 172.21.15.121:0/218364266 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7b680fdef0 0x7f7b68113470 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f7b5000c790 tx=0x7f7b500043c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:53:05.694 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:05.691+0000 7f7b5effd640 1 -- 172.21.15.121:0/218364266 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7b5000a820 con 0x7f7b680fdef0 2024-08-18T22:53:05.694 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:05.691+0000 7f7b6cdcb640 1 -- 172.21.15.121:0/218364266 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b6810d060 con 0x7f7b680fdef0 2024-08-18T22:53:05.694 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:05.691+0000 7f7b5effd640 1 -- 172.21.15.121:0/218364266 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f7b5000ae20 con 0x7f7b680fdef0 2024-08-18T22:53:05.694 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:05.691+0000 7f7b5effd640 1 -- 172.21.15.121:0/218364266 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7b500113a0 con 0x7f7b680fdef0 2024-08-18T22:53:05.695 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:05.691+0000 7f7b6cdcb640 1 -- 172.21.15.121:0/218364266 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b6810d600 con 0x7f7b680fdef0 2024-08-18T22:53:05.695 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:05.692+0000 7f7b6cdcb640 1 -- 172.21.15.121:0/218364266 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b680fda90 con 0x7f7b680fdef0 2024-08-18T22:53:05.695 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:05.693+0000 7f7b5effd640 1 -- 172.21.15.121:0/218364266 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 37) v1 ==== 92205+0+0 (secure 0 0 0) 0x7f7b50012400 con 0x7f7b680fdef0 2024-08-18T22:53:05.696 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:05.693+0000 7f7b5effd640 1 --2- 172.21.15.121:0/218364266 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f7b5406e0b0 0x7f7b54070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:53:05.696 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:05.693+0000 7f7b5effd640 1 -- 172.21.15.121:0/218364266 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6668+0+0 (secure 0 0 0) 0x7f7b5008de00 con 0x7f7b680fdef0 2024-08-18T22:53:05.696 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:05.693+0000 7f7b6659c640 1 --2- 172.21.15.121:0/218364266 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f7b5406e0b0 0x7f7b54070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:53:05.696 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:05.694+0000 7f7b6659c640 1 --2- 172.21.15.121:0/218364266 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f7b5406e0b0 0x7f7b54070560 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f7b58007ac0 tx=0x7f7b58035040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:53:05.698 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:05.698+0000 7f7b5effd640 1 -- 172.21.15.121:0/218364266 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f7b50057100 con 0x7f7b680fdef0 2024-08-18T22:53:05.900 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:05.900+0000 7f7b6cdcb640 1 -- 172.21.15.121:0/218364266 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 22, "format": "json"} v 0) v1 -- 0x7f7b6804b4c0 con 0x7f7b680fdef0 2024-08-18T22:53:05.901 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:05.900+0000 7f7b5effd640 1 -- 172.21.15.121:0/218364266 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 22, "format": "json"}]=0 dumped fsmap epoch 22 v46) v1 ==== 107+0+4933 (secure 0 0 0) 0x7f7b5005a7c0 con 0x7f7b680fdef0 2024-08-18T22:53:05.901 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-08-18T22:53:05.901 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":22,"btime":"2024-08-18T22:45:32:233419+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14490,"name":"cephfs.smithi121.xuzsdg","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6827/91588128","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":91588128},{"type":"v1","addr":"172.21.15.121:6827","nonce":91588128}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":14},{"gid":24259,"name":"cephfs.smithi195.nptgyc","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.195:6827/238549847","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":238549847},{"type":"v1","addr":"172.21.15.195:6827","nonce":238549847}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15}],"filesystems":[{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-18T22:39:04.054074+0000","modified":"2024-08-18T22:45:31.247467+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":47,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":14474,"mds_1":24249},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14474":{"gid":14474,"name":"cephfs.smithi121.gbickb","rank":0,"incarnation":13,"state":"up:active","state_seq":83,"addr":"172.21.15.121:6829/2277706406","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6828","nonce":2277706406},{"type":"v1","addr":"172.21.15.121:6829","nonce":2277706406}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24249":{"gid":24249,"name":"cephfs.smithi195.buqvbr","rank":1,"incarnation":7,"state":"up:active","state_seq":4,"addr":"172.21.15.195:6825/2414511859","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":2414511859},{"type":"v1","addr":"172.21.15.195:6825","nonce":2414511859}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":14474,"qdb_cluster":[14474,24249]},"id":1}]} 2024-08-18T22:53:05.902 INFO:teuthology.orchestra.run.smithi121.stderr:dumped fsmap epoch 22 2024-08-18T22:53:05.903 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:05.902+0000 7f7b6cdcb640 1 -- 172.21.15.121:0/218364266 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f7b5406e0b0 msgr2=0x7f7b54070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:53:05.903 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:05.902+0000 7f7b6cdcb640 1 --2- 172.21.15.121:0/218364266 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f7b5406e0b0 0x7f7b54070560 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f7b58007ac0 tx=0x7f7b58035040 comp rx=0 tx=0).stop 2024-08-18T22:53:05.903 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:05.902+0000 7f7b6cdcb640 1 -- 172.21.15.121:0/218364266 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7b680fdef0 msgr2=0x7f7b68113470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:53:05.904 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:05.902+0000 7f7b6cdcb640 1 --2- 172.21.15.121:0/218364266 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7b680fdef0 0x7f7b68113470 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f7b5000c790 tx=0x7f7b500043c0 comp rx=0 tx=0).stop 2024-08-18T22:53:05.904 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:05.902+0000 7f7b6cdcb640 1 -- 172.21.15.121:0/218364266 shutdown_connections 2024-08-18T22:53:05.904 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:05.902+0000 7f7b6cdcb640 1 --2- 172.21.15.121:0/218364266 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f7b5406e0b0 0x7f7b54070560 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:53:05.904 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:05.902+0000 7f7b6cdcb640 1 --2- 172.21.15.121:0/218364266 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7b680fdef0 0x7f7b68113470 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:53:05.904 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:05.902+0000 7f7b6cdcb640 1 --2- 172.21.15.121:0/218364266 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7b680650e0 0x7f7b68112f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:53:05.904 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:05.902+0000 7f7b6cdcb640 1 -- 172.21.15.121:0/218364266 >> 172.21.15.121:0/218364266 conn(0x7f7b68072150 msgr2=0x7f7b68101010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:53:05.904 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:05.903+0000 7f7b6cdcb640 1 -- 172.21.15.121:0/218364266 shutdown_connections 2024-08-18T22:53:05.904 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:05.903+0000 7f7b6cdcb640 1 -- 172.21.15.121:0/218364266 wait complete. 2024-08-18T22:53:06.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:53:05 smithi121 ceph-mon[81053]: pgmap v320: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:53:06.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:53:05 smithi195 ceph-mon[68841]: pgmap v320: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:53:06.534 DEBUG:teuthology.orchestra.run.smithi121:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid b003123a-5db1-11ef-bccf-c7b262605968 -- ceph fs dump --format=json 23 2024-08-18T22:53:06.785 INFO:teuthology.orchestra.run.smithi121.stderr:Inferring config /var/lib/ceph/b003123a-5db1-11ef-bccf-c7b262605968/mon.smithi121/config 2024-08-18T22:53:06.833 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:53:06 smithi121 ceph-mon[81053]: from='client.? 172.21.15.121:0/218364266' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 22, "format": "json"}]: dispatch 2024-08-18T22:53:07.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:53:06 smithi195 ceph-mon[68841]: from='client.? 172.21.15.121:0/218364266' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 22, "format": "json"}]: dispatch 2024-08-18T22:53:07.848 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:53:07 smithi121 ceph-mon[81053]: pgmap v321: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:53:08.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:53:07 smithi195 ceph-mon[68841]: pgmap v321: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:53:08.329 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:08.328+0000 7f1dda7f0640 1 -- 172.21.15.121:0/117789766 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1dd4102ca0 msgr2=0x7f1dd40fc330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:53:08.329 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:08.328+0000 7f1dda7f0640 1 --2- 172.21.15.121:0/117789766 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1dd4102ca0 0x7f1dd40fc330 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f1dc80048d0 tx=0x7f1dc8009da0 comp rx=0 tx=0).stop 2024-08-18T22:53:08.330 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:08.328+0000 7f1dda7f0640 1 -- 172.21.15.121:0/117789766 shutdown_connections 2024-08-18T22:53:08.330 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:08.328+0000 7f1dda7f0640 1 --2- 172.21.15.121:0/117789766 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1dd4102ca0 0x7f1dd40fc330 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:53:08.330 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:08.328+0000 7f1dda7f0640 1 --2- 172.21.15.121:0/117789766 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1dd4102300 0x7f1dd41026d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:53:08.330 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:08.328+0000 7f1dda7f0640 1 -- 172.21.15.121:0/117789766 >> 172.21.15.121:0/117789766 conn(0x7f1dd40f7e90 msgr2=0x7f1dd40fa2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:53:08.330 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:08.328+0000 7f1dda7f0640 1 -- 172.21.15.121:0/117789766 shutdown_connections 2024-08-18T22:53:08.330 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:08.328+0000 7f1dda7f0640 1 -- 172.21.15.121:0/117789766 wait complete. 2024-08-18T22:53:08.330 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:08.329+0000 7f1dda7f0640 1 Processor -- start 2024-08-18T22:53:08.330 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:08.329+0000 7f1dda7f0640 1 -- start start 2024-08-18T22:53:08.331 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:08.329+0000 7f1dda7f0640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1dd4102300 0x7f1dd41132a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:53:08.331 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:08.329+0000 7f1dda7f0640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1dd4102ca0 0x7f1dd41137e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:53:08.332 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:08.329+0000 7f1dda7f0640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1dd4113de0 con 0x7f1dd4102300 2024-08-18T22:53:08.332 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:08.329+0000 7f1dda7f0640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1dd410d220 con 0x7f1dd4102ca0 2024-08-18T22:53:08.332 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:08.329+0000 7f1dd3fff640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1dd4102300 0x7f1dd41132a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:53:08.332 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:08.329+0000 7f1dd3fff640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1dd4102300 0x7f1dd41132a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:56654/0 (socket says 172.21.15.121:56654) 2024-08-18T22:53:08.332 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:08.329+0000 7f1dd3fff640 1 -- 172.21.15.121:0/3341646988 learned_addr learned my addr 172.21.15.121:0/3341646988 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-18T22:53:08.332 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:08.329+0000 7f1dd37fe640 1 --2- 172.21.15.121:0/3341646988 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1dd4102ca0 0x7f1dd41137e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:53:08.332 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:08.329+0000 7f1dd3fff640 1 -- 172.21.15.121:0/3341646988 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1dd4102ca0 msgr2=0x7f1dd41137e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:53:08.332 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:08.329+0000 7f1dd3fff640 1 --2- 172.21.15.121:0/3341646988 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1dd4102ca0 0x7f1dd41137e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:53:08.332 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:08.329+0000 7f1dd3fff640 1 -- 172.21.15.121:0/3341646988 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1dc8005040 con 0x7f1dd4102300 2024-08-18T22:53:08.332 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:08.330+0000 7f1dd3fff640 1 --2- 172.21.15.121:0/3341646988 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1dd4102300 0x7f1dd41132a0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f1dc400c830 tx=0x7f1dc4004430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:53:08.332 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:08.330+0000 7f1dd0ff9640 1 -- 172.21.15.121:0/3341646988 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1dc400a7d0 con 0x7f1dd4102300 2024-08-18T22:53:08.332 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:08.330+0000 7f1dda7f0640 1 -- 172.21.15.121:0/3341646988 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1dd410d500 con 0x7f1dd4102300 2024-08-18T22:53:08.332 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:08.330+0000 7f1dd0ff9640 1 -- 172.21.15.121:0/3341646988 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f1dc400add0 con 0x7f1dd4102300 2024-08-18T22:53:08.332 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:08.330+0000 7f1dd0ff9640 1 -- 172.21.15.121:0/3341646988 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1dc40113a0 con 0x7f1dd4102300 2024-08-18T22:53:08.333 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:08.330+0000 7f1dda7f0640 1 -- 172.21.15.121:0/3341646988 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1dd410daa0 con 0x7f1dd4102300 2024-08-18T22:53:08.333 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:08.331+0000 7f1dda7f0640 1 -- 172.21.15.121:0/3341646988 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1dd40fda70 con 0x7f1dd4102300 2024-08-18T22:53:08.333 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:08.331+0000 7f1dd0ff9640 1 -- 172.21.15.121:0/3341646988 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 37) v1 ==== 92205+0+0 (secure 0 0 0) 0x7f1dc4012400 con 0x7f1dd4102300 2024-08-18T22:53:08.333 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:08.332+0000 7f1dd0ff9640 1 --2- 172.21.15.121:0/3341646988 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f1dbc06e0b0 0x7f1dbc070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:53:08.334 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:08.332+0000 7f1dd0ff9640 1 -- 172.21.15.121:0/3341646988 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6668+0+0 (secure 0 0 0) 0x7f1dc408dd40 con 0x7f1dd4102300 2024-08-18T22:53:08.334 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:08.332+0000 7f1dd37fe640 1 --2- 172.21.15.121:0/3341646988 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f1dbc06e0b0 0x7f1dbc070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:53:08.334 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:08.332+0000 7f1dd37fe640 1 --2- 172.21.15.121:0/3341646988 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f1dbc06e0b0 0x7f1dbc070560 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f1dc8007ac0 tx=0x7f1dc8009da0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:53:08.337 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:08.336+0000 7f1dd0ff9640 1 -- 172.21.15.121:0/3341646988 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f1dc40570e0 con 0x7f1dd4102300 2024-08-18T22:53:08.537 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:08.536+0000 7f1dda7f0640 1 -- 172.21.15.121:0/3341646988 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 23, "format": "json"} v 0) v1 -- 0x7f1dd40fbaf0 con 0x7f1dd4102300 2024-08-18T22:53:08.537 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:08.536+0000 7f1dd0ff9640 1 -- 172.21.15.121:0/3341646988 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 23, "format": "json"}]=0 dumped fsmap epoch 23 v46) v1 ==== 107+0+4933 (secure 0 0 0) 0x7f1dc405e360 con 0x7f1dd4102300 2024-08-18T22:53:08.538 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-08-18T22:53:08.538 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":23,"btime":"2024-08-18T22:47:45:133904+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14490,"name":"cephfs.smithi121.xuzsdg","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6827/91588128","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":91588128},{"type":"v1","addr":"172.21.15.121:6827","nonce":91588128}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":14},{"gid":24259,"name":"cephfs.smithi195.nptgyc","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.195:6827/238549847","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":238549847},{"type":"v1","addr":"172.21.15.195:6827","nonce":238549847}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-18T22:39:04.054074+0000","modified":"2024-08-18T22:47:44.136802+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":47,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0,1],"up":{"mds_0":14474,"mds_1":24249},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14474":{"gid":14474,"name":"cephfs.smithi121.gbickb","rank":0,"incarnation":13,"state":"up:active","state_seq":83,"addr":"172.21.15.121:6829/2277706406","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6828","nonce":2277706406},{"type":"v1","addr":"172.21.15.121:6829","nonce":2277706406}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24249":{"gid":24249,"name":"cephfs.smithi195.buqvbr","rank":1,"incarnation":7,"state":"up:active","state_seq":4,"addr":"172.21.15.195:6825/2414511859","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":2414511859},{"type":"v1","addr":"172.21.15.195:6825","nonce":2414511859}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":14474,"qdb_cluster":[24249,14474]},"id":1}]} 2024-08-18T22:53:08.538 INFO:teuthology.orchestra.run.smithi121.stderr:dumped fsmap epoch 23 2024-08-18T22:53:08.540 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:08.539+0000 7f1dda7f0640 1 -- 172.21.15.121:0/3341646988 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f1dbc06e0b0 msgr2=0x7f1dbc070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:53:08.540 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:08.539+0000 7f1dda7f0640 1 --2- 172.21.15.121:0/3341646988 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f1dbc06e0b0 0x7f1dbc070560 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f1dc8007ac0 tx=0x7f1dc8009da0 comp rx=0 tx=0).stop 2024-08-18T22:53:08.540 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:08.539+0000 7f1dda7f0640 1 -- 172.21.15.121:0/3341646988 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1dd4102300 msgr2=0x7f1dd41132a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:53:08.540 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:08.539+0000 7f1dda7f0640 1 --2- 172.21.15.121:0/3341646988 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1dd4102300 0x7f1dd41132a0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f1dc400c830 tx=0x7f1dc4004430 comp rx=0 tx=0).stop 2024-08-18T22:53:08.540 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:08.539+0000 7f1dda7f0640 1 -- 172.21.15.121:0/3341646988 shutdown_connections 2024-08-18T22:53:08.540 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:08.539+0000 7f1dda7f0640 1 --2- 172.21.15.121:0/3341646988 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f1dbc06e0b0 0x7f1dbc070560 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:53:08.540 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:08.539+0000 7f1dda7f0640 1 --2- 172.21.15.121:0/3341646988 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1dd4102ca0 0x7f1dd41137e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:53:08.540 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:08.539+0000 7f1dda7f0640 1 --2- 172.21.15.121:0/3341646988 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1dd4102300 0x7f1dd41132a0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:53:08.540 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:08.539+0000 7f1dda7f0640 1 -- 172.21.15.121:0/3341646988 >> 172.21.15.121:0/3341646988 conn(0x7f1dd40f7e90 msgr2=0x7f1dd40f8ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:53:08.540 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:08.539+0000 7f1dda7f0640 1 -- 172.21.15.121:0/3341646988 shutdown_connections 2024-08-18T22:53:08.540 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:08.539+0000 7f1dda7f0640 1 -- 172.21.15.121:0/3341646988 wait complete. 2024-08-18T22:53:08.833 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:53:08 smithi121 ceph-mon[81053]: from='client.? 172.21.15.121:0/3341646988' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 23, "format": "json"}]: dispatch 2024-08-18T22:53:08.833 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:53:08 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-18T22:53:09.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:53:08 smithi195 ceph-mon[68841]: from='client.? 172.21.15.121:0/3341646988' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 23, "format": "json"}]: dispatch 2024-08-18T22:53:09.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:53:08 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-18T22:53:09.307 DEBUG:tasks.fs:max_mds reduced in epoch 23 2024-08-18T22:53:09.307 DEBUG:teuthology.orchestra.run.smithi121:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid b003123a-5db1-11ef-bccf-c7b262605968 -- ceph fs dump --format=json 24 2024-08-18T22:53:09.568 INFO:teuthology.orchestra.run.smithi121.stderr:Inferring config /var/lib/ceph/b003123a-5db1-11ef-bccf-c7b262605968/mon.smithi121/config 2024-08-18T22:53:09.842 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:53:09 smithi121 ceph-mon[81053]: pgmap v322: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:53:10.158 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:53:09 smithi195 ceph-mon[68841]: pgmap v322: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:53:11.228 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:11.225+0000 7fd54458d640 1 -- 172.21.15.121:0/360390403 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd53c102ca0 msgr2=0x7fd53c0fc330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:53:11.228 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:11.225+0000 7fd54458d640 1 --2- 172.21.15.121:0/360390403 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd53c102ca0 0x7fd53c0fc330 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fd530009c50 tx=0x7fd530004d10 comp rx=0 tx=0).stop 2024-08-18T22:53:11.228 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:11.225+0000 7fd54458d640 1 -- 172.21.15.121:0/360390403 shutdown_connections 2024-08-18T22:53:11.228 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:11.225+0000 7fd54458d640 1 --2- 172.21.15.121:0/360390403 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd53c102ca0 0x7fd53c0fc330 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:53:11.228 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:11.225+0000 7fd54458d640 1 --2- 172.21.15.121:0/360390403 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd53c102300 0x7fd53c1026d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:53:11.228 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:11.225+0000 7fd54458d640 1 -- 172.21.15.121:0/360390403 >> 172.21.15.121:0/360390403 conn(0x7fd53c0f7e90 msgr2=0x7fd53c0fa2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:53:11.228 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:11.225+0000 7fd54458d640 1 -- 172.21.15.121:0/360390403 shutdown_connections 2024-08-18T22:53:11.228 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:11.225+0000 7fd54458d640 1 -- 172.21.15.121:0/360390403 wait complete. 2024-08-18T22:53:11.228 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:11.226+0000 7fd54458d640 1 Processor -- start 2024-08-18T22:53:11.229 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:11.226+0000 7fd54458d640 1 -- start start 2024-08-18T22:53:11.229 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:11.226+0000 7fd54458d640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd53c102300 0x7fd53c1132c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:53:11.229 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:11.226+0000 7fd54458d640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd53c102ca0 0x7fd53c113800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:53:11.229 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:11.226+0000 7fd54458d640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd53c113e00 con 0x7fd53c102ca0 2024-08-18T22:53:11.229 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:11.226+0000 7fd54458d640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd53c10d240 con 0x7fd53c102300 2024-08-18T22:53:11.229 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:11.226+0000 7fd541b28640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd53c102ca0 0x7fd53c113800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:53:11.229 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:11.226+0000 7fd541b28640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd53c102ca0 0x7fd53c113800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:56670/0 (socket says 172.21.15.121:56670) 2024-08-18T22:53:11.229 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:11.226+0000 7fd541b28640 1 -- 172.21.15.121:0/661418321 learned_addr learned my addr 172.21.15.121:0/661418321 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-18T22:53:11.229 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:11.226+0000 7fd542329640 1 --2- 172.21.15.121:0/661418321 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd53c102300 0x7fd53c1132c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:53:11.229 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:11.226+0000 7fd541b28640 1 -- 172.21.15.121:0/661418321 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd53c102300 msgr2=0x7fd53c1132c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:53:11.229 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:11.226+0000 7fd541b28640 1 --2- 172.21.15.121:0/661418321 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd53c102300 0x7fd53c1132c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:53:11.229 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:11.226+0000 7fd541b28640 1 -- 172.21.15.121:0/661418321 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5300098b0 con 0x7fd53c102ca0 2024-08-18T22:53:11.229 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:11.226+0000 7fd541b28640 1 --2- 172.21.15.121:0/661418321 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd53c102ca0 0x7fd53c113800 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fd530004750 tx=0x7fd530004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:53:11.230 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:11.227+0000 7fd53affd640 1 -- 172.21.15.121:0/661418321 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd530009590 con 0x7fd53c102ca0 2024-08-18T22:53:11.230 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:11.227+0000 7fd53affd640 1 -- 172.21.15.121:0/661418321 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fd5300096f0 con 0x7fd53c102ca0 2024-08-18T22:53:11.230 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:11.227+0000 7fd54458d640 1 -- 172.21.15.121:0/661418321 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd53c10d4c0 con 0x7fd53c102ca0 2024-08-18T22:53:11.230 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:11.227+0000 7fd53affd640 1 -- 172.21.15.121:0/661418321 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd53003d960 con 0x7fd53c102ca0 2024-08-18T22:53:11.230 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:11.227+0000 7fd54458d640 1 -- 172.21.15.121:0/661418321 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd53c10da60 con 0x7fd53c102ca0 2024-08-18T22:53:11.231 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:11.228+0000 7fd54458d640 1 -- 172.21.15.121:0/661418321 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd53c0fda70 con 0x7fd53c102ca0 2024-08-18T22:53:11.231 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:11.228+0000 7fd53affd640 1 -- 172.21.15.121:0/661418321 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 37) v1 ==== 92205+0+0 (secure 0 0 0) 0x7fd53002f030 con 0x7fd53c102ca0 2024-08-18T22:53:11.231 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:11.228+0000 7fd53affd640 1 --2- 172.21.15.121:0/661418321 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7fd52406e0b0 0x7fd524070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:53:11.231 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:11.229+0000 7fd53affd640 1 -- 172.21.15.121:0/661418321 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6668+0+0 (secure 0 0 0) 0x7fd5300af0f0 con 0x7fd53c102ca0 2024-08-18T22:53:11.231 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:11.229+0000 7fd542329640 1 --2- 172.21.15.121:0/661418321 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7fd52406e0b0 0x7fd524070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:53:11.231 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:11.229+0000 7fd542329640 1 --2- 172.21.15.121:0/661418321 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7fd52406e0b0 0x7fd524070560 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fd534004a70 tx=0x7fd53400b040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:53:11.233 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:11.233+0000 7fd53affd640 1 -- 172.21.15.121:0/661418321 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7fd530078430 con 0x7fd53c102ca0 2024-08-18T22:53:11.434 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:11.433+0000 7fd54458d640 1 -- 172.21.15.121:0/661418321 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 24, "format": "json"} v 0) v1 -- 0x7fd53c109310 con 0x7fd53c102ca0 2024-08-18T22:53:11.435 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:11.434+0000 7fd53affd640 1 -- 172.21.15.121:0/661418321 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 24, "format": "json"}]=0 dumped fsmap epoch 24 v46) v1 ==== 107+0+4929 (secure 0 0 0) 0x7fd53007baf0 con 0x7fd53c102ca0 2024-08-18T22:53:11.435 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-08-18T22:53:11.435 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":24,"btime":"2024-08-18T22:47:45:143968+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14490,"name":"cephfs.smithi121.xuzsdg","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6827/91588128","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":91588128},{"type":"v1","addr":"172.21.15.121:6827","nonce":91588128}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":14},{"gid":24259,"name":"cephfs.smithi195.nptgyc","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.195:6827/238549847","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":238549847},{"type":"v1","addr":"172.21.15.195:6827","nonce":238549847}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-18T22:39:04.054074+0000","modified":"2024-08-18T22:47:45.143965+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":47,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0,1],"up":{"mds_0":14474,"mds_1":24249},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14474":{"gid":14474,"name":"cephfs.smithi121.gbickb","rank":0,"incarnation":13,"state":"up:active","state_seq":83,"addr":"172.21.15.121:6829/2277706406","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6828","nonce":2277706406},{"type":"v1","addr":"172.21.15.121:6829","nonce":2277706406}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24249":{"gid":24249,"name":"cephfs.smithi195.buqvbr","rank":1,"incarnation":7,"state":"up:stopping","state_seq":4,"addr":"172.21.15.195:6825/2414511859","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":2414511859},{"type":"v1","addr":"172.21.15.195:6825","nonce":2414511859}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":14474,"qdb_cluster":[14474]},"id":1}]} 2024-08-18T22:53:11.436 INFO:teuthology.orchestra.run.smithi121.stderr:dumped fsmap epoch 24 2024-08-18T22:53:11.437 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:11.436+0000 7fd54458d640 1 -- 172.21.15.121:0/661418321 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7fd52406e0b0 msgr2=0x7fd524070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:53:11.437 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:11.436+0000 7fd54458d640 1 --2- 172.21.15.121:0/661418321 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7fd52406e0b0 0x7fd524070560 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fd534004a70 tx=0x7fd53400b040 comp rx=0 tx=0).stop 2024-08-18T22:53:11.437 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:11.436+0000 7fd54458d640 1 -- 172.21.15.121:0/661418321 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd53c102ca0 msgr2=0x7fd53c113800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:53:11.438 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:11.436+0000 7fd54458d640 1 --2- 172.21.15.121:0/661418321 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd53c102ca0 0x7fd53c113800 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fd530004750 tx=0x7fd530004d10 comp rx=0 tx=0).stop 2024-08-18T22:53:11.438 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:11.436+0000 7fd54458d640 1 -- 172.21.15.121:0/661418321 shutdown_connections 2024-08-18T22:53:11.439 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:11.436+0000 7fd54458d640 1 --2- 172.21.15.121:0/661418321 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7fd52406e0b0 0x7fd524070560 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:53:11.439 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:11.436+0000 7fd54458d640 1 --2- 172.21.15.121:0/661418321 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd53c102ca0 0x7fd53c113800 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:53:11.439 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:11.436+0000 7fd54458d640 1 --2- 172.21.15.121:0/661418321 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd53c102300 0x7fd53c1132c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:53:11.439 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:11.436+0000 7fd54458d640 1 -- 172.21.15.121:0/661418321 >> 172.21.15.121:0/661418321 conn(0x7fd53c0f7e90 msgr2=0x7fd53c0f8fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:53:11.439 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:11.436+0000 7fd54458d640 1 -- 172.21.15.121:0/661418321 shutdown_connections 2024-08-18T22:53:11.439 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:11.436+0000 7fd54458d640 1 -- 172.21.15.121:0/661418321 wait complete. 2024-08-18T22:53:12.045 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:53:11 smithi121 ceph-mon[81053]: pgmap v323: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:53:12.046 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:53:11 smithi121 ceph-mon[81053]: from='client.? 172.21.15.121:0/661418321' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 24, "format": "json"}]: dispatch 2024-08-18T22:53:12.069 DEBUG:tasks.fs:max_mds reduced in epoch 24 2024-08-18T22:53:12.070 DEBUG:teuthology.orchestra.run.smithi121:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid b003123a-5db1-11ef-bccf-c7b262605968 -- ceph fs dump --format=json 25 2024-08-18T22:53:12.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:53:11 smithi195 ceph-mon[68841]: pgmap v323: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:53:12.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:53:11 smithi195 ceph-mon[68841]: from='client.? 172.21.15.121:0/661418321' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 24, "format": "json"}]: dispatch 2024-08-18T22:53:12.323 INFO:teuthology.orchestra.run.smithi121.stderr:Inferring config /var/lib/ceph/b003123a-5db1-11ef-bccf-c7b262605968/mon.smithi121/config 2024-08-18T22:53:13.889 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:13.874+0000 7f86eaf96640 1 -- 172.21.15.121:0/1594672983 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f86e41022e0 msgr2=0x7f86e41026b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:53:13.889 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:13.874+0000 7f86eaf96640 1 --2- 172.21.15.121:0/1594672983 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f86e41022e0 0x7f86e41026b0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f86d80048d0 tx=0x7f86d8009da0 comp rx=0 tx=0).stop 2024-08-18T22:53:13.889 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:13.874+0000 7f86eaf96640 1 -- 172.21.15.121:0/1594672983 shutdown_connections 2024-08-18T22:53:13.889 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:13.874+0000 7f86eaf96640 1 --2- 172.21.15.121:0/1594672983 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f86e4102c80 0x7f86e40fc310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:53:13.889 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:13.874+0000 7f86eaf96640 1 --2- 172.21.15.121:0/1594672983 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f86e41022e0 0x7f86e41026b0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:53:13.889 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:13.874+0000 7f86eaf96640 1 -- 172.21.15.121:0/1594672983 >> 172.21.15.121:0/1594672983 conn(0x7f86e40f7eb0 msgr2=0x7f86e40fa2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:53:13.889 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:13.874+0000 7f86eaf96640 1 -- 172.21.15.121:0/1594672983 shutdown_connections 2024-08-18T22:53:13.890 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:13.874+0000 7f86eaf96640 1 -- 172.21.15.121:0/1594672983 wait complete. 2024-08-18T22:53:13.890 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:13.874+0000 7f86eaf96640 1 Processor -- start 2024-08-18T22:53:13.890 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:13.875+0000 7f86eaf96640 1 -- start start 2024-08-18T22:53:13.890 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:13.875+0000 7f86eaf96640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f86e41022e0 0x7f86e4112f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:53:13.890 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:13.875+0000 7f86eaf96640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f86e4102c80 0x7f86e4113490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:53:13.890 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:13.875+0000 7f86eaf96640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86e4113a90 con 0x7f86e4102c80 2024-08-18T22:53:13.890 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:13.875+0000 7f86eaf96640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86e410ced0 con 0x7f86e41022e0 2024-08-18T22:53:13.890 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:13.875+0000 7f86e3fff640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f86e4102c80 0x7f86e4113490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:53:13.890 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:13.875+0000 7f86e3fff640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f86e4102c80 0x7f86e4113490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:56684/0 (socket says 172.21.15.121:56684) 2024-08-18T22:53:13.890 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:13.875+0000 7f86e3fff640 1 -- 172.21.15.121:0/1822384225 learned_addr learned my addr 172.21.15.121:0/1822384225 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-18T22:53:13.890 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:13.875+0000 7f86e8d32640 1 --2- 172.21.15.121:0/1822384225 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f86e41022e0 0x7f86e4112f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:53:13.890 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:13.875+0000 7f86e3fff640 1 -- 172.21.15.121:0/1822384225 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f86e41022e0 msgr2=0x7f86e4112f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:53:13.890 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:13.875+0000 7f86e3fff640 1 --2- 172.21.15.121:0/1822384225 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f86e41022e0 0x7f86e4112f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:53:13.891 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:13.875+0000 7f86e3fff640 1 -- 172.21.15.121:0/1822384225 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86d8005040 con 0x7f86e4102c80 2024-08-18T22:53:13.891 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:13.875+0000 7f86e8d32640 1 --2- 172.21.15.121:0/1822384225 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f86e41022e0 0x7f86e4112f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:53:13.891 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:13.875+0000 7f86e3fff640 1 --2- 172.21.15.121:0/1822384225 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f86e4102c80 0x7f86e4113490 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f86d0002a50 tx=0x7f86d0004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:53:13.891 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:13.876+0000 7f86e17fa640 1 -- 172.21.15.121:0/1822384225 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f86d0007c30 con 0x7f86e4102c80 2024-08-18T22:53:13.891 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:13.876+0000 7f86e17fa640 1 -- 172.21.15.121:0/1822384225 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f86d000f040 con 0x7f86e4102c80 2024-08-18T22:53:13.891 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:13.876+0000 7f86eaf96640 1 -- 172.21.15.121:0/1822384225 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86e410d1b0 con 0x7f86e4102c80 2024-08-18T22:53:13.891 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:13.876+0000 7f86e17fa640 1 -- 172.21.15.121:0/1822384225 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f86d000da90 con 0x7f86e4102c80 2024-08-18T22:53:13.891 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:13.876+0000 7f86eaf96640 1 -- 172.21.15.121:0/1822384225 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86e410d750 con 0x7f86e4102c80 2024-08-18T22:53:13.891 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:13.877+0000 7f86eaf96640 1 -- 172.21.15.121:0/1822384225 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86e40fda50 con 0x7f86e4102c80 2024-08-18T22:53:13.891 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:13.877+0000 7f86e17fa640 1 -- 172.21.15.121:0/1822384225 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 37) v1 ==== 92205+0+0 (secure 0 0 0) 0x7f86d000dd00 con 0x7f86e4102c80 2024-08-18T22:53:13.891 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:13.878+0000 7f86e17fa640 1 --2- 172.21.15.121:0/1822384225 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f86d406e0b0 0x7f86d4070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:53:13.891 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:13.878+0000 7f86e17fa640 1 -- 172.21.15.121:0/1822384225 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6668+0+0 (secure 0 0 0) 0x7f86d008d550 con 0x7f86e4102c80 2024-08-18T22:53:13.891 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:13.878+0000 7f86e8d32640 1 --2- 172.21.15.121:0/1822384225 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f86d406e0b0 0x7f86d4070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:53:13.891 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:13.878+0000 7f86e8d32640 1 --2- 172.21.15.121:0/1822384225 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f86d406e0b0 0x7f86d4070560 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f86d8007ac0 tx=0x7f86d8035040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:53:13.892 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:13.882+0000 7f86e17fa640 1 -- 172.21.15.121:0/1822384225 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f86d00567d0 con 0x7f86e4102c80 2024-08-18T22:53:14.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:53:13 smithi121 ceph-mon[81053]: pgmap v324: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:53:14.084 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:14.083+0000 7f86eaf96640 1 -- 172.21.15.121:0/1822384225 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 25, "format": "json"} v 0) v1 -- 0x7f86e40fbad0 con 0x7f86e4102c80 2024-08-18T22:53:14.085 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:14.084+0000 7f86e17fa640 1 -- 172.21.15.121:0/1822384225 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 25, "format": "json"}]=0 dumped fsmap epoch 25 v46) v1 ==== 107+0+4930 (secure 0 0 0) 0x7f86d0059e90 con 0x7f86e4102c80 2024-08-18T22:53:14.085 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-08-18T22:53:14.085 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":25,"btime":"2024-08-18T22:47:52:160518+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14490,"name":"cephfs.smithi121.xuzsdg","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6827/91588128","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":91588128},{"type":"v1","addr":"172.21.15.121:6827","nonce":91588128}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":14},{"gid":24259,"name":"cephfs.smithi195.nptgyc","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.195:6827/238549847","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":238549847},{"type":"v1","addr":"172.21.15.195:6827","nonce":238549847}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-18T22:39:04.054074+0000","modified":"2024-08-18T22:47:51.250426+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":47,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0,1],"up":{"mds_0":14474,"mds_1":24249},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14474":{"gid":14474,"name":"cephfs.smithi121.gbickb","rank":0,"incarnation":13,"state":"up:active","state_seq":83,"addr":"172.21.15.121:6829/2277706406","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6828","nonce":2277706406},{"type":"v1","addr":"172.21.15.121:6829","nonce":2277706406}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24249":{"gid":24249,"name":"cephfs.smithi195.buqvbr","rank":1,"incarnation":7,"state":"up:stopping","state_seq":4,"addr":"172.21.15.195:6825/2414511859","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":2414511859},{"type":"v1","addr":"172.21.15.195:6825","nonce":2414511859}]},"join_fscid":1,"export_targets":[0],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":14474,"qdb_cluster":[14474]},"id":1}]} 2024-08-18T22:53:14.085 INFO:teuthology.orchestra.run.smithi121.stderr:dumped fsmap epoch 25 2024-08-18T22:53:14.088 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:14.087+0000 7f86eaf96640 1 -- 172.21.15.121:0/1822384225 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f86d406e0b0 msgr2=0x7f86d4070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:53:14.088 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:14.087+0000 7f86eaf96640 1 --2- 172.21.15.121:0/1822384225 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f86d406e0b0 0x7f86d4070560 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f86d8007ac0 tx=0x7f86d8035040 comp rx=0 tx=0).stop 2024-08-18T22:53:14.088 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:14.087+0000 7f86eaf96640 1 -- 172.21.15.121:0/1822384225 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f86e4102c80 msgr2=0x7f86e4113490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:53:14.088 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:14.087+0000 7f86eaf96640 1 --2- 172.21.15.121:0/1822384225 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f86e4102c80 0x7f86e4113490 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f86d0002a50 tx=0x7f86d0004600 comp rx=0 tx=0).stop 2024-08-18T22:53:14.088 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:14.087+0000 7f86eaf96640 1 -- 172.21.15.121:0/1822384225 shutdown_connections 2024-08-18T22:53:14.088 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:14.087+0000 7f86eaf96640 1 --2- 172.21.15.121:0/1822384225 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f86d406e0b0 0x7f86d4070560 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:53:14.088 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:14.087+0000 7f86eaf96640 1 --2- 172.21.15.121:0/1822384225 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f86e4102c80 0x7f86e4113490 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:53:14.088 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:14.087+0000 7f86eaf96640 1 --2- 172.21.15.121:0/1822384225 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f86e41022e0 0x7f86e4112f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:53:14.088 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:14.087+0000 7f86eaf96640 1 -- 172.21.15.121:0/1822384225 >> 172.21.15.121:0/1822384225 conn(0x7f86e40f7eb0 msgr2=0x7f86e40f8f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:53:14.088 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:14.087+0000 7f86eaf96640 1 -- 172.21.15.121:0/1822384225 shutdown_connections 2024-08-18T22:53:14.088 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:14.087+0000 7f86eaf96640 1 -- 172.21.15.121:0/1822384225 wait complete. 2024-08-18T22:53:14.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:53:13 smithi195 ceph-mon[68841]: pgmap v324: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:53:14.833 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:53:14 smithi121 ceph-mon[81053]: from='client.? 172.21.15.121:0/1822384225' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 25, "format": "json"}]: dispatch 2024-08-18T22:53:14.863 DEBUG:tasks.fs:max_mds reduced in epoch 25 2024-08-18T22:53:14.863 DEBUG:teuthology.orchestra.run.smithi121:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid b003123a-5db1-11ef-bccf-c7b262605968 -- ceph fs dump --format=json 26 2024-08-18T22:53:15.116 INFO:teuthology.orchestra.run.smithi121.stderr:Inferring config /var/lib/ceph/b003123a-5db1-11ef-bccf-c7b262605968/mon.smithi121/config 2024-08-18T22:53:15.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:53:14 smithi195 ceph-mon[68841]: from='client.? 172.21.15.121:0/1822384225' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 25, "format": "json"}]: dispatch 2024-08-18T22:53:15.833 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:53:15 smithi121 ceph-mon[81053]: pgmap v325: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:53:16.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:53:15 smithi195 ceph-mon[68841]: pgmap v325: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:53:16.631 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:16.629+0000 7f02aedd8640 1 -- 172.21.15.121:0/862193290 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f02a8102c80 msgr2=0x7f02a80fc310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:53:16.632 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:16.629+0000 7f02aedd8640 1 --2- 172.21.15.121:0/862193290 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f02a8102c80 0x7f02a80fc310 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f0298009c50 tx=0x7f0298004d10 comp rx=0 tx=0).stop 2024-08-18T22:53:16.632 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:16.629+0000 7f02aedd8640 1 -- 172.21.15.121:0/862193290 shutdown_connections 2024-08-18T22:53:16.632 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:16.629+0000 7f02aedd8640 1 --2- 172.21.15.121:0/862193290 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f02a8102c80 0x7f02a80fc310 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:53:16.632 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:16.629+0000 7f02aedd8640 1 --2- 172.21.15.121:0/862193290 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f02a81022e0 0x7f02a81026b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:53:16.632 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:16.629+0000 7f02aedd8640 1 -- 172.21.15.121:0/862193290 >> 172.21.15.121:0/862193290 conn(0x7f02a80f7eb0 msgr2=0x7f02a80fa2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:53:16.632 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:16.629+0000 7f02aedd8640 1 -- 172.21.15.121:0/862193290 shutdown_connections 2024-08-18T22:53:16.632 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:16.629+0000 7f02aedd8640 1 -- 172.21.15.121:0/862193290 wait complete. 2024-08-18T22:53:16.632 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:16.629+0000 7f02aedd8640 1 Processor -- start 2024-08-18T22:53:16.632 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:16.630+0000 7f02aedd8640 1 -- start start 2024-08-18T22:53:16.632 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:16.630+0000 7f02aedd8640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f02a81022e0 0x7f02a8113020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:53:16.632 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:16.630+0000 7f02aedd8640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f02a8102c80 0x7f02a8113560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:53:16.633 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:16.630+0000 7f02aedd8640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02a8113bf0 con 0x7f02a81022e0 2024-08-18T22:53:16.633 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:16.630+0000 7f02aedd8640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02a810cfa0 con 0x7f02a8102c80 2024-08-18T22:53:16.633 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:16.630+0000 7f02acb74640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f02a81022e0 0x7f02a8113020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:53:16.633 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:16.630+0000 7f02acb74640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f02a81022e0 0x7f02a8113020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:56706/0 (socket says 172.21.15.121:56706) 2024-08-18T22:53:16.633 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:16.630+0000 7f02acb74640 1 -- 172.21.15.121:0/2497684102 learned_addr learned my addr 172.21.15.121:0/2497684102 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-18T22:53:16.633 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:16.630+0000 7f02a7fff640 1 --2- 172.21.15.121:0/2497684102 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f02a8102c80 0x7f02a8113560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:53:16.633 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:16.630+0000 7f02acb74640 1 -- 172.21.15.121:0/2497684102 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f02a8102c80 msgr2=0x7f02a8113560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:53:16.633 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:16.630+0000 7f02acb74640 1 --2- 172.21.15.121:0/2497684102 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f02a8102c80 0x7f02a8113560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:53:16.633 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:16.630+0000 7f02acb74640 1 -- 172.21.15.121:0/2497684102 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02980098b0 con 0x7f02a81022e0 2024-08-18T22:53:16.633 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:16.631+0000 7f02acb74640 1 --2- 172.21.15.121:0/2497684102 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f02a81022e0 0x7f02a8113020 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f029000b790 tx=0x7f02900091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:53:16.633 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:16.631+0000 7f02a57fa640 1 -- 172.21.15.121:0/2497684102 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f029000c700 con 0x7f02a81022e0 2024-08-18T22:53:16.633 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:16.631+0000 7f02a57fa640 1 -- 172.21.15.121:0/2497684102 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f029000cd00 con 0x7f02a81022e0 2024-08-18T22:53:16.633 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:16.631+0000 7f02a57fa640 1 -- 172.21.15.121:0/2497684102 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0290015e70 con 0x7f02a81022e0 2024-08-18T22:53:16.634 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:16.631+0000 7f02aedd8640 1 -- 172.21.15.121:0/2497684102 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02a810d280 con 0x7f02a81022e0 2024-08-18T22:53:16.634 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:16.631+0000 7f02aedd8640 1 -- 172.21.15.121:0/2497684102 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02a810d770 con 0x7f02a81022e0 2024-08-18T22:53:16.634 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:16.632+0000 7f02aedd8640 1 -- 172.21.15.121:0/2497684102 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02a80fda50 con 0x7f02a81022e0 2024-08-18T22:53:16.634 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:16.632+0000 7f02a57fa640 1 -- 172.21.15.121:0/2497684102 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 37) v1 ==== 92205+0+0 (secure 0 0 0) 0x7f0290012070 con 0x7f02a81022e0 2024-08-18T22:53:16.635 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:16.633+0000 7f02a57fa640 1 --2- 172.21.15.121:0/2497684102 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f029406e0b0 0x7f0294070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:53:16.635 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:16.633+0000 7f02a57fa640 1 -- 172.21.15.121:0/2497684102 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6668+0+0 (secure 0 0 0) 0x7f029008d550 con 0x7f02a81022e0 2024-08-18T22:53:16.635 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:16.633+0000 7f02a7fff640 1 --2- 172.21.15.121:0/2497684102 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f029406e0b0 0x7f0294070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:53:16.635 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:16.633+0000 7f02a7fff640 1 --2- 172.21.15.121:0/2497684102 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f029406e0b0 0x7f0294070560 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f02a8103150 tx=0x7f0298004d10 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:53:16.638 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:16.637+0000 7f02a57fa640 1 -- 172.21.15.121:0/2497684102 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f0290056850 con 0x7f02a81022e0 2024-08-18T22:53:16.841 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:16.840+0000 7f02aedd8640 1 -- 172.21.15.121:0/2497684102 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 26, "format": "json"} v 0) v1 -- 0x7f02a804b550 con 0x7f02a81022e0 2024-08-18T22:53:16.841 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:16.841+0000 7f02a57fa640 1 -- 172.21.15.121:0/2497684102 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 26, "format": "json"}]=0 dumped fsmap epoch 26 v46) v1 ==== 107+0+4131 (secure 0 0 0) 0x7f0290059f10 con 0x7f02a81022e0 2024-08-18T22:53:16.842 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-08-18T22:53:16.842 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":26,"btime":"2024-08-18T22:48:16:961035+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14490,"name":"cephfs.smithi121.xuzsdg","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6827/91588128","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":91588128},{"type":"v1","addr":"172.21.15.121:6827","nonce":91588128}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":14},{"gid":24259,"name":"cephfs.smithi195.nptgyc","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.195:6827/238549847","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":238549847},{"type":"v1","addr":"172.21.15.195:6827","nonce":238549847}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-18T22:39:04.054074+0000","modified":"2024-08-18T22:48:16.251573+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":47,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":14474},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_14474":{"gid":14474,"name":"cephfs.smithi121.gbickb","rank":0,"incarnation":13,"state":"up:active","state_seq":83,"addr":"172.21.15.121:6829/2277706406","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6828","nonce":2277706406},{"type":"v1","addr":"172.21.15.121:6829","nonce":2277706406}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":14474,"qdb_cluster":[14474]},"id":1}]} 2024-08-18T22:53:16.842 INFO:teuthology.orchestra.run.smithi121.stderr:dumped fsmap epoch 26 2024-08-18T22:53:16.844 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:16.843+0000 7f02aedd8640 1 -- 172.21.15.121:0/2497684102 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f029406e0b0 msgr2=0x7f0294070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:53:16.844 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:16.843+0000 7f02aedd8640 1 --2- 172.21.15.121:0/2497684102 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f029406e0b0 0x7f0294070560 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f02a8103150 tx=0x7f0298004d10 comp rx=0 tx=0).stop 2024-08-18T22:53:16.844 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:16.843+0000 7f02aedd8640 1 -- 172.21.15.121:0/2497684102 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f02a81022e0 msgr2=0x7f02a8113020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:53:16.844 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:16.843+0000 7f02aedd8640 1 --2- 172.21.15.121:0/2497684102 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f02a81022e0 0x7f02a8113020 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f029000b790 tx=0x7f02900091d0 comp rx=0 tx=0).stop 2024-08-18T22:53:16.844 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:16.843+0000 7f02aedd8640 1 -- 172.21.15.121:0/2497684102 shutdown_connections 2024-08-18T22:53:16.844 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:16.843+0000 7f02aedd8640 1 --2- 172.21.15.121:0/2497684102 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f029406e0b0 0x7f0294070560 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:53:16.844 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:16.843+0000 7f02aedd8640 1 --2- 172.21.15.121:0/2497684102 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f02a8102c80 0x7f02a8113560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:53:16.844 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:16.843+0000 7f02aedd8640 1 --2- 172.21.15.121:0/2497684102 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f02a81022e0 0x7f02a8113020 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:53:16.845 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:16.843+0000 7f02aedd8640 1 -- 172.21.15.121:0/2497684102 >> 172.21.15.121:0/2497684102 conn(0x7f02a80f7eb0 msgr2=0x7f02a80f8e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:53:16.845 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:16.843+0000 7f02aedd8640 1 -- 172.21.15.121:0/2497684102 shutdown_connections 2024-08-18T22:53:16.845 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:16.843+0000 7f02aedd8640 1 -- 172.21.15.121:0/2497684102 wait complete. 2024-08-18T22:53:17.478 DEBUG:tasks.fs:max_mds reduced in epoch 26 2024-08-18T22:53:17.478 DEBUG:teuthology.orchestra.run.smithi121:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid b003123a-5db1-11ef-bccf-c7b262605968 -- ceph fs dump --format=json 27 2024-08-18T22:53:17.731 INFO:teuthology.orchestra.run.smithi121.stderr:Inferring config /var/lib/ceph/b003123a-5db1-11ef-bccf-c7b262605968/mon.smithi121/config 2024-08-18T22:53:17.833 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:53:17 smithi121 ceph-mon[81053]: pgmap v326: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:53:17.833 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:53:17 smithi121 ceph-mon[81053]: from='client.? 172.21.15.121:0/2497684102' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 26, "format": "json"}]: dispatch 2024-08-18T22:53:18.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:53:17 smithi195 ceph-mon[68841]: pgmap v326: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:53:18.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:53:17 smithi195 ceph-mon[68841]: from='client.? 172.21.15.121:0/2497684102' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 26, "format": "json"}]: dispatch 2024-08-18T22:53:19.254 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:19.252+0000 7f55846a4640 1 -- 172.21.15.121:0/3275823777 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f557c102c80 msgr2=0x7f557c0fc310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:53:19.255 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:19.252+0000 7f55846a4640 1 --2- 172.21.15.121:0/3275823777 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f557c102c80 0x7f557c0fc310 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f556c0048d0 tx=0x7f556c009da0 comp rx=0 tx=0).stop 2024-08-18T22:53:19.255 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:19.252+0000 7f55846a4640 1 -- 172.21.15.121:0/3275823777 shutdown_connections 2024-08-18T22:53:19.255 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:19.252+0000 7f55846a4640 1 --2- 172.21.15.121:0/3275823777 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f557c102c80 0x7f557c0fc310 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:53:19.255 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:19.252+0000 7f55846a4640 1 --2- 172.21.15.121:0/3275823777 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f557c1022e0 0x7f557c1026b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:53:19.255 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:19.252+0000 7f55846a4640 1 -- 172.21.15.121:0/3275823777 >> 172.21.15.121:0/3275823777 conn(0x7f557c0f7eb0 msgr2=0x7f557c0fa2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:53:19.255 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:19.252+0000 7f55846a4640 1 -- 172.21.15.121:0/3275823777 shutdown_connections 2024-08-18T22:53:19.255 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:19.252+0000 7f55846a4640 1 -- 172.21.15.121:0/3275823777 wait complete. 2024-08-18T22:53:19.255 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:19.252+0000 7f55846a4640 1 Processor -- start 2024-08-18T22:53:19.255 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:19.252+0000 7f55846a4640 1 -- start start 2024-08-18T22:53:19.256 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:19.253+0000 7f55846a4640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f557c1022e0 0x7f557c112f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:53:19.256 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:19.253+0000 7f55846a4640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f557c102c80 0x7f557c1134c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:53:19.256 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:19.253+0000 7f55846a4640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f557c113ac0 con 0x7f557c102c80 2024-08-18T22:53:19.256 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:19.253+0000 7f55846a4640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f557c10cf00 con 0x7f557c1022e0 2024-08-18T22:53:19.256 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:19.253+0000 7f5581c3f640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f557c102c80 0x7f557c1134c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:53:19.256 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:19.253+0000 7f5581c3f640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f557c102c80 0x7f557c1134c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:53924/0 (socket says 172.21.15.121:53924) 2024-08-18T22:53:19.257 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:19.253+0000 7f5581c3f640 1 -- 172.21.15.121:0/2544764742 learned_addr learned my addr 172.21.15.121:0/2544764742 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-18T22:53:19.257 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:19.253+0000 7f5582440640 1 --2- 172.21.15.121:0/2544764742 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f557c1022e0 0x7f557c112f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:53:19.257 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:19.253+0000 7f5581c3f640 1 -- 172.21.15.121:0/2544764742 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f557c1022e0 msgr2=0x7f557c112f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:53:19.257 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:19.253+0000 7f5581c3f640 1 --2- 172.21.15.121:0/2544764742 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f557c1022e0 0x7f557c112f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:53:19.257 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:19.253+0000 7f5581c3f640 1 -- 172.21.15.121:0/2544764742 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f556c005040 con 0x7f557c102c80 2024-08-18T22:53:19.257 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:19.253+0000 7f5581c3f640 1 --2- 172.21.15.121:0/2544764742 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f557c102c80 0x7f557c1134c0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f556c000c00 tx=0x7f556c009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:53:19.257 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:19.253+0000 7f5572ffd640 1 -- 172.21.15.121:0/2544764742 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f556c038070 con 0x7f557c102c80 2024-08-18T22:53:19.257 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:19.253+0000 7f55846a4640 1 -- 172.21.15.121:0/2544764742 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f557c10d180 con 0x7f557c102c80 2024-08-18T22:53:19.257 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:19.253+0000 7f5572ffd640 1 -- 172.21.15.121:0/2544764742 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f556c02ade0 con 0x7f557c102c80 2024-08-18T22:53:19.257 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:19.253+0000 7f5572ffd640 1 -- 172.21.15.121:0/2544764742 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f556c02c7e0 con 0x7f557c102c80 2024-08-18T22:53:19.257 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:19.253+0000 7f55846a4640 1 -- 172.21.15.121:0/2544764742 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f557c10d6c0 con 0x7f557c102c80 2024-08-18T22:53:19.258 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:19.255+0000 7f55846a4640 1 -- 172.21.15.121:0/2544764742 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f557c0fda50 con 0x7f557c102c80 2024-08-18T22:53:19.258 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:19.255+0000 7f5572ffd640 1 -- 172.21.15.121:0/2544764742 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 37) v1 ==== 92205+0+0 (secure 0 0 0) 0x7f556c030020 con 0x7f557c102c80 2024-08-18T22:53:19.258 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:19.255+0000 7f5572ffd640 1 --2- 172.21.15.121:0/2544764742 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f556806e0b0 0x7f5568070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:53:19.258 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:19.255+0000 7f5572ffd640 1 -- 172.21.15.121:0/2544764742 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6668+0+0 (secure 0 0 0) 0x7f556c0ad8c0 con 0x7f557c102c80 2024-08-18T22:53:19.259 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:19.255+0000 7f5582440640 1 --2- 172.21.15.121:0/2544764742 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f556806e0b0 0x7f5568070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:53:19.259 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:19.256+0000 7f5582440640 1 --2- 172.21.15.121:0/2544764742 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f556806e0b0 0x7f5568070560 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f5578004ed0 tx=0x7f557800b040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:53:19.260 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:19.260+0000 7f5572ffd640 1 -- 172.21.15.121:0/2544764742 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f556c076bf0 con 0x7f557c102c80 2024-08-18T22:53:19.459 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:19.459+0000 7f55846a4640 1 -- 172.21.15.121:0/2544764742 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 27, "format": "json"} v 0) v1 -- 0x7f557c1092f0 con 0x7f557c102c80 2024-08-18T22:53:19.460 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:19.459+0000 7f5572ffd640 1 -- 172.21.15.121:0/2544764742 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 27, "format": "json"}]=0 dumped fsmap epoch 27 v46) v1 ==== 107+0+4910 (secure 0 0 0) 0x7f556c07a2b0 con 0x7f557c102c80 2024-08-18T22:53:19.460 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-08-18T22:53:19.460 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":27,"btime":"2024-08-18T22:48:17:965016+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14490,"name":"cephfs.smithi121.xuzsdg","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6827/91588128","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":91588128},{"type":"v1","addr":"172.21.15.121:6827","nonce":91588128}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":14},{"gid":24259,"name":"cephfs.smithi195.nptgyc","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.195:6827/238549847","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":238549847},{"type":"v1","addr":"172.21.15.195:6827","nonce":238549847}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15},{"gid":44267,"name":"cephfs.smithi195.buqvbr","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6825/110644516","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":110644516},{"type":"v1","addr":"172.21.15.195:6825","nonce":110644516}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-18T22:39:04.054074+0000","modified":"2024-08-18T22:48:16.251573+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":47,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":14474},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_14474":{"gid":14474,"name":"cephfs.smithi121.gbickb","rank":0,"incarnation":13,"state":"up:active","state_seq":83,"addr":"172.21.15.121:6829/2277706406","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6828","nonce":2277706406},{"type":"v1","addr":"172.21.15.121:6829","nonce":2277706406}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":14474,"qdb_cluster":[14474]},"id":1}]} 2024-08-18T22:53:19.461 INFO:teuthology.orchestra.run.smithi121.stderr:dumped fsmap epoch 27 2024-08-18T22:53:19.462 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:19.461+0000 7f55846a4640 1 -- 172.21.15.121:0/2544764742 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f556806e0b0 msgr2=0x7f5568070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:53:19.462 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:19.461+0000 7f55846a4640 1 --2- 172.21.15.121:0/2544764742 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f556806e0b0 0x7f5568070560 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f5578004ed0 tx=0x7f557800b040 comp rx=0 tx=0).stop 2024-08-18T22:53:19.463 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:19.461+0000 7f55846a4640 1 -- 172.21.15.121:0/2544764742 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f557c102c80 msgr2=0x7f557c1134c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:53:19.463 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:19.461+0000 7f55846a4640 1 --2- 172.21.15.121:0/2544764742 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f557c102c80 0x7f557c1134c0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f556c000c00 tx=0x7f556c009da0 comp rx=0 tx=0).stop 2024-08-18T22:53:19.463 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:19.461+0000 7f55846a4640 1 -- 172.21.15.121:0/2544764742 shutdown_connections 2024-08-18T22:53:19.463 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:19.461+0000 7f55846a4640 1 --2- 172.21.15.121:0/2544764742 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f556806e0b0 0x7f5568070560 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:53:19.463 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:19.461+0000 7f55846a4640 1 --2- 172.21.15.121:0/2544764742 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f557c102c80 0x7f557c1134c0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:53:19.463 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:19.461+0000 7f55846a4640 1 --2- 172.21.15.121:0/2544764742 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f557c1022e0 0x7f557c112f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:53:19.463 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:19.461+0000 7f55846a4640 1 -- 172.21.15.121:0/2544764742 >> 172.21.15.121:0/2544764742 conn(0x7f557c0f7eb0 msgr2=0x7f557c0f8fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:53:19.463 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:19.462+0000 7f55846a4640 1 -- 172.21.15.121:0/2544764742 shutdown_connections 2024-08-18T22:53:19.463 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:19.462+0000 7f55846a4640 1 -- 172.21.15.121:0/2544764742 wait complete. 2024-08-18T22:53:20.017 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:53:19 smithi121 ceph-mon[81053]: pgmap v327: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:53:20.017 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:53:19 smithi121 ceph-mon[81053]: from='client.? 172.21.15.121:0/2544764742' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 27, "format": "json"}]: dispatch 2024-08-18T22:53:20.147 DEBUG:tasks.fs:max_mds reduced in epoch 27 2024-08-18T22:53:20.148 DEBUG:teuthology.orchestra.run.smithi121:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid b003123a-5db1-11ef-bccf-c7b262605968 -- ceph fs dump --format=json 28 2024-08-18T22:53:20.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:53:19 smithi195 ceph-mon[68841]: pgmap v327: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:53:20.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:53:19 smithi195 ceph-mon[68841]: from='client.? 172.21.15.121:0/2544764742' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 27, "format": "json"}]: dispatch 2024-08-18T22:53:20.396 INFO:teuthology.orchestra.run.smithi121.stderr:Inferring config /var/lib/ceph/b003123a-5db1-11ef-bccf-c7b262605968/mon.smithi121/config 2024-08-18T22:53:21.978 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:53:21 smithi121 ceph-mon[81053]: pgmap v328: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:53:22.010 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:21.977+0000 7fb41c602640 1 -- 172.21.15.121:0/1364289678 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb414102330 msgr2=0x7fb414102700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:53:22.010 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:21.977+0000 7fb41c602640 1 --2- 172.21.15.121:0/1364289678 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb414102330 0x7fb414102700 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fb4100048d0 tx=0x7fb410009da0 comp rx=0 tx=0).stop 2024-08-18T22:53:22.011 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:21.977+0000 7fb41c602640 1 -- 172.21.15.121:0/1364289678 shutdown_connections 2024-08-18T22:53:22.011 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:21.977+0000 7fb41c602640 1 --2- 172.21.15.121:0/1364289678 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb414102cd0 0x7fb4140faa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:53:22.011 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:21.977+0000 7fb41c602640 1 --2- 172.21.15.121:0/1364289678 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb414102330 0x7fb414102700 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:53:22.011 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:21.977+0000 7fb41c602640 1 -- 172.21.15.121:0/1364289678 >> 172.21.15.121:0/1364289678 conn(0x7fb414070a80 msgr2=0x7fb414070e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:53:22.011 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:21.977+0000 7fb41c602640 1 -- 172.21.15.121:0/1364289678 shutdown_connections 2024-08-18T22:53:22.011 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:21.977+0000 7fb41c602640 1 -- 172.21.15.121:0/1364289678 wait complete. 2024-08-18T22:53:22.011 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:21.977+0000 7fb41c602640 1 Processor -- start 2024-08-18T22:53:22.011 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:21.977+0000 7fb41c602640 1 -- start start 2024-08-18T22:53:22.011 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:21.978+0000 7fb41c602640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb414102330 0x7fb414113090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:53:22.011 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:21.978+0000 7fb41c602640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb414102cd0 0x7fb4141135d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:53:22.011 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:21.978+0000 7fb41c602640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb414113bd0 con 0x7fb414102330 2024-08-18T22:53:22.011 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:21.978+0000 7fb41c602640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb41410d010 con 0x7fb414102cd0 2024-08-18T22:53:22.012 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:21.978+0000 7fb41a39e640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb414102330 0x7fb414113090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:53:22.012 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:21.978+0000 7fb41a39e640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb414102330 0x7fb414113090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:53950/0 (socket says 172.21.15.121:53950) 2024-08-18T22:53:22.012 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:21.978+0000 7fb41a39e640 1 -- 172.21.15.121:0/432368977 learned_addr learned my addr 172.21.15.121:0/432368977 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-18T22:53:22.012 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:21.978+0000 7fb419b9d640 1 --2- 172.21.15.121:0/432368977 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb414102cd0 0x7fb4141135d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:53:22.012 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:21.978+0000 7fb41a39e640 1 -- 172.21.15.121:0/432368977 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb414102cd0 msgr2=0x7fb4141135d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:53:22.012 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:21.978+0000 7fb41a39e640 1 --2- 172.21.15.121:0/432368977 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb414102cd0 0x7fb4141135d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:53:22.012 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:21.978+0000 7fb41a39e640 1 -- 172.21.15.121:0/432368977 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb410005040 con 0x7fb414102330 2024-08-18T22:53:22.012 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:21.978+0000 7fb419b9d640 1 --2- 172.21.15.121:0/432368977 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb414102cd0 0x7fb4141135d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:53:22.012 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:21.978+0000 7fb41a39e640 1 --2- 172.21.15.121:0/432368977 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb414102330 0x7fb414113090 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fb410003080 tx=0x7fb410009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:53:22.012 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:21.978+0000 7fb406ffd640 1 -- 172.21.15.121:0/432368977 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb410038070 con 0x7fb414102330 2024-08-18T22:53:22.012 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:21.978+0000 7fb41c602640 1 -- 172.21.15.121:0/432368977 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb41410d290 con 0x7fb414102330 2024-08-18T22:53:22.012 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:21.978+0000 7fb406ffd640 1 -- 172.21.15.121:0/432368977 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fb410009760 con 0x7fb414102330 2024-08-18T22:53:22.012 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:21.978+0000 7fb406ffd640 1 -- 172.21.15.121:0/432368977 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb410033420 con 0x7fb414102330 2024-08-18T22:53:22.013 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:21.978+0000 7fb41c602640 1 -- 172.21.15.121:0/432368977 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb41410d6f0 con 0x7fb414102330 2024-08-18T22:53:22.013 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:21.979+0000 7fb41c602640 1 -- 172.21.15.121:0/432368977 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb414065550 con 0x7fb414102330 2024-08-18T22:53:22.013 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:21.980+0000 7fb406ffd640 1 -- 172.21.15.121:0/432368977 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 37) v1 ==== 92205+0+0 (secure 0 0 0) 0x7fb410030020 con 0x7fb414102330 2024-08-18T22:53:22.013 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:21.980+0000 7fb406ffd640 1 --2- 172.21.15.121:0/432368977 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7fb40006e0b0 0x7fb400070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:53:22.013 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:21.980+0000 7fb406ffd640 1 -- 172.21.15.121:0/432368977 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6668+0+0 (secure 0 0 0) 0x7fb4100ada20 con 0x7fb414102330 2024-08-18T22:53:22.013 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:21.980+0000 7fb419b9d640 1 --2- 172.21.15.121:0/432368977 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7fb40006e0b0 0x7fb400070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:53:22.013 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:21.981+0000 7fb419b9d640 1 --2- 172.21.15.121:0/432368977 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7fb40006e0b0 0x7fb400070560 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fb41410e950 tx=0x7fb408009040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:53:22.013 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:21.984+0000 7fb406ffd640 1 -- 172.21.15.121:0/432368977 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7fb410076ca0 con 0x7fb414102330 2024-08-18T22:53:22.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:53:21 smithi195 ceph-mon[68841]: pgmap v328: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:53:22.188 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:22.187+0000 7fb41c602640 1 -- 172.21.15.121:0/432368977 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 28, "format": "json"} v 0) v1 -- 0x7fb4140749f0 con 0x7fb414102330 2024-08-18T22:53:22.188 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:22.187+0000 7fb406ffd640 1 -- 172.21.15.121:0/432368977 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 28, "format": "json"}]=0 dumped fsmap epoch 28 v46) v1 ==== 107+0+4134 (secure 0 0 0) 0x7fb41007a360 con 0x7fb414102330 2024-08-18T22:53:22.188 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-08-18T22:53:22.189 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":28,"btime":"2024-08-18T22:48:29:653921+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24259,"name":"cephfs.smithi195.nptgyc","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.195:6827/238549847","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":238549847},{"type":"v1","addr":"172.21.15.195:6827","nonce":238549847}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15},{"gid":44267,"name":"cephfs.smithi195.buqvbr","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6825/110644516","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":110644516},{"type":"v1","addr":"172.21.15.195:6825","nonce":110644516}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-18T22:39:04.054074+0000","modified":"2024-08-18T22:48:16.251573+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":47,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":14474},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_14474":{"gid":14474,"name":"cephfs.smithi121.gbickb","rank":0,"incarnation":13,"state":"up:active","state_seq":83,"addr":"172.21.15.121:6829/2277706406","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6828","nonce":2277706406},{"type":"v1","addr":"172.21.15.121:6829","nonce":2277706406}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":14474,"qdb_cluster":[14474]},"id":1}]} 2024-08-18T22:53:22.189 INFO:teuthology.orchestra.run.smithi121.stderr:dumped fsmap epoch 28 2024-08-18T22:53:22.191 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:22.190+0000 7fb41c602640 1 -- 172.21.15.121:0/432368977 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7fb40006e0b0 msgr2=0x7fb400070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:53:22.191 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:22.190+0000 7fb41c602640 1 --2- 172.21.15.121:0/432368977 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7fb40006e0b0 0x7fb400070560 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fb41410e950 tx=0x7fb408009040 comp rx=0 tx=0).stop 2024-08-18T22:53:22.191 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:22.190+0000 7fb41c602640 1 -- 172.21.15.121:0/432368977 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb414102330 msgr2=0x7fb414113090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:53:22.191 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:22.190+0000 7fb41c602640 1 --2- 172.21.15.121:0/432368977 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb414102330 0x7fb414113090 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fb410003080 tx=0x7fb410009da0 comp rx=0 tx=0).stop 2024-08-18T22:53:22.191 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:22.190+0000 7fb41c602640 1 -- 172.21.15.121:0/432368977 shutdown_connections 2024-08-18T22:53:22.191 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:22.190+0000 7fb41c602640 1 --2- 172.21.15.121:0/432368977 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7fb40006e0b0 0x7fb400070560 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:53:22.191 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:22.190+0000 7fb41c602640 1 --2- 172.21.15.121:0/432368977 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb414102cd0 0x7fb4141135d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:53:22.191 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:22.190+0000 7fb41c602640 1 --2- 172.21.15.121:0/432368977 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb414102330 0x7fb414113090 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:53:22.191 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:22.190+0000 7fb41c602640 1 -- 172.21.15.121:0/432368977 >> 172.21.15.121:0/432368977 conn(0x7fb414070a80 msgr2=0x7fb4140f9490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:53:22.191 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:22.190+0000 7fb41c602640 1 -- 172.21.15.121:0/432368977 shutdown_connections 2024-08-18T22:53:22.192 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:22.190+0000 7fb41c602640 1 -- 172.21.15.121:0/432368977 wait complete. 2024-08-18T22:53:22.894 DEBUG:tasks.fs:max_mds reduced in epoch 28 2024-08-18T22:53:22.895 DEBUG:teuthology.orchestra.run.smithi121:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid b003123a-5db1-11ef-bccf-c7b262605968 -- ceph fs dump --format=json 29 2024-08-18T22:53:23.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:53:22 smithi121 ceph-mon[81053]: from='client.? 172.21.15.121:0/432368977' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 28, "format": "json"}]: dispatch 2024-08-18T22:53:23.146 INFO:teuthology.orchestra.run.smithi121.stderr:Inferring config /var/lib/ceph/b003123a-5db1-11ef-bccf-c7b262605968/mon.smithi121/config 2024-08-18T22:53:23.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:53:22 smithi195 ceph-mon[68841]: from='client.? 172.21.15.121:0/432368977' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 28, "format": "json"}]: dispatch 2024-08-18T22:53:23.952 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:53:23 smithi121 ceph-mon[81053]: pgmap v329: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:53:23.952 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:53:23 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-18T22:53:24.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:53:23 smithi195 ceph-mon[68841]: pgmap v329: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:53:24.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:53:23 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-18T22:53:24.700 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:24.698+0000 7fde7a497640 1 -- 172.21.15.121:0/2062865004 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fde74101ba0 msgr2=0x7fde740fb230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:53:24.700 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:24.698+0000 7fde7a497640 1 --2- 172.21.15.121:0/2062865004 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fde74101ba0 0x7fde740fb230 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fde680048d0 tx=0x7fde68009da0 comp rx=0 tx=0).stop 2024-08-18T22:53:24.700 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:24.699+0000 7fde7a497640 1 -- 172.21.15.121:0/2062865004 shutdown_connections 2024-08-18T22:53:24.700 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:24.699+0000 7fde7a497640 1 --2- 172.21.15.121:0/2062865004 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fde74101ba0 0x7fde740fb230 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:53:24.700 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:24.699+0000 7fde7a497640 1 --2- 172.21.15.121:0/2062865004 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fde74101200 0x7fde741015d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:53:24.700 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:24.699+0000 7fde7a497640 1 -- 172.21.15.121:0/2062865004 >> 172.21.15.121:0/2062865004 conn(0x7fde740f6df0 msgr2=0x7fde740f9200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:53:24.700 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:24.699+0000 7fde7a497640 1 -- 172.21.15.121:0/2062865004 shutdown_connections 2024-08-18T22:53:24.700 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:24.699+0000 7fde7a497640 1 -- 172.21.15.121:0/2062865004 wait complete. 2024-08-18T22:53:24.701 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:24.699+0000 7fde7a497640 1 Processor -- start 2024-08-18T22:53:24.701 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:24.699+0000 7fde7a497640 1 -- start start 2024-08-18T22:53:24.702 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:24.699+0000 7fde7a497640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fde74101200 0x7fde74111ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:53:24.702 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:24.699+0000 7fde7a497640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fde74101ba0 0x7fde74112410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:53:24.703 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:24.699+0000 7fde7a497640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde74112aa0 con 0x7fde74101ba0 2024-08-18T22:53:24.703 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:24.699+0000 7fde7a497640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde7410be50 con 0x7fde74101200 2024-08-18T22:53:24.703 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:24.700+0000 7fde737fe640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fde74101ba0 0x7fde74112410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:53:24.703 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:24.700+0000 7fde737fe640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fde74101ba0 0x7fde74112410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:53964/0 (socket says 172.21.15.121:53964) 2024-08-18T22:53:24.703 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:24.700+0000 7fde737fe640 1 -- 172.21.15.121:0/1509769600 learned_addr learned my addr 172.21.15.121:0/1509769600 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-18T22:53:24.703 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:24.700+0000 7fde73fff640 1 --2- 172.21.15.121:0/1509769600 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fde74101200 0x7fde74111ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:53:24.703 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:24.700+0000 7fde737fe640 1 -- 172.21.15.121:0/1509769600 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fde74101200 msgr2=0x7fde74111ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:53:24.703 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:24.700+0000 7fde737fe640 1 --2- 172.21.15.121:0/1509769600 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fde74101200 0x7fde74111ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:53:24.703 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:24.700+0000 7fde737fe640 1 -- 172.21.15.121:0/1509769600 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde68005040 con 0x7fde74101ba0 2024-08-18T22:53:24.703 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:24.700+0000 7fde737fe640 1 --2- 172.21.15.121:0/1509769600 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fde74101ba0 0x7fde74112410 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fde68003080 tx=0x7fde68009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:53:24.703 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:24.700+0000 7fde70ff9640 1 -- 172.21.15.121:0/1509769600 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fde68038070 con 0x7fde74101ba0 2024-08-18T22:53:24.703 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:24.700+0000 7fde70ff9640 1 -- 172.21.15.121:0/1509769600 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fde6802ade0 con 0x7fde74101ba0 2024-08-18T22:53:24.703 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:24.700+0000 7fde7a497640 1 -- 172.21.15.121:0/1509769600 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde7410c0d0 con 0x7fde74101ba0 2024-08-18T22:53:24.703 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:24.700+0000 7fde70ff9640 1 -- 172.21.15.121:0/1509769600 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fde6802c880 con 0x7fde74101ba0 2024-08-18T22:53:24.704 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:24.700+0000 7fde7a497640 1 -- 172.21.15.121:0/1509769600 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde7410c530 con 0x7fde74101ba0 2024-08-18T22:53:24.704 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:24.702+0000 7fde7a497640 1 -- 172.21.15.121:0/1509769600 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde740fc970 con 0x7fde74101ba0 2024-08-18T22:53:24.704 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:24.702+0000 7fde70ff9640 1 -- 172.21.15.121:0/1509769600 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 37) v1 ==== 92205+0+0 (secure 0 0 0) 0x7fde68030020 con 0x7fde74101ba0 2024-08-18T22:53:24.704 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:24.702+0000 7fde70ff9640 1 --2- 172.21.15.121:0/1509769600 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7fde5c06e0b0 0x7fde5c070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:53:24.704 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:24.703+0000 7fde70ff9640 1 -- 172.21.15.121:0/1509769600 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6668+0+0 (secure 0 0 0) 0x7fde680adc40 con 0x7fde74101ba0 2024-08-18T22:53:24.704 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:24.703+0000 7fde73fff640 1 --2- 172.21.15.121:0/1509769600 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7fde5c06e0b0 0x7fde5c070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:53:24.705 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:24.703+0000 7fde73fff640 1 --2- 172.21.15.121:0/1509769600 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7fde5c06e0b0 0x7fde5c070560 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fde64006fd0 tx=0x7fde64008040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:53:24.708 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:24.707+0000 7fde70ff9640 1 -- 172.21.15.121:0/1509769600 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7fde68076f40 con 0x7fde74101ba0 2024-08-18T22:53:24.913 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:24.912+0000 7fde7a497640 1 -- 172.21.15.121:0/1509769600 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 29, "format": "json"} v 0) v1 -- 0x7fde740fa9f0 con 0x7fde74101ba0 2024-08-18T22:53:24.914 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:24.913+0000 7fde70ff9640 1 -- 172.21.15.121:0/1509769600 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 29, "format": "json"}]=0 dumped fsmap epoch 29 v46) v1 ==== 107+0+4984 (secure 0 0 0) 0x7fde6807a600 con 0x7fde74101ba0 2024-08-18T22:53:24.914 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-08-18T22:53:24.914 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":29,"btime":"2024-08-18T22:48:33:668477+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24259,"name":"cephfs.smithi195.nptgyc","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.195:6827/238549847","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":238549847},{"type":"v1","addr":"172.21.15.195:6827","nonce":238549847}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15},{"gid":34404,"name":"cephfs.smithi121.xuzsdg","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6827/4267588865","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":4267588865},{"type":"v1","addr":"172.21.15.121:6827","nonce":4267588865}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":29},{"gid":44267,"name":"cephfs.smithi195.buqvbr","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6825/110644516","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":110644516},{"type":"v1","addr":"172.21.15.195:6825","nonce":110644516}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-18T22:39:04.054074+0000","modified":"2024-08-18T22:48:16.251573+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":47,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":14474},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_14474":{"gid":14474,"name":"cephfs.smithi121.gbickb","rank":0,"incarnation":13,"state":"up:active","state_seq":83,"addr":"172.21.15.121:6829/2277706406","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6828","nonce":2277706406},{"type":"v1","addr":"172.21.15.121:6829","nonce":2277706406}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":14474,"qdb_cluster":[14474]},"id":1}]} 2024-08-18T22:53:24.914 INFO:teuthology.orchestra.run.smithi121.stderr:dumped fsmap epoch 29 2024-08-18T22:53:24.916 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:24.915+0000 7fde7a497640 1 -- 172.21.15.121:0/1509769600 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7fde5c06e0b0 msgr2=0x7fde5c070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:53:24.916 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:24.915+0000 7fde7a497640 1 --2- 172.21.15.121:0/1509769600 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7fde5c06e0b0 0x7fde5c070560 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fde64006fd0 tx=0x7fde64008040 comp rx=0 tx=0).stop 2024-08-18T22:53:24.916 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:24.915+0000 7fde7a497640 1 -- 172.21.15.121:0/1509769600 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fde74101ba0 msgr2=0x7fde74112410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:53:24.916 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:24.915+0000 7fde7a497640 1 --2- 172.21.15.121:0/1509769600 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fde74101ba0 0x7fde74112410 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fde68003080 tx=0x7fde68009da0 comp rx=0 tx=0).stop 2024-08-18T22:53:24.916 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:24.915+0000 7fde7a497640 1 -- 172.21.15.121:0/1509769600 shutdown_connections 2024-08-18T22:53:24.916 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:24.915+0000 7fde7a497640 1 --2- 172.21.15.121:0/1509769600 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7fde5c06e0b0 0x7fde5c070560 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:53:24.916 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:24.915+0000 7fde7a497640 1 --2- 172.21.15.121:0/1509769600 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fde74101ba0 0x7fde74112410 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:53:24.917 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:24.915+0000 7fde7a497640 1 --2- 172.21.15.121:0/1509769600 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fde74101200 0x7fde74111ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:53:24.917 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:24.915+0000 7fde7a497640 1 -- 172.21.15.121:0/1509769600 >> 172.21.15.121:0/1509769600 conn(0x7fde740f6df0 msgr2=0x7fde740f7dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:53:24.917 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:24.915+0000 7fde7a497640 1 -- 172.21.15.121:0/1509769600 shutdown_connections 2024-08-18T22:53:24.917 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:24.915+0000 7fde7a497640 1 -- 172.21.15.121:0/1509769600 wait complete. 2024-08-18T22:53:25.722 DEBUG:tasks.fs:max_mds reduced in epoch 29 2024-08-18T22:53:25.723 DEBUG:teuthology.orchestra.run.smithi121:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid b003123a-5db1-11ef-bccf-c7b262605968 -- ceph fs dump --format=json 30 2024-08-18T22:53:25.977 INFO:teuthology.orchestra.run.smithi121.stderr:Inferring config /var/lib/ceph/b003123a-5db1-11ef-bccf-c7b262605968/mon.smithi121/config 2024-08-18T22:53:26.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:53:25 smithi121 ceph-mon[81053]: pgmap v330: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:53:26.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:53:25 smithi121 ceph-mon[81053]: from='client.? 172.21.15.121:0/1509769600' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 29, "format": "json"}]: dispatch 2024-08-18T22:53:26.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:53:25 smithi195 ceph-mon[68841]: pgmap v330: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:53:26.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:53:25 smithi195 ceph-mon[68841]: from='client.? 172.21.15.121:0/1509769600' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 29, "format": "json"}]: dispatch 2024-08-18T22:53:27.633 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:27.630+0000 7f9cfdc53640 1 -- 172.21.15.121:0/3213356556 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9cf81022e0 msgr2=0x7f9cf81026b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:53:27.633 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:27.630+0000 7f9cfdc53640 1 --2- 172.21.15.121:0/3213356556 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9cf81022e0 0x7f9cf81026b0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f9ce80048d0 tx=0x7f9ce8009da0 comp rx=0 tx=0).stop 2024-08-18T22:53:27.633 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:27.630+0000 7f9cfdc53640 1 -- 172.21.15.121:0/3213356556 shutdown_connections 2024-08-18T22:53:27.633 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:27.630+0000 7f9cfdc53640 1 --2- 172.21.15.121:0/3213356556 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9cf8102c80 0x7f9cf80fc310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:53:27.634 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:27.630+0000 7f9cfdc53640 1 --2- 172.21.15.121:0/3213356556 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9cf81022e0 0x7f9cf81026b0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:53:27.634 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:27.630+0000 7f9cfdc53640 1 -- 172.21.15.121:0/3213356556 >> 172.21.15.121:0/3213356556 conn(0x7f9cf80f7e90 msgr2=0x7f9cf80fa2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:53:27.634 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:27.630+0000 7f9cfdc53640 1 -- 172.21.15.121:0/3213356556 shutdown_connections 2024-08-18T22:53:27.634 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:27.630+0000 7f9cfdc53640 1 -- 172.21.15.121:0/3213356556 wait complete. 2024-08-18T22:53:27.634 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:27.631+0000 7f9cfdc53640 1 Processor -- start 2024-08-18T22:53:27.634 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:27.631+0000 7f9cfdc53640 1 -- start start 2024-08-18T22:53:27.634 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:27.631+0000 7f9cfdc53640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9cf81022e0 0x7f9cf8112fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:53:27.634 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:27.631+0000 7f9cfdc53640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9cf8102c80 0x7f9cf8113520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:53:27.634 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:27.631+0000 7f9cfdc53640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cf8113bb0 con 0x7f9cf81022e0 2024-08-18T22:53:27.634 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:27.631+0000 7f9cfdc53640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cf810cf60 con 0x7f9cf8102c80 2024-08-18T22:53:27.635 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:27.631+0000 7f9cf77fe640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9cf81022e0 0x7f9cf8112fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:53:27.635 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:27.631+0000 7f9cf77fe640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9cf81022e0 0x7f9cf8112fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:47070/0 (socket says 172.21.15.121:47070) 2024-08-18T22:53:27.635 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:27.631+0000 7f9cf77fe640 1 -- 172.21.15.121:0/671500294 learned_addr learned my addr 172.21.15.121:0/671500294 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-18T22:53:27.635 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:27.632+0000 7f9cf6ffd640 1 --2- 172.21.15.121:0/671500294 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9cf8102c80 0x7f9cf8113520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:53:27.635 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:27.632+0000 7f9cf77fe640 1 -- 172.21.15.121:0/671500294 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9cf8102c80 msgr2=0x7f9cf8113520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:53:27.635 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:27.632+0000 7f9cf77fe640 1 --2- 172.21.15.121:0/671500294 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9cf8102c80 0x7f9cf8113520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:53:27.635 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:27.632+0000 7f9cf77fe640 1 -- 172.21.15.121:0/671500294 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ce8005040 con 0x7f9cf81022e0 2024-08-18T22:53:27.635 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:27.632+0000 7f9cf77fe640 1 --2- 172.21.15.121:0/671500294 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9cf81022e0 0x7f9cf8112fe0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f9ce8003080 tx=0x7f9ce8009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:53:27.635 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:27.632+0000 7f9cdffff640 1 -- 172.21.15.121:0/671500294 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9ce8038070 con 0x7f9cf81022e0 2024-08-18T22:53:27.635 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:27.632+0000 7f9cdffff640 1 -- 172.21.15.121:0/671500294 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f9ce80097e0 con 0x7f9cf81022e0 2024-08-18T22:53:27.635 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:27.632+0000 7f9cfdc53640 1 -- 172.21.15.121:0/671500294 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9cf810d1e0 con 0x7f9cf81022e0 2024-08-18T22:53:27.635 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:27.632+0000 7f9cdffff640 1 -- 172.21.15.121:0/671500294 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9ce803d420 con 0x7f9cf81022e0 2024-08-18T22:53:27.636 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:27.632+0000 7f9cfdc53640 1 -- 172.21.15.121:0/671500294 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9cf810d6a0 con 0x7f9cf81022e0 2024-08-18T22:53:27.637 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:27.633+0000 7f9cfdc53640 1 -- 172.21.15.121:0/671500294 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9cf80fda50 con 0x7f9cf81022e0 2024-08-18T22:53:27.637 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:27.634+0000 7f9cdffff640 1 -- 172.21.15.121:0/671500294 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 37) v1 ==== 92205+0+0 (secure 0 0 0) 0x7f9ce8030020 con 0x7f9cf81022e0 2024-08-18T22:53:27.637 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:27.634+0000 7f9cdffff640 1 --2- 172.21.15.121:0/671500294 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f9ce006e0b0 0x7f9ce0070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:53:27.637 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:27.634+0000 7f9cdffff640 1 -- 172.21.15.121:0/671500294 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6668+0+0 (secure 0 0 0) 0x7f9ce80ae210 con 0x7f9cf81022e0 2024-08-18T22:53:27.637 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:27.634+0000 7f9cf6ffd640 1 --2- 172.21.15.121:0/671500294 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f9ce006e0b0 0x7f9ce0070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:53:27.637 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:27.634+0000 7f9cf6ffd640 1 --2- 172.21.15.121:0/671500294 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f9ce006e0b0 0x7f9ce0070560 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f9cec006fd0 tx=0x7f9cec008040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:53:27.639 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:27.638+0000 7f9cdffff640 1 -- 172.21.15.121:0/671500294 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f9ce8077490 con 0x7f9cf81022e0 2024-08-18T22:53:27.840 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:27.839+0000 7f9cfdc53640 1 -- 172.21.15.121:0/671500294 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 30, "format": "json"} v 0) v1 -- 0x7f9cf80fbad0 con 0x7f9cf81022e0 2024-08-18T22:53:27.841 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:27.840+0000 7f9cdffff640 1 -- 172.21.15.121:0/671500294 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 30, "format": "json"}]=0 dumped fsmap epoch 30 v46) v1 ==== 107+0+4181 (secure 0 0 0) 0x7f9ce807ab50 con 0x7f9cf81022e0 2024-08-18T22:53:27.841 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-08-18T22:53:27.841 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":30,"btime":"2024-08-18T22:48:45:429286+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24259,"name":"cephfs.smithi195.nptgyc","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.195:6827/238549847","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":238549847},{"type":"v1","addr":"172.21.15.195:6827","nonce":238549847}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15},{"gid":34404,"name":"cephfs.smithi121.xuzsdg","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6827/4267588865","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":4267588865},{"type":"v1","addr":"172.21.15.121:6827","nonce":4267588865}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":29},{"gid":44267,"name":"cephfs.smithi195.buqvbr","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6825/110644516","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":110644516},{"type":"v1","addr":"172.21.15.195:6825","nonce":110644516}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27}],"filesystems":[{"mdsmap":{"epoch":30,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-18T22:39:04.054074+0000","modified":"2024-08-18T22:48:45.429284+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":82,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[1],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-08-18T22:53:27.842 INFO:teuthology.orchestra.run.smithi121.stderr:dumped fsmap epoch 30 2024-08-18T22:53:27.843 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:27.842+0000 7f9cfdc53640 1 -- 172.21.15.121:0/671500294 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f9ce006e0b0 msgr2=0x7f9ce0070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:53:27.843 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:27.842+0000 7f9cfdc53640 1 --2- 172.21.15.121:0/671500294 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f9ce006e0b0 0x7f9ce0070560 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f9cec006fd0 tx=0x7f9cec008040 comp rx=0 tx=0).stop 2024-08-18T22:53:27.843 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:27.842+0000 7f9cfdc53640 1 -- 172.21.15.121:0/671500294 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9cf81022e0 msgr2=0x7f9cf8112fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:53:27.843 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:27.842+0000 7f9cfdc53640 1 --2- 172.21.15.121:0/671500294 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9cf81022e0 0x7f9cf8112fe0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f9ce8003080 tx=0x7f9ce8009da0 comp rx=0 tx=0).stop 2024-08-18T22:53:27.843 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:27.842+0000 7f9cfdc53640 1 -- 172.21.15.121:0/671500294 shutdown_connections 2024-08-18T22:53:27.843 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:27.842+0000 7f9cfdc53640 1 --2- 172.21.15.121:0/671500294 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f9ce006e0b0 0x7f9ce0070560 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:53:27.843 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:27.842+0000 7f9cfdc53640 1 --2- 172.21.15.121:0/671500294 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9cf8102c80 0x7f9cf8113520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:53:27.844 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:27.842+0000 7f9cfdc53640 1 --2- 172.21.15.121:0/671500294 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9cf81022e0 0x7f9cf8112fe0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:53:27.844 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:27.842+0000 7f9cfdc53640 1 -- 172.21.15.121:0/671500294 >> 172.21.15.121:0/671500294 conn(0x7f9cf80f7e90 msgr2=0x7f9cf80f8e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:53:27.844 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:27.842+0000 7f9cfdc53640 1 -- 172.21.15.121:0/671500294 shutdown_connections 2024-08-18T22:53:27.844 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:27.842+0000 7f9cfdc53640 1 -- 172.21.15.121:0/671500294 wait complete. 2024-08-18T22:53:28.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:53:27 smithi121 ceph-mon[81053]: pgmap v331: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:53:28.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:53:27 smithi195 ceph-mon[68841]: pgmap v331: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:53:28.508 DEBUG:tasks.fs:max_mds reduced in epoch 30 2024-08-18T22:53:28.509 DEBUG:teuthology.orchestra.run.smithi121:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid b003123a-5db1-11ef-bccf-c7b262605968 -- ceph fs dump --format=json 31 2024-08-18T22:53:28.759 INFO:teuthology.orchestra.run.smithi121.stderr:Inferring config /var/lib/ceph/b003123a-5db1-11ef-bccf-c7b262605968/mon.smithi121/config 2024-08-18T22:53:29.049 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:53:28 smithi121 ceph-mon[81053]: from='client.? 172.21.15.121:0/671500294' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 30, "format": "json"}]: dispatch 2024-08-18T22:53:29.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:53:28 smithi195 ceph-mon[68841]: from='client.? 172.21.15.121:0/671500294' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 30, "format": "json"}]: dispatch 2024-08-18T22:53:29.907 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:53:29 smithi121 ceph-mon[81053]: pgmap v332: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:53:30.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:53:29 smithi195 ceph-mon[68841]: pgmap v332: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:53:30.405 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:30.402+0000 7fca023cb640 1 -- 172.21.15.121:0/2241798358 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc9fc0fd320 msgr2=0x7fc9fc0fd6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:53:30.405 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:30.402+0000 7fca023cb640 1 --2- 172.21.15.121:0/2241798358 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc9fc0fd320 0x7fc9fc0fd6f0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fc9ec0048d0 tx=0x7fc9ec009da0 comp rx=0 tx=0).stop 2024-08-18T22:53:30.405 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:30.403+0000 7fca023cb640 1 -- 172.21.15.121:0/2241798358 shutdown_connections 2024-08-18T22:53:30.405 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:30.403+0000 7fca023cb640 1 --2- 172.21.15.121:0/2241798358 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc9fc0fdcc0 0x7fc9fc106390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:53:30.405 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:30.403+0000 7fca023cb640 1 --2- 172.21.15.121:0/2241798358 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc9fc0fd320 0x7fc9fc0fd6f0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:53:30.405 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:30.403+0000 7fca023cb640 1 -- 172.21.15.121:0/2241798358 >> 172.21.15.121:0/2241798358 conn(0x7fc9fc0f6de0 msgr2=0x7fc9fc0f91f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:53:30.406 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:30.403+0000 7fca023cb640 1 -- 172.21.15.121:0/2241798358 shutdown_connections 2024-08-18T22:53:30.406 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:30.403+0000 7fca023cb640 1 -- 172.21.15.121:0/2241798358 wait complete. 2024-08-18T22:53:30.406 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:30.403+0000 7fca023cb640 1 Processor -- start 2024-08-18T22:53:30.406 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:30.403+0000 7fca023cb640 1 -- start start 2024-08-18T22:53:30.406 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:30.403+0000 7fca023cb640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc9fc0fd320 0x7fc9fc0fb1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:53:30.406 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:30.403+0000 7fca023cb640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc9fc0fdcc0 0x7fc9fc0fb720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:53:30.406 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:30.403+0000 7fca023cb640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9fc0fbc60 con 0x7fc9fc0fd320 2024-08-18T22:53:30.406 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:30.403+0000 7fca023cb640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9fc0fbdd0 con 0x7fc9fc0fdcc0 2024-08-18T22:53:30.406 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:30.404+0000 7fc9fbfff640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc9fc0fd320 0x7fc9fc0fb1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:53:30.406 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:30.404+0000 7fc9fbfff640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc9fc0fd320 0x7fc9fc0fb1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:47090/0 (socket says 172.21.15.121:47090) 2024-08-18T22:53:30.406 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:30.404+0000 7fc9fbfff640 1 -- 172.21.15.121:0/2274731752 learned_addr learned my addr 172.21.15.121:0/2274731752 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-18T22:53:30.406 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:30.404+0000 7fc9fb7fe640 1 --2- 172.21.15.121:0/2274731752 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc9fc0fdcc0 0x7fc9fc0fb720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:53:30.406 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:30.404+0000 7fc9fbfff640 1 -- 172.21.15.121:0/2274731752 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc9fc0fdcc0 msgr2=0x7fc9fc0fb720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:53:30.407 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:30.404+0000 7fc9fbfff640 1 --2- 172.21.15.121:0/2274731752 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc9fc0fdcc0 0x7fc9fc0fb720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:53:30.407 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:30.404+0000 7fc9fbfff640 1 -- 172.21.15.121:0/2274731752 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9ec005040 con 0x7fc9fc0fd320 2024-08-18T22:53:30.407 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:30.404+0000 7fc9fbfff640 1 --2- 172.21.15.121:0/2274731752 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc9fc0fd320 0x7fc9fc0fb1e0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fc9ec003080 tx=0x7fc9ec009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:53:30.407 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:30.404+0000 7fc9f8ff9640 1 -- 172.21.15.121:0/2274731752 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc9ec038070 con 0x7fc9fc0fd320 2024-08-18T22:53:30.407 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:30.404+0000 7fca023cb640 1 -- 172.21.15.121:0/2274731752 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9fc0fc000 con 0x7fc9fc0fd320 2024-08-18T22:53:30.407 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:30.404+0000 7fc9f8ff9640 1 -- 172.21.15.121:0/2274731752 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fc9ec0097e0 con 0x7fc9fc0fd320 2024-08-18T22:53:30.407 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:30.404+0000 7fc9f8ff9640 1 -- 172.21.15.121:0/2274731752 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc9ec03d420 con 0x7fc9fc0fd320 2024-08-18T22:53:30.407 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:30.404+0000 7fca023cb640 1 -- 172.21.15.121:0/2274731752 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9fc1195a0 con 0x7fc9fc0fd320 2024-08-18T22:53:30.408 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:30.405+0000 7fca023cb640 1 -- 172.21.15.121:0/2274731752 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9fc066090 con 0x7fc9fc0fd320 2024-08-18T22:53:30.408 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:30.406+0000 7fc9f8ff9640 1 -- 172.21.15.121:0/2274731752 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 37) v1 ==== 92205+0+0 (secure 0 0 0) 0x7fc9ec030020 con 0x7fc9fc0fd320 2024-08-18T22:53:30.408 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:30.406+0000 7fc9f8ff9640 1 --2- 172.21.15.121:0/2274731752 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7fc9e406e0b0 0x7fc9e4070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:53:30.408 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:30.406+0000 7fc9f8ff9640 1 -- 172.21.15.121:0/2274731752 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6668+0+0 (secure 0 0 0) 0x7fc9ec0ae230 con 0x7fc9fc0fd320 2024-08-18T22:53:30.408 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:30.407+0000 7fc9fb7fe640 1 --2- 172.21.15.121:0/2274731752 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7fc9e406e0b0 0x7fc9e4070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:53:30.408 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:30.407+0000 7fc9fb7fe640 1 --2- 172.21.15.121:0/2274731752 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7fc9e406e0b0 0x7fc9e4070560 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fc9fc0fcb20 tx=0x7fc9f0009040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:53:30.411 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:30.411+0000 7fc9f8ff9640 1 -- 172.21.15.121:0/2274731752 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7fc9ec0774b0 con 0x7fc9fc0fd320 2024-08-18T22:53:30.611 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:30.610+0000 7fca023cb640 1 -- 172.21.15.121:0/2274731752 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 31, "format": "json"} v 0) v1 -- 0x7fc9fc04b4f0 con 0x7fc9fc0fd320 2024-08-18T22:53:30.611 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:30.611+0000 7fc9f8ff9640 1 -- 172.21.15.121:0/2274731752 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 31, "format": "json"}]=0 dumped fsmap epoch 31 v46) v1 ==== 107+0+4192 (secure 0 0 0) 0x7fc9ec07ab70 con 0x7fc9fc0fd320 2024-08-18T22:53:30.612 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-08-18T22:53:30.612 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":31,"btime":"2024-08-18T22:48:45:433716+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34404,"name":"cephfs.smithi121.xuzsdg","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6827/4267588865","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":4267588865},{"type":"v1","addr":"172.21.15.121:6827","nonce":4267588865}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":29},{"gid":44267,"name":"cephfs.smithi195.buqvbr","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6825/110644516","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":110644516},{"type":"v1","addr":"172.21.15.195:6825","nonce":110644516}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27}],"filesystems":[{"mdsmap":{"epoch":31,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-18T22:39:04.054074+0000","modified":"2024-08-18T22:48:45.433708+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":82,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24259},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_24259":{"gid":24259,"name":"cephfs.smithi195.nptgyc","rank":0,"incarnation":31,"state":"up:replay","state_seq":2,"addr":"172.21.15.195:6827/238549847","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":238549847},{"type":"v1","addr":"172.21.15.195:6827","nonce":238549847}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-08-18T22:53:30.612 INFO:teuthology.orchestra.run.smithi121.stderr:dumped fsmap epoch 31 2024-08-18T22:53:30.613 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:30.613+0000 7fca023cb640 1 -- 172.21.15.121:0/2274731752 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7fc9e406e0b0 msgr2=0x7fc9e4070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:53:30.614 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:30.613+0000 7fca023cb640 1 --2- 172.21.15.121:0/2274731752 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7fc9e406e0b0 0x7fc9e4070560 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fc9fc0fcb20 tx=0x7fc9f0009040 comp rx=0 tx=0).stop 2024-08-18T22:53:30.614 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:30.613+0000 7fca023cb640 1 -- 172.21.15.121:0/2274731752 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc9fc0fd320 msgr2=0x7fc9fc0fb1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:53:30.614 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:30.613+0000 7fca023cb640 1 --2- 172.21.15.121:0/2274731752 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc9fc0fd320 0x7fc9fc0fb1e0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fc9ec003080 tx=0x7fc9ec009da0 comp rx=0 tx=0).stop 2024-08-18T22:53:30.614 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:30.613+0000 7fca023cb640 1 -- 172.21.15.121:0/2274731752 shutdown_connections 2024-08-18T22:53:30.614 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:30.613+0000 7fca023cb640 1 --2- 172.21.15.121:0/2274731752 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7fc9e406e0b0 0x7fc9e4070560 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:53:30.614 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:30.613+0000 7fca023cb640 1 --2- 172.21.15.121:0/2274731752 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc9fc0fdcc0 0x7fc9fc0fb720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:53:30.614 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:30.613+0000 7fca023cb640 1 --2- 172.21.15.121:0/2274731752 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc9fc0fd320 0x7fc9fc0fb1e0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:53:30.614 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:30.613+0000 7fca023cb640 1 -- 172.21.15.121:0/2274731752 >> 172.21.15.121:0/2274731752 conn(0x7fc9fc0f6de0 msgr2=0x7fc9fc0f83c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:53:30.614 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:30.613+0000 7fca023cb640 1 -- 172.21.15.121:0/2274731752 shutdown_connections 2024-08-18T22:53:30.614 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:30.613+0000 7fca023cb640 1 -- 172.21.15.121:0/2274731752 wait complete. 2024-08-18T22:53:30.888 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:53:30 smithi121 ceph-mon[81053]: from='client.? 172.21.15.121:0/2274731752' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 31, "format": "json"}]: dispatch 2024-08-18T22:53:31.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:53:30 smithi195 ceph-mon[68841]: from='client.? 172.21.15.121:0/2274731752' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 31, "format": "json"}]: dispatch 2024-08-18T22:53:31.363 DEBUG:tasks.fs:max_mds reduced in epoch 31 2024-08-18T22:53:31.364 DEBUG:teuthology.orchestra.run.smithi121:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid b003123a-5db1-11ef-bccf-c7b262605968 -- ceph fs dump --format=json 32 2024-08-18T22:53:31.614 INFO:teuthology.orchestra.run.smithi121.stderr:Inferring config /var/lib/ceph/b003123a-5db1-11ef-bccf-c7b262605968/mon.smithi121/config 2024-08-18T22:53:31.986 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:53:31 smithi121 ceph-mon[81053]: pgmap v333: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:53:32.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:53:31 smithi195 ceph-mon[68841]: pgmap v333: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:53:33.286 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:33.280+0000 7f6f91105640 1 -- 172.21.15.121:0/3451478279 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6f8c0650e0 msgr2=0x7f6f8c0654b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:53:33.286 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:33.280+0000 7f6f91105640 1 --2- 172.21.15.121:0/3451478279 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6f8c0650e0 0x7f6f8c0654b0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f6f7c009c50 tx=0x7f6f7c004d10 comp rx=0 tx=0).stop 2024-08-18T22:53:33.286 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:33.280+0000 7f6f91105640 1 -- 172.21.15.121:0/3451478279 shutdown_connections 2024-08-18T22:53:33.287 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:33.280+0000 7f6f91105640 1 --2- 172.21.15.121:0/3451478279 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6f8c0fdef0 0x7f6f8c0fe320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:53:33.287 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:33.280+0000 7f6f91105640 1 --2- 172.21.15.121:0/3451478279 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6f8c0650e0 0x7f6f8c0654b0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:53:33.287 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:33.280+0000 7f6f91105640 1 -- 172.21.15.121:0/3451478279 >> 172.21.15.121:0/3451478279 conn(0x7f6f8c072150 msgr2=0x7f6f8c072550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:53:33.287 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:33.280+0000 7f6f91105640 1 -- 172.21.15.121:0/3451478279 shutdown_connections 2024-08-18T22:53:33.287 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:33.280+0000 7f6f91105640 1 -- 172.21.15.121:0/3451478279 wait complete. 2024-08-18T22:53:33.287 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:33.280+0000 7f6f91105640 1 Processor -- start 2024-08-18T22:53:33.287 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:33.280+0000 7f6f91105640 1 -- start start 2024-08-18T22:53:33.287 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:33.281+0000 7f6f91105640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6f8c0650e0 0x7f6f8c112fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:53:33.287 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:33.281+0000 7f6f91105640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6f8c0fdef0 0x7f6f8c113500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:53:33.287 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:33.281+0000 7f6f91105640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f8c113b00 con 0x7f6f8c0fdef0 2024-08-18T22:53:33.287 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:33.281+0000 7f6f91105640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f8c10cf40 con 0x7f6f8c0650e0 2024-08-18T22:53:33.287 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:33.281+0000 7f6f8a59c640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6f8c0fdef0 0x7f6f8c113500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:53:33.288 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:33.281+0000 7f6f8a59c640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6f8c0fdef0 0x7f6f8c113500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:47106/0 (socket says 172.21.15.121:47106) 2024-08-18T22:53:33.288 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:33.281+0000 7f6f8a59c640 1 -- 172.21.15.121:0/2164902344 learned_addr learned my addr 172.21.15.121:0/2164902344 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-18T22:53:33.288 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:33.281+0000 7f6f8ad9d640 1 --2- 172.21.15.121:0/2164902344 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6f8c0650e0 0x7f6f8c112fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:53:33.288 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:33.281+0000 7f6f8a59c640 1 -- 172.21.15.121:0/2164902344 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6f8c0650e0 msgr2=0x7f6f8c112fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:53:33.288 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:33.281+0000 7f6f8a59c640 1 --2- 172.21.15.121:0/2164902344 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6f8c0650e0 0x7f6f8c112fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:53:33.288 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:33.281+0000 7f6f8a59c640 1 -- 172.21.15.121:0/2164902344 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f7c0098b0 con 0x7f6f8c0fdef0 2024-08-18T22:53:33.288 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:33.281+0000 7f6f8a59c640 1 --2- 172.21.15.121:0/2164902344 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6f8c0fdef0 0x7f6f8c113500 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f6f8000c830 tx=0x7f6f80004430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:53:33.288 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:33.281+0000 7f6f737fe640 1 -- 172.21.15.121:0/2164902344 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6f8000a850 con 0x7f6f8c0fdef0 2024-08-18T22:53:33.289 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:33.281+0000 7f6f91105640 1 -- 172.21.15.121:0/2164902344 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f8c10d220 con 0x7f6f8c0fdef0 2024-08-18T22:53:33.289 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:33.281+0000 7f6f737fe640 1 -- 172.21.15.121:0/2164902344 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f6f8000ae50 con 0x7f6f8c0fdef0 2024-08-18T22:53:33.289 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:33.281+0000 7f6f737fe640 1 -- 172.21.15.121:0/2164902344 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6f800113a0 con 0x7f6f8c0fdef0 2024-08-18T22:53:33.289 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:33.281+0000 7f6f91105640 1 -- 172.21.15.121:0/2164902344 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f8c10d7c0 con 0x7f6f8c0fdef0 2024-08-18T22:53:33.289 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:33.283+0000 7f6f91105640 1 -- 172.21.15.121:0/2164902344 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f8c0fda90 con 0x7f6f8c0fdef0 2024-08-18T22:53:33.289 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:33.283+0000 7f6f737fe640 1 -- 172.21.15.121:0/2164902344 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 37) v1 ==== 92205+0+0 (secure 0 0 0) 0x7f6f80012400 con 0x7f6f8c0fdef0 2024-08-18T22:53:33.289 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:33.284+0000 7f6f737fe640 1 --2- 172.21.15.121:0/2164902344 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f6f7406e0b0 0x7f6f74070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:53:33.289 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:33.284+0000 7f6f8ad9d640 1 --2- 172.21.15.121:0/2164902344 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f6f7406e0b0 0x7f6f74070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:53:33.289 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:33.284+0000 7f6f737fe640 1 -- 172.21.15.121:0/2164902344 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6668+0+0 (secure 0 0 0) 0x7f6f8008de80 con 0x7f6f8c0fdef0 2024-08-18T22:53:33.289 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:33.284+0000 7f6f8ad9d640 1 --2- 172.21.15.121:0/2164902344 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f6f7406e0b0 0x7f6f74070560 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f6f7c004a30 tx=0x7f6f7c004d10 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:53:33.290 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:33.288+0000 7f6f737fe640 1 -- 172.21.15.121:0/2164902344 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f6f80057180 con 0x7f6f8c0fdef0 2024-08-18T22:53:33.490 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:33.489+0000 7f6f91105640 1 -- 172.21.15.121:0/2164902344 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 32, "format": "json"} v 0) v1 -- 0x7f6f8c072c60 con 0x7f6f8c0fdef0 2024-08-18T22:53:33.490 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:33.489+0000 7f6f737fe640 1 -- 172.21.15.121:0/2164902344 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 32, "format": "json"}]=0 dumped fsmap epoch 32 v46) v1 ==== 107+0+4197 (secure 0 0 0) 0x7f6f8005a840 con 0x7f6f8c0fdef0 2024-08-18T22:53:33.491 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-08-18T22:53:33.491 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":32,"btime":"2024-08-18T22:48:49:645869+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34404,"name":"cephfs.smithi121.xuzsdg","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6827/4267588865","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":4267588865},{"type":"v1","addr":"172.21.15.121:6827","nonce":4267588865}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":29},{"gid":44267,"name":"cephfs.smithi195.buqvbr","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6825/110644516","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":110644516},{"type":"v1","addr":"172.21.15.195:6825","nonce":110644516}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27}],"filesystems":[{"mdsmap":{"epoch":32,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-18T22:39:04.054074+0000","modified":"2024-08-18T22:48:48.771287+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":82,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24259},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_24259":{"gid":24259,"name":"cephfs.smithi195.nptgyc","rank":0,"incarnation":31,"state":"up:reconnect","state_seq":144,"addr":"172.21.15.195:6827/238549847","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":238549847},{"type":"v1","addr":"172.21.15.195:6827","nonce":238549847}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-08-18T22:53:33.491 INFO:teuthology.orchestra.run.smithi121.stderr:dumped fsmap epoch 32 2024-08-18T22:53:33.493 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:33.491+0000 7f6f91105640 1 -- 172.21.15.121:0/2164902344 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f6f7406e0b0 msgr2=0x7f6f74070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:53:33.493 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:33.491+0000 7f6f91105640 1 --2- 172.21.15.121:0/2164902344 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f6f7406e0b0 0x7f6f74070560 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f6f7c004a30 tx=0x7f6f7c004d10 comp rx=0 tx=0).stop 2024-08-18T22:53:33.493 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:33.491+0000 7f6f91105640 1 -- 172.21.15.121:0/2164902344 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6f8c0fdef0 msgr2=0x7f6f8c113500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:53:33.493 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:33.491+0000 7f6f91105640 1 --2- 172.21.15.121:0/2164902344 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6f8c0fdef0 0x7f6f8c113500 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f6f8000c830 tx=0x7f6f80004430 comp rx=0 tx=0).stop 2024-08-18T22:53:33.493 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:33.491+0000 7f6f91105640 1 -- 172.21.15.121:0/2164902344 shutdown_connections 2024-08-18T22:53:33.493 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:33.491+0000 7f6f91105640 1 --2- 172.21.15.121:0/2164902344 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f6f7406e0b0 0x7f6f74070560 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:53:33.493 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:33.491+0000 7f6f91105640 1 --2- 172.21.15.121:0/2164902344 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6f8c0fdef0 0x7f6f8c113500 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:53:33.494 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:33.491+0000 7f6f91105640 1 --2- 172.21.15.121:0/2164902344 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6f8c0650e0 0x7f6f8c112fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:53:33.494 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:33.491+0000 7f6f91105640 1 -- 172.21.15.121:0/2164902344 >> 172.21.15.121:0/2164902344 conn(0x7f6f8c072150 msgr2=0x7f6f8c101010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:53:33.494 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:33.491+0000 7f6f91105640 1 -- 172.21.15.121:0/2164902344 shutdown_connections 2024-08-18T22:53:33.494 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:33.491+0000 7f6f91105640 1 -- 172.21.15.121:0/2164902344 wait complete. 2024-08-18T22:53:34.064 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:53:33 smithi121 ceph-mon[81053]: pgmap v334: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:53:34.064 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:53:33 smithi121 ceph-mon[81053]: from='client.? 172.21.15.121:0/2164902344' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 32, "format": "json"}]: dispatch 2024-08-18T22:53:34.093 DEBUG:tasks.fs:max_mds reduced in epoch 32 2024-08-18T22:53:34.094 DEBUG:teuthology.orchestra.run.smithi121:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid b003123a-5db1-11ef-bccf-c7b262605968 -- ceph fs dump --format=json 33 2024-08-18T22:53:34.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:53:33 smithi195 ceph-mon[68841]: pgmap v334: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:53:34.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:53:33 smithi195 ceph-mon[68841]: from='client.? 172.21.15.121:0/2164902344' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 32, "format": "json"}]: dispatch 2024-08-18T22:53:34.348 INFO:teuthology.orchestra.run.smithi121.stderr:Inferring config /var/lib/ceph/b003123a-5db1-11ef-bccf-c7b262605968/mon.smithi121/config 2024-08-18T22:53:35.833 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:53:35 smithi121 ceph-mon[81053]: pgmap v335: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:53:35.950 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:35.943+0000 7f1b80a76640 1 -- 172.21.15.121:0/2709476842 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1b7c1022e0 msgr2=0x7f1b7c1026b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:53:35.950 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:35.943+0000 7f1b80a76640 1 --2- 172.21.15.121:0/2709476842 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1b7c1022e0 0x7f1b7c1026b0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f1b6c009c50 tx=0x7f1b6c004d10 comp rx=0 tx=0).stop 2024-08-18T22:53:35.951 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:35.943+0000 7f1b80a76640 1 -- 172.21.15.121:0/2709476842 shutdown_connections 2024-08-18T22:53:35.951 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:35.943+0000 7f1b80a76640 1 --2- 172.21.15.121:0/2709476842 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1b7c102c80 0x7f1b7c0fc310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:53:35.951 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:35.943+0000 7f1b80a76640 1 --2- 172.21.15.121:0/2709476842 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1b7c1022e0 0x7f1b7c1026b0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:53:35.951 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:35.943+0000 7f1b80a76640 1 -- 172.21.15.121:0/2709476842 >> 172.21.15.121:0/2709476842 conn(0x7f1b7c0f7e90 msgr2=0x7f1b7c0fa2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:53:35.951 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:35.943+0000 7f1b80a76640 1 -- 172.21.15.121:0/2709476842 shutdown_connections 2024-08-18T22:53:35.952 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:35.943+0000 7f1b80a76640 1 -- 172.21.15.121:0/2709476842 wait complete. 2024-08-18T22:53:35.952 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:35.943+0000 7f1b80a76640 1 Processor -- start 2024-08-18T22:53:35.952 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:35.943+0000 7f1b80a76640 1 -- start start 2024-08-18T22:53:35.952 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:35.944+0000 7f1b80a76640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1b7c1022e0 0x7f1b7c06f7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:53:35.952 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:35.944+0000 7f1b80a76640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1b7c102c80 0x7f1b7c06fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:53:35.953 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:35.944+0000 7f1b80a76640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b7c0702c0 con 0x7f1b7c102c80 2024-08-18T22:53:35.953 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:35.944+0000 7f1b80a76640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b7c070430 con 0x7f1b7c1022e0 2024-08-18T22:53:35.953 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:35.944+0000 7f1b79d9b640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1b7c102c80 0x7f1b7c06fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:53:35.953 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:35.944+0000 7f1b79d9b640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1b7c102c80 0x7f1b7c06fcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:47128/0 (socket says 172.21.15.121:47128) 2024-08-18T22:53:35.953 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:35.944+0000 7f1b79d9b640 1 -- 172.21.15.121:0/1815292203 learned_addr learned my addr 172.21.15.121:0/1815292203 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-18T22:53:35.953 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:35.944+0000 7f1b7a59c640 1 --2- 172.21.15.121:0/1815292203 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1b7c1022e0 0x7f1b7c06f7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:53:35.954 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:35.944+0000 7f1b79d9b640 1 -- 172.21.15.121:0/1815292203 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1b7c1022e0 msgr2=0x7f1b7c06f7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:53:35.954 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:35.944+0000 7f1b79d9b640 1 --2- 172.21.15.121:0/1815292203 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1b7c1022e0 0x7f1b7c06f7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:53:35.954 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:35.944+0000 7f1b79d9b640 1 -- 172.21.15.121:0/1815292203 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b6c0098b0 con 0x7f1b7c102c80 2024-08-18T22:53:35.954 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:35.944+0000 7f1b79d9b640 1 --2- 172.21.15.121:0/1815292203 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1b7c102c80 0x7f1b7c06fcf0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f1b6400b790 tx=0x7f1b640091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:53:35.954 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:35.944+0000 7f1b72ffd640 1 -- 172.21.15.121:0/1815292203 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1b6400c700 con 0x7f1b7c102c80 2024-08-18T22:53:35.955 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:35.944+0000 7f1b72ffd640 1 -- 172.21.15.121:0/1815292203 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f1b6400cd00 con 0x7f1b7c102c80 2024-08-18T22:53:35.955 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:35.944+0000 7f1b80a76640 1 -- 172.21.15.121:0/1815292203 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b7c119300 con 0x7f1b7c102c80 2024-08-18T22:53:35.955 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:35.944+0000 7f1b72ffd640 1 -- 172.21.15.121:0/1815292203 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1b64015e70 con 0x7f1b7c102c80 2024-08-18T22:53:35.955 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:35.944+0000 7f1b80a76640 1 -- 172.21.15.121:0/1815292203 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b7c119740 con 0x7f1b7c102c80 2024-08-18T22:53:35.955 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:35.945+0000 7f1b80a76640 1 -- 172.21.15.121:0/1815292203 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b7c0fda50 con 0x7f1b7c102c80 2024-08-18T22:53:35.956 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:35.946+0000 7f1b72ffd640 1 -- 172.21.15.121:0/1815292203 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 37) v1 ==== 92205+0+0 (secure 0 0 0) 0x7f1b64012070 con 0x7f1b7c102c80 2024-08-18T22:53:35.956 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:35.946+0000 7f1b72ffd640 1 --2- 172.21.15.121:0/1815292203 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f1b6806e0b0 0x7f1b68070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:53:35.956 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:35.946+0000 7f1b72ffd640 1 -- 172.21.15.121:0/1815292203 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6668+0+0 (secure 0 0 0) 0x7f1b6408d750 con 0x7f1b7c102c80 2024-08-18T22:53:35.956 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:35.946+0000 7f1b7a59c640 1 --2- 172.21.15.121:0/1815292203 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f1b6806e0b0 0x7f1b68070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:53:35.956 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:35.947+0000 7f1b7a59c640 1 --2- 172.21.15.121:0/1815292203 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f1b6806e0b0 0x7f1b68070560 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f1b6c004a30 tx=0x7f1b6c004d10 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:53:35.957 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:35.951+0000 7f1b72ffd640 1 -- 172.21.15.121:0/1815292203 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f1b64056a50 con 0x7f1b7c102c80 2024-08-18T22:53:36.151 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:36.150+0000 7f1b80a76640 1 -- 172.21.15.121:0/1815292203 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 33, "format": "json"} v 0) v1 -- 0x7f1b7c0fbad0 con 0x7f1b7c102c80 2024-08-18T22:53:36.152 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:36.151+0000 7f1b72ffd640 1 -- 172.21.15.121:0/1815292203 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 33, "format": "json"}]=0 dumped fsmap epoch 33 v46) v1 ==== 107+0+4194 (secure 0 0 0) 0x7f1b6405a110 con 0x7f1b7c102c80 2024-08-18T22:53:36.152 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-08-18T22:53:36.152 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":33,"btime":"2024-08-18T22:48:50:652004+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34404,"name":"cephfs.smithi121.xuzsdg","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6827/4267588865","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":4267588865},{"type":"v1","addr":"172.21.15.121:6827","nonce":4267588865}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":29},{"gid":44267,"name":"cephfs.smithi195.buqvbr","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6825/110644516","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":110644516},{"type":"v1","addr":"172.21.15.195:6825","nonce":110644516}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27}],"filesystems":[{"mdsmap":{"epoch":33,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-18T22:39:04.054074+0000","modified":"2024-08-18T22:48:49.704376+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":82,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24259},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_24259":{"gid":24259,"name":"cephfs.smithi195.nptgyc","rank":0,"incarnation":31,"state":"up:rejoin","state_seq":145,"addr":"172.21.15.195:6827/238549847","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":238549847},{"type":"v1","addr":"172.21.15.195:6827","nonce":238549847}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-08-18T22:53:36.152 INFO:teuthology.orchestra.run.smithi121.stderr:dumped fsmap epoch 33 2024-08-18T22:53:36.154 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:36.153+0000 7f1b80a76640 1 -- 172.21.15.121:0/1815292203 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f1b6806e0b0 msgr2=0x7f1b68070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:53:36.154 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:36.153+0000 7f1b80a76640 1 --2- 172.21.15.121:0/1815292203 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f1b6806e0b0 0x7f1b68070560 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f1b6c004a30 tx=0x7f1b6c004d10 comp rx=0 tx=0).stop 2024-08-18T22:53:36.154 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:36.153+0000 7f1b80a76640 1 -- 172.21.15.121:0/1815292203 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1b7c102c80 msgr2=0x7f1b7c06fcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:53:36.154 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:36.153+0000 7f1b80a76640 1 --2- 172.21.15.121:0/1815292203 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1b7c102c80 0x7f1b7c06fcf0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f1b6400b790 tx=0x7f1b640091d0 comp rx=0 tx=0).stop 2024-08-18T22:53:36.154 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:36.153+0000 7f1b80a76640 1 -- 172.21.15.121:0/1815292203 shutdown_connections 2024-08-18T22:53:36.155 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:36.153+0000 7f1b80a76640 1 --2- 172.21.15.121:0/1815292203 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f1b6806e0b0 0x7f1b68070560 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:53:36.155 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:36.153+0000 7f1b80a76640 1 --2- 172.21.15.121:0/1815292203 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1b7c102c80 0x7f1b7c06fcf0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:53:36.155 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:36.153+0000 7f1b80a76640 1 --2- 172.21.15.121:0/1815292203 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1b7c1022e0 0x7f1b7c06f7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:53:36.155 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:36.153+0000 7f1b80a76640 1 -- 172.21.15.121:0/1815292203 >> 172.21.15.121:0/1815292203 conn(0x7f1b7c0f7e90 msgr2=0x7f1b7c0f8e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:53:36.155 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:36.153+0000 7f1b80a76640 1 -- 172.21.15.121:0/1815292203 shutdown_connections 2024-08-18T22:53:36.155 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:36.154+0000 7f1b80a76640 1 -- 172.21.15.121:0/1815292203 wait complete. 2024-08-18T22:53:36.158 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:53:35 smithi195 ceph-mon[68841]: pgmap v335: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:53:36.924 DEBUG:tasks.fs:max_mds reduced in epoch 33 2024-08-18T22:53:36.924 DEBUG:teuthology.orchestra.run.smithi121:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid b003123a-5db1-11ef-bccf-c7b262605968 -- ceph fs dump --format=json 34 2024-08-18T22:53:37.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:53:36 smithi121 ceph-mon[81053]: from='client.? 172.21.15.121:0/1815292203' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 33, "format": "json"}]: dispatch 2024-08-18T22:53:37.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:53:36 smithi195 ceph-mon[68841]: from='client.? 172.21.15.121:0/1815292203' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 33, "format": "json"}]: dispatch 2024-08-18T22:53:37.174 INFO:teuthology.orchestra.run.smithi121.stderr:Inferring config /var/lib/ceph/b003123a-5db1-11ef-bccf-c7b262605968/mon.smithi121/config 2024-08-18T22:53:37.854 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:53:37 smithi121 ceph-mon[81053]: pgmap v336: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:53:38.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:53:37 smithi195 ceph-mon[68841]: pgmap v336: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:53:38.641 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:38.616+0000 7ff6529e8640 1 -- 172.21.15.121:0/1297239302 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff64c101b90 msgr2=0x7ff64c0fb220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:53:38.641 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:38.616+0000 7ff6529e8640 1 --2- 172.21.15.121:0/1297239302 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff64c101b90 0x7ff64c0fb220 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7ff6340048d0 tx=0x7ff634009da0 comp rx=0 tx=0).stop 2024-08-18T22:53:38.641 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:38.617+0000 7ff6529e8640 1 -- 172.21.15.121:0/1297239302 shutdown_connections 2024-08-18T22:53:38.641 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:38.617+0000 7ff6529e8640 1 --2- 172.21.15.121:0/1297239302 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff64c101b90 0x7ff64c0fb220 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:53:38.641 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:38.617+0000 7ff6529e8640 1 --2- 172.21.15.121:0/1297239302 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff64c1011f0 0x7ff64c1015c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:53:38.642 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:38.617+0000 7ff6529e8640 1 -- 172.21.15.121:0/1297239302 >> 172.21.15.121:0/1297239302 conn(0x7ff64c0f6da0 msgr2=0x7ff64c0f91b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:53:38.642 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:38.617+0000 7ff6529e8640 1 -- 172.21.15.121:0/1297239302 shutdown_connections 2024-08-18T22:53:38.642 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:38.617+0000 7ff6529e8640 1 -- 172.21.15.121:0/1297239302 wait complete. 2024-08-18T22:53:38.642 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:38.617+0000 7ff6529e8640 1 Processor -- start 2024-08-18T22:53:38.642 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:38.617+0000 7ff6529e8640 1 -- start start 2024-08-18T22:53:38.642 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:38.617+0000 7ff6529e8640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff64c1011f0 0x7ff64c102070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:53:38.642 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:38.617+0000 7ff6529e8640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff64c101b90 0x7ff64c1025b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:53:38.642 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:38.617+0000 7ff6529e8640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff64c102b80 con 0x7ff64c1011f0 2024-08-18T22:53:38.642 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:38.617+0000 7ff6529e8640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff64c102cf0 con 0x7ff64c101b90 2024-08-18T22:53:38.642 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:38.617+0000 7ff64bfff640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff64c1011f0 0x7ff64c102070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:53:38.642 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:38.617+0000 7ff64bfff640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff64c1011f0 0x7ff64c102070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:32792/0 (socket says 172.21.15.121:32792) 2024-08-18T22:53:38.642 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:38.617+0000 7ff64bfff640 1 -- 172.21.15.121:0/2567782262 learned_addr learned my addr 172.21.15.121:0/2567782262 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-18T22:53:38.643 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:38.618+0000 7ff643fff640 1 --2- 172.21.15.121:0/2567782262 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff64c101b90 0x7ff64c1025b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:53:38.643 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:38.618+0000 7ff64bfff640 1 -- 172.21.15.121:0/2567782262 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff64c101b90 msgr2=0x7ff64c1025b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:53:38.643 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:38.618+0000 7ff64bfff640 1 --2- 172.21.15.121:0/2567782262 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff64c101b90 0x7ff64c1025b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:53:38.643 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:38.618+0000 7ff64bfff640 1 -- 172.21.15.121:0/2567782262 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff634005040 con 0x7ff64c1011f0 2024-08-18T22:53:38.643 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:38.618+0000 7ff643fff640 1 --2- 172.21.15.121:0/2567782262 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff64c101b90 0x7ff64c1025b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:53:38.643 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:38.618+0000 7ff64bfff640 1 --2- 172.21.15.121:0/2567782262 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff64c1011f0 0x7ff64c102070 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7ff63c00b790 tx=0x7ff63c0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:53:38.643 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:38.618+0000 7ff6497fa640 1 -- 172.21.15.121:0/2567782262 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff63c00c700 con 0x7ff64c1011f0 2024-08-18T22:53:38.643 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:38.618+0000 7ff6497fa640 1 -- 172.21.15.121:0/2567782262 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7ff63c00cd00 con 0x7ff64c1011f0 2024-08-18T22:53:38.643 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:38.618+0000 7ff6529e8640 1 -- 172.21.15.121:0/2567782262 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff64c119320 con 0x7ff64c1011f0 2024-08-18T22:53:38.643 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:38.618+0000 7ff6497fa640 1 -- 172.21.15.121:0/2567782262 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff63c015e70 con 0x7ff64c1011f0 2024-08-18T22:53:38.643 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:38.618+0000 7ff6529e8640 1 -- 172.21.15.121:0/2567782262 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff64c119760 con 0x7ff64c1011f0 2024-08-18T22:53:38.643 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:38.619+0000 7ff6529e8640 1 -- 172.21.15.121:0/2567782262 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff64c0fc960 con 0x7ff64c1011f0 2024-08-18T22:53:38.643 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:38.619+0000 7ff6497fa640 1 -- 172.21.15.121:0/2567782262 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 37) v1 ==== 92205+0+0 (secure 0 0 0) 0x7ff63c012070 con 0x7ff64c1011f0 2024-08-18T22:53:38.644 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:38.620+0000 7ff6497fa640 1 --2- 172.21.15.121:0/2567782262 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7ff63806e0b0 0x7ff638070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:53:38.644 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:38.620+0000 7ff643fff640 1 --2- 172.21.15.121:0/2567782262 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7ff63806e0b0 0x7ff638070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:53:38.644 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:38.620+0000 7ff6497fa640 1 -- 172.21.15.121:0/2567782262 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6668+0+0 (secure 0 0 0) 0x7ff63c08d750 con 0x7ff64c1011f0 2024-08-18T22:53:38.644 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:38.621+0000 7ff643fff640 1 --2- 172.21.15.121:0/2567782262 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7ff63806e0b0 0x7ff638070560 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7ff63400b020 tx=0x7ff634009da0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:53:38.644 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:38.625+0000 7ff6497fa640 1 -- 172.21.15.121:0/2567782262 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7ff63c056a50 con 0x7ff64c1011f0 2024-08-18T22:53:38.834 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:38.833+0000 7ff6529e8640 1 -- 172.21.15.121:0/2567782262 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 34, "format": "json"} v 0) v1 -- 0x7ff64c04b4c0 con 0x7ff64c1011f0 2024-08-18T22:53:38.835 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:38.834+0000 7ff6497fa640 1 -- 172.21.15.121:0/2567782262 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 34, "format": "json"}]=0 dumped fsmap epoch 34 v46) v1 ==== 107+0+5053 (secure 0 0 0) 0x7ff63c05a110 con 0x7ff64c1011f0 2024-08-18T22:53:38.835 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-08-18T22:53:38.835 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":34,"btime":"2024-08-18T22:48:51:656628+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34404,"name":"cephfs.smithi121.xuzsdg","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6827/4267588865","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":4267588865},{"type":"v1","addr":"172.21.15.121:6827","nonce":4267588865}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":29},{"gid":34436,"name":"cephfs.smithi121.gbickb","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6829/2915303436","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6828","nonce":2915303436},{"type":"v1","addr":"172.21.15.121:6829","nonce":2915303436}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":34},{"gid":44267,"name":"cephfs.smithi195.buqvbr","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6825/110644516","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":110644516},{"type":"v1","addr":"172.21.15.195:6825","nonce":110644516}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27}],"filesystems":[{"mdsmap":{"epoch":34,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-18T22:39:04.054074+0000","modified":"2024-08-18T22:48:51.656624+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":82,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24259},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_24259":{"gid":24259,"name":"cephfs.smithi195.nptgyc","rank":0,"incarnation":31,"state":"up:active","state_seq":146,"addr":"172.21.15.195:6827/238549847","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":238549847},{"type":"v1","addr":"172.21.15.195:6827","nonce":238549847}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":24259,"qdb_cluster":[24259]},"id":1}]} 2024-08-18T22:53:38.835 INFO:teuthology.orchestra.run.smithi121.stderr:dumped fsmap epoch 34 2024-08-18T22:53:38.837 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:38.836+0000 7ff6529e8640 1 -- 172.21.15.121:0/2567782262 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7ff63806e0b0 msgr2=0x7ff638070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:53:38.837 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:38.836+0000 7ff6529e8640 1 --2- 172.21.15.121:0/2567782262 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7ff63806e0b0 0x7ff638070560 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7ff63400b020 tx=0x7ff634009da0 comp rx=0 tx=0).stop 2024-08-18T22:53:38.838 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:38.836+0000 7ff6529e8640 1 -- 172.21.15.121:0/2567782262 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff64c1011f0 msgr2=0x7ff64c102070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:53:38.838 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:38.836+0000 7ff6529e8640 1 --2- 172.21.15.121:0/2567782262 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff64c1011f0 0x7ff64c102070 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7ff63c00b790 tx=0x7ff63c0091d0 comp rx=0 tx=0).stop 2024-08-18T22:53:38.838 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:38.837+0000 7ff6529e8640 1 -- 172.21.15.121:0/2567782262 shutdown_connections 2024-08-18T22:53:38.838 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:38.837+0000 7ff6529e8640 1 --2- 172.21.15.121:0/2567782262 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7ff63806e0b0 0x7ff638070560 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:53:38.838 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:38.837+0000 7ff6529e8640 1 --2- 172.21.15.121:0/2567782262 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff64c101b90 0x7ff64c1025b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:53:38.838 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:38.837+0000 7ff6529e8640 1 --2- 172.21.15.121:0/2567782262 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff64c1011f0 0x7ff64c102070 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:53:38.838 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:38.837+0000 7ff6529e8640 1 -- 172.21.15.121:0/2567782262 >> 172.21.15.121:0/2567782262 conn(0x7ff64c0f6da0 msgr2=0x7ff64c065870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:53:38.838 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:38.837+0000 7ff6529e8640 1 -- 172.21.15.121:0/2567782262 shutdown_connections 2024-08-18T22:53:38.838 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:38.837+0000 7ff6529e8640 1 -- 172.21.15.121:0/2567782262 wait complete. 2024-08-18T22:53:39.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:53:38 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-18T22:53:39.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:53:38 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-18T22:53:39.510 DEBUG:tasks.fs:max_mds reduced in epoch 34 2024-08-18T22:53:39.511 DEBUG:teuthology.orchestra.run.smithi121:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid b003123a-5db1-11ef-bccf-c7b262605968 -- ceph fs dump --format=json 35 2024-08-18T22:53:39.773 INFO:teuthology.orchestra.run.smithi121.stderr:Inferring config /var/lib/ceph/b003123a-5db1-11ef-bccf-c7b262605968/mon.smithi121/config 2024-08-18T22:53:40.056 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:53:39 smithi121 ceph-mon[81053]: pgmap v337: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:53:40.056 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:53:39 smithi121 ceph-mon[81053]: from='client.? 172.21.15.121:0/2567782262' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 34, "format": "json"}]: dispatch 2024-08-18T22:53:40.158 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:53:39 smithi195 ceph-mon[68841]: pgmap v337: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:53:40.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:53:39 smithi195 ceph-mon[68841]: from='client.? 172.21.15.121:0/2567782262' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 34, "format": "json"}]: dispatch 2024-08-18T22:53:41.250 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:41.249+0000 7ffa12bd3640 1 -- 172.21.15.121:0/4047658648 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ffa0c1011f0 msgr2=0x7ffa0c1015c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:53:41.250 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:41.249+0000 7ffa12bd3640 1 --2- 172.21.15.121:0/4047658648 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ffa0c1011f0 0x7ffa0c1015c0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7ffa000048d0 tx=0x7ffa00009da0 comp rx=0 tx=0).stop 2024-08-18T22:53:41.250 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:41.249+0000 7ffa12bd3640 1 -- 172.21.15.121:0/4047658648 shutdown_connections 2024-08-18T22:53:41.251 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:41.249+0000 7ffa12bd3640 1 --2- 172.21.15.121:0/4047658648 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ffa0c101b90 0x7ffa0c0fb220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:53:41.251 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:41.249+0000 7ffa12bd3640 1 --2- 172.21.15.121:0/4047658648 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ffa0c1011f0 0x7ffa0c1015c0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:53:41.251 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:41.249+0000 7ffa12bd3640 1 -- 172.21.15.121:0/4047658648 >> 172.21.15.121:0/4047658648 conn(0x7ffa0c0f6da0 msgr2=0x7ffa0c0f91b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:53:41.251 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:41.249+0000 7ffa12bd3640 1 -- 172.21.15.121:0/4047658648 shutdown_connections 2024-08-18T22:53:41.251 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:41.249+0000 7ffa12bd3640 1 -- 172.21.15.121:0/4047658648 wait complete. 2024-08-18T22:53:41.251 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:41.249+0000 7ffa12bd3640 1 Processor -- start 2024-08-18T22:53:41.251 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:41.250+0000 7ffa12bd3640 1 -- start start 2024-08-18T22:53:41.253 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:41.250+0000 7ffa12bd3640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ffa0c1011f0 0x7ffa0c112f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:53:41.253 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:41.250+0000 7ffa12bd3640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ffa0c101b90 0x7ffa0c113490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:53:41.253 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:41.250+0000 7ffa12bd3640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa0c113a90 con 0x7ffa0c101b90 2024-08-18T22:53:41.253 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:41.250+0000 7ffa12bd3640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa0c113c00 con 0x7ffa0c1011f0 2024-08-18T22:53:41.253 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:41.250+0000 7ffa0bfff640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ffa0c101b90 0x7ffa0c113490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:53:41.253 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:41.250+0000 7ffa0bfff640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ffa0c101b90 0x7ffa0c113490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:32820/0 (socket says 172.21.15.121:32820) 2024-08-18T22:53:41.253 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:41.250+0000 7ffa0bfff640 1 -- 172.21.15.121:0/1793430808 learned_addr learned my addr 172.21.15.121:0/1793430808 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-18T22:53:41.253 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:41.250+0000 7ffa1096f640 1 --2- 172.21.15.121:0/1793430808 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ffa0c1011f0 0x7ffa0c112f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:53:41.253 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:41.250+0000 7ffa0bfff640 1 -- 172.21.15.121:0/1793430808 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ffa0c1011f0 msgr2=0x7ffa0c112f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:53:41.253 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:41.250+0000 7ffa0bfff640 1 --2- 172.21.15.121:0/1793430808 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ffa0c1011f0 0x7ffa0c112f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:53:41.253 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:41.250+0000 7ffa0bfff640 1 -- 172.21.15.121:0/1793430808 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa00005040 con 0x7ffa0c101b90 2024-08-18T22:53:41.254 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:41.250+0000 7ffa0bfff640 1 --2- 172.21.15.121:0/1793430808 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ffa0c101b90 0x7ffa0c113490 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7ff9f800c790 tx=0x7ff9f80043c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:53:41.254 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:41.251+0000 7ffa097fa640 1 -- 172.21.15.121:0/1793430808 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff9f800a820 con 0x7ffa0c101b90 2024-08-18T22:53:41.254 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:41.251+0000 7ffa097fa640 1 -- 172.21.15.121:0/1793430808 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7ff9f800ae20 con 0x7ffa0c101b90 2024-08-18T22:53:41.254 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:41.251+0000 7ffa12bd3640 1 -- 172.21.15.121:0/1793430808 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa0c10d080 con 0x7ffa0c101b90 2024-08-18T22:53:41.254 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:41.251+0000 7ffa097fa640 1 -- 172.21.15.121:0/1793430808 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff9f80113a0 con 0x7ffa0c101b90 2024-08-18T22:53:41.254 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:41.251+0000 7ffa12bd3640 1 -- 172.21.15.121:0/1793430808 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa0c10d620 con 0x7ffa0c101b90 2024-08-18T22:53:41.254 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:41.252+0000 7ffa12bd3640 1 -- 172.21.15.121:0/1793430808 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa0c0fc960 con 0x7ffa0c101b90 2024-08-18T22:53:41.255 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:41.252+0000 7ffa097fa640 1 -- 172.21.15.121:0/1793430808 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 37) v1 ==== 92205+0+0 (secure 0 0 0) 0x7ff9f8012400 con 0x7ffa0c101b90 2024-08-18T22:53:41.255 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:41.253+0000 7ffa097fa640 1 --2- 172.21.15.121:0/1793430808 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7ff9fc06e0b0 0x7ff9fc070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:53:41.255 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:41.253+0000 7ffa1096f640 1 --2- 172.21.15.121:0/1793430808 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7ff9fc06e0b0 0x7ff9fc070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:53:41.255 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:41.253+0000 7ffa097fa640 1 -- 172.21.15.121:0/1793430808 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6668+0+0 (secure 0 0 0) 0x7ff9f808ddf0 con 0x7ffa0c101b90 2024-08-18T22:53:41.255 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:41.254+0000 7ffa1096f640 1 --2- 172.21.15.121:0/1793430808 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7ff9fc06e0b0 0x7ff9fc070560 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7ffa00009ac0 tx=0x7ffa00035040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:53:41.258 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:41.257+0000 7ffa097fa640 1 -- 172.21.15.121:0/1793430808 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7ff9f80570f0 con 0x7ffa0c101b90 2024-08-18T22:53:41.462 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:41.461+0000 7ffa12bd3640 1 -- 172.21.15.121:0/1793430808 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 35, "format": "json"} v 0) v1 -- 0x7ffa0c0fa9e0 con 0x7ffa0c101b90 2024-08-18T22:53:41.462 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:41.461+0000 7ffa097fa640 1 -- 172.21.15.121:0/1793430808 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 35, "format": "json"}]=0 dumped fsmap epoch 35 v46) v1 ==== 107+0+4274 (secure 0 0 0) 0x7ff9f800a980 con 0x7ffa0c101b90 2024-08-18T22:53:41.463 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-08-18T22:53:41.463 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":35,"btime":"2024-08-18T22:49:07:659546+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34404,"name":"cephfs.smithi121.xuzsdg","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6827/4267588865","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":4267588865},{"type":"v1","addr":"172.21.15.121:6827","nonce":4267588865}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":29},{"gid":34436,"name":"cephfs.smithi121.gbickb","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6829/2915303436","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6828","nonce":2915303436},{"type":"v1","addr":"172.21.15.121:6829","nonce":2915303436}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":34}],"filesystems":[{"mdsmap":{"epoch":34,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-18T22:39:04.054074+0000","modified":"2024-08-18T22:48:51.656624+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":82,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24259},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_24259":{"gid":24259,"name":"cephfs.smithi195.nptgyc","rank":0,"incarnation":31,"state":"up:active","state_seq":146,"addr":"172.21.15.195:6827/238549847","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":238549847},{"type":"v1","addr":"172.21.15.195:6827","nonce":238549847}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":24259,"qdb_cluster":[24259]},"id":1}]} 2024-08-18T22:53:41.463 INFO:teuthology.orchestra.run.smithi121.stderr:dumped fsmap epoch 35 2024-08-18T22:53:41.464 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:41.463+0000 7ffa12bd3640 1 -- 172.21.15.121:0/1793430808 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7ff9fc06e0b0 msgr2=0x7ff9fc070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:53:41.465 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:41.463+0000 7ffa12bd3640 1 --2- 172.21.15.121:0/1793430808 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7ff9fc06e0b0 0x7ff9fc070560 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7ffa00009ac0 tx=0x7ffa00035040 comp rx=0 tx=0).stop 2024-08-18T22:53:41.465 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:41.463+0000 7ffa12bd3640 1 -- 172.21.15.121:0/1793430808 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ffa0c101b90 msgr2=0x7ffa0c113490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:53:41.465 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:41.463+0000 7ffa12bd3640 1 --2- 172.21.15.121:0/1793430808 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ffa0c101b90 0x7ffa0c113490 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7ff9f800c790 tx=0x7ff9f80043c0 comp rx=0 tx=0).stop 2024-08-18T22:53:41.465 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:41.464+0000 7ffa12bd3640 1 -- 172.21.15.121:0/1793430808 shutdown_connections 2024-08-18T22:53:41.465 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:41.464+0000 7ffa12bd3640 1 --2- 172.21.15.121:0/1793430808 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7ff9fc06e0b0 0x7ff9fc070560 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:53:41.465 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:41.464+0000 7ffa12bd3640 1 --2- 172.21.15.121:0/1793430808 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ffa0c101b90 0x7ffa0c113490 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:53:41.465 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:41.464+0000 7ffa12bd3640 1 --2- 172.21.15.121:0/1793430808 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ffa0c1011f0 0x7ffa0c112f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:53:41.465 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:41.464+0000 7ffa12bd3640 1 -- 172.21.15.121:0/1793430808 >> 172.21.15.121:0/1793430808 conn(0x7ffa0c0f6da0 msgr2=0x7ffa0c0657f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:53:41.465 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:41.464+0000 7ffa12bd3640 1 -- 172.21.15.121:0/1793430808 shutdown_connections 2024-08-18T22:53:41.465 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:41.464+0000 7ffa12bd3640 1 -- 172.21.15.121:0/1793430808 wait complete. 2024-08-18T22:53:42.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:53:41 smithi121 ceph-mon[81053]: pgmap v338: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:53:42.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:53:41 smithi121 ceph-mon[81053]: from='client.? 172.21.15.121:0/1793430808' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 35, "format": "json"}]: dispatch 2024-08-18T22:53:42.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:53:41 smithi195 ceph-mon[68841]: pgmap v338: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:53:42.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:53:41 smithi195 ceph-mon[68841]: from='client.? 172.21.15.121:0/1793430808' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 35, "format": "json"}]: dispatch 2024-08-18T22:53:42.167 DEBUG:tasks.fs:max_mds reduced in epoch 35 2024-08-18T22:53:42.167 DEBUG:teuthology.orchestra.run.smithi121:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid b003123a-5db1-11ef-bccf-c7b262605968 -- ceph fs dump --format=json 36 2024-08-18T22:53:42.418 INFO:teuthology.orchestra.run.smithi121.stderr:Inferring config /var/lib/ceph/b003123a-5db1-11ef-bccf-c7b262605968/mon.smithi121/config 2024-08-18T22:53:43.833 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:53:43 smithi121 ceph-mon[81053]: pgmap v339: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:53:44.097 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:44.096+0000 7ff5b934b640 1 -- 172.21.15.121:0/926997803 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff5b40fdef0 msgr2=0x7ff5b40fe320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:53:44.097 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:44.096+0000 7ff5b934b640 1 --2- 172.21.15.121:0/926997803 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff5b40fdef0 0x7ff5b40fe320 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7ff59c0048d0 tx=0x7ff59c009da0 comp rx=0 tx=0).stop 2024-08-18T22:53:44.097 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:44.096+0000 7ff5b934b640 1 -- 172.21.15.121:0/926997803 shutdown_connections 2024-08-18T22:53:44.097 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:44.096+0000 7ff5b934b640 1 --2- 172.21.15.121:0/926997803 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff5b40fdef0 0x7ff5b40fe320 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:53:44.097 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:44.096+0000 7ff5b934b640 1 --2- 172.21.15.121:0/926997803 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff5b40650e0 0x7ff5b40654b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:53:44.097 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:44.096+0000 7ff5b934b640 1 -- 172.21.15.121:0/926997803 >> 172.21.15.121:0/926997803 conn(0x7ff5b4072150 msgr2=0x7ff5b4072550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:53:44.098 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:44.096+0000 7ff5b934b640 1 -- 172.21.15.121:0/926997803 shutdown_connections 2024-08-18T22:53:44.098 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:44.096+0000 7ff5b934b640 1 -- 172.21.15.121:0/926997803 wait complete. 2024-08-18T22:53:44.098 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:44.096+0000 7ff5b934b640 1 Processor -- start 2024-08-18T22:53:44.099 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:44.097+0000 7ff5b934b640 1 -- start start 2024-08-18T22:53:44.099 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:44.097+0000 7ff5b934b640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff5b40650e0 0x7ff5b4112fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:53:44.099 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:44.097+0000 7ff5b934b640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff5b40fdef0 0x7ff5b4113520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:53:44.099 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:44.097+0000 7ff5b934b640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5b4113bb0 con 0x7ff5b40650e0 2024-08-18T22:53:44.099 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:44.097+0000 7ff5b934b640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5b410cf60 con 0x7ff5b40fdef0 2024-08-18T22:53:44.100 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:44.097+0000 7ff5b2ffd640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff5b40650e0 0x7ff5b4112fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:53:44.100 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:44.097+0000 7ff5b2ffd640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff5b40650e0 0x7ff5b4112fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:32828/0 (socket says 172.21.15.121:32828) 2024-08-18T22:53:44.100 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:44.097+0000 7ff5b2ffd640 1 -- 172.21.15.121:0/3837625766 learned_addr learned my addr 172.21.15.121:0/3837625766 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-18T22:53:44.100 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:44.097+0000 7ff5aa7fc640 1 --2- 172.21.15.121:0/3837625766 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff5b40fdef0 0x7ff5b4113520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:53:44.100 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:44.097+0000 7ff5b2ffd640 1 -- 172.21.15.121:0/3837625766 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff5b40fdef0 msgr2=0x7ff5b4113520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:53:44.100 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:44.097+0000 7ff5b2ffd640 1 --2- 172.21.15.121:0/3837625766 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff5b40fdef0 0x7ff5b4113520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:53:44.100 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:44.097+0000 7ff5b2ffd640 1 -- 172.21.15.121:0/3837625766 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff59c005040 con 0x7ff5b40650e0 2024-08-18T22:53:44.100 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:44.097+0000 7ff5b2ffd640 1 --2- 172.21.15.121:0/3837625766 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff5b40650e0 0x7ff5b4112fe0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7ff5a400b790 tx=0x7ff5a40091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:53:44.100 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:44.098+0000 7ff5abfff640 1 -- 172.21.15.121:0/3837625766 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff5a400c700 con 0x7ff5b40650e0 2024-08-18T22:53:44.100 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:44.098+0000 7ff5b934b640 1 -- 172.21.15.121:0/3837625766 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5b410d240 con 0x7ff5b40650e0 2024-08-18T22:53:44.100 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:44.098+0000 7ff5abfff640 1 -- 172.21.15.121:0/3837625766 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7ff5a400cd00 con 0x7ff5b40650e0 2024-08-18T22:53:44.100 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:44.098+0000 7ff5abfff640 1 -- 172.21.15.121:0/3837625766 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff5a4015e70 con 0x7ff5b40650e0 2024-08-18T22:53:44.100 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:44.098+0000 7ff5b934b640 1 -- 172.21.15.121:0/3837625766 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5b410d760 con 0x7ff5b40650e0 2024-08-18T22:53:44.101 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:44.099+0000 7ff5b934b640 1 -- 172.21.15.121:0/3837625766 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5b40fda90 con 0x7ff5b40650e0 2024-08-18T22:53:44.101 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:44.099+0000 7ff5abfff640 1 -- 172.21.15.121:0/3837625766 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 37) v1 ==== 92205+0+0 (secure 0 0 0) 0x7ff5a4012070 con 0x7ff5b40650e0 2024-08-18T22:53:44.101 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:44.100+0000 7ff5abfff640 1 --2- 172.21.15.121:0/3837625766 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7ff5a006e0b0 0x7ff5a0070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:53:44.101 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:44.100+0000 7ff5abfff640 1 -- 172.21.15.121:0/3837625766 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6668+0+0 (secure 0 0 0) 0x7ff5a408d5e0 con 0x7ff5b40650e0 2024-08-18T22:53:44.102 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:44.100+0000 7ff5aa7fc640 1 --2- 172.21.15.121:0/3837625766 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7ff5a006e0b0 0x7ff5a0070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:53:44.102 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:44.100+0000 7ff5aa7fc640 1 --2- 172.21.15.121:0/3837625766 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7ff5a006e0b0 0x7ff5a0070560 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7ff59c009ac0 tx=0x7ff59c009da0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:53:44.105 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:44.104+0000 7ff5abfff640 1 -- 172.21.15.121:0/3837625766 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7ff5a4056860 con 0x7ff5b40650e0 2024-08-18T22:53:44.158 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:53:43 smithi195 ceph-mon[68841]: pgmap v339: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:53:44.307 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:44.306+0000 7ff5b934b640 1 -- 172.21.15.121:0/3837625766 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 36, "format": "json"} v 0) v1 -- 0x7ff5b404b4f0 con 0x7ff5b40650e0 2024-08-18T22:53:44.308 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:44.307+0000 7ff5abfff640 1 -- 172.21.15.121:0/3837625766 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 36, "format": "json"}]=0 dumped fsmap epoch 36 v46) v1 ==== 107+0+5124 (secure 0 0 0) 0x7ff5a4059f20 con 0x7ff5b40650e0 2024-08-18T22:53:44.308 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-08-18T22:53:44.308 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":36,"btime":"2024-08-18T22:49:10:675867+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34404,"name":"cephfs.smithi121.xuzsdg","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6827/4267588865","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":4267588865},{"type":"v1","addr":"172.21.15.121:6827","nonce":4267588865}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":29},{"gid":34436,"name":"cephfs.smithi121.gbickb","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6829/2915303436","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6828","nonce":2915303436},{"type":"v1","addr":"172.21.15.121:6829","nonce":2915303436}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":34},{"gid":44299,"name":"cephfs.smithi195.buqvbr","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6825/1574620912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":1574620912},{"type":"v1","addr":"172.21.15.195:6825","nonce":1574620912}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":36}],"filesystems":[{"mdsmap":{"epoch":34,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-18T22:39:04.054074+0000","modified":"2024-08-18T22:48:51.656624+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":82,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24259},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_24259":{"gid":24259,"name":"cephfs.smithi195.nptgyc","rank":0,"incarnation":31,"state":"up:active","state_seq":146,"addr":"172.21.15.195:6827/238549847","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":238549847},{"type":"v1","addr":"172.21.15.195:6827","nonce":238549847}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":24259,"qdb_cluster":[24259]},"id":1}]} 2024-08-18T22:53:44.308 INFO:teuthology.orchestra.run.smithi121.stderr:dumped fsmap epoch 36 2024-08-18T22:53:44.310 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:44.309+0000 7ff5b934b640 1 -- 172.21.15.121:0/3837625766 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7ff5a006e0b0 msgr2=0x7ff5a0070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:53:44.310 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:44.309+0000 7ff5b934b640 1 --2- 172.21.15.121:0/3837625766 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7ff5a006e0b0 0x7ff5a0070560 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7ff59c009ac0 tx=0x7ff59c009da0 comp rx=0 tx=0).stop 2024-08-18T22:53:44.310 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:44.309+0000 7ff5b934b640 1 -- 172.21.15.121:0/3837625766 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff5b40650e0 msgr2=0x7ff5b4112fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:53:44.310 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:44.309+0000 7ff5b934b640 1 --2- 172.21.15.121:0/3837625766 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff5b40650e0 0x7ff5b4112fe0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7ff5a400b790 tx=0x7ff5a40091d0 comp rx=0 tx=0).stop 2024-08-18T22:53:44.310 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:44.309+0000 7ff5b934b640 1 -- 172.21.15.121:0/3837625766 shutdown_connections 2024-08-18T22:53:44.311 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:44.309+0000 7ff5b934b640 1 --2- 172.21.15.121:0/3837625766 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7ff5a006e0b0 0x7ff5a0070560 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:53:44.311 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:44.309+0000 7ff5b934b640 1 --2- 172.21.15.121:0/3837625766 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff5b40fdef0 0x7ff5b4113520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:53:44.311 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:44.309+0000 7ff5b934b640 1 --2- 172.21.15.121:0/3837625766 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff5b40650e0 0x7ff5b4112fe0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:53:44.311 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:44.309+0000 7ff5b934b640 1 -- 172.21.15.121:0/3837625766 >> 172.21.15.121:0/3837625766 conn(0x7ff5b4072150 msgr2=0x7ff5b40f87a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:53:44.311 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:44.309+0000 7ff5b934b640 1 -- 172.21.15.121:0/3837625766 shutdown_connections 2024-08-18T22:53:44.311 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:44.309+0000 7ff5b934b640 1 -- 172.21.15.121:0/3837625766 wait complete. 2024-08-18T22:53:44.999 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:53:44 smithi121 ceph-mon[81053]: from='client.? 172.21.15.121:0/3837625766' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 36, "format": "json"}]: dispatch 2024-08-18T22:53:45.025 DEBUG:tasks.fs:max_mds reduced in epoch 36 2024-08-18T22:53:45.025 DEBUG:teuthology.orchestra.run.smithi121:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid b003123a-5db1-11ef-bccf-c7b262605968 -- ceph fs dump --format=json 37 2024-08-18T22:53:45.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:53:44 smithi195 ceph-mon[68841]: from='client.? 172.21.15.121:0/3837625766' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 36, "format": "json"}]: dispatch 2024-08-18T22:53:45.278 INFO:teuthology.orchestra.run.smithi121.stderr:Inferring config /var/lib/ceph/b003123a-5db1-11ef-bccf-c7b262605968/mon.smithi121/config 2024-08-18T22:53:46.048 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:53:45 smithi121 ceph-mon[81053]: pgmap v340: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:53:46.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:53:45 smithi195 ceph-mon[68841]: pgmap v340: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:53:46.881 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:46.846+0000 7fa09d3a0640 1 -- 172.21.15.121:0/2293483986 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa0981022e0 msgr2=0x7fa0981026b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:53:46.881 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:46.846+0000 7fa09d3a0640 1 --2- 172.21.15.121:0/2293483986 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa0981022e0 0x7fa0981026b0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fa0880048d0 tx=0x7fa088009da0 comp rx=0 tx=0).stop 2024-08-18T22:53:46.881 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:46.846+0000 7fa09d3a0640 1 -- 172.21.15.121:0/2293483986 shutdown_connections 2024-08-18T22:53:46.881 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:46.846+0000 7fa09d3a0640 1 --2- 172.21.15.121:0/2293483986 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa098102c80 0x7fa0980fc310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:53:46.881 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:46.846+0000 7fa09d3a0640 1 --2- 172.21.15.121:0/2293483986 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa0981022e0 0x7fa0981026b0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:53:46.881 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:46.846+0000 7fa09d3a0640 1 -- 172.21.15.121:0/2293483986 >> 172.21.15.121:0/2293483986 conn(0x7fa0980f7e90 msgr2=0x7fa0980fa2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:53:46.881 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:46.846+0000 7fa09d3a0640 1 -- 172.21.15.121:0/2293483986 shutdown_connections 2024-08-18T22:53:46.881 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:46.846+0000 7fa09d3a0640 1 -- 172.21.15.121:0/2293483986 wait complete. 2024-08-18T22:53:46.882 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:46.846+0000 7fa09d3a0640 1 Processor -- start 2024-08-18T22:53:46.882 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:46.847+0000 7fa09d3a0640 1 -- start start 2024-08-18T22:53:46.882 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:46.847+0000 7fa09d3a0640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa0981022e0 0x7fa098112f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:53:46.882 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:46.847+0000 7fa09d3a0640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa098102c80 0x7fa098113480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:53:46.882 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:46.847+0000 7fa09d3a0640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa098113a80 con 0x7fa098102c80 2024-08-18T22:53:46.882 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:46.847+0000 7fa09d3a0640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa09810cec0 con 0x7fa0981022e0 2024-08-18T22:53:46.882 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:46.847+0000 7fa08e7fc640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa098102c80 0x7fa098113480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:53:46.882 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:46.847+0000 7fa08e7fc640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa098102c80 0x7fa098113480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:40830/0 (socket says 172.21.15.121:40830) 2024-08-18T22:53:46.882 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:46.847+0000 7fa08e7fc640 1 -- 172.21.15.121:0/1887682218 learned_addr learned my addr 172.21.15.121:0/1887682218 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-18T22:53:46.882 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:46.847+0000 7fa096ffd640 1 --2- 172.21.15.121:0/1887682218 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa0981022e0 0x7fa098112f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:53:46.882 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:46.847+0000 7fa08e7fc640 1 -- 172.21.15.121:0/1887682218 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa0981022e0 msgr2=0x7fa098112f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:53:46.882 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:46.847+0000 7fa08e7fc640 1 --2- 172.21.15.121:0/1887682218 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa0981022e0 0x7fa098112f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:53:46.882 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:46.847+0000 7fa08e7fc640 1 -- 172.21.15.121:0/1887682218 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa088005040 con 0x7fa098102c80 2024-08-18T22:53:46.883 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:46.848+0000 7fa08e7fc640 1 --2- 172.21.15.121:0/1887682218 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa098102c80 0x7fa098113480 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fa08000c790 tx=0x7fa0800043c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:53:46.883 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:46.848+0000 7fa08ffff640 1 -- 172.21.15.121:0/1887682218 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa08000a7a0 con 0x7fa098102c80 2024-08-18T22:53:46.883 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:46.848+0000 7fa08ffff640 1 -- 172.21.15.121:0/1887682218 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fa08000ada0 con 0x7fa098102c80 2024-08-18T22:53:46.883 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:46.848+0000 7fa08ffff640 1 -- 172.21.15.121:0/1887682218 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa0800113a0 con 0x7fa098102c80 2024-08-18T22:53:46.883 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:46.848+0000 7fa09d3a0640 1 -- 172.21.15.121:0/1887682218 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa09810d1a0 con 0x7fa098102c80 2024-08-18T22:53:46.883 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:46.848+0000 7fa09d3a0640 1 -- 172.21.15.121:0/1887682218 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa09810d740 con 0x7fa098102c80 2024-08-18T22:53:46.883 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:46.849+0000 7fa09d3a0640 1 -- 172.21.15.121:0/1887682218 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0980fda50 con 0x7fa098102c80 2024-08-18T22:53:46.883 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:46.849+0000 7fa08ffff640 1 -- 172.21.15.121:0/1887682218 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 37) v1 ==== 92205+0+0 (secure 0 0 0) 0x7fa08000a900 con 0x7fa098102c80 2024-08-18T22:53:46.883 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:46.850+0000 7fa08ffff640 1 --2- 172.21.15.121:0/1887682218 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7fa08406e0b0 0x7fa084070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:53:46.883 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:46.850+0000 7fa08ffff640 1 -- 172.21.15.121:0/1887682218 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6668+0+0 (secure 0 0 0) 0x7fa08008dd50 con 0x7fa098102c80 2024-08-18T22:53:46.883 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:46.850+0000 7fa096ffd640 1 --2- 172.21.15.121:0/1887682218 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7fa08406e0b0 0x7fa084070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:53:46.883 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:46.850+0000 7fa096ffd640 1 --2- 172.21.15.121:0/1887682218 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7fa08406e0b0 0x7fa084070560 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fa088009ac0 tx=0x7fa088035040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:53:46.883 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:46.854+0000 7fa08ffff640 1 -- 172.21.15.121:0/1887682218 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7fa080057050 con 0x7fa098102c80 2024-08-18T22:53:47.059 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:47.058+0000 7fa09d3a0640 1 -- 172.21.15.121:0/1887682218 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 37, "format": "json"} v 0) v1 -- 0x7fa0981092f0 con 0x7fa098102c80 2024-08-18T22:53:47.059 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:47.058+0000 7fa08ffff640 1 -- 172.21.15.121:0/1887682218 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 37, "format": "json"}]=0 dumped fsmap epoch 37 v46) v1 ==== 107+0+4323 (secure 0 0 0) 0x7fa08005a710 con 0x7fa098102c80 2024-08-18T22:53:47.060 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-08-18T22:53:47.060 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":37,"btime":"2024-08-18T22:49:22:412004+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34404,"name":"cephfs.smithi121.xuzsdg","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6827/4267588865","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":4267588865},{"type":"v1","addr":"172.21.15.121:6827","nonce":4267588865}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":29},{"gid":34436,"name":"cephfs.smithi121.gbickb","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6829/2915303436","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6828","nonce":2915303436},{"type":"v1","addr":"172.21.15.121:6829","nonce":2915303436}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":34},{"gid":44299,"name":"cephfs.smithi195.buqvbr","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6825/1574620912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":1574620912},{"type":"v1","addr":"172.21.15.195:6825","nonce":1574620912}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":36}],"filesystems":[{"mdsmap":{"epoch":37,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-18T22:39:04.054074+0000","modified":"2024-08-18T22:49:22.412001+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":84,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[1],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-08-18T22:53:47.060 INFO:teuthology.orchestra.run.smithi121.stderr:dumped fsmap epoch 37 2024-08-18T22:53:47.062 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:47.060+0000 7fa09d3a0640 1 -- 172.21.15.121:0/1887682218 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7fa08406e0b0 msgr2=0x7fa084070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:53:47.062 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:47.060+0000 7fa09d3a0640 1 --2- 172.21.15.121:0/1887682218 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7fa08406e0b0 0x7fa084070560 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fa088009ac0 tx=0x7fa088035040 comp rx=0 tx=0).stop 2024-08-18T22:53:47.062 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:47.060+0000 7fa09d3a0640 1 -- 172.21.15.121:0/1887682218 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa098102c80 msgr2=0x7fa098113480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:53:47.062 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:47.060+0000 7fa09d3a0640 1 --2- 172.21.15.121:0/1887682218 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa098102c80 0x7fa098113480 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fa08000c790 tx=0x7fa0800043c0 comp rx=0 tx=0).stop 2024-08-18T22:53:47.062 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:47.060+0000 7fa09d3a0640 1 -- 172.21.15.121:0/1887682218 shutdown_connections 2024-08-18T22:53:47.062 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:47.060+0000 7fa09d3a0640 1 --2- 172.21.15.121:0/1887682218 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7fa08406e0b0 0x7fa084070560 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:53:47.062 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:47.060+0000 7fa09d3a0640 1 --2- 172.21.15.121:0/1887682218 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa098102c80 0x7fa098113480 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:53:47.062 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:47.060+0000 7fa09d3a0640 1 --2- 172.21.15.121:0/1887682218 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa0981022e0 0x7fa098112f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:53:47.062 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:47.060+0000 7fa09d3a0640 1 -- 172.21.15.121:0/1887682218 >> 172.21.15.121:0/1887682218 conn(0x7fa0980f7e90 msgr2=0x7fa0980f8f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:53:47.062 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:47.061+0000 7fa09d3a0640 1 -- 172.21.15.121:0/1887682218 shutdown_connections 2024-08-18T22:53:47.063 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:47.061+0000 7fa09d3a0640 1 -- 172.21.15.121:0/1887682218 wait complete. 2024-08-18T22:53:47.722 DEBUG:tasks.fs:max_mds reduced in epoch 37 2024-08-18T22:53:47.722 DEBUG:teuthology.orchestra.run.smithi121:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid b003123a-5db1-11ef-bccf-c7b262605968 -- ceph fs dump --format=json 38 2024-08-18T22:53:47.973 INFO:teuthology.orchestra.run.smithi121.stderr:Inferring config /var/lib/ceph/b003123a-5db1-11ef-bccf-c7b262605968/mon.smithi121/config 2024-08-18T22:53:48.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:53:47 smithi121 ceph-mon[81053]: pgmap v341: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:53:48.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:53:47 smithi121 ceph-mon[81053]: from='client.? 172.21.15.121:0/1887682218' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 37, "format": "json"}]: dispatch 2024-08-18T22:53:48.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:53:47 smithi195 ceph-mon[68841]: pgmap v341: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:53:48.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:53:47 smithi195 ceph-mon[68841]: from='client.? 172.21.15.121:0/1887682218' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 37, "format": "json"}]: dispatch 2024-08-18T22:53:49.483 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:49.467+0000 7f9abd221640 1 -- 172.21.15.121:0/1112043535 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9ab81023b0 msgr2=0x7f9ab8102780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:53:49.483 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:49.467+0000 7f9abd221640 1 --2- 172.21.15.121:0/1112043535 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9ab81023b0 0x7f9ab8102780 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f9aa80048d0 tx=0x7f9aa8009da0 comp rx=0 tx=0).stop 2024-08-18T22:53:49.483 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:49.467+0000 7f9abd221640 1 -- 172.21.15.121:0/1112043535 shutdown_connections 2024-08-18T22:53:49.483 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:49.467+0000 7f9abd221640 1 --2- 172.21.15.121:0/1112043535 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9ab80faa00 0x7f9ab80fae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:53:49.483 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:49.467+0000 7f9abd221640 1 --2- 172.21.15.121:0/1112043535 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9ab81023b0 0x7f9ab8102780 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:53:49.483 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:49.467+0000 7f9abd221640 1 -- 172.21.15.121:0/1112043535 >> 172.21.15.121:0/1112043535 conn(0x7f9ab8070a20 msgr2=0x7f9ab8070e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:53:49.483 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:49.467+0000 7f9abd221640 1 -- 172.21.15.121:0/1112043535 shutdown_connections 2024-08-18T22:53:49.483 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:49.467+0000 7f9abd221640 1 -- 172.21.15.121:0/1112043535 wait complete. 2024-08-18T22:53:49.484 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:49.468+0000 7f9abd221640 1 Processor -- start 2024-08-18T22:53:49.484 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:49.468+0000 7f9abd221640 1 -- start start 2024-08-18T22:53:49.484 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:49.468+0000 7f9abd221640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9ab80faa00 0x7f9ab8112f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:53:49.484 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:49.468+0000 7f9abd221640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9ab81023b0 0x7f9ab8113490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:53:49.484 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:49.468+0000 7f9abd221640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ab8113a90 con 0x7f9ab81023b0 2024-08-18T22:53:49.484 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:49.468+0000 7f9abd221640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ab810ced0 con 0x7f9ab80faa00 2024-08-18T22:53:49.484 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:49.468+0000 7f9aaffff640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9ab81023b0 0x7f9ab8113490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:53:49.484 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:49.468+0000 7f9aaffff640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9ab81023b0 0x7f9ab8113490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:40856/0 (socket says 172.21.15.121:40856) 2024-08-18T22:53:49.484 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:49.468+0000 7f9aaffff640 1 -- 172.21.15.121:0/2629591327 learned_addr learned my addr 172.21.15.121:0/2629591327 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-18T22:53:49.484 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:49.468+0000 7f9ab6d9d640 1 --2- 172.21.15.121:0/2629591327 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9ab80faa00 0x7f9ab8112f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:53:49.484 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:49.468+0000 7f9aaffff640 1 -- 172.21.15.121:0/2629591327 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9ab80faa00 msgr2=0x7f9ab8112f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:53:49.484 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:49.468+0000 7f9aaffff640 1 --2- 172.21.15.121:0/2629591327 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9ab80faa00 0x7f9ab8112f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:53:49.484 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:49.468+0000 7f9aaffff640 1 -- 172.21.15.121:0/2629591327 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9aa8005040 con 0x7f9ab81023b0 2024-08-18T22:53:49.484 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:49.468+0000 7f9ab6d9d640 1 --2- 172.21.15.121:0/2629591327 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9ab80faa00 0x7f9ab8112f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:53:49.485 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:49.469+0000 7f9aaffff640 1 --2- 172.21.15.121:0/2629591327 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9ab81023b0 0x7f9ab8113490 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f9aa000c810 tx=0x7f9aa00043c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:53:49.485 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:49.469+0000 7f9aaf7fe640 1 -- 172.21.15.121:0/2629591327 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9aa000a820 con 0x7f9ab81023b0 2024-08-18T22:53:49.485 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:49.469+0000 7f9aaf7fe640 1 -- 172.21.15.121:0/2629591327 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f9aa000ae20 con 0x7f9ab81023b0 2024-08-18T22:53:49.485 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:49.469+0000 7f9abd221640 1 -- 172.21.15.121:0/2629591327 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ab810d1b0 con 0x7f9ab81023b0 2024-08-18T22:53:49.485 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:49.469+0000 7f9aaf7fe640 1 -- 172.21.15.121:0/2629591327 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9aa00115c0 con 0x7f9ab81023b0 2024-08-18T22:53:49.485 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:49.469+0000 7f9abd221640 1 -- 172.21.15.121:0/2629591327 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ab810d750 con 0x7f9ab81023b0 2024-08-18T22:53:49.485 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:49.470+0000 7f9abd221640 1 -- 172.21.15.121:0/2629591327 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ab80655b0 con 0x7f9ab81023b0 2024-08-18T22:53:49.485 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:49.470+0000 7f9aaf7fe640 1 -- 172.21.15.121:0/2629591327 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 37) v1 ==== 92205+0+0 (secure 0 0 0) 0x7f9aa0012840 con 0x7f9ab81023b0 2024-08-18T22:53:49.485 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:49.471+0000 7f9aaf7fe640 1 --2- 172.21.15.121:0/2629591327 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f9aa406e0b0 0x7f9aa4070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:53:49.485 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:49.471+0000 7f9aaf7fe640 1 -- 172.21.15.121:0/2629591327 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6668+0+0 (secure 0 0 0) 0x7f9aa008e170 con 0x7f9ab81023b0 2024-08-18T22:53:49.485 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:49.471+0000 7f9ab6d9d640 1 --2- 172.21.15.121:0/2629591327 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f9aa406e0b0 0x7f9aa4070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:53:49.485 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:49.471+0000 7f9ab6d9d640 1 --2- 172.21.15.121:0/2629591327 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f9aa406e0b0 0x7f9aa4070560 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f9aa800b020 tx=0x7f9aa8009da0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:53:49.485 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:49.475+0000 7f9aaf7fe640 1 -- 172.21.15.121:0/2629591327 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f9aa005afa0 con 0x7f9ab81023b0 2024-08-18T22:53:49.678 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:49.677+0000 7f9abd221640 1 -- 172.21.15.121:0/2629591327 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 38, "format": "json"} v 0) v1 -- 0x7f9ab81093d0 con 0x7f9ab81023b0 2024-08-18T22:53:49.678 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:49.677+0000 7f9aaf7fe640 1 -- 172.21.15.121:0/2629591327 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 38, "format": "json"}]=0 dumped fsmap epoch 38 v46) v1 ==== 107+0+4402 (secure 0 0 0) 0x7f9aa005ab30 con 0x7f9ab81023b0 2024-08-18T22:53:49.678 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-08-18T22:53:49.679 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":38,"btime":"2024-08-18T22:49:22:418750+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34436,"name":"cephfs.smithi121.gbickb","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6829/2915303436","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6828","nonce":2915303436},{"type":"v1","addr":"172.21.15.121:6829","nonce":2915303436}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":34},{"gid":44299,"name":"cephfs.smithi195.buqvbr","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6825/1574620912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":1574620912},{"type":"v1","addr":"172.21.15.195:6825","nonce":1574620912}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":36}],"filesystems":[{"mdsmap":{"epoch":38,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-18T22:39:04.054074+0000","modified":"2024-08-18T22:49:22.418741+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":84,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34404},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_34404":{"gid":34404,"name":"cephfs.smithi121.xuzsdg","rank":0,"incarnation":38,"state":"up:replay","state_seq":1,"addr":"172.21.15.121:6827/4267588865","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":4267588865},{"type":"v1","addr":"172.21.15.121:6827","nonce":4267588865}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-08-18T22:53:49.679 INFO:teuthology.orchestra.run.smithi121.stderr:dumped fsmap epoch 38 2024-08-18T22:53:49.681 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:49.680+0000 7f9abd221640 1 -- 172.21.15.121:0/2629591327 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f9aa406e0b0 msgr2=0x7f9aa4070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:53:49.681 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:49.680+0000 7f9abd221640 1 --2- 172.21.15.121:0/2629591327 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f9aa406e0b0 0x7f9aa4070560 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f9aa800b020 tx=0x7f9aa8009da0 comp rx=0 tx=0).stop 2024-08-18T22:53:49.681 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:49.680+0000 7f9abd221640 1 -- 172.21.15.121:0/2629591327 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9ab81023b0 msgr2=0x7f9ab8113490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:53:49.681 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:49.680+0000 7f9abd221640 1 --2- 172.21.15.121:0/2629591327 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9ab81023b0 0x7f9ab8113490 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f9aa000c810 tx=0x7f9aa00043c0 comp rx=0 tx=0).stop 2024-08-18T22:53:49.681 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:49.680+0000 7f9abd221640 1 -- 172.21.15.121:0/2629591327 shutdown_connections 2024-08-18T22:53:49.681 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:49.680+0000 7f9abd221640 1 --2- 172.21.15.121:0/2629591327 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f9aa406e0b0 0x7f9aa4070560 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:53:49.681 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:49.680+0000 7f9abd221640 1 --2- 172.21.15.121:0/2629591327 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9ab81023b0 0x7f9ab8113490 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:53:49.681 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:49.680+0000 7f9abd221640 1 --2- 172.21.15.121:0/2629591327 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9ab80faa00 0x7f9ab8112f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:53:49.681 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:49.680+0000 7f9abd221640 1 -- 172.21.15.121:0/2629591327 >> 172.21.15.121:0/2629591327 conn(0x7f9ab8070a20 msgr2=0x7f9ab80f9d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:53:49.682 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:49.680+0000 7f9abd221640 1 -- 172.21.15.121:0/2629591327 shutdown_connections 2024-08-18T22:53:49.682 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:49.680+0000 7f9abd221640 1 -- 172.21.15.121:0/2629591327 wait complete. 2024-08-18T22:53:50.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:53:49 smithi121 ceph-mon[81053]: pgmap v342: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:53:50.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:53:49 smithi121 ceph-mon[81053]: from='client.? 172.21.15.121:0/2629591327' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 38, "format": "json"}]: dispatch 2024-08-18T22:53:50.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:53:49 smithi195 ceph-mon[68841]: pgmap v342: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:53:50.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:53:49 smithi195 ceph-mon[68841]: from='client.? 172.21.15.121:0/2629591327' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 38, "format": "json"}]: dispatch 2024-08-18T22:53:50.328 DEBUG:tasks.fs:max_mds reduced in epoch 38 2024-08-18T22:53:50.328 DEBUG:teuthology.orchestra.run.smithi121:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid b003123a-5db1-11ef-bccf-c7b262605968 -- ceph fs dump --format=json 39 2024-08-18T22:53:50.575 INFO:teuthology.orchestra.run.smithi121.stderr:Inferring config /var/lib/ceph/b003123a-5db1-11ef-bccf-c7b262605968/mon.smithi121/config 2024-08-18T22:53:51.982 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:53:51 smithi121 ceph-mon[81053]: pgmap v343: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:53:52.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:53:51 smithi195 ceph-mon[68841]: pgmap v343: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:53:52.236 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:52.233+0000 7f997a49a640 1 -- 172.21.15.121:0/1399779308 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9974101b90 msgr2=0x7f99740fb220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:53:52.236 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:52.233+0000 7f997a49a640 1 --2- 172.21.15.121:0/1399779308 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9974101b90 0x7f99740fb220 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f99680048d0 tx=0x7f9968009da0 comp rx=0 tx=0).stop 2024-08-18T22:53:52.236 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:52.233+0000 7f997a49a640 1 -- 172.21.15.121:0/1399779308 shutdown_connections 2024-08-18T22:53:52.236 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:52.233+0000 7f997a49a640 1 --2- 172.21.15.121:0/1399779308 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9974101b90 0x7f99740fb220 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:53:52.236 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:52.233+0000 7f997a49a640 1 --2- 172.21.15.121:0/1399779308 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f99741011f0 0x7f99741015c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:53:52.236 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:52.233+0000 7f997a49a640 1 -- 172.21.15.121:0/1399779308 >> 172.21.15.121:0/1399779308 conn(0x7f99740f6da0 msgr2=0x7f99740f91b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:53:52.236 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:52.233+0000 7f997a49a640 1 -- 172.21.15.121:0/1399779308 shutdown_connections 2024-08-18T22:53:52.236 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:52.233+0000 7f997a49a640 1 -- 172.21.15.121:0/1399779308 wait complete. 2024-08-18T22:53:52.236 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:52.234+0000 7f997a49a640 1 Processor -- start 2024-08-18T22:53:52.237 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:52.234+0000 7f997a49a640 1 -- start start 2024-08-18T22:53:52.237 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:52.234+0000 7f997a49a640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f99741011f0 0x7f9974112fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:53:52.237 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:52.234+0000 7f997a49a640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9974101b90 0x7f9974113520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:53:52.237 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:52.234+0000 7f997a49a640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9974113b20 con 0x7f99741011f0 2024-08-18T22:53:52.237 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:52.234+0000 7f997a49a640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9974113c90 con 0x7f9974101b90 2024-08-18T22:53:52.237 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:52.234+0000 7f9973fff640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f99741011f0 0x7f9974112fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:53:52.237 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:52.234+0000 7f9973fff640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f99741011f0 0x7f9974112fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:40882/0 (socket says 172.21.15.121:40882) 2024-08-18T22:53:52.237 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:52.234+0000 7f9973fff640 1 -- 172.21.15.121:0/3102697569 learned_addr learned my addr 172.21.15.121:0/3102697569 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-18T22:53:52.237 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:52.234+0000 7f99737fe640 1 --2- 172.21.15.121:0/3102697569 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9974101b90 0x7f9974113520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:53:52.237 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:52.234+0000 7f9973fff640 1 -- 172.21.15.121:0/3102697569 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9974101b90 msgr2=0x7f9974113520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:53:52.237 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:52.234+0000 7f9973fff640 1 --2- 172.21.15.121:0/3102697569 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9974101b90 0x7f9974113520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:53:52.237 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:52.234+0000 7f9973fff640 1 -- 172.21.15.121:0/3102697569 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9968005040 con 0x7f99741011f0 2024-08-18T22:53:52.237 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:52.234+0000 7f99737fe640 1 --2- 172.21.15.121:0/3102697569 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9974101b90 0x7f9974113520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:53:52.237 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:52.235+0000 7f9973fff640 1 --2- 172.21.15.121:0/3102697569 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f99741011f0 0x7f9974112fe0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f9964002a50 tx=0x7f9964004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:53:52.238 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:52.235+0000 7f9970ff9640 1 -- 172.21.15.121:0/3102697569 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9964007c30 con 0x7f99741011f0 2024-08-18T22:53:52.238 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:52.235+0000 7f9970ff9640 1 -- 172.21.15.121:0/3102697569 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f996400f040 con 0x7f99741011f0 2024-08-18T22:53:52.238 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:52.235+0000 7f997a49a640 1 -- 172.21.15.121:0/3102697569 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f997410d110 con 0x7f99741011f0 2024-08-18T22:53:52.238 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:52.235+0000 7f9970ff9640 1 -- 172.21.15.121:0/3102697569 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f996400da90 con 0x7f99741011f0 2024-08-18T22:53:52.238 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:52.235+0000 7f997a49a640 1 -- 172.21.15.121:0/3102697569 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f997410d630 con 0x7f99741011f0 2024-08-18T22:53:52.239 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:52.236+0000 7f997a49a640 1 -- 172.21.15.121:0/3102697569 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99740fc960 con 0x7f99741011f0 2024-08-18T22:53:52.239 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:52.236+0000 7f9970ff9640 1 -- 172.21.15.121:0/3102697569 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 37) v1 ==== 92205+0+0 (secure 0 0 0) 0x7f996400dc30 con 0x7f99741011f0 2024-08-18T22:53:52.239 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:52.237+0000 7f9970ff9640 1 --2- 172.21.15.121:0/3102697569 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f995c06e0b0 0x7f995c070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:53:52.239 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:52.237+0000 7f99737fe640 1 --2- 172.21.15.121:0/3102697569 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f995c06e0b0 0x7f995c070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:53:52.239 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:52.237+0000 7f9970ff9640 1 -- 172.21.15.121:0/3102697569 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6668+0+0 (secure 0 0 0) 0x7f996408d460 con 0x7f99741011f0 2024-08-18T22:53:52.239 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:52.238+0000 7f99737fe640 1 --2- 172.21.15.121:0/3102697569 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f995c06e0b0 0x7f995c070560 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f996800b020 tx=0x7f9968009da0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:53:52.242 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:52.242+0000 7f9970ff9640 1 -- 172.21.15.121:0/3102697569 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f9964056760 con 0x7f99741011f0 2024-08-18T22:53:52.445 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:52.444+0000 7f997a49a640 1 -- 172.21.15.121:0/3102697569 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 39, "format": "json"} v 0) v1 -- 0x7f997410e690 con 0x7f99741011f0 2024-08-18T22:53:52.445 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:52.444+0000 7f9970ff9640 1 -- 172.21.15.121:0/3102697569 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 39, "format": "json"}]=0 dumped fsmap epoch 39 v46) v1 ==== 107+0+4406 (secure 0 0 0) 0x7f9964059e20 con 0x7f99741011f0 2024-08-18T22:53:52.446 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-08-18T22:53:52.446 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":39,"btime":"2024-08-18T22:49:27:651607+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34436,"name":"cephfs.smithi121.gbickb","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6829/2915303436","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6828","nonce":2915303436},{"type":"v1","addr":"172.21.15.121:6829","nonce":2915303436}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":34},{"gid":44299,"name":"cephfs.smithi195.buqvbr","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6825/1574620912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":1574620912},{"type":"v1","addr":"172.21.15.195:6825","nonce":1574620912}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":36}],"filesystems":[{"mdsmap":{"epoch":39,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-18T22:39:04.054074+0000","modified":"2024-08-18T22:49:26.830800+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":84,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34404},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_34404":{"gid":34404,"name":"cephfs.smithi121.xuzsdg","rank":0,"incarnation":38,"state":"up:reconnect","state_seq":15,"addr":"172.21.15.121:6827/4267588865","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":4267588865},{"type":"v1","addr":"172.21.15.121:6827","nonce":4267588865}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-08-18T22:53:52.446 INFO:teuthology.orchestra.run.smithi121.stderr:dumped fsmap epoch 39 2024-08-18T22:53:52.448 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:52.446+0000 7f997a49a640 1 -- 172.21.15.121:0/3102697569 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f995c06e0b0 msgr2=0x7f995c070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:53:52.448 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:52.446+0000 7f997a49a640 1 --2- 172.21.15.121:0/3102697569 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f995c06e0b0 0x7f995c070560 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f996800b020 tx=0x7f9968009da0 comp rx=0 tx=0).stop 2024-08-18T22:53:52.448 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:52.446+0000 7f997a49a640 1 -- 172.21.15.121:0/3102697569 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f99741011f0 msgr2=0x7f9974112fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:53:52.448 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:52.446+0000 7f997a49a640 1 --2- 172.21.15.121:0/3102697569 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f99741011f0 0x7f9974112fe0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f9964002a50 tx=0x7f9964004600 comp rx=0 tx=0).stop 2024-08-18T22:53:52.448 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:52.447+0000 7f997a49a640 1 -- 172.21.15.121:0/3102697569 shutdown_connections 2024-08-18T22:53:52.448 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:52.447+0000 7f997a49a640 1 --2- 172.21.15.121:0/3102697569 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f995c06e0b0 0x7f995c070560 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:53:52.448 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:52.447+0000 7f997a49a640 1 --2- 172.21.15.121:0/3102697569 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9974101b90 0x7f9974113520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:53:52.448 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:52.447+0000 7f997a49a640 1 --2- 172.21.15.121:0/3102697569 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f99741011f0 0x7f9974112fe0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:53:52.448 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:52.447+0000 7f997a49a640 1 -- 172.21.15.121:0/3102697569 >> 172.21.15.121:0/3102697569 conn(0x7f99740f6da0 msgr2=0x7f99740657f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:53:52.448 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:52.447+0000 7f997a49a640 1 -- 172.21.15.121:0/3102697569 shutdown_connections 2024-08-18T22:53:52.449 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:52.447+0000 7f997a49a640 1 -- 172.21.15.121:0/3102697569 wait complete. 2024-08-18T22:53:53.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:53:52 smithi121 ceph-mon[81053]: from='client.? 172.21.15.121:0/3102697569' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 39, "format": "json"}]: dispatch 2024-08-18T22:53:53.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:53:52 smithi195 ceph-mon[68841]: from='client.? 172.21.15.121:0/3102697569' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 39, "format": "json"}]: dispatch 2024-08-18T22:53:53.189 DEBUG:tasks.fs:max_mds reduced in epoch 39 2024-08-18T22:53:53.189 DEBUG:teuthology.orchestra.run.smithi121:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid b003123a-5db1-11ef-bccf-c7b262605968 -- ceph fs dump --format=json 40 2024-08-18T22:53:53.446 INFO:teuthology.orchestra.run.smithi121.stderr:Inferring config /var/lib/ceph/b003123a-5db1-11ef-bccf-c7b262605968/mon.smithi121/config 2024-08-18T22:53:53.833 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:53:53 smithi121 ceph-mon[81053]: pgmap v344: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:53:53.833 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:53:53 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-18T22:53:54.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:53:53 smithi195 ceph-mon[68841]: pgmap v344: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:53:54.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:53:53 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-18T22:53:54.929 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:54.914+0000 7f982617b640 1 -- 172.21.15.121:0/3504138068 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9820102cb0 msgr2=0x7f98200fc340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:53:54.929 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:54.914+0000 7f982617b640 1 --2- 172.21.15.121:0/3504138068 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9820102cb0 0x7f98200fc340 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f98140048d0 tx=0x7f9814009da0 comp rx=0 tx=0).stop 2024-08-18T22:53:54.929 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:54.914+0000 7f982617b640 1 -- 172.21.15.121:0/3504138068 shutdown_connections 2024-08-18T22:53:54.929 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:54.914+0000 7f982617b640 1 --2- 172.21.15.121:0/3504138068 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9820102cb0 0x7f98200fc340 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:53:54.930 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:54.914+0000 7f982617b640 1 --2- 172.21.15.121:0/3504138068 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9820102310 0x7f98201026e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:53:54.930 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:54.914+0000 7f982617b640 1 -- 172.21.15.121:0/3504138068 >> 172.21.15.121:0/3504138068 conn(0x7f98200f7ec0 msgr2=0x7f98200fa2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:53:54.930 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:54.914+0000 7f982617b640 1 -- 172.21.15.121:0/3504138068 shutdown_connections 2024-08-18T22:53:54.930 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:54.914+0000 7f982617b640 1 -- 172.21.15.121:0/3504138068 wait complete. 2024-08-18T22:53:54.930 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:54.914+0000 7f982617b640 1 Processor -- start 2024-08-18T22:53:54.930 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:54.914+0000 7f982617b640 1 -- start start 2024-08-18T22:53:54.930 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:54.915+0000 7f982617b640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9820102310 0x7f9820113020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:53:54.930 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:54.915+0000 7f982617b640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9820102cb0 0x7f9820113560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:53:54.930 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:54.915+0000 7f982617b640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9820113bf0 con 0x7f9820102310 2024-08-18T22:53:54.930 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:54.915+0000 7f982617b640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f982010cfa0 con 0x7f9820102cb0 2024-08-18T22:53:54.930 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:54.915+0000 7f981f7fe640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9820102310 0x7f9820113020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:53:54.930 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:54.915+0000 7f981f7fe640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9820102310 0x7f9820113020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:40898/0 (socket says 172.21.15.121:40898) 2024-08-18T22:53:54.930 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:54.915+0000 7f981f7fe640 1 -- 172.21.15.121:0/1331880715 learned_addr learned my addr 172.21.15.121:0/1331880715 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-18T22:53:54.931 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:54.915+0000 7f981effd640 1 --2- 172.21.15.121:0/1331880715 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9820102cb0 0x7f9820113560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:53:54.931 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:54.915+0000 7f981f7fe640 1 -- 172.21.15.121:0/1331880715 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9820102cb0 msgr2=0x7f9820113560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:53:54.931 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:54.915+0000 7f981f7fe640 1 --2- 172.21.15.121:0/1331880715 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9820102cb0 0x7f9820113560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:53:54.931 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:54.915+0000 7f981f7fe640 1 -- 172.21.15.121:0/1331880715 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9814005040 con 0x7f9820102310 2024-08-18T22:53:54.931 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:54.915+0000 7f981f7fe640 1 --2- 172.21.15.121:0/1331880715 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9820102310 0x7f9820113020 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f981000b790 tx=0x7f98100091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:53:54.931 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:54.915+0000 7f9807fff640 1 -- 172.21.15.121:0/1331880715 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f981000c700 con 0x7f9820102310 2024-08-18T22:53:54.931 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:54.915+0000 7f9807fff640 1 -- 172.21.15.121:0/1331880715 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f981000cd00 con 0x7f9820102310 2024-08-18T22:53:54.931 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:54.915+0000 7f982617b640 1 -- 172.21.15.121:0/1331880715 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f982010d280 con 0x7f9820102310 2024-08-18T22:53:54.931 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:54.915+0000 7f9807fff640 1 -- 172.21.15.121:0/1331880715 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9810015e80 con 0x7f9820102310 2024-08-18T22:53:54.931 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:54.915+0000 7f982617b640 1 -- 172.21.15.121:0/1331880715 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f982010d770 con 0x7f9820102310 2024-08-18T22:53:54.931 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:54.916+0000 7f982617b640 1 -- 172.21.15.121:0/1331880715 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98200fda80 con 0x7f9820102310 2024-08-18T22:53:54.931 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:54.917+0000 7f9807fff640 1 -- 172.21.15.121:0/1331880715 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 37) v1 ==== 92205+0+0 (secure 0 0 0) 0x7f9810012070 con 0x7f9820102310 2024-08-18T22:53:54.931 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:54.917+0000 7f9807fff640 1 --2- 172.21.15.121:0/1331880715 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f980806e0b0 0x7f9808070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:53:54.931 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:54.917+0000 7f9807fff640 1 -- 172.21.15.121:0/1331880715 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6668+0+0 (secure 0 0 0) 0x7f981008d530 con 0x7f9820102310 2024-08-18T22:53:54.931 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:54.917+0000 7f981effd640 1 --2- 172.21.15.121:0/1331880715 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f980806e0b0 0x7f9808070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:53:54.932 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:54.918+0000 7f981effd640 1 --2- 172.21.15.121:0/1331880715 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f980806e0b0 0x7f9808070560 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f9814009ac0 tx=0x7f9814035040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:53:54.932 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:54.922+0000 7f9807fff640 1 -- 172.21.15.121:0/1331880715 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f98100567b0 con 0x7f9820102310 2024-08-18T22:53:55.123 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:55.122+0000 7f982617b640 1 -- 172.21.15.121:0/1331880715 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 40, "format": "json"} v 0) v1 -- 0x7f982004b4c0 con 0x7f9820102310 2024-08-18T22:53:55.123 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:55.123+0000 7f9807fff640 1 -- 172.21.15.121:0/1331880715 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 40, "format": "json"}]=0 dumped fsmap epoch 40 v46) v1 ==== 107+0+4403 (secure 0 0 0) 0x7f9810059e70 con 0x7f9820102310 2024-08-18T22:53:55.124 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-08-18T22:53:55.124 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":40,"btime":"2024-08-18T22:49:28:657130+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34436,"name":"cephfs.smithi121.gbickb","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6829/2915303436","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6828","nonce":2915303436},{"type":"v1","addr":"172.21.15.121:6829","nonce":2915303436}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":34},{"gid":44299,"name":"cephfs.smithi195.buqvbr","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6825/1574620912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":1574620912},{"type":"v1","addr":"172.21.15.195:6825","nonce":1574620912}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":36}],"filesystems":[{"mdsmap":{"epoch":40,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-18T22:39:04.054074+0000","modified":"2024-08-18T22:49:27.659807+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":84,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34404},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_34404":{"gid":34404,"name":"cephfs.smithi121.xuzsdg","rank":0,"incarnation":38,"state":"up:rejoin","state_seq":16,"addr":"172.21.15.121:6827/4267588865","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":4267588865},{"type":"v1","addr":"172.21.15.121:6827","nonce":4267588865}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-08-18T22:53:55.124 INFO:teuthology.orchestra.run.smithi121.stderr:dumped fsmap epoch 40 2024-08-18T22:53:55.125 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:55.124+0000 7f982617b640 1 -- 172.21.15.121:0/1331880715 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f980806e0b0 msgr2=0x7f9808070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:53:55.125 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:55.124+0000 7f982617b640 1 --2- 172.21.15.121:0/1331880715 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f980806e0b0 0x7f9808070560 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f9814009ac0 tx=0x7f9814035040 comp rx=0 tx=0).stop 2024-08-18T22:53:55.126 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:55.124+0000 7f982617b640 1 -- 172.21.15.121:0/1331880715 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9820102310 msgr2=0x7f9820113020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:53:55.126 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:55.124+0000 7f982617b640 1 --2- 172.21.15.121:0/1331880715 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9820102310 0x7f9820113020 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f981000b790 tx=0x7f98100091d0 comp rx=0 tx=0).stop 2024-08-18T22:53:55.126 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:55.125+0000 7f982617b640 1 -- 172.21.15.121:0/1331880715 shutdown_connections 2024-08-18T22:53:55.126 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:55.125+0000 7f982617b640 1 --2- 172.21.15.121:0/1331880715 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f980806e0b0 0x7f9808070560 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:53:55.126 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:55.125+0000 7f982617b640 1 --2- 172.21.15.121:0/1331880715 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9820102cb0 0x7f9820113560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:53:55.126 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:55.125+0000 7f982617b640 1 --2- 172.21.15.121:0/1331880715 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9820102310 0x7f9820113020 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:53:55.126 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:55.125+0000 7f982617b640 1 -- 172.21.15.121:0/1331880715 >> 172.21.15.121:0/1331880715 conn(0x7f98200f7ec0 msgr2=0x7f98200f8e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:53:55.126 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:55.125+0000 7f982617b640 1 -- 172.21.15.121:0/1331880715 shutdown_connections 2024-08-18T22:53:55.126 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:55.125+0000 7f982617b640 1 -- 172.21.15.121:0/1331880715 wait complete. 2024-08-18T22:53:55.709 DEBUG:tasks.fs:max_mds reduced in epoch 40 2024-08-18T22:53:55.709 DEBUG:teuthology.orchestra.run.smithi121:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid b003123a-5db1-11ef-bccf-c7b262605968 -- ceph fs dump --format=json 41 2024-08-18T22:53:55.962 INFO:teuthology.orchestra.run.smithi121.stderr:Inferring config /var/lib/ceph/b003123a-5db1-11ef-bccf-c7b262605968/mon.smithi121/config 2024-08-18T22:53:56.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:53:55 smithi121 ceph-mon[81053]: pgmap v345: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:53:56.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:53:55 smithi121 ceph-mon[81053]: from='client.? 172.21.15.121:0/1331880715' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 40, "format": "json"}]: dispatch 2024-08-18T22:53:56.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:53:55 smithi195 ceph-mon[68841]: pgmap v345: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:53:56.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:53:55 smithi195 ceph-mon[68841]: from='client.? 172.21.15.121:0/1331880715' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 40, "format": "json"}]: dispatch 2024-08-18T22:53:57.541 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:57.539+0000 7f2761ce3640 1 -- 172.21.15.121:0/4054236283 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f275c0fb210 msgr2=0x7f275c0fb660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:53:57.541 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:57.539+0000 7f2761ce3640 1 --2- 172.21.15.121:0/4054236283 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f275c0fb210 0x7f275c0fb660 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f27440048d0 tx=0x7f2744009da0 comp rx=0 tx=0).stop 2024-08-18T22:53:57.541 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:57.539+0000 7f2761ce3640 1 -- 172.21.15.121:0/4054236283 shutdown_connections 2024-08-18T22:53:57.541 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:57.539+0000 7f2761ce3640 1 --2- 172.21.15.121:0/4054236283 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f275c0fb210 0x7f275c0fb660 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:53:57.541 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:57.539+0000 7f2761ce3640 1 --2- 172.21.15.121:0/4054236283 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f275c101230 0x7f275c101600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:53:57.541 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:57.539+0000 7f2761ce3640 1 -- 172.21.15.121:0/4054236283 >> 172.21.15.121:0/4054236283 conn(0x7f275c0711f0 msgr2=0x7f275c0715f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:53:57.541 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:57.539+0000 7f2761ce3640 1 -- 172.21.15.121:0/4054236283 shutdown_connections 2024-08-18T22:53:57.541 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:57.539+0000 7f2761ce3640 1 -- 172.21.15.121:0/4054236283 wait complete. 2024-08-18T22:53:57.541 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:57.539+0000 7f2761ce3640 1 Processor -- start 2024-08-18T22:53:57.541 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:57.539+0000 7f2761ce3640 1 -- start start 2024-08-18T22:53:57.541 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:57.539+0000 7f2761ce3640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f275c0fb210 0x7f275c112f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:53:57.541 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:57.539+0000 7f2761ce3640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f275c101230 0x7f275c113460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:53:57.542 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:57.540+0000 7f2761ce3640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f275c113af0 con 0x7f275c0fb210 2024-08-18T22:53:57.542 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:57.540+0000 7f2761ce3640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f275c10cea0 con 0x7f275c101230 2024-08-18T22:53:57.542 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:57.540+0000 7f275b7fe640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f275c0fb210 0x7f275c112f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:53:57.542 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:57.540+0000 7f275b7fe640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f275c0fb210 0x7f275c112f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:55558/0 (socket says 172.21.15.121:55558) 2024-08-18T22:53:57.542 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:57.540+0000 7f275b7fe640 1 -- 172.21.15.121:0/1774178703 learned_addr learned my addr 172.21.15.121:0/1774178703 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-18T22:53:57.542 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:57.540+0000 7f2753fff640 1 --2- 172.21.15.121:0/1774178703 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f275c101230 0x7f275c113460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:53:57.542 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:57.540+0000 7f275b7fe640 1 -- 172.21.15.121:0/1774178703 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f275c101230 msgr2=0x7f275c113460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:53:57.542 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:57.540+0000 7f275b7fe640 1 --2- 172.21.15.121:0/1774178703 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f275c101230 0x7f275c113460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:53:57.542 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:57.540+0000 7f275b7fe640 1 -- 172.21.15.121:0/1774178703 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2744005040 con 0x7f275c0fb210 2024-08-18T22:53:57.542 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:57.540+0000 7f275b7fe640 1 --2- 172.21.15.121:0/1774178703 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f275c0fb210 0x7f275c112f20 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f274c00b790 tx=0x7f274c0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:53:57.544 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:57.540+0000 7f2758ff9640 1 -- 172.21.15.121:0/1774178703 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f274c00c700 con 0x7f275c0fb210 2024-08-18T22:53:57.544 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:57.540+0000 7f2758ff9640 1 -- 172.21.15.121:0/1774178703 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f274c00cd00 con 0x7f275c0fb210 2024-08-18T22:53:57.544 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:57.540+0000 7f2761ce3640 1 -- 172.21.15.121:0/1774178703 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f275c10d180 con 0x7f275c0fb210 2024-08-18T22:53:57.544 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:57.540+0000 7f2758ff9640 1 -- 172.21.15.121:0/1774178703 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f274c015e70 con 0x7f275c0fb210 2024-08-18T22:53:57.544 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:57.541+0000 7f2761ce3640 1 -- 172.21.15.121:0/1774178703 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f275c10d670 con 0x7f275c0fb210 2024-08-18T22:53:57.544 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:57.542+0000 7f2761ce3640 1 -- 172.21.15.121:0/1774178703 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f275c0fc8f0 con 0x7f275c0fb210 2024-08-18T22:53:57.544 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:57.542+0000 7f2758ff9640 1 -- 172.21.15.121:0/1774178703 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 37) v1 ==== 92205+0+0 (secure 0 0 0) 0x7f274c012070 con 0x7f275c0fb210 2024-08-18T22:53:57.544 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:57.542+0000 7f2758ff9640 1 --2- 172.21.15.121:0/1774178703 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f274806e0b0 0x7f2748070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:53:57.544 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:57.543+0000 7f2758ff9640 1 -- 172.21.15.121:0/1774178703 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6668+0+0 (secure 0 0 0) 0x7f274c08d850 con 0x7f275c0fb210 2024-08-18T22:53:57.544 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:57.543+0000 7f2753fff640 1 --2- 172.21.15.121:0/1774178703 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f274806e0b0 0x7f2748070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:53:57.544 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:57.543+0000 7f2753fff640 1 --2- 172.21.15.121:0/1774178703 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f274806e0b0 0x7f2748070560 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f2744000c00 tx=0x7f2744009da0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:53:57.548 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:57.547+0000 7f2758ff9640 1 -- 172.21.15.121:0/1774178703 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f274c056ad0 con 0x7f275c0fb210 2024-08-18T22:53:57.749 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:57.748+0000 7f2761ce3640 1 -- 172.21.15.121:0/1774178703 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 41, "format": "json"} v 0) v1 -- 0x7f275c04b550 con 0x7f275c0fb210 2024-08-18T22:53:57.749 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:57.749+0000 7f2758ff9640 1 -- 172.21.15.121:0/1774178703 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 41, "format": "json"}]=0 dumped fsmap epoch 41 v46) v1 ==== 107+0+4409 (secure 0 0 0) 0x7f274c05a190 con 0x7f275c0fb210 2024-08-18T22:53:57.750 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-08-18T22:53:57.750 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":41,"btime":"2024-08-18T22:49:29:662241+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34436,"name":"cephfs.smithi121.gbickb","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6829/2915303436","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6828","nonce":2915303436},{"type":"v1","addr":"172.21.15.121:6829","nonce":2915303436}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":34},{"gid":44299,"name":"cephfs.smithi195.buqvbr","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6825/1574620912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":1574620912},{"type":"v1","addr":"172.21.15.195:6825","nonce":1574620912}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":36}],"filesystems":[{"mdsmap":{"epoch":41,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-18T22:39:04.054074+0000","modified":"2024-08-18T22:49:28.764155+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":84,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34404},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_34404":{"gid":34404,"name":"cephfs.smithi121.xuzsdg","rank":0,"incarnation":38,"state":"up:clientreplay","state_seq":17,"addr":"172.21.15.121:6827/4267588865","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":4267588865},{"type":"v1","addr":"172.21.15.121:6827","nonce":4267588865}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-08-18T22:53:57.750 INFO:teuthology.orchestra.run.smithi121.stderr:dumped fsmap epoch 41 2024-08-18T22:53:57.752 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:57.751+0000 7f2761ce3640 1 -- 172.21.15.121:0/1774178703 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f274806e0b0 msgr2=0x7f2748070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:53:57.752 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:57.751+0000 7f2761ce3640 1 --2- 172.21.15.121:0/1774178703 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f274806e0b0 0x7f2748070560 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f2744000c00 tx=0x7f2744009da0 comp rx=0 tx=0).stop 2024-08-18T22:53:57.752 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:57.751+0000 7f2761ce3640 1 -- 172.21.15.121:0/1774178703 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f275c0fb210 msgr2=0x7f275c112f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:53:57.752 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:57.751+0000 7f2761ce3640 1 --2- 172.21.15.121:0/1774178703 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f275c0fb210 0x7f275c112f20 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f274c00b790 tx=0x7f274c0091d0 comp rx=0 tx=0).stop 2024-08-18T22:53:57.752 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:57.751+0000 7f2761ce3640 1 -- 172.21.15.121:0/1774178703 shutdown_connections 2024-08-18T22:53:57.752 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:57.751+0000 7f2761ce3640 1 --2- 172.21.15.121:0/1774178703 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f274806e0b0 0x7f2748070560 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:53:57.752 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:57.751+0000 7f2761ce3640 1 --2- 172.21.15.121:0/1774178703 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f275c101230 0x7f275c113460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:53:57.752 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:57.751+0000 7f2761ce3640 1 --2- 172.21.15.121:0/1774178703 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f275c0fb210 0x7f275c112f20 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:53:57.752 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:57.751+0000 7f2761ce3640 1 -- 172.21.15.121:0/1774178703 >> 172.21.15.121:0/1774178703 conn(0x7f275c0711f0 msgr2=0x7f275c0f9d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:53:57.752 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:57.751+0000 7f2761ce3640 1 -- 172.21.15.121:0/1774178703 shutdown_connections 2024-08-18T22:53:57.752 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:53:57.751+0000 7f2761ce3640 1 -- 172.21.15.121:0/1774178703 wait complete. 2024-08-18T22:53:58.049 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:53:57 smithi121 ceph-mon[81053]: pgmap v346: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:53:58.049 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:53:57 smithi121 ceph-mon[81053]: from='client.? 172.21.15.121:0/1774178703' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 41, "format": "json"}]: dispatch 2024-08-18T22:53:58.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:53:57 smithi195 ceph-mon[68841]: pgmap v346: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:53:58.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:53:57 smithi195 ceph-mon[68841]: from='client.? 172.21.15.121:0/1774178703' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 41, "format": "json"}]: dispatch 2024-08-18T22:53:58.526 DEBUG:tasks.fs:max_mds reduced in epoch 41 2024-08-18T22:53:58.526 DEBUG:teuthology.orchestra.run.smithi121:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid b003123a-5db1-11ef-bccf-c7b262605968 -- ceph fs dump --format=json 42 2024-08-18T22:53:58.777 INFO:teuthology.orchestra.run.smithi121.stderr:Inferring config /var/lib/ceph/b003123a-5db1-11ef-bccf-c7b262605968/mon.smithi121/config 2024-08-18T22:54:00.075 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:53:59 smithi121 ceph-mon[81053]: pgmap v347: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:54:00.158 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:53:59 smithi195 ceph-mon[68841]: pgmap v347: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:54:00.381 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:54:00.377+0000 7f43ba3d5640 1 -- 172.21.15.121:0/1782934373 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f43b4101210 msgr2=0x7f43b41015e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:54:00.381 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:54:00.377+0000 7f43ba3d5640 1 --2- 172.21.15.121:0/1782934373 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f43b4101210 0x7f43b41015e0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f43a40048d0 tx=0x7f43a4009da0 comp rx=0 tx=0).stop 2024-08-18T22:54:00.381 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:54:00.377+0000 7f43ba3d5640 1 -- 172.21.15.121:0/1782934373 shutdown_connections 2024-08-18T22:54:00.381 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:54:00.377+0000 7f43ba3d5640 1 --2- 172.21.15.121:0/1782934373 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f43b4101bb0 0x7f43b40fb240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:54:00.382 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:54:00.377+0000 7f43ba3d5640 1 --2- 172.21.15.121:0/1782934373 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f43b4101210 0x7f43b41015e0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:54:00.382 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:54:00.377+0000 7f43ba3d5640 1 -- 172.21.15.121:0/1782934373 >> 172.21.15.121:0/1782934373 conn(0x7f43b40f6dc0 msgr2=0x7f43b40f91d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:54:00.382 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:54:00.377+0000 7f43ba3d5640 1 -- 172.21.15.121:0/1782934373 shutdown_connections 2024-08-18T22:54:00.382 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:54:00.377+0000 7f43ba3d5640 1 -- 172.21.15.121:0/1782934373 wait complete. 2024-08-18T22:54:00.382 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:54:00.378+0000 7f43ba3d5640 1 Processor -- start 2024-08-18T22:54:00.382 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:54:00.378+0000 7f43ba3d5640 1 -- start start 2024-08-18T22:54:00.382 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:54:00.378+0000 7f43ba3d5640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f43b4101210 0x7f43b410dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:54:00.382 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:54:00.378+0000 7f43ba3d5640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f43b4101bb0 0x7f43b410e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:54:00.382 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:54:00.378+0000 7f43ba3d5640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43b410ebc0 con 0x7f43b4101210 2024-08-18T22:54:00.382 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:54:00.378+0000 7f43ba3d5640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43b410ed30 con 0x7f43b4101bb0 2024-08-18T22:54:00.382 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:54:00.378+0000 7f43b3fff640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f43b4101210 0x7f43b410dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:54:00.382 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:54:00.378+0000 7f43b3fff640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f43b4101210 0x7f43b410dfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:55566/0 (socket says 172.21.15.121:55566) 2024-08-18T22:54:00.383 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:54:00.378+0000 7f43b3fff640 1 -- 172.21.15.121:0/1781622481 learned_addr learned my addr 172.21.15.121:0/1781622481 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-18T22:54:00.383 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:54:00.378+0000 7f43b37fe640 1 --2- 172.21.15.121:0/1781622481 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f43b4101bb0 0x7f43b410e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:54:00.383 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:54:00.378+0000 7f43b3fff640 1 -- 172.21.15.121:0/1781622481 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f43b4101bb0 msgr2=0x7f43b410e4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:54:00.383 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:54:00.378+0000 7f43b3fff640 1 --2- 172.21.15.121:0/1781622481 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f43b4101bb0 0x7f43b410e4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:54:00.383 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:54:00.379+0000 7f43b3fff640 1 -- 172.21.15.121:0/1781622481 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43a4005040 con 0x7f43b4101210 2024-08-18T22:54:00.383 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:54:00.379+0000 7f43b37fe640 1 --2- 172.21.15.121:0/1781622481 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f43b4101bb0 0x7f43b410e4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:54:00.383 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:54:00.379+0000 7f43b3fff640 1 --2- 172.21.15.121:0/1781622481 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f43b4101210 0x7f43b410dfa0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f43a4003080 tx=0x7f43a4009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:54:00.383 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:54:00.379+0000 7f43b0ff9640 1 -- 172.21.15.121:0/1781622481 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f43a4038070 con 0x7f43b4101210 2024-08-18T22:54:00.383 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:54:00.379+0000 7f43ba3d5640 1 -- 172.21.15.121:0/1781622481 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43b4117010 con 0x7f43b4101210 2024-08-18T22:54:00.383 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:54:00.379+0000 7f43b0ff9640 1 -- 172.21.15.121:0/1781622481 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f43a40097e0 con 0x7f43b4101210 2024-08-18T22:54:00.383 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:54:00.379+0000 7f43b0ff9640 1 -- 172.21.15.121:0/1781622481 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f43a403d420 con 0x7f43b4101210 2024-08-18T22:54:00.383 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:54:00.379+0000 7f43ba3d5640 1 -- 172.21.15.121:0/1781622481 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43b4117480 con 0x7f43b4101210 2024-08-18T22:54:00.384 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:54:00.380+0000 7f43ba3d5640 1 -- 172.21.15.121:0/1781622481 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43b40fc980 con 0x7f43b4101210 2024-08-18T22:54:00.384 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:54:00.380+0000 7f43b0ff9640 1 -- 172.21.15.121:0/1781622481 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 37) v1 ==== 92205+0+0 (secure 0 0 0) 0x7f43a4030020 con 0x7f43b4101210 2024-08-18T22:54:00.384 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:54:00.381+0000 7f43b0ff9640 1 --2- 172.21.15.121:0/1781622481 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f439c06e0b0 0x7f439c070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:54:00.385 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:54:00.381+0000 7f43b0ff9640 1 -- 172.21.15.121:0/1781622481 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6668+0+0 (secure 0 0 0) 0x7f43a40ae1f0 con 0x7f43b4101210 2024-08-18T22:54:00.385 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:54:00.381+0000 7f43b37fe640 1 --2- 172.21.15.121:0/1781622481 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f439c06e0b0 0x7f439c070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:54:00.385 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:54:00.381+0000 7f43b37fe640 1 --2- 172.21.15.121:0/1781622481 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f439c06e0b0 0x7f439c070560 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f43a8006fd0 tx=0x7f43a8008040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:54:00.387 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:54:00.385+0000 7f43b0ff9640 1 -- 172.21.15.121:0/1781622481 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f43a4077470 con 0x7f43b4101210 2024-08-18T22:54:00.585 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:54:00.583+0000 7f43ba3d5640 1 -- 172.21.15.121:0/1781622481 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 42, "format": "json"} v 0) v1 -- 0x7f43b404b4f0 con 0x7f43b4101210 2024-08-18T22:54:00.586 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:54:00.584+0000 7f43b0ff9640 1 -- 172.21.15.121:0/1781622481 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 42, "format": "json"}]=0 dumped fsmap epoch 42 v46) v1 ==== 107+0+4412 (secure 0 0 0) 0x7f43a407ab30 con 0x7f43b4101210 2024-08-18T22:54:00.586 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-08-18T22:54:00.586 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":42,"btime":"2024-08-18T22:49:30:667891+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34436,"name":"cephfs.smithi121.gbickb","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6829/2915303436","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6828","nonce":2915303436},{"type":"v1","addr":"172.21.15.121:6829","nonce":2915303436}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":34},{"gid":44299,"name":"cephfs.smithi195.buqvbr","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6825/1574620912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":1574620912},{"type":"v1","addr":"172.21.15.195:6825","nonce":1574620912}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":36}],"filesystems":[{"mdsmap":{"epoch":42,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-18T22:39:04.054074+0000","modified":"2024-08-18T22:49:30.667887+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":84,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34404},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_34404":{"gid":34404,"name":"cephfs.smithi121.xuzsdg","rank":0,"incarnation":38,"state":"up:active","state_seq":18,"addr":"172.21.15.121:6827/4267588865","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":4267588865},{"type":"v1","addr":"172.21.15.121:6827","nonce":4267588865}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":34404,"qdb_cluster":[34404]},"id":1}]} 2024-08-18T22:54:00.587 INFO:teuthology.orchestra.run.smithi121.stderr:dumped fsmap epoch 42 2024-08-18T22:54:00.588 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:54:00.586+0000 7f43ba3d5640 1 -- 172.21.15.121:0/1781622481 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f439c06e0b0 msgr2=0x7f439c070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:54:00.588 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:54:00.586+0000 7f43ba3d5640 1 --2- 172.21.15.121:0/1781622481 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f439c06e0b0 0x7f439c070560 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f43a8006fd0 tx=0x7f43a8008040 comp rx=0 tx=0).stop 2024-08-18T22:54:00.588 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:54:00.586+0000 7f43ba3d5640 1 -- 172.21.15.121:0/1781622481 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f43b4101210 msgr2=0x7f43b410dfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:54:00.588 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:54:00.586+0000 7f43ba3d5640 1 --2- 172.21.15.121:0/1781622481 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f43b4101210 0x7f43b410dfa0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f43a4003080 tx=0x7f43a4009da0 comp rx=0 tx=0).stop 2024-08-18T22:54:00.588 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:54:00.586+0000 7f43ba3d5640 1 -- 172.21.15.121:0/1781622481 shutdown_connections 2024-08-18T22:54:00.588 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:54:00.586+0000 7f43ba3d5640 1 --2- 172.21.15.121:0/1781622481 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f439c06e0b0 0x7f439c070560 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:54:00.589 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:54:00.586+0000 7f43ba3d5640 1 --2- 172.21.15.121:0/1781622481 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f43b4101bb0 0x7f43b410e4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:54:00.589 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:54:00.586+0000 7f43ba3d5640 1 --2- 172.21.15.121:0/1781622481 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f43b4101210 0x7f43b410dfa0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:54:00.589 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:54:00.586+0000 7f43ba3d5640 1 -- 172.21.15.121:0/1781622481 >> 172.21.15.121:0/1781622481 conn(0x7f43b40f6dc0 msgr2=0x7f43b40f7d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:54:00.589 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:54:00.586+0000 7f43ba3d5640 1 -- 172.21.15.121:0/1781622481 shutdown_connections 2024-08-18T22:54:00.589 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:54:00.586+0000 7f43ba3d5640 1 -- 172.21.15.121:0/1781622481 wait complete. 2024-08-18T22:54:01.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:54:00 smithi121 ceph-mon[81053]: from='client.? 172.21.15.121:0/1781622481' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 42, "format": "json"}]: dispatch 2024-08-18T22:54:01.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:54:00 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-18T22:54:01.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:54:00 smithi195 ceph-mon[68841]: from='client.? 172.21.15.121:0/1781622481' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 42, "format": "json"}]: dispatch 2024-08-18T22:54:01.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:54:00 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-18T22:54:01.331 DEBUG:tasks.fs:max_mds reduced in epoch 42 2024-08-18T22:54:01.331 DEBUG:teuthology.orchestra.run.smithi121:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid b003123a-5db1-11ef-bccf-c7b262605968 -- ceph fs dump --format=json 43 2024-08-18T22:54:01.610 INFO:teuthology.orchestra.run.smithi121.stderr:Inferring config /var/lib/ceph/b003123a-5db1-11ef-bccf-c7b262605968/mon.smithi121/config 2024-08-18T22:54:02.044 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:54:01 smithi121 ceph-mon[81053]: pgmap v348: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:54:02.044 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:54:01 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:54:02.044 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:54:01 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:54:02.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:54:01 smithi195 ceph-mon[68841]: pgmap v348: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:54:02.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:54:01 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:54:02.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:54:01 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:54:03.043 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:54:02 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:54:03.043 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:54:02 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-18T22:54:03.043 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:54:02 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:54:03.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:54:02 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:54:03.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:54:02 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-18T22:54:03.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:54:02 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:54:03.460 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:54:03.256+0000 7f79bcff1640 1 -- 172.21.15.121:0/2461157327 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f79b80fdef0 msgr2=0x7f79b80fe320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:54:03.460 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:54:03.256+0000 7f79bcff1640 1 --2- 172.21.15.121:0/2461157327 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f79b80fdef0 0x7f79b80fe320 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f79a8009c50 tx=0x7f79a8004d10 comp rx=0 tx=0).stop 2024-08-18T22:54:03.461 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:54:03.256+0000 7f79bcff1640 1 -- 172.21.15.121:0/2461157327 shutdown_connections 2024-08-18T22:54:03.461 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:54:03.256+0000 7f79bcff1640 1 --2- 172.21.15.121:0/2461157327 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f79b80fdef0 0x7f79b80fe320 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:54:03.461 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:54:03.256+0000 7f79bcff1640 1 --2- 172.21.15.121:0/2461157327 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f79b80650e0 0x7f79b80654b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:54:03.461 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:54:03.256+0000 7f79bcff1640 1 -- 172.21.15.121:0/2461157327 >> 172.21.15.121:0/2461157327 conn(0x7f79b8072150 msgr2=0x7f79b8072550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:54:03.461 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:54:03.256+0000 7f79bcff1640 1 -- 172.21.15.121:0/2461157327 shutdown_connections 2024-08-18T22:54:03.461 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:54:03.256+0000 7f79bcff1640 1 -- 172.21.15.121:0/2461157327 wait complete. 2024-08-18T22:54:03.461 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:54:03.256+0000 7f79bcff1640 1 Processor -- start 2024-08-18T22:54:03.461 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:54:03.256+0000 7f79bcff1640 1 -- start start 2024-08-18T22:54:03.461 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:54:03.257+0000 7f79bcff1640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f79b80650e0 0x7f79b8113000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:54:03.461 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:54:03.257+0000 7f79bcff1640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f79b80fdef0 0x7f79b8113540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:54:03.462 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:54:03.257+0000 7f79bcff1640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79b8113b40 con 0x7f79b80650e0 2024-08-18T22:54:03.462 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:54:03.257+0000 7f79bcff1640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79b810cf80 con 0x7f79b80fdef0 2024-08-18T22:54:03.462 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:54:03.257+0000 7f79b659c640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f79b80650e0 0x7f79b8113000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:54:03.462 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:54:03.257+0000 7f79b659c640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f79b80650e0 0x7f79b8113000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:55574/0 (socket says 172.21.15.121:55574) 2024-08-18T22:54:03.462 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:54:03.257+0000 7f79b659c640 1 -- 172.21.15.121:0/1040345293 learned_addr learned my addr 172.21.15.121:0/1040345293 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-18T22:54:03.462 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:54:03.257+0000 7f79b5d9b640 1 --2- 172.21.15.121:0/1040345293 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f79b80fdef0 0x7f79b8113540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:54:03.462 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:54:03.257+0000 7f79b659c640 1 -- 172.21.15.121:0/1040345293 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f79b80fdef0 msgr2=0x7f79b8113540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:54:03.462 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:54:03.257+0000 7f79b659c640 1 --2- 172.21.15.121:0/1040345293 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f79b80fdef0 0x7f79b8113540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:54:03.462 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:54:03.257+0000 7f79b659c640 1 -- 172.21.15.121:0/1040345293 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79a80098b0 con 0x7f79b80650e0 2024-08-18T22:54:03.463 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:54:03.257+0000 7f79b5d9b640 1 --2- 172.21.15.121:0/1040345293 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f79b80fdef0 0x7f79b8113540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:54:03.463 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:54:03.257+0000 7f79b659c640 1 --2- 172.21.15.121:0/1040345293 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f79b80650e0 0x7f79b8113000 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f79ac002a50 tx=0x7f79ac004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:54:03.463 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:54:03.257+0000 7f79a6ffd640 1 -- 172.21.15.121:0/1040345293 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f79ac007c30 con 0x7f79b80650e0 2024-08-18T22:54:03.463 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:54:03.257+0000 7f79bcff1640 1 -- 172.21.15.121:0/1040345293 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79b810d260 con 0x7f79b80650e0 2024-08-18T22:54:03.463 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:54:03.258+0000 7f79a6ffd640 1 -- 172.21.15.121:0/1040345293 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f79ac00f040 con 0x7f79b80650e0 2024-08-18T22:54:03.463 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:54:03.258+0000 7f79a6ffd640 1 -- 172.21.15.121:0/1040345293 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f79ac00da90 con 0x7f79b80650e0 2024-08-18T22:54:03.463 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:54:03.258+0000 7f79bcff1640 1 -- 172.21.15.121:0/1040345293 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79b810d750 con 0x7f79b80650e0 2024-08-18T22:54:03.463 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:54:03.258+0000 7f79bcff1640 1 -- 172.21.15.121:0/1040345293 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79b80fda90 con 0x7f79b80650e0 2024-08-18T22:54:03.463 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:54:03.259+0000 7f79a6ffd640 1 -- 172.21.15.121:0/1040345293 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 37) v1 ==== 92205+0+0 (secure 0 0 0) 0x7f79ac00dd00 con 0x7f79b80650e0 2024-08-18T22:54:03.463 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:54:03.260+0000 7f79a6ffd640 1 --2- 172.21.15.121:0/1040345293 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f79a006e100 0x7f79a00705b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:54:03.463 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:54:03.260+0000 7f79a6ffd640 1 -- 172.21.15.121:0/1040345293 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6668+0+0 (secure 0 0 0) 0x7f79ac08d600 con 0x7f79b80650e0 2024-08-18T22:54:03.463 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:54:03.263+0000 7f79b5d9b640 1 --2- 172.21.15.121:0/1040345293 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f79a006e100 0x7f79a00705b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:54:03.464 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:54:03.263+0000 7f79b5d9b640 1 --2- 172.21.15.121:0/1040345293 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f79a006e100 0x7f79a00705b0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f79b80f90c0 tx=0x7f79a8004d10 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:54:03.464 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:54:03.268+0000 7f79a6ffd640 1 -- 172.21.15.121:0/1040345293 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f79ac0567e0 con 0x7f79b80650e0 2024-08-18T22:54:03.474 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:54:03.472+0000 7f79bcff1640 1 -- 172.21.15.121:0/1040345293 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 43, "format": "json"} v 0) v1 -- 0x7f79b804b4f0 con 0x7f79b80650e0 2024-08-18T22:54:03.475 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:54:03.473+0000 7f79a6ffd640 1 -- 172.21.15.121:0/1040345293 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 43, "format": "json"}]=0 dumped fsmap epoch 43 v46) v1 ==== 107+0+5262 (secure 0 0 0) 0x7f79ac059ea0 con 0x7f79b80650e0 2024-08-18T22:54:03.475 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-08-18T22:54:03.475 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":43,"btime":"2024-08-18T22:49:34:676487+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34436,"name":"cephfs.smithi121.gbickb","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6829/2915303436","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6828","nonce":2915303436},{"type":"v1","addr":"172.21.15.121:6829","nonce":2915303436}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":34},{"gid":44299,"name":"cephfs.smithi195.buqvbr","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6825/1574620912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":1574620912},{"type":"v1","addr":"172.21.15.195:6825","nonce":1574620912}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":36},{"gid":44327,"name":"cephfs.smithi195.nptgyc","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6827/4050783124","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":4050783124},{"type":"v1","addr":"172.21.15.195:6827","nonce":4050783124}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":43}],"filesystems":[{"mdsmap":{"epoch":42,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-18T22:39:04.054074+0000","modified":"2024-08-18T22:49:30.667887+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":84,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34404},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_34404":{"gid":34404,"name":"cephfs.smithi121.xuzsdg","rank":0,"incarnation":38,"state":"up:active","state_seq":18,"addr":"172.21.15.121:6827/4267588865","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":4267588865},{"type":"v1","addr":"172.21.15.121:6827","nonce":4267588865}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":34404,"qdb_cluster":[34404]},"id":1}]} 2024-08-18T22:54:03.475 INFO:teuthology.orchestra.run.smithi121.stderr:dumped fsmap epoch 43 2024-08-18T22:54:03.477 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:54:03.475+0000 7f79bcff1640 1 -- 172.21.15.121:0/1040345293 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f79a006e100 msgr2=0x7f79a00705b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:54:03.477 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:54:03.475+0000 7f79bcff1640 1 --2- 172.21.15.121:0/1040345293 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f79a006e100 0x7f79a00705b0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f79b80f90c0 tx=0x7f79a8004d10 comp rx=0 tx=0).stop 2024-08-18T22:54:03.477 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:54:03.475+0000 7f79bcff1640 1 -- 172.21.15.121:0/1040345293 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f79b80650e0 msgr2=0x7f79b8113000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:54:03.477 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:54:03.475+0000 7f79bcff1640 1 --2- 172.21.15.121:0/1040345293 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f79b80650e0 0x7f79b8113000 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f79ac002a50 tx=0x7f79ac004600 comp rx=0 tx=0).stop 2024-08-18T22:54:03.477 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:54:03.475+0000 7f79bcff1640 1 -- 172.21.15.121:0/1040345293 shutdown_connections 2024-08-18T22:54:03.478 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:54:03.475+0000 7f79bcff1640 1 --2- 172.21.15.121:0/1040345293 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f79a006e100 0x7f79a00705b0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:54:03.478 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:54:03.475+0000 7f79bcff1640 1 --2- 172.21.15.121:0/1040345293 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f79b80fdef0 0x7f79b8113540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:54:03.478 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:54:03.475+0000 7f79bcff1640 1 --2- 172.21.15.121:0/1040345293 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f79b80650e0 0x7f79b8113000 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:54:03.478 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:54:03.475+0000 7f79bcff1640 1 -- 172.21.15.121:0/1040345293 >> 172.21.15.121:0/1040345293 conn(0x7f79b8072150 msgr2=0x7f79b8101010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:54:03.478 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:54:03.475+0000 7f79bcff1640 1 -- 172.21.15.121:0/1040345293 shutdown_connections 2024-08-18T22:54:03.478 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:54:03.475+0000 7f79bcff1640 1 -- 172.21.15.121:0/1040345293 wait complete. 2024-08-18T22:54:04.048 DEBUG:tasks.fs:max_mds reduced in epoch 43 2024-08-18T22:54:04.048 DEBUG:teuthology.orchestra.run.smithi121:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid b003123a-5db1-11ef-bccf-c7b262605968 -- ceph fs dump --format=json 44 2024-08-18T22:54:04.071 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:54:03 smithi121 ceph-mon[81053]: pgmap v349: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:54:04.071 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:54:03 smithi121 ceph-mon[81053]: from='client.? 172.21.15.121:0/1040345293' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 43, "format": "json"}]: dispatch 2024-08-18T22:54:04.158 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:54:03 smithi195 ceph-mon[68841]: pgmap v349: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:54:04.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:54:03 smithi195 ceph-mon[68841]: from='client.? 172.21.15.121:0/1040345293' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 43, "format": "json"}]: dispatch 2024-08-18T22:54:04.296 INFO:teuthology.orchestra.run.smithi121.stderr:Inferring config /var/lib/ceph/b003123a-5db1-11ef-bccf-c7b262605968/mon.smithi121/config 2024-08-18T22:54:05.842 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:54:05.816+0000 7f19e21e4640 1 -- 172.21.15.121:0/679598461 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f19dc102330 msgr2=0x7f19dc102700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:54:05.842 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:54:05.816+0000 7f19e21e4640 1 --2- 172.21.15.121:0/679598461 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f19dc102330 0x7f19dc102700 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f19d00048d0 tx=0x7f19d0009da0 comp rx=0 tx=0).stop 2024-08-18T22:54:05.842 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:54:05.816+0000 7f19e21e4640 1 -- 172.21.15.121:0/679598461 shutdown_connections 2024-08-18T22:54:05.842 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:54:05.816+0000 7f19e21e4640 1 --2- 172.21.15.121:0/679598461 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f19dc102cd0 0x7f19dc0faa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:54:05.842 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:54:05.816+0000 7f19e21e4640 1 --2- 172.21.15.121:0/679598461 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f19dc102330 0x7f19dc102700 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:54:05.842 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:54:05.816+0000 7f19e21e4640 1 -- 172.21.15.121:0/679598461 >> 172.21.15.121:0/679598461 conn(0x7f19dc070a80 msgr2=0x7f19dc070e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:54:05.842 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:54:05.816+0000 7f19e21e4640 1 -- 172.21.15.121:0/679598461 shutdown_connections 2024-08-18T22:54:05.843 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:54:05.816+0000 7f19e21e4640 1 -- 172.21.15.121:0/679598461 wait complete. 2024-08-18T22:54:05.843 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:54:05.817+0000 7f19e21e4640 1 Processor -- start 2024-08-18T22:54:05.843 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:54:05.817+0000 7f19e21e4640 1 -- start start 2024-08-18T22:54:05.843 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:54:05.817+0000 7f19e21e4640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f19dc102330 0x7f19dc0fbc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:54:05.843 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:54:05.817+0000 7f19e21e4640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f19dc102cd0 0x7f19dc0fc140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:54:05.843 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:54:05.817+0000 7f19e21e4640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19dc0fc680 con 0x7f19dc102cd0 2024-08-18T22:54:05.843 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:54:05.817+0000 7f19e21e4640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19dc0fc7f0 con 0x7f19dc102330 2024-08-18T22:54:05.843 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:54:05.817+0000 7f19daffd640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f19dc102cd0 0x7f19dc0fc140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:54:05.843 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:54:05.817+0000 7f19daffd640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f19dc102cd0 0x7f19dc0fc140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:55588/0 (socket says 172.21.15.121:55588) 2024-08-18T22:54:05.843 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:54:05.817+0000 7f19daffd640 1 -- 172.21.15.121:0/3239863940 learned_addr learned my addr 172.21.15.121:0/3239863940 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-18T22:54:05.843 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:54:05.817+0000 7f19db7fe640 1 --2- 172.21.15.121:0/3239863940 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f19dc102330 0x7f19dc0fbc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:54:05.843 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:54:05.817+0000 7f19daffd640 1 -- 172.21.15.121:0/3239863940 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f19dc102330 msgr2=0x7f19dc0fbc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:54:05.843 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:54:05.817+0000 7f19daffd640 1 --2- 172.21.15.121:0/3239863940 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f19dc102330 0x7f19dc0fbc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:54:05.843 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:54:05.817+0000 7f19daffd640 1 -- 172.21.15.121:0/3239863940 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19d0005040 con 0x7f19dc102cd0 2024-08-18T22:54:05.844 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:54:05.817+0000 7f19db7fe640 1 --2- 172.21.15.121:0/3239863940 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f19dc102330 0x7f19dc0fbc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T22:54:05.844 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:54:05.818+0000 7f19daffd640 1 --2- 172.21.15.121:0/3239863940 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f19dc102cd0 0x7f19dc0fc140 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f19cc00c760 tx=0x7f19cc00cb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:54:05.844 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:54:05.818+0000 7f19c3fff640 1 -- 172.21.15.121:0/3239863940 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f19cc00a820 con 0x7f19dc102cd0 2024-08-18T22:54:05.844 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:54:05.818+0000 7f19e21e4640 1 -- 172.21.15.121:0/3239863940 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19dc0fca80 con 0x7f19dc102cd0 2024-08-18T22:54:05.844 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:54:05.818+0000 7f19c3fff640 1 -- 172.21.15.121:0/3239863940 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f19cc00ae20 con 0x7f19dc102cd0 2024-08-18T22:54:05.844 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:54:05.818+0000 7f19c3fff640 1 -- 172.21.15.121:0/3239863940 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f19cc0113a0 con 0x7f19dc102cd0 2024-08-18T22:54:05.844 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:54:05.818+0000 7f19e21e4640 1 -- 172.21.15.121:0/3239863940 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19dc119720 con 0x7f19dc102cd0 2024-08-18T22:54:05.844 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:54:05.819+0000 7f19e21e4640 1 -- 172.21.15.121:0/3239863940 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19dc065550 con 0x7f19dc102cd0 2024-08-18T22:54:05.844 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:54:05.819+0000 7f19c3fff640 1 -- 172.21.15.121:0/3239863940 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 37) v1 ==== 92205+0+0 (secure 0 0 0) 0x7f19cc012790 con 0x7f19dc102cd0 2024-08-18T22:54:05.844 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:54:05.820+0000 7f19c3fff640 1 --2- 172.21.15.121:0/3239863940 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f19c406e0b0 0x7f19c4070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:54:05.844 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:54:05.820+0000 7f19c3fff640 1 -- 172.21.15.121:0/3239863940 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6668+0+0 (secure 0 0 0) 0x7f19cc08de10 con 0x7f19dc102cd0 2024-08-18T22:54:05.844 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:54:05.820+0000 7f19db7fe640 1 --2- 172.21.15.121:0/3239863940 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f19c406e0b0 0x7f19c4070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:54:05.844 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:54:05.820+0000 7f19db7fe640 1 --2- 172.21.15.121:0/3239863940 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f19c406e0b0 0x7f19c4070560 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f19d000b020 tx=0x7f19d0009da0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:54:05.844 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:54:05.824+0000 7f19c3fff640 1 -- 172.21.15.121:0/3239863940 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f19cc057110 con 0x7f19dc102cd0 2024-08-18T22:54:06.027 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:54:06.025+0000 7f19e21e4640 1 -- 172.21.15.121:0/3239863940 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 44, "format": "json"} v 0) v1 -- 0x7f19dc0749a0 con 0x7f19dc102cd0 2024-08-18T22:54:06.027 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:54:05 smithi121 ceph-mon[81053]: pgmap v350: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:54:06.028 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:54:06.025+0000 7f19c3fff640 1 -- 172.21.15.121:0/3239863940 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 44, "format": "json"}]=0 dumped fsmap epoch 44 v46) v1 ==== 107+0+5262 (secure 0 0 0) 0x7f19cc05a7d0 con 0x7f19dc102cd0 2024-08-18T22:54:06.028 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-08-18T22:54:06.028 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":44,"btime":"2024-08-18T22:49:42:264254+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34436,"name":"cephfs.smithi121.gbickb","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6829/2915303436","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6828","nonce":2915303436},{"type":"v1","addr":"172.21.15.121:6829","nonce":2915303436}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":34},{"gid":44299,"name":"cephfs.smithi195.buqvbr","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6825/1574620912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":1574620912},{"type":"v1","addr":"172.21.15.195:6825","nonce":1574620912}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":36},{"gid":44327,"name":"cephfs.smithi195.nptgyc","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6827/4050783124","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":4050783124},{"type":"v1","addr":"172.21.15.195:6827","nonce":4050783124}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":43}],"filesystems":[{"mdsmap":{"epoch":44,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-18T22:39:04.054074+0000","modified":"2024-08-18T22:49:41.268288+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":84,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":2,"in":[0],"up":{"mds_0":34404},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_34404":{"gid":34404,"name":"cephfs.smithi121.xuzsdg","rank":0,"incarnation":38,"state":"up:active","state_seq":18,"addr":"172.21.15.121:6827/4267588865","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":4267588865},{"type":"v1","addr":"172.21.15.121:6827","nonce":4267588865}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":34404,"qdb_cluster":[34404]},"id":1}]} 2024-08-18T22:54:06.028 INFO:teuthology.orchestra.run.smithi121.stderr:dumped fsmap epoch 44 2024-08-18T22:54:06.030 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:54:06.027+0000 7f19e21e4640 1 -- 172.21.15.121:0/3239863940 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f19c406e0b0 msgr2=0x7f19c4070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:54:06.030 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:54:06.027+0000 7f19e21e4640 1 --2- 172.21.15.121:0/3239863940 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f19c406e0b0 0x7f19c4070560 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f19d000b020 tx=0x7f19d0009da0 comp rx=0 tx=0).stop 2024-08-18T22:54:06.030 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:54:06.027+0000 7f19e21e4640 1 -- 172.21.15.121:0/3239863940 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f19dc102cd0 msgr2=0x7f19dc0fc140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:54:06.030 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:54:06.027+0000 7f19e21e4640 1 --2- 172.21.15.121:0/3239863940 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f19dc102cd0 0x7f19dc0fc140 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f19cc00c760 tx=0x7f19cc00cb60 comp rx=0 tx=0).stop 2024-08-18T22:54:06.030 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:54:06.028+0000 7f19e21e4640 1 -- 172.21.15.121:0/3239863940 shutdown_connections 2024-08-18T22:54:06.030 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:54:06.028+0000 7f19e21e4640 1 --2- 172.21.15.121:0/3239863940 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f19c406e0b0 0x7f19c4070560 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:54:06.030 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:54:06.028+0000 7f19e21e4640 1 --2- 172.21.15.121:0/3239863940 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f19dc102cd0 0x7f19dc0fc140 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:54:06.030 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:54:06.028+0000 7f19e21e4640 1 --2- 172.21.15.121:0/3239863940 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f19dc102330 0x7f19dc0fbc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:54:06.030 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:54:06.028+0000 7f19e21e4640 1 -- 172.21.15.121:0/3239863940 >> 172.21.15.121:0/3239863940 conn(0x7f19dc070a80 msgr2=0x7f19dc0f9490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:54:06.031 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:54:06.028+0000 7f19e21e4640 1 -- 172.21.15.121:0/3239863940 shutdown_connections 2024-08-18T22:54:06.031 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:54:06.028+0000 7f19e21e4640 1 -- 172.21.15.121:0/3239863940 wait complete. 2024-08-18T22:54:06.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:54:05 smithi195 ceph-mon[68841]: pgmap v350: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:54:06.645 DEBUG:teuthology.orchestra.run.smithi121:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid b003123a-5db1-11ef-bccf-c7b262605968 -- ceph fs dump --format=json 45 2024-08-18T22:54:06.935 INFO:teuthology.orchestra.run.smithi121.stderr:Inferring config /var/lib/ceph/b003123a-5db1-11ef-bccf-c7b262605968/mon.smithi121/config 2024-08-18T22:54:07.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:54:06 smithi121 ceph-mon[81053]: from='client.? 172.21.15.121:0/3239863940' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 44, "format": "json"}]: dispatch 2024-08-18T22:54:07.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:54:06 smithi195 ceph-mon[68841]: from='client.? 172.21.15.121:0/3239863940' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 44, "format": "json"}]: dispatch 2024-08-18T22:54:07.853 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:54:07 smithi121 ceph-mon[81053]: pgmap v351: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:54:08.158 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:54:07 smithi195 ceph-mon[68841]: pgmap v351: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:54:08.348 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:54:08.340+0000 7f4cd807c640 1 -- 172.21.15.121:0/2745979117 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4cd01022e0 msgr2=0x7f4cd01026b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:54:08.348 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:54:08.340+0000 7f4cd807c640 1 --2- 172.21.15.121:0/2745979117 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4cd01022e0 0x7f4cd01026b0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f4ccc0048d0 tx=0x7f4ccc009da0 comp rx=0 tx=0).stop 2024-08-18T22:54:08.348 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:54:08.340+0000 7f4cd807c640 1 -- 172.21.15.121:0/2745979117 shutdown_connections 2024-08-18T22:54:08.348 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:54:08.340+0000 7f4cd807c640 1 --2- 172.21.15.121:0/2745979117 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4cd0102c80 0x7f4cd00fc310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:54:08.348 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:54:08.340+0000 7f4cd807c640 1 --2- 172.21.15.121:0/2745979117 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4cd01022e0 0x7f4cd01026b0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:54:08.348 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:54:08.340+0000 7f4cd807c640 1 -- 172.21.15.121:0/2745979117 >> 172.21.15.121:0/2745979117 conn(0x7f4cd00f7e90 msgr2=0x7f4cd00fa2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:54:08.348 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:54:08.340+0000 7f4cd807c640 1 -- 172.21.15.121:0/2745979117 shutdown_connections 2024-08-18T22:54:08.348 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:54:08.340+0000 7f4cd807c640 1 -- 172.21.15.121:0/2745979117 wait complete. 2024-08-18T22:54:08.348 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:54:08.340+0000 7f4cd807c640 1 Processor -- start 2024-08-18T22:54:08.349 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:54:08.340+0000 7f4cd807c640 1 -- start start 2024-08-18T22:54:08.349 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:54:08.340+0000 7f4cd807c640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4cd01022e0 0x7f4cd0112f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:54:08.349 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:54:08.340+0000 7f4cd807c640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4cd0102c80 0x7f4cd0113480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:54:08.349 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:54:08.340+0000 7f4cd807c640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cd0113a80 con 0x7f4cd0102c80 2024-08-18T22:54:08.349 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:54:08.340+0000 7f4cd807c640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cd010cec0 con 0x7f4cd01022e0 2024-08-18T22:54:08.349 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:54:08.341+0000 7f4cd5617640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4cd0102c80 0x7f4cd0113480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:54:08.349 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:54:08.341+0000 7f4cd5617640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4cd0102c80 0x7f4cd0113480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:36170/0 (socket says 172.21.15.121:36170) 2024-08-18T22:54:08.349 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:54:08.341+0000 7f4cd5617640 1 -- 172.21.15.121:0/2378419775 learned_addr learned my addr 172.21.15.121:0/2378419775 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-18T22:54:08.349 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:54:08.341+0000 7f4cd5e18640 1 --2- 172.21.15.121:0/2378419775 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4cd01022e0 0x7f4cd0112f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:54:08.349 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:54:08.341+0000 7f4cd5617640 1 -- 172.21.15.121:0/2378419775 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4cd01022e0 msgr2=0x7f4cd0112f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:54:08.349 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:54:08.341+0000 7f4cd5617640 1 --2- 172.21.15.121:0/2378419775 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4cd01022e0 0x7f4cd0112f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:54:08.349 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:54:08.341+0000 7f4cd5617640 1 -- 172.21.15.121:0/2378419775 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ccc005040 con 0x7f4cd0102c80 2024-08-18T22:54:08.349 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:54:08.341+0000 7f4cd5617640 1 --2- 172.21.15.121:0/2378419775 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4cd0102c80 0x7f4cd0113480 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f4cc0002a50 tx=0x7f4cc0004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:54:08.349 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:54:08.341+0000 7f4cc67fc640 1 -- 172.21.15.121:0/2378419775 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4cc0007c30 con 0x7f4cd0102c80 2024-08-18T22:54:08.350 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:54:08.341+0000 7f4cd807c640 1 -- 172.21.15.121:0/2378419775 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4cd010d1a0 con 0x7f4cd0102c80 2024-08-18T22:54:08.350 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:54:08.341+0000 7f4cc67fc640 1 -- 172.21.15.121:0/2378419775 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f4cc000f040 con 0x7f4cd0102c80 2024-08-18T22:54:08.350 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:54:08.341+0000 7f4cc67fc640 1 -- 172.21.15.121:0/2378419775 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4cc000da90 con 0x7f4cd0102c80 2024-08-18T22:54:08.350 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:54:08.341+0000 7f4cd807c640 1 -- 172.21.15.121:0/2378419775 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4cd010d740 con 0x7f4cd0102c80 2024-08-18T22:54:08.350 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:54:08.342+0000 7f4cd807c640 1 -- 172.21.15.121:0/2378419775 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4cd00fda50 con 0x7f4cd0102c80 2024-08-18T22:54:08.350 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:54:08.343+0000 7f4cc67fc640 1 -- 172.21.15.121:0/2378419775 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 37) v1 ==== 92205+0+0 (secure 0 0 0) 0x7f4cc000dd00 con 0x7f4cd0102c80 2024-08-18T22:54:08.350 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:54:08.343+0000 7f4cc67fc640 1 --2- 172.21.15.121:0/2378419775 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f4cbc06e0b0 0x7f4cbc070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:54:08.350 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:54:08.343+0000 7f4cc67fc640 1 -- 172.21.15.121:0/2378419775 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6668+0+0 (secure 0 0 0) 0x7f4cc008d540 con 0x7f4cd0102c80 2024-08-18T22:54:08.350 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:54:08.343+0000 7f4cd5e18640 1 --2- 172.21.15.121:0/2378419775 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f4cbc06e0b0 0x7f4cbc070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:54:08.350 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:54:08.344+0000 7f4cd5e18640 1 --2- 172.21.15.121:0/2378419775 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f4cbc06e0b0 0x7f4cbc070560 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f4ccc009ac0 tx=0x7f4ccc035040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:54:08.351 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:54:08.348+0000 7f4cc67fc640 1 -- 172.21.15.121:0/2378419775 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f4cc00567c0 con 0x7f4cd0102c80 2024-08-18T22:54:08.555 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:54:08.553+0000 7f4cd807c640 1 -- 172.21.15.121:0/2378419775 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 45, "format": "json"} v 0) v1 -- 0x7f4cd00fbad0 con 0x7f4cd0102c80 2024-08-18T22:54:08.555 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:54:08.554+0000 7f4cc67fc640 1 -- 172.21.15.121:0/2378419775 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 45, "format": "json"}]=0 dumped fsmap epoch 45 v46) v1 ==== 107+0+5279 (secure 0 0 0) 0x7f4cc0059e80 con 0x7f4cd0102c80 2024-08-18T22:54:08.556 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-08-18T22:54:08.556 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":45,"btime":"2024-08-18T22:49:42:268481+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":44299,"name":"cephfs.smithi195.buqvbr","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6825/1574620912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":1574620912},{"type":"v1","addr":"172.21.15.195:6825","nonce":1574620912}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":36},{"gid":44327,"name":"cephfs.smithi195.nptgyc","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6827/4050783124","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":4050783124},{"type":"v1","addr":"172.21.15.195:6827","nonce":4050783124}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":43}],"filesystems":[{"mdsmap":{"epoch":45,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-18T22:39:04.054074+0000","modified":"2024-08-18T22:49:42.268466+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":84,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":2,"in":[0,1],"up":{"mds_0":34404,"mds_1":34436},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34404":{"gid":34404,"name":"cephfs.smithi121.xuzsdg","rank":0,"incarnation":38,"state":"up:active","state_seq":18,"addr":"172.21.15.121:6827/4267588865","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":4267588865},{"type":"v1","addr":"172.21.15.121:6827","nonce":4267588865}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34436":{"gid":34436,"name":"cephfs.smithi121.gbickb","rank":1,"incarnation":45,"state":"up:starting","state_seq":1,"addr":"172.21.15.121:6829/2915303436","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6828","nonce":2915303436},{"type":"v1","addr":"172.21.15.121:6829","nonce":2915303436}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":34404,"qdb_cluster":[34404]},"id":1}]} 2024-08-18T22:54:08.556 INFO:teuthology.orchestra.run.smithi121.stderr:dumped fsmap epoch 45 2024-08-18T22:54:08.559 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:54:08.557+0000 7f4cd807c640 1 -- 172.21.15.121:0/2378419775 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f4cbc06e0b0 msgr2=0x7f4cbc070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:54:08.559 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:54:08.557+0000 7f4cd807c640 1 --2- 172.21.15.121:0/2378419775 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f4cbc06e0b0 0x7f4cbc070560 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f4ccc009ac0 tx=0x7f4ccc035040 comp rx=0 tx=0).stop 2024-08-18T22:54:08.559 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:54:08.557+0000 7f4cd807c640 1 -- 172.21.15.121:0/2378419775 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4cd0102c80 msgr2=0x7f4cd0113480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:54:08.559 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:54:08.557+0000 7f4cd807c640 1 --2- 172.21.15.121:0/2378419775 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4cd0102c80 0x7f4cd0113480 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f4cc0002a50 tx=0x7f4cc0004600 comp rx=0 tx=0).stop 2024-08-18T22:54:08.559 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:54:08.557+0000 7f4cd807c640 1 -- 172.21.15.121:0/2378419775 shutdown_connections 2024-08-18T22:54:08.559 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:54:08.557+0000 7f4cd807c640 1 --2- 172.21.15.121:0/2378419775 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f4cbc06e0b0 0x7f4cbc070560 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:54:08.559 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:54:08.557+0000 7f4cd807c640 1 --2- 172.21.15.121:0/2378419775 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4cd0102c80 0x7f4cd0113480 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:54:08.559 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:54:08.557+0000 7f4cd807c640 1 --2- 172.21.15.121:0/2378419775 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4cd01022e0 0x7f4cd0112f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:54:08.559 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:54:08.557+0000 7f4cd807c640 1 -- 172.21.15.121:0/2378419775 >> 172.21.15.121:0/2378419775 conn(0x7f4cd00f7e90 msgr2=0x7f4cd00f8f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:54:08.559 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:54:08.557+0000 7f4cd807c640 1 -- 172.21.15.121:0/2378419775 shutdown_connections 2024-08-18T22:54:08.559 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:54:08.557+0000 7f4cd807c640 1 -- 172.21.15.121:0/2378419775 wait complete. 2024-08-18T22:54:09.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:54:08 smithi195 ceph-mon[68841]: from='client.? 172.21.15.121:0/2378419775' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 45, "format": "json"}]: dispatch 2024-08-18T22:54:09.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:54:08 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-18T22:54:09.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:54:08 smithi195 ceph-mon[68841]: pgmap v352: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:54:09.271 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:54:08 smithi121 ceph-mon[81053]: from='client.? 172.21.15.121:0/2378419775' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 45, "format": "json"}]: dispatch 2024-08-18T22:54:09.271 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:54:08 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-18T22:54:09.271 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:54:08 smithi121 ceph-mon[81053]: pgmap v352: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:54:09.295 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2024-08-18T22:54:09.306 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2024-08-18T22:54:09.306 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-08-18T22:54:09.306 DEBUG:teuthology.orchestra.run.smithi121:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-18T22:54:09.324 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-08-18T22:54:09.324 DEBUG:teuthology.orchestra.run.smithi121:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-18T22:54:09.382 DEBUG:teuthology.orchestra.run.smithi121:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid b003123a-5db1-11ef-bccf-c7b262605968 -- ceph osd blocklist ls 2024-08-18T22:54:09.682 INFO:teuthology.orchestra.run.smithi121.stderr:Inferring config /var/lib/ceph/b003123a-5db1-11ef-bccf-c7b262605968/mon.smithi121/config 2024-08-18T22:54:11.198 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:54:11.194+0000 7f3f1bf98640 1 -- 172.21.15.121:0/2096142944 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3f140fb5b0 msgr2=0x7f3f140fb980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:54:11.198 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:54:11.194+0000 7f3f1bf98640 1 --2- 172.21.15.121:0/2096142944 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3f140fb5b0 0x7f3f140fb980 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f3f100048d0 tx=0x7f3f10009da0 comp rx=0 tx=0).stop 2024-08-18T22:54:11.198 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:54:11.194+0000 7f3f1bf98640 1 -- 172.21.15.121:0/2096142944 shutdown_connections 2024-08-18T22:54:11.198 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:54:11.194+0000 7f3f1bf98640 1 --2- 172.21.15.121:0/2096142944 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3f140fbec0 0x7f3f140fcdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:54:11.198 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:54:11.194+0000 7f3f1bf98640 1 --2- 172.21.15.121:0/2096142944 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3f140fb5b0 0x7f3f140fb980 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:54:11.198 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:54:11.194+0000 7f3f1bf98640 1 -- 172.21.15.121:0/2096142944 >> 172.21.15.121:0/2096142944 conn(0x7f3f14072150 msgr2=0x7f3f14072550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:54:11.198 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:54:11.194+0000 7f3f1bf98640 1 -- 172.21.15.121:0/2096142944 shutdown_connections 2024-08-18T22:54:11.199 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:54:11.194+0000 7f3f1bf98640 1 -- 172.21.15.121:0/2096142944 wait complete. 2024-08-18T22:54:11.199 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:54:11.195+0000 7f3f1bf98640 1 Processor -- start 2024-08-18T22:54:11.199 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:54:11.195+0000 7f3f1bf98640 1 -- start start 2024-08-18T22:54:11.199 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:54:11.195+0000 7f3f1bf98640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3f140fb5b0 0x7f3f1410df20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:54:11.199 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:54:11.195+0000 7f3f1bf98640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3f140fbec0 0x7f3f1410e460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:54:11.199 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:54:11.195+0000 7f3f1bf98640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f1410eab0 con 0x7f3f140fb5b0 2024-08-18T22:54:11.199 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:54:11.195+0000 7f3f1bf98640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f1410ec20 con 0x7f3f140fbec0 2024-08-18T22:54:11.199 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:54:11.195+0000 7f3f19d34640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3f140fb5b0 0x7f3f1410df20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:54:11.199 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:54:11.195+0000 7f3f19d34640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3f140fb5b0 0x7f3f1410df20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:36186/0 (socket says 172.21.15.121:36186) 2024-08-18T22:54:11.199 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:54:11.195+0000 7f3f19d34640 1 -- 172.21.15.121:0/2649749279 learned_addr learned my addr 172.21.15.121:0/2649749279 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-18T22:54:11.199 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:54:11.195+0000 7f3f19533640 1 --2- 172.21.15.121:0/2649749279 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3f140fbec0 0x7f3f1410e460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:54:11.199 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:54:11.195+0000 7f3f19d34640 1 -- 172.21.15.121:0/2649749279 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3f140fbec0 msgr2=0x7f3f1410e460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:54:11.199 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:54:11.195+0000 7f3f19d34640 1 --2- 172.21.15.121:0/2649749279 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3f140fbec0 0x7f3f1410e460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:54:11.199 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:54:11.195+0000 7f3f19d34640 1 -- 172.21.15.121:0/2649749279 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f10005040 con 0x7f3f140fb5b0 2024-08-18T22:54:11.200 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:54:11.195+0000 7f3f19533640 1 --2- 172.21.15.121:0/2649749279 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3f140fbec0 0x7f3f1410e460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T22:54:11.200 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:54:11.195+0000 7f3f19d34640 1 --2- 172.21.15.121:0/2649749279 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3f140fb5b0 0x7f3f1410df20 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f3f10003080 tx=0x7f3f10009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:54:11.200 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:54:11.196+0000 7f3f0a7fc640 1 -- 172.21.15.121:0/2649749279 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3f10038070 con 0x7f3f140fb5b0 2024-08-18T22:54:11.200 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:54:11.196+0000 7f3f0a7fc640 1 -- 172.21.15.121:0/2649749279 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f3f100097e0 con 0x7f3f140fb5b0 2024-08-18T22:54:11.200 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:54:11.196+0000 7f3f1bf98640 1 -- 172.21.15.121:0/2649749279 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f14116f90 con 0x7f3f140fb5b0 2024-08-18T22:54:11.200 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:54:11.196+0000 7f3f0a7fc640 1 -- 172.21.15.121:0/2649749279 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3f1003d420 con 0x7f3f140fb5b0 2024-08-18T22:54:11.200 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:54:11.196+0000 7f3f1bf98640 1 -- 172.21.15.121:0/2649749279 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f141173f0 con 0x7f3f140fb5b0 2024-08-18T22:54:11.201 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:54:11.197+0000 7f3f1bf98640 1 -- 172.21.15.121:0/2649749279 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f140fc960 con 0x7f3f140fb5b0 2024-08-18T22:54:11.201 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:54:11.197+0000 7f3f0a7fc640 1 -- 172.21.15.121:0/2649749279 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 37) v1 ==== 92205+0+0 (secure 0 0 0) 0x7f3f10030020 con 0x7f3f140fb5b0 2024-08-18T22:54:11.201 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:54:11.198+0000 7f3f0a7fc640 1 --2- 172.21.15.121:0/2649749279 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f3f0006e0b0 0x7f3f00070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:54:11.201 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:54:11.198+0000 7f3f19533640 1 --2- 172.21.15.121:0/2649749279 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f3f0006e0b0 0x7f3f00070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:54:11.202 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:54:11.198+0000 7f3f0a7fc640 1 -- 172.21.15.121:0/2649749279 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6668+0+0 (secure 0 0 0) 0x7f3f100ae110 con 0x7f3f140fb5b0 2024-08-18T22:54:11.202 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:54:11.198+0000 7f3f19533640 1 --2- 172.21.15.121:0/2649749279 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f3f0006e0b0 0x7f3f00070560 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f3f14065720 tx=0x7f3f04009040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:54:11.204 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:54:11.202+0000 7f3f0a7fc640 1 -- 172.21.15.121:0/2649749279 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f3f10077410 con 0x7f3f140fb5b0 2024-08-18T22:54:11.381 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:54:11.379+0000 7f3f1bf98640 1 -- 172.21.15.121:0/2649749279 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f3f1404b4c0 con 0x7f3f140fb5b0 2024-08-18T22:54:11.381 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:54:11.379+0000 7f3f0a7fc640 1 -- 172.21.15.121:0/2649749279 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 43 entries v84) v1 ==== 81+0+2580 (secure 0 0 0) 0x7f3f1007aad0 con 0x7f3f140fb5b0 2024-08-18T22:54:11.381 INFO:teuthology.orchestra.run.smithi121.stdout:172.21.15.121:6829/2277706406 2024-08-19T22:48:45.429077+0000 2024-08-18T22:54:11.382 INFO:teuthology.orchestra.run.smithi121.stdout:172.21.15.121:0/1660274877 2024-08-19T22:43:38.504277+0000 2024-08-18T22:54:11.382 INFO:teuthology.orchestra.run.smithi121.stdout:172.21.15.121:0/1084348064 2024-08-19T22:43:38.504277+0000 2024-08-18T22:54:11.382 INFO:teuthology.orchestra.run.smithi121.stdout:172.21.15.121:0/311500639 2024-08-19T22:43:38.504277+0000 2024-08-18T22:54:11.382 INFO:teuthology.orchestra.run.smithi121.stdout:172.21.15.121:6801/1096247887 2024-08-19T22:43:38.504277+0000 2024-08-18T22:54:11.382 INFO:teuthology.orchestra.run.smithi121.stdout:172.21.15.121:6800/1096247887 2024-08-19T22:43:38.504277+0000 2024-08-18T22:54:11.382 INFO:teuthology.orchestra.run.smithi121.stdout:172.21.15.121:0/3576026097 2024-08-19T22:33:38.104162+0000 2024-08-18T22:54:11.382 INFO:teuthology.orchestra.run.smithi121.stdout:172.21.15.121:6827/754747487 2024-08-19T22:39:19.933408+0000 2024-08-18T22:54:11.382 INFO:teuthology.orchestra.run.smithi121.stdout:172.21.15.121:0/3351339836 2024-08-19T22:43:38.504277+0000 2024-08-18T22:54:11.382 INFO:teuthology.orchestra.run.smithi121.stdout:172.21.15.195:0/1914560122 2024-08-19T22:43:00.158765+0000 2024-08-18T22:54:11.382 INFO:teuthology.orchestra.run.smithi121.stdout:172.21.15.195:6826/238549847 2024-08-19T22:49:22.411738+0000 2024-08-18T22:54:11.382 INFO:teuthology.orchestra.run.smithi121.stdout:172.21.15.121:6826/754747487 2024-08-19T22:39:19.933408+0000 2024-08-18T22:54:11.382 INFO:teuthology.orchestra.run.smithi121.stdout:172.21.15.121:6800/2610373559 2024-08-19T22:33:09.834580+0000 2024-08-18T22:54:11.382 INFO:teuthology.orchestra.run.smithi121.stdout:172.21.15.121:0/3436592689 2024-08-19T22:43:38.504277+0000 2024-08-18T22:54:11.383 INFO:teuthology.orchestra.run.smithi121.stdout:172.21.15.121:0/1769827421 2024-08-19T22:41:37.669696+0000 2024-08-18T22:54:11.383 INFO:teuthology.orchestra.run.smithi121.stdout:172.21.15.121:6828/2277706406 2024-08-19T22:48:45.429077+0000 2024-08-18T22:54:11.383 INFO:teuthology.orchestra.run.smithi121.stdout:172.21.15.121:0/2242648652 2024-08-19T22:33:09.834580+0000 2024-08-18T22:54:11.383 INFO:teuthology.orchestra.run.smithi121.stdout:172.21.15.121:0/490420940 2024-08-19T22:43:38.504277+0000 2024-08-18T22:54:11.383 INFO:teuthology.orchestra.run.smithi121.stdout:172.21.15.121:0/772981487 2024-08-19T22:34:38.509926+0000 2024-08-18T22:54:11.383 INFO:teuthology.orchestra.run.smithi121.stdout:172.21.15.121:0/1731486537 2024-08-19T22:33:38.104162+0000 2024-08-18T22:54:11.383 INFO:teuthology.orchestra.run.smithi121.stdout:172.21.15.195:0/2677725488 2024-08-19T22:43:00.158765+0000 2024-08-18T22:54:11.383 INFO:teuthology.orchestra.run.smithi121.stdout:172.21.15.121:0/2061352978 2024-08-19T22:34:38.509926+0000 2024-08-18T22:54:11.383 INFO:teuthology.orchestra.run.smithi121.stdout:172.21.15.195:6827/238549847 2024-08-19T22:49:22.411738+0000 2024-08-18T22:54:11.383 INFO:teuthology.orchestra.run.smithi121.stdout:172.21.15.121:6800/833901271 2024-08-19T22:33:38.104162+0000 2024-08-18T22:54:11.383 INFO:teuthology.orchestra.run.smithi121.stdout:172.21.15.121:0/2570435202 2024-08-19T22:33:38.104162+0000 2024-08-18T22:54:11.383 INFO:teuthology.orchestra.run.smithi121.stdout:172.21.15.195:6829/1174410756 2024-08-19T22:43:00.158765+0000 2024-08-18T22:54:11.384 INFO:teuthology.orchestra.run.smithi121.stdout:172.21.15.121:0/1294402539 2024-08-19T22:41:37.669696+0000 2024-08-18T22:54:11.384 INFO:teuthology.orchestra.run.smithi121.stdout:172.21.15.121:6801/1740603058 2024-08-19T22:34:38.509926+0000 2024-08-18T22:54:11.384 INFO:teuthology.orchestra.run.smithi121.stdout:172.21.15.121:0/2324544310 2024-08-19T22:33:09.834580+0000 2024-08-18T22:54:11.384 INFO:teuthology.orchestra.run.smithi121.stdout:172.21.15.195:6828/1174410756 2024-08-19T22:43:00.158765+0000 2024-08-18T22:54:11.384 INFO:teuthology.orchestra.run.smithi121.stdout:172.21.15.195:0/831005506 2024-08-19T22:43:00.158765+0000 2024-08-18T22:54:11.384 INFO:teuthology.orchestra.run.smithi121.stdout:172.21.15.121:6801/3225195982 2024-08-19T22:41:37.669696+0000 2024-08-18T22:54:11.384 INFO:teuthology.orchestra.run.smithi121.stdout:172.21.15.195:0/3443237455 2024-08-19T22:43:00.158765+0000 2024-08-18T22:54:11.384 INFO:teuthology.orchestra.run.smithi121.stdout:172.21.15.121:0/1246808679 2024-08-19T22:41:37.669696+0000 2024-08-18T22:54:11.384 INFO:teuthology.orchestra.run.smithi121.stdout:172.21.15.121:0/3667011451 2024-08-19T22:33:09.834580+0000 2024-08-18T22:54:11.384 INFO:teuthology.orchestra.run.smithi121.stdout:172.21.15.195:0/3046294409 2024-08-19T22:43:00.158765+0000 2024-08-18T22:54:11.384 INFO:teuthology.orchestra.run.smithi121.stdout:172.21.15.121:0/774496394 2024-08-19T22:34:38.509926+0000 2024-08-18T22:54:11.384 INFO:teuthology.orchestra.run.smithi121.stdout:172.21.15.121:0/2343998977 2024-08-19T22:41:37.669696+0000 2024-08-18T22:54:11.384 INFO:teuthology.orchestra.run.smithi121.stdout:172.21.15.121:6800/1740603058 2024-08-19T22:34:38.509926+0000 2024-08-18T22:54:11.384 INFO:teuthology.orchestra.run.smithi121.stdout:172.21.15.121:6801/2610373559 2024-08-19T22:33:09.834580+0000 2024-08-18T22:54:11.385 INFO:teuthology.orchestra.run.smithi121.stdout:172.21.15.195:0/3623544260 2024-08-19T22:43:00.158765+0000 2024-08-18T22:54:11.385 INFO:teuthology.orchestra.run.smithi121.stdout:172.21.15.121:6800/3225195982 2024-08-19T22:41:37.669696+0000 2024-08-18T22:54:11.385 INFO:teuthology.orchestra.run.smithi121.stdout:172.21.15.121:6801/833901271 2024-08-19T22:33:38.104162+0000 2024-08-18T22:54:11.386 INFO:teuthology.orchestra.run.smithi121.stderr:listed 43 entries 2024-08-18T22:54:11.386 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:54:11.381+0000 7f3f1bf98640 1 -- 172.21.15.121:0/2649749279 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f3f0006e0b0 msgr2=0x7f3f00070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:54:11.386 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:54:11.381+0000 7f3f1bf98640 1 --2- 172.21.15.121:0/2649749279 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f3f0006e0b0 0x7f3f00070560 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f3f14065720 tx=0x7f3f04009040 comp rx=0 tx=0).stop 2024-08-18T22:54:11.386 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:54:11.381+0000 7f3f1bf98640 1 -- 172.21.15.121:0/2649749279 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3f140fb5b0 msgr2=0x7f3f1410df20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:54:11.386 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:54:11.381+0000 7f3f1bf98640 1 --2- 172.21.15.121:0/2649749279 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3f140fb5b0 0x7f3f1410df20 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f3f10003080 tx=0x7f3f10009da0 comp rx=0 tx=0).stop 2024-08-18T22:54:11.386 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:54:11.381+0000 7f3f1bf98640 1 -- 172.21.15.121:0/2649749279 shutdown_connections 2024-08-18T22:54:11.386 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:54:11.381+0000 7f3f1bf98640 1 --2- 172.21.15.121:0/2649749279 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f3f0006e0b0 0x7f3f00070560 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:54:11.386 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:54:11.381+0000 7f3f1bf98640 1 --2- 172.21.15.121:0/2649749279 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3f140fbec0 0x7f3f1410e460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:54:11.386 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:54:11.381+0000 7f3f1bf98640 1 --2- 172.21.15.121:0/2649749279 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3f140fb5b0 0x7f3f1410df20 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:54:11.387 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:54:11.381+0000 7f3f1bf98640 1 -- 172.21.15.121:0/2649749279 >> 172.21.15.121:0/2649749279 conn(0x7f3f14072150 msgr2=0x7f3f140f8780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:54:11.387 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:54:11.382+0000 7f3f1bf98640 1 -- 172.21.15.121:0/2649749279 shutdown_connections 2024-08-18T22:54:11.387 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:54:11.382+0000 7f3f1bf98640 1 -- 172.21.15.121:0/2649749279 wait complete. 2024-08-18T22:54:11.974 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:54:11 smithi121 ceph-mon[81053]: pgmap v353: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:54:11.975 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:54:11 smithi121 ceph-mon[81053]: from='client.? 172.21.15.121:0/2649749279' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-08-18T22:54:11.999 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-08-18T22:54:12.000 DEBUG:teuthology.orchestra.run.smithi121:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-18T22:54:12.019 DEBUG:teuthology.orchestra.run.smithi121:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid b003123a-5db1-11ef-bccf-c7b262605968 -- ceph osd blocklist ls 2024-08-18T22:54:12.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:54:11 smithi195 ceph-mon[68841]: pgmap v353: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:54:12.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:54:11 smithi195 ceph-mon[68841]: from='client.? 172.21.15.121:0/2649749279' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-08-18T22:54:12.311 INFO:teuthology.orchestra.run.smithi121.stderr:Inferring config /var/lib/ceph/b003123a-5db1-11ef-bccf-c7b262605968/mon.smithi121/config 2024-08-18T22:54:13.911 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:54:13.895+0000 7f7d440fc640 1 -- 172.21.15.121:0/1559118595 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7d3c102420 msgr2=0x7f7d3c1027f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:54:13.911 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:54:13.895+0000 7f7d440fc640 1 --2- 172.21.15.121:0/1559118595 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7d3c102420 0x7f7d3c1027f0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f7d340048d0 tx=0x7f7d34009da0 comp rx=0 tx=0).stop 2024-08-18T22:54:13.911 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:54:13.895+0000 7f7d440fc640 1 -- 172.21.15.121:0/1559118595 shutdown_connections 2024-08-18T22:54:13.911 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:54:13.895+0000 7f7d440fc640 1 --2- 172.21.15.121:0/1559118595 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7d3c0faa90 0x7f7d3c0faf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:54:13.911 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:54:13.895+0000 7f7d440fc640 1 --2- 172.21.15.121:0/1559118595 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7d3c102420 0x7f7d3c1027f0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:54:13.911 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:54:13.895+0000 7f7d440fc640 1 -- 172.21.15.121:0/1559118595 >> 172.21.15.121:0/1559118595 conn(0x7f7d3c070af0 msgr2=0x7f7d3c070ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:54:13.911 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:54:13.895+0000 7f7d440fc640 1 -- 172.21.15.121:0/1559118595 shutdown_connections 2024-08-18T22:54:13.911 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:54:13.895+0000 7f7d440fc640 1 -- 172.21.15.121:0/1559118595 wait complete. 2024-08-18T22:54:13.911 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:54:13.896+0000 7f7d440fc640 1 Processor -- start 2024-08-18T22:54:13.912 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:54:13.896+0000 7f7d440fc640 1 -- start start 2024-08-18T22:54:13.912 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:54:13.896+0000 7f7d440fc640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7d3c0faa90 0x7f7d3c1130f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:54:13.912 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:54:13.896+0000 7f7d440fc640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7d3c102420 0x7f7d3c113630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:54:13.912 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:54:13.896+0000 7f7d440fc640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d3c113cc0 con 0x7f7d3c0faa90 2024-08-18T22:54:13.912 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:54:13.896+0000 7f7d440fc640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d3c10d070 con 0x7f7d3c102420 2024-08-18T22:54:13.912 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:54:13.896+0000 7f7d41e98640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7d3c0faa90 0x7f7d3c1130f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:54:13.912 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:54:13.896+0000 7f7d41e98640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7d3c0faa90 0x7f7d3c1130f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:36200/0 (socket says 172.21.15.121:36200) 2024-08-18T22:54:13.912 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:54:13.896+0000 7f7d41e98640 1 -- 172.21.15.121:0/986745744 learned_addr learned my addr 172.21.15.121:0/986745744 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-18T22:54:13.912 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:54:13.896+0000 7f7d41697640 1 --2- 172.21.15.121:0/986745744 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7d3c102420 0x7f7d3c113630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:54:13.912 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:54:13.897+0000 7f7d41e98640 1 -- 172.21.15.121:0/986745744 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7d3c102420 msgr2=0x7f7d3c113630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:54:13.912 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:54:13.897+0000 7f7d41e98640 1 --2- 172.21.15.121:0/986745744 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7d3c102420 0x7f7d3c113630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:54:13.912 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:54:13.897+0000 7f7d41e98640 1 -- 172.21.15.121:0/986745744 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d34005040 con 0x7f7d3c0faa90 2024-08-18T22:54:13.912 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:54:13.897+0000 7f7d41e98640 1 --2- 172.21.15.121:0/986745744 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7d3c0faa90 0x7f7d3c1130f0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f7d34003080 tx=0x7f7d34009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:54:13.912 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:54:13.897+0000 7f7d3a7fc640 1 -- 172.21.15.121:0/986745744 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7d34038070 con 0x7f7d3c0faa90 2024-08-18T22:54:13.913 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:54:13.897+0000 7f7d3a7fc640 1 -- 172.21.15.121:0/986745744 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f7d340097e0 con 0x7f7d3c0faa90 2024-08-18T22:54:13.913 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:54:13.897+0000 7f7d440fc640 1 -- 172.21.15.121:0/986745744 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d3c10d2f0 con 0x7f7d3c0faa90 2024-08-18T22:54:13.913 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:54:13.897+0000 7f7d3a7fc640 1 -- 172.21.15.121:0/986745744 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7d3403d420 con 0x7f7d3c0faa90 2024-08-18T22:54:13.913 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:54:13.897+0000 7f7d440fc640 1 -- 172.21.15.121:0/986745744 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d3c10d7b0 con 0x7f7d3c0faa90 2024-08-18T22:54:13.913 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:54:13.898+0000 7f7d440fc640 1 -- 172.21.15.121:0/986745744 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d3c065590 con 0x7f7d3c0faa90 2024-08-18T22:54:13.913 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:54:13.898+0000 7f7d3a7fc640 1 -- 172.21.15.121:0/986745744 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 37) v1 ==== 92205+0+0 (secure 0 0 0) 0x7f7d34030020 con 0x7f7d3c0faa90 2024-08-18T22:54:13.913 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:54:13.899+0000 7f7d3a7fc640 1 --2- 172.21.15.121:0/986745744 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f7d2406e0b0 0x7f7d24070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T22:54:13.913 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:54:13.899+0000 7f7d3a7fc640 1 -- 172.21.15.121:0/986745744 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6668+0+0 (secure 0 0 0) 0x7f7d340ae0c0 con 0x7f7d3c0faa90 2024-08-18T22:54:13.913 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:54:13.899+0000 7f7d41697640 1 --2- 172.21.15.121:0/986745744 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f7d2406e0b0 0x7f7d24070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T22:54:13.913 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:54:13.900+0000 7f7d41697640 1 --2- 172.21.15.121:0/986745744 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f7d2406e0b0 0x7f7d24070560 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f7d3c10e9b0 tx=0x7f7d30009620 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T22:54:13.913 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:54:13.903+0000 7f7d3a7fc640 1 -- 172.21.15.121:0/986745744 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f7d340773c0 con 0x7f7d3c0faa90 2024-08-18T22:54:14.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:54:13 smithi121 ceph-mon[81053]: pgmap v354: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:54:14.084 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:54:14.084+0000 7f7d440fc640 1 -- 172.21.15.121:0/986745744 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f7d3c074a10 con 0x7f7d3c0faa90 2024-08-18T22:54:14.085 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:54:14.084+0000 7f7d3a7fc640 1 -- 172.21.15.121:0/986745744 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 43 entries v84) v1 ==== 81+0+2580 (secure 0 0 0) 0x7f7d3407aa80 con 0x7f7d3c0faa90 2024-08-18T22:54:14.085 INFO:teuthology.orchestra.run.smithi121.stdout:172.21.15.121:6829/2277706406 2024-08-19T22:48:45.429077+0000 2024-08-18T22:54:14.085 INFO:teuthology.orchestra.run.smithi121.stdout:172.21.15.121:0/1660274877 2024-08-19T22:43:38.504277+0000 2024-08-18T22:54:14.085 INFO:teuthology.orchestra.run.smithi121.stdout:172.21.15.121:0/1084348064 2024-08-19T22:43:38.504277+0000 2024-08-18T22:54:14.085 INFO:teuthology.orchestra.run.smithi121.stdout:172.21.15.121:0/311500639 2024-08-19T22:43:38.504277+0000 2024-08-18T22:54:14.085 INFO:teuthology.orchestra.run.smithi121.stdout:172.21.15.121:6801/1096247887 2024-08-19T22:43:38.504277+0000 2024-08-18T22:54:14.086 INFO:teuthology.orchestra.run.smithi121.stdout:172.21.15.121:6800/1096247887 2024-08-19T22:43:38.504277+0000 2024-08-18T22:54:14.086 INFO:teuthology.orchestra.run.smithi121.stdout:172.21.15.121:0/3576026097 2024-08-19T22:33:38.104162+0000 2024-08-18T22:54:14.086 INFO:teuthology.orchestra.run.smithi121.stdout:172.21.15.121:6827/754747487 2024-08-19T22:39:19.933408+0000 2024-08-18T22:54:14.086 INFO:teuthology.orchestra.run.smithi121.stdout:172.21.15.121:0/3351339836 2024-08-19T22:43:38.504277+0000 2024-08-18T22:54:14.086 INFO:teuthology.orchestra.run.smithi121.stdout:172.21.15.195:0/1914560122 2024-08-19T22:43:00.158765+0000 2024-08-18T22:54:14.086 INFO:teuthology.orchestra.run.smithi121.stdout:172.21.15.195:6826/238549847 2024-08-19T22:49:22.411738+0000 2024-08-18T22:54:14.086 INFO:teuthology.orchestra.run.smithi121.stdout:172.21.15.121:6826/754747487 2024-08-19T22:39:19.933408+0000 2024-08-18T22:54:14.086 INFO:teuthology.orchestra.run.smithi121.stdout:172.21.15.121:6800/2610373559 2024-08-19T22:33:09.834580+0000 2024-08-18T22:54:14.086 INFO:teuthology.orchestra.run.smithi121.stdout:172.21.15.121:0/3436592689 2024-08-19T22:43:38.504277+0000 2024-08-18T22:54:14.086 INFO:teuthology.orchestra.run.smithi121.stdout:172.21.15.121:0/1769827421 2024-08-19T22:41:37.669696+0000 2024-08-18T22:54:14.086 INFO:teuthology.orchestra.run.smithi121.stdout:172.21.15.121:6828/2277706406 2024-08-19T22:48:45.429077+0000 2024-08-18T22:54:14.086 INFO:teuthology.orchestra.run.smithi121.stdout:172.21.15.121:0/2242648652 2024-08-19T22:33:09.834580+0000 2024-08-18T22:54:14.087 INFO:teuthology.orchestra.run.smithi121.stdout:172.21.15.121:0/490420940 2024-08-19T22:43:38.504277+0000 2024-08-18T22:54:14.087 INFO:teuthology.orchestra.run.smithi121.stdout:172.21.15.121:0/772981487 2024-08-19T22:34:38.509926+0000 2024-08-18T22:54:14.087 INFO:teuthology.orchestra.run.smithi121.stdout:172.21.15.121:0/1731486537 2024-08-19T22:33:38.104162+0000 2024-08-18T22:54:14.087 INFO:teuthology.orchestra.run.smithi121.stdout:172.21.15.195:0/2677725488 2024-08-19T22:43:00.158765+0000 2024-08-18T22:54:14.087 INFO:teuthology.orchestra.run.smithi121.stdout:172.21.15.121:0/2061352978 2024-08-19T22:34:38.509926+0000 2024-08-18T22:54:14.087 INFO:teuthology.orchestra.run.smithi121.stdout:172.21.15.195:6827/238549847 2024-08-19T22:49:22.411738+0000 2024-08-18T22:54:14.087 INFO:teuthology.orchestra.run.smithi121.stdout:172.21.15.121:6800/833901271 2024-08-19T22:33:38.104162+0000 2024-08-18T22:54:14.087 INFO:teuthology.orchestra.run.smithi121.stdout:172.21.15.121:0/2570435202 2024-08-19T22:33:38.104162+0000 2024-08-18T22:54:14.087 INFO:teuthology.orchestra.run.smithi121.stdout:172.21.15.195:6829/1174410756 2024-08-19T22:43:00.158765+0000 2024-08-18T22:54:14.087 INFO:teuthology.orchestra.run.smithi121.stdout:172.21.15.121:0/1294402539 2024-08-19T22:41:37.669696+0000 2024-08-18T22:54:14.087 INFO:teuthology.orchestra.run.smithi121.stdout:172.21.15.121:6801/1740603058 2024-08-19T22:34:38.509926+0000 2024-08-18T22:54:14.087 INFO:teuthology.orchestra.run.smithi121.stdout:172.21.15.121:0/2324544310 2024-08-19T22:33:09.834580+0000 2024-08-18T22:54:14.087 INFO:teuthology.orchestra.run.smithi121.stdout:172.21.15.195:6828/1174410756 2024-08-19T22:43:00.158765+0000 2024-08-18T22:54:14.088 INFO:teuthology.orchestra.run.smithi121.stdout:172.21.15.195:0/831005506 2024-08-19T22:43:00.158765+0000 2024-08-18T22:54:14.088 INFO:teuthology.orchestra.run.smithi121.stdout:172.21.15.121:6801/3225195982 2024-08-19T22:41:37.669696+0000 2024-08-18T22:54:14.088 INFO:teuthology.orchestra.run.smithi121.stdout:172.21.15.195:0/3443237455 2024-08-19T22:43:00.158765+0000 2024-08-18T22:54:14.088 INFO:teuthology.orchestra.run.smithi121.stdout:172.21.15.121:0/1246808679 2024-08-19T22:41:37.669696+0000 2024-08-18T22:54:14.088 INFO:teuthology.orchestra.run.smithi121.stdout:172.21.15.121:0/3667011451 2024-08-19T22:33:09.834580+0000 2024-08-18T22:54:14.088 INFO:teuthology.orchestra.run.smithi121.stdout:172.21.15.195:0/3046294409 2024-08-19T22:43:00.158765+0000 2024-08-18T22:54:14.088 INFO:teuthology.orchestra.run.smithi121.stdout:172.21.15.121:0/774496394 2024-08-19T22:34:38.509926+0000 2024-08-18T22:54:14.088 INFO:teuthology.orchestra.run.smithi121.stdout:172.21.15.121:0/2343998977 2024-08-19T22:41:37.669696+0000 2024-08-18T22:54:14.088 INFO:teuthology.orchestra.run.smithi121.stdout:172.21.15.121:6800/1740603058 2024-08-19T22:34:38.509926+0000 2024-08-18T22:54:14.088 INFO:teuthology.orchestra.run.smithi121.stdout:172.21.15.121:6801/2610373559 2024-08-19T22:33:09.834580+0000 2024-08-18T22:54:14.088 INFO:teuthology.orchestra.run.smithi121.stdout:172.21.15.195:0/3623544260 2024-08-19T22:43:00.158765+0000 2024-08-18T22:54:14.089 INFO:teuthology.orchestra.run.smithi121.stdout:172.21.15.121:6800/3225195982 2024-08-19T22:41:37.669696+0000 2024-08-18T22:54:14.089 INFO:teuthology.orchestra.run.smithi121.stdout:172.21.15.121:6801/833901271 2024-08-19T22:33:38.104162+0000 2024-08-18T22:54:14.090 INFO:teuthology.orchestra.run.smithi121.stderr:listed 43 entries 2024-08-18T22:54:14.090 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:54:14.087+0000 7f7d440fc640 1 -- 172.21.15.121:0/986745744 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f7d2406e0b0 msgr2=0x7f7d24070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:54:14.090 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:54:14.087+0000 7f7d440fc640 1 --2- 172.21.15.121:0/986745744 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f7d2406e0b0 0x7f7d24070560 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f7d3c10e9b0 tx=0x7f7d30009620 comp rx=0 tx=0).stop 2024-08-18T22:54:14.090 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:54:14.087+0000 7f7d440fc640 1 -- 172.21.15.121:0/986745744 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7d3c0faa90 msgr2=0x7f7d3c1130f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T22:54:14.090 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:54:14.087+0000 7f7d440fc640 1 --2- 172.21.15.121:0/986745744 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7d3c0faa90 0x7f7d3c1130f0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f7d34003080 tx=0x7f7d34009da0 comp rx=0 tx=0).stop 2024-08-18T22:54:14.090 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:54:14.087+0000 7f7d440fc640 1 -- 172.21.15.121:0/986745744 shutdown_connections 2024-08-18T22:54:14.090 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:54:14.087+0000 7f7d440fc640 1 --2- 172.21.15.121:0/986745744 >> [v2:172.21.15.121:6800/3037387239,v1:172.21.15.121:6801/3037387239] conn(0x7f7d2406e0b0 0x7f7d24070560 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:54:14.090 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:54:14.087+0000 7f7d440fc640 1 --2- 172.21.15.121:0/986745744 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7d3c102420 0x7f7d3c113630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:54:14.090 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:54:14.087+0000 7f7d440fc640 1 --2- 172.21.15.121:0/986745744 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7d3c0faa90 0x7f7d3c1130f0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T22:54:14.090 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:54:14.087+0000 7f7d440fc640 1 -- 172.21.15.121:0/986745744 >> 172.21.15.121:0/986745744 conn(0x7f7d3c070af0 msgr2=0x7f7d3c0f9dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T22:54:14.090 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:54:14.087+0000 7f7d440fc640 1 -- 172.21.15.121:0/986745744 shutdown_connections 2024-08-18T22:54:14.091 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-18T22:54:14.087+0000 7f7d440fc640 1 -- 172.21.15.121:0/986745744 wait complete. 2024-08-18T22:54:14.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:54:13 smithi195 ceph-mon[68841]: pgmap v354: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:54:14.890 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi121.front.sepia.ceph.com... 2024-08-18T22:54:14.890 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T22:54:14.890 DEBUG:teuthology.orchestra.run.smithi121:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-08-18T22:54:14.918 INFO:teuthology.orchestra.run:waiting for 300 2024-08-18T22:54:15.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:54:14 smithi121 ceph-mon[81053]: from='client.? 172.21.15.121:0/986745744' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-08-18T22:54:15.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:54:14 smithi195 ceph-mon[68841]: from='client.? 172.21.15.121:0/986745744' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-08-18T22:54:16.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:54:15 smithi121 ceph-mon[81053]: pgmap v355: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:54:16.158 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:54:15 smithi195 ceph-mon[68841]: pgmap v355: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:54:18.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:54:17 smithi121 ceph-mon[81053]: pgmap v356: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:54:18.158 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:54:17 smithi195 ceph-mon[68841]: pgmap v356: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:54:20.006 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:54:19 smithi121 ceph-mon[81053]: pgmap v357: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:54:20.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:54:19 smithi195 ceph-mon[68841]: pgmap v357: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:54:22.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:54:21 smithi121 ceph-mon[81053]: pgmap v358: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:54:22.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:54:21 smithi195 ceph-mon[68841]: pgmap v358: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:54:24.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:54:23 smithi121 ceph-mon[81053]: pgmap v359: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:54:24.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:54:23 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-18T22:54:24.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:54:23 smithi195 ceph-mon[68841]: pgmap v359: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:54:24.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:54:23 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-18T22:54:26.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:54:25 smithi121 ceph-mon[81053]: pgmap v360: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:54:26.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:54:25 smithi195 ceph-mon[68841]: pgmap v360: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:54:27.833 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:54:27 smithi121 ceph-mon[81053]: pgmap v361: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:54:28.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:54:27 smithi195 ceph-mon[68841]: pgmap v361: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:54:30.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:54:29 smithi121 ceph-mon[81053]: pgmap v362: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:54:30.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:54:29 smithi195 ceph-mon[68841]: pgmap v362: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:54:32.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:54:31 smithi121 ceph-mon[81053]: pgmap v363: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:54:32.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:54:31 smithi195 ceph-mon[68841]: pgmap v363: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:54:34.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:54:33 smithi121 ceph-mon[81053]: pgmap v364: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:54:34.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:54:33 smithi195 ceph-mon[68841]: pgmap v364: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:54:36.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:54:35 smithi121 ceph-mon[81053]: pgmap v365: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:54:36.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:54:35 smithi195 ceph-mon[68841]: pgmap v365: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:54:38.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:54:37 smithi121 ceph-mon[81053]: pgmap v366: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:54:38.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:54:37 smithi195 ceph-mon[68841]: pgmap v366: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:54:39.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:54:38 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-18T22:54:39.158 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:54:38 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-18T22:54:40.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:54:39 smithi121 ceph-mon[81053]: pgmap v367: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:54:40.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:54:39 smithi195 ceph-mon[68841]: pgmap v367: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:54:42.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:54:41 smithi121 ceph-mon[81053]: pgmap v368: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:54:42.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:54:41 smithi195 ceph-mon[68841]: pgmap v368: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:54:43.659 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:54:43 smithi195 ceph-mon[68841]: pgmap v369: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:54:43.833 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:54:43 smithi121 ceph-mon[81053]: pgmap v369: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:54:46.085 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:54:45 smithi121 ceph-mon[81053]: pgmap v370: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:54:46.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:54:45 smithi195 ceph-mon[68841]: pgmap v370: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:54:48.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:54:47 smithi121 ceph-mon[81053]: pgmap v371: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:54:48.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:54:47 smithi195 ceph-mon[68841]: pgmap v371: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:54:50.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:54:49 smithi121 ceph-mon[81053]: pgmap v372: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:54:50.158 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:54:49 smithi195 ceph-mon[68841]: pgmap v372: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:54:52.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:54:51 smithi121 ceph-mon[81053]: pgmap v373: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:54:52.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:54:51 smithi195 ceph-mon[68841]: pgmap v373: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:54:54.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:54:53 smithi121 ceph-mon[81053]: pgmap v374: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:54:54.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:54:53 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-18T22:54:54.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:54:53 smithi195 ceph-mon[68841]: pgmap v374: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:54:54.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:54:53 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-18T22:54:56.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:54:55 smithi121 ceph-mon[81053]: pgmap v375: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:54:56.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:54:55 smithi195 ceph-mon[68841]: pgmap v375: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:54:58.087 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:54:57 smithi121 ceph-mon[81053]: pgmap v376: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:54:58.166 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:54:57 smithi195 ceph-mon[68841]: pgmap v376: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:55:00.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:54:59 smithi121 ceph-mon[81053]: pgmap v377: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:55:00.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:54:59 smithi195 ceph-mon[68841]: pgmap v377: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:55:02.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:55:01 smithi121 ceph-mon[81053]: pgmap v378: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:55:02.158 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:55:01 smithi195 ceph-mon[68841]: pgmap v378: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:55:03.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:55:02 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-18T22:55:03.158 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:55:02 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-18T22:55:04.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:55:03 smithi121 ceph-mon[81053]: pgmap v379: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:55:04.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:55:03 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:55:04.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:55:03 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:55:04.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:55:03 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:55:04.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:55:03 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-18T22:55:04.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:55:03 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:55:04.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:55:03 smithi195 ceph-mon[68841]: pgmap v379: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:55:04.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:55:03 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:55:04.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:55:03 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:55:04.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:55:03 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:55:04.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:55:03 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-18T22:55:04.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:55:03 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:55:06.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:55:05 smithi121 ceph-mon[81053]: pgmap v380: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:55:06.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:55:05 smithi195 ceph-mon[68841]: pgmap v380: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:55:08.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:55:07 smithi121 ceph-mon[81053]: pgmap v381: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:55:08.158 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:55:07 smithi195 ceph-mon[68841]: pgmap v381: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:55:09.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:55:08 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-18T22:55:09.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:55:08 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-18T22:55:10.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:55:09 smithi121 ceph-mon[81053]: pgmap v382: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:55:10.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:55:09 smithi195 ceph-mon[68841]: pgmap v382: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:55:12.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:55:11 smithi121 ceph-mon[81053]: pgmap v383: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:55:12.158 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:55:11 smithi195 ceph-mon[68841]: pgmap v383: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:55:14.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:55:13 smithi121 ceph-mon[81053]: pgmap v384: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:55:14.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:55:13 smithi195 ceph-mon[68841]: pgmap v384: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:55:16.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:55:15 smithi121 ceph-mon[81053]: pgmap v385: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:55:16.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:55:15 smithi195 ceph-mon[68841]: pgmap v385: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:55:18.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:55:17 smithi121 ceph-mon[81053]: pgmap v386: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:55:18.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:55:17 smithi195 ceph-mon[68841]: pgmap v386: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:55:20.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:55:19 smithi121 ceph-mon[81053]: pgmap v387: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:55:20.158 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:55:19 smithi195 ceph-mon[68841]: pgmap v387: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:55:22.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:55:21 smithi195 ceph-mon[68841]: pgmap v388: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:55:22.314 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:55:21 smithi121 ceph-mon[81053]: pgmap v388: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:55:24.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:55:23 smithi195 ceph-mon[68841]: pgmap v389: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:55:24.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:55:23 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-18T22:55:24.334 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:55:23 smithi121 ceph-mon[81053]: pgmap v389: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:55:24.334 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:55:23 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-18T22:55:26.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:55:25 smithi195 ceph-mon[68841]: pgmap v390: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:55:26.333 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:55:25 smithi121 ceph-mon[81053]: pgmap v390: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:55:27.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:55:26 smithi195 ceph-mon[68841]: pgmap v391: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:55:27.333 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:55:26 smithi121 ceph-mon[81053]: pgmap v391: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:55:30.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:55:29 smithi121 ceph-mon[81053]: pgmap v392: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:55:30.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:55:29 smithi195 ceph-mon[68841]: pgmap v392: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:55:32.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:55:31 smithi121 ceph-mon[81053]: pgmap v393: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:55:32.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:55:31 smithi195 ceph-mon[68841]: pgmap v393: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:55:34.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:55:33 smithi121 ceph-mon[81053]: pgmap v394: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:55:34.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:55:33 smithi195 ceph-mon[68841]: pgmap v394: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:55:36.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:55:35 smithi121 ceph-mon[81053]: pgmap v395: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:55:36.158 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:55:35 smithi195 ceph-mon[68841]: pgmap v395: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:55:38.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:55:37 smithi121 ceph-mon[81053]: pgmap v396: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:55:38.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:55:37 smithi195 ceph-mon[68841]: pgmap v396: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:55:39.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:55:38 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-18T22:55:39.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:55:38 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-18T22:55:40.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:55:39 smithi121 ceph-mon[81053]: pgmap v397: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:55:40.158 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:55:39 smithi195 ceph-mon[68841]: pgmap v397: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:55:42.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:55:41 smithi121 ceph-mon[81053]: pgmap v398: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:55:42.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:55:41 smithi195 ceph-mon[68841]: pgmap v398: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:55:44.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:55:43 smithi121 ceph-mon[81053]: pgmap v399: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:55:44.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:55:43 smithi195 ceph-mon[68841]: pgmap v399: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:55:46.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:55:45 smithi121 ceph-mon[81053]: pgmap v400: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:55:46.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:55:45 smithi195 ceph-mon[68841]: pgmap v400: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:55:48.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:55:47 smithi121 ceph-mon[81053]: pgmap v401: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:55:48.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:55:47 smithi195 ceph-mon[68841]: pgmap v401: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:55:50.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:55:49 smithi121 ceph-mon[81053]: pgmap v402: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:55:50.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:55:49 smithi195 ceph-mon[68841]: pgmap v402: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:55:52.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:55:51 smithi121 ceph-mon[81053]: pgmap v403: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:55:52.158 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:55:51 smithi195 ceph-mon[68841]: pgmap v403: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:55:54.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:55:53 smithi121 ceph-mon[81053]: pgmap v404: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:55:54.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:55:53 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-18T22:55:54.162 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:55:53 smithi195 ceph-mon[68841]: pgmap v404: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:55:54.163 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:55:53 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-18T22:55:56.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:55:55 smithi121 ceph-mon[81053]: pgmap v405: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:55:56.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:55:55 smithi195 ceph-mon[68841]: pgmap v405: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:55:58.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:55:57 smithi121 ceph-mon[81053]: pgmap v406: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:55:58.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:55:57 smithi195 ceph-mon[68841]: pgmap v406: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:56:00.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:55:59 smithi121 ceph-mon[81053]: pgmap v407: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:56:00.158 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:55:59 smithi195 ceph-mon[68841]: pgmap v407: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:56:02.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:56:01 smithi121 ceph-mon[81053]: pgmap v408: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:56:02.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:56:01 smithi195 ceph-mon[68841]: pgmap v408: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:56:04.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:56:03 smithi121 ceph-mon[81053]: pgmap v409: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:56:04.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:56:03 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-18T22:56:04.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:56:03 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:56:04.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:56:03 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-18T22:56:04.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:56:03 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:56:04.158 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:56:03 smithi195 ceph-mon[68841]: pgmap v409: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:56:04.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:56:03 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-18T22:56:04.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:56:03 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:56:04.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:56:03 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-18T22:56:04.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:56:03 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:56:06.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:56:05 smithi121 ceph-mon[81053]: pgmap v410: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:56:06.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:56:05 smithi195 ceph-mon[68841]: pgmap v410: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:56:08.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:56:07 smithi121 ceph-mon[81053]: pgmap v411: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:56:08.158 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:56:07 smithi195 ceph-mon[68841]: pgmap v411: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:56:09.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:56:08 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-18T22:56:09.158 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:56:08 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-18T22:56:10.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:56:09 smithi121 ceph-mon[81053]: pgmap v412: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:56:10.158 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:56:09 smithi195 ceph-mon[68841]: pgmap v412: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:56:12.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:56:11 smithi121 ceph-mon[81053]: pgmap v413: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:56:12.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:56:11 smithi195 ceph-mon[68841]: pgmap v413: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:56:14.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:56:13 smithi121 ceph-mon[81053]: pgmap v414: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:56:14.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:56:13 smithi195 ceph-mon[68841]: pgmap v414: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:56:16.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:56:15 smithi121 ceph-mon[81053]: pgmap v415: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:56:16.158 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:56:15 smithi195 ceph-mon[68841]: pgmap v415: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:56:18.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:56:17 smithi121 ceph-mon[81053]: pgmap v416: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:56:18.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:56:17 smithi195 ceph-mon[68841]: pgmap v416: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:56:20.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:56:19 smithi121 ceph-mon[81053]: pgmap v417: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:56:20.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:56:19 smithi195 ceph-mon[68841]: pgmap v417: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:56:22.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:56:21 smithi121 ceph-mon[81053]: pgmap v418: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:56:22.158 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:56:21 smithi195 ceph-mon[68841]: pgmap v418: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:56:24.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:56:23 smithi121 ceph-mon[81053]: pgmap v419: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:56:24.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:56:23 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-18T22:56:24.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:56:23 smithi195 ceph-mon[68841]: pgmap v419: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:56:24.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:56:23 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-18T22:56:26.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:56:25 smithi121 ceph-mon[81053]: pgmap v420: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:56:26.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:56:25 smithi195 ceph-mon[68841]: pgmap v420: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:56:28.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:56:27 smithi121 ceph-mon[81053]: pgmap v421: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:56:28.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:56:27 smithi195 ceph-mon[68841]: pgmap v421: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:56:30.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:56:29 smithi195 ceph-mon[68841]: pgmap v422: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:56:30.333 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:56:29 smithi121 ceph-mon[81053]: pgmap v422: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:56:32.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:56:31 smithi195 ceph-mon[68841]: pgmap v423: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:56:32.314 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:56:31 smithi121 ceph-mon[81053]: pgmap v423: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:56:34.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:56:33 smithi195 ceph-mon[68841]: pgmap v424: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:56:34.333 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:56:33 smithi121 ceph-mon[81053]: pgmap v424: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:56:36.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:56:35 smithi195 ceph-mon[68841]: pgmap v425: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:56:36.333 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:56:35 smithi121 ceph-mon[81053]: pgmap v425: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:56:38.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:56:37 smithi195 ceph-mon[68841]: pgmap v426: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:56:38.333 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:56:37 smithi121 ceph-mon[81053]: pgmap v426: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:56:39.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:56:38 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-18T22:56:39.234 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:56:38 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-18T22:56:40.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:56:39 smithi195 ceph-mon[68841]: pgmap v427: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:56:40.333 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:56:39 smithi121 ceph-mon[81053]: pgmap v427: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:56:41.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:56:40 smithi195 ceph-mon[68841]: pgmap v428: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:56:41.333 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:56:40 smithi121 ceph-mon[81053]: pgmap v428: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:56:44.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:56:43 smithi121 ceph-mon[81053]: pgmap v429: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:56:44.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:56:43 smithi195 ceph-mon[68841]: pgmap v429: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:56:46.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:56:45 smithi121 ceph-mon[81053]: pgmap v430: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:56:46.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:56:45 smithi195 ceph-mon[68841]: pgmap v430: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:56:48.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:56:47 smithi121 ceph-mon[81053]: pgmap v431: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:56:48.158 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:56:47 smithi195 ceph-mon[68841]: pgmap v431: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:56:50.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:56:49 smithi121 ceph-mon[81053]: pgmap v432: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:56:50.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:56:49 smithi195 ceph-mon[68841]: pgmap v432: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:56:52.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:56:51 smithi121 ceph-mon[81053]: pgmap v433: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:56:52.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:56:51 smithi195 ceph-mon[68841]: pgmap v433: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:56:54.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:56:53 smithi121 ceph-mon[81053]: pgmap v434: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:56:54.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:56:53 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-18T22:56:54.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:56:53 smithi195 ceph-mon[68841]: pgmap v434: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:56:54.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:56:53 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-18T22:56:56.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:56:55 smithi121 ceph-mon[81053]: pgmap v435: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:56:56.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:56:55 smithi195 ceph-mon[68841]: pgmap v435: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:56:58.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:56:57 smithi121 ceph-mon[81053]: pgmap v436: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:56:58.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:56:57 smithi195 ceph-mon[68841]: pgmap v436: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:57:00.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:56:59 smithi121 ceph-mon[81053]: pgmap v437: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:57:00.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:56:59 smithi195 ceph-mon[68841]: pgmap v437: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:57:02.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:57:01 smithi121 ceph-mon[81053]: pgmap v438: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:57:02.158 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:57:01 smithi195 ceph-mon[68841]: pgmap v438: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:57:04.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:57:03 smithi121 ceph-mon[81053]: pgmap v439: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:57:04.158 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:57:03 smithi195 ceph-mon[68841]: pgmap v439: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:57:05.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:57:04 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-18T22:57:05.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:57:04 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:57:05.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:57:04 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-18T22:57:05.084 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:57:04 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:57:05.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:57:04 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-18T22:57:05.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:57:04 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:57:05.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:57:04 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-18T22:57:05.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:57:04 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:57:06.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:57:05 smithi121 ceph-mon[81053]: pgmap v440: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:57:06.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:57:05 smithi195 ceph-mon[68841]: pgmap v440: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:57:08.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:57:07 smithi121 ceph-mon[81053]: pgmap v441: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:57:08.158 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:57:07 smithi195 ceph-mon[68841]: pgmap v441: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:57:09.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:57:08 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-18T22:57:09.158 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:57:08 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-18T22:57:10.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:57:09 smithi121 ceph-mon[81053]: pgmap v442: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:57:10.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:57:09 smithi195 ceph-mon[68841]: pgmap v442: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:57:12.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:57:11 smithi121 ceph-mon[81053]: pgmap v443: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:57:12.284 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:57:11 smithi195 ceph-mon[68841]: pgmap v443: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:57:13.833 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:57:13 smithi121 ceph-mon[81053]: pgmap v444: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:57:13.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:57:13 smithi195 ceph-mon[68841]: pgmap v444: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:57:16.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:57:15 smithi121 ceph-mon[81053]: pgmap v445: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:57:16.158 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:57:15 smithi195 ceph-mon[68841]: pgmap v445: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:57:18.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:57:17 smithi121 ceph-mon[81053]: pgmap v446: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:57:18.158 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:57:17 smithi195 ceph-mon[68841]: pgmap v446: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:57:20.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:57:19 smithi121 ceph-mon[81053]: pgmap v447: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:57:20.158 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:57:19 smithi195 ceph-mon[68841]: pgmap v447: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:57:22.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:57:21 smithi121 ceph-mon[81053]: pgmap v448: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:57:22.158 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:57:21 smithi195 ceph-mon[68841]: pgmap v448: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:57:24.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:57:23 smithi121 ceph-mon[81053]: pgmap v449: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:57:24.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:57:23 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-18T22:57:24.158 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:57:23 smithi195 ceph-mon[68841]: pgmap v449: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:57:24.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:57:23 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-18T22:57:26.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:57:25 smithi121 ceph-mon[81053]: pgmap v450: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:57:26.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:57:25 smithi195 ceph-mon[68841]: pgmap v450: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:57:28.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:57:27 smithi121 ceph-mon[81053]: pgmap v451: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:57:28.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:57:27 smithi195 ceph-mon[68841]: pgmap v451: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:57:30.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:57:29 smithi121 ceph-mon[81053]: pgmap v452: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:57:30.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:57:29 smithi195 ceph-mon[68841]: pgmap v452: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:57:32.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:57:31 smithi121 ceph-mon[81053]: pgmap v453: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:57:32.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:57:31 smithi195 ceph-mon[68841]: pgmap v453: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:57:34.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:57:33 smithi121 ceph-mon[81053]: pgmap v454: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:57:34.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:57:33 smithi195 ceph-mon[68841]: pgmap v454: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:57:36.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:57:35 smithi121 ceph-mon[81053]: pgmap v455: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:57:36.158 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:57:35 smithi195 ceph-mon[68841]: pgmap v455: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:57:38.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:57:37 smithi121 ceph-mon[81053]: pgmap v456: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:57:38.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:57:37 smithi195 ceph-mon[68841]: pgmap v456: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:57:39.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:57:38 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-18T22:57:39.158 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:57:38 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-18T22:57:40.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:57:39 smithi121 ceph-mon[81053]: pgmap v457: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:57:40.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:57:39 smithi195 ceph-mon[68841]: pgmap v457: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:57:42.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:57:41 smithi121 ceph-mon[81053]: pgmap v458: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:57:42.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:57:41 smithi195 ceph-mon[68841]: pgmap v458: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:57:44.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:57:43 smithi121 ceph-mon[81053]: pgmap v459: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:57:44.158 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:57:43 smithi195 ceph-mon[68841]: pgmap v459: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:57:46.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:57:45 smithi121 ceph-mon[81053]: pgmap v460: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:57:46.158 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:57:45 smithi195 ceph-mon[68841]: pgmap v460: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:57:48.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:57:47 smithi121 ceph-mon[81053]: pgmap v461: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:57:48.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:57:47 smithi195 ceph-mon[68841]: pgmap v461: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:57:50.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:57:49 smithi121 ceph-mon[81053]: pgmap v462: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:57:50.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:57:49 smithi195 ceph-mon[68841]: pgmap v462: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:57:52.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:57:51 smithi121 ceph-mon[81053]: pgmap v463: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:57:52.158 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:57:51 smithi195 ceph-mon[68841]: pgmap v463: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:57:54.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:57:53 smithi121 ceph-mon[81053]: pgmap v464: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:57:54.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:57:53 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-18T22:57:54.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:57:53 smithi195 ceph-mon[68841]: pgmap v464: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:57:54.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:57:53 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-18T22:57:56.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:57:55 smithi195 ceph-mon[68841]: pgmap v465: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:57:56.333 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:57:55 smithi121 ceph-mon[81053]: pgmap v465: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:57:58.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:57:57 smithi195 ceph-mon[68841]: pgmap v466: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:57:58.333 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:57:57 smithi121 ceph-mon[81053]: pgmap v466: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:58:00.158 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:57:59 smithi195 ceph-mon[68841]: pgmap v467: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:58:00.333 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:57:59 smithi121 ceph-mon[81053]: pgmap v467: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:58:02.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:58:01 smithi195 ceph-mon[68841]: pgmap v468: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:58:02.315 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:58:01 smithi121 ceph-mon[81053]: pgmap v468: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:58:04.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:58:03 smithi195 ceph-mon[68841]: pgmap v469: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:58:04.333 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:58:03 smithi121 ceph-mon[81053]: pgmap v469: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:58:05.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:58:04 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-18T22:58:05.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:58:04 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:58:05.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:58:04 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-18T22:58:05.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:58:04 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:58:05.333 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:58:04 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-18T22:58:05.333 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:58:04 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:58:05.333 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:58:04 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-18T22:58:05.333 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:58:04 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:58:06.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:58:05 smithi195 ceph-mon[68841]: pgmap v470: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:58:06.333 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:58:05 smithi121 ceph-mon[81053]: pgmap v470: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:58:08.158 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:58:07 smithi195 ceph-mon[68841]: pgmap v471: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:58:08.333 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:58:07 smithi121 ceph-mon[81053]: pgmap v471: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:58:09.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:58:08 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-18T22:58:09.234 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:58:08 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-18T22:58:10.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:58:09 smithi195 ceph-mon[68841]: pgmap v472: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:58:10.333 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:58:09 smithi121 ceph-mon[81053]: pgmap v472: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:58:12.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:58:11 smithi195 ceph-mon[68841]: pgmap v473: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:58:12.315 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:58:11 smithi121 ceph-mon[81053]: pgmap v473: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:58:13.158 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:58:12 smithi195 ceph-mon[68841]: pgmap v474: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:58:13.333 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:58:12 smithi121 ceph-mon[81053]: pgmap v474: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:58:16.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:58:15 smithi121 ceph-mon[81053]: pgmap v475: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:58:16.158 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:58:15 smithi195 ceph-mon[68841]: pgmap v475: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:58:18.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:58:17 smithi121 ceph-mon[81053]: pgmap v476: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:58:18.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:58:17 smithi195 ceph-mon[68841]: pgmap v476: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:58:20.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:58:19 smithi121 ceph-mon[81053]: pgmap v477: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:58:20.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:58:19 smithi195 ceph-mon[68841]: pgmap v477: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:58:22.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:58:21 smithi121 ceph-mon[81053]: pgmap v478: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:58:22.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:58:21 smithi195 ceph-mon[68841]: pgmap v478: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:58:24.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:58:23 smithi121 ceph-mon[81053]: pgmap v479: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:58:24.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:58:23 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-18T22:58:24.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:58:23 smithi195 ceph-mon[68841]: pgmap v479: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:58:24.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:58:23 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-18T22:58:26.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:58:25 smithi121 ceph-mon[81053]: pgmap v480: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:58:26.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:58:25 smithi195 ceph-mon[68841]: pgmap v480: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:58:28.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:58:27 smithi121 ceph-mon[81053]: pgmap v481: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:58:28.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:58:27 smithi195 ceph-mon[68841]: pgmap v481: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:58:30.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:58:29 smithi121 ceph-mon[81053]: pgmap v482: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:58:30.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:58:29 smithi195 ceph-mon[68841]: pgmap v482: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:58:32.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:58:31 smithi121 ceph-mon[81053]: pgmap v483: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:58:32.158 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:58:31 smithi195 ceph-mon[68841]: pgmap v483: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:58:34.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:58:33 smithi121 ceph-mon[81053]: pgmap v484: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:58:34.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:58:33 smithi195 ceph-mon[68841]: pgmap v484: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:58:36.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:58:35 smithi121 ceph-mon[81053]: pgmap v485: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:58:36.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:58:35 smithi195 ceph-mon[68841]: pgmap v485: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:58:38.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:58:37 smithi121 ceph-mon[81053]: pgmap v486: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:58:38.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:58:37 smithi195 ceph-mon[68841]: pgmap v486: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:58:39.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:58:38 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-18T22:58:39.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:58:38 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-18T22:58:40.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:58:39 smithi121 ceph-mon[81053]: pgmap v487: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:58:40.158 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:58:39 smithi195 ceph-mon[68841]: pgmap v487: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:58:42.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:58:41 smithi121 ceph-mon[81053]: pgmap v488: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:58:42.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:58:41 smithi195 ceph-mon[68841]: pgmap v488: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:58:44.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:58:43 smithi121 ceph-mon[81053]: pgmap v489: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:58:44.158 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:58:43 smithi195 ceph-mon[68841]: pgmap v489: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:58:46.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:58:45 smithi121 ceph-mon[81053]: pgmap v490: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:58:46.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:58:45 smithi195 ceph-mon[68841]: pgmap v490: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:58:48.083 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:58:47 smithi121 ceph-mon[81053]: pgmap v491: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:58:48.158 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:58:47 smithi195 ceph-mon[68841]: pgmap v491: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:58:50.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:58:49 smithi195 ceph-mon[68841]: pgmap v492: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:58:50.333 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:58:49 smithi121 ceph-mon[81053]: pgmap v492: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:58:52.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:58:51 smithi195 ceph-mon[68841]: pgmap v493: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:58:52.314 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:58:51 smithi121 ceph-mon[81053]: pgmap v493: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:58:54.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:58:53 smithi195 ceph-mon[68841]: pgmap v494: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:58:54.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:58:53 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-18T22:58:54.333 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:58:53 smithi121 ceph-mon[81053]: pgmap v494: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:58:54.333 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:58:53 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-18T22:58:56.158 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:58:55 smithi195 ceph-mon[68841]: pgmap v495: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:58:56.333 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:58:55 smithi121 ceph-mon[81053]: pgmap v495: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:58:58.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:58:57 smithi195 ceph-mon[68841]: pgmap v496: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:58:58.333 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:58:57 smithi121 ceph-mon[81053]: pgmap v496: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:59:00.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:58:59 smithi195 ceph-mon[68841]: pgmap v497: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:59:00.333 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:58:59 smithi121 ceph-mon[81053]: pgmap v497: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:59:02.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:59:01 smithi195 ceph-mon[68841]: pgmap v498: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:59:02.315 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:59:01 smithi121 ceph-mon[81053]: pgmap v498: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:59:04.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:59:03 smithi195 ceph-mon[68841]: pgmap v499: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:59:04.333 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:59:03 smithi121 ceph-mon[81053]: pgmap v499: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:59:06.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:59:05 smithi195 ceph-mon[68841]: pgmap v500: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:59:06.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:59:05 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-18T22:59:06.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:59:05 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:59:06.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:59:05 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-18T22:59:06.159 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:59:05 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:59:06.333 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:59:05 smithi121 ceph-mon[81053]: pgmap v500: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:59:06.333 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:59:05 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-18T22:59:06.333 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:59:05 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-18T22:59:06.334 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:59:05 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-18T22:59:06.334 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:59:05 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' 2024-08-18T22:59:08.158 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:59:07 smithi195 ceph-mon[68841]: pgmap v501: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:59:08.333 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:59:07 smithi121 ceph-mon[81053]: pgmap v501: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:59:09.158 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:59:08 smithi195 ceph-mon[68841]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-18T22:59:09.234 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:59:08 smithi121 ceph-mon[81053]: from='mgr.34102 172.21.15.121:0/1806434883' entity='mgr.smithi121.lopxqc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-18T22:59:10.158 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:59:09 smithi195 ceph-mon[68841]: pgmap v502: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:59:10.333 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:59:09 smithi121 ceph-mon[81053]: pgmap v502: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:59:12.158 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:59:11 smithi195 ceph-mon[68841]: pgmap v503: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:59:12.315 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:59:11 smithi121 ceph-mon[81053]: pgmap v503: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:59:13.992 ERROR:tasks.cephfs.fuse_mount:process failed to terminate after unmount. This probably indicates a bug within ceph-fuse. 2024-08-18T22:59:13.992 ERROR:teuthology.run_tasks:Manager failed: ceph-fuse Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/run_tasks.py", line 160, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.10/contextlib.py", line 142, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph_78215f5a1cf5eaf321d506a66539942e12851f34/qa/tasks/ceph_fuse.py", line 248, in task mount.umount_wait() File "/home/teuthworker/src/git.ceph.com_ceph_78215f5a1cf5eaf321d506a66539942e12851f34/qa/tasks/cephfs/fuse_mount.py", line 403, in umount_wait run.wait([self.fuse_daemon], timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/orchestra/run.py", line 473, in wait check_time() File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/contextutil.py", line 134, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: reached maximum tries (50) after waiting for 300 seconds 2024-08-18T22:59:13.994 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2024-08-18T22:59:14.005 INFO:tasks.cephadm:Teardown begin 2024-08-18T22:59:14.005 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/git.ceph.com_ceph_78215f5a1cf5eaf321d506a66539942e12851f34/qa/tasks/cephadm.py", line 2236, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/run_tasks.py", line 160, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.10/contextlib.py", line 142, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph_78215f5a1cf5eaf321d506a66539942e12851f34/qa/tasks/ceph_fuse.py", line 248, in task mount.umount_wait() File "/home/teuthworker/src/git.ceph.com_ceph_78215f5a1cf5eaf321d506a66539942e12851f34/qa/tasks/cephfs/fuse_mount.py", line 403, in umount_wait run.wait([self.fuse_daemon], timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/orchestra/run.py", line 473, in wait check_time() File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/contextutil.py", line 134, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: reached maximum tries (50) after waiting for 300 seconds 2024-08-18T22:59:14.006 DEBUG:teuthology.orchestra.run.smithi121:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-08-18T22:59:14.041 DEBUG:teuthology.orchestra.run.smithi195:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-08-18T22:59:14.075 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2024-08-18T22:59:14.075 DEBUG:teuthology.orchestra.run.smithi121:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-08-18T22:59:14.098 DEBUG:teuthology.orchestra.run.smithi195:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-08-18T22:59:14.132 INFO:tasks.cephadm:Stopping all daemons... 2024-08-18T22:59:14.132 INFO:tasks.cephadm.mon.smithi121:Stopping mon.smithi121... 2024-08-18T22:59:14.132 DEBUG:teuthology.orchestra.run.smithi121:> sudo systemctl stop ceph-b003123a-5db1-11ef-bccf-c7b262605968@mon.smithi121 2024-08-18T22:59:14.158 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:59:13 smithi195 ceph-mon[68841]: pgmap v504: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:59:14.162 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:59:13 smithi121 ceph-mon[81053]: pgmap v504: 65 pgs: 65 active+clean; 162 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2024-08-18T22:59:14.449 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:59:14 smithi121 systemd[1]: Stopping Ceph mon.smithi121 for b003123a-5db1-11ef-bccf-c7b262605968... 2024-08-18T22:59:14.741 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:59:14 smithi121 ceph-b003123a-5db1-11ef-bccf-c7b262605968-mon-smithi121[81049]: 2024-08-18T22:59:14.446+0000 7f7aee76b640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi121 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-08-18T22:59:14.741 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:59:14 smithi121 ceph-b003123a-5db1-11ef-bccf-c7b262605968-mon-smithi121[81049]: 2024-08-18T22:59:14.446+0000 7f7aee76b640 -1 mon.smithi121@0(leader) e3 *** Got Signal Terminated *** 2024-08-18T22:59:14.741 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:59:14 smithi121 podman[139860]: 2024-08-18 22:59:14.480445164 +0000 UTC m=+0.140932479 container died d71695a4fb56e5aee853ed2634967de22964c5047716447f055b737a82b6e55e (image=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-b003123a-5db1-11ef-bccf-c7b262605968-mon-smithi121, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.36.0, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, RELEASE=squid-de09dd0, ceph=True, org.label-schema.vendor=CentOS) 2024-08-18T22:59:15.029 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:59:14 smithi121 podman[139860]: 2024-08-18 22:59:14.93209837 +0000 UTC m=+0.592585685 container cleanup d71695a4fb56e5aee853ed2634967de22964c5047716447f055b737a82b6e55e (image=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-b003123a-5db1-11ef-bccf-c7b262605968-mon-smithi121, ceph=True, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-de09dd0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, io.buildah.version=1.36.0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-08-18T22:59:15.029 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:59:14 smithi121 bash[139860]: ceph-b003123a-5db1-11ef-bccf-c7b262605968-mon-smithi121 2024-08-18T22:59:15.333 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Aug 18 22:59:15 smithi121 podman[139874]: 2024-08-18 22:59:15.217297369 +0000 UTC m=+0.733083147 container remove d71695a4fb56e5aee853ed2634967de22964c5047716447f055b737a82b6e55e (image=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-b003123a-5db1-11ef-bccf-c7b262605968-mon-smithi121, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-de09dd0, io.buildah.version=1.36.0, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux ) 2024-08-18T22:59:15.378 DEBUG:teuthology.orchestra.run.smithi121:> sudo pkill -f 'journalctl -f -n 0 -u ceph-b003123a-5db1-11ef-bccf-c7b262605968@mon.smithi121.service' 2024-08-18T22:59:15.473 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-18T22:59:15.473 INFO:tasks.cephadm.mon.smithi121:Stopped mon.smithi121 2024-08-18T22:59:15.473 INFO:tasks.cephadm.mon.smithi195:Stopping mon.smithi195... 2024-08-18T22:59:15.473 DEBUG:teuthology.orchestra.run.smithi195:> sudo systemctl stop ceph-b003123a-5db1-11ef-bccf-c7b262605968@mon.smithi195 2024-08-18T22:59:15.808 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:59:15 smithi195 systemd[1]: Stopping Ceph mon.smithi195 for b003123a-5db1-11ef-bccf-c7b262605968... 2024-08-18T22:59:16.125 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:59:15 smithi195 ceph-b003123a-5db1-11ef-bccf-c7b262605968-mon-smithi195[68835]: 2024-08-18T22:59:15.806+0000 7f8683241640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi195 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-08-18T22:59:16.126 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:59:15 smithi195 ceph-b003123a-5db1-11ef-bccf-c7b262605968-mon-smithi195[68835]: 2024-08-18T22:59:15.806+0000 7f8683241640 -1 mon.smithi195@1(peon) e3 *** Got Signal Terminated *** 2024-08-18T22:59:16.126 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:59:15 smithi195 podman[105953]: 2024-08-18 22:59:15.818282366 +0000 UTC m=+0.132001223 container stop a9bb94ba3b56650f5a5000faf001d16dac61f58cad8af1485605838311cd7916 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-b003123a-5db1-11ef-bccf-c7b262605968-mon-smithi195, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, io.buildah.version=1.36.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, RELEASE=squid-de09dd0, org.label-schema.license=GPLv2) 2024-08-18T22:59:16.126 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:59:15 smithi195 podman[105953]: 2024-08-18 22:59:15.847063902 +0000 UTC m=+0.160782802 container died a9bb94ba3b56650f5a5000faf001d16dac61f58cad8af1485605838311cd7916 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-b003123a-5db1-11ef-bccf-c7b262605968-mon-smithi195, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.build-date=20240731, io.buildah.version=1.36.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-de09dd0, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-08-18T22:59:16.409 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:59:16 smithi195 podman[105953]: 2024-08-18 22:59:16.30798362 +0000 UTC m=+0.621702473 container cleanup a9bb94ba3b56650f5a5000faf001d16dac61f58cad8af1485605838311cd7916 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-b003123a-5db1-11ef-bccf-c7b262605968-mon-smithi195, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-de09dd0, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , io.buildah.version=1.36.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True) 2024-08-18T22:59:16.409 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:59:16 smithi195 bash[105953]: ceph-b003123a-5db1-11ef-bccf-c7b262605968-mon-smithi195 2024-08-18T22:59:16.735 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Aug 18 22:59:16 smithi195 podman[105967]: 2024-08-18 22:59:16.484709491 +0000 UTC m=+0.660767031 container remove a9bb94ba3b56650f5a5000faf001d16dac61f58cad8af1485605838311cd7916 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-b003123a-5db1-11ef-bccf-c7b262605968-mon-smithi195, GIT_BRANCH=HEAD, ceph=True, org.label-schema.license=GPLv2, io.buildah.version=1.36.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-de09dd0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True) 2024-08-18T22:59:16.738 DEBUG:teuthology.orchestra.run.smithi195:> sudo pkill -f 'journalctl -f -n 0 -u ceph-b003123a-5db1-11ef-bccf-c7b262605968@mon.smithi195.service' 2024-08-18T22:59:16.795 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-18T22:59:16.795 INFO:tasks.cephadm.mon.smithi195:Stopped mon.smithi195 2024-08-18T22:59:16.795 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2024-08-18T22:59:16.795 DEBUG:teuthology.orchestra.run.smithi121:> sudo systemctl stop ceph-b003123a-5db1-11ef-bccf-c7b262605968@osd.0 2024-08-18T22:59:17.083 INFO:journalctl@ceph.osd.0.smithi121.stdout:Aug 18 22:59:16 smithi121 systemd[1]: Stopping Ceph osd.0 for b003123a-5db1-11ef-bccf-c7b262605968... 2024-08-18T22:59:17.583 INFO:journalctl@ceph.osd.0.smithi121.stdout:Aug 18 22:59:17 smithi121 ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-0[89254]: 2024-08-18T22:59:17.294+0000 7fc1f6106640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-18T22:59:17.584 INFO:journalctl@ceph.osd.0.smithi121.stdout:Aug 18 22:59:17 smithi121 ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-0[89254]: 2024-08-18T22:59:17.294+0000 7fc1f6106640 -1 osd.0 84 *** Got signal Terminated *** 2024-08-18T22:59:17.584 INFO:journalctl@ceph.osd.0.smithi121.stdout:Aug 18 22:59:17 smithi121 ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-0[89254]: 2024-08-18T22:59:17.294+0000 7fc1f6106640 -1 osd.0 84 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-08-18T22:59:23.071 INFO:journalctl@ceph.osd.0.smithi121.stdout:Aug 18 22:59:22 smithi121 podman[139992]: 2024-08-18 22:59:22.782459329 +0000 UTC m=+5.785892392 container died d378dd46eeb6920fbd6fccca9ddd1cd477d678eedd7275915f8473f4c786c4ef (image=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-0, io.buildah.version=1.36.0, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, RELEASE=squid-de09dd0, GIT_CLEAN=True) 2024-08-18T22:59:23.333 INFO:journalctl@ceph.osd.0.smithi121.stdout:Aug 18 22:59:23 smithi121 podman[139992]: 2024-08-18 22:59:23.161397662 +0000 UTC m=+6.164830800 container cleanup d378dd46eeb6920fbd6fccca9ddd1cd477d678eedd7275915f8473f4c786c4ef (image=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-0, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, io.buildah.version=1.36.0, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-de09dd0) 2024-08-18T22:59:23.333 INFO:journalctl@ceph.osd.0.smithi121.stdout:Aug 18 22:59:23 smithi121 bash[139992]: ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-0 2024-08-18T22:59:23.750 INFO:journalctl@ceph.osd.0.smithi121.stdout:Aug 18 22:59:23 smithi121 podman[140007]: 2024-08-18 22:59:23.413095598 +0000 UTC m=+0.626514311 container remove d378dd46eeb6920fbd6fccca9ddd1cd477d678eedd7275915f8473f4c786c4ef (image=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-0, io.buildah.version=1.36.0, RELEASE=squid-de09dd0, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.license=GPLv2) 2024-08-18T22:59:24.003 INFO:journalctl@ceph.osd.0.smithi121.stdout:Aug 18 22:59:23 smithi121 podman[140097]: 2024-08-18 22:59:23.652925865 +0000 UTC m=+0.017477899 image pull ea7a5189f30bad3aca9524788e2965d2368d7ce786df09d4edcd8c3edf9cefba quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9 2024-08-18T22:59:24.003 INFO:journalctl@ceph.osd.0.smithi121.stdout:Aug 18 22:59:23 smithi121 podman[140097]: 2024-08-18 22:59:23.780731941 +0000 UTC m=+0.145283959 container create 055b745f923190e626d236b0bf49e1846dc0018b896d814aec8cc6f8178cfa98 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-0-deactivate, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, RELEASE=squid-de09dd0, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.36.0, GIT_BRANCH=HEAD) 2024-08-18T22:59:24.004 INFO:journalctl@ceph.osd.0.smithi121.stdout:Aug 18 22:59:24 smithi121 podman[140097]: 2024-08-18 22:59:24.000047917 +0000 UTC m=+0.364599938 container init 055b745f923190e626d236b0bf49e1846dc0018b896d814aec8cc6f8178cfa98 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-0-deactivate, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, RELEASE=squid-de09dd0, ceph=True, maintainer=Guillaume Abrioux , io.buildah.version=1.36.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-08-18T22:59:24.004 INFO:journalctl@ceph.osd.0.smithi121.stdout:Aug 18 22:59:24 smithi121 podman[140097]: 2024-08-18 22:59:24.003496195 +0000 UTC m=+0.368048222 container start 055b745f923190e626d236b0bf49e1846dc0018b896d814aec8cc6f8178cfa98 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-0-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, ceph=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, RELEASE=squid-de09dd0, GIT_CLEAN=True, io.buildah.version=1.36.0, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux ) 2024-08-18T22:59:24.284 INFO:journalctl@ceph.osd.0.smithi121.stdout:Aug 18 22:59:24 smithi121 podman[140097]: 2024-08-18 22:59:24.100280052 +0000 UTC m=+0.464832094 container attach 055b745f923190e626d236b0bf49e1846dc0018b896d814aec8cc6f8178cfa98 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-0-deactivate, RELEASE=squid-de09dd0, ceph=True, io.buildah.version=1.36.0, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-08-18T22:59:24.284 INFO:journalctl@ceph.osd.0.smithi121.stdout:Aug 18 22:59:24 smithi121 podman[140097]: 2024-08-18 22:59:24.207872803 +0000 UTC m=+0.572424827 container died 055b745f923190e626d236b0bf49e1846dc0018b896d814aec8cc6f8178cfa98 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-0-deactivate, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, RELEASE=squid-de09dd0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.36.0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image) 2024-08-18T22:59:24.798 DEBUG:teuthology.orchestra.run.smithi121:> sudo pkill -f 'journalctl -f -n 0 -u ceph-b003123a-5db1-11ef-bccf-c7b262605968@osd.0.service' 2024-08-18T22:59:24.837 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-18T22:59:24.837 INFO:tasks.cephadm.osd.0:Stopped osd.0 2024-08-18T22:59:24.837 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2024-08-18T22:59:24.837 DEBUG:teuthology.orchestra.run.smithi121:> sudo systemctl stop ceph-b003123a-5db1-11ef-bccf-c7b262605968@osd.1 2024-08-18T22:59:25.083 INFO:journalctl@ceph.osd.1.smithi121.stdout:Aug 18 22:59:24 smithi121 systemd[1]: Stopping Ceph osd.1 for b003123a-5db1-11ef-bccf-c7b262605968... 2024-08-18T22:59:25.583 INFO:journalctl@ceph.osd.1.smithi121.stdout:Aug 18 22:59:25 smithi121 ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-1[94584]: 2024-08-18T22:59:25.199+0000 7f80077e1640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-18T22:59:25.583 INFO:journalctl@ceph.osd.1.smithi121.stdout:Aug 18 22:59:25 smithi121 ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-1[94584]: 2024-08-18T22:59:25.199+0000 7f80077e1640 -1 osd.1 84 *** Got signal Terminated *** 2024-08-18T22:59:25.583 INFO:journalctl@ceph.osd.1.smithi121.stdout:Aug 18 22:59:25 smithi121 ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-1[94584]: 2024-08-18T22:59:25.199+0000 7f80077e1640 -1 osd.1 84 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-08-18T22:59:31.017 INFO:journalctl@ceph.osd.1.smithi121.stdout:Aug 18 22:59:30 smithi121 podman[140211]: 2024-08-18 22:59:30.74255439 +0000 UTC m=+5.648971859 container died 0f9e03de53827aa3ba70e71ce1bad36fb0f976881abf54494db9d8e5dde715be (image=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-1, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, RELEASE=squid-de09dd0, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, io.buildah.version=1.36.0, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, GIT_CLEAN=True, ceph=True) 2024-08-18T22:59:31.333 INFO:journalctl@ceph.osd.1.smithi121.stdout:Aug 18 22:59:31 smithi121 podman[140211]: 2024-08-18 22:59:31.08182751 +0000 UTC m=+5.988244978 container cleanup 0f9e03de53827aa3ba70e71ce1bad36fb0f976881abf54494db9d8e5dde715be (image=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-1, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-de09dd0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, ceph=True, io.buildah.version=1.36.0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-08-18T22:59:31.334 INFO:journalctl@ceph.osd.1.smithi121.stdout:Aug 18 22:59:31 smithi121 bash[140211]: ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-1 2024-08-18T22:59:31.334 INFO:journalctl@ceph.osd.1.smithi121.stdout:Aug 18 22:59:31 smithi121 podman[140227]: 2024-08-18 22:59:31.258125196 +0000 UTC m=+0.514487362 container remove 0f9e03de53827aa3ba70e71ce1bad36fb0f976881abf54494db9d8e5dde715be (image=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-1, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-de09dd0, io.buildah.version=1.36.0, org.label-schema.license=GPLv2, ceph=True, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD) 2024-08-18T22:59:32.020 INFO:journalctl@ceph.osd.1.smithi121.stdout:Aug 18 22:59:31 smithi121 podman[140318]: 2024-08-18 22:59:31.709074483 +0000 UTC m=+0.112853213 container create cc0ed5c6cdb9c8a439965a3cfee655583ed15f8ced085ca38236379867f45689 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-1-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_CLEAN=True, ceph=True, CEPH_POINT_RELEASE=, RELEASE=squid-de09dd0, org.label-schema.build-date=20240731, io.buildah.version=1.36.0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux ) 2024-08-18T22:59:32.020 INFO:journalctl@ceph.osd.1.smithi121.stdout:Aug 18 22:59:31 smithi121 podman[140318]: 2024-08-18 22:59:31.614010809 +0000 UTC m=+0.017789554 image pull ea7a5189f30bad3aca9524788e2965d2368d7ce786df09d4edcd8c3edf9cefba quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9 2024-08-18T22:59:32.021 INFO:journalctl@ceph.osd.1.smithi121.stdout:Aug 18 22:59:31 smithi121 podman[140318]: 2024-08-18 22:59:31.945266689 +0000 UTC m=+0.349045432 container init cc0ed5c6cdb9c8a439965a3cfee655583ed15f8ced085ca38236379867f45689 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-1-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-de09dd0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.36.0, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2) 2024-08-18T22:59:32.021 INFO:journalctl@ceph.osd.1.smithi121.stdout:Aug 18 22:59:31 smithi121 podman[140318]: 2024-08-18 22:59:31.94892664 +0000 UTC m=+0.352705379 container start cc0ed5c6cdb9c8a439965a3cfee655583ed15f8ced085ca38236379867f45689 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-1-deactivate, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.36.0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, ceph=True, RELEASE=squid-de09dd0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image) 2024-08-18T22:59:32.021 INFO:journalctl@ceph.osd.1.smithi121.stdout:Aug 18 22:59:32 smithi121 podman[140318]: 2024-08-18 22:59:32.020059601 +0000 UTC m=+0.423838344 container attach cc0ed5c6cdb9c8a439965a3cfee655583ed15f8ced085ca38236379867f45689 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-1-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, RELEASE=squid-de09dd0, io.buildah.version=1.36.0, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD) 2024-08-18T22:59:32.315 INFO:journalctl@ceph.osd.1.smithi121.stdout:Aug 18 22:59:32 smithi121 podman[140318]: 2024-08-18 22:59:32.135052468 +0000 UTC m=+0.538831199 container died cc0ed5c6cdb9c8a439965a3cfee655583ed15f8ced085ca38236379867f45689 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-1-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, io.buildah.version=1.36.0, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, RELEASE=squid-de09dd0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True) 2024-08-18T22:59:32.704 DEBUG:teuthology.orchestra.run.smithi121:> sudo pkill -f 'journalctl -f -n 0 -u ceph-b003123a-5db1-11ef-bccf-c7b262605968@osd.1.service' 2024-08-18T22:59:32.746 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-18T22:59:32.746 INFO:tasks.cephadm.osd.1:Stopped osd.1 2024-08-18T22:59:32.746 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2024-08-18T22:59:32.746 DEBUG:teuthology.orchestra.run.smithi121:> sudo systemctl stop ceph-b003123a-5db1-11ef-bccf-c7b262605968@osd.2 2024-08-18T22:59:33.083 INFO:journalctl@ceph.osd.2.smithi121.stdout:Aug 18 22:59:32 smithi121 systemd[1]: Stopping Ceph osd.2 for b003123a-5db1-11ef-bccf-c7b262605968... 2024-08-18T22:59:33.583 INFO:journalctl@ceph.osd.2.smithi121.stdout:Aug 18 22:59:33 smithi121 ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-2[100439]: 2024-08-18T22:59:33.085+0000 7fb144573640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-18T22:59:33.583 INFO:journalctl@ceph.osd.2.smithi121.stdout:Aug 18 22:59:33 smithi121 ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-2[100439]: 2024-08-18T22:59:33.085+0000 7fb144573640 -1 osd.2 84 *** Got signal Terminated *** 2024-08-18T22:59:33.583 INFO:journalctl@ceph.osd.2.smithi121.stdout:Aug 18 22:59:33 smithi121 ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-2[100439]: 2024-08-18T22:59:33.085+0000 7fb144573640 -1 osd.2 84 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-08-18T22:59:38.686 INFO:journalctl@ceph.osd.2.smithi121.stdout:Aug 18 22:59:38 smithi121 podman[140423]: 2024-08-18 22:59:38.421300678 +0000 UTC m=+5.446959569 container died 93270b5bed689073bfe28362e591881f556f2f2e8f46c60585fcc8c914152ded (image=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-2, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-de09dd0, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, io.buildah.version=1.36.0, org.label-schema.schema-version=1.0) 2024-08-18T22:59:39.083 INFO:journalctl@ceph.osd.2.smithi121.stdout:Aug 18 22:59:38 smithi121 podman[140423]: 2024-08-18 22:59:38.785059423 +0000 UTC m=+5.810718314 container cleanup 93270b5bed689073bfe28362e591881f556f2f2e8f46c60585fcc8c914152ded (image=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, RELEASE=squid-de09dd0, io.buildah.version=1.36.0, ceph=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS) 2024-08-18T22:59:39.083 INFO:journalctl@ceph.osd.2.smithi121.stdout:Aug 18 22:59:38 smithi121 bash[140423]: ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-2 2024-08-18T22:59:39.462 INFO:journalctl@ceph.osd.2.smithi121.stdout:Aug 18 22:59:39 smithi121 podman[140442]: 2024-08-18 22:59:39.119709024 +0000 UTC m=+0.688784095 container remove 93270b5bed689073bfe28362e591881f556f2f2e8f46c60585fcc8c914152ded (image=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-2, maintainer=Guillaume Abrioux , RELEASE=squid-de09dd0, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, io.buildah.version=1.36.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=) 2024-08-18T22:59:39.782 INFO:journalctl@ceph.osd.2.smithi121.stdout:Aug 18 22:59:39 smithi121 podman[140528]: 2024-08-18 22:59:39.46218829 +0000 UTC m=+0.111719141 container create 825f54a852a3e4860a62882c7d1cc7565416bfec9d54f375c4ad974271abbfc8 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-2-deactivate, GIT_CLEAN=True, RELEASE=squid-de09dd0, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, ceph=True, maintainer=Guillaume Abrioux , io.buildah.version=1.36.0, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2) 2024-08-18T22:59:39.782 INFO:journalctl@ceph.osd.2.smithi121.stdout:Aug 18 22:59:39 smithi121 podman[140528]: 2024-08-18 22:59:39.36823331 +0000 UTC m=+0.017764159 image pull ea7a5189f30bad3aca9524788e2965d2368d7ce786df09d4edcd8c3edf9cefba quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9 2024-08-18T22:59:39.782 INFO:journalctl@ceph.osd.2.smithi121.stdout:Aug 18 22:59:39 smithi121 podman[140528]: 2024-08-18 22:59:39.689647016 +0000 UTC m=+0.339177867 container init 825f54a852a3e4860a62882c7d1cc7565416bfec9d54f375c4ad974271abbfc8 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-2-deactivate, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.schema-version=1.0, io.buildah.version=1.36.0, RELEASE=squid-de09dd0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD) 2024-08-18T22:59:39.782 INFO:journalctl@ceph.osd.2.smithi121.stdout:Aug 18 22:59:39 smithi121 podman[140528]: 2024-08-18 22:59:39.692880755 +0000 UTC m=+0.342411606 container start 825f54a852a3e4860a62882c7d1cc7565416bfec9d54f375c4ad974271abbfc8 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-2-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, io.buildah.version=1.36.0, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, RELEASE=squid-de09dd0) 2024-08-18T22:59:40.083 INFO:journalctl@ceph.osd.2.smithi121.stdout:Aug 18 22:59:39 smithi121 podman[140528]: 2024-08-18 22:59:39.781375719 +0000 UTC m=+0.430906576 container attach 825f54a852a3e4860a62882c7d1cc7565416bfec9d54f375c4ad974271abbfc8 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-2-deactivate, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , RELEASE=squid-de09dd0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.36.0) 2024-08-18T22:59:40.083 INFO:journalctl@ceph.osd.2.smithi121.stdout:Aug 18 22:59:39 smithi121 podman[140528]: 2024-08-18 22:59:39.878062536 +0000 UTC m=+0.527593381 container died 825f54a852a3e4860a62882c7d1cc7565416bfec9d54f375c4ad974271abbfc8 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-2-deactivate, io.buildah.version=1.36.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-de09dd0, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0) 2024-08-18T22:59:40.415 DEBUG:teuthology.orchestra.run.smithi121:> sudo pkill -f 'journalctl -f -n 0 -u ceph-b003123a-5db1-11ef-bccf-c7b262605968@osd.2.service' 2024-08-18T22:59:40.439 INFO:journalctl@ceph.osd.2.smithi121.stdout:Aug 18 22:59:40 smithi121 podman[140551]: 2024-08-18 22:59:40.393367253 +0000 UTC m=+0.507117687 container remove 825f54a852a3e4860a62882c7d1cc7565416bfec9d54f375c4ad974271abbfc8 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-2-deactivate, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, io.buildah.version=1.36.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , RELEASE=squid-de09dd0, ceph=True, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_BRANCH=HEAD) 2024-08-18T22:59:40.439 INFO:journalctl@ceph.osd.2.smithi121.stdout:Aug 18 22:59:40 smithi121 systemd[1]: ceph-b003123a-5db1-11ef-bccf-c7b262605968@osd.2.service: Deactivated successfully. 2024-08-18T22:59:40.439 INFO:journalctl@ceph.osd.2.smithi121.stdout:Aug 18 22:59:40 smithi121 systemd[1]: Stopped Ceph osd.2 for b003123a-5db1-11ef-bccf-c7b262605968. 2024-08-18T22:59:40.439 INFO:journalctl@ceph.osd.2.smithi121.stdout:Aug 18 22:59:40 smithi121 systemd[1]: ceph-b003123a-5db1-11ef-bccf-c7b262605968@osd.2.service: Consumed 19.302s CPU time. 2024-08-18T22:59:40.455 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-18T22:59:40.455 INFO:tasks.cephadm.osd.2:Stopped osd.2 2024-08-18T22:59:40.455 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2024-08-18T22:59:40.455 DEBUG:teuthology.orchestra.run.smithi195:> sudo systemctl stop ceph-b003123a-5db1-11ef-bccf-c7b262605968@osd.3 2024-08-18T22:59:40.761 INFO:journalctl@ceph.osd.3.smithi195.stdout:Aug 18 22:59:40 smithi195 systemd[1]: Stopping Ceph osd.3 for b003123a-5db1-11ef-bccf-c7b262605968... 2024-08-18T22:59:41.017 INFO:journalctl@ceph.osd.3.smithi195.stdout:Aug 18 22:59:40 smithi195 ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-3[77949]: 2024-08-18T22:59:40.760+0000 7f77e13ce640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-18T22:59:41.017 INFO:journalctl@ceph.osd.3.smithi195.stdout:Aug 18 22:59:40 smithi195 ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-3[77949]: 2024-08-18T22:59:40.760+0000 7f77e13ce640 -1 osd.3 84 *** Got signal Terminated *** 2024-08-18T22:59:41.017 INFO:journalctl@ceph.osd.3.smithi195.stdout:Aug 18 22:59:40 smithi195 ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-3[77949]: 2024-08-18T22:59:40.760+0000 7f77e13ce640 -1 osd.3 84 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-08-18T22:59:44.909 INFO:journalctl@ceph.osd.5.smithi195.stdout:Aug 18 22:59:44 smithi195 ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-5[88441]: 2024-08-18T22:59:44.512+0000 7f4112506640 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.121:6806 osd.0 since back 2024-08-18T22:59:17.933867+0000 front 2024-08-18T22:59:17.933758+0000 (oldest deadline 2024-08-18T22:59:43.833572+0000) 2024-08-18T22:59:44.909 INFO:journalctl@ceph.osd.4.smithi195.stdout:Aug 18 22:59:44 smithi195 ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-4[83189]: 2024-08-18T22:59:44.619+0000 7f3ca73a3640 -1 osd.4 84 heartbeat_check: no reply from 172.21.15.121:6806 osd.0 since back 2024-08-18T22:59:19.188008+0000 front 2024-08-18T22:59:19.188088+0000 (oldest deadline 2024-08-18T22:59:44.487939+0000) 2024-08-18T22:59:45.909 INFO:journalctl@ceph.osd.4.smithi195.stdout:Aug 18 22:59:45 smithi195 ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-4[83189]: 2024-08-18T22:59:45.662+0000 7f3ca73a3640 -1 osd.4 84 heartbeat_check: no reply from 172.21.15.121:6806 osd.0 since back 2024-08-18T22:59:19.188008+0000 front 2024-08-18T22:59:19.188088+0000 (oldest deadline 2024-08-18T22:59:44.487939+0000) 2024-08-18T22:59:45.909 INFO:journalctl@ceph.osd.5.smithi195.stdout:Aug 18 22:59:45 smithi195 ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-5[88441]: 2024-08-18T22:59:45.499+0000 7f4112506640 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.121:6806 osd.0 since back 2024-08-18T22:59:17.933867+0000 front 2024-08-18T22:59:17.933758+0000 (oldest deadline 2024-08-18T22:59:43.833572+0000) 2024-08-18T22:59:46.445 INFO:journalctl@ceph.osd.3.smithi195.stdout:Aug 18 22:59:46 smithi195 podman[106077]: 2024-08-18 22:59:46.168439695 +0000 UTC m=+5.507678857 container died 72c2860c0e9f84f06c39629eeb7b304d2170938fdc53a044b43dbb7b3ba20f4c (image=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-3, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=squid-de09dd0, io.buildah.version=1.36.0, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-08-18T22:59:46.710 INFO:journalctl@ceph.osd.5.smithi195.stdout:Aug 18 22:59:46 smithi195 ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-5[88441]: 2024-08-18T22:59:46.481+0000 7f4112506640 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.121:6806 osd.0 since back 2024-08-18T22:59:17.933867+0000 front 2024-08-18T22:59:17.933758+0000 (oldest deadline 2024-08-18T22:59:43.833572+0000) 2024-08-18T22:59:46.710 INFO:journalctl@ceph.osd.3.smithi195.stdout:Aug 18 22:59:46 smithi195 podman[106077]: 2024-08-18 22:59:46.519241909 +0000 UTC m=+5.858481116 container cleanup 72c2860c0e9f84f06c39629eeb7b304d2170938fdc53a044b43dbb7b3ba20f4c (image=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-3, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, io.buildah.version=1.36.0, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-de09dd0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD) 2024-08-18T22:59:46.710 INFO:journalctl@ceph.osd.3.smithi195.stdout:Aug 18 22:59:46 smithi195 bash[106077]: ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-3 2024-08-18T22:59:47.158 INFO:journalctl@ceph.osd.3.smithi195.stdout:Aug 18 22:59:46 smithi195 podman[106105]: 2024-08-18 22:59:46.729100792 +0000 UTC m=+0.555952088 container remove 72c2860c0e9f84f06c39629eeb7b304d2170938fdc53a044b43dbb7b3ba20f4c (image=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-3, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-de09dd0, org.label-schema.vendor=CentOS, ceph=True, io.buildah.version=1.36.0, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux ) 2024-08-18T22:59:47.158 INFO:journalctl@ceph.osd.4.smithi195.stdout:Aug 18 22:59:46 smithi195 ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-4[83189]: 2024-08-18T22:59:46.709+0000 7f3ca73a3640 -1 osd.4 84 heartbeat_check: no reply from 172.21.15.121:6806 osd.0 since back 2024-08-18T22:59:19.188008+0000 front 2024-08-18T22:59:19.188088+0000 (oldest deadline 2024-08-18T22:59:44.487939+0000) 2024-08-18T22:59:47.409 INFO:journalctl@ceph.osd.3.smithi195.stdout:Aug 18 22:59:47 smithi195 podman[106196]: 2024-08-18 22:59:47.060421279 +0000 UTC m=+0.017439473 image pull ea7a5189f30bad3aca9524788e2965d2368d7ce786df09d4edcd8c3edf9cefba quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9 2024-08-18T22:59:47.409 INFO:journalctl@ceph.osd.3.smithi195.stdout:Aug 18 22:59:47 smithi195 podman[106196]: 2024-08-18 22:59:47.163221434 +0000 UTC m=+0.120239631 container create 4b5b8aa2c2466589aaf6bd0a2f51dfd04b9f4ec77416aec13a5c689c001fdf3a (image=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-3-deactivate, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, RELEASE=squid-de09dd0, io.buildah.version=1.36.0, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-08-18T22:59:47.692 INFO:journalctl@ceph.osd.5.smithi195.stdout:Aug 18 22:59:47 smithi195 ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-5[88441]: 2024-08-18T22:59:47.466+0000 7f4112506640 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.121:6806 osd.0 since back 2024-08-18T22:59:17.933867+0000 front 2024-08-18T22:59:17.933758+0000 (oldest deadline 2024-08-18T22:59:43.833572+0000) 2024-08-18T22:59:47.692 INFO:journalctl@ceph.osd.3.smithi195.stdout:Aug 18 22:59:47 smithi195 podman[106196]: 2024-08-18 22:59:47.424302138 +0000 UTC m=+0.381320340 container init 4b5b8aa2c2466589aaf6bd0a2f51dfd04b9f4ec77416aec13a5c689c001fdf3a (image=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-3-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, ceph=True, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.36.0, org.label-schema.license=GPLv2, RELEASE=squid-de09dd0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, maintainer=Guillaume Abrioux ) 2024-08-18T22:59:47.693 INFO:journalctl@ceph.osd.3.smithi195.stdout:Aug 18 22:59:47 smithi195 podman[106196]: 2024-08-18 22:59:47.428021487 +0000 UTC m=+0.385039690 container start 4b5b8aa2c2466589aaf6bd0a2f51dfd04b9f4ec77416aec13a5c689c001fdf3a (image=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-3-deactivate, org.label-schema.vendor=CentOS, io.buildah.version=1.36.0, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-de09dd0, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-08-18T22:59:47.693 INFO:journalctl@ceph.osd.3.smithi195.stdout:Aug 18 22:59:47 smithi195 podman[106196]: 2024-08-18 22:59:47.499233273 +0000 UTC m=+0.456251482 container attach 4b5b8aa2c2466589aaf6bd0a2f51dfd04b9f4ec77416aec13a5c689c001fdf3a (image=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-3-deactivate, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-de09dd0, GIT_BRANCH=HEAD, io.buildah.version=1.36.0, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-08-18T22:59:47.693 INFO:journalctl@ceph.osd.3.smithi195.stdout:Aug 18 22:59:47 smithi195 podman[106196]: 2024-08-18 22:59:47.611541501 +0000 UTC m=+0.568559695 container died 4b5b8aa2c2466589aaf6bd0a2f51dfd04b9f4ec77416aec13a5c689c001fdf3a (image=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-3-deactivate, io.buildah.version=1.36.0, org.label-schema.build-date=20240731, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , RELEASE=squid-de09dd0, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True) 2024-08-18T22:59:48.159 INFO:journalctl@ceph.osd.4.smithi195.stdout:Aug 18 22:59:47 smithi195 ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-4[83189]: 2024-08-18T22:59:47.691+0000 7f3ca73a3640 -1 osd.4 84 heartbeat_check: no reply from 172.21.15.121:6806 osd.0 since back 2024-08-18T22:59:19.188008+0000 front 2024-08-18T22:59:19.188088+0000 (oldest deadline 2024-08-18T22:59:44.487939+0000) 2024-08-18T22:59:48.200 DEBUG:teuthology.orchestra.run.smithi195:> sudo pkill -f 'journalctl -f -n 0 -u ceph-b003123a-5db1-11ef-bccf-c7b262605968@osd.3.service' 2024-08-18T22:59:48.240 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-18T22:59:48.240 INFO:tasks.cephadm.osd.3:Stopped osd.3 2024-08-18T22:59:48.241 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2024-08-18T22:59:48.241 DEBUG:teuthology.orchestra.run.smithi195:> sudo systemctl stop ceph-b003123a-5db1-11ef-bccf-c7b262605968@osd.4 2024-08-18T22:59:48.483 INFO:journalctl@ceph.osd.4.smithi195.stdout:Aug 18 22:59:48 smithi195 systemd[1]: Stopping Ceph osd.4 for b003123a-5db1-11ef-bccf-c7b262605968... 2024-08-18T22:59:48.909 INFO:journalctl@ceph.osd.5.smithi195.stdout:Aug 18 22:59:48 smithi195 ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-5[88441]: 2024-08-18T22:59:48.482+0000 7f4112506640 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.121:6806 osd.0 since back 2024-08-18T22:59:17.933867+0000 front 2024-08-18T22:59:17.933758+0000 (oldest deadline 2024-08-18T22:59:43.833572+0000) 2024-08-18T22:59:48.909 INFO:journalctl@ceph.osd.4.smithi195.stdout:Aug 18 22:59:48 smithi195 ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-4[83189]: 2024-08-18T22:59:48.572+0000 7f3caa59d640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-18T22:59:48.909 INFO:journalctl@ceph.osd.4.smithi195.stdout:Aug 18 22:59:48 smithi195 ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-4[83189]: 2024-08-18T22:59:48.572+0000 7f3caa59d640 -1 osd.4 84 *** Got signal Terminated *** 2024-08-18T22:59:48.909 INFO:journalctl@ceph.osd.4.smithi195.stdout:Aug 18 22:59:48 smithi195 ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-4[83189]: 2024-08-18T22:59:48.572+0000 7f3caa59d640 -1 osd.4 84 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-08-18T22:59:48.909 INFO:journalctl@ceph.osd.4.smithi195.stdout:Aug 18 22:59:48 smithi195 ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-4[83189]: 2024-08-18T22:59:48.702+0000 7f3ca73a3640 -1 osd.4 84 heartbeat_check: no reply from 172.21.15.121:6806 osd.0 since back 2024-08-18T22:59:19.188008+0000 front 2024-08-18T22:59:19.188088+0000 (oldest deadline 2024-08-18T22:59:44.487939+0000) 2024-08-18T22:59:49.909 INFO:journalctl@ceph.osd.4.smithi195.stdout:Aug 18 22:59:49 smithi195 ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-4[83189]: 2024-08-18T22:59:49.670+0000 7f3ca73a3640 -1 osd.4 84 heartbeat_check: no reply from 172.21.15.121:6806 osd.0 since back 2024-08-18T22:59:19.188008+0000 front 2024-08-18T22:59:19.188088+0000 (oldest deadline 2024-08-18T22:59:44.487939+0000) 2024-08-18T22:59:49.909 INFO:journalctl@ceph.osd.5.smithi195.stdout:Aug 18 22:59:49 smithi195 ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-5[88441]: 2024-08-18T22:59:49.480+0000 7f4112506640 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.121:6806 osd.0 since back 2024-08-18T22:59:17.933867+0000 front 2024-08-18T22:59:17.933758+0000 (oldest deadline 2024-08-18T22:59:43.833572+0000) 2024-08-18T22:59:50.909 INFO:journalctl@ceph.osd.4.smithi195.stdout:Aug 18 22:59:50 smithi195 ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-4[83189]: 2024-08-18T22:59:50.703+0000 7f3ca73a3640 -1 osd.4 84 heartbeat_check: no reply from 172.21.15.121:6806 osd.0 since back 2024-08-18T22:59:19.188008+0000 front 2024-08-18T22:59:19.188088+0000 (oldest deadline 2024-08-18T22:59:44.487939+0000) 2024-08-18T22:59:50.909 INFO:journalctl@ceph.osd.5.smithi195.stdout:Aug 18 22:59:50 smithi195 ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-5[88441]: 2024-08-18T22:59:50.511+0000 7f4112506640 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.121:6806 osd.0 since back 2024-08-18T22:59:17.933867+0000 front 2024-08-18T22:59:17.933758+0000 (oldest deadline 2024-08-18T22:59:43.833572+0000) 2024-08-18T22:59:51.909 INFO:journalctl@ceph.osd.4.smithi195.stdout:Aug 18 22:59:51 smithi195 ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-4[83189]: 2024-08-18T22:59:51.669+0000 7f3ca73a3640 -1 osd.4 84 heartbeat_check: no reply from 172.21.15.121:6806 osd.0 since back 2024-08-18T22:59:19.188008+0000 front 2024-08-18T22:59:19.188088+0000 (oldest deadline 2024-08-18T22:59:44.487939+0000) 2024-08-18T22:59:51.909 INFO:journalctl@ceph.osd.5.smithi195.stdout:Aug 18 22:59:51 smithi195 ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-5[88441]: 2024-08-18T22:59:51.523+0000 7f4112506640 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.121:6806 osd.0 since back 2024-08-18T22:59:17.933867+0000 front 2024-08-18T22:59:17.933758+0000 (oldest deadline 2024-08-18T22:59:43.833572+0000) 2024-08-18T22:59:52.909 INFO:journalctl@ceph.osd.4.smithi195.stdout:Aug 18 22:59:52 smithi195 ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-4[83189]: 2024-08-18T22:59:52.699+0000 7f3ca73a3640 -1 osd.4 84 heartbeat_check: no reply from 172.21.15.121:6806 osd.0 since back 2024-08-18T22:59:19.188008+0000 front 2024-08-18T22:59:19.188088+0000 (oldest deadline 2024-08-18T22:59:44.487939+0000) 2024-08-18T22:59:52.909 INFO:journalctl@ceph.osd.4.smithi195.stdout:Aug 18 22:59:52 smithi195 ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-4[83189]: 2024-08-18T22:59:52.699+0000 7f3ca73a3640 -1 osd.4 84 heartbeat_check: no reply from 172.21.15.121:6814 osd.1 since back 2024-08-18T22:59:25.588851+0000 front 2024-08-18T22:59:25.588953+0000 (oldest deadline 2024-08-18T22:59:51.989189+0000) 2024-08-18T22:59:52.909 INFO:journalctl@ceph.osd.5.smithi195.stdout:Aug 18 22:59:52 smithi195 ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-5[88441]: 2024-08-18T22:59:52.499+0000 7f4112506640 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.121:6806 osd.0 since back 2024-08-18T22:59:17.933867+0000 front 2024-08-18T22:59:17.933758+0000 (oldest deadline 2024-08-18T22:59:43.833572+0000) 2024-08-18T22:59:52.909 INFO:journalctl@ceph.osd.5.smithi195.stdout:Aug 18 22:59:52 smithi195 ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-5[88441]: 2024-08-18T22:59:52.499+0000 7f4112506640 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.121:6814 osd.1 since back 2024-08-18T22:59:27.334637+0000 front 2024-08-18T22:59:27.334623+0000 (oldest deadline 2024-08-18T22:59:52.034394+0000) 2024-08-18T22:59:53.909 INFO:journalctl@ceph.osd.5.smithi195.stdout:Aug 18 22:59:53 smithi195 ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-5[88441]: 2024-08-18T22:59:53.527+0000 7f4112506640 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.121:6806 osd.0 since back 2024-08-18T22:59:17.933867+0000 front 2024-08-18T22:59:17.933758+0000 (oldest deadline 2024-08-18T22:59:43.833572+0000) 2024-08-18T22:59:53.909 INFO:journalctl@ceph.osd.5.smithi195.stdout:Aug 18 22:59:53 smithi195 ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-5[88441]: 2024-08-18T22:59:53.527+0000 7f4112506640 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.121:6814 osd.1 since back 2024-08-18T22:59:27.334637+0000 front 2024-08-18T22:59:27.334623+0000 (oldest deadline 2024-08-18T22:59:52.034394+0000) 2024-08-18T22:59:54.283 INFO:journalctl@ceph.osd.4.smithi195.stdout:Aug 18 22:59:53 smithi195 podman[106298]: 2024-08-18 22:59:53.973453605 +0000 UTC m=+5.502472963 container stop d88a83c9724731b5dc60aa4b46cc9bea6fafc35f907ed8bf04d380ad8b040bf3 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-4, io.buildah.version=1.36.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, RELEASE=squid-de09dd0, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-08-18T22:59:54.283 INFO:journalctl@ceph.osd.4.smithi195.stdout:Aug 18 22:59:53 smithi195 podman[106298]: 2024-08-18 22:59:53.999207781 +0000 UTC m=+5.528227140 container died d88a83c9724731b5dc60aa4b46cc9bea6fafc35f907ed8bf04d380ad8b040bf3 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-4, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.36.0, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , ceph=True, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, RELEASE=squid-de09dd0) 2024-08-18T22:59:54.542 INFO:journalctl@ceph.osd.4.smithi195.stdout:Aug 18 22:59:54 smithi195 podman[106298]: 2024-08-18 22:59:54.374030026 +0000 UTC m=+5.903049383 container cleanup d88a83c9724731b5dc60aa4b46cc9bea6fafc35f907ed8bf04d380ad8b040bf3 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-4, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.36.0, RELEASE=squid-de09dd0, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.build-date=20240731, GIT_CLEAN=True) 2024-08-18T22:59:54.542 INFO:journalctl@ceph.osd.4.smithi195.stdout:Aug 18 22:59:54 smithi195 bash[106298]: ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-4 2024-08-18T22:59:54.542 INFO:journalctl@ceph.osd.5.smithi195.stdout:Aug 18 22:59:54 smithi195 ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-5[88441]: 2024-08-18T22:59:54.485+0000 7f4112506640 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.121:6806 osd.0 since back 2024-08-18T22:59:17.933867+0000 front 2024-08-18T22:59:17.933758+0000 (oldest deadline 2024-08-18T22:59:43.833572+0000) 2024-08-18T22:59:54.542 INFO:journalctl@ceph.osd.5.smithi195.stdout:Aug 18 22:59:54 smithi195 ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-5[88441]: 2024-08-18T22:59:54.485+0000 7f4112506640 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.121:6814 osd.1 since back 2024-08-18T22:59:27.334637+0000 front 2024-08-18T22:59:27.334623+0000 (oldest deadline 2024-08-18T22:59:52.034394+0000) 2024-08-18T22:59:54.908 INFO:journalctl@ceph.osd.4.smithi195.stdout:Aug 18 22:59:54 smithi195 podman[106312]: 2024-08-18 22:59:54.541820676 +0000 UTC m=+0.560520316 container remove d88a83c9724731b5dc60aa4b46cc9bea6fafc35f907ed8bf04d380ad8b040bf3 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-4, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, ceph=True, maintainer=Guillaume Abrioux , RELEASE=squid-de09dd0, io.buildah.version=1.36.0, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-08-18T22:59:55.262 INFO:journalctl@ceph.osd.4.smithi195.stdout:Aug 18 22:59:54 smithi195 podman[106404]: 2024-08-18 22:59:54.951221068 +0000 UTC m=+0.107959351 container create 7e3da3797c875162f9875d5883c159a9fafe3a7d637faee00b350428c2d76d38 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-4-deactivate, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, ceph=True, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.36.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, RELEASE=squid-de09dd0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-08-18T22:59:55.262 INFO:journalctl@ceph.osd.4.smithi195.stdout:Aug 18 22:59:54 smithi195 podman[106404]: 2024-08-18 22:59:54.860257026 +0000 UTC m=+0.016995309 image pull ea7a5189f30bad3aca9524788e2965d2368d7ce786df09d4edcd8c3edf9cefba quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9 2024-08-18T22:59:55.262 INFO:journalctl@ceph.osd.4.smithi195.stdout:Aug 18 22:59:55 smithi195 podman[106404]: 2024-08-18 22:59:55.17060556 +0000 UTC m=+0.327343850 container init 7e3da3797c875162f9875d5883c159a9fafe3a7d637faee00b350428c2d76d38 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-4-deactivate, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, io.buildah.version=1.36.0, org.label-schema.schema-version=1.0, RELEASE=squid-de09dd0, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_CLEAN=True) 2024-08-18T22:59:55.262 INFO:journalctl@ceph.osd.4.smithi195.stdout:Aug 18 22:59:55 smithi195 podman[106404]: 2024-08-18 22:59:55.174052022 +0000 UTC m=+0.330790310 container start 7e3da3797c875162f9875d5883c159a9fafe3a7d637faee00b350428c2d76d38 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-4-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, io.buildah.version=1.36.0, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-de09dd0, ceph=True, maintainer=Guillaume Abrioux ) 2024-08-18T22:59:55.262 INFO:journalctl@ceph.osd.4.smithi195.stdout:Aug 18 22:59:55 smithi195 podman[106404]: 2024-08-18 22:59:55.261913127 +0000 UTC m=+0.418651414 container attach 7e3da3797c875162f9875d5883c159a9fafe3a7d637faee00b350428c2d76d38 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-4-deactivate, org.label-schema.license=GPLv2, io.buildah.version=1.36.0, org.label-schema.schema-version=1.0, RELEASE=squid-de09dd0, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux ) 2024-08-18T22:59:55.536 INFO:journalctl@ceph.osd.4.smithi195.stdout:Aug 18 22:59:55 smithi195 podman[106404]: 2024-08-18 22:59:55.369725079 +0000 UTC m=+0.526463371 container died 7e3da3797c875162f9875d5883c159a9fafe3a7d637faee00b350428c2d76d38 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-4-deactivate, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.36.0, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, RELEASE=squid-de09dd0, ceph=True, org.label-schema.schema-version=1.0, GIT_CLEAN=True) 2024-08-18T22:59:55.909 INFO:journalctl@ceph.osd.5.smithi195.stdout:Aug 18 22:59:55 smithi195 ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-5[88441]: 2024-08-18T22:59:55.535+0000 7f4112506640 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.121:6806 osd.0 since back 2024-08-18T22:59:17.933867+0000 front 2024-08-18T22:59:17.933758+0000 (oldest deadline 2024-08-18T22:59:43.833572+0000) 2024-08-18T22:59:55.909 INFO:journalctl@ceph.osd.5.smithi195.stdout:Aug 18 22:59:55 smithi195 ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-5[88441]: 2024-08-18T22:59:55.535+0000 7f4112506640 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.121:6814 osd.1 since back 2024-08-18T22:59:27.334637+0000 front 2024-08-18T22:59:27.334623+0000 (oldest deadline 2024-08-18T22:59:52.034394+0000) 2024-08-18T22:59:56.025 DEBUG:teuthology.orchestra.run.smithi195:> sudo pkill -f 'journalctl -f -n 0 -u ceph-b003123a-5db1-11ef-bccf-c7b262605968@osd.4.service' 2024-08-18T22:59:56.064 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-18T22:59:56.064 INFO:tasks.cephadm.osd.4:Stopped osd.4 2024-08-18T22:59:56.064 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2024-08-18T22:59:56.064 DEBUG:teuthology.orchestra.run.smithi195:> sudo systemctl stop ceph-b003123a-5db1-11ef-bccf-c7b262605968@osd.5 2024-08-18T22:59:56.395 INFO:journalctl@ceph.osd.5.smithi195.stdout:Aug 18 22:59:56 smithi195 systemd[1]: Stopping Ceph osd.5 for b003123a-5db1-11ef-bccf-c7b262605968... 2024-08-18T22:59:56.395 INFO:journalctl@ceph.osd.5.smithi195.stdout:Aug 18 22:59:56 smithi195 ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-5[88441]: 2024-08-18T22:59:56.393+0000 7f4115700640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-18T22:59:56.395 INFO:journalctl@ceph.osd.5.smithi195.stdout:Aug 18 22:59:56 smithi195 ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-5[88441]: 2024-08-18T22:59:56.393+0000 7f4115700640 -1 osd.5 84 *** Got signal Terminated *** 2024-08-18T22:59:56.396 INFO:journalctl@ceph.osd.5.smithi195.stdout:Aug 18 22:59:56 smithi195 ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-5[88441]: 2024-08-18T22:59:56.393+0000 7f4115700640 -1 osd.5 84 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-08-18T22:59:56.659 INFO:journalctl@ceph.osd.5.smithi195.stdout:Aug 18 22:59:56 smithi195 ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-5[88441]: 2024-08-18T22:59:56.532+0000 7f4112506640 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.121:6806 osd.0 since back 2024-08-18T22:59:17.933867+0000 front 2024-08-18T22:59:17.933758+0000 (oldest deadline 2024-08-18T22:59:43.833572+0000) 2024-08-18T22:59:56.659 INFO:journalctl@ceph.osd.5.smithi195.stdout:Aug 18 22:59:56 smithi195 ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-5[88441]: 2024-08-18T22:59:56.532+0000 7f4112506640 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.121:6814 osd.1 since back 2024-08-18T22:59:27.334637+0000 front 2024-08-18T22:59:27.334623+0000 (oldest deadline 2024-08-18T22:59:52.034394+0000) 2024-08-18T22:59:57.909 INFO:journalctl@ceph.osd.5.smithi195.stdout:Aug 18 22:59:57 smithi195 ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-5[88441]: 2024-08-18T22:59:57.487+0000 7f4112506640 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.121:6806 osd.0 since back 2024-08-18T22:59:17.933867+0000 front 2024-08-18T22:59:17.933758+0000 (oldest deadline 2024-08-18T22:59:43.833572+0000) 2024-08-18T22:59:57.909 INFO:journalctl@ceph.osd.5.smithi195.stdout:Aug 18 22:59:57 smithi195 ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-5[88441]: 2024-08-18T22:59:57.487+0000 7f4112506640 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.121:6814 osd.1 since back 2024-08-18T22:59:27.334637+0000 front 2024-08-18T22:59:27.334623+0000 (oldest deadline 2024-08-18T22:59:52.034394+0000) 2024-08-18T22:59:58.659 INFO:journalctl@ceph.osd.5.smithi195.stdout:Aug 18 22:59:58 smithi195 ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-5[88441]: 2024-08-18T22:59:58.486+0000 7f4112506640 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.121:6806 osd.0 since back 2024-08-18T22:59:17.933867+0000 front 2024-08-18T22:59:17.933758+0000 (oldest deadline 2024-08-18T22:59:43.833572+0000) 2024-08-18T22:59:58.659 INFO:journalctl@ceph.osd.5.smithi195.stdout:Aug 18 22:59:58 smithi195 ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-5[88441]: 2024-08-18T22:59:58.486+0000 7f4112506640 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.121:6814 osd.1 since back 2024-08-18T22:59:27.334637+0000 front 2024-08-18T22:59:27.334623+0000 (oldest deadline 2024-08-18T22:59:52.034394+0000) 2024-08-18T22:59:59.908 INFO:journalctl@ceph.osd.5.smithi195.stdout:Aug 18 22:59:59 smithi195 ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-5[88441]: 2024-08-18T22:59:59.524+0000 7f4112506640 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.121:6806 osd.0 since back 2024-08-18T22:59:17.933867+0000 front 2024-08-18T22:59:17.933758+0000 (oldest deadline 2024-08-18T22:59:43.833572+0000) 2024-08-18T22:59:59.909 INFO:journalctl@ceph.osd.5.smithi195.stdout:Aug 18 22:59:59 smithi195 ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-5[88441]: 2024-08-18T22:59:59.524+0000 7f4112506640 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.121:6814 osd.1 since back 2024-08-18T22:59:27.334637+0000 front 2024-08-18T22:59:27.334623+0000 (oldest deadline 2024-08-18T22:59:52.034394+0000) 2024-08-18T22:59:59.909 INFO:journalctl@ceph.osd.5.smithi195.stdout:Aug 18 22:59:59 smithi195 ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-5[88441]: 2024-08-18T22:59:59.524+0000 7f4112506640 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.121:6822 osd.2 since back 2024-08-18T22:59:37.736095+0000 front 2024-08-18T22:59:37.736043+0000 (oldest deadline 2024-08-18T22:59:59.435939+0000) 2024-08-18T23:00:00.909 INFO:journalctl@ceph.osd.5.smithi195.stdout:Aug 18 23:00:00 smithi195 ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-5[88441]: 2024-08-18T23:00:00.557+0000 7f4112506640 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.121:6806 osd.0 since back 2024-08-18T22:59:17.933867+0000 front 2024-08-18T22:59:17.933758+0000 (oldest deadline 2024-08-18T22:59:43.833572+0000) 2024-08-18T23:00:00.909 INFO:journalctl@ceph.osd.5.smithi195.stdout:Aug 18 23:00:00 smithi195 ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-5[88441]: 2024-08-18T23:00:00.557+0000 7f4112506640 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.121:6814 osd.1 since back 2024-08-18T22:59:27.334637+0000 front 2024-08-18T22:59:27.334623+0000 (oldest deadline 2024-08-18T22:59:52.034394+0000) 2024-08-18T23:00:00.909 INFO:journalctl@ceph.osd.5.smithi195.stdout:Aug 18 23:00:00 smithi195 ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-5[88441]: 2024-08-18T23:00:00.557+0000 7f4112506640 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.121:6822 osd.2 since back 2024-08-18T22:59:37.736095+0000 front 2024-08-18T22:59:37.736043+0000 (oldest deadline 2024-08-18T22:59:59.435939+0000) 2024-08-18T23:00:02.127 INFO:journalctl@ceph.osd.5.smithi195.stdout:Aug 18 23:00:01 smithi195 podman[106507]: 2024-08-18 23:00:01.787412826 +0000 UTC m=+5.497547050 container died 5af2d6de9afecf8db3ca644c53ec70f5a0dd06cc0dcb54ae9dcdd3a69bb855ee (image=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-5, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, ceph=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.vendor=CentOS, RELEASE=squid-de09dd0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.36.0, org.label-schema.license=GPLv2) 2024-08-18T23:00:02.127 INFO:journalctl@ceph.osd.5.smithi195.stdout:Aug 18 23:00:02 smithi195 podman[106507]: 2024-08-18 23:00:02.126840288 +0000 UTC m=+5.836974510 container cleanup 5af2d6de9afecf8db3ca644c53ec70f5a0dd06cc0dcb54ae9dcdd3a69bb855ee (image=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-5, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, io.buildah.version=1.36.0, org.label-schema.build-date=20240731, ceph=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, RELEASE=squid-de09dd0, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-08-18T23:00:02.409 INFO:journalctl@ceph.osd.5.smithi195.stdout:Aug 18 23:00:02 smithi195 bash[106507]: ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-5 2024-08-18T23:00:02.409 INFO:journalctl@ceph.osd.5.smithi195.stdout:Aug 18 23:00:02 smithi195 podman[106526]: 2024-08-18 23:00:02.285885983 +0000 UTC m=+0.495486561 container remove 5af2d6de9afecf8db3ca644c53ec70f5a0dd06cc0dcb54ae9dcdd3a69bb855ee (image=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-5, RELEASE=squid-de09dd0, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.36.0, ceph=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731) 2024-08-18T23:00:03.014 INFO:journalctl@ceph.osd.5.smithi195.stdout:Aug 18 23:00:02 smithi195 podman[106612]: 2024-08-18 23:00:02.609365044 +0000 UTC m=+0.017244048 image pull ea7a5189f30bad3aca9524788e2965d2368d7ce786df09d4edcd8c3edf9cefba quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9 2024-08-18T23:00:03.014 INFO:journalctl@ceph.osd.5.smithi195.stdout:Aug 18 23:00:02 smithi195 podman[106612]: 2024-08-18 23:00:02.720375527 +0000 UTC m=+0.128254517 container create d201803f5c138ac0ae1bad2c3099b43fd6163b28fc9ec7c242894a444664bf29 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-5-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_CLEAN=True, io.buildah.version=1.36.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-de09dd0, ceph=True) 2024-08-18T23:00:03.015 INFO:journalctl@ceph.osd.5.smithi195.stdout:Aug 18 23:00:02 smithi195 podman[106612]: 2024-08-18 23:00:02.939492266 +0000 UTC m=+0.347371256 container init d201803f5c138ac0ae1bad2c3099b43fd6163b28fc9ec7c242894a444664bf29 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-5-deactivate, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, io.buildah.version=1.36.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, RELEASE=squid-de09dd0, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-08-18T23:00:03.015 INFO:journalctl@ceph.osd.5.smithi195.stdout:Aug 18 23:00:02 smithi195 podman[106612]: 2024-08-18 23:00:02.94279798 +0000 UTC m=+0.350676975 container start d201803f5c138ac0ae1bad2c3099b43fd6163b28fc9ec7c242894a444664bf29 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-5-deactivate, org.label-schema.build-date=20240731, io.buildah.version=1.36.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, RELEASE=squid-de09dd0, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-08-18T23:00:03.015 INFO:journalctl@ceph.osd.5.smithi195.stdout:Aug 18 23:00:03 smithi195 podman[106612]: 2024-08-18 23:00:03.014202499 +0000 UTC m=+0.422081491 container attach d201803f5c138ac0ae1bad2c3099b43fd6163b28fc9ec7c242894a444664bf29 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-5-deactivate, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.license=GPLv2, io.buildah.version=1.36.0, RELEASE=squid-de09dd0) 2024-08-18T23:00:03.409 INFO:journalctl@ceph.osd.5.smithi195.stdout:Aug 18 23:00:03 smithi195 podman[106612]: 2024-08-18 23:00:03.12897809 +0000 UTC m=+0.536857090 container died d201803f5c138ac0ae1bad2c3099b43fd6163b28fc9ec7c242894a444664bf29 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-5-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, ceph=True, io.buildah.version=1.36.0, org.label-schema.vendor=CentOS, RELEASE=squid-de09dd0, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-08-18T23:00:03.670 INFO:journalctl@ceph.osd.5.smithi195.stdout:Aug 18 23:00:03 smithi195 podman[106635]: 2024-08-18 23:00:03.667575135 +0000 UTC m=+0.528307563 container remove d201803f5c138ac0ae1bad2c3099b43fd6163b28fc9ec7c242894a444664bf29 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-b003123a-5db1-11ef-bccf-c7b262605968-osd-5-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, RELEASE=squid-de09dd0, ceph=True, org.label-schema.license=GPLv2, io.buildah.version=1.36.0, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.vendor=CentOS) 2024-08-18T23:00:03.685 DEBUG:teuthology.orchestra.run.smithi195:> sudo pkill -f 'journalctl -f -n 0 -u ceph-b003123a-5db1-11ef-bccf-c7b262605968@osd.5.service' 2024-08-18T23:00:03.724 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-18T23:00:03.724 INFO:tasks.cephadm.osd.5:Stopped osd.5 2024-08-18T23:00:03.724 DEBUG:teuthology.orchestra.run.smithi121:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid b003123a-5db1-11ef-bccf-c7b262605968 --force --keep-logs 2024-08-18T23:00:07.012 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi121.stderr:ceph-fuse[64378]: fuse finished with error 0 and tester_r 0 2024-08-18T23:00:24.901 DEBUG:teuthology.orchestra.run.smithi195:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid b003123a-5db1-11ef-bccf-c7b262605968 --force --keep-logs 2024-08-18T23:00:39.995 DEBUG:teuthology.orchestra.run.smithi121:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-08-18T23:00:40.029 DEBUG:teuthology.orchestra.run.smithi195:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-08-18T23:00:40.056 INFO:tasks.cephadm:Archiving crash dumps... 2024-08-18T23:00:40.058 DEBUG:teuthology.misc:Transferring archived files from smithi121:/var/lib/ceph/b003123a-5db1-11ef-bccf-c7b262605968/crash to /home/teuthworker/archive/teuthology-2024-08-18_21:24:02-fs-squid-distro-default-smithi/7859944/remote/smithi121/crash 2024-08-18T23:00:40.059 DEBUG:teuthology.orchestra.run.smithi121:> sudo tar c -f - -C /var/lib/ceph/b003123a-5db1-11ef-bccf-c7b262605968/crash -- . 2024-08-18T23:00:40.097 INFO:teuthology.orchestra.run.smithi121.stderr:tar: /var/lib/ceph/b003123a-5db1-11ef-bccf-c7b262605968/crash: Cannot open: No such file or directory 2024-08-18T23:00:40.098 INFO:teuthology.orchestra.run.smithi121.stderr:tar: Error is not recoverable: exiting now 2024-08-18T23:00:40.100 DEBUG:teuthology.misc:Transferring archived files from smithi195:/var/lib/ceph/b003123a-5db1-11ef-bccf-c7b262605968/crash to /home/teuthworker/archive/teuthology-2024-08-18_21:24:02-fs-squid-distro-default-smithi/7859944/remote/smithi195/crash 2024-08-18T23:00:40.101 DEBUG:teuthology.orchestra.run.smithi195:> sudo tar c -f - -C /var/lib/ceph/b003123a-5db1-11ef-bccf-c7b262605968/crash -- . 2024-08-18T23:00:40.124 INFO:teuthology.orchestra.run.smithi195.stderr:tar: /var/lib/ceph/b003123a-5db1-11ef-bccf-c7b262605968/crash: Cannot open: No such file or directory 2024-08-18T23:00:40.124 INFO:teuthology.orchestra.run.smithi195.stderr:tar: Error is not recoverable: exiting now 2024-08-18T23:00:40.126 INFO:tasks.cephadm:Checking cluster log for badness... 2024-08-18T23:00:40.126 DEBUG:teuthology.orchestra.run.smithi121:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/b003123a-5db1-11ef-bccf-c7b262605968/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v OSD_DOWN | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v MON_DOWN | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | head -n 1 2024-08-18T23:00:40.179 INFO:teuthology.orchestra.run.smithi121.stdout:2024-08-18T22:44:30.286047+0000 mds.cephfs.smithi121.gbickb (mds.0) 1 : cluster [WRN] 3 slow requests, 3 included below; oldest blocked for > 181.866976 secs 2024-08-18T23:00:40.179 WARNING:tasks.cephadm:Found errors (ERR|WRN|SEC) in cluster log 2024-08-18T23:00:40.179 INFO:tasks.cephadm:Compressing logs... 2024-08-18T23:00:40.179 DEBUG:teuthology.orchestra.run.smithi121:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-08-18T23:00:40.222 DEBUG:teuthology.orchestra.run.smithi195:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-08-18T23:00:40.245 INFO:teuthology.orchestra.run.smithi121.stderr:find: gzip‘/var/log/rbd-target-api’ -5 --verbose -- /var/log/ceph/b003123a-5db1-11ef-bccf-c7b262605968/ceph-mds.cephfs.smithi121.gbickb.log 2024-08-18T23:00:40.246 INFO:teuthology.orchestra.run.smithi121.stderr:: No such file or directory 2024-08-18T23:00:40.246 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/b003123a-5db1-11ef-bccf-c7b262605968/ceph-volume.log 2024-08-18T23:00:40.246 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/b003123a-5db1-11ef-bccf-c7b262605968/ceph-osd.2.log 2024-08-18T23:00:40.250 INFO:teuthology.orchestra.run.smithi195.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/b003123a-5db1-11ef-bccf-c7b262605968/ceph-volume.log 2024-08-18T23:00:40.250 INFO:teuthology.orchestra.run.smithi195.stderr:: No such file or directory 2024-08-18T23:00:40.250 INFO:teuthology.orchestra.run.smithi195.stderr:gzip -5 --verbose -- /var/log/ceph/b003123a-5db1-11ef-bccf-c7b262605968/ceph-mon.smithi195.log 2024-08-18T23:00:40.250 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/b003123a-5db1-11ef-bccf-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/b003123a-5db1-11ef-bccf-c7b262605968/ceph-osd.3.log 2024-08-18T23:00:40.250 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/b003123a-5db1-11ef-bccf-c7b262605968/ceph-mon.smithi195.log: gzip -5 --verbose -- /var/log/ceph/b003123a-5db1-11ef-bccf-c7b262605968/ceph-mds.cephfs.smithi195.nptgyc.log 2024-08-18T23:00:40.250 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/b003123a-5db1-11ef-bccf-c7b262605968/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/b003123a-5db1-11ef-bccf-c7b262605968/ceph-mds.cephfs.smithi195.buqvbr.log 2024-08-18T23:00:40.250 INFO:teuthology.orchestra.run.smithi195.stderr:gzip -5 --verbose -- /var/log/ceph/b003123a-5db1-11ef-bccf-c7b262605968/ceph.cephadm.log 2024-08-18T23:00:40.250 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/b003123a-5db1-11ef-bccf-c7b262605968/ceph-mds.cephfs.smithi195.nptgyc.log: /var/log/ceph/b003123a-5db1-11ef-bccf-c7b262605968/ceph-mds.cephfs.smithi195.buqvbr.log: gzip -5 --verbose -- /var/log/ceph/b003123a-5db1-11ef-bccf-c7b262605968/ceph.audit.log 2024-08-18T23:00:40.251 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/b003123a-5db1-11ef-bccf-c7b262605968/ceph-mds.cephfs.smithi121.gbickb.log: /var/log/ceph/b003123a-5db1-11ef-bccf-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/b003123a-5db1-11ef-bccf-c7b262605968/ceph.cephadm.log 2024-08-18T23:00:40.252 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/b003123a-5db1-11ef-bccf-c7b262605968/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/b003123a-5db1-11ef-bccf-c7b262605968/ceph.audit.log 2024-08-18T23:00:40.252 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/b003123a-5db1-11ef-bccf-c7b262605968/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/b003123a-5db1-11ef-bccf-c7b262605968/ceph-mds.cephfs.smithi121.xuzsdg.log 2024-08-18T23:00:40.252 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/b003123a-5db1-11ef-bccf-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/b003123a-5db1-11ef-bccf-c7b262605968/ceph-osd.0.log 2024-08-18T23:00:40.252 INFO:teuthology.orchestra.run.smithi121.stderr: 86.4%/var/log/ceph/b003123a-5db1-11ef-bccf-c7b262605968/ceph-mds.cephfs.smithi121.xuzsdg.log: -- replaced with /var/log/ceph/b003123a-5db1-11ef-bccf-c7b262605968/ceph.cephadm.log.gz 2024-08-18T23:00:40.252 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/b003123a-5db1-11ef-bccf-c7b262605968/ceph-mon.smithi121.log 2024-08-18T23:00:40.252 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/b003123a-5db1-11ef-bccf-c7b262605968/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/b003123a-5db1-11ef-bccf-c7b262605968/ceph-osd.1.log 2024-08-18T23:00:40.252 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/b003123a-5db1-11ef-bccf-c7b262605968/ceph-mon.smithi121.log: gzip -5 --verbose -- /var/log/ceph/b003123a-5db1-11ef-bccf-c7b262605968/ceph.log 2024-08-18T23:00:40.253 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/b003123a-5db1-11ef-bccf-c7b262605968/ceph-osd.1.log: 91.3% -- replaced with /var/log/ceph/b003123a-5db1-11ef-bccf-c7b262605968/ceph.audit.log.gz 2024-08-18T23:00:40.253 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/b003123a-5db1-11ef-bccf-c7b262605968/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/b003123a-5db1-11ef-bccf-c7b262605968/ceph-osd.4.log 2024-08-18T23:00:40.253 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/b003123a-5db1-11ef-bccf-c7b262605968/ceph.audit.log: /var/log/ceph/b003123a-5db1-11ef-bccf-c7b262605968/ceph-osd.4.log: 85.3% -- replaced with /var/log/ceph/b003123a-5db1-11ef-bccf-c7b262605968/ceph.cephadm.log.gz 2024-08-18T23:00:40.253 INFO:teuthology.orchestra.run.smithi195.stderr:gzip -5 --verbose -- /var/log/ceph/b003123a-5db1-11ef-bccf-c7b262605968/ceph-osd.5.log 2024-08-18T23:00:40.253 INFO:teuthology.orchestra.run.smithi195.stderr:gzip -5 --verbose -- /var/log/ceph/b003123a-5db1-11ef-bccf-c7b262605968/ceph.log 2024-08-18T23:00:40.254 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/b003123a-5db1-11ef-bccf-c7b262605968/ceph-osd.5.log: 91.5% -- replaced with /var/log/ceph/b003123a-5db1-11ef-bccf-c7b262605968/ceph.audit.log.gz 2024-08-18T23:00:40.262 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/b003123a-5db1-11ef-bccf-c7b262605968/ceph-mgr.smithi121.lopxqc.log 2024-08-18T23:00:40.264 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/b003123a-5db1-11ef-bccf-c7b262605968/ceph.log: 91.2% -- replaced with /var/log/ceph/b003123a-5db1-11ef-bccf-c7b262605968/ceph-volume.log.gz 2024-08-18T23:00:40.265 INFO:teuthology.orchestra.run.smithi121.stderr: 87.8% -- replaced with /var/log/ceph/b003123a-5db1-11ef-bccf-c7b262605968/ceph.log.gz 2024-08-18T23:00:40.265 INFO:teuthology.orchestra.run.smithi195.stderr:gzip -5 --verbose -- /var/log/ceph/b003123a-5db1-11ef-bccf-c7b262605968/ceph-mgr.smithi195.acttsj.log 2024-08-18T23:00:40.267 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/b003123a-5db1-11ef-bccf-c7b262605968/ceph.log: 91.1% -- replaced with /var/log/ceph/b003123a-5db1-11ef-bccf-c7b262605968/ceph-volume.log.gz 2024-08-18T23:00:40.268 INFO:teuthology.orchestra.run.smithi195.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-08-18T23:00:40.269 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/b003123a-5db1-11ef-bccf-c7b262605968/ceph-mgr.smithi195.acttsj.log: 87.8% -- replaced with /var/log/ceph/b003123a-5db1-11ef-bccf-c7b262605968/ceph.log.gz 2024-08-18T23:00:40.275 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-08-18T23:00:40.276 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/b003123a-5db1-11ef-bccf-c7b262605968/ceph-mgr.smithi121.lopxqc.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.log 2024-08-18T23:00:40.282 INFO:teuthology.orchestra.run.smithi195.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.log 2024-08-18T23:00:40.284 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/cephadm.log: 92.2% -- replaced with /var/log/ceph/cephadm.log.gz 2024-08-18T23:00:40.335 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/cephadm.log: /var/log/ceph/ceph-client.0.log: 92.0% -- replaced with /var/log/ceph/cephadm.log.gz 2024-08-18T23:00:40.338 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-client.1.log: 89.9% -- replaced with /var/log/ceph/b003123a-5db1-11ef-bccf-c7b262605968/ceph-mgr.smithi195.acttsj.log.gz 2024-08-18T23:00:40.673 INFO:teuthology.orchestra.run.smithi121.stderr: 89.0% -- replaced with /var/log/ceph/b003123a-5db1-11ef-bccf-c7b262605968/ceph-mgr.smithi121.lopxqc.log.gz 2024-08-18T23:00:40.700 INFO:teuthology.orchestra.run.smithi195.stderr: 92.5% -- replaced with /var/log/ceph/b003123a-5db1-11ef-bccf-c7b262605968/ceph-mon.smithi195.log.gz 2024-08-18T23:00:41.470 INFO:teuthology.orchestra.run.smithi121.stderr: 90.5% -- replaced with /var/log/ceph/b003123a-5db1-11ef-bccf-c7b262605968/ceph-mon.smithi121.log.gz 2024-08-18T23:00:45.729 INFO:teuthology.orchestra.run.smithi195.stderr: 93.6% -- replaced with /var/log/ceph/b003123a-5db1-11ef-bccf-c7b262605968/ceph-osd.5.log.gz 2024-08-18T23:00:46.155 INFO:teuthology.orchestra.run.smithi121.stderr: 93.4% -- replaced with /var/log/ceph/b003123a-5db1-11ef-bccf-c7b262605968/ceph-osd.2.log.gz 2024-08-18T23:00:46.546 INFO:teuthology.orchestra.run.smithi195.stderr: 93.4% -- replaced with /var/log/ceph/b003123a-5db1-11ef-bccf-c7b262605968/ceph-osd.4.log.gz 2024-08-18T23:00:47.302 INFO:teuthology.orchestra.run.smithi121.stderr: 93.5% -- replaced with /var/log/ceph/b003123a-5db1-11ef-bccf-c7b262605968/ceph-osd.0.log.gz 2024-08-18T23:00:47.340 INFO:teuthology.orchestra.run.smithi121.stderr: 93.5% -- replaced with /var/log/ceph/b003123a-5db1-11ef-bccf-c7b262605968/ceph-osd.1.log.gz 2024-08-18T23:00:48.025 INFO:teuthology.orchestra.run.smithi195.stderr: 93.6% -- replaced with /var/log/ceph/b003123a-5db1-11ef-bccf-c7b262605968/ceph-osd.3.log.gz 2024-08-18T23:00:55.313 INFO:teuthology.orchestra.run.smithi195.stderr: 94.0% -- replaced with /var/log/ceph/b003123a-5db1-11ef-bccf-c7b262605968/ceph-mds.cephfs.smithi195.nptgyc.log.gz 2024-08-18T23:00:55.592 INFO:teuthology.orchestra.run.smithi121.stderr: 93.2% -- replaced with /var/log/ceph/ceph-client.0.log.gz 2024-08-18T23:00:56.435 INFO:teuthology.orchestra.run.smithi195.stderr:gzip: /var/log/ceph/ceph-client.1.log: file size changed while zipping 2024-08-18T23:00:56.435 INFO:teuthology.orchestra.run.smithi195.stderr: 93.2% -- replaced with /var/log/ceph/ceph-client.1.log.gz 2024-08-18T23:00:57.256 INFO:teuthology.orchestra.run.smithi121.stderr: 93.9% -- replaced with /var/log/ceph/b003123a-5db1-11ef-bccf-c7b262605968/ceph-mds.cephfs.smithi121.xuzsdg.log.gz 2024-08-18T23:01:13.618 INFO:teuthology.orchestra.run.smithi121.stderr: 93.0% -- replaced with /var/log/ceph/b003123a-5db1-11ef-bccf-c7b262605968/ceph-mds.cephfs.smithi121.gbickb.log.gz 2024-08-18T23:01:13.620 INFO:teuthology.orchestra.run.smithi121.stderr: 2024-08-18T23:01:13.620 INFO:teuthology.orchestra.run.smithi121.stderr:real 0m33.385s 2024-08-18T23:01:13.620 INFO:teuthology.orchestra.run.smithi121.stderr:user 1m24.513s 2024-08-18T23:01:13.620 INFO:teuthology.orchestra.run.smithi121.stderr:sys 0m2.723s 2024-08-18T23:01:14.608 INFO:teuthology.orchestra.run.smithi195.stderr: 93.4% -- replaced with /var/log/ceph/b003123a-5db1-11ef-bccf-c7b262605968/ceph-mds.cephfs.smithi195.buqvbr.log.gz 2024-08-18T23:01:14.610 INFO:teuthology.orchestra.run.smithi195.stderr: 2024-08-18T23:01:14.610 INFO:teuthology.orchestra.run.smithi195.stderr:real 0m34.374s 2024-08-18T23:01:14.610 INFO:teuthology.orchestra.run.smithi195.stderr:user 1m22.925s 2024-08-18T23:01:14.610 INFO:teuthology.orchestra.run.smithi195.stderr:sys 0m2.503s 2024-08-18T23:01:14.610 INFO:tasks.cephadm:Archiving logs... 2024-08-18T23:01:14.611 DEBUG:teuthology.misc:Transferring archived files from smithi121:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-08-18_21:24:02-fs-squid-distro-default-smithi/7859944/remote/smithi121/log 2024-08-18T23:01:14.612 DEBUG:teuthology.orchestra.run.smithi121:> sudo tar c -f - -C /var/log/ceph -- . 2024-08-18T23:01:25.547 DEBUG:teuthology.misc:Transferring archived files from smithi195:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-08-18_21:24:02-fs-squid-distro-default-smithi/7859944/remote/smithi195/log 2024-08-18T23:01:25.548 DEBUG:teuthology.orchestra.run.smithi195:> sudo tar c -f - -C /var/log/ceph -- . 2024-08-18T23:01:36.536 INFO:tasks.cephadm:Removing cluster... 2024-08-18T23:01:36.536 DEBUG:teuthology.orchestra.run.smithi121:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid b003123a-5db1-11ef-bccf-c7b262605968 --force 2024-08-18T23:01:37.087 DEBUG:teuthology.orchestra.run.smithi195:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid b003123a-5db1-11ef-bccf-c7b262605968 --force 2024-08-18T23:01:37.635 INFO:tasks.cephadm:Removing cephadm ... 2024-08-18T23:01:37.636 DEBUG:teuthology.orchestra.run.smithi121:> rm -rf /home/ubuntu/cephtest/cephadm 2024-08-18T23:01:37.653 DEBUG:teuthology.orchestra.run.smithi195:> rm -rf /home/ubuntu/cephtest/cephadm 2024-08-18T23:01:37.668 INFO:tasks.cephadm:Teardown complete 2024-08-18T23:01:37.668 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-08-18T23:01:37.681 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/task/install/__init__.py", line 641, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/run_tasks.py", line 160, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.10/contextlib.py", line 142, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph_78215f5a1cf5eaf321d506a66539942e12851f34/qa/tasks/ceph_fuse.py", line 248, in task mount.umount_wait() File "/home/teuthworker/src/git.ceph.com_ceph_78215f5a1cf5eaf321d506a66539942e12851f34/qa/tasks/cephfs/fuse_mount.py", line 403, in umount_wait run.wait([self.fuse_daemon], timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/orchestra/run.py", line 473, in wait check_time() File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/contextutil.py", line 134, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: reached maximum tries (50) after waiting for 300 seconds 2024-08-18T23:01:37.682 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-08-18T23:01:37.682 DEBUG:teuthology.orchestra.run.smithi121:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-08-18T23:01:37.696 DEBUG:teuthology.orchestra.run.smithi195:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-08-18T23:01:37.780 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-08-18T23:01:37.790 INFO:teuthology.task.clock:Checking final clock skew... 2024-08-18T23:01:37.791 DEBUG:teuthology.orchestra.run.smithi121:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-08-18T23:01:37.793 DEBUG:teuthology.orchestra.run.smithi195:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-08-18T23:01:37.805 INFO:teuthology.orchestra.run.smithi121.stderr:bash: line 1: ntpq: command not found 2024-08-18T23:01:37.807 INFO:teuthology.orchestra.run.smithi195.stderr:bash: line 1: ntpq: command not found 2024-08-18T23:01:37.810 INFO:teuthology.orchestra.run.smithi121.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-08-18T23:01:37.810 INFO:teuthology.orchestra.run.smithi121.stdout:=============================================================================== 2024-08-18T23:01:37.810 INFO:teuthology.orchestra.run.smithi121.stdout:^* hv01.front.sepia.ceph.com 3 7 377 20 +491us[ +550us] +/- 51ms 2024-08-18T23:01:37.811 INFO:teuthology.orchestra.run.smithi121.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 18 -791us[ -791us] +/- 71ms 2024-08-18T23:01:37.811 INFO:teuthology.orchestra.run.smithi121.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 19 +57us[ +57us] +/- 75ms 2024-08-18T23:01:37.811 INFO:teuthology.orchestra.run.smithi121.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-08-18T23:01:37.813 INFO:teuthology.orchestra.run.smithi195.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-08-18T23:01:37.814 INFO:teuthology.orchestra.run.smithi195.stdout:=============================================================================== 2024-08-18T23:01:37.814 INFO:teuthology.orchestra.run.smithi195.stdout:^* hv01.front.sepia.ceph.com 3 6 377 18 +483us[ +485us] +/- 51ms 2024-08-18T23:01:37.814 INFO:teuthology.orchestra.run.smithi195.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 17 -769us[ -769us] +/- 71ms 2024-08-18T23:01:37.814 INFO:teuthology.orchestra.run.smithi195.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 18 +87us[ +90us] +/- 75ms 2024-08-18T23:01:37.814 INFO:teuthology.orchestra.run.smithi195.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-08-18T23:01:37.814 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-08-18T23:01:37.824 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-08-18T23:01:37.825 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-08-18T23:01:37.835 DEBUG:teuthology.orchestra.run.smithi121:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-08-18T23:01:37.920 DEBUG:teuthology.orchestra.run.smithi195:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-08-18T23:01:37.981 DEBUG:teuthology.orchestra.run.smithi121:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-08-18T23:01:38.008 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-18T23:01:38.009 DEBUG:teuthology.orchestra.run.smithi195:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-08-18T23:01:38.036 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-18T23:01:38.036 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-08-18T23:01:38.046 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-08-18T23:01:38.056 INFO:teuthology.task.internal:Duration was 2004.102131 seconds 2024-08-18T23:01:38.057 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-08-18T23:01:38.067 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-08-18T23:01:38.067 DEBUG:teuthology.orchestra.run.smithi121:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-08-18T23:01:38.070 DEBUG:teuthology.orchestra.run.smithi195:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-08-18T23:01:38.106 INFO:teuthology.orchestra.run.smithi121.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-08-18T23:01:38.115 INFO:teuthology.orchestra.run.smithi195.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-08-18T23:01:38.444 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-08-18T23:01:38.444 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi121.front.sepia.ceph.com 2024-08-18T23:01:38.444 DEBUG:teuthology.orchestra.run.smithi121:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-08-18T23:01:38.464 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi195.front.sepia.ceph.com 2024-08-18T23:01:38.464 DEBUG:teuthology.orchestra.run.smithi195:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-08-18T23:01:38.506 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-08-18T23:01:38.506 DEBUG:teuthology.orchestra.run.smithi121:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-08-18T23:01:38.509 DEBUG:teuthology.orchestra.run.smithi195:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-08-18T23:01:38.573 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-08-18T23:01:38.573 DEBUG:teuthology.orchestra.run.smithi121:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-08-18T23:01:38.575 DEBUG:teuthology.orchestra.run.smithi195:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-08-18T23:01:39.245 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-08-18T23:01:39.256 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-08-18T23:01:39.257 DEBUG:teuthology.orchestra.run.smithi121:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-08-18T23:01:39.282 DEBUG:teuthology.orchestra.run.smithi195:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-08-18T23:01:39.308 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-08-18T23:01:39.319 DEBUG:teuthology.orchestra.run.smithi121:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-08-18T23:01:39.324 DEBUG:teuthology.orchestra.run.smithi195:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-08-18T23:01:39.344 INFO:teuthology.orchestra.run.smithi121.stdout:kernel.core_pattern = core 2024-08-18T23:01:39.373 INFO:teuthology.orchestra.run.smithi195.stdout:kernel.core_pattern = core 2024-08-18T23:01:39.413 DEBUG:teuthology.orchestra.run.smithi121:> test -e /home/ubuntu/cephtest/archive/coredump 2024-08-18T23:01:39.428 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-18T23:01:39.429 DEBUG:teuthology.orchestra.run.smithi195:> test -e /home/ubuntu/cephtest/archive/coredump 2024-08-18T23:01:39.468 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-18T23:01:39.469 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-08-18T23:01:39.480 INFO:teuthology.task.internal:Transferring archived files... 2024-08-18T23:01:39.481 DEBUG:teuthology.misc:Transferring archived files from smithi121:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-08-18_21:24:02-fs-squid-distro-default-smithi/7859944/remote/smithi121 2024-08-18T23:01:39.482 DEBUG:teuthology.orchestra.run.smithi121:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-08-18T23:01:39.529 DEBUG:teuthology.misc:Transferring archived files from smithi195:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-08-18_21:24:02-fs-squid-distro-default-smithi/7859944/remote/smithi195 2024-08-18T23:01:39.529 DEBUG:teuthology.orchestra.run.smithi195:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-08-18T23:01:39.565 INFO:teuthology.task.internal:Removing archive directory... 2024-08-18T23:01:39.565 DEBUG:teuthology.orchestra.run.smithi121:> rm -rf -- /home/ubuntu/cephtest/archive 2024-08-18T23:01:39.567 DEBUG:teuthology.orchestra.run.smithi195:> rm -rf -- /home/ubuntu/cephtest/archive 2024-08-18T23:01:39.614 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-08-18T23:01:39.627 INFO:teuthology.task.internal:Not uploading archives. 2024-08-18T23:01:39.627 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-08-18T23:01:39.638 INFO:teuthology.task.internal:Tidying up after the test... 2024-08-18T23:01:39.638 DEBUG:teuthology.orchestra.run.smithi121:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-08-18T23:01:39.640 DEBUG:teuthology.orchestra.run.smithi195:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-08-18T23:01:39.653 INFO:teuthology.orchestra.run.smithi121.stdout: 262218 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Aug 18 23:01 /home/ubuntu/cephtest 2024-08-18T23:01:39.653 INFO:teuthology.orchestra.run.smithi121.stdout: 547855 4 d--------- 2 ubuntu ubuntu 4096 Aug 18 22:39 /home/ubuntu/cephtest/mnt.0 2024-08-18T23:01:39.654 INFO:teuthology.orchestra.run.smithi121.stderr:find: ‘/home/ubuntu/cephtest/mnt.0’: Permission denied 2024-08-18T23:01:39.654 INFO:teuthology.orchestra.run.smithi121.stderr:rmdir: failed to remove '/home/ubuntu/cephtest': Directory not empty 2024-08-18T23:01:39.657 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-18T23:01:39.657 ERROR:teuthology.run_tasks:Manager failed: internal.base Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/task/internal/__init__.py", line 48, in base yield File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/run_tasks.py", line 160, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.10/contextlib.py", line 142, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph_78215f5a1cf5eaf321d506a66539942e12851f34/qa/tasks/ceph_fuse.py", line 248, in task mount.umount_wait() File "/home/teuthworker/src/git.ceph.com_ceph_78215f5a1cf5eaf321d506a66539942e12851f34/qa/tasks/cephfs/fuse_mount.py", line 403, in umount_wait run.wait([self.fuse_daemon], timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/orchestra/run.py", line 473, in wait check_time() File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/contextutil.py", line 134, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: reached maximum tries (50) after waiting for 300 seconds During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/run_tasks.py", line 160, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.10/contextlib.py", line 153, in __exit__ self.gen.throw(typ, value, traceback) File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/task/internal/__init__.py", line 53, in base run.wait( File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi121 with status 1: 'find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest' 2024-08-18T23:01:39.658 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-08-18T23:01:39.669 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-08-18T23:01:39.681 DEBUG:teuthology.run_tasks:Exception was not quenched, exiting: MaxWhileTries: reached maximum tries (50) after waiting for 300 seconds 2024-08-18T23:01:39.684 INFO:teuthology.run:Summary data: description: fs/upgrade/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} duration: 2004.1021311283112 failure_reason: reached maximum tries (50) after waiting for 300 seconds flavor: default owner: scheduled_teuthology@teuthology status: fail success: false 2024-08-18T23:01:39.684 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-08-18T23:01:39.776 INFO:teuthology.run:FAIL